2023-07-20T08:35:27.977 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T08:35:27.978 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --owner scheduled_vshankar@teuthology --verbose --name vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461 -- /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/orig.config.yaml 2023-07-20T08:35:28.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T08:35:28.107 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461 branch: wip-vshankar-testing-20230720.042515 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: vshankar@redhat.com first_in_suite: false job_id: '7344461' kernel: client: branch: testing flavor: default kdb: true sha1: 8c15ad6dab84a191431785901a40e4f9fa32bda8 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20230720.042515 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230720.042515 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 632 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 sleep_before_teardown: 0 subset: 14/1024 suite: fs suite_branch: wip-vshankar-testing-20230720.042515 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIODH0sPfyutXLZWq/SXYQcdS80yOrImKWKlzMyK29SPS smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5kztsB4HHg4Sk4pRWO2OP/y1BTalgZzqg/o3iOpQIXlxidEhWS9y0FPHRRJGQDmsdbakH8Jzjn/HFnXugrUoc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-20_08:24:15 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-20T08:35:28.108 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa; will attempt to use it 2023-07-20T08:35:28.108 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa/tasks 2023-07-20T08:35:28.109 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-20T08:35:28.111 INFO:teuthology.task.internal:Checking packages... 2023-07-20T08:35:28.137 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e2c50893bf78471cc8ee960317cc10390300dfd5' 2023-07-20T08:35:28.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-20T08:35:28.138 INFO:teuthology.packaging:ref: None 2023-07-20T08:35:28.138 INFO:teuthology.packaging:tag: None 2023-07-20T08:35:28.138 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230720.042515 2023-07-20T08:35:28.139 INFO:teuthology.packaging:sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-20T08:35:28.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20230720.042515 2023-07-20T08:35:28.926 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5042-ge2c50893-1jammy 2023-07-20T08:35:28.927 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-20T08:35:28.934 INFO:teuthology.task.internal:no buildpackages task found 2023-07-20T08:35:28.935 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-20T08:35:29.023 INFO:teuthology.task.internal:Saving configuration 2023-07-20T08:35:29.039 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-20T08:35:29.110 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T08:35:29.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:32.659460', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIODH0sPfyutXLZWq/SXYQcdS80yOrImKWKlzMyK29SPS'} 2023-07-20T08:35:29.167 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:32.657426', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAxlb8y6BxSMUJgkeJT0tkql8zkeYqfkueqlTu17WcCR'} 2023-07-20T08:35:29.167 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-20T08:35:29.176 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-20T08:35:29.176 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-20T08:35:29.176 INFO:teuthology.run_tasks:Running task console_log... 2023-07-20T08:35:29.300 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f970a34c0>, signals=[15]) 2023-07-20T08:35:29.302 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-20T08:35:29.309 INFO:teuthology.task.internal:Opening connections... 2023-07-20T08:35:29.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T08:35:29.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T08:35:29.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T08:35:29.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T08:35:29.467 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-20T08:35:29.475 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2023-07-20T08:35:29.481 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2023-07-20T08:35:29.481 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2023-07-20T08:35:29.530 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Ubuntu" 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="22.04" 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_CODENAME=jammy 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:ID=ubuntu 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE=debian 2023-07-20T08:35:29.531 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T08:35:29.532 INFO:teuthology.orchestra.run.smithi082.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T08:35:29.532 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T08:35:29.532 INFO:teuthology.orchestra.run.smithi082.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T08:35:29.532 INFO:teuthology.orchestra.run.smithi082.stdout:UBUNTU_CODENAME=jammy 2023-07-20T08:35:29.533 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-07-20T08:35:29.556 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-07-20T08:35:29.561 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-07-20T08:35:29.561 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-07-20T08:35:29.607 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-20T08:35:29.607 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04" 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-07-20T08:35:29.608 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-20T08:35:29.609 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-20T08:35:29.609 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-20T08:35:29.609 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-20T08:35:29.609 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy 2023-07-20T08:35:29.609 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-07-20T08:35:29.631 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-20T08:35:29.642 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-20T08:35:29.696 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-20T08:35:29.696 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2023-07-20T08:35:29.698 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-07-20T08:35:29.702 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-20T08:35:29.735 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-20T08:35:29.736 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2023-07-20T08:35:29.744 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-07-20T08:35:29.838 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-20T08:35:29.903 INFO:teuthology.run_tasks:Running task kernel... 2023-07-20T08:35:29.928 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c15ad6dab84a191431785901a40e4f9fa32bda8'} 2023-07-20T08:35:29.929 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-20T08:35:29.929 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-20T08:35:29.929 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-20T08:35:29.930 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-20T08:35:29.935 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T08:35:29.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-20T08:35:29.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T08:35:29.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-20T08:35:30.602 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T08:35:30.602 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8c15ad6dab84a191431785901a40e4f9fa32bda8"... 2023-07-20T08:35:30.603 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-07-20T08:35:30.607 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T08:35:30.607 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8c15ad6dab84a191431785901a40e4f9fa32bda8"... 2023-07-20T08:35:30.607 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-07-20T08:35:30.608 INFO:teuthology.orchestra.run.smithi082.stdout:5.15.0-56-generic 2023-07-20T08:35:30.609 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T08:35:30.609 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-20T08:35:30.610 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-07-20T08:35:30.610 DEBUG:teuthology.orchestra.run.smithi082:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-20T08:35:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:5.15.0-56-generic 2023-07-20T08:35:30.615 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T08:35:30.615 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-20T08:35:30.616 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-07-20T08:35:30.616 DEBUG:teuthology.orchestra.run.smithi183:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-20T08:35:30.660 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-20T08:35:30.673 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-20T08:35:30.798 INFO:teuthology.orchestra.run.smithi082.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-20T08:35:30.798 INFO:teuthology.orchestra.run.smithi082.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-20T08:35:30.798 INFO:teuthology.orchestra.run.smithi082.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-20T08:35:30.798 INFO:teuthology.orchestra.run.smithi082.stderr:hint: 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: git config --global init.defaultBranch 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: 2023-07-20T08:35:30.799 INFO:teuthology.orchestra.run.smithi082.stderr:hint: git branch -m 2023-07-20T08:35:30.800 INFO:teuthology.orchestra.run.smithi082.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-20T08:35:30.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-20T08:35:30.814 INFO:teuthology.orchestra.run.smithi183.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: git config --global init.defaultBranch 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-20T08:35:30.815 INFO:teuthology.orchestra.run.smithi183.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-20T08:35:30.816 INFO:teuthology.orchestra.run.smithi183.stderr:hint: 2023-07-20T08:35:30.816 INFO:teuthology.orchestra.run.smithi183.stderr:hint: git branch -m 2023-07-20T08:35:30.816 INFO:teuthology.orchestra.run.smithi183.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-20T08:35:30.818 DEBUG:teuthology.orchestra.run.smithi183:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-20T08:35:30.868 DEBUG:teuthology.orchestra.run.smithi082:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-20T08:35:30.882 DEBUG:teuthology.orchestra.run.smithi183:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-20T08:35:30.924 DEBUG:teuthology.orchestra.run.smithi082:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-20T08:35:30.935 DEBUG:teuthology.orchestra.run.smithi183:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-20T09:32:29.879 INFO:teuthology.orchestra.run.smithi183.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-20T09:32:29.879 INFO:teuthology.orchestra.run.smithi183.stderr: * [new branch] main -> origin/main 2023-07-20T09:32:29.906 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190312 -> 20190312 2023-07-20T09:32:29.907 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190416 -> 20190416 2023-07-20T09:32:29.907 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190514 -> 20190514 2023-07-20T09:32:29.907 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190618 -> 20190618 2023-07-20T09:32:29.907 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190717 -> 20190717 2023-07-20T09:32:29.908 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190815 -> 20190815 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20190923 -> 20190923 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20191022 -> 20191022 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20191215 -> 20191215 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200122 -> 20200122 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200316 -> 20200316 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200421 -> 20200421 2023-07-20T09:32:29.909 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200519 -> 20200519 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200619 -> 20200619 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200721 -> 20200721 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200817 -> 20200817 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20200918 -> 20200918 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20201022 -> 20201022 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20201118 -> 20201118 2023-07-20T09:32:29.910 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20201218 -> 20201218 2023-07-20T09:32:29.911 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210208 -> 20210208 2023-07-20T09:32:29.912 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210315 -> 20210315 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210511 -> 20210511 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210716 -> 20210716 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210818 -> 20210818 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20210919 -> 20210919 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20211027 -> 20211027 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20211216 -> 20211216 2023-07-20T09:32:29.913 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220209 -> 20220209 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220310 -> 20220310 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220411 -> 20220411 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220509 -> 20220509 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220610 -> 20220610 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220708 -> 20220708 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220815 -> 20220815 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20220913 -> 20220913 2023-07-20T09:32:29.914 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20221012 -> 20221012 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20221109 -> 20221109 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20221214 -> 20221214 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230117 -> 20230117 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230210 -> 20230210 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230310 -> 20230310 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230404 -> 20230404 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230515 -> 20230515 2023-07-20T09:32:29.915 INFO:teuthology.orchestra.run.smithi183.stderr: * [new tag] 20230625 -> 20230625 2023-07-20T09:32:33.157 INFO:teuthology.orchestra.run.smithi183.stderr:Updating files: 50% (1505/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1955/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2448/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-20T09:32:33.161 INFO:teuthology.orchestra.run.smithi183.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-20T09:32:33.180 INFO:teuthology.task.kernel:Downloading kernel 8c15ad6dab84a191431785901a40e4f9fa32bda8 on client.1... 2023-07-20T09:32:33.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T09:32:33.504 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:32:33.505 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-g8c15ad6dab84_6.5.0-rc1-g8c15ad6dab84-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/ --input-file=- 2023-07-20T09:32:33.508 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi183.front.sepia.ceph.com to complete... 2023-07-20T09:33:14.790 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20 09:33:14 URL:https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/linux-image-6.5.0-rc1-g8c15ad6dab84_6.5.0-rc1-g8c15ad6dab84-1_amd64.deb [38848240/38848240] -> "/tmp/linux-image.deb" [1] 2023-07-20T09:33:14.791 INFO:teuthology.orchestra.run.smithi183.stderr:FINISHED --2023-07-20 09:33:14-- 2023-07-20T09:33:14.791 INFO:teuthology.orchestra.run.smithi183.stderr:Total wall clock time: 41s 2023-07-20T09:33:14.791 INFO:teuthology.orchestra.run.smithi183.stderr:Downloaded: 1 files, 37M in 41s (930 KB/s) 2023-07-20T09:33:14.793 INFO:teuthology.task.kernel:Installing kernel 8c15ad6dab84a191431785901a40e4f9fa32bda8 on client.1... 2023-07-20T09:33:14.794 DEBUG:teuthology.orchestra.run.smithi183:> sudo dpkg -i /tmp/linux-image.deb 2023-07-20T09:33:15.052 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-g8c15ad6dab84. 2023-07-20T09:33:17.053 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-20T09:33:17.057 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-20T09:33:17.399 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking linux-image-6.5.0-rc1-g8c15ad6dab84 (6.5.0-rc1-g8c15ad6dab84-1) ... 2023-07-20T09:33:20.735 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up linux-image-6.5.0-rc1-g8c15ad6dab84 (6.5.0-rc1-g8c15ad6dab84-1) ... 2023-07-20T09:33:20.829 INFO:teuthology.orchestra.run.smithi183.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:29.059 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub' 2023-07-20T09:33:29.066 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-20T09:33:29.086 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-07-20T09:33:29.415 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:29.432 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:29.777 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-20T09:33:29.784 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-20T09:33:29.850 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-20T09:33:29.857 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-20T09:33:30.014 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-20T09:33:30.014 INFO:teuthology.orchestra.run.smithi183.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-20T09:33:30.014 INFO:teuthology.orchestra.run.smithi183.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-20T09:33:30.075 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-07-20T09:33:30.233 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-deb -c /tmp/linux-image.deb 2023-07-20T09:33:30.241 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./ 2023-07-20T09:33:30.241 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./boot/ 2023-07-20T09:33:30.242 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 4380308 2023-07-20 06:00 ./boot/System.map-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.253 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 168433 2023-07-20 06:00 ./boot/config-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.254 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11280128 2023-07-20 06:00 ./boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.272 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/postinst.d/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/postrm.d/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/preinst.d/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/prerm.d/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/ 2023-07-20T09:33:30.273 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/ 2023-07-20T09:33:30.274 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 490385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 93113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 106729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-20T09:33:30.275 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 152241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-20T09:33:30.277 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-20T09:33:30.277 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-20T09:33:30.277 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 83889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-20T09:33:30.277 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-20T09:33:30.277 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 58585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-20T09:33:30.278 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/ 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/ 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/mce/ 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpuid.ko 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/msr.ko 2023-07-20T09:33:30.279 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/ 2023-07-20T09:33:30.280 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 348417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-20T09:33:30.280 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 972641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-20T09:33:30.280 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 2273145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm.ko 2023-07-20T09:33:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ 2023-07-20T09:33:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/af_alg.ko 2023-07-20T09:33:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/algif_hash.ko 2023-07-20T09:33:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/algif_skcipher.ko 2023-07-20T09:33:30.289 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ansi_cprng.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/anubis.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/arc4.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/asymmetric_keys/ 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/ 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_memcpy.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_pq.ko 2023-07-20T09:33:30.290 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_tx.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_xor.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/raid6test.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/authenc.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/authencesn.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blake2b_generic.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blowfish_common.ko 2023-07-20T09:33:30.291 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blowfish_generic.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/camellia_generic.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast5_generic.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast6_generic.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast_common.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ccm.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cmac.ko 2023-07-20T09:33:30.292 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crc32_generic.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cryptd.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_engine.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_simd.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_user.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cts.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/des_generic.ko 2023-07-20T09:33:30.293 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/dh_generic.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/echainiv.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/essiv.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/fcrypt.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/khazad.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lrw.ko 2023-07-20T09:33:30.294 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lz4.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lz4hc.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/md4.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/michael_mic.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/pcbc.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/pcrypt.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/rmd160.ko 2023-07-20T09:33:30.295 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/seed.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/serpent_generic.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 149193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/tcrypt.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/tea.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/twofish_common.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/twofish_generic.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/vmac.ko 2023-07-20T09:33:30.296 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/wp512.ko 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xcbc.ko 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xor.ko 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xts.ko 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xxhash_generic.ko 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ 2023-07-20T09:33:30.297 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/ 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_extlog.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_pad.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/apei/ 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/apei/einj.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/ec_sys.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/platform_profile.ko 2023-07-20T09:33:30.298 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/sbs.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/sbshc.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/video.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/acard-ahci.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 88625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ahci.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ahci_platform.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 87841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/libahci.ko 2023-07-20T09:33:30.299 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/libahci_platform.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_acpi.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ali.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_amd.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_artop.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_atiixp.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_atp867x.ko 2023-07-20T09:33:30.300 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cmd640.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cmd64x.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cypress.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_efar.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt366.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt37x.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-20T09:33:30.301 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_it8213.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_it821x.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_jmicron.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_legacy.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_marvell.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_mpiix.ko 2023-07-20T09:33:30.302 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_netcell.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ninja32.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ns87410.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ns87415.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_oldpiix.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_opti.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_optidma.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pcmcia.ko 2023-07-20T09:33:30.303 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_piccolo.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_radisys.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_rdc.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_rz1000.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sch.ko 2023-07-20T09:33:30.304 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_serverworks.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sil680.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sl82c105.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_triflex.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_via.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pdc_adma.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_inic162x.ko 2023-07-20T09:33:30.305 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 83225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_mv.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_nv.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_promise.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_qstor.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sil.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sil24.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sis.ko 2023-07-20T09:33:30.306 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_svw.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sx4.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_uli.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_via.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_vsc.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/auxdisplay/ 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/auxdisplay/ks0108.ko 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/bcma/ 2023-07-20T09:33:30.307 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 124457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/bcma/bcma.ko 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/ 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/aoe/ 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 113705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/aoe/aoe.ko 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/drbd/ 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 968433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/drbd/drbd.ko 2023-07-20T09:33:30.308 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 173201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/floppy.ko 2023-07-20T09:33:30.349 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/mtip32xx/ 2023-07-20T09:33:30.349 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 94297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-20T09:33:30.349 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 115345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/nbd.ko 2023-07-20T09:33:30.349 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/null_blk/ 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 110361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/null_blk/null_blk.ko 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 98225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/pktcdvd.ko 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 257529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/rbd.ko 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/xen-blkback/ 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 98129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/zram/ 2023-07-20T09:33:30.350 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/zram/zram.ko 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/applicom.ko 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hangcheck-timer.ko 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/ 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-20T09:33:30.351 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/via-rng.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 150665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-20T09:33:30.352 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 139057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/lp.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/mwave/ 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 84121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/mwave/mwave.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/nvram.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ppdev.ko 2023-07-20T09:33:30.353 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tlclk.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/ 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-20T09:33:30.354 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/ 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/ 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-palmas.ko 2023-07-20T09:33:30.355 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-si5351.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-twl6040.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-wm831x.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/ 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-20T09:33:30.356 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 234473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ccp.ko 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/ 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/ 2023-07-20T09:33:30.357 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 408489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/padlock-aes.ko 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/padlock-sha.ko 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/virtio/ 2023-07-20T09:33:30.358 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dca/ 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dca/dca.ko 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/dw/ 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ioat/ 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 122641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-20T09:33:30.359 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/ 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/amd64_edac.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/e752x_edac.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/edac_mce_amd.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i3000_edac.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i3200_edac.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i5100_edac.ko 2023-07-20T09:33:30.360 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i5400_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i7300_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i7core_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i82975x_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/ie31200_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/sb_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/x38_edac.ko 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/ 2023-07-20T09:33:30.361 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-gpio.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max14577.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max77693.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max8997.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-palmas.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/ 2023-07-20T09:33:30.362 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/efi/ 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/ 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-arizona.ko 2023-07-20T09:33:30.363 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-da9052.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-da9055.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-dln2.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 77849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-generic.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-ich.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-20T09:33:30.364 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-kempld.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max7300.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max730x.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max732x.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-20T09:33:30.365 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-sch.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-20T09:33:30.366 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-vx855.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/ 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-a4tech.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-apple.ko 2023-07-20T09:33:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-appleir.ko 2023-07-20T09:33:30.368 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-aureal.ko 2023-07-20T09:33:30.368 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-axff.ko 2023-07-20T09:33:30.368 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-belkin.ko 2023-07-20T09:33:30.368 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cherry.ko 2023-07-20T09:33:30.369 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-chicony.ko 2023-07-20T09:33:30.369 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cp2112.ko 2023-07-20T09:33:30.369 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cypress.ko 2023-07-20T09:33:30.369 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-dr.ko 2023-07-20T09:33:30.369 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-elecom.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-elo.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-emsff.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ezkey.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gaff.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-generic.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gt683r.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gyration.ko 2023-07-20T09:33:30.370 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtekff.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-hyperv.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-icade.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-kensington.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-keytouch.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-kye.ko 2023-07-20T09:33:30.371 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lcpower.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-led.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lenovo.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lg-g15.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech.ko 2023-07-20T09:33:30.372 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-magicmouse.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-microsoft.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-monterey.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-multitouch.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ntrig.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ortek.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-penmount.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-petalynx.ko 2023-07-20T09:33:30.373 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 72937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-picolcd.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-pl.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-plantronics.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-primax.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-rmi.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-common.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-20T09:33:30.374 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-20T09:33:30.375 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-saitek.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-samsung.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sjoy.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sony.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-speedlink.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-steelseries.ko 2023-07-20T09:33:30.376 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sunplus.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-tivo.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-tmff.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-topseed.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-twinhan.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-uclogic.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-waltop.ko 2023-07-20T09:33:30.377 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 143585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-wiimote.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-xinmo.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-zpff.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-zydacron.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 267713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/uhid.ko 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/ 2023-07-20T09:33:30.378 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 125721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 217401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/wacom.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/ 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_balloon.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_utils.ko 2023-07-20T09:33:30.379 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 301449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_vmbus.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/abituguru.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/abituguru3.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ad7414.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ad7418.ko 2023-07-20T09:33:30.380 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adc128d818.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1025.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 97977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1026.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1029.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1031.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm9240.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ads7828.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7410.ko 2023-07-20T09:33:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7411.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 74433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7462.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7470.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7475.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7x10.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/amc6821.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/applesmc.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asb100.ko 2023-07-20T09:33:30.382 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 58617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asc7621.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/atxp1.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/coretemp.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 99601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/dme1737.ko 2023-07-20T09:33:30.383 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ds1621.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ds620.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc1403.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc2103.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc6w201.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f71805f.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 94457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f71882fg.ko 2023-07-20T09:33:30.384 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f75375s.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/fam15h_power.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/fschmd.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/g760a.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/g762.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/gl518sm.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/gl520sm.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/hih6130.ko 2023-07-20T09:33:30.385 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/i5500_temp.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/i5k_amb.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ibmaem.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ibmpex.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ina209.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ina2xx.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 129217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/it87.ko 2023-07-20T09:33:30.386 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/jc42.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/k10temp.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/k8temp.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lineage-pem.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm63.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm73.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm75.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm77.ko 2023-07-20T09:33:30.387 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm78.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm80.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm83.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 72833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm85.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm87.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm90.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm92.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 108841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm93.ko 2023-07-20T09:33:30.388 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95234.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95241.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95245.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc2945.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4151.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4215.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4222.ko 2023-07-20T09:33:30.389 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4245.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4260.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4261.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max16065.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max1619.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max1668.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max197.ko 2023-07-20T09:33:30.390 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6639.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6650.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6697.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/mcp3021.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6683.ko 2023-07-20T09:33:30.391 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 116737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6775-core.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6775.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct7802.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 82337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pc87360.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pc87427.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pcf8591.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-20T09:33:30.392 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-20T09:33:30.393 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/powr1220.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch5627.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch5636.ko 2023-07-20T09:33:30.394 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sht15.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sht21.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/shtc1.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sis5595.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smm665.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47b397.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47m1.ko 2023-07-20T09:33:30.395 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47m192.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/thmc50.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp102.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp103.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp401.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp421.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/via-cputemp.ko 2023-07-20T09:33:30.396 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/via686a.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/vt1211.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/vt8231.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83627ehf.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83627hf.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83781d.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83791d.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83792d.ko 2023-07-20T09:33:30.397 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 101457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83793.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 119505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83795.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83l785ts.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83l786ng.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/ 2023-07-20T09:33:30.398 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/ 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/ 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-20T09:33:30.399 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-20T09:33:30.400 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-20T09:33:30.401 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-20T09:33:30.402 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-20T09:33:30.403 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-mux.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-smbus.ko 2023-07-20T09:33:30.404 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-stub.ko 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/ 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 273641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-20T09:33:30.405 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 876913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_core.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 324145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 97961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 279321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-20T09:33:30.406 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 492561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx4/ 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 419217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx5/ 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 739705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mthca/ 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 296649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-20T09:33:30.407 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 153681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/usnic/ 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 169017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 263177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/iser/ 2023-07-20T09:33:30.408 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/isert/ 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 111993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srp/ 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 129081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srpt/ 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 129553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/ 2023-07-20T09:33:30.409 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/evbug.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/ff-memless.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/ 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/gameport.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/lightning.ko 2023-07-20T09:33:30.410 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/ns558.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/joydev.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/ 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-20T09:33:30.411 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lm8323.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lm8333.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-20T09:33:30.412 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/qt1070.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/qt2160.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/stowaway.ko 2023-07-20T09:33:30.413 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/matrix-keymap.ko 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/ 2023-07-20T09:33:30.414 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/appletouch.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/bcm5974.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 123681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/cyapatp.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 335849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/psmouse.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/sermouse.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-20T09:33:30.415 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/rmi4/ 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 109849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/altera_ps2.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/arc_ps2.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ct82c710.ko 2023-07-20T09:33:30.416 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/parkbd.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/pcips2.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ps2mult.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/serio_raw.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/serport.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/sparse-keymap.ko 2023-07-20T09:33:30.417 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/ 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/amd/ 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/ 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-88pm860x.ko 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-adp5520.ko 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-bd2802.ko 2023-07-20T09:33:30.418 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-blinkm.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-da903x.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-da9052.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-gpio.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3530.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3533.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm355x.ko 2023-07-20T09:33:30.419 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3642.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lp3944.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lp8788.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-max8997.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-mc13783.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-20T09:33:30.420 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca9532.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca955x.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca963x.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-ss4200.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-tca6507.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-20T09:33:30.421 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-wm8350.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-20T09:33:30.422 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/ 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/bcache/ 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 655473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/bcache/bcache.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-bio-prison.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-bufio.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-cache-smq.ko 2023-07-20T09:33:30.423 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 155993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-cache.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 107049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-crypt.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-delay.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-era.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-flakey.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-log-userspace.ko 2023-07-20T09:33:30.424 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-log.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-mirror.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-multipath.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-queue-length.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-raid.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-region-hash.ko 2023-07-20T09:33:30.425 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-round-robin.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-service-time.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 109593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-snapshot.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-switch.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 181585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-thin-pool.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-verity.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-zero.ko 2023-07-20T09:33:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/faulty.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/linear.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/multipath.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/persistent-data/ 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 199937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid0.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 112609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid1.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 160553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid10.ko 2023-07-20T09:33:30.427 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 396153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid456.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/ 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/ 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 178113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptbase.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptctl.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptfc.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptlan.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 123305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptsas.ko 2023-07-20T09:33:30.428 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 79017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptscsih.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptspi.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/ 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm800.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm805.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm80x.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/arizona-i2c.ko 2023-07-20T09:33:30.429 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 123721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/arizona.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/bcm590xx.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/dln2.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/janz-cmodio.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/kempld-core.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lm3533-core.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-20T09:33:30.430 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lp3943.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lpc_ich.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lpc_sch.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/max8907.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-20T09:33:30.431 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/menf21bmc.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/retu-mfd.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/si476x-core.ko 2023-07-20T09:33:30.432 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/sm501.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/tps65010.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/tps6507x.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/viperboard.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/vx855.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/wl1273-core.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/wm8994.ko 2023-07-20T09:33:30.433 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ad525x_dpot.ko 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/altera-stapl/ 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/apds9802als.ko 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/apds990x.ko 2023-07-20T09:33:30.434 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/bh1770glc.ko 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/ 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/core.ko 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/cb710/ 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/cb710/cb710.ko 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ds1682.ko 2023-07-20T09:33:30.435 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/dummy-irq.ko 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/echo/ 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/echo/echo.ko 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/ 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/at24.ko 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-20T09:33:30.436 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/max6875.ko 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/enclosure.ko 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/genwqe/ 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 152137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/hmc6352.ko 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/hpilo.ko 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ibmasm/ 2023-07-20T09:33:30.437 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 72601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ics932s401.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/isl29003.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/isl29020.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/ 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/ 2023-07-20T09:33:30.438 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 125209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei-me.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei-txe.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 309857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/phantom.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ti-st/ 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 74905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tifm_7xx1.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tifm_core.ko 2023-07-20T09:33:30.439 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tsl2550.ko 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_balloon.ko 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_vmci/ 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 183857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/bonding/ 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 487801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/bonding/bonding.ko 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/ 2023-07-20T09:33:30.440 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/b53/ 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 106009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 452481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-20T09:33:30.441 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dummy.ko 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/eql.ko 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/ 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 130489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-20T09:33:30.442 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/ 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 99113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/adaptec/ 2023-07-20T09:33:30.443 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-20T09:33:30.444 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/agere/ 2023-07-20T09:33:30.444 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-20T09:33:30.444 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/alteon/ 2023-07-20T09:33:30.445 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-20T09:33:30.445 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/altera/ 2023-07-20T09:33:30.445 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-20T09:33:30.445 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/ 2023-07-20T09:33:30.446 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-20T09:33:30.446 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-20T09:33:30.446 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 87345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-20T09:33:30.446 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/ 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 97321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 104585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-20T09:33:30.447 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 90257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/ 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 176881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-20T09:33:30.448 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1422209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-20T09:33:30.500 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 128377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 132289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 312145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/ 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 323601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-20T09:33:30.501 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/ 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 193433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 347641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1044145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-20T09:33:30.502 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 166113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/ 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 204329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/ 2023-07-20T09:33:30.503 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 141161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-20T09:33:30.504 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/ 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dnet.ko 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/ 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 281329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-20T09:33:30.505 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ethoc.ko 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fealnx.ko 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fujitsu/ 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 90465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 295713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-20T09:33:30.506 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 584249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 246321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 923969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 298097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-20T09:33:30.507 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igb/ 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 514889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 93593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 734297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-20T09:33:30.508 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 151841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 86921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/jme.ko 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/ 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 102385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 122681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/ 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-20T09:33:30.509 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 727433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 280513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1095817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-20T09:33:30.510 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 95665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/ 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 108809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/ 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-20T09:33:30.511 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/neterion/ 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 150905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/nvidia/ 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 136785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/ 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/ 2023-07-20T09:33:30.512 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 227113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 87081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 671393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/rdc/ 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/ 2023-07-20T09:33:30.513 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 83921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 190089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/ 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 104241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sfc/ 2023-07-20T09:33:30.514 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 952881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/silan/ 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/ 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/ 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-20T09:33:30.515 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/ 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-20T09:33:30.516 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 481681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/ 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 103321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 166121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/tehuti/ 2023-07-20T09:33:30.517 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ti/ 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 86465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/ 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 83681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/ 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-20T09:33:30.518 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/xircom/ 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/ 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/defxx.ko 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/skfp/ 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 216977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 77401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/geneve.ko 2023-07-20T09:33:30.519 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/hyperv/ 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 235593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ieee802154/ 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ifb.ko 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ipvlan/ 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 83737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/macvlan.ko 2023-07-20T09:33:30.520 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/macvtap.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/ 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mii.ko 2023-07-20T09:33:30.521 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/netconsole.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/nlmon.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/ 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/ 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/amd.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-20T09:33:30.522 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm87xx.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/broadcom.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/cicada.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/davicom.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/et1011c.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/icplus.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/lxt.ko 2023-07-20T09:33:30.523 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/marvell.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 75713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/micrel.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/national.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 97265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/phylink.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/qsemi.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/realtek.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/smsc.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/ste10Xp.ko 2023-07-20T09:33:30.524 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/vitesse.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/plip/ 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/plip/plip.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_async.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-20T09:33:30.525 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pppoe.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pppox.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pptp.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/sb1000.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/slip/ 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/slip/slip.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/sungem_phy.ko 2023-07-20T09:33:30.526 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 64889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/tap.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/ 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 105961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_random.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-20T09:33:30.527 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 88193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/veth.ko 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vmxnet3/ 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 120497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vxlan/ 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 290665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vxlan/vxlan.ko 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/xen-netback/ 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 143801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-20T09:33:30.528 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ntb/ 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ntb/ntb.ko 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/ 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/ 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 266561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/nvme-core.ko 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 101937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/nvme.ko 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/ 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 133817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport.ko 2023-07-20T09:33:30.529 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_cs.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 84337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_pc.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_serial.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/ 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/ 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-20T09:33:30.530 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/pci-stub.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/xen-pcifront.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/ 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/i82092.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 145785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pd6729.ko 2023-07-20T09:33:30.531 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 112913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/ 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/broadcom/ 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/samsung/ 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/ 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/intel/ 2023-07-20T09:33:30.532 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/ 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/ 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-20T09:33:30.533 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/ 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/acerhdf.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-20T09:33:30.534 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 106873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/hdaps.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-20T09:33:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/ 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel_ips.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-20T09:33:30.536 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/wmi.ko 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/ 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ 2023-07-20T09:33:30.537 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/da9030_battery.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/da9052-battery.ko 2023-07-20T09:33:30.538 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/gpio-charger.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max14577_charger.ko 2023-07-20T09:33:30.539 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max17040_battery.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max17042_battery.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max8903_charger.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max8925_power.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/sbs-battery.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/test_power.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-20T09:33:30.540 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm831x_power.ko 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm8350_power.ko 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/ 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/ 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/ 2023-07-20T09:33:30.541 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps_parport.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/pps_core.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ptp.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ptp_kvm.ko 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/ 2023-07-20T09:33:30.542 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9052.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9055.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9063.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-20T09:33:30.543 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-20T09:33:30.544 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-em3027.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-20T09:33:30.545 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max6900.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8907.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8925.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8997.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8998.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-20T09:33:30.546 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-palmas.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-20T09:33:30.547 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-20T09:33:30.548 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-x1205.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 77617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-9xxx.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-sas.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-xxxx.ko 2023-07-20T09:33:30.549 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 135169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/BusLogic.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/a100u2w.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aacraid/ 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 272353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/advansys.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/ 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 356265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 295801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-20T09:33:30.550 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic94xx/ 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 189321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/am53c974.ko 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/arcmsr/ 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 106569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/atp870u.ko 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/be2iscsi/ 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 246897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-20T09:33:30.551 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bfa/ 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1172185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bfa/bfa.ko 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2fc/ 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 237169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2i/ 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 115393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ch.ko 2023-07-20T09:33:30.552 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/csiostor/ 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 308889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/ 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 76193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 101449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 146785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-20T09:33:30.553 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 75529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/dc395x.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/dmx3191d.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esas2r/ 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 212401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esp_scsi.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/ 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 158193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-20T09:33:30.554 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fdomain.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fnic/ 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 261913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fnic/fnic.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 201793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hpsa.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hptiop.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hv_storvsc.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/imm.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/initio.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 266521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ipr.ko 2023-07-20T09:33:30.555 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 101881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ips.ko 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/isci/ 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 317249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/isci/isci.ko 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libfc/ 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 314961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libfc/libfc.ko 2023-07-20T09:33:30.556 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 145569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libiscsi.ko 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libsas/ 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 217209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libsas/libsas.ko 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/lpfc/ 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 2192449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/ 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-20T09:33:30.557 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 310729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 84697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mpt3sas/ 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 659577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvsas/ 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 119929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvumi.ko 2023-07-20T09:33:30.558 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/ 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pm8001/ 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 364257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 123489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pmcraid.ko 2023-07-20T09:33:30.559 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ppa.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla1280.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/ 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1860025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 85313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla4xxx/ 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 558865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qlogicfas408.ko 2023-07-20T09:33:30.560 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/raid_class.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 238801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_debug.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 173921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 278865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 97705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ses.ko 2023-07-20T09:33:30.561 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 115849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/st.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/stex.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 162121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/virtio_scsi.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/wd719x.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/xen-scsifront.ko 2023-07-20T09:33:30.562 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ssb/ 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 129417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ssb/ssb.ko 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/ 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/iscsi/ 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 739089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/loopback/ 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_file.ko 2023-07-20T09:33:30.563 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_iblock.ko 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 931721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_mod.ko 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_pscsi.ko 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 122545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_user.ko 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/tcm_fc/ 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 75641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/ 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/ 2023-07-20T09:33:30.564 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-20T09:33:30.565 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-20T09:33:30.566 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ipwireless/ 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/moxa.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 50793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/mxser.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 107545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/n_gsm.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/n_hdlc.ko 2023-07-20T09:33:30.567 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/nozomi.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/ 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/ 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/altera_uart.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/arc_uart.ko 2023-07-20T09:33:30.568 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 72193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/jsm/ 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 103017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/rp2.ko 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/synclink_gt.ko 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/ 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/core/ 2023-07-20T09:33:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 536617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/ 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_aec.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_cif.ko 2023-07-20T09:33:30.570 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_mf624.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_netx.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_pci_generic.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_sercos3.ko 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/ 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/c67x00/ 2023-07-20T09:33:30.571 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 143785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/ 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 85457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/cdc-acm.ko 2023-07-20T09:33:30.572 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/usblp.ko 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/usbtmc.ko 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/common/ 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/common/ulpi.ko 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc2/ 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/ 2023-07-20T09:33:30.573 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 445801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/ 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/ 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-20T09:33:30.574 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 92377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 122073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-20T09:33:30.575 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 85841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 58433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/ 2023-07-20T09:33:30.576 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-20T09:33:30.577 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 62153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 161233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/ 2023-07-20T09:33:30.578 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 157665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 76033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-20T09:33:30.579 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 75057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 65793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 156033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/ 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-20T09:33:30.580 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 87337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/sl811_cs.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/ 2023-07-20T09:33:30.581 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/mdc800.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/microtek.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/adutux.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/appledisplay.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/cytherm.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ehset.ko 2023-07-20T09:33:30.582 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/emi26.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/emi62.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ezusb.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/idmouse.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/iowarrior.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ldusb.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/legousbtower.ko 2023-07-20T09:33:30.583 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/lvstest.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/sisusbvga/ 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 64841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usb3503.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usblcd.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usbtest.ko 2023-07-20T09:33:30.584 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/uss720.ko 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/yurex.ko 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/mon/ 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/mon/usbmon.ko 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/musb/ 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 301521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/ 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-generic.ko 2023-07-20T09:33:30.585 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/aircable.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ark3116.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ch341.ko 2023-07-20T09:33:30.586 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 70209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cp210x.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cyberjack.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/empeg.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/f81232.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 175145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-20T09:33:30.587 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 137105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 124673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/io_ti.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ipaq.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ipw.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ir-usb.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 57937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 107417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/keyspan.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-20T09:33:30.588 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mct_u232.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/metro-usb.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mos7720.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 78113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mos7840.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mxuport.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/navman.ko 2023-07-20T09:33:30.589 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/omninet.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/opticon.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 189729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/option.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/oti6858.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/pl2303.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/qcaux.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/qcserial.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/quatech2.ko 2023-07-20T09:33:30.590 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/safe_serial.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 51297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/sierra.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ssu100.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/symbolserial.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb_debug.ko 2023-07-20T09:33:30.591 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 125505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usbserial.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/visor.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/whiteheat.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/uas.ko 2023-07-20T09:33:30.592 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-karma.ko 2023-07-20T09:33:30.593 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 180017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/usb-storage.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/ 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-20T09:33:30.594 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 105401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/ 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/ 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 153697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/vfio.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 75137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-20T09:33:30.595 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/ 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 113889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost.ko 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 58137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_net.ko 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 86521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_scsi.ko 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/ 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/ 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-20T09:33:30.596 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/apple_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/bd6107.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-20T09:33:30.597 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lcd.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-20T09:33:30.598 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/ 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ds2482.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ds2490.ko 2023-07-20T09:33:30.599 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/ 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-20T09:33:30.600 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-20T09:33:30.601 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 102657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/wire.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/acquirewdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/advantechwdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-20T09:33:30.602 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/dw_wdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/hpwdt.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/i6300esb.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-20T09:33:30.603 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ib700wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ibmasr.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/it87_wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/machzwd.ko 2023-07-20T09:33:30.604 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/nv_tco.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/retu_wdt.ko 2023-07-20T09:33:30.605 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/softdog.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-20T09:33:30.606 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/via_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wdt_pci.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-20T09:33:30.607 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/xen_wdt.ko 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/ 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-evtchn.ko 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-gntalloc.ko 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-gntdev.ko 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-pciback/ 2023-07-20T09:33:30.608 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 176417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-privcmd.ko 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 71321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-scsiback.ko 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xenfs/ 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/9p/ 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 165697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/9p/9p.ko 2023-07-20T09:33:30.609 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/adfs/ 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/adfs/adfs.ko 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/affs/ 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 162617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/affs/affs.ko 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/afs/ 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 931937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/afs/kafs.ko 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/autofs/ 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/autofs/autofs4.ko 2023-07-20T09:33:30.610 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/befs/ 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 64481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/befs/befs.ko 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/bfs/ 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/bfs/bfs.ko 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/binfmt_misc.ko 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/btrfs/ 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 3468681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/btrfs/btrfs.ko 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cachefiles/ 2023-07-20T09:33:30.611 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 305745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cachefiles/cachefiles.ko 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ceph/ 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1312545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ceph/ceph.ko 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/coda/ 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/coda/coda.ko 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/configfs/ 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 108073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/configfs/configfs.ko 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cramfs/ 2023-07-20T09:33:30.612 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cramfs/cramfs.ko 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/dlm/ 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 633825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/dlm/dlm.ko 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/efs/ 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/efs/efs.ko 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/f2fs/ 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1500513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/f2fs/f2fs.ko 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fat/ 2023-07-20T09:33:30.613 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fat/msdos.ko 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/freevxfs/ 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/freevxfs/freevxfs.ko 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fscache/ 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 226505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fscache/fscache.ko 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fuse/ 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fuse/cuse.ko 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/gfs2/ 2023-07-20T09:33:30.614 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1226249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/gfs2/gfs2.ko 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfs/ 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 141241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfs/hfs.ko 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfsplus/ 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 221553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfsplus/hfsplus.ko 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hpfs/ 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 193577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hpfs/hpfs.ko 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/isofs/ 2023-07-20T09:33:30.615 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 74393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/isofs/isofs.ko 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/jfs/ 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 420745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/jfs/jfs.ko 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/lockd/ 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 279041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/lockd/lockd.ko 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/minix/ 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 87897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/minix/minix.ko 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/netfs/ 2023-07-20T09:33:30.616 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 124697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/netfs/netfs.ko 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/ 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/blocklayout/ 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/filelayout/ 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/flexfilelayout/ 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 117705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-20T09:33:30.617 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1053889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfs.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv2.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 119801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv3.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 2041809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv4.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/ 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/grace.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/nfs_acl.ko 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfsd/ 2023-07-20T09:33:30.618 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1504993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfsd/nfsd.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nilfs2/ 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 591417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nilfs2/nilfs2.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/ 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-celtic.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-centeuro.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-croatian.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-cyrillic.ko 2023-07-20T09:33:30.619 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-gaelic.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-greek.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-iceland.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-inuit.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-roman.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-romanian.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-turkish.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_ascii.ko 2023-07-20T09:33:30.620 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1250.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1251.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1255.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp737.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp775.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp850.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp852.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp855.ko 2023-07-20T09:33:30.621 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp857.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp860.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp861.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp862.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp863.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp864.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp865.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp866.ko 2023-07-20T09:33:30.622 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp869.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp874.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 94137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp932.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 142673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp936.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 165745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp949.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 118121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp950.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_euc-jp.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-1.ko 2023-07-20T09:33:30.623 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-13.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-14.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-15.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-2.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-3.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-4.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-5.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-6.ko 2023-07-20T09:33:30.624 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-7.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-9.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-r.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-ru.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-u.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_utf8.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ntfs/ 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 219073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ntfs/ntfs.ko 2023-07-20T09:33:30.625 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/cluster/ 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 244177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlm/ 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 440785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlmfs/ 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 2589569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2.ko 2023-07-20T09:33:30.626 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/omfs/ 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 52569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/omfs/omfs.ko 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/overlayfs/ 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 336473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/overlayfs/overlay.ko 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/pstore/ 2023-07-20T09:33:30.627 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/pstore/ramoops.ko 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx4/ 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx4/qnx4.ko 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx6/ 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 46649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx6/qnx6.ko 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/ 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_tree.ko 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_v1.ko 2023-07-20T09:33:30.628 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_v2.ko 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/reiserfs/ 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 530697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/reiserfs/reiserfs.ko 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/romfs/ 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/romfs/romfs.ko 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/ 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/client/ 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 2658777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/client/cifs.ko 2023-07-20T09:33:30.629 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/ 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/cifs_arc4.ko 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/cifs_md4.ko 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/squashfs/ 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 134313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/squashfs/squashfs.ko 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/sysv/ 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/sysv/sysv.ko 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/udf/ 2023-07-20T09:33:30.630 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 248049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/udf/udf.ko 2023-07-20T09:33:30.631 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ufs/ 2023-07-20T09:33:30.631 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 160857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ufs/ufs.ko 2023-07-20T09:33:30.631 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/xfs/ 2023-07-20T09:33:30.631 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 3998129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/xfs/xfs.ko 2023-07-20T09:33:30.657 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/ 2023-07-20T09:33:30.657 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/locking/ 2023-07-20T09:33:30.657 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 74865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/locking/locktorture.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/time/ 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/time/test_udelay.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 58473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/torture.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc-itu-t.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc7.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc8.ko 2023-07-20T09:33:30.658 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/ 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/libarc4.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/libdes.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/interval_tree_test.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/libcrc32c.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lru_cache.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/ 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/lz4_compress.ko 2023-07-20T09:33:30.659 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/lz4hc_compress.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/math/ 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/math/cordic.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/memory-notifier-error-inject.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/notifier-error-inject.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/percpu_test.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/pm-notifier-error-inject.ko 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/raid6/ 2023-07-20T09:33:30.660 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 143433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/raid6/raid6_pq.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/rbtree_test.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/reed_solomon/ 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test-kstrtox.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test-string_helpers.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 4760825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_bpf.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_firmware.ko 2023-07-20T09:33:30.661 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_module.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_user_copy.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_bm.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_fsm.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_kmp.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/xz/ 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/xz/xz_dec_test.ko 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/mm/ 2023-07-20T09:33:30.662 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/mm/hwpoison-inject.ko 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/ 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/6lowpan.ko 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_dest.ko 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_fragment.ko 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_hop.ko 2023-07-20T09:33:30.663 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 6985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_mobility.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_routing.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_udp.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/ 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/garp.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/mrp.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/p8022.ko 2023-07-20T09:33:30.664 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/psnap.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/stp.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/8021q/ 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 81017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/8021q/8021q.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/ 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 198417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_fd.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_rdma.ko 2023-07-20T09:33:30.665 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_virtio.ko 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/batman-adv/ 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 652553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/batman-adv/batman-adv.ko 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/ 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 63825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/br_netfilter.ko 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 772505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/bridge.ko 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-20T09:33:30.666 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-20T09:33:30.667 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-20T09:33:30.668 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 55937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtables.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ceph/ 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1046417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ceph/libceph.ko 2023-07-20T09:33:30.669 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/core/ 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 124793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/core/pktgen.ko 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/ 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 194321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp.ko 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_diag.ko 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 56945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_ipv4.ko 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_ipv6.ko 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/ 2023-07-20T09:33:30.670 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 390297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/dsa_core.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_brcm.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_dsa.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_none.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_trailer.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/hsr/ 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 100257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/hsr/hsr.ko 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ 2023-07-20T09:33:30.671 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/6lowpan/ 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 45169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 254601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ieee802154.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ah4.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/esp4.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/fou.ko 2023-07-20T09:33:30.672 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/gre.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/inet_diag.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 60529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_gre.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_tunnel.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_vti.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ipcomp.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ipip.ko 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ 2023-07-20T09:33:30.673 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-20T09:33:30.674 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-20T09:33:30.675 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-20T09:33:30.676 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_bic.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_dctcp.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_diag.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_highspeed.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_htcp.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_hybla.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_illinois.ko 2023-07-20T09:33:30.677 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_lp.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_scalable.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_vegas.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_veno.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_westwood.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_yeah.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tunnel4.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/udp_diag.ko 2023-07-20T09:33:30.678 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 41577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/udp_tunnel.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ah6.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/esp6.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/fou6.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 80793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_gre.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 92817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_tunnel.ko 2023-07-20T09:33:30.679 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_vti.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ipcomp6.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/mip6.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 42209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-20T09:33:30.680 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-20T09:33:30.681 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-20T09:33:30.682 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 73161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/sit.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/tunnel6.ko 2023-07-20T09:33:30.683 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/key/ 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 82929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/key/af_key.ko 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/ 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 125873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_core.ko 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 25865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_eth.ko 2023-07-20T09:33:30.684 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ip.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ip6.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_netlink.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 53153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ppp.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/lapb/ 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/lapb/lapb.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/ 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/llc.ko 2023-07-20T09:33:30.685 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 267017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/llc2.ko 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mac802154/ 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 291041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mac802154/mac802154.ko 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mpls/ 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mpls/mpls_gso.ko 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 119649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set.ko 2023-07-20T09:33:30.686 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 102033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 103121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 104593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 105129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 114393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-20T09:33:30.687 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 111161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 114673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 114329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 113217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 116217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ 2023-07-20T09:33:30.688 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 412481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-20T09:33:30.689 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conncount.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 408689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack.ko 2023-07-20T09:33:30.690 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 118145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 108393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-20T09:33:30.691 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 66641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 88513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_flow_table.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_log_syslog.ko 2023-07-20T09:33:30.692 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 95353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_irc.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_sip.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 44025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 592185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_tables.ko 2023-07-20T09:33:30.693 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 39905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_log.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 49673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_chain_nat.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_compat.ko 2023-07-20T09:33:30.694 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 40721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_ct.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_fib.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_hash.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_limit.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_log.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_masq.ko 2023-07-20T09:33:30.695 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_nat.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_numgen.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_osf.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_queue.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_redir.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_reject.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_reject_inet.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_socket.ko 2023-07-20T09:33:30.696 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_synproxy.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_tproxy.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 89329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/x_tables.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_AUDIT.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 18169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CT.ko 2023-07-20T09:33:30.697 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_DSCP.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_HL.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_HMARK.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 38857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_LED.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_LOG.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NETMAP.ko 2023-07-20T09:33:30.698 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NFLOG.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_RATEEST.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 14337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_SECMARK.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TEE.ko 2023-07-20T09:33:30.699 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TPROXY.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TRACE.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_addrtype.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_bpf.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cgroup.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cluster.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_comment.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connbytes.ko 2023-07-20T09:33:30.700 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connlabel.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connlimit.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connmark.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_conntrack.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cpu.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_dccp.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_devgroup.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_dscp.ko 2023-07-20T09:33:30.701 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ecn.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_esp.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_hashlimit.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_helper.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_hl.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ipcomp.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_iprange.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ipvs.ko 2023-07-20T09:33:30.702 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_l2tp.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_length.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_limit.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_mac.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_mark.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_multiport.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_nat.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_nfacct.ko 2023-07-20T09:33:30.703 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_osf.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_owner.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_physdev.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_pkttype.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_policy.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_quota.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_rateest.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_realm.ko 2023-07-20T09:33:30.704 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_recent.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_sctp.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 30089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_set.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_socket.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_state.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_statistic.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_string.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 8553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_tcpmss.ko 2023-07-20T09:33:30.705 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_tcpudp.ko 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_time.ko 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_u32.ko 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netlink/ 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netlink/netlink_diag.ko 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/nsh/ 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 12425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/nsh/nsh.ko 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/ 2023-07-20T09:33:30.706 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 379545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/openvswitch.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-geneve.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-gre.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 11793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-vxlan.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/packet/ 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/packet/af_packet_diag.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/ 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 109961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/phonet.ko 2023-07-20T09:33:30.707 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 54761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/pn_pep.ko 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/ 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 252825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds.ko 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 165081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds_rdma.ko 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 67241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds_tcp.ko 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rxrpc/ 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 820137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rxrpc/rxrpc.ko 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/ 2023-07-20T09:33:30.708 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_csum.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_gact.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_ipt.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 34057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_mirred.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_nat.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 43817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_pedit.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_police.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_simple.ko 2023-07-20T09:33:30.709 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_skbedit.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 36057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_vlan.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_basic.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_bpf.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_cgroup.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_flow.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_fw.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 37953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_route.ko 2023-07-20T09:33:30.710 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 59217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_u32.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_cmp.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_ipset.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_meta.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_nbyte.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_text.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_u32.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 21649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_choke.ko 2023-07-20T09:33:30.711 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_codel.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_drr.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 33609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_fq.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_fq_codel.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_gred.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 48409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_hfsc.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_hhf.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 65793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_htb.ko 2023-07-20T09:33:30.712 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 16065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_ingress.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 29809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_mqprio.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_mqprio_lib.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_multiq.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 35601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_netem.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_pie.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_plug.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 24729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_prio.ko 2023-07-20T09:33:30.713 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 47617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_qfq.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 32953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_red.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 26881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_sfb.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 31425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_sfq.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 28897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_tbf.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 27729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_teql.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/ 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 930369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/sctp.ko 2023-07-20T09:33:30.714 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 19033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/sctp_diag.ko 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/ 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/ 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 335569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 61833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 1514649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/sunrpc.ko 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/xprtrdma/ 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 707401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-20T09:33:30.715 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/ 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/diag.ko 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 862233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/tipc.ko 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/unix/ 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/unix/unix_diag.ko 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/ 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 84841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 68033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-20T09:33:30.716 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 95985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 10705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 17521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/x25/ 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 125097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/x25/x25.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/ 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 22657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_algo.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 20705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-20T09:33:30.717 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 102265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_user.ko 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/ 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/lib/ 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 15513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/lib/irqbypass.ko 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 638200 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.alias 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 623896 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.alias.bin 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 7656 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 23361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.alias.bin 2023-07-20T09:33:30.718 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 9821 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.bin 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 69903 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.modinfo 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 146449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.dep 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 232695 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.dep.bin 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 210 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.devname 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 72754 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.order 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 879 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.softdep 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 252883 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.symbols 2023-07-20T09:33:30.719 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 307884 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.symbols.bin 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/ 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/ 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/doc/ 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 174 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/changelog.Debian.gz 2023-07-20T09:33:30.720 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r-- root/root 691 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/copyright 2023-07-20T09:33:30.721 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.722 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.722 DEBUG:teuthology.orchestra.run.smithi183:> egrep '(submenu|menuentry.*6.5.0-rc1-g8c15ad6dab84).*{' /boot/grub/grub.cfg 2023-07-20T09:33:30.728 INFO:teuthology.orchestra.run.smithi183.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:33:30.729 INFO:teuthology.orchestra.run.smithi183.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-g8c15ad6dab84-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:33:30.729 INFO:teuthology.orchestra.run.smithi183.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-g8c15ad6dab84-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:33:30.729 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-20T09:33:30.729 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:30.730 DEBUG:teuthology.orchestra.run.smithi183:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-20T09:33:30.773 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi183.front.sepia.ceph.com to complete... 2023-07-20T09:33:31.204 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub' 2023-07-20T09:33:31.206 INFO:teuthology.orchestra.run.smithi183.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-20T09:33:31.225 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-07-20T09:33:31.454 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:31.461 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:33:31.805 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-20T09:33:31.810 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-20T09:33:31.852 INFO:teuthology.orchestra.run.smithi183.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-20T09:33:31.857 INFO:teuthology.orchestra.run.smithi183.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-20T09:33:32.006 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-20T09:33:32.006 INFO:teuthology.orchestra.run.smithi183.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-20T09:33:32.006 INFO:teuthology.orchestra.run.smithi183.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-20T09:33:32.015 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-07-20T09:34:03.143 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-20T09:34:03.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:34:03.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:34:08.127 INFO:teuthology.orchestra.run.smithi082.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-20T09:34:08.127 INFO:teuthology.orchestra.run.smithi082.stderr: * [new branch] main -> origin/main 2023-07-20T09:34:08.155 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190312 -> 20190312 2023-07-20T09:34:08.155 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190416 -> 20190416 2023-07-20T09:34:08.155 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190514 -> 20190514 2023-07-20T09:34:08.157 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190618 -> 20190618 2023-07-20T09:34:08.157 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190717 -> 20190717 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190815 -> 20190815 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20190923 -> 20190923 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20191022 -> 20191022 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20191215 -> 20191215 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200122 -> 20200122 2023-07-20T09:34:08.158 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200316 -> 20200316 2023-07-20T09:34:08.160 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200421 -> 20200421 2023-07-20T09:34:08.160 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200519 -> 20200519 2023-07-20T09:34:08.160 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200619 -> 20200619 2023-07-20T09:34:08.160 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200721 -> 20200721 2023-07-20T09:34:08.161 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200817 -> 20200817 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20200918 -> 20200918 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201022 -> 20201022 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201118 -> 20201118 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20201218 -> 20201218 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210208 -> 20210208 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210315 -> 20210315 2023-07-20T09:34:08.163 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210511 -> 20210511 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210716 -> 20210716 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210818 -> 20210818 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20210919 -> 20210919 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20211027 -> 20211027 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20211216 -> 20211216 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220209 -> 20220209 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220310 -> 20220310 2023-07-20T09:34:08.164 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220411 -> 20220411 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220509 -> 20220509 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220610 -> 20220610 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220708 -> 20220708 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220815 -> 20220815 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20220913 -> 20220913 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221012 -> 20221012 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221109 -> 20221109 2023-07-20T09:34:08.165 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20221214 -> 20221214 2023-07-20T09:34:08.166 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230117 -> 20230117 2023-07-20T09:34:08.166 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230210 -> 20230210 2023-07-20T09:34:08.166 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230310 -> 20230310 2023-07-20T09:34:08.166 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230404 -> 20230404 2023-07-20T09:34:08.167 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230515 -> 20230515 2023-07-20T09:34:08.167 INFO:teuthology.orchestra.run.smithi082.stderr: * [new tag] 20230625 -> 20230625 2023-07-20T09:34:11.413 INFO:teuthology.orchestra.run.smithi082.stderr:Updating files: 50% (1511/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1955/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2449/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-20T09:34:11.417 INFO:teuthology.orchestra.run.smithi082.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-20T09:34:11.436 INFO:teuthology.task.kernel:Downloading kernel 8c15ad6dab84a191431785901a40e4f9fa32bda8 on client.0... 2023-07-20T09:34:11.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8c15ad6dab84a191431785901a40e4f9fa32bda8 2023-07-20T09:34:11.793 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:34:11.794 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-g8c15ad6dab84_6.5.0-rc1-g8c15ad6dab84-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/ --input-file=- 2023-07-20T09:34:11.796 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2023-07-20T09:34:21.552 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-07-20T09:34:30.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:34:30.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:34:32.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20 09:34:32 URL:https://3.chacra.ceph.com/r/kernel/testing/8c15ad6dab84a191431785901a40e4f9fa32bda8/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-g8c15ad6dab84/linux-image-6.5.0-rc1-g8c15ad6dab84_6.5.0-rc1-g8c15ad6dab84-1_amd64.deb [38848240/38848240] -> "/tmp/linux-image.deb" [1] 2023-07-20T09:34:32.078 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2023-07-20 09:34:32-- 2023-07-20T09:34:32.078 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 20s 2023-07-20T09:34:32.079 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 37M in 20s (1.87 MB/s) 2023-07-20T09:34:32.081 INFO:teuthology.task.kernel:Installing kernel 8c15ad6dab84a191431785901a40e4f9fa32bda8 on client.0... 2023-07-20T09:34:32.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo dpkg -i /tmp/linux-image.deb 2023-07-20T09:34:32.393 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-g8c15ad6dab84. 2023-07-20T09:34:33.620 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-07-20T09:34:34.357 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-20T09:34:34.361 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-20T09:34:34.491 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking linux-image-6.5.0-rc1-g8c15ad6dab84 (6.5.0-rc1-g8c15ad6dab84-1) ... 2023-07-20T09:34:37.736 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up linux-image-6.5.0-rc1-g8c15ad6dab84 (6.5.0-rc1-g8c15ad6dab84-1) ... 2023-07-20T09:34:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:45.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:34:45.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:34:55.993 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2023-07-20T09:34:56.008 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-20T09:34:56.025 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-07-20T09:34:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:56.595 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-20T09:34:56.602 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-20T09:34:56.667 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-20T09:34:56.673 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-20T09:34:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-20T09:34:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-20T09:34:56.838 INFO:teuthology.orchestra.run.smithi082.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-20T09:34:56.892 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-07-20T09:34:57.091 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-deb -c /tmp/linux-image.deb 2023-07-20T09:34:57.097 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./ 2023-07-20T09:34:57.098 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./boot/ 2023-07-20T09:34:57.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 4380308 2023-07-20 06:00 ./boot/System.map-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 168433 2023-07-20 06:00 ./boot/config-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11280128 2023-07-20 06:00 ./boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/ 2023-07-20T09:34:57.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/ 2023-07-20T09:34:57.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/postinst.d/ 2023-07-20T09:34:57.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/postrm.d/ 2023-07-20T09:34:57.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/preinst.d/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./etc/kernel/prerm.d/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/ 2023-07-20T09:34:57.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/ 2023-07-20T09:34:57.126 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/ 2023-07-20T09:34:57.126 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 490385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-20T09:34:57.127 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 93113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 152241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-20T09:34:57.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-20T09:34:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/ 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/ 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/mce/ 2023-07-20T09:34:57.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-20T09:34:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/cpuid.ko 2023-07-20T09:34:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kernel/msr.ko 2023-07-20T09:34:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/ 2023-07-20T09:34:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 348417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-20T09:34:57.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 972641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-20T09:34:57.137 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2273145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/arch/x86/kvm/kvm.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/af_alg.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/algif_hash.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/algif_skcipher.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ansi_cprng.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/anubis.ko 2023-07-20T09:34:57.138 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/arc4.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/asymmetric_keys/ 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/ 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_memcpy.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_pq.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_tx.ko 2023-07-20T09:34:57.139 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/async_xor.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/async_tx/raid6test.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/authenc.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/authencesn.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blake2b_generic.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blowfish_common.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/blowfish_generic.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/camellia_generic.ko 2023-07-20T09:34:57.140 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast5_generic.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast6_generic.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cast_common.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/ccm.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cmac.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crc32_generic.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cryptd.ko 2023-07-20T09:34:57.141 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_engine.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_simd.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/crypto_user.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/cts.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/des_generic.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/dh_generic.ko 2023-07-20T09:34:57.142 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/echainiv.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/essiv.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/fcrypt.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/khazad.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lrw.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lz4.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/lz4hc.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/md4.ko 2023-07-20T09:34:57.143 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/michael_mic.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/pcbc.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/pcrypt.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/rmd160.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/seed.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/serpent_generic.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 149193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/tcrypt.ko 2023-07-20T09:34:57.144 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/tea.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/twofish_common.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/twofish_generic.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/vmac.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/wp512.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xcbc.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xor.ko 2023-07-20T09:34:57.145 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xts.ko 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/crypto/xxhash_generic.ko 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/ 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_extlog.ko 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/acpi_pad.ko 2023-07-20T09:34:57.146 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/apei/ 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/apei/einj.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/ec_sys.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/platform_profile.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/sbs.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/sbshc.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/acpi/video.ko 2023-07-20T09:34:57.147 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/acard-ahci.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 88625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ahci.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/ahci_platform.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/libahci.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/libahci_platform.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_acpi.ko 2023-07-20T09:34:57.148 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ali.ko 2023-07-20T09:34:57.149 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_amd.ko 2023-07-20T09:34:57.149 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_artop.ko 2023-07-20T09:34:57.149 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_atiixp.ko 2023-07-20T09:34:57.149 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_atp867x.ko 2023-07-20T09:34:57.149 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cmd640.ko 2023-07-20T09:34:57.150 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cmd64x.ko 2023-07-20T09:34:57.150 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_cypress.ko 2023-07-20T09:34:57.150 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_efar.ko 2023-07-20T09:34:57.150 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt366.ko 2023-07-20T09:34:57.151 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt37x.ko 2023-07-20T09:34:57.151 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-20T09:34:57.151 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-20T09:34:57.151 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_it8213.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_it821x.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_jmicron.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_legacy.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_marvell.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_mpiix.ko 2023-07-20T09:34:57.152 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_netcell.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ninja32.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ns87410.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_ns87415.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_oldpiix.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_opti.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_optidma.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pcmcia.ko 2023-07-20T09:34:57.153 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_piccolo.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_radisys.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_rdc.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_rz1000.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sch.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_serverworks.ko 2023-07-20T09:34:57.154 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sil680.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_sl82c105.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_triflex.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pata_via.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/pdc_adma.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_inic162x.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_mv.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_nv.ko 2023-07-20T09:34:57.155 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_promise.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_qstor.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sil.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sil24.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sis.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_svw.ko 2023-07-20T09:34:57.156 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_sx4.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_uli.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_via.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ata/sata_vsc.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/auxdisplay/ 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/auxdisplay/ks0108.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/bcma/ 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/bcma/bcma.ko 2023-07-20T09:34:57.157 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/ 2023-07-20T09:34:57.158 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/aoe/ 2023-07-20T09:34:57.158 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/aoe/aoe.ko 2023-07-20T09:34:57.158 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/drbd/ 2023-07-20T09:34:57.158 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 968433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/drbd/drbd.ko 2023-07-20T09:34:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 173201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/floppy.ko 2023-07-20T09:34:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/mtip32xx/ 2023-07-20T09:34:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-20T09:34:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/nbd.ko 2023-07-20T09:34:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/null_blk/ 2023-07-20T09:34:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 110361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/null_blk/null_blk.ko 2023-07-20T09:34:57.203 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 98225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/pktcdvd.ko 2023-07-20T09:34:57.203 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 257529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/rbd.ko 2023-07-20T09:34:57.203 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/xen-blkback/ 2023-07-20T09:34:57.204 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 98129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-20T09:34:57.204 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/zram/ 2023-07-20T09:34:57.204 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/block/zram/zram.ko 2023-07-20T09:34:57.205 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ 2023-07-20T09:34:57.205 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/applicom.ko 2023-07-20T09:34:57.205 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hangcheck-timer.ko 2023-07-20T09:34:57.205 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/ 2023-07-20T09:34:57.206 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-20T09:34:57.206 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-20T09:34:57.206 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-20T09:34:57.207 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/via-rng.ko 2023-07-20T09:34:57.207 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-20T09:34:57.207 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ 2023-07-20T09:34:57.207 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-20T09:34:57.208 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 150665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-20T09:34:57.208 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-20T09:34:57.208 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 139057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-20T09:34:57.208 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-20T09:34:57.209 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-20T09:34:57.209 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/lp.ko 2023-07-20T09:34:57.209 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/mwave/ 2023-07-20T09:34:57.209 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/mwave/mwave.ko 2023-07-20T09:34:57.209 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/nvram.ko 2023-07-20T09:34:57.210 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/ppdev.ko 2023-07-20T09:34:57.210 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tlclk.ko 2023-07-20T09:34:57.210 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/ 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-20T09:34:57.211 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/ 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/ 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-palmas.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-si5351.ko 2023-07-20T09:34:57.212 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-twl6040.ko 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/clk/clk-wm831x.ko 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/ 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ 2023-07-20T09:34:57.213 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 234473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/ccp/ccp.ko 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/ 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/ 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 408489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-20T09:34:57.214 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/padlock-aes.ko 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/padlock-sha.ko 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/virtio/ 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dca/ 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dca/dca.ko 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ 2023-07-20T09:34:57.215 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/dw/ 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ioat/ 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/ 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/amd64_edac.ko 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/e752x_edac.ko 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/edac_mce_amd.ko 2023-07-20T09:34:57.216 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i3000_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i3200_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i5100_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i5400_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i7300_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i7core_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/i82975x_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/ie31200_edac.ko 2023-07-20T09:34:57.217 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/sb_edac.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/edac/x38_edac.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/ 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-gpio.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max14577.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max77693.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-max8997.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-palmas.ko 2023-07-20T09:34:57.218 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/ 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/efi/ 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/ 2023-07-20T09:34:57.219 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-arizona.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-da9052.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-da9055.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-dln2.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-generic.ko 2023-07-20T09:34:57.220 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-ich.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-kempld.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max7300.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max730x.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-max732x.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-20T09:34:57.221 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-sch.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-20T09:34:57.222 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-vx855.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/ 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-a4tech.ko 2023-07-20T09:34:57.223 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-apple.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-appleir.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-aureal.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-axff.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-belkin.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cherry.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-chicony.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cp2112.ko 2023-07-20T09:34:57.224 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-cypress.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-dr.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-elecom.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-elo.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-emsff.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ezkey.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gaff.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-generic.ko 2023-07-20T09:34:57.225 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gt683r.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-gyration.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-holtekff.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-hyperv.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-icade.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-kensington.ko 2023-07-20T09:34:57.226 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-keytouch.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-kye.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lcpower.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-led.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lenovo.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-lg-g15.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-20T09:34:57.227 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-logitech.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-magicmouse.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-microsoft.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-monterey.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-multitouch.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ntrig.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-ortek.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-penmount.ko 2023-07-20T09:34:57.228 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-petalynx.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-picolcd.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-pl.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-plantronics.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-primax.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-rmi.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-common.ko 2023-07-20T09:34:57.229 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-20T09:34:57.230 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-roccat.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-saitek.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-samsung.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sjoy.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sony.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-speedlink.ko 2023-07-20T09:34:57.231 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-steelseries.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-sunplus.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-tivo.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-tmff.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-topseed.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-twinhan.ko 2023-07-20T09:34:57.232 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-uclogic.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-waltop.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-wiimote.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-xinmo.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-zpff.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid-zydacron.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 267713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/hid.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/uhid.ko 2023-07-20T09:34:57.233 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/ 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 217401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hid/wacom.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/ 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_balloon.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_utils.ko 2023-07-20T09:34:57.234 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 301449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hv/hv_vmbus.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/abituguru.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/abituguru3.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ad7414.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ad7418.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adc128d818.ko 2023-07-20T09:34:57.235 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1025.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1026.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1029.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm1031.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adm9240.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ads7828.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7410.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7411.ko 2023-07-20T09:34:57.236 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7462.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7470.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7475.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/adt7x10.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/amc6821.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/applesmc.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asb100.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asc7621.ko 2023-07-20T09:34:57.237 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/atxp1.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/coretemp.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 99601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/dme1737.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ds1621.ko 2023-07-20T09:34:57.238 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ds620.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc1403.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc2103.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/emc6w201.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f71805f.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f71882fg.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/f75375s.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/fam15h_power.ko 2023-07-20T09:34:57.239 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/fschmd.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/g760a.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/g762.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/gl518sm.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/gl520sm.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/hih6130.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/i5500_temp.ko 2023-07-20T09:34:57.240 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/i5k_amb.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ibmaem.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ibmpex.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ina209.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ina2xx.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/it87.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/jc42.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/k10temp.ko 2023-07-20T09:34:57.241 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/k8temp.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lineage-pem.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm63.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm73.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm75.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm77.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm78.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm80.ko 2023-07-20T09:34:57.242 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm83.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm85.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm87.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm90.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm92.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm93.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95234.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95241.ko 2023-07-20T09:34:57.243 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/lm95245.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc2945.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4151.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4215.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4222.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4245.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4260.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/ltc4261.ko 2023-07-20T09:34:57.244 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max16065.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max1619.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max1668.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max197.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6639.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6650.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/max6697.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-20T09:34:57.245 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/mcp3021.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6683.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 116737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6775-core.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct6775.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/nct7802.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pc87360.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pc87427.ko 2023-07-20T09:34:57.246 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pcf8591.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-20T09:34:57.247 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/powr1220.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch5627.ko 2023-07-20T09:34:57.248 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch5636.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sht15.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sht21.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/shtc1.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/sis5595.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smm665.ko 2023-07-20T09:34:57.249 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47b397.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47m1.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/smsc47m192.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/thmc50.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp102.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp103.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp401.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/tmp421.ko 2023-07-20T09:34:57.250 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/via-cputemp.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/via686a.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/vt1211.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/vt8231.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83627ehf.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83627hf.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83781d.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83791d.ko 2023-07-20T09:34:57.251 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83792d.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83793.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83795.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83l785ts.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/w83l786ng.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/ 2023-07-20T09:34:57.252 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/ 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/ 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-20T09:34:57.253 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-20T09:34:57.254 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-20T09:34:57.255 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-20T09:34:57.256 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-20T09:34:57.257 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-mux.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-smbus.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/i2c-stub.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/ 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-20T09:34:57.258 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 273641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 876913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_core.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 324145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-20T09:34:57.259 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 279321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 492561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx4/ 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 419217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx5/ 2023-07-20T09:34:57.260 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 739705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mthca/ 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 296649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 153681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/usnic/ 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 169017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ 2023-07-20T09:34:57.261 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 263177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/iser/ 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/isert/ 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 111993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srp/ 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-20T09:34:57.262 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srpt/ 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/ 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/evbug.ko 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/ff-memless.ko 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/ 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-20T09:34:57.263 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/gameport.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/lightning.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/gameport/ns558.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/joydev.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/ 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-20T09:34:57.264 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lm8323.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/lm8333.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-20T09:34:57.265 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/qt1070.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/qt2160.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/stowaway.ko 2023-07-20T09:34:57.266 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/matrix-keymap.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/ 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/appletouch.ko 2023-07-20T09:34:57.267 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/bcm5974.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/cyapatp.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 335849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/psmouse.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/sermouse.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-20T09:34:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/rmi4/ 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/altera_ps2.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/arc_ps2.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ct82c710.ko 2023-07-20T09:34:57.269 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/parkbd.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/pcips2.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/ps2mult.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/serio_raw.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/serio/serport.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/input/sparse-keymap.ko 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/ 2023-07-20T09:34:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/amd/ 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/ 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-88pm860x.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-adp5520.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-bd2802.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-blinkm.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-da903x.ko 2023-07-20T09:34:57.271 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-da9052.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-gpio.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3530.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3533.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm355x.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lm3642.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lp3944.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-lp8788.ko 2023-07-20T09:34:57.272 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-max8997.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-mc13783.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca9532.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca955x.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-pca963x.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-ss4200.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-tca6507.ko 2023-07-20T09:34:57.273 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/leds-wm8350.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-20T09:34:57.274 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/ 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/bcache/ 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 655473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/bcache/bcache.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-bio-prison.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-bufio.ko 2023-07-20T09:34:57.275 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-cache-smq.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 155993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-cache.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-crypt.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-delay.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-era.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-flakey.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-log-userspace.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-log.ko 2023-07-20T09:34:57.276 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-mirror.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-multipath.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-queue-length.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-raid.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-region-hash.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-round-robin.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-service-time.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-snapshot.ko 2023-07-20T09:34:57.277 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-switch.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 181585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-thin-pool.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-verity.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/dm-zero.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/faulty.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/linear.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/multipath.ko 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/persistent-data/ 2023-07-20T09:34:57.278 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 199937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid0.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 112609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid1.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 160553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid10.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 396153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/md/raid456.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/ 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/ 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 178113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptbase.ko 2023-07-20T09:34:57.279 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptctl.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptfc.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptlan.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptsas.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 79017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptscsih.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/message/fusion/mptspi.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/ 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm800.ko 2023-07-20T09:34:57.280 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm805.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/88pm80x.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/arizona-i2c.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/arizona.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/bcm590xx.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/dln2.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/janz-cmodio.ko 2023-07-20T09:34:57.281 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/kempld-core.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lm3533-core.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lp3943.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lpc_ich.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/lpc_sch.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/max8907.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-20T09:34:57.282 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/menf21bmc.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/pcf50633.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/retu-mfd.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/si476x-core.ko 2023-07-20T09:34:57.283 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/sm501.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/tps65010.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/tps6507x.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/viperboard.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/vx855.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/wl1273-core.ko 2023-07-20T09:34:57.284 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/mfd/wm8994.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ad525x_dpot.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/altera-stapl/ 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/apds9802als.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/apds990x.ko 2023-07-20T09:34:57.285 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/bh1770glc.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/ 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/c2port/core.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/cb710/ 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/cb710/cb710.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ds1682.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/dummy-irq.ko 2023-07-20T09:34:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/echo/ 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/echo/echo.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/ 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/at24.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/eeprom/max6875.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/enclosure.ko 2023-07-20T09:34:57.287 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/genwqe/ 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 152137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/hmc6352.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/hpilo.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ibmasm/ 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ics932s401.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/isl29003.ko 2023-07-20T09:34:57.288 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/isl29020.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/ 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/ 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei-me.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei-txe.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 309857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/mei/mei.ko 2023-07-20T09:34:57.289 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/phantom.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ti-st/ 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tifm_7xx1.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tifm_core.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/tsl2550.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_balloon.ko 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_vmci/ 2023-07-20T09:34:57.290 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 183857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/bonding/ 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 487801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/bonding/bonding.ko 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/ 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/b53/ 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-20T09:34:57.291 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 452481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/dummy.ko 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/eql.ko 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/ 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-20T09:34:57.292 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 130489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/ 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 99113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-20T09:34:57.293 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/adaptec/ 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/agere/ 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/alteon/ 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/altera/ 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-20T09:34:57.294 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/ 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/ 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-20T09:34:57.295 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 104585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 90257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/ 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-20T09:34:57.296 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 176881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1422209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 128377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 132289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 312145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/ 2023-07-20T09:34:57.297 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 323601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/ 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 193433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 347641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-20T09:34:57.298 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1044145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 166113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/ 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 204329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-20T09:34:57.299 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/ 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 141161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-20T09:34:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/ 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/dnet.ko 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/ 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-20T09:34:57.301 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 281329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ethoc.ko 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fealnx.ko 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fujitsu/ 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 90465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-20T09:34:57.302 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 295713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 584249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 246321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-20T09:34:57.303 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 923969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-20T09:34:57.382 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-20T09:34:57.382 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 298097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igb/ 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 514889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 93593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 734297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-20T09:34:57.383 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 151841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 86921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/jme.ko 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/ 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/ 2023-07-20T09:34:57.384 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 727433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 280513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1095817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-20T09:34:57.385 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 95665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/ 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/ 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-20T09:34:57.386 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/neterion/ 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 150905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/nvidia/ 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 136785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/ 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-20T09:34:57.387 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/ 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 227113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 671393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/rdc/ 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-20T09:34:57.388 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/ 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 190089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/ 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 104241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-20T09:34:57.389 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sfc/ 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 952881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/silan/ 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/ 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/ 2023-07-20T09:34:57.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/ 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-20T09:34:57.391 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 481681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/ 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 166121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-20T09:34:57.392 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/tehuti/ 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ti/ 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 86465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/ 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/ 2023-07-20T09:34:57.393 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/xircom/ 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/ 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/defxx.ko 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/skfp/ 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 216977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-20T09:34:57.394 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/geneve.ko 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/hyperv/ 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 235593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ieee802154/ 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ifb.ko 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ipvlan/ 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 83737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-20T09:34:57.395 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/macvlan.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/macvtap.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/ 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mdio.ko 2023-07-20T09:34:57.396 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/mii.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/netconsole.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/nlmon.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/ 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/ 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/amd.ko 2023-07-20T09:34:57.397 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/bcm87xx.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/broadcom.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/cicada.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/davicom.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/et1011c.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/icplus.ko 2023-07-20T09:34:57.398 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/lxt.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/marvell.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/micrel.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/national.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/phylink.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/qsemi.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/realtek.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/smsc.ko 2023-07-20T09:34:57.399 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/ste10Xp.ko 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/phy/vitesse.ko 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/plip/ 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/plip/plip.ko 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_async.ko 2023-07-20T09:34:57.400 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pppoe.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pppox.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/ppp/pptp.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/sb1000.ko 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/slip/ 2023-07-20T09:34:57.401 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/slip/slip.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/sungem_phy.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/tap.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/ 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 105961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-20T09:34:57.402 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_random.ko 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 88193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/veth.ko 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vmxnet3/ 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 120497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vxlan/ 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 290665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/vxlan/vxlan.ko 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/xen-netback/ 2023-07-20T09:34:57.403 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ntb/ 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ntb/ntb.ko 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/ 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/ 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 266561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/nvme-core.ko 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/nvme/host/nvme.ko 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/ 2023-07-20T09:34:57.404 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 133817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_cs.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_pc.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/parport/parport_serial.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/ 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/ 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-20T09:34:57.405 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/pci-stub.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pci/xen-pcifront.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/ 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/i82092.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 145785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-20T09:34:57.406 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/pd6729.ko 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 112913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/ 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/broadcom/ 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/samsung/ 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/ 2023-07-20T09:34:57.407 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/intel/ 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/ 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/ 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-20T09:34:57.408 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/ 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/acerhdf.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-20T09:34:57.409 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/hdaps.ko 2023-07-20T09:34:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/ 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/intel_ips.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-20T09:34:57.411 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/platform/x86/wmi.ko 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/ 2023-07-20T09:34:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/da9030_battery.ko 2023-07-20T09:34:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/da9052-battery.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/gpio-charger.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-20T09:34:57.414 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max14577_charger.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max17040_battery.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max17042_battery.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max8903_charger.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/max8925_power.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/sbs-battery.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/test_power.ko 2023-07-20T09:34:57.415 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm831x_power.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/power/supply/wm8350_power.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/ 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-20T09:34:57.416 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/ 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/ 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/clients/pps_parport.ko 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/pps/pps_core.ko 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ptp.ko 2023-07-20T09:34:57.417 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ptp/ptp_kvm.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/ 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9052.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9055.ko 2023-07-20T09:34:57.418 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-da9063.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-20T09:34:57.419 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-em3027.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-20T09:34:57.420 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max6900.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8907.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8925.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8997.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-max8998.ko 2023-07-20T09:34:57.421 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-palmas.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-20T09:34:57.422 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-20T09:34:57.423 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/rtc/rtc-x1205.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 77617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-9xxx.ko 2023-07-20T09:34:57.424 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-sas.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/3w-xxxx.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 135169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/BusLogic.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/a100u2w.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aacraid/ 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 272353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/advansys.ko 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/ 2023-07-20T09:34:57.425 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 356265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 295801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic94xx/ 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 189321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/am53c974.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/arcmsr/ 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 106569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/atp870u.ko 2023-07-20T09:34:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/be2iscsi/ 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 246897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bfa/ 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1172185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bfa/bfa.ko 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2fc/ 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 237169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2i/ 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-20T09:34:57.427 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ch.ko 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/csiostor/ 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 308889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/ 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 76193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-20T09:34:57.428 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 146785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/dc395x.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/dmx3191d.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esas2r/ 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 212401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/esp_scsi.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/ 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-20T09:34:57.429 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 158193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fdomain.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fnic/ 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 261913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/fnic/fnic.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 201793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hpsa.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hptiop.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/hv_storvsc.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/imm.ko 2023-07-20T09:34:57.430 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/initio.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 266521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ipr.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 101881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ips.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/isci/ 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 317249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/isci/isci.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libfc/ 2023-07-20T09:34:57.431 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 314961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libfc/libfc.ko 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 145569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libiscsi.ko 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libsas/ 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 217209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/libsas/libsas.ko 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/lpfc/ 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2192449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/ 2023-07-20T09:34:57.432 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 310729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/megaraid.ko 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mpt3sas/ 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 659577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvsas/ 2023-07-20T09:34:57.433 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/mvumi.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/ 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pm8001/ 2023-07-20T09:34:57.434 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 364257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 123489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/pmcraid.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ppa.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla1280.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/ 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1860025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla4xxx/ 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 558865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-20T09:34:57.435 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/qlogicfas408.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/raid_class.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 238801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_debug.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 173921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 278865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 97705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-20T09:34:57.436 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/ses.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 115849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/st.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/stex.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 162121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/virtio_scsi.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-20T09:34:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/wd719x.ko 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/scsi/xen-scsifront.ko 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ssb/ 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 129417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ssb/ssb.ko 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/ 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/iscsi/ 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 739089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/loopback/ 2023-07-20T09:34:57.438 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_file.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_iblock.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 931721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_mod.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_pscsi.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/target_core_user.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/tcm_fc/ 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-20T09:34:57.439 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/ 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/ 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-20T09:34:57.440 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-20T09:34:57.441 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ipwireless/ 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/moxa.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 50793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/mxser.ko 2023-07-20T09:34:57.442 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/n_gsm.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/n_hdlc.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/nozomi.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/ 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/ 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-20T09:34:57.443 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/altera_uart.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/arc_uart.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/jsm/ 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/rp2.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/tty/synclink_gt.ko 2023-07-20T09:34:57.444 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/ 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/core/ 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 536617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/ 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio.ko 2023-07-20T09:34:57.445 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_aec.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_cif.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_mf624.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_netx.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_pci_generic.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/uio/uio_sercos3.ko 2023-07-20T09:34:57.446 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/ 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/c67x00/ 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-20T09:34:57.447 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/ 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/cdc-acm.ko 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/usblp.ko 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/class/usbtmc.ko 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/common/ 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/common/ulpi.ko 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc2/ 2023-07-20T09:34:57.448 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/ 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 445801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/ 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/ 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-20T09:34:57.449 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 92377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 122073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-20T09:34:57.450 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 85841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-20T09:34:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/ 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-20T09:34:57.452 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 62153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15201 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 161233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-20T09:34:57.453 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/ 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 157665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-20T09:34:57.454 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 76033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 65793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 156033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/ 2023-07-20T09:34:57.455 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/sl811_cs.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-20T09:34:57.456 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/ 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/mdc800.ko 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/image/microtek.ko 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/adutux.ko 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/appledisplay.ko 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-20T09:34:57.457 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/cytherm.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ehset.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/emi26.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/emi62.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ezusb.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/idmouse.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/iowarrior.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-20T09:34:57.458 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/ldusb.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/legousbtower.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/lvstest.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/sisusbvga/ 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usb3503.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usblcd.ko 2023-07-20T09:34:57.459 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/usbtest.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/uss720.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/misc/yurex.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/mon/ 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/mon/usbmon.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/musb/ 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 301521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-20T09:34:57.460 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/ 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-generic.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/aircable.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ark3116.ko 2023-07-20T09:34:57.461 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ch341.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 70209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cp210x.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cyberjack.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/empeg.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/f81232.ko 2023-07-20T09:34:57.462 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 175145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 137105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/io_ti.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ipaq.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ipw.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ir-usb.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 57937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-20T09:34:57.463 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 107417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/keyspan.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mct_u232.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/metro-usb.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mos7720.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 78113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mos7840.ko 2023-07-20T09:34:57.464 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/mxuport.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/navman.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/omninet.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/opticon.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 189729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/option.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/oti6858.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/pl2303.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/qcaux.ko 2023-07-20T09:34:57.465 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/qcserial.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/quatech2.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/safe_serial.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 51297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/sierra.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ssu100.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/symbolserial.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-20T09:34:57.466 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb_debug.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/usbserial.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/visor.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/whiteheat.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-20T09:34:57.467 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/uas.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-20T09:34:57.468 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-karma.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 180017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/storage/usb-storage.ko 2023-07-20T09:34:57.469 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/ 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 105401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/ 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/ 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 153697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-20T09:34:57.470 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/vfio.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 75137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/ 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_net.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 86521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/vhost/vhost_scsi.ko 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/ 2023-07-20T09:34:57.471 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/ 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/apple_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-20T09:34:57.472 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/bd6107.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14769 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lcd.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-20T09:34:57.473 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/ 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ 2023-07-20T09:34:57.474 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ds2482.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/ds2490.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/ 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-20T09:34:57.475 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-20T09:34:57.476 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/w1/wire.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/acquirewdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19977 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/advantechwdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-20T09:34:57.477 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/dw_wdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/hpwdt.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/i6300esb.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-20T09:34:57.478 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ib700wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ibmasr.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/it87_wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/machzwd.ko 2023-07-20T09:34:57.479 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/nv_tco.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/retu_wdt.ko 2023-07-20T09:34:57.480 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/softdog.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-20T09:34:57.481 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/via_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wdt_pci.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-20T09:34:57.482 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/watchdog/xen_wdt.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/ 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-evtchn.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-gntalloc.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-gntdev.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-pciback/ 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 176417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-20T09:34:57.483 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-privcmd.ko 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 71321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xen-scsiback.ko 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xenfs/ 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/9p/ 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 165697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/9p/9p.ko 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/adfs/ 2023-07-20T09:34:57.484 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/adfs/adfs.ko 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/affs/ 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 162617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/affs/affs.ko 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/afs/ 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 931937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/afs/kafs.ko 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/autofs/ 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/autofs/autofs4.ko 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/befs/ 2023-07-20T09:34:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 64481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/befs/befs.ko 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/bfs/ 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/bfs/bfs.ko 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/binfmt_misc.ko 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/btrfs/ 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 3468681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/btrfs/btrfs.ko 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cachefiles/ 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 305745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cachefiles/cachefiles.ko 2023-07-20T09:34:57.486 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ceph/ 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1312545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ceph/ceph.ko 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/coda/ 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/coda/coda.ko 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/configfs/ 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/configfs/configfs.ko 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cramfs/ 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/cramfs/cramfs.ko 2023-07-20T09:34:57.487 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/dlm/ 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 633825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/dlm/dlm.ko 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/efs/ 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/efs/efs.ko 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/f2fs/ 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1500513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/f2fs/f2fs.ko 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fat/ 2023-07-20T09:34:57.488 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fat/msdos.ko 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/freevxfs/ 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/freevxfs/freevxfs.ko 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fscache/ 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 226505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fscache/fscache.ko 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fuse/ 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/fuse/cuse.ko 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/gfs2/ 2023-07-20T09:34:57.489 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1226249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/gfs2/gfs2.ko 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfs/ 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 141241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfs/hfs.ko 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfsplus/ 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 221553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hfsplus/hfsplus.ko 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hpfs/ 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 193577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/hpfs/hpfs.ko 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/isofs/ 2023-07-20T09:34:57.490 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/isofs/isofs.ko 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/jfs/ 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 420745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/jfs/jfs.ko 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/lockd/ 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 279041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/lockd/lockd.ko 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/minix/ 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 87897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/minix/minix.ko 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/netfs/ 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/netfs/netfs.ko 2023-07-20T09:34:57.491 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/ 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/blocklayout/ 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/filelayout/ 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/flexfilelayout/ 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 117705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-20T09:34:57.492 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1053889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfs.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv2.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv3.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2041809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs/nfsv4.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/ 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/grace.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfs_common/nfs_acl.ko 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfsd/ 2023-07-20T09:34:57.493 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1504993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nfsd/nfsd.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nilfs2/ 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 591417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nilfs2/nilfs2.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/ 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-celtic.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-centeuro.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-croatian.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-cyrillic.ko 2023-07-20T09:34:57.494 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-gaelic.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-greek.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-iceland.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-inuit.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-roman.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-romanian.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/mac-turkish.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_ascii.ko 2023-07-20T09:34:57.495 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1250.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1251.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp1255.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp737.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp775.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp850.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp852.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp855.ko 2023-07-20T09:34:57.496 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp857.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp860.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp861.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp862.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp863.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp864.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp865.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp866.ko 2023-07-20T09:34:57.497 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp869.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp874.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 94137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp932.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 142673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp936.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 165745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp949.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 118121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_cp950.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_euc-jp.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-1.ko 2023-07-20T09:34:57.498 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-13.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-14.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-15.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-2.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-3.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-4.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-5.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-6.ko 2023-07-20T09:34:57.499 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-7.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_iso8859-9.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-r.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-ru.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_koi8-u.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/nls/nls_utf8.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ntfs/ 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 219073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ntfs/ntfs.ko 2023-07-20T09:34:57.500 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/cluster/ 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 244177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlm/ 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 440785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlmfs/ 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2589569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2.ko 2023-07-20T09:34:57.501 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/omfs/ 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 52569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/omfs/omfs.ko 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/overlayfs/ 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 336473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/overlayfs/overlay.ko 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/pstore/ 2023-07-20T09:34:57.502 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/pstore/ramoops.ko 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx4/ 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx4/qnx4.ko 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx6/ 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 46649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/qnx6/qnx6.ko 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/ 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_tree.ko 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_v1.ko 2023-07-20T09:34:57.503 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/quota/quota_v2.ko 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/reiserfs/ 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 530697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/reiserfs/reiserfs.ko 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/romfs/ 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/romfs/romfs.ko 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/ 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/client/ 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 2658777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/client/cifs.ko 2023-07-20T09:34:57.504 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/ 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/cifs_arc4.ko 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/smb/common/cifs_md4.ko 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/squashfs/ 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 134313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/squashfs/squashfs.ko 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/sysv/ 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/sysv/sysv.ko 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/udf/ 2023-07-20T09:34:57.505 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 248049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/udf/udf.ko 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ufs/ 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 160857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/ufs/ufs.ko 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/xfs/ 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 3998129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/fs/xfs/xfs.ko 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/ 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/locking/ 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 74865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/locking/locktorture.ko 2023-07-20T09:34:57.506 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/time/ 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/time/test_udelay.ko 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 58473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/kernel/torture.ko 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc-itu-t.ko 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc7.ko 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crc8.ko 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/ 2023-07-20T09:34:57.507 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/libarc4.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/crypto/libdes.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/interval_tree_test.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/libcrc32c.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lru_cache.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/ 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/lz4_compress.ko 2023-07-20T09:34:57.508 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/lz4/lz4hc_compress.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/math/ 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/math/cordic.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/memory-notifier-error-inject.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/notifier-error-inject.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/percpu_test.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/pm-notifier-error-inject.ko 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/raid6/ 2023-07-20T09:34:57.509 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 143433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/raid6/raid6_pq.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/rbtree_test.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/reed_solomon/ 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test-kstrtox.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test-string_helpers.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 4760825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_bpf.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_firmware.ko 2023-07-20T09:34:57.510 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_module.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/test_user_copy.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_bm.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_fsm.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/ts_kmp.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/xz/ 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/lib/xz/xz_dec_test.ko 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/mm/ 2023-07-20T09:34:57.511 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/mm/hwpoison-inject.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/ 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/6lowpan.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_dest.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_fragment.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_hop.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 6985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-20T09:34:57.512 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_mobility.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_routing.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/6lowpan/nhc_udp.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/ 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/garp.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/mrp.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/p8022.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/psnap.ko 2023-07-20T09:34:57.513 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/802/stp.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/8021q/ 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 81017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/8021q/8021q.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/ 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 198417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_fd.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_rdma.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/9p/9pnet_virtio.ko 2023-07-20T09:34:57.514 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/batman-adv/ 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 652553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/batman-adv/batman-adv.ko 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/ 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 63825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/br_netfilter.ko 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 772505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/bridge.ko 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-20T09:34:57.515 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7585 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-20T09:34:57.516 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8385 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-20T09:34:57.517 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 55937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/ebtables.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ceph/ 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1046417 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ceph/libceph.ko 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/core/ 2023-07-20T09:34:57.518 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 124793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/core/pktgen.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/ 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 194321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8665 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_diag.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 56945 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_ipv4.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dccp/dccp_ipv6.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/ 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 390297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/dsa_core.ko 2023-07-20T09:34:57.519 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_brcm.ko 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_dsa.ko 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_none.ko 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/dsa/tag_trailer.ko 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/hsr/ 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 100257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/hsr/hsr.ko 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/6lowpan/ 2023-07-20T09:34:57.520 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 45169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 254601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ieee802154.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ah4.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/esp4.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/fou.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/gre.ko 2023-07-20T09:34:57.521 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/inet_diag.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 60529 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_gre.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61281 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_tunnel.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ip_vti.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ipcomp.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28889 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/ipip.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-20T09:34:57.522 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-20T09:34:57.523 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-20T09:34:57.524 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20561 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15225 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-20T09:34:57.525 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_bic.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_dctcp.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_diag.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_highspeed.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_htcp.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_hybla.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_illinois.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_lp.ko 2023-07-20T09:34:57.526 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_scalable.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_vegas.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_veno.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_westwood.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tcp_yeah.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/tunnel4.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/udp_diag.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 41577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/udp_tunnel.ko 2023-07-20T09:34:57.527 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ah6.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/esp6.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/fou6.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 80793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_gre.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 92817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_tunnel.ko 2023-07-20T09:34:57.528 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ip6_vti.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/ipcomp6.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/mip6.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 42209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-20T09:34:57.529 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8913 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10937 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-20T09:34:57.530 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-20T09:34:57.531 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9009 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 73161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/sit.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24193 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/tunnel6.ko 2023-07-20T09:34:57.532 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23305 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/key/ 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 82929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/key/af_key.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/ 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_core.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 25865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_eth.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35049 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ip.ko 2023-07-20T09:34:57.533 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ip6.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_netlink.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 53153 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/l2tp/l2tp_ppp.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/lapb/ 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/lapb/lapb.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/ 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/llc.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 267017 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/llc/llc2.ko 2023-07-20T09:34:57.534 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mac802154/ 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 291041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mac802154/mac802154.ko 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mpls/ 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/mpls/mpls_gso.ko 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 119649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set.ko 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-20T09:34:57.535 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 103121 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 104593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 105129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 114393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-20T09:34:57.536 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 111161 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 114673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 114329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 113217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 116217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 412481 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-20T09:34:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10681 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-20T09:34:57.538 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7697 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10993 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conncount.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 408689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-20T09:34:57.539 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10177 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 118145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 108393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-20T09:34:57.540 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 66641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10113 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 88513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_flow_table.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9593 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_log_syslog.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 95353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat.ko 2023-07-20T09:34:57.541 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_irc.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28929 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_sip.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 44025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 592185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nf_tables.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink.ko 2023-07-20T09:34:57.542 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 39905 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_log.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22713 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 49673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_chain_nat.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_compat.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 40721 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_ct.ko 2023-07-20T09:34:57.543 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11345 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_fib.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13745 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14185 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_hash.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_limit.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_log.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_masq.ko 2023-07-20T09:34:57.544 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_nat.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_numgen.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_osf.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_queue.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_redir.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_reject.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_reject_inet.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12737 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_socket.ko 2023-07-20T09:34:57.545 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20393 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_synproxy.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14849 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/nft_tproxy.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 89329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/x_tables.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_AUDIT.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 18169 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_CT.ko 2023-07-20T09:34:57.546 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10497 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_DSCP.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_HL.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_HMARK.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 38857 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13873 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_LED.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11489 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_LOG.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NETMAP.ko 2023-07-20T09:34:57.547 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NFLOG.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13289 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19689 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_RATEEST.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 14337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_SECMARK.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TEE.ko 2023-07-20T09:34:57.548 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TPROXY.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_TRACE.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_addrtype.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_bpf.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15577 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cgroup.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11209 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cluster.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_comment.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10465 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connbytes.ko 2023-07-20T09:34:57.549 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connlabel.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connlimit.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_connmark.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_conntrack.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_cpu.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_dccp.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_devgroup.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8801 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_dscp.ko 2023-07-20T09:34:57.550 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ecn.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_esp.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_hashlimit.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_helper.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7865 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_hl.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11921 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ipcomp.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_iprange.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11785 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_ipvs.ko 2023-07-20T09:34:57.551 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16041 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_l2tp.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8001 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_length.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10273 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_limit.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_mac.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8641 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_mark.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_multiport.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_nat.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_nfacct.ko 2023-07-20T09:34:57.552 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8297 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_osf.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_owner.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_physdev.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7633 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_pkttype.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_policy.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_quota.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_rateest.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8257 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_realm.ko 2023-07-20T09:34:57.553 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_recent.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13329 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_sctp.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 30089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_set.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16089 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_socket.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9505 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_state.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9473 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_statistic.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_string.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 8553 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_tcpmss.ko 2023-07-20T09:34:57.554 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15777 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_tcpudp.ko 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11129 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_time.ko 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9105 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netfilter/xt_u32.ko 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netlink/ 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13969 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/netlink/netlink_diag.ko 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/nsh/ 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 12425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/nsh/nsh.ko 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/ 2023-07-20T09:34:57.555 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 379545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/openvswitch.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10321 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-geneve.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-gre.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 11793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/openvswitch/vport-vxlan.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/packet/ 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/packet/af_packet_diag.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/ 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 109961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/phonet.ko 2023-07-20T09:34:57.556 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 54761 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/phonet/pn_pep.ko 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/ 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 252825 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds.ko 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 165081 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds_rdma.ko 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 67241 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rds/rds_tcp.ko 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rxrpc/ 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 820137 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/rxrpc/rxrpc.ko 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/ 2023-07-20T09:34:57.557 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_csum.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23537 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_gact.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_ipt.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 34057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_mirred.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_nat.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 43817 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_pedit.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_police.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20313 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_simple.ko 2023-07-20T09:34:57.558 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36353 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_skbedit.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 36057 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/act_vlan.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26145 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_basic.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33673 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_bpf.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_cgroup.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31377 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_flow.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_fw.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 37953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_route.ko 2023-07-20T09:34:57.559 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 59217 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/cls_u32.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7441 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_cmp.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 13457 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_ipset.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33337 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_meta.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_nbyte.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10625 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_text.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7249 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/em_u32.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 21649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_choke.ko 2023-07-20T09:34:57.560 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20961 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_codel.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33753 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_drr.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 33609 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_fq.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_fq_codel.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35433 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_gred.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 48409 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_hfsc.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22073 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_hhf.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 65793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_htb.ko 2023-07-20T09:34:57.561 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 16065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_ingress.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 29809 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_mqprio.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10793 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_mqprio_lib.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26065 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_multiq.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 35601 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_netem.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27545 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_pie.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_plug.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 24729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_prio.ko 2023-07-20T09:34:57.562 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 47617 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_qfq.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 32953 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_red.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 26881 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_sfb.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 31425 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_sfq.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 28897 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_tbf.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 27729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sched/sch_teql.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/ 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 930369 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/sctp.ko 2023-07-20T09:34:57.563 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 19033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sctp/sctp_diag.ko 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/ 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/ 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 335569 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 61833 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 1514649 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/sunrpc.ko 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/xprtrdma/ 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 707401 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-20T09:34:57.564 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/ 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10025 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/diag.ko 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 862233 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/tipc/tipc.ko 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/unix/ 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15729 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/unix/unix_diag.ko 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/ 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 84841 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 68033 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-20T09:34:57.565 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 95985 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 10705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 17521 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/x25/ 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 125097 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/x25/x25.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/ 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 22657 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_algo.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 20705 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-20T09:34:57.566 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 102265 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/net/xfrm/xfrm_user.ko 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/ 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/lib/ 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 15513 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/kernel/virt/lib/irqbypass.ko 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 638200 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.alias 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 623896 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.alias.bin 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 7656 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 23361 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.alias.bin 2023-07-20T09:34:57.567 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 9821 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.bin 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 69903 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.builtin.modinfo 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 146449 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.dep 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 232695 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.dep.bin 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 210 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.devname 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 72754 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.order 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 879 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.softdep 2023-07-20T09:34:57.568 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 252883 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.symbols 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 307884 2023-07-20 06:00 ./lib/modules/6.5.0-rc1-g8c15ad6dab84/modules.symbols.bin 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/ 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/ 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/doc/ 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x root/root 0 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/ 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 174 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/changelog.Debian.gz 2023-07-20T09:34:57.569 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r-- root/root 691 2023-07-20 06:00 ./usr/share/doc/linux-image-6.5.0-rc1-g8c15ad6dab84/copyright 2023-07-20T09:34:57.570 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.570 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.571 DEBUG:teuthology.orchestra.run.smithi082:> egrep '(submenu|menuentry.*6.5.0-rc1-g8c15ad6dab84).*{' /boot/grub/grub.cfg 2023-07-20T09:34:57.577 INFO:teuthology.orchestra.run.smithi082.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:34:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-g8c15ad6dab84-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:34:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-g8c15ad6dab84-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-20T09:34:57.578 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-20T09:34:57.578 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:57.578 DEBUG:teuthology.orchestra.run.smithi082:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-20T09:34:57.619 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi082.front.sepia.ceph.com to complete... 2023-07-20T09:34:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub' 2023-07-20T09:34:58.010 INFO:teuthology.orchestra.run.smithi082.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-20T09:34:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2023-07-20T09:34:58.218 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:58.224 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:34:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-20T09:34:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-20T09:34:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-20T09:34:58.494 INFO:teuthology.orchestra.run.smithi082.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-20T09:34:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-20T09:34:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-20T09:34:58.601 INFO:teuthology.orchestra.run.smithi082.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-20T09:34:58.625 INFO:teuthology.orchestra.run.smithi082.stderr:done 2023-07-20T09:34:59.762 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-20T09:35:17.501 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-07-20T09:35:18.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:35:18.460 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-g8c15ad6dab84"... 2023-07-20T09:35:18.461 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-07-20T09:35:18.469 INFO:teuthology.orchestra.run.smithi183.stdout:6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:35:18.469 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-g8c15ad6dab84 vs 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:35:18.469 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-20T09:35:18.469 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-20T09:35:19.470 DEBUG:teuthology.parallel:result is None 2023-07-20T09:35:29.765 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-20T09:35:29.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:35:29.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:35:48.080 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-20T09:35:57.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:35:57.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:36:00.148 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-20T09:36:12.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:36:12.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:36:30.576 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-20T09:36:45.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:36:45.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:36:45.820 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-07-20T09:36:46.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:36:46.755 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-g8c15ad6dab84"... 2023-07-20T09:36:46.755 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2023-07-20T09:36:46.807 INFO:teuthology.orchestra.run.smithi082.stdout:6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:36:46.808 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-g8c15ad6dab84 vs 6.5.0-rc1-g8c15ad6dab84 2023-07-20T09:36:46.808 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-20T09:36:46.808 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-20T09:36:47.809 DEBUG:teuthology.parallel:result is None 2023-07-20T09:36:47.809 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-20T09:36:47.818 INFO:teuthology.task.internal:Creating test directory... 2023-07-20T09:36:47.818 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-20T09:36:47.822 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-20T09:36:47.833 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-20T09:36:47.852 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-20T09:36:47.859 INFO:teuthology.task.internal:Creating archive directory... 2023-07-20T09:36:47.859 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-20T09:36:47.875 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-20T09:36:48.182 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-20T09:36:48.189 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-20T09:36:48.190 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-20T09:36:48.193 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-20T09:36:48.275 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T09:36:48.299 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T09:36:48.306 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T09:36:48.326 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-20T09:36:48.328 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-20T09:36:48.335 INFO:teuthology.task.internal:Configuring sudo... 2023-07-20T09:36:48.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-20T09:36:48.339 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-20T09:36:48.361 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-20T09:36:48.370 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-20T09:36:48.371 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-20T09:36:48.403 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-20T09:36:48.412 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T09:36:48.460 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T09:36:48.512 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:36:48.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-20T09:36:48.589 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-20T09:36:48.599 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-20T09:36:48.655 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:36:48.656 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-20T09:36:48.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2023-07-20T09:36:48.739 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-07-20T09:36:48.872 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-20T09:36:48.880 INFO:teuthology.task.internal:Starting timer... 2023-07-20T09:36:48.880 INFO:teuthology.run_tasks:Running task pcp... 2023-07-20T09:36:48.890 INFO:teuthology.run_tasks:Running task selinux... 2023-07-20T09:36:48.898 DEBUG:teuthology.task.selinux:Excluding smithi082: OS 'ubuntu' does not support SELinux 2023-07-20T09:36:48.898 DEBUG:teuthology.task.selinux:Excluding smithi183: OS 'ubuntu' does not support SELinux 2023-07-20T09:36:48.899 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-20T09:36:48.899 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-20T09:36:48.899 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-20T09:36:48.899 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-20T09:36:48.907 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-20T09:36:48.916 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-20T09:36:49.057 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-20T09:36:49.079 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-20T09:36:49.080 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-20T09:45:40.477 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-07-20T09:45:40.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:45:40.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:45:40.561 DEBUG:teuthology.orchestra.run.smithi082:> true 2023-07-20T09:45:40.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2023-07-20T09:45:40.675 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:45:40.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T09:45:40.758 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-07-20T09:45:40.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-07-20T09:45:40.875 INFO:teuthology.run_tasks:Running task clock... 2023-07-20T09:45:40.891 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-20T09:45:40.892 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-20T09:45:40.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T09:45:40.897 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-20T09:45:40.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T09:45:40.934 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Command line: ntpd -gq 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: ---------------------------------------------------- 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: ntp-4 is maintained by Network Time Foundation, 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: corporation. Support and training for ntp-4 are 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: available at https://www.nwtime.org/support 2023-07-20T09:45:40.935 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: ---------------------------------------------------- 2023-07-20T09:45:40.936 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: proto: precision = 0.042 usec (-24) 2023-07-20T09:45:40.936 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: basedate set to 2022-02-04 2023-07-20T09:45:40.937 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: gps base set to 2022-02-06 (week 2196) 2023-07-20T09:45:40.937 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-20T09:45:40.937 INFO:teuthology.orchestra.run.smithi082.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-20T09:45:40.938 INFO:teuthology.orchestra.run.smithi082.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-20T09:45:40.938 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: restrict ::: KOD does nothing without LIMITED. 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen and drop on 0 v6wildcard [::]:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen normally on 2 lo 127.0.0.1:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen normally on 3 enp3s0f1 172.21.15.82:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen normally on 4 lo [::1]:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3ff%5]:123 2023-07-20T09:45:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:40 ntpd[27439]: Listening on routing socket on fd #22 for interface updates 2023-07-20T09:45:40.958 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-20T09:45:40.958 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Command line: ntpd -gq 2023-07-20T09:45:40.958 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: ---------------------------------------------------- 2023-07-20T09:45:40.958 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: ntp-4 is maintained by Network Time Foundation, 2023-07-20T09:45:40.959 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-20T09:45:40.959 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: corporation. Support and training for ntp-4 are 2023-07-20T09:45:40.959 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: available at https://www.nwtime.org/support 2023-07-20T09:45:40.960 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: ---------------------------------------------------- 2023-07-20T09:45:40.960 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: proto: precision = 0.042 usec (-24) 2023-07-20T09:45:40.961 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: basedate set to 2022-02-04 2023-07-20T09:45:40.961 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: gps base set to 2022-02-06 (week 2196) 2023-07-20T09:45:40.961 INFO:teuthology.orchestra.run.smithi183.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-20T09:45:40.962 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-20T09:45:40.962 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: restrict ::: KOD does nothing without LIMITED. 2023-07-20T09:45:40.962 INFO:teuthology.orchestra.run.smithi183.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-20T09:45:40.963 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen and drop on 0 v6wildcard [::]:123 2023-07-20T09:45:40.963 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-20T09:45:40.963 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen normally on 2 lo 127.0.0.1:123 2023-07-20T09:45:40.963 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen normally on 3 enp3s0f1 172.21.15.183:123 2023-07-20T09:45:40.964 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen normally on 4 lo [::1]:123 2023-07-20T09:45:40.964 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8085%5]:123 2023-07-20T09:45:40.964 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:40 ntpd[27444]: Listening on routing socket on fd #22 for interface updates 2023-07-20T09:45:41.957 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:41.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:41.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:41.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:41.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:41.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:41 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:42 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:43.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:43.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:43.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:43.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:43.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:43.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:43 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:43.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:43.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:43.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:43.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:43.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:43.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:43 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:44.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:44.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:44.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:44 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:44.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:44.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:44.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:44.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:44 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:45.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:45 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:45.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:45.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:45 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:46.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:46.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:46 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:46.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:46.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:46.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:46.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:46 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:47.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:47.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:47.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:47.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:47.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:47 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:47.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:47.958 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:47.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:47.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:47.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:47.959 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:47.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:47.960 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:47.961 INFO:teuthology.orchestra.run.smithi183.stdout:20 Jul 09:45:47 ntpd[27444]: ntpd: time slew -0.000917 s 2023-07-20T09:45:47.961 INFO:teuthology.orchestra.run.smithi183.stdout:ntpd: time slew -0.000917s 2023-07-20T09:45:47.962 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-20T09:45:47.962 INFO:teuthology.orchestra.run.smithi183.stderr:20 Jul 09:45:47 ntpd[27444]: can't open /var/log/ntpstats/loopstats.20230720: Permission denied 2023-07-20T09:45:48.051 INFO:teuthology.orchestra.run.smithi183.stdout: remote refid st t when poll reach delay offset jitter 2023-07-20T09:45:48.052 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================== 2023-07-20T09:45:48.052 INFO:teuthology.orchestra.run.smithi183.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:48.052 INFO:teuthology.orchestra.run.smithi183.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:48.052 INFO:teuthology.orchestra.run.smithi183.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:48.053 INFO:teuthology.orchestra.run.smithi183.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:48.935 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:48.936 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:48.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-20T09:45:48.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/rawstats.20230720: Permission denied 2023-07-20T09:45:48.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-20T09:45:48.937 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/peerstats.20230720: Permission denied 2023-07-20T09:45:48.937 INFO:teuthology.orchestra.run.smithi082.stdout:20 Jul 09:45:48 ntpd[27439]: ntpd: time slew -0.001027 s 2023-07-20T09:45:48.938 INFO:teuthology.orchestra.run.smithi082.stdout:ntpd: time slew -0.001027s 2023-07-20T09:45:48.938 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-20T09:45:48.939 INFO:teuthology.orchestra.run.smithi082.stderr:20 Jul 09:45:48 ntpd[27439]: can't open /var/log/ntpstats/loopstats.20230720: Permission denied 2023-07-20T09:45:49.027 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-07-20T09:45:49.027 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-07-20T09:45:49.028 INFO:teuthology.orchestra.run.smithi082.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:49.028 INFO:teuthology.orchestra.run.smithi082.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:49.028 INFO:teuthology.orchestra.run.smithi082.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:49.028 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-20T09:45:49.029 INFO:teuthology.run_tasks:Running task install... 2023-07-20T09:45:49.039 DEBUG:teuthology.task.install:project ceph 2023-07-20T09:45:49.040 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}} 2023-07-20T09:45:49.040 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'} 2023-07-20T09:45:49.040 INFO:teuthology.task.install:Using flavor: default 2023-07-20T09:45:49.052 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-20T09:45:49.053 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-20T09:45:49.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-key list | grep Ceph 2023-07-20T09:45:49.055 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-key list | grep Ceph 2023-07-20T09:45:49.166 INFO:teuthology.orchestra.run.smithi183.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-20T09:45:49.180 INFO:teuthology.orchestra.run.smithi082.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-20T09:45:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-20T09:45:49.220 INFO:teuthology.orchestra.run.smithi183.stdout:uid [ unknown] Ceph.com (release key) 2023-07-20T09:45:49.221 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-20T09:45:49.221 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-20T09:45:49.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-20T09:45:49.236 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-20T09:45:49.237 INFO:teuthology.orchestra.run.smithi082.stdout:uid [ unknown] Ceph.com (release key) 2023-07-20T09:45:49.237 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-20T09:45:49.237 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-20T09:45:49.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-20T09:45:49.448 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default/ 2023-07-20T09:45:49.449 INFO:teuthology.task.install.deb:Package version is 18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:45:49.466 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default/ 2023-07-20T09:45:49.466 INFO:teuthology.task.install.deb:Package version is 18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:45:49.638 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:45:49.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-20T09:45:49.650 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:45:49.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-20T09:45:49.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo apt-get update 2023-07-20T09:45:49.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo apt-get update 2023-07-20T09:45:49.869 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-20T09:45:49.882 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-20T09:45:49.896 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-20T09:45:49.901 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-20T09:45:49.918 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-20T09:45:49.949 INFO:teuthology.orchestra.run.smithi183.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-20T09:45:49.970 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-20T09:45:50.067 INFO:teuthology.orchestra.run.smithi082.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-20T09:45:50.076 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy InRelease 2023-07-20T09:45:50.078 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy InRelease 2023-07-20T09:45:50.139 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-20T09:45:50.141 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-20T09:45:50.210 INFO:teuthology.orchestra.run.smithi082.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-20T09:45:50.213 INFO:teuthology.orchestra.run.smithi183.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-20T09:45:50.290 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-20T09:45:50.312 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-07-20T09:45:50.374 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-07-20T09:45:50.394 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-20T09:45:50.500 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 28.5 kB in 1s (46.5 kB/s) 2023-07-20T09:45:50.513 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 28.5 kB in 1s (46.4 kB/s) 2023-07-20T09:45:51.381 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-07-20T09:45:51.382 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-07-20T09:45:51.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5042-ge2c50893-1jammy cephadm=18.0.0-5042-ge2c50893-1jammy ceph-mds=18.0.0-5042-ge2c50893-1jammy ceph-mgr=18.0.0-5042-ge2c50893-1jammy ceph-common=18.0.0-5042-ge2c50893-1jammy ceph-fuse=18.0.0-5042-ge2c50893-1jammy ceph-test=18.0.0-5042-ge2c50893-1jammy ceph-volume=18.0.0-5042-ge2c50893-1jammy radosgw=18.0.0-5042-ge2c50893-1jammy python3-rados=18.0.0-5042-ge2c50893-1jammy python3-rgw=18.0.0-5042-ge2c50893-1jammy python3-cephfs=18.0.0-5042-ge2c50893-1jammy python3-rbd=18.0.0-5042-ge2c50893-1jammy libcephfs2=18.0.0-5042-ge2c50893-1jammy libcephfs-dev=18.0.0-5042-ge2c50893-1jammy librados2=18.0.0-5042-ge2c50893-1jammy librbd1=18.0.0-5042-ge2c50893-1jammy rbd-fuse=18.0.0-5042-ge2c50893-1jammy python3-cephfs=18.0.0-5042-ge2c50893-1jammy cephfs-shell=18.0.0-5042-ge2c50893-1jammy cephfs-top=18.0.0-5042-ge2c50893-1jammy cephfs-mirror=18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:45:51.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5042-ge2c50893-1jammy cephadm=18.0.0-5042-ge2c50893-1jammy ceph-mds=18.0.0-5042-ge2c50893-1jammy ceph-mgr=18.0.0-5042-ge2c50893-1jammy ceph-common=18.0.0-5042-ge2c50893-1jammy ceph-fuse=18.0.0-5042-ge2c50893-1jammy ceph-test=18.0.0-5042-ge2c50893-1jammy ceph-volume=18.0.0-5042-ge2c50893-1jammy radosgw=18.0.0-5042-ge2c50893-1jammy python3-rados=18.0.0-5042-ge2c50893-1jammy python3-rgw=18.0.0-5042-ge2c50893-1jammy python3-cephfs=18.0.0-5042-ge2c50893-1jammy python3-rbd=18.0.0-5042-ge2c50893-1jammy libcephfs2=18.0.0-5042-ge2c50893-1jammy libcephfs-dev=18.0.0-5042-ge2c50893-1jammy librados2=18.0.0-5042-ge2c50893-1jammy librbd1=18.0.0-5042-ge2c50893-1jammy rbd-fuse=18.0.0-5042-ge2c50893-1jammy python3-cephfs=18.0.0-5042-ge2c50893-1jammy cephfs-shell=18.0.0-5042-ge2c50893-1jammy cephfs-top=18.0.0-5042-ge2c50893-1jammy cephfs-mirror=18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:45:51.474 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-07-20T09:45:51.475 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-07-20T09:45:51.631 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2023-07-20T09:45:51.632 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2023-07-20T09:45:51.636 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-07-20T09:45:51.637 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-07-20T09:45:51.776 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2023-07-20T09:45:51.776 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-20T09:45:51.776 INFO:teuthology.orchestra.run.smithi183.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-20T09:45:51.776 INFO:teuthology.orchestra.run.smithi183.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-20T09:45:51.776 INFO:teuthology.orchestra.run.smithi183.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-20T09:45:51.778 INFO:teuthology.orchestra.run.smithi183.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-20T09:45:51.778 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-20T09:45:51.778 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2023-07-20T09:45:51.778 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-20T09:45:51.779 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-20T09:45:51.780 INFO:teuthology.orchestra.run.smithi183.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-20T09:45:51.780 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-20T09:45:51.780 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-20T09:45:51.781 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-20T09:45:51.782 INFO:teuthology.orchestra.run.smithi183.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-20T09:45:51.782 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-20T09:45:51.782 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-20T09:45:51.782 INFO:teuthology.orchestra.run.smithi183.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-20T09:45:51.782 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-20T09:45:51.783 INFO:teuthology.orchestra.run.smithi183.stdout: python3-watchdog 2023-07-20T09:45:51.784 INFO:teuthology.orchestra.run.smithi183.stdout:Recommended packages: 2023-07-20T09:45:51.784 INFO:teuthology.orchestra.run.smithi183.stdout: btrfs-tools 2023-07-20T09:45:51.787 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-07-20T09:45:51.788 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-20T09:45:51.788 INFO:teuthology.orchestra.run.smithi082.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-20T09:45:51.788 INFO:teuthology.orchestra.run.smithi082.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-20T09:45:51.789 INFO:teuthology.orchestra.run.smithi082.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-20T09:45:51.789 INFO:teuthology.orchestra.run.smithi082.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-20T09:45:51.789 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-20T09:45:51.789 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-07-20T09:45:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-20T09:45:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-20T09:45:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-20T09:45:51.790 INFO:teuthology.orchestra.run.smithi082.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-20T09:45:51.791 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-20T09:45:51.792 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-20T09:45:51.793 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-20T09:45:51.794 INFO:teuthology.orchestra.run.smithi082.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout: python3-watchdog 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout:Recommended packages: 2023-07-20T09:45:51.795 INFO:teuthology.orchestra.run.smithi082.stdout: btrfs-tools 2023-07-20T09:45:51.919 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2023-07-20T09:45:51.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-20T09:45:51.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-20T09:45:51.919 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-20T09:45:51.919 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-20T09:45:51.920 INFO:teuthology.orchestra.run.smithi183.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-20T09:45:51.920 INFO:teuthology.orchestra.run.smithi183.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-20T09:45:51.920 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-20T09:45:51.921 INFO:teuthology.orchestra.run.smithi183.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-20T09:45:51.921 INFO:teuthology.orchestra.run.smithi183.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-20T09:45:51.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-20T09:45:51.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-20T09:45:51.921 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-20T09:45:51.922 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-20T09:45:51.923 INFO:teuthology.orchestra.run.smithi183.stdout: socat xmlstarlet 2023-07-20T09:45:51.932 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-07-20T09:45:51.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-20T09:45:51.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-20T09:45:51.932 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-20T09:45:51.933 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-20T09:45:51.934 INFO:teuthology.orchestra.run.smithi082.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-20T09:45:51.934 INFO:teuthology.orchestra.run.smithi082.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-20T09:45:51.934 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-20T09:45:51.934 INFO:teuthology.orchestra.run.smithi082.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-20T09:45:51.934 INFO:teuthology.orchestra.run.smithi082.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-20T09:45:51.935 INFO:teuthology.orchestra.run.smithi082.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-20T09:45:51.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-20T09:45:51.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-20T09:45:51.936 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-20T09:45:51.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-20T09:45:51.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-20T09:45:51.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-20T09:45:51.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-20T09:45:51.937 INFO:teuthology.orchestra.run.smithi082.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-20T09:45:51.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-20T09:45:51.938 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-20T09:45:51.938 INFO:teuthology.orchestra.run.smithi082.stdout: socat xmlstarlet 2023-07-20T09:45:52.012 INFO:teuthology.orchestra.run.smithi183.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-20T09:45:52.013 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 183 MB of archives. 2023-07-20T09:45:52.013 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 821 MB of additional disk space will be used. 2023-07-20T09:45:52.013 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-20T09:45:52.043 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-20T09:45:52.063 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-20T09:45:52.142 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-20T09:45:52.151 INFO:teuthology.orchestra.run.smithi082.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-20T09:45:52.151 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 183 MB of archives. 2023-07-20T09:45:52.151 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 821 MB of additional disk space will be used. 2023-07-20T09:45:52.151 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-20T09:45:52.160 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-20T09:45:52.200 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-20T09:45:52.204 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-20T09:45:52.220 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-5042-ge2c50893-1jammy [3,409 kB] 2023-07-20T09:45:52.222 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-5042-ge2c50893-1jammy [3,409 kB] 2023-07-20T09:45:52.223 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-20T09:45:52.255 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-20T09:45:52.312 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-20T09:45:52.316 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-20T09:45:52.321 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-20T09:45:52.348 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-20T09:45:52.434 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-20T09:45:52.539 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-20T09:45:52.554 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-20T09:45:52.601 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-20T09:45:52.704 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-20T09:45:52.720 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-20T09:45:52.738 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-20T09:45:52.744 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-20T09:45:52.745 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-20T09:45:52.751 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-20T09:45:52.752 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-20T09:45:52.753 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-20T09:45:52.754 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-20T09:45:52.755 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-20T09:45:52.755 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-20T09:45:52.792 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-20T09:45:52.949 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-20T09:45:53.189 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-20T09:45:53.191 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-20T09:45:53.199 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-20T09:45:53.328 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-20T09:45:53.354 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-20T09:45:53.367 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-20T09:45:53.381 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-20T09:45:53.419 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-20T09:45:53.427 INFO:teuthology.orchestra.run.smithi183.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-20T09:45:53.430 INFO:teuthology.orchestra.run.smithi183.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-20T09:45:53.477 INFO:teuthology.orchestra.run.smithi183.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-20T09:45:53.500 INFO:teuthology.orchestra.run.smithi183.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-20T09:45:53.510 INFO:teuthology.orchestra.run.smithi183.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-20T09:45:53.533 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-20T09:45:53.695 INFO:teuthology.orchestra.run.smithi183.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-20T09:45:53.720 INFO:teuthology.orchestra.run.smithi183.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-20T09:45:53.750 INFO:teuthology.orchestra.run.smithi183.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-20T09:45:53.772 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-20T09:45:53.774 INFO:teuthology.orchestra.run.smithi183.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-20T09:45:53.809 INFO:teuthology.orchestra.run.smithi183.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-20T09:45:53.834 INFO:teuthology.orchestra.run.smithi183.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-20T09:45:53.841 INFO:teuthology.orchestra.run.smithi183.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-20T09:45:53.848 INFO:teuthology.orchestra.run.smithi183.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-20T09:45:53.852 INFO:teuthology.orchestra.run.smithi183.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-20T09:45:53.864 INFO:teuthology.orchestra.run.smithi183.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-20T09:45:53.866 INFO:teuthology.orchestra.run.smithi183.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-20T09:45:53.925 INFO:teuthology.orchestra.run.smithi183.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-20T09:45:54.188 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-20T09:45:54.191 INFO:teuthology.orchestra.run.smithi183.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-20T09:45:54.192 INFO:teuthology.orchestra.run.smithi183.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-20T09:45:54.194 INFO:teuthology.orchestra.run.smithi183.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-20T09:45:54.195 INFO:teuthology.orchestra.run.smithi183.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-20T09:45:54.196 INFO:teuthology.orchestra.run.smithi183.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-20T09:45:54.197 INFO:teuthology.orchestra.run.smithi183.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-20T09:45:54.205 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-20T09:45:54.208 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-20T09:45:54.222 INFO:teuthology.orchestra.run.smithi183.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-20T09:45:54.224 INFO:teuthology.orchestra.run.smithi183.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-20T09:45:54.225 INFO:teuthology.orchestra.run.smithi183.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-20T09:45:54.233 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-20T09:45:54.233 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-20T09:45:54.234 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-20T09:45:54.238 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-20T09:45:54.241 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-20T09:45:54.243 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-20T09:45:54.256 INFO:teuthology.orchestra.run.smithi183.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-20T09:45:54.303 INFO:teuthology.orchestra.run.smithi183.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-20T09:45:54.379 INFO:teuthology.orchestra.run.smithi183.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-20T09:45:54.379 INFO:teuthology.orchestra.run.smithi183.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-5042-ge2c50893-1jammy [3,120 kB] 2023-07-20T09:45:54.386 INFO:teuthology.orchestra.run.smithi183.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-20T09:45:54.394 INFO:teuthology.orchestra.run.smithi183.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-20T09:45:54.410 INFO:teuthology.orchestra.run.smithi183.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-20T09:45:54.416 INFO:teuthology.orchestra.run.smithi183.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-20T09:45:54.419 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-20T09:45:54.423 INFO:teuthology.orchestra.run.smithi183.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-20T09:45:54.462 INFO:teuthology.orchestra.run.smithi183.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-20T09:45:54.473 INFO:teuthology.orchestra.run.smithi183.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-20T09:45:54.478 INFO:teuthology.orchestra.run.smithi183.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-20T09:45:54.481 INFO:teuthology.orchestra.run.smithi183.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-20T09:45:54.541 INFO:teuthology.orchestra.run.smithi183.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-20T09:45:54.682 INFO:teuthology.orchestra.run.smithi183.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-20T09:45:54.683 INFO:teuthology.orchestra.run.smithi183.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-20T09:45:54.724 INFO:teuthology.orchestra.run.smithi183.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-20T09:45:54.737 INFO:teuthology.orchestra.run.smithi183.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-20T09:45:54.738 INFO:teuthology.orchestra.run.smithi183.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-20T09:45:54.739 INFO:teuthology.orchestra.run.smithi183.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-20T09:45:54.739 INFO:teuthology.orchestra.run.smithi183.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-20T09:45:54.746 INFO:teuthology.orchestra.run.smithi183.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-20T09:45:54.747 INFO:teuthology.orchestra.run.smithi183.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-20T09:45:54.769 INFO:teuthology.orchestra.run.smithi183.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-20T09:45:54.817 INFO:teuthology.orchestra.run.smithi183.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-20T09:45:54.865 INFO:teuthology.orchestra.run.smithi183.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-20T09:45:54.874 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-20T09:45:54.884 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-20T09:45:54.890 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-20T09:45:54.895 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-20T09:45:54.915 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-20T09:45:54.917 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-20T09:45:54.919 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-20T09:45:54.944 INFO:teuthology.orchestra.run.smithi183.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-20T09:45:54.952 INFO:teuthology.orchestra.run.smithi183.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-20T09:45:54.963 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-20T09:45:54.978 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-20T09:45:54.983 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-20T09:45:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-5042-ge2c50893-1jammy [3,120 kB] 2023-07-20T09:45:55.249 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-20T09:45:55.337 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-20T09:45:55.433 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-20T09:45:55.501 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-20T09:45:55.631 INFO:teuthology.orchestra.run.smithi183.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-5042-ge2c50893-1jammy [658 kB] 2023-07-20T09:45:55.644 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-20T09:45:55.751 INFO:teuthology.orchestra.run.smithi082.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-20T09:45:55.773 INFO:teuthology.orchestra.run.smithi082.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-20T09:45:55.810 INFO:teuthology.orchestra.run.smithi082.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-20T09:45:55.824 INFO:teuthology.orchestra.run.smithi082.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-20T09:45:55.880 INFO:teuthology.orchestra.run.smithi082.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-20T09:45:55.887 INFO:teuthology.orchestra.run.smithi082.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-20T09:45:55.973 INFO:teuthology.orchestra.run.smithi183.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-5042-ge2c50893-1jammy [345 kB] 2023-07-20T09:45:56.121 INFO:teuthology.orchestra.run.smithi082.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-20T09:45:56.126 INFO:teuthology.orchestra.run.smithi183.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-5042-ge2c50893-1jammy [23.0 kB] 2023-07-20T09:45:56.141 INFO:teuthology.orchestra.run.smithi183.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-5042-ge2c50893-1jammy [170 kB] 2023-07-20T09:45:56.217 INFO:teuthology.orchestra.run.smithi183.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-5042-ge2c50893-1jammy [51.0 kB] 2023-07-20T09:45:56.235 INFO:teuthology.orchestra.run.smithi183.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-5042-ge2c50893-1jammy [318 kB] 2023-07-20T09:45:56.394 INFO:teuthology.orchestra.run.smithi183.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-5042-ge2c50893-1jammy [6,091 kB] 2023-07-20T09:45:57.167 INFO:teuthology.orchestra.run.smithi082.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-5042-ge2c50893-1jammy [658 kB] 2023-07-20T09:45:57.197 INFO:teuthology.orchestra.run.smithi082.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-20T09:45:57.199 INFO:teuthology.orchestra.run.smithi082.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-20T09:45:57.201 INFO:teuthology.orchestra.run.smithi082.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-20T09:45:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-20T09:45:57.202 INFO:teuthology.orchestra.run.smithi082.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-20T09:45:57.203 INFO:teuthology.orchestra.run.smithi082.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-20T09:45:57.410 INFO:teuthology.orchestra.run.smithi082.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-20T09:45:57.412 INFO:teuthology.orchestra.run.smithi082.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-20T09:45:57.413 INFO:teuthology.orchestra.run.smithi082.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-20T09:45:57.485 INFO:teuthology.orchestra.run.smithi082.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-20T09:45:57.708 INFO:teuthology.orchestra.run.smithi082.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-20T09:45:57.710 INFO:teuthology.orchestra.run.smithi082.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-5042-ge2c50893-1jammy [345 kB] 2023-07-20T09:45:58.095 INFO:teuthology.orchestra.run.smithi082.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-20T09:45:58.138 INFO:teuthology.orchestra.run.smithi082.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-20T09:45:58.171 INFO:teuthology.orchestra.run.smithi082.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-20T09:45:58.199 INFO:teuthology.orchestra.run.smithi082.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-5042-ge2c50893-1jammy [23.0 kB] 2023-07-20T09:45:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-20T09:45:58.259 INFO:teuthology.orchestra.run.smithi082.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-5042-ge2c50893-1jammy [170 kB] 2023-07-20T09:45:58.294 INFO:teuthology.orchestra.run.smithi082.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-20T09:45:58.424 INFO:teuthology.orchestra.run.smithi082.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-20T09:45:58.543 INFO:teuthology.orchestra.run.smithi082.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-20T09:45:58.625 INFO:teuthology.orchestra.run.smithi082.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-20T09:45:58.672 INFO:teuthology.orchestra.run.smithi082.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-5042-ge2c50893-1jammy [51.0 kB] 2023-07-20T09:45:58.745 INFO:teuthology.orchestra.run.smithi082.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-20T09:45:58.746 INFO:teuthology.orchestra.run.smithi082.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-20T09:45:58.752 INFO:teuthology.orchestra.run.smithi082.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-5042-ge2c50893-1jammy [318 kB] 2023-07-20T09:45:58.931 INFO:teuthology.orchestra.run.smithi082.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-20T09:45:59.165 INFO:teuthology.orchestra.run.smithi082.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-5042-ge2c50893-1jammy [6,091 kB] 2023-07-20T09:45:59.468 INFO:teuthology.orchestra.run.smithi082.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-20T09:45:59.473 INFO:teuthology.orchestra.run.smithi082.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-20T09:45:59.627 INFO:teuthology.orchestra.run.smithi082.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-20T09:45:59.682 INFO:teuthology.orchestra.run.smithi082.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-20T09:45:59.682 INFO:teuthology.orchestra.run.smithi082.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-20T09:45:59.683 INFO:teuthology.orchestra.run.smithi082.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-20T09:45:59.685 INFO:teuthology.orchestra.run.smithi082.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-20T09:45:59.714 INFO:teuthology.orchestra.run.smithi082.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-20T09:45:59.721 INFO:teuthology.orchestra.run.smithi082.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-20T09:45:59.792 INFO:teuthology.orchestra.run.smithi082.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-20T09:45:59.983 INFO:teuthology.orchestra.run.smithi082.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-20T09:46:00.173 INFO:teuthology.orchestra.run.smithi082.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-20T09:46:00.341 INFO:teuthology.orchestra.run.smithi183.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-5042-ge2c50893-1jammy [102 kB] 2023-07-20T09:46:00.392 INFO:teuthology.orchestra.run.smithi183.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-5042-ge2c50893-1jammy [428 kB] 2023-07-20T09:46:00.500 INFO:teuthology.orchestra.run.smithi082.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-20T09:46:00.531 INFO:teuthology.orchestra.run.smithi082.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-20T09:46:00.982 INFO:teuthology.orchestra.run.smithi183.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-5042-ge2c50893-1jammy [22.3 MB] 2023-07-20T09:46:04.535 INFO:teuthology.orchestra.run.smithi082.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-5042-ge2c50893-1jammy [102 kB] 2023-07-20T09:46:04.591 INFO:teuthology.orchestra.run.smithi082.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-5042-ge2c50893-1jammy [428 kB] 2023-07-20T09:46:04.815 INFO:teuthology.orchestra.run.smithi082.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-5042-ge2c50893-1jammy [22.3 MB] 2023-07-20T09:46:10.215 INFO:teuthology.orchestra.run.smithi183.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-5042-ge2c50893-1jammy [6,819 kB] 2023-07-20T09:46:10.460 INFO:teuthology.orchestra.run.smithi082.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-5042-ge2c50893-1jammy [6,819 kB] 2023-07-20T09:46:11.698 INFO:teuthology.orchestra.run.smithi082.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-5042-ge2c50893-1jammy [226 kB] 2023-07-20T09:46:11.740 INFO:teuthology.orchestra.run.smithi082.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5042-ge2c50893-1jammy [117 kB] 2023-07-20T09:46:11.753 INFO:teuthology.orchestra.run.smithi082.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-5042-ge2c50893-1jammy [1,471 kB] 2023-07-20T09:46:11.978 INFO:teuthology.orchestra.run.smithi183.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-5042-ge2c50893-1jammy [226 kB] 2023-07-20T09:46:11.987 INFO:teuthology.orchestra.run.smithi082.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-5042-ge2c50893-1jammy [9,867 kB] 2023-07-20T09:46:12.021 INFO:teuthology.orchestra.run.smithi183.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5042-ge2c50893-1jammy [117 kB] 2023-07-20T09:46:12.036 INFO:teuthology.orchestra.run.smithi183.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-5042-ge2c50893-1jammy [1,471 kB] 2023-07-20T09:46:12.304 INFO:teuthology.orchestra.run.smithi183.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-5042-ge2c50893-1jammy [9,867 kB] 2023-07-20T09:46:13.440 INFO:teuthology.orchestra.run.smithi082.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-5042-ge2c50893-1jammy [31.5 MB] 2023-07-20T09:46:13.654 INFO:teuthology.orchestra.run.smithi183.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-5042-ge2c50893-1jammy [31.5 MB] 2023-07-20T09:46:18.602 INFO:teuthology.orchestra.run.smithi183.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-5042-ge2c50893-1jammy [3,594 B] 2023-07-20T09:46:18.602 INFO:teuthology.orchestra.run.smithi183.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-5042-ge2c50893-1jammy [809 kB] 2023-07-20T09:46:18.986 INFO:teuthology.orchestra.run.smithi183.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-5042-ge2c50893-1jammy [2,150 kB] 2023-07-20T09:46:19.776 INFO:teuthology.orchestra.run.smithi183.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-5042-ge2c50893-1jammy [220 kB] 2023-07-20T09:46:19.887 INFO:teuthology.orchestra.run.smithi183.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-5042-ge2c50893-1jammy [125 kB] 2023-07-20T09:46:19.942 INFO:teuthology.orchestra.run.smithi183.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-5042-ge2c50893-1jammy [1,847 kB] 2023-07-20T09:46:20.671 INFO:teuthology.orchestra.run.smithi183.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5042-ge2c50893-1jammy [8,615 kB] 2023-07-20T09:46:22.781 INFO:teuthology.orchestra.run.smithi082.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-5042-ge2c50893-1jammy [3,594 B] 2023-07-20T09:46:22.781 INFO:teuthology.orchestra.run.smithi082.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-5042-ge2c50893-1jammy [809 kB] 2023-07-20T09:46:23.631 INFO:teuthology.orchestra.run.smithi082.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-5042-ge2c50893-1jammy [2,150 kB] 2023-07-20T09:46:25.594 INFO:teuthology.orchestra.run.smithi082.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-5042-ge2c50893-1jammy [220 kB] 2023-07-20T09:46:25.632 INFO:teuthology.orchestra.run.smithi183.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-5042-ge2c50893-1jammy [3,720 B] 2023-07-20T09:46:25.633 INFO:teuthology.orchestra.run.smithi183.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-5042-ge2c50893-1jammy [47.5 MB] 2023-07-20T09:46:25.740 INFO:teuthology.orchestra.run.smithi082.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-5042-ge2c50893-1jammy [125 kB] 2023-07-20T09:46:25.878 INFO:teuthology.orchestra.run.smithi082.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-5042-ge2c50893-1jammy [1,847 kB] 2023-07-20T09:46:27.208 INFO:teuthology.orchestra.run.smithi082.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5042-ge2c50893-1jammy [8,615 kB] 2023-07-20T09:46:32.052 INFO:teuthology.orchestra.run.smithi082.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-5042-ge2c50893-1jammy [3,720 B] 2023-07-20T09:46:32.053 INFO:teuthology.orchestra.run.smithi082.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-5042-ge2c50893-1jammy [47.5 MB] 2023-07-20T09:46:43.863 INFO:teuthology.orchestra.run.smithi183.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-5042-ge2c50893-1jammy [231 kB] 2023-07-20T09:46:43.920 INFO:teuthology.orchestra.run.smithi183.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-5042-ge2c50893-1jammy [214 kB] 2023-07-20T09:46:43.996 INFO:teuthology.orchestra.run.smithi183.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-5042-ge2c50893-1jammy [23.8 kB] 2023-07-20T09:46:44.015 INFO:teuthology.orchestra.run.smithi183.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-5042-ge2c50893-1jammy [13.2 kB] 2023-07-20T09:46:44.016 INFO:teuthology.orchestra.run.smithi183.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-5042-ge2c50893-1jammy [28.3 kB] 2023-07-20T09:46:44.016 INFO:teuthology.orchestra.run.smithi183.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-5042-ge2c50893-1jammy [12.0 MB] 2023-07-20T09:46:49.627 INFO:teuthology.orchestra.run.smithi183.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-5042-ge2c50893-1jammy [80.9 kB] 2023-07-20T09:46:50.339 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 183 MB in 58s (3,159 kB/s) 2023-07-20T09:46:50.488 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-20T09:46:50.559 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-20T09:46:50.563 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-20T09:46:50.604 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-20T09:46:50.923 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-20T09:46:50.936 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-20T09:46:50.973 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-20T09:46:51.250 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cmd2. 2023-07-20T09:46:51.264 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-20T09:46:51.292 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-20T09:46:51.595 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-20T09:46:51.608 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-20T09:46:51.687 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-20T09:46:52.015 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-20T09:46:52.028 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-20T09:46:52.065 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-20T09:46:52.434 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-20T09:46:52.448 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-20T09:46:52.493 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-20T09:46:52.779 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-20T09:46:52.792 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-20T09:46:52.829 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-20T09:46:53.257 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-20T09:46:53.272 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:46:53.324 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:46:53.702 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-20T09:46:53.716 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:46:53.762 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:46:54.157 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-20T09:46:54.172 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:46:54.215 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:46:54.635 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-20T09:46:54.649 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-20T09:46:54.701 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-20T09:46:55.238 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librados2. 2023-07-20T09:46:55.252 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../011-librados2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:55.304 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librados2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:55.732 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librbd1. 2023-07-20T09:46:55.747 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../012-librbd1_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:55.790 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librbd1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:56.260 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs2. 2023-07-20T09:46:56.274 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:56.326 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:56.645 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rados. 2023-07-20T09:46:56.660 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../014-python3-rados_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:56.720 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rados (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:57.090 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-20T09:46:57.105 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:46:57.148 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-argparse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:57.425 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cephfs. 2023-07-20T09:46:57.440 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:57.492 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cephfs (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:57.878 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-20T09:46:57.893 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:46:57.945 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:58.161 INFO:teuthology.orchestra.run.smithi082.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-5042-ge2c50893-1jammy [231 kB] 2023-07-20T09:46:58.239 INFO:teuthology.orchestra.run.smithi082.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-5042-ge2c50893-1jammy [214 kB] 2023-07-20T09:46:58.327 INFO:teuthology.orchestra.run.smithi082.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-5042-ge2c50893-1jammy [23.8 kB] 2023-07-20T09:46:58.329 INFO:teuthology.orchestra.run.smithi082.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-5042-ge2c50893-1jammy [13.2 kB] 2023-07-20T09:46:58.337 INFO:teuthology.orchestra.run.smithi082.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-5042-ge2c50893-1jammy [28.3 kB] 2023-07-20T09:46:58.339 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-prettytable. 2023-07-20T09:46:58.350 INFO:teuthology.orchestra.run.smithi082.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-5042-ge2c50893-1jammy [12.0 MB] 2023-07-20T09:46:58.354 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-20T09:46:58.406 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-20T09:46:58.726 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rbd. 2023-07-20T09:46:58.740 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:58.784 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rbd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:46:59.128 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-20T09:46:59.143 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-20T09:46:59.186 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-20T09:46:59.514 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package librgw2. 2023-07-20T09:46:59.529 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../021-librgw2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:46:59.573 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking librgw2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:00.058 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rgw. 2023-07-20T09:47:00.072 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:00.116 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:00.494 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-20T09:47:00.508 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-20T09:47:00.561 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-20T09:47:00.947 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libradosstriper1. 2023-07-20T09:47:00.961 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:01.014 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libradosstriper1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:01.450 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-common. 2023-07-20T09:47:01.465 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../025-ceph-common_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:01.534 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:02.293 INFO:teuthology.orchestra.run.smithi082.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-5042-ge2c50893-1jammy [80.9 kB] 2023-07-20T09:47:02.656 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-base. 2023-07-20T09:47:02.671 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../026-ceph-base_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:02.724 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-base (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:02.895 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 183 MB in 1min 10s (2,596 kB/s) 2023-07-20T09:47:03.015 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-20T09:47:03.086 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-20T09:47:03.089 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-20T09:47:03.122 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-20T09:47:03.408 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-20T09:47:03.421 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-20T09:47:03.458 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-20T09:47:03.468 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-20T09:47:03.482 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-20T09:47:03.526 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-20T09:47:03.763 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cmd2. 2023-07-20T09:47:03.771 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cheroot. 2023-07-20T09:47:03.774 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-20T09:47:03.785 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-20T09:47:03.811 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-20T09:47:03.821 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-20T09:47:04.099 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-20T09:47:04.113 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-20T09:47:04.122 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-20T09:47:04.135 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-20T09:47:04.157 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-20T09:47:04.214 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-20T09:47:04.460 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-20T09:47:04.475 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-20T09:47:04.518 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-20T09:47:04.567 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-20T09:47:04.581 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-20T09:47:04.625 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-20T09:47:04.854 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-20T09:47:04.869 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-20T09:47:04.913 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-20T09:47:04.920 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-20T09:47:04.935 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-20T09:47:04.970 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-20T09:47:05.174 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-tempora. 2023-07-20T09:47:05.189 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-20T09:47:05.224 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-20T09:47:05.298 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-20T09:47:05.313 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-20T09:47:05.356 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-20T09:47:05.526 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-portend. 2023-07-20T09:47:05.541 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-20T09:47:05.584 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-20T09:47:05.851 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-20T09:47:05.866 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:47:05.896 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-20T09:47:05.911 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-20T09:47:05.918 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:47:05.954 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-20T09:47:06.246 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-20T09:47:06.261 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:47:06.274 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-20T09:47:06.288 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-20T09:47:06.296 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:47:06.324 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-20T09:47:06.624 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-20T09:47:06.639 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-20T09:47:06.652 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-natsort. 2023-07-20T09:47:06.666 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-20T09:47:06.682 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:47:06.710 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-20T09:47:07.030 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-logutils. 2023-07-20T09:47:07.044 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-20T09:47:07.044 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-20T09:47:07.060 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-20T09:47:07.088 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-20T09:47:07.102 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-20T09:47:07.349 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-20T09:47:07.364 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-20T09:47:07.399 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-20T09:47:07.421 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librados2. 2023-07-20T09:47:07.436 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../011-librados2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:07.480 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librados2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:07.685 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-mako. 2023-07-20T09:47:07.700 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-20T09:47:07.744 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-20T09:47:08.041 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librbd1. 2023-07-20T09:47:08.055 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../012-librbd1_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:08.091 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librbd1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:08.105 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-20T09:47:08.120 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-20T09:47:08.163 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-20T09:47:08.466 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-20T09:47:08.477 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs2. 2023-07-20T09:47:08.481 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-20T09:47:08.490 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:08.525 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-20T09:47:08.535 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:08.794 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webob. 2023-07-20T09:47:08.809 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-20T09:47:08.813 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rados. 2023-07-20T09:47:08.826 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../014-python3-rados_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:08.843 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-20T09:47:08.871 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rados (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:09.180 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-waitress. 2023-07-20T09:47:09.195 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-20T09:47:09.215 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-20T09:47:09.229 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:09.241 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-20T09:47:09.265 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-argparse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:09.484 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cephfs. 2023-07-20T09:47:09.498 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:09.543 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cephfs (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:09.591 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-tempita. 2023-07-20T09:47:09.606 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-20T09:47:09.649 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-20T09:47:09.845 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-20T09:47:09.860 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:09.904 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:09.977 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-paste. 2023-07-20T09:47:09.992 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-20T09:47:10.044 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-20T09:47:10.265 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-prettytable. 2023-07-20T09:47:10.279 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-20T09:47:10.315 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-20T09:47:10.364 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-20T09:47:10.379 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-20T09:47:10.414 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-20T09:47:10.534 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rbd. 2023-07-20T09:47:10.548 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:10.592 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rbd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:10.700 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-20T09:47:10.715 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-20T09:47:10.758 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-20T09:47:10.955 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-20T09:47:10.970 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-20T09:47:11.014 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-20T09:47:11.111 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-webtest. 2023-07-20T09:47:11.126 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-20T09:47:11.169 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-20T09:47:11.316 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package librgw2. 2023-07-20T09:47:11.331 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../021-librgw2_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:11.366 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking librgw2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:11.472 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pecan. 2023-07-20T09:47:11.487 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-20T09:47:11.530 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-20T09:47:11.802 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rgw. 2023-07-20T09:47:11.816 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:11.860 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:11.876 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-certifi. 2023-07-20T09:47:11.891 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-20T09:47:11.935 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-20T09:47:12.196 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-20T09:47:12.211 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-20T09:47:12.254 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-idna. 2023-07-20T09:47:12.254 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-20T09:47:12.268 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-20T09:47:12.304 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-20T09:47:12.599 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libradosstriper1. 2023-07-20T09:47:12.614 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:12.624 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-urllib3. 2023-07-20T09:47:12.638 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-20T09:47:12.649 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libradosstriper1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:12.682 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-20T09:47:13.002 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-requests. 2023-07-20T09:47:13.016 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-20T09:47:13.052 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-common. 2023-07-20T09:47:13.060 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-20T09:47:13.066 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../025-ceph-common_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:13.110 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:13.371 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-20T09:47:13.386 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-20T09:47:13.429 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-20T09:47:13.732 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-20T09:47:13.747 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:13.791 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:14.187 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-20T09:47:14.201 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:14.224 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-base. 2023-07-20T09:47:14.237 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:14.239 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../026-ceph-base_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:14.292 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-base (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:14.540 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-openssl. 2023-07-20T09:47:14.555 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-20T09:47:14.598 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-20T09:47:14.943 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr. 2023-07-20T09:47:14.957 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:15.001 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:15.012 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-20T09:47:15.025 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-20T09:47:15.070 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-20T09:47:15.347 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cheroot. 2023-07-20T09:47:15.361 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-20T09:47:15.387 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mon. 2023-07-20T09:47:15.397 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-20T09:47:15.402 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:15.437 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mon (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:15.700 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-20T09:47:15.714 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-20T09:47:15.750 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-20T09:47:16.095 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-20T09:47:16.108 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-20T09:47:16.145 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-20T09:47:16.232 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-osd. 2023-07-20T09:47:16.247 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:16.290 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-osd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:16.448 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-20T09:47:16.461 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-20T09:47:16.506 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-20T09:47:16.792 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempora. 2023-07-20T09:47:16.805 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-20T09:47:16.850 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-20T09:47:17.186 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-portend. 2023-07-20T09:47:17.200 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-20T09:47:17.245 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-20T09:47:17.556 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-20T09:47:17.561 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph. 2023-07-20T09:47:17.570 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-20T09:47:17.575 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../061-ceph_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:17.614 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-20T09:47:17.619 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:17.859 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-20T09:47:17.872 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-20T09:47:17.879 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-fuse. 2023-07-20T09:47:17.894 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:17.908 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-20T09:47:17.929 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:18.291 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mds. 2023-07-20T09:47:18.306 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:18.349 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mds (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:18.429 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-natsort. 2023-07-20T09:47:18.443 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-20T09:47:18.487 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-20T09:47:18.744 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephadm. 2023-07-20T09:47:18.758 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../064-cephadm_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:18.790 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-logutils. 2023-07-20T09:47:18.793 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:18.805 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-20T09:47:18.840 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-20T09:47:19.072 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-20T09:47:19.087 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-20T09:47:19.130 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-20T09:47:19.134 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-20T09:47:19.148 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-20T09:47:19.192 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-20T09:47:19.458 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-20T09:47:19.473 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-20T09:47:19.516 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-20T09:47:19.520 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-mako. 2023-07-20T09:47:19.535 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-20T09:47:19.579 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-20T09:47:19.907 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-20T09:47:19.921 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-20T09:47:19.965 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-20T09:47:20.268 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-20T09:47:20.282 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-20T09:47:20.318 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-20T09:47:20.604 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-babel. 2023-07-20T09:47:20.618 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-20T09:47:20.646 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webob. 2023-07-20T09:47:20.661 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-20T09:47:20.704 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-20T09:47:20.836 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-20T09:47:21.040 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-waitress. 2023-07-20T09:47:21.054 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-20T09:47:21.101 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-20T09:47:21.157 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-jinja2. 2023-07-20T09:47:21.171 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-20T09:47:21.207 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-20T09:47:21.393 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-tempita. 2023-07-20T09:47:21.407 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-20T09:47:21.451 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-20T09:47:21.527 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-20T09:47:21.541 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:21.577 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:21.796 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-paste. 2023-07-20T09:47:21.810 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-20T09:47:21.854 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-20T09:47:21.913 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-20T09:47:21.928 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-20T09:47:21.963 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-20T09:47:22.207 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-20T09:47:22.221 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-20T09:47:22.241 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-20T09:47:22.257 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-20T09:47:22.273 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-20T09:47:22.299 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-20T09:47:22.593 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-20T09:47:22.602 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-routes. 2023-07-20T09:47:22.607 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-20T09:47:22.617 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-20T09:47:22.651 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-20T09:47:22.660 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-20T09:47:23.006 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-20T09:47:23.021 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:23.029 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-webtest. 2023-07-20T09:47:23.044 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-20T09:47:23.064 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:23.096 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-20T09:47:23.457 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pecan. 2023-07-20T09:47:23.472 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-20T09:47:23.517 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-20T09:47:23.523 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-20T09:47:23.531 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-20T09:47:23.567 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-20T09:47:23.945 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-certifi. 2023-07-20T09:47:23.959 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-20T09:47:24.011 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-20T09:47:24.062 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-joblib. 2023-07-20T09:47:24.076 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-20T09:47:24.120 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-20T09:47:24.431 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-idna. 2023-07-20T09:47:24.446 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-20T09:47:24.498 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-20T09:47:24.499 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-20T09:47:24.514 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-20T09:47:24.557 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-20T09:47:24.825 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-urllib3. 2023-07-20T09:47:24.840 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-20T09:47:24.877 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-sklearn. 2023-07-20T09:47:24.883 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-20T09:47:24.892 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-20T09:47:24.935 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-20T09:47:25.245 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests. 2023-07-20T09:47:25.260 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-20T09:47:25.303 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-20T09:47:25.576 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-20T09:47:25.590 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:25.615 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-20T09:47:25.629 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-20T09:47:25.634 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:25.673 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-20T09:47:25.959 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-20T09:47:25.974 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:26.017 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:26.405 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-20T09:47:26.420 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:26.455 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:26.654 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-cachetools. 2023-07-20T09:47:26.669 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-20T09:47:26.721 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-20T09:47:26.741 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-openssl. 2023-07-20T09:47:26.756 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-20T09:47:26.816 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-20T09:47:26.991 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-20T09:47:27.006 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-20T09:47:27.040 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-20T09:47:27.153 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr. 2023-07-20T09:47:27.167 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:27.210 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:27.302 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-20T09:47:27.317 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-20T09:47:27.352 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-20T09:47:27.614 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mon. 2023-07-20T09:47:27.629 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:27.629 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-rsa. 2023-07-20T09:47:27.644 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-20T09:47:27.672 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mon (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:27.687 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-20T09:47:28.118 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-google-auth. 2023-07-20T09:47:28.133 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-20T09:47:28.176 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-20T09:47:28.417 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-osd. 2023-07-20T09:47:28.431 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:28.475 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-osd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:28.496 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-20T09:47:28.510 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-20T09:47:28.554 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-20T09:47:28.840 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-websocket. 2023-07-20T09:47:28.855 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-20T09:47:28.890 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-20T09:47:29.218 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-20T09:47:29.233 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-20T09:47:29.276 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-20T09:47:29.679 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph. 2023-07-20T09:47:29.694 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../061-ceph_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:29.729 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:29.990 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-20T09:47:30.004 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:30.015 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-fuse. 2023-07-20T09:47:30.030 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:30.048 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:30.065 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:30.368 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-20T09:47:30.381 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-20T09:47:30.426 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-20T09:47:30.426 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mds. 2023-07-20T09:47:30.440 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:30.484 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mds (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:30.721 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-20T09:47:30.735 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-20T09:47:30.779 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-20T09:47:30.871 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephadm. 2023-07-20T09:47:30.885 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../064-cephadm_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:30.929 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:31.040 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package jq. 2023-07-20T09:47:31.054 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-20T09:47:31.098 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-20T09:47:31.257 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-20T09:47:31.272 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-20T09:47:31.307 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-20T09:47:31.359 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package socat. 2023-07-20T09:47:31.373 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-20T09:47:31.417 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-20T09:47:31.609 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-20T09:47:31.624 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-20T09:47:31.668 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-20T09:47:31.737 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package xmlstarlet. 2023-07-20T09:47:31.751 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-20T09:47:31.795 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-20T09:47:32.143 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-test. 2023-07-20T09:47:32.157 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../093-ceph-test_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:32.201 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-test (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:32.623 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-babel. 2023-07-20T09:47:32.636 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-20T09:47:32.681 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-20T09:47:32.984 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-jinja2. 2023-07-20T09:47:32.997 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-20T09:47:33.034 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-20T09:47:33.362 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-20T09:47:33.376 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:33.429 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:33.732 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-20T09:47:33.745 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-20T09:47:33.773 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-20T09:47:34.038 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ceph-volume. 2023-07-20T09:47:34.052 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:34.076 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-20T09:47:34.090 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-20T09:47:34.105 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ceph-volume (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:34.134 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-20T09:47:34.421 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-routes. 2023-07-20T09:47:34.434 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-20T09:47:34.479 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-20T09:47:34.535 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-20T09:47:34.549 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:34.593 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-mirror (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:34.841 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-20T09:47:34.854 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:34.863 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-colorama. 2023-07-20T09:47:34.877 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-20T09:47:34.899 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:34.913 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-20T09:47:35.182 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-shell. 2023-07-20T09:47:35.196 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:35.240 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-shell (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:35.252 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-20T09:47:35.265 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-20T09:47:35.310 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-20T09:47:35.510 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package cephfs-top. 2023-07-20T09:47:35.523 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:35.568 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking cephfs-top (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:35.812 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-20T09:47:35.826 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:35.839 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-joblib. 2023-07-20T09:47:35.852 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-20T09:47:35.895 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libcephfs-dev (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:35.897 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-20T09:47:36.215 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package nvme-cli. 2023-07-20T09:47:36.229 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-20T09:47:36.251 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-20T09:47:36.264 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-20T09:47:36.273 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-20T09:47:36.300 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-20T09:47:36.579 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-sklearn. 2023-07-20T09:47:36.592 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-20T09:47:36.595 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-20T09:47:36.609 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-20T09:47:36.637 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-20T09:47:36.653 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-20T09:47:37.056 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-20T09:47:37.069 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-20T09:47:37.114 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-20T09:47:37.329 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-20T09:47:37.343 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:37.379 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:37.434 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pastescript. 2023-07-20T09:47:37.448 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-20T09:47:37.509 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-20T09:47:37.828 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pluggy. 2023-07-20T09:47:37.847 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-20T09:47:37.886 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-20T09:47:38.164 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-psutil. 2023-07-20T09:47:38.178 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-20T09:47:38.222 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-20T09:47:38.332 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-cachetools. 2023-07-20T09:47:38.347 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-20T09:47:38.390 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-20T09:47:38.576 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-py. 2023-07-20T09:47:38.590 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-20T09:47:38.634 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-20T09:47:38.868 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-20T09:47:38.883 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-20T09:47:38.926 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-20T09:47:38.995 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pygments. 2023-07-20T09:47:39.009 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-20T09:47:39.053 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-20T09:47:39.296 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-20T09:47:39.311 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-20T09:47:39.354 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-20T09:47:39.474 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-20T09:47:39.488 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-20T09:47:39.524 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-20T09:47:39.648 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-rsa. 2023-07-20T09:47:39.662 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-20T09:47:39.707 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-20T09:47:39.835 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-toml. 2023-07-20T09:47:39.849 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-20T09:47:39.893 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-20T09:47:40.095 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-google-auth. 2023-07-20T09:47:40.110 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-20T09:47:40.153 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-20T09:47:40.196 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-pytest. 2023-07-20T09:47:40.209 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-20T09:47:40.254 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-20T09:47:40.473 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-20T09:47:40.488 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-20T09:47:40.531 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-20T09:47:40.632 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package python3-simplejson. 2023-07-20T09:47:40.647 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-20T09:47:40.691 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-20T09:47:40.842 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-websocket. 2023-07-20T09:47:40.857 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-20T09:47:40.901 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-20T09:47:40.960 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-20T09:47:40.974 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-20T09:47:41.018 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-20T09:47:41.204 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-20T09:47:41.219 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-20T09:47:41.262 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-20T09:47:41.930 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package radosgw. 2023-07-20T09:47:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../113-radosgw_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:41.959 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-20T09:47:41.973 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:41.988 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking radosgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:42.017 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:42.295 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-20T09:47:42.309 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-20T09:47:42.345 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-20T09:47:42.617 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package rbd-fuse. 2023-07-20T09:47:42.632 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:42.675 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking rbd-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:42.706 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-20T09:47:42.720 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-20T09:47:42.764 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-20T09:47:42.961 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-20T09:47:43.026 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package jq. 2023-07-20T09:47:43.039 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-20T09:47:43.084 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-20T09:47:43.230 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-20T09:47:43.336 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package socat. 2023-07-20T09:47:43.350 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-20T09:47:43.355 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-20T09:47:43.395 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-20T09:47:43.615 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-20T09:47:43.689 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package xmlstarlet. 2023-07-20T09:47:43.703 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-20T09:47:43.747 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-20T09:47:44.029 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-20T09:47:44.110 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-test. 2023-07-20T09:47:44.124 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../093-ceph-test_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:44.168 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-test (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:44.662 INFO:teuthology.orchestra.run.smithi183.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-20T09:47:44.712 INFO:teuthology.orchestra.run.smithi183.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-20T09:47:44.766 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:45.344 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user cephadm....done 2023-07-20T09:47:45.505 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-20T09:47:45.781 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-20T09:47:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ceph-volume. 2023-07-20T09:47:45.954 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:45.997 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ceph-volume (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:46.057 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-20T09:47:46.183 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-20T09:47:46.426 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-20T09:47:46.435 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-20T09:47:46.449 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:46.493 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-mirror (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:46.694 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-20T09:47:46.796 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-colorama. 2023-07-20T09:47:46.811 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-20T09:47:46.820 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-20T09:47:46.854 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-20T09:47:47.115 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-shell. 2023-07-20T09:47:47.130 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:47.130 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-20T09:47:47.165 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-shell (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:47.418 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package cephfs-top. 2023-07-20T09:47:47.432 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-5042-ge2c50893-1jammy_all.deb ... 2023-07-20T09:47:47.476 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking cephfs-top (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:47.499 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-20T09:47:47.729 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-20T09:47:47.743 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:47.758 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-20T09:47:47.787 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libcephfs-dev (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:48.009 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-20T09:47:48.184 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package nvme-cli. 2023-07-20T09:47:48.196 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-20T09:47:48.240 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-20T09:47:48.277 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-20T09:47:48.537 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-20T09:47:48.589 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-20T09:47:48.603 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-20T09:47:48.647 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-20T09:47:48.938 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-20T09:47:49.083 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-20T09:47:49.097 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-20T09:47:49.141 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-20T09:47:49.205 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-argparse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:49.444 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pastescript. 2023-07-20T09:47:49.458 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-20T09:47:49.473 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-20T09:47:49.502 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-20T09:47:49.575 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-20T09:47:49.817 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-20T09:47:49.863 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pluggy. 2023-07-20T09:47:49.877 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-20T09:47:49.922 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-20T09:47:50.077 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-20T09:47:50.177 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-20T09:47:50.233 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-psutil. 2023-07-20T09:47:50.247 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-20T09:47:50.291 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-20T09:47:50.545 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-20T09:47:50.636 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-py. 2023-07-20T09:47:50.649 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-20T09:47:50.671 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-20T09:47:50.693 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-20T09:47:50.947 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-20T09:47:51.055 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pygments. 2023-07-20T09:47:51.069 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-20T09:47:51.113 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-20T09:47:51.207 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-20T09:47:51.533 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-20T09:47:51.542 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-20T09:47:51.556 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-20T09:47:51.601 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-20T09:47:51.894 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-toml. 2023-07-20T09:47:51.908 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-20T09:47:51.944 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-20T09:47:52.215 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-20T09:47:52.239 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-pytest. 2023-07-20T09:47:52.253 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-20T09:47:52.297 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-20T09:47:52.477 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-20T09:47:52.603 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-20T09:47:52.650 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package python3-simplejson. 2023-07-20T09:47:52.664 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-20T09:47:52.708 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-20T09:47:52.729 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-20T09:47:52.977 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-20T09:47:52.992 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-20T09:47:53.061 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-20T09:47:53.072 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-20T09:47:53.457 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-20T09:47:53.714 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package radosgw. 2023-07-20T09:47:53.716 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-20T09:47:53.728 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../113-radosgw_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:53.772 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking radosgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:54.093 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-20T09:47:54.359 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package rbd-fuse. 2023-07-20T09:47:54.373 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-5042-ge2c50893-1jammy_amd64.deb ... 2023-07-20T09:47:54.394 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-20T09:47:54.408 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking rbd-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:54.701 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-20T09:47:54.720 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-20T09:47:54.980 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-20T09:47:55.071 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-20T09:47:55.097 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-20T09:47:55.331 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-20T09:47:55.331 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-20T09:47:55.465 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:55.714 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-20T09:47:55.783 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-idna (3.3-1) ... 2023-07-20T09:47:56.134 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-20T09:47:56.334 INFO:teuthology.orchestra.run.smithi082.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-20T09:47:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-20T09:47:56.408 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:47:57.300 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user cephadm....done 2023-07-20T09:47:57.357 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:47:57.516 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-20T09:47:57.601 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-20T09:47:57.783 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-20T09:47:57.909 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-20T09:47:58.035 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-20T09:47:58.039 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-20T09:47:58.290 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-20T09:47:58.337 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-20T09:47:58.391 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-20T09:47:58.597 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-20T09:47:58.642 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-20T09:47:58.839 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:47:58.910 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-20T09:47:58.998 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-20T09:47:59.036 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-20T09:47:59.124 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-20T09:47:59.354 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-20T09:47:59.417 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-20T09:47:59.685 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-20T09:47:59.731 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-20T09:47:59.952 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-20T09:47:59.974 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-20T09:48:00.220 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-20T09:48:00.258 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-20T09:48:00.488 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-20T09:48:00.543 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-20T09:48:00.747 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-20T09:48:00.869 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-20T09:48:00.873 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-20T09:48:01.145 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-20T09:48:01.150 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-20T09:48:01.250 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-20T09:48:01.412 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-argparse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:01.535 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-20T09:48:01.680 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-20T09:48:01.789 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-20T09:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-20T09:48:02.057 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-20T09:48:02.112 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-20T09:48:02.316 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-20T09:48:02.442 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-20T09:48:02.523 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-20T09:48:02.765 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-20T09:48:02.802 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-20T09:48:02.891 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-20T09:48:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-20T09:48:03.195 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-20T09:48:03.292 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-20T09:48:03.471 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-20T09:48:03.560 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-20T09:48:03.773 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-20T09:48:03.828 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:48:03.962 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-20T09:48:04.271 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-20T09:48:04.449 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-20T09:48:04.581 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-20T09:48:04.725 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-20T09:48:04.851 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-20T09:48:04.874 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-20T09:48:04.977 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-20T09:48:04.983 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-20T09:48:05.267 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-20T09:48:05.295 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-20T09:48:05.552 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-20T09:48:05.729 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-20T09:48:05.828 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-20T09:48:05.980 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-20T09:48:06.213 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-20T09:48:06.348 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-20T09:48:06.522 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-20T09:48:06.641 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-20T09:48:06.916 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-20T09:48:06.959 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-20T09:48:07.042 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librados2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.168 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librgw2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.293 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-20T09:48:07.362 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.464 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.553 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-20T09:48:07.598 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libradosstriper1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.679 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:07.724 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-20T09:48:07.972 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-idna (3.3-1) ... 2023-07-20T09:48:08.017 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up librbd1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:08.168 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:08.295 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:08.331 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-20T09:48:08.497 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-20T09:48:08.497 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-20T09:48:09.121 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libcephfs-dev (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:09.247 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rados (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:09.373 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-top (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:09.482 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-20T09:48:09.596 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:48:09.712 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-20T09:48:09.955 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-20T09:48:10.056 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-20T09:48:10.157 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-20T09:48:10.458 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-20T09:48:10.709 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-20T09:48:10.753 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rbd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:10.879 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up rbd-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:10.977 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:48:11.005 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-rgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:11.103 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-20T09:48:11.140 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up python3-cephfs (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:11.229 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-20T09:48:11.299 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-shell (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:11.425 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:11.539 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-20T09:48:11.790 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-20T09:48:11.970 INFO:teuthology.orchestra.run.smithi183.stdout:Adding group ceph....done 2023-07-20T09:48:12.058 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-20T09:48:12.325 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-20T09:48:12.354 INFO:teuthology.orchestra.run.smithi183.stdout:Adding system user ceph....done 2023-07-20T09:48:12.567 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-20T09:48:12.815 INFO:teuthology.orchestra.run.smithi183.stdout:Setting system user ceph properties....done 2023-07-20T09:48:12.832 INFO:teuthology.orchestra.run.smithi183.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-20T09:48:12.877 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-20T09:48:12.968 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-20T09:48:13.019 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-20T09:48:13.304 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-20T09:48:13.380 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-20T09:48:13.430 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-20T09:48:13.723 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-20T09:48:14.049 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-20T09:48:14.068 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up cephfs-mirror (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-20T09:48:14.279 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-20T09:48:14.308 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-20T09:48:14.702 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-20T09:48:14.903 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-test (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:14.977 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-20T09:48:15.012 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up radosgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:15.104 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-20T09:48:15.242 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-20T09:48:15.242 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-20T09:48:15.497 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-20T09:48:15.765 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-20T09:48:16.015 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-20T09:48:16.166 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-20T09:48:16.197 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-base (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:16.476 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-20T09:48:16.536 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-20T09:48:16.785 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-20T09:48:17.069 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-20T09:48:17.179 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-20T09:48:17.261 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mds (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:17.463 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-20T09:48:17.535 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-20T09:48:17.535 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-20T09:48:17.714 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-20T09:48:17.965 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-20T09:48:18.238 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:18.349 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-20T09:48:18.442 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-20T09:48:18.442 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-20T09:48:18.668 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-20T09:48:19.028 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-20T09:48:19.047 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-osd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.154 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librados2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.280 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librgw2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.364 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-20T09:48:19.364 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-20T09:48:19.466 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.617 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs2 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.743 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libradosstriper1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:19.869 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-20T09:48:20.015 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.133 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.163 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up librbd1 (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.264 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.276 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mon (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.373 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:20.485 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-20T09:48:20.485 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-20T09:48:20.582 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-20T09:48:20.582 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-20T09:48:21.127 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.232 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libcephfs-dev (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.245 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.345 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.358 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rados (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.472 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ceph-volume (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.484 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-top (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:21.615 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-20T09:48:21.669 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-20T09:48:22.431 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-20T09:48:22.911 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-20T09:48:22.914 DEBUG:teuthology.orchestra.run.smithi183:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-20T09:48:22.948 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rbd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:22.990 INFO:teuthology.orchestra.run.smithi183.stdout:Reading package lists... 2023-07-20T09:48:23.116 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up rbd-fuse (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:23.146 INFO:teuthology.orchestra.run.smithi183.stdout:Building dependency tree... 2023-07-20T09:48:23.147 INFO:teuthology.orchestra.run.smithi183.stdout:Reading state information... 2023-07-20T09:48:23.242 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-rgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:23.287 INFO:teuthology.orchestra.run.smithi183.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-20T09:48:23.287 INFO:teuthology.orchestra.run.smithi183.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-20T09:48:23.287 INFO:teuthology.orchestra.run.smithi183.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-20T09:48:23.287 INFO:teuthology.orchestra.run.smithi183.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-20T09:48:23.287 INFO:teuthology.orchestra.run.smithi183.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-20T09:48:23.288 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages were automatically installed and are no longer required: 2023-07-20T09:48:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-20T09:48:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-20T09:48:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-20T09:48:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-20T09:48:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-20T09:48:23.289 INFO:teuthology.orchestra.run.smithi183.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-20T09:48:23.289 INFO:teuthology.orchestra.run.smithi183.stdout:The following additional packages will be installed: 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-20T09:48:23.290 INFO:teuthology.orchestra.run.smithi183.stdout:Suggested packages: 2023-07-20T09:48:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-20T09:48:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-20T09:48:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: libengine-pkcs11-openssl 2023-07-20T09:48:23.335 INFO:teuthology.orchestra.run.smithi183.stdout:The following NEW packages will be installed: 2023-07-20T09:48:23.336 INFO:teuthology.orchestra.run.smithi183.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-20T09:48:23.337 INFO:teuthology.orchestra.run.smithi183.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-20T09:48:23.338 INFO:teuthology.orchestra.run.smithi183.stdout:The following packages will be upgraded: 2023-07-20T09:48:23.338 INFO:teuthology.orchestra.run.smithi183.stdout: libssl3 2023-07-20T09:48:23.368 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up python3-cephfs (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:23.494 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-shell (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:23.546 INFO:teuthology.orchestra.run.smithi183.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-20T09:48:23.546 INFO:teuthology.orchestra.run.smithi183.stdout:Need to get 54.6 MB of archives. 2023-07-20T09:48:23.546 INFO:teuthology.orchestra.run.smithi183.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-20T09:48:23.546 INFO:teuthology.orchestra.run.smithi183.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-20T09:48:23.611 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-common (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:24.065 INFO:teuthology.orchestra.run.smithi082.stdout:Adding group ceph....done 2023-07-20T09:48:24.160 INFO:teuthology.orchestra.run.smithi183.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-20T09:48:24.468 INFO:teuthology.orchestra.run.smithi082.stdout:Adding system user ceph....done 2023-07-20T09:48:24.473 INFO:teuthology.orchestra.run.smithi183.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-20T09:48:24.512 INFO:teuthology.orchestra.run.smithi183.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-20T09:48:24.514 INFO:teuthology.orchestra.run.smithi183.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-20T09:48:24.521 INFO:teuthology.orchestra.run.smithi183.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-20T09:48:24.525 INFO:teuthology.orchestra.run.smithi183.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-20T09:48:24.526 INFO:teuthology.orchestra.run.smithi183.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-20T09:48:24.529 INFO:teuthology.orchestra.run.smithi183.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-20T09:48:24.531 INFO:teuthology.orchestra.run.smithi183.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-20T09:48:24.532 INFO:teuthology.orchestra.run.smithi183.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-20T09:48:24.652 INFO:teuthology.orchestra.run.smithi082.stdout:Setting system user ceph properties....done 2023-07-20T09:48:24.667 INFO:teuthology.orchestra.run.smithi082.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-20T09:48:24.708 INFO:teuthology.orchestra.run.smithi183.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-20T09:48:24.803 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-20T09:48:25.039 INFO:teuthology.orchestra.run.smithi183.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-20T09:48:25.198 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-20T09:48:25.837 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up cephfs-mirror (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:26.045 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-20T09:48:26.045 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-20T09:48:26.194 INFO:teuthology.orchestra.run.smithi183.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-20T09:48:26.196 INFO:teuthology.orchestra.run.smithi183.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-20T09:48:26.196 INFO:teuthology.orchestra.run.smithi183.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-20T09:48:26.199 INFO:teuthology.orchestra.run.smithi183.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-20T09:48:26.200 INFO:teuthology.orchestra.run.smithi183.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-20T09:48:26.204 INFO:teuthology.orchestra.run.smithi183.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-20T09:48:26.234 INFO:teuthology.orchestra.run.smithi183.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-20T09:48:26.251 INFO:teuthology.orchestra.run.smithi183.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-20T09:48:26.252 INFO:teuthology.orchestra.run.smithi183.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-20T09:48:26.531 INFO:teuthology.orchestra.run.smithi183.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-20T09:48:26.620 INFO:teuthology.orchestra.run.smithi183.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-20T09:48:26.655 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-test (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:26.764 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up radosgw (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-20T09:48:27.019 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-20T09:48:27.147 INFO:teuthology.orchestra.run.smithi183.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-20T09:48:27.310 INFO:teuthology.orchestra.run.smithi183.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-20T09:48:27.327 INFO:teuthology.orchestra.run.smithi183.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-20T09:48:27.328 INFO:teuthology.orchestra.run.smithi183.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-20T09:48:27.328 INFO:teuthology.orchestra.run.smithi183.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-20T09:48:27.330 INFO:teuthology.orchestra.run.smithi183.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-20T09:48:27.379 INFO:teuthology.orchestra.run.smithi183.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-20T09:48:27.385 INFO:teuthology.orchestra.run.smithi183.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-20T09:48:27.899 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-base (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:28.251 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-20T09:48:28.381 INFO:teuthology.orchestra.run.smithi183.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-20T09:48:28.634 INFO:teuthology.orchestra.run.smithi183.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-20T09:48:28.730 INFO:teuthology.orchestra.run.smithi183.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-20T09:48:28.731 INFO:teuthology.orchestra.run.smithi183.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-20T09:48:28.842 INFO:teuthology.orchestra.run.smithi183.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-20T09:48:28.851 INFO:teuthology.orchestra.run.smithi183.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-20T09:48:28.901 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mds (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:29.123 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-20T09:48:29.124 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-20T09:48:29.454 INFO:teuthology.orchestra.run.smithi183.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-20T09:48:29.459 INFO:teuthology.orchestra.run.smithi183.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-20T09:48:29.851 INFO:teuthology.orchestra.run.smithi183.stdout:Preconfiguring packages ... 2023-07-20T09:48:30.016 INFO:teuthology.orchestra.run.smithi183.stdout:Fetched 54.6 MB in 6s (8,929 kB/s) 2023-07-20T09:48:30.101 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:30.112 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package flex. 2023-07-20T09:48:30.186 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-07-20T09:48:30.190 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:30.228 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-20T09:48:30.404 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-20T09:48:30.404 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-20T09:48:30.806 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-20T09:48:30.983 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-20T09:48:31.049 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-osd (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:31.366 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-20T09:48:31.367 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-20T09:48:31.407 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:48:31.936 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package bison. 2023-07-20T09:48:31.983 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:32.011 INFO:teuthology.orchestra.run.smithi183.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-07-20T09:48:32.014 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-20T09:48:32.063 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-20T09:48:32.118 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:32.252 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mon (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:32.446 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-20T09:48:32.446 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-20T09:48:32.455 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-20T09:48:32.470 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-20T09:48:32.505 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-20T09:48:32.833 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package dump. 2023-07-20T09:48:32.848 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-20T09:48:32.891 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking dump (0.4b47-3) ... 2023-07-20T09:48:33.061 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:33.178 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package indent. 2023-07-20T09:48:33.179 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:33.193 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-20T09:48:33.236 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-20T09:48:33.297 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:33.439 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ceph-volume (18.0.0-5042-ge2c50893-1jammy) ... 2023-07-20T09:48:33.506 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-20T09:48:33.520 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-20T09:48:33.555 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-20T09:48:33.599 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-20T09:48:33.884 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-20T09:48:33.899 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-20T09:48:33.942 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-20T09:48:34.211 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-20T09:48:34.227 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-20T09:48:34.286 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-20T09:48:34.298 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-20T09:48:34.606 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-20T09:48:34.621 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:34.656 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:34.762 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-20T09:48:34.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-20T09:48:34.841 INFO:teuthology.orchestra.run.smithi082.stdout:Reading package lists... 2023-07-20T09:48:34.866 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-20T09:48:34.882 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:34.925 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:34.997 INFO:teuthology.orchestra.run.smithi082.stdout:Building dependency tree... 2023-07-20T09:48:34.997 INFO:teuthology.orchestra.run.smithi082.stdout:Reading state information... 2023-07-20T09:48:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-20T09:48:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-20T09:48:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-20T09:48:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-20T09:48:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-20T09:48:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages were automatically installed and are no longer required: 2023-07-20T09:48:35.143 INFO:teuthology.orchestra.run.smithi082.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-20T09:48:35.143 INFO:teuthology.orchestra.run.smithi082.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-20T09:48:35.143 INFO:teuthology.orchestra.run.smithi082.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-20T09:48:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-20T09:48:35.144 INFO:teuthology.orchestra.run.smithi082.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-20T09:48:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-20T09:48:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:The following additional packages will be installed: 2023-07-20T09:48:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-20T09:48:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-20T09:48:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-20T09:48:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-20T09:48:35.145 INFO:teuthology.orchestra.run.smithi082.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-20T09:48:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:Suggested packages: 2023-07-20T09:48:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-20T09:48:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-20T09:48:35.146 INFO:teuthology.orchestra.run.smithi082.stdout: libengine-pkcs11-openssl 2023-07-20T09:48:35.177 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libjson-perl. 2023-07-20T09:48:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:The following NEW packages will be installed: 2023-07-20T09:48:35.191 INFO:teuthology.orchestra.run.smithi082.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-20T09:48:35.191 INFO:teuthology.orchestra.run.smithi082.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-20T09:48:35.191 INFO:teuthology.orchestra.run.smithi082.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-20T09:48:35.192 INFO:teuthology.orchestra.run.smithi082.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-20T09:48:35.192 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-20T09:48:35.192 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-20T09:48:35.192 INFO:teuthology.orchestra.run.smithi082.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-20T09:48:35.193 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-20T09:48:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:The following packages will be upgraded: 2023-07-20T09:48:35.193 INFO:teuthology.orchestra.run.smithi082.stdout: libssl3 2023-07-20T09:48:35.235 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-20T09:48:35.435 INFO:teuthology.orchestra.run.smithi082.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-20T09:48:35.435 INFO:teuthology.orchestra.run.smithi082.stdout:Need to get 54.6 MB of archives. 2023-07-20T09:48:35.435 INFO:teuthology.orchestra.run.smithi082.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-20T09:48:35.436 INFO:teuthology.orchestra.run.smithi082.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-20T09:48:35.555 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-20T09:48:35.570 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-20T09:48:35.613 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-20T09:48:35.982 INFO:teuthology.orchestra.run.smithi082.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-20T09:48:36.433 INFO:teuthology.orchestra.run.smithi082.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-20T09:48:36.519 INFO:teuthology.orchestra.run.smithi082.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-20T09:48:36.522 INFO:teuthology.orchestra.run.smithi082.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-20T09:48:36.535 INFO:teuthology.orchestra.run.smithi082.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-20T09:48:36.638 INFO:teuthology.orchestra.run.smithi082.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-20T09:48:36.639 INFO:teuthology.orchestra.run.smithi082.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-20T09:48:36.645 INFO:teuthology.orchestra.run.smithi082.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-20T09:48:36.648 INFO:teuthology.orchestra.run.smithi082.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-20T09:48:36.982 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-20T09:48:36.998 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-20T09:48:37.032 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:37.273 INFO:teuthology.orchestra.run.smithi082.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-20T09:48:37.273 INFO:teuthology.orchestra.run.smithi082.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-20T09:48:37.343 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-20T09:48:37.359 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-20T09:48:37.401 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:37.456 INFO:teuthology.orchestra.run.smithi082.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-20T09:48:37.737 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-20T09:48:37.752 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-20T09:48:37.795 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:48:38.414 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-20T09:48:38.430 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-20T09:48:38.473 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-20T09:48:38.792 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-20T09:48:38.802 INFO:teuthology.orchestra.run.smithi082.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-20T09:48:38.803 INFO:teuthology.orchestra.run.smithi082.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-20T09:48:38.804 INFO:teuthology.orchestra.run.smithi082.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-20T09:48:38.807 INFO:teuthology.orchestra.run.smithi082.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-20T09:48:38.807 INFO:teuthology.orchestra.run.smithi082.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-20T09:48:38.808 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-20T09:48:38.815 INFO:teuthology.orchestra.run.smithi082.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-20T09:48:38.818 INFO:teuthology.orchestra.run.smithi082.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-20T09:48:38.840 INFO:teuthology.orchestra.run.smithi082.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-20T09:48:38.883 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-20T09:48:38.904 INFO:teuthology.orchestra.run.smithi082.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-20T09:48:39.219 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-20T09:48:39.235 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:39.278 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:39.510 INFO:teuthology.orchestra.run.smithi082.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-20T09:48:39.511 INFO:teuthology.orchestra.run.smithi082.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-20T09:48:39.541 INFO:teuthology.orchestra.run.smithi082.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-20T09:48:39.583 INFO:teuthology.orchestra.run.smithi082.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-20T09:48:39.587 INFO:teuthology.orchestra.run.smithi082.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-20T09:48:39.588 INFO:teuthology.orchestra.run.smithi082.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-20T09:48:39.589 INFO:teuthology.orchestra.run.smithi082.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-20T09:48:39.589 INFO:teuthology.orchestra.run.smithi082.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-20T09:48:39.597 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-20T09:48:39.607 INFO:teuthology.orchestra.run.smithi082.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-20T09:48:39.609 INFO:teuthology.orchestra.run.smithi082.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-20T09:48:39.613 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:39.646 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:48:39.925 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-20T09:48:39.940 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:39.982 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:48:40.019 INFO:teuthology.orchestra.run.smithi082.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-20T09:48:40.047 INFO:teuthology.orchestra.run.smithi082.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-20T09:48:40.047 INFO:teuthology.orchestra.run.smithi082.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-20T09:48:40.048 INFO:teuthology.orchestra.run.smithi082.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-20T09:48:40.078 INFO:teuthology.orchestra.run.smithi082.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-20T09:48:40.080 INFO:teuthology.orchestra.run.smithi082.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-20T09:48:40.226 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-20T09:48:40.242 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-20T09:48:40.260 INFO:teuthology.orchestra.run.smithi082.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-20T09:48:40.260 INFO:teuthology.orchestra.run.smithi082.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-20T09:48:40.284 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:48:40.635 INFO:teuthology.orchestra.run.smithi082.stdout:Preconfiguring packages ... 2023-07-20T09:48:40.788 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-20T09:48:40.793 INFO:teuthology.orchestra.run.smithi082.stdout:Fetched 54.6 MB in 5s (10.8 MB/s) 2023-07-20T09:48:40.804 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-20T09:48:40.846 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-20T09:48:40.939 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package flex. 2023-07-20T09:48:41.014 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-07-20T09:48:41.017 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:41.054 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-20T09:48:41.207 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package modemmanager. 2023-07-20T09:48:41.223 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-20T09:48:41.265 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:48:41.573 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-20T09:48:41.735 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-20T09:48:41.928 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package network-manager. 2023-07-20T09:48:41.944 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-20T09:48:41.996 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-20T09:48:42.124 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:48:42.619 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package ppp. 2023-07-20T09:48:42.635 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-20T09:48:42.660 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package bison. 2023-07-20T09:48:42.734 INFO:teuthology.orchestra.run.smithi082.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-07-20T09:48:42.737 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-20T09:48:42.812 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-20T09:48:42.992 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-20T09:48:43.205 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-20T09:48:43.219 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-20T09:48:43.263 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-20T09:48:43.307 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package pptp-linux. 2023-07-20T09:48:43.321 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-20T09:48:43.382 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-20T09:48:43.541 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package dump. 2023-07-20T09:48:43.555 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-20T09:48:43.591 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking dump (0.4b47-3) ... 2023-07-20T09:48:43.667 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-20T09:48:43.682 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-20T09:48:43.726 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-20T09:48:43.836 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package indent. 2023-07-20T09:48:43.851 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-20T09:48:43.886 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-20T09:48:44.003 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-20T09:48:44.018 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-20T09:48:44.053 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-client-common (238) ... 2023-07-20T09:48:44.180 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-20T09:48:44.195 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-20T09:48:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-20T09:48:44.332 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-20T09:48:44.346 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:44.390 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:44.583 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-20T09:48:44.641 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-20T09:48:44.641 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-20T09:48:44.852 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-20T09:48:44.868 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-20T09:48:44.902 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-20T09:48:45.011 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-common. 2023-07-20T09:48:45.026 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-20T09:48:45.087 INFO:teuthology.orchestra.run.smithi183.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-20T09:48:45.119 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-common (238) ... 2023-07-20T09:48:45.230 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-20T09:48:45.246 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:45.288 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:45.540 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-20T09:48:45.556 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-20T09:48:45.560 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-14. 2023-07-20T09:48:45.575 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:45.599 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:45.612 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:45.843 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libjson-perl. 2023-07-20T09:48:45.859 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-20T09:48:45.893 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-20T09:48:46.204 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-20T09:48:46.220 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-20T09:48:46.287 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-20T09:48:46.896 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql. 2023-07-20T09:48:46.911 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-20T09:48:46.954 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql (14+238) ... 2023-07-20T09:48:47.181 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-client. 2023-07-20T09:48:47.195 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-20T09:48:47.231 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-client (14+238) ... 2023-07-20T09:48:47.450 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-20T09:48:47.465 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-20T09:48:47.508 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-20T09:48:47.723 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-20T09:48:47.739 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-20T09:48:47.781 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:47.827 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package tcl8.6. 2023-07-20T09:48:47.843 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-20T09:48:47.885 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-20T09:48:48.019 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-20T09:48:48.035 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-20T09:48:48.069 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:48.188 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package tcl. 2023-07-20T09:48:48.204 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-20T09:48:48.250 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-20T09:48:48.363 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-20T09:48:48.379 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-20T09:48:48.422 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:48:48.557 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package wpasupplicant. 2023-07-20T09:48:48.573 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-20T09:48:48.607 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-20T09:48:48.799 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-20T09:48:48.815 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-20T09:48:48.858 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-20T09:48:48.978 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-20T09:48:48.994 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-20T09:48:49.036 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-20T09:48:49.185 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-20T09:48:49.201 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-20T09:48:49.235 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-20T09:48:49.414 INFO:teuthology.orchestra.run.smithi183.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-20T09:48:49.430 INFO:teuthology.orchestra.run.smithi183.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-20T09:48:49.480 INFO:teuthology.orchestra.run.smithi183.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-20T09:48:49.505 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-20T09:48:49.520 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:49.563 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:49.781 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-client-common (238) ... 2023-07-20T09:48:49.916 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-20T09:48:49.931 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:49.974 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:48:49.986 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-20T09:48:50.112 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-20T09:48:50.238 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:50.260 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-20T09:48:50.275 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:50.319 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:48:50.364 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-20T09:48:50.489 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-20T09:48:50.546 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-20T09:48:50.561 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-20T09:48:50.596 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:48:50.607 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:51.099 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-20T09:48:51.113 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-20T09:48:51.157 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-20T09:48:51.510 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package modemmanager. 2023-07-20T09:48:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-20T09:48:51.568 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:48:51.618 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-20T09:48:51.712 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-20T09:48:52.093 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-20T09:48:52.093 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-20T09:48:52.158 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager. 2023-07-20T09:48:52.172 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-20T09:48:52.215 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-20T09:48:52.815 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-20T09:48:52.823 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package ppp. 2023-07-20T09:48:52.837 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-20T09:48:53.167 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-20T09:48:53.199 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:48:53.309 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-20T09:48:53.435 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-20T09:48:53.511 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package pptp-linux. 2023-07-20T09:48:53.525 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-20T09:48:53.552 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:53.569 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-20T09:48:53.822 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-20T09:48:53.836 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-20T09:48:53.880 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-20T09:48:53.953 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-20T09:48:54.079 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-20T09:48:54.183 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-20T09:48:54.197 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-20T09:48:54.241 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client-common (238) ... 2023-07-20T09:48:54.570 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-20T09:48:54.585 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:54.620 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:54.734 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-20T09:48:54.860 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up dump (0.4b47-3) ... 2023-07-20T09:48:54.956 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-20T09:48:55.020 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:48:55.146 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-20T09:48:55.200 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-common. 2023-07-20T09:48:55.214 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-20T09:48:55.272 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-20T09:48:55.275 INFO:teuthology.orchestra.run.smithi082.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-20T09:48:55.307 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-common (238) ... 2023-07-20T09:48:55.398 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-20T09:48:55.524 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-20T09:48:55.605 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-20T09:48:55.659 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-20T09:48:55.790 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-14. 2023-07-20T09:48:55.805 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-20T09:48:55.835 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-20T09:48:55.851 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:48:56.011 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-20T09:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:56.263 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-20T09:48:56.430 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-client (14+238) ... 2023-07-20T09:48:56.565 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-20T09:48:57.044 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql. 2023-07-20T09:48:57.059 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-20T09:48:57.102 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql (14+238) ... 2023-07-20T09:48:57.148 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:48:57.148 INFO:teuthology.orchestra.run.smithi183.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-20T09:48:57.149 INFO:teuthology.orchestra.run.smithi183.stdout:which means they are currently configured by ifupdown: 2023-07-20T09:48:57.149 INFO:teuthology.orchestra.run.smithi183.stdout:- enp3s0f1 2023-07-20T09:48:57.149 INFO:teuthology.orchestra.run.smithi183.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-20T09:48:57.149 INFO:teuthology.orchestra.run.smithi183.stdout:remove their configuration from /etc/network/interfaces. 2023-07-20T09:48:57.150 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:48:57.281 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-20T09:48:57.329 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-client. 2023-07-20T09:48:57.344 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-20T09:48:57.379 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-client (14+238) ... 2023-07-20T09:48:57.606 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-20T09:48:57.621 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-20T09:48:57.664 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-20T09:48:57.688 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-20T09:48:58.009 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package tcl8.6. 2023-07-20T09:48:58.023 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-20T09:48:58.067 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-20T09:48:58.094 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-20T09:48:58.361 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package tcl. 2023-07-20T09:48:58.376 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-20T09:48:58.425 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-20T09:48:58.714 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package wpasupplicant. 2023-07-20T09:48:58.729 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-20T09:48:58.772 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-20T09:48:58.850 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:48:59.018 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-20T09:48:59.144 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-20T09:48:59.160 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-20T09:48:59.176 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-20T09:48:59.219 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-20T09:48:59.270 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-common (238) ... 2023-07-20T09:48:59.596 INFO:teuthology.orchestra.run.smithi082.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-20T09:48:59.612 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-20T09:48:59.663 INFO:teuthology.orchestra.run.smithi082.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-20T09:48:59.938 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client-common (238) ... 2023-07-20T09:49:00.161 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-20T09:49:00.210 INFO:teuthology.orchestra.run.smithi183.stdout:Adding user postgres to group ssl-cert 2023-07-20T09:49:00.287 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-20T09:49:00.413 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:49:00.461 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:00.461 INFO:teuthology.orchestra.run.smithi183.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-20T09:49:00.539 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-20T09:49:00.665 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-20T09:49:00.724 INFO:teuthology.orchestra.run.smithi183.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-20T09:49:00.724 INFO:teuthology.orchestra.run.smithi183.stdout:Removing obsolete dictionary files: 2023-07-20T09:49:01.199 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:49:01.496 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-20T09:49:01.988 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:49:02.237 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-20T09:49:02.330 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-20T09:49:02.331 INFO:teuthology.orchestra.run.smithi183.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-20T09:49:02.347 INFO:teuthology.orchestra.run.smithi183.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-20T09:49:02.409 INFO:teuthology.orchestra.run.smithi183.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout:This user must also own the server process. 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout:The database cluster will be initialized with locale "en_US". 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout:The default text search configuration will be set to "english". 2023-07-20T09:49:02.410 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:02.411 INFO:teuthology.orchestra.run.smithi183.stdout:Data page checksums are disabled. 2023-07-20T09:49:02.411 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:02.411 INFO:teuthology.orchestra.run.smithi183.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-20T09:49:02.411 INFO:teuthology.orchestra.run.smithi183.stdout:creating subdirectories ... ok 2023-07-20T09:49:02.412 INFO:teuthology.orchestra.run.smithi183.stdout:selecting dynamic shared memory implementation ... posix 2023-07-20T09:49:02.435 INFO:teuthology.orchestra.run.smithi183.stdout:selecting default max_connections ... 100 2023-07-20T09:49:02.469 INFO:teuthology.orchestra.run.smithi183.stdout:selecting default shared_buffers ... 128MB 2023-07-20T09:49:02.483 INFO:teuthology.orchestra.run.smithi183.stdout:selecting default time zone ... Etc/UTC 2023-07-20T09:49:02.483 INFO:teuthology.orchestra.run.smithi183.stdout:creating configuration files ... ok 2023-07-20T09:49:02.659 INFO:teuthology.orchestra.run.smithi183.stdout:running bootstrap script ... ok 2023-07-20T09:49:02.759 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-20T09:49:02.759 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-20T09:49:03.292 INFO:teuthology.orchestra.run.smithi183.stdout:performing post-bootstrap initialization ... ok 2023-07-20T09:49:03.433 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-20T09:49:03.584 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-20T09:49:03.710 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-20T09:49:03.844 INFO:teuthology.orchestra.run.smithi183.stdout:syncing data to disk ... ok 2023-07-20T09:49:03.877 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-20T09:49:03.987 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-20T09:49:04.104 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-20T09:49:04.231 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-20T09:49:04.366 INFO:teuthology.orchestra.run.smithi183.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-20T09:49:04.886 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-20T09:49:05.012 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up dump (0.4b47-3) ... 2023-07-20T09:49:05.107 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-20T09:49:05.172 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:49:05.298 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-20T09:49:05.416 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-20T09:49:05.516 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-20T09:49:05.659 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-20T09:49:05.758 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-20T09:49:06.142 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-20T09:49:06.270 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-20T09:49:06.447 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-20T09:49:06.572 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:49:06.699 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-20T09:49:06.841 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-client (14+238) ... 2023-07-20T09:49:06.959 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-20T09:49:07.412 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:49:07.529 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-20T09:49:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:07.579 INFO:teuthology.orchestra.run.smithi082.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-20T09:49:07.579 INFO:teuthology.orchestra.run.smithi082.stdout:which means they are currently configured by ifupdown: 2023-07-20T09:49:07.579 INFO:teuthology.orchestra.run.smithi082.stdout:- enp3s0f1 2023-07-20T09:49:07.579 INFO:teuthology.orchestra.run.smithi082.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-20T09:49:07.580 INFO:teuthology.orchestra.run.smithi082.stdout:remove their configuration from /etc/network/interfaces. 2023-07-20T09:49:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:07.630 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up postgresql (14+238) ... 2023-07-20T09:49:07.712 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-20T09:49:07.756 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:49:07.882 INFO:teuthology.orchestra.run.smithi183.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:49:08.122 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-20T09:49:08.143 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-20T09:49:08.143 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-20T09:49:08.520 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-20T09:49:08.951 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-20T09:49:09.252 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-20T09:49:09.253 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-20T09:49:09.387 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-20T09:49:09.413 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-20T09:49:09.523 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-20T09:49:09.632 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-common (238) ... 2023-07-20T09:49:10.364 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-20T09:49:10.464 INFO:teuthology.orchestra.run.smithi183.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-20T09:49:10.549 INFO:teuthology.orchestra.run.smithi082.stdout:Adding user postgres to group ssl-cert 2023-07-20T09:49:10.787 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:10.787 INFO:teuthology.orchestra.run.smithi082.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-20T09:49:11.052 INFO:teuthology.orchestra.run.smithi082.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-20T09:49:11.053 INFO:teuthology.orchestra.run.smithi082.stdout:Removing obsolete dictionary files: 2023-07-20T09:49:11.140 INFO:teuthology.orchestra.run.smithi183.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-20T09:49:11.144 DEBUG:teuthology.parallel:result is None 2023-07-20T09:49:11.762 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-20T09:49:12.225 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-20T09:49:12.658 INFO:teuthology.orchestra.run.smithi082.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-20T09:49:12.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-20T09:49:12.739 INFO:teuthology.orchestra.run.smithi082.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout:This user must also own the server process. 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout:The database cluster will be initialized with locale "en_US". 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout:The default text search configuration will be set to "english". 2023-07-20T09:49:12.740 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:12.741 INFO:teuthology.orchestra.run.smithi082.stdout:Data page checksums are disabled. 2023-07-20T09:49:12.741 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:12.741 INFO:teuthology.orchestra.run.smithi082.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-20T09:49:12.741 INFO:teuthology.orchestra.run.smithi082.stdout:creating subdirectories ... ok 2023-07-20T09:49:12.742 INFO:teuthology.orchestra.run.smithi082.stdout:selecting dynamic shared memory implementation ... posix 2023-07-20T09:49:12.764 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default max_connections ... 100 2023-07-20T09:49:12.799 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default shared_buffers ... 128MB 2023-07-20T09:49:12.812 INFO:teuthology.orchestra.run.smithi082.stdout:selecting default time zone ... Etc/UTC 2023-07-20T09:49:12.813 INFO:teuthology.orchestra.run.smithi082.stdout:creating configuration files ... ok 2023-07-20T09:49:12.990 INFO:teuthology.orchestra.run.smithi082.stdout:running bootstrap script ... ok 2023-07-20T09:49:13.616 INFO:teuthology.orchestra.run.smithi082.stdout:performing post-bootstrap initialization ... ok 2023-07-20T09:49:14.206 INFO:teuthology.orchestra.run.smithi082.stdout:syncing data to disk ... ok 2023-07-20T09:49:14.739 INFO:teuthology.orchestra.run.smithi082.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-20T09:49:17.807 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:49:17.933 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-20T09:49:18.059 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up postgresql (14+238) ... 2023-07-20T09:49:18.185 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-20T09:49:18.311 INFO:teuthology.orchestra.run.smithi082.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-20T09:49:18.572 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-20T09:49:18.572 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-20T09:49:19.297 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-20T09:49:19.682 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-20T09:49:19.867 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-20T09:49:20.869 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-20T09:49:21.011 INFO:teuthology.orchestra.run.smithi082.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-20T09:49:21.702 INFO:teuthology.orchestra.run.smithi082.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-20T09:49:21.706 DEBUG:teuthology.parallel:result is None 2023-07-20T09:49:21.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-20T09:49:22.067 DEBUG:teuthology.orchestra.run.smithi082:> dpkg-query -W -f '${Version}' ceph 2023-07-20T09:49:22.090 INFO:teuthology.orchestra.run.smithi082.stdout:18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:49:22.091 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:49:22.091 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042-ge2c50893-1jammy is installed. 2023-07-20T09:49:22.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-20T09:49:22.439 DEBUG:teuthology.orchestra.run.smithi183:> dpkg-query -W -f '${Version}' ceph 2023-07-20T09:49:22.463 INFO:teuthology.orchestra.run.smithi183.stdout:18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:49:22.464 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042-ge2c50893-1jammy 2023-07-20T09:49:22.465 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042-ge2c50893-1jammy is installed. 2023-07-20T09:49:22.465 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-20T09:49:22.466 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:22.466 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-20T09:49:22.490 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:22.490 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-20T09:49:22.528 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-20T09:49:22.529 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:22.530 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2023-07-20T09:49:22.554 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-20T09:49:22.619 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:22.619 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-07-20T09:49:22.642 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-20T09:49:22.711 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-20T09:49:22.711 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:22.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-20T09:49:22.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-20T09:49:22.799 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:22.799 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-20T09:49:22.821 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-20T09:49:22.887 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-20T09:49:22.887 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:22.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2023-07-20T09:49:22.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-20T09:49:22.975 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:22.975 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-07-20T09:49:22.998 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-20T09:49:23.068 INFO:teuthology.run_tasks:Running task ceph... 2023-07-20T09:49:23.147 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-20T09:49:23.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /var/log/ceph 2023-07-20T09:49:23.153 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-07-20T09:49:23.175 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-20T09:49:23.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-20T09:49:23.216 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-20T09:49:23.243 INFO:tasks.ceph:Creating extra log directories... 2023-07-20T09:49:23.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-20T09:49:23.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-20T09:49:23.337 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-20T09:49:23.337 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-20T09:49:23.337 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-20T09:49:23.338 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:23.338 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-20T09:49:23.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-20T09:49:23.445 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:23.445 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-20T09:49:23.455 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-20T09:49:23.555 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-20T09:49:23.556 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-20T09:49:23.556 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461', 'branch': 'wip-vshankar-testing-20230720.042515', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7344461', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c15ad6dab84a191431785901a40e4f9fa32bda8'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230720.042515'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230720.042515', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 632, 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'sleep_before_teardown': 0, 'subset': '14/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230720.042515', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi082.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIODH0sPfyutXLZWq/SXYQcdS80yOrImKWKlzMyK29SPS', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5kztsB4HHg4Sk4pRWO2OP/y1BTalgZzqg/o3iOpQIXlxidEhWS9y0FPHRRJGQDmsdbakH8Jzjn/HFnXugrUoc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8c15ad6dab84a191431785901a40e4f9fa32bda8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-20_08:24:15', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-20T09:49:23.557 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-20T09:49:23.561 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-20T09:49:23.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m0777 -- /var/run/ceph 2023-07-20T09:49:23.616 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-07-20T09:49:23.639 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:23.639 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2023-07-20T09:49:23.686 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-20T09:49:23.687 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2023-07-20T09:49:23.738 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-07-20 09:42:01.217056366 +0000 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-07-20 09:42:00.765063057 +0000 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-07-20 09:42:00.765063057 +0000 2023-07-20T09:49:23.739 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-07-20 09:42:00.765063057 +0000 2023-07-20T09:49:23.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-20T09:49:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-07-20T09:49:23.805 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-07-20T09:49:23.806 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000394198 s, 1.3 MB/s 2023-07-20T09:49:23.807 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-20T09:49:23.860 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2023-07-20T09:49:23.910 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-20T09:49:23.911 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:23.911 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 916 Links: 1 2023-07-20T09:49:23.911 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:23.912 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-07-20 09:42:01.953045469 +0000 2023-07-20T09:49:23.912 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-07-20 09:42:01.489052339 +0000 2023-07-20T09:49:23.912 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-07-20 09:42:01.489052339 +0000 2023-07-20T09:49:23.912 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-07-20 09:42:01.489052339 +0000 2023-07-20T09:49:23.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-20T09:49:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-07-20T09:49:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-07-20T09:49:23.973 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000387038 s, 1.3 MB/s 2023-07-20T09:49:23.975 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-20T09:49:24.028 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2023-07-20T09:49:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-20T09:49:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.079 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-07-20T09:49:24.079 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.079 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-07-20 09:42:02.677034751 +0000 2023-07-20T09:49:24.079 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-07-20 09:42:02.221041502 +0000 2023-07-20T09:49:24.080 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-07-20 09:42:02.221041502 +0000 2023-07-20T09:49:24.080 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-07-20 09:42:02.221041502 +0000 2023-07-20T09:49:24.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-20T09:49:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-07-20T09:49:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-07-20T09:49:24.141 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000386362 s, 1.3 MB/s 2023-07-20T09:49:24.143 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-20T09:49:24.197 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2023-07-20T09:49:24.246 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-20T09:49:24.246 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 951 Links: 1 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2023-07-20 09:42:02.933030961 +0000 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2023-07-20 09:42:02.929031021 +0000 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2023-07-20 09:42:02.929031021 +0000 2023-07-20T09:49:24.247 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2023-07-20 09:42:02.929031021 +0000 2023-07-20T09:49:24.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-20T09:49:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2023-07-20T09:49:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2023-07-20T09:49:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000399869 s, 1.3 MB/s 2023-07-20T09:49:24.315 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-20T09:49:24.368 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:24.368 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:24.369 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-07-20T09:49:24.379 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-20T09:49:24.379 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-07-20T09:49:24.431 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-20T09:49:24.431 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.431 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 888 Links: 1 2023-07-20T09:49:24.431 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.432 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-07-20 09:42:00.182413578 +0000 2023-07-20T09:49:24.432 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-07-20 09:41:59.750438741 +0000 2023-07-20T09:49:24.432 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-07-20 09:41:59.750438741 +0000 2023-07-20T09:49:24.432 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-07-20 09:41:59.750438741 +0000 2023-07-20T09:49:24.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-20T09:49:24.499 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-07-20T09:49:24.499 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-07-20T09:49:24.499 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000392692 s, 1.3 MB/s 2023-07-20T09:49:24.500 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-20T09:49:24.557 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-07-20T09:49:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-20T09:49:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.607 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-07-20T09:49:24.607 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.608 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-07-20 09:42:00.622388208 +0000 2023-07-20T09:49:24.608 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-07-20 09:42:00.618388438 +0000 2023-07-20T09:49:24.608 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-07-20 09:42:00.618388438 +0000 2023-07-20T09:49:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-07-20 09:42:00.618388438 +0000 2023-07-20T09:49:24.609 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-20T09:49:24.670 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-07-20T09:49:24.671 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-07-20T09:49:24.671 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000671137 s, 763 kB/s 2023-07-20T09:49:24.672 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-20T09:49:24.724 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-07-20T09:49:24.774 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-20T09:49:24.774 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.774 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-07-20T09:49:24.775 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.775 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-07-20 09:42:01.822319837 +0000 2023-07-20T09:49:24.775 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-07-20 09:42:01.350346577 +0000 2023-07-20T09:49:24.775 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-07-20 09:42:01.350346577 +0000 2023-07-20T09:49:24.775 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-07-20 09:42:01.350346577 +0000 2023-07-20T09:49:24.775 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-20T09:49:24.842 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-07-20T09:49:24.842 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-07-20T09:49:24.842 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000384641 s, 1.3 MB/s 2023-07-20T09:49:24.844 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-20T09:49:24.896 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-07-20T09:49:24.950 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-20T09:49:24.951 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-20T09:49:24.951 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-07-20T09:49:24.951 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-20T09:49:24.951 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-07-20 09:42:02.570278585 +0000 2023-07-20T09:49:24.951 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-07-20 09:42:02.110303726 +0000 2023-07-20T09:49:24.952 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-07-20 09:42:02.110303726 +0000 2023-07-20T09:49:24.952 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-07-20 09:42:02.110303726 +0000 2023-07-20T09:49:24.952 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-20T09:49:25.017 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-07-20T09:49:25.018 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-07-20T09:49:25.018 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000402732 s, 1.3 MB/s 2023-07-20T09:49:25.019 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-20T09:49:25.072 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:25.073 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-20T09:49:25.073 INFO:tasks.ceph:Generating config... 2023-07-20T09:49:25.074 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-20T09:49:25.074 INFO:tasks.ceph:[client] debug client = 20 2023-07-20T09:49:25.075 INFO:tasks.ceph:[client] debug ms = 1 2023-07-20T09:49:25.075 INFO:tasks.ceph:[client] pid file = 2023-07-20T09:49:25.075 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-20T09:49:25.075 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-20T09:49:25.075 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-20T09:49:25.076 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-20T09:49:25.076 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-20T09:49:25.076 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-20T09:49:25.076 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-20T09:49:25.076 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-20T09:49:25.077 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-20T09:49:25.077 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-20T09:49:25.077 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-20T09:49:25.077 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-20T09:49:25.077 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-20T09:49:25.078 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-20T09:49:25.079 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-20T09:49:25.079 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-20T09:49:25.079 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-20T09:49:25.079 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-20T09:49:25.079 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-20T09:49:25.080 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-20T09:49:25.080 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-20T09:49:25.080 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-20T09:49:25.080 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-20T09:49:25.080 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-20T09:49:25.081 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-20T09:49:25.081 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-20T09:49:25.081 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-20T09:49:25.081 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-20T09:49:25.081 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-20T09:49:25.082 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-20T09:49:25.082 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-20T09:49:25.082 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-20T09:49:25.082 INFO:tasks.ceph:Setting up mon.a... 2023-07-20T09:49:25.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-20T09:49:25.130 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.keyring 2023-07-20T09:49:25.143 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-20T09:49:25.193 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-20T09:49:25.214 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.82'), ('mon.b', '172.21.15.183'), ('mon.c', '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]')] 2023-07-20T09:49:25.215 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.82,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-20T09:49:25.216 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:25.216 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-20T09:49:25.265 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.82 --add b 172.21.15.183 --addv c '[v2:172.21.15.183:3301,v1:172.21.15.183:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: generated fsid 79d507c4-9484-40cb-9468-5aa547ff1f30 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = pacific 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 0 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 79d507c4-9484-40cb-9468-5aa547ff1f30 2023-07-20T09:49:25.356 INFO:teuthology.orchestra.run.smithi082.stdout:last_changed 2023-07-20T09:49:25.322476+0000 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:created 2023-07-20T09:49:25.322476+0000 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:min_mon_release 16 (pacific) 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:election_strategy: 1 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.b 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:2: [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] mon.c 2023-07-20T09:49:25.357 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-20T09:49:25.358 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-20T09:49:25.367 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 79d507c4-9484-40cb-9468-5aa547ff1f30... 2023-07-20T09:49:25.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-20T09:49:25.412 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-20T09:49:25.454 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2023-07-20T09:49:25.454 INFO:teuthology.orchestra.run.smithi082.stdout: chdir = "" 2023-07-20T09:49:25.455 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-20T09:49:25.455 INFO:teuthology.orchestra.run.smithi082.stdout: auth supported = cephx 2023-07-20T09:49:25.455 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.455 INFO:teuthology.orchestra.run.smithi082.stdout: filestore xattr use omap = true 2023-07-20T09:49:25.456 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.456 INFO:teuthology.orchestra.run.smithi082.stdout: mon clock drift allowed = 1.000 2023-07-20T09:49:25.456 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: osd crush chooseleaf type = 0 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: auth debug = true 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on old message = true 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on bug = true 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.457 INFO:teuthology.orchestra.run.smithi082.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: mon pg warn max object skew = 0 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: # disable pg_autoscaler by default for new pools 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default size = 2 2023-07-20T09:49:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.459 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow primary affinity = true 2023-07-20T09:49:25.459 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd allow pg remap = true 2023-07-20T09:49:25.459 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on legacy crush tunables = false 2023-07-20T09:49:25.459 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on crush straw calc version zero = false 2023-07-20T09:49:25.460 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on no sortbitwise = false 2023-07-20T09:49:25.460 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on osd down out interval zero = false 2023-07-20T09:49:25.460 INFO:teuthology.orchestra.run.smithi082.stdout: mon warn on too few osds = false 2023-07-20T09:49:25.460 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-20T09:49:25.461 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-20T09:49:25.461 INFO:teuthology.orchestra.run.smithi082.stdout: mon_allow_pool_size_one = true 2023-07-20T09:49:25.461 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.461 INFO:teuthology.orchestra.run.smithi082.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-20T09:49:25.462 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.462 INFO:teuthology.orchestra.run.smithi082.stdout: osd default data pool replay window = 5 2023-07-20T09:49:25.462 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.462 INFO:teuthology.orchestra.run.smithi082.stdout: mon allow pool delete = true 2023-07-20T09:49:25.463 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.463 INFO:teuthology.orchestra.run.smithi082.stdout: mon cluster log file level = debug 2023-07-20T09:49:25.463 INFO:teuthology.orchestra.run.smithi082.stdout: debug asserts on shutdown = true 2023-07-20T09:49:25.464 INFO:teuthology.orchestra.run.smithi082.stdout: mon health detail to clog = false 2023-07-20T09:49:25.464 INFO:teuthology.orchestra.run.smithi082.stdout: mon host = "172.21.15.82,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-07-20T09:49:25.464 INFO:teuthology.orchestra.run.smithi082.stdout: ms die on skipped message = False 2023-07-20T09:49:25.464 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 79d507c4-9484-40cb-9468-5aa547ff1f30 2023-07-20T09:49:25.465 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.465 INFO:teuthology.orchestra.run.smithi082.stdout:[osd] 2023-07-20T09:49:25.465 INFO:teuthology.orchestra.run.smithi082.stdout: osd journal size = 100 2023-07-20T09:49:25.465 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.466 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub load threshold = 5.0 2023-07-20T09:49:25.466 INFO:teuthology.orchestra.run.smithi082.stdout: osd scrub max interval = 600 2023-07-20T09:49:25.466 INFO:teuthology.orchestra.run.smithi082.stdout: osd mclock profile = high_recovery_ops 2023-07-20T09:49:25.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.467 INFO:teuthology.orchestra.run.smithi082.stdout: osd recover clone overlap = true 2023-07-20T09:49:25.467 INFO:teuthology.orchestra.run.smithi082.stdout: osd recovery max chunk = 1048576 2023-07-20T09:49:25.467 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug shutdown = true 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug op order = true 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug verify stray on activate = true 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: osd open classes on start = true 2023-07-20T09:49:25.468 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug pg log writeout = true 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: osd deep scrub update digest min age = 30 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: osd map max advance = 10 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: journal zero on create = true 2023-07-20T09:49:25.469 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: filestore ondisk finisher threads = 3 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: filestore apply finisher threads = 3 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: bdev debug aio = true 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: osd debug misdirected ops = true 2023-07-20T09:49:25.470 INFO:teuthology.orchestra.run.smithi082.stdout: bdev async discard = True 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: bdev enable discard = True 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore allocator = bitmap 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore block size = 96636764160 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: bluestore fsck on mount = True 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluefs = 1/20 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: debug bluestore = 1/20 2023-07-20T09:49:25.471 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-07-20T09:49:25.472 INFO:teuthology.orchestra.run.smithi082.stdout: debug osd = 20 2023-07-20T09:49:25.472 INFO:teuthology.orchestra.run.smithi082.stdout: debug rocksdb = 4/10 2023-07-20T09:49:25.472 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd backfillfull_ratio = 0.85 2023-07-20T09:49:25.472 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd full ratio = 0.9 2023-07-20T09:49:25.472 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd nearfull ratio = 0.8 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: osd failsafe full ratio = 0.95 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: osd objectstore = bluestore 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr] 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-07-20T09:49:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: debug mgr = 20 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: mgr/telemetry/nag = false 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-07-20T09:49:25.474 INFO:teuthology.orchestra.run.smithi082.stdout: debug finisher = 20 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout:[mon] 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: debug mon = 20 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: debug paxos = 20 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: debug auth = 20 2023-07-20T09:49:25.475 INFO:teuthology.orchestra.run.smithi082.stdout: mon data avail warn = 5 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: mon mgr mkfs grace = 240 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min pgs per osd = 4 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd reporter subtree level = osd 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: mon osd prime pg temp = true 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: mon reweight min bytes per osd = 10 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.476 INFO:teuthology.orchestra.run.smithi082.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: auth mon ticket ttl = 660 # 11m 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: auth service ticket ttl = 240 # 4m 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: # don't complain about insecure global_id in the test suite 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-20T09:49:25.477 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-20T09:49:25.478 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.478 INFO:teuthology.orchestra.run.smithi082.stdout: # 1m isn't quite enough 2023-07-20T09:49:25.478 INFO:teuthology.orchestra.run.smithi082.stdout: mon_down_mkfs_grace = 2m 2023-07-20T09:49:25.478 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.478 INFO:teuthology.orchestra.run.smithi082.stdout: mon_warn_on_filestore_osds = false 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: mon op complaint time = 120 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout:[client] 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: rgw cache enabled = true 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable ops log = true 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: rgw enable usage log = true 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-20T09:49:25.479 INFO:teuthology.orchestra.run.smithi082.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: client mount timeout = 600 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: debug client = 20 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: pid file = "" 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-07-20T09:49:25.480 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.a] 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.b] 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mon.c] 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-07-20T09:49:25.481 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout:[mds] 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds = 20 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout: debug mds balancer = 20 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout: debug ms = 1 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug frag = True 2023-07-20T09:49:25.482 INFO:teuthology.orchestra.run.smithi082.stdout: mds debug scatterstat = True 2023-07-20T09:49:25.483 INFO:teuthology.orchestra.run.smithi082.stdout: mds op complaint time = 180 2023-07-20T09:49:25.483 INFO:teuthology.orchestra.run.smithi082.stdout: mds verify scatter = True 2023-07-20T09:49:25.483 INFO:teuthology.orchestra.run.smithi082.stdout: osd op complaint time = 180 2023-07-20T09:49:25.483 INFO:teuthology.orchestra.run.smithi082.stdout: rados mon op timeout = 900 2023-07-20T09:49:25.483 INFO:teuthology.orchestra.run.smithi082.stdout: rados osd op timeout = 900 2023-07-20T09:49:25.485 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-07-20T09:49:25.485 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-07-20T09:49:25.485 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-07-20T09:49:25.486 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.487 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-07-20T09:49:25.488 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-07-20T09:49:25.489 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.490 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-07-20T09:49:25.491 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.82,172.21.15.183,[v2:172.21.15.183:3301,v1:172.21.15.183:6790]" 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on skipped message = False 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = 79d507c4-9484-40cb-9468-5aa547ff1f30 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-07-20T09:49:25.492 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-07-20T09:49:25.493 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.494 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.495 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-07-20T09:49:25.496 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore allocator = bitmap 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-07-20T09:49:25.497 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1/20 2023-07-20T09:49:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1/20 2023-07-20T09:49:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-07-20T09:49:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-07-20T09:49:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 4/10 2023-07-20T09:49:25.498 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-07-20T09:49:25.499 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.500 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-07-20T09:49:25.500 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-07-20T09:49:25.500 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-07-20T09:49:25.500 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-07-20T09:49:25.500 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-07-20T09:49:25.501 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-07-20T09:49:25.501 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-07-20T09:49:25.501 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-07-20T09:49:25.501 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-07-20T09:49:25.502 INFO:teuthology.orchestra.run.smithi183.stdout: debug finisher = 20 2023-07-20T09:49:25.502 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.502 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-07-20T09:49:25.502 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-07-20T09:49:25.503 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-07-20T09:49:25.503 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-07-20T09:49:25.503 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-07-20T09:49:25.503 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-07-20T09:49:25.503 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-07-20T09:49:25.504 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-07-20T09:49:25.504 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-07-20T09:49:25.504 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-07-20T09:49:25.504 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.505 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-07-20T09:49:25.506 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-20T09:49:25.506 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-20T09:49:25.506 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.506 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-07-20T09:49:25.507 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-07-20T09:49:25.507 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.507 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-07-20T09:49:25.508 INFO:teuthology.orchestra.run.smithi183.stdout: mon op complaint time = 120 2023-07-20T09:49:25.508 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-07-20T09:49:25.508 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-07-20T09:49:25.509 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-07-20T09:49:25.509 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-07-20T09:49:25.509 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-07-20T09:49:25.510 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-20T09:49:25.510 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-20T09:49:25.510 INFO:teuthology.orchestra.run.smithi183.stdout: client mount timeout = 600 2023-07-20T09:49:25.510 INFO:teuthology.orchestra.run.smithi183.stdout: debug client = 20 2023-07-20T09:49:25.511 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-07-20T09:49:25.511 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = "" 2023-07-20T09:49:25.511 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-07-20T09:49:25.512 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-07-20T09:49:25.512 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-07-20T09:49:25.512 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-07-20T09:49:25.513 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-07-20T09:49:25.513 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-07-20T09:49:25.513 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-07-20T09:49:25.513 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout:[mds] 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds = 20 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout: debug mds balancer = 20 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-07-20T09:49:25.514 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug frag = True 2023-07-20T09:49:25.515 INFO:teuthology.orchestra.run.smithi183.stdout: mds debug scatterstat = True 2023-07-20T09:49:25.515 INFO:teuthology.orchestra.run.smithi183.stdout: mds op complaint time = 180 2023-07-20T09:49:25.515 INFO:teuthology.orchestra.run.smithi183.stdout: mds verify scatter = True 2023-07-20T09:49:25.516 INFO:teuthology.orchestra.run.smithi183.stdout: osd op complaint time = 180 2023-07-20T09:49:25.516 INFO:teuthology.orchestra.run.smithi183.stdout: rados mon op timeout = 900 2023-07-20T09:49:25.516 INFO:teuthology.orchestra.run.smithi183.stdout: rados osd op timeout = 900 2023-07-20T09:49:25.517 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-20T09:49:25.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-20T09:49:25.593 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-20T09:49:25.594 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:25.594 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-20T09:49:25.650 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:25.650 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-20T09:49:25.701 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:49:25.701 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:25.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-20T09:49:25.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-20T09:49:25.774 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:25.775 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:25.825 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:49:25.825 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:25.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-20T09:49:25.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-20T09:49:25.863 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:25.863 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:25.914 INFO:tasks.ceph:Setting up mon nodes... 2023-07-20T09:49:25.915 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-20T09:49:25.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-20T09:49:25.972 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-20T09:49:25.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-20T09:49:26.038 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-20T09:49:26.060 INFO:tasks.ceph:Setting up mds nodes... 2023-07-20T09:49:26.060 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-20T09:49:26.117 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-20T09:49:26.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-20T09:49:26.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-20T09:49:26.241 INFO:teuthology.orchestra.run.smithi082.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-20T09:49:26.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-20T09:49:26.266 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-20T09:49:26.327 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-20T09:49:26.332 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-20T09:49:26.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-20T09:49:26.451 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-20T09:49:26.455 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-20T09:49:26.475 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-20T09:49:26.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-20T09:49:26.519 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-20T09:49:26.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-20T09:49:26.619 INFO:teuthology.orchestra.run.smithi082.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-20T09:49:26.637 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-20T09:49:26.681 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-20T09:49:26.699 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-20T09:49:26.789 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-20T09:49:26.806 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-20T09:49:26.807 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi082.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-20T09:49:26.807 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-20T09:49:26.828 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:26.828 INFO:tasks.ceph:role: osd.0 2023-07-20T09:49:26.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:49:26.829 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-20T09:49:26.896 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:26.897 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:26.897 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:26.897 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:26.897 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:26.897 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:26.898 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:26.898 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:26.898 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:26.899 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:27.385 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-07-20T09:49:27.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-07-20T09:49:27.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-20T09:49:27.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-20T09:49:27.545 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:27.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:27.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-20T09:49:27.612 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:27.613 INFO:tasks.ceph:role: osd.1 2023-07-20T09:49:27.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:49:27.613 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-20T09:49:27.680 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:27.680 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:27.680 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:27.681 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:28.125 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-07-20T09:49:28.128 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-07-20T09:49:28.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-20T09:49:28.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-20T09:49:28.244 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:28.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:28.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-20T09:49:28.309 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:28.310 INFO:tasks.ceph:role: osd.2 2023-07-20T09:49:28.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:49:28.311 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-20T09:49:28.385 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:28.386 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:28.386 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:28.387 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:28.387 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:28.387 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:28.387 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:28.849 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-07-20T09:49:28.851 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-07-20T09:49:28.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-20T09:49:28.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-20T09:49:29.013 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:29.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:29.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-20T09:49:29.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:29.079 INFO:tasks.ceph:role: osd.3 2023-07-20T09:49:29.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:49:29.079 DEBUG:teuthology.orchestra.run.smithi082:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-20T09:49:29.150 INFO:teuthology.orchestra.run.smithi082.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:29.151 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:29.151 INFO:teuthology.orchestra.run.smithi082.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:29.151 INFO:teuthology.orchestra.run.smithi082.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:29.152 INFO:teuthology.orchestra.run.smithi082.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:29.152 INFO:teuthology.orchestra.run.smithi082.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:29.152 INFO:teuthology.orchestra.run.smithi082.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:29.153 INFO:teuthology.orchestra.run.smithi082.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:29.153 INFO:teuthology.orchestra.run.smithi082.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:29.153 INFO:teuthology.orchestra.run.smithi082.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:29.664 INFO:teuthology.orchestra.run.smithi082.stdout:Discarding blocks...Done. 2023-07-20T09:49:29.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi082.front.sepia.ceph.com -o noatime 2023-07-20T09:49:29.667 DEBUG:teuthology.orchestra.run.smithi082:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-20T09:49:29.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-20T09:49:29.823 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:29.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:29.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:29.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.923+0000 7f6651cff640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-20T09:49:29.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.927+0000 7f6651cff640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-20T09:49:29.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.927+0000 7f6651cff640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-20T09:49:29.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.927+0000 7f6651cff640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-20T09:49:29.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.927+0000 7f6651cff640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-20T09:49:29.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:29.931+0000 7f6651cff640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-20T09:49:32.945 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-20T09:49:32.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:33.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.027+0000 7ff2c2dbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-20T09:49:33.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.027+0000 7ff2c2dbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-20T09:49:33.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.027+0000 7ff2c2dbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-20T09:49:33.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.027+0000 7ff2c2dbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-20T09:49:33.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.027+0000 7ff2c2dbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-20T09:49:33.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:33.031+0000 7ff2c2dbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-20T09:49:36.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-20T09:49:36.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.143+0000 7f8eb136e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-20T09:49:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.147+0000 7f8eb136e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-20T09:49:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.147+0000 7f8eb136e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-20T09:49:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.147+0000 7f8eb136e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-20T09:49:36.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.147+0000 7f8eb136e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-20T09:49:36.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:36.147+0000 7f8eb136e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-20T09:49:39.179 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-20T09:49:39.201 DEBUG:teuthology.orchestra.run.smithi082:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:39.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.259+0000 7fdcc05ca640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-20T09:49:39.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.259+0000 7fdcc05ca640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-20T09:49:39.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.259+0000 7fdcc05ca640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-20T09:49:39.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.259+0000 7fdcc05ca640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-20T09:49:39.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.259+0000 7fdcc05ca640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-20T09:49:39.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:49:39.263+0000 7fdcc05ca640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-20T09:49:42.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-20T09:49:42.305 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-20T09:49:42.329 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:42.329 INFO:tasks.ceph:role: osd.4 2023-07-20T09:49:42.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:49:42.330 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-20T09:49:42.399 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:42.400 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:42.401 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:42.401 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:42.401 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:42.852 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-07-20T09:49:42.855 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-07-20T09:49:42.855 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-20T09:49:42.971 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-20T09:49:42.989 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:42.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:42.990 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-20T09:49:43.056 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:43.056 INFO:tasks.ceph:role: osd.5 2023-07-20T09:49:43.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:49:43.057 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-20T09:49:43.127 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:43.128 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:43.128 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:43.128 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:43.128 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:43.128 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:43.129 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:43.129 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:43.129 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:43.129 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:43.637 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-07-20T09:49:43.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-07-20T09:49:43.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-20T09:49:43.799 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-20T09:49:43.817 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:43.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:43.819 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-20T09:49:43.888 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:43.889 INFO:tasks.ceph:role: osd.6 2023-07-20T09:49:43.889 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:49:43.890 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-20T09:49:43.964 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:43.965 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:44.451 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-07-20T09:49:44.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-07-20T09:49:44.454 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-20T09:49:44.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-20T09:49:44.600 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:44.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:44.601 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-20T09:49:44.668 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-20T09:49:44.669 INFO:tasks.ceph:role: osd.7 2023-07-20T09:49:44.669 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:49:44.669 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-20T09:49:44.739 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-20T09:49:44.739 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-20T09:49:44.739 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-20T09:49:44.740 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-20T09:49:45.201 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-07-20T09:49:45.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-07-20T09:49:45.204 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-20T09:49:45.314 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-20T09:49:45.333 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: /sbin/restorecon: command not found 2023-07-20T09:49:45.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:49:45.334 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:45.471 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.437+0000 7f32bf02b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-20T09:49:45.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.441+0000 7f32bf02b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-20T09:49:45.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.441+0000 7f32bf02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-20T09:49:45.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.441+0000 7f32bf02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-20T09:49:45.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.441+0000 7f32bf02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-20T09:49:45.479 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:45.445+0000 7f32bf02b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-20T09:49:48.461 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-20T09:49:48.483 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:48.581 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.545+0000 7f2ae5b57640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-20T09:49:48.582 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.545+0000 7f2ae5b57640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-20T09:49:48.582 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.545+0000 7f2ae5b57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-20T09:49:48.582 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.545+0000 7f2ae5b57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-20T09:49:48.583 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.545+0000 7f2ae5b57640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-20T09:49:48.584 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:48.549+0000 7f2ae5b57640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-20T09:49:51.569 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-20T09:49:51.591 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:51.687 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-20T09:49:51.688 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-20T09:49:51.688 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-20T09:49:51.688 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-20T09:49:51.689 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-20T09:49:51.689 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:51.653+0000 7f969593c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-20T09:49:53.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:49:53.562 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:49:54.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-20T09:49:54.690 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:49:54.788 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-20T09:49:54.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-20T09:49:54.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-20T09:49:54.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-20T09:49:54.789 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-20T09:49:54.790 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:49:54.753+0000 7eff4026b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-20T09:49:57.781 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-20T09:49:57.803 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-20T09:49:57.804 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:57.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-20T09:49:57.828 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:57.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-20T09:49:57.894 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:57.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-20T09:49:57.958 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:57.959 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-20T09:49:58.022 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:58.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-20T09:49:58.091 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:58.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-20T09:49:58.154 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:58.155 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-20T09:49:58.218 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.218 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-20T09:49:58.239 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.240 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-20T09:49:58.303 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.304 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-20T09:49:58.366 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.367 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-20T09:49:58.430 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.430 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-20T09:49:58.490 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.490 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-20T09:49:58.550 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.551 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-20T09:49:58.610 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:58.610 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-20T09:49:58.620 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:49:58.620 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-20T09:49:58.673 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.674 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-20T09:49:58.682 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:49:58.682 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-20T09:49:58.731 INFO:tasks.ceph:Adding keys to all mons... 2023-07-20T09:49:58.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-20T09:49:58.735 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-20T09:49:58.782 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.y] 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw== 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a] 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q== 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c] 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw== 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.0] 2023-07-20T09:49:58.783 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg== 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.1] 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w== 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.2] 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw== 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.3] 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg== 2023-07-20T09:49:58.784 INFO:teuthology.orchestra.run.smithi082.stdout:[mgr.x] 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA== 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b] 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw== 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d] 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA== 2023-07-20T09:49:58.785 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.4] 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w== 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.5] 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg== 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.6] 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw== 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout:[osd.7] 2023-07-20T09:49:58.786 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w== 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout:[client.2] 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ== 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout:[client.1] 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A== 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout:[client.3] 2023-07-20T09:49:58.787 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg== 2023-07-20T09:49:58.796 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-07-20T09:49:58.796 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw== 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.a] 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q== 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.c] 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw== 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg== 2023-07-20T09:49:58.797 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w== 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw== 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg== 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA== 2023-07-20T09:49:58.798 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.b] 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw== 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout:[mds.d] 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA== 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w== 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg== 2023-07-20T09:49:58.799 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw== 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w== 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout:[client.2] 2023-07-20T09:49:58.800 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ== 2023-07-20T09:49:58.801 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-07-20T09:49:58.801 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A== 2023-07-20T09:49:58.801 INFO:teuthology.orchestra.run.smithi183.stdout:[client.3] 2023-07-20T09:49:58.801 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg== 2023-07-20T09:49:58.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-20T09:49:58.836 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-20T09:49:58.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:58.902 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:58.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:58.978 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:59.037 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.041 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.100 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.160 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.222 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-20T09:49:59.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-20T09:49:59.338 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:59.342 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:59.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:59.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-20T09:49:59.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.468 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.527 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.586 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.642 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.646 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-20T09:49:59.701 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.705 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.766 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.829 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.892 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-20T09:49:59.950 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-20T09:49:59.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-20T09:49:59.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-20T09:50:00.088 DEBUG:teuthology.orchestra.run.smithi082:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-20T09:50:00.108 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-20T09:50:00.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-20T09:50:00.244 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-20T09:50:00.265 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-20T09:50:00.325 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-20T09:50:00.439 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-20T09:50:00.460 DEBUG:teuthology.orchestra.run.smithi082:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:50:00.463 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-20T09:50:00.510 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-20T09:50:00.510 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-20T09:50:00.511 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-20T09:50:00.515 INFO:tasks.ceph.mon.a:Started 2023-07-20T09:50:00.516 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-20T09:50:00.516 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-20T09:50:00.557 INFO:tasks.ceph.mon.b:Started 2023-07-20T09:50:00.557 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-20T09:50:00.558 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-20T09:50:00.561 INFO:tasks.ceph.mon.c:Started 2023-07-20T09:50:00.562 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-20T09:50:00.563 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-20T09:50:00.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-20T09:50:00.567 INFO:tasks.ceph.mgr.y:Started 2023-07-20T09:50:00.568 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-20T09:50:00.568 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-20T09:50:00.571 INFO:tasks.ceph.mgr.x:Started 2023-07-20T09:50:00.572 INFO:tasks.ceph:Setting crush tunables to default 2023-07-20T09:50:00.572 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd crush tunables default 2023-07-20T09:50:00.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.675+0000 7f8bd100b640 1 Processor -- start 2023-07-20T09:50:00.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.675+0000 7f8bd100b640 1 -- start start 2023-07-20T09:50:00.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.675+0000 7f8bd100b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bd100b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bd100b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bcc0cc8d0 con 0x7f8bcc159830 2023-07-20T09:50:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bd100b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bcc0cce90 con 0x7f8bcc0afd50 2023-07-20T09:50:00.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bd100b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc0b0700 con 0x7f8bcc159450 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33296/0 (socket says 172.21.15.82:33296) 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 learned_addr learned my addr 172.21.15.82:0/718182656 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 msgr2=0x7f8bcc0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 msgr2=0x7f8bcc0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-20T09:50:00.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/718182656 >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-20T09:50:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/718182656 >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T09:50:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcad9d640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-20T09:50:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcad9d640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-20T09:50:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-20T09:50:00.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.679+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T09:50:00.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/718182656 >> v2:172.21.15.82:3300/0 conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcad9d640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-20T09:50:00.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcad9d640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-20T09:50:00.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-20T09:50:00.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:00.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T09:50:00.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:00.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 >> v1:172.21.15.183:6789/0 conn(0x7f8bcc159830 legacy=0x7f8bcc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:00.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.883+0000 7f8bcb59e640 1 -- 172.21.15.82:0/718182656 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc0ccbb0 con 0x7f8bcc0afd50 2023-07-20T09:50:00.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098d0 tx=0x7f8bc401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277752abf7cc9580 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:00.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bc9d9b640 1 -- 172.21.15.82:0/718182656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40a5840 con 0x7f8bcc0afd50 2023-07-20T09:50:00.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bc9d9b640 1 -- 172.21.15.82:0/718182656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a59a0 con 0x7f8bcc0afd50 2023-07-20T09:50:00.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bc9d9b640 1 -- 172.21.15.82:0/718182656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40a5d90 con 0x7f8bcc0afd50 2023-07-20T09:50:00.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 -- 172.21.15.82:0/718182656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 msgr2=0x7f8bcc0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:00.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098d0 tx=0x7f8bc401c780 comp rx=0 tx=0).stop 2023-07-20T09:50:00.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 -- 172.21.15.82:0/718182656 shutdown_connections 2023-07-20T09:50:00.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc0b01c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:00.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 --2- 172.21.15.82:0/718182656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc159450 0x7f8bcc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:00.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 -- 172.21.15.82:0/718182656 >> 172.21.15.82:0/718182656 conn(0x7f8bcc0cad50 msgr2=0x7f8bcc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:00.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 -- 172.21.15.82:0/718182656 shutdown_connections 2023-07-20T09:50:00.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.887+0000 7f8bd100b640 1 -- 172.21.15.82:0/718182656 wait complete. 2023-07-20T09:50:00.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 Processor -- start 2023-07-20T09:50:00.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- start start 2023-07-20T09:50:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bcc159450 0x7f8bcc1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:00.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc1ee370 0x7f8bcc1ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc14a070 con 0x7f8bcc0afd50 2023-07-20T09:50:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc1f0470 con 0x7f8bcc159450 2023-07-20T09:50:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc15c120 con 0x7f8bcc1ee370 2023-07-20T09:50:00.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33342/0 (socket says 172.21.15.82:33342) 2023-07-20T09:50:00.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 -- 172.21.15.82:0/3443039499 learned_addr learned my addr 172.21.15.82:0/3443039499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:00.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bca59c640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bcc159450 0x7f8bcc1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcb59e640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc1ee370 0x7f8bcc1ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:00.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 -- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc1ee370 msgr2=0x7f8bcc1ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:00.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc1ee370 0x7f8bcc1ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:00.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 -- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bcc159450 msgr2=0x7f8bcc1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:00.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bcc159450 0x7f8bcc1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:00.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 -- 172.21.15.82:0/3443039499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc4009530 con 0x7f8bcc0afd50 2023-07-20T09:50:00.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bcad9d640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc004630 tx=0x7f8bbc007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:00.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc014610 con 0x7f8bcc0afd50 2023-07-20T09:50:00.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00f050 con 0x7f8bcc0afd50 2023-07-20T09:50:00.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc0149d0 con 0x7f8bcc0afd50 2023-07-20T09:50:00.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc15be40 con 0x7f8bcc0afd50 2023-07-20T09:50:00.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8bbc014b30 con 0x7f8bcc0afd50 2023-07-20T09:50:00.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc0c6f50 con 0x7f8bcc0afd50 2023-07-20T09:50:00.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.891+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8bbc01e460 con 0x7f8bcc0afd50 2023-07-20T09:50:00.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.895+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc0c6ad0 con 0x7f8bcc0afd50 2023-07-20T09:50:00.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.907+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8bcc0c6ad0 con 0x7f8bcc0afd50 2023-07-20T09:50:01.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.967+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8bcc04da30 con 0x7f8bcc0afd50 2023-07-20T09:50:01.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.971+0000 7f8bb37fe640 1 -- 172.21.15.82:0/3443039499 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8bbc01e620 con 0x7f8bcc0afd50 2023-07-20T09:50:01.009 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2023-07-20T09:50:01.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 msgr2=0x7f8bcc149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc004630 tx=0x7f8bbc007700 comp rx=0 tx=0).stop 2023-07-20T09:50:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 shutdown_connections 2023-07-20T09:50:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bcc1ee370 0x7f8bcc1ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bcc159450 0x7f8bcc1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 --2- 172.21.15.82:0/3443039499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bcc0afd50 0x7f8bcc149b30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 >> 172.21.15.82:0/3443039499 conn(0x7f8bcc0cad50 msgr2=0x7f8bcc158790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:01.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 shutdown_connections 2023-07-20T09:50:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:00.975+0000 7f8bd100b640 1 -- 172.21.15.82:0/3443039499 wait complete. 2023-07-20T09:50:01.029 INFO:tasks.ceph:check_enable_crimson: False 2023-07-20T09:50:01.030 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-20T09:50:01.030 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:01.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-20T09:50:01.053 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:01.053 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-20T09:50:01.115 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:01.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-20T09:50:01.134 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:01.099+0000 7f766302c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T09:50:01.156 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:01.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-20T09:50:01.162 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:01.124+0000 7f9234787180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T09:50:01.219 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:01.219 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-20T09:50:01.241 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:01.241 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-20T09:50:01.302 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:01.303 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-20T09:50:01.362 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:01.363 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-20T09:50:01.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e 0 2023-07-20T09:50:01.605 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.568+0000 7f8040367640 1 Processor -- start 2023-07-20T09:50:01.606 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.568+0000 7f8040367640 1 -- start start 2023-07-20T09:50:01.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f8040367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f8040367640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80380d0ca0 0x7f80380d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.607 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f8040367640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80380cd5e0 con 0x7f80380d0320 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f8040367640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380d1690 con 0x7f80380d0ca0 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f8040367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380cf610 con 0x7f803815c8e0 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55392/0 (socket says 172.21.15.183:55392) 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 -- 172.21.15.183:0/987724030 learned_addr learned my addr 172.21.15.183:0/987724030 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:01.608 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e904640 1 --2- 172.21.15.183:0/987724030 >> v2:172.21.15.82:3300/0 conn(0x7f80380d0ca0 0x7f80380d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 -- 172.21.15.183:0/987724030 >> v2:172.21.15.82:3300/0 conn(0x7f80380d0ca0 msgr2=0x7f80380d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:01.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 --2- 172.21.15.183:0/987724030 >> v2:172.21.15.82:3300/0 conn(0x7f80380d0ca0 0x7f80380d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 -- 172.21.15.183:0/987724030 >> v1:172.21.15.82:6789/0 conn(0x7f80380d0320 legacy=0x7f80380cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:01.609 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 -- 172.21.15.183:0/987724030 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803806b020 con 0x7f803815c8e0 2023-07-20T09:50:01.610 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.572+0000 7f803e103640 1 --2- 172.21.15.183:0/987724030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afff331e7709874 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:01.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f803d101640 1 -- 172.21.15.183:0/987724030 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340aa5f0 con 0x7f803815c8e0 2023-07-20T09:50:01.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f803d101640 1 -- 172.21.15.183:0/987724030 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80340aa750 con 0x7f803815c8e0 2023-07-20T09:50:01.611 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f803d101640 1 -- 172.21.15.183:0/987724030 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340aaae0 con 0x7f803815c8e0 2023-07-20T09:50:01.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- 172.21.15.183:0/987724030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 msgr2=0x7f803806aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- 172.21.15.183:0/987724030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8034009870 tx=0x7f803401c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- 172.21.15.183:0/987724030 shutdown_connections 2023-07-20T09:50:01.612 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- 172.21.15.183:0/987724030 >> v2:172.21.15.82:3300/0 conn(0x7f80380d0ca0 0x7f80380d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- 172.21.15.183:0/987724030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803806aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- 172.21.15.183:0/987724030 >> 172.21.15.183:0/987724030 conn(0x7f8038065d40 msgr2=0x7f803809b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:01.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- 172.21.15.183:0/987724030 shutdown_connections 2023-07-20T09:50:01.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- 172.21.15.183:0/987724030 wait complete. 2023-07-20T09:50:01.613 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 Processor -- start 2023-07-20T09:50:01.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- start start 2023-07-20T09:50:01.614 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80380d0ca0 0x7f803815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b40e0 con 0x7f80380d0320 2023-07-20T09:50:01.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b34d0 con 0x7f80380d0ca0 2023-07-20T09:50:01.615 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.576+0000 7f8040367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b37b0 con 0x7f803815c8e0 2023-07-20T09:50:01.617 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.617 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e904640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.617 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.183:52066/0 (socket says 172.21.15.183:52066) 2023-07-20T09:50:01.617 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 -- 172.21.15.183:0/408908477 learned_addr learned my addr 172.21.15.183:0/408908477 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:01.617 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803d902640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80380d0ca0 0x7f803815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 -- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 msgr2=0x7f803815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 -- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80380d0ca0 msgr2=0x7f803815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80380d0ca0 0x7f803815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 -- 172.21.15.183:0/408908477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340094d0 con 0x7f80380d0320 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e904640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f803e103640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80340ac040 tx=0x7f803401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:01.618 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340b3800 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80340b3960 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340b3d10 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80380b3a90 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380b7ff0 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80340c6740 con 0x7f80380d0320 2023-07-20T09:50:01.619 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f80340a7070 con 0x7f80380d0320 2023-07-20T09:50:01.620 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.580+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803804da30 con 0x7f80380d0320 2023-07-20T09:50:01.621 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.584+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f80340c6b80 con 0x7f80380d0320 2023-07-20T09:50:01.687 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.652+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e", "id": 0} v 0) v1 -- 0x7f803806a8c0 con 0x7f80380d0320 2023-07-20T09:50:01.692 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f802effd640 1 -- 172.21.15.183:0/408908477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80340c6d20 con 0x7f80380d0320 2023-07-20T09:50:01.693 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-07-20T09:50:01.694 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 msgr2=0x7f8038157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.694 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f80340ac040 tx=0x7f803401ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:01.694 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 shutdown_connections 2023-07-20T09:50:01.694 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f803815c8e0 0x7f803815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80380d0ca0 0x7f803815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 --2- 172.21.15.183:0/408908477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80380d0320 0x7f8038157970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 >> 172.21.15.183:0/408908477 conn(0x7f8038065d40 msgr2=0x7f80380afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:01.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 shutdown_connections 2023-07-20T09:50:01.695 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.656+0000 7f8040367640 1 -- 172.21.15.183:0/408908477 wait complete. 2023-07-20T09:50:01.709 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:01.671+0000 7f766302c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T09:50:01.712 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 200bd499-11e9-4e25-b0e8-7f3663f2d3d8 1 2023-07-20T09:50:01.723 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:01.688+0000 7f9234787180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T09:50:01.849 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 Processor -- start 2023-07-20T09:50:01.849 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 -- start start 2023-07-20T09:50:01.851 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb3c06ab10 0x7fbb3c06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c0ce4f0 con 0x7fbb3c06c120 2023-07-20T09:50:01.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c06b4c0 con 0x7fbb3c06ab10 2023-07-20T09:50:01.852 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb435f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0d0970 con 0x7fbb3c1602b0 2023-07-20T09:50:01.853 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb40b8e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.853 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb4138f640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fbb3c06c120 0x7fbb3c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.183:53204/0 (socket says 172.21.15.183:53204) 2023-07-20T09:50:01.853 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb4138f640 1 -- 172.21.15.183:0/2809238220 learned_addr learned my addr 172.21.15.183:0/2809238220 (peer_addr_for_me v1:172.21.15.183:0/0) 2023-07-20T09:50:01.854 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb41b90640 1 --2- 172.21.15.183:0/2809238220 >> v2:172.21.15.82:3300/0 conn(0x7fbb3c06ab10 0x7fbb3c06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.854 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb33fff640 1 -- 172.21.15.183:0/2809238220 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495761945 0 0) 0x7fbb3c0ce4f0 con 0x7fbb3c06c120 2023-07-20T09:50:01.854 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb40b8e640 1 -- 172.21.15.183:0/2809238220 >> v2:172.21.15.82:3300/0 conn(0x7fbb3c06ab10 msgr2=0x7fbb3c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:01.854 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb40b8e640 1 --2- 172.21.15.183:0/2809238220 >> v2:172.21.15.82:3300/0 conn(0x7fbb3c06ab10 0x7fbb3c06af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.855 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb40b8e640 1 -- 172.21.15.183:0/2809238220 >> v1:172.21.15.183:6789/0 conn(0x7fbb3c06c120 legacy=0x7fbb3c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.855 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.812+0000 7fbb40b8e640 1 -- 172.21.15.183:0/2809238220 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c160e20 con 0x7fbb3c1602b0 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb40b8e640 1 --2- 172.21.15.183:0/2809238220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c160710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0097c0 tx=0x7fbb2c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6538123c738beb0f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb33fff640 1 -- 172.21.15.183:0/2809238220 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0ab600 con 0x7fbb3c1602b0 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb33fff640 1 -- 172.21.15.183:0/2809238220 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0a7050 con 0x7fbb3c1602b0 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb33fff640 1 -- 172.21.15.183:0/2809238220 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0ab980 con 0x7fbb3c1602b0 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- 172.21.15.183:0/2809238220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 msgr2=0x7fbb3c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.857 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 --2- 172.21.15.183:0/2809238220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c160710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0097c0 tx=0x7fbb2c01c3f0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.858 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- 172.21.15.183:0/2809238220 shutdown_connections 2023-07-20T09:50:01.858 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 --2- 172.21.15.183:0/2809238220 >> v2:172.21.15.82:3300/0 conn(0x7fbb3c06ab10 0x7fbb3c06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.858 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 --2- 172.21.15.183:0/2809238220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c160710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.858 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- 172.21.15.183:0/2809238220 >> 172.21.15.183:0/2809238220 conn(0x7fbb3c08c0a0 msgr2=0x7fbb3c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:01.859 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- 172.21.15.183:0/2809238220 shutdown_connections 2023-07-20T09:50:01.859 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- 172.21.15.183:0/2809238220 wait complete. 2023-07-20T09:50:01.860 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 Processor -- start 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.820+0000 7fbb435f3640 1 -- start start 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c06ab10 0x7fbb3c0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0c8fd0 con 0x7fbb3c06ab10 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0c8a10 con 0x7fbb3c06c120 2023-07-20T09:50:01.861 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0c8cf0 con 0x7fbb3c1602b0 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb41b90640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44674/0 (socket says 172.21.15.183:44674) 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 -- 172.21.15.183:0/169405687 learned_addr learned my addr 172.21.15.183:0/169405687 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb4138f640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c06ab10 0x7fbb3c0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 -- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 msgr2=0x7fbb3c0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c0b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.862 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 -- 172.21.15.183:0/169405687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c06ab10 msgr2=0x7fbb3c0c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c06ab10 0x7fbb3c0c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 -- 172.21.15.183:0/169405687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c009420 con 0x7fbb3c06c120 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb41b90640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb40b8e640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c01a020 tx=0x7fbb2c019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0b4400 con 0x7fbb3c06c120 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0b4580 con 0x7fbb3c06c120 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0b6d40 con 0x7fbb3c06c120 2023-07-20T09:50:01.863 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0b4930 con 0x7fbb3c06c120 2023-07-20T09:50:01.864 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c0c8120 con 0x7fbb3c06c120 2023-07-20T09:50:01.864 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbb2c0b2040 con 0x7fbb3c06c120 2023-07-20T09:50:01.864 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fbb2c0c0da0 con 0x7fbb3c06c120 2023-07-20T09:50:01.865 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.824+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c15f2b0 con 0x7fbb3c06c120 2023-07-20T09:50:01.865 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.828+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbb2c0deb00 con 0x7fbb3c06c120 2023-07-20T09:50:01.907 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:01.871+0000 7f766302c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T09:50:01.924 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:01.888+0000 7f9234787180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T09:50:01.934 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.896+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "200bd499-11e9-4e25-b0e8-7f3663f2d3d8", "id": 1} v 0) v1 -- 0x7fbb3c04da30 con 0x7fbb3c06c120 2023-07-20T09:50:01.942 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.904+0000 7fbb31ffb640 1 -- 172.21.15.183:0/169405687 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "200bd499-11e9-4e25-b0e8-7f3663f2d3d8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb2c0cd030 con 0x7fbb3c06c120 2023-07-20T09:50:01.942 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-07-20T09:50:01.943 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 msgr2=0x7fbb3c0b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:01.943 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c01a020 tx=0x7fbb2c019190 comp rx=0 tx=0).stop 2023-07-20T09:50:01.943 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 shutdown_connections 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb3c1602b0 0x7fbb3c0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb3c06c120 0x7fbb3c0b7540 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 --2- 172.21.15.183:0/169405687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb3c06ab10 0x7fbb3c0c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 >> 172.21.15.183:0/169405687 conn(0x7fbb3c08c0a0 msgr2=0x7fbb3c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 shutdown_connections 2023-07-20T09:50:01.944 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:01.908+0000 7fbb435f3640 1 -- 172.21.15.183:0/169405687 wait complete. 2023-07-20T09:50:01.962 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new ff0d60d9-8dad-43bf-9708-b699417f3003 2 2023-07-20T09:50:02.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.100+0000 7fcc5b78f640 1 Processor -- start 2023-07-20T09:50:02.138 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.100+0000 7fcc5b78f640 1 -- start start 2023-07-20T09:50:02.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5b78f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc5406c120 0x7fcc540cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5b78f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5b78f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc540d0970 con 0x7fcc5406ab10 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5b78f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc54160e20 con 0x7fcc5406c120 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5b78f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540cd300 con 0x7fcc541602b0 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55416/0 (socket says 172.21.15.183:55416) 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 -- 172.21.15.183:0/3766013761 learned_addr learned my addr 172.21.15.183:0/3766013761 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc5952b640 1 --2- 172.21.15.183:0/3766013761 >> v2:172.21.15.82:3300/0 conn(0x7fcc5406c120 0x7fcc540cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 -- 172.21.15.183:0/3766013761 >> v2:172.21.15.82:3300/0 conn(0x7fcc5406c120 msgr2=0x7fcc540cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:02.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 --2- 172.21.15.183:0/3766013761 >> v2:172.21.15.82:3300/0 conn(0x7fcc5406c120 0x7fcc540cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 -- 172.21.15.183:0/3766013761 >> v1:172.21.15.82:6789/0 conn(0x7fcc5406ab10 legacy=0x7fcc5406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 -- 172.21.15.183:0/3766013761 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc540cd5e0 con 0x7fcc541602b0 2023-07-20T09:50:02.143 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.104+0000 7fcc58d2a640 1 --2- 172.21.15.183:0/3766013761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009870 tx=0x7fcc4401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc754c5f0000858e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.143 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc4bfff640 1 -- 172.21.15.183:0/3766013761 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440ac620 con 0x7fcc541602b0 2023-07-20T09:50:02.143 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc4bfff640 1 -- 172.21.15.183:0/3766013761 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440ac780 con 0x7fcc541602b0 2023-07-20T09:50:02.143 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc4bfff640 1 -- 172.21.15.183:0/3766013761 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440acb10 con 0x7fcc541602b0 2023-07-20T09:50:02.144 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- 172.21.15.183:0/3766013761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 msgr2=0x7fcc54160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.144 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/3766013761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009870 tx=0x7fcc4401c4b0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.144 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- 172.21.15.183:0/3766013761 shutdown_connections 2023-07-20T09:50:02.144 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/3766013761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc541602b0 0x7fcc54160710 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.145 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/3766013761 >> v2:172.21.15.82:3300/0 conn(0x7fcc5406c120 0x7fcc540cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.145 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- 172.21.15.183:0/3766013761 >> 172.21.15.183:0/3766013761 conn(0x7fcc5408c0a0 msgr2=0x7fcc5409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.145 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- 172.21.15.183:0/3766013761 shutdown_connections 2023-07-20T09:50:02.145 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- 172.21.15.183:0/3766013761 wait complete. 2023-07-20T09:50:02.145 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 Processor -- start 2023-07-20T09:50:02.146 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- start start 2023-07-20T09:50:02.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc541602b0 0x7fcc540c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc54154920 con 0x7fcc541602b0 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540ca0b0 con 0x7fcc5406c120 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5b78f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540af6b0 con 0x7fcc5406ab10 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc58d2a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5952b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc58d2a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44684/0 (socket says 172.21.15.183:44684) 2023-07-20T09:50:02.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc58d2a640 1 -- 172.21.15.183:0/9702114 learned_addr learned my addr 172.21.15.183:0/9702114 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.108+0000 7fcc5952b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55420/0 (socket says 172.21.15.183:55420) 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc59d2c640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc541602b0 0x7fcc540c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 -- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 msgr2=0x7fcc540c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 -- 172.21.15.183:0/9702114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc541602b0 msgr2=0x7fcc540c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc541602b0 0x7fcc540c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 -- 172.21.15.183:0/9702114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440094d0 con 0x7fcc5406c120 2023-07-20T09:50:02.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc5952b640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:02.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc58d2a640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc440af040 tx=0x7fcc44019250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440b7420 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440b75c0 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc540af990 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440b7970 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc540aff50 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc440b3040 con 0x7fcc5406c120 2023-07-20T09:50:02.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fcc440b7dd0 con 0x7fcc5406c120 2023-07-20T09:50:02.152 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.112+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5404da30 con 0x7fcc5406c120 2023-07-20T09:50:02.152 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.116+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcc440c5060 con 0x7fcc5406c120 2023-07-20T09:50:02.217 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.180+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ff0d60d9-8dad-43bf-9708-b699417f3003", "id": 2} v 0) v1 -- 0x7fcc540cee40 con 0x7fcc5406c120 2023-07-20T09:50:02.225 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.188+0000 7fcc49ffb640 1 -- 172.21.15.183:0/9702114 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ff0d60d9-8dad-43bf-9708-b699417f3003", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc440bb070 con 0x7fcc5406c120 2023-07-20T09:50:02.226 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-07-20T09:50:02.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.188+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 msgr2=0x7fcc54153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.188+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc440af040 tx=0x7fcc44019250 comp rx=0 tx=0).stop 2023-07-20T09:50:02.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 shutdown_connections 2023-07-20T09:50:02.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc541602b0 0x7fcc540c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.227 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5406c120 0x7fcc54153de0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.228 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 --2- 172.21.15.183:0/9702114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5406ab10 0x7fcc540c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.228 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 >> 172.21.15.183:0/9702114 conn(0x7fcc5408c0a0 msgr2=0x7fcc540ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.228 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 shutdown_connections 2023-07-20T09:50:02.228 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.192+0000 7fcc5b78f640 1 -- 172.21.15.183:0/9702114 wait complete. 2023-07-20T09:50:02.245 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new dc91d622-b11a-46b2-8e34-2032bc7885b8 3 2023-07-20T09:50:02.386 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.348+0000 7f963f05f640 1 Processor -- start 2023-07-20T09:50:02.386 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.348+0000 7f963f05f640 1 -- start start 2023-07-20T09:50:02.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963f05f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f963806c120 0x7f96380cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963f05f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 0x7f9638160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963f05f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96380d0970 con 0x7f96381602b0 2023-07-20T09:50:02.387 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963f05f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9638160e20 con 0x7f963806b220 2023-07-20T09:50:02.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963f05f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96380cd300 con 0x7f963806c120 2023-07-20T09:50:02.388 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f963806c120 0x7f96380cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f963806c120 0x7f96380cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44690/0 (socket says 172.21.15.183:44690) 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 -- 172.21.15.183:0/1996961275 learned_addr learned my addr 172.21.15.183:0/1996961275 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963d5fc640 1 --2- 172.21.15.183:0/1996961275 >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 0x7f9638160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 -- 172.21.15.183:0/1996961275 >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 msgr2=0x7f9638160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 --2- 172.21.15.183:0/1996961275 >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 0x7f9638160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 -- 172.21.15.183:0/1996961275 >> v1:172.21.15.82:6789/0 conn(0x7f96381602b0 legacy=0x7f963806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.389 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 -- 172.21.15.183:0/1996961275 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380cd5e0 con 0x7f963806c120 2023-07-20T09:50:02.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963d5fc640 1 --2- 172.21.15.183:0/1996961275 >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 0x7f9638160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:02.390 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.352+0000 7f963cdfb640 1 --2- 172.21.15.183:0/1996961275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f96380cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96380d00e0 tx=0x7f963401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cff72dd39a002ee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.391 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f962f7fe640 1 -- 172.21.15.183:0/1996961275 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340ac630 con 0x7f963806c120 2023-07-20T09:50:02.391 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f962f7fe640 1 -- 172.21.15.183:0/1996961275 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96340ac790 con 0x7f963806c120 2023-07-20T09:50:02.391 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f962f7fe640 1 -- 172.21.15.183:0/1996961275 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340acb20 con 0x7f963806c120 2023-07-20T09:50:02.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- 172.21.15.183:0/1996961275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 msgr2=0x7f96380cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- 172.21.15.183:0/1996961275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f96380cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96380d00e0 tx=0x7f963401c3b0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- 172.21.15.183:0/1996961275 shutdown_connections 2023-07-20T09:50:02.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- 172.21.15.183:0/1996961275 >> v2:172.21.15.82:3300/0 conn(0x7f963806b220 0x7f9638160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.392 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- 172.21.15.183:0/1996961275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f96380cdde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- 172.21.15.183:0/1996961275 >> 172.21.15.183:0/1996961275 conn(0x7f963808c0a0 msgr2=0x7f963809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- 172.21.15.183:0/1996961275 shutdown_connections 2023-07-20T09:50:02.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- 172.21.15.183:0/1996961275 wait complete. 2023-07-20T09:50:02.393 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 Processor -- start 2023-07-20T09:50:02.394 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- start start 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 0x7f96380b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f963815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96381602b0 0x7f96380b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b7a60 con 0x7f96381602b0 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963815dac0 con 0x7f963806c120 2023-07-20T09:50:02.395 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.356+0000 7f963f05f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96380b5b40 con 0x7f963806b220 2023-07-20T09:50:02.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f963815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 0x7f96380b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f963815d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44706/0 (socket says 172.21.15.183:44706) 2023-07-20T09:50:02.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962ffff640 1 -- 172.21.15.183:0/62072683 learned_addr learned my addr 172.21.15.183:0/62072683 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.396 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963d5fc640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96381602b0 0x7f96380b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 -- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 msgr2=0x7f963815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.397 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f963815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 -- 172.21.15.183:0/62072683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96381602b0 msgr2=0x7f96380b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96381602b0 0x7f96380b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 -- 172.21.15.183:0/62072683 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340094d0 con 0x7f963806b220 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963cdfb640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 0x7f96380b7520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96380cd440 tx=0x7f9634019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340b5640 con 0x7f963806b220 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96340b57c0 con 0x7f963806b220 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96340b5b70 con 0x7f963806b220 2023-07-20T09:50:02.398 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96380c6180 con 0x7f963806b220 2023-07-20T09:50:02.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96380c6700 con 0x7f963806b220 2023-07-20T09:50:02.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f96340b3070 con 0x7f963806b220 2023-07-20T09:50:02.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f96340be890 con 0x7f963806b220 2023-07-20T09:50:02.399 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.360+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963804da30 con 0x7f963806b220 2023-07-20T09:50:02.400 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.364+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f96340dcb00 con 0x7f963806b220 2023-07-20T09:50:02.467 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.432+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dc91d622-b11a-46b2-8e34-2032bc7885b8", "id": 3} v 0) v1 -- 0x7f963808be40 con 0x7f963806b220 2023-07-20T09:50:02.475 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f962d7fa640 1 -- 172.21.15.183:0/62072683 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc91d622-b11a-46b2-8e34-2032bc7885b8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96340cb030 con 0x7f963806b220 2023-07-20T09:50:02.476 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-07-20T09:50:02.476 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 msgr2=0x7f96380b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 0x7f96380b7520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96380cd440 tx=0x7f9634019150 comp rx=0 tx=0).stop 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 shutdown_connections 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96381602b0 0x7f96380b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f963806c120 0x7f963815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 --2- 172.21.15.183:0/62072683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f963806b220 0x7f96380b7520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 >> 172.21.15.183:0/62072683 conn(0x7f963808c0a0 msgr2=0x7f96380b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.477 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 shutdown_connections 2023-07-20T09:50:02.478 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.440+0000 7f963f05f640 1 -- 172.21.15.183:0/62072683 wait complete. 2023-07-20T09:50:02.496 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 2b3f3f0f-df34-4331-b077-eb84fac8e883 4 2023-07-20T09:50:02.524 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.487+0000 7f766302c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T09:50:02.578 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.540+0000 7f9234787180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T09:50:02.585 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.551+0000 7f766302c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T09:50:02.633 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 Processor -- start 2023-07-20T09:50:02.633 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 -- start start 2023-07-20T09:50:02.634 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c9c159450 0x7f1c9c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.634 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1c9c159830 0x7f1c9c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0cc8d0 con 0x7f1c9c0cc3e0 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0cce90 con 0x7f1c9c159450 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1ca126a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0ccbb0 con 0x7f1c9c159830 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1c927fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1c9c159830 0x7f1c9c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1c927fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1c9c159830 0x7f1c9c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44712/0 (socket says 172.21.15.183:44712) 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1c927fc640 1 -- 172.21.15.183:0/1623147196 learned_addr learned my addr 172.21.15.183:0/1623147196 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.635 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.596+0000 7f1c9affd640 1 --2- 172.21.15.183:0/1623147196 >> v2:172.21.15.82:3300/0 conn(0x7f1c9c159450 0x7f1c9c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.636 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.600+0000 7f1c927fc640 1 -- 172.21.15.183:0/1623147196 >> v2:172.21.15.82:3300/0 conn(0x7f1c9c159450 msgr2=0x7f1c9c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:02.636 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.600+0000 7f1c927fc640 1 --2- 172.21.15.183:0/1623147196 >> v2:172.21.15.82:3300/0 conn(0x7f1c9c159450 0x7f1c9c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.636 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.600+0000 7f1c927fc640 1 -- 172.21.15.183:0/1623147196 >> v1:172.21.15.82:6789/0 conn(0x7f1c9c0cc3e0 legacy=0x7f1c9c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.637 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.600+0000 7f1c927fc640 1 -- 172.21.15.183:0/1623147196 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c159cc0 con 0x7f1c9c159830 2023-07-20T09:50:02.639 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1c927fc640 1 --2- 172.21.15.183:0/1623147196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159830 0x7f1c9c0cbea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c15e190 tx=0x7f1c8401eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e189f4e9ca38017a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.640 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1c9a7fc640 1 -- 172.21.15.183:0/1623147196 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840a7c50 con 0x7f1c9c159830 2023-07-20T09:50:02.640 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1c9a7fc640 1 -- 172.21.15.183:0/1623147196 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840a7db0 con 0x7f1c9c159830 2023-07-20T09:50:02.640 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1c9a7fc640 1 -- 172.21.15.183:0/1623147196 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840af660 con 0x7f1c9c159830 2023-07-20T09:50:02.641 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 -- 172.21.15.183:0/1623147196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159830 msgr2=0x7f1c9c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.641 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1623147196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159830 0x7f1c9c0cbea0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c15e190 tx=0x7f1c8401eba0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.641 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 -- 172.21.15.183:0/1623147196 shutdown_connections 2023-07-20T09:50:02.641 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1623147196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159830 0x7f1c9c0cbea0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.641 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1623147196 >> v2:172.21.15.82:3300/0 conn(0x7f1c9c159450 0x7f1c9c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 -- 172.21.15.183:0/1623147196 >> 172.21.15.183:0/1623147196 conn(0x7f1c9c0cad50 msgr2=0x7f1c9c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 -- 172.21.15.183:0/1623147196 shutdown_connections 2023-07-20T09:50:02.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 -- 172.21.15.183:0/1623147196 wait complete. 2023-07-20T09:50:02.642 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.604+0000 7f1ca126a640 1 Processor -- start 2023-07-20T09:50:02.643 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- start start 2023-07-20T09:50:02.643 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c9c0cc3e0 0x7f1c9c151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b3b50 con 0x7f1c9c0cc3e0 2023-07-20T09:50:02.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b2fd0 con 0x7f1c9c159450 2023-07-20T09:50:02.644 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b32b0 con 0x7f1c9c0b2a20 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c9b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44722/0 (socket says 172.21.15.183:44722) 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c9b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55444/0 (socket says 172.21.15.183:55444) 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 -- 172.21.15.183:0/1533963661 learned_addr learned my addr 172.21.15.183:0/1533963661 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.646 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c9affd640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c9c0cc3e0 0x7f1c9c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 -- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 msgr2=0x7f1c9c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 -- 172.21.15.183:0/1533963661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c9c0cc3e0 msgr2=0x7f1c9c151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c9c0cc3e0 0x7f1c9c151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 -- 172.21.15.183:0/1533963661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8400b770 con 0x7f1c9c159450 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c9b7fe640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:02.647 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c927fc640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400b2c0 tx=0x7f1c8401b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840afd90 con 0x7f1c9c159450 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840ba410 con 0x7f1c9c159450 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c0b3590 con 0x7f1c9c159450 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840ba7c0 con 0x7f1c9c159450 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c0c6620 con 0x7f1c9c159450 2023-07-20T09:50:02.648 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1c840bac20 con 0x7f1c9c159450 2023-07-20T09:50:02.649 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f9234787180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T09:50:02.649 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1c840c3450 con 0x7f1c9c159450 2023-07-20T09:50:02.649 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.608+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c04da30 con 0x7f1c9c159450 2023-07-20T09:50:02.649 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.612+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1c840b4070 con 0x7f1c9c159450 2023-07-20T09:50:02.650 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.611+0000 7f766302c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T09:50:02.717 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.680+0000 7f9234787180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T09:50:02.727 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.692+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2b3f3f0f-df34-4331-b077-eb84fac8e883", "id": 4} v 0) v1 -- 0x7f1c9c0b33f0 con 0x7f1c9c159450 2023-07-20T09:50:02.734 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.696+0000 7f1c93fff640 1 -- 172.21.15.183:0/1533963661 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b3f3f0f-df34-4331-b077-eb84fac8e883", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c9c0b33f0 con 0x7f1c9c159450 2023-07-20T09:50:02.734 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-07-20T09:50:02.735 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.699+0000 7f766302c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T09:50:02.736 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 msgr2=0x7f1c9c0b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.736 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400b2c0 tx=0x7f1c8401b940 comp rx=0 tx=0).stop 2023-07-20T09:50:02.736 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 shutdown_connections 2023-07-20T09:50:02.736 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c9c0b2a20 0x7f1c9c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.736 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c9c159450 0x7f1c9c0b24e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.737 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 --2- 172.21.15.183:0/1533963661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c9c0cc3e0 0x7f1c9c151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.737 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 >> 172.21.15.183:0/1533963661 conn(0x7f1c9c0cad50 msgr2=0x7f1c9c0af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.737 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 shutdown_connections 2023-07-20T09:50:02.737 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.700+0000 7f1ca126a640 1 -- 172.21.15.183:0/1533963661 wait complete. 2023-07-20T09:50:02.755 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1 5 2023-07-20T09:50:02.794 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.759+0000 7f766302c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T09:50:02.811 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.776+0000 7f9234787180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T09:50:02.873 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.836+0000 7f9234787180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T09:50:02.881 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.843+0000 7f766302c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T09:50:02.892 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 Processor -- start 2023-07-20T09:50:02.892 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 -- start start 2023-07-20T09:50:02.893 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.893 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 0x7fb1d00b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d00d1040 con 0x7fb1d015c870 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00cfcb0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1cf59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d015cc50 con 0x7fb1d00cf820 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1c7fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1ced9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 0x7fb1d00b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.894 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1c7fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44726/0 (socket says 172.21.15.183:44726) 2023-07-20T09:50:02.895 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1c7fff640 1 -- 172.21.15.183:0/935533224 learned_addr learned my addr 172.21.15.183:0/935533224 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.895 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1ced9d640 1 -- 172.21.15.183:0/935533224 >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 msgr2=0x7fb1d00cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:02.895 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1ced9d640 1 --2- 172.21.15.183:0/935533224 >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.896 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1ced9d640 1 -- 172.21.15.183:0/935533224 >> v1:172.21.15.82:6789/0 conn(0x7fb1d015c870 legacy=0x7fb1d00d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.896 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1ced9d640 1 -- 172.21.15.183:0/935533224 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d00d1320 con 0x7fb1d00cf820 2023-07-20T09:50:02.896 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.856+0000 7fb1c7fff640 1 --2- 172.21.15.183:0/935533224 >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:02.897 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1ced9d640 1 --2- 172.21.15.183:0/935533224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 0x7fb1d00b5610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009d90 tx=0x7fb1c801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2872357623148f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.897 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cdd9b640 1 -- 172.21.15.183:0/935533224 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80a59e0 con 0x7fb1d00cf820 2023-07-20T09:50:02.897 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cdd9b640 1 -- 172.21.15.183:0/935533224 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c80a5b40 con 0x7fb1d00cf820 2023-07-20T09:50:02.897 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cdd9b640 1 -- 172.21.15.183:0/935533224 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80ad440 con 0x7fb1d00cf820 2023-07-20T09:50:02.898 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 -- 172.21.15.183:0/935533224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 msgr2=0x7fb1d00b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.898 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/935533224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 0x7fb1d00b5610 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009d90 tx=0x7fb1c801c920 comp rx=0 tx=0).stop 2023-07-20T09:50:02.898 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 -- 172.21.15.183:0/935533224 shutdown_connections 2023-07-20T09:50:02.899 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/935533224 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00cf820 0x7fb1d00b5610 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.899 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/935533224 >> v2:172.21.15.183:3300/0 conn(0x7fb1d00d20e0 0x7fb1d00cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.899 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 -- 172.21.15.183:0/935533224 >> 172.21.15.183:0/935533224 conn(0x7fb1d00654e0 msgr2=0x7fb1d00658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.899 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 -- 172.21.15.183:0/935533224 shutdown_connections 2023-07-20T09:50:02.899 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.860+0000 7fb1cf59e640 1 -- 172.21.15.183:0/935533224 wait complete. 2023-07-20T09:50:02.900 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 Processor -- start 2023-07-20T09:50:02.900 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- start start 2023-07-20T09:50:02.901 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 0x7fb1d014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.901 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.901 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d015c870 0x7fb1d00ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d015ace0 con 0x7fb1d015c870 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0153be0 con 0x7fb1d00cf820 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0153ec0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1ce59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 0x7fb1d014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55462/0 (socket says 172.21.15.183:55462) 2023-07-20T09:50:02.902 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 -- 172.21.15.183:0/3888230379 learned_addr learned my addr 172.21.15.183:0/3888230379 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:02.903 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1ced9d640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d015c870 0x7fb1d00ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:02.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 -- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 msgr2=0x7fb1d014e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 0x7fb1d014e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 -- 172.21.15.183:0/3888230379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d015c870 msgr2=0x7fb1d00ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.904 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d015c870 0x7fb1d00ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 -- 172.21.15.183:0/3888230379 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80094d0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1ce59c640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 0x7fb1d014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c7fff640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e9d0 tx=0x7fb1b800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800ca60 con 0x7fb1d00d20e0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b800cbc0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c8009a70 con 0x7fb1d00d20e0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8013470 con 0x7fb1d00d20e0 2023-07-20T09:50:02.905 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d0154480 con 0x7fb1d00d20e0 2023-07-20T09:50:02.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.864+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb1b80138d0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.868+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb1b801c450 con 0x7fb1d00d20e0 2023-07-20T09:50:02.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.868+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d006b6d0 con 0x7fb1d00d20e0 2023-07-20T09:50:02.906 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.868+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb1b8021060 con 0x7fb1d00d20e0 2023-07-20T09:50:02.942 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:02.907+0000 7f766302c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T09:50:02.966 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.928+0000 7f9234787180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T09:50:02.972 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.936+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1", "id": 5} v 0) v1 -- 0x7fb1d004da30 con 0x7fb1d00d20e0 2023-07-20T09:50:02.979 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1c6ffd640 1 -- 172.21.15.183:0/3888230379 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb1b8017070 con 0x7fb1d00d20e0 2023-07-20T09:50:02.979 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-07-20T09:50:02.980 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 msgr2=0x7fb1d015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:02.980 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800e9d0 tx=0x7fb1b800ee90 comp rx=0 tx=0).stop 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 shutdown_connections 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1d015c870 0x7fb1d00ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1d00d20e0 0x7fb1d015a290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 --2- 172.21.15.183:0/3888230379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1d00cf820 0x7fb1d014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 >> 172.21.15.183:0/3888230379 conn(0x7fb1d00654e0 msgr2=0x7fb1d00b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 shutdown_connections 2023-07-20T09:50:02.981 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:02.944+0000 7fb1cf59e640 1 -- 172.21.15.183:0/3888230379 wait complete. 2023-07-20T09:50:02.999 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 1622ed3e-f458-450f-998d-7e4534c6e551 6 2023-07-20T09:50:03.029 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:02.992+0000 7f9234787180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T09:50:03.096 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:03.059+0000 7f766302c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T09:50:03.135 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.096+0000 7f4634ee5640 1 Processor -- start 2023-07-20T09:50:03.135 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 -- start start 2023-07-20T09:50:03.136 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.136 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.136 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300d0970 con 0x7f46301602b0 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4630160e20 con 0x7f463006c120 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f4634ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300cd300 con 0x7f463006b220 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462e59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462e59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44744/0 (socket says 172.21.15.183:44744) 2023-07-20T09:50:03.137 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55468/0 (socket says 172.21.15.183:55468) 2023-07-20T09:50:03.138 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462e59c640 1 -- 172.21.15.183:0/920780390 learned_addr learned my addr 172.21.15.183:0/920780390 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:03.138 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 -- 172.21.15.183:0/920780390 >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 msgr2=0x7f46300cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:03.138 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 --2- 172.21.15.183:0/920780390 >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.138 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 -- 172.21.15.183:0/920780390 >> v1:172.21.15.82:6789/0 conn(0x7f46301602b0 legacy=0x7f463006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462ed9d640 1 -- 172.21.15.183:0/920780390 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300cd5e0 con 0x7f463006b220 2023-07-20T09:50:03.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.100+0000 7f462e59c640 1 --2- 172.21.15.183:0/920780390 >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:03.139 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f462ed9d640 1 --2- 172.21.15.183:0/920780390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4628009d90 tx=0x7f462801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d3bf51a01dc223 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f462dd9b640 1 -- 172.21.15.183:0/920780390 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280a5970 con 0x7f463006b220 2023-07-20T09:50:03.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f462dd9b640 1 -- 172.21.15.183:0/920780390 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280a5ad0 con 0x7f463006b220 2023-07-20T09:50:03.140 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f462dd9b640 1 -- 172.21.15.183:0/920780390 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280a5e60 con 0x7f463006b220 2023-07-20T09:50:03.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 -- 172.21.15.183:0/920780390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 msgr2=0x7f4630160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 --2- 172.21.15.183:0/920780390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4628009d90 tx=0x7f462801c890 comp rx=0 tx=0).stop 2023-07-20T09:50:03.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 -- 172.21.15.183:0/920780390 shutdown_connections 2023-07-20T09:50:03.141 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 --2- 172.21.15.183:0/920780390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006b220 0x7f4630160740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.142 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 --2- 172.21.15.183:0/920780390 >> v2:172.21.15.183:3300/0 conn(0x7f463006c120 0x7f46300cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.142 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 -- 172.21.15.183:0/920780390 >> 172.21.15.183:0/920780390 conn(0x7f463008c0a0 msgr2=0x7f463009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.142 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 -- 172.21.15.183:0/920780390 shutdown_connections 2023-07-20T09:50:03.142 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.104+0000 7f4634ee5640 1 -- 172.21.15.183:0/920780390 wait complete. 2023-07-20T09:50:03.143 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 Processor -- start 2023-07-20T09:50:03.144 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 -- start start 2023-07-20T09:50:03.146 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 0x7f4630154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.146 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.146 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46301602b0 0x7f4630156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46300c6180 con 0x7f46301602b0 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630155260 con 0x7f463006b220 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4634ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300b1120 con 0x7f463006c120 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f462e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 0x7f4630154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55472/0 (socket says 172.21.15.183:55472) 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 -- 172.21.15.183:0/2244760488 learned_addr learned my addr 172.21.15.183:0/2244760488 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:03.147 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f462e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 0x7f4630154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44748/0 (socket says 172.21.15.183:44748) 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f462ed9d640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46301602b0 0x7f4630156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 -- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 msgr2=0x7f4630154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 0x7f4630154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 -- 172.21.15.183:0/2244760488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46301602b0 msgr2=0x7f4630156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46301602b0 0x7f4630156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.148 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 -- 172.21.15.183:0/2244760488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200094d0 con 0x7f463006c120 2023-07-20T09:50:03.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.108+0000 7f4627fff640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f461800c3c0 tx=0x7f461800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.149 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46180052d0 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4618005430 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628009a70 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4618003840 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46300c66b0 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4618003ca0 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4618011e50 con 0x7f463006c120 2023-07-20T09:50:03.150 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463004da30 con 0x7f463006c120 2023-07-20T09:50:03.151 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.112+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4618017070 con 0x7f463006c120 2023-07-20T09:50:03.164 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:03.127+0000 7f766302c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T09:50:03.191 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:03.156+0000 7f9234787180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T09:50:03.216 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.180+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1622ed3e-f458-450f-998d-7e4534c6e551", "id": 6} v 0) v1 -- 0x7f46300b1760 con 0x7f463006c120 2023-07-20T09:50:03.221 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.184+0000 7f4626ffd640 1 -- 172.21.15.183:0/2244760488 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1622ed3e-f458-450f-998d-7e4534c6e551", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4618011590 con 0x7f463006c120 2023-07-20T09:50:03.222 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-07-20T09:50:03.223 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.184+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 msgr2=0x7f4630156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.223 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.184+0000 7f4634ee5640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f461800c3c0 tx=0x7f461800c880 comp rx=0 tx=0).stop 2023-07-20T09:50:03.223 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.184+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 shutdown_connections 2023-07-20T09:50:03.223 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46301602b0 0x7f4630156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f463006c120 0x7f4630156770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 --2- 172.21.15.183:0/2244760488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463006b220 0x7f4630154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 >> 172.21.15.183:0/2244760488 conn(0x7f463008c0a0 msgr2=0x7f463006ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 shutdown_connections 2023-07-20T09:50:03.224 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.188+0000 7f4634ee5640 1 -- 172.21.15.183:0/2244760488 wait complete. 2023-07-20T09:50:03.242 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 2c6df0ea-6d1c-4055-8891-dcaa9bd489c1 7 2023-07-20T09:50:03.262 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:03.224+0000 7f9234787180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T09:50:03.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.364+0000 7f2336141640 1 Processor -- start 2023-07-20T09:50:03.402 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.364+0000 7f2336141640 1 -- start start 2023-07-20T09:50:03.403 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2336141640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23300d20e0 0x7f23300cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2336141640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23300cf820 0x7f23300b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2336141640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300cfc70 con 0x7f233015c870 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2336141640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233015cc50 con 0x7f23300cf820 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2336141640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23300d1040 con 0x7f23300d20e0 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23300d20e0 0x7f23300cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f23300d20e0 0x7f23300cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44750/0 (socket says 172.21.15.183:44750) 2023-07-20T09:50:03.404 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 -- 172.21.15.183:0/2872108272 learned_addr learned my addr 172.21.15.183:0/2872108272 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:03.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f2335940640 1 --2- 172.21.15.183:0/2872108272 >> v2:172.21.15.82:3300/0 conn(0x7f23300cf820 0x7f23300b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 -- 172.21.15.183:0/2872108272 >> v2:172.21.15.82:3300/0 conn(0x7f23300cf820 msgr2=0x7f23300b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:03.405 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 --2- 172.21.15.183:0/2872108272 >> v2:172.21.15.82:3300/0 conn(0x7f23300cf820 0x7f23300b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 -- 172.21.15.183:0/2872108272 >> v1:172.21.15.82:6789/0 conn(0x7f233015c870 legacy=0x7f23300d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:03.406 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.368+0000 7f233493e640 1 -- 172.21.15.183:0/2872108272 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23300d1320 con 0x7f23300d20e0 2023-07-20T09:50:03.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f233493e640 1 --2- 172.21.15.183:0/2872108272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23300d20e0 0x7f23300cf2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2330066240 tx=0x7f232001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c1c726d0eeee82 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2327fff640 1 -- 172.21.15.183:0/2872108272 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200aa430 con 0x7f23300d20e0 2023-07-20T09:50:03.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2327fff640 1 -- 172.21.15.183:0/2872108272 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23200aa590 con 0x7f23300d20e0 2023-07-20T09:50:03.407 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2327fff640 1 -- 172.21.15.183:0/2872108272 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200aa920 con 0x7f23300d20e0 2023-07-20T09:50:03.408 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- 172.21.15.183:0/2872108272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23300d20e0 msgr2=0x7f23300cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.408 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 --2- 172.21.15.183:0/2872108272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23300d20e0 0x7f23300cf2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2330066240 tx=0x7f232001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- 172.21.15.183:0/2872108272 shutdown_connections 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 --2- 172.21.15.183:0/2872108272 >> v2:172.21.15.82:3300/0 conn(0x7f23300cf820 0x7f23300b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 --2- 172.21.15.183:0/2872108272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f23300d20e0 0x7f23300cf2e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- 172.21.15.183:0/2872108272 >> 172.21.15.183:0/2872108272 conn(0x7f23300654e0 msgr2=0x7f23300658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- 172.21.15.183:0/2872108272 shutdown_connections 2023-07-20T09:50:03.409 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- 172.21.15.183:0/2872108272 wait complete. 2023-07-20T09:50:03.410 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 Processor -- start 2023-07-20T09:50:03.410 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 -- start start 2023-07-20T09:50:03.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.372+0000 7f2336141640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23300cf820 0x7f23300c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233014de70 con 0x7f23300cf820 2023-07-20T09:50:03.411 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233014e6e0 con 0x7f233015c870 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c8e70 con 0x7f23300d20e0 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2335940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233513f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23300cf820 0x7f23300c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.183:55484/0 (socket says 172.21.15.183:55484) 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2335940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:44758/0 (socket says 172.21.15.183:44758) 2023-07-20T09:50:03.412 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 -- 172.21.15.183:0/2097585072 learned_addr learned my addr 172.21.15.183:0/2097585072 (peer_addr_for_me v2:172.21.15.183:0/0) 2023-07-20T09:50:03.413 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 -- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 msgr2=0x7f23300c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 -- 172.21.15.183:0/2097585072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23300cf820 msgr2=0x7f23300c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23300cf820 0x7f23300c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 -- 172.21.15.183:0/2097585072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200094d0 con 0x7f23300d20e0 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2335940640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:03.414 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f233493e640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23200190e0 tx=0x7f232001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200b3800 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23200b3960 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200b3cf0 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233014d1f0 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233014d7b0 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f23200bd6f0 con 0x7f23300d20e0 2023-07-20T09:50:03.415 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f23200b2510 con 0x7f23300d20e0 2023-07-20T09:50:03.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.376+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233006b6d0 con 0x7f23300d20e0 2023-07-20T09:50:03.416 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.380+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f23200c3060 con 0x7f23300d20e0 2023-07-20T09:50:03.480 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.444+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2c6df0ea-6d1c-4055-8891-dcaa9bd489c1", "id": 7} v 0) v1 -- 0x7f233004da30 con 0x7f23300d20e0 2023-07-20T09:50:03.487 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2325ffb640 1 -- 172.21.15.183:0/2097585072 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c6df0ea-6d1c-4055-8891-dcaa9bd489c1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f23200bd9a0 con 0x7f23300d20e0 2023-07-20T09:50:03.487 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-07-20T09:50:03.488 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 msgr2=0x7f23300c83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.488 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23200190e0 tx=0x7f232001ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:03.488 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 shutdown_connections 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f233015c870 0x7f23300c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23300d20e0 0x7f23300c83f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 --2- 172.21.15.183:0/2097585072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23300cf820 0x7f23300c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 >> 172.21.15.183:0/2097585072 conn(0x7f23300654e0 msgr2=0x7f23300b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 shutdown_connections 2023-07-20T09:50:03.489 INFO:teuthology.orchestra.run.smithi183.stderr:2023-07-20T09:50:03.452+0000 7f2336141640 1 -- 172.21.15.183:0/2097585072 wait complete. 2023-07-20T09:50:03.506 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-20T09:50:03.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-20T09:50:03.511 INFO:tasks.ceph.osd.0:Started 2023-07-20T09:50:03.512 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-20T09:50:03.512 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-20T09:50:03.517 INFO:tasks.ceph.osd.1:Started 2023-07-20T09:50:03.518 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-20T09:50:03.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-20T09:50:03.523 INFO:tasks.ceph.osd.2:Started 2023-07-20T09:50:03.523 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-20T09:50:03.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-20T09:50:03.529 INFO:tasks.ceph.osd.3:Started 2023-07-20T09:50:03.529 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-20T09:50:03.529 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-20T09:50:03.533 INFO:tasks.ceph.osd.4:Started 2023-07-20T09:50:03.534 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-20T09:50:03.534 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-20T09:50:03.538 INFO:tasks.ceph.osd.5:Started 2023-07-20T09:50:03.538 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-20T09:50:03.538 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-20T09:50:03.541 INFO:tasks.ceph.osd.6:Started 2023-07-20T09:50:03.542 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-20T09:50:03.542 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-20T09:50:03.545 INFO:tasks.ceph.osd.7:Started 2023-07-20T09:50:03.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.691+0000 7f4d53b00640 1 Processor -- start 2023-07-20T09:50:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 -- start start 2023-07-20T09:50:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d4c0afda0 0x7f4d4c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 0x7f4d4c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b3160 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b2ee0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d53b00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0b06c0 con 0x7f4d4c0b2060 2023-07-20T09:50:03.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51834/0 (socket says 172.21.15.82:51834) 2023-07-20T09:50:03.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 -- 172.21.15.82:0/79427326 learned_addr learned my addr 172.21.15.82:0/79427326 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:03.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5189c640 1 --2- 172.21.15.82:0/79427326 >> v2:172.21.15.183:3300/0 conn(0x7f4d4c0afda0 0x7f4d4c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5209d640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 0x7f4d4c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 -- 172.21.15.82:0/79427326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 msgr2=0x7f4d4c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 0x7f4d4c0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 -- 172.21.15.82:0/79427326 >> v2:172.21.15.183:3300/0 conn(0x7f4d4c0afda0 msgr2=0x7f4d4c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 --2- 172.21.15.82:0/79427326 >> v2:172.21.15.183:3300/0 conn(0x7f4d4c0afda0 0x7f4d4c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5109b640 1 -- 172.21.15.82:0/79427326 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0b12a0 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.695+0000 7f4d5209d640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 0x7f4d4c0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:03.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d5109b640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b0b40 tx=0x7f4d3c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a7d25e8b2ec8a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d5089a640 1 -- 172.21.15.82:0/79427326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0ab600 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d5089a640 1 -- 172.21.15.82:0/79427326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0a7050 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d5089a640 1 -- 172.21.15.82:0/79427326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0ab980 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- 172.21.15.82:0/79427326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c15a8e0 msgr2=0x7f4d4c0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0b0b40 tx=0x7f4d3c01c3b0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- 172.21.15.82:0/79427326 shutdown_connections 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c0b2060 0x7f4d4c0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 --2- 172.21.15.82:0/79427326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c15a8e0 0x7f4d4c0b29a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 --2- 172.21.15.82:0/79427326 >> v2:172.21.15.183:3300/0 conn(0x7f4d4c0afda0 0x7f4d4c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- 172.21.15.82:0/79427326 >> 172.21.15.82:0/79427326 conn(0x7f4d4c0cada0 msgr2=0x7f4d4c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- 172.21.15.82:0/79427326 shutdown_connections 2023-07-20T09:50:03.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- 172.21.15.82:0/79427326 wait complete. 2023-07-20T09:50:03.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 Processor -- start 2023-07-20T09:50:03.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.699+0000 7f4d53b00640 1 -- start start 2023-07-20T09:50:03.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d4c0b2060 0x7f4d4c0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c15a8e0 0x7f4d4c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:03.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c15acf0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c150d60 con 0x7f4d4c0b2060 2023-07-20T09:50:03.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c0ab3d0 con 0x7f4d4c15a8e0 2023-07-20T09:50:03.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51836/0 (socket says 172.21.15.82:51836) 2023-07-20T09:50:03.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 -- 172.21.15.82:0/4121536759 learned_addr learned my addr 172.21.15.82:0/4121536759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:03.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5109b640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d4c0b2060 0x7f4d4c0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5209d640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c15a8e0 0x7f4d4c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:03.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 -- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c15a8e0 msgr2=0x7f4d4c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c15a8e0 0x7f4d4c1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 -- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d4c0b2060 msgr2=0x7f4d4c0aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d4c0b2060 0x7f4d4c0aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 -- 172.21.15.82:0/4121536759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c0094d0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d5189c640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800e870 tx=0x7f4d4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800ee60 con 0x7f4d4c0afda0 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800c940 con 0x7f4d4c0afda0 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c0ab670 con 0x7f4d4c0afda0 2023-07-20T09:50:03.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800ccf0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0abc30 con 0x7f4d4c0afda0 2023-07-20T09:50:03.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4d48005ca0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4d480067a0 con 0x7f4d4c0afda0 2023-07-20T09:50:03.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.703+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c0af200 con 0x7f4d4c0afda0 2023-07-20T09:50:03.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.707+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4d48021060 con 0x7f4d4c0afda0 2023-07-20T09:50:03.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d4c073c70 con 0x7f4d4c0afda0 2023-07-20T09:50:03.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d427fc640 1 -- 172.21.15.82:0/4121536759 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4d48029020 con 0x7f4d4c0afda0 2023-07-20T09:50:03.799 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:03.799 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:03.448089+0000","last_up_change":"0.000000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 msgr2=0x7f4d4c150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800e870 tx=0x7f4d4800ed30 comp rx=0 tx=0).stop 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 shutdown_connections 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d4c15a8e0 0x7f4d4c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d4c0b2060 0x7f4d4c0aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 --2- 172.21.15.82:0/4121536759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d4c0afda0 0x7f4d4c150820 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 >> 172.21.15.82:0/4121536759 conn(0x7f4d4c0cada0 msgr2=0x7f4d4c159890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 shutdown_connections 2023-07-20T09:50:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:03.763+0000 7f4d53b00640 1 -- 172.21.15.82:0/4121536759 wait complete. 2023-07-20T09:50:03.818 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-20T09:50:03.819 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-20T09:50:03.890 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T09:50:03.890 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T09:50:03.890 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T09:50:03.947 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:03.911+0000 7f766302c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T09:50:03.974 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T09:50:03.975 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T09:50:03.975 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T09:50:04.014 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:03.976+0000 7f9234787180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T09:50:04.085 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:04.047+0000 7f766302c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:50:04.147 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:04.108+0000 7f9234787180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:50:04.177 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-07-20T09:50:04.140+0000 7f810ca95640 -1 Falling back to public interface 2023-07-20T09:50:04.184 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-07-20T09:50:04.148+0000 7f0bd4c2c640 -1 Falling back to public interface 2023-07-20T09:50:04.185 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-07-20T09:50:04.148+0000 7f898c567640 -1 Falling back to public interface 2023-07-20T09:50:04.203 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-07-20T09:50:04.167+0000 7f5e0b2da640 -1 Falling back to public interface 2023-07-20T09:50:04.204 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-07-20T09:50:04.168+0000 7fd5ce2d8640 -1 Falling back to public interface 2023-07-20T09:50:04.219 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-07-20T09:50:04.183+0000 7fbe4da39640 -1 Falling back to public interface 2023-07-20T09:50:04.219 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-07-20T09:50:04.183+0000 7fec0d4ac640 -1 Falling back to public interface 2023-07-20T09:50:04.219 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-07-20T09:50:04.183+0000 7fec0c46d640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-07-20T09:50:04.223 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-07-20T09:50:04.187+0000 7fcd0aa72640 -1 Falling back to public interface 2023-07-20T09:50:04.257 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:04.219+0000 7f766302c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T09:50:04.320 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:04.284+0000 7f9234787180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T09:50:04.329 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:04.291+0000 7f766302c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T09:50:04.392 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:04.356+0000 7f9234787180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T09:50:04.464 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:04.427+0000 7f766302c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:50:04.530 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:04.492+0000 7f9234787180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:50:04.624 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:04.751 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 Processor -- start 2023-07-20T09:50:04.752 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 -- start start 2023-07-20T09:50:04.753 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f618c15c5a0 0x7f618c160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:04.753 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c06c5c0 con 0x7f618c06e3e0 2023-07-20T09:50:04.753 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c06aa70 con 0x7f618c0ce680 2023-07-20T09:50:04.753 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6191596640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c06ad10 con 0x7f618c15c5a0 2023-07-20T09:50:04.754 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6183fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f618c06e3e0 0x7f618c0cdf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52462/0 (socket says 172.21.15.82:52462) 2023-07-20T09:50:04.754 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f6183fff640 1 -- 172.21.15.82:0/3967883541 learned_addr learned my addr 172.21.15.82:0/3967883541 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:04.755 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.715+0000 7f618affd640 1 --2- 172.21.15.82:0/3967883541 >> v2:172.21.15.183:3300/0 conn(0x7f618c15c5a0 0x7f618c160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:04.755 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618a7fc640 1 -- 172.21.15.82:0/3967883541 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239019929 0 0) 0x7f618c06c5c0 con 0x7f618c06e3e0 2023-07-20T09:50:04.756 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618a7fc640 1 -- 172.21.15.82:0/3967883541 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6178003530 con 0x7f618c06e3e0 2023-07-20T09:50:04.756 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618affd640 1 -- 172.21.15.82:0/3967883541 >> v1:172.21.15.183:6789/0 conn(0x7f618c0ce680 legacy=0x7f618c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.756 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618affd640 1 -- 172.21.15.82:0/3967883541 >> v1:172.21.15.82:6789/0 conn(0x7f618c06e3e0 legacy=0x7f618c0cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.756 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618affd640 1 -- 172.21.15.82:0/3967883541 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c06aff0 con 0x7f618c15c5a0 2023-07-20T09:50:04.757 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618affd640 1 --2- 172.21.15.82:0/3967883541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c15c5a0 0x7f618c160c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d034c3c92f8a6a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:04.757 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618a7fc640 1 -- 172.21.15.82:0/3967883541 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0ab660 con 0x7f618c15c5a0 2023-07-20T09:50:04.757 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618a7fc640 1 -- 172.21.15.82:0/3967883541 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c0ab7c0 con 0x7f618c15c5a0 2023-07-20T09:50:04.757 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.719+0000 7f618a7fc640 1 -- 172.21.15.82:0/3967883541 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0abb30 con 0x7f618c15c5a0 2023-07-20T09:50:04.758 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- 172.21.15.82:0/3967883541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c15c5a0 msgr2=0x7f618c160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.758 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 --2- 172.21.15.82:0/3967883541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c15c5a0 0x7f618c160c50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097a0 tx=0x7f617c01c460 comp rx=0 tx=0).stop 2023-07-20T09:50:04.759 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- 172.21.15.82:0/3967883541 shutdown_connections 2023-07-20T09:50:04.759 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 --2- 172.21.15.82:0/3967883541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c15c5a0 0x7f618c160c50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.759 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- 172.21.15.82:0/3967883541 >> 172.21.15.82:0/3967883541 conn(0x7f618c069750 msgr2=0x7f618c069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:04.759 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- 172.21.15.82:0/3967883541 shutdown_connections 2023-07-20T09:50:04.759 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- 172.21.15.82:0/3967883541 wait complete. 2023-07-20T09:50:04.762 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 Processor -- start 2023-07-20T09:50:04.762 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- start start 2023-07-20T09:50:04.763 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c06e3e0 0x7f618c152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:04.763 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:04.763 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 0x7f618c0b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:04.763 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c0b14d0 con 0x7f618c0ce680 2023-07-20T09:50:04.764 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c154a60 con 0x7f618c06e3e0 2023-07-20T09:50:04.764 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6191596640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c153e50 con 0x7f618c15c5a0 2023-07-20T09:50:04.764 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:04.764 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f618affd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c06e3e0 0x7f618c152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:04.764 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51838/0 (socket says 172.21.15.82:51838) 2023-07-20T09:50:04.765 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 -- 172.21.15.82:0/205287630 learned_addr learned my addr 172.21.15.82:0/205287630 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:04.765 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f618b7fe640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 0x7f618c0b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:04.765 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 -- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 msgr2=0x7f618c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.765 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 0x7f618c0b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.766 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 -- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c06e3e0 msgr2=0x7f618c152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.766 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c06e3e0 0x7f618c152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.766 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f6183fff640 1 -- 172.21.15.82:0/205287630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c0093b0 con 0x7f618c0ce680 2023-07-20T09:50:04.766 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.723+0000 7f618b7fe640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 0x7f618c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:04.766 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f6183fff640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f617400c4d0 tx=0x7f617400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:04.767 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174005cf0 con 0x7f618c0ce680 2023-07-20T09:50:04.767 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174005e50 con 0x7f618c0ce680 2023-07-20T09:50:04.767 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174007270 con 0x7f618c0ce680 2023-07-20T09:50:04.767 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c154130 con 0x7f618c0ce680 2023-07-20T09:50:04.768 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c1546f0 con 0x7f618c0ce680 2023-07-20T09:50:04.768 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f617401c440 con 0x7f618c0ce680 2023-07-20T09:50:04.768 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f617401cdc0 con 0x7f618c0ce680 2023-07-20T09:50:04.769 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c073ca0 con 0x7f618c0ce680 2023-07-20T09:50:04.770 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.727+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6174021060 con 0x7f618c0ce680 2023-07-20T09:50:04.821 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.783+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f618c0b6320 con 0x7f618c0ce680 2023-07-20T09:50:04.822 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f61837fe640 1 -- 172.21.15.82:0/205287630 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6174017070 con 0x7f618c0ce680 2023-07-20T09:50:04.823 INFO:teuthology.misc.health.smithi082.stdout: 2023-07-20T09:50:04.823 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":10,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:03.448089+0000","last_up_change":"0.000000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:04.824 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 msgr2=0x7f618c0b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:04.825 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f617400c4d0 tx=0x7f617400c990 comp rx=0 tx=0).stop 2023-07-20T09:50:04.825 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 shutdown_connections 2023-07-20T09:50:04.825 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f618c15c5a0 0x7f618c0b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.825 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f618c0ce680 0x7f618c0b0680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.826 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 --2- 172.21.15.82:0/205287630 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f618c06e3e0 0x7f618c152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:04.826 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 >> 172.21.15.82:0/205287630 conn(0x7f618c069750 msgr2=0x7f618c15ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:04.826 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 shutdown_connections 2023-07-20T09:50:04.827 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:04.787+0000 7f6191596640 1 -- 172.21.15.82:0/205287630 wait complete. 2023-07-20T09:50:04.840 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-20T09:50:05.144 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.107+0000 7f766302c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T09:50:05.206 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.168+0000 7f9234787180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T09:50:05.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.195+0000 7f766302c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T09:50:05.293 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.256+0000 7f9234787180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T09:50:05.419 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.383+0000 7f766302c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T09:50:05.483 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.444+0000 7f9234787180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T09:50:05.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.467+0000 7f766302c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T09:50:05.566 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.528+0000 7f9234787180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T09:50:05.783 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.747+0000 7f766302c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T09:50:05.847 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.812+0000 7f9234787180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T09:50:05.851 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:05.815+0000 7f766302c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T09:50:05.924 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:50:05.888+0000 7f9234787180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T09:50:06.872 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:06.835+0000 7f7609869640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-20T09:50:06.875 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:50:06.839+0000 7f7609869640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-20T09:50:07.991 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-07-20T09:50:07.956+0000 7f810ca95640 -1 osd.6 0 log_to_monitors true 2023-07-20T09:50:08.064 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-07-20T09:50:08.027+0000 7f5e0b2da640 -1 osd.3 0 log_to_monitors true 2023-07-20T09:50:08.096 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-07-20T09:50:08.060+0000 7fd5ce2d8640 -1 osd.4 0 log_to_monitors true 2023-07-20T09:50:08.161 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-07-20T09:50:08.123+0000 7fcd0aa72640 -1 osd.2 0 log_to_monitors true 2023-07-20T09:50:08.187 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-07-20T09:50:08.152+0000 7f898c567640 -1 osd.7 0 log_to_monitors true 2023-07-20T09:50:08.197 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-07-20T09:50:08.160+0000 7f0bd4c2c640 -1 osd.5 0 log_to_monitors true 2023-07-20T09:50:08.258 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-07-20T09:50:08.223+0000 7fbe4da39640 -1 osd.0 0 log_to_monitors true 2023-07-20T09:50:08.263 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-07-20T09:50:08.227+0000 7fec0d4ac640 -1 osd.1 0 log_to_monitors true 2023-07-20T09:50:11.646 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:11.865 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 Processor -- start 2023-07-20T09:50:11.866 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 -- start start 2023-07-20T09:50:11.868 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 0x7f7164164950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.868 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.868 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71640cc250 con 0x7f71640c92f0 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7164160fa0 con 0x7f71640b02c0 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716c5d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640cc4a0 con 0x7f7164164e90 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716a36e640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f71640c92f0 0x7f71640afbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59436/0 (socket says 172.21.15.82:59436) 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:53202/0 (socket says 172.21.15.82:53202) 2023-07-20T09:50:11.869 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716a36e640 1 -- 172.21.15.82:0/2191804854 learned_addr learned my addr 172.21.15.82:0/2191804854 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:11.870 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f7169b6d640 1 --2- 172.21.15.82:0/2191804854 >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 0x7f7164164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.870 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 -- 172.21.15.82:0/2191804854 >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 msgr2=0x7f7164164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:11.870 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716936c640 1 -- 172.21.15.82:0/2191804854 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562981410 0 0) 0x7f71640cc250 con 0x7f71640c92f0 2023-07-20T09:50:11.870 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 --2- 172.21.15.82:0/2191804854 >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 0x7f7164164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.871 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 -- 172.21.15.82:0/2191804854 >> v1:172.21.15.183:6789/0 conn(0x7f71640c92f0 legacy=0x7f71640afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:11.871 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f716ab6f640 1 -- 172.21.15.82:0/2191804854 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640cc780 con 0x7f7164164e90 2023-07-20T09:50:11.871 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.830+0000 7f7169b6d640 1 --2- 172.21.15.82:0/2191804854 >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 0x7f7164164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:11.872 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.834+0000 7f716ab6f640 1 --2- 172.21.15.82:0/2191804854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f715c009d90 tx=0x7f715c01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f66ddb0b7301737 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:11.872 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.834+0000 7f716936c640 1 -- 172.21.15.82:0/2191804854 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0a5980 con 0x7f7164164e90 2023-07-20T09:50:11.873 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.834+0000 7f716936c640 1 -- 172.21.15.82:0/2191804854 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0a5ae0 con 0x7f7164164e90 2023-07-20T09:50:11.873 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.834+0000 7f716936c640 1 -- 172.21.15.82:0/2191804854 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0a5e70 con 0x7f7164164e90 2023-07-20T09:50:11.874 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 -- 172.21.15.82:0/2191804854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 msgr2=0x7f716406f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:11.874 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 --2- 172.21.15.82:0/2191804854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f715c009d90 tx=0x7f715c01c8c0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 -- 172.21.15.82:0/2191804854 shutdown_connections 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 --2- 172.21.15.82:0/2191804854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7164164e90 0x7f716406f630 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 --2- 172.21.15.82:0/2191804854 >> v2:172.21.15.82:3300/0 conn(0x7f71640b02c0 0x7f7164164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 -- 172.21.15.82:0/2191804854 >> 172.21.15.82:0/2191804854 conn(0x7f71640cabb0 msgr2=0x7f71640cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 -- 172.21.15.82:0/2191804854 shutdown_connections 2023-07-20T09:50:11.875 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 -- 172.21.15.82:0/2191804854 wait complete. 2023-07-20T09:50:11.877 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.838+0000 7f716c5d2640 1 Processor -- start 2023-07-20T09:50:11.878 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 -- start start 2023-07-20T09:50:11.880 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71640b02c0 0x7f71640b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.880 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.880 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 0x7f7164159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.880 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71640b39a0 con 0x7f7164164e90 2023-07-20T09:50:11.881 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71641fd080 con 0x7f71640b02c0 2023-07-20T09:50:11.881 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716c5d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71641fd360 con 0x7f71640c92f0 2023-07-20T09:50:11.881 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f7169b6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.884 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716a36e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71640b02c0 0x7f71640b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.884 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f7169b6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:53208/0 (socket says 172.21.15.82:53208) 2023-07-20T09:50:11.884 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f7169b6d640 1 -- 172.21.15.82:0/776692938 learned_addr learned my addr 172.21.15.82:0/776692938 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:11.885 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 0x7f7164159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.885 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 -- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 msgr2=0x7f71641fc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:11.885 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.885 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 -- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71640b02c0 msgr2=0x7f71640b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:11.886 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71640b02c0 0x7f71640b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:11.886 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 -- 172.21.15.82:0/776692938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009a70 con 0x7f7164164e90 2023-07-20T09:50:11.886 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f7169b6d640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:11.886 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.842+0000 7f716ab6f640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 0x7f7164159a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f715c0ac000 tx=0x7f715c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:11.887 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.846+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0ad8d0 con 0x7f7164164e90 2023-07-20T09:50:11.887 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.846+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0ada30 con 0x7f7164164e90 2023-07-20T09:50:11.887 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.846+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0adda0 con 0x7f7164164e90 2023-07-20T09:50:11.888 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.846+0000 7f716c5d2640 1 -- 172.21.15.82:0/776692938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71640b2c60 con 0x7f7164164e90 2023-07-20T09:50:11.889 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.846+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f715c0b8420 con 0x7f7164164e90 2023-07-20T09:50:11.890 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f715affd640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 0x7f71480686b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:11.890 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f716c5d2640 1 -- 172.21.15.82:0/776692938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71640b0d40 con 0x7f7164164e90 2023-07-20T09:50:11.890 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f715c0f3410 con 0x7f7164164e90 2023-07-20T09:50:11.890 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f716a36e640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 0x7f71480686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:11.891 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7140005260 con 0x7f7164164e90 2023-07-20T09:50:11.891 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.850+0000 7f716a36e640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 0x7f71480686b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7160007fd0 tx=0x7f7160007ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:11.900 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:11.862+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f715c0b2020 con 0x7f7164164e90 2023-07-20T09:50:12.201 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.162+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71400057e0 con 0x7f7164164e90 2023-07-20T09:50:12.202 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f715affd640 1 -- 172.21.15.82:0/776692938 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f715c0eb790 con 0x7f7164164e90 2023-07-20T09:50:12.202 INFO:teuthology.misc.health.smithi082.stdout: 2023-07-20T09:50:12.203 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":12,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:09.844671+0000","last_up_change":"0.000000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:12.205 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 msgr2=0x7f71480686b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:12.205 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 0x7f71480686b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7160007fd0 tx=0x7f7160007ba0 comp rx=0 tx=0).stop 2023-07-20T09:50:12.205 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 msgr2=0x7f7164159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:12.205 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 0x7f7164159a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f715c0ac000 tx=0x7f715c019660 comp rx=0 tx=0).stop 2023-07-20T09:50:12.205 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 shutdown_connections 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f71480661f0 0x7f71480686b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7164164e90 0x7f7164159a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71640c92f0 0x7f71641fc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 --2- 172.21.15.82:0/776692938 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71640b02c0 0x7f71640b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 >> 172.21.15.82:0/776692938 conn(0x7f71640cabb0 msgr2=0x7f716415d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 shutdown_connections 2023-07-20T09:50:12.206 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:12.166+0000 7f7158ff9640 1 -- 172.21.15.82:0/776692938 wait complete. 2023-07-20T09:50:12.235 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-20T09:50:12.272 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-07-20T09:50:12.236+0000 7f810821c640 -1 osd.6 0 waiting for initial osdmap 2023-07-20T09:50:12.274 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-07-20T09:50:12.236+0000 7fd5c9a5d640 -1 osd.4 0 waiting for initial osdmap 2023-07-20T09:50:12.303 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-07-20T09:50:12.268+0000 7f8987cee640 -1 osd.7 0 waiting for initial osdmap 2023-07-20T09:50:12.311 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-07-20T09:50:12.274+0000 7fec08c31640 -1 osd.1 0 waiting for initial osdmap 2023-07-20T09:50:12.315 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-07-20T09:50:12.280+0000 7fd5c20a4640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.316 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-07-20T09:50:12.280+0000 7f8100863640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.331 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-07-20T09:50:12.296+0000 7f8980335640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.345 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-07-20T09:50:12.308+0000 7f0bcf9fd640 -1 osd.5 0 waiting for initial osdmap 2023-07-20T09:50:12.351 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-07-20T09:50:12.314+0000 7fcd07a2f640 -1 osd.2 0 waiting for initial osdmap 2023-07-20T09:50:12.354 INFO:tasks.ceph.osd.1.smithi082.stderr:2023-07-20T09:50:12.318+0000 7fec01278640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.367 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-07-20T09:50:12.332+0000 7f0bc8044640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.386 INFO:tasks.ceph.osd.2.smithi082.stderr:2023-07-20T09:50:12.350+0000 7fccfe83e640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.401 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-07-20T09:50:12.362+0000 7fbe491be640 -1 osd.0 0 waiting for initial osdmap 2023-07-20T09:50:12.405 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-07-20T09:50:12.370+0000 7f5e08297640 -1 osd.3 0 waiting for initial osdmap 2023-07-20T09:50:12.438 INFO:tasks.ceph.osd.0.smithi082.stderr:2023-07-20T09:50:12.402+0000 7fbe41805640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:12.457 INFO:tasks.ceph.osd.3.smithi082.stderr:2023-07-20T09:50:12.422+0000 7f5dff0a6640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-20T09:50:19.042 DEBUG:teuthology.orchestra.run.smithi082:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:19.180 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.142+0000 7f98e4b00640 1 Processor -- start 2023-07-20T09:50:19.180 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.142+0000 7f98e4b00640 1 -- start start 2023-07-20T09:50:19.181 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.142+0000 7f98e4b00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f98e00cd950 0x7f98e0070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.181 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98e4b00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00ca750 con 0x7f98e0159320 2023-07-20T09:50:19.181 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98e4b00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00c9800 con 0x7f98e00afbb0 2023-07-20T09:50:19.181 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98e4b00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e00c8f60 con 0x7f98e00cd950 2023-07-20T09:50:19.182 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98de59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98e0159320 0x7f98e00c8780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57264/0 (socket says 172.21.15.82:57264) 2023-07-20T09:50:19.182 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98de59c640 1 -- 172.21.15.82:0/300129500 learned_addr learned my addr 172.21.15.82:0/300129500 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:19.184 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627130430 0 0) 0x7f98e00ca750 con 0x7f98e0159320 2023-07-20T09:50:19.184 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98cc003530 con 0x7f98e0159320 2023-07-20T09:50:19.184 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/300129500 >> v2:172.21.15.183:3300/0 conn(0x7f98e00cd950 0x7f98e0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.184 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 154889388 0 0) 0x7f98cc003530 con 0x7f98e0159320 2023-07-20T09:50:19.184 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 >> v2:172.21.15.183:3300/0 conn(0x7f98e00cd950 msgr2=0x7f98e0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 --2- 172.21.15.82:0/300129500 >> v2:172.21.15.183:3300/0 conn(0x7f98e00cd950 0x7f98e0070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 >> v1:172.21.15.183:6789/0 conn(0x7f98e00afbb0 legacy=0x7f98e00cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00c9240 con 0x7f98e0159320 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f98d0001680 con 0x7f98e0159320 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 >> v1:172.21.15.82:6789/0 conn(0x7f98e0159320 legacy=0x7f98e00c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc003980 0x7f98cc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 0x7f98cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.185 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98cc005190 0x7f98cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.186 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c8f60 con 0x7f98cc0047d0 2023-07-20T09:50:19.186 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc00c030 con 0x7f98cc003980 2023-07-20T09:50:19.186 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc00c1f0 con 0x7f98cc005190 2023-07-20T09:50:19.186 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 0x7f98cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98de59c640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc003980 0x7f98cc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ded9d640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98cc005190 0x7f98cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 -- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98cc005190 msgr2=0x7f98cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98cc005190 0x7f98cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 -- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc003980 msgr2=0x7f98cc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc003980 0x7f98cc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.187 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98d5d9b640 1 -- 172.21.15.82:0/300129500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc003530 con 0x7f98cc0047d0 2023-07-20T09:50:19.188 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.146+0000 7f98ded9d640 1 -- 172.21.15.82:0/300129500 reap_dead start 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 0x7f98cc004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009fc0 tx=0x7f98c801ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b55c18a08dd082 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80a7c70 con 0x7f98cc0047d0 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800f040 con 0x7f98cc0047d0 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98ddd9b640 1 -- 172.21.15.82:0/300129500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80af440 con 0x7f98cc0047d0 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 msgr2=0x7f98cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.189 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 0x7f98cc004c50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009fc0 tx=0x7f98c801ee70 comp rx=0 tx=0).stop 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- 172.21.15.82:0/300129500 shutdown_connections 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 --2- 172.21.15.82:0/300129500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98cc0047d0 0x7f98cc004c50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- 172.21.15.82:0/300129500 >> 172.21.15.82:0/300129500 conn(0x7f98e00cabb0 msgr2=0x7f98e00cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- 172.21.15.82:0/300129500 shutdown_connections 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- 172.21.15.82:0/300129500 wait complete. 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 Processor -- start 2023-07-20T09:50:19.190 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.150+0000 7f98e4b00640 1 -- start start 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc0047d0 0x7f98e01f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98e015bdc0 0x7f98e006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e0146020 con 0x7f98e015c240 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015b870 con 0x7f98cc0047d0 2023-07-20T09:50:19.193 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e015aca0 con 0x7f98e015bdc0 2023-07-20T09:50:19.194 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.194 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44222/0 (socket says 172.21.15.82:44222) 2023-07-20T09:50:19.194 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 -- 172.21.15.82:0/4277102400 learned_addr learned my addr 172.21.15.82:0/4277102400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:19.194 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98de59c640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc0047d0 0x7f98e01f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.194 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98d5d9b640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98e015bdc0 0x7f98e006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 -- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98e015bdc0 msgr2=0x7f98e006b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98e015bdc0 0x7f98e006b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 -- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc0047d0 msgr2=0x7f98e01f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc0047d0 0x7f98e01f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 -- 172.21.15.82:0/4277102400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e01f1b40 con 0x7f98e015c240 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98ded9d640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98e00cdfc0 tx=0x7f98d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80050d0 con 0x7f98e015c240 2023-07-20T09:50:19.195 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8005250 con 0x7f98e015c240 2023-07-20T09:50:19.196 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8003600 con 0x7f98e015c240 2023-07-20T09:50:19.196 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e015af40 con 0x7f98e015c240 2023-07-20T09:50:19.196 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e015b500 con 0x7f98e015c240 2023-07-20T09:50:19.196 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.154+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e015ba00 con 0x7f98e015c240 2023-07-20T09:50:19.197 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.158+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98d8003760 con 0x7f98e015c240 2023-07-20T09:50:19.197 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.158+0000 7f98d77fe640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 0x7f98c0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.197 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.158+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f98d8082c90 con 0x7f98e015c240 2023-07-20T09:50:19.197 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.158+0000 7f98de59c640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 0x7f98c0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.198 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.158+0000 7f98de59c640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 0x7f98c0068740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98d0007cc0 tx=0x7f98d0001c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.199 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.162+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98d80505d0 con 0x7f98e015c240 2023-07-20T09:50:19.349 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e0073060 con 0x7f98e015c240 2023-07-20T09:50:19.350 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98d77fe640 1 -- 172.21.15.82:0/4277102400 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12826 (secure 0 0 0) 0x7f98d8019090 con 0x7f98e015c240 2023-07-20T09:50:19.350 INFO:teuthology.misc.health.smithi082.stdout: 2023-07-20T09:50:19.351 INFO:teuthology.misc.health.smithi082.stdout:{"epoch":16,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:16.294222+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:19.352 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 msgr2=0x7f98c0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.352 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 0x7f98c0068740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f98d0007cc0 tx=0x7f98d0001c10 comp rx=0 tx=0).stop 2023-07-20T09:50:19.352 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 msgr2=0x7f98e006b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.352 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98e00cdfc0 tx=0x7f98d800e530 comp rx=0 tx=0).stop 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 shutdown_connections 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f98c0066280 0x7f98c0068740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98e015c240 0x7f98e006b930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98e015bdc0 0x7f98e006b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 --2- 172.21.15.82:0/4277102400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98cc0047d0 0x7f98e01f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 >> 172.21.15.82:0/4277102400 conn(0x7f98e00cabb0 msgr2=0x7f98e0155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:19.353 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 shutdown_connections 2023-07-20T09:50:19.354 INFO:teuthology.misc.health.smithi082.stderr:2023-07-20T09:50:19.314+0000 7f98e4b00640 1 -- 172.21.15.82:0/4277102400 wait complete. 2023-07-20T09:50:19.371 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-20T09:50:19.371 INFO:tasks.ceph:Creating RBD pool 2023-07-20T09:50:19.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-20T09:50:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.470+0000 7fed63737640 1 Processor -- start 2023-07-20T09:50:19.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.470+0000 7fed63737640 1 -- start start 2023-07-20T09:50:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed63737640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fed5c06bd30 0x7fed5c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed63737640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0c95d0 con 0x7fed5c070970 2023-07-20T09:50:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed63737640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c1590c0 con 0x7fed5c158ce0 2023-07-20T09:50:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed63737640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0c89c0 con 0x7fed5c06bd30 2023-07-20T09:50:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed60cd2640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fed5c070970 0x7fed5c06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57274/0 (socket says 172.21.15.82:57274) 2023-07-20T09:50:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed60cd2640 1 -- 172.21.15.82:0/873642774 learned_addr learned my addr 172.21.15.82:0/873642774 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:19.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed61cd4640 1 --2- 172.21.15.82:0/873642774 >> v2:172.21.15.183:3300/0 conn(0x7fed5c06bd30 0x7fed5c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed53fff640 1 -- 172.21.15.82:0/873642774 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524642081 0 0) 0x7fed5c0c95d0 con 0x7fed5c070970 2023-07-20T09:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed53fff640 1 -- 172.21.15.82:0/873642774 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed48003530 con 0x7fed5c070970 2023-07-20T09:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed61cd4640 1 -- 172.21.15.82:0/873642774 >> v1:172.21.15.183:6789/0 conn(0x7fed5c158ce0 legacy=0x7fed5c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed61cd4640 1 -- 172.21.15.82:0/873642774 >> v1:172.21.15.82:6789/0 conn(0x7fed5c070970 legacy=0x7fed5c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.474+0000 7fed61cd4640 1 -- 172.21.15.82:0/873642774 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0c8ca0 con 0x7fed5c06bd30 2023-07-20T09:50:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed61cd4640 1 --2- 172.21.15.82:0/873642774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c06bd30 0x7fed5c070e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed54009d90 tx=0x7fed5401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ffc777690217e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed53fff640 1 -- 172.21.15.82:0/873642774 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540a5880 con 0x7fed5c06bd30 2023-07-20T09:50:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed53fff640 1 -- 172.21.15.82:0/873642774 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540a59e0 con 0x7fed5c06bd30 2023-07-20T09:50:19.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed53fff640 1 -- 172.21.15.82:0/873642774 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540a5d70 con 0x7fed5c06bd30 2023-07-20T09:50:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- 172.21.15.82:0/873642774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c06bd30 msgr2=0x7fed5c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 --2- 172.21.15.82:0/873642774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c06bd30 0x7fed5c070e00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed54009d90 tx=0x7fed5401c950 comp rx=0 tx=0).stop 2023-07-20T09:50:19.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- 172.21.15.82:0/873642774 shutdown_connections 2023-07-20T09:50:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 --2- 172.21.15.82:0/873642774 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c06bd30 0x7fed5c070e00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- 172.21.15.82:0/873642774 >> 172.21.15.82:0/873642774 conn(0x7fed5c0cad50 msgr2=0x7fed5c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- 172.21.15.82:0/873642774 shutdown_connections 2023-07-20T09:50:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- 172.21.15.82:0/873642774 wait complete. 2023-07-20T09:50:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 Processor -- start 2023-07-20T09:50:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.478+0000 7fed63737640 1 -- start start 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 0x7fed5c0af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c158ce0 0x7fed5c145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b2b20 con 0x7fed5c06bd30 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b2e00 con 0x7fed5c158ce0 2023-07-20T09:50:19.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b30e0 con 0x7fed5c070970 2023-07-20T09:50:19.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44238/0 (socket says 172.21.15.82:44238) 2023-07-20T09:50:19.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 -- 172.21.15.82:0/901887425 learned_addr learned my addr 172.21.15.82:0/901887425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed61cd4640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c158ce0 0x7fed5c145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed60cd2640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 0x7fed5c0af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 -- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 msgr2=0x7fed5c0af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 0x7fed5c0af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 -- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c158ce0 msgr2=0x7fed5c145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c158ce0 0x7fed5c145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 -- 172.21.15.82:0/901887425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009a70 con 0x7fed5c06bd30 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed60cd2640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 0x7fed5c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed614d3640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c3c0 tx=0x7fed5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580052d0 con 0x7fed5c06bd30 2023-07-20T09:50:19.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58005430 con 0x7fed5c06bd30 2023-07-20T09:50:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58003840 con 0x7fed5c06bd30 2023-07-20T09:50:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0b33c0 con 0x7fed5c06bd30 2023-07-20T09:50:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0b27b0 con 0x7fed5c06bd30 2023-07-20T09:50:19.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c04da30 con 0x7fed5c06bd30 2023-07-20T09:50:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.482+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed580039a0 con 0x7fed5c06bd30 2023-07-20T09:50:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.486+0000 7fed51ffb640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 0x7fed40068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.486+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed58082e60 con 0x7fed5c06bd30 2023-07-20T09:50:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.486+0000 7fed60cd2640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 0x7fed40068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:19.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.486+0000 7fed60cd2640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 0x7fed40068740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b3ef0 tx=0x7fed4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:19.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.490+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed580506f0 con 0x7fed5c06bd30 2023-07-20T09:50:19.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:19.638+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fed5c0b4250 con 0x7fed5c06bd30 2023-07-20T09:50:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.334+0000 7fed51ffb640 1 -- 172.21.15.82:0/901887425 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fed58053d10 con 0x7fed5c06bd30 2023-07-20T09:50:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'rbd' created 2023-07-20T09:50:20.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 msgr2=0x7fed40068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 0x7fed40068740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b3ef0 tx=0x7fed4c009040 comp rx=0 tx=0).stop 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 msgr2=0x7fed5c0c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c3c0 tx=0x7fed5800c880 comp rx=0 tx=0).stop 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 shutdown_connections 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed40066280 0x7fed40068740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed5c158ce0 0x7fed5c145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed5c070970 0x7fed5c0af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 --2- 172.21.15.82:0/901887425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed5c06bd30 0x7fed5c0c1e00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 >> 172.21.15.82:0/901887425 conn(0x7fed5c0cad50 msgr2=0x7fed5c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:20.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 shutdown_connections 2023-07-20T09:50:20.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.338+0000 7fed63737640 1 -- 172.21.15.82:0/901887425 wait complete. 2023-07-20T09:50:20.395 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-20T09:50:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 Processor -- start 2023-07-20T09:50:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 -- start start 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27701602b0 0x7f2770160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700ce4f0 con 0x7f277006c120 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27700d0970 con 0x7f277006ab10 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f2775848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2770160e20 con 0x7f27701602b0 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f277006c120 0x7f27700cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57276/0 (socket says 172.21.15.82:57276) 2023-07-20T09:50:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276effd640 1 -- 172.21.15.82:0/1094910527 learned_addr learned my addr 172.21.15.82:0/1094910527 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276e7fc640 1 --2- 172.21.15.82:0/1094910527 >> v2:172.21.15.183:3300/0 conn(0x7f27701602b0 0x7f2770160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438928067 0 0) 0x7f27700ce4f0 con 0x7f277006c120 2023-07-20T09:50:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2758003530 con 0x7f277006c120 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 827189713 0 0) 0x7f2758003530 con 0x7f277006c120 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 >> v2:172.21.15.183:3300/0 conn(0x7f27701602b0 msgr2=0x7f2770160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 --2- 172.21.15.82:0/1094910527 >> v2:172.21.15.183:3300/0 conn(0x7f27701602b0 0x7f2770160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 >> v1:172.21.15.183:6789/0 conn(0x7f277006ab10 legacy=0x7f277006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700cd300 con 0x7f277006c120 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2760001680 con 0x7f277006c120 2023-07-20T09:50:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 >> v1:172.21.15.82:6789/0 conn(0x7f277006c120 legacy=0x7f27700cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27580039f0 0x7f2758003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580047d0 0x7f2758004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 0x7f275800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2770160e20 con 0x7f2758005290 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275800c1d0 con 0x7f27580047d0 2023-07-20T09:50:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275800c390 con 0x7f27580039f0 2023-07-20T09:50:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 0x7f275800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276e7fc640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580047d0 0x7f2758004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276effd640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27580039f0 0x7f2758003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 -- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27580039f0 msgr2=0x7f2758003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:20.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27580039f0 0x7f2758003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 -- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580047d0 msgr2=0x7f2758004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:20.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27580047d0 0x7f2758004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.502+0000 7f276f7fe640 1 -- 172.21.15.82:0/1094910527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758003530 con 0x7f2758005290 2023-07-20T09:50:20.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f276f7fe640 1 -- 172.21.15.82:0/1094910527 reap_dead start 2023-07-20T09:50:20.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 0x7f275800b990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2768001e70 tx=0x7f276801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5bcab34b45f552 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:20.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768003b80 con 0x7f2758005290 2023-07-20T09:50:20.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2768003d20 con 0x7f2758005290 2023-07-20T09:50:20.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f276dffb640 1 -- 172.21.15.82:0/1094910527 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768005260 con 0x7f2758005290 2023-07-20T09:50:20.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 -- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 msgr2=0x7f275800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 0x7f275800b990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2768001e70 tx=0x7f276801c730 comp rx=0 tx=0).stop 2023-07-20T09:50:20.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 -- 172.21.15.82:0/1094910527 shutdown_connections 2023-07-20T09:50:20.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 --2- 172.21.15.82:0/1094910527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2758005290 0x7f275800b990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 -- 172.21.15.82:0/1094910527 >> 172.21.15.82:0/1094910527 conn(0x7f277008c0a0 msgr2=0x7f277009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:20.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 -- 172.21.15.82:0/1094910527 shutdown_connections 2023-07-20T09:50:20.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.506+0000 7f2775848640 1 -- 172.21.15.82:0/1094910527 wait complete. 2023-07-20T09:50:20.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 Processor -- start 2023-07-20T09:50:20.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- start start 2023-07-20T09:50:20.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758005290 0x7f27700cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 0x7f27700c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700cbb80 con 0x7f27700cb350 2023-07-20T09:50:20.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27700cb8a0 con 0x7f27700b0620 2023-07-20T09:50:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27700c6d30 con 0x7f2758005290 2023-07-20T09:50:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44248/0 (socket says 172.21.15.82:44248) 2023-07-20T09:50:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 -- 172.21.15.82:0/1326624870 learned_addr learned my addr 172.21.15.82:0/1326624870 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276effd640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758005290 0x7f27700cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 0x7f27700c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 -- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758005290 msgr2=0x7f27700cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758005290 0x7f27700cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 -- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 msgr2=0x7f27700c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 0x7f27700c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 -- 172.21.15.82:0/1326624870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27700c7010 con 0x7f27700cb350 2023-07-20T09:50:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276f7fe640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 0x7f27700c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f276e7fc640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2764011960 tx=0x7f2764011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276400faf0 con 0x7f27700cb350 2023-07-20T09:50:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276400fc50 con 0x7f27700cb350 2023-07-20T09:50:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764014440 con 0x7f27700cb350 2023-07-20T09:50:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700c72f0 con 0x7f27700cb350 2023-07-20T09:50:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.510+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27700b5d50 con 0x7f27700cb350 2023-07-20T09:50:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27700c6b70 con 0x7f27700cb350 2023-07-20T09:50:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27640145a0 con 0x7f27700cb350 2023-07-20T09:50:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f2757fff640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 0x7f275c068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f27640842c0 con 0x7f27700cb350 2023-07-20T09:50:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f276effd640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 0x7f275c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.514+0000 7f276effd640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 0x7f275c068770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27600018f0 tx=0x7f2760009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.518+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2764051a40 con 0x7f27700cb350 2023-07-20T09:50:20.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:20.670+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f277004da30 con 0x7f27700cb350 2023-07-20T09:50:21.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.338+0000 7f2757fff640 1 -- 172.21.15.82:0/1326624870 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2764055060 con 0x7f27700cb350 2023-07-20T09:50:21.375 INFO:teuthology.orchestra.run.smithi082.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-20T09:50:21.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.338+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 msgr2=0x7f275c068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.338+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 0x7f275c068770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f27600018f0 tx=0x7f2760009040 comp rx=0 tx=0).stop 2023-07-20T09:50:21.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.338+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 msgr2=0x7f27700b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.338+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2764011960 tx=0x7f2764011e20 comp rx=0 tx=0).stop 2023-07-20T09:50:21.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 shutdown_connections 2023-07-20T09:50:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f275c0662b0 0x7f275c068770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27700b0620 0x7f27700c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27700cb350 0x7f27700b5810 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 --2- 172.21.15.82:0/1326624870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2758005290 0x7f27700cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 >> 172.21.15.82:0/1326624870 conn(0x7f277008c0a0 msgr2=0x7f27700af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:21.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 shutdown_connections 2023-07-20T09:50:21.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.342+0000 7f2775848640 1 -- 172.21.15.82:0/1326624870 wait complete. 2023-07-20T09:50:21.399 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-20T09:50:21.400 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T09:50:21.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T09:50:21.404 INFO:tasks.ceph.mds.a:Started 2023-07-20T09:50:21.405 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T09:50:21.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T09:50:21.408 INFO:tasks.ceph.mds.c:Started 2023-07-20T09:50:21.409 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T09:50:21.409 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T09:50:21.412 INFO:tasks.ceph.mds.b:Started 2023-07-20T09:50:21.413 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T09:50:21.413 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T09:50:21.416 INFO:tasks.ceph.mds.d:Started 2023-07-20T09:50:21.417 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-20T09:50:21.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:21.515 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T09:50:21.518 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T09:50:21.524 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T09:50:21.533 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T09:50:21.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 Processor -- start 2023-07-20T09:50:21.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 -- start start 2023-07-20T09:50:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fec2015c5f0 0x7fec200b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec200ccfb0 0x7fec200ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200b7c20 con 0x7fec200ce9a0 2023-07-20T09:50:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec200cee30 con 0x7fec200ccfb0 2023-07-20T09:50:21.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec25608640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2015c9d0 con 0x7fec2015c5f0 2023-07-20T09:50:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fec200ccfb0 0x7fec200ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec24e07640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec200ce9a0 0x7fec200b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57296/0 (socket says 172.21.15.82:57296) 2023-07-20T09:50:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec24e07640 1 -- 172.21.15.82:0/1031518799 learned_addr learned my addr 172.21.15.82:0/1031518799 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:21.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1ffff640 1 --2- 172.21.15.82:0/1031518799 >> v2:172.21.15.183:3300/0 conn(0x7fec2015c5f0 0x7fec200b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1f7fe640 1 -- 172.21.15.82:0/1031518799 >> v2:172.21.15.183:3300/0 conn(0x7fec2015c5f0 msgr2=0x7fec200b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1f7fe640 1 --2- 172.21.15.82:0/1031518799 >> v2:172.21.15.183:3300/0 conn(0x7fec2015c5f0 0x7fec200b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1f7fe640 1 -- 172.21.15.82:0/1031518799 >> v1:172.21.15.82:6789/0 conn(0x7fec200ce9a0 legacy=0x7fec200b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1effd640 1 -- 172.21.15.82:0/1031518799 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409171696 0 0) 0x7fec200b7c20 con 0x7fec200ce9a0 2023-07-20T09:50:21.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.534+0000 7fec1f7fe640 1 -- 172.21.15.82:0/1031518799 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200ce030 con 0x7fec200ccfb0 2023-07-20T09:50:21.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec1f7fe640 1 --2- 172.21.15.82:0/1031518799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ce460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec200d2470 tx=0x7fec1401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61c0716dbbd4794 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec1effd640 1 -- 172.21.15.82:0/1031518799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140a8950 con 0x7fec200ccfb0 2023-07-20T09:50:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec1effd640 1 -- 172.21.15.82:0/1031518799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec140a8ab0 con 0x7fec200ccfb0 2023-07-20T09:50:21.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec1effd640 1 -- 172.21.15.82:0/1031518799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140a8e40 con 0x7fec200ccfb0 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 -- 172.21.15.82:0/1031518799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 msgr2=0x7fec200ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 --2- 172.21.15.82:0/1031518799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ce460 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fec200d2470 tx=0x7fec1401ec50 comp rx=0 tx=0).stop 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 -- 172.21.15.82:0/1031518799 shutdown_connections 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 --2- 172.21.15.82:0/1031518799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ce460 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 --2- 172.21.15.82:0/1031518799 >> v2:172.21.15.183:3300/0 conn(0x7fec2015c5f0 0x7fec200b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 -- 172.21.15.82:0/1031518799 >> 172.21.15.82:0/1031518799 conn(0x7fec20065710 msgr2=0x7fec20065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 -- 172.21.15.82:0/1031518799 shutdown_connections 2023-07-20T09:50:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 -- 172.21.15.82:0/1031518799 wait complete. 2023-07-20T09:50:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.538+0000 7fec25608640 1 Processor -- start 2023-07-20T09:50:21.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- start start 2023-07-20T09:50:21.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec200ce9a0 0x7fec201f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 0x7fec200aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec200a9300 con 0x7fec200ccfb0 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec201f5750 con 0x7fec200ce9a0 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec201f5a30 con 0x7fec2015c5f0 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44304/0 (socket says 172.21.15.82:44304) 2023-07-20T09:50:21.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 -- 172.21.15.82:0/288941545 learned_addr learned my addr 172.21.15.82:0/288941545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:21.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec24e07640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 0x7fec200aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1f7fe640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec200ce9a0 0x7fec201f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 -- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 msgr2=0x7fec200aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 0x7fec200aa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 -- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec200ce9a0 msgr2=0x7fec201f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec200ce9a0 0x7fec201f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 -- 172.21.15.82:0/288941545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009420 con 0x7fec200ccfb0 2023-07-20T09:50:21.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec24e07640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 0x7fec200aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1ffff640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e870 tx=0x7fec1000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10009510 con 0x7fec200ccfb0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1000eec0 con 0x7fec200ccfb0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000cb40 con 0x7fec200ccfb0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec200a8f90 con 0x7fec200ccfb0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec200acd70 con 0x7fec200ccfb0 2023-07-20T09:50:21.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.542+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2004da30 con 0x7fec200ccfb0 2023-07-20T09:50:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.546+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec1000cca0 con 0x7fec200ccfb0 2023-07-20T09:50:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.546+0000 7fec1cff9640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 0x7fec0c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.546+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec10083b90 con 0x7fec200ccfb0 2023-07-20T09:50:21.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.546+0000 7fec1f7fe640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 0x7fec0c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.546+0000 7fec1f7fe640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 0x7fec0c068740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec140b2000 tx=0x7fec14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.550+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec100512c0 con 0x7fec200ccfb0 2023-07-20T09:50:21.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.698+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec200d0ce0 con 0x7fec200ccfb0 2023-07-20T09:50:21.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.698+0000 7fec1cff9640 1 -- 172.21.15.82:0/288941545 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14625 (secure 0 0 0) 0x7fec10017090 con 0x7fec200ccfb0 2023-07-20T09:50:21.736 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:21.736 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:21.332170+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:21.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 msgr2=0x7fec0c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 0x7fec0c068740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec140b2000 tx=0x7fec14008040 comp rx=0 tx=0).stop 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 msgr2=0x7fec200ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fec1000e870 tx=0x7fec1000ec70 comp rx=0 tx=0).stop 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 shutdown_connections 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fec0c066280 0x7fec0c068740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec2015c5f0 0x7fec200aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec200ce9a0 0x7fec201f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 --2- 172.21.15.82:0/288941545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec200ccfb0 0x7fec200ac830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 >> 172.21.15.82:0/288941545 conn(0x7fec20065710 msgr2=0x7fec2015cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:21.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 shutdown_connections 2023-07-20T09:50:21.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.702+0000 7fec25608640 1 -- 172.21.15.82:0/288941545 wait complete. 2023-07-20T09:50:21.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:21.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:21.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.862+0000 7f76e13e6640 1 Processor -- start 2023-07-20T09:50:21.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.862+0000 7f76e13e6640 1 -- start start 2023-07-20T09:50:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e13e6640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f76dc15fb70 0x7f76dc0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e13e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0d0970 0x7f76dc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e13e6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc15ff50 con 0x7f76dc0b44d0 2023-07-20T09:50:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e13e6640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0b4960 con 0x7f76dc15fb70 2023-07-20T09:50:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e13e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc0d0f90 con 0x7f76dc0d0970 2023-07-20T09:50:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f76dc15fb70 0x7f76dc0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76e0be5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0d0970 0x7f76dc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f76dc15fb70 0x7f76dc0b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:52048/0 (socket says 172.21.15.82:52048) 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 -- 172.21.15.82:0/1654855206 learned_addr learned my addr 172.21.15.82:0/1654855206 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 -- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0d0970 msgr2=0x7f76dc0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 --2- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0d0970 0x7f76dc0b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 -- 172.21.15.82:0/1654855206 >> v1:172.21.15.183:6789/0 conn(0x7f76dc0b44d0 legacy=0x7f76dc0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.866+0000 7f76dbfff640 1 -- 172.21.15.82:0/1654855206 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc0cd190 con 0x7f76dc15fb70 2023-07-20T09:50:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76dbfff640 1 --2- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc0b3f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009870 tx=0x7f76cc01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d353dffd04a779 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76daffd640 1 -- 172.21.15.82:0/1654855206 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0ac640 con 0x7f76dc15fb70 2023-07-20T09:50:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76daffd640 1 -- 172.21.15.82:0/1654855206 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0ac7a0 con 0x7f76dc15fb70 2023-07-20T09:50:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76daffd640 1 -- 172.21.15.82:0/1654855206 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0acb30 con 0x7f76dc15fb70 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 msgr2=0x7f76dc0b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc0b3f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009870 tx=0x7f76cc01c420 comp rx=0 tx=0).stop 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- 172.21.15.82:0/1654855206 shutdown_connections 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0d0970 0x7f76dc0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1654855206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc0b3f90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- 172.21.15.82:0/1654855206 >> 172.21.15.82:0/1654855206 conn(0x7f76dc065710 msgr2=0x7f76dc065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- 172.21.15.82:0/1654855206 shutdown_connections 2023-07-20T09:50:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- 172.21.15.82:0/1654855206 wait complete. 2023-07-20T09:50:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 Processor -- start 2023-07-20T09:50:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.870+0000 7f76e13e6640 1 -- start start 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0b44d0 0x7f76dc0cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc14e280 con 0x7f76dc0d0970 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc14cf80 con 0x7f76dc15fb70 2023-07-20T09:50:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc14d260 con 0x7f76dc0b44d0 2023-07-20T09:50:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44310/0 (socket says 172.21.15.82:44310) 2023-07-20T09:50:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 -- 172.21.15.82:0/1726790625 learned_addr learned my addr 172.21.15.82:0/1726790625 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76dbfff640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0b44d0 0x7f76dc0cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e0be5640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 -- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0b44d0 msgr2=0x7f76dc0cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0b44d0 0x7f76dc0cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 -- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 msgr2=0x7f76dc14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 -- 172.21.15.82:0/1726790625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0094d0 con 0x7f76dc0d0970 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76db7fe640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c500 tx=0x7f76d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0005220 con 0x7f76dc0d0970 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d0005380 con 0x7f76dc0d0970 2023-07-20T09:50:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc14d540 con 0x7f76dc0d0970 2023-07-20T09:50:21.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d0007270 con 0x7f76dc0d0970 2023-07-20T09:50:21.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc0cc340 con 0x7f76dc0d0970 2023-07-20T09:50:21.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.874+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc04da30 con 0x7f76dc0d0970 2023-07-20T09:50:21.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.878+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76d00073d0 con 0x7f76dc0d0970 2023-07-20T09:50:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.878+0000 7f76d8ff9640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 0x7f76c8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.878+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f76d0083200 con 0x7f76dc0d0970 2023-07-20T09:50:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.878+0000 7f76dbfff640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 0x7f76c8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:21.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.878+0000 7f76dbfff640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 0x7f76c8068740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0ae000 tx=0x7f76cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:21.882+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76d00509f0 con 0x7f76dc0d0970 2023-07-20T09:50:22.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.030+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76dc14d9f0 con 0x7f76dc0d0970 2023-07-20T09:50:22.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.030+0000 7f76d8ff9640 1 -- 172.21.15.82:0/1726790625 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76d0054010 con 0x7f76dc0d0970 2023-07-20T09:50:22.068 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:22.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 msgr2=0x7f76c8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 0x7f76c8068740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0ae000 tx=0x7f76cc008040 comp rx=0 tx=0).stop 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 msgr2=0x7f76dc14dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f76d000c500 tx=0x7f76d000c9c0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 shutdown_connections 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f76c8066280 0x7f76c8068740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76dc15fb70 0x7f76dc14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76dc0d0970 0x7f76dc14dd40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 --2- 172.21.15.82:0/1726790625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76dc0b44d0 0x7f76dc0cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 >> 172.21.15.82:0/1726790625 conn(0x7f76dc065710 msgr2=0x7f76dc0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 shutdown_connections 2023-07-20T09:50:22.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.034+0000 7f76e13e6640 1 -- 172.21.15.82:0/1726790625 wait complete. 2023-07-20T09:50:22.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:22.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.190+0000 7f48ef456640 1 Processor -- start 2023-07-20T09:50:22.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.190+0000 7f48ef456640 1 -- start start 2023-07-20T09:50:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ef456640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48e8159830 0x7f48e80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ef456640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f48e80cc3e0 0x7f48e80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ef456640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80cc8d0 con 0x7f48e8159450 2023-07-20T09:50:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ef456640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80cce90 con 0x7f48e8159830 2023-07-20T09:50:22.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ef456640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e80ccbb0 con 0x7f48e80cc3e0 2023-07-20T09:50:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48e8159830 0x7f48e80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48e8159830 0x7f48e80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44326/0 (socket says 172.21.15.82:44326) 2023-07-20T09:50:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 -- 172.21.15.82:0/362258564 learned_addr learned my addr 172.21.15.82:0/362258564 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ed9f3640 1 --2- 172.21.15.82:0/362258564 >> v2:172.21.15.183:3300/0 conn(0x7f48e80cc3e0 0x7f48e80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 -- 172.21.15.82:0/362258564 >> v2:172.21.15.183:3300/0 conn(0x7f48e80cc3e0 msgr2=0x7f48e80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 --2- 172.21.15.82:0/362258564 >> v2:172.21.15.183:3300/0 conn(0x7f48e80cc3e0 0x7f48e80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 -- 172.21.15.82:0/362258564 >> v1:172.21.15.183:6789/0 conn(0x7f48e8159450 legacy=0x7f48e815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.194+0000 7f48ec9f1640 1 -- 172.21.15.82:0/362258564 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8159cc0 con 0x7f48e8159830 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ec9f1640 1 --2- 172.21.15.82:0/362258564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159830 0x7f48e80cbea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48e80c1da0 tx=0x7f48d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1436d071e4bd239 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48dffff640 1 -- 172.21.15.82:0/362258564 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80ac640 con 0x7f48e8159830 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48dffff640 1 -- 172.21.15.82:0/362258564 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80ac7a0 con 0x7f48e8159830 2023-07-20T09:50:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48dffff640 1 -- 172.21.15.82:0/362258564 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80acb30 con 0x7f48e8159830 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- 172.21.15.82:0/362258564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159830 msgr2=0x7f48e80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 --2- 172.21.15.82:0/362258564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159830 0x7f48e80cbea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f48e80c1da0 tx=0x7f48d801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- 172.21.15.82:0/362258564 shutdown_connections 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 --2- 172.21.15.82:0/362258564 >> v2:172.21.15.183:3300/0 conn(0x7f48e80cc3e0 0x7f48e80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 --2- 172.21.15.82:0/362258564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159830 0x7f48e80cbea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- 172.21.15.82:0/362258564 >> 172.21.15.82:0/362258564 conn(0x7f48e80cad50 msgr2=0x7f48e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- 172.21.15.82:0/362258564 shutdown_connections 2023-07-20T09:50:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- 172.21.15.82:0/362258564 wait complete. 2023-07-20T09:50:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 Processor -- start 2023-07-20T09:50:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.198+0000 7f48ef456640 1 -- start start 2023-07-20T09:50:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 0x7f48e80acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e80c7e80 0x7f48e815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c6910 con 0x7f48e8159450 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80c5620 con 0x7f48e80c7e80 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80ad100 con 0x7f48e80cc3e0 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44334/0 (socket says 172.21.15.82:44334) 2023-07-20T09:50:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 -- 172.21.15.82:0/956071343 learned_addr learned my addr 172.21.15.82:0/956071343 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ed1f2640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 0x7f48e80acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ed9f3640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e80c7e80 0x7f48e815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 -- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 msgr2=0x7f48e80acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 0x7f48e80acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 -- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e80c7e80 msgr2=0x7f48e815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e80c7e80 0x7f48e815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 -- 172.21.15.82:0/956071343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80094d0 con 0x7f48e8159450 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ed1f2640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 0x7f48e80acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ec9f1640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000c10 tx=0x7f48d8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b5820 con 0x7f48e8159450 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80b59a0 con 0x7f48e8159450 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80b5d50 con 0x7f48e8159450 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e80c5870 con 0x7f48e8159450 2023-07-20T09:50:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e80c5e30 con 0x7f48e8159450 2023-07-20T09:50:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e804da30 con 0x7f48e8159450 2023-07-20T09:50:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.202+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48d80b3040 con 0x7f48e8159450 2023-07-20T09:50:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.206+0000 7f48ddffb640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 0x7f48cc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.206+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f48d811ddb0 con 0x7f48e8159450 2023-07-20T09:50:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.206+0000 7f48ed1f2640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 0x7f48cc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.206+0000 7f48ed1f2640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 0x7f48cc068740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48e4001710 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.210+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48d80eb4e0 con 0x7f48e8159450 2023-07-20T09:50:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f48e80cbbf0 con 0x7f48e8159450 2023-07-20T09:50:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ddffb640 1 -- 172.21.15.82:0/956071343 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48d80b1020 con 0x7f48e8159450 2023-07-20T09:50:22.395 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:22.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 msgr2=0x7f48cc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 0x7f48cc068740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48e4001710 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 msgr2=0x7f48e814e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000c10 tx=0x7f48d8019270 comp rx=0 tx=0).stop 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 shutdown_connections 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f48cc066280 0x7f48cc068740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e80c7e80 0x7f48e815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8159450 0x7f48e814e5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 --2- 172.21.15.82:0/956071343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80cc3e0 0x7f48e80acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 >> 172.21.15.82:0/956071343 conn(0x7f48e80cad50 msgr2=0x7f48e80c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 shutdown_connections 2023-07-20T09:50:22.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.358+0000 7f48ef456640 1 -- 172.21.15.82:0/956071343 wait complete. 2023-07-20T09:50:22.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:50:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.518+0000 7f94004cb640 1 Processor -- start 2023-07-20T09:50:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.518+0000 7f94004cb640 1 -- start start 2023-07-20T09:50:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.518+0000 7f94004cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93f80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f94004cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f93f815a8e0 0x7f93f80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f94004cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f80b2ee0 con 0x7f93f80b2060 2023-07-20T09:50:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f94004cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f80b3160 con 0x7f93f815a8e0 2023-07-20T09:50:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f94004cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b12a0 con 0x7f93f80afda0 2023-07-20T09:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fea68640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f93f80b2060 0x7f93f80b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57306/0 (socket says 172.21.15.82:57306) 2023-07-20T09:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fea68640 1 -- 172.21.15.82:0/4013746479 learned_addr learned my addr 172.21.15.82:0/4013746479 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93f80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fda66640 1 --2- 172.21.15.82:0/4013746479 >> v2:172.21.15.183:3300/0 conn(0x7f93f815a8e0 0x7f93f80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122123121 0 0) 0x7f93f80b2ee0 con 0x7f93f80b2060 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e4003530 con 0x7f93f80b2060 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3619399821 0 0) 0x7f93e4003530 con 0x7f93f80b2060 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 msgr2=0x7f93f80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93f80ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 >> v2:172.21.15.183:3300/0 conn(0x7f93f815a8e0 msgr2=0x7f93f80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 --2- 172.21.15.82:0/4013746479 >> v2:172.21.15.183:3300/0 conn(0x7f93f815a8e0 0x7f93f80b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f80b1580 con 0x7f93f80b2060 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f93f0001a00 con 0x7f93f80b2060 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 >> v1:172.21.15.82:6789/0 conn(0x7f93f80b2060 legacy=0x7f93f80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e4003980 0x7f93e4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e40047d0 0x7f93e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b3160 con 0x7f93e4003980 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80b12a0 con 0x7f93e40047d0 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e400fe80 con 0x7f93f80afda0 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e4003980 0x7f93e4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fda66640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e40047d0 0x7f93e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fea68640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 -- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 msgr2=0x7f93e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f80afda0 0x7f93e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 -- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e40047d0 msgr2=0x7f93e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e40047d0 0x7f93e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.522+0000 7f93fe267640 1 -- 172.21.15.82:0/4013746479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4003530 con 0x7f93e4003980 2023-07-20T09:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f93fe267640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e4003980 0x7f93e4003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ab0 tx=0x7f93f401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe8a9c4c0235dd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40a64d0 con 0x7f93e4003980 2023-07-20T09:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f40a6630 con 0x7f93e4003980 2023-07-20T09:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f93fd265640 1 -- 172.21.15.82:0/4013746479 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f40a69e0 con 0x7f93e4003980 2023-07-20T09:50:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- 172.21.15.82:0/4013746479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e4003980 msgr2=0x7f93e4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 --2- 172.21.15.82:0/4013746479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e4003980 0x7f93e4003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009ab0 tx=0x7f93f401c9e0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f93fea68640 1 -- 172.21.15.82:0/4013746479 reap_dead start 2023-07-20T09:50:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- 172.21.15.82:0/4013746479 shutdown_connections 2023-07-20T09:50:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- 172.21.15.82:0/4013746479 >> 172.21.15.82:0/4013746479 conn(0x7f93f80cada0 msgr2=0x7f93f80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- 172.21.15.82:0/4013746479 shutdown_connections 2023-07-20T09:50:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- 172.21.15.82:0/4013746479 wait complete. 2023-07-20T09:50:22.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 Processor -- start 2023-07-20T09:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.526+0000 7f94004cb640 1 -- start start 2023-07-20T09:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e4003980 0x7f93f8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f815c910 0x7f93f80c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815b870 con 0x7f93f815b390 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815bb50 con 0x7f93e4003980 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f815be30 con 0x7f93f815c910 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44352/0 (socket says 172.21.15.82:44352) 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 -- 172.21.15.82:0/2592354648 learned_addr learned my addr 172.21.15.82:0/2592354648 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fe267640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e4003980 0x7f93f8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fea68640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f815c910 0x7f93f80c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 -- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f815c910 msgr2=0x7f93f80c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f815c910 0x7f93f80c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 -- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e4003980 msgr2=0x7f93f8157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e4003980 0x7f93f8157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 -- 172.21.15.82:0/2592354648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f815c110 con 0x7f93f815b390 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93fda66640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93e80119d0 tx=0x7f93e8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e800fb50 con 0x7f93f815b390 2023-07-20T09:50:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e800fcb0 con 0x7f93f815b390 2023-07-20T09:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8014440 con 0x7f93f815b390 2023-07-20T09:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f815c3f0 con 0x7f93f815b390 2023-07-20T09:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f8158f80 con 0x7f93f815b390 2023-07-20T09:50:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f815c580 con 0x7f93f815b390 2023-07-20T09:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.530+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93e80145a0 con 0x7f93f815b390 2023-07-20T09:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.534+0000 7f93eeffd640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 0x7f93dc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.534+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93e8083fe0 con 0x7f93f815b390 2023-07-20T09:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.534+0000 7f93fe267640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 0x7f93dc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.534+0000 7f93fe267640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 0x7f93dc068740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93f40af000 tx=0x7f93f40046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.538+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93e8051970 con 0x7f93f815b390 2023-07-20T09:50:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.714+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93f8073c70 con 0x7f93f815b390 2023-07-20T09:50:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.714+0000 7f93eeffd640 1 -- 172.21.15.82:0/2592354648 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f93e8054f90 con 0x7f93f815b390 2023-07-20T09:50:22.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:22.752 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-20T09:50:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2023-07-20T09:50:22.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 msgr2=0x7f93dc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 0x7f93dc068740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f93f40af000 tx=0x7f93f40046d0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 msgr2=0x7f93f8158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93e80119d0 tx=0x7f93e8011e90 comp rx=0 tx=0).stop 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 shutdown_connections 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f93dc066280 0x7f93dc068740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93f815c910 0x7f93f80c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93f815b390 0x7f93f8158870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 --2- 172.21.15.82:0/2592354648 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93e4003980 0x7f93f8157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 >> 172.21.15.82:0/2592354648 conn(0x7f93f80cada0 msgr2=0x7f93f8159770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 shutdown_connections 2023-07-20T09:50:22.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.718+0000 7f94004cb640 1 -- 172.21.15.82:0/2592354648 wait complete. 2023-07-20T09:50:22.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 Processor -- start 2023-07-20T09:50:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 -- start start 2023-07-20T09:50:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e440d0d10 0x7f1e440d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e440cd4b0 0x7f1e440cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440d16b0 con 0x7f1e4415cab0 2023-07-20T09:50:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440d31c0 con 0x7f1e440cd4b0 2023-07-20T09:50:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e48ffa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440b3520 con 0x7f1e440d0d10 2023-07-20T09:50:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e440cd4b0 0x7f1e440cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1e440cd4b0 0x7f1e440cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44356/0 (socket says 172.21.15.82:44356) 2023-07-20T09:50:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 -- 172.21.15.82:0/3553473431 learned_addr learned my addr 172.21.15.82:0/3553473431 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e3bfff640 1 --2- 172.21.15.82:0/3553473431 >> v2:172.21.15.183:3300/0 conn(0x7f1e440d0d10 0x7f1e440d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 -- 172.21.15.82:0/3553473431 >> v2:172.21.15.183:3300/0 conn(0x7f1e440d0d10 msgr2=0x7f1e440d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 --2- 172.21.15.82:0/3553473431 >> v2:172.21.15.183:3300/0 conn(0x7f1e440d0d10 0x7f1e440d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 -- 172.21.15.82:0/3553473431 >> v1:172.21.15.183:6789/0 conn(0x7f1e4415cab0 legacy=0x7f1e440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.874+0000 7f1e42d9d640 1 -- 172.21.15.82:0/3553473431 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440d0a10 con 0x7f1e440cd4b0 2023-07-20T09:50:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e42d9d640 1 --2- 172.21.15.82:0/3553473431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e440cd920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e440d0190 tx=0x7f1e3c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc6d4352e1241b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e41d9b640 1 -- 172.21.15.82:0/3553473431 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0a5820 con 0x7f1e440cd4b0 2023-07-20T09:50:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e41d9b640 1 -- 172.21.15.82:0/3553473431 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0a5980 con 0x7f1e440cd4b0 2023-07-20T09:50:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e41d9b640 1 -- 172.21.15.82:0/3553473431 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0a5d10 con 0x7f1e440cd4b0 2023-07-20T09:50:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3553473431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 msgr2=0x7f1e440cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3553473431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e440cd920 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1e440d0190 tx=0x7f1e3c01c960 comp rx=0 tx=0).stop 2023-07-20T09:50:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3553473431 shutdown_connections 2023-07-20T09:50:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3553473431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e440cd920 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3553473431 >> v2:172.21.15.183:3300/0 conn(0x7f1e440d0d10 0x7f1e440d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3553473431 >> 172.21.15.82:0/3553473431 conn(0x7f1e4408c120 msgr2=0x7f1e4409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3553473431 shutdown_connections 2023-07-20T09:50:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.878+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3553473431 wait complete. 2023-07-20T09:50:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 Processor -- start 2023-07-20T09:50:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- start start 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 0x7f1e4414eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 0x7f1e44155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4415bd60 con 0x7f1e440cd4b0 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440c83a0 con 0x7f1e4415cab0 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440c8c20 con 0x7f1e440d0d10 2023-07-20T09:50:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44370/0 (socket says 172.21.15.82:44370) 2023-07-20T09:50:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 -- 172.21.15.82:0/3120310753 learned_addr learned my addr 172.21.15.82:0/3120310753 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e3bfff640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 0x7f1e4414eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e42d9d640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 0x7f1e44155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 -- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 msgr2=0x7f1e4414eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 0x7f1e4414eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 -- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 msgr2=0x7f1e44155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 0x7f1e44155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 -- 172.21.15.82:0/3120310753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c009b30 con 0x7f1e440cd4b0 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e3bfff640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 0x7f1e4414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e42d9d640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 0x7f1e44155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e4259c640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b410 tx=0x7f1e3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34004020 con 0x7f1e440cd4b0 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34004180 con 0x7f1e440cd4b0 2023-07-20T09:50:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34011630 con 0x7f1e440cd4b0 2023-07-20T09:50:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e440c90b0 con 0x7f1e440cd4b0 2023-07-20T09:50:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4414f530 con 0x7f1e440cd4b0 2023-07-20T09:50:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.882+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44073c70 con 0x7f1e440cd4b0 2023-07-20T09:50:22.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.886+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e34011790 con 0x7f1e440cd4b0 2023-07-20T09:50:22.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.886+0000 7f1e3affd640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:22.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.886+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e34083790 con 0x7f1e440cd4b0 2023-07-20T09:50:22.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.886+0000 7f1e3bfff640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:22.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.886+0000 7f1e3bfff640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e4414c4d0 tx=0x7f1e2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:22.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:22.890+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e34050f60 con 0x7f1e440cd4b0 2023-07-20T09:50:23.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e440d1940 con 0x7f1e440cd4b0 2023-07-20T09:50:23.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e3affd640 1 -- 172.21.15.82:0/3120310753 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14612 (secure 0 0 0) 0x7f1e34054580 con 0x7f1e440cd4b0 2023-07-20T09:50:23.074 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:23.075 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":19,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:22.345304+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 msgr2=0x7f1e24068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e4414c4d0 tx=0x7f1e2c008040 comp rx=0 tx=0).stop 2023-07-20T09:50:23.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 msgr2=0x7f1e4415b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b410 tx=0x7f1e3400b8d0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 shutdown_connections 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4415cab0 0x7f1e44155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e440d0d10 0x7f1e4414eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 --2- 172.21.15.82:0/3120310753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e440cd4b0 0x7f1e4415b820 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 >> 172.21.15.82:0/3120310753 conn(0x7f1e4408c120 msgr2=0x7f1e4415bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 shutdown_connections 2023-07-20T09:50:23.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.038+0000 7f1e48ffa640 1 -- 172.21.15.82:0/3120310753 wait complete. 2023-07-20T09:50:23.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:23.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:23.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 Processor -- start 2023-07-20T09:50:23.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 -- start start 2023-07-20T09:50:23.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36680ae060 0x7f366806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 0x7f36680c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680ae440 con 0x7f3668070ce0 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366806ce50 con 0x7f36680ae060 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f36701f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366815cac0 con 0x7f36680c90c0 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36680ae060 0x7f366806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f36680ae060 0x7f366806bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44382/0 (socket says 172.21.15.82:44382) 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 -- 172.21.15.82:0/329490670 learned_addr learned my addr 172.21.15.82:0/329490670 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366e790640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 0x7f36680c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 -- 172.21.15.82:0/329490670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 msgr2=0x7f36680c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 0x7f36680c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 -- 172.21.15.82:0/329490670 >> v1:172.21.15.183:6789/0 conn(0x7f3668070ce0 legacy=0x7f3668160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366df8f640 1 -- 172.21.15.82:0/329490670 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366806c5b0 con 0x7f36680ae060 2023-07-20T09:50:23.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.202+0000 7f366e790640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 0x7f36680c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:23.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f366df8f640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36680ae060 0x7f366806bf20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3664009e50 tx=0x7f366401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d481baabd0096430 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f366cf8d640 1 -- 172.21.15.82:0/329490670 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5820 con 0x7f36680ae060 2023-07-20T09:50:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f366cf8d640 1 -- 172.21.15.82:0/329490670 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640a5980 con 0x7f36680ae060 2023-07-20T09:50:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f366cf8d640 1 -- 172.21.15.82:0/329490670 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640a5d10 con 0x7f36680ae060 2023-07-20T09:50:23.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 -- 172.21.15.82:0/329490670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36680ae060 msgr2=0x7f366806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36680ae060 0x7f366806bf20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3664009e50 tx=0x7f366401c9a0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 -- 172.21.15.82:0/329490670 shutdown_connections 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680c90c0 0x7f36680c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 --2- 172.21.15.82:0/329490670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36680ae060 0x7f366806bf20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 -- 172.21.15.82:0/329490670 >> 172.21.15.82:0/329490670 conn(0x7f36680cf070 msgr2=0x7f36680cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 -- 172.21.15.82:0/329490670 shutdown_connections 2023-07-20T09:50:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.206+0000 7f36701f3640 1 -- 172.21.15.82:0/329490670 wait complete. 2023-07-20T09:50:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 Processor -- start 2023-07-20T09:50:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- start start 2023-07-20T09:50:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680ae060 0x7f36680c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36680c90c0 0x7f36680ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680c7970 con 0x7f3668070ce0 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680c6a90 con 0x7f36680c90c0 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3668155c80 con 0x7f36680ae060 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44398/0 (socket says 172.21.15.82:44398) 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 -- 172.21.15.82:0/236227598 learned_addr learned my addr 172.21.15.82:0/236227598 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366d78e640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680ae060 0x7f36680c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366e790640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36680c90c0 0x7f36680ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 -- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680ae060 msgr2=0x7f36680c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680ae060 0x7f36680c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 -- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36680c90c0 msgr2=0x7f36680ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36680c90c0 0x7f36680ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 -- 172.21.15.82:0/236227598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3664009b30 con 0x7f3668070ce0 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f366df8f640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f366401b050 tx=0x7f3664019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640b8880 con 0x7f3668070ce0 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640b8a00 con 0x7f3668070ce0 2023-07-20T09:50:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640b8db0 con 0x7f3668070ce0 2023-07-20T09:50:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680c6cf0 con 0x7f3668070ce0 2023-07-20T09:50:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.210+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36680c72b0 con 0x7f3668070ce0 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3668071120 con 0x7f3668070ce0 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36640c3460 con 0x7f3668070ce0 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f365e7fc640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 0x7f364c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f366411f220 con 0x7f3668070ce0 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f366d78e640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 0x7f364c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.214+0000 7f366d78e640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 0x7f364c068740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36680af4a0 tx=0x7f3658009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.218+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3668071120 con 0x7f3668070ce0 2023-07-20T09:50:23.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.366+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3668071120 con 0x7f3668070ce0 2023-07-20T09:50:23.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.366+0000 7f365e7fc640 1 -- 172.21.15.82:0/236227598 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3668071120 con 0x7f3668070ce0 2023-07-20T09:50:23.405 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 msgr2=0x7f364c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 0x7f364c068740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36680af4a0 tx=0x7f3658009060 comp rx=0 tx=0).stop 2023-07-20T09:50:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 msgr2=0x7f366815ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f366401b050 tx=0x7f3664019740 comp rx=0 tx=0).stop 2023-07-20T09:50:23.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 shutdown_connections 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f364c066280 0x7f364c068740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36680c90c0 0x7f36680ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f36680ae060 0x7f36680c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 --2- 172.21.15.82:0/236227598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3668070ce0 0x7f366815ecd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 >> 172.21.15.82:0/236227598 conn(0x7f36680cf070 msgr2=0x7f36680af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 shutdown_connections 2023-07-20T09:50:23.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.370+0000 7f36701f3640 1 -- 172.21.15.82:0/236227598 wait complete. 2023-07-20T09:50:23.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:23.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 Processor -- start 2023-07-20T09:50:23.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 -- start start 2023-07-20T09:50:23.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc1c15c7e0 0x7efc1c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0c9190 con 0x7efc1c0b2230 2023-07-20T09:50:23.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0b26a0 con 0x7efc1c15c7e0 2023-07-20T09:50:23.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2426d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0cb8d0 con 0x7efc1c0caf00 2023-07-20T09:50:23.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc22009640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc1c15c7e0 0x7efc1c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:59462/0 (socket says 172.21.15.82:59462) 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 -- 172.21.15.82:0/4187140495 learned_addr learned my addr 172.21.15.82:0/4187140495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 -- 172.21.15.82:0/4187140495 >> v2:172.21.15.183:3300/0 conn(0x7efc1c15c7e0 msgr2=0x7efc1c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 --2- 172.21.15.82:0/4187140495 >> v2:172.21.15.183:3300/0 conn(0x7efc1c15c7e0 0x7efc1c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 -- 172.21.15.82:0/4187140495 >> v1:172.21.15.183:6789/0 conn(0x7efc1c0b2230 legacy=0x7efc1c160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.530+0000 7efc2280a640 1 -- 172.21.15.82:0/4187140495 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c15cbc0 con 0x7efc1c0caf00 2023-07-20T09:50:23.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2280a640 1 --2- 172.21.15.82:0/4187140495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc14009e50 tx=0x7efc1401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b35800a6dfc86a6d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc21007640 1 -- 172.21.15.82:0/4187140495 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140a58a0 con 0x7efc1c0caf00 2023-07-20T09:50:23.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc21007640 1 -- 172.21.15.82:0/4187140495 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc140a5a00 con 0x7efc1c0caf00 2023-07-20T09:50:23.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc21007640 1 -- 172.21.15.82:0/4187140495 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140a5d90 con 0x7efc1c0caf00 2023-07-20T09:50:23.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 -- 172.21.15.82:0/4187140495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 msgr2=0x7efc1c0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 --2- 172.21.15.82:0/4187140495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc14009e50 tx=0x7efc1401c9e0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 -- 172.21.15.82:0/4187140495 shutdown_connections 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 --2- 172.21.15.82:0/4187140495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c0caf00 0x7efc1c0cb390 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 --2- 172.21.15.82:0/4187140495 >> v2:172.21.15.183:3300/0 conn(0x7efc1c15c7e0 0x7efc1c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 -- 172.21.15.82:0/4187140495 >> 172.21.15.82:0/4187140495 conn(0x7efc1c065710 msgr2=0x7efc1c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 -- 172.21.15.82:0/4187140495 shutdown_connections 2023-07-20T09:50:23.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.534+0000 7efc2426d640 1 -- 172.21.15.82:0/4187140495 wait complete. 2023-07-20T09:50:23.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 Processor -- start 2023-07-20T09:50:23.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- start start 2023-07-20T09:50:23.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2230 0x7efc1c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c15c7e0 0x7efc1c0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0c8040 con 0x7efc1c0caf00 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15d860 con 0x7efc1c0b2230 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c154300 con 0x7efc1c15c7e0 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42974/0 (socket says 172.21.15.82:42974) 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 -- 172.21.15.82:0/2547482948 learned_addr learned my addr 172.21.15.82:0/2547482948 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc22009640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2230 0x7efc1c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2280a640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c15c7e0 0x7efc1c0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 -- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c15c7e0 msgr2=0x7efc1c0c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c15c7e0 0x7efc1c0c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 -- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2230 msgr2=0x7efc1c153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2230 0x7efc1c153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 -- 172.21.15.82:0/2547482948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009b30 con 0x7efc1c0caf00 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc21808640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c420 tx=0x7efc0c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0052d0 con 0x7efc1c0caf00 2023-07-20T09:50:23.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c005430 con 0x7efc1c0caf00 2023-07-20T09:50:23.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c15e7f0 con 0x7efc1c0caf00 2023-07-20T09:50:23.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c007260 con 0x7efc1c0caf00 2023-07-20T09:50:23.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.538+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c0c7d60 con 0x7efc1c0caf00 2023-07-20T09:50:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c04da30 con 0x7efc1c0caf00 2023-07-20T09:50:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc0c0073c0 con 0x7efc1c0caf00 2023-07-20T09:50:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc12ffd640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 0x7efc00068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efc0c082d40 con 0x7efc1c0caf00 2023-07-20T09:50:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc22009640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 0x7efc00068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.542+0000 7efc22009640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 0x7efc00068740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ac0 tx=0x7efc18009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.546+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc0c0505b0 con 0x7efc1c0caf00 2023-07-20T09:50:23.640 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:50:23.643 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:50:23.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.694+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc1c0c89f0 con 0x7efc1c0caf00 2023-07-20T09:50:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.694+0000 7efc12ffd640 1 -- 172.21.15.82:0/2547482948 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc0c053bd0 con 0x7efc1c0caf00 2023-07-20T09:50:23.732 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 msgr2=0x7efc00068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 0x7efc00068740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc18009ac0 tx=0x7efc18009190 comp rx=0 tx=0).stop 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 msgr2=0x7efc1c15e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00c420 tx=0x7efc0c00c8e0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 shutdown_connections 2023-07-20T09:50:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efc00066280 0x7efc00068740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c15c7e0 0x7efc1c0c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0caf00 0x7efc1c15e2b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 --2- 172.21.15.82:0/2547482948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2230 0x7efc1c153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 >> 172.21.15.82:0/2547482948 conn(0x7efc1c065710 msgr2=0x7efc1c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 shutdown_connections 2023-07-20T09:50:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.698+0000 7efc2426d640 1 -- 172.21.15.82:0/2547482948 wait complete. 2023-07-20T09:50:23.752 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T09:50:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 Processor -- start 2023-07-20T09:50:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 -- start start 2023-07-20T09:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f565415cab0 0x7f56540d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f56540d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56540d16b0 con 0x7f56540cf110 2023-07-20T09:50:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56540d31c0 con 0x7f565415cab0 2023-07-20T09:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5658d33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540b3520 con 0x7f56540d0d10 2023-07-20T09:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f565415cab0 0x7f56540d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f565415cab0 0x7f56540d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42986/0 (socket says 172.21.15.82:42986) 2023-07-20T09:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 -- 172.21.15.82:0/1956075435 learned_addr learned my addr 172.21.15.82:0/1956075435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f5649d9b640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f56540d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 -- 172.21.15.82:0/1956075435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 msgr2=0x7f56540d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f56540d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 -- 172.21.15.82:0/1956075435 >> v1:172.21.15.183:6789/0 conn(0x7f56540cf110 legacy=0x7f56540cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.854+0000 7f565259c640 1 -- 172.21.15.82:0/1956075435 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540b2910 con 0x7f565415cab0 2023-07-20T09:50:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f565259c640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540d0300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5644009870 tx=0x7f564401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cab761bc73a694 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5651d9b640 1 -- 172.21.15.82:0/1956075435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440aa670 con 0x7f565415cab0 2023-07-20T09:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5651d9b640 1 -- 172.21.15.82:0/1956075435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56440aa7d0 con 0x7f565415cab0 2023-07-20T09:50:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5651d9b640 1 -- 172.21.15.82:0/1956075435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56440aab60 con 0x7f565415cab0 2023-07-20T09:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 -- 172.21.15.82:0/1956075435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 msgr2=0x7f56540d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540d0300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5644009870 tx=0x7f564401c510 comp rx=0 tx=0).stop 2023-07-20T09:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 -- 172.21.15.82:0/1956075435 shutdown_connections 2023-07-20T09:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f56540d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 --2- 172.21.15.82:0/1956075435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540d0300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 -- 172.21.15.82:0/1956075435 >> 172.21.15.82:0/1956075435 conn(0x7f565408c120 msgr2=0x7f565409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 -- 172.21.15.82:0/1956075435 shutdown_connections 2023-07-20T09:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.858+0000 7f5658d33640 1 -- 172.21.15.82:0/1956075435 wait complete. 2023-07-20T09:50:23.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 Processor -- start 2023-07-20T09:50:23.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 -- start start 2023-07-20T09:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56540cf110 0x7f56540cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f5654157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56540cc660 con 0x7f565415cab0 2023-07-20T09:50:23.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56540c6c70 con 0x7f56540cf110 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540c8e90 con 0x7f56540d0d10 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43002/0 (socket says 172.21.15.82:43002) 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 -- 172.21.15.82:0/3699019680 learned_addr learned my addr 172.21.15.82:0/3699019680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f565259c640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56540cf110 0x7f56540cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5649d9b640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f5654157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 -- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 msgr2=0x7f5654157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f5654157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 -- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56540cf110 msgr2=0x7f56540cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56540cf110 0x7f56540cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 -- 172.21.15.82:0/3699019680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094d0 con 0x7f565415cab0 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5652d9d640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c460 tx=0x7f564c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c005220 con 0x7f565415cab0 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c005380 con 0x7f565415cab0 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.862+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56540c6ec0 con 0x7f565415cab0 2023-07-20T09:50:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c007270 con 0x7f565415cab0 2023-07-20T09:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56540c7480 con 0x7f565415cab0 2023-07-20T09:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5654073c70 con 0x7f565415cab0 2023-07-20T09:50:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f564c0073d0 con 0x7f565415cab0 2023-07-20T09:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f564b7fe640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 0x7f5634068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f564c0830b0 con 0x7f565415cab0 2023-07-20T09:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.866+0000 7f565259c640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 0x7f5634068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.870+0000 7f565259c640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 0x7f5634068740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56440ae000 tx=0x7f56440b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:23.870+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f564c050920 con 0x7f565415cab0 2023-07-20T09:50:24.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56540b2310 con 0x7f565415cab0 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f564b7fe640 1 -- 172.21.15.82:0/3699019680 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f564c053f40 con 0x7f565415cab0 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T09:50:24.059 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:50:24.060 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T09:50:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 msgr2=0x7f5634068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 0x7f5634068740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56440ae000 tx=0x7f56440b5040 comp rx=0 tx=0).stop 2023-07-20T09:50:24.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 msgr2=0x7f56540c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c460 tx=0x7f564c00c920 comp rx=0 tx=0).stop 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 shutdown_connections 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5634066280 0x7f5634068740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f565415cab0 0x7f56540c7fe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56540d0d10 0x7f5654157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 --2- 172.21.15.82:0/3699019680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56540cf110 0x7f56540cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 >> 172.21.15.82:0/3699019680 conn(0x7f565408c120 msgr2=0x7f56540af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:24.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 shutdown_connections 2023-07-20T09:50:24.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.022+0000 7f5658d33640 1 -- 172.21.15.82:0/3699019680 wait complete. 2023-07-20T09:50:24.079 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T09:50:24.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T09:50:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 Processor -- start 2023-07-20T09:50:24.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 -- start start 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f554c070450 0x7f554c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 0x7f554c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c159670 con 0x7f554c159290 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0ca220 con 0x7f554c070450 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55511e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c15d1f0 con 0x7f554c0c9da0 2023-07-20T09:50:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f554c070450 0x7f554c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f554c070450 0x7f554c0c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43018/0 (socket says 172.21.15.82:43018) 2023-07-20T09:50:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 -- 172.21.15.82:0/1477236136 learned_addr learned my addr 172.21.15.82:0/1477236136 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55509e5640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 0x7f554c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 -- 172.21.15.82:0/1477236136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 msgr2=0x7f554c06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 0x7f554c06ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 -- 172.21.15.82:0/1477236136 >> v1:172.21.15.183:6789/0 conn(0x7f554c159290 legacy=0x7f554c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f554b7fe640 1 -- 172.21.15.82:0/1477236136 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c15d4d0 con 0x7f554c070450 2023-07-20T09:50:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.186+0000 7f55509e5640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 0x7f554c06ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f554b7fe640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c070450 0x7f554c0c9860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f554000bb10 tx=0x7f554001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3ce85eaa843677 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f554affd640 1 -- 172.21.15.82:0/1477236136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400a7b10 con 0x7f554c070450 2023-07-20T09:50:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f554affd640 1 -- 172.21.15.82:0/1477236136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55400a7c70 con 0x7f554c070450 2023-07-20T09:50:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f554affd640 1 -- 172.21.15.82:0/1477236136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400af440 con 0x7f554c070450 2023-07-20T09:50:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- 172.21.15.82:0/1477236136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c070450 msgr2=0x7f554c0c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c070450 0x7f554c0c9860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f554000bb10 tx=0x7f554001ea80 comp rx=0 tx=0).stop 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- 172.21.15.82:0/1477236136 shutdown_connections 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c0c9da0 0x7f554c06ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 --2- 172.21.15.82:0/1477236136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c070450 0x7f554c0c9860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- 172.21.15.82:0/1477236136 >> 172.21.15.82:0/1477236136 conn(0x7f554c0ce080 msgr2=0x7f554c0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- 172.21.15.82:0/1477236136 shutdown_connections 2023-07-20T09:50:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- 172.21.15.82:0/1477236136 wait complete. 2023-07-20T09:50:24.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 Processor -- start 2023-07-20T09:50:24.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.190+0000 7f55511e6640 1 -- start start 2023-07-20T09:50:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c070450 0x7f554c0c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554c0c9da0 0x7f554c0c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c65b0 con 0x7f554c159290 2023-07-20T09:50:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c5690 con 0x7f554c0c9da0 2023-07-20T09:50:24.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0c5930 con 0x7f554c070450 2023-07-20T09:50:24.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43022/0 (socket says 172.21.15.82:43022) 2023-07-20T09:50:24.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 -- 172.21.15.82:0/2028024943 learned_addr learned my addr 172.21.15.82:0/2028024943 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:24.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f554bfff640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c070450 0x7f554c0c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f554b7fe640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554c0c9da0 0x7f554c0c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 -- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c070450 msgr2=0x7f554c0c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:24.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c070450 0x7f554c0c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 -- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554c0c9da0 msgr2=0x7f554c0c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554c0c9da0 0x7f554c0c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 -- 172.21.15.82:0/2028024943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554000b770 con 0x7f554c159290 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55509e5640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f554400cd50 tx=0x7f554400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400f680 con 0x7f554c159290 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400f800 con 0x7f554c159290 2023-07-20T09:50:24.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400fbb0 con 0x7f554c159290 2023-07-20T09:50:24.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c0c5c10 con 0x7f554c159290 2023-07-20T09:50:24.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c0c61d0 con 0x7f554c159290 2023-07-20T09:50:24.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.194+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c04da30 con 0x7f554c159290 2023-07-20T09:50:24.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.198+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f554400b040 con 0x7f554c159290 2023-07-20T09:50:24.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.198+0000 7f5548ff9640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 0x7f5538068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:24.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.198+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5544084400 con 0x7f554c159290 2023-07-20T09:50:24.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.198+0000 7f554bfff640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 0x7f5538068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:24.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.198+0000 7f554bfff640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 0x7f5538068740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f553c004e30 tx=0x7f553c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:24.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.202+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5544051bc0 con 0x7f554c159290 2023-07-20T09:50:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:24.350+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f554c0b4000 con 0x7f554c159290 2023-07-20T09:50:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.358+0000 7f5548ff9640 1 -- 172.21.15.82:0/2028024943 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f55440551e0 con 0x7f554c159290 2023-07-20T09:50:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T09:50:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 msgr2=0x7f5538068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 0x7f5538068740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f553c004e30 tx=0x7f553c009040 comp rx=0 tx=0).stop 2023-07-20T09:50:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 msgr2=0x7f554c1f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f554400cd50 tx=0x7f554400a650 comp rx=0 tx=0).stop 2023-07-20T09:50:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 shutdown_connections 2023-07-20T09:50:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5538066280 0x7f5538068740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f554c159290 0x7f554c1f77b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554c0c9da0 0x7f554c0c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 --2- 172.21.15.82:0/2028024943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554c070450 0x7f554c0c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.362+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 >> 172.21.15.82:0/2028024943 conn(0x7f554c0ce080 msgr2=0x7f554c162210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.366+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 shutdown_connections 2023-07-20T09:50:25.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.366+0000 7f55511e6640 1 -- 172.21.15.82:0/2028024943 wait complete. 2023-07-20T09:50:25.428 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T09:50:25.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 Processor -- start 2023-07-20T09:50:25.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 -- start start 2023-07-20T09:50:25.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e8415a4f0 0x7f7e8406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8406ce00 con 0x7f7e841603e0 2023-07-20T09:50:25.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e84070f30 con 0x7f7e84069750 2023-07-20T09:50:25.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e8b06d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8415a8d0 con 0x7f7e8415a4f0 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7e841603e0 0x7f7e84070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60836/0 (socket says 172.21.15.82:60836) 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7bfff640 1 -- 172.21.15.82:0/2135375479 learned_addr learned my addr 172.21.15.82:0/2135375479 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e88e09640 1 --2- 172.21.15.82:0/2135375479 >> v2:172.21.15.183:3300/0 conn(0x7f7e8415a4f0 0x7f7e8406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589239277 0 0) 0x7f7e8406ce00 con 0x7f7e841603e0 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e6c003530 con 0x7f7e841603e0 2023-07-20T09:50:25.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086308527 0 0) 0x7f7e84070f30 con 0x7f7e84069750 2023-07-20T09:50:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e8406ce00 con 0x7f7e84069750 2023-07-20T09:50:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2139668671 0 0) 0x7f7e6c003530 con 0x7f7e841603e0 2023-07-20T09:50:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 >> v2:172.21.15.183:3300/0 conn(0x7f7e8415a4f0 msgr2=0x7f7e8406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:25.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 --2- 172.21.15.82:0/2135375479 >> v2:172.21.15.183:3300/0 conn(0x7f7e8415a4f0 0x7f7e8406c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 >> v1:172.21.15.183:6789/0 conn(0x7f7e84069750 legacy=0x7f7e8415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e841609a0 con 0x7f7e841603e0 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7e74001680 con 0x7f7e841603e0 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 >> v1:172.21.15.82:6789/0 conn(0x7f7e841603e0 legacy=0x7f7e84070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 0x7f7e6c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c0047d0 0x7f7e6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e6c005190 0x7f7e6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8415a8d0 con 0x7f7e6c0047d0 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c00c090 con 0x7f7e6c003b80 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c00c250 con 0x7f7e6c005190 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e7bfff640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c0047d0 0x7f7e6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.542+0000 7f7e88e09640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 0x7f7e6c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e8960a640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e6c005190 0x7f7e6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 -- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e6c005190 msgr2=0x7f7e6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e6c005190 0x7f7e6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 -- 172.21.15.82:0/2135375479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c0047d0 msgr2=0x7f7e6c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c0047d0 0x7f7e6c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 -- 172.21.15.82:0/2135375479 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c003530 con 0x7f7e6c003b80 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e8960a640 1 -- 172.21.15.82:0/2135375479 reap_dead start 2023-07-20T09:50:25.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e88e09640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 0x7f7e6c003f80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ae0 tx=0x7f7e8001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da4021d267dbeeb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800a5640 con 0x7f7e6c003b80 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800a57a0 con 0x7f7e6c003b80 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.546+0000 7f7e7b7fe640 1 -- 172.21.15.82:0/2135375479 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800a5b50 con 0x7f7e6c003b80 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 msgr2=0x7f7e6c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 0x7f7e6c003f80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ae0 tx=0x7f7e8001ca50 comp rx=0 tx=0).stop 2023-07-20T09:50:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- 172.21.15.82:0/2135375479 shutdown_connections 2023-07-20T09:50:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/2135375479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e6c003b80 0x7f7e6c003f80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- 172.21.15.82:0/2135375479 >> 172.21.15.82:0/2135375479 conn(0x7f7e840cbe80 msgr2=0x7f7e840cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- 172.21.15.82:0/2135375479 shutdown_connections 2023-07-20T09:50:25.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- 172.21.15.82:0/2135375479 wait complete. 2023-07-20T09:50:25.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 Processor -- start 2023-07-20T09:50:25.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- start start 2023-07-20T09:50:25.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84070c60 0x7f7e840aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e840acf40 0x7f7e840c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840710c0 con 0x7f7e6c003b80 2023-07-20T09:50:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840c92d0 con 0x7f7e84070c60 2023-07-20T09:50:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8b06d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e840ad3c0 con 0x7f7e840acf40 2023-07-20T09:50:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e88e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e88e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43040/0 (socket says 172.21.15.82:43040) 2023-07-20T09:50:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e88e09640 1 -- 172.21.15.82:0/608889955 learned_addr learned my addr 172.21.15.82:0/608889955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e7bfff640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84070c60 0x7f7e840aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.550+0000 7f7e8960a640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e840acf40 0x7f7e840c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 -- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e840acf40 msgr2=0x7f7e840c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e840acf40 0x7f7e840c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 -- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84070c60 msgr2=0x7f7e840aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84070c60 0x7f7e840aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 -- 172.21.15.82:0/608889955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e840c8470 con 0x7f7e6c003b80 2023-07-20T09:50:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e88e09640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e8001c880 tx=0x7f7e800197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80004020 con 0x7f7e6c003b80 2023-07-20T09:50:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800041c0 con 0x7f7e6c003b80 2023-07-20T09:50:25.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e840c8750 con 0x7f7e6c003b80 2023-07-20T09:50:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800b8660 con 0x7f7e6c003b80 2023-07-20T09:50:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e840c8d10 con 0x7f7e6c003b80 2023-07-20T09:50:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8404da30 con 0x7f7e6c003b80 2023-07-20T09:50:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.554+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e800b4070 con 0x7f7e6c003b80 2023-07-20T09:50:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.558+0000 7f7e797fa640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 0x7f7e70068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.558+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7e8011eef0 con 0x7f7e6c003b80 2023-07-20T09:50:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.558+0000 7f7e7bfff640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 0x7f7e70068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.558+0000 7f7e7bfff640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 0x7f7e70068740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c10 tx=0x7f7e74009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.558+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e800ec6e0 con 0x7f7e6c003b80 2023-07-20T09:50:25.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:25.706+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7e840b5380 con 0x7f7e6c003b80 2023-07-20T09:50:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.362+0000 7f7e797fa640 1 -- 172.21.15.82:0/608889955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7e800efd00 con 0x7f7e6c003b80 2023-07-20T09:50:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T09:50:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.370+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 msgr2=0x7f7e70068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.370+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 0x7f7e70068740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c10 tx=0x7f7e74009040 comp rx=0 tx=0).stop 2023-07-20T09:50:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.370+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 msgr2=0x7f7e84070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e8001c880 tx=0x7f7e800197f0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 shutdown_connections 2023-07-20T09:50:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7e70066280 0x7f7e70068740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e840acf40 0x7f7e840c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e84070c60 0x7f7e840aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 --2- 172.21.15.82:0/608889955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e6c003b80 0x7f7e84070720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.374+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 >> 172.21.15.82:0/608889955 conn(0x7f7e840cbe80 msgr2=0x7f7e8406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:26.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.378+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 shutdown_connections 2023-07-20T09:50:26.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.378+0000 7f7e8b06d640 1 -- 172.21.15.82:0/608889955 wait complete. 2023-07-20T09:50:26.443 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T09:50:26.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 Processor -- start 2023-07-20T09:50:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 -- start start 2023-07-20T09:50:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f09480cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480cdb40 con 0x7f094815c6e0 2023-07-20T09:50:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09480d07a0 con 0x7f09480d3200 2023-07-20T09:50:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f094d2bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09480cd4f0 con 0x7f09480d12f0 2023-07-20T09:50:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f0946ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f094815c6e0 0x7f09480cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60840/0 (socket says 172.21.15.82:60840) 2023-07-20T09:50:26.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f0946ffd640 1 -- 172.21.15.82:0/91365843 learned_addr learned my addr 172.21.15.82:0/91365843 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478951052 0 0) 0x7f09480cdb40 con 0x7f094815c6e0 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0934003530 con 0x7f094815c6e0 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09477fe640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f09480cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1196617838 0 0) 0x7f0934003530 con 0x7f094815c6e0 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 msgr2=0x7f09480cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f09480cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 >> v1:172.21.15.183:6789/0 conn(0x7f09480d3200 legacy=0x7f09480d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480cd7d0 con 0x7f094815c6e0 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f0938001a00 con 0x7f094815c6e0 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 >> v1:172.21.15.82:6789/0 conn(0x7f094815c6e0 legacy=0x7f09480cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f0934003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0934004050 0x7f09340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0934004e30 0x7f093400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480cd4f0 con 0x7f0934004050 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934005650 con 0x7f0934004e30 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093400bed0 con 0x7f09480d12f0 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0934004050 0x7f09340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f09477fe640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0934004e30 0x7f093400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f0946ffd640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f0934003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 -- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 msgr2=0x7f0934003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f09480d12f0 0x7f0934003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 -- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0934004e30 msgr2=0x7f093400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0934004e30 0x7f093400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.550+0000 7f093e7fc640 1 -- 172.21.15.82:0/91365843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934003530 con 0x7f0934004050 2023-07-20T09:50:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f093e7fc640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0934004050 0x7f09340047d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09300017b0 tx=0x7f093001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2053d6dc3f30de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300a4ea0 con 0x7f0934004050 2023-07-20T09:50:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09300a7050 con 0x7f0934004050 2023-07-20T09:50:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f09467fc640 1 -- 172.21.15.82:0/91365843 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930003600 con 0x7f0934004050 2023-07-20T09:50:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 -- 172.21.15.82:0/91365843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0934004050 msgr2=0x7f09340047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 --2- 172.21.15.82:0/91365843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0934004050 0x7f09340047d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09300017b0 tx=0x7f093001c3e0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f09477fe640 1 -- 172.21.15.82:0/91365843 reap_dead start 2023-07-20T09:50:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 -- 172.21.15.82:0/91365843 shutdown_connections 2023-07-20T09:50:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 -- 172.21.15.82:0/91365843 >> 172.21.15.82:0/91365843 conn(0x7f09480d2600 msgr2=0x7f09480d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 -- 172.21.15.82:0/91365843 shutdown_connections 2023-07-20T09:50:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.554+0000 7f094d2bd640 1 -- 172.21.15.82:0/91365843 wait complete. 2023-07-20T09:50:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 Processor -- start 2023-07-20T09:50:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- start start 2023-07-20T09:50:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0934004050 0x7f094815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09480cb7c0 0x7f09480cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09480cb3a0 con 0x7f09481f58f0 2023-07-20T09:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094809fd30 con 0x7f09480cb7c0 2023-07-20T09:50:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094815ac00 con 0x7f0934004050 2023-07-20T09:50:26.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43060/0 (socket says 172.21.15.82:43060) 2023-07-20T09:50:26.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 -- 172.21.15.82:0/3563021790 learned_addr learned my addr 172.21.15.82:0/3563021790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:26.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f0946ffd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0934004050 0x7f094815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f09477fe640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09480cb7c0 0x7f09480cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 -- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0934004050 msgr2=0x7f094815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0934004050 0x7f094815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 -- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09480cb7c0 msgr2=0x7f09480cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09480cb7c0 0x7f09480cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 -- 172.21.15.82:0/3563021790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480ca720 con 0x7f09481f58f0 2023-07-20T09:50:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093e7fc640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09300017b0 tx=0x7f0934005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300ba070 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0930007040 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300071d0 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09480caa00 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.558+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09480cafc0 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094804da30 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0930007330 con 0x7f09481f58f0 2023-07-20T09:50:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f093ffff640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 0x7f0928068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f093011d0d0 con 0x7f09481f58f0 2023-07-20T09:50:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f0946ffd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 0x7f0928068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.562+0000 7f0946ffd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 0x7f0928068740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0938001590 tx=0x7f09380013c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.566+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09300ea670 con 0x7f09481f58f0 2023-07-20T09:50:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:26.746+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f09480b8580 con 0x7f09481f58f0 2023-07-20T09:50:27.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.694+0000 7f093ffff640 1 -- 172.21.15.82:0/3563021790 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f09300edc90 con 0x7f09481f58f0 2023-07-20T09:50:27.732 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 3 and data pool 4 2023-07-20T09:50:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 msgr2=0x7f0928068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 0x7f0928068740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0938001590 tx=0x7f09380013c0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 msgr2=0x7f09481f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09300017b0 tx=0x7f0934005800 comp rx=0 tx=0).stop 2023-07-20T09:50:27.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 shutdown_connections 2023-07-20T09:50:27.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0928066280 0x7f0928068740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f09480cb7c0 0x7f09480cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09481f58f0 0x7f09481f5d50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 --2- 172.21.15.82:0/3563021790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0934004050 0x7f094815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 >> 172.21.15.82:0/3563021790 conn(0x7f09480d2600 msgr2=0x7f09480b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:27.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 shutdown_connections 2023-07-20T09:50:27.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.706+0000 7f094d2bd640 1 -- 172.21.15.82:0/3563021790 wait complete. 2023-07-20T09:50:27.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:27.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.870+0000 7f46cbe19640 1 Processor -- start 2023-07-20T09:50:27.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.870+0000 7f46cbe19640 1 -- start start 2023-07-20T09:50:27.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46cbe19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c41596b0 0x7f46c415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46cbe19640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c40cc900 0x7f46c40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46cbe19640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40ccd60 con 0x7f46c40b2380 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46cbe19640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c40ad600 con 0x7f46c40cc900 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46cbe19640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40ad810 con 0x7f46c41596b0 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c40cc900 0x7f46c40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46ca3b6640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46c40b2380 0x7f46c40c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60846/0 (socket says 172.21.15.82:60846) 2023-07-20T09:50:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46ca3b6640 1 -- 172.21.15.82:0/152981543 learned_addr learned my addr 172.21.15.82:0/152981543 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:27.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c9bb5640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c41596b0 0x7f46c415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c8bb3640 1 -- 172.21.15.82:0/152981543 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258324902 0 0) 0x7f46c40ccd60 con 0x7f46c40b2380 2023-07-20T09:50:27.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c8bb3640 1 -- 172.21.15.82:0/152981543 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b0003530 con 0x7f46c40b2380 2023-07-20T09:50:27.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 -- 172.21.15.82:0/152981543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c41596b0 msgr2=0x7f46c415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:27.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c41596b0 0x7f46c415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 -- 172.21.15.82:0/152981543 >> v1:172.21.15.82:6789/0 conn(0x7f46c40b2380 legacy=0x7f46c40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 -- 172.21.15.82:0/152981543 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c415d0d0 con 0x7f46c40cc900 2023-07-20T09:50:27.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.874+0000 7f46c93b4640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c40ad0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46b40097c0 tx=0x7f46b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7331b817bd953d58 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:27.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c8bb3640 1 -- 172.21.15.82:0/152981543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40ab650 con 0x7f46c40cc900 2023-07-20T09:50:27.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c8bb3640 1 -- 172.21.15.82:0/152981543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40ab7b0 con 0x7f46c40cc900 2023-07-20T09:50:27.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c8bb3640 1 -- 172.21.15.82:0/152981543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40abb20 con 0x7f46c40cc900 2023-07-20T09:50:27.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- 172.21.15.82:0/152981543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 msgr2=0x7f46c40ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c40ad0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46b40097c0 tx=0x7f46b401c450 comp rx=0 tx=0).stop 2023-07-20T09:50:27.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- 172.21.15.82:0/152981543 shutdown_connections 2023-07-20T09:50:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c40ad0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- 172.21.15.82:0/152981543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c41596b0 0x7f46c415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- 172.21.15.82:0/152981543 >> 172.21.15.82:0/152981543 conn(0x7f46c40cada0 msgr2=0x7f46c40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- 172.21.15.82:0/152981543 shutdown_connections 2023-07-20T09:50:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- 172.21.15.82:0/152981543 wait complete. 2023-07-20T09:50:27.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 Processor -- start 2023-07-20T09:50:27.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- start start 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 0x7f46c414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 0x7f46c4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40c7fd0 con 0x7f46c40cc900 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c415c9a0 con 0x7f46c41596b0 2023-07-20T09:50:27.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46cbe19640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c414d4b0 con 0x7f46c40b2380 2023-07-20T09:50:27.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c93b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c93b4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43066/0 (socket says 172.21.15.82:43066) 2023-07-20T09:50:27.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.878+0000 7f46c93b4640 1 -- 172.21.15.82:0/1143223899 learned_addr learned my addr 172.21.15.82:0/1143223899 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 -- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 msgr2=0x7f46c414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c9bb5640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 0x7f46c414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ca3b6640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 0x7f46c4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 0x7f46c414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 -- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 msgr2=0x7f46c4070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 0x7f46c4070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 -- 172.21.15.82:0/1143223899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009420 con 0x7f46c40cc900 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c9bb5640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 0x7f46c414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ca3b6640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 0x7f46c4070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c93b4640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ad040 tx=0x7f46b40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4004450 con 0x7f46c40cc900 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40ab920 con 0x7f46c40cc900 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40b2d20 con 0x7f46c40cc900 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40abcb0 con 0x7f46c40cc900 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c40c76a0 con 0x7f46c40cc900 2023-07-20T09:50:27.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c40c8140 con 0x7f46c40cc900 2023-07-20T09:50:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46b4003620 con 0x7f46c40cc900 2023-07-20T09:50:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 0x7f46a8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46b411dfd0 con 0x7f46c40cc900 2023-07-20T09:50:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.882+0000 7f46c9bb5640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 0x7f46a8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.886+0000 7f46c9bb5640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 0x7f46a8068740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009ae0 tx=0x7f46c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:27.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:27.886+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46b40eb440 con 0x7f46c40cc900 2023-07-20T09:50:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46c4073c70 con 0x7f46c40cc900 2023-07-20T09:50:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46ba7fc640 1 -- 172.21.15.82:0/1143223899 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7f46b40eea60 con 0x7f46c40cc900 2023-07-20T09:50:28.075 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:28.075 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:26.749149+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 msgr2=0x7f46a8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 0x7f46a8068740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009ae0 tx=0x7f46c0008040 comp rx=0 tx=0).stop 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 msgr2=0x7f46c4070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ad040 tx=0x7f46b40191f0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 shutdown_connections 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f46a8066280 0x7f46a8068740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c41596b0 0x7f46c4070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c40cc900 0x7f46c4070a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 --2- 172.21.15.82:0/1143223899 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c40b2380 0x7f46c414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 >> 172.21.15.82:0/1143223899 conn(0x7f46c40cada0 msgr2=0x7f46c40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 shutdown_connections 2023-07-20T09:50:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.038+0000 7f46cbe19640 1 -- 172.21.15.82:0/1143223899 wait complete. 2023-07-20T09:50:28.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 Processor -- start 2023-07-20T09:50:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 -- start start 2023-07-20T09:50:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc09c06f350 0x7fc09c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc09c0b2640 0x7fc09c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09c0cf4a0 con 0x7fc09c06b970 2023-07-20T09:50:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c06ea80 con 0x7fc09c06f350 2023-07-20T09:50:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.198+0000 7fc0a11ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09c0ce890 con 0x7fc09c0b2640 2023-07-20T09:50:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc09c06b970 0x7fc09c0b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60854/0 (socket says 172.21.15.82:60854) 2023-07-20T09:50:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09259c640 1 -- 172.21.15.82:0/3932432184 learned_addr learned my addr 172.21.15.82:0/3932432184 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 --2- 172.21.15.82:0/3932432184 >> v2:172.21.15.82:3300/0 conn(0x7fc09c06f350 0x7fc09c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09b59e640 1 --2- 172.21.15.82:0/3932432184 >> v2:172.21.15.183:3300/0 conn(0x7fc09c0b2640 0x7fc09c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09a59c640 1 -- 172.21.15.82:0/3932432184 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026358758 0 0) 0x7fc09c0cf4a0 con 0x7fc09c06b970 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09a59c640 1 -- 172.21.15.82:0/3932432184 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc088003530 con 0x7fc09c06b970 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 -- 172.21.15.82:0/3932432184 >> v2:172.21.15.183:3300/0 conn(0x7fc09c0b2640 msgr2=0x7fc09c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 --2- 172.21.15.82:0/3932432184 >> v2:172.21.15.183:3300/0 conn(0x7fc09c0b2640 0x7fc09c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 -- 172.21.15.82:0/3932432184 >> v1:172.21.15.82:6789/0 conn(0x7fc09c06b970 legacy=0x7fc09c0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 -- 172.21.15.82:0/3932432184 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0ceb70 con 0x7fc09c06f350 2023-07-20T09:50:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09ad9d640 1 --2- 172.21.15.82:0/3932432184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06f350 0x7fc09c06b430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0afea0 tx=0x7fc08c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d5fba817a471f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09a59c640 1 -- 172.21.15.82:0/3932432184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0a5820 con 0x7fc09c06f350 2023-07-20T09:50:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09a59c640 1 -- 172.21.15.82:0/3932432184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c0a5980 con 0x7fc09c06f350 2023-07-20T09:50:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.202+0000 7fc09a59c640 1 -- 172.21.15.82:0/3932432184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0a5cf0 con 0x7fc09c06f350 2023-07-20T09:50:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- 172.21.15.82:0/3932432184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06f350 msgr2=0x7fc09c06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/3932432184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06f350 0x7fc09c06b430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0afea0 tx=0x7fc08c01c850 comp rx=0 tx=0).stop 2023-07-20T09:50:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- 172.21.15.82:0/3932432184 shutdown_connections 2023-07-20T09:50:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/3932432184 >> v2:172.21.15.183:3300/0 conn(0x7fc09c0b2640 0x7fc09c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/3932432184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c06f350 0x7fc09c06b430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- 172.21.15.82:0/3932432184 >> 172.21.15.82:0/3932432184 conn(0x7fc09c089fa0 msgr2=0x7fc09c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- 172.21.15.82:0/3932432184 shutdown_connections 2023-07-20T09:50:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- 172.21.15.82:0/3932432184 wait complete. 2023-07-20T09:50:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 Processor -- start 2023-07-20T09:50:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- start start 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc09c06b970 0x7fc09c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc09c06f350 0x7fc09c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c15b670 con 0x7fc09c0b2640 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0b4850 con 0x7fc09c06f350 2023-07-20T09:50:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc0a11ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09c0b4b30 con 0x7fc09c06b970 2023-07-20T09:50:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc09b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc09b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43086/0 (socket says 172.21.15.82:43086) 2023-07-20T09:50:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc09ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc09c06b970 0x7fc09c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc09b59e640 1 -- 172.21.15.82:0/2961416246 learned_addr learned my addr 172.21.15.82:0/2961416246 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.206+0000 7fc09259c640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc09c06f350 0x7fc09c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 -- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc09c06b970 msgr2=0x7fc09c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc09c06b970 0x7fc09c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 -- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc09c06f350 msgr2=0x7fc09c0b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc09c06f350 0x7fc09c0b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 -- 172.21.15.82:0/2961416246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009a70 con 0x7fc09c0b2640 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09b59e640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e7f0 tx=0x7fc09400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094009530 con 0x7fc09c0b2640 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400eea0 con 0x7fc09c0b2640 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400cb60 con 0x7fc09c0b2640 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c0cfab0 con 0x7fc09c0b2640 2023-07-20T09:50:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09c0b50f0 con 0x7fc09c0b2640 2023-07-20T09:50:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09c0b5310 con 0x7fc09c0b2640 2023-07-20T09:50:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc09400ccc0 con 0x7fc09c0b2640 2023-07-20T09:50:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 0x7fc07c068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc094083dd0 con 0x7fc09c0b2640 2023-07-20T09:50:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.210+0000 7fc09ad9d640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 0x7fc07c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.214+0000 7fc09ad9d640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 0x7fc07c068770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0af000 tx=0x7fc08c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.214+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc094051260 con 0x7fc09c0b2640 2023-07-20T09:50:28.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc09c073c70 con 0x7fc09c0b2640 2023-07-20T09:50:28.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc093fff640 1 -- 172.21.15.82:0/2961416246 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18268 (secure 0 0 0) 0x7fc094017090 con 0x7fc09c0b2640 2023-07-20T09:50:28.403 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:28.403 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:26.749149+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 msgr2=0x7fc07c068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 0x7fc07c068770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0af000 tx=0x7fc08c0a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 msgr2=0x7fc09c0b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e7f0 tx=0x7fc09400ecb0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 shutdown_connections 2023-07-20T09:50:28.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc07c0662b0 0x7fc07c068770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc09c0b2640 0x7fc09c0b13a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc09c06f350 0x7fc09c0b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 --2- 172.21.15.82:0/2961416246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc09c06b970 0x7fc09c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 >> 172.21.15.82:0/2961416246 conn(0x7fc09c089fa0 msgr2=0x7fc09c15be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 shutdown_connections 2023-07-20T09:50:28.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.366+0000 7fc0a11ba640 1 -- 172.21.15.82:0/2961416246 wait complete. 2023-07-20T09:50:28.424 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T09:50:28.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.526+0000 7f8462da3640 1 Processor -- start 2023-07-20T09:50:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 -- start start 2023-07-20T09:50:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f845c1602b0 0x7f845c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0d0970 con 0x7f845c06ab10 2023-07-20T09:50:28.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c160e20 con 0x7f845c1602b0 2023-07-20T09:50:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8462da3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cd300 con 0x7f845c06c120 2023-07-20T09:50:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8461340640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f845c06ab10 0x7f845c06af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60858/0 (socket says 172.21.15.82:60858) 2023-07-20T09:50:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8461340640 1 -- 172.21.15.82:0/3147374596 learned_addr learned my addr 172.21.15.82:0/3147374596 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8453fff640 1 --2- 172.21.15.82:0/3147374596 >> v2:172.21.15.82:3300/0 conn(0x7f845c1602b0 0x7f845c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8460b3f640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8453fff640 1 -- 172.21.15.82:0/3147374596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 msgr2=0x7f845c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8453fff640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8453fff640 1 -- 172.21.15.82:0/3147374596 >> v1:172.21.15.82:6789/0 conn(0x7f845c06ab10 legacy=0x7f845c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f8453fff640 1 -- 172.21.15.82:0/3147374596 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0cd5e0 con 0x7f845c1602b0 2023-07-20T09:50:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.530+0000 7f84537fe640 1 -- 172.21.15.82:0/3147374596 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956215799 0 0) 0x7f845c0d0970 con 0x7f845c06ab10 2023-07-20T09:50:28.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8453fff640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c160710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f844c0097c0 tx=0x7f844c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0b73944b783d26 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f84537fe640 1 -- 172.21.15.82:0/3147374596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ab600 con 0x7f845c1602b0 2023-07-20T09:50:28.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f84537fe640 1 -- 172.21.15.82:0/3147374596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0a7050 con 0x7f845c1602b0 2023-07-20T09:50:28.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f84537fe640 1 -- 172.21.15.82:0/3147374596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ab980 con 0x7f845c1602b0 2023-07-20T09:50:28.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- 172.21.15.82:0/3147374596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 msgr2=0x7f845c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c160710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f844c0097c0 tx=0x7f844c01c3f0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- 172.21.15.82:0/3147374596 shutdown_connections 2023-07-20T09:50:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c160710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 --2- 172.21.15.82:0/3147374596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- 172.21.15.82:0/3147374596 >> 172.21.15.82:0/3147374596 conn(0x7f845c08c0a0 msgr2=0x7f845c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:28.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- 172.21.15.82:0/3147374596 shutdown_connections 2023-07-20T09:50:28.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- 172.21.15.82:0/3147374596 wait complete. 2023-07-20T09:50:28.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 Processor -- start 2023-07-20T09:50:28.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.534+0000 7f8462da3640 1 -- start start 2023-07-20T09:50:28.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06ab10 0x7f845c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06c120 0x7f845c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c152420 con 0x7f845c1602b0 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cae20 con 0x7f845c06c120 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cb100 con 0x7f845c06ab10 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43104/0 (socket says 172.21.15.82:43104) 2023-07-20T09:50:28.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 -- 172.21.15.82:0/2507899902 learned_addr learned my addr 172.21.15.82:0/2507899902 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:28.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8453fff640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06c120 0x7f845c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8460b3f640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06ab10 0x7f845c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 -- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06ab10 msgr2=0x7f845c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06ab10 0x7f845c0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 -- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06c120 msgr2=0x7f845c0b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06c120 0x7f845c0b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 -- 172.21.15.82:0/2507899902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009420 con 0x7f845c1602b0 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8461340640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8454001570 tx=0x7f845400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400a640 con 0x7f845c1602b0 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845400a7c0 con 0x7f845c1602b0 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400ab70 con 0x7f845c1602b0 2023-07-20T09:50:28.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0cb3e0 con 0x7f845c1602b0 2023-07-20T09:50:28.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c0cb9a0 con 0x7f845c1602b0 2023-07-20T09:50:28.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.538+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c0cbb90 con 0x7f845c1602b0 2023-07-20T09:50:28.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.542+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f845400acd0 con 0x7f845c1602b0 2023-07-20T09:50:28.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.542+0000 7f84517fa640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 0x7f8448068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.542+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8454083260 con 0x7f845c1602b0 2023-07-20T09:50:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.542+0000 7f8460b3f640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 0x7f8448068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.542+0000 7f8460b3f640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 0x7f8448068740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8458009b60 tx=0x7f8458009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:28.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.546+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8454050660 con 0x7f845c1602b0 2023-07-20T09:50:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:28.726+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f845c04da30 con 0x7f845c1602b0 2023-07-20T09:50:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.702+0000 7f84517fa640 1 -- 172.21.15.82:0/2507899902 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84540180b0 con 0x7f845c1602b0 2023-07-20T09:50:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 msgr2=0x7f8448068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 0x7f8448068740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8458009b60 tx=0x7f8458009190 comp rx=0 tx=0).stop 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 msgr2=0x7f845c0b07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8454001570 tx=0x7f845400cca0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 shutdown_connections 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8448066280 0x7f8448068740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0b07b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06c120 0x7f845c0b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 --2- 172.21.15.82:0/2507899902 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06ab10 0x7f845c0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 >> 172.21.15.82:0/2507899902 conn(0x7f845c08c0a0 msgr2=0x7f845c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 shutdown_connections 2023-07-20T09:50:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.706+0000 7f8462da3640 1 -- 172.21.15.82:0/2507899902 wait complete. 2023-07-20T09:50:29.764 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T09:50:29.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T09:50:29.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 Processor -- start 2023-07-20T09:50:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 -- start start 2023-07-20T09:50:29.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e980cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e980d1040 con 0x7f2e9815c870 2023-07-20T09:50:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e980d1320 con 0x7f2e980cf820 2023-07-20T09:50:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e9cdc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980cfcb0 con 0x7f2e980d20e0 2023-07-20T09:50:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e977fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2e9815c870 0x7f2e980d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60868/0 (socket says 172.21.15.82:60868) 2023-07-20T09:50:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e977fe640 1 -- 172.21.15.82:0/3456171715 learned_addr learned my addr 172.21.15.82:0/3456171715 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e8ffff640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e980cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281164871 0 0) 0x7f2e980d1040 con 0x7f2e9815c870 2023-07-20T09:50:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e84003530 con 0x7f2e9815c870 2023-07-20T09:50:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 584850685 0 0) 0x7f2e84003530 con 0x7f2e9815c870 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 msgr2=0x7f2e980cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e980cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 >> v1:172.21.15.183:6789/0 conn(0x7f2e980cf820 legacy=0x7f2e980b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980d1600 con 0x7f2e9815c870 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2e88001680 con 0x7f2e9815c870 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 >> v1:172.21.15.82:6789/0 conn(0x7f2e9815c870 legacy=0x7f2e980d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84003a20 0x7f2e84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e840047d0 0x7f2e84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e84005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980cfcb0 con 0x7f2e84003a20 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8400ba40 con 0x7f2e840047d0 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8400bbd0 con 0x7f2e980d20e0 2023-07-20T09:50:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e977fe640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84003a20 0x7f2e84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.874+0000 7f2e8ffff640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e840047d0 0x7f2e84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e97fff640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e84005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 -- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 msgr2=0x7f2e84005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e980d20e0 0x7f2e84005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 -- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e840047d0 msgr2=0x7f2e84004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e840047d0 0x7f2e84004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 -- 172.21.15.82:0/3456171715 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84003530 con 0x7f2e84003a20 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e977fe640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84003a20 0x7f2e84003e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c190 tx=0x7f2e8801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b7fa50424907de server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88005ae0 con 0x7f2e84003a20 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88005c40 con 0x7f2e84003a20 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e96ffd640 1 -- 172.21.15.82:0/3456171715 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88007070 con 0x7f2e84003a20 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/3456171715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84003a20 msgr2=0x7f2e84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/3456171715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84003a20 0x7f2e84003e00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800c190 tx=0x7f2e8801cb80 comp rx=0 tx=0).stop 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e97fff640 1 -- 172.21.15.82:0/3456171715 reap_dead start 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/3456171715 shutdown_connections 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.878+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/3456171715 >> 172.21.15.82:0/3456171715 conn(0x7f2e980654e0 msgr2=0x7f2e980658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/3456171715 shutdown_connections 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/3456171715 wait complete. 2023-07-20T09:50:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 Processor -- start 2023-07-20T09:50:29.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- start start 2023-07-20T09:50:29.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 0x7f2e98151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e98156810 0x7f2e98156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e981571d0 con 0x7f2e980c73a0 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980c8450 con 0x7f2e84003a20 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980c78d0 con 0x7f2e98156810 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43126/0 (socket says 172.21.15.82:43126) 2023-07-20T09:50:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 -- 172.21.15.82:0/2066474144 learned_addr learned my addr 172.21.15.82:0/2066474144 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e977fe640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 0x7f2e98151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e97fff640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e98156810 0x7f2e98156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 -- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e98156810 msgr2=0x7f2e98156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e98156810 0x7f2e98156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 -- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 msgr2=0x7f2e98151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 0x7f2e98151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 -- 172.21.15.82:0/2066474144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980c7bb0 con 0x7f2e980c73a0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e977fe640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 0x7f2e98151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e8ffff640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e800119d0 tx=0x7f2e80011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000fb50 con 0x7f2e980c73a0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8000fcb0 con 0x7f2e980c73a0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e980c7e90 con 0x7f2e980c73a0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80014440 con 0x7f2e980c73a0 2023-07-20T09:50:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.882+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9815dd10 con 0x7f2e980c73a0 2023-07-20T09:50:29.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9804da30 con 0x7f2e980c73a0 2023-07-20T09:50:29.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e800145a0 con 0x7f2e980c73a0 2023-07-20T09:50:29.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e94ff9640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 0x7f2e78068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:29.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e800844b0 con 0x7f2e980c73a0 2023-07-20T09:50:29.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e977fe640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 0x7f2e78068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:29.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.886+0000 7f2e977fe640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 0x7f2e78068770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e880ab000 tx=0x7f2e880a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:29.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:29.890+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e80055470 con 0x7f2e980c73a0 2023-07-20T09:50:30.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.070+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e98160b90 con 0x7f2e980c73a0 2023-07-20T09:50:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e94ff9640 1 -- 172.21.15.82:0/2066474144 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e80055000 con 0x7f2e980c73a0 2023-07-20T09:50:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 msgr2=0x7f2e78068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 0x7f2e78068770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e880ab000 tx=0x7f2e880a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 msgr2=0x7f2e9815d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e800119d0 tx=0x7f2e80011e90 comp rx=0 tx=0).stop 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 shutdown_connections 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e780662b0 0x7f2e78068770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e98156810 0x7f2e98156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e980c73a0 0x7f2e9815d7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 --2- 172.21.15.82:0/2066474144 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e84003a20 0x7f2e98151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 >> 172.21.15.82:0/2066474144 conn(0x7f2e980654e0 msgr2=0x7f2e98159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 shutdown_connections 2023-07-20T09:50:30.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.710+0000 7f2e9cdc4640 1 -- 172.21.15.82:0/2066474144 wait complete. 2023-07-20T09:50:30.771 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T09:50:30.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:50:30.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 Processor -- start 2023-07-20T09:50:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 -- start start 2023-07-20T09:50:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d3415c590 0x7f7d340cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d340d0d00 0x7f7d340b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340cf880 con 0x7f7d340b5a60 2023-07-20T09:50:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d340cd2a0 con 0x7f7d3415c590 2023-07-20T09:50:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d394cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b4f50 con 0x7f7d340d0d00 2023-07-20T09:50:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d3415c590 0x7f7d340cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d3415c590 0x7f7d340cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43134/0 (socket says 172.21.15.82:43134) 2023-07-20T09:50:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 -- 172.21.15.82:0/3529717557 learned_addr learned my addr 172.21.15.82:0/3529717557 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 -- 172.21.15.82:0/3529717557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d340d0d00 msgr2=0x7f7d340b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 --2- 172.21.15.82:0/3529717557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d340d0d00 0x7f7d340b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 -- 172.21.15.82:0/3529717557 >> v1:172.21.15.183:6789/0 conn(0x7f7d340b5a60 legacy=0x7f7d340cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.878+0000 7f7d32ffd640 1 -- 172.21.15.82:0/3529717557 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340cfab0 con 0x7f7d3415c590 2023-07-20T09:50:30.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d32ffd640 1 --2- 172.21.15.82:0/3529717557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d3415c590 0x7f7d340cf340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7d340d0310 tx=0x7f7d2401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac890b28008ee10 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d327fc640 1 -- 172.21.15.82:0/3529717557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24004230 con 0x7f7d3415c590 2023-07-20T09:50:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d327fc640 1 -- 172.21.15.82:0/3529717557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d240a7050 con 0x7f7d3415c590 2023-07-20T09:50:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d327fc640 1 -- 172.21.15.82:0/3529717557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24003620 con 0x7f7d3415c590 2023-07-20T09:50:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 -- 172.21.15.82:0/3529717557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d3415c590 msgr2=0x7f7d340cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 --2- 172.21.15.82:0/3529717557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d3415c590 0x7f7d340cf340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7d340d0310 tx=0x7f7d2401c390 comp rx=0 tx=0).stop 2023-07-20T09:50:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 -- 172.21.15.82:0/3529717557 shutdown_connections 2023-07-20T09:50:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 --2- 172.21.15.82:0/3529717557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d340d0d00 0x7f7d340b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 --2- 172.21.15.82:0/3529717557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d3415c590 0x7f7d340cf340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 -- 172.21.15.82:0/3529717557 >> 172.21.15.82:0/3529717557 conn(0x7f7d340654e0 msgr2=0x7f7d340658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 -- 172.21.15.82:0/3529717557 shutdown_connections 2023-07-20T09:50:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.882+0000 7f7d394cb640 1 -- 172.21.15.82:0/3529717557 wait complete. 2023-07-20T09:50:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 Processor -- start 2023-07-20T09:50:30.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- start start 2023-07-20T09:50:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 0x7f7d3414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d3415c590 0x7f7d3415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3415f530 con 0x7f7d340b5a60 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3415e920 con 0x7f7d340d0d00 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3415ec00 con 0x7f7d3415c590 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43138/0 (socket says 172.21.15.82:43138) 2023-07-20T09:50:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 -- 172.21.15.82:0/914791624 learned_addr learned my addr 172.21.15.82:0/914791624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d337fe640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d3415c590 0x7f7d3415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d2bfff640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 0x7f7d3414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 -- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d3415c590 msgr2=0x7f7d3415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d3415c590 0x7f7d3415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 -- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 msgr2=0x7f7d3414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 0x7f7d3414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 -- 172.21.15.82:0/914791624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240094d0 con 0x7f7d340b5a60 2023-07-20T09:50:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d2bfff640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 0x7f7d3414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d32ffd640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d2401aa40 tx=0x7f7d24019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24003ca0 con 0x7f7d340b5a60 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d24003e00 con 0x7f7d340b5a60 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3415eee0 con 0x7f7d340b5a60 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240ab680 con 0x7f7d340b5a60 2023-07-20T09:50:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3415f9c0 con 0x7f7d340b5a60 2023-07-20T09:50:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.886+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3404da30 con 0x7f7d340b5a60 2023-07-20T09:50:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.890+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d240ab7e0 con 0x7f7d340b5a60 2023-07-20T09:50:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.890+0000 7f7d2b7fe640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 0x7f7d14068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:30.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.890+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d2411e630 con 0x7f7d340b5a60 2023-07-20T09:50:30.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.890+0000 7f7d2bfff640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 0x7f7d14068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:30.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.890+0000 7f7d2bfff640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 0x7f7d14068740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d3414d4c0 tx=0x7f7d1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:30.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:30.894+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d240eba10 con 0x7f7d340b5a60 2023-07-20T09:50:31.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d340b6090 con 0x7f7d340b5a60 2023-07-20T09:50:31.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d2b7fe640 1 -- 172.21.15.82:0/914791624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f7d240ef030 con 0x7f7d340b5a60 2023-07-20T09:50:31.110 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:31.110 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:50:31.111 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:50:31.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 msgr2=0x7f7d14068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 0x7f7d14068740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7d3414d4c0 tx=0x7f7d1c008040 comp rx=0 tx=0).stop 2023-07-20T09:50:31.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 msgr2=0x7f7d3414bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7d2401aa40 tx=0x7f7d24019130 comp rx=0 tx=0).stop 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 shutdown_connections 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7d14066280 0x7f7d14068740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d3415c590 0x7f7d3415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d340d0d00 0x7f7d3414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 --2- 172.21.15.82:0/914791624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d340b5a60 0x7f7d3414bdd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 >> 172.21.15.82:0/914791624 conn(0x7f7d340654e0 msgr2=0x7f7d340d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 shutdown_connections 2023-07-20T09:50:31.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.074+0000 7f7d394cb640 1 -- 172.21.15.82:0/914791624 wait complete. 2023-07-20T09:50:31.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:31.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 Processor -- start 2023-07-20T09:50:31.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 -- start start 2023-07-20T09:50:31.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c48070660 con 0x7f6c4815d060 2023-07-20T09:50:31.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c480ca6f0 con 0x7f6c4815d440 2023-07-20T09:50:31.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4d163640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480cd490 con 0x7f6c480c86d0 2023-07-20T09:50:31.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4c962640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4c962640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:49214/0 (socket says 172.21.15.82:49214) 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:59630/0 (socket says 172.21.15.82:59630) 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4c962640 1 -- 172.21.15.82:0/3703454870 learned_addr learned my addr 172.21.15.82:0/3703454870 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 -- 172.21.15.82:0/3703454870 >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 msgr2=0x7f6c4815a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 --2- 172.21.15.82:0/3703454870 >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 -- 172.21.15.82:0/3703454870 >> v1:172.21.15.183:6789/0 conn(0x7f6c4815d060 legacy=0x7f6c48070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c477fe640 1 -- 172.21.15.82:0/3703454870 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480cd770 con 0x7f6c480c86d0 2023-07-20T09:50:31.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.234+0000 7f6c4c962640 1 --2- 172.21.15.82:0/3703454870 >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c477fe640 1 --2- 172.21.15.82:0/3703454870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097c0 tx=0x7f6c3c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d7909bfd4ffc3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c46ffd640 1 -- 172.21.15.82:0/3703454870 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab600 con 0x7f6c480c86d0 2023-07-20T09:50:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c46ffd640 1 -- 172.21.15.82:0/3703454870 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c0a7050 con 0x7f6c480c86d0 2023-07-20T09:50:31.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c46ffd640 1 -- 172.21.15.82:0/3703454870 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c0ab980 con 0x7f6c480c86d0 2023-07-20T09:50:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 -- 172.21.15.82:0/3703454870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 msgr2=0x7f6c4806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 --2- 172.21.15.82:0/3703454870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0097c0 tx=0x7f6c3c01c480 comp rx=0 tx=0).stop 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 -- 172.21.15.82:0/3703454870 shutdown_connections 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 --2- 172.21.15.82:0/3703454870 >> v2:172.21.15.183:3300/0 conn(0x7f6c4815d440 0x7f6c4815a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 --2- 172.21.15.82:0/3703454870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c480c86d0 0x7f6c4806c3d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 -- 172.21.15.82:0/3703454870 >> 172.21.15.82:0/3703454870 conn(0x7f6c480ce080 msgr2=0x7f6c480ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 -- 172.21.15.82:0/3703454870 shutdown_connections 2023-07-20T09:50:31.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.238+0000 7f6c4d163640 1 -- 172.21.15.82:0/3703454870 wait complete. 2023-07-20T09:50:31.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 Processor -- start 2023-07-20T09:50:31.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- start start 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c4815d060 0x7f6c4814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c4815d440 0x7f6c4814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480c1370 con 0x7f6c480c86d0 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4814f980 con 0x7f6c4815d440 2023-07-20T09:50:31.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4815c1d0 con 0x7f6c4815d060 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43142/0 (socket says 172.21.15.82:43142) 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 -- 172.21.15.82:0/4277524669 learned_addr learned my addr 172.21.15.82:0/4277524669 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4c962640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c4815d440 0x7f6c4814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c477fe640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c4815d060 0x7f6c4814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 -- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c4815d060 msgr2=0x7f6c4814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c4815d060 0x7f6c4814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 -- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c4815d440 msgr2=0x7f6c4814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c4815d440 0x7f6c4814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 -- 172.21.15.82:0/4277524669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c40009b30 con 0x7f6c480c86d0 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c47fff640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c420 tx=0x7f6c3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380052d0 con 0x7f6c480c86d0 2023-07-20T09:50:31.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c38005430 con 0x7f6c480c86d0 2023-07-20T09:50:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38007260 con 0x7f6c480c86d0 2023-07-20T09:50:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c009420 con 0x7f6c480c86d0 2023-07-20T09:50:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.242+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4814fc20 con 0x7f6c480c86d0 2023-07-20T09:50:31.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c480ad8d0 con 0x7f6c480c86d0 2023-07-20T09:50:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c380073c0 con 0x7f6c480c86d0 2023-07-20T09:50:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c44ff9640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 0x7f6c34068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c380830f0 con 0x7f6c480c86d0 2023-07-20T09:50:31.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c477fe640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 0x7f6c34068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.246+0000 7f6c477fe640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 0x7f6c34068770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ad000 tx=0x7f6c3c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.250+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c38050570 con 0x7f6c480c86d0 2023-07-20T09:50:31.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.398+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c4804da30 con 0x7f6c480c86d0 2023-07-20T09:50:31.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.398+0000 7f6c44ff9640 1 -- 172.21.15.82:0/4277524669 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f6c38053b90 con 0x7f6c480c86d0 2023-07-20T09:50:31.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:31.437 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:31.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 msgr2=0x7f6c34068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 0x7f6c34068770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0ad000 tx=0x7f6c3c0a6000 comp rx=0 tx=0).stop 2023-07-20T09:50:31.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 msgr2=0x7f6c4814b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c420 tx=0x7f6c3800c8e0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 shutdown_connections 2023-07-20T09:50:31.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6c340662b0 0x7f6c34068770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c4815d440 0x7f6c4814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6c4815d060 0x7f6c4814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 --2- 172.21.15.82:0/4277524669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c480c86d0 0x7f6c4814b3b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 >> 172.21.15.82:0/4277524669 conn(0x7f6c480ce080 msgr2=0x7f6c480cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 shutdown_connections 2023-07-20T09:50:31.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.402+0000 7f6c4d163640 1 -- 172.21.15.82:0/4277524669 wait complete. 2023-07-20T09:50:31.458 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T09:50:31.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:50:31.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 Processor -- start 2023-07-20T09:50:31.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 -- start start 2023-07-20T09:50:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98a415cab0 0x7f98a40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40b3520 con 0x7f98a40d0d10 2023-07-20T09:50:31.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40cff30 con 0x7f98a40ce4c0 2023-07-20T09:50:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98ab46d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a40d31c0 con 0x7f98a415cab0 2023-07-20T09:50:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a8a08640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98a40d0d10 0x7f98a40cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60880/0 (socket says 172.21.15.82:60880) 2023-07-20T09:50:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a8a08640 1 -- 172.21.15.82:0/2563125785 learned_addr learned my addr 172.21.15.82:0/2563125785 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:31.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a9209640 1 --2- 172.21.15.82:0/2563125785 >> v2:172.21.15.82:3300/0 conn(0x7f98a415cab0 0x7f98a40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f989bfff640 1 -- 172.21.15.82:0/2563125785 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065643869 0 0) 0x7f98a40b3520 con 0x7f98a40d0d10 2023-07-20T09:50:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a9209640 1 -- 172.21.15.82:0/2563125785 >> v1:172.21.15.183:6789/0 conn(0x7f98a40ce4c0 legacy=0x7f98a40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a9209640 1 -- 172.21.15.82:0/2563125785 >> v1:172.21.15.82:6789/0 conn(0x7f98a40d0d10 legacy=0x7f98a40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.562+0000 7f98a9209640 1 -- 172.21.15.82:0/2563125785 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40b2910 con 0x7f98a415cab0 2023-07-20T09:50:31.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98a9209640 1 --2- 172.21.15.82:0/2563125785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40d0300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d90 tx=0x7f98a001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3115913839c7530 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f989bfff640 1 -- 172.21.15.82:0/2563125785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a00a59a0 con 0x7f98a415cab0 2023-07-20T09:50:31.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f989bfff640 1 -- 172.21.15.82:0/2563125785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a00a5b00 con 0x7f98a415cab0 2023-07-20T09:50:31.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f989bfff640 1 -- 172.21.15.82:0/2563125785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a00a5e90 con 0x7f98a415cab0 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 -- 172.21.15.82:0/2563125785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 msgr2=0x7f98a40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 --2- 172.21.15.82:0/2563125785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40d0300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98a0009d90 tx=0x7f98a001c8e0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 -- 172.21.15.82:0/2563125785 shutdown_connections 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 --2- 172.21.15.82:0/2563125785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40d0300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 -- 172.21.15.82:0/2563125785 >> 172.21.15.82:0/2563125785 conn(0x7f98a408c120 msgr2=0x7f98a409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 -- 172.21.15.82:0/2563125785 shutdown_connections 2023-07-20T09:50:31.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.566+0000 7f98ab46d640 1 -- 172.21.15.82:0/2563125785 wait complete. 2023-07-20T09:50:31.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 Processor -- start 2023-07-20T09:50:31.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- start start 2023-07-20T09:50:31.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98a40ce4c0 0x7f98a40b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98a40d0d10 0x7f98a4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40b69a0 con 0x7f98a415cab0 2023-07-20T09:50:31.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a41529d0 con 0x7f98a40d0d10 2023-07-20T09:50:31.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40b6b90 con 0x7f98a40ce4c0 2023-07-20T09:50:31.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43152/0 (socket says 172.21.15.82:43152) 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 -- 172.21.15.82:0/745794670 learned_addr learned my addr 172.21.15.82:0/745794670 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9209640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98a40ce4c0 0x7f98a40b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a8a08640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98a40d0d10 0x7f98a4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 -- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98a40ce4c0 msgr2=0x7f98a40b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98a40ce4c0 0x7f98a40b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 -- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98a40d0d10 msgr2=0x7f98a4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98a40d0d10 0x7f98a4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 -- 172.21.15.82:0/745794670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a0009a70 con 0x7f98a415cab0 2023-07-20T09:50:31.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98a9a0a640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f989c00b490 tx=0x7f989c00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c004020 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c004180 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011630 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40b6ed0 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.570+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a40b7710 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a40b7930 con 0x7f98a415cab0 2023-07-20T09:50:31.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989c011790 con 0x7f98a415cab0 2023-07-20T09:50:31.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f9899ffb640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 0x7f9888068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f989c083890 con 0x7f98a415cab0 2023-07-20T09:50:31.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f98a9209640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 0x7f9888068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.574+0000 7f98a9209640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 0x7f9888068740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98a00af000 tx=0x7f98a00a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.578+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f989c050d20 con 0x7f98a415cab0 2023-07-20T09:50:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.722+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98a40b25c0 con 0x7f9888066280 2023-07-20T09:50:31.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.730+0000 7f9899ffb640 1 -- 172.21.15.82:0/745794670 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286740 (secure 0 0 0) 0x7f98a00bd070 con 0x7f9888066280 2023-07-20T09:50:31.769 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:31.772 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 msgr2=0x7f9888068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 0x7f9888068740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f98a00af000 tx=0x7f98a00a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 msgr2=0x7f98a40c8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f989c00b490 tx=0x7f989c00b950 comp rx=0 tx=0).stop 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 shutdown_connections 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9888066280 0x7f9888068740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98a415cab0 0x7f98a40c8750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98a40d0d10 0x7f98a4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 --2- 172.21.15.82:0/745794670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98a40ce4c0 0x7f98a40b6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 >> 172.21.15.82:0/745794670 conn(0x7f98a408c120 msgr2=0x7f98a40b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 shutdown_connections 2023-07-20T09:50:31.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.734+0000 7f98ab46d640 1 -- 172.21.15.82:0/745794670 wait complete. 2023-07-20T09:50:31.791 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T09:50:29.836773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219204,"kb_used_data":3016,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755516,"statfs":{"total":773094113280,"available":772869648384,"internally_reserved":0,"allocated":3088384,"data_stored":1849028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.477580"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.704516+0000","last_change":"2023-07-20T09:50:27.702234+0000","last_active":"2023-07-20T09:50:27.704516+0000","last_peered":"2023-07-20T09:50:27.704516+0000","last_clean":"2023-07-20T09:50:27.704516+0000","last_became_active":"2023-07-20T09:50:27.701890+0000","last_became_peered":"2023-07-20T09:50:27.701890+0000","last_unstale":"2023-07-20T09:50:27.704516+0000","last_undegraded":"2023-07-20T09:50:27.704516+0000","last_fullsized":"2023-07-20T09:50:27.704516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:22.608674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679258+0000","last_change":"2023-07-20T09:50:27.691896+0000","last_active":"2023-07-20T09:50:28.679258+0000","last_peered":"2023-07-20T09:50:28.679258+0000","last_clean":"2023-07-20T09:50:28.679258+0000","last_became_active":"2023-07-20T09:50:27.691138+0000","last_became_peered":"2023-07-20T09:50:27.691138+0000","last_unstale":"2023-07-20T09:50:28.679258+0000","last_undegraded":"2023-07-20T09:50:28.679258+0000","last_fullsized":"2023-07-20T09:50:28.679258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680090+0000","last_change":"2023-07-20T09:50:27.686197+0000","last_active":"2023-07-20T09:50:28.680090+0000","last_peered":"2023-07-20T09:50:28.680090+0000","last_clean":"2023-07-20T09:50:28.680090+0000","last_became_active":"2023-07-20T09:50:27.685846+0000","last_became_peered":"2023-07-20T09:50:27.685846+0000","last_unstale":"2023-07-20T09:50:28.680090+0000","last_undegraded":"2023-07-20T09:50:28.680090+0000","last_fullsized":"2023-07-20T09:50:28.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:44.021656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.689846+0000","last_change":"2023-07-20T09:50:27.686988+0000","last_active":"2023-07-20T09:50:27.689846+0000","last_peered":"2023-07-20T09:50:27.689846+0000","last_clean":"2023-07-20T09:50:27.689846+0000","last_became_active":"2023-07-20T09:50:27.686647+0000","last_became_peered":"2023-07-20T09:50:27.686647+0000","last_unstale":"2023-07-20T09:50:27.689846+0000","last_undegraded":"2023-07-20T09:50:27.689846+0000","last_fullsized":"2023-07-20T09:50:27.689846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:12.329493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733017+0000","last_change":"2023-07-20T09:50:27.706718+0000","last_active":"2023-07-20T09:50:28.733017+0000","last_peered":"2023-07-20T09:50:28.733017+0000","last_clean":"2023-07-20T09:50:28.733017+0000","last_became_active":"2023-07-20T09:50:27.706185+0000","last_became_peered":"2023-07-20T09:50:27.706185+0000","last_unstale":"2023-07-20T09:50:28.733017+0000","last_undegraded":"2023-07-20T09:50:28.733017+0000","last_fullsized":"2023-07-20T09:50:28.733017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678715+0000","last_change":"2023-07-20T09:50:27.686831+0000","last_active":"2023-07-20T09:50:28.678715+0000","last_peered":"2023-07-20T09:50:28.678715+0000","last_clean":"2023-07-20T09:50:28.678715+0000","last_became_active":"2023-07-20T09:50:27.686412+0000","last_became_peered":"2023-07-20T09:50:27.686412+0000","last_unstale":"2023-07-20T09:50:28.678715+0000","last_undegraded":"2023-07-20T09:50:28.678715+0000","last_fullsized":"2023-07-20T09:50:28.678715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.694933+0000","last_change":"2023-07-20T09:50:27.692084+0000","last_active":"2023-07-20T09:50:27.694933+0000","last_peered":"2023-07-20T09:50:27.694933+0000","last_clean":"2023-07-20T09:50:27.694933+0000","last_became_active":"2023-07-20T09:50:27.691849+0000","last_became_peered":"2023-07-20T09:50:27.691849+0000","last_unstale":"2023-07-20T09:50:27.694933+0000","last_undegraded":"2023-07-20T09:50:27.694933+0000","last_fullsized":"2023-07-20T09:50:27.694933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679116+0000","last_change":"2023-07-20T09:50:27.690562+0000","last_active":"2023-07-20T09:50:28.679116+0000","last_peered":"2023-07-20T09:50:28.679116+0000","last_clean":"2023-07-20T09:50:28.679116+0000","last_became_active":"2023-07-20T09:50:27.685211+0000","last_became_peered":"2023-07-20T09:50:27.685211+0000","last_unstale":"2023-07-20T09:50:28.679116+0000","last_undegraded":"2023-07-20T09:50:28.679116+0000","last_fullsized":"2023-07-20T09:50:28.679116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732966+0000","last_change":"2023-07-20T09:50:27.705540+0000","last_active":"2023-07-20T09:50:28.732966+0000","last_peered":"2023-07-20T09:50:28.732966+0000","last_clean":"2023-07-20T09:50:28.732966+0000","last_became_active":"2023-07-20T09:50:27.705238+0000","last_became_peered":"2023-07-20T09:50:27.705238+0000","last_unstale":"2023-07-20T09:50:28.732966+0000","last_undegraded":"2023-07-20T09:50:28.732966+0000","last_fullsized":"2023-07-20T09:50:28.732966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679423+0000","last_change":"2023-07-20T09:50:27.692110+0000","last_active":"2023-07-20T09:50:28.679423+0000","last_peered":"2023-07-20T09:50:28.679423+0000","last_clean":"2023-07-20T09:50:28.679423+0000","last_became_active":"2023-07-20T09:50:27.691537+0000","last_became_peered":"2023-07-20T09:50:27.691537+0000","last_unstale":"2023-07-20T09:50:28.679423+0000","last_undegraded":"2023-07-20T09:50:28.679423+0000","last_fullsized":"2023-07-20T09:50:28.679423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680137+0000","last_change":"2023-07-20T09:50:27.693033+0000","last_active":"2023-07-20T09:50:28.680137+0000","last_peered":"2023-07-20T09:50:28.680137+0000","last_clean":"2023-07-20T09:50:28.680137+0000","last_became_active":"2023-07-20T09:50:27.692715+0000","last_became_peered":"2023-07-20T09:50:27.692715+0000","last_unstale":"2023-07-20T09:50:28.680137+0000","last_undegraded":"2023-07-20T09:50:28.680137+0000","last_fullsized":"2023-07-20T09:50:28.680137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:49.858742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.691754+0000","last_change":"2023-07-20T09:50:27.689428+0000","last_active":"2023-07-20T09:50:27.691754+0000","last_peered":"2023-07-20T09:50:27.691754+0000","last_clean":"2023-07-20T09:50:27.691754+0000","last_became_active":"2023-07-20T09:50:27.689088+0000","last_became_peered":"2023-07-20T09:50:27.689088+0000","last_unstale":"2023-07-20T09:50:27.691754+0000","last_undegraded":"2023-07-20T09:50:27.691754+0000","last_fullsized":"2023-07-20T09:50:27.691754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:12.329493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.706464+0000","last_change":"2023-07-20T09:50:27.704247+0000","last_active":"2023-07-20T09:50:27.706464+0000","last_peered":"2023-07-20T09:50:27.706464+0000","last_clean":"2023-07-20T09:50:27.706464+0000","last_became_active":"2023-07-20T09:50:27.703955+0000","last_became_peered":"2023-07-20T09:50:27.703955+0000","last_unstale":"2023-07-20T09:50:27.706464+0000","last_undegraded":"2023-07-20T09:50:27.706464+0000","last_fullsized":"2023-07-20T09:50:27.706464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:46:33.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679534+0000","last_change":"2023-07-20T09:50:27.679300+0000","last_active":"2023-07-20T09:50:28.679534+0000","last_peered":"2023-07-20T09:50:28.679534+0000","last_clean":"2023-07-20T09:50:28.679534+0000","last_became_active":"2023-07-20T09:50:27.678826+0000","last_became_peered":"2023-07-20T09:50:27.678826+0000","last_unstale":"2023-07-20T09:50:28.679534+0000","last_undegraded":"2023-07-20T09:50:28.679534+0000","last_fullsized":"2023-07-20T09:50:28.679534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.694912+0000","last_change":"2023-07-20T09:50:27.691224+0000","last_active":"2023-07-20T09:50:27.694912+0000","last_peered":"2023-07-20T09:50:27.694912+0000","last_clean":"2023-07-20T09:50:27.694912+0000","last_became_active":"2023-07-20T09:50:27.690992+0000","last_became_peered":"2023-07-20T09:50:27.690992+0000","last_unstale":"2023-07-20T09:50:27.694912+0000","last_undegraded":"2023-07-20T09:50:27.694912+0000","last_fullsized":"2023-07-20T09:50:27.694912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678697+0000","last_change":"2023-07-20T09:50:27.680234+0000","last_active":"2023-07-20T09:50:28.678697+0000","last_peered":"2023-07-20T09:50:28.678697+0000","last_clean":"2023-07-20T09:50:28.678697+0000","last_became_active":"2023-07-20T09:50:27.679957+0000","last_became_peered":"2023-07-20T09:50:27.679957+0000","last_unstale":"2023-07-20T09:50:28.678697+0000","last_undegraded":"2023-07-20T09:50:28.678697+0000","last_fullsized":"2023-07-20T09:50:28.678697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733011+0000","last_change":"2023-07-20T09:50:27.705338+0000","last_active":"2023-07-20T09:50:28.733011+0000","last_peered":"2023-07-20T09:50:28.733011+0000","last_clean":"2023-07-20T09:50:28.733011+0000","last_became_active":"2023-07-20T09:50:27.704958+0000","last_became_peered":"2023-07-20T09:50:27.704958+0000","last_unstale":"2023-07-20T09:50:28.733011+0000","last_undegraded":"2023-07-20T09:50:28.733011+0000","last_fullsized":"2023-07-20T09:50:28.733011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680236+0000","last_change":"2023-07-20T09:50:27.684311+0000","last_active":"2023-07-20T09:50:28.680236+0000","last_peered":"2023-07-20T09:50:28.680236+0000","last_clean":"2023-07-20T09:50:28.680236+0000","last_became_active":"2023-07-20T09:50:27.680860+0000","last_became_peered":"2023-07-20T09:50:27.680860+0000","last_unstale":"2023-07-20T09:50:28.680236+0000","last_undegraded":"2023-07-20T09:50:28.680236+0000","last_fullsized":"2023-07-20T09:50:28.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:06.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.686343+0000","last_change":"2023-07-20T09:50:27.681256+0000","last_active":"2023-07-20T09:50:27.686343+0000","last_peered":"2023-07-20T09:50:27.686343+0000","last_clean":"2023-07-20T09:50:27.686343+0000","last_became_active":"2023-07-20T09:50:27.680937+0000","last_became_peered":"2023-07-20T09:50:27.680937+0000","last_unstale":"2023-07-20T09:50:27.686343+0000","last_undegraded":"2023-07-20T09:50:27.686343+0000","last_fullsized":"2023-07-20T09:50:27.686343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:16.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678905+0000","last_change":"2023-07-20T09:50:27.681378+0000","last_active":"2023-07-20T09:50:28.678905+0000","last_peered":"2023-07-20T09:50:28.678905+0000","last_clean":"2023-07-20T09:50:28.678905+0000","last_became_active":"2023-07-20T09:50:27.681016+0000","last_became_peered":"2023-07-20T09:50:27.681016+0000","last_unstale":"2023-07-20T09:50:28.678905+0000","last_undegraded":"2023-07-20T09:50:28.678905+0000","last_fullsized":"2023-07-20T09:50:28.678905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711904+0000","last_change":"2023-07-20T09:50:27.708844+0000","last_active":"2023-07-20T09:50:27.711904+0000","last_peered":"2023-07-20T09:50:27.711904+0000","last_clean":"2023-07-20T09:50:27.711904+0000","last_became_active":"2023-07-20T09:50:27.708506+0000","last_became_peered":"2023-07-20T09:50:27.708506+0000","last_unstale":"2023-07-20T09:50:27.711904+0000","last_undegraded":"2023-07-20T09:50:27.711904+0000","last_fullsized":"2023-07-20T09:50:27.711904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732746+0000","last_change":"2023-07-20T09:50:27.693993+0000","last_active":"2023-07-20T09:50:28.732746+0000","last_peered":"2023-07-20T09:50:28.732746+0000","last_clean":"2023-07-20T09:50:28.732746+0000","last_became_active":"2023-07-20T09:50:27.693525+0000","last_became_peered":"2023-07-20T09:50:27.693525+0000","last_unstale":"2023-07-20T09:50:28.732746+0000","last_undegraded":"2023-07-20T09:50:28.732746+0000","last_fullsized":"2023-07-20T09:50:28.732746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674068+0000","last_change":"2023-07-20T09:50:27.703451+0000","last_active":"2023-07-20T09:50:28.674068+0000","last_peered":"2023-07-20T09:50:28.674068+0000","last_clean":"2023-07-20T09:50:28.674068+0000","last_became_active":"2023-07-20T09:50:27.702940+0000","last_became_peered":"2023-07-20T09:50:27.702940+0000","last_unstale":"2023-07-20T09:50:28.674068+0000","last_undegraded":"2023-07-20T09:50:28.674068+0000","last_fullsized":"2023-07-20T09:50:28.674068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711869+0000","last_change":"2023-07-20T09:50:27.708326+0000","last_active":"2023-07-20T09:50:27.711869+0000","last_peered":"2023-07-20T09:50:27.711869+0000","last_clean":"2023-07-20T09:50:27.711869+0000","last_became_active":"2023-07-20T09:50:27.707974+0000","last_became_peered":"2023-07-20T09:50:27.707974+0000","last_unstale":"2023-07-20T09:50:27.711869+0000","last_undegraded":"2023-07-20T09:50:27.711869+0000","last_fullsized":"2023-07-20T09:50:27.711869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738150+0000","last_change":"2023-07-20T09:50:27.692567+0000","last_active":"2023-07-20T09:50:28.738150+0000","last_peered":"2023-07-20T09:50:28.738150+0000","last_clean":"2023-07-20T09:50:28.738150+0000","last_became_active":"2023-07-20T09:50:27.692146+0000","last_became_peered":"2023-07-20T09:50:27.692146+0000","last_unstale":"2023-07-20T09:50:28.738150+0000","last_undegraded":"2023-07-20T09:50:28.738150+0000","last_fullsized":"2023-07-20T09:50:28.738150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738221+0000","last_change":"2023-07-20T09:50:27.692593+0000","last_active":"2023-07-20T09:50:28.738221+0000","last_peered":"2023-07-20T09:50:28.738221+0000","last_clean":"2023-07-20T09:50:28.738221+0000","last_became_active":"2023-07-20T09:50:27.692226+0000","last_became_peered":"2023-07-20T09:50:27.692226+0000","last_unstale":"2023-07-20T09:50:28.738221+0000","last_undegraded":"2023-07-20T09:50:28.738221+0000","last_fullsized":"2023-07-20T09:50:28.738221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679407+0000","last_change":"2023-07-20T09:50:27.683556+0000","last_active":"2023-07-20T09:50:28.679407+0000","last_peered":"2023-07-20T09:50:28.679407+0000","last_clean":"2023-07-20T09:50:28.679407+0000","last_became_active":"2023-07-20T09:50:27.683246+0000","last_became_peered":"2023-07-20T09:50:27.683246+0000","last_unstale":"2023-07-20T09:50:28.679407+0000","last_undegraded":"2023-07-20T09:50:28.679407+0000","last_fullsized":"2023-07-20T09:50:28.679407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738218+0000","last_change":"2023-07-20T09:50:27.690772+0000","last_active":"2023-07-20T09:50:28.738218+0000","last_peered":"2023-07-20T09:50:28.738218+0000","last_clean":"2023-07-20T09:50:28.738218+0000","last_became_active":"2023-07-20T09:50:27.690456+0000","last_became_peered":"2023-07-20T09:50:27.690456+0000","last_unstale":"2023-07-20T09:50:28.738218+0000","last_undegraded":"2023-07-20T09:50:28.738218+0000","last_fullsized":"2023-07-20T09:50:28.738218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674414+0000","last_change":"2023-07-20T09:50:27.701936+0000","last_active":"2023-07-20T09:50:28.674414+0000","last_peered":"2023-07-20T09:50:28.674414+0000","last_clean":"2023-07-20T09:50:28.674414+0000","last_became_active":"2023-07-20T09:50:27.701378+0000","last_became_peered":"2023-07-20T09:50:27.701378+0000","last_unstale":"2023-07-20T09:50:28.674414+0000","last_undegraded":"2023-07-20T09:50:28.674414+0000","last_fullsized":"2023-07-20T09:50:28.674414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679021+0000","last_change":"2023-07-20T09:50:27.682320+0000","last_active":"2023-07-20T09:50:28.679021+0000","last_peered":"2023-07-20T09:50:28.679021+0000","last_clean":"2023-07-20T09:50:28.679021+0000","last_became_active":"2023-07-20T09:50:27.681183+0000","last_became_peered":"2023-07-20T09:50:27.681183+0000","last_unstale":"2023-07-20T09:50:28.679021+0000","last_undegraded":"2023-07-20T09:50:28.679021+0000","last_fullsized":"2023-07-20T09:50:28.679021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674102+0000","last_change":"2023-07-20T09:50:27.703874+0000","last_active":"2023-07-20T09:50:28.674102+0000","last_peered":"2023-07-20T09:50:28.674102+0000","last_clean":"2023-07-20T09:50:28.674102+0000","last_became_active":"2023-07-20T09:50:27.701925+0000","last_became_peered":"2023-07-20T09:50:27.701925+0000","last_unstale":"2023-07-20T09:50:28.674102+0000","last_undegraded":"2023-07-20T09:50:28.674102+0000","last_fullsized":"2023-07-20T09:50:28.674102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.688425+0000","last_change":"2023-07-20T09:50:27.685373+0000","last_active":"2023-07-20T09:50:27.688425+0000","last_peered":"2023-07-20T09:50:27.688425+0000","last_clean":"2023-07-20T09:50:27.688425+0000","last_became_active":"2023-07-20T09:50:27.685083+0000","last_became_peered":"2023-07-20T09:50:27.685083+0000","last_unstale":"2023-07-20T09:50:27.688425+0000","last_undegraded":"2023-07-20T09:50:27.688425+0000","last_fullsized":"2023-07-20T09:50:27.688425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:16.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674290+0000","last_change":"2023-07-20T09:50:27.696660+0000","last_active":"2023-07-20T09:50:28.674290+0000","last_peered":"2023-07-20T09:50:28.674290+0000","last_clean":"2023-07-20T09:50:28.674290+0000","last_became_active":"2023-07-20T09:50:27.696285+0000","last_became_peered":"2023-07-20T09:50:27.696285+0000","last_unstale":"2023-07-20T09:50:28.674290+0000","last_undegraded":"2023-07-20T09:50:28.674290+0000","last_fullsized":"2023-07-20T09:50:28.674290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.712869+0000","last_change":"2023-07-20T09:50:26.398520+0000","last_active":"2023-07-20T09:50:27.712869+0000","last_peered":"2023-07-20T09:50:27.712869+0000","last_clean":"2023-07-20T09:50:27.712869+0000","last_became_active":"2023-07-20T09:50:26.398176+0000","last_became_peered":"2023-07-20T09:50:26.398176+0000","last_unstale":"2023-07-20T09:50:27.712869+0000","last_undegraded":"2023-07-20T09:50:27.712869+0000","last_fullsized":"2023-07-20T09:50:27.712869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679549+0000","last_change":"2023-07-20T09:50:27.684529+0000","last_active":"2023-07-20T09:50:28.679549+0000","last_peered":"2023-07-20T09:50:28.679549+0000","last_clean":"2023-07-20T09:50:28.679549+0000","last_became_active":"2023-07-20T09:50:27.684036+0000","last_became_peered":"2023-07-20T09:50:27.684036+0000","last_unstale":"2023-07-20T09:50:28.679549+0000","last_undegraded":"2023-07-20T09:50:28.679549+0000","last_fullsized":"2023-07-20T09:50:28.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:13.421282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732887+0000","last_change":"2023-07-20T09:50:26.384546+0000","last_active":"2023-07-20T09:50:28.732887+0000","last_peered":"2023-07-20T09:50:28.732887+0000","last_clean":"2023-07-20T09:50:28.732887+0000","last_became_active":"2023-07-20T09:50:26.384051+0000","last_became_peered":"2023-07-20T09:50:26.384051+0000","last_unstale":"2023-07-20T09:50:28.732887+0000","last_undegraded":"2023-07-20T09:50:28.732887+0000","last_fullsized":"2023-07-20T09:50:28.732887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:30.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733111+0000","last_change":"2023-07-20T09:50:27.702104+0000","last_active":"2023-07-20T09:50:28.733111+0000","last_peered":"2023-07-20T09:50:28.733111+0000","last_clean":"2023-07-20T09:50:28.733111+0000","last_became_active":"2023-07-20T09:50:27.701753+0000","last_became_peered":"2023-07-20T09:50:27.701753+0000","last_unstale":"2023-07-20T09:50:28.733111+0000","last_undegraded":"2023-07-20T09:50:28.733111+0000","last_fullsized":"2023-07-20T09:50:28.733111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677099+0000","last_change":"2023-07-20T09:50:26.398397+0000","last_active":"2023-07-20T09:50:27.677099+0000","last_peered":"2023-07-20T09:50:27.677099+0000","last_clean":"2023-07-20T09:50:27.677099+0000","last_became_active":"2023-07-20T09:50:26.398035+0000","last_became_peered":"2023-07-20T09:50:26.398035+0000","last_unstale":"2023-07-20T09:50:27.677099+0000","last_undegraded":"2023-07-20T09:50:27.677099+0000","last_fullsized":"2023-07-20T09:50:27.677099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674694+0000","last_change":"2023-07-20T09:50:27.701766+0000","last_active":"2023-07-20T09:50:28.674694+0000","last_peered":"2023-07-20T09:50:28.674694+0000","last_clean":"2023-07-20T09:50:28.674694+0000","last_became_active":"2023-07-20T09:50:27.701453+0000","last_became_peered":"2023-07-20T09:50:27.701453+0000","last_unstale":"2023-07-20T09:50:28.674694+0000","last_undegraded":"2023-07-20T09:50:28.674694+0000","last_fullsized":"2023-07-20T09:50:28.674694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.715565+0000","last_change":"2023-07-20T09:50:26.386136+0000","last_active":"2023-07-20T09:50:27.715565+0000","last_peered":"2023-07-20T09:50:27.715565+0000","last_clean":"2023-07-20T09:50:27.715565+0000","last_became_active":"2023-07-20T09:50:26.385573+0000","last_became_peered":"2023-07-20T09:50:26.385573+0000","last_unstale":"2023-07-20T09:50:27.715565+0000","last_undegraded":"2023-07-20T09:50:27.715565+0000","last_fullsized":"2023-07-20T09:50:27.715565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:06:59.705313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.713145+0000","last_change":"2023-07-20T09:50:26.399349+0000","last_active":"2023-07-20T09:50:27.713145+0000","last_peered":"2023-07-20T09:50:27.713145+0000","last_clean":"2023-07-20T09:50:27.713145+0000","last_became_active":"2023-07-20T09:50:26.398932+0000","last_became_peered":"2023-07-20T09:50:26.398932+0000","last_unstale":"2023-07-20T09:50:27.713145+0000","last_undegraded":"2023-07-20T09:50:27.713145+0000","last_fullsized":"2023-07-20T09:50:27.713145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:45.504134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679283+0000","last_change":"2023-07-20T09:50:27.683608+0000","last_active":"2023-07-20T09:50:28.679283+0000","last_peered":"2023-07-20T09:50:28.679283+0000","last_clean":"2023-07-20T09:50:28.679283+0000","last_became_active":"2023-07-20T09:50:27.683287+0000","last_became_peered":"2023-07-20T09:50:27.683287+0000","last_unstale":"2023-07-20T09:50:28.679283+0000","last_undegraded":"2023-07-20T09:50:28.679283+0000","last_fullsized":"2023-07-20T09:50:28.679283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.713138+0000","last_change":"2023-07-20T09:50:26.398232+0000","last_active":"2023-07-20T09:50:27.713138+0000","last_peered":"2023-07-20T09:50:27.713138+0000","last_clean":"2023-07-20T09:50:27.713138+0000","last_became_active":"2023-07-20T09:50:26.397884+0000","last_became_peered":"2023-07-20T09:50:26.397884+0000","last_unstale":"2023-07-20T09:50:27.713138+0000","last_undegraded":"2023-07-20T09:50:27.713138+0000","last_fullsized":"2023-07-20T09:50:27.713138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678623+0000","last_change":"2023-07-20T09:50:27.692914+0000","last_active":"2023-07-20T09:50:28.678623+0000","last_peered":"2023-07-20T09:50:28.678623+0000","last_clean":"2023-07-20T09:50:28.678623+0000","last_became_active":"2023-07-20T09:50:27.692610+0000","last_became_peered":"2023-07-20T09:50:27.692610+0000","last_unstale":"2023-07-20T09:50:28.678623+0000","last_undegraded":"2023-07-20T09:50:28.678623+0000","last_fullsized":"2023-07-20T09:50:28.678623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711043+0000","last_change":"2023-07-20T09:50:26.391171+0000","last_active":"2023-07-20T09:50:27.711043+0000","last_peered":"2023-07-20T09:50:27.711043+0000","last_clean":"2023-07-20T09:50:27.711043+0000","last_became_active":"2023-07-20T09:50:26.390823+0000","last_became_peered":"2023-07-20T09:50:26.390823+0000","last_unstale":"2023-07-20T09:50:27.711043+0000","last_undegraded":"2023-07-20T09:50:27.711043+0000","last_fullsized":"2023-07-20T09:50:27.711043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:19.970248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.693878+0000","last_change":"2023-07-20T09:50:27.692283+0000","last_active":"2023-07-20T09:50:27.693878+0000","last_peered":"2023-07-20T09:50:27.693878+0000","last_clean":"2023-07-20T09:50:27.693878+0000","last_became_active":"2023-07-20T09:50:27.691972+0000","last_became_peered":"2023-07-20T09:50:27.691972+0000","last_unstale":"2023-07-20T09:50:27.693878+0000","last_undegraded":"2023-07-20T09:50:27.693878+0000","last_fullsized":"2023-07-20T09:50:27.693878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:39.685523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679424+0000","last_change":"2023-07-20T09:50:26.387250+0000","last_active":"2023-07-20T09:50:28.679424+0000","last_peered":"2023-07-20T09:50:28.679424+0000","last_clean":"2023-07-20T09:50:28.679424+0000","last_became_active":"2023-07-20T09:50:26.386829+0000","last_became_peered":"2023-07-20T09:50:26.386829+0000","last_unstale":"2023-07-20T09:50:28.679424+0000","last_undegraded":"2023-07-20T09:50:28.679424+0000","last_fullsized":"2023-07-20T09:50:28.679424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732879+0000","last_change":"2023-07-20T09:50:27.693747+0000","last_active":"2023-07-20T09:50:28.732879+0000","last_peered":"2023-07-20T09:50:28.732879+0000","last_clean":"2023-07-20T09:50:28.732879+0000","last_became_active":"2023-07-20T09:50:27.693399+0000","last_became_peered":"2023-07-20T09:50:27.693399+0000","last_unstale":"2023-07-20T09:50:28.732879+0000","last_undegraded":"2023-07-20T09:50:28.732879+0000","last_fullsized":"2023-07-20T09:50:28.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674542+0000","last_change":"2023-07-20T09:50:26.387168+0000","last_active":"2023-07-20T09:50:28.674542+0000","last_peered":"2023-07-20T09:50:28.674542+0000","last_clean":"2023-07-20T09:50:28.674542+0000","last_became_active":"2023-07-20T09:50:26.386895+0000","last_became_peered":"2023-07-20T09:50:26.386895+0000","last_unstale":"2023-07-20T09:50:28.674542+0000","last_undegraded":"2023-07-20T09:50:28.674542+0000","last_fullsized":"2023-07-20T09:50:28.674542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:28.011137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679049+0000","last_change":"2023-07-20T09:50:27.705371+0000","last_active":"2023-07-20T09:50:28.679049+0000","last_peered":"2023-07-20T09:50:28.679049+0000","last_clean":"2023-07-20T09:50:28.679049+0000","last_became_active":"2023-07-20T09:50:27.705101+0000","last_became_peered":"2023-07-20T09:50:27.705101+0000","last_unstale":"2023-07-20T09:50:28.679049+0000","last_undegraded":"2023-07-20T09:50:28.679049+0000","last_fullsized":"2023-07-20T09:50:28.679049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677856+0000","last_change":"2023-07-20T09:50:26.396439+0000","last_active":"2023-07-20T09:50:27.677856+0000","last_peered":"2023-07-20T09:50:27.677856+0000","last_clean":"2023-07-20T09:50:27.677856+0000","last_became_active":"2023-07-20T09:50:26.396127+0000","last_became_peered":"2023-07-20T09:50:26.396127+0000","last_unstale":"2023-07-20T09:50:27.677856+0000","last_undegraded":"2023-07-20T09:50:27.677856+0000","last_fullsized":"2023-07-20T09:50:27.677856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:16.292193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680251+0000","last_change":"2023-07-20T09:50:27.684320+0000","last_active":"2023-07-20T09:50:28.680251+0000","last_peered":"2023-07-20T09:50:28.680251+0000","last_clean":"2023-07-20T09:50:28.680251+0000","last_became_active":"2023-07-20T09:50:27.683970+0000","last_became_peered":"2023-07-20T09:50:27.683970+0000","last_unstale":"2023-07-20T09:50:28.680251+0000","last_undegraded":"2023-07-20T09:50:28.680251+0000","last_fullsized":"2023-07-20T09:50:28.680251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:51.387330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678776+0000","last_change":"2023-07-20T09:50:26.392014+0000","last_active":"2023-07-20T09:50:28.678776+0000","last_peered":"2023-07-20T09:50:28.678776+0000","last_clean":"2023-07-20T09:50:28.678776+0000","last_became_active":"2023-07-20T09:50:26.388891+0000","last_became_peered":"2023-07-20T09:50:26.388891+0000","last_unstale":"2023-07-20T09:50:28.678776+0000","last_undegraded":"2023-07-20T09:50:28.678776+0000","last_fullsized":"2023-07-20T09:50:28.678776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680271+0000","last_change":"2023-07-20T09:50:27.684512+0000","last_active":"2023-07-20T09:50:28.680271+0000","last_peered":"2023-07-20T09:50:28.680271+0000","last_clean":"2023-07-20T09:50:28.680271+0000","last_became_active":"2023-07-20T09:50:27.681388+0000","last_became_peered":"2023-07-20T09:50:27.681388+0000","last_unstale":"2023-07-20T09:50:28.680271+0000","last_undegraded":"2023-07-20T09:50:28.680271+0000","last_fullsized":"2023-07-20T09:50:28.680271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674181+0000","last_change":"2023-07-20T09:50:26.385847+0000","last_active":"2023-07-20T09:50:28.674181+0000","last_peered":"2023-07-20T09:50:28.674181+0000","last_clean":"2023-07-20T09:50:28.674181+0000","last_became_active":"2023-07-20T09:50:26.385192+0000","last_became_peered":"2023-07-20T09:50:26.385192+0000","last_unstale":"2023-07-20T09:50:28.674181+0000","last_undegraded":"2023-07-20T09:50:28.674181+0000","last_fullsized":"2023-07-20T09:50:28.674181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738280+0000","last_change":"2023-07-20T09:50:27.704187+0000","last_active":"2023-07-20T09:50:28.738280+0000","last_peered":"2023-07-20T09:50:28.738280+0000","last_clean":"2023-07-20T09:50:28.738280+0000","last_became_active":"2023-07-20T09:50:27.703930+0000","last_became_peered":"2023-07-20T09:50:27.703930+0000","last_unstale":"2023-07-20T09:50:28.738280+0000","last_undegraded":"2023-07-20T09:50:28.738280+0000","last_fullsized":"2023-07-20T09:50:28.738280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678778+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:50:27.678778+0000","last_peered":"2023-07-20T09:50:27.678778+0000","last_clean":"2023-07-20T09:50:27.678778+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:50:27.678778+0000","last_undegraded":"2023-07-20T09:50:27.678778+0000","last_fullsized":"2023-07-20T09:50:27.678778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:08.337522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679858+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:50:28.679858+0000","last_peered":"2023-07-20T09:50:28.679858+0000","last_clean":"2023-07-20T09:50:28.679858+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:50:28.679858+0000","last_undegraded":"2023-07-20T09:50:28.679858+0000","last_fullsized":"2023-07-20T09:50:28.679858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:52.887681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674244+0000","last_change":"2023-07-20T09:50:26.391454+0000","last_active":"2023-07-20T09:50:28.674244+0000","last_peered":"2023-07-20T09:50:28.674244+0000","last_clean":"2023-07-20T09:50:28.674244+0000","last_became_active":"2023-07-20T09:50:26.391057+0000","last_became_peered":"2023-07-20T09:50:26.391057+0000","last_unstale":"2023-07-20T09:50:28.674244+0000","last_undegraded":"2023-07-20T09:50:28.674244+0000","last_fullsized":"2023-07-20T09:50:28.674244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.690840+0000","last_change":"2023-07-20T09:50:27.689061+0000","last_active":"2023-07-20T09:50:27.690840+0000","last_peered":"2023-07-20T09:50:27.690840+0000","last_clean":"2023-07-20T09:50:27.690840+0000","last_became_active":"2023-07-20T09:50:27.688756+0000","last_became_peered":"2023-07-20T09:50:27.688756+0000","last_unstale":"2023-07-20T09:50:27.690840+0000","last_undegraded":"2023-07-20T09:50:27.690840+0000","last_fullsized":"2023-07-20T09:50:27.690840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:22.608674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678601+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:50:27.678601+0000","last_peered":"2023-07-20T09:50:27.678601+0000","last_clean":"2023-07-20T09:50:27.678601+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:50:27.678601+0000","last_undegraded":"2023-07-20T09:50:27.678601+0000","last_fullsized":"2023-07-20T09:50:27.678601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:00.546233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732711+0000","last_change":"2023-07-20T09:50:26.398360+0000","last_active":"2023-07-20T09:50:28.732711+0000","last_peered":"2023-07-20T09:50:28.732711+0000","last_clean":"2023-07-20T09:50:28.732711+0000","last_became_active":"2023-07-20T09:50:26.398066+0000","last_became_peered":"2023-07-20T09:50:26.398066+0000","last_unstale":"2023-07-20T09:50:28.732711+0000","last_undegraded":"2023-07-20T09:50:28.732711+0000","last_fullsized":"2023-07-20T09:50:28.732711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733059+0000","last_change":"2023-07-20T09:50:27.692188+0000","last_active":"2023-07-20T09:50:28.733059+0000","last_peered":"2023-07-20T09:50:28.733059+0000","last_clean":"2023-07-20T09:50:28.733059+0000","last_became_active":"2023-07-20T09:50:27.691911+0000","last_became_peered":"2023-07-20T09:50:27.691911+0000","last_unstale":"2023-07-20T09:50:28.733059+0000","last_undegraded":"2023-07-20T09:50:28.733059+0000","last_fullsized":"2023-07-20T09:50:28.733059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.669753+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:50:27.669753+0000","last_peered":"2023-07-20T09:50:27.669753+0000","last_clean":"2023-07-20T09:50:27.669753+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:50:27.669753+0000","last_undegraded":"2023-07-20T09:50:27.669753+0000","last_fullsized":"2023-07-20T09:50:27.669753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:54.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737810+0000","last_change":"2023-07-20T09:50:26.378417+0000","last_active":"2023-07-20T09:50:28.737810+0000","last_peered":"2023-07-20T09:50:28.737810+0000","last_clean":"2023-07-20T09:50:28.737810+0000","last_became_active":"2023-07-20T09:50:26.378120+0000","last_became_peered":"2023-07-20T09:50:26.378120+0000","last_unstale":"2023-07-20T09:50:28.737810+0000","last_undegraded":"2023-07-20T09:50:28.737810+0000","last_fullsized":"2023-07-20T09:50:28.737810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738299+0000","last_change":"2023-07-20T09:50:27.693115+0000","last_active":"2023-07-20T09:50:28.738299+0000","last_peered":"2023-07-20T09:50:28.738299+0000","last_clean":"2023-07-20T09:50:28.738299+0000","last_became_active":"2023-07-20T09:50:27.692827+0000","last_became_peered":"2023-07-20T09:50:27.692827+0000","last_unstale":"2023-07-20T09:50:28.738299+0000","last_undegraded":"2023-07-20T09:50:28.738299+0000","last_fullsized":"2023-07-20T09:50:28.738299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679628+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:50:28.679628+0000","last_peered":"2023-07-20T09:50:28.679628+0000","last_clean":"2023-07-20T09:50:28.679628+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:50:28.679628+0000","last_undegraded":"2023-07-20T09:50:28.679628+0000","last_fullsized":"2023-07-20T09:50:28.679628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:22.979973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679636+0000","last_change":"2023-07-20T09:50:26.395292+0000","last_active":"2023-07-20T09:50:28.679636+0000","last_peered":"2023-07-20T09:50:28.679636+0000","last_clean":"2023-07-20T09:50:28.679636+0000","last_became_active":"2023-07-20T09:50:26.393257+0000","last_became_peered":"2023-07-20T09:50:26.393257+0000","last_unstale":"2023-07-20T09:50:28.679636+0000","last_undegraded":"2023-07-20T09:50:28.679636+0000","last_fullsized":"2023-07-20T09:50:28.679636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738078+0000","last_change":"2023-07-20T09:50:27.692549+0000","last_active":"2023-07-20T09:50:28.738078+0000","last_peered":"2023-07-20T09:50:28.738078+0000","last_clean":"2023-07-20T09:50:28.738078+0000","last_became_active":"2023-07-20T09:50:27.692235+0000","last_became_peered":"2023-07-20T09:50:27.692235+0000","last_unstale":"2023-07-20T09:50:28.738078+0000","last_undegraded":"2023-07-20T09:50:28.738078+0000","last_fullsized":"2023-07-20T09:50:28.738078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679719+0000","last_change":"2023-07-20T09:50:26.387332+0000","last_active":"2023-07-20T09:50:28.679719+0000","last_peered":"2023-07-20T09:50:28.679719+0000","last_clean":"2023-07-20T09:50:28.679719+0000","last_became_active":"2023-07-20T09:50:26.386908+0000","last_became_peered":"2023-07-20T09:50:26.386908+0000","last_unstale":"2023-07-20T09:50:28.679719+0000","last_undegraded":"2023-07-20T09:50:28.679719+0000","last_fullsized":"2023-07-20T09:50:28.679719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738187+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:50:28.738187+0000","last_peered":"2023-07-20T09:50:28.738187+0000","last_clean":"2023-07-20T09:50:28.738187+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:50:28.738187+0000","last_undegraded":"2023-07-20T09:50:28.738187+0000","last_fullsized":"2023-07-20T09:50:28.738187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:07.387104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738108+0000","last_change":"2023-07-20T09:50:27.693485+0000","last_active":"2023-07-20T09:50:28.738108+0000","last_peered":"2023-07-20T09:50:28.738108+0000","last_clean":"2023-07-20T09:50:28.738108+0000","last_became_active":"2023-07-20T09:50:27.692992+0000","last_became_peered":"2023-07-20T09:50:27.692992+0000","last_unstale":"2023-07-20T09:50:28.738108+0000","last_undegraded":"2023-07-20T09:50:28.738108+0000","last_fullsized":"2023-07-20T09:50:28.738108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738109+0000","last_change":"2023-07-20T09:50:26.385485+0000","last_active":"2023-07-20T09:50:28.738109+0000","last_peered":"2023-07-20T09:50:28.738109+0000","last_clean":"2023-07-20T09:50:28.738109+0000","last_became_active":"2023-07-20T09:50:26.385129+0000","last_became_peered":"2023-07-20T09:50:26.385129+0000","last_unstale":"2023-07-20T09:50:28.738109+0000","last_undegraded":"2023-07-20T09:50:28.738109+0000","last_fullsized":"2023-07-20T09:50:28.738109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678059+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:50:27.678059+0000","last_peered":"2023-07-20T09:50:27.678059+0000","last_clean":"2023-07-20T09:50:27.678059+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:50:27.678059+0000","last_undegraded":"2023-07-20T09:50:27.678059+0000","last_fullsized":"2023-07-20T09:50:27.678059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:11.360983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732950+0000","last_change":"2023-07-20T09:50:27.685907+0000","last_active":"2023-07-20T09:50:28.732950+0000","last_peered":"2023-07-20T09:50:28.732950+0000","last_clean":"2023-07-20T09:50:28.732950+0000","last_became_active":"2023-07-20T09:50:27.685597+0000","last_became_peered":"2023-07-20T09:50:27.685597+0000","last_unstale":"2023-07-20T09:50:28.732950+0000","last_undegraded":"2023-07-20T09:50:28.732950+0000","last_fullsized":"2023-07-20T09:50:28.732950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674778+0000","last_change":"2023-07-20T09:50:26.381821+0000","last_active":"2023-07-20T09:50:28.674778+0000","last_peered":"2023-07-20T09:50:28.674778+0000","last_clean":"2023-07-20T09:50:28.674778+0000","last_became_active":"2023-07-20T09:50:26.381592+0000","last_became_peered":"2023-07-20T09:50:26.381592+0000","last_unstale":"2023-07-20T09:50:28.674778+0000","last_undegraded":"2023-07-20T09:50:28.674778+0000","last_fullsized":"2023-07-20T09:50:28.674778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:57.918845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738166+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:50:28.738166+0000","last_peered":"2023-07-20T09:50:28.738166+0000","last_clean":"2023-07-20T09:50:28.738166+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:50:28.738166+0000","last_undegraded":"2023-07-20T09:50:28.738166+0000","last_fullsized":"2023-07-20T09:50:28.738166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:14.378010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674063+0000","last_change":"2023-07-20T09:50:27.700981+0000","last_active":"2023-07-20T09:50:28.674063+0000","last_peered":"2023-07-20T09:50:28.674063+0000","last_clean":"2023-07-20T09:50:28.674063+0000","last_became_active":"2023-07-20T09:50:27.700684+0000","last_became_peered":"2023-07-20T09:50:27.700684+0000","last_unstale":"2023-07-20T09:50:28.674063+0000","last_undegraded":"2023-07-20T09:50:28.674063+0000","last_fullsized":"2023-07-20T09:50:28.674063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733151+0000","last_change":"2023-07-20T09:50:26.386007+0000","last_active":"2023-07-20T09:50:28.733151+0000","last_peered":"2023-07-20T09:50:28.733151+0000","last_clean":"2023-07-20T09:50:28.733151+0000","last_became_active":"2023-07-20T09:50:26.385678+0000","last_became_peered":"2023-07-20T09:50:26.385678+0000","last_unstale":"2023-07-20T09:50:28.733151+0000","last_undegraded":"2023-07-20T09:50:28.733151+0000","last_fullsized":"2023-07-20T09:50:28.733151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677949+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:50:27.677949+0000","last_peered":"2023-07-20T09:50:27.677949+0000","last_clean":"2023-07-20T09:50:27.677949+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:50:27.677949+0000","last_undegraded":"2023-07-20T09:50:27.677949+0000","last_fullsized":"2023-07-20T09:50:27.677949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:44.763793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679874+0000","last_change":"2023-07-20T09:50:27.680743+0000","last_active":"2023-07-20T09:50:28.679874+0000","last_peered":"2023-07-20T09:50:28.679874+0000","last_clean":"2023-07-20T09:50:28.679874+0000","last_became_active":"2023-07-20T09:50:27.680495+0000","last_became_peered":"2023-07-20T09:50:27.680495+0000","last_unstale":"2023-07-20T09:50:28.679874+0000","last_undegraded":"2023-07-20T09:50:28.679874+0000","last_fullsized":"2023-07-20T09:50:28.679874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679567+0000","last_change":"2023-07-20T09:50:27.682591+0000","last_active":"2023-07-20T09:50:28.679567+0000","last_peered":"2023-07-20T09:50:28.679567+0000","last_clean":"2023-07-20T09:50:28.679567+0000","last_became_active":"2023-07-20T09:50:27.681420+0000","last_became_peered":"2023-07-20T09:50:27.681420+0000","last_unstale":"2023-07-20T09:50:28.679567+0000","last_undegraded":"2023-07-20T09:50:28.679567+0000","last_fullsized":"2023-07-20T09:50:28.679567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680046+0000","last_change":"2023-07-20T09:50:26.391865+0000","last_active":"2023-07-20T09:50:28.680046+0000","last_peered":"2023-07-20T09:50:28.680046+0000","last_clean":"2023-07-20T09:50:28.680046+0000","last_became_active":"2023-07-20T09:50:26.389528+0000","last_became_peered":"2023-07-20T09:50:26.389528+0000","last_unstale":"2023-07-20T09:50:28.680046+0000","last_undegraded":"2023-07-20T09:50:28.680046+0000","last_fullsized":"2023-07-20T09:50:28.680046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738011+0000","last_change":"2023-07-20T09:50:27.693275+0000","last_active":"2023-07-20T09:50:28.738011+0000","last_peered":"2023-07-20T09:50:28.738011+0000","last_clean":"2023-07-20T09:50:28.738011+0000","last_became_active":"2023-07-20T09:50:27.692606+0000","last_became_peered":"2023-07-20T09:50:27.692606+0000","last_unstale":"2023-07-20T09:50:28.738011+0000","last_undegraded":"2023-07-20T09:50:28.738011+0000","last_fullsized":"2023-07-20T09:50:28.738011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.714014+0000","last_change":"2023-07-20T09:50:26.387370+0000","last_active":"2023-07-20T09:50:27.714014+0000","last_peered":"2023-07-20T09:50:27.714014+0000","last_clean":"2023-07-20T09:50:27.714014+0000","last_became_active":"2023-07-20T09:50:26.387057+0000","last_became_peered":"2023-07-20T09:50:26.387057+0000","last_unstale":"2023-07-20T09:50:27.714014+0000","last_undegraded":"2023-07-20T09:50:27.714014+0000","last_fullsized":"2023-07-20T09:50:27.714014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679914+0000","last_change":"2023-07-20T09:50:26.385418+0000","last_active":"2023-07-20T09:50:28.679914+0000","last_peered":"2023-07-20T09:50:28.679914+0000","last_clean":"2023-07-20T09:50:28.679914+0000","last_became_active":"2023-07-20T09:50:26.380033+0000","last_became_peered":"2023-07-20T09:50:26.380033+0000","last_unstale":"2023-07-20T09:50:28.679914+0000","last_undegraded":"2023-07-20T09:50:28.679914+0000","last_fullsized":"2023-07-20T09:50:28.679914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674279+0000","last_change":"2023-07-20T09:50:27.704425+0000","last_active":"2023-07-20T09:50:28.674279+0000","last_peered":"2023-07-20T09:50:28.674279+0000","last_clean":"2023-07-20T09:50:28.674279+0000","last_became_active":"2023-07-20T09:50:27.704141+0000","last_became_peered":"2023-07-20T09:50:27.704141+0000","last_unstale":"2023-07-20T09:50:28.674279+0000","last_undegraded":"2023-07-20T09:50:28.674279+0000","last_fullsized":"2023-07-20T09:50:28.674279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733132+0000","last_change":"2023-07-20T09:50:26.379893+0000","last_active":"2023-07-20T09:50:28.733132+0000","last_peered":"2023-07-20T09:50:28.733132+0000","last_clean":"2023-07-20T09:50:28.733132+0000","last_became_active":"2023-07-20T09:50:26.379557+0000","last_became_peered":"2023-07-20T09:50:26.379557+0000","last_unstale":"2023-07-20T09:50:28.733132+0000","last_undegraded":"2023-07-20T09:50:28.733132+0000","last_fullsized":"2023-07-20T09:50:28.733132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.673906+0000","last_change":"2023-07-20T09:50:27.696687+0000","last_active":"2023-07-20T09:50:28.673906+0000","last_peered":"2023-07-20T09:50:28.673906+0000","last_clean":"2023-07-20T09:50:28.673906+0000","last_became_active":"2023-07-20T09:50:27.696327+0000","last_became_peered":"2023-07-20T09:50:27.696327+0000","last_unstale":"2023-07-20T09:50:28.673906+0000","last_undegraded":"2023-07-20T09:50:28.673906+0000","last_fullsized":"2023-07-20T09:50:28.673906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.682433+0000","last_change":"2023-07-20T09:50:27.678469+0000","last_active":"2023-07-20T09:50:27.682433+0000","last_peered":"2023-07-20T09:50:27.682433+0000","last_clean":"2023-07-20T09:50:27.682433+0000","last_became_active":"2023-07-20T09:50:27.678174+0000","last_became_peered":"2023-07-20T09:50:27.678174+0000","last_unstale":"2023-07-20T09:50:27.682433+0000","last_undegraded":"2023-07-20T09:50:27.682433+0000","last_fullsized":"2023-07-20T09:50:27.682433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:02:18.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674037+0000","last_change":"2023-07-20T09:50:26.386119+0000","last_active":"2023-07-20T09:50:28.674037+0000","last_peered":"2023-07-20T09:50:28.674037+0000","last_clean":"2023-07-20T09:50:28.674037+0000","last_became_active":"2023-07-20T09:50:26.385547+0000","last_became_peered":"2023-07-20T09:50:26.385547+0000","last_unstale":"2023-07-20T09:50:28.674037+0000","last_undegraded":"2023-07-20T09:50:28.674037+0000","last_fullsized":"2023-07-20T09:50:28.674037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:14.790712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733031+0000","last_change":"2023-07-20T09:50:27.686135+0000","last_active":"2023-07-20T09:50:28.733031+0000","last_peered":"2023-07-20T09:50:28.733031+0000","last_clean":"2023-07-20T09:50:28.733031+0000","last_became_active":"2023-07-20T09:50:27.685727+0000","last_became_peered":"2023-07-20T09:50:27.685727+0000","last_unstale":"2023-07-20T09:50:28.733031+0000","last_undegraded":"2023-07-20T09:50:28.733031+0000","last_fullsized":"2023-07-20T09:50:28.733031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737961+0000","last_change":"2023-07-20T09:50:26.380820+0000","last_active":"2023-07-20T09:50:28.737961+0000","last_peered":"2023-07-20T09:50:28.737961+0000","last_clean":"2023-07-20T09:50:28.737961+0000","last_became_active":"2023-07-20T09:50:26.380492+0000","last_became_peered":"2023-07-20T09:50:26.380492+0000","last_unstale":"2023-07-20T09:50:28.737961+0000","last_undegraded":"2023-07-20T09:50:28.737961+0000","last_fullsized":"2023-07-20T09:50:28.737961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674526+0000","last_change":"2023-07-20T09:50:27.701903+0000","last_active":"2023-07-20T09:50:28.674526+0000","last_peered":"2023-07-20T09:50:28.674526+0000","last_clean":"2023-07-20T09:50:28.674526+0000","last_became_active":"2023-07-20T09:50:27.701530+0000","last_became_peered":"2023-07-20T09:50:27.701530+0000","last_unstale":"2023-07-20T09:50:28.674526+0000","last_undegraded":"2023-07-20T09:50:28.674526+0000","last_fullsized":"2023-07-20T09:50:28.674526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679068+0000","last_change":"2023-07-20T09:50:26.394729+0000","last_active":"2023-07-20T09:50:28.679068+0000","last_peered":"2023-07-20T09:50:28.679068+0000","last_clean":"2023-07-20T09:50:28.679068+0000","last_became_active":"2023-07-20T09:50:26.392883+0000","last_became_peered":"2023-07-20T09:50:26.392883+0000","last_unstale":"2023-07-20T09:50:28.679068+0000","last_undegraded":"2023-07-20T09:50:28.679068+0000","last_fullsized":"2023-07-20T09:50:28.679068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.691735+0000","last_change":"2023-07-20T09:50:27.689341+0000","last_active":"2023-07-20T09:50:27.691735+0000","last_peered":"2023-07-20T09:50:27.691735+0000","last_clean":"2023-07-20T09:50:27.691735+0000","last_became_active":"2023-07-20T09:50:27.689034+0000","last_became_peered":"2023-07-20T09:50:27.689034+0000","last_unstale":"2023-07-20T09:50:27.691735+0000","last_undegraded":"2023-07-20T09:50:27.691735+0000","last_fullsized":"2023-07-20T09:50:27.691735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:02:18.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733088+0000","last_change":"2023-07-20T09:50:26.398368+0000","last_active":"2023-07-20T09:50:28.733088+0000","last_peered":"2023-07-20T09:50:28.733088+0000","last_clean":"2023-07-20T09:50:28.733088+0000","last_became_active":"2023-07-20T09:50:26.398065+0000","last_became_peered":"2023-07-20T09:50:26.398065+0000","last_unstale":"2023-07-20T09:50:28.733088+0000","last_undegraded":"2023-07-20T09:50:28.733088+0000","last_fullsized":"2023-07-20T09:50:28.733088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:05.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679485+0000","last_change":"2023-07-20T09:50:27.706756+0000","last_active":"2023-07-20T09:50:28.679485+0000","last_peered":"2023-07-20T09:50:28.679485+0000","last_clean":"2023-07-20T09:50:28.679485+0000","last_became_active":"2023-07-20T09:50:27.706507+0000","last_became_peered":"2023-07-20T09:50:27.706507+0000","last_unstale":"2023-07-20T09:50:28.679485+0000","last_undegraded":"2023-07-20T09:50:28.679485+0000","last_fullsized":"2023-07-20T09:50:28.679485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679270+0000","last_change":"2023-07-20T09:50:26.390120+0000","last_active":"2023-07-20T09:50:28.679270+0000","last_peered":"2023-07-20T09:50:28.679270+0000","last_clean":"2023-07-20T09:50:28.679270+0000","last_became_active":"2023-07-20T09:50:26.389816+0000","last_became_peered":"2023-07-20T09:50:26.389816+0000","last_unstale":"2023-07-20T09:50:28.679270+0000","last_undegraded":"2023-07-20T09:50:28.679270+0000","last_fullsized":"2023-07-20T09:50:28.679270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678908+0000","last_change":"2023-07-20T09:50:27.702550+0000","last_active":"2023-07-20T09:50:28.678908+0000","last_peered":"2023-07-20T09:50:28.678908+0000","last_clean":"2023-07-20T09:50:28.678908+0000","last_became_active":"2023-07-20T09:50:27.702277+0000","last_became_peered":"2023-07-20T09:50:27.702277+0000","last_unstale":"2023-07-20T09:50:28.678908+0000","last_undegraded":"2023-07-20T09:50:28.678908+0000","last_fullsized":"2023-07-20T09:50:28.678908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679629+0000","last_change":"2023-07-20T09:50:26.396668+0000","last_active":"2023-07-20T09:50:28.679629+0000","last_peered":"2023-07-20T09:50:28.679629+0000","last_clean":"2023-07-20T09:50:28.679629+0000","last_became_active":"2023-07-20T09:50:26.396332+0000","last_became_peered":"2023-07-20T09:50:26.396332+0000","last_unstale":"2023-07-20T09:50:28.679629+0000","last_undegraded":"2023-07-20T09:50:28.679629+0000","last_fullsized":"2023-07-20T09:50:28.679629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674405+0000","last_change":"2023-07-20T09:50:27.703228+0000","last_active":"2023-07-20T09:50:28.674405+0000","last_peered":"2023-07-20T09:50:28.674405+0000","last_clean":"2023-07-20T09:50:28.674405+0000","last_became_active":"2023-07-20T09:50:27.701601+0000","last_became_peered":"2023-07-20T09:50:27.701601+0000","last_unstale":"2023-07-20T09:50:28.674405+0000","last_undegraded":"2023-07-20T09:50:28.674405+0000","last_fullsized":"2023-07-20T09:50:28.674405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674510+0000","last_change":"2023-07-20T09:50:26.382031+0000","last_active":"2023-07-20T09:50:28.674510+0000","last_peered":"2023-07-20T09:50:28.674510+0000","last_clean":"2023-07-20T09:50:28.674510+0000","last_became_active":"2023-07-20T09:50:26.381747+0000","last_became_peered":"2023-07-20T09:50:26.381747+0000","last_unstale":"2023-07-20T09:50:28.674510+0000","last_undegraded":"2023-07-20T09:50:28.674510+0000","last_fullsized":"2023-07-20T09:50:28.674510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678817+0000","last_change":"2023-07-20T09:50:27.683183+0000","last_active":"2023-07-20T09:50:28.678817+0000","last_peered":"2023-07-20T09:50:28.678817+0000","last_clean":"2023-07-20T09:50:28.678817+0000","last_became_active":"2023-07-20T09:50:27.682880+0000","last_became_peered":"2023-07-20T09:50:27.682880+0000","last_unstale":"2023-07-20T09:50:28.678817+0000","last_undegraded":"2023-07-20T09:50:28.678817+0000","last_fullsized":"2023-07-20T09:50:28.678817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733093+0000","last_change":"2023-07-20T09:50:26.391296+0000","last_active":"2023-07-20T09:50:28.733093+0000","last_peered":"2023-07-20T09:50:28.733093+0000","last_clean":"2023-07-20T09:50:28.733093+0000","last_became_active":"2023-07-20T09:50:26.391049+0000","last_became_peered":"2023-07-20T09:50:26.391049+0000","last_unstale":"2023-07-20T09:50:28.733093+0000","last_undegraded":"2023-07-20T09:50:28.733093+0000","last_fullsized":"2023-07-20T09:50:28.733093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":83598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:50:31.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:50:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 Processor -- start 2023-07-20T09:50:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 -- start start 2023-07-20T09:50:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5acc15cab0 0x7f5acc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc0b3520 con 0x7f5acc0d0d10 2023-07-20T09:50:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc0cff30 con 0x7f5acc0ce4c0 2023-07-20T09:50:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad3dfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc0d31c0 con 0x7f5acc15cab0 2023-07-20T09:50:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1b96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5acc15cab0 0x7f5acc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1395640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5acc0d0d10 0x7f5acc0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60884/0 (socket says 172.21.15.82:60884) 2023-07-20T09:50:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1395640 1 -- 172.21.15.82:0/1374530760 learned_addr learned my addr 172.21.15.82:0/1374530760 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1b96640 1 -- 172.21.15.82:0/1374530760 >> v1:172.21.15.183:6789/0 conn(0x7f5acc0ce4c0 legacy=0x7f5acc0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1b96640 1 -- 172.21.15.82:0/1374530760 >> v1:172.21.15.82:6789/0 conn(0x7f5acc0d0d10 legacy=0x7f5acc0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad1b96640 1 -- 172.21.15.82:0/1374530760 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0b2910 con 0x7f5acc15cab0 2023-07-20T09:50:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.934+0000 7f5ad0b94640 1 -- 172.21.15.82:0/1374530760 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703810789 0 0) 0x7f5acc0b3520 con 0x7f5acc0d0d10 2023-07-20T09:50:31.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad1b96640 1 --2- 172.21.15.82:0/1374530760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc0d0300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80097c0 tx=0x7f5ac801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd5443c8d92035f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad0b94640 1 -- 172.21.15.82:0/1374530760 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80ab610 con 0x7f5acc15cab0 2023-07-20T09:50:31.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad0b94640 1 -- 172.21.15.82:0/1374530760 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac80ab770 con 0x7f5acc15cab0 2023-07-20T09:50:31.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad0b94640 1 -- 172.21.15.82:0/1374530760 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80abb00 con 0x7f5acc15cab0 2023-07-20T09:50:31.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1374530760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 msgr2=0x7f5acc0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1374530760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc0d0300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80097c0 tx=0x7f5ac801c410 comp rx=0 tx=0).stop 2023-07-20T09:50:31.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1374530760 shutdown_connections 2023-07-20T09:50:31.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1374530760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc0d0300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1374530760 >> 172.21.15.82:0/1374530760 conn(0x7f5acc08c120 msgr2=0x7f5acc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1374530760 shutdown_connections 2023-07-20T09:50:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.938+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1374530760 wait complete. 2023-07-20T09:50:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 Processor -- start 2023-07-20T09:50:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- start start 2023-07-20T09:50:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5acc0ce4c0 0x7f5acc0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5acc0d0d10 0x7f5acc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc1477e0 con 0x7f5acc15cab0 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc156d80 con 0x7f5acc0d0d10 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0b1260 con 0x7f5acc0ce4c0 2023-07-20T09:50:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43172/0 (socket says 172.21.15.82:43172) 2023-07-20T09:50:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 -- 172.21.15.82:0/1046998438 learned_addr learned my addr 172.21.15.82:0/1046998438 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 -- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5acc0ce4c0 msgr2=0x7f5acc0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5acc0ce4c0 0x7f5acc0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 -- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5acc0d0d10 msgr2=0x7f5acc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5acc0d0d10 0x7f5acc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 -- 172.21.15.82:0/1046998438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8009420 con 0x7f5acc15cab0 2023-07-20T09:50:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad2397640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b9e0 tx=0x7f5ac400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400cb20 con 0x7f5acc15cab0 2023-07-20T09:50:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400cc80 con 0x7f5acc15cab0 2023-07-20T09:50:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc0b1540 con 0x7f5acc15cab0 2023-07-20T09:50:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4014680 con 0x7f5acc15cab0 2023-07-20T09:50:31.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.942+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc14e050 con 0x7f5acc15cab0 2023-07-20T09:50:31.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc073c70 con 0x7f5acc15cab0 2023-07-20T09:50:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ac401d3b0 con 0x7f5acc15cab0 2023-07-20T09:50:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ac27fc640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 0x7f5ab0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:31.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ac4083c80 con 0x7f5acc15cab0 2023-07-20T09:50:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ad1b96640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 0x7f5ab0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:31.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.946+0000 7f5ad1b96640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 0x7f5ab0068740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80af000 tx=0x7f5ac8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:31.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:31.950+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ac40510f0 con 0x7f5acc15cab0 2023-07-20T09:50:32.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.094+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5acc0b25c0 con 0x7f5ab0066280 2023-07-20T09:50:32.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.102+0000 7f5ac27fc640 1 -- 172.21.15.82:0/1046998438 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286740 (secure 0 0 0) 0x7f5ac80ab8e0 con 0x7f5ab0066280 2023-07-20T09:50:32.141 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:32.142 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:50:32.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 msgr2=0x7f5ab0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 0x7f5ab0068740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80af000 tx=0x7f5ac8008040 comp rx=0 tx=0).stop 2023-07-20T09:50:32.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 msgr2=0x7f5acc1446d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b9e0 tx=0x7f5ac400bea0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 shutdown_connections 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5ab0066280 0x7f5ab0068740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5acc15cab0 0x7f5acc1446d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5acc0d0d10 0x7f5acc1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 --2- 172.21.15.82:0/1046998438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5acc0ce4c0 0x7f5acc0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 >> 172.21.15.82:0/1046998438 conn(0x7f5acc08c120 msgr2=0x7f5acc06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 shutdown_connections 2023-07-20T09:50:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.106+0000 7f5ad3dfa640 1 -- 172.21.15.82:0/1046998438 wait complete. 2023-07-20T09:50:32.161 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T09:50:31.837229+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219204,"kb_used_data":3016,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755516,"statfs":{"total":773094113280,"available":772869648384,"internally_reserved":0,"allocated":3088384,"data_stored":1849028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001238"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.704516+0000","last_change":"2023-07-20T09:50:27.702234+0000","last_active":"2023-07-20T09:50:27.704516+0000","last_peered":"2023-07-20T09:50:27.704516+0000","last_clean":"2023-07-20T09:50:27.704516+0000","last_became_active":"2023-07-20T09:50:27.701890+0000","last_became_peered":"2023-07-20T09:50:27.701890+0000","last_unstale":"2023-07-20T09:50:27.704516+0000","last_undegraded":"2023-07-20T09:50:27.704516+0000","last_fullsized":"2023-07-20T09:50:27.704516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:22.608674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679258+0000","last_change":"2023-07-20T09:50:27.691896+0000","last_active":"2023-07-20T09:50:28.679258+0000","last_peered":"2023-07-20T09:50:28.679258+0000","last_clean":"2023-07-20T09:50:28.679258+0000","last_became_active":"2023-07-20T09:50:27.691138+0000","last_became_peered":"2023-07-20T09:50:27.691138+0000","last_unstale":"2023-07-20T09:50:28.679258+0000","last_undegraded":"2023-07-20T09:50:28.679258+0000","last_fullsized":"2023-07-20T09:50:28.679258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680090+0000","last_change":"2023-07-20T09:50:27.686197+0000","last_active":"2023-07-20T09:50:28.680090+0000","last_peered":"2023-07-20T09:50:28.680090+0000","last_clean":"2023-07-20T09:50:28.680090+0000","last_became_active":"2023-07-20T09:50:27.685846+0000","last_became_peered":"2023-07-20T09:50:27.685846+0000","last_unstale":"2023-07-20T09:50:28.680090+0000","last_undegraded":"2023-07-20T09:50:28.680090+0000","last_fullsized":"2023-07-20T09:50:28.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:44.021656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.689846+0000","last_change":"2023-07-20T09:50:27.686988+0000","last_active":"2023-07-20T09:50:27.689846+0000","last_peered":"2023-07-20T09:50:27.689846+0000","last_clean":"2023-07-20T09:50:27.689846+0000","last_became_active":"2023-07-20T09:50:27.686647+0000","last_became_peered":"2023-07-20T09:50:27.686647+0000","last_unstale":"2023-07-20T09:50:27.689846+0000","last_undegraded":"2023-07-20T09:50:27.689846+0000","last_fullsized":"2023-07-20T09:50:27.689846+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:12.329493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733017+0000","last_change":"2023-07-20T09:50:27.706718+0000","last_active":"2023-07-20T09:50:28.733017+0000","last_peered":"2023-07-20T09:50:28.733017+0000","last_clean":"2023-07-20T09:50:28.733017+0000","last_became_active":"2023-07-20T09:50:27.706185+0000","last_became_peered":"2023-07-20T09:50:27.706185+0000","last_unstale":"2023-07-20T09:50:28.733017+0000","last_undegraded":"2023-07-20T09:50:28.733017+0000","last_fullsized":"2023-07-20T09:50:28.733017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678715+0000","last_change":"2023-07-20T09:50:27.686831+0000","last_active":"2023-07-20T09:50:28.678715+0000","last_peered":"2023-07-20T09:50:28.678715+0000","last_clean":"2023-07-20T09:50:28.678715+0000","last_became_active":"2023-07-20T09:50:27.686412+0000","last_became_peered":"2023-07-20T09:50:27.686412+0000","last_unstale":"2023-07-20T09:50:28.678715+0000","last_undegraded":"2023-07-20T09:50:28.678715+0000","last_fullsized":"2023-07-20T09:50:28.678715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.694933+0000","last_change":"2023-07-20T09:50:27.692084+0000","last_active":"2023-07-20T09:50:27.694933+0000","last_peered":"2023-07-20T09:50:27.694933+0000","last_clean":"2023-07-20T09:50:27.694933+0000","last_became_active":"2023-07-20T09:50:27.691849+0000","last_became_peered":"2023-07-20T09:50:27.691849+0000","last_unstale":"2023-07-20T09:50:27.694933+0000","last_undegraded":"2023-07-20T09:50:27.694933+0000","last_fullsized":"2023-07-20T09:50:27.694933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679116+0000","last_change":"2023-07-20T09:50:27.690562+0000","last_active":"2023-07-20T09:50:28.679116+0000","last_peered":"2023-07-20T09:50:28.679116+0000","last_clean":"2023-07-20T09:50:28.679116+0000","last_became_active":"2023-07-20T09:50:27.685211+0000","last_became_peered":"2023-07-20T09:50:27.685211+0000","last_unstale":"2023-07-20T09:50:28.679116+0000","last_undegraded":"2023-07-20T09:50:28.679116+0000","last_fullsized":"2023-07-20T09:50:28.679116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732966+0000","last_change":"2023-07-20T09:50:27.705540+0000","last_active":"2023-07-20T09:50:28.732966+0000","last_peered":"2023-07-20T09:50:28.732966+0000","last_clean":"2023-07-20T09:50:28.732966+0000","last_became_active":"2023-07-20T09:50:27.705238+0000","last_became_peered":"2023-07-20T09:50:27.705238+0000","last_unstale":"2023-07-20T09:50:28.732966+0000","last_undegraded":"2023-07-20T09:50:28.732966+0000","last_fullsized":"2023-07-20T09:50:28.732966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679423+0000","last_change":"2023-07-20T09:50:27.692110+0000","last_active":"2023-07-20T09:50:28.679423+0000","last_peered":"2023-07-20T09:50:28.679423+0000","last_clean":"2023-07-20T09:50:28.679423+0000","last_became_active":"2023-07-20T09:50:27.691537+0000","last_became_peered":"2023-07-20T09:50:27.691537+0000","last_unstale":"2023-07-20T09:50:28.679423+0000","last_undegraded":"2023-07-20T09:50:28.679423+0000","last_fullsized":"2023-07-20T09:50:28.679423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680137+0000","last_change":"2023-07-20T09:50:27.693033+0000","last_active":"2023-07-20T09:50:28.680137+0000","last_peered":"2023-07-20T09:50:28.680137+0000","last_clean":"2023-07-20T09:50:28.680137+0000","last_became_active":"2023-07-20T09:50:27.692715+0000","last_became_peered":"2023-07-20T09:50:27.692715+0000","last_unstale":"2023-07-20T09:50:28.680137+0000","last_undegraded":"2023-07-20T09:50:28.680137+0000","last_fullsized":"2023-07-20T09:50:28.680137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:49.858742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.691754+0000","last_change":"2023-07-20T09:50:27.689428+0000","last_active":"2023-07-20T09:50:27.691754+0000","last_peered":"2023-07-20T09:50:27.691754+0000","last_clean":"2023-07-20T09:50:27.691754+0000","last_became_active":"2023-07-20T09:50:27.689088+0000","last_became_peered":"2023-07-20T09:50:27.689088+0000","last_unstale":"2023-07-20T09:50:27.691754+0000","last_undegraded":"2023-07-20T09:50:27.691754+0000","last_fullsized":"2023-07-20T09:50:27.691754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:12.329493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.706464+0000","last_change":"2023-07-20T09:50:27.704247+0000","last_active":"2023-07-20T09:50:27.706464+0000","last_peered":"2023-07-20T09:50:27.706464+0000","last_clean":"2023-07-20T09:50:27.706464+0000","last_became_active":"2023-07-20T09:50:27.703955+0000","last_became_peered":"2023-07-20T09:50:27.703955+0000","last_unstale":"2023-07-20T09:50:27.706464+0000","last_undegraded":"2023-07-20T09:50:27.706464+0000","last_fullsized":"2023-07-20T09:50:27.706464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:46:33.199174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679534+0000","last_change":"2023-07-20T09:50:27.679300+0000","last_active":"2023-07-20T09:50:28.679534+0000","last_peered":"2023-07-20T09:50:28.679534+0000","last_clean":"2023-07-20T09:50:28.679534+0000","last_became_active":"2023-07-20T09:50:27.678826+0000","last_became_peered":"2023-07-20T09:50:27.678826+0000","last_unstale":"2023-07-20T09:50:28.679534+0000","last_undegraded":"2023-07-20T09:50:28.679534+0000","last_fullsized":"2023-07-20T09:50:28.679534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.694912+0000","last_change":"2023-07-20T09:50:27.691224+0000","last_active":"2023-07-20T09:50:27.694912+0000","last_peered":"2023-07-20T09:50:27.694912+0000","last_clean":"2023-07-20T09:50:27.694912+0000","last_became_active":"2023-07-20T09:50:27.690992+0000","last_became_peered":"2023-07-20T09:50:27.690992+0000","last_unstale":"2023-07-20T09:50:27.694912+0000","last_undegraded":"2023-07-20T09:50:27.694912+0000","last_fullsized":"2023-07-20T09:50:27.694912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678697+0000","last_change":"2023-07-20T09:50:27.680234+0000","last_active":"2023-07-20T09:50:28.678697+0000","last_peered":"2023-07-20T09:50:28.678697+0000","last_clean":"2023-07-20T09:50:28.678697+0000","last_became_active":"2023-07-20T09:50:27.679957+0000","last_became_peered":"2023-07-20T09:50:27.679957+0000","last_unstale":"2023-07-20T09:50:28.678697+0000","last_undegraded":"2023-07-20T09:50:28.678697+0000","last_fullsized":"2023-07-20T09:50:28.678697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733011+0000","last_change":"2023-07-20T09:50:27.705338+0000","last_active":"2023-07-20T09:50:28.733011+0000","last_peered":"2023-07-20T09:50:28.733011+0000","last_clean":"2023-07-20T09:50:28.733011+0000","last_became_active":"2023-07-20T09:50:27.704958+0000","last_became_peered":"2023-07-20T09:50:27.704958+0000","last_unstale":"2023-07-20T09:50:28.733011+0000","last_undegraded":"2023-07-20T09:50:28.733011+0000","last_fullsized":"2023-07-20T09:50:28.733011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680236+0000","last_change":"2023-07-20T09:50:27.684311+0000","last_active":"2023-07-20T09:50:28.680236+0000","last_peered":"2023-07-20T09:50:28.680236+0000","last_clean":"2023-07-20T09:50:28.680236+0000","last_became_active":"2023-07-20T09:50:27.680860+0000","last_became_peered":"2023-07-20T09:50:27.680860+0000","last_unstale":"2023-07-20T09:50:28.680236+0000","last_undegraded":"2023-07-20T09:50:28.680236+0000","last_fullsized":"2023-07-20T09:50:28.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:06.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.686343+0000","last_change":"2023-07-20T09:50:27.681256+0000","last_active":"2023-07-20T09:50:27.686343+0000","last_peered":"2023-07-20T09:50:27.686343+0000","last_clean":"2023-07-20T09:50:27.686343+0000","last_became_active":"2023-07-20T09:50:27.680937+0000","last_became_peered":"2023-07-20T09:50:27.680937+0000","last_unstale":"2023-07-20T09:50:27.686343+0000","last_undegraded":"2023-07-20T09:50:27.686343+0000","last_fullsized":"2023-07-20T09:50:27.686343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:16.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678905+0000","last_change":"2023-07-20T09:50:27.681378+0000","last_active":"2023-07-20T09:50:28.678905+0000","last_peered":"2023-07-20T09:50:28.678905+0000","last_clean":"2023-07-20T09:50:28.678905+0000","last_became_active":"2023-07-20T09:50:27.681016+0000","last_became_peered":"2023-07-20T09:50:27.681016+0000","last_unstale":"2023-07-20T09:50:28.678905+0000","last_undegraded":"2023-07-20T09:50:28.678905+0000","last_fullsized":"2023-07-20T09:50:28.678905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711904+0000","last_change":"2023-07-20T09:50:27.708844+0000","last_active":"2023-07-20T09:50:27.711904+0000","last_peered":"2023-07-20T09:50:27.711904+0000","last_clean":"2023-07-20T09:50:27.711904+0000","last_became_active":"2023-07-20T09:50:27.708506+0000","last_became_peered":"2023-07-20T09:50:27.708506+0000","last_unstale":"2023-07-20T09:50:27.711904+0000","last_undegraded":"2023-07-20T09:50:27.711904+0000","last_fullsized":"2023-07-20T09:50:27.711904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732746+0000","last_change":"2023-07-20T09:50:27.693993+0000","last_active":"2023-07-20T09:50:28.732746+0000","last_peered":"2023-07-20T09:50:28.732746+0000","last_clean":"2023-07-20T09:50:28.732746+0000","last_became_active":"2023-07-20T09:50:27.693525+0000","last_became_peered":"2023-07-20T09:50:27.693525+0000","last_unstale":"2023-07-20T09:50:28.732746+0000","last_undegraded":"2023-07-20T09:50:28.732746+0000","last_fullsized":"2023-07-20T09:50:28.732746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674068+0000","last_change":"2023-07-20T09:50:27.703451+0000","last_active":"2023-07-20T09:50:28.674068+0000","last_peered":"2023-07-20T09:50:28.674068+0000","last_clean":"2023-07-20T09:50:28.674068+0000","last_became_active":"2023-07-20T09:50:27.702940+0000","last_became_peered":"2023-07-20T09:50:27.702940+0000","last_unstale":"2023-07-20T09:50:28.674068+0000","last_undegraded":"2023-07-20T09:50:28.674068+0000","last_fullsized":"2023-07-20T09:50:28.674068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711869+0000","last_change":"2023-07-20T09:50:27.708326+0000","last_active":"2023-07-20T09:50:27.711869+0000","last_peered":"2023-07-20T09:50:27.711869+0000","last_clean":"2023-07-20T09:50:27.711869+0000","last_became_active":"2023-07-20T09:50:27.707974+0000","last_became_peered":"2023-07-20T09:50:27.707974+0000","last_unstale":"2023-07-20T09:50:27.711869+0000","last_undegraded":"2023-07-20T09:50:27.711869+0000","last_fullsized":"2023-07-20T09:50:27.711869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738150+0000","last_change":"2023-07-20T09:50:27.692567+0000","last_active":"2023-07-20T09:50:28.738150+0000","last_peered":"2023-07-20T09:50:28.738150+0000","last_clean":"2023-07-20T09:50:28.738150+0000","last_became_active":"2023-07-20T09:50:27.692146+0000","last_became_peered":"2023-07-20T09:50:27.692146+0000","last_unstale":"2023-07-20T09:50:28.738150+0000","last_undegraded":"2023-07-20T09:50:28.738150+0000","last_fullsized":"2023-07-20T09:50:28.738150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738221+0000","last_change":"2023-07-20T09:50:27.692593+0000","last_active":"2023-07-20T09:50:28.738221+0000","last_peered":"2023-07-20T09:50:28.738221+0000","last_clean":"2023-07-20T09:50:28.738221+0000","last_became_active":"2023-07-20T09:50:27.692226+0000","last_became_peered":"2023-07-20T09:50:27.692226+0000","last_unstale":"2023-07-20T09:50:28.738221+0000","last_undegraded":"2023-07-20T09:50:28.738221+0000","last_fullsized":"2023-07-20T09:50:28.738221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679407+0000","last_change":"2023-07-20T09:50:27.683556+0000","last_active":"2023-07-20T09:50:28.679407+0000","last_peered":"2023-07-20T09:50:28.679407+0000","last_clean":"2023-07-20T09:50:28.679407+0000","last_became_active":"2023-07-20T09:50:27.683246+0000","last_became_peered":"2023-07-20T09:50:27.683246+0000","last_unstale":"2023-07-20T09:50:28.679407+0000","last_undegraded":"2023-07-20T09:50:28.679407+0000","last_fullsized":"2023-07-20T09:50:28.679407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738218+0000","last_change":"2023-07-20T09:50:27.690772+0000","last_active":"2023-07-20T09:50:28.738218+0000","last_peered":"2023-07-20T09:50:28.738218+0000","last_clean":"2023-07-20T09:50:28.738218+0000","last_became_active":"2023-07-20T09:50:27.690456+0000","last_became_peered":"2023-07-20T09:50:27.690456+0000","last_unstale":"2023-07-20T09:50:28.738218+0000","last_undegraded":"2023-07-20T09:50:28.738218+0000","last_fullsized":"2023-07-20T09:50:28.738218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674414+0000","last_change":"2023-07-20T09:50:27.701936+0000","last_active":"2023-07-20T09:50:28.674414+0000","last_peered":"2023-07-20T09:50:28.674414+0000","last_clean":"2023-07-20T09:50:28.674414+0000","last_became_active":"2023-07-20T09:50:27.701378+0000","last_became_peered":"2023-07-20T09:50:27.701378+0000","last_unstale":"2023-07-20T09:50:28.674414+0000","last_undegraded":"2023-07-20T09:50:28.674414+0000","last_fullsized":"2023-07-20T09:50:28.674414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679021+0000","last_change":"2023-07-20T09:50:27.682320+0000","last_active":"2023-07-20T09:50:28.679021+0000","last_peered":"2023-07-20T09:50:28.679021+0000","last_clean":"2023-07-20T09:50:28.679021+0000","last_became_active":"2023-07-20T09:50:27.681183+0000","last_became_peered":"2023-07-20T09:50:27.681183+0000","last_unstale":"2023-07-20T09:50:28.679021+0000","last_undegraded":"2023-07-20T09:50:28.679021+0000","last_fullsized":"2023-07-20T09:50:28.679021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674102+0000","last_change":"2023-07-20T09:50:27.703874+0000","last_active":"2023-07-20T09:50:28.674102+0000","last_peered":"2023-07-20T09:50:28.674102+0000","last_clean":"2023-07-20T09:50:28.674102+0000","last_became_active":"2023-07-20T09:50:27.701925+0000","last_became_peered":"2023-07-20T09:50:27.701925+0000","last_unstale":"2023-07-20T09:50:28.674102+0000","last_undegraded":"2023-07-20T09:50:28.674102+0000","last_fullsized":"2023-07-20T09:50:28.674102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.688425+0000","last_change":"2023-07-20T09:50:27.685373+0000","last_active":"2023-07-20T09:50:27.688425+0000","last_peered":"2023-07-20T09:50:27.688425+0000","last_clean":"2023-07-20T09:50:27.688425+0000","last_became_active":"2023-07-20T09:50:27.685083+0000","last_became_peered":"2023-07-20T09:50:27.685083+0000","last_unstale":"2023-07-20T09:50:27.688425+0000","last_undegraded":"2023-07-20T09:50:27.688425+0000","last_fullsized":"2023-07-20T09:50:27.688425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:16.863641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674290+0000","last_change":"2023-07-20T09:50:27.696660+0000","last_active":"2023-07-20T09:50:28.674290+0000","last_peered":"2023-07-20T09:50:28.674290+0000","last_clean":"2023-07-20T09:50:28.674290+0000","last_became_active":"2023-07-20T09:50:27.696285+0000","last_became_peered":"2023-07-20T09:50:27.696285+0000","last_unstale":"2023-07-20T09:50:28.674290+0000","last_undegraded":"2023-07-20T09:50:28.674290+0000","last_fullsized":"2023-07-20T09:50:28.674290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.712869+0000","last_change":"2023-07-20T09:50:26.398520+0000","last_active":"2023-07-20T09:50:27.712869+0000","last_peered":"2023-07-20T09:50:27.712869+0000","last_clean":"2023-07-20T09:50:27.712869+0000","last_became_active":"2023-07-20T09:50:26.398176+0000","last_became_peered":"2023-07-20T09:50:26.398176+0000","last_unstale":"2023-07-20T09:50:27.712869+0000","last_undegraded":"2023-07-20T09:50:27.712869+0000","last_fullsized":"2023-07-20T09:50:27.712869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679549+0000","last_change":"2023-07-20T09:50:27.684529+0000","last_active":"2023-07-20T09:50:28.679549+0000","last_peered":"2023-07-20T09:50:28.679549+0000","last_clean":"2023-07-20T09:50:28.679549+0000","last_became_active":"2023-07-20T09:50:27.684036+0000","last_became_peered":"2023-07-20T09:50:27.684036+0000","last_unstale":"2023-07-20T09:50:28.679549+0000","last_undegraded":"2023-07-20T09:50:28.679549+0000","last_fullsized":"2023-07-20T09:50:28.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:13.421282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732887+0000","last_change":"2023-07-20T09:50:26.384546+0000","last_active":"2023-07-20T09:50:28.732887+0000","last_peered":"2023-07-20T09:50:28.732887+0000","last_clean":"2023-07-20T09:50:28.732887+0000","last_became_active":"2023-07-20T09:50:26.384051+0000","last_became_peered":"2023-07-20T09:50:26.384051+0000","last_unstale":"2023-07-20T09:50:28.732887+0000","last_undegraded":"2023-07-20T09:50:28.732887+0000","last_fullsized":"2023-07-20T09:50:28.732887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:30.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733111+0000","last_change":"2023-07-20T09:50:27.702104+0000","last_active":"2023-07-20T09:50:28.733111+0000","last_peered":"2023-07-20T09:50:28.733111+0000","last_clean":"2023-07-20T09:50:28.733111+0000","last_became_active":"2023-07-20T09:50:27.701753+0000","last_became_peered":"2023-07-20T09:50:27.701753+0000","last_unstale":"2023-07-20T09:50:28.733111+0000","last_undegraded":"2023-07-20T09:50:28.733111+0000","last_fullsized":"2023-07-20T09:50:28.733111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677099+0000","last_change":"2023-07-20T09:50:26.398397+0000","last_active":"2023-07-20T09:50:27.677099+0000","last_peered":"2023-07-20T09:50:27.677099+0000","last_clean":"2023-07-20T09:50:27.677099+0000","last_became_active":"2023-07-20T09:50:26.398035+0000","last_became_peered":"2023-07-20T09:50:26.398035+0000","last_unstale":"2023-07-20T09:50:27.677099+0000","last_undegraded":"2023-07-20T09:50:27.677099+0000","last_fullsized":"2023-07-20T09:50:27.677099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674694+0000","last_change":"2023-07-20T09:50:27.701766+0000","last_active":"2023-07-20T09:50:28.674694+0000","last_peered":"2023-07-20T09:50:28.674694+0000","last_clean":"2023-07-20T09:50:28.674694+0000","last_became_active":"2023-07-20T09:50:27.701453+0000","last_became_peered":"2023-07-20T09:50:27.701453+0000","last_unstale":"2023-07-20T09:50:28.674694+0000","last_undegraded":"2023-07-20T09:50:28.674694+0000","last_fullsized":"2023-07-20T09:50:28.674694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.715565+0000","last_change":"2023-07-20T09:50:26.386136+0000","last_active":"2023-07-20T09:50:27.715565+0000","last_peered":"2023-07-20T09:50:27.715565+0000","last_clean":"2023-07-20T09:50:27.715565+0000","last_became_active":"2023-07-20T09:50:26.385573+0000","last_became_peered":"2023-07-20T09:50:26.385573+0000","last_unstale":"2023-07-20T09:50:27.715565+0000","last_undegraded":"2023-07-20T09:50:27.715565+0000","last_fullsized":"2023-07-20T09:50:27.715565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:06:59.705313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.713145+0000","last_change":"2023-07-20T09:50:26.399349+0000","last_active":"2023-07-20T09:50:27.713145+0000","last_peered":"2023-07-20T09:50:27.713145+0000","last_clean":"2023-07-20T09:50:27.713145+0000","last_became_active":"2023-07-20T09:50:26.398932+0000","last_became_peered":"2023-07-20T09:50:26.398932+0000","last_unstale":"2023-07-20T09:50:27.713145+0000","last_undegraded":"2023-07-20T09:50:27.713145+0000","last_fullsized":"2023-07-20T09:50:27.713145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:45.504134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679283+0000","last_change":"2023-07-20T09:50:27.683608+0000","last_active":"2023-07-20T09:50:28.679283+0000","last_peered":"2023-07-20T09:50:28.679283+0000","last_clean":"2023-07-20T09:50:28.679283+0000","last_became_active":"2023-07-20T09:50:27.683287+0000","last_became_peered":"2023-07-20T09:50:27.683287+0000","last_unstale":"2023-07-20T09:50:28.679283+0000","last_undegraded":"2023-07-20T09:50:28.679283+0000","last_fullsized":"2023-07-20T09:50:28.679283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.713138+0000","last_change":"2023-07-20T09:50:26.398232+0000","last_active":"2023-07-20T09:50:27.713138+0000","last_peered":"2023-07-20T09:50:27.713138+0000","last_clean":"2023-07-20T09:50:27.713138+0000","last_became_active":"2023-07-20T09:50:26.397884+0000","last_became_peered":"2023-07-20T09:50:26.397884+0000","last_unstale":"2023-07-20T09:50:27.713138+0000","last_undegraded":"2023-07-20T09:50:27.713138+0000","last_fullsized":"2023-07-20T09:50:27.713138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678623+0000","last_change":"2023-07-20T09:50:27.692914+0000","last_active":"2023-07-20T09:50:28.678623+0000","last_peered":"2023-07-20T09:50:28.678623+0000","last_clean":"2023-07-20T09:50:28.678623+0000","last_became_active":"2023-07-20T09:50:27.692610+0000","last_became_peered":"2023-07-20T09:50:27.692610+0000","last_unstale":"2023-07-20T09:50:28.678623+0000","last_undegraded":"2023-07-20T09:50:28.678623+0000","last_fullsized":"2023-07-20T09:50:28.678623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.711043+0000","last_change":"2023-07-20T09:50:26.391171+0000","last_active":"2023-07-20T09:50:27.711043+0000","last_peered":"2023-07-20T09:50:27.711043+0000","last_clean":"2023-07-20T09:50:27.711043+0000","last_became_active":"2023-07-20T09:50:26.390823+0000","last_became_peered":"2023-07-20T09:50:26.390823+0000","last_unstale":"2023-07-20T09:50:27.711043+0000","last_undegraded":"2023-07-20T09:50:27.711043+0000","last_fullsized":"2023-07-20T09:50:27.711043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:19.970248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.693878+0000","last_change":"2023-07-20T09:50:27.692283+0000","last_active":"2023-07-20T09:50:27.693878+0000","last_peered":"2023-07-20T09:50:27.693878+0000","last_clean":"2023-07-20T09:50:27.693878+0000","last_became_active":"2023-07-20T09:50:27.691972+0000","last_became_peered":"2023-07-20T09:50:27.691972+0000","last_unstale":"2023-07-20T09:50:27.693878+0000","last_undegraded":"2023-07-20T09:50:27.693878+0000","last_fullsized":"2023-07-20T09:50:27.693878+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:39.685523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679424+0000","last_change":"2023-07-20T09:50:26.387250+0000","last_active":"2023-07-20T09:50:28.679424+0000","last_peered":"2023-07-20T09:50:28.679424+0000","last_clean":"2023-07-20T09:50:28.679424+0000","last_became_active":"2023-07-20T09:50:26.386829+0000","last_became_peered":"2023-07-20T09:50:26.386829+0000","last_unstale":"2023-07-20T09:50:28.679424+0000","last_undegraded":"2023-07-20T09:50:28.679424+0000","last_fullsized":"2023-07-20T09:50:28.679424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732879+0000","last_change":"2023-07-20T09:50:27.693747+0000","last_active":"2023-07-20T09:50:28.732879+0000","last_peered":"2023-07-20T09:50:28.732879+0000","last_clean":"2023-07-20T09:50:28.732879+0000","last_became_active":"2023-07-20T09:50:27.693399+0000","last_became_peered":"2023-07-20T09:50:27.693399+0000","last_unstale":"2023-07-20T09:50:28.732879+0000","last_undegraded":"2023-07-20T09:50:28.732879+0000","last_fullsized":"2023-07-20T09:50:28.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674542+0000","last_change":"2023-07-20T09:50:26.387168+0000","last_active":"2023-07-20T09:50:28.674542+0000","last_peered":"2023-07-20T09:50:28.674542+0000","last_clean":"2023-07-20T09:50:28.674542+0000","last_became_active":"2023-07-20T09:50:26.386895+0000","last_became_peered":"2023-07-20T09:50:26.386895+0000","last_unstale":"2023-07-20T09:50:28.674542+0000","last_undegraded":"2023-07-20T09:50:28.674542+0000","last_fullsized":"2023-07-20T09:50:28.674542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:28.011137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679049+0000","last_change":"2023-07-20T09:50:27.705371+0000","last_active":"2023-07-20T09:50:28.679049+0000","last_peered":"2023-07-20T09:50:28.679049+0000","last_clean":"2023-07-20T09:50:28.679049+0000","last_became_active":"2023-07-20T09:50:27.705101+0000","last_became_peered":"2023-07-20T09:50:27.705101+0000","last_unstale":"2023-07-20T09:50:28.679049+0000","last_undegraded":"2023-07-20T09:50:28.679049+0000","last_fullsized":"2023-07-20T09:50:28.679049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677856+0000","last_change":"2023-07-20T09:50:26.396439+0000","last_active":"2023-07-20T09:50:27.677856+0000","last_peered":"2023-07-20T09:50:27.677856+0000","last_clean":"2023-07-20T09:50:27.677856+0000","last_became_active":"2023-07-20T09:50:26.396127+0000","last_became_peered":"2023-07-20T09:50:26.396127+0000","last_unstale":"2023-07-20T09:50:27.677856+0000","last_undegraded":"2023-07-20T09:50:27.677856+0000","last_fullsized":"2023-07-20T09:50:27.677856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:16.292193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680251+0000","last_change":"2023-07-20T09:50:27.684320+0000","last_active":"2023-07-20T09:50:28.680251+0000","last_peered":"2023-07-20T09:50:28.680251+0000","last_clean":"2023-07-20T09:50:28.680251+0000","last_became_active":"2023-07-20T09:50:27.683970+0000","last_became_peered":"2023-07-20T09:50:27.683970+0000","last_unstale":"2023-07-20T09:50:28.680251+0000","last_undegraded":"2023-07-20T09:50:28.680251+0000","last_fullsized":"2023-07-20T09:50:28.680251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:51.387330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678776+0000","last_change":"2023-07-20T09:50:26.392014+0000","last_active":"2023-07-20T09:50:28.678776+0000","last_peered":"2023-07-20T09:50:28.678776+0000","last_clean":"2023-07-20T09:50:28.678776+0000","last_became_active":"2023-07-20T09:50:26.388891+0000","last_became_peered":"2023-07-20T09:50:26.388891+0000","last_unstale":"2023-07-20T09:50:28.678776+0000","last_undegraded":"2023-07-20T09:50:28.678776+0000","last_fullsized":"2023-07-20T09:50:28.678776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680271+0000","last_change":"2023-07-20T09:50:27.684512+0000","last_active":"2023-07-20T09:50:28.680271+0000","last_peered":"2023-07-20T09:50:28.680271+0000","last_clean":"2023-07-20T09:50:28.680271+0000","last_became_active":"2023-07-20T09:50:27.681388+0000","last_became_peered":"2023-07-20T09:50:27.681388+0000","last_unstale":"2023-07-20T09:50:28.680271+0000","last_undegraded":"2023-07-20T09:50:28.680271+0000","last_fullsized":"2023-07-20T09:50:28.680271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674181+0000","last_change":"2023-07-20T09:50:26.385847+0000","last_active":"2023-07-20T09:50:28.674181+0000","last_peered":"2023-07-20T09:50:28.674181+0000","last_clean":"2023-07-20T09:50:28.674181+0000","last_became_active":"2023-07-20T09:50:26.385192+0000","last_became_peered":"2023-07-20T09:50:26.385192+0000","last_unstale":"2023-07-20T09:50:28.674181+0000","last_undegraded":"2023-07-20T09:50:28.674181+0000","last_fullsized":"2023-07-20T09:50:28.674181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738280+0000","last_change":"2023-07-20T09:50:27.704187+0000","last_active":"2023-07-20T09:50:28.738280+0000","last_peered":"2023-07-20T09:50:28.738280+0000","last_clean":"2023-07-20T09:50:28.738280+0000","last_became_active":"2023-07-20T09:50:27.703930+0000","last_became_peered":"2023-07-20T09:50:27.703930+0000","last_unstale":"2023-07-20T09:50:28.738280+0000","last_undegraded":"2023-07-20T09:50:28.738280+0000","last_fullsized":"2023-07-20T09:50:28.738280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678778+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:50:27.678778+0000","last_peered":"2023-07-20T09:50:27.678778+0000","last_clean":"2023-07-20T09:50:27.678778+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:50:27.678778+0000","last_undegraded":"2023-07-20T09:50:27.678778+0000","last_fullsized":"2023-07-20T09:50:27.678778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:08.337522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679858+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:50:28.679858+0000","last_peered":"2023-07-20T09:50:28.679858+0000","last_clean":"2023-07-20T09:50:28.679858+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:50:28.679858+0000","last_undegraded":"2023-07-20T09:50:28.679858+0000","last_fullsized":"2023-07-20T09:50:28.679858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:52.887681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674244+0000","last_change":"2023-07-20T09:50:26.391454+0000","last_active":"2023-07-20T09:50:28.674244+0000","last_peered":"2023-07-20T09:50:28.674244+0000","last_clean":"2023-07-20T09:50:28.674244+0000","last_became_active":"2023-07-20T09:50:26.391057+0000","last_became_peered":"2023-07-20T09:50:26.391057+0000","last_unstale":"2023-07-20T09:50:28.674244+0000","last_undegraded":"2023-07-20T09:50:28.674244+0000","last_fullsized":"2023-07-20T09:50:28.674244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.690840+0000","last_change":"2023-07-20T09:50:27.689061+0000","last_active":"2023-07-20T09:50:27.690840+0000","last_peered":"2023-07-20T09:50:27.690840+0000","last_clean":"2023-07-20T09:50:27.690840+0000","last_became_active":"2023-07-20T09:50:27.688756+0000","last_became_peered":"2023-07-20T09:50:27.688756+0000","last_unstale":"2023-07-20T09:50:27.690840+0000","last_undegraded":"2023-07-20T09:50:27.690840+0000","last_fullsized":"2023-07-20T09:50:27.690840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:22.608674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678601+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:50:27.678601+0000","last_peered":"2023-07-20T09:50:27.678601+0000","last_clean":"2023-07-20T09:50:27.678601+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:50:27.678601+0000","last_undegraded":"2023-07-20T09:50:27.678601+0000","last_fullsized":"2023-07-20T09:50:27.678601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:00.546233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732711+0000","last_change":"2023-07-20T09:50:26.398360+0000","last_active":"2023-07-20T09:50:28.732711+0000","last_peered":"2023-07-20T09:50:28.732711+0000","last_clean":"2023-07-20T09:50:28.732711+0000","last_became_active":"2023-07-20T09:50:26.398066+0000","last_became_peered":"2023-07-20T09:50:26.398066+0000","last_unstale":"2023-07-20T09:50:28.732711+0000","last_undegraded":"2023-07-20T09:50:28.732711+0000","last_fullsized":"2023-07-20T09:50:28.732711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733059+0000","last_change":"2023-07-20T09:50:27.692188+0000","last_active":"2023-07-20T09:50:28.733059+0000","last_peered":"2023-07-20T09:50:28.733059+0000","last_clean":"2023-07-20T09:50:28.733059+0000","last_became_active":"2023-07-20T09:50:27.691911+0000","last_became_peered":"2023-07-20T09:50:27.691911+0000","last_unstale":"2023-07-20T09:50:28.733059+0000","last_undegraded":"2023-07-20T09:50:28.733059+0000","last_fullsized":"2023-07-20T09:50:28.733059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.669753+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:50:27.669753+0000","last_peered":"2023-07-20T09:50:27.669753+0000","last_clean":"2023-07-20T09:50:27.669753+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:50:27.669753+0000","last_undegraded":"2023-07-20T09:50:27.669753+0000","last_fullsized":"2023-07-20T09:50:27.669753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:54.709891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737810+0000","last_change":"2023-07-20T09:50:26.378417+0000","last_active":"2023-07-20T09:50:28.737810+0000","last_peered":"2023-07-20T09:50:28.737810+0000","last_clean":"2023-07-20T09:50:28.737810+0000","last_became_active":"2023-07-20T09:50:26.378120+0000","last_became_peered":"2023-07-20T09:50:26.378120+0000","last_unstale":"2023-07-20T09:50:28.737810+0000","last_undegraded":"2023-07-20T09:50:28.737810+0000","last_fullsized":"2023-07-20T09:50:28.737810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738299+0000","last_change":"2023-07-20T09:50:27.693115+0000","last_active":"2023-07-20T09:50:28.738299+0000","last_peered":"2023-07-20T09:50:28.738299+0000","last_clean":"2023-07-20T09:50:28.738299+0000","last_became_active":"2023-07-20T09:50:27.692827+0000","last_became_peered":"2023-07-20T09:50:27.692827+0000","last_unstale":"2023-07-20T09:50:28.738299+0000","last_undegraded":"2023-07-20T09:50:28.738299+0000","last_fullsized":"2023-07-20T09:50:28.738299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679628+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:50:28.679628+0000","last_peered":"2023-07-20T09:50:28.679628+0000","last_clean":"2023-07-20T09:50:28.679628+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:50:28.679628+0000","last_undegraded":"2023-07-20T09:50:28.679628+0000","last_fullsized":"2023-07-20T09:50:28.679628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:22.979973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679636+0000","last_change":"2023-07-20T09:50:26.395292+0000","last_active":"2023-07-20T09:50:28.679636+0000","last_peered":"2023-07-20T09:50:28.679636+0000","last_clean":"2023-07-20T09:50:28.679636+0000","last_became_active":"2023-07-20T09:50:26.393257+0000","last_became_peered":"2023-07-20T09:50:26.393257+0000","last_unstale":"2023-07-20T09:50:28.679636+0000","last_undegraded":"2023-07-20T09:50:28.679636+0000","last_fullsized":"2023-07-20T09:50:28.679636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738078+0000","last_change":"2023-07-20T09:50:27.692549+0000","last_active":"2023-07-20T09:50:28.738078+0000","last_peered":"2023-07-20T09:50:28.738078+0000","last_clean":"2023-07-20T09:50:28.738078+0000","last_became_active":"2023-07-20T09:50:27.692235+0000","last_became_peered":"2023-07-20T09:50:27.692235+0000","last_unstale":"2023-07-20T09:50:28.738078+0000","last_undegraded":"2023-07-20T09:50:28.738078+0000","last_fullsized":"2023-07-20T09:50:28.738078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679719+0000","last_change":"2023-07-20T09:50:26.387332+0000","last_active":"2023-07-20T09:50:28.679719+0000","last_peered":"2023-07-20T09:50:28.679719+0000","last_clean":"2023-07-20T09:50:28.679719+0000","last_became_active":"2023-07-20T09:50:26.386908+0000","last_became_peered":"2023-07-20T09:50:26.386908+0000","last_unstale":"2023-07-20T09:50:28.679719+0000","last_undegraded":"2023-07-20T09:50:28.679719+0000","last_fullsized":"2023-07-20T09:50:28.679719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738187+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:50:28.738187+0000","last_peered":"2023-07-20T09:50:28.738187+0000","last_clean":"2023-07-20T09:50:28.738187+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:50:28.738187+0000","last_undegraded":"2023-07-20T09:50:28.738187+0000","last_fullsized":"2023-07-20T09:50:28.738187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:07.387104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738108+0000","last_change":"2023-07-20T09:50:27.693485+0000","last_active":"2023-07-20T09:50:28.738108+0000","last_peered":"2023-07-20T09:50:28.738108+0000","last_clean":"2023-07-20T09:50:28.738108+0000","last_became_active":"2023-07-20T09:50:27.692992+0000","last_became_peered":"2023-07-20T09:50:27.692992+0000","last_unstale":"2023-07-20T09:50:28.738108+0000","last_undegraded":"2023-07-20T09:50:28.738108+0000","last_fullsized":"2023-07-20T09:50:28.738108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738109+0000","last_change":"2023-07-20T09:50:26.385485+0000","last_active":"2023-07-20T09:50:28.738109+0000","last_peered":"2023-07-20T09:50:28.738109+0000","last_clean":"2023-07-20T09:50:28.738109+0000","last_became_active":"2023-07-20T09:50:26.385129+0000","last_became_peered":"2023-07-20T09:50:26.385129+0000","last_unstale":"2023-07-20T09:50:28.738109+0000","last_undegraded":"2023-07-20T09:50:28.738109+0000","last_fullsized":"2023-07-20T09:50:28.738109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.678059+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:50:27.678059+0000","last_peered":"2023-07-20T09:50:27.678059+0000","last_clean":"2023-07-20T09:50:27.678059+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:50:27.678059+0000","last_undegraded":"2023-07-20T09:50:27.678059+0000","last_fullsized":"2023-07-20T09:50:27.678059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:11.360983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732950+0000","last_change":"2023-07-20T09:50:27.685907+0000","last_active":"2023-07-20T09:50:28.732950+0000","last_peered":"2023-07-20T09:50:28.732950+0000","last_clean":"2023-07-20T09:50:28.732950+0000","last_became_active":"2023-07-20T09:50:27.685597+0000","last_became_peered":"2023-07-20T09:50:27.685597+0000","last_unstale":"2023-07-20T09:50:28.732950+0000","last_undegraded":"2023-07-20T09:50:28.732950+0000","last_fullsized":"2023-07-20T09:50:28.732950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674778+0000","last_change":"2023-07-20T09:50:26.381821+0000","last_active":"2023-07-20T09:50:28.674778+0000","last_peered":"2023-07-20T09:50:28.674778+0000","last_clean":"2023-07-20T09:50:28.674778+0000","last_became_active":"2023-07-20T09:50:26.381592+0000","last_became_peered":"2023-07-20T09:50:26.381592+0000","last_unstale":"2023-07-20T09:50:28.674778+0000","last_undegraded":"2023-07-20T09:50:28.674778+0000","last_fullsized":"2023-07-20T09:50:28.674778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:57.918845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738166+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:50:28.738166+0000","last_peered":"2023-07-20T09:50:28.738166+0000","last_clean":"2023-07-20T09:50:28.738166+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:50:28.738166+0000","last_undegraded":"2023-07-20T09:50:28.738166+0000","last_fullsized":"2023-07-20T09:50:28.738166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:14.378010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674063+0000","last_change":"2023-07-20T09:50:27.700981+0000","last_active":"2023-07-20T09:50:28.674063+0000","last_peered":"2023-07-20T09:50:28.674063+0000","last_clean":"2023-07-20T09:50:28.674063+0000","last_became_active":"2023-07-20T09:50:27.700684+0000","last_became_peered":"2023-07-20T09:50:27.700684+0000","last_unstale":"2023-07-20T09:50:28.674063+0000","last_undegraded":"2023-07-20T09:50:28.674063+0000","last_fullsized":"2023-07-20T09:50:28.674063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733151+0000","last_change":"2023-07-20T09:50:26.386007+0000","last_active":"2023-07-20T09:50:28.733151+0000","last_peered":"2023-07-20T09:50:28.733151+0000","last_clean":"2023-07-20T09:50:28.733151+0000","last_became_active":"2023-07-20T09:50:26.385678+0000","last_became_peered":"2023-07-20T09:50:26.385678+0000","last_unstale":"2023-07-20T09:50:28.733151+0000","last_undegraded":"2023-07-20T09:50:28.733151+0000","last_fullsized":"2023-07-20T09:50:28.733151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.677949+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:50:27.677949+0000","last_peered":"2023-07-20T09:50:27.677949+0000","last_clean":"2023-07-20T09:50:27.677949+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:50:27.677949+0000","last_undegraded":"2023-07-20T09:50:27.677949+0000","last_fullsized":"2023-07-20T09:50:27.677949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:44.763793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679874+0000","last_change":"2023-07-20T09:50:27.680743+0000","last_active":"2023-07-20T09:50:28.679874+0000","last_peered":"2023-07-20T09:50:28.679874+0000","last_clean":"2023-07-20T09:50:28.679874+0000","last_became_active":"2023-07-20T09:50:27.680495+0000","last_became_peered":"2023-07-20T09:50:27.680495+0000","last_unstale":"2023-07-20T09:50:28.679874+0000","last_undegraded":"2023-07-20T09:50:28.679874+0000","last_fullsized":"2023-07-20T09:50:28.679874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679567+0000","last_change":"2023-07-20T09:50:27.682591+0000","last_active":"2023-07-20T09:50:28.679567+0000","last_peered":"2023-07-20T09:50:28.679567+0000","last_clean":"2023-07-20T09:50:28.679567+0000","last_became_active":"2023-07-20T09:50:27.681420+0000","last_became_peered":"2023-07-20T09:50:27.681420+0000","last_unstale":"2023-07-20T09:50:28.679567+0000","last_undegraded":"2023-07-20T09:50:28.679567+0000","last_fullsized":"2023-07-20T09:50:28.679567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680046+0000","last_change":"2023-07-20T09:50:26.391865+0000","last_active":"2023-07-20T09:50:28.680046+0000","last_peered":"2023-07-20T09:50:28.680046+0000","last_clean":"2023-07-20T09:50:28.680046+0000","last_became_active":"2023-07-20T09:50:26.389528+0000","last_became_peered":"2023-07-20T09:50:26.389528+0000","last_unstale":"2023-07-20T09:50:28.680046+0000","last_undegraded":"2023-07-20T09:50:28.680046+0000","last_fullsized":"2023-07-20T09:50:28.680046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738011+0000","last_change":"2023-07-20T09:50:27.693275+0000","last_active":"2023-07-20T09:50:28.738011+0000","last_peered":"2023-07-20T09:50:28.738011+0000","last_clean":"2023-07-20T09:50:28.738011+0000","last_became_active":"2023-07-20T09:50:27.692606+0000","last_became_peered":"2023-07-20T09:50:27.692606+0000","last_unstale":"2023-07-20T09:50:28.738011+0000","last_undegraded":"2023-07-20T09:50:28.738011+0000","last_fullsized":"2023-07-20T09:50:28.738011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.714014+0000","last_change":"2023-07-20T09:50:26.387370+0000","last_active":"2023-07-20T09:50:27.714014+0000","last_peered":"2023-07-20T09:50:27.714014+0000","last_clean":"2023-07-20T09:50:27.714014+0000","last_became_active":"2023-07-20T09:50:26.387057+0000","last_became_peered":"2023-07-20T09:50:26.387057+0000","last_unstale":"2023-07-20T09:50:27.714014+0000","last_undegraded":"2023-07-20T09:50:27.714014+0000","last_fullsized":"2023-07-20T09:50:27.714014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679914+0000","last_change":"2023-07-20T09:50:26.385418+0000","last_active":"2023-07-20T09:50:28.679914+0000","last_peered":"2023-07-20T09:50:28.679914+0000","last_clean":"2023-07-20T09:50:28.679914+0000","last_became_active":"2023-07-20T09:50:26.380033+0000","last_became_peered":"2023-07-20T09:50:26.380033+0000","last_unstale":"2023-07-20T09:50:28.679914+0000","last_undegraded":"2023-07-20T09:50:28.679914+0000","last_fullsized":"2023-07-20T09:50:28.679914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674279+0000","last_change":"2023-07-20T09:50:27.704425+0000","last_active":"2023-07-20T09:50:28.674279+0000","last_peered":"2023-07-20T09:50:28.674279+0000","last_clean":"2023-07-20T09:50:28.674279+0000","last_became_active":"2023-07-20T09:50:27.704141+0000","last_became_peered":"2023-07-20T09:50:27.704141+0000","last_unstale":"2023-07-20T09:50:28.674279+0000","last_undegraded":"2023-07-20T09:50:28.674279+0000","last_fullsized":"2023-07-20T09:50:28.674279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733132+0000","last_change":"2023-07-20T09:50:26.379893+0000","last_active":"2023-07-20T09:50:28.733132+0000","last_peered":"2023-07-20T09:50:28.733132+0000","last_clean":"2023-07-20T09:50:28.733132+0000","last_became_active":"2023-07-20T09:50:26.379557+0000","last_became_peered":"2023-07-20T09:50:26.379557+0000","last_unstale":"2023-07-20T09:50:28.733132+0000","last_undegraded":"2023-07-20T09:50:28.733132+0000","last_fullsized":"2023-07-20T09:50:28.733132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.673906+0000","last_change":"2023-07-20T09:50:27.696687+0000","last_active":"2023-07-20T09:50:28.673906+0000","last_peered":"2023-07-20T09:50:28.673906+0000","last_clean":"2023-07-20T09:50:28.673906+0000","last_became_active":"2023-07-20T09:50:27.696327+0000","last_became_peered":"2023-07-20T09:50:27.696327+0000","last_unstale":"2023-07-20T09:50:28.673906+0000","last_undegraded":"2023-07-20T09:50:28.673906+0000","last_fullsized":"2023-07-20T09:50:28.673906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.682433+0000","last_change":"2023-07-20T09:50:27.678469+0000","last_active":"2023-07-20T09:50:27.682433+0000","last_peered":"2023-07-20T09:50:27.682433+0000","last_clean":"2023-07-20T09:50:27.682433+0000","last_became_active":"2023-07-20T09:50:27.678174+0000","last_became_peered":"2023-07-20T09:50:27.678174+0000","last_unstale":"2023-07-20T09:50:27.682433+0000","last_undegraded":"2023-07-20T09:50:27.682433+0000","last_fullsized":"2023-07-20T09:50:27.682433+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:02:18.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674037+0000","last_change":"2023-07-20T09:50:26.386119+0000","last_active":"2023-07-20T09:50:28.674037+0000","last_peered":"2023-07-20T09:50:28.674037+0000","last_clean":"2023-07-20T09:50:28.674037+0000","last_became_active":"2023-07-20T09:50:26.385547+0000","last_became_peered":"2023-07-20T09:50:26.385547+0000","last_unstale":"2023-07-20T09:50:28.674037+0000","last_undegraded":"2023-07-20T09:50:28.674037+0000","last_fullsized":"2023-07-20T09:50:28.674037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:14.790712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733031+0000","last_change":"2023-07-20T09:50:27.686135+0000","last_active":"2023-07-20T09:50:28.733031+0000","last_peered":"2023-07-20T09:50:28.733031+0000","last_clean":"2023-07-20T09:50:28.733031+0000","last_became_active":"2023-07-20T09:50:27.685727+0000","last_became_peered":"2023-07-20T09:50:27.685727+0000","last_unstale":"2023-07-20T09:50:28.733031+0000","last_undegraded":"2023-07-20T09:50:28.733031+0000","last_fullsized":"2023-07-20T09:50:28.733031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737961+0000","last_change":"2023-07-20T09:50:26.380820+0000","last_active":"2023-07-20T09:50:28.737961+0000","last_peered":"2023-07-20T09:50:28.737961+0000","last_clean":"2023-07-20T09:50:28.737961+0000","last_became_active":"2023-07-20T09:50:26.380492+0000","last_became_peered":"2023-07-20T09:50:26.380492+0000","last_unstale":"2023-07-20T09:50:28.737961+0000","last_undegraded":"2023-07-20T09:50:28.737961+0000","last_fullsized":"2023-07-20T09:50:28.737961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674526+0000","last_change":"2023-07-20T09:50:27.701903+0000","last_active":"2023-07-20T09:50:28.674526+0000","last_peered":"2023-07-20T09:50:28.674526+0000","last_clean":"2023-07-20T09:50:28.674526+0000","last_became_active":"2023-07-20T09:50:27.701530+0000","last_became_peered":"2023-07-20T09:50:27.701530+0000","last_unstale":"2023-07-20T09:50:28.674526+0000","last_undegraded":"2023-07-20T09:50:28.674526+0000","last_fullsized":"2023-07-20T09:50:28.674526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679068+0000","last_change":"2023-07-20T09:50:26.394729+0000","last_active":"2023-07-20T09:50:28.679068+0000","last_peered":"2023-07-20T09:50:28.679068+0000","last_clean":"2023-07-20T09:50:28.679068+0000","last_became_active":"2023-07-20T09:50:26.392883+0000","last_became_peered":"2023-07-20T09:50:26.392883+0000","last_unstale":"2023-07-20T09:50:28.679068+0000","last_undegraded":"2023-07-20T09:50:28.679068+0000","last_fullsized":"2023-07-20T09:50:28.679068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-20T09:50:27.691735+0000","last_change":"2023-07-20T09:50:27.689341+0000","last_active":"2023-07-20T09:50:27.691735+0000","last_peered":"2023-07-20T09:50:27.691735+0000","last_clean":"2023-07-20T09:50:27.691735+0000","last_became_active":"2023-07-20T09:50:27.689034+0000","last_became_peered":"2023-07-20T09:50:27.689034+0000","last_unstale":"2023-07-20T09:50:27.691735+0000","last_undegraded":"2023-07-20T09:50:27.691735+0000","last_fullsized":"2023-07-20T09:50:27.691735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:02:18.896805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733088+0000","last_change":"2023-07-20T09:50:26.398368+0000","last_active":"2023-07-20T09:50:28.733088+0000","last_peered":"2023-07-20T09:50:28.733088+0000","last_clean":"2023-07-20T09:50:28.733088+0000","last_became_active":"2023-07-20T09:50:26.398065+0000","last_became_peered":"2023-07-20T09:50:26.398065+0000","last_unstale":"2023-07-20T09:50:28.733088+0000","last_undegraded":"2023-07-20T09:50:28.733088+0000","last_fullsized":"2023-07-20T09:50:28.733088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:05.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679485+0000","last_change":"2023-07-20T09:50:27.706756+0000","last_active":"2023-07-20T09:50:28.679485+0000","last_peered":"2023-07-20T09:50:28.679485+0000","last_clean":"2023-07-20T09:50:28.679485+0000","last_became_active":"2023-07-20T09:50:27.706507+0000","last_became_peered":"2023-07-20T09:50:27.706507+0000","last_unstale":"2023-07-20T09:50:28.679485+0000","last_undegraded":"2023-07-20T09:50:28.679485+0000","last_fullsized":"2023-07-20T09:50:28.679485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679270+0000","last_change":"2023-07-20T09:50:26.390120+0000","last_active":"2023-07-20T09:50:28.679270+0000","last_peered":"2023-07-20T09:50:28.679270+0000","last_clean":"2023-07-20T09:50:28.679270+0000","last_became_active":"2023-07-20T09:50:26.389816+0000","last_became_peered":"2023-07-20T09:50:26.389816+0000","last_unstale":"2023-07-20T09:50:28.679270+0000","last_undegraded":"2023-07-20T09:50:28.679270+0000","last_fullsized":"2023-07-20T09:50:28.679270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678908+0000","last_change":"2023-07-20T09:50:27.702550+0000","last_active":"2023-07-20T09:50:28.678908+0000","last_peered":"2023-07-20T09:50:28.678908+0000","last_clean":"2023-07-20T09:50:28.678908+0000","last_became_active":"2023-07-20T09:50:27.702277+0000","last_became_peered":"2023-07-20T09:50:27.702277+0000","last_unstale":"2023-07-20T09:50:28.678908+0000","last_undegraded":"2023-07-20T09:50:28.678908+0000","last_fullsized":"2023-07-20T09:50:28.678908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679629+0000","last_change":"2023-07-20T09:50:26.396668+0000","last_active":"2023-07-20T09:50:28.679629+0000","last_peered":"2023-07-20T09:50:28.679629+0000","last_clean":"2023-07-20T09:50:28.679629+0000","last_became_active":"2023-07-20T09:50:26.396332+0000","last_became_peered":"2023-07-20T09:50:26.396332+0000","last_unstale":"2023-07-20T09:50:28.679629+0000","last_undegraded":"2023-07-20T09:50:28.679629+0000","last_fullsized":"2023-07-20T09:50:28.679629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674405+0000","last_change":"2023-07-20T09:50:27.703228+0000","last_active":"2023-07-20T09:50:28.674405+0000","last_peered":"2023-07-20T09:50:28.674405+0000","last_clean":"2023-07-20T09:50:28.674405+0000","last_became_active":"2023-07-20T09:50:27.701601+0000","last_became_peered":"2023-07-20T09:50:27.701601+0000","last_unstale":"2023-07-20T09:50:28.674405+0000","last_undegraded":"2023-07-20T09:50:28.674405+0000","last_fullsized":"2023-07-20T09:50:28.674405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674510+0000","last_change":"2023-07-20T09:50:26.382031+0000","last_active":"2023-07-20T09:50:28.674510+0000","last_peered":"2023-07-20T09:50:28.674510+0000","last_clean":"2023-07-20T09:50:28.674510+0000","last_became_active":"2023-07-20T09:50:26.381747+0000","last_became_peered":"2023-07-20T09:50:26.381747+0000","last_unstale":"2023-07-20T09:50:28.674510+0000","last_undegraded":"2023-07-20T09:50:28.674510+0000","last_fullsized":"2023-07-20T09:50:28.674510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678817+0000","last_change":"2023-07-20T09:50:27.683183+0000","last_active":"2023-07-20T09:50:28.678817+0000","last_peered":"2023-07-20T09:50:28.678817+0000","last_clean":"2023-07-20T09:50:28.678817+0000","last_became_active":"2023-07-20T09:50:27.682880+0000","last_became_peered":"2023-07-20T09:50:27.682880+0000","last_unstale":"2023-07-20T09:50:28.678817+0000","last_undegraded":"2023-07-20T09:50:28.678817+0000","last_fullsized":"2023-07-20T09:50:28.678817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733093+0000","last_change":"2023-07-20T09:50:26.391296+0000","last_active":"2023-07-20T09:50:28.733093+0000","last_peered":"2023-07-20T09:50:28.733093+0000","last_clean":"2023-07-20T09:50:28.733093+0000","last_became_active":"2023-07-20T09:50:26.391049+0000","last_became_peered":"2023-07-20T09:50:26.391049+0000","last_unstale":"2023-07-20T09:50:28.733093+0000","last_undegraded":"2023-07-20T09:50:28.733093+0000","last_fullsized":"2023-07-20T09:50:28.733093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":83598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:50:32.167 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T09:50:32.168 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-20T09:50:32.168 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-20T09:50:32.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-20T09:50:32.169 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-20T09:50:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 Processor -- start 2023-07-20T09:50:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 -- start start 2023-07-20T09:50:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0ca040 0x7ff58c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff58c15c910 0x7ff58c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58c0cde70 con 0x7ff58c15d2d0 2023-07-20T09:50:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58c0cbef0 con 0x7ff58c15c910 2023-07-20T09:50:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff593c6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0ca420 con 0x7ff58c0ca040 2023-07-20T09:50:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff59220a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff58c15d2d0 0x7ff58c0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60898/0 (socket says 172.21.15.82:60898) 2023-07-20T09:50:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff59220a640 1 -- 172.21.15.82:0/256974335 learned_addr learned my addr 172.21.15.82:0/256974335 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:32.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591208640 1 --2- 172.21.15.82:0/256974335 >> v2:172.21.15.82:3300/0 conn(0x7ff58c15c910 0x7ff58c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591a09640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0ca040 0x7ff58c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591208640 1 -- 172.21.15.82:0/256974335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0ca040 msgr2=0x7ff58c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591208640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0ca040 0x7ff58c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591208640 1 -- 172.21.15.82:0/256974335 >> v1:172.21.15.82:6789/0 conn(0x7ff58c15d2d0 legacy=0x7ff58c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff591208640 1 -- 172.21.15.82:0/256974335 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c15d760 con 0x7ff58c15c910 2023-07-20T09:50:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.310+0000 7ff590a07640 1 -- 172.21.15.82:0/256974335 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911806776 0 0) 0x7ff58c0cde70 con 0x7ff58c15d2d0 2023-07-20T09:50:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff591208640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15c910 0x7ff58c15cd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097c0 tx=0x7ff57c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52efc397aa666bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff590a07640 1 -- 172.21.15.82:0/256974335 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0ab600 con 0x7ff58c15c910 2023-07-20T09:50:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff590a07640 1 -- 172.21.15.82:0/256974335 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c0a7050 con 0x7ff58c15c910 2023-07-20T09:50:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff590a07640 1 -- 172.21.15.82:0/256974335 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c0ab980 con 0x7ff58c15c910 2023-07-20T09:50:32.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 -- 172.21.15.82:0/256974335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15c910 msgr2=0x7ff58c15cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15c910 0x7ff58c15cd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff57c0097c0 tx=0x7ff57c01c480 comp rx=0 tx=0).stop 2023-07-20T09:50:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 -- 172.21.15.82:0/256974335 shutdown_connections 2023-07-20T09:50:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15c910 0x7ff58c15cd90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 --2- 172.21.15.82:0/256974335 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c0ca040 0x7ff58c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 -- 172.21.15.82:0/256974335 >> 172.21.15.82:0/256974335 conn(0x7ff58c0cada0 msgr2=0x7ff58c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 -- 172.21.15.82:0/256974335 shutdown_connections 2023-07-20T09:50:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.314+0000 7ff593c6d640 1 -- 172.21.15.82:0/256974335 wait complete. 2023-07-20T09:50:32.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 Processor -- start 2023-07-20T09:50:32.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- start start 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff58c0ca040 0x7ff58c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c15c910 0x7ff58c1f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c0adc80 con 0x7ff58c15d2d0 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c15c090 con 0x7ff58c0ca040 2023-07-20T09:50:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58c155ae0 con 0x7ff58c15c910 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43190/0 (socket says 172.21.15.82:43190) 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff591208640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c15c910 0x7ff58c1f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 -- 172.21.15.82:0/2943470410 learned_addr learned my addr 172.21.15.82:0/2943470410 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff591a09640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff58c0ca040 0x7ff58c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 -- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c15c910 msgr2=0x7ff58c1f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c15c910 0x7ff58c1f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 -- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff58c0ca040 msgr2=0x7ff58c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff58c0ca040 0x7ff58c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 -- 172.21.15.82:0/2943470410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57c009420 con 0x7ff58c15d2d0 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff59220a640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c780 tx=0x7ff58400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400ce90 con 0x7ff58c15d2d0 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400a640 con 0x7ff58c15d2d0 2023-07-20T09:50:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58c0ade90 con 0x7ff58c15d2d0 2023-07-20T09:50:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400a9d0 con 0x7ff58c15d2d0 2023-07-20T09:50:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58c0ae450 con 0x7ff58c15d2d0 2023-07-20T09:50:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.318+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58c0ae670 con 0x7ff58c15d2d0 2023-07-20T09:50:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.322+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff58400ab30 con 0x7ff58c15d2d0 2023-07-20T09:50:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.322+0000 7ff5827fc640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 0x7ff570068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.322+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff584083410 con 0x7ff58c15d2d0 2023-07-20T09:50:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.322+0000 7ff591a09640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 0x7ff570068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.322+0000 7ff591a09640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 0x7ff570068740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff588007a60 tx=0x7ff588008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.326+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5840509d0 con 0x7ff58c15d2d0 2023-07-20T09:50:32.544 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-07-20T09:50:32.507+0000 7f8c0da20640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T09:50:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.510+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff58c073c70 con 0x7ff58c15d2d0 2023-07-20T09:50:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.510+0000 7ff5827fc640 1 -- 172.21.15.82:0/2943470410 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7ff584053ff0 con 0x7ff58c15d2d0 2023-07-20T09:50:32.550 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 msgr2=0x7ff570068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 0x7ff570068740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff588007a60 tx=0x7ff588008040 comp rx=0 tx=0).stop 2023-07-20T09:50:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 msgr2=0x7ff58c0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff58400c780 tx=0x7ff58400cc40 comp rx=0 tx=0).stop 2023-07-20T09:50:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 shutdown_connections 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff570066280 0x7ff570068740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c15d2d0 0x7ff58c0b0bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff58c15c910 0x7ff58c1f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 --2- 172.21.15.82:0/2943470410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff58c0ca040 0x7ff58c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 >> 172.21.15.82:0/2943470410 conn(0x7ff58c0cada0 msgr2=0x7ff58c06b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 shutdown_connections 2023-07-20T09:50:32.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.514+0000 7ff593c6d640 1 -- 172.21.15.82:0/2943470410 wait complete. 2023-07-20T09:50:32.570 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":2623212404},{"type":"v1","addr":"172.21.15.82:6833","nonce":2623212404}]},"active_addr":"172.21.15.82:6833/2623212404","active_change":"2023-07-20T09:50:05.820694+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3996830125}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1031146939}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3113011850}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2172384118}]}]} 2023-07-20T09:50:32.574 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-20T09:50:32.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-20T09:50:32.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:32.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.674+0000 7f306280b640 1 Processor -- start 2023-07-20T09:50:32.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 -- start start 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b1cc0 0x7f305c0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f305c0ad720 0x7f305c0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f305c0b02e0 0x7f305c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0b0770 con 0x7f305c0ad720 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0cdd60 con 0x7f305c0b02e0 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f306280b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0b20a0 con 0x7f305c0b1cc0 2023-07-20T09:50:32.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f305c0ad720 0x7f305c0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f305c0ad720 0x7f305c0afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43202/0 (socket says 172.21.15.82:43202) 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 -- 172.21.15.82:0/2871928215 learned_addr learned my addr 172.21.15.82:0/2871928215 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305bfff640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b1cc0 0x7f305c0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f3060da8640 1 --2- 172.21.15.82:0/2871928215 >> v2:172.21.15.183:3300/0 conn(0x7f305c0b02e0 0x7f305c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 -- 172.21.15.82:0/2871928215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b1cc0 msgr2=0x7f305c0b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:32.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b1cc0 0x7f305c0b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 -- 172.21.15.82:0/2871928215 >> v2:172.21.15.183:3300/0 conn(0x7f305c0b02e0 msgr2=0x7f305c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 --2- 172.21.15.82:0/2871928215 >> v2:172.21.15.183:3300/0 conn(0x7f305c0b02e0 0x7f305c06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.678+0000 7f305b7fe640 1 -- 172.21.15.82:0/2871928215 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0cd430 con 0x7f305c0ad720 2023-07-20T09:50:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f305b7fe640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0afda0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f305c066370 tx=0x7f305001c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1002d6de14c6cd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f305affd640 1 -- 172.21.15.82:0/2871928215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500ab600 con 0x7f305c0ad720 2023-07-20T09:50:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f305affd640 1 -- 172.21.15.82:0/2871928215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30500a7050 con 0x7f305c0ad720 2023-07-20T09:50:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f305affd640 1 -- 172.21.15.82:0/2871928215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500ab980 con 0x7f305c0ad720 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- 172.21.15.82:0/2871928215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 msgr2=0x7f305c0afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0afda0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f305c066370 tx=0x7f305001c180 comp rx=0 tx=0).stop 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- 172.21.15.82:0/2871928215 shutdown_connections 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 --2- 172.21.15.82:0/2871928215 >> v2:172.21.15.183:3300/0 conn(0x7f305c0b02e0 0x7f305c06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0afda0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 --2- 172.21.15.82:0/2871928215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b1cc0 0x7f305c0b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- 172.21.15.82:0/2871928215 >> 172.21.15.82:0/2871928215 conn(0x7f305c0cada0 msgr2=0x7f305c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- 172.21.15.82:0/2871928215 shutdown_connections 2023-07-20T09:50:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- 172.21.15.82:0/2871928215 wait complete. 2023-07-20T09:50:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 Processor -- start 2023-07-20T09:50:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.682+0000 7f306280b640 1 -- start start 2023-07-20T09:50:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b02e0 0x7f305c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f305c0b1cc0 0x7f305c0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0ad210 con 0x7f305c0ad720 2023-07-20T09:50:32.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c15b340 con 0x7f305c0b1cc0 2023-07-20T09:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c15b620 con 0x7f305c0b02e0 2023-07-20T09:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43206/0 (socket says 172.21.15.82:43206) 2023-07-20T09:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 -- 172.21.15.82:0/625288748 learned_addr learned my addr 172.21.15.82:0/625288748 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f3060da8640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f305c0b1cc0 0x7f305c0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305b7fe640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b02e0 0x7f305c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 -- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b02e0 msgr2=0x7f305c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b02e0 0x7f305c15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 -- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f305c0b1cc0 msgr2=0x7f305c0c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f305c0b1cc0 0x7f305c0c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 -- 172.21.15.82:0/625288748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500094d0 con 0x7f305c0ad720 2023-07-20T09:50:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f305bfff640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f304c00d800 tx=0x7f304c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00b6c0 con 0x7f305c0ad720 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00b820 con 0x7f305c0ad720 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00bb90 con 0x7f305c0ad720 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c0b12f0 con 0x7f305c0ad720 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c15bbe0 con 0x7f305c0ad720 2023-07-20T09:50:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c073c70 con 0x7f305c0ad720 2023-07-20T09:50:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.686+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f304c00bcf0 con 0x7f305c0ad720 2023-07-20T09:50:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.690+0000 7f3058ff9640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.690+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f304c084150 con 0x7f305c0ad720 2023-07-20T09:50:32.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.690+0000 7f305b7fe640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.690+0000 7f305b7fe640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30500ad000 tx=0x7f30500a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.694+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f304c055110 con 0x7f305c0ad720 2023-07-20T09:50:32.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.842+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f305c0ae8d0 con 0x7f305c0ad720 2023-07-20T09:50:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.842+0000 7f3058ff9640 1 -- 172.21.15.82:0/625288748 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f304c054ca0 con 0x7f305c0ad720 2023-07-20T09:50:32.880 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:32.881 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 msgr2=0x7f3048068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30500ad000 tx=0x7f30500a6000 comp rx=0 tx=0).stop 2023-07-20T09:50:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 msgr2=0x7f305c0accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f304c00d800 tx=0x7f304c00dcc0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 shutdown_connections 2023-07-20T09:50:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f305c0b1cc0 0x7f305c0c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f305c0b02e0 0x7f305c15a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 --2- 172.21.15.82:0/625288748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f305c0ad720 0x7f305c0accd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 >> 172.21.15.82:0/625288748 conn(0x7f305c0cada0 msgr2=0x7f305c0c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 shutdown_connections 2023-07-20T09:50:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:32.846+0000 7f306280b640 1 -- 172.21.15.82:0/625288748 wait complete. 2023-07-20T09:50:32.901 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-20T09:50:32.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:33.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 Processor -- start 2023-07-20T09:50:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 -- start start 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f74cc0c9a70 0x7f74cc0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74cc0cf170 con 0x7f74cc0ce600 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74cc0b0c80 con 0x7f74cc0c9a70 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74d226a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc0aed60 con 0x7f74cc0b0360 2023-07-20T09:50:33.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74cb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f74cc0ce600 0x7f74cc0cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60904/0 (socket says 172.21.15.82:60904) 2023-07-20T09:50:33.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.002+0000 7f74cb7fe640 1 -- 172.21.15.82:0/342113156 learned_addr learned my addr 172.21.15.82:0/342113156 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 --2- 172.21.15.82:0/342113156 >> v2:172.21.15.183:3300/0 conn(0x7f74cc0c9a70 0x7f74cc0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74cbfff640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74caffd640 1 -- 172.21.15.82:0/342113156 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448048240 0 0) 0x7f74cc0cf170 con 0x7f74cc0ce600 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74caffd640 1 -- 172.21.15.82:0/342113156 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b4003530 con 0x7f74cc0ce600 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 -- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 msgr2=0x7f74cc0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc0b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 -- 172.21.15.82:0/342113156 >> v1:172.21.15.82:6789/0 conn(0x7f74cc0ce600 legacy=0x7f74cc0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 -- 172.21.15.82:0/342113156 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0af040 con 0x7f74cc0c9a70 2023-07-20T09:50:33.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74d0807640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0c9a70 0x7f74cc0c9f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009dc0 tx=0x7f74c401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3db0ba7bc4841e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74caffd640 1 -- 172.21.15.82:0/342113156 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a59c0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74caffd640 1 -- 172.21.15.82:0/342113156 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40a5b20 con 0x7f74cc0c9a70 2023-07-20T09:50:33.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.006+0000 7f74caffd640 1 -- 172.21.15.82:0/342113156 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40a5e90 con 0x7f74cc0c9a70 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0c9a70 msgr2=0x7f74cc0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0c9a70 0x7f74cc0c9f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009dc0 tx=0x7f74c401c900 comp rx=0 tx=0).stop 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- 172.21.15.82:0/342113156 shutdown_connections 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0c9a70 0x7f74cc0c9f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- 172.21.15.82:0/342113156 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- 172.21.15.82:0/342113156 >> 172.21.15.82:0/342113156 conn(0x7f74cc098a10 msgr2=0x7f74cc0cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- 172.21.15.82:0/342113156 shutdown_connections 2023-07-20T09:50:33.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- 172.21.15.82:0/342113156 wait complete. 2023-07-20T09:50:33.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 Processor -- start 2023-07-20T09:50:33.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- start start 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0ce600 0x7f74cc0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc156350 con 0x7f74cc0c9a70 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1fcba0 con 0x7f74cc0ce600 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d226a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc1fce80 con 0x7f74cc0b0360 2023-07-20T09:50:33.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43222/0 (socket says 172.21.15.82:43222) 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 -- 172.21.15.82:0/4199037108 learned_addr learned my addr 172.21.15.82:0/4199037108 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74d0807640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0ce600 0x7f74cc0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cbfff640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 -- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 msgr2=0x7f74cc157fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc157fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 -- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0ce600 msgr2=0x7f74cc0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0ce600 0x7f74cc0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.010+0000 7f74cb7fe640 1 -- 172.21.15.82:0/4199037108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c4009a70 con 0x7f74cc0c9a70 2023-07-20T09:50:33.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74cb7fe640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c3c0 tx=0x7f74c000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0005cf0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0005e50 con 0x7f74cc0c9a70 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74cc1fd160 con 0x7f74cc0c9a70 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00072f0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74cc0cb590 con 0x7f74cc0c9a70 2023-07-20T09:50:33.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74cc1fd3a0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74c0007450 con 0x7f74cc0c9a70 2023-07-20T09:50:33.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 0x7f74b8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74c0083310 con 0x7f74cc0c9a70 2023-07-20T09:50:33.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.014+0000 7f74cbfff640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 0x7f74b8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.018+0000 7f74cbfff640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 0x7f74b8068740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009b60 tx=0x7f74bc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.018+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74c00507a0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.166+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74cc156550 con 0x7f74cc0c9a70 2023-07-20T09:50:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74c8ff9640 1 -- 172.21.15.82:0/4199037108 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f74c0053dc0 con 0x7f74cc0c9a70 2023-07-20T09:50:33.206 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:33.207 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:33.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 msgr2=0x7f74b8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 0x7f74b8068740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009b60 tx=0x7f74bc009190 comp rx=0 tx=0).stop 2023-07-20T09:50:33.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 msgr2=0x7f74cc1fc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c3c0 tx=0x7f74c000c880 comp rx=0 tx=0).stop 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 shutdown_connections 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f74b8066280 0x7f74b8068740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74cc0ce600 0x7f74cc0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74cc0c9a70 0x7f74cc1fc4c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 --2- 172.21.15.82:0/4199037108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74cc0b0360 0x7f74cc157fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 >> 172.21.15.82:0/4199037108 conn(0x7f74cc098a10 msgr2=0x7f74cc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 shutdown_connections 2023-07-20T09:50:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.170+0000 7f74d226a640 1 -- 172.21.15.82:0/4199037108 wait complete. 2023-07-20T09:50:33.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-20T09:50:33.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-20T09:50:33.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-20T09:50:33.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-20T09:50:33.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-20T09:50:33.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-20T09:50:33.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-20T09:50:33.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-20T09:50:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.430+0000 7f975726d640 1 Processor -- start 2023-07-20T09:50:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.430+0000 7f975726d640 1 -- start start 2023-07-20T09:50:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975726d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 0x7f97500caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975726d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 0x7f97500c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975726d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975006c410 con 0x7f975015c950 2023-07-20T09:50:33.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975726d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975006c6f0 con 0x7f975006bf80 2023-07-20T09:50:33.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975726d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975006c9d0 con 0x7f97500ccd40 2023-07-20T09:50:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f9754808640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 0x7f97500caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f9755009640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f975015c950 0x7f97500cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34910/0 (socket says 172.21.15.82:34910) 2023-07-20T09:50:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f9755009640 1 -- 172.21.15.82:0/2340525235 learned_addr learned my addr 172.21.15.82:0/2340525235 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975580a640 1 --2- 172.21.15.82:0/2340525235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 0x7f97500c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975580a640 1 -- 172.21.15.82:0/2340525235 >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 msgr2=0x7f97500caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975580a640 1 --2- 172.21.15.82:0/2340525235 >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 0x7f97500caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975580a640 1 -- 172.21.15.82:0/2340525235 >> v1:172.21.15.183:6789/0 conn(0x7f975015c950 legacy=0x7f97500cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f975580a640 1 -- 172.21.15.82:0/2340525235 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975006ccb0 con 0x7f97500ccd40 2023-07-20T09:50:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7f9754808640 1 --2- 172.21.15.82:0/2340525235 >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 0x7f97500caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7fd30398f640 1 Processor -- start 2023-07-20T09:50:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.434+0000 7fd30398f640 1 -- start start 2023-07-20T09:50:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30398f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 0x7fd2fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30398f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 0x7fd2fc164770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30398f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc06fff0 con 0x7fd2fc164cb0 2023-07-20T09:50:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30398f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc1654a0 con 0x7fd2fc160a50 2023-07-20T09:50:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30398f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc06c360 con 0x7fd2fc06bee0 2023-07-20T09:50:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd300f2a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 0x7fd2fc164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd301f2c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd2fc164cb0 0x7fd2fc06cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34924/0 (socket says 172.21.15.82:34924) 2023-07-20T09:50:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd301f2c640 1 -- 172.21.15.82:0/1455788018 learned_addr learned my addr 172.21.15.82:0/1455788018 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd30172b640 1 --2- 172.21.15.82:0/1455788018 >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 0x7fd2fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f39bdbba640 1 Processor -- start 2023-07-20T09:50:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd300f2a640 1 -- 172.21.15.82:0/1455788018 >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 msgr2=0x7fd2fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd300f2a640 1 --2- 172.21.15.82:0/1455788018 >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 0x7fd2fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd2f3fff640 1 -- 172.21.15.82:0/1455788018 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760807506 0 0) 0x7fd2fc06fff0 con 0x7fd2fc164cb0 2023-07-20T09:50:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd300f2a640 1 -- 172.21.15.82:0/1455788018 >> v1:172.21.15.183:6789/0 conn(0x7fd2fc164cb0 legacy=0x7fd2fc06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7fd300f2a640 1 -- 172.21.15.82:0/1455788018 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0702d0 con 0x7fd2fc06bee0 2023-07-20T09:50:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f975580a640 1 --2- 172.21.15.82:0/2340525235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 0x7f97500c92d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9748009d90 tx=0x7f974801d180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648cd21a2039b8e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f9747fff640 1 -- 172.21.15.82:0/2340525235 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480a5740 con 0x7f97500ccd40 2023-07-20T09:50:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f9747fff640 1 -- 172.21.15.82:0/2340525235 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480a58a0 con 0x7f97500ccd40 2023-07-20T09:50:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f9747fff640 1 -- 172.21.15.82:0/2340525235 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480a5c30 con 0x7f97500ccd40 2023-07-20T09:50:33.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.438+0000 7f39bdbba640 1 -- start start 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 -- 172.21.15.82:0/2340525235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 msgr2=0x7f97500c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 --2- 172.21.15.82:0/2340525235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 0x7f97500c92d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9748009d90 tx=0x7f974801d180 comp rx=0 tx=0).stop 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 -- 172.21.15.82:0/2340525235 shutdown_connections 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 --2- 172.21.15.82:0/2340525235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500ccd40 0x7f97500c92d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 --2- 172.21.15.82:0/2340525235 >> v2:172.21.15.82:3300/0 conn(0x7f975006bf80 0x7f97500caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 -- 172.21.15.82:0/2340525235 >> 172.21.15.82:0/2340525235 conn(0x7f97500cb4e0 msgr2=0x7f97500cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39bdbba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39b815cbb0 0x7f39b8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39bdbba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39bdbba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b815c720 con 0x7f39b80b0900 2023-07-20T09:50:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7fd30172b640 1 --2- 172.21.15.82:0/1455788018 >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 0x7fd2fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 -- 172.21.15.82:0/2340525235 shutdown_connections 2023-07-20T09:50:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f975726d640 1 -- 172.21.15.82:0/2340525235 wait complete. 2023-07-20T09:50:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39bdbba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b8159c30 con 0x7f39b815cbb0 2023-07-20T09:50:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39bdbba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8159670 con 0x7f39b8159160 2023-07-20T09:50:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57490/0 (socket says 172.21.15.82:57490) 2023-07-20T09:50:33.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 -- 172.21.15.82:0/44591051 learned_addr learned my addr 172.21.15.82:0/44591051 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 Processor -- start 2023-07-20T09:50:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 -- start start 2023-07-20T09:50:33.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd300f2a640 1 --2- 172.21.15.82:0/1455788018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 0x7fd2fc164770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0097c0 tx=0x7fd2ec01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a8285a5945c8ce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 Processor -- start 2023-07-20T09:50:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd2f3fff640 1 -- 172.21.15.82:0/1455788018 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0ac620 con 0x7fd2fc06bee0 2023-07-20T09:50:33.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd2f3fff640 1 -- 172.21.15.82:0/1455788018 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec0ac780 con 0x7fd2fc06bee0 2023-07-20T09:50:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 -- start start 2023-07-20T09:50:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd2f3fff640 1 -- 172.21.15.82:0/1455788018 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0acb10 con 0x7fd2fc06bee0 2023-07-20T09:50:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 -- 172.21.15.82:0/1455788018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 msgr2=0x7fd2fc164770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 --2- 172.21.15.82:0/1455788018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 0x7fd2fc164770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0097c0 tx=0x7fd2ec01c3e0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 0x7f9750145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 -- 172.21.15.82:0/1455788018 shutdown_connections 2023-07-20T09:50:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 --2- 172.21.15.82:0/1455788018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc06bee0 0x7fd2fc164770 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 --2- 172.21.15.82:0/1455788018 >> v2:172.21.15.82:3300/0 conn(0x7fd2fc160a50 0x7fd2fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 -- 172.21.15.82:0/1455788018 >> 172.21.15.82:0/1455788018 conn(0x7fd2fc0afde0 msgr2=0x7fd2fc0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f975015c950 0x7f9750157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 -- 172.21.15.82:0/44591051 >> v2:172.21.15.82:3300/0 conn(0x7f39b815cbb0 msgr2=0x7f39b8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 --2- 172.21.15.82:0/44591051 >> v2:172.21.15.82:3300/0 conn(0x7f39b815cbb0 0x7f39b8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 -- 172.21.15.82:0/44591051 >> v1:172.21.15.82:6789/0 conn(0x7f39b80b0900 legacy=0x7f39b8152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.442+0000 7f39b7fff640 1 -- 172.21.15.82:0/44591051 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b8159950 con 0x7f39b8159160 2023-07-20T09:50:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 -- 172.21.15.82:0/1455788018 shutdown_connections 2023-07-20T09:50:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7fd30398f640 1 -- 172.21.15.82:0/1455788018 wait complete. 2023-07-20T09:50:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75500ccfb0 0x7f75500ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500b7c20 con 0x7f755015c5f0 2023-07-20T09:50:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755015c9d0 con 0x7f75500ce9a0 2023-07-20T09:50:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f75570a1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500b4980 con 0x7f75500ccfb0 2023-07-20T09:50:33.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f9754808640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f975015c950 0x7f9750157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f9754808640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f975015c950 0x7f9750157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53182/0 (socket says 172.21.15.82:53182) 2023-07-20T09:50:33.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f9755009640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 0x7f9750145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f9755009640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 0x7f9750145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58490/0 (socket says 172.21.15.82:58490) 2023-07-20T09:50:33.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f9754808640 1 -- 172.21.15.82:0/3836630325 learned_addr learned my addr 172.21.15.82:0/3836630325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755589e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75500ccfb0 0x7f75500ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755609f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f755015c5f0 0x7f75500b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42532/0 (socket says 172.21.15.82:42532) 2023-07-20T09:50:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755589e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75500ccfb0 0x7f75500ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53188/0 (socket says 172.21.15.82:53188) 2023-07-20T09:50:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755609f640 1 -- 172.21.15.82:0/4030943504 learned_addr learned my addr 172.21.15.82:0/4030943504 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500c5b30 0x7f975015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c4720 con 0x7f975015c950 2023-07-20T09:50:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c3aa0 con 0x7f97500ccd40 2023-07-20T09:50:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97500c3d80 con 0x7f97500c5b30 2023-07-20T09:50:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f975580a640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500c5b30 0x7f975015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755589e640 1 -- 172.21.15.82:0/4030943504 >> v1:172.21.15.183:6789/0 conn(0x7f75500ce9a0 legacy=0x7f75500b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755589e640 1 -- 172.21.15.82:0/4030943504 >> v1:172.21.15.82:6789/0 conn(0x7f755015c5f0 legacy=0x7f75500b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.446+0000 7f755589e640 1 -- 172.21.15.82:0/4030943504 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500ce030 con 0x7f75500ccfb0 2023-07-20T09:50:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 -- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500c5b30 msgr2=0x7f975015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97500c5b30 0x7f975015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 -- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f975015c950 msgr2=0x7f9750157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f975015c950 0x7f9750157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009a70 con 0x7f97500ccd40 2023-07-20T09:50:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 Processor -- start 2023-07-20T09:50:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 -- start start 2023-07-20T09:50:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9755009640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 0x7f9750145df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c530 tx=0x7f974c00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7faffb431640 1 Processor -- start 2023-07-20T09:50:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39b7fff640 1 --2- 172.21.15.82:0/44591051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009870 tx=0x7f39a001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8212cf3ab97d2760 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 0x7fd2fc162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc160a50 0x7fd2fc162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2fc164cb0 0x7fd2fc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc15d440 con 0x7fd2fc06bee0 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ce760 con 0x7fd2fc164cb0 2023-07-20T09:50:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30398f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ce480 con 0x7fd2fc160a50 2023-07-20T09:50:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39b67fc640 1 -- 172.21.15.82:0/44591051 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00ac600 con 0x7f39b8159160 2023-07-20T09:50:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39b67fc640 1 -- 172.21.15.82:0/44591051 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00a8050 con 0x7f39b8159160 2023-07-20T09:50:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39b67fc640 1 -- 172.21.15.82:0/44591051 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00ac980 con 0x7f39b8159160 2023-07-20T09:50:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7faffb431640 1 -- start start 2023-07-20T09:50:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30172b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 0x7fd2fc162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30172b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 0x7fd2fc162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53200/0 (socket says 172.21.15.82:53200) 2023-07-20T09:50:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd30172b640 1 -- 172.21.15.82:0/2312625759 learned_addr learned my addr 172.21.15.82:0/2312625759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 -- 172.21.15.82:0/44591051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 msgr2=0x7f39b80b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 --2- 172.21.15.82:0/44591051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009870 tx=0x7f39a001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 -- 172.21.15.82:0/44591051 shutdown_connections 2023-07-20T09:50:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 --2- 172.21.15.82:0/44591051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b8159160 0x7f39b80b1bf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 --2- 172.21.15.82:0/44591051 >> v2:172.21.15.82:3300/0 conn(0x7f39b815cbb0 0x7f39b8158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f39bdbba640 1 -- 172.21.15.82:0/44591051 >> 172.21.15.82:0/44591051 conn(0x7f39b80afde0 msgr2=0x7f39b80b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7fd300f2a640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc160a50 0x7fd2fc162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f39bdbba640 1 -- 172.21.15.82:0/44591051 shutdown_connections 2023-07-20T09:50:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f39bdbba640 1 -- 172.21.15.82:0/44591051 wait complete. 2023-07-20T09:50:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 -- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2fc164cb0 msgr2=0x7fd2fc157f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-20T09:50:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2fc164cb0 0x7fd2fc157f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 -- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 msgr2=0x7fd2fc162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 0x7fd2fc162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f755589e640 1 --2- 172.21.15.82:0/4030943504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75500ce460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75400097c0 tx=0x7f754001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4817ac94f450f08 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0074e0 con 0x7f97500ccd40 2023-07-20T09:50:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c007640 con 0x7f97500ccd40 2023-07-20T09:50:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c004a30 con 0x7f97500ccd40 2023-07-20T09:50:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec009420 con 0x7fd2fc160a50 2023-07-20T09:50:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd30172b640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2fc06bee0 0x7fd2fc162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:33.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd300f2a640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc160a50 0x7fd2fc162f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0ac000 tx=0x7fd2ec019180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f755509d640 1 -- 172.21.15.82:0/4030943504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400a8970 con 0x7f75500ccfb0 2023-07-20T09:50:33.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f755509d640 1 -- 172.21.15.82:0/4030943504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400a8ad0 con 0x7f75500ccfb0 2023-07-20T09:50:33.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f755509d640 1 -- 172.21.15.82:0/4030943504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400a8e60 con 0x7f75500ccfb0 2023-07-20T09:50:33.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f75570a1640 1 -- 172.21.15.82:0/4030943504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 msgr2=0x7f75500ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f75570a1640 1 --2- 172.21.15.82:0/4030943504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75500ce460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f75400097c0 tx=0x7f754001ec70 comp rx=0 tx=0).stop 2023-07-20T09:50:33.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f3460869640 1 Processor -- start 2023-07-20T09:50:33.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffb431640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faff4158620 0x7faff40cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffb431640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faff406c0e0 0x7faff406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffb431640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40c90e0 con 0x7faff40ca930 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffb431640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40c98f0 con 0x7faff406c0e0 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffb431640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40cc3b0 con 0x7faff4158620 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faff4158620 0x7faff40cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faff4158620 0x7faff40cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58504/0 (socket says 172.21.15.82:58504) 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 -- 172.21.15.82:0/3195445796 learned_addr learned my addr 172.21.15.82:0/3195445796 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faff9c2e640 1 --2- 172.21.15.82:0/3195445796 >> v2:172.21.15.82:3300/0 conn(0x7faff406c0e0 0x7faff406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 -- 172.21.15.82:0/3195445796 >> v2:172.21.15.82:3300/0 conn(0x7faff406c0e0 msgr2=0x7faff406f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 --2- 172.21.15.82:0/3195445796 >> v2:172.21.15.82:3300/0 conn(0x7faff406c0e0 0x7faff406f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 -- 172.21.15.82:0/3195445796 >> v1:172.21.15.82:6789/0 conn(0x7faff40ca930 legacy=0x7faff40ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7faffa42f640 1 -- 172.21.15.82:0/3195445796 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40c9330 con 0x7faff4158620 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97500c4060 con 0x7f97500ccd40 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9750146330 con 0x7f97500ccd40 2023-07-20T09:50:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97500ca020 con 0x7f97500ccd40 2023-07-20T09:50:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f75570a1640 1 -- 172.21.15.82:0/4030943504 shutdown_connections 2023-07-20T09:50:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f75570a1640 1 --2- 172.21.15.82:0/4030943504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75500ce460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f75570a1640 1 -- 172.21.15.82:0/4030943504 >> 172.21.15.82:0/4030943504 conn(0x7f7550065710 msgr2=0x7f7550065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0b5410 con 0x7fd2fc160a50 2023-07-20T09:50:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec0b5570 con 0x7fd2fc160a50 2023-07-20T09:50:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd30398f640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc1538a0 con 0x7fd2fc160a50 2023-07-20T09:50:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f39bdbba640 1 Processor -- start 2023-07-20T09:50:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec0b5900 con 0x7fd2fc160a50 2023-07-20T09:50:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f3460869640 1 -- start start 2023-07-20T09:50:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7fd30398f640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc153e60 con 0x7fd2fc160a50 2023-07-20T09:50:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f39bdbba640 1 -- start start 2023-07-20T09:50:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f1d5af34640 1 Processor -- start 2023-07-20T09:50:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.450+0000 7f1d5af34640 1 -- start start 2023-07-20T09:50:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d5af34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d540cd430 0x7f1d540c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d5af34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d54160e60 con 0x7f1d540cd810 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d5af34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540c9220 con 0x7f1d540cafc0 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d5af34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54161120 con 0x7f1d540cd430 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d59731640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1d540cd810 0x7f1d540ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42554/0 (socket says 172.21.15.82:42554) 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d59731640 1 -- 172.21.15.82:0/2749811323 learned_addr learned my addr 172.21.15.82:0/2749811323 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842878572 0 0) 0x7f1d54160e60 con 0x7f1d540cd810 2023-07-20T09:50:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d40003530 con 0x7f1d540cd810 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845430274 0 0) 0x7f1d40003530 con 0x7f1d540cd810 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 >> v2:172.21.15.82:3300/0 conn(0x7f1d540cd430 msgr2=0x7f1d540c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 --2- 172.21.15.82:0/2749811323 >> v2:172.21.15.82:3300/0 conn(0x7f1d540cd430 0x7f1d540c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 >> v1:172.21.15.183:6789/0 conn(0x7f1d540cafc0 legacy=0x7f1d540cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54161400 con 0x7f1d540cd810 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f1d44001680 con 0x7f1d540cd810 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 >> v1:172.21.15.82:6789/0 conn(0x7f1d540cd810 legacy=0x7f1d540ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40003980 0x7f1d40003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 0x7f1d40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.454+0000 7f1d58f30640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d400052b0 0x7f1d4000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54161120 con 0x7f1d400047d0 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4002e1c0 con 0x7f1d40003980 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4002e380 con 0x7f1d400052b0 2023-07-20T09:50:33.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 0x7f1d40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f974c004b90 con 0x7f97500ccd40 2023-07-20T09:50:33.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 -- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d400052b0 msgr2=0x7f1d4000b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-20T09:50:33.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2fc070db0 con 0x7fd2fc160a50 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f75570a1640 1 -- 172.21.15.82:0/4030943504 shutdown_connections 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d400052b0 0x7f1d4000b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 -- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40003980 msgr2=0x7f1d40003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40003980 0x7f1d40003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d59731640 1 -- 172.21.15.82:0/2749811323 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54161400 con 0x7f1d400047d0 2023-07-20T09:50:33.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f1d5a733640 1 -- 172.21.15.82:0/2749811323 reap_dead start 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f3460869640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f345c163fc0 0x7f345c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f3460869640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f3460869640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c06c0c0 con 0x7f345c06bc60 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f3460869640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c1643a0 con 0x7f345c163fc0 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f3460869640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c93e0 con 0x7f345c0c8de0 2023-07-20T09:50:33.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57546/0 (socket says 172.21.15.82:57546) 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 -- 172.21.15.82:0/1649889325 learned_addr learned my addr 172.21.15.82:0/1649889325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345b7fe640 1 --2- 172.21.15.82:0/1649889325 >> v2:172.21.15.183:3300/0 conn(0x7f345c163fc0 0x7f345c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 -- 172.21.15.82:0/1649889325 >> v2:172.21.15.183:3300/0 conn(0x7f345c163fc0 msgr2=0x7f345c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 --2- 172.21.15.82:0/1649889325 >> v2:172.21.15.183:3300/0 conn(0x7f345c163fc0 0x7f345c06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 -- 172.21.15.82:0/1649889325 >> v1:172.21.15.183:6789/0 conn(0x7f345c06bc60 legacy=0x7f345c0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f345bfff640 1 -- 172.21.15.82:0/1649889325 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0c96c0 con 0x7f345c0c8de0 2023-07-20T09:50:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f75570a1640 1 -- 172.21.15.82:0/4030943504 wait complete. 2023-07-20T09:50:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39b80b0900 0x7f39b8143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b8159160 0x7f39b815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 0x7f39b8147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8158710 con 0x7f39b8159160 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8157230 con 0x7f39b80b0900 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f39bdbba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8152390 con 0x7f39b815cbb0 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97340662d0 0x7f9734068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f974c083630 con 0x7f97500ccd40 2023-07-20T09:50:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f973406eb90 0x7f9734070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9734071660 con 0x7f973406eb90 2023-07-20T09:50:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f974c0839a0 con 0x7f97500ccd40 2023-07-20T09:50:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.458+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2ec0b3040 con 0x7fd2fc160a50 2023-07-20T09:50:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffa42f640 1 --2- 172.21.15.82:0/3195445796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff4158620 0x7faff40cd9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faff40b0be0 tx=0x7fafec01e950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=474abed5db43b9f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f975580a640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f973406eb90 0x7f9734070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f9754808640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97340662d0 0x7f9734068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 Processor -- start 2023-07-20T09:50:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd2f1ffb640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd2e8066410 0x7fd2e80688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2ec11dd70 con 0x7fd2fc160a50 2023-07-20T09:50:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f9754808640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97340662d0 0x7f9734068790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97501f8000 tx=0x7f9740008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd2f1ffb640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7fd2e806ecd0 0x7fd2e80710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd30172b640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd2e8066410 0x7fd2e80688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2e80717a0 con 0x7fd2e806ecd0 2023-07-20T09:50:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2ec120390 con 0x7fd2fc160a50 2023-07-20T09:50:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 -- start start 2023-07-20T09:50:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d59731640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 0x7f1d40004c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c260 tx=0x7f1d4401f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61015bddbc94add server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f975580a640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f973406eb90 0x7f9734070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd301f2c640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7fd2e806ecd0 0x7fd2e80710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd30172b640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd2e8066410 0x7fd2e80688d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009e00 tx=0x7fd2f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75501f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 0x7f755006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755015c5f0 0x7f75500d2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755006de20 con 0x7f75500ccfb0 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755006cfb0 con 0x7f755015c5f0 2023-07-20T09:50:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75570a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755006d1a0 con 0x7f75500ce9a0 2023-07-20T09:50:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44005ae0 con 0x7f1d400047d0 2023-07-20T09:50:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440ab070 con 0x7f1d400047d0 2023-07-20T09:50:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d58f30640 1 -- 172.21.15.82:0/2749811323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44005ae0 con 0x7f1d400047d0 2023-07-20T09:50:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faff942d640 1 -- 172.21.15.82:0/3195445796 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0a7a20 con 0x7faff4158620 2023-07-20T09:50:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faff942d640 1 -- 172.21.15.82:0/3195445796 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec0ab070 con 0x7faff4158620 2023-07-20T09:50:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faff942d640 1 -- 172.21.15.82:0/3195445796 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0a7da0 con 0x7faff4158620 2023-07-20T09:50:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7fd301f2c640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7fd2e806ecd0 0x7fd2e80710f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d5af34640 1 -- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 msgr2=0x7f1d40004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d5af34640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 0x7f1d40004c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c260 tx=0x7f1d4401f410 comp rx=0 tx=0).stop 2023-07-20T09:50:33.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 0x7f39b8147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 0x7f39b8147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57554/0 (socket says 172.21.15.82:57554) 2023-07-20T09:50:33.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b7fff640 1 -- 172.21.15.82:0/1984786490 learned_addr learned my addr 172.21.15.82:0/1984786490 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 -- 172.21.15.82:0/3195445796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff4158620 msgr2=0x7faff40cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 --2- 172.21.15.82:0/3195445796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff4158620 0x7faff40cd9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faff40b0be0 tx=0x7fafec01e950 comp rx=0 tx=0).stop 2023-07-20T09:50:33.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b77fe640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39b80b0900 0x7f39b8143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b6ffd640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b8159160 0x7f39b815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d5af34640 1 -- 172.21.15.82:0/2749811323 shutdown_connections 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d5af34640 1 --2- 172.21.15.82:0/2749811323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d400047d0 0x7f1d40004c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f1d5af34640 1 -- 172.21.15.82:0/2749811323 >> 172.21.15.82:0/2749811323 conn(0x7f1d540afb90 msgr2=0x7f1d540affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 -- 172.21.15.82:0/3195445796 shutdown_connections 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 --2- 172.21.15.82:0/3195445796 >> v2:172.21.15.82:3300/0 conn(0x7faff406c0e0 0x7faff406f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 --2- 172.21.15.82:0/3195445796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff4158620 0x7faff40cd9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7faffb431640 1 -- 172.21.15.82:0/3195445796 >> 172.21.15.82:0/3195445796 conn(0x7faff40afb90 msgr2=0x7faff40affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== osd.0 v2:172.21.15.82:6808/1720305563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9734071660 con 0x7f973406eb90 2023-07-20T09:50:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f755589e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 0x7f755006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f755589e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 0x7f755006ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57558/0 (socket says 172.21.15.82:57558) 2023-07-20T09:50:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f755589e640 1 -- 172.21.15.82:0/144901292 learned_addr learned my addr 172.21.15.82:0/144901292 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f75568a0640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755015c5f0 0x7f75500d2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f1d5af34640 1 -- 172.21.15.82:0/2749811323 shutdown_connections 2023-07-20T09:50:33.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755609f640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75501f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f345bfff640 1 --2- 172.21.15.82:0/1649889325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3450009870 tx=0x7f345001c550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2297efe83fafb7d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== osd.1 v2:172.21.15.82:6809/403607720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd2e80717a0 con 0x7fd2e806ecd0 2023-07-20T09:50:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b7fff640 1 -- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39b80b0900 msgr2=0x7f39b8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.462+0000 7f39b7fff640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39b80b0900 0x7f39b8143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39b7fff640 1 -- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b8159160 msgr2=0x7f39b815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39b7fff640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39b8159160 0x7f39b815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39b7fff640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00094d0 con 0x7f39b815cbb0 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 -- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755015c5f0 msgr2=0x7f75500d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f755015c5f0 0x7f75500d2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 -- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 msgr2=0x7f75501f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75500ccfb0 0x7f75501f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540009420 con 0x7f75500ce9a0 2023-07-20T09:50:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f1d5af34640 1 -- 172.21.15.82:0/2749811323 wait complete. 2023-07-20T09:50:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7faffb431640 1 -- 172.21.15.82:0/3195445796 shutdown_connections 2023-07-20T09:50:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f755589e640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 0x7f755006ca70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f754001b880 tx=0x7f754001ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7faffb431640 1 -- 172.21.15.82:0/3195445796 wait complete. 2023-07-20T09:50:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f345a7fc640 1 -- 172.21.15.82:0/1649889325 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500a9610 con 0x7f345c0c8de0 2023-07-20T09:50:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f345a7fc640 1 -- 172.21.15.82:0/1649889325 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500a9770 con 0x7f345c0c8de0 2023-07-20T09:50:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f345a7fc640 1 -- 172.21.15.82:0/1649889325 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500a9b40 con 0x7f345c0c8de0 2023-07-20T09:50:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39b7fff640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 0x7f39b8147db0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009870 tx=0x7f39a001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00b7620 con 0x7f39b815cbb0 2023-07-20T09:50:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a00b7780 con 0x7f39b815cbb0 2023-07-20T09:50:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a00b7af0 con 0x7f39b815cbb0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39bdbba640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8158430 con 0x7f39b815cbb0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f39bdbba640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b80af5c0 con 0x7f39b815cbb0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400b9610 con 0x7f75500ce9a0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400b9790 con 0x7f75500ce9a0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400b9b40 con 0x7f75500ce9a0 2023-07-20T09:50:33.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755006d480 con 0x7f75500ce9a0 2023-07-20T09:50:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755006da40 con 0x7f75500ce9a0 2023-07-20T09:50:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f1d5af34640 1 Processor -- start 2023-07-20T09:50:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 -- 172.21.15.82:0/1649889325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 msgr2=0x7f345c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 --2- 172.21.15.82:0/1649889325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3450009870 tx=0x7f345001c550 comp rx=0 tx=0).stop 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 -- 172.21.15.82:0/1649889325 shutdown_connections 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 --2- 172.21.15.82:0/1649889325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c06f540 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 --2- 172.21.15.82:0/1649889325 >> v2:172.21.15.183:3300/0 conn(0x7f345c163fc0 0x7f345c06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 -- 172.21.15.82:0/1649889325 >> 172.21.15.82:0/1649889325 conn(0x7f345c0ce080 msgr2=0x7f345c0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 -- 172.21.15.82:0/1649889325 shutdown_connections 2023-07-20T09:50:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7faffb431640 1 Processor -- start 2023-07-20T09:50:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f1d5af34640 1 -- start start 2023-07-20T09:50:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 0x7f1d541605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7f3460869640 1 -- 172.21.15.82:0/1649889325 wait complete. 2023-07-20T09:50:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f7544ff9640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75500cd790 con 0x7f75500ce9a0 2023-07-20T09:50:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 Processor -- start 2023-07-20T09:50:33.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 0x7f1d541605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 0x7f1d541605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58564/0 (socket says 172.21.15.82:58564) 2023-07-20T09:50:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d541577a0 0x7f1d540c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 -- 172.21.15.82:0/212541889 learned_addr learned my addr 172.21.15.82:0/212541889 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d540b0d80 0x7f1d54163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 -- start start 2023-07-20T09:50:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.466+0000 7faffb431640 1 -- start start 2023-07-20T09:50:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54157c00 con 0x7f1d541577a0 2023-07-20T09:50:33.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f39bdbba640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f399c000fd0 con 0x7f39b815cbb0 2023-07-20T09:50:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59731640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d541577a0 0x7f1d540c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5a733640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d540b0d80 0x7f1d54163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540b1200 con 0x7f1d400047d0 2023-07-20T09:50:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540c7ea0 con 0x7f1d540b0d80 2023-07-20T09:50:33.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 0x7f345c0bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 -- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d540b0d80 msgr2=0x7f1d54163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d540b0d80 0x7f1d54163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 -- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d541577a0 msgr2=0x7f1d540c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d541577a0 0x7f1d540c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f1d59f32640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d541569e0 con 0x7f1d400047d0 2023-07-20T09:50:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c0c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f345c163fc0 0x7f345c0c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c14d310 con 0x7f345c06bc60 2023-07-20T09:50:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c79e0 con 0x7f345c163fc0 2023-07-20T09:50:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f3460869640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0c7cc0 con 0x7f345c0c8de0 2023-07-20T09:50:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39a00b3040 con 0x7f39b815cbb0 2023-07-20T09:50:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f345b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 0x7f345c0bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f345b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 0x7f345c0bffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53268/0 (socket says 172.21.15.82:53268) 2023-07-20T09:50:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f345b7fe640 1 -- 172.21.15.82:0/2400407642 learned_addr learned my addr 172.21.15.82:0/2400407642 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345affd640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c0c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d59f32640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 0x7f1d541605a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000b4d0 tx=0x7f1d5000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345bfff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f345c163fc0 0x7f345c0c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 -- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 msgr2=0x7f345c0c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c0c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 -- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f345c163fc0 msgr2=0x7f345c0c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f345c163fc0 0x7f345c0c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500094d0 con 0x7f345c06bc60 2023-07-20T09:50:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011830 con 0x7f1d400047d0 2023-07-20T09:50:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d500119b0 con 0x7f1d400047d0 2023-07-20T09:50:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011d60 con 0x7f1d400047d0 2023-07-20T09:50:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff406c0e0 0x7faff40c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54156cc0 con 0x7f1d400047d0 2023-07-20T09:50:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d54157280 con 0x7f1d400047d0 2023-07-20T09:50:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345affd640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f345c0c8de0 0x7f345c0c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345bfff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f345c163fc0 0x7f345c0c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f345b7fe640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 0x7f345c0bffd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c7f0 tx=0x7f344c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39affff640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3998066350 0x7f3998068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffa42f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff406c0e0 0x7faff40c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a011de90 con 0x7f39b815cbb0 2023-07-20T09:50:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c004220 con 0x7f345c06bc60 2023-07-20T09:50:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0043a0 con 0x7f345c06bc60 2023-07-20T09:50:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c004510 con 0x7f345c06bc60 2023-07-20T09:50:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffa42f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff406c0e0 0x7faff40c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58572/0 (socket says 172.21.15.82:58572) 2023-07-20T09:50:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3460869640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c0c7fa0 con 0x7f345c06bc60 2023-07-20T09:50:33.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3460869640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c15bac0 con 0x7f345c06bc60 2023-07-20T09:50:33.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 0x7faff40c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.470+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75400b7040 con 0x7f75500ce9a0 2023-07-20T09:50:33.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f7546ffd640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7534066350 0x7f7534068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75401223a0 con 0x7f75500ce9a0 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f7546ffd640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f753406ec10 0x7f7534071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75340716e0 con 0x7f753406ec10 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7540122750 con 0x7f75500ce9a0 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faff9c2e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 0x7faff40c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faff9c2e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 0x7faff40c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57590/0 (socket says 172.21.15.82:57590) 2023-07-20T09:50:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39affff640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f399806ec10 0x7f3998071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f39980716e0 con 0x7f399806ec10 2023-07-20T09:50:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39a01204b0 con 0x7f39b815cbb0 2023-07-20T09:50:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39b77fe640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3998066350 0x7f3998068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39b6ffd640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f399806ec10 0x7f3998071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f755609f640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7534066350 0x7f7534068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f3460869640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f345c0ca480 con 0x7f345c06bc60 2023-07-20T09:50:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39b77fe640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3998066350 0x7f3998068810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007fd0 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff4158620 0x7faff414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c6a00 con 0x7faff4158620 2023-07-20T09:50:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c6570 con 0x7faff406c0e0 2023-07-20T09:50:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffb431640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40c5690 con 0x7faff40ca930 2023-07-20T09:50:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7faffa42f640 1 -- 172.21.15.82:0/1475946605 learned_addr learned my addr 172.21.15.82:0/1475946605 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f755609f640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7534066350 0x7f7534068810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f754c000f70 tx=0x7f754c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.474+0000 7f39b6ffd640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f399806ec10 0x7f3998071030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faffac30640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff4158620 0x7faff414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f75568a0640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f753406ec10 0x7f7534071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f75568a0640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f753406ec10 0x7f7534071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== osd.2 v2:172.21.15.82:6821/3865820031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f39980716e0 con 0x7f399806ec10 2023-07-20T09:50:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== osd.3 v2:172.21.15.82:6800/2403361967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75340716e0 con 0x7f753406ec10 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d5001a400 con 0x7f1d400047d0 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d4a7fc640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d380662b0 0x7f1d38068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d50083e40 con 0x7f1d400047d0 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d5af34640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f1d3c0015f0 0x7f1d3c003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d3c006b50 con 0x7f1d3c0015f0 2023-07-20T09:50:33.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d59731640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d380662b0 0x7f1d38068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d5a733640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f1d3c0015f0 0x7f1d3c003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d5a733640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f1d3c0015f0 0x7f1d3c003ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f1d59731640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d380662b0 0x7f1d38068770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d440af000 tx=0x7f1d440aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== osd.4 v2:172.21.15.183:6824/683958145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1d3c006b50 con 0x7f1d3c0015f0 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faff9c2e640 1 -- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff406c0e0 msgr2=0x7faff40c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faff9c2e640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faff406c0e0 0x7faff40c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faff9c2e640 1 -- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff4158620 msgr2=0x7faff414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faff9c2e640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff4158620 0x7faff414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7faff9c2e640 1 -- 172.21.15.82:0/1475946605 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec008550 con 0x7faff40ca930 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7faffac30640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faff4158620 0x7faff414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7faff9c2e640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 0x7faff40c5150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faff0009db0 tx=0x7faff000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 Processor -- start 2023-07-20T09:50:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 -- start start 2023-07-20T09:50:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0014480 con 0x7faff40ca930 2023-07-20T09:50:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40c5960 con 0x7faff40ca930 2023-07-20T09:50:33.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40c5f20 con 0x7faff40ca930 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840cde70 con 0x7f54840b0290 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840cbef0 con 0x7f54840afe10 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f5489c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ad440 con 0x7f54840ad060 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57594/0 (socket says 172.21.15.82:57594) 2023-07-20T09:50:33.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 -- 172.21.15.82:0/2508085585 learned_addr learned my addr 172.21.15.82:0/2508085585 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 -- 172.21.15.82:0/2508085585 >> v1:172.21.15.183:6789/0 conn(0x7f54840afe10 legacy=0x7f548415c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-20T09:50:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000f040 con 0x7faff40ca930 2023-07-20T09:50:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff0014800 con 0x7faff40ca930 2023-07-20T09:50:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 -- 172.21.15.82:0/2508085585 >> v1:172.21.15.82:6789/0 conn(0x7f54840b0290 legacy=0x7f548415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f54837fe640 1 -- 172.21.15.82:0/2508085585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548415d730 con 0x7f54840ad060 2023-07-20T09:50:33.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f344c003860 con 0x7f345c06bc60 2023-07-20T09:50:33.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.478+0000 7f3443fff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3448066350 0x7f3448068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f344c0840b0 con 0x7f345c06bc60 2023-07-20T09:50:33.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f3443fff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f344806ec10 0x7f3448071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f34480716e0 con 0x7f344806ec10 2023-07-20T09:50:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.482+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f344c084460 con 0x7f345c06bc60 2023-07-20T09:50:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7f345affd640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3448066350 0x7f3448068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7f345affd640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3448066350 0x7f3448068810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f345c15cc70 tx=0x7f3454009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faff0014960 con 0x7faff40ca930 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7fafeaffd640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafd8066280 0x7fafd8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faff0084c50 con 0x7faff40ca930 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7faffb431640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fafdc0015f0 0x7fafdc003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7faffa42f640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafd8066280 0x7fafd8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.486+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 --> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafdc006b50 con 0x7fafdc0015f0 2023-07-20T09:50:33.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f345bfff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f344806ec10 0x7f3448071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f54837fe640 1 --2- 172.21.15.82:0/2508085585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098a0 tx=0x7f547c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4dcd339c82c50c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7faffac30640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fafdc0015f0 0x7fafdc003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f345bfff640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f344806ec10 0x7f3448071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7faffa42f640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafd8066280 0x7fafd8068740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafec01c580 tx=0x7fafec00a040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7faffac30640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fafdc0015f0 0x7fafdc003ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f54827fc640 1 -- 172.21.15.82:0/2508085585 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ab400 con 0x7f54840ad060 2023-07-20T09:50:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== osd.5 v2:172.21.15.183:6808/454263273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f34480716e0 con 0x7f344806ec10 2023-07-20T09:50:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f54827fc640 1 -- 172.21.15.82:0/2508085585 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0a7050 con 0x7f54840ad060 2023-07-20T09:50:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 -- 172.21.15.82:0/2508085585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 msgr2=0x7f54840c9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== osd.6 v2:172.21.15.183:6800/2355022847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fafdc006b50 con 0x7fafdc0015f0 2023-07-20T09:50:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f54827fc640 1 -- 172.21.15.82:0/2508085585 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0ab400 con 0x7f54840ad060 2023-07-20T09:50:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 --2- 172.21.15.82:0/2508085585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f547c0098a0 tx=0x7f547c01c520 comp rx=0 tx=0).stop 2023-07-20T09:50:33.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 -- 172.21.15.82:0/2508085585 shutdown_connections 2023-07-20T09:50:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 --2- 172.21.15.82:0/2508085585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840ad060 0x7f54840c9fb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 -- 172.21.15.82:0/2508085585 >> 172.21.15.82:0/2508085585 conn(0x7f54840cada0 msgr2=0x7f54840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 -- 172.21.15.82:0/2508085585 shutdown_connections 2023-07-20T09:50:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 --> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2fc154050 con 0x7fd2e806ecd0 2023-07-20T09:50:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.490+0000 7f5489c34640 1 -- 172.21.15.82:0/2508085585 wait complete. 2023-07-20T09:50:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.494+0000 7f5489c34640 1 Processor -- start 2023-07-20T09:50:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.494+0000 7fd2f1ffb640 1 -- 172.21.15.82:0/2312625759 <== osd.1 v2:172.21.15.82:6809/403607720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2fc154050 con 0x7fd2e806ecd0 2023-07-20T09:50:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.494+0000 7f5489c34640 1 -- start start 2023-07-20T09:50:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54840ad060 0x7f54840abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 0x7f54840c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840b0290 0x7f54840c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5482ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 0x7f54840c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5482ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 0x7f54840c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53280/0 (socket says 172.21.15.82:53280) 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5482ffd640 1 -- 172.21.15.82:0/600924834 learned_addr learned my addr 172.21.15.82:0/600924834 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f54837fe640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54840ad060 0x7f54840abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840b0290 0x7f54840c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54841fa4f0 con 0x7f54840afe10 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840aaf30 con 0x7f54840ad060 2023-07-20T09:50:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ab210 con 0x7f54840b0290 2023-07-20T09:50:33.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7fd2e806ecd0 msgr2=0x7fd2e80710f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7fd2e806ecd0 0x7fd2e80710f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 -- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54840ad060 msgr2=0x7f54840abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54840ad060 0x7f54840abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 -- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 msgr2=0x7f54840c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 0x7f54840c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0094d0 con 0x7f54840b0290 2023-07-20T09:50:33.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5482ffd640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54840afe10 0x7f54840c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:33.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f5483fff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840b0290 0x7f54840c6340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f547400c700 tx=0x7f547400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd2e8066410 msgr2=0x7fd2e80688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd2e8066410 0x7fd2e80688d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009e00 tx=0x7fd2f8008040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc160a50 msgr2=0x7fd2fc162f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd2e77fe640 1 --2- 172.21.15.82:0/2312625759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2fc160a50 0x7fd2fc162f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0ac000 tx=0x7fd2ec019180 comp rx=0 tx=0).stop 2023-07-20T09:50:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f975726d640 1 -- 172.21.15.82:0/3836630325 --> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f975004da30 con 0x7f973406eb90 2023-07-20T09:50:33.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7fd301f2c640 1 -- 172.21.15.82:0/2312625759 reap_dead start 2023-07-20T09:50:33.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474003b80 con 0x7f54840b0290 2023-07-20T09:50:33.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f9745ffb640 1 -- 172.21.15.82:0/3836630325 <== osd.0 v2:172.21.15.82:6808/1720305563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f975004da30 con 0x7f973406eb90 2023-07-20T09:50:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 shutdown_connections 2023-07-20T09:50:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 >> 172.21.15.82:0/2312625759 conn(0x7fd2fc0afde0 msgr2=0x7fd2fc06cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.498+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474003ce0 con 0x7f54840b0290 2023-07-20T09:50:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54840ab4f0 con 0x7f54840b0290 2023-07-20T09:50:33.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54840abab0 con 0x7f54840b0290 2023-07-20T09:50:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5474005310 con 0x7f54840b0290 2023-07-20T09:50:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 shutdown_connections 2023-07-20T09:50:33.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5468000fd0 con 0x7f54840b0290 2023-07-20T09:50:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7fd2e77fe640 1 -- 172.21.15.82:0/2312625759 wait complete. 2023-07-20T09:50:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f973406eb90 msgr2=0x7f9734070fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f973406eb90 0x7f9734070fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97340662d0 msgr2=0x7f9734068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97340662d0 0x7f9734068790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97501f8000 tx=0x7f9740008040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 msgr2=0x7f9750145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f97337fe640 1 --2- 172.21.15.82:0/3836630325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97500ccd40 0x7f9750145df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f974c00c530 tx=0x7f974c00c9f0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f975580a640 1 -- 172.21.15.82:0/3836630325 reap_dead start 2023-07-20T09:50:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.502+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5474005470 con 0x7f54840b0290 2023-07-20T09:50:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 shutdown_connections 2023-07-20T09:50:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 >> 172.21.15.82:0/3836630325 conn(0x7f97500cb4e0 msgr2=0x7f97500cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 shutdown_connections 2023-07-20T09:50:33.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f97337fe640 1 -- 172.21.15.82:0/3836630325 wait complete. 2023-07-20T09:50:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 --> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d3c005bd0 con 0x7f1d3c0015f0 2023-07-20T09:50:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f547bfff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5464066350 0x7f5464068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5474038020 con 0x7f54840b0290 2023-07-20T09:50:33.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d4a7fc640 1 -- 172.21.15.82:0/212541889 <== osd.4 v2:172.21.15.183:6824/683958145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d3c005bd0 con 0x7f1d3c0015f0 2023-07-20T09:50:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f547bfff640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f546406ec10 0x7f5464071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54640716e0 con 0x7f546406ec10 2023-07-20T09:50:33.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54740847d0 con 0x7f54840b0290 2023-07-20T09:50:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f1d3c0015f0 msgr2=0x7f1d3c003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f1d3c0015f0 0x7f1d3c003ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d380662b0 msgr2=0x7f1d38068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d380662b0 0x7f1d38068770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1d440af000 tx=0x7f1d440aa000 comp rx=0 tx=0).stop 2023-07-20T09:50:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f5482ffd640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f546406ec10 0x7f5464071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 msgr2=0x7f1d541605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 --2- 172.21.15.82:0/212541889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d400047d0 0x7f1d541605a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000b4d0 tx=0x7f1d5000b8d0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5a733640 1 -- 172.21.15.82:0/212541889 reap_dead start 2023-07-20T09:50:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f54837fe640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5464066350 0x7f5464068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 shutdown_connections 2023-07-20T09:50:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 >> 172.21.15.82:0/212541889 conn(0x7f1d540afb90 msgr2=0x7f1d540af210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 shutdown_connections 2023-07-20T09:50:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.506+0000 7f1d5af34640 1 -- 172.21.15.82:0/212541889 wait complete. 2023-07-20T09:50:33.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f5482ffd640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f546406ec10 0x7f5464071030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f54837fe640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5464066350 0x7f5464068810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ad000 tx=0x7f547c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== osd.7 v2:172.21.15.183:6809/1024675739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f54640716e0 con 0x7f546406ec10 2023-07-20T09:50:33.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f7544ff9640 1 -- 172.21.15.82:0/144901292 --> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75500cd4b0 con 0x7f753406ec10 2023-07-20T09:50:33.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f7546ffd640 1 -- 172.21.15.82:0/144901292 <== osd.3 v2:172.21.15.82:6800/2403361967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7548001ad0 con 0x7f753406ec10 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f753406ec10 msgr2=0x7f7534071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f75570a1640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f753406ec10 0x7f7534071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7534066350 msgr2=0x7f7534068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f75570a1640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7534066350 0x7f7534068810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f754c000f70 tx=0x7f754c009040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.510+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 msgr2=0x7f755006ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75570a1640 1 --2- 172.21.15.82:0/144901292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75500ce9a0 0x7f755006ca70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f754001b880 tx=0x7f754001ba10 comp rx=0 tx=0).stop 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75568a0640 1 -- 172.21.15.82:0/144901292 reap_dead start 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 shutdown_connections 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 >> 172.21.15.82:0/144901292 conn(0x7f7550065710 msgr2=0x7f75500cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 shutdown_connections 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7f75570a1640 1 -- 172.21.15.82:0/144901292 wait complete. 2023-07-20T09:50:33.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.514+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 --> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafdc005c30 con 0x7fafdc0015f0 2023-07-20T09:50:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39bdbba640 1 -- 172.21.15.82:0/1984786490 --> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f399c002cc0 con 0x7f399806ec10 2023-07-20T09:50:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7fafeaffd640 1 -- 172.21.15.82:0/1475946605 <== osd.6 v2:172.21.15.183:6800/2355022847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafdc005c30 con 0x7fafdc0015f0 2023-07-20T09:50:33.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39affff640 1 -- 172.21.15.82:0/1984786490 <== osd.2 v2:172.21.15.82:6821/3865820031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f399c002cc0 con 0x7f399806ec10 2023-07-20T09:50:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f399806ec10 msgr2=0x7f3998071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f399806ec10 0x7f3998071030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fafdc0015f0 msgr2=0x7fafdc003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fafdc0015f0 0x7fafdc003ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3998066350 msgr2=0x7f3998068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafd8066280 msgr2=0x7fafd8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafd8066280 0x7fafd8068740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fafec01c580 tx=0x7fafec00a040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 msgr2=0x7faff40c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3998066350 0x7f3998068810 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007fd0 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffb431640 1 --2- 172.21.15.82:0/1475946605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faff40ca930 0x7faff40c5150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faff0009db0 tx=0x7faff000c490 comp rx=0 tx=0).stop 2023-07-20T09:50:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 msgr2=0x7f39b8147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 --2- 172.21.15.82:0/1984786490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39b815cbb0 0x7f39b8147db0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009870 tx=0x7f39a001ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39b7fff640 1 -- 172.21.15.82:0/1984786490 reap_dead start 2023-07-20T09:50:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 shutdown_connections 2023-07-20T09:50:33.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7faffac30640 1 -- 172.21.15.82:0/1475946605 reap_dead start 2023-07-20T09:50:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 >> 172.21.15.82:0/1984786490 conn(0x7f39b80afde0 msgr2=0x7f39b8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 shutdown_connections 2023-07-20T09:50:33.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.518+0000 7f39adffb640 1 -- 172.21.15.82:0/1984786490 wait complete. 2023-07-20T09:50:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3460869640 1 -- 172.21.15.82:0/2400407642 --> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f345c0c9f60 con 0x7f344806ec10 2023-07-20T09:50:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3443fff640 1 -- 172.21.15.82:0/2400407642 <== osd.5 v2:172.21.15.183:6808/454263273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f34500a98e0 con 0x7f344806ec10 2023-07-20T09:50:33.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f344806ec10 msgr2=0x7f3448071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f344806ec10 0x7f3448071030 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3448066350 msgr2=0x7f3448068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3448066350 0x7f3448068810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f345c15cc70 tx=0x7f3454009040 comp rx=0 tx=0).stop 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 msgr2=0x7f345c0bffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 --2- 172.21.15.82:0/2400407642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f345c06bc60 0x7f345c0bffd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f344c00c7f0 tx=0x7f344c00ccb0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f345bfff640 1 -- 172.21.15.82:0/2400407642 reap_dead start 2023-07-20T09:50:33.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 shutdown_connections 2023-07-20T09:50:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.522+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 >> 172.21.15.82:0/2400407642 conn(0x7f345c0ce080 msgr2=0x7f345c0cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.526+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 shutdown_connections 2023-07-20T09:50:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.526+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 >> 172.21.15.82:0/1475946605 conn(0x7faff40afb90 msgr2=0x7faff40af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.526+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 shutdown_connections 2023-07-20T09:50:33.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.526+0000 7f3441ffb640 1 -- 172.21.15.82:0/2400407642 wait complete. 2023-07-20T09:50:33.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.534+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 shutdown_connections 2023-07-20T09:50:33.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.534+0000 7faffb431640 1 -- 172.21.15.82:0/1475946605 wait complete. 2023-07-20T09:50:33.608 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:33.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-20T09:50:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.538+0000 7f5489c34640 1 -- 172.21.15.82:0/600924834 --> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5468002cc0 con 0x7f546406ec10 2023-07-20T09:50:33.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f547bfff640 1 -- 172.21.15.82:0/600924834 <== osd.7 v2:172.21.15.183:6809/1024675739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5468002cc0 con 0x7f546406ec10 2023-07-20T09:50:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f546406ec10 msgr2=0x7f5464071030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f546406ec10 0x7f5464071030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5464066350 msgr2=0x7f5464068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5464066350 0x7f5464068810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f547c0ad000 tx=0x7f547c0a6000 comp rx=0 tx=0).stop 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840b0290 msgr2=0x7f54840c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 --2- 172.21.15.82:0/600924834 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54840b0290 0x7f54840c6340 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f547400c700 tx=0x7f547400cbc0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5483fff640 1 -- 172.21.15.82:0/600924834 reap_dead start 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 shutdown_connections 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 >> 172.21.15.82:0/600924834 conn(0x7f54840cada0 msgr2=0x7f548406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 shutdown_connections 2023-07-20T09:50:33.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.542+0000 7f5479ffb640 1 -- 172.21.15.82:0/600924834 wait complete. 2023-07-20T09:50:33.612 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:33.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-20T09:50:33.613 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:33.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-20T09:50:33.614 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:33.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-20T09:50:33.615 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:33.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-20T09:50:33.616 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:33.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-20T09:50:33.617 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-07-20T09:50:33.618 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-20T09:50:33.618 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:33.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-20T09:50:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.858+0000 7f9adf5f3640 1 Processor -- start 2023-07-20T09:50:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.858+0000 7f9adf5f3640 1 -- start start 2023-07-20T09:50:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9add38f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ad8152b70 0x7f9ad815cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42570/0 (socket says 172.21.15.82:42570) 2023-07-20T09:50:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9add38f640 1 -- 172.21.15.82:0/3203108156 learned_addr learned my addr 172.21.15.82:0/3203108156 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/3203108156 >> v2:172.21.15.183:3300/0 conn(0x7f9ad80b0900 0x7f9ad8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/3203108156 >> v2:172.21.15.82:3300/0 conn(0x7f9ad8159160 0x7f9ad80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad815c720 con 0x7f9ad8152b70 2023-07-20T09:50:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad8159c30 con 0x7f9ad8159160 2023-07-20T09:50:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad8159670 con 0x7f9ad80b0900 2023-07-20T09:50:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adcb8e640 1 --2- 172.21.15.82:0/3203108156 >> v2:172.21.15.183:3300/0 conn(0x7f9ad80b0900 0x7f9ad8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adcb8e640 1 -- 172.21.15.82:0/3203108156 >> v2:172.21.15.82:3300/0 conn(0x7f9ad8159160 msgr2=0x7f9ad80b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adcb8e640 1 --2- 172.21.15.82:0/3203108156 >> v2:172.21.15.82:3300/0 conn(0x7f9ad8159160 0x7f9ad80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adcb8e640 1 -- 172.21.15.82:0/3203108156 >> v1:172.21.15.82:6789/0 conn(0x7f9ad8152b70 legacy=0x7f9ad815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.862+0000 7f9adcb8e640 1 -- 172.21.15.82:0/3203108156 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8159950 con 0x7f9ad80b0900 2023-07-20T09:50:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 Processor -- start 2023-07-20T09:50:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 -- start start 2023-07-20T09:50:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7feda6634640 1 Processor -- start 2023-07-20T09:50:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7feda6634640 1 -- start start 2023-07-20T09:50:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ecc0b2300 0x7f8ecc070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc15c720 con 0x7f8ecc152b70 2023-07-20T09:50:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc159670 con 0x7f8ecc158c20 2023-07-20T09:50:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.866+0000 7f8ed1048640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc159c30 con 0x7f8ecc0b2300 2023-07-20T09:50:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ecc0b2300 0x7f8ecc070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8ecc0b2300 0x7f8ecc070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53302/0 (socket says 172.21.15.82:53302) 2023-07-20T09:50:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 -- 172.21.15.82:0/1369341512 learned_addr learned my addr 172.21.15.82:0/1369341512 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adcb8e640 1 --2- 172.21.15.82:0/3203108156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad80b0900 0x7f9ad8158c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e150 tx=0x7f9ad401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d28c692eb6a64f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 -- 172.21.15.82:0/1369341512 >> v1:172.21.15.183:6789/0 conn(0x7f8ecc158c20 legacy=0x7f8ecc0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7feda6634640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feda00cb1b0 0x7feda00c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7feda6634640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda006c490 con 0x7feda00c90d0 2023-07-20T09:50:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7feda6634640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda006b880 con 0x7feda00cdcf0 2023-07-20T09:50:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7feda6634640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda006bb60 con 0x7feda00cb1b0 2023-07-20T09:50:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9acffff640 1 -- 172.21.15.82:0/3203108156 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40ab600 con 0x7f9ad80b0900 2023-07-20T09:50:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9acffff640 1 -- 172.21.15.82:0/3203108156 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad40a7050 con 0x7f9ad80b0900 2023-07-20T09:50:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9acffff640 1 -- 172.21.15.82:0/3203108156 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40ab980 con 0x7f9ad80b0900 2023-07-20T09:50:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9ffff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7feda00cdcf0 0x7feda00caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34980/0 (socket says 172.21.15.82:34980) 2023-07-20T09:50:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9ffff640 1 -- 172.21.15.82:0/2927404983 learned_addr learned my addr 172.21.15.82:0/2927404983 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 -- 172.21.15.82:0/1369341512 >> v1:172.21.15.82:6789/0 conn(0x7f8ecc152b70 legacy=0x7f8ecc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f8ecb59e640 1 -- 172.21.15.82:0/1369341512 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc159950 con 0x7f8ecc0b2300 2023-07-20T09:50:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad80b0900 msgr2=0x7f9ad8158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/3203108156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad80b0900 0x7f9ad8158c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e150 tx=0x7f9ad401c450 comp rx=0 tx=0).stop 2023-07-20T09:50:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 shutdown_connections 2023-07-20T09:50:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/3203108156 >> v2:172.21.15.82:3300/0 conn(0x7f9ad8159160 0x7f9ad80b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/3203108156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad80b0900 0x7f9ad8158c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 >> 172.21.15.82:0/3203108156 conn(0x7f9ad80afde0 msgr2=0x7f9ad80b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/2927404983 >> v2:172.21.15.82:3300/0 conn(0x7feda00cb1b0 0x7feda00c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369378930 0 0) 0x7feda006b880 con 0x7feda00cdcf0 2023-07-20T09:50:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed88003530 con 0x7feda00cdcf0 2023-07-20T09:50:33.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 shutdown_connections 2023-07-20T09:50:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3693329207 0 0) 0x7fed88003530 con 0x7feda00cdcf0 2023-07-20T09:50:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 >> v2:172.21.15.82:3300/0 conn(0x7feda00cb1b0 msgr2=0x7feda00c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 --2- 172.21.15.82:0/2927404983 >> v2:172.21.15.82:3300/0 conn(0x7feda00cb1b0 0x7feda00c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 >> v1:172.21.15.82:6789/0 conn(0x7feda00c90d0 legacy=0x7feda00cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 --> v1:172.21.15.183:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda006be40 con 0x7feda00cdcf0 2023-07-20T09:50:33.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 <== mon.1 v1:172.21.15.183:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fed94001680 con 0x7feda00cdcf0 2023-07-20T09:50:33.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 >> v1:172.21.15.183:6789/0 conn(0x7feda00cdcf0 legacy=0x7feda00caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 0x7fed88003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed880047d0 0x7fed88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed88005190 0x7fed8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda006bb60 con 0x7fed88003980 2023-07-20T09:50:33.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8800c010 con 0x7fed880047d0 2023-07-20T09:50:33.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8800c1d0 con 0x7fed88005190 2023-07-20T09:50:33.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7f9adf5f3640 1 -- 172.21.15.82:0/3203108156 wait complete. 2023-07-20T09:50:33.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9ffff640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 0x7fed88003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.870+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/2927404983 >> v2:172.21.15.82:3300/0 conn(0x7feda00cb1b0 0x7feda00c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:33.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7feda4bd1640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed88005190 0x7fed8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed880047d0 0x7fed88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9ffff640 1 -- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed88005190 msgr2=0x7fed8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9ffff640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed88005190 0x7fed8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9ffff640 1 -- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed880047d0 msgr2=0x7fed88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9ffff640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed880047d0 0x7fed88004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7fed9ffff640 1 -- 172.21.15.82:0/2927404983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda006be40 con 0x7fed88003980 2023-07-20T09:50:33.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7feda4bd1640 1 -- 172.21.15.82:0/2927404983 reap_dead start 2023-07-20T09:50:33.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f9adf5f3640 1 Processor -- start 2023-07-20T09:50:33.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f9adf5f3640 1 -- start start 2023-07-20T09:50:33.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f8ecb59e640 1 --2- 172.21.15.82:0/1369341512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc070070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400d150 tx=0x7f8ec401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22441ed8c3b61aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f8ec9d9b640 1 -- 172.21.15.82:0/1369341512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400b2d0 con 0x7f8ecc0b2300 2023-07-20T09:50:33.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f8ec9d9b640 1 -- 172.21.15.82:0/1369341512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400b430 con 0x7f8ecc0b2300 2023-07-20T09:50:33.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.874+0000 7f9adf5f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 -- 172.21.15.82:0/1369341512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 msgr2=0x7f8ecc070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad8152b70 0x7f9ad81f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ec9d9b640 1 -- 172.21.15.82:0/1369341512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400b2d0 con 0x7f8ecc0b2300 2023-07-20T09:50:33.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53342/0 (socket says 172.21.15.82:53342) 2023-07-20T09:50:33.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 -- 172.21.15.82:0/1993423624 learned_addr learned my addr 172.21.15.82:0/1993423624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 --2- 172.21.15.82:0/1369341512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc070070 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400d150 tx=0x7f8ec401eba0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 0x7f9ad806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad814b130 con 0x7f9ad80b0900 2023-07-20T09:50:33.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8165b70 con 0x7f9ad8159160 2023-07-20T09:50:33.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80adfc0 con 0x7f9ad8152b70 2023-07-20T09:50:33.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 -- 172.21.15.82:0/1369341512 shutdown_connections 2023-07-20T09:50:33.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 --2- 172.21.15.82:0/1369341512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc070070 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 -- 172.21.15.82:0/1369341512 >> 172.21.15.82:0/1369341512 conn(0x7f8ecc0afde0 msgr2=0x7f8ecc0b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 -- 172.21.15.82:0/1369341512 shutdown_connections 2023-07-20T09:50:33.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9addb90640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 0x7f9ad806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 -- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad8152b70 msgr2=0x7f9ad81f8b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-20T09:50:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad8152b70 0x7f9ad81f8b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 -- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 msgr2=0x7f9ad806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 0x7f9ad806ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4009420 con 0x7f9ad80b0900 2023-07-20T09:50:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7fed9ffff640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 0x7fed88003d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c260 tx=0x7fed9401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac57e2e2ca95697 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9addb90640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 0x7f9ad806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f44290f7640 1 Processor -- start 2023-07-20T09:50:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9add38f640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000c770 tx=0x7f9ad000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f44290f7640 1 -- start start 2023-07-20T09:50:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f8ed1048640 1 -- 172.21.15.82:0/1369341512 wait complete. 2023-07-20T09:50:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94005ae0 con 0x7fed88003980 2023-07-20T09:50:33.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000aa50 con 0x7f9ad80b0900 2023-07-20T09:50:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000abb0 con 0x7f9ad80b0900 2023-07-20T09:50:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000ce80 con 0x7f9ad80b0900 2023-07-20T09:50:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad81fd850 con 0x7f9ad80b0900 2023-07-20T09:50:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80adc90 con 0x7f9ad80b0900 2023-07-20T09:50:33.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7fed9effd640 1 -- 172.21.15.82:0/2927404983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed940ab070 con 0x7fed88003980 2023-07-20T09:50:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7feda6634640 1 -- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 msgr2=0x7fed88003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.878+0000 7feda6634640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 0x7fed88003d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c260 tx=0x7fed9401f390 comp rx=0 tx=0).stop 2023-07-20T09:50:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44290f7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f441c03ed00 0x7f441c053e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44290f7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f441c054340 0x7f441c057c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44290f7640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0577a0 con 0x7f441c0e6890 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44290f7640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c0547d0 con 0x7f441c054340 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44290f7640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c03f160 con 0x7f441c03ed00 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f4423fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f441c0e6890 0x7f441c006cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42588/0 (socket says 172.21.15.82:42588) 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f4423fff640 1 -- 172.21.15.82:0/1702888962 learned_addr learned my addr 172.21.15.82:0/1702888962 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44237fe640 1 --2- 172.21.15.82:0/1702888962 >> v2:172.21.15.183:3300/0 conn(0x7f441c03ed00 0x7f441c053e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f8ed1048640 1 Processor -- start 2023-07-20T09:50:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad80adac0 con 0x7f9ad80b0900 2023-07-20T09:50:33.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44288f6640 1 --2- 172.21.15.82:0/1702888962 >> v2:172.21.15.82:3300/0 conn(0x7f441c054340 0x7f441c057c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 -- 172.21.15.82:0/2927404983 shutdown_connections 2023-07-20T09:50:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 --2- 172.21.15.82:0/2927404983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed88003980 0x7fed88003d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 -- 172.21.15.82:0/2927404983 >> 172.21.15.82:0/2927404983 conn(0x7feda00afc00 msgr2=0x7feda00affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 -- 172.21.15.82:0/2927404983 shutdown_connections 2023-07-20T09:50:33.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 -- 172.21.15.82:0/2927404983 wait complete. 2023-07-20T09:50:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f4422ffd640 1 -- 172.21.15.82:0/1702888962 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869405933 0 0) 0x7f441c0577a0 con 0x7f441c0e6890 2023-07-20T09:50:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f4422ffd640 1 -- 172.21.15.82:0/1702888962 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4414003530 con 0x7f441c0e6890 2023-07-20T09:50:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44237fe640 1 -- 172.21.15.82:0/1702888962 >> v2:172.21.15.82:3300/0 conn(0x7f441c054340 msgr2=0x7f441c057c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44237fe640 1 --2- 172.21.15.82:0/1702888962 >> v2:172.21.15.82:3300/0 conn(0x7f441c054340 0x7f441c057c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44237fe640 1 -- 172.21.15.82:0/1702888962 >> v1:172.21.15.82:6789/0 conn(0x7f441c0e6890 legacy=0x7f441c006cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f44237fe640 1 -- 172.21.15.82:0/1702888962 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c057470 con 0x7f441c03ed00 2023-07-20T09:50:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7fda6d396640 1 Processor -- start 2023-07-20T09:50:33.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f8ed1048640 1 -- start start 2023-07-20T09:50:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 Processor -- start 2023-07-20T09:50:33.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f8ed1048640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ed1048640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ecc152b70 0x7f8ecc150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ed1048640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ed1048640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cafc0 con 0x7f8ecc0b2300 2023-07-20T09:50:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7fda6d396640 1 -- start start 2023-07-20T09:50:33.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda6d396640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 0x7fda680d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda6d396640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda680ce9c0 0x7fda680ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda6d396640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680b1120 con 0x7fda680af8e0 2023-07-20T09:50:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda6d396640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda68069da0 con 0x7fda680ce9c0 2023-07-20T09:50:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda6d396640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680d07f0 con 0x7fda680cfed0 2023-07-20T09:50:33.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58642/0 (socket says 172.21.15.82:58642) 2023-07-20T09:50:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 -- 172.21.15.82:0/3321995653 learned_addr learned my addr 172.21.15.82:0/3321995653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecad9d640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda66ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 0x7fda680d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda66ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 0x7fda680d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58632/0 (socket says 172.21.15.82:58632) 2023-07-20T09:50:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda66ffd640 1 -- 172.21.15.82:0/1959515517 learned_addr learned my addr 172.21.15.82:0/1959515517 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7feda6634640 1 -- start start 2023-07-20T09:50:33.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda667fc640 1 --2- 172.21.15.82:0/1959515517 >> v2:172.21.15.82:3300/0 conn(0x7fda680ce9c0 0x7fda680ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 0x7feda0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8eca59c640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ecc152b70 0x7f8ecc150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 0x7feda0070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 0x7feda0070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.882+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ad0012420 con 0x7f9ad80b0900 2023-07-20T09:50:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f9acdffb640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 0x7f9abc068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ad0083c40 con 0x7f9ad80b0900 2023-07-20T09:50:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f9adcb8e640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 0x7f9abc068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc14fd20 con 0x7f8ecc158c20 2023-07-20T09:50:33.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0155ac0 con 0x7feda00b2c10 2023-07-20T09:50:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cb210 con 0x7f8ecc152b70 2023-07-20T09:50:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0162ba0 con 0x7fed88003980 2023-07-20T09:50:33.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 0x7feda0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9ffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 0x7feda0155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58654/0 (socket says 172.21.15.82:58654) 2023-07-20T09:50:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9ffff640 1 -- 172.21.15.82:0/232453948 learned_addr learned my addr 172.21.15.82:0/232453948 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda4bd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 0x7feda0070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda6634640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda0162e80 con 0x7feda00b2790 2023-07-20T09:50:33.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 0x7feda0070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f9adcb8e640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 0x7f9abc068770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e230 tx=0x7f9ad40ad040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda667fc640 1 -- 172.21.15.82:0/1959515517 >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 msgr2=0x7fda680d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda667fc640 1 --2- 172.21.15.82:0/1959515517 >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 0x7fda680d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda667fc640 1 -- 172.21.15.82:0/1959515517 >> v1:172.21.15.183:6789/0 conn(0x7fda680af8e0 legacy=0x7fda6806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fda667fc640 1 -- 172.21.15.82:0/1959515517 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680ceea0 con 0x7fda680ce9c0 2023-07-20T09:50:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f44237fe640 1 --2- 172.21.15.82:0/1702888962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c03ed00 0x7f441c053e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f441c055430 tx=0x7f441001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7210cf7f930f0a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f4422ffd640 1 -- 172.21.15.82:0/1702888962 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100ab600 con 0x7f441c03ed00 2023-07-20T09:50:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f4422ffd640 1 -- 172.21.15.82:0/1702888962 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44100a7050 con 0x7f441c03ed00 2023-07-20T09:50:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 -- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 msgr2=0x7feda0155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 0x7feda0155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 -- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 msgr2=0x7feda0070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 0x7feda0070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0163160 con 0x7feda00b2790 2023-07-20T09:50:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f4422ffd640 1 -- 172.21.15.82:0/1702888962 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44100ab980 con 0x7f441c03ed00 2023-07-20T09:50:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 -- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ecc152b70 msgr2=0x7f8ecc150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ecc152b70 0x7f8ecc150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 -- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 msgr2=0x7f8ecc141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec400bd40 con 0x7f8ecc158c20 2023-07-20T09:50:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7f8ecb59e640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ec401b7b0 tx=0x7f8ec401b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7feda4bd1640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 0x7feda0070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:33.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.886+0000 7fed9f7fe640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 0x7feda0070900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feda0074970 tx=0x7fed90011e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400b2d0 con 0x7f8ecc158c20 2023-07-20T09:50:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4003db0 con 0x7f8ecc158c20 2023-07-20T09:50:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4004240 con 0x7f8ecc158c20 2023-07-20T09:50:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc0cb4f0 con 0x7f8ecc158c20 2023-07-20T09:50:33.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc141a70 con 0x7f8ecc158c20 2023-07-20T09:50:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9000fbb0 con 0x7feda00b2790 2023-07-20T09:50:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9000fd10 con 0x7feda00b2790 2023-07-20T09:50:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90004250 con 0x7feda00b2790 2023-07-20T09:50:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7feda6634640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda0163440 con 0x7feda00b2790 2023-07-20T09:50:33.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7feda6634640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda0162730 con 0x7feda00b2790 2023-07-20T09:50:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 -- 172.21.15.82:0/1702888962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c03ed00 msgr2=0x7f441c053e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 --2- 172.21.15.82:0/1702888962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c03ed00 0x7f441c053e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f441c055430 tx=0x7f441001c3a0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc0cba10 con 0x7f8ecc158c20 2023-07-20T09:50:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 -- 172.21.15.82:0/1702888962 shutdown_connections 2023-07-20T09:50:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 --2- 172.21.15.82:0/1702888962 >> v2:172.21.15.82:3300/0 conn(0x7f441c054340 0x7f441c057c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 --2- 172.21.15.82:0/1702888962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c03ed00 0x7f441c053e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 -- 172.21.15.82:0/1702888962 >> 172.21.15.82:0/1702888962 conn(0x7f441c059130 msgr2=0x7f441c059540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 -- 172.21.15.82:0/1702888962 shutdown_connections 2023-07-20T09:50:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7feda6634640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed80005260 con 0x7feda00b2790 2023-07-20T09:50:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed900043b0 con 0x7feda00b2790 2023-07-20T09:50:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7fda667fc640 1 --2- 172.21.15.82:0/1959515517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680ce9c0 0x7fda680ca0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda680cd5a0 tx=0x7fda6001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdfd2e55fa1286f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.890+0000 7f44290f7640 1 -- 172.21.15.82:0/1702888962 wait complete. 2023-07-20T09:50:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 Processor -- start 2023-07-20T09:50:33.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 -- start start 2023-07-20T09:50:33.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fed9cff9640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 0x7fed8c068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ad0051020 con 0x7f9ad80b0900 2023-07-20T09:50:33.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed900841a0 con 0x7feda00b2790 2023-07-20T09:50:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fed9ffff640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 0x7fed8c068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8f91c9e640 1 Processor -- start 2023-07-20T09:50:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44290f7640 1 Processor -- start 2023-07-20T09:50:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda65ffb640 1 -- 172.21.15.82:0/1959515517 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600a5960 con 0x7fda680ce9c0 2023-07-20T09:50:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda65ffb640 1 -- 172.21.15.82:0/1959515517 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda600a5ac0 con 0x7fda680ce9c0 2023-07-20T09:50:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda65ffb640 1 -- 172.21.15.82:0/1959515517 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600a5e50 con 0x7fda680ce9c0 2023-07-20T09:50:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f6175103640 1 Processor -- start 2023-07-20T09:50:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 0x7f44b4160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ec40043a0 con 0x7f8ecc158c20 2023-07-20T09:50:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8eb37fe640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 0x7f8eb8068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8ec411f570 con 0x7f8ecc158c20 2023-07-20T09:50:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44b415a580 0x7f44b415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b40cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b41603e0 con 0x7f44b415a580 2023-07-20T09:50:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b4161370 con 0x7f44b415a1a0 2023-07-20T09:50:33.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b966a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415d8e0 con 0x7f44b415d330 2023-07-20T09:50:33.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f6175103640 1 -- start start 2023-07-20T09:50:33.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 -- 172.21.15.82:0/1959515517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680ce9c0 msgr2=0x7fda680ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 --2- 172.21.15.82:0/1959515517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680ce9c0 0x7fda680ca0d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fda680cd5a0 tx=0x7fda6001c8a0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44b415a580 0x7f44b415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44b415a580 0x7f44b415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53374/0 (socket says 172.21.15.82:53374) 2023-07-20T09:50:33.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 -- 172.21.15.82:0/3564761474 learned_addr learned my addr 172.21.15.82:0/3564761474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b37fe640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b40cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b2ffd640 1 --2- 172.21.15.82:0/3564761474 >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 0x7f44b4160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8ecad9d640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 0x7f8eb8068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 -- 172.21.15.82:0/3564761474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 msgr2=0x7f44b40cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b40cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 -- 172.21.15.82:0/3564761474 >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 msgr2=0x7f44b4160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fed9ffff640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 0x7fed8c068840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed9401f3d0 tx=0x7fed940aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 -- 172.21.15.82:0/1959515517 shutdown_connections 2023-07-20T09:50:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 --2- 172.21.15.82:0/1959515517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680ce9c0 0x7fda680ca0d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 --2- 172.21.15.82:0/1959515517 >> v2:172.21.15.183:3300/0 conn(0x7fda680cfed0 0x7fda680d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7fda6d396640 1 -- 172.21.15.82:0/1959515517 >> 172.21.15.82:0/1959515517 conn(0x7fda68098a10 msgr2=0x7fda68098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7fda6d396640 1 -- 172.21.15.82:0/1959515517 shutdown_connections 2023-07-20T09:50:33.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7fda6d396640 1 -- 172.21.15.82:0/1959515517 wait complete. 2023-07-20T09:50:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f8f91c9e640 1 -- start start 2023-07-20T09:50:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f91c9e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8f840df570 0x7f8f84007520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f91c9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f84054220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f91c9e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f84006480 con 0x7f8f84005ff0 2023-07-20T09:50:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.894+0000 7f44b27fc640 1 --2- 172.21.15.82:0/3564761474 >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 0x7f44b4160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f44b27fc640 1 -- 172.21.15.82:0/3564761474 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b415dbc0 con 0x7f44b415a580 2023-07-20T09:50:33.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8ecad9d640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 0x7f8eb8068810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc007fd0 tx=0x7f8ebc007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f44b37fe640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f91c9e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f84006760 con 0x7f8f840df570 2023-07-20T09:50:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f91c9e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84006a40 con 0x7f8f84050390 2023-07-20T09:50:33.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f44b2ffd640 1 --2- 172.21.15.82:0/3564761474 >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 0x7f44b4160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f8bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8f84005ff0 0x7f8f8404fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42600/0 (socket says 172.21.15.82:42600) 2023-07-20T09:50:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f8bfff640 1 -- 172.21.15.82:0/4106713476 learned_addr learned my addr 172.21.15.82:0/4106713476 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f9149d640 1 --2- 172.21.15.82:0/4106713476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f84054220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f90c9c640 1 --2- 172.21.15.82:0/4106713476 >> v2:172.21.15.82:3300/0 conn(0x7f8f840df570 0x7f8f84007520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f6175103640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f61680e3500 0x7f6168038340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616e59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6168053e20 0x7f61680e2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34988/0 (socket says 172.21.15.82:34988) 2023-07-20T09:50:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616e59c640 1 -- 172.21.15.82:0/1716466800 learned_addr learned my addr 172.21.15.82:0/1716466800 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6168006020 con 0x7f61680df430 2023-07-20T09:50:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680e3bb0 con 0x7f6168053e20 2023-07-20T09:50:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616f59e640 1 --2- 172.21.15.82:0/1716466800 >> v2:172.21.15.82:3300/0 conn(0x7f61680e3500 0x7f6168038340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7fda6d396640 1 Processor -- start 2023-07-20T09:50:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680062c0 con 0x7f61680e3500 2023-07-20T09:50:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed900516b0 con 0x7feda00b2790 2023-07-20T09:50:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f9149d640 1 -- 172.21.15.82:0/4106713476 >> v2:172.21.15.82:3300/0 conn(0x7f8f840df570 msgr2=0x7f8f84007520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f9149d640 1 --2- 172.21.15.82:0/4106713476 >> v2:172.21.15.82:3300/0 conn(0x7f8f840df570 0x7f8f84007520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f9149d640 1 -- 172.21.15.82:0/4106713476 >> v1:172.21.15.82:6789/0 conn(0x7f8f84005ff0 legacy=0x7f8f8404fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f8f9149d640 1 -- 172.21.15.82:0/4106713476 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84006d20 con 0x7f8f84050390 2023-07-20T09:50:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616f59e640 1 -- 172.21.15.82:0/1716466800 >> v1:172.21.15.183:6789/0 conn(0x7f6168053e20 legacy=0x7f61680e2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616f59e640 1 -- 172.21.15.82:0/1716466800 >> v1:172.21.15.82:6789/0 conn(0x7f61680df430 legacy=0x7f6168007360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7f616f59e640 1 -- 172.21.15.82:0/1716466800 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680065a0 con 0x7f61680e3500 2023-07-20T09:50:33.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.898+0000 7fda6d396640 1 -- start start 2023-07-20T09:50:33.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ecc0cba10 con 0x7f8ecc158c20 2023-07-20T09:50:33.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f44290f7640 1 -- start start 2023-07-20T09:50:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680af8e0 0x7fda680c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda680cfed0 0x7fda681f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57668/0 (socket says 172.21.15.82:57668) 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680c5e50 con 0x7fda680af8e0 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 -- 172.21.15.82:0/2576179785 learned_addr learned my addr 172.21.15.82:0/2576179785 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68162500 con 0x7fda680cfed0 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda6d396640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda681627e0 con 0x7fda680ce9c0 2023-07-20T09:50:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda67fff640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda680cfed0 0x7fda681f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f9149d640 1 --2- 172.21.15.82:0/4106713476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f84054220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8f780097c0 tx=0x7f8f7801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c005cb0c789bc8a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda66ffd640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680af8e0 0x7fda680c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f8b7fe640 1 -- 172.21.15.82:0/4106713476 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780ab600 con 0x7f8f84050390 2023-07-20T09:50:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f8b7fe640 1 -- 172.21.15.82:0/4106713476 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f780a7050 con 0x7f8f84050390 2023-07-20T09:50:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f8b7fe640 1 -- 172.21.15.82:0/4106713476 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780ab980 con 0x7f8f84050390 2023-07-20T09:50:33.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 -- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda680cfed0 msgr2=0x7fda681f9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda680cfed0 0x7fda681f9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 -- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680af8e0 msgr2=0x7fda680c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680af8e0 0x7fda680c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60009a70 con 0x7fda680ce9c0 2023-07-20T09:50:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f44290f7640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7fda667fc640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda6001a4d0 tx=0x7fda60019640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f44290f7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c054340 0x7f441c0d5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f91c9e640 1 -- 172.21.15.82:0/4106713476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 msgr2=0x7f8f84054220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f8f91c9e640 1 --2- 172.21.15.82:0/4106713476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f84054220 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8f780097c0 tx=0x7f8f7801c480 comp rx=0 tx=0).stop 2023-07-20T09:50:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.902+0000 7f4423fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57682/0 (socket says 172.21.15.82:57682) 2023-07-20T09:50:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c0e6890 0x7f441c0d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 -- 172.21.15.82:0/4106713476 shutdown_connections 2023-07-20T09:50:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 --2- 172.21.15.82:0/4106713476 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f84054220 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 --2- 172.21.15.82:0/4106713476 >> v2:172.21.15.82:3300/0 conn(0x7f8f840df570 0x7f8f84007520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 -- 172.21.15.82:0/4106713476 >> 172.21.15.82:0/4106713476 conn(0x7f8f84054c20 msgr2=0x7f8f84055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 -- 172.21.15.82:0/657376314 learned_addr learned my addr 172.21.15.82:0/657376314 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0519a0 con 0x7f441c054340 2023-07-20T09:50:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 -- 172.21.15.82:0/4106713476 shutdown_connections 2023-07-20T09:50:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c051c80 con 0x7f441c0e6890 2023-07-20T09:50:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 -- 172.21.15.82:0/4106713476 wait complete. 2023-07-20T09:50:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c051f60 con 0x7f441c03ed00 2023-07-20T09:50:33.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f616f59e640 1 --2- 172.21.15.82:0/1716466800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61680e3500 0x7f6168038340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61600071d0 tx=0x7f616001dfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9312f84cb88d8faa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 -- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c0e6890 msgr2=0x7f441c0d61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c0e6890 0x7f441c0d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 -- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c054340 msgr2=0x7f441c0d5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c054340 0x7f441c0d5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009420 con 0x7f441c03ed00 2023-07-20T09:50:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4423fff640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f441800c3c0 tx=0x7f441800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4418005db0 con 0x7f441c03ed00 2023-07-20T09:50:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44180070d0 con 0x7f441c03ed00 2023-07-20T09:50:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44180074a0 con 0x7f441c03ed00 2023-07-20T09:50:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 Processor -- start 2023-07-20T09:50:33.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0dd850 con 0x7f441c03ed00 2023-07-20T09:50:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f8f91c9e640 1 -- start start 2023-07-20T09:50:33.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44290f7640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0dc920 con 0x7f441c03ed00 2023-07-20T09:50:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b27fc640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b415a580 0x7f44b415cdf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44b40b0e20 tx=0x7f44a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bbd7672f88b411 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b1ffb640 1 -- 172.21.15.82:0/3564761474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80ac600 con 0x7f44b415a580 2023-07-20T09:50:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b1ffb640 1 -- 172.21.15.82:0/3564761474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a80a8050 con 0x7f44b415a580 2023-07-20T09:50:33.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b1ffb640 1 -- 172.21.15.82:0/3564761474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a80ac980 con 0x7f44b415a580 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 -- 172.21.15.82:0/3564761474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b415a580 msgr2=0x7f44b415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b415a580 0x7f44b415cdf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44b40b0e20 tx=0x7f44a801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 -- 172.21.15.82:0/3564761474 shutdown_connections 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b40cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 --2- 172.21.15.82:0/3564761474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b415a580 0x7f44b415cdf0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f44b40b0e20 tx=0x7f44a801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 --2- 172.21.15.82:0/3564761474 >> v2:172.21.15.183:3300/0 conn(0x7f44b415a1a0 0x7f44b4160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.906+0000 7f44b966a640 1 -- 172.21.15.82:0/3564761474 >> 172.21.15.82:0/3564761474 conn(0x7f44b4069750 msgr2=0x7f44b4069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600aed60 con 0x7fda680ce9c0 2023-07-20T09:50:33.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda600b7410 con 0x7fda680ce9c0 2023-07-20T09:50:33.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 0x7f8f8404a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f90c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f90c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57688/0 (socket says 172.21.15.82:57688) 2023-07-20T09:50:33.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f90c9c640 1 -- 172.21.15.82:0/1946538460 learned_addr learned my addr 172.21.15.82:0/1946538460 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:33.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f8404bcf0 0x7f8f840dce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:33.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 0x7f8f8404a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:33.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f616dd9b640 1 -- 172.21.15.82:0/1716466800 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160008be0 con 0x7f61680e3500 2023-07-20T09:50:33.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f616dd9b640 1 -- 172.21.15.82:0/1716466800 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160008d40 con 0x7f61680e3500 2023-07-20T09:50:33.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f616dd9b640 1 -- 172.21.15.82:0/1716466800 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000a2f0 con 0x7f61680e3500 2023-07-20T09:50:33.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600b77c0 con 0x7fda680ce9c0 2023-07-20T09:50:33.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda6d396640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda68162ac0 con 0x7fda680ce9c0 2023-07-20T09:50:33.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda6d396640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6809b8b0 con 0x7fda680ce9c0 2023-07-20T09:50:33.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8404a820 con 0x7f8f8404bcf0 2023-07-20T09:50:33.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840d2790 con 0x7f8f840df570 2023-07-20T09:50:33.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840d2a70 con 0x7f8f84050390 2023-07-20T09:50:33.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f44b966a640 1 -- 172.21.15.82:0/3564761474 shutdown_connections 2023-07-20T09:50:33.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61680e3500 msgr2=0x7f6168038340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 --2- 172.21.15.82:0/1716466800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61680e3500 0x7f6168038340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61600071d0 tx=0x7f616001dfe0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 shutdown_connections 2023-07-20T09:50:33.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 --2- 172.21.15.82:0/1716466800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61680e3500 0x7f6168038340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 >> 172.21.15.82:0/1716466800 conn(0x7f6168054c50 msgr2=0x7f6168055060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 -- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 msgr2=0x7f8f8404e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 -- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f8404bcf0 msgr2=0x7f8f840dce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f8404bcf0 0x7f8f840dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:33.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78009420 con 0x7f8f840df570 2023-07-20T09:50:34.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 shutdown_connections 2023-07-20T09:50:34.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f6175103640 1 -- 172.21.15.82:0/1716466800 wait complete. 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f90c9c640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f8bfff640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 0x7f8f8404a2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c430 tx=0x7f8f8000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80005cf0 con 0x7f8f840df570 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80005e50 con 0x7f8f840df570 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800072d0 con 0x7f8f840df570 2023-07-20T09:50:34.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f840d2d50 con 0x7f8f840df570 2023-07-20T09:50:34.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f8f91c9e640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8404c180 con 0x7f8f840df570 2023-07-20T09:50:34.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7fda6d396640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6809bb90 con 0x7fda680ce9c0 2023-07-20T09:50:34.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fda600b4050 con 0x7fda680ce9c0 2023-07-20T09:50:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f44b966a640 1 -- 172.21.15.82:0/3564761474 wait complete. 2023-07-20T09:50:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 Processor -- start 2023-07-20T09:50:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.910+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4418007600 con 0x7f441c03ed00 2023-07-20T09:50:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f4420ff9640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 0x7f4408068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44180833d0 con 0x7f441c03ed00 2023-07-20T09:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44237fe640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 0x7f4408068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44237fe640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 0x7f4408068740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44100ad000 tx=0x7f4410004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 -- start start 2023-07-20T09:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f6175103640 1 Processor -- start 2023-07-20T09:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f6175103640 1 -- start start 2023-07-20T09:50:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f6175103640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b2ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b2ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58698/0 (socket says 172.21.15.82:58698) 2023-07-20T09:50:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53428/0 (socket says 172.21.15.82:53428) 2023-07-20T09:50:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f6175103640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 0x7f616804a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40715a0 con 0x7f44b40704f0 2023-07-20T09:50:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4070990 con 0x7f44b415a1a0 2023-07-20T09:50:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b966a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4070c70 con 0x7f44b415d330 2023-07-20T09:50:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f44b2ffd640 1 -- 172.21.15.82:0/3910512561 learned_addr learned my addr 172.21.15.82:0/3910512561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f616ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f616ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53436/0 (socket says 172.21.15.82:53436) 2023-07-20T09:50:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f6175103640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 0x7f616804ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 -- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 msgr2=0x7f44b406ffb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T09:50:34.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 -- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 msgr2=0x7f44b4159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 -- 172.21.15.82:0/3910512561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a80094d0 con 0x7f44b40704f0 2023-07-20T09:50:34.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b2ffd640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:34.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 0x7f616804a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 0x7f616804a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58706/0 (socket says 172.21.15.82:58706) 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f6175103640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616818a7f0 con 0x7f6168053e20 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f6175103640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616804c0b0 con 0x7f61680df430 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f6175103640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616818a510 con 0x7f61680e3500 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 0x7f616804ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616ed9d640 1 -- 172.21.15.82:0/299400280 learned_addr learned my addr 172.21.15.82:0/299400280 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 -- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 msgr2=0x7f616804a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 0x7f616804a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 -- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 msgr2=0x7f6168188f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 -- 172.21.15.82:0/299400280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616000ae50 con 0x7f61680e3500 2023-07-20T09:50:34.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441c0058f0 con 0x7f441c03ed00 2023-07-20T09:50:34.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b37fe640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007d40 tx=0x7f44ac00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f64005260 con 0x7f8f840df570 2023-07-20T09:50:34.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.914+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f80007430 con 0x7f8f840df570 2023-07-20T09:50:34.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f8f897fa640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 0x7f8f70068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f800832e0 con 0x7f8f840df570 2023-07-20T09:50:34.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f8f90c9c640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 0x7f8f70068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616ed9d640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:34.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f616f59e640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 0x7f616804ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61600ac000 tx=0x7f616001b0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7fda4f7fe640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 0x7fda54068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0039a0 con 0x7f44b40704f0 2023-07-20T09:50:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00f040 con 0x7f44b40704f0 2023-07-20T09:50:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b4070f50 con 0x7f44b40704f0 2023-07-20T09:50:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac003d40 con 0x7f44b40704f0 2023-07-20T09:50:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b4159eb0 con 0x7f44b40704f0 2023-07-20T09:50:34.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7f8f90c9c640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 0x7f8f70068810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c068a30 tx=0x7f8f8c071040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7fda66ffd640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 0x7fda54068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.918+0000 7fda66ffd640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 0x7fda54068810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda580044d0 tx=0x7fda5800d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda6011ecf0 con 0x7fda680ce9c0 2023-07-20T09:50:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda601232e0 con 0x7fda680ce9c0 2023-07-20T09:50:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f80050760 con 0x7f8f840df570 2023-07-20T09:50:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b4071710 con 0x7f44b40704f0 2023-07-20T09:50:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44ac004030 con 0x7f44b40704f0 2023-07-20T09:50:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44180507d0 con 0x7f441c03ed00 2023-07-20T09:50:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000f150 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160008ac0 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600a6860 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680500b0 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61680da700 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.926+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61600a69c0 con 0x7f61680e3500 2023-07-20T09:50:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.930+0000 7f61577fe640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 0x7f615c068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.930+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f616011cb60 con 0x7f61680e3500 2023-07-20T09:50:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f449b7fe640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 0x7f44a00687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.922+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44ac083f10 con 0x7f44b40704f0 2023-07-20T09:50:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.926+0000 7f44b2ffd640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 0x7f44a00687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.926+0000 7f44b2ffd640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 0x7f44a00687c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006b20 tx=0x7f44a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.930+0000 7f616ed9d640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 0x7f615c068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:34.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.930+0000 7f616ed9d640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 0x7f615c068810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6170067960 tx=0x7f6170061230 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:34.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.930+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616804ff10 con 0x7f61680e3500 2023-07-20T09:50:34.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.934+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44ac0514b0 con 0x7f44b40704f0 2023-07-20T09:50:34.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:33.934+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f616804ff10 con 0x7f61680e3500 2023-07-20T09:50:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.210+0000 7f9adf5f3640 1 -- 172.21.15.82:0/1993423624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ad814a8f0 con 0x7f9ad80b0900 2023-07-20T09:50:34.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.210+0000 7f9acdffb640 1 -- 172.21.15.82:0/1993423624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ad0054640 con 0x7f9ad80b0900 2023-07-20T09:50:34.250 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2023-07-20T09:50:34.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 msgr2=0x7f9abc068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 0x7f9abc068770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ad806e230 tx=0x7f9ad40ad040 comp rx=0 tx=0).stop 2023-07-20T09:50:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 msgr2=0x7f9ad81fd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000c770 tx=0x7f9ad000cc30 comp rx=0 tx=0).stop 2023-07-20T09:50:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 shutdown_connections 2023-07-20T09:50:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9abc0662b0 0x7f9abc068770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ad8159160 0x7f9ad806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ad8152b70 0x7f9ad81f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 --2- 172.21.15.82:0/1993423624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ad80b0900 0x7f9ad81fd310 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 >> 172.21.15.82:0/1993423624 conn(0x7f9ad80afde0 msgr2=0x7f9ad8070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.214+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 shutdown_connections 2023-07-20T09:50:34.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.218+0000 7f9ac37fe640 1 -- 172.21.15.82:0/1993423624 wait complete. 2023-07-20T09:50:34.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.218+0000 7feda6634640 1 -- 172.21.15.82:0/232453948 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fed80005510 con 0x7feda00b2790 2023-07-20T09:50:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.218+0000 7fed9cff9640 1 -- 172.21.15.82:0/232453948 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed90006c40 con 0x7feda00b2790 2023-07-20T09:50:34.256 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 msgr2=0x7fed8c068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 0x7fed8c068840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed9401f3d0 tx=0x7fed940aa000 comp rx=0 tx=0).stop 2023-07-20T09:50:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 msgr2=0x7feda0070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 0x7feda0070900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feda0074970 tx=0x7fed90011e10 comp rx=0 tx=0).stop 2023-07-20T09:50:34.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 shutdown_connections 2023-07-20T09:50:34.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fed8c066380 0x7fed8c068840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feda00b2c10 0x7feda0070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feda00b2790 0x7feda0070900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 --2- 172.21.15.82:0/232453948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed88003980 0x7feda0155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 >> 172.21.15.82:0/232453948 conn(0x7feda00afc00 msgr2=0x7feda006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.222+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 shutdown_connections 2023-07-20T09:50:34.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.226+0000 7fed867fc640 1 -- 172.21.15.82:0/232453948 wait complete. 2023-07-20T09:50:34.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.230+0000 7f8ed1048640 1 -- 172.21.15.82:0/3321995653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ecc0cba10 con 0x7f8ecc158c20 2023-07-20T09:50:34.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.230+0000 7f8eb37fe640 1 -- 172.21.15.82:0/3321995653 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ecc0cba10 con 0x7f8ecc158c20 2023-07-20T09:50:34.270 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:34.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 msgr2=0x7f8eb8068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 0x7f8eb8068810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc007fd0 tx=0x7f8ebc007e40 comp rx=0 tx=0).stop 2023-07-20T09:50:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 msgr2=0x7f8ecc150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ec401b7b0 tx=0x7f8ec401b940 comp rx=0 tx=0).stop 2023-07-20T09:50:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 shutdown_connections 2023-07-20T09:50:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8eb8066350 0x7f8eb8068810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ecc158c20 0x7f8ecc150b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ecc152b70 0x7f8ecc150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 --2- 172.21.15.82:0/3321995653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc0b2300 0x7f8ecc141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 >> 172.21.15.82:0/3321995653 conn(0x7f8ecc0afde0 msgr2=0x7f8ecc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 shutdown_connections 2023-07-20T09:50:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.234+0000 7f8eb17fa640 1 -- 172.21.15.82:0/3321995653 wait complete. 2023-07-20T09:50:34.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7fda6d396640 1 -- 172.21.15.82:0/2576179785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fda6809bb90 con 0x7fda680ce9c0 2023-07-20T09:50:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8f64005510 con 0x7f8f840df570 2023-07-20T09:50:34.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7fda4f7fe640 1 -- 172.21.15.82:0/2576179785 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda600ec320 con 0x7fda680ce9c0 2023-07-20T09:50:34.282 INFO:teuthology.orchestra.run.smithi082.stdout:55834574852 2023-07-20T09:50:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7f8f897fa640 1 -- 172.21.15.82:0/1946538460 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f80053d80 con 0x7f8f840df570 2023-07-20T09:50:34.283 INFO:teuthology.orchestra.run.smithi082.stdout:55834574855 2023-07-20T09:50:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 msgr2=0x7fda54068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.246+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 0x7fda54068810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda580044d0 tx=0x7fda5800d040 comp rx=0 tx=0).stop 2023-07-20T09:50:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 msgr2=0x7fda68161a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda6001a4d0 tx=0x7fda60019640 comp rx=0 tx=0).stop 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 shutdown_connections 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fda54066350 0x7fda54068810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda680cfed0 0x7fda681f9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda680ce9c0 0x7fda68161a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 --2- 172.21.15.82:0/2576179785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda680af8e0 0x7fda680c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 >> 172.21.15.82:0/2576179785 conn(0x7fda68098a10 msgr2=0x7fda680999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 shutdown_connections 2023-07-20T09:50:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7fda4d7fa640 1 -- 172.21.15.82:0/2576179785 wait complete. 2023-07-20T09:50:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f441c03b080 con 0x7f441c03ed00 2023-07-20T09:50:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 msgr2=0x7f8f70068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f4420ff9640 1 -- 172.21.15.82:0/657376314 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4418017030 con 0x7f441c03ed00 2023-07-20T09:50:34.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 0x7f8f70068810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c068a30 tx=0x7f8f8c071040 comp rx=0 tx=0).stop 2023-07-20T09:50:34.289 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 msgr2=0x7f8f8404a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 0x7f8f8404a2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c430 tx=0x7f8f8000c8f0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 shutdown_connections 2023-07-20T09:50:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8f70066350 0x7f8f70068810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f8404bcf0 0x7f8f840dce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f840df570 0x7f8f8404a2e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 --2- 172.21.15.82:0/1946538460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f84050390 0x7f8f8404e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 >> 172.21.15.82:0/1946538460 conn(0x7f8f84054c20 msgr2=0x7f8f84055000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 shutdown_connections 2023-07-20T09:50:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.250+0000 7f8f76ffd640 1 -- 172.21.15.82:0/1946538460 wait complete. 2023-07-20T09:50:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f616804ff10 con 0x7f61680e3500 2023-07-20T09:50:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 msgr2=0x7f4408068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 0x7f4408068740 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44100ad000 tx=0x7f4410004740 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 msgr2=0x7f441c0de050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f441800c3c0 tx=0x7f441800c880 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 shutdown_connections 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4408066280 0x7f4408068740 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f441c0e6890 0x7f441c0d61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f441c054340 0x7f441c0d5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 --2- 172.21.15.82:0/657376314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f441c03ed00 0x7f441c0de050 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 >> 172.21.15.82:0/657376314 conn(0x7f441c059130 msgr2=0x7f441c03b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f61577fe640 1 -- 172.21.15.82:0/299400280 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f616804ff10 con 0x7f61680e3500 2023-07-20T09:50:34.294 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 shutdown_connections 2023-07-20T09:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.254+0000 7f440e7fc640 1 -- 172.21.15.82:0/657376314 wait complete. 2023-07-20T09:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 msgr2=0x7f615c068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 0x7f615c068810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6170067960 tx=0x7f6170061230 comp rx=0 tx=0).stop 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 msgr2=0x7f616804ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 0x7f616804ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61600ac000 tx=0x7f616001b0d0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 shutdown_connections 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f615c066350 0x7f615c068810 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61680e3500 0x7f616804ae90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61680df430 0x7f616804a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 --2- 172.21.15.82:0/299400280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6168053e20 0x7f6168188f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 >> 172.21.15.82:0/299400280 conn(0x7f6168054c50 msgr2=0x7f6168039170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 shutdown_connections 2023-07-20T09:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f6175103640 1 -- 172.21.15.82:0/299400280 wait complete. 2023-07-20T09:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44b4073c70 con 0x7f44b40704f0 2023-07-20T09:50:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.258+0000 7f449b7fe640 1 -- 172.21.15.82:0/3910512561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44ac01a090 con 0x7f44b40704f0 2023-07-20T09:50:34.298 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:34.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-07-20T09:50:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 msgr2=0x7f44a00687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 0x7f44a00687c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f44a4006b20 tx=0x7f44a4008040 comp rx=0 tx=0).stop 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 msgr2=0x7f44b40ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44ac007d40 tx=0x7f44ac00d4a0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 shutdown_connections 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f44a0066300 0x7f44a00687c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44b40704f0 0x7f44b40ade50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44b415d330 0x7f44b406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 --2- 172.21.15.82:0/3910512561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44b415a1a0 0x7f44b4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 >> 172.21.15.82:0/3910512561 conn(0x7f44b4069750 msgr2=0x7f44b415f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 shutdown_connections 2023-07-20T09:50:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:34.262+0000 7f44b966a640 1 -- 172.21.15.82:0/3910512561 wait complete. 2023-07-20T09:50:34.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-07-20T09:50:34.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-07-20T09:50:34.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-07-20T09:50:34.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-07-20T09:50:34.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-07-20T09:50:34.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-07-20T09:50:35.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-20T09:50:35.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-20T09:50:35.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-20T09:50:35.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-20T09:50:35.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-20T09:50:35.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-20T09:50:35.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-20T09:50:35.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-20T09:50:35.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 Processor -- start 2023-07-20T09:50:35.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 -- start start 2023-07-20T09:50:35.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 0x7f1d400b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4015c720 con 0x7f1d40152b70 2023-07-20T09:50:35.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d40159670 con 0x7f1d401590a0 2023-07-20T09:50:35.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d471ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40159c30 con 0x7f1d40158c20 2023-07-20T09:50:35.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d44f56640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1d40152b70 0x7f1d4015cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42626/0 (socket says 172.21.15.82:42626) 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d44f56640 1 -- 172.21.15.82:0/2058982513 learned_addr learned my addr 172.21.15.82:0/2058982513 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.470+0000 7f1d3ffff640 1 --2- 172.21.15.82:0/2058982513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 0x7f1d400b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281878279 0 0) 0x7f1d40159670 con 0x7f1d401590a0 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d28005740 con 0x7f1d401590a0 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506765448 0 0) 0x7f1d4015c720 con 0x7f1d40152b70 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d40159670 con 0x7f1d40152b70 2023-07-20T09:50:35.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3ffff640 1 -- 172.21.15.82:0/2058982513 >> v1:172.21.15.183:6789/0 conn(0x7f1d401590a0 legacy=0x7f1d40070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3ffff640 1 -- 172.21.15.82:0/2058982513 >> v1:172.21.15.82:6789/0 conn(0x7f1d40152b70 legacy=0x7f1d4015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.474+0000 7f1d3ffff640 1 -- 172.21.15.82:0/2058982513 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40159950 con 0x7f1d40158c20 2023-07-20T09:50:35.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d3ffff640 1 --2- 172.21.15.82:0/2058982513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 0x7f1d400b1bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097f0 tx=0x7f1d3401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d26e53d54c47ff server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340a6690 con 0x7f1d40158c20 2023-07-20T09:50:35.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d3f7fe640 1 -- 172.21.15.82:0/2058982513 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340a67f0 con 0x7f1d40158c20 2023-07-20T09:50:35.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 -- 172.21.15.82:0/2058982513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 msgr2=0x7f1d400b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 --2- 172.21.15.82:0/2058982513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 0x7f1d400b1bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097f0 tx=0x7f1d3401c5a0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 -- 172.21.15.82:0/2058982513 shutdown_connections 2023-07-20T09:50:35.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 --2- 172.21.15.82:0/2058982513 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d40158c20 0x7f1d400b1bf0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d340097f0 tx=0x7f1d3401c5a0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 -- 172.21.15.82:0/2058982513 >> 172.21.15.82:0/2058982513 conn(0x7f1d400afde0 msgr2=0x7f1d400b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 -- 172.21.15.82:0/2058982513 shutdown_connections 2023-07-20T09:50:35.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.478+0000 7f1d471ba640 1 -- 172.21.15.82:0/2058982513 wait complete. 2023-07-20T09:50:35.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.482+0000 7f1d471ba640 1 Processor -- start 2023-07-20T09:50:35.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.482+0000 7f1d471ba640 1 -- start start 2023-07-20T09:50:35.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d401590a0 0x7f1d4006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40144730 0x7f1d4006d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40148580 con 0x7f1d40152b70 2023-07-20T09:50:35.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40146f70 con 0x7f1d40144730 2023-07-20T09:50:35.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40147250 con 0x7f1d401590a0 2023-07-20T09:50:35.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53442/0 (socket says 172.21.15.82:53442) 2023-07-20T09:50:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 -- 172.21.15.82:0/3378530743 learned_addr learned my addr 172.21.15.82:0/3378530743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d45757640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40144730 0x7f1d4006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d3ffff640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d401590a0 0x7f1d4006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 -- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d401590a0 msgr2=0x7f1d4006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d401590a0 0x7f1d4006cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 -- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40144730 msgr2=0x7f1d4006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40144730 0x7f1d4006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 -- 172.21.15.82:0/3378530743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34009420 con 0x7f1d40152b70 2023-07-20T09:50:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d44f56640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000d5f0 tx=0x7f1d3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000f850 con 0x7f1d40152b70 2023-07-20T09:50:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000f9b0 con 0x7f1d40152b70 2023-07-20T09:50:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 -- 172.21.15.82:0/3378530743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d400caef0 con 0x7f1d40152b70 2023-07-20T09:50:35.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.486+0000 7f1d471ba640 1 -- 172.21.15.82:0/3378530743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4015b860 con 0x7f1d40152b70 2023-07-20T09:50:35.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.490+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000fde0 con 0x7f1d40152b70 2023-07-20T09:50:35.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.490+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d30010420 con 0x7f1d40152b70 2023-07-20T09:50:35.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.494+0000 7f1d3d7fa640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 0x7f1d2806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.494+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d30009040 con 0x7f1d40152b70 2023-07-20T09:50:35.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.494+0000 7f1d3ffff640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 0x7f1d2806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.494+0000 7f1d3ffff640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 0x7f1d2806d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d340af000 tx=0x7f1d340a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.494+0000 7f1d471ba640 1 -- 172.21.15.82:0/3378530743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d20005260 con 0x7f1d40152b70 2023-07-20T09:50:35.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.502+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d30051720 con 0x7f1d40152b70 2023-07-20T09:50:35.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.542+0000 7f8807e6d640 1 Processor -- start 2023-07-20T09:50:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8807e6d640 1 -- start start 2023-07-20T09:50:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8807e6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8800152b70 0x7f880015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8807e6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880015c720 con 0x7f88000b2300 2023-07-20T09:50:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8807e6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8800159670 con 0x7f8800158c20 2023-07-20T09:50:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8807e6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8800159c30 con 0x7f8800152b70 2023-07-20T09:50:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8805408640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f8800158c20 0x7f88000b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:35004/0 (socket says 172.21.15.82:35004) 2023-07-20T09:50:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7f8805408640 1 -- 172.21.15.82:0/1019910436 learned_addr learned my addr 172.21.15.82:0/1019910436 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8805c09640 1 --2- 172.21.15.82:0/1019910436 >> v2:172.21.15.183:3300/0 conn(0x7f8800152b70 0x7f880015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172140147 0 0) 0x7f880015c720 con 0x7f88000b2300 2023-07-20T09:50:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ec003530 con 0x7f88000b2300 2023-07-20T09:50:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504369756 0 0) 0x7f8800159670 con 0x7f8800158c20 2023-07-20T09:50:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880015c720 con 0x7f8800158c20 2023-07-20T09:50:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8805c09640 1 -- 172.21.15.82:0/1019910436 >> v1:172.21.15.183:6789/0 conn(0x7f8800158c20 legacy=0x7f88000b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8805c09640 1 -- 172.21.15.82:0/1019910436 >> v1:172.21.15.82:6789/0 conn(0x7f88000b2300 legacy=0x7f8800070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7f8805c09640 1 -- 172.21.15.82:0/1019910436 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8800159950 con 0x7f8800152b70 2023-07-20T09:50:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 Processor -- start 2023-07-20T09:50:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 -- start start 2023-07-20T09:50:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5940cd810 0x7fc5940ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5940cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc593fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5940cd810 0x7fc5940ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc598ead640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc5940cd430 0x7fc5940c86d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34998/0 (socket says 172.21.15.82:34998) 2023-07-20T09:50:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8805c09640 1 --2- 172.21.15.82:0/1019910436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f880015cbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00ba50 tx=0x7f87fc01c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eceb9bdd8ce12baf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc598ead640 1 -- 172.21.15.82:0/301596188 learned_addr learned my addr 172.21.15.82:0/301596188 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc5996ae640 1 --2- 172.21.15.82:0/301596188 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5940cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc594160e60 con 0x7fc5940cd430 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5940c9220 con 0x7fc5940cd810 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.546+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc594161120 con 0x7fc5940cadf0 2023-07-20T09:50:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7fc5996ae640 1 -- 172.21.15.82:0/301596188 >> v2:172.21.15.183:3300/0 conn(0x7fc5940cd810 msgr2=0x7fc5940ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7fc5996ae640 1 --2- 172.21.15.82:0/301596188 >> v2:172.21.15.183:3300/0 conn(0x7fc5940cd810 0x7fc5940ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7fc5996ae640 1 -- 172.21.15.82:0/301596188 >> v1:172.21.15.183:6789/0 conn(0x7fc5940cd430 legacy=0x7fc5940c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.550+0000 7fc5996ae640 1 -- 172.21.15.82:0/301596188 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594161400 con 0x7fc5940cadf0 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc5996ae640 1 --2- 172.21.15.82:0/301596188 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5940cbc50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009d90 tx=0x7fc58c01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6df770c7e83eaadb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc5937fe640 1 -- 172.21.15.82:0/301596188 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0ab600 con 0x7fc5940cadf0 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc5937fe640 1 -- 172.21.15.82:0/301596188 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0a7050 con 0x7fc5940cadf0 2023-07-20T09:50:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc5937fe640 1 -- 172.21.15.82:0/301596188 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0ab980 con 0x7fc5940cadf0 2023-07-20T09:50:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0a5970 con 0x7f8800152b70 2023-07-20T09:50:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0a9070 con 0x7f8800152b70 2023-07-20T09:50:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8804c07640 1 -- 172.21.15.82:0/1019910436 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0a5cf0 con 0x7f8800152b70 2023-07-20T09:50:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 -- 172.21.15.82:0/1019910436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 msgr2=0x7f880015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 --2- 172.21.15.82:0/1019910436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f880015cbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00ba50 tx=0x7f87fc01c8f0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 msgr2=0x7fc5940cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 -- 172.21.15.82:0/1019910436 shutdown_connections 2023-07-20T09:50:35.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 --2- 172.21.15.82:0/1019910436 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f880015cbb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 -- 172.21.15.82:0/1019910436 >> 172.21.15.82:0/1019910436 conn(0x7f88000afde0 msgr2=0x7f88000b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 --2- 172.21.15.82:0/301596188 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5940cbc50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009d90 tx=0x7fc58c01c7e0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 shutdown_connections 2023-07-20T09:50:35.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 --2- 172.21.15.82:0/301596188 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5940cbc50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7f8807e6d640 1 -- 172.21.15.82:0/1019910436 shutdown_connections 2023-07-20T09:50:35.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 --2- 172.21.15.82:0/301596188 >> v2:172.21.15.183:3300/0 conn(0x7fc5940cd810 0x7fc5940ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 >> 172.21.15.82:0/301596188 conn(0x7fc5940afb90 msgr2=0x7fc5940affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 Processor -- start 2023-07-20T09:50:35.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 -- start start 2023-07-20T09:50:35.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 shutdown_connections 2023-07-20T09:50:35.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.554+0000 7fc599eaf640 1 -- 172.21.15.82:0/301596188 wait complete. 2023-07-20T09:50:35.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7f5ed1e61640 1 Processor -- start 2023-07-20T09:50:35.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7f8807e6d640 1 -- 172.21.15.82:0/1019910436 wait complete. 2023-07-20T09:50:35.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7f8807e6d640 1 Processor -- start 2023-07-20T09:50:35.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7f5ed1e61640 1 -- start start 2023-07-20T09:50:35.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea101609e0 0x7fea1006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1006fe50 con 0x7fea10164f60 2023-07-20T09:50:35.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea10165370 con 0x7fea1006bb40 2023-07-20T09:50:35.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fea16ccb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1006bff0 con 0x7fea101609e0 2023-07-20T09:50:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7f8807e6d640 1 -- start start 2023-07-20T09:50:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea101609e0 0x7fea1006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fea101609e0 0x7fea1006b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53446/0 (socket says 172.21.15.82:53446) 2023-07-20T09:50:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 -- 172.21.15.82:0/1287504182 learned_addr learned my addr 172.21.15.82:0/1287504182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 0x7f8800146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f88000af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 -- 172.21.15.82:0/1287504182 >> v1:172.21.15.183:6789/0 conn(0x7fea1006bb40 legacy=0x7fea10164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 -- 172.21.15.82:0/1287504182 >> v1:172.21.15.82:6789/0 conn(0x7fea10164f60 legacy=0x7fea10160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fea14a67640 1 -- 172.21.15.82:0/1287504182 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100700a0 con 0x7fea101609e0 2023-07-20T09:50:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8800158c20 0x7f8800144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805c09640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 0x7f8800146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88000afc80 con 0x7f8800158c20 2023-07-20T09:50:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001f89f0 con 0x7f8800152b70 2023-07-20T09:50:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800071160 con 0x7f88000b2300 2023-07-20T09:50:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805c09640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 0x7f8800146fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57742/0 (socket says 172.21.15.82:57742) 2023-07-20T09:50:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805c09640 1 -- 172.21.15.82:0/54508086 learned_addr learned my addr 172.21.15.82:0/54508086 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ed1e61640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f88000af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fc599eaf640 1 Processor -- start 2023-07-20T09:50:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 -- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 msgr2=0x7f8800146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 0x7f8800146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 -- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8800158c20 msgr2=0x7f8800144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8800158c20 0x7f8800144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 -- 172.21.15.82:0/54508086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc00b6b0 con 0x7f8800152b70 2023-07-20T09:50:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ecb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ecb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53478/0 (socket says 172.21.15.82:53478) 2023-07-20T09:50:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.558+0000 7fc599eaf640 1 -- start start 2023-07-20T09:50:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/1820361728 learned_addr learned my addr 172.21.15.82:0/1820361728 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 0x7fc59415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57730/0 (socket says 172.21.15.82:57730) 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc593fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 0x7fc59415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc593fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 0x7fc59415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53462/0 (socket says 172.21.15.82:53462) 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5940cd810 0x7fc59415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59415c900 con 0x7fc5940cd430 2023-07-20T09:50:35.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc06da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8805408640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f88000af740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c680 tx=0x7f87f000cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0007900 con 0x7f8800152b70 2023-07-20T09:50:35.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0007a60 con 0x7f8800152b70 2023-07-20T09:50:35.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0007e50 con 0x7f8800152b70 2023-07-20T09:50:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800071440 con 0x7f8800152b70 2023-07-20T09:50:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8800145190 con 0x7f8800152b70 2023-07-20T09:50:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0cf740 con 0x7f5ecc06df50 2023-07-20T09:50:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc0cb1f0 con 0x7f5ecc15a210 2023-07-20T09:50:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc06e3c0 con 0x7f5ecc0cf2e0 2023-07-20T09:50:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fd149963640 1 Processor -- start 2023-07-20T09:50:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/1820361728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 msgr2=0x7f5ecc06da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-20T09:50:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f5ecb7fe640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc06da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/1820361728 >> v1:172.21.15.183:6789/0 conn(0x7f5ecc06df50 legacy=0x7f5ecc15ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/1820361728 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0ce9e0 con 0x7f5ecc15a210 2023-07-20T09:50:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fd149963640 1 -- start start 2023-07-20T09:50:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea14a67640 1 --2- 172.21.15.82:0/1287504182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1006b600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea00009870 tx=0x7fea0001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9401dde9bfe369 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd14406c0e0 0x7fd14406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1440ca930 0x7fd1440cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440c98f0 con 0x7fd1440ca930 2023-07-20T09:50:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440cc3b0 con 0x7fd14406c0e0 2023-07-20T09:50:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea0f7fe640 1 -- 172.21.15.82:0/1287504182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000aa430 con 0x7fea101609e0 2023-07-20T09:50:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd149963640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440cb300 con 0x7fd144158620 2023-07-20T09:50:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57756/0 (socket says 172.21.15.82:57756) 2023-07-20T09:50:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 -- 172.21.15.82:0/2218840052 learned_addr learned my addr 172.21.15.82:0/2218840052 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 -- 172.21.15.82:0/2218840052 >> v2:172.21.15.183:3300/0 conn(0x7fd14406c0e0 msgr2=0x7fd14406f720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-20T09:50:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880015adc0 con 0x7f8800152b70 2023-07-20T09:50:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea0f7fe640 1 -- 172.21.15.82:0/1287504182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000aa590 con 0x7fea101609e0 2023-07-20T09:50:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea0f7fe640 1 -- 172.21.15.82:0/1287504182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000aa430 con 0x7fea101609e0 2023-07-20T09:50:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 --2- 172.21.15.82:0/2218840052 >> v2:172.21.15.183:3300/0 conn(0x7fd14406c0e0 0x7fd14406f720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87f0018400 con 0x7f8800152b70 2023-07-20T09:50:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea16ccb640 1 -- 172.21.15.82:0/1287504182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 msgr2=0x7fea1006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fea16ccb640 1 --2- 172.21.15.82:0/1287504182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1006b600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fea00009870 tx=0x7fea0001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 -- 172.21.15.82:0/2218840052 >> v2:172.21.15.82:3300/0 conn(0x7fd1440ca930 msgr2=0x7fd1440cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 -- 172.21.15.82:0/1287504182 shutdown_connections 2023-07-20T09:50:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 --2- 172.21.15.82:0/1287504182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1006b600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 -- 172.21.15.82:0/1287504182 >> 172.21.15.82:0/1287504182 conn(0x7fea100afde0 msgr2=0x7fea100b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 --2- 172.21.15.82:0/2218840052 >> v2:172.21.15.82:3300/0 conn(0x7fd1440ca930 0x7fd1440cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fd148961640 1 -- 172.21.15.82:0/2218840052 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440c90e0 con 0x7fd144158620 2023-07-20T09:50:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 -- 172.21.15.82:0/1287504182 shutdown_connections 2023-07-20T09:50:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f87f67fc640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 0x7f87e4068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87f0083fb0 con 0x7f8800152b70 2023-07-20T09:50:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 -- 172.21.15.82:0/1287504182 wait complete. 2023-07-20T09:50:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f8805c09640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 0x7f87e4068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f5ecb7fe640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0098a0 tx=0x7f5ebc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ace946ff5ac9586 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59415c6d0 con 0x7fc5940cd810 2023-07-20T09:50:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f5ecaffd640 1 -- 172.21.15.82:0/1820361728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0ac640 con 0x7f5ecc15a210 2023-07-20T09:50:35.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f6b6a196640 1 Processor -- start 2023-07-20T09:50:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940c2f60 con 0x7fc5940cadf0 2023-07-20T09:50:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc593fff640 1 -- 172.21.15.82:0/1159035260 learned_addr learned my addr 172.21.15.82:0/1159035260 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc5996ae640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5940cd810 0x7fc59415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 -- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5940cd810 msgr2=0x7fc59415c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5940cd810 0x7fc59415c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 -- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 msgr2=0x7fc59415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 0x7fc59415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 -- 172.21.15.82:0/1159035260 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c009a70 con 0x7fc5940cadf0 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc598ead640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c7b0 tx=0x7fc58800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880072d0 con 0x7fc5940cadf0 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588007430 con 0x7fc5940cadf0 2023-07-20T09:50:35.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880047f0 con 0x7fc5940cadf0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 -- 172.21.15.82:0/1159035260 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc594160330 con 0x7fc5940cadf0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.562+0000 7fc599eaf640 1 -- 172.21.15.82:0/1159035260 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5940c31b0 con 0x7fc5940cadf0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.566+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc588004950 con 0x7fc5940cadf0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fc5917fa640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 0x7fc580068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc588083430 con 0x7fc5940cadf0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fc593fff640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 0x7fc580068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fc593fff640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 0x7fc580068810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc59406ab30 tx=0x7fc584009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f8805c09640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 0x7f87e4068810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f87fc000c10 tx=0x7f87fc0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 Processor -- start 2023-07-20T09:50:35.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5940c33a0 con 0x7fc5940cadf0 2023-07-20T09:50:35.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f6b6a196640 1 -- start start 2023-07-20T09:50:35.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f2fef0ca640 1 Processor -- start 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f5ecaffd640 1 -- 172.21.15.82:0/1820361728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0ac7a0 con 0x7f5ecc15a210 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc15a210 msgr2=0x7f5ecc0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0098a0 tx=0x7f5ebc01c500 comp rx=0 tx=0).stop 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 shutdown_connections 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc06da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/1820361728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc15a210 0x7f5ecc0cfdc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 >> 172.21.15.82:0/1820361728 conn(0x7f5ecc0b1e70 msgr2=0x7f5ecc0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fef0ca640 1 -- start start 2023-07-20T09:50:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 shutdown_connections 2023-07-20T09:50:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 -- 172.21.15.82:0/1820361728 wait complete. 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.570+0000 7fea16ccb640 1 -- start start 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b6a196640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b5c054a30 0x7f6b5c0ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b6a196640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 0x7f6b5c051890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b6a196640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c0364a0 con 0x7f6b5c038b40 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b6a196640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c0533c0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b6a196640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c0536a0 con 0x7f6b5c054a30 2023-07-20T09:50:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f880015adc0 con 0x7f8800152b70 2023-07-20T09:50:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea14a67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea14a67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58780/0 (socket says 172.21.15.82:58780) 2023-07-20T09:50:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b5c054a30 0x7f6b5c0ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6b5c054a30 0x7f6b5c0ec270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58770/0 (socket says 172.21.15.82:58770) 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 -- 172.21.15.82:0/580396993 learned_addr learned my addr 172.21.15.82:0/580396993 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea10164f60 0x7fea1015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1015f630 con 0x7fea101609e0 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea100cc190 con 0x7fea1006bb40 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea16ccb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100ccd10 con 0x7fea10164f60 2023-07-20T09:50:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea14a67640 1 -- 172.21.15.82:0/954972046 learned_addr learned my addr 172.21.15.82:0/954972046 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b63fff640 1 --2- 172.21.15.82:0/580396993 >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 0x7f6b5c051890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 -- 172.21.15.82:0/580396993 >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 msgr2=0x7f6b5c051890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 --2- 172.21.15.82:0/580396993 >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 0x7f6b5c051890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 -- 172.21.15.82:0/580396993 >> v1:172.21.15.183:6789/0 conn(0x7f6b5c038b40 legacy=0x7f6b5c0ebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b62ffd640 1 -- 172.21.15.82:0/580396993 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0544a0 con 0x7f6b5c054a30 2023-07-20T09:50:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fef0ca640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2fe80cd460 0x7f2fe8164470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fef0ca640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe806a860 con 0x7f2fe80ce620 2023-07-20T09:50:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fef0ca640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe806ab20 con 0x7f2fe80c3790 2023-07-20T09:50:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fef0ca640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe806ae00 con 0x7f2fe80cd460 2023-07-20T09:50:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea15268640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea10164f60 0x7fea1015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 Processor -- start 2023-07-20T09:50:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fd148961640 1 --2- 172.21.15.82:0/2218840052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b0c10 tx=0x7fd138020b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43820009899a2b17 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f6b63fff640 1 --2- 172.21.15.82:0/580396993 >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 0x7f6b5c051890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee0c8640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2fe80c3790 0x7f2fe80cdf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:35044/0 (socket says 172.21.15.82:35044) 2023-07-20T09:50:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee0c8640 1 -- 172.21.15.82:0/1001661838 learned_addr learned my addr 172.21.15.82:0/1001661838 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee8c9640 1 --2- 172.21.15.82:0/1001661838 >> v2:172.21.15.183:3300/0 conn(0x7f2fe80cd460 0x7f2fe8164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f5ed1e61640 1 -- start start 2023-07-20T09:50:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 -- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea10164f60 msgr2=0x7fea1015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea10164f60 0x7fea1015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 -- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 msgr2=0x7fea10143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea0ffff640 1 -- 172.21.15.82:0/954972046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000094d0 con 0x7fea101609e0 2023-07-20T09:50:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee8c9640 1 -- 172.21.15.82:0/1001661838 >> v1:172.21.15.183:6789/0 conn(0x7f2fe80c3790 legacy=0x7f2fe80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee8c9640 1 -- 172.21.15.82:0/1001661838 >> v1:172.21.15.82:6789/0 conn(0x7f2fe80ce620 legacy=0x7f2fe80ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7f2fee8c9640 1 -- 172.21.15.82:0/1001661838 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe806b0e0 con 0x7f2fe80cd460 2023-07-20T09:50:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.574+0000 7fea14a67640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea0ffff640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1015c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fea04001ec0 tx=0x7fea0400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ecc155930 0x7f5ecc1633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc154170 con 0x7f5ecc06df50 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc15d5a0 con 0x7f5ecc155930 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc15ca20 con 0x7f5ecc0cf2e0 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53540/0 (socket says 172.21.15.82:53540) 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/3132451268 learned_addr learned my addr 172.21.15.82:0/3132451268 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ec2ffd640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc588050940 con 0x7fc5940cadf0 2023-07-20T09:50:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecbfff640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ecc155930 0x7f5ecc1633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040052d0 con 0x7fea101609e0 2023-07-20T09:50:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04005430 con 0x7fea101609e0 2023-07-20T09:50:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04003840 con 0x7fea101609e0 2023-07-20T09:50:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea10146bf0 con 0x7fea101609e0 2023-07-20T09:50:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 msgr2=0x7f5ecc15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ecc155930 msgr2=0x7f5ecc1633e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ecc155930 0x7f5ecc1633e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 -- 172.21.15.82:0/3132451268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0094d0 con 0x7f5ecc06df50 2023-07-20T09:50:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ec2ffd640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:35.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100cc6c0 con 0x7fea101609e0 2023-07-20T09:50:35.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ecb7fe640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af040 tx=0x7f5ebc0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fd1437fe640 1 -- 172.21.15.82:0/2218840052 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a9c20 con 0x7fd144158620 2023-07-20T09:50:35.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fd1437fe640 1 -- 172.21.15.82:0/2218840052 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1380ad070 con 0x7fd144158620 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fd1437fe640 1 -- 172.21.15.82:0/2218840052 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1380a9c20 con 0x7fd144158620 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fd149963640 1 -- 172.21.15.82:0/2218840052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 msgr2=0x7fd1440cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fd149963640 1 --2- 172.21.15.82:0/2218840052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd1440b0c10 tx=0x7fd138020b90 comp rx=0 tx=0).stop 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0bb070 con 0x7f5ecc06df50 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0ab9d0 con 0x7f5ecc06df50 2023-07-20T09:50:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0abda0 con 0x7f5ecc06df50 2023-07-20T09:50:35.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc15cd00 con 0x7f5ecc06df50 2023-07-20T09:50:35.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f2fee8c9640 1 --2- 172.21.15.82:0/1001661838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe8164470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009d90 tx=0x7f2fe001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20144964a76c48c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1004da30 con 0x7fea101609e0 2023-07-20T09:50:35.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f6b62ffd640 1 --2- 172.21.15.82:0/580396993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c054a30 0x7f6b5c0ec270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c007b70 tx=0x7f6b5001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14898e0c539c505 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.578+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc15d2c0 con 0x7f5ecc06df50 2023-07-20T09:50:35.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fed0c6640 1 -- 172.21.15.82:0/1001661838 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00a5a00 con 0x7f2fe80cd460 2023-07-20T09:50:35.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fed0c6640 1 -- 172.21.15.82:0/1001661838 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe00a5b60 con 0x7f2fe80cd460 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fed0c6640 1 -- 172.21.15.82:0/1001661838 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00ad440 con 0x7f2fe80cd460 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 -- 172.21.15.82:0/2218840052 shutdown_connections 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 --2- 172.21.15.82:0/2218840052 >> v2:172.21.15.183:3300/0 conn(0x7fd14406c0e0 0x7fd14406f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 --2- 172.21.15.82:0/2218840052 >> v2:172.21.15.82:3300/0 conn(0x7fd1440ca930 0x7fd1440cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 --2- 172.21.15.82:0/2218840052 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd144158620 0x7fd1440cd9a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 -- 172.21.15.82:0/2218840052 >> 172.21.15.82:0/2218840052 conn(0x7fd1440afb90 msgr2=0x7fd1440affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 -- 172.21.15.82:0/2218840052 shutdown_connections 2023-07-20T09:50:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1001661838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 msgr2=0x7f2fe8164470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1001661838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe8164470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009d90 tx=0x7f2fe001c920 comp rx=0 tx=0).stop 2023-07-20T09:50:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea040039a0 con 0x7fea101609e0 2023-07-20T09:50:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1001661838 shutdown_connections 2023-07-20T09:50:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1001661838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe8164470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1001661838 >> 172.21.15.82:0/1001661838 conn(0x7f2fe80b1e50 msgr2=0x7f2fe80b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc04da30 con 0x7f5ecc06df50 2023-07-20T09:50:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 -- 172.21.15.82:0/2218840052 wait complete. 2023-07-20T09:50:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1001661838 shutdown_connections 2023-07-20T09:50:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f6b627fc640 1 -- 172.21.15.82:0/580396993 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500ac630 con 0x7f6b5c054a30 2023-07-20T09:50:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f6b627fc640 1 -- 172.21.15.82:0/580396993 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b500ac790 con 0x7f6b5c054a30 2023-07-20T09:50:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f6b627fc640 1 -- 172.21.15.82:0/580396993 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500acb20 con 0x7f6b5c054a30 2023-07-20T09:50:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fd149963640 1 Processor -- start 2023-07-20T09:50:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fea0d7fa640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 0x7fe9fc068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea040835b0 con 0x7fea101609e0 2023-07-20T09:50:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 -- 172.21.15.82:0/580396993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c054a30 msgr2=0x7f6b5c0ec270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 --2- 172.21.15.82:0/580396993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c054a30 0x7f6b5c0ec270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c007b70 tx=0x7f6b5001c4c0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fea14a67640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 0x7fe9fc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 -- 172.21.15.82:0/580396993 shutdown_connections 2023-07-20T09:50:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 --2- 172.21.15.82:0/580396993 >> v2:172.21.15.82:3300/0 conn(0x7f6b5c008ca0 0x7f6b5c051890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 --2- 172.21.15.82:0/580396993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c054a30 0x7f6b5c0ec270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 -- 172.21.15.82:0/580396993 >> 172.21.15.82:0/580396993 conn(0x7f6b5c0538e0 msgr2=0x7f6b5c053cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 -- 172.21.15.82:0/580396993 shutdown_connections 2023-07-20T09:50:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fea14a67640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 0x7fe9fc068810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea000190e0 tx=0x7fea000b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 -- 172.21.15.82:0/580396993 wait complete. 2023-07-20T09:50:35.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.582+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1001661838 wait complete. 2023-07-20T09:50:35.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f2fef0ca640 1 Processor -- start 2023-07-20T09:50:35.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 -- start start 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 0x7fd144145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd148961640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd143fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 0x7fd144145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd148961640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53550/0 (socket says 172.21.15.82:53550) 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd144158620 0x7fd144157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c6530 con 0x7fd14406c0e0 2023-07-20T09:50:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c67d0 con 0x7fd144158620 2023-07-20T09:50:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149963640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c6ab0 con 0x7fd1440ca930 2023-07-20T09:50:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd148961640 1 -- 172.21.15.82:0/2269083724 learned_addr learned my addr 172.21.15.82:0/2269083724 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f2fef0ca640 1 -- start start 2023-07-20T09:50:35.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f2fef0ca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 0x7f2fe80caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd149162640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd144158620 0x7fd144157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f6b6a196640 1 Processor -- start 2023-07-20T09:50:35.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f2fef0ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe81591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd143fff640 1 -- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd144158620 msgr2=0x7fd144157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd143fff640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd144158620 0x7fd144157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7fd143fff640 1 -- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 msgr2=0x7fd1440c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.586+0000 7f2fee0c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 0x7f2fe80caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fee0c8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 0x7f2fe80caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57790/0 (socket says 172.21.15.82:57790) 2023-07-20T09:50:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fee0c8640 1 -- 172.21.15.82:0/1118410844 learned_addr learned my addr 172.21.15.82:0/1118410844 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f6b6a196640 1 -- start start 2023-07-20T09:50:35.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd143fff640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd143fff640 1 -- 172.21.15.82:0/2269083724 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13800a570 con 0x7fd1440ca930 2023-07-20T09:50:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe81591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe80ce620 0x7f2fe80c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80b5420 con 0x7f2fe80ce620 2023-07-20T09:50:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8158d20 con 0x7f2fe80cd460 2023-07-20T09:50:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c2e10 con 0x7f2fe80c3790 2023-07-20T09:50:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fee8c9640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe80ce620 0x7f2fe80c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea04050b50 con 0x7fea101609e0 2023-07-20T09:50:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd148961640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd143fff640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 0x7fd144145030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd13000b410 tx=0x7fd13000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 -- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 msgr2=0x7f2fe80caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 0x7f2fe80caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 -- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe80ce620 msgr2=0x7f2fe80c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe80ce620 0x7f2fe80c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009a70 con 0x7f2fe80cd460 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fed8c7640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe81591b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8000f70 tx=0x7f2fd800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130011830 con 0x7fd1440ca930 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300119b0 con 0x7fd1440ca930 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd130011d60 con 0x7fd1440ca930 2023-07-20T09:50:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440c6d90 con 0x7fd1440ca930 2023-07-20T09:50:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd144145570 con 0x7fd1440ca930 2023-07-20T09:50:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124005260 con 0x7fd1440ca930 2023-07-20T09:50:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80052d0 con 0x7f2fe80cd460 2023-07-20T09:50:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd8005430 con 0x7f2fe80cd460 2023-07-20T09:50:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8003840 con 0x7f2fe80cd460 2023-07-20T09:50:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe81583f0 con 0x7f2fe80cd460 2023-07-20T09:50:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe81589b0 con 0x7f2fe80cd460 2023-07-20T09:50:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.590+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ebc0b3040 con 0x7f5ecc06df50 2023-07-20T09:50:35.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f5ec8ff9640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 0x7f5eac068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ebc11e090 con 0x7f5ecc06df50 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f5ec2ffd640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 0x7f5eac068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f5ec2ffd640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 0x7f5eac068840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc1552a0 tx=0x7f5eb40090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd13001a400 con 0x7fd1440ca930 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7fd1417fa640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 0x7fd128068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd1300843a0 con 0x7fd1440ca930 2023-07-20T09:50:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.594+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fd80039a0 con 0x7f2fe80cd460 2023-07-20T09:50:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f2fdeffd640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 0x7f2fcc068810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fd8083190 con 0x7f2fe80cd460 2023-07-20T09:50:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7fd148961640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 0x7fd128068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd130051940 con 0x7fd1440ca930 2023-07-20T09:50:35.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 0x7f6b5c04bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7fd148961640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 0x7fd128068810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1380209c0 tx=0x7fd13800d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f2fee0c8640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 0x7f2fcc068810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe804da30 con 0x7f2fe80cd460 2023-07-20T09:50:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b5c038b40 0x7f6b5c04cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0e7520 con 0x7f6b5c008ca0 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b63fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0e6f40 con 0x7f6b5c0eb300 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b63fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58810/0 (socket says 172.21.15.82:58810) 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b63fff640 1 -- 172.21.15.82:0/505233642 learned_addr learned my addr 172.21.15.82:0/505233642 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c04c3a0 con 0x7f6b5c038b40 2023-07-20T09:50:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 0x7f6b5c04bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b62ffd640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b5c038b40 0x7f6b5c04cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f2fee0c8640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 0x7f2fcc068810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4005890 tx=0x7f2fe4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 -- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b5c038b40 msgr2=0x7f6b5c04cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b5c038b40 0x7f6b5c04cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 -- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 msgr2=0x7f6b5c0e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500094d0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b63fff640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ebc0eb750 con 0x7f5ecc06df50 2023-07-20T09:50:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.598+0000 7f6b637fe640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 0x7f6b5c04bd10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c3e0 tx=0x7f6b5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.602+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58011790 con 0x7f6b5c008ca0 2023-07-20T09:50:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.602+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c0e6610 con 0x7f6b5c008ca0 2023-07-20T09:50:35.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.602+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c0e6bd0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.602+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b580118f0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.602+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58011ce0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b5801c460 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f6b4ffff640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 0x7f6b48068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b58083bd0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b44005260 con 0x7f6b5c008ca0 2023-07-20T09:50:35.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f6b62ffd640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 0x7f6b48068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.606+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fd80506a0 con 0x7f2fe80cd460 2023-07-20T09:50:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.618+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b58050fb0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.618+0000 7f6b62ffd640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 0x7f6b48068740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b500ae000 tx=0x7f6b500a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:35.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.830+0000 7f1d471ba640 1 -- 172.21.15.82:0/3378530743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d20005510 con 0x7f1d40152b70 2023-07-20T09:50:35.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.834+0000 7f1d3d7fa640 1 -- 172.21.15.82:0/3378530743 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d3001e070 con 0x7f1d40152b70 2023-07-20T09:50:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.834+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 msgr2=0x7f1d2806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.834+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 0x7f1d2806d2c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1d340af000 tx=0x7f1d340a7000 comp rx=0 tx=0).stop 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.834+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 msgr2=0x7f1d4015b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.834+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000d5f0 tx=0x7f1d3000dab0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 shutdown_connections 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1d2806ae00 0x7f1d2806d2c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d40144730 0x7f1d4006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d401590a0 0x7f1d4006cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 --2- 172.21.15.82:0/3378530743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d40152b70 0x7f1d4015b150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 >> 172.21.15.82:0/3378530743 conn(0x7f1d400afde0 msgr2=0x7f1d40150530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 shutdown_connections 2023-07-20T09:50:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.838+0000 7f1d26ffd640 1 -- 172.21.15.82:0/3378530743 wait complete. 2023-07-20T09:50:35.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-07-20T09:50:35.906 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:35.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fea100cce50 con 0x7fea101609e0 2023-07-20T09:50:35.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea0d7fa640 1 -- 172.21.15.82:0/954972046 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea04054170 con 0x7fea101609e0 2023-07-20T09:50:35.926 INFO:teuthology.orchestra.run.smithi082.stdout:55834574853 2023-07-20T09:50:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 msgr2=0x7fe9fc068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 0x7fe9fc068810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea000190e0 tx=0x7fea000b5040 comp rx=0 tx=0).stop 2023-07-20T09:50:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 msgr2=0x7fea1015c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1015c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fea04001ec0 tx=0x7fea0400c890 comp rx=0 tx=0).stop 2023-07-20T09:50:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 shutdown_connections 2023-07-20T09:50:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe9fc066350 0x7fe9fc068810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea10164f60 0x7fea1015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea101609e0 0x7fea1015c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 --2- 172.21.15.82:0/954972046 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea1006bb40 0x7fea10143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 >> 172.21.15.82:0/954972046 conn(0x7fea100afde0 msgr2=0x7fea10157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 shutdown_connections 2023-07-20T09:50:35.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.890+0000 7fea16ccb640 1 -- 172.21.15.82:0/954972046 wait complete. 2023-07-20T09:50:35.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.906+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f880015adc0 con 0x7f8800152b70 2023-07-20T09:50:35.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.906+0000 7f87f67fc640 1 -- 172.21.15.82:0/54508086 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f880015adc0 con 0x7f8800152b70 2023-07-20T09:50:35.944 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:35.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.906+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc59404da30 con 0x7fc5940cadf0 2023-07-20T09:50:35.945 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:35.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.906+0000 7fc5917fa640 1 -- 172.21.15.82:0/1159035260 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc588018030 con 0x7fc5940cadf0 2023-07-20T09:50:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 msgr2=0x7f87e4068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 0x7f87e4068810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f87fc000c10 tx=0x7f87fc0a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 msgr2=0x7f88000af740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f88000af740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c680 tx=0x7f87f000cb40 comp rx=0 tx=0).stop 2023-07-20T09:50:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 shutdown_connections 2023-07-20T09:50:35.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f87e4066350 0x7f87e4068810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8800158c20 0x7f8800144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8800152b70 0x7f88000af740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 --2- 172.21.15.82:0/54508086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88000b2300 0x7f8800146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 msgr2=0x7fc580068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 0x7fc580068810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc59406ab30 tx=0x7fc584009190 comp rx=0 tx=0).stop 2023-07-20T09:50:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 msgr2=0x7fc5941575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c7b0 tx=0x7fc58800cc70 comp rx=0 tx=0).stop 2023-07-20T09:50:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 >> 172.21.15.82:0/54508086 conn(0x7f88000afde0 msgr2=0x7f880006ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 shutdown_connections 2023-07-20T09:50:35.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7f8807e6d640 1 -- 172.21.15.82:0/54508086 wait complete. 2023-07-20T09:50:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 shutdown_connections 2023-07-20T09:50:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc580066350 0x7fc580068810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5940cd810 0x7fc59415c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5940cd430 0x7fc59415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 --2- 172.21.15.82:0/1159035260 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5940cadf0 0x7fc5941575b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 >> 172.21.15.82:0/1159035260 conn(0x7fc5940afb90 msgr2=0x7fc5940c4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 shutdown_connections 2023-07-20T09:50:35.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.910+0000 7fc57affd640 1 -- 172.21.15.82:0/1159035260 wait complete. 2023-07-20T09:50:35.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-07-20T09:50:35.953 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:35.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.918+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd1240057e0 con 0x7fd1440ca930 2023-07-20T09:50:35.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.918+0000 7fd1417fa640 1 -- 172.21.15.82:0/2269083724 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd130054f60 con 0x7fd1440ca930 2023-07-20T09:50:35.955 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 msgr2=0x7fd128068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 0x7fd128068810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1380209c0 tx=0x7fd13800d040 comp rx=0 tx=0).stop 2023-07-20T09:50:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 msgr2=0x7fd144145030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 0x7fd144145030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd13000b410 tx=0x7fd13000b8d0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 shutdown_connections 2023-07-20T09:50:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd128066350 0x7fd128068810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd144158620 0x7fd144157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1440ca930 0x7fd144145030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 --2- 172.21.15.82:0/2269083724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd14406c0e0 0x7fd1440c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 >> 172.21.15.82:0/2269083724 conn(0x7fd1440afb90 msgr2=0x7fd1440cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 shutdown_connections 2023-07-20T09:50:35.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.922+0000 7fd149963640 1 -- 172.21.15.82:0/2269083724 wait complete. 2023-07-20T09:50:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.926+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5ecc0af9f0 con 0x7f5ecc06df50 2023-07-20T09:50:35.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.930+0000 7f5ec8ff9640 1 -- 172.21.15.82:0/3132451268 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ebc0b1090 con 0x7f5ecc06df50 2023-07-20T09:50:35.967 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 msgr2=0x7f5eac068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 0x7f5eac068840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc1552a0 tx=0x7f5eb40090e0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 msgr2=0x7f5ecc1f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0af040 tx=0x7f5ebc0192a0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 shutdown_connections 2023-07-20T09:50:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5eac066380 0x7f5eac068840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ecc155930 0x7f5ecc1633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ecc0cf2e0 0x7f5ecc15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 --2- 172.21.15.82:0/3132451268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ecc06df50 0x7f5ecc1f8550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 >> 172.21.15.82:0/3132451268 conn(0x7f5ecc0b1e70 msgr2=0x7f5ecc0b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6b440050d0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 shutdown_connections 2023-07-20T09:50:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f5ed1e61640 1 -- 172.21.15.82:0/3132451268 wait complete. 2023-07-20T09:50:35.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b4ffff640 1 -- 172.21.15.82:0/505233642 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b580545d0 con 0x7f6b5c008ca0 2023-07-20T09:50:35.974 INFO:teuthology.orchestra.run.smithi082.stdout:55834574854 2023-07-20T09:50:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 msgr2=0x7f6b48068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 0x7f6b48068740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6b500ae000 tx=0x7f6b500a7000 comp rx=0 tx=0).stop 2023-07-20T09:50:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 msgr2=0x7f6b5c04bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 0x7f6b5c04bd10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c3e0 tx=0x7f6b5800c8a0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 shutdown_connections 2023-07-20T09:50:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b48066280 0x7f6b48068740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b5c0eb300 0x7f6b5c0e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b5c038b40 0x7f6b5c04cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.934+0000 7f6b6a196640 1 --2- 172.21.15.82:0/505233642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c008ca0 0x7f6b5c04bd10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.938+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 >> 172.21.15.82:0/505233642 conn(0x7f6b5c0538e0 msgr2=0x7f6b5c0083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.938+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 shutdown_connections 2023-07-20T09:50:35.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.938+0000 7f6b6a196640 1 -- 172.21.15.82:0/505233642 wait complete. 2023-07-20T09:50:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.938+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2fe806fb30 con 0x7f2fe80cd460 2023-07-20T09:50:35.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.938+0000 7f2fdeffd640 1 -- 172.21.15.82:0/1118410844 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fd8017070 con 0x7f2fe80cd460 2023-07-20T09:50:35.978 INFO:teuthology.orchestra.run.smithi082.stdout:55834574856 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 msgr2=0x7f2fcc068810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 0x7f2fcc068810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4005890 tx=0x7f2fe4009040 comp rx=0 tx=0).stop 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 msgr2=0x7f2fe81591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe81591b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8000f70 tx=0x7f2fd800c820 comp rx=0 tx=0).stop 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 shutdown_connections 2023-07-20T09:50:35.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2fcc066350 0x7f2fcc068810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe80ce620 0x7f2fe80c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fe80cd460 0x7f2fe81591b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 --2- 172.21.15.82:0/1118410844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2fe80c3790 0x7f2fe80caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 >> 172.21.15.82:0/1118410844 conn(0x7f2fe80b1e50 msgr2=0x7f2fe80ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 shutdown_connections 2023-07-20T09:50:35.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:35.942+0000 7f2fef0ca640 1 -- 172.21.15.82:0/1118410844 wait complete. 2023-07-20T09:50:35.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-07-20T09:50:35.986 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:35.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-07-20T09:50:35.987 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:35.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-07-20T09:50:35.988 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:36.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-07-20T09:50:36.001 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:36.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-07-20T09:50:36.003 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:36.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-07-20T09:50:36.007 DEBUG:teuthology.parallel:result is None 2023-07-20T09:50:36.007 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-20T09:50:36.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:50:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 Processor -- start 2023-07-20T09:50:36.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 -- start start 2023-07-20T09:50:36.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79a00d0d10 0x7f79a00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79a00cd4b0 0x7f79a00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00d16b0 con 0x7f79a015cab0 2023-07-20T09:50:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00d31c0 con 0x7f79a00cd4b0 2023-07-20T09:50:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a6903640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00b3520 con 0x7f79a00d0d10 2023-07-20T09:50:36.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f799ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f79a015cab0 0x7f79a00d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42676/0 (socket says 172.21.15.82:42676) 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f799ffff640 1 -- 172.21.15.82:0/3667321932 learned_addr learned my addr 172.21.15.82:0/3667321932 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a4ea0640 1 --2- 172.21.15.82:0/3667321932 >> v2:172.21.15.82:3300/0 conn(0x7f79a00cd4b0 0x7f79a00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f799f7fe640 1 --2- 172.21.15.82:0/3667321932 >> v2:172.21.15.183:3300/0 conn(0x7f79a00d0d10 0x7f79a00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f799effd640 1 -- 172.21.15.82:0/3667321932 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251040512 0 0) 0x7f79a00d16b0 con 0x7f79a015cab0 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f799effd640 1 -- 172.21.15.82:0/3667321932 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7988003530 con 0x7f79a015cab0 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a4ea0640 1 -- 172.21.15.82:0/3667321932 >> v2:172.21.15.183:3300/0 conn(0x7f79a00d0d10 msgr2=0x7f79a00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a4ea0640 1 --2- 172.21.15.82:0/3667321932 >> v2:172.21.15.183:3300/0 conn(0x7f79a00d0d10 0x7f79a00d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a4ea0640 1 -- 172.21.15.82:0/3667321932 >> v1:172.21.15.82:6789/0 conn(0x7f79a015cab0 legacy=0x7f79a00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.150+0000 7f79a4ea0640 1 -- 172.21.15.82:0/3667321932 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00d0a10 con 0x7f79a00cd4b0 2023-07-20T09:50:36.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a4ea0640 1 --2- 172.21.15.82:0/3667321932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00cd4b0 0x7f79a00cd920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79a00d0190 tx=0x7f799801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8000ecccf9736774 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f799effd640 1 -- 172.21.15.82:0/3667321932 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980a59a0 con 0x7f79a00cd4b0 2023-07-20T09:50:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f799effd640 1 -- 172.21.15.82:0/3667321932 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980a5b00 con 0x7f79a00cd4b0 2023-07-20T09:50:36.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f799effd640 1 -- 172.21.15.82:0/3667321932 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980a5e90 con 0x7f79a00cd4b0 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 -- 172.21.15.82:0/3667321932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00cd4b0 msgr2=0x7f79a00cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 --2- 172.21.15.82:0/3667321932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00cd4b0 0x7f79a00cd920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f79a00d0190 tx=0x7f799801c8e0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 -- 172.21.15.82:0/3667321932 shutdown_connections 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 --2- 172.21.15.82:0/3667321932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00cd4b0 0x7f79a00cd920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 --2- 172.21.15.82:0/3667321932 >> v2:172.21.15.183:3300/0 conn(0x7f79a00d0d10 0x7f79a00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 -- 172.21.15.82:0/3667321932 >> 172.21.15.82:0/3667321932 conn(0x7f79a008c120 msgr2=0x7f79a009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:36.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 -- 172.21.15.82:0/3667321932 shutdown_connections 2023-07-20T09:50:36.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.154+0000 7f79a6903640 1 -- 172.21.15.82:0/3667321932 wait complete. 2023-07-20T09:50:36.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 Processor -- start 2023-07-20T09:50:36.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- start start 2023-07-20T09:50:36.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 0x7f79a00c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79a015cab0 0x7f79a00c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00cb1c0 con 0x7f79a00d0d10 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ca5b0 con 0x7f79a015cab0 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ca890 con 0x7f79a00cd4b0 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53586/0 (socket says 172.21.15.82:53586) 2023-07-20T09:50:36.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 -- 172.21.15.82:0/3624290766 learned_addr learned my addr 172.21.15.82:0/3624290766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:36.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799ffff640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 0x7f79a00c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a4ea0640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79a015cab0 0x7f79a00c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 -- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 msgr2=0x7f79a00c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 0x7f79a00c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 -- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79a015cab0 msgr2=0x7f79a00c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79a015cab0 0x7f79a00c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 -- 172.21.15.82:0/3624290766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009a70 con 0x7f79a00d0d10 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799ffff640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 0x7f79a00c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799f7fe640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f799400d5f0 tx=0x7f799400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940125f0 con 0x7f79a00d0d10 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994012750 con 0x7f79a00d0d10 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994012ae0 con 0x7f79a00d0d10 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00cab70 con 0x7f79a00d0d10 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00b5320 con 0x7f79a00d0d10 2023-07-20T09:50:36.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.158+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a00cb330 con 0x7f79a00d0d10 2023-07-20T09:50:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.162+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7994012c40 con 0x7f79a00d0d10 2023-07-20T09:50:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.162+0000 7f799cff9640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 0x7f798c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.162+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7994084250 con 0x7f79a00d0d10 2023-07-20T09:50:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.162+0000 7f799ffff640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 0x7f798c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.162+0000 7f799ffff640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 0x7f798c068740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79900011f0 tx=0x7f7990009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.166+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79940516d0 con 0x7f79a00d0d10 2023-07-20T09:50:36.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.310+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79a00b31b0 con 0x7f798c066280 2023-07-20T09:50:36.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.318+0000 7f799cff9640 1 -- 172.21.15.82:0/3624290766 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286763 (secure 0 0 0) 0x7f79900013e0 con 0x7f798c066280 2023-07-20T09:50:36.358 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:36.360 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:50:36.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 msgr2=0x7f798c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 0x7f798c068740 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f79900011f0 tx=0x7f7990009040 comp rx=0 tx=0).stop 2023-07-20T09:50:36.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 msgr2=0x7f79a015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f799400d5f0 tx=0x7f799400dab0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 shutdown_connections 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f798c066280 0x7f798c068740 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79a015cab0 0x7f79a00c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79a00d0d10 0x7f79a015adf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 --2- 172.21.15.82:0/3624290766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79a00cd4b0 0x7f79a00c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 >> 172.21.15.82:0/3624290766 conn(0x7f79a008c120 msgr2=0x7f79a00af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:36.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 shutdown_connections 2023-07-20T09:50:36.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.322+0000 7f79a6903640 1 -- 172.21.15.82:0/3624290766 wait complete. 2023-07-20T09:50:36.378 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T09:50:35.838395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219312,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755408,"statfs":{"total":773094113280,"available":772869537792,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.170530"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135440+0000","last_change":"2023-07-20T09:50:27.702234+0000","last_active":"2023-07-20T09:50:29.135440+0000","last_peered":"2023-07-20T09:50:29.135440+0000","last_clean":"2023-07-20T09:50:29.135440+0000","last_became_active":"2023-07-20T09:50:27.701890+0000","last_became_peered":"2023-07-20T09:50:27.701890+0000","last_unstale":"2023-07-20T09:50:29.135440+0000","last_undegraded":"2023-07-20T09:50:29.135440+0000","last_fullsized":"2023-07-20T09:50:29.135440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:38.700040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679258+0000","last_change":"2023-07-20T09:50:27.691896+0000","last_active":"2023-07-20T09:50:28.679258+0000","last_peered":"2023-07-20T09:50:28.679258+0000","last_clean":"2023-07-20T09:50:28.679258+0000","last_became_active":"2023-07-20T09:50:27.691138+0000","last_became_peered":"2023-07-20T09:50:27.691138+0000","last_unstale":"2023-07-20T09:50:28.679258+0000","last_undegraded":"2023-07-20T09:50:28.679258+0000","last_fullsized":"2023-07-20T09:50:28.679258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680090+0000","last_change":"2023-07-20T09:50:27.686197+0000","last_active":"2023-07-20T09:50:28.680090+0000","last_peered":"2023-07-20T09:50:28.680090+0000","last_clean":"2023-07-20T09:50:28.680090+0000","last_became_active":"2023-07-20T09:50:27.685846+0000","last_became_peered":"2023-07-20T09:50:27.685846+0000","last_unstale":"2023-07-20T09:50:28.680090+0000","last_undegraded":"2023-07-20T09:50:28.680090+0000","last_fullsized":"2023-07-20T09:50:28.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:44.021656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066160+0000","last_change":"2023-07-20T09:50:27.686988+0000","last_active":"2023-07-20T09:50:29.066160+0000","last_peered":"2023-07-20T09:50:29.066160+0000","last_clean":"2023-07-20T09:50:29.066160+0000","last_became_active":"2023-07-20T09:50:27.686647+0000","last_became_peered":"2023-07-20T09:50:27.686647+0000","last_unstale":"2023-07-20T09:50:29.066160+0000","last_undegraded":"2023-07-20T09:50:29.066160+0000","last_fullsized":"2023-07-20T09:50:29.066160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:09.828008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733017+0000","last_change":"2023-07-20T09:50:27.706718+0000","last_active":"2023-07-20T09:50:28.733017+0000","last_peered":"2023-07-20T09:50:28.733017+0000","last_clean":"2023-07-20T09:50:28.733017+0000","last_became_active":"2023-07-20T09:50:27.706185+0000","last_became_peered":"2023-07-20T09:50:27.706185+0000","last_unstale":"2023-07-20T09:50:28.733017+0000","last_undegraded":"2023-07-20T09:50:28.733017+0000","last_fullsized":"2023-07-20T09:50:28.733017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678715+0000","last_change":"2023-07-20T09:50:27.686831+0000","last_active":"2023-07-20T09:50:28.678715+0000","last_peered":"2023-07-20T09:50:28.678715+0000","last_clean":"2023-07-20T09:50:28.678715+0000","last_became_active":"2023-07-20T09:50:27.686412+0000","last_became_peered":"2023-07-20T09:50:27.686412+0000","last_unstale":"2023-07-20T09:50:28.678715+0000","last_undegraded":"2023-07-20T09:50:28.678715+0000","last_fullsized":"2023-07-20T09:50:28.678715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272132+0000","last_change":"2023-07-20T09:50:27.692084+0000","last_active":"2023-07-20T09:50:29.272132+0000","last_peered":"2023-07-20T09:50:29.272132+0000","last_clean":"2023-07-20T09:50:29.272132+0000","last_became_active":"2023-07-20T09:50:27.691849+0000","last_became_peered":"2023-07-20T09:50:27.691849+0000","last_unstale":"2023-07-20T09:50:29.272132+0000","last_undegraded":"2023-07-20T09:50:29.272132+0000","last_fullsized":"2023-07-20T09:50:29.272132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679116+0000","last_change":"2023-07-20T09:50:27.690562+0000","last_active":"2023-07-20T09:50:28.679116+0000","last_peered":"2023-07-20T09:50:28.679116+0000","last_clean":"2023-07-20T09:50:28.679116+0000","last_became_active":"2023-07-20T09:50:27.685211+0000","last_became_peered":"2023-07-20T09:50:27.685211+0000","last_unstale":"2023-07-20T09:50:28.679116+0000","last_undegraded":"2023-07-20T09:50:28.679116+0000","last_fullsized":"2023-07-20T09:50:28.679116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732966+0000","last_change":"2023-07-20T09:50:27.705540+0000","last_active":"2023-07-20T09:50:28.732966+0000","last_peered":"2023-07-20T09:50:28.732966+0000","last_clean":"2023-07-20T09:50:28.732966+0000","last_became_active":"2023-07-20T09:50:27.705238+0000","last_became_peered":"2023-07-20T09:50:27.705238+0000","last_unstale":"2023-07-20T09:50:28.732966+0000","last_undegraded":"2023-07-20T09:50:28.732966+0000","last_fullsized":"2023-07-20T09:50:28.732966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679423+0000","last_change":"2023-07-20T09:50:27.692110+0000","last_active":"2023-07-20T09:50:28.679423+0000","last_peered":"2023-07-20T09:50:28.679423+0000","last_clean":"2023-07-20T09:50:28.679423+0000","last_became_active":"2023-07-20T09:50:27.691537+0000","last_became_peered":"2023-07-20T09:50:27.691537+0000","last_unstale":"2023-07-20T09:50:28.679423+0000","last_undegraded":"2023-07-20T09:50:28.679423+0000","last_fullsized":"2023-07-20T09:50:28.679423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680137+0000","last_change":"2023-07-20T09:50:27.693033+0000","last_active":"2023-07-20T09:50:28.680137+0000","last_peered":"2023-07-20T09:50:28.680137+0000","last_clean":"2023-07-20T09:50:28.680137+0000","last_became_active":"2023-07-20T09:50:27.692715+0000","last_became_peered":"2023-07-20T09:50:27.692715+0000","last_unstale":"2023-07-20T09:50:28.680137+0000","last_undegraded":"2023-07-20T09:50:28.680137+0000","last_fullsized":"2023-07-20T09:50:28.680137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:49.858742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135538+0000","last_change":"2023-07-20T09:50:27.689428+0000","last_active":"2023-07-20T09:50:29.135538+0000","last_peered":"2023-07-20T09:50:29.135538+0000","last_clean":"2023-07-20T09:50:29.135538+0000","last_became_active":"2023-07-20T09:50:27.689088+0000","last_became_peered":"2023-07-20T09:50:27.689088+0000","last_unstale":"2023-07-20T09:50:29.135538+0000","last_undegraded":"2023-07-20T09:50:29.135538+0000","last_fullsized":"2023-07-20T09:50:29.135538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:43.347892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135281+0000","last_change":"2023-07-20T09:50:27.704247+0000","last_active":"2023-07-20T09:50:29.135281+0000","last_peered":"2023-07-20T09:50:29.135281+0000","last_clean":"2023-07-20T09:50:29.135281+0000","last_became_active":"2023-07-20T09:50:27.703955+0000","last_became_peered":"2023-07-20T09:50:27.703955+0000","last_unstale":"2023-07-20T09:50:29.135281+0000","last_undegraded":"2023-07-20T09:50:29.135281+0000","last_fullsized":"2023-07-20T09:50:29.135281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:50.797971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679534+0000","last_change":"2023-07-20T09:50:27.679300+0000","last_active":"2023-07-20T09:50:28.679534+0000","last_peered":"2023-07-20T09:50:28.679534+0000","last_clean":"2023-07-20T09:50:28.679534+0000","last_became_active":"2023-07-20T09:50:27.678826+0000","last_became_peered":"2023-07-20T09:50:27.678826+0000","last_unstale":"2023-07-20T09:50:28.679534+0000","last_undegraded":"2023-07-20T09:50:28.679534+0000","last_fullsized":"2023-07-20T09:50:28.679534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272329+0000","last_change":"2023-07-20T09:50:27.691224+0000","last_active":"2023-07-20T09:50:29.272329+0000","last_peered":"2023-07-20T09:50:29.272329+0000","last_clean":"2023-07-20T09:50:29.272329+0000","last_became_active":"2023-07-20T09:50:27.690992+0000","last_became_peered":"2023-07-20T09:50:27.690992+0000","last_unstale":"2023-07-20T09:50:29.272329+0000","last_undegraded":"2023-07-20T09:50:29.272329+0000","last_fullsized":"2023-07-20T09:50:29.272329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678697+0000","last_change":"2023-07-20T09:50:27.680234+0000","last_active":"2023-07-20T09:50:28.678697+0000","last_peered":"2023-07-20T09:50:28.678697+0000","last_clean":"2023-07-20T09:50:28.678697+0000","last_became_active":"2023-07-20T09:50:27.679957+0000","last_became_peered":"2023-07-20T09:50:27.679957+0000","last_unstale":"2023-07-20T09:50:28.678697+0000","last_undegraded":"2023-07-20T09:50:28.678697+0000","last_fullsized":"2023-07-20T09:50:28.678697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733011+0000","last_change":"2023-07-20T09:50:27.705338+0000","last_active":"2023-07-20T09:50:28.733011+0000","last_peered":"2023-07-20T09:50:28.733011+0000","last_clean":"2023-07-20T09:50:28.733011+0000","last_became_active":"2023-07-20T09:50:27.704958+0000","last_became_peered":"2023-07-20T09:50:27.704958+0000","last_unstale":"2023-07-20T09:50:28.733011+0000","last_undegraded":"2023-07-20T09:50:28.733011+0000","last_fullsized":"2023-07-20T09:50:28.733011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680236+0000","last_change":"2023-07-20T09:50:27.684311+0000","last_active":"2023-07-20T09:50:28.680236+0000","last_peered":"2023-07-20T09:50:28.680236+0000","last_clean":"2023-07-20T09:50:28.680236+0000","last_became_active":"2023-07-20T09:50:27.680860+0000","last_became_peered":"2023-07-20T09:50:27.680860+0000","last_unstale":"2023-07-20T09:50:28.680236+0000","last_undegraded":"2023-07-20T09:50:28.680236+0000","last_fullsized":"2023-07-20T09:50:28.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:06.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135426+0000","last_change":"2023-07-20T09:50:27.681256+0000","last_active":"2023-07-20T09:50:29.135426+0000","last_peered":"2023-07-20T09:50:29.135426+0000","last_clean":"2023-07-20T09:50:29.135426+0000","last_became_active":"2023-07-20T09:50:27.680937+0000","last_became_peered":"2023-07-20T09:50:27.680937+0000","last_unstale":"2023-07-20T09:50:29.135426+0000","last_undegraded":"2023-07-20T09:50:29.135426+0000","last_fullsized":"2023-07-20T09:50:29.135426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:02:21.845003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678905+0000","last_change":"2023-07-20T09:50:27.681378+0000","last_active":"2023-07-20T09:50:28.678905+0000","last_peered":"2023-07-20T09:50:28.678905+0000","last_clean":"2023-07-20T09:50:28.678905+0000","last_became_active":"2023-07-20T09:50:27.681016+0000","last_became_peered":"2023-07-20T09:50:27.681016+0000","last_unstale":"2023-07-20T09:50:28.678905+0000","last_undegraded":"2023-07-20T09:50:28.678905+0000","last_fullsized":"2023-07-20T09:50:28.678905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272305+0000","last_change":"2023-07-20T09:50:27.708844+0000","last_active":"2023-07-20T09:50:29.272305+0000","last_peered":"2023-07-20T09:50:29.272305+0000","last_clean":"2023-07-20T09:50:29.272305+0000","last_became_active":"2023-07-20T09:50:27.708506+0000","last_became_peered":"2023-07-20T09:50:27.708506+0000","last_unstale":"2023-07-20T09:50:29.272305+0000","last_undegraded":"2023-07-20T09:50:29.272305+0000","last_fullsized":"2023-07-20T09:50:29.272305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732746+0000","last_change":"2023-07-20T09:50:27.693993+0000","last_active":"2023-07-20T09:50:28.732746+0000","last_peered":"2023-07-20T09:50:28.732746+0000","last_clean":"2023-07-20T09:50:28.732746+0000","last_became_active":"2023-07-20T09:50:27.693525+0000","last_became_peered":"2023-07-20T09:50:27.693525+0000","last_unstale":"2023-07-20T09:50:28.732746+0000","last_undegraded":"2023-07-20T09:50:28.732746+0000","last_fullsized":"2023-07-20T09:50:28.732746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674068+0000","last_change":"2023-07-20T09:50:27.703451+0000","last_active":"2023-07-20T09:50:28.674068+0000","last_peered":"2023-07-20T09:50:28.674068+0000","last_clean":"2023-07-20T09:50:28.674068+0000","last_became_active":"2023-07-20T09:50:27.702940+0000","last_became_peered":"2023-07-20T09:50:27.702940+0000","last_unstale":"2023-07-20T09:50:28.674068+0000","last_undegraded":"2023-07-20T09:50:28.674068+0000","last_fullsized":"2023-07-20T09:50:28.674068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272060+0000","last_change":"2023-07-20T09:50:27.708326+0000","last_active":"2023-07-20T09:50:29.272060+0000","last_peered":"2023-07-20T09:50:29.272060+0000","last_clean":"2023-07-20T09:50:29.272060+0000","last_became_active":"2023-07-20T09:50:27.707974+0000","last_became_peered":"2023-07-20T09:50:27.707974+0000","last_unstale":"2023-07-20T09:50:29.272060+0000","last_undegraded":"2023-07-20T09:50:29.272060+0000","last_fullsized":"2023-07-20T09:50:29.272060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738150+0000","last_change":"2023-07-20T09:50:27.692567+0000","last_active":"2023-07-20T09:50:28.738150+0000","last_peered":"2023-07-20T09:50:28.738150+0000","last_clean":"2023-07-20T09:50:28.738150+0000","last_became_active":"2023-07-20T09:50:27.692146+0000","last_became_peered":"2023-07-20T09:50:27.692146+0000","last_unstale":"2023-07-20T09:50:28.738150+0000","last_undegraded":"2023-07-20T09:50:28.738150+0000","last_fullsized":"2023-07-20T09:50:28.738150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738221+0000","last_change":"2023-07-20T09:50:27.692593+0000","last_active":"2023-07-20T09:50:28.738221+0000","last_peered":"2023-07-20T09:50:28.738221+0000","last_clean":"2023-07-20T09:50:28.738221+0000","last_became_active":"2023-07-20T09:50:27.692226+0000","last_became_peered":"2023-07-20T09:50:27.692226+0000","last_unstale":"2023-07-20T09:50:28.738221+0000","last_undegraded":"2023-07-20T09:50:28.738221+0000","last_fullsized":"2023-07-20T09:50:28.738221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679407+0000","last_change":"2023-07-20T09:50:27.683556+0000","last_active":"2023-07-20T09:50:28.679407+0000","last_peered":"2023-07-20T09:50:28.679407+0000","last_clean":"2023-07-20T09:50:28.679407+0000","last_became_active":"2023-07-20T09:50:27.683246+0000","last_became_peered":"2023-07-20T09:50:27.683246+0000","last_unstale":"2023-07-20T09:50:28.679407+0000","last_undegraded":"2023-07-20T09:50:28.679407+0000","last_fullsized":"2023-07-20T09:50:28.679407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738218+0000","last_change":"2023-07-20T09:50:27.690772+0000","last_active":"2023-07-20T09:50:28.738218+0000","last_peered":"2023-07-20T09:50:28.738218+0000","last_clean":"2023-07-20T09:50:28.738218+0000","last_became_active":"2023-07-20T09:50:27.690456+0000","last_became_peered":"2023-07-20T09:50:27.690456+0000","last_unstale":"2023-07-20T09:50:28.738218+0000","last_undegraded":"2023-07-20T09:50:28.738218+0000","last_fullsized":"2023-07-20T09:50:28.738218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674414+0000","last_change":"2023-07-20T09:50:27.701936+0000","last_active":"2023-07-20T09:50:28.674414+0000","last_peered":"2023-07-20T09:50:28.674414+0000","last_clean":"2023-07-20T09:50:28.674414+0000","last_became_active":"2023-07-20T09:50:27.701378+0000","last_became_peered":"2023-07-20T09:50:27.701378+0000","last_unstale":"2023-07-20T09:50:28.674414+0000","last_undegraded":"2023-07-20T09:50:28.674414+0000","last_fullsized":"2023-07-20T09:50:28.674414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679021+0000","last_change":"2023-07-20T09:50:27.682320+0000","last_active":"2023-07-20T09:50:28.679021+0000","last_peered":"2023-07-20T09:50:28.679021+0000","last_clean":"2023-07-20T09:50:28.679021+0000","last_became_active":"2023-07-20T09:50:27.681183+0000","last_became_peered":"2023-07-20T09:50:27.681183+0000","last_unstale":"2023-07-20T09:50:28.679021+0000","last_undegraded":"2023-07-20T09:50:28.679021+0000","last_fullsized":"2023-07-20T09:50:28.679021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674102+0000","last_change":"2023-07-20T09:50:27.703874+0000","last_active":"2023-07-20T09:50:28.674102+0000","last_peered":"2023-07-20T09:50:28.674102+0000","last_clean":"2023-07-20T09:50:28.674102+0000","last_became_active":"2023-07-20T09:50:27.701925+0000","last_became_peered":"2023-07-20T09:50:27.701925+0000","last_unstale":"2023-07-20T09:50:28.674102+0000","last_undegraded":"2023-07-20T09:50:28.674102+0000","last_fullsized":"2023-07-20T09:50:28.674102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.065932+0000","last_change":"2023-07-20T09:50:27.685373+0000","last_active":"2023-07-20T09:50:29.065932+0000","last_peered":"2023-07-20T09:50:29.065932+0000","last_clean":"2023-07-20T09:50:29.065932+0000","last_became_active":"2023-07-20T09:50:27.685083+0000","last_became_peered":"2023-07-20T09:50:27.685083+0000","last_unstale":"2023-07-20T09:50:29.065932+0000","last_undegraded":"2023-07-20T09:50:29.065932+0000","last_fullsized":"2023-07-20T09:50:29.065932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:43.347892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674290+0000","last_change":"2023-07-20T09:50:27.696660+0000","last_active":"2023-07-20T09:50:28.674290+0000","last_peered":"2023-07-20T09:50:28.674290+0000","last_clean":"2023-07-20T09:50:28.674290+0000","last_became_active":"2023-07-20T09:50:27.696285+0000","last_became_peered":"2023-07-20T09:50:27.696285+0000","last_unstale":"2023-07-20T09:50:28.674290+0000","last_undegraded":"2023-07-20T09:50:28.674290+0000","last_fullsized":"2023-07-20T09:50:28.674290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272295+0000","last_change":"2023-07-20T09:50:26.398520+0000","last_active":"2023-07-20T09:50:29.272295+0000","last_peered":"2023-07-20T09:50:29.272295+0000","last_clean":"2023-07-20T09:50:29.272295+0000","last_became_active":"2023-07-20T09:50:26.398176+0000","last_became_peered":"2023-07-20T09:50:26.398176+0000","last_unstale":"2023-07-20T09:50:29.272295+0000","last_undegraded":"2023-07-20T09:50:29.272295+0000","last_fullsized":"2023-07-20T09:50:29.272295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679549+0000","last_change":"2023-07-20T09:50:27.684529+0000","last_active":"2023-07-20T09:50:28.679549+0000","last_peered":"2023-07-20T09:50:28.679549+0000","last_clean":"2023-07-20T09:50:28.679549+0000","last_became_active":"2023-07-20T09:50:27.684036+0000","last_became_peered":"2023-07-20T09:50:27.684036+0000","last_unstale":"2023-07-20T09:50:28.679549+0000","last_undegraded":"2023-07-20T09:50:28.679549+0000","last_fullsized":"2023-07-20T09:50:28.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:13.421282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732887+0000","last_change":"2023-07-20T09:50:26.384546+0000","last_active":"2023-07-20T09:50:28.732887+0000","last_peered":"2023-07-20T09:50:28.732887+0000","last_clean":"2023-07-20T09:50:28.732887+0000","last_became_active":"2023-07-20T09:50:26.384051+0000","last_became_peered":"2023-07-20T09:50:26.384051+0000","last_unstale":"2023-07-20T09:50:28.732887+0000","last_undegraded":"2023-07-20T09:50:28.732887+0000","last_fullsized":"2023-07-20T09:50:28.732887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:30.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733111+0000","last_change":"2023-07-20T09:50:27.702104+0000","last_active":"2023-07-20T09:50:28.733111+0000","last_peered":"2023-07-20T09:50:28.733111+0000","last_clean":"2023-07-20T09:50:28.733111+0000","last_became_active":"2023-07-20T09:50:27.701753+0000","last_became_peered":"2023-07-20T09:50:27.701753+0000","last_unstale":"2023-07-20T09:50:28.733111+0000","last_undegraded":"2023-07-20T09:50:28.733111+0000","last_fullsized":"2023-07-20T09:50:28.733111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272465+0000","last_change":"2023-07-20T09:50:26.398397+0000","last_active":"2023-07-20T09:50:29.272465+0000","last_peered":"2023-07-20T09:50:29.272465+0000","last_clean":"2023-07-20T09:50:29.272465+0000","last_became_active":"2023-07-20T09:50:26.398035+0000","last_became_peered":"2023-07-20T09:50:26.398035+0000","last_unstale":"2023-07-20T09:50:29.272465+0000","last_undegraded":"2023-07-20T09:50:29.272465+0000","last_fullsized":"2023-07-20T09:50:29.272465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:05.778024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674694+0000","last_change":"2023-07-20T09:50:27.701766+0000","last_active":"2023-07-20T09:50:28.674694+0000","last_peered":"2023-07-20T09:50:28.674694+0000","last_clean":"2023-07-20T09:50:28.674694+0000","last_became_active":"2023-07-20T09:50:27.701453+0000","last_became_peered":"2023-07-20T09:50:27.701453+0000","last_unstale":"2023-07-20T09:50:28.674694+0000","last_undegraded":"2023-07-20T09:50:28.674694+0000","last_fullsized":"2023-07-20T09:50:28.674694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066094+0000","last_change":"2023-07-20T09:50:26.386136+0000","last_active":"2023-07-20T09:50:29.066094+0000","last_peered":"2023-07-20T09:50:29.066094+0000","last_clean":"2023-07-20T09:50:29.066094+0000","last_became_active":"2023-07-20T09:50:26.385573+0000","last_became_peered":"2023-07-20T09:50:26.385573+0000","last_unstale":"2023-07-20T09:50:29.066094+0000","last_undegraded":"2023-07-20T09:50:29.066094+0000","last_fullsized":"2023-07-20T09:50:29.066094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:18.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272606+0000","last_change":"2023-07-20T09:50:26.399349+0000","last_active":"2023-07-20T09:50:29.272606+0000","last_peered":"2023-07-20T09:50:29.272606+0000","last_clean":"2023-07-20T09:50:29.272606+0000","last_became_active":"2023-07-20T09:50:26.398932+0000","last_became_peered":"2023-07-20T09:50:26.398932+0000","last_unstale":"2023-07-20T09:50:29.272606+0000","last_undegraded":"2023-07-20T09:50:29.272606+0000","last_fullsized":"2023-07-20T09:50:29.272606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:12:27.812093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679283+0000","last_change":"2023-07-20T09:50:27.683608+0000","last_active":"2023-07-20T09:50:28.679283+0000","last_peered":"2023-07-20T09:50:28.679283+0000","last_clean":"2023-07-20T09:50:28.679283+0000","last_became_active":"2023-07-20T09:50:27.683287+0000","last_became_peered":"2023-07-20T09:50:27.683287+0000","last_unstale":"2023-07-20T09:50:28.679283+0000","last_undegraded":"2023-07-20T09:50:28.679283+0000","last_fullsized":"2023-07-20T09:50:28.679283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272408+0000","last_change":"2023-07-20T09:50:26.398232+0000","last_active":"2023-07-20T09:50:29.272408+0000","last_peered":"2023-07-20T09:50:29.272408+0000","last_clean":"2023-07-20T09:50:29.272408+0000","last_became_active":"2023-07-20T09:50:26.397884+0000","last_became_peered":"2023-07-20T09:50:26.397884+0000","last_unstale":"2023-07-20T09:50:29.272408+0000","last_undegraded":"2023-07-20T09:50:29.272408+0000","last_fullsized":"2023-07-20T09:50:29.272408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:48.855728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678623+0000","last_change":"2023-07-20T09:50:27.692914+0000","last_active":"2023-07-20T09:50:28.678623+0000","last_peered":"2023-07-20T09:50:28.678623+0000","last_clean":"2023-07-20T09:50:28.678623+0000","last_became_active":"2023-07-20T09:50:27.692610+0000","last_became_peered":"2023-07-20T09:50:27.692610+0000","last_unstale":"2023-07-20T09:50:28.678623+0000","last_undegraded":"2023-07-20T09:50:28.678623+0000","last_fullsized":"2023-07-20T09:50:28.678623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272594+0000","last_change":"2023-07-20T09:50:26.391171+0000","last_active":"2023-07-20T09:50:29.272594+0000","last_peered":"2023-07-20T09:50:29.272594+0000","last_clean":"2023-07-20T09:50:29.272594+0000","last_became_active":"2023-07-20T09:50:26.390823+0000","last_became_peered":"2023-07-20T09:50:26.390823+0000","last_unstale":"2023-07-20T09:50:29.272594+0000","last_undegraded":"2023-07-20T09:50:29.272594+0000","last_fullsized":"2023-07-20T09:50:29.272594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:07.373905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.065958+0000","last_change":"2023-07-20T09:50:27.692283+0000","last_active":"2023-07-20T09:50:29.065958+0000","last_peered":"2023-07-20T09:50:29.065958+0000","last_clean":"2023-07-20T09:50:29.065958+0000","last_became_active":"2023-07-20T09:50:27.691972+0000","last_became_peered":"2023-07-20T09:50:27.691972+0000","last_unstale":"2023-07-20T09:50:29.065958+0000","last_undegraded":"2023-07-20T09:50:29.065958+0000","last_fullsized":"2023-07-20T09:50:29.065958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:38.700040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679424+0000","last_change":"2023-07-20T09:50:26.387250+0000","last_active":"2023-07-20T09:50:28.679424+0000","last_peered":"2023-07-20T09:50:28.679424+0000","last_clean":"2023-07-20T09:50:28.679424+0000","last_became_active":"2023-07-20T09:50:26.386829+0000","last_became_peered":"2023-07-20T09:50:26.386829+0000","last_unstale":"2023-07-20T09:50:28.679424+0000","last_undegraded":"2023-07-20T09:50:28.679424+0000","last_fullsized":"2023-07-20T09:50:28.679424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732879+0000","last_change":"2023-07-20T09:50:27.693747+0000","last_active":"2023-07-20T09:50:28.732879+0000","last_peered":"2023-07-20T09:50:28.732879+0000","last_clean":"2023-07-20T09:50:28.732879+0000","last_became_active":"2023-07-20T09:50:27.693399+0000","last_became_peered":"2023-07-20T09:50:27.693399+0000","last_unstale":"2023-07-20T09:50:28.732879+0000","last_undegraded":"2023-07-20T09:50:28.732879+0000","last_fullsized":"2023-07-20T09:50:28.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674542+0000","last_change":"2023-07-20T09:50:26.387168+0000","last_active":"2023-07-20T09:50:28.674542+0000","last_peered":"2023-07-20T09:50:28.674542+0000","last_clean":"2023-07-20T09:50:28.674542+0000","last_became_active":"2023-07-20T09:50:26.386895+0000","last_became_peered":"2023-07-20T09:50:26.386895+0000","last_unstale":"2023-07-20T09:50:28.674542+0000","last_undegraded":"2023-07-20T09:50:28.674542+0000","last_fullsized":"2023-07-20T09:50:28.674542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:28.011137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679049+0000","last_change":"2023-07-20T09:50:27.705371+0000","last_active":"2023-07-20T09:50:28.679049+0000","last_peered":"2023-07-20T09:50:28.679049+0000","last_clean":"2023-07-20T09:50:28.679049+0000","last_became_active":"2023-07-20T09:50:27.705101+0000","last_became_peered":"2023-07-20T09:50:27.705101+0000","last_unstale":"2023-07-20T09:50:28.679049+0000","last_undegraded":"2023-07-20T09:50:28.679049+0000","last_fullsized":"2023-07-20T09:50:28.679049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066342+0000","last_change":"2023-07-20T09:50:26.396439+0000","last_active":"2023-07-20T09:50:29.066342+0000","last_peered":"2023-07-20T09:50:29.066342+0000","last_clean":"2023-07-20T09:50:29.066342+0000","last_became_active":"2023-07-20T09:50:26.396127+0000","last_became_peered":"2023-07-20T09:50:26.396127+0000","last_unstale":"2023-07-20T09:50:29.066342+0000","last_undegraded":"2023-07-20T09:50:29.066342+0000","last_fullsized":"2023-07-20T09:50:29.066342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:45.504134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680251+0000","last_change":"2023-07-20T09:50:27.684320+0000","last_active":"2023-07-20T09:50:28.680251+0000","last_peered":"2023-07-20T09:50:28.680251+0000","last_clean":"2023-07-20T09:50:28.680251+0000","last_became_active":"2023-07-20T09:50:27.683970+0000","last_became_peered":"2023-07-20T09:50:27.683970+0000","last_unstale":"2023-07-20T09:50:28.680251+0000","last_undegraded":"2023-07-20T09:50:28.680251+0000","last_fullsized":"2023-07-20T09:50:28.680251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:51.387330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678776+0000","last_change":"2023-07-20T09:50:26.392014+0000","last_active":"2023-07-20T09:50:28.678776+0000","last_peered":"2023-07-20T09:50:28.678776+0000","last_clean":"2023-07-20T09:50:28.678776+0000","last_became_active":"2023-07-20T09:50:26.388891+0000","last_became_peered":"2023-07-20T09:50:26.388891+0000","last_unstale":"2023-07-20T09:50:28.678776+0000","last_undegraded":"2023-07-20T09:50:28.678776+0000","last_fullsized":"2023-07-20T09:50:28.678776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680271+0000","last_change":"2023-07-20T09:50:27.684512+0000","last_active":"2023-07-20T09:50:28.680271+0000","last_peered":"2023-07-20T09:50:28.680271+0000","last_clean":"2023-07-20T09:50:28.680271+0000","last_became_active":"2023-07-20T09:50:27.681388+0000","last_became_peered":"2023-07-20T09:50:27.681388+0000","last_unstale":"2023-07-20T09:50:28.680271+0000","last_undegraded":"2023-07-20T09:50:28.680271+0000","last_fullsized":"2023-07-20T09:50:28.680271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674181+0000","last_change":"2023-07-20T09:50:26.385847+0000","last_active":"2023-07-20T09:50:28.674181+0000","last_peered":"2023-07-20T09:50:28.674181+0000","last_clean":"2023-07-20T09:50:28.674181+0000","last_became_active":"2023-07-20T09:50:26.385192+0000","last_became_peered":"2023-07-20T09:50:26.385192+0000","last_unstale":"2023-07-20T09:50:28.674181+0000","last_undegraded":"2023-07-20T09:50:28.674181+0000","last_fullsized":"2023-07-20T09:50:28.674181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738280+0000","last_change":"2023-07-20T09:50:27.704187+0000","last_active":"2023-07-20T09:50:28.738280+0000","last_peered":"2023-07-20T09:50:28.738280+0000","last_clean":"2023-07-20T09:50:28.738280+0000","last_became_active":"2023-07-20T09:50:27.703930+0000","last_became_peered":"2023-07-20T09:50:27.703930+0000","last_unstale":"2023-07-20T09:50:28.738280+0000","last_undegraded":"2023-07-20T09:50:28.738280+0000","last_fullsized":"2023-07-20T09:50:28.738280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272446+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:50:29.272446+0000","last_peered":"2023-07-20T09:50:29.272446+0000","last_clean":"2023-07-20T09:50:29.272446+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:50:29.272446+0000","last_undegraded":"2023-07-20T09:50:29.272446+0000","last_fullsized":"2023-07-20T09:50:29.272446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:39.312665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679858+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:50:28.679858+0000","last_peered":"2023-07-20T09:50:28.679858+0000","last_clean":"2023-07-20T09:50:28.679858+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:50:28.679858+0000","last_undegraded":"2023-07-20T09:50:28.679858+0000","last_fullsized":"2023-07-20T09:50:28.679858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:52.887681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674244+0000","last_change":"2023-07-20T09:50:26.391454+0000","last_active":"2023-07-20T09:50:28.674244+0000","last_peered":"2023-07-20T09:50:28.674244+0000","last_clean":"2023-07-20T09:50:28.674244+0000","last_became_active":"2023-07-20T09:50:26.391057+0000","last_became_peered":"2023-07-20T09:50:26.391057+0000","last_unstale":"2023-07-20T09:50:28.674244+0000","last_undegraded":"2023-07-20T09:50:28.674244+0000","last_fullsized":"2023-07-20T09:50:28.674244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066206+0000","last_change":"2023-07-20T09:50:27.689061+0000","last_active":"2023-07-20T09:50:29.066206+0000","last_peered":"2023-07-20T09:50:29.066206+0000","last_clean":"2023-07-20T09:50:29.066206+0000","last_became_active":"2023-07-20T09:50:27.688756+0000","last_became_peered":"2023-07-20T09:50:27.688756+0000","last_unstale":"2023-07-20T09:50:29.066206+0000","last_undegraded":"2023-07-20T09:50:29.066206+0000","last_fullsized":"2023-07-20T09:50:29.066206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:49:05.889644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272248+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:50:29.272248+0000","last_peered":"2023-07-20T09:50:29.272248+0000","last_clean":"2023-07-20T09:50:29.272248+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:50:29.272248+0000","last_undegraded":"2023-07-20T09:50:29.272248+0000","last_fullsized":"2023-07-20T09:50:29.272248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:24:13.088617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732711+0000","last_change":"2023-07-20T09:50:26.398360+0000","last_active":"2023-07-20T09:50:28.732711+0000","last_peered":"2023-07-20T09:50:28.732711+0000","last_clean":"2023-07-20T09:50:28.732711+0000","last_became_active":"2023-07-20T09:50:26.398066+0000","last_became_peered":"2023-07-20T09:50:26.398066+0000","last_unstale":"2023-07-20T09:50:28.732711+0000","last_undegraded":"2023-07-20T09:50:28.732711+0000","last_fullsized":"2023-07-20T09:50:28.732711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733059+0000","last_change":"2023-07-20T09:50:27.692188+0000","last_active":"2023-07-20T09:50:28.733059+0000","last_peered":"2023-07-20T09:50:28.733059+0000","last_clean":"2023-07-20T09:50:28.733059+0000","last_became_active":"2023-07-20T09:50:27.691911+0000","last_became_peered":"2023-07-20T09:50:27.691911+0000","last_unstale":"2023-07-20T09:50:28.733059+0000","last_undegraded":"2023-07-20T09:50:28.733059+0000","last_fullsized":"2023-07-20T09:50:28.733059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135329+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:50:29.135329+0000","last_peered":"2023-07-20T09:50:29.135329+0000","last_clean":"2023-07-20T09:50:29.135329+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:50:29.135329+0000","last_undegraded":"2023-07-20T09:50:29.135329+0000","last_fullsized":"2023-07-20T09:50:29.135329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:45:27.689820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737810+0000","last_change":"2023-07-20T09:50:26.378417+0000","last_active":"2023-07-20T09:50:28.737810+0000","last_peered":"2023-07-20T09:50:28.737810+0000","last_clean":"2023-07-20T09:50:28.737810+0000","last_became_active":"2023-07-20T09:50:26.378120+0000","last_became_peered":"2023-07-20T09:50:26.378120+0000","last_unstale":"2023-07-20T09:50:28.737810+0000","last_undegraded":"2023-07-20T09:50:28.737810+0000","last_fullsized":"2023-07-20T09:50:28.737810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738299+0000","last_change":"2023-07-20T09:50:27.693115+0000","last_active":"2023-07-20T09:50:28.738299+0000","last_peered":"2023-07-20T09:50:28.738299+0000","last_clean":"2023-07-20T09:50:28.738299+0000","last_became_active":"2023-07-20T09:50:27.692827+0000","last_became_peered":"2023-07-20T09:50:27.692827+0000","last_unstale":"2023-07-20T09:50:28.738299+0000","last_undegraded":"2023-07-20T09:50:28.738299+0000","last_fullsized":"2023-07-20T09:50:28.738299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679628+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:50:28.679628+0000","last_peered":"2023-07-20T09:50:28.679628+0000","last_clean":"2023-07-20T09:50:28.679628+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:50:28.679628+0000","last_undegraded":"2023-07-20T09:50:28.679628+0000","last_fullsized":"2023-07-20T09:50:28.679628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:22.979973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679636+0000","last_change":"2023-07-20T09:50:26.395292+0000","last_active":"2023-07-20T09:50:28.679636+0000","last_peered":"2023-07-20T09:50:28.679636+0000","last_clean":"2023-07-20T09:50:28.679636+0000","last_became_active":"2023-07-20T09:50:26.393257+0000","last_became_peered":"2023-07-20T09:50:26.393257+0000","last_unstale":"2023-07-20T09:50:28.679636+0000","last_undegraded":"2023-07-20T09:50:28.679636+0000","last_fullsized":"2023-07-20T09:50:28.679636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738078+0000","last_change":"2023-07-20T09:50:27.692549+0000","last_active":"2023-07-20T09:50:28.738078+0000","last_peered":"2023-07-20T09:50:28.738078+0000","last_clean":"2023-07-20T09:50:28.738078+0000","last_became_active":"2023-07-20T09:50:27.692235+0000","last_became_peered":"2023-07-20T09:50:27.692235+0000","last_unstale":"2023-07-20T09:50:28.738078+0000","last_undegraded":"2023-07-20T09:50:28.738078+0000","last_fullsized":"2023-07-20T09:50:28.738078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679719+0000","last_change":"2023-07-20T09:50:26.387332+0000","last_active":"2023-07-20T09:50:28.679719+0000","last_peered":"2023-07-20T09:50:28.679719+0000","last_clean":"2023-07-20T09:50:28.679719+0000","last_became_active":"2023-07-20T09:50:26.386908+0000","last_became_peered":"2023-07-20T09:50:26.386908+0000","last_unstale":"2023-07-20T09:50:28.679719+0000","last_undegraded":"2023-07-20T09:50:28.679719+0000","last_fullsized":"2023-07-20T09:50:28.679719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738187+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:50:28.738187+0000","last_peered":"2023-07-20T09:50:28.738187+0000","last_clean":"2023-07-20T09:50:28.738187+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:50:28.738187+0000","last_undegraded":"2023-07-20T09:50:28.738187+0000","last_fullsized":"2023-07-20T09:50:28.738187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:07.387104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738108+0000","last_change":"2023-07-20T09:50:27.693485+0000","last_active":"2023-07-20T09:50:28.738108+0000","last_peered":"2023-07-20T09:50:28.738108+0000","last_clean":"2023-07-20T09:50:28.738108+0000","last_became_active":"2023-07-20T09:50:27.692992+0000","last_became_peered":"2023-07-20T09:50:27.692992+0000","last_unstale":"2023-07-20T09:50:28.738108+0000","last_undegraded":"2023-07-20T09:50:28.738108+0000","last_fullsized":"2023-07-20T09:50:28.738108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738109+0000","last_change":"2023-07-20T09:50:26.385485+0000","last_active":"2023-07-20T09:50:28.738109+0000","last_peered":"2023-07-20T09:50:28.738109+0000","last_clean":"2023-07-20T09:50:28.738109+0000","last_became_active":"2023-07-20T09:50:26.385129+0000","last_became_peered":"2023-07-20T09:50:26.385129+0000","last_unstale":"2023-07-20T09:50:28.738109+0000","last_undegraded":"2023-07-20T09:50:28.738109+0000","last_fullsized":"2023-07-20T09:50:28.738109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272724+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:50:29.272724+0000","last_peered":"2023-07-20T09:50:29.272724+0000","last_clean":"2023-07-20T09:50:29.272724+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:50:29.272724+0000","last_undegraded":"2023-07-20T09:50:29.272724+0000","last_fullsized":"2023-07-20T09:50:29.272724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:22:52.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732950+0000","last_change":"2023-07-20T09:50:27.685907+0000","last_active":"2023-07-20T09:50:28.732950+0000","last_peered":"2023-07-20T09:50:28.732950+0000","last_clean":"2023-07-20T09:50:28.732950+0000","last_became_active":"2023-07-20T09:50:27.685597+0000","last_became_peered":"2023-07-20T09:50:27.685597+0000","last_unstale":"2023-07-20T09:50:28.732950+0000","last_undegraded":"2023-07-20T09:50:28.732950+0000","last_fullsized":"2023-07-20T09:50:28.732950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674778+0000","last_change":"2023-07-20T09:50:26.381821+0000","last_active":"2023-07-20T09:50:28.674778+0000","last_peered":"2023-07-20T09:50:28.674778+0000","last_clean":"2023-07-20T09:50:28.674778+0000","last_became_active":"2023-07-20T09:50:26.381592+0000","last_became_peered":"2023-07-20T09:50:26.381592+0000","last_unstale":"2023-07-20T09:50:28.674778+0000","last_undegraded":"2023-07-20T09:50:28.674778+0000","last_fullsized":"2023-07-20T09:50:28.674778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:57.918845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738166+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:50:28.738166+0000","last_peered":"2023-07-20T09:50:28.738166+0000","last_clean":"2023-07-20T09:50:28.738166+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:50:28.738166+0000","last_undegraded":"2023-07-20T09:50:28.738166+0000","last_fullsized":"2023-07-20T09:50:28.738166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:14.378010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674063+0000","last_change":"2023-07-20T09:50:27.700981+0000","last_active":"2023-07-20T09:50:28.674063+0000","last_peered":"2023-07-20T09:50:28.674063+0000","last_clean":"2023-07-20T09:50:28.674063+0000","last_became_active":"2023-07-20T09:50:27.700684+0000","last_became_peered":"2023-07-20T09:50:27.700684+0000","last_unstale":"2023-07-20T09:50:28.674063+0000","last_undegraded":"2023-07-20T09:50:28.674063+0000","last_fullsized":"2023-07-20T09:50:28.674063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.861799+0000","last_change":"2023-07-20T09:50:26.386007+0000","last_active":"2023-07-20T09:50:28.861799+0000","last_peered":"2023-07-20T09:50:28.861799+0000","last_clean":"2023-07-20T09:50:28.861799+0000","last_became_active":"2023-07-20T09:50:26.385678+0000","last_became_peered":"2023-07-20T09:50:26.385678+0000","last_unstale":"2023-07-20T09:50:28.861799+0000","last_undegraded":"2023-07-20T09:50:28.861799+0000","last_fullsized":"2023-07-20T09:50:28.861799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066369+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:50:29.066369+0000","last_peered":"2023-07-20T09:50:29.066369+0000","last_clean":"2023-07-20T09:50:29.066369+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:50:29.066369+0000","last_undegraded":"2023-07-20T09:50:29.066369+0000","last_fullsized":"2023-07-20T09:50:29.066369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:02.151760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679874+0000","last_change":"2023-07-20T09:50:27.680743+0000","last_active":"2023-07-20T09:50:28.679874+0000","last_peered":"2023-07-20T09:50:28.679874+0000","last_clean":"2023-07-20T09:50:28.679874+0000","last_became_active":"2023-07-20T09:50:27.680495+0000","last_became_peered":"2023-07-20T09:50:27.680495+0000","last_unstale":"2023-07-20T09:50:28.679874+0000","last_undegraded":"2023-07-20T09:50:28.679874+0000","last_fullsized":"2023-07-20T09:50:28.679874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679567+0000","last_change":"2023-07-20T09:50:27.682591+0000","last_active":"2023-07-20T09:50:28.679567+0000","last_peered":"2023-07-20T09:50:28.679567+0000","last_clean":"2023-07-20T09:50:28.679567+0000","last_became_active":"2023-07-20T09:50:27.681420+0000","last_became_peered":"2023-07-20T09:50:27.681420+0000","last_unstale":"2023-07-20T09:50:28.679567+0000","last_undegraded":"2023-07-20T09:50:28.679567+0000","last_fullsized":"2023-07-20T09:50:28.679567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680046+0000","last_change":"2023-07-20T09:50:26.391865+0000","last_active":"2023-07-20T09:50:28.680046+0000","last_peered":"2023-07-20T09:50:28.680046+0000","last_clean":"2023-07-20T09:50:28.680046+0000","last_became_active":"2023-07-20T09:50:26.389528+0000","last_became_peered":"2023-07-20T09:50:26.389528+0000","last_unstale":"2023-07-20T09:50:28.680046+0000","last_undegraded":"2023-07-20T09:50:28.680046+0000","last_fullsized":"2023-07-20T09:50:28.680046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738011+0000","last_change":"2023-07-20T09:50:27.693275+0000","last_active":"2023-07-20T09:50:28.738011+0000","last_peered":"2023-07-20T09:50:28.738011+0000","last_clean":"2023-07-20T09:50:28.738011+0000","last_became_active":"2023-07-20T09:50:27.692606+0000","last_became_peered":"2023-07-20T09:50:27.692606+0000","last_unstale":"2023-07-20T09:50:28.738011+0000","last_undegraded":"2023-07-20T09:50:28.738011+0000","last_fullsized":"2023-07-20T09:50:28.738011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272370+0000","last_change":"2023-07-20T09:50:26.387370+0000","last_active":"2023-07-20T09:50:29.272370+0000","last_peered":"2023-07-20T09:50:29.272370+0000","last_clean":"2023-07-20T09:50:29.272370+0000","last_became_active":"2023-07-20T09:50:26.387057+0000","last_became_peered":"2023-07-20T09:50:26.387057+0000","last_unstale":"2023-07-20T09:50:29.272370+0000","last_undegraded":"2023-07-20T09:50:29.272370+0000","last_fullsized":"2023-07-20T09:50:29.272370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:43.018642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679914+0000","last_change":"2023-07-20T09:50:26.385418+0000","last_active":"2023-07-20T09:50:28.679914+0000","last_peered":"2023-07-20T09:50:28.679914+0000","last_clean":"2023-07-20T09:50:28.679914+0000","last_became_active":"2023-07-20T09:50:26.380033+0000","last_became_peered":"2023-07-20T09:50:26.380033+0000","last_unstale":"2023-07-20T09:50:28.679914+0000","last_undegraded":"2023-07-20T09:50:28.679914+0000","last_fullsized":"2023-07-20T09:50:28.679914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674279+0000","last_change":"2023-07-20T09:50:27.704425+0000","last_active":"2023-07-20T09:50:28.674279+0000","last_peered":"2023-07-20T09:50:28.674279+0000","last_clean":"2023-07-20T09:50:28.674279+0000","last_became_active":"2023-07-20T09:50:27.704141+0000","last_became_peered":"2023-07-20T09:50:27.704141+0000","last_unstale":"2023-07-20T09:50:28.674279+0000","last_undegraded":"2023-07-20T09:50:28.674279+0000","last_fullsized":"2023-07-20T09:50:28.674279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733132+0000","last_change":"2023-07-20T09:50:26.379893+0000","last_active":"2023-07-20T09:50:28.733132+0000","last_peered":"2023-07-20T09:50:28.733132+0000","last_clean":"2023-07-20T09:50:28.733132+0000","last_became_active":"2023-07-20T09:50:26.379557+0000","last_became_peered":"2023-07-20T09:50:26.379557+0000","last_unstale":"2023-07-20T09:50:28.733132+0000","last_undegraded":"2023-07-20T09:50:28.733132+0000","last_fullsized":"2023-07-20T09:50:28.733132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.673906+0000","last_change":"2023-07-20T09:50:27.696687+0000","last_active":"2023-07-20T09:50:28.673906+0000","last_peered":"2023-07-20T09:50:28.673906+0000","last_clean":"2023-07-20T09:50:28.673906+0000","last_became_active":"2023-07-20T09:50:27.696327+0000","last_became_peered":"2023-07-20T09:50:27.696327+0000","last_unstale":"2023-07-20T09:50:28.673906+0000","last_undegraded":"2023-07-20T09:50:28.673906+0000","last_fullsized":"2023-07-20T09:50:28.673906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066196+0000","last_change":"2023-07-20T09:50:27.678469+0000","last_active":"2023-07-20T09:50:29.066196+0000","last_peered":"2023-07-20T09:50:29.066196+0000","last_clean":"2023-07-20T09:50:29.066196+0000","last_became_active":"2023-07-20T09:50:27.678174+0000","last_became_peered":"2023-07-20T09:50:27.678174+0000","last_unstale":"2023-07-20T09:50:29.066196+0000","last_undegraded":"2023-07-20T09:50:29.066196+0000","last_fullsized":"2023-07-20T09:50:29.066196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:00.450516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674037+0000","last_change":"2023-07-20T09:50:26.386119+0000","last_active":"2023-07-20T09:50:28.674037+0000","last_peered":"2023-07-20T09:50:28.674037+0000","last_clean":"2023-07-20T09:50:28.674037+0000","last_became_active":"2023-07-20T09:50:26.385547+0000","last_became_peered":"2023-07-20T09:50:26.385547+0000","last_unstale":"2023-07-20T09:50:28.674037+0000","last_undegraded":"2023-07-20T09:50:28.674037+0000","last_fullsized":"2023-07-20T09:50:28.674037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:14.790712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733031+0000","last_change":"2023-07-20T09:50:27.686135+0000","last_active":"2023-07-20T09:50:28.733031+0000","last_peered":"2023-07-20T09:50:28.733031+0000","last_clean":"2023-07-20T09:50:28.733031+0000","last_became_active":"2023-07-20T09:50:27.685727+0000","last_became_peered":"2023-07-20T09:50:27.685727+0000","last_unstale":"2023-07-20T09:50:28.733031+0000","last_undegraded":"2023-07-20T09:50:28.733031+0000","last_fullsized":"2023-07-20T09:50:28.733031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737961+0000","last_change":"2023-07-20T09:50:26.380820+0000","last_active":"2023-07-20T09:50:28.737961+0000","last_peered":"2023-07-20T09:50:28.737961+0000","last_clean":"2023-07-20T09:50:28.737961+0000","last_became_active":"2023-07-20T09:50:26.380492+0000","last_became_peered":"2023-07-20T09:50:26.380492+0000","last_unstale":"2023-07-20T09:50:28.737961+0000","last_undegraded":"2023-07-20T09:50:28.737961+0000","last_fullsized":"2023-07-20T09:50:28.737961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674526+0000","last_change":"2023-07-20T09:50:27.701903+0000","last_active":"2023-07-20T09:50:28.674526+0000","last_peered":"2023-07-20T09:50:28.674526+0000","last_clean":"2023-07-20T09:50:28.674526+0000","last_became_active":"2023-07-20T09:50:27.701530+0000","last_became_peered":"2023-07-20T09:50:27.701530+0000","last_unstale":"2023-07-20T09:50:28.674526+0000","last_undegraded":"2023-07-20T09:50:28.674526+0000","last_fullsized":"2023-07-20T09:50:28.674526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679068+0000","last_change":"2023-07-20T09:50:26.394729+0000","last_active":"2023-07-20T09:50:28.679068+0000","last_peered":"2023-07-20T09:50:28.679068+0000","last_clean":"2023-07-20T09:50:28.679068+0000","last_became_active":"2023-07-20T09:50:26.392883+0000","last_became_peered":"2023-07-20T09:50:26.392883+0000","last_unstale":"2023-07-20T09:50:28.679068+0000","last_undegraded":"2023-07-20T09:50:28.679068+0000","last_fullsized":"2023-07-20T09:50:28.679068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135570+0000","last_change":"2023-07-20T09:50:27.689341+0000","last_active":"2023-07-20T09:50:29.135570+0000","last_peered":"2023-07-20T09:50:29.135570+0000","last_clean":"2023-07-20T09:50:29.135570+0000","last_became_active":"2023-07-20T09:50:27.689034+0000","last_became_peered":"2023-07-20T09:50:27.689034+0000","last_unstale":"2023-07-20T09:50:29.135570+0000","last_undegraded":"2023-07-20T09:50:29.135570+0000","last_fullsized":"2023-07-20T09:50:29.135570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:09.828008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733088+0000","last_change":"2023-07-20T09:50:26.398368+0000","last_active":"2023-07-20T09:50:28.733088+0000","last_peered":"2023-07-20T09:50:28.733088+0000","last_clean":"2023-07-20T09:50:28.733088+0000","last_became_active":"2023-07-20T09:50:26.398065+0000","last_became_peered":"2023-07-20T09:50:26.398065+0000","last_unstale":"2023-07-20T09:50:28.733088+0000","last_undegraded":"2023-07-20T09:50:28.733088+0000","last_fullsized":"2023-07-20T09:50:28.733088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:05.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679485+0000","last_change":"2023-07-20T09:50:27.706756+0000","last_active":"2023-07-20T09:50:28.679485+0000","last_peered":"2023-07-20T09:50:28.679485+0000","last_clean":"2023-07-20T09:50:28.679485+0000","last_became_active":"2023-07-20T09:50:27.706507+0000","last_became_peered":"2023-07-20T09:50:27.706507+0000","last_unstale":"2023-07-20T09:50:28.679485+0000","last_undegraded":"2023-07-20T09:50:28.679485+0000","last_fullsized":"2023-07-20T09:50:28.679485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679270+0000","last_change":"2023-07-20T09:50:26.390120+0000","last_active":"2023-07-20T09:50:28.679270+0000","last_peered":"2023-07-20T09:50:28.679270+0000","last_clean":"2023-07-20T09:50:28.679270+0000","last_became_active":"2023-07-20T09:50:26.389816+0000","last_became_peered":"2023-07-20T09:50:26.389816+0000","last_unstale":"2023-07-20T09:50:28.679270+0000","last_undegraded":"2023-07-20T09:50:28.679270+0000","last_fullsized":"2023-07-20T09:50:28.679270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678908+0000","last_change":"2023-07-20T09:50:27.702550+0000","last_active":"2023-07-20T09:50:28.678908+0000","last_peered":"2023-07-20T09:50:28.678908+0000","last_clean":"2023-07-20T09:50:28.678908+0000","last_became_active":"2023-07-20T09:50:27.702277+0000","last_became_peered":"2023-07-20T09:50:27.702277+0000","last_unstale":"2023-07-20T09:50:28.678908+0000","last_undegraded":"2023-07-20T09:50:28.678908+0000","last_fullsized":"2023-07-20T09:50:28.678908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679629+0000","last_change":"2023-07-20T09:50:26.396668+0000","last_active":"2023-07-20T09:50:28.679629+0000","last_peered":"2023-07-20T09:50:28.679629+0000","last_clean":"2023-07-20T09:50:28.679629+0000","last_became_active":"2023-07-20T09:50:26.396332+0000","last_became_peered":"2023-07-20T09:50:26.396332+0000","last_unstale":"2023-07-20T09:50:28.679629+0000","last_undegraded":"2023-07-20T09:50:28.679629+0000","last_fullsized":"2023-07-20T09:50:28.679629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674405+0000","last_change":"2023-07-20T09:50:27.703228+0000","last_active":"2023-07-20T09:50:28.674405+0000","last_peered":"2023-07-20T09:50:28.674405+0000","last_clean":"2023-07-20T09:50:28.674405+0000","last_became_active":"2023-07-20T09:50:27.701601+0000","last_became_peered":"2023-07-20T09:50:27.701601+0000","last_unstale":"2023-07-20T09:50:28.674405+0000","last_undegraded":"2023-07-20T09:50:28.674405+0000","last_fullsized":"2023-07-20T09:50:28.674405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674510+0000","last_change":"2023-07-20T09:50:26.382031+0000","last_active":"2023-07-20T09:50:28.674510+0000","last_peered":"2023-07-20T09:50:28.674510+0000","last_clean":"2023-07-20T09:50:28.674510+0000","last_became_active":"2023-07-20T09:50:26.381747+0000","last_became_peered":"2023-07-20T09:50:26.381747+0000","last_unstale":"2023-07-20T09:50:28.674510+0000","last_undegraded":"2023-07-20T09:50:28.674510+0000","last_fullsized":"2023-07-20T09:50:28.674510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678817+0000","last_change":"2023-07-20T09:50:27.683183+0000","last_active":"2023-07-20T09:50:28.678817+0000","last_peered":"2023-07-20T09:50:28.678817+0000","last_clean":"2023-07-20T09:50:28.678817+0000","last_became_active":"2023-07-20T09:50:27.682880+0000","last_became_peered":"2023-07-20T09:50:27.682880+0000","last_unstale":"2023-07-20T09:50:28.678817+0000","last_undegraded":"2023-07-20T09:50:28.678817+0000","last_fullsized":"2023-07-20T09:50:28.678817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733093+0000","last_change":"2023-07-20T09:50:26.391296+0000","last_active":"2023-07-20T09:50:28.733093+0000","last_peered":"2023-07-20T09:50:28.733093+0000","last_clean":"2023-07-20T09:50:28.733093+0000","last_became_active":"2023-07-20T09:50:26.391049+0000","last_became_peered":"2023-07-20T09:50:26.391049+0000","last_unstale":"2023-07-20T09:50:28.733093+0000","last_undegraded":"2023-07-20T09:50:28.733093+0000","last_fullsized":"2023-07-20T09:50:28.733093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:50:36.385 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:50:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 Processor -- start 2023-07-20T09:50:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 -- start start 2023-07-20T09:50:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff480d0d10 0x7eff480d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff480cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff480d16b0 con 0x7eff4815cab0 2023-07-20T09:50:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff480d31c0 con 0x7eff480d0d10 2023-07-20T09:50:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4f167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff480b3520 con 0x7eff480cd4b0 2023-07-20T09:50:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff4d704640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff480cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff480d0d10 0x7eff480d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7eff480d0d10 0x7eff480d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58828/0 (socket says 172.21.15.82:58828) 2023-07-20T09:50:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 -- 172.21.15.82:0/1981874200 learned_addr learned my addr 172.21.15.82:0/1981874200 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 -- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 msgr2=0x7eff480cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 --2- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff480cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 -- 172.21.15.82:0/1981874200 >> v1:172.21.15.183:6789/0 conn(0x7eff4815cab0 legacy=0x7eff480d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.522+0000 7eff3ffff640 1 -- 172.21.15.82:0/1981874200 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480d0a10 con 0x7eff480d0d10 2023-07-20T09:50:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff3ffff640 1 --2- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff480d0d10 0x7eff480d1170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff38009870 tx=0x7eff3801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db3bc21373998581 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff3f7fe640 1 -- 172.21.15.82:0/1981874200 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380aa670 con 0x7eff480d0d10 2023-07-20T09:50:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff3f7fe640 1 -- 172.21.15.82:0/1981874200 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380aa7d0 con 0x7eff480d0d10 2023-07-20T09:50:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff3f7fe640 1 -- 172.21.15.82:0/1981874200 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380aab60 con 0x7eff480d0d10 2023-07-20T09:50:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 -- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff480d0d10 msgr2=0x7eff480d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 --2- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff480d0d10 0x7eff480d1170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff38009870 tx=0x7eff3801c510 comp rx=0 tx=0).stop 2023-07-20T09:50:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 -- 172.21.15.82:0/1981874200 shutdown_connections 2023-07-20T09:50:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 --2- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff480cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 --2- 172.21.15.82:0/1981874200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff480d0d10 0x7eff480d1170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 -- 172.21.15.82:0/1981874200 >> 172.21.15.82:0/1981874200 conn(0x7eff4808c120 msgr2=0x7eff4809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 -- 172.21.15.82:0/1981874200 shutdown_connections 2023-07-20T09:50:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.526+0000 7eff4f167640 1 -- 172.21.15.82:0/1981874200 wait complete. 2023-07-20T09:50:36.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 Processor -- start 2023-07-20T09:50:36.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 -- start start 2023-07-20T09:50:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff4814a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff4815cab0 0x7eff4806b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4814adf0 con 0x7eff480d0d10 2023-07-20T09:50:36.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4814b0d0 con 0x7eff4815cab0 2023-07-20T09:50:36.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4f167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4814b3b0 con 0x7eff480cd4b0 2023-07-20T09:50:36.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53596/0 (socket says 172.21.15.82:53596) 2023-07-20T09:50:36.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 -- 172.21.15.82:0/1852310338 learned_addr learned my addr 172.21.15.82:0/1852310338 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:36.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4d704640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff4815cab0 0x7eff4806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4cf03640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff4814a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 -- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 msgr2=0x7eff4814a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff4814a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 -- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff4815cab0 msgr2=0x7eff4806b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff4815cab0 0x7eff4806b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 -- 172.21.15.82:0/1852310338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380094d0 con 0x7eff480d0d10 2023-07-20T09:50:36.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff4cf03640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff4814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:36.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.530+0000 7eff3ffff640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff3801a140 tx=0x7eff3801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380b3800 con 0x7eff480d0d10 2023-07-20T09:50:36.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380b3980 con 0x7eff480d0d10 2023-07-20T09:50:36.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4814b690 con 0x7eff480d0d10 2023-07-20T09:50:36.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380b3d30 con 0x7eff480d0d10 2023-07-20T09:50:36.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff480c7070 con 0x7eff480d0d10 2023-07-20T09:50:36.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff48073c70 con 0x7eff480d0d10 2023-07-20T09:50:36.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff480ce690 con 0x7eff480d0d10 2023-07-20T09:50:36.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 0x7eff34068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff3811e480 con 0x7eff480d0d10 2023-07-20T09:50:36.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.534+0000 7eff4cf03640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 0x7eff34068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.538+0000 7eff4cf03640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 0x7eff34068770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff440012f0 tx=0x7eff44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.538+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff380eb9b0 con 0x7eff480d0d10 2023-07-20T09:50:36.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.686+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff4814b240 con 0x7eff340662b0 2023-07-20T09:50:36.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.690+0000 7eff3d7fa640 1 -- 172.21.15.82:0/1852310338 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286763 (secure 0 0 0) 0x7eff4814b240 con 0x7eff340662b0 2023-07-20T09:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:36.734 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:50:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 msgr2=0x7eff34068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 0x7eff34068770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff440012f0 tx=0x7eff44009040 comp rx=0 tx=0).stop 2023-07-20T09:50:36.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 msgr2=0x7eff4814bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff3801a140 tx=0x7eff3801ad50 comp rx=0 tx=0).stop 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 shutdown_connections 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7eff340662b0 0x7eff34068770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff4815cab0 0x7eff4806b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff480d0d10 0x7eff4814bbb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 --2- 172.21.15.82:0/1852310338 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff480cd4b0 0x7eff4814a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 >> 172.21.15.82:0/1852310338 conn(0x7eff4808c120 msgr2=0x7eff48159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 shutdown_connections 2023-07-20T09:50:36.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.694+0000 7eff4f167640 1 -- 172.21.15.82:0/1852310338 wait complete. 2023-07-20T09:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T09:50:35.838395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219312,"kb_used_data":3112,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755408,"statfs":{"total":773094113280,"available":772869537792,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.170530"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135440+0000","last_change":"2023-07-20T09:50:27.702234+0000","last_active":"2023-07-20T09:50:29.135440+0000","last_peered":"2023-07-20T09:50:29.135440+0000","last_clean":"2023-07-20T09:50:29.135440+0000","last_became_active":"2023-07-20T09:50:27.701890+0000","last_became_peered":"2023-07-20T09:50:27.701890+0000","last_unstale":"2023-07-20T09:50:29.135440+0000","last_undegraded":"2023-07-20T09:50:29.135440+0000","last_fullsized":"2023-07-20T09:50:29.135440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:38.700040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679258+0000","last_change":"2023-07-20T09:50:27.691896+0000","last_active":"2023-07-20T09:50:28.679258+0000","last_peered":"2023-07-20T09:50:28.679258+0000","last_clean":"2023-07-20T09:50:28.679258+0000","last_became_active":"2023-07-20T09:50:27.691138+0000","last_became_peered":"2023-07-20T09:50:27.691138+0000","last_unstale":"2023-07-20T09:50:28.679258+0000","last_undegraded":"2023-07-20T09:50:28.679258+0000","last_fullsized":"2023-07-20T09:50:28.679258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680090+0000","last_change":"2023-07-20T09:50:27.686197+0000","last_active":"2023-07-20T09:50:28.680090+0000","last_peered":"2023-07-20T09:50:28.680090+0000","last_clean":"2023-07-20T09:50:28.680090+0000","last_became_active":"2023-07-20T09:50:27.685846+0000","last_became_peered":"2023-07-20T09:50:27.685846+0000","last_unstale":"2023-07-20T09:50:28.680090+0000","last_undegraded":"2023-07-20T09:50:28.680090+0000","last_fullsized":"2023-07-20T09:50:28.680090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:44.021656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066160+0000","last_change":"2023-07-20T09:50:27.686988+0000","last_active":"2023-07-20T09:50:29.066160+0000","last_peered":"2023-07-20T09:50:29.066160+0000","last_clean":"2023-07-20T09:50:29.066160+0000","last_became_active":"2023-07-20T09:50:27.686647+0000","last_became_peered":"2023-07-20T09:50:27.686647+0000","last_unstale":"2023-07-20T09:50:29.066160+0000","last_undegraded":"2023-07-20T09:50:29.066160+0000","last_fullsized":"2023-07-20T09:50:29.066160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:09.828008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733017+0000","last_change":"2023-07-20T09:50:27.706718+0000","last_active":"2023-07-20T09:50:28.733017+0000","last_peered":"2023-07-20T09:50:28.733017+0000","last_clean":"2023-07-20T09:50:28.733017+0000","last_became_active":"2023-07-20T09:50:27.706185+0000","last_became_peered":"2023-07-20T09:50:27.706185+0000","last_unstale":"2023-07-20T09:50:28.733017+0000","last_undegraded":"2023-07-20T09:50:28.733017+0000","last_fullsized":"2023-07-20T09:50:28.733017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678715+0000","last_change":"2023-07-20T09:50:27.686831+0000","last_active":"2023-07-20T09:50:28.678715+0000","last_peered":"2023-07-20T09:50:28.678715+0000","last_clean":"2023-07-20T09:50:28.678715+0000","last_became_active":"2023-07-20T09:50:27.686412+0000","last_became_peered":"2023-07-20T09:50:27.686412+0000","last_unstale":"2023-07-20T09:50:28.678715+0000","last_undegraded":"2023-07-20T09:50:28.678715+0000","last_fullsized":"2023-07-20T09:50:28.678715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272132+0000","last_change":"2023-07-20T09:50:27.692084+0000","last_active":"2023-07-20T09:50:29.272132+0000","last_peered":"2023-07-20T09:50:29.272132+0000","last_clean":"2023-07-20T09:50:29.272132+0000","last_became_active":"2023-07-20T09:50:27.691849+0000","last_became_peered":"2023-07-20T09:50:27.691849+0000","last_unstale":"2023-07-20T09:50:29.272132+0000","last_undegraded":"2023-07-20T09:50:29.272132+0000","last_fullsized":"2023-07-20T09:50:29.272132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679116+0000","last_change":"2023-07-20T09:50:27.690562+0000","last_active":"2023-07-20T09:50:28.679116+0000","last_peered":"2023-07-20T09:50:28.679116+0000","last_clean":"2023-07-20T09:50:28.679116+0000","last_became_active":"2023-07-20T09:50:27.685211+0000","last_became_peered":"2023-07-20T09:50:27.685211+0000","last_unstale":"2023-07-20T09:50:28.679116+0000","last_undegraded":"2023-07-20T09:50:28.679116+0000","last_fullsized":"2023-07-20T09:50:28.679116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732966+0000","last_change":"2023-07-20T09:50:27.705540+0000","last_active":"2023-07-20T09:50:28.732966+0000","last_peered":"2023-07-20T09:50:28.732966+0000","last_clean":"2023-07-20T09:50:28.732966+0000","last_became_active":"2023-07-20T09:50:27.705238+0000","last_became_peered":"2023-07-20T09:50:27.705238+0000","last_unstale":"2023-07-20T09:50:28.732966+0000","last_undegraded":"2023-07-20T09:50:28.732966+0000","last_fullsized":"2023-07-20T09:50:28.732966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679423+0000","last_change":"2023-07-20T09:50:27.692110+0000","last_active":"2023-07-20T09:50:28.679423+0000","last_peered":"2023-07-20T09:50:28.679423+0000","last_clean":"2023-07-20T09:50:28.679423+0000","last_became_active":"2023-07-20T09:50:27.691537+0000","last_became_peered":"2023-07-20T09:50:27.691537+0000","last_unstale":"2023-07-20T09:50:28.679423+0000","last_undegraded":"2023-07-20T09:50:28.679423+0000","last_fullsized":"2023-07-20T09:50:28.679423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680137+0000","last_change":"2023-07-20T09:50:27.693033+0000","last_active":"2023-07-20T09:50:28.680137+0000","last_peered":"2023-07-20T09:50:28.680137+0000","last_clean":"2023-07-20T09:50:28.680137+0000","last_became_active":"2023-07-20T09:50:27.692715+0000","last_became_peered":"2023-07-20T09:50:27.692715+0000","last_unstale":"2023-07-20T09:50:28.680137+0000","last_undegraded":"2023-07-20T09:50:28.680137+0000","last_fullsized":"2023-07-20T09:50:28.680137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:49.858742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135538+0000","last_change":"2023-07-20T09:50:27.689428+0000","last_active":"2023-07-20T09:50:29.135538+0000","last_peered":"2023-07-20T09:50:29.135538+0000","last_clean":"2023-07-20T09:50:29.135538+0000","last_became_active":"2023-07-20T09:50:27.689088+0000","last_became_peered":"2023-07-20T09:50:27.689088+0000","last_unstale":"2023-07-20T09:50:29.135538+0000","last_undegraded":"2023-07-20T09:50:29.135538+0000","last_fullsized":"2023-07-20T09:50:29.135538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:43.347892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135281+0000","last_change":"2023-07-20T09:50:27.704247+0000","last_active":"2023-07-20T09:50:29.135281+0000","last_peered":"2023-07-20T09:50:29.135281+0000","last_clean":"2023-07-20T09:50:29.135281+0000","last_became_active":"2023-07-20T09:50:27.703955+0000","last_became_peered":"2023-07-20T09:50:27.703955+0000","last_unstale":"2023-07-20T09:50:29.135281+0000","last_undegraded":"2023-07-20T09:50:29.135281+0000","last_fullsized":"2023-07-20T09:50:29.135281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:50.797971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679534+0000","last_change":"2023-07-20T09:50:27.679300+0000","last_active":"2023-07-20T09:50:28.679534+0000","last_peered":"2023-07-20T09:50:28.679534+0000","last_clean":"2023-07-20T09:50:28.679534+0000","last_became_active":"2023-07-20T09:50:27.678826+0000","last_became_peered":"2023-07-20T09:50:27.678826+0000","last_unstale":"2023-07-20T09:50:28.679534+0000","last_undegraded":"2023-07-20T09:50:28.679534+0000","last_fullsized":"2023-07-20T09:50:28.679534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272329+0000","last_change":"2023-07-20T09:50:27.691224+0000","last_active":"2023-07-20T09:50:29.272329+0000","last_peered":"2023-07-20T09:50:29.272329+0000","last_clean":"2023-07-20T09:50:29.272329+0000","last_became_active":"2023-07-20T09:50:27.690992+0000","last_became_peered":"2023-07-20T09:50:27.690992+0000","last_unstale":"2023-07-20T09:50:29.272329+0000","last_undegraded":"2023-07-20T09:50:29.272329+0000","last_fullsized":"2023-07-20T09:50:29.272329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678697+0000","last_change":"2023-07-20T09:50:27.680234+0000","last_active":"2023-07-20T09:50:28.678697+0000","last_peered":"2023-07-20T09:50:28.678697+0000","last_clean":"2023-07-20T09:50:28.678697+0000","last_became_active":"2023-07-20T09:50:27.679957+0000","last_became_peered":"2023-07-20T09:50:27.679957+0000","last_unstale":"2023-07-20T09:50:28.678697+0000","last_undegraded":"2023-07-20T09:50:28.678697+0000","last_fullsized":"2023-07-20T09:50:28.678697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733011+0000","last_change":"2023-07-20T09:50:27.705338+0000","last_active":"2023-07-20T09:50:28.733011+0000","last_peered":"2023-07-20T09:50:28.733011+0000","last_clean":"2023-07-20T09:50:28.733011+0000","last_became_active":"2023-07-20T09:50:27.704958+0000","last_became_peered":"2023-07-20T09:50:27.704958+0000","last_unstale":"2023-07-20T09:50:28.733011+0000","last_undegraded":"2023-07-20T09:50:28.733011+0000","last_fullsized":"2023-07-20T09:50:28.733011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680236+0000","last_change":"2023-07-20T09:50:27.684311+0000","last_active":"2023-07-20T09:50:28.680236+0000","last_peered":"2023-07-20T09:50:28.680236+0000","last_clean":"2023-07-20T09:50:28.680236+0000","last_became_active":"2023-07-20T09:50:27.680860+0000","last_became_peered":"2023-07-20T09:50:27.680860+0000","last_unstale":"2023-07-20T09:50:28.680236+0000","last_undegraded":"2023-07-20T09:50:28.680236+0000","last_fullsized":"2023-07-20T09:50:28.680236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:06.781038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135426+0000","last_change":"2023-07-20T09:50:27.681256+0000","last_active":"2023-07-20T09:50:29.135426+0000","last_peered":"2023-07-20T09:50:29.135426+0000","last_clean":"2023-07-20T09:50:29.135426+0000","last_became_active":"2023-07-20T09:50:27.680937+0000","last_became_peered":"2023-07-20T09:50:27.680937+0000","last_unstale":"2023-07-20T09:50:29.135426+0000","last_undegraded":"2023-07-20T09:50:29.135426+0000","last_fullsized":"2023-07-20T09:50:29.135426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:02:21.845003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678905+0000","last_change":"2023-07-20T09:50:27.681378+0000","last_active":"2023-07-20T09:50:28.678905+0000","last_peered":"2023-07-20T09:50:28.678905+0000","last_clean":"2023-07-20T09:50:28.678905+0000","last_became_active":"2023-07-20T09:50:27.681016+0000","last_became_peered":"2023-07-20T09:50:27.681016+0000","last_unstale":"2023-07-20T09:50:28.678905+0000","last_undegraded":"2023-07-20T09:50:28.678905+0000","last_fullsized":"2023-07-20T09:50:28.678905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272305+0000","last_change":"2023-07-20T09:50:27.708844+0000","last_active":"2023-07-20T09:50:29.272305+0000","last_peered":"2023-07-20T09:50:29.272305+0000","last_clean":"2023-07-20T09:50:29.272305+0000","last_became_active":"2023-07-20T09:50:27.708506+0000","last_became_peered":"2023-07-20T09:50:27.708506+0000","last_unstale":"2023-07-20T09:50:29.272305+0000","last_undegraded":"2023-07-20T09:50:29.272305+0000","last_fullsized":"2023-07-20T09:50:29.272305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732746+0000","last_change":"2023-07-20T09:50:27.693993+0000","last_active":"2023-07-20T09:50:28.732746+0000","last_peered":"2023-07-20T09:50:28.732746+0000","last_clean":"2023-07-20T09:50:28.732746+0000","last_became_active":"2023-07-20T09:50:27.693525+0000","last_became_peered":"2023-07-20T09:50:27.693525+0000","last_unstale":"2023-07-20T09:50:28.732746+0000","last_undegraded":"2023-07-20T09:50:28.732746+0000","last_fullsized":"2023-07-20T09:50:28.732746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:21.751973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674068+0000","last_change":"2023-07-20T09:50:27.703451+0000","last_active":"2023-07-20T09:50:28.674068+0000","last_peered":"2023-07-20T09:50:28.674068+0000","last_clean":"2023-07-20T09:50:28.674068+0000","last_became_active":"2023-07-20T09:50:27.702940+0000","last_became_peered":"2023-07-20T09:50:27.702940+0000","last_unstale":"2023-07-20T09:50:28.674068+0000","last_undegraded":"2023-07-20T09:50:28.674068+0000","last_fullsized":"2023-07-20T09:50:28.674068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:30.381484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272060+0000","last_change":"2023-07-20T09:50:27.708326+0000","last_active":"2023-07-20T09:50:29.272060+0000","last_peered":"2023-07-20T09:50:29.272060+0000","last_clean":"2023-07-20T09:50:29.272060+0000","last_became_active":"2023-07-20T09:50:27.707974+0000","last_became_peered":"2023-07-20T09:50:27.707974+0000","last_unstale":"2023-07-20T09:50:29.272060+0000","last_undegraded":"2023-07-20T09:50:29.272060+0000","last_fullsized":"2023-07-20T09:50:29.272060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738150+0000","last_change":"2023-07-20T09:50:27.692567+0000","last_active":"2023-07-20T09:50:28.738150+0000","last_peered":"2023-07-20T09:50:28.738150+0000","last_clean":"2023-07-20T09:50:28.738150+0000","last_became_active":"2023-07-20T09:50:27.692146+0000","last_became_peered":"2023-07-20T09:50:27.692146+0000","last_unstale":"2023-07-20T09:50:28.738150+0000","last_undegraded":"2023-07-20T09:50:28.738150+0000","last_fullsized":"2023-07-20T09:50:28.738150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738221+0000","last_change":"2023-07-20T09:50:27.692593+0000","last_active":"2023-07-20T09:50:28.738221+0000","last_peered":"2023-07-20T09:50:28.738221+0000","last_clean":"2023-07-20T09:50:28.738221+0000","last_became_active":"2023-07-20T09:50:27.692226+0000","last_became_peered":"2023-07-20T09:50:27.692226+0000","last_unstale":"2023-07-20T09:50:28.738221+0000","last_undegraded":"2023-07-20T09:50:28.738221+0000","last_fullsized":"2023-07-20T09:50:28.738221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679407+0000","last_change":"2023-07-20T09:50:27.683556+0000","last_active":"2023-07-20T09:50:28.679407+0000","last_peered":"2023-07-20T09:50:28.679407+0000","last_clean":"2023-07-20T09:50:28.679407+0000","last_became_active":"2023-07-20T09:50:27.683246+0000","last_became_peered":"2023-07-20T09:50:27.683246+0000","last_unstale":"2023-07-20T09:50:28.679407+0000","last_undegraded":"2023-07-20T09:50:28.679407+0000","last_fullsized":"2023-07-20T09:50:28.679407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738218+0000","last_change":"2023-07-20T09:50:27.690772+0000","last_active":"2023-07-20T09:50:28.738218+0000","last_peered":"2023-07-20T09:50:28.738218+0000","last_clean":"2023-07-20T09:50:28.738218+0000","last_became_active":"2023-07-20T09:50:27.690456+0000","last_became_peered":"2023-07-20T09:50:27.690456+0000","last_unstale":"2023-07-20T09:50:28.738218+0000","last_undegraded":"2023-07-20T09:50:28.738218+0000","last_fullsized":"2023-07-20T09:50:28.738218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674414+0000","last_change":"2023-07-20T09:50:27.701936+0000","last_active":"2023-07-20T09:50:28.674414+0000","last_peered":"2023-07-20T09:50:28.674414+0000","last_clean":"2023-07-20T09:50:28.674414+0000","last_became_active":"2023-07-20T09:50:27.701378+0000","last_became_peered":"2023-07-20T09:50:27.701378+0000","last_unstale":"2023-07-20T09:50:28.674414+0000","last_undegraded":"2023-07-20T09:50:28.674414+0000","last_fullsized":"2023-07-20T09:50:28.674414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679021+0000","last_change":"2023-07-20T09:50:27.682320+0000","last_active":"2023-07-20T09:50:28.679021+0000","last_peered":"2023-07-20T09:50:28.679021+0000","last_clean":"2023-07-20T09:50:28.679021+0000","last_became_active":"2023-07-20T09:50:27.681183+0000","last_became_peered":"2023-07-20T09:50:27.681183+0000","last_unstale":"2023-07-20T09:50:28.679021+0000","last_undegraded":"2023-07-20T09:50:28.679021+0000","last_fullsized":"2023-07-20T09:50:28.679021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674102+0000","last_change":"2023-07-20T09:50:27.703874+0000","last_active":"2023-07-20T09:50:28.674102+0000","last_peered":"2023-07-20T09:50:28.674102+0000","last_clean":"2023-07-20T09:50:28.674102+0000","last_became_active":"2023-07-20T09:50:27.701925+0000","last_became_peered":"2023-07-20T09:50:27.701925+0000","last_unstale":"2023-07-20T09:50:28.674102+0000","last_undegraded":"2023-07-20T09:50:28.674102+0000","last_fullsized":"2023-07-20T09:50:28.674102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.065932+0000","last_change":"2023-07-20T09:50:27.685373+0000","last_active":"2023-07-20T09:50:29.065932+0000","last_peered":"2023-07-20T09:50:29.065932+0000","last_clean":"2023-07-20T09:50:29.065932+0000","last_became_active":"2023-07-20T09:50:27.685083+0000","last_became_peered":"2023-07-20T09:50:27.685083+0000","last_unstale":"2023-07-20T09:50:29.065932+0000","last_undegraded":"2023-07-20T09:50:29.065932+0000","last_fullsized":"2023-07-20T09:50:29.065932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:43.347892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674290+0000","last_change":"2023-07-20T09:50:27.696660+0000","last_active":"2023-07-20T09:50:28.674290+0000","last_peered":"2023-07-20T09:50:28.674290+0000","last_clean":"2023-07-20T09:50:28.674290+0000","last_became_active":"2023-07-20T09:50:27.696285+0000","last_became_peered":"2023-07-20T09:50:27.696285+0000","last_unstale":"2023-07-20T09:50:28.674290+0000","last_undegraded":"2023-07-20T09:50:28.674290+0000","last_fullsized":"2023-07-20T09:50:28.674290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272295+0000","last_change":"2023-07-20T09:50:26.398520+0000","last_active":"2023-07-20T09:50:29.272295+0000","last_peered":"2023-07-20T09:50:29.272295+0000","last_clean":"2023-07-20T09:50:29.272295+0000","last_became_active":"2023-07-20T09:50:26.398176+0000","last_became_peered":"2023-07-20T09:50:26.398176+0000","last_unstale":"2023-07-20T09:50:29.272295+0000","last_undegraded":"2023-07-20T09:50:29.272295+0000","last_fullsized":"2023-07-20T09:50:29.272295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679549+0000","last_change":"2023-07-20T09:50:27.684529+0000","last_active":"2023-07-20T09:50:28.679549+0000","last_peered":"2023-07-20T09:50:28.679549+0000","last_clean":"2023-07-20T09:50:28.679549+0000","last_became_active":"2023-07-20T09:50:27.684036+0000","last_became_peered":"2023-07-20T09:50:27.684036+0000","last_unstale":"2023-07-20T09:50:28.679549+0000","last_undegraded":"2023-07-20T09:50:28.679549+0000","last_fullsized":"2023-07-20T09:50:28.679549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:13.421282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732887+0000","last_change":"2023-07-20T09:50:26.384546+0000","last_active":"2023-07-20T09:50:28.732887+0000","last_peered":"2023-07-20T09:50:28.732887+0000","last_clean":"2023-07-20T09:50:28.732887+0000","last_became_active":"2023-07-20T09:50:26.384051+0000","last_became_peered":"2023-07-20T09:50:26.384051+0000","last_unstale":"2023-07-20T09:50:28.732887+0000","last_undegraded":"2023-07-20T09:50:28.732887+0000","last_fullsized":"2023-07-20T09:50:28.732887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:30.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733111+0000","last_change":"2023-07-20T09:50:27.702104+0000","last_active":"2023-07-20T09:50:28.733111+0000","last_peered":"2023-07-20T09:50:28.733111+0000","last_clean":"2023-07-20T09:50:28.733111+0000","last_became_active":"2023-07-20T09:50:27.701753+0000","last_became_peered":"2023-07-20T09:50:27.701753+0000","last_unstale":"2023-07-20T09:50:28.733111+0000","last_undegraded":"2023-07-20T09:50:28.733111+0000","last_fullsized":"2023-07-20T09:50:28.733111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272465+0000","last_change":"2023-07-20T09:50:26.398397+0000","last_active":"2023-07-20T09:50:29.272465+0000","last_peered":"2023-07-20T09:50:29.272465+0000","last_clean":"2023-07-20T09:50:29.272465+0000","last_became_active":"2023-07-20T09:50:26.398035+0000","last_became_peered":"2023-07-20T09:50:26.398035+0000","last_unstale":"2023-07-20T09:50:29.272465+0000","last_undegraded":"2023-07-20T09:50:29.272465+0000","last_fullsized":"2023-07-20T09:50:29.272465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:05.778024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674694+0000","last_change":"2023-07-20T09:50:27.701766+0000","last_active":"2023-07-20T09:50:28.674694+0000","last_peered":"2023-07-20T09:50:28.674694+0000","last_clean":"2023-07-20T09:50:28.674694+0000","last_became_active":"2023-07-20T09:50:27.701453+0000","last_became_peered":"2023-07-20T09:50:27.701453+0000","last_unstale":"2023-07-20T09:50:28.674694+0000","last_undegraded":"2023-07-20T09:50:28.674694+0000","last_fullsized":"2023-07-20T09:50:28.674694+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066094+0000","last_change":"2023-07-20T09:50:26.386136+0000","last_active":"2023-07-20T09:50:29.066094+0000","last_peered":"2023-07-20T09:50:29.066094+0000","last_clean":"2023-07-20T09:50:29.066094+0000","last_became_active":"2023-07-20T09:50:26.385573+0000","last_became_peered":"2023-07-20T09:50:26.385573+0000","last_unstale":"2023-07-20T09:50:29.066094+0000","last_undegraded":"2023-07-20T09:50:29.066094+0000","last_fullsized":"2023-07-20T09:50:29.066094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:18.396263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272606+0000","last_change":"2023-07-20T09:50:26.399349+0000","last_active":"2023-07-20T09:50:29.272606+0000","last_peered":"2023-07-20T09:50:29.272606+0000","last_clean":"2023-07-20T09:50:29.272606+0000","last_became_active":"2023-07-20T09:50:26.398932+0000","last_became_peered":"2023-07-20T09:50:26.398932+0000","last_unstale":"2023-07-20T09:50:29.272606+0000","last_undegraded":"2023-07-20T09:50:29.272606+0000","last_fullsized":"2023-07-20T09:50:29.272606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:12:27.812093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679283+0000","last_change":"2023-07-20T09:50:27.683608+0000","last_active":"2023-07-20T09:50:28.679283+0000","last_peered":"2023-07-20T09:50:28.679283+0000","last_clean":"2023-07-20T09:50:28.679283+0000","last_became_active":"2023-07-20T09:50:27.683287+0000","last_became_peered":"2023-07-20T09:50:27.683287+0000","last_unstale":"2023-07-20T09:50:28.679283+0000","last_undegraded":"2023-07-20T09:50:28.679283+0000","last_fullsized":"2023-07-20T09:50:28.679283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272408+0000","last_change":"2023-07-20T09:50:26.398232+0000","last_active":"2023-07-20T09:50:29.272408+0000","last_peered":"2023-07-20T09:50:29.272408+0000","last_clean":"2023-07-20T09:50:29.272408+0000","last_became_active":"2023-07-20T09:50:26.397884+0000","last_became_peered":"2023-07-20T09:50:26.397884+0000","last_unstale":"2023-07-20T09:50:29.272408+0000","last_undegraded":"2023-07-20T09:50:29.272408+0000","last_fullsized":"2023-07-20T09:50:29.272408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:48.855728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678623+0000","last_change":"2023-07-20T09:50:27.692914+0000","last_active":"2023-07-20T09:50:28.678623+0000","last_peered":"2023-07-20T09:50:28.678623+0000","last_clean":"2023-07-20T09:50:28.678623+0000","last_became_active":"2023-07-20T09:50:27.692610+0000","last_became_peered":"2023-07-20T09:50:27.692610+0000","last_unstale":"2023-07-20T09:50:28.678623+0000","last_undegraded":"2023-07-20T09:50:28.678623+0000","last_fullsized":"2023-07-20T09:50:28.678623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272594+0000","last_change":"2023-07-20T09:50:26.391171+0000","last_active":"2023-07-20T09:50:29.272594+0000","last_peered":"2023-07-20T09:50:29.272594+0000","last_clean":"2023-07-20T09:50:29.272594+0000","last_became_active":"2023-07-20T09:50:26.390823+0000","last_became_peered":"2023-07-20T09:50:26.390823+0000","last_unstale":"2023-07-20T09:50:29.272594+0000","last_undegraded":"2023-07-20T09:50:29.272594+0000","last_fullsized":"2023-07-20T09:50:29.272594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:07.373905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.065958+0000","last_change":"2023-07-20T09:50:27.692283+0000","last_active":"2023-07-20T09:50:29.065958+0000","last_peered":"2023-07-20T09:50:29.065958+0000","last_clean":"2023-07-20T09:50:29.065958+0000","last_became_active":"2023-07-20T09:50:27.691972+0000","last_became_peered":"2023-07-20T09:50:27.691972+0000","last_unstale":"2023-07-20T09:50:29.065958+0000","last_undegraded":"2023-07-20T09:50:29.065958+0000","last_fullsized":"2023-07-20T09:50:29.065958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:38.700040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679424+0000","last_change":"2023-07-20T09:50:26.387250+0000","last_active":"2023-07-20T09:50:28.679424+0000","last_peered":"2023-07-20T09:50:28.679424+0000","last_clean":"2023-07-20T09:50:28.679424+0000","last_became_active":"2023-07-20T09:50:26.386829+0000","last_became_peered":"2023-07-20T09:50:26.386829+0000","last_unstale":"2023-07-20T09:50:28.679424+0000","last_undegraded":"2023-07-20T09:50:28.679424+0000","last_fullsized":"2023-07-20T09:50:28.679424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732879+0000","last_change":"2023-07-20T09:50:27.693747+0000","last_active":"2023-07-20T09:50:28.732879+0000","last_peered":"2023-07-20T09:50:28.732879+0000","last_clean":"2023-07-20T09:50:28.732879+0000","last_became_active":"2023-07-20T09:50:27.693399+0000","last_became_peered":"2023-07-20T09:50:27.693399+0000","last_unstale":"2023-07-20T09:50:28.732879+0000","last_undegraded":"2023-07-20T09:50:28.732879+0000","last_fullsized":"2023-07-20T09:50:28.732879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:15.793726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674542+0000","last_change":"2023-07-20T09:50:26.387168+0000","last_active":"2023-07-20T09:50:28.674542+0000","last_peered":"2023-07-20T09:50:28.674542+0000","last_clean":"2023-07-20T09:50:28.674542+0000","last_became_active":"2023-07-20T09:50:26.386895+0000","last_became_peered":"2023-07-20T09:50:26.386895+0000","last_unstale":"2023-07-20T09:50:28.674542+0000","last_undegraded":"2023-07-20T09:50:28.674542+0000","last_fullsized":"2023-07-20T09:50:28.674542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:28.011137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679049+0000","last_change":"2023-07-20T09:50:27.705371+0000","last_active":"2023-07-20T09:50:28.679049+0000","last_peered":"2023-07-20T09:50:28.679049+0000","last_clean":"2023-07-20T09:50:28.679049+0000","last_became_active":"2023-07-20T09:50:27.705101+0000","last_became_peered":"2023-07-20T09:50:27.705101+0000","last_unstale":"2023-07-20T09:50:28.679049+0000","last_undegraded":"2023-07-20T09:50:28.679049+0000","last_fullsized":"2023-07-20T09:50:28.679049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:38.508833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066342+0000","last_change":"2023-07-20T09:50:26.396439+0000","last_active":"2023-07-20T09:50:29.066342+0000","last_peered":"2023-07-20T09:50:29.066342+0000","last_clean":"2023-07-20T09:50:29.066342+0000","last_became_active":"2023-07-20T09:50:26.396127+0000","last_became_peered":"2023-07-20T09:50:26.396127+0000","last_unstale":"2023-07-20T09:50:29.066342+0000","last_undegraded":"2023-07-20T09:50:29.066342+0000","last_fullsized":"2023-07-20T09:50:29.066342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:45.504134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680251+0000","last_change":"2023-07-20T09:50:27.684320+0000","last_active":"2023-07-20T09:50:28.680251+0000","last_peered":"2023-07-20T09:50:28.680251+0000","last_clean":"2023-07-20T09:50:28.680251+0000","last_became_active":"2023-07-20T09:50:27.683970+0000","last_became_peered":"2023-07-20T09:50:27.683970+0000","last_unstale":"2023-07-20T09:50:28.680251+0000","last_undegraded":"2023-07-20T09:50:28.680251+0000","last_fullsized":"2023-07-20T09:50:28.680251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:51.387330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678776+0000","last_change":"2023-07-20T09:50:26.392014+0000","last_active":"2023-07-20T09:50:28.678776+0000","last_peered":"2023-07-20T09:50:28.678776+0000","last_clean":"2023-07-20T09:50:28.678776+0000","last_became_active":"2023-07-20T09:50:26.388891+0000","last_became_peered":"2023-07-20T09:50:26.388891+0000","last_unstale":"2023-07-20T09:50:28.678776+0000","last_undegraded":"2023-07-20T09:50:28.678776+0000","last_fullsized":"2023-07-20T09:50:28.678776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680271+0000","last_change":"2023-07-20T09:50:27.684512+0000","last_active":"2023-07-20T09:50:28.680271+0000","last_peered":"2023-07-20T09:50:28.680271+0000","last_clean":"2023-07-20T09:50:28.680271+0000","last_became_active":"2023-07-20T09:50:27.681388+0000","last_became_peered":"2023-07-20T09:50:27.681388+0000","last_unstale":"2023-07-20T09:50:28.680271+0000","last_undegraded":"2023-07-20T09:50:28.680271+0000","last_fullsized":"2023-07-20T09:50:28.680271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:45.345422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674181+0000","last_change":"2023-07-20T09:50:26.385847+0000","last_active":"2023-07-20T09:50:28.674181+0000","last_peered":"2023-07-20T09:50:28.674181+0000","last_clean":"2023-07-20T09:50:28.674181+0000","last_became_active":"2023-07-20T09:50:26.385192+0000","last_became_peered":"2023-07-20T09:50:26.385192+0000","last_unstale":"2023-07-20T09:50:28.674181+0000","last_undegraded":"2023-07-20T09:50:28.674181+0000","last_fullsized":"2023-07-20T09:50:28.674181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738280+0000","last_change":"2023-07-20T09:50:27.704187+0000","last_active":"2023-07-20T09:50:28.738280+0000","last_peered":"2023-07-20T09:50:28.738280+0000","last_clean":"2023-07-20T09:50:28.738280+0000","last_became_active":"2023-07-20T09:50:27.703930+0000","last_became_peered":"2023-07-20T09:50:27.703930+0000","last_unstale":"2023-07-20T09:50:28.738280+0000","last_undegraded":"2023-07-20T09:50:28.738280+0000","last_fullsized":"2023-07-20T09:50:28.738280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272446+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:50:29.272446+0000","last_peered":"2023-07-20T09:50:29.272446+0000","last_clean":"2023-07-20T09:50:29.272446+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:50:29.272446+0000","last_undegraded":"2023-07-20T09:50:29.272446+0000","last_fullsized":"2023-07-20T09:50:29.272446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:39.312665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679858+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:50:28.679858+0000","last_peered":"2023-07-20T09:50:28.679858+0000","last_clean":"2023-07-20T09:50:28.679858+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:50:28.679858+0000","last_undegraded":"2023-07-20T09:50:28.679858+0000","last_fullsized":"2023-07-20T09:50:28.679858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:52.887681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674244+0000","last_change":"2023-07-20T09:50:26.391454+0000","last_active":"2023-07-20T09:50:28.674244+0000","last_peered":"2023-07-20T09:50:28.674244+0000","last_clean":"2023-07-20T09:50:28.674244+0000","last_became_active":"2023-07-20T09:50:26.391057+0000","last_became_peered":"2023-07-20T09:50:26.391057+0000","last_unstale":"2023-07-20T09:50:28.674244+0000","last_undegraded":"2023-07-20T09:50:28.674244+0000","last_fullsized":"2023-07-20T09:50:28.674244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066206+0000","last_change":"2023-07-20T09:50:27.689061+0000","last_active":"2023-07-20T09:50:29.066206+0000","last_peered":"2023-07-20T09:50:29.066206+0000","last_clean":"2023-07-20T09:50:29.066206+0000","last_became_active":"2023-07-20T09:50:27.688756+0000","last_became_peered":"2023-07-20T09:50:27.688756+0000","last_unstale":"2023-07-20T09:50:29.066206+0000","last_undegraded":"2023-07-20T09:50:29.066206+0000","last_fullsized":"2023-07-20T09:50:29.066206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:49:05.889644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272248+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:50:29.272248+0000","last_peered":"2023-07-20T09:50:29.272248+0000","last_clean":"2023-07-20T09:50:29.272248+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:50:29.272248+0000","last_undegraded":"2023-07-20T09:50:29.272248+0000","last_fullsized":"2023-07-20T09:50:29.272248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:24:13.088617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732711+0000","last_change":"2023-07-20T09:50:26.398360+0000","last_active":"2023-07-20T09:50:28.732711+0000","last_peered":"2023-07-20T09:50:28.732711+0000","last_clean":"2023-07-20T09:50:28.732711+0000","last_became_active":"2023-07-20T09:50:26.398066+0000","last_became_peered":"2023-07-20T09:50:26.398066+0000","last_unstale":"2023-07-20T09:50:28.732711+0000","last_undegraded":"2023-07-20T09:50:28.732711+0000","last_fullsized":"2023-07-20T09:50:28.732711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:07.182924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733059+0000","last_change":"2023-07-20T09:50:27.692188+0000","last_active":"2023-07-20T09:50:28.733059+0000","last_peered":"2023-07-20T09:50:28.733059+0000","last_clean":"2023-07-20T09:50:28.733059+0000","last_became_active":"2023-07-20T09:50:27.691911+0000","last_became_peered":"2023-07-20T09:50:27.691911+0000","last_unstale":"2023-07-20T09:50:28.733059+0000","last_undegraded":"2023-07-20T09:50:28.733059+0000","last_fullsized":"2023-07-20T09:50:28.733059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135329+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:50:29.135329+0000","last_peered":"2023-07-20T09:50:29.135329+0000","last_clean":"2023-07-20T09:50:29.135329+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:50:29.135329+0000","last_undegraded":"2023-07-20T09:50:29.135329+0000","last_fullsized":"2023-07-20T09:50:29.135329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:45:27.689820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737810+0000","last_change":"2023-07-20T09:50:26.378417+0000","last_active":"2023-07-20T09:50:28.737810+0000","last_peered":"2023-07-20T09:50:28.737810+0000","last_clean":"2023-07-20T09:50:28.737810+0000","last_became_active":"2023-07-20T09:50:26.378120+0000","last_became_peered":"2023-07-20T09:50:26.378120+0000","last_unstale":"2023-07-20T09:50:28.737810+0000","last_undegraded":"2023-07-20T09:50:28.737810+0000","last_fullsized":"2023-07-20T09:50:28.737810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:40.379325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738299+0000","last_change":"2023-07-20T09:50:27.693115+0000","last_active":"2023-07-20T09:50:28.738299+0000","last_peered":"2023-07-20T09:50:28.738299+0000","last_clean":"2023-07-20T09:50:28.738299+0000","last_became_active":"2023-07-20T09:50:27.692827+0000","last_became_peered":"2023-07-20T09:50:27.692827+0000","last_unstale":"2023-07-20T09:50:28.738299+0000","last_undegraded":"2023-07-20T09:50:28.738299+0000","last_fullsized":"2023-07-20T09:50:28.738299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:09.671653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679628+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:50:28.679628+0000","last_peered":"2023-07-20T09:50:28.679628+0000","last_clean":"2023-07-20T09:50:28.679628+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:50:28.679628+0000","last_undegraded":"2023-07-20T09:50:28.679628+0000","last_fullsized":"2023-07-20T09:50:28.679628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:22.979973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679636+0000","last_change":"2023-07-20T09:50:26.395292+0000","last_active":"2023-07-20T09:50:28.679636+0000","last_peered":"2023-07-20T09:50:28.679636+0000","last_clean":"2023-07-20T09:50:28.679636+0000","last_became_active":"2023-07-20T09:50:26.393257+0000","last_became_peered":"2023-07-20T09:50:26.393257+0000","last_unstale":"2023-07-20T09:50:28.679636+0000","last_undegraded":"2023-07-20T09:50:28.679636+0000","last_fullsized":"2023-07-20T09:50:28.679636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738078+0000","last_change":"2023-07-20T09:50:27.692549+0000","last_active":"2023-07-20T09:50:28.738078+0000","last_peered":"2023-07-20T09:50:28.738078+0000","last_clean":"2023-07-20T09:50:28.738078+0000","last_became_active":"2023-07-20T09:50:27.692235+0000","last_became_peered":"2023-07-20T09:50:27.692235+0000","last_unstale":"2023-07-20T09:50:28.738078+0000","last_undegraded":"2023-07-20T09:50:28.738078+0000","last_fullsized":"2023-07-20T09:50:28.738078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:17.395161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679719+0000","last_change":"2023-07-20T09:50:26.387332+0000","last_active":"2023-07-20T09:50:28.679719+0000","last_peered":"2023-07-20T09:50:28.679719+0000","last_clean":"2023-07-20T09:50:28.679719+0000","last_became_active":"2023-07-20T09:50:26.386908+0000","last_became_peered":"2023-07-20T09:50:26.386908+0000","last_unstale":"2023-07-20T09:50:28.679719+0000","last_undegraded":"2023-07-20T09:50:28.679719+0000","last_fullsized":"2023-07-20T09:50:28.679719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:04:08.668639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738187+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:50:28.738187+0000","last_peered":"2023-07-20T09:50:28.738187+0000","last_clean":"2023-07-20T09:50:28.738187+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:50:28.738187+0000","last_undegraded":"2023-07-20T09:50:28.738187+0000","last_fullsized":"2023-07-20T09:50:28.738187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:07.387104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738108+0000","last_change":"2023-07-20T09:50:27.693485+0000","last_active":"2023-07-20T09:50:28.738108+0000","last_peered":"2023-07-20T09:50:28.738108+0000","last_clean":"2023-07-20T09:50:28.738108+0000","last_became_active":"2023-07-20T09:50:27.692992+0000","last_became_peered":"2023-07-20T09:50:27.692992+0000","last_unstale":"2023-07-20T09:50:28.738108+0000","last_undegraded":"2023-07-20T09:50:28.738108+0000","last_fullsized":"2023-07-20T09:50:28.738108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738109+0000","last_change":"2023-07-20T09:50:26.385485+0000","last_active":"2023-07-20T09:50:28.738109+0000","last_peered":"2023-07-20T09:50:28.738109+0000","last_clean":"2023-07-20T09:50:28.738109+0000","last_became_active":"2023-07-20T09:50:26.385129+0000","last_became_peered":"2023-07-20T09:50:26.385129+0000","last_unstale":"2023-07-20T09:50:28.738109+0000","last_undegraded":"2023-07-20T09:50:28.738109+0000","last_fullsized":"2023-07-20T09:50:28.738109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:59.210144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272724+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:50:29.272724+0000","last_peered":"2023-07-20T09:50:29.272724+0000","last_clean":"2023-07-20T09:50:29.272724+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:50:29.272724+0000","last_undegraded":"2023-07-20T09:50:29.272724+0000","last_fullsized":"2023-07-20T09:50:29.272724+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:22:52.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.732950+0000","last_change":"2023-07-20T09:50:27.685907+0000","last_active":"2023-07-20T09:50:28.732950+0000","last_peered":"2023-07-20T09:50:28.732950+0000","last_clean":"2023-07-20T09:50:28.732950+0000","last_became_active":"2023-07-20T09:50:27.685597+0000","last_became_peered":"2023-07-20T09:50:27.685597+0000","last_unstale":"2023-07-20T09:50:28.732950+0000","last_undegraded":"2023-07-20T09:50:28.732950+0000","last_fullsized":"2023-07-20T09:50:28.732950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674778+0000","last_change":"2023-07-20T09:50:26.381821+0000","last_active":"2023-07-20T09:50:28.674778+0000","last_peered":"2023-07-20T09:50:28.674778+0000","last_clean":"2023-07-20T09:50:28.674778+0000","last_became_active":"2023-07-20T09:50:26.381592+0000","last_became_peered":"2023-07-20T09:50:26.381592+0000","last_unstale":"2023-07-20T09:50:28.674778+0000","last_undegraded":"2023-07-20T09:50:28.674778+0000","last_fullsized":"2023-07-20T09:50:28.674778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:57.918845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738166+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:50:28.738166+0000","last_peered":"2023-07-20T09:50:28.738166+0000","last_clean":"2023-07-20T09:50:28.738166+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:50:28.738166+0000","last_undegraded":"2023-07-20T09:50:28.738166+0000","last_fullsized":"2023-07-20T09:50:28.738166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:14.378010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674063+0000","last_change":"2023-07-20T09:50:27.700981+0000","last_active":"2023-07-20T09:50:28.674063+0000","last_peered":"2023-07-20T09:50:28.674063+0000","last_clean":"2023-07-20T09:50:28.674063+0000","last_became_active":"2023-07-20T09:50:27.700684+0000","last_became_peered":"2023-07-20T09:50:27.700684+0000","last_unstale":"2023-07-20T09:50:28.674063+0000","last_undegraded":"2023-07-20T09:50:28.674063+0000","last_fullsized":"2023-07-20T09:50:28.674063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:41.382339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.861799+0000","last_change":"2023-07-20T09:50:26.386007+0000","last_active":"2023-07-20T09:50:28.861799+0000","last_peered":"2023-07-20T09:50:28.861799+0000","last_clean":"2023-07-20T09:50:28.861799+0000","last_became_active":"2023-07-20T09:50:26.385678+0000","last_became_peered":"2023-07-20T09:50:26.385678+0000","last_unstale":"2023-07-20T09:50:28.861799+0000","last_undegraded":"2023-07-20T09:50:28.861799+0000","last_fullsized":"2023-07-20T09:50:28.861799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066369+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:50:29.066369+0000","last_peered":"2023-07-20T09:50:29.066369+0000","last_clean":"2023-07-20T09:50:29.066369+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:50:29.066369+0000","last_undegraded":"2023-07-20T09:50:29.066369+0000","last_fullsized":"2023-07-20T09:50:29.066369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:02.151760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679874+0000","last_change":"2023-07-20T09:50:27.680743+0000","last_active":"2023-07-20T09:50:28.679874+0000","last_peered":"2023-07-20T09:50:28.679874+0000","last_clean":"2023-07-20T09:50:28.679874+0000","last_became_active":"2023-07-20T09:50:27.680495+0000","last_became_peered":"2023-07-20T09:50:27.680495+0000","last_unstale":"2023-07-20T09:50:28.679874+0000","last_undegraded":"2023-07-20T09:50:28.679874+0000","last_fullsized":"2023-07-20T09:50:28.679874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:58.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679567+0000","last_change":"2023-07-20T09:50:27.682591+0000","last_active":"2023-07-20T09:50:28.679567+0000","last_peered":"2023-07-20T09:50:28.679567+0000","last_clean":"2023-07-20T09:50:28.679567+0000","last_became_active":"2023-07-20T09:50:27.681420+0000","last_became_peered":"2023-07-20T09:50:27.681420+0000","last_unstale":"2023-07-20T09:50:28.679567+0000","last_undegraded":"2023-07-20T09:50:28.679567+0000","last_fullsized":"2023-07-20T09:50:28.679567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:29.014151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.680046+0000","last_change":"2023-07-20T09:50:26.391865+0000","last_active":"2023-07-20T09:50:28.680046+0000","last_peered":"2023-07-20T09:50:28.680046+0000","last_clean":"2023-07-20T09:50:28.680046+0000","last_became_active":"2023-07-20T09:50:26.389528+0000","last_became_peered":"2023-07-20T09:50:26.389528+0000","last_unstale":"2023-07-20T09:50:28.680046+0000","last_undegraded":"2023-07-20T09:50:28.680046+0000","last_fullsized":"2023-07-20T09:50:28.680046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.738011+0000","last_change":"2023-07-20T09:50:27.693275+0000","last_active":"2023-07-20T09:50:28.738011+0000","last_peered":"2023-07-20T09:50:28.738011+0000","last_clean":"2023-07-20T09:50:28.738011+0000","last_became_active":"2023-07-20T09:50:27.692606+0000","last_became_peered":"2023-07-20T09:50:27.692606+0000","last_unstale":"2023-07-20T09:50:28.738011+0000","last_undegraded":"2023-07-20T09:50:28.738011+0000","last_fullsized":"2023-07-20T09:50:28.738011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:20.973262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.272370+0000","last_change":"2023-07-20T09:50:26.387370+0000","last_active":"2023-07-20T09:50:29.272370+0000","last_peered":"2023-07-20T09:50:29.272370+0000","last_clean":"2023-07-20T09:50:29.272370+0000","last_became_active":"2023-07-20T09:50:26.387057+0000","last_became_peered":"2023-07-20T09:50:26.387057+0000","last_unstale":"2023-07-20T09:50:29.272370+0000","last_undegraded":"2023-07-20T09:50:29.272370+0000","last_fullsized":"2023-07-20T09:50:29.272370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:20:43.018642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679914+0000","last_change":"2023-07-20T09:50:26.385418+0000","last_active":"2023-07-20T09:50:28.679914+0000","last_peered":"2023-07-20T09:50:28.679914+0000","last_clean":"2023-07-20T09:50:28.679914+0000","last_became_active":"2023-07-20T09:50:26.380033+0000","last_became_peered":"2023-07-20T09:50:26.380033+0000","last_unstale":"2023-07-20T09:50:28.679914+0000","last_undegraded":"2023-07-20T09:50:28.679914+0000","last_fullsized":"2023-07-20T09:50:28.679914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:41.338377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674279+0000","last_change":"2023-07-20T09:50:27.704425+0000","last_active":"2023-07-20T09:50:28.674279+0000","last_peered":"2023-07-20T09:50:28.674279+0000","last_clean":"2023-07-20T09:50:28.674279+0000","last_became_active":"2023-07-20T09:50:27.704141+0000","last_became_peered":"2023-07-20T09:50:27.704141+0000","last_unstale":"2023-07-20T09:50:28.674279+0000","last_undegraded":"2023-07-20T09:50:28.674279+0000","last_fullsized":"2023-07-20T09:50:28.674279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:04.123068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733132+0000","last_change":"2023-07-20T09:50:26.379893+0000","last_active":"2023-07-20T09:50:28.733132+0000","last_peered":"2023-07-20T09:50:28.733132+0000","last_clean":"2023-07-20T09:50:28.733132+0000","last_became_active":"2023-07-20T09:50:26.379557+0000","last_became_peered":"2023-07-20T09:50:26.379557+0000","last_unstale":"2023-07-20T09:50:28.733132+0000","last_undegraded":"2023-07-20T09:50:28.733132+0000","last_fullsized":"2023-07-20T09:50:28.733132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.673906+0000","last_change":"2023-07-20T09:50:27.696687+0000","last_active":"2023-07-20T09:50:28.673906+0000","last_peered":"2023-07-20T09:50:28.673906+0000","last_clean":"2023-07-20T09:50:28.673906+0000","last_became_active":"2023-07-20T09:50:27.696327+0000","last_became_peered":"2023-07-20T09:50:27.696327+0000","last_unstale":"2023-07-20T09:50:28.673906+0000","last_undegraded":"2023-07-20T09:50:28.673906+0000","last_fullsized":"2023-07-20T09:50:28.673906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:31.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.066196+0000","last_change":"2023-07-20T09:50:27.678469+0000","last_active":"2023-07-20T09:50:29.066196+0000","last_peered":"2023-07-20T09:50:29.066196+0000","last_clean":"2023-07-20T09:50:29.066196+0000","last_became_active":"2023-07-20T09:50:27.678174+0000","last_became_peered":"2023-07-20T09:50:27.678174+0000","last_unstale":"2023-07-20T09:50:29.066196+0000","last_undegraded":"2023-07-20T09:50:29.066196+0000","last_fullsized":"2023-07-20T09:50:29.066196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:00.450516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674037+0000","last_change":"2023-07-20T09:50:26.386119+0000","last_active":"2023-07-20T09:50:28.674037+0000","last_peered":"2023-07-20T09:50:28.674037+0000","last_clean":"2023-07-20T09:50:28.674037+0000","last_became_active":"2023-07-20T09:50:26.385547+0000","last_became_peered":"2023-07-20T09:50:26.385547+0000","last_unstale":"2023-07-20T09:50:28.674037+0000","last_undegraded":"2023-07-20T09:50:28.674037+0000","last_fullsized":"2023-07-20T09:50:28.674037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:14.790712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733031+0000","last_change":"2023-07-20T09:50:27.686135+0000","last_active":"2023-07-20T09:50:28.733031+0000","last_peered":"2023-07-20T09:50:28.733031+0000","last_clean":"2023-07-20T09:50:28.733031+0000","last_became_active":"2023-07-20T09:50:27.685727+0000","last_became_peered":"2023-07-20T09:50:27.685727+0000","last_unstale":"2023-07-20T09:50:28.733031+0000","last_undegraded":"2023-07-20T09:50:28.733031+0000","last_fullsized":"2023-07-20T09:50:28.733031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.737961+0000","last_change":"2023-07-20T09:50:26.380820+0000","last_active":"2023-07-20T09:50:28.737961+0000","last_peered":"2023-07-20T09:50:28.737961+0000","last_clean":"2023-07-20T09:50:28.737961+0000","last_became_active":"2023-07-20T09:50:26.380492+0000","last_became_peered":"2023-07-20T09:50:26.380492+0000","last_unstale":"2023-07-20T09:50:28.737961+0000","last_undegraded":"2023-07-20T09:50:28.737961+0000","last_fullsized":"2023-07-20T09:50:28.737961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:29.378469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674526+0000","last_change":"2023-07-20T09:50:27.701903+0000","last_active":"2023-07-20T09:50:28.674526+0000","last_peered":"2023-07-20T09:50:28.674526+0000","last_clean":"2023-07-20T09:50:28.674526+0000","last_became_active":"2023-07-20T09:50:27.701530+0000","last_became_peered":"2023-07-20T09:50:27.701530+0000","last_unstale":"2023-07-20T09:50:28.674526+0000","last_undegraded":"2023-07-20T09:50:28.674526+0000","last_fullsized":"2023-07-20T09:50:28.674526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679068+0000","last_change":"2023-07-20T09:50:26.394729+0000","last_active":"2023-07-20T09:50:28.679068+0000","last_peered":"2023-07-20T09:50:28.679068+0000","last_clean":"2023-07-20T09:50:28.679068+0000","last_became_active":"2023-07-20T09:50:26.392883+0000","last_became_peered":"2023-07-20T09:50:26.392883+0000","last_unstale":"2023-07-20T09:50:28.679068+0000","last_undegraded":"2023-07-20T09:50:28.679068+0000","last_fullsized":"2023-07-20T09:50:28.679068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:29.135570+0000","last_change":"2023-07-20T09:50:27.689341+0000","last_active":"2023-07-20T09:50:29.135570+0000","last_peered":"2023-07-20T09:50:29.135570+0000","last_clean":"2023-07-20T09:50:29.135570+0000","last_became_active":"2023-07-20T09:50:27.689034+0000","last_became_peered":"2023-07-20T09:50:27.689034+0000","last_unstale":"2023-07-20T09:50:29.135570+0000","last_undegraded":"2023-07-20T09:50:29.135570+0000","last_fullsized":"2023-07-20T09:50:29.135570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:09.828008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733088+0000","last_change":"2023-07-20T09:50:26.398368+0000","last_active":"2023-07-20T09:50:28.733088+0000","last_peered":"2023-07-20T09:50:28.733088+0000","last_clean":"2023-07-20T09:50:28.733088+0000","last_became_active":"2023-07-20T09:50:26.398065+0000","last_became_peered":"2023-07-20T09:50:26.398065+0000","last_unstale":"2023-07-20T09:50:28.733088+0000","last_undegraded":"2023-07-20T09:50:28.733088+0000","last_fullsized":"2023-07-20T09:50:28.733088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:05.577397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679485+0000","last_change":"2023-07-20T09:50:27.706756+0000","last_active":"2023-07-20T09:50:28.679485+0000","last_peered":"2023-07-20T09:50:28.679485+0000","last_clean":"2023-07-20T09:50:28.679485+0000","last_became_active":"2023-07-20T09:50:27.706507+0000","last_became_peered":"2023-07-20T09:50:27.706507+0000","last_unstale":"2023-07-20T09:50:28.679485+0000","last_undegraded":"2023-07-20T09:50:28.679485+0000","last_fullsized":"2023-07-20T09:50:28.679485+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:06.383357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679270+0000","last_change":"2023-07-20T09:50:26.390120+0000","last_active":"2023-07-20T09:50:28.679270+0000","last_peered":"2023-07-20T09:50:28.679270+0000","last_clean":"2023-07-20T09:50:28.679270+0000","last_became_active":"2023-07-20T09:50:26.389816+0000","last_became_peered":"2023-07-20T09:50:26.389816+0000","last_unstale":"2023-07-20T09:50:28.679270+0000","last_undegraded":"2023-07-20T09:50:28.679270+0000","last_fullsized":"2023-07-20T09:50:28.679270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:16.392146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678908+0000","last_change":"2023-07-20T09:50:27.702550+0000","last_active":"2023-07-20T09:50:28.678908+0000","last_peered":"2023-07-20T09:50:28.678908+0000","last_clean":"2023-07-20T09:50:28.678908+0000","last_became_active":"2023-07-20T09:50:27.702277+0000","last_became_peered":"2023-07-20T09:50:27.702277+0000","last_unstale":"2023-07-20T09:50:28.678908+0000","last_undegraded":"2023-07-20T09:50:28.678908+0000","last_fullsized":"2023-07-20T09:50:28.678908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:53:06.580411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.679629+0000","last_change":"2023-07-20T09:50:26.396668+0000","last_active":"2023-07-20T09:50:28.679629+0000","last_peered":"2023-07-20T09:50:28.679629+0000","last_clean":"2023-07-20T09:50:28.679629+0000","last_became_active":"2023-07-20T09:50:26.396332+0000","last_became_peered":"2023-07-20T09:50:26.396332+0000","last_unstale":"2023-07-20T09:50:28.679629+0000","last_undegraded":"2023-07-20T09:50:28.679629+0000","last_fullsized":"2023-07-20T09:50:28.679629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:02:05.380343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674405+0000","last_change":"2023-07-20T09:50:27.703228+0000","last_active":"2023-07-20T09:50:28.674405+0000","last_peered":"2023-07-20T09:50:28.674405+0000","last_clean":"2023-07-20T09:50:28.674405+0000","last_became_active":"2023-07-20T09:50:27.701601+0000","last_became_peered":"2023-07-20T09:50:27.701601+0000","last_unstale":"2023-07-20T09:50:28.674405+0000","last_undegraded":"2023-07-20T09:50:28.674405+0000","last_fullsized":"2023-07-20T09:50:28.674405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:20.412188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.674510+0000","last_change":"2023-07-20T09:50:26.382031+0000","last_active":"2023-07-20T09:50:28.674510+0000","last_peered":"2023-07-20T09:50:28.674510+0000","last_clean":"2023-07-20T09:50:28.674510+0000","last_became_active":"2023-07-20T09:50:26.381747+0000","last_became_peered":"2023-07-20T09:50:26.381747+0000","last_unstale":"2023-07-20T09:50:28.674510+0000","last_undegraded":"2023-07-20T09:50:28.674510+0000","last_fullsized":"2023-07-20T09:50:28.674510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:12.418268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.678817+0000","last_change":"2023-07-20T09:50:27.683183+0000","last_active":"2023-07-20T09:50:28.678817+0000","last_peered":"2023-07-20T09:50:28.678817+0000","last_clean":"2023-07-20T09:50:28.678817+0000","last_became_active":"2023-07-20T09:50:27.682880+0000","last_became_peered":"2023-07-20T09:50:27.682880+0000","last_unstale":"2023-07-20T09:50:28.678817+0000","last_undegraded":"2023-07-20T09:50:28.678817+0000","last_fullsized":"2023-07-20T09:50:28.678817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:26.358303+0000","last_clean_scrub_stamp":"2023-07-20T09:50:26.358303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:00.213158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-20T09:50:28.733093+0000","last_change":"2023-07-20T09:50:26.391296+0000","last_active":"2023-07-20T09:50:28.733093+0000","last_peered":"2023-07-20T09:50:28.733093+0000","last_clean":"2023-07-20T09:50:28.733093+0000","last_became_active":"2023-07-20T09:50:26.391049+0000","last_became_peered":"2023-07-20T09:50:26.391049+0000","last_unstale":"2023-07-20T09:50:28.733093+0000","last_undegraded":"2023-07-20T09:50:28.733093+0000","last_fullsized":"2023-07-20T09:50:28.733093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:25.355289+0000","last_clean_scrub_stamp":"2023-07-20T09:50:25.355289+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:19.409174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:50:36.758 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-20T09:50:36.759 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-20T09:50:36.759 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-20T09:50:36.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-20T09:50:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 Processor -- start 2023-07-20T09:50:36.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 -- start start 2023-07-20T09:50:36.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf680cd4b0 0x7fbf680cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680d16b0 con 0x7fbf6815cab0 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680d31c0 con 0x7fbf680cd4b0 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf6d38f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680b3520 con 0x7fbf680d0d10 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf66ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbf6815cab0 0x7fbf680d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42692/0 (socket says 172.21.15.82:42692) 2023-07-20T09:50:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf66ffd640 1 -- 172.21.15.82:0/1869710018 learned_addr learned my addr 172.21.15.82:0/1869710018 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf5e7fc640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf677fe640 1 --2- 172.21.15.82:0/1869710018 >> v2:172.21.15.183:3300/0 conn(0x7fbf680cd4b0 0x7fbf680cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686092424 0 0) 0x7fbf680d16b0 con 0x7fbf6815cab0 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf54003530 con 0x7fbf6815cab0 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf677fe640 1 -- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 msgr2=0x7fbf680d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf677fe640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf677fe640 1 -- 172.21.15.82:0/1869710018 >> v1:172.21.15.82:6789/0 conn(0x7fbf6815cab0 legacy=0x7fbf680d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578902488 0 0) 0x7fbf54003530 con 0x7fbf6815cab0 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf677fe640 1 -- 172.21.15.82:0/1869710018 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680d0a10 con 0x7fbf680cd4b0 2023-07-20T09:50:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.898+0000 7fbf5e7fc640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:36.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf677fe640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf680cd940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009d90 tx=0x7fbf6001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f933651357c07 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58001680 con 0x7fbf680cd4b0 2023-07-20T09:50:36.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf600a5640 con 0x7fbf680cd4b0 2023-07-20T09:50:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf667fc640 1 -- 172.21.15.82:0/1869710018 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600a59d0 con 0x7fbf680cd4b0 2023-07-20T09:50:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 -- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 msgr2=0x7fbf680cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf680cd940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009d90 tx=0x7fbf6001c840 comp rx=0 tx=0).stop 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 -- 172.21.15.82:0/1869710018 shutdown_connections 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf680cd940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/1869710018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 -- 172.21.15.82:0/1869710018 >> 172.21.15.82:0/1869710018 conn(0x7fbf6808c120 msgr2=0x7fbf6809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 -- 172.21.15.82:0/1869710018 shutdown_connections 2023-07-20T09:50:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.902+0000 7fbf6d38f640 1 -- 172.21.15.82:0/1869710018 wait complete. 2023-07-20T09:50:36.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 Processor -- start 2023-07-20T09:50:36.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- start start 2023-07-20T09:50:36.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf68157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680b7b30 con 0x7fbf6815cab0 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680c8ce0 con 0x7fbf680cd4b0 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680c8f60 con 0x7fbf680d0d10 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53606/0 (socket says 172.21.15.82:53606) 2023-07-20T09:50:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 -- 172.21.15.82:0/270031258 learned_addr learned my addr 172.21.15.82:0/270031258 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf66ffd640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf68157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf5e7fc640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 -- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 msgr2=0x7fbf680c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 -- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 msgr2=0x7fbf68157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf68157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 -- 172.21.15.82:0/270031258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009420 con 0x7fbf6815cab0 2023-07-20T09:50:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf677fe640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf600b0040 tx=0x7fbf600195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600ad850 con 0x7fbf6815cab0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf600ad9b0 con 0x7fbf6815cab0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf60009a70 con 0x7fbf6815cab0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600add60 con 0x7fbf6815cab0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.906+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf680b7750 con 0x7fbf6815cab0 2023-07-20T09:50:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf680b7c70 con 0x7fbf6815cab0 2023-07-20T09:50:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf600b4050 con 0x7fbf6815cab0 2023-07-20T09:50:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf5ffff640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 0x7fbf48068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf6011ea50 con 0x7fbf6815cab0 2023-07-20T09:50:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf66ffd640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 0x7fbf48068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:36.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.910+0000 7fbf66ffd640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 0x7fbf48068740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005890 tx=0x7fbf58001660 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:36.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:36.914+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf600ebf70 con 0x7fbf6815cab0 2023-07-20T09:50:37.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.090+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf68073c70 con 0x7fbf6815cab0 2023-07-20T09:50:37.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.090+0000 7fbf5ffff640 1 -- 172.21.15.82:0/270031258 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbf600b2040 con 0x7fbf6815cab0 2023-07-20T09:50:37.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:37.130 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-20T09:50:37.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 msgr2=0x7fbf48068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 0x7fbf48068740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbf58005890 tx=0x7fbf58001660 comp rx=0 tx=0).stop 2023-07-20T09:50:37.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 msgr2=0x7fbf68155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf600b0040 tx=0x7fbf600195e0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 shutdown_connections 2023-07-20T09:50:37.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fbf48066280 0x7fbf48068740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf6815cab0 0x7fbf68155e20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf680d0d10 0x7fbf680c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 --2- 172.21.15.82:0/270031258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf680cd4b0 0x7fbf68157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 >> 172.21.15.82:0/270031258 conn(0x7fbf6808c120 msgr2=0x7fbf6806a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 shutdown_connections 2023-07-20T09:50:37.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.094+0000 7fbf6d38f640 1 -- 172.21.15.82:0/270031258 wait complete. 2023-07-20T09:50:37.149 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-20T09:50:37.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.250+0000 7f7fdae34640 1 Processor -- start 2023-07-20T09:50:37.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.250+0000 7f7fdae34640 1 -- start start 2023-07-20T09:50:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fdae34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fdae34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd40b2060 0x7f7fd40b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fdae34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd40b06c0 con 0x7f7fd415a8e0 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fdae34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd40b3160 con 0x7f7fd40b2060 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fdae34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40b12a0 con 0x7f7fd40afda0 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd40b2060 0x7f7fd40b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd8bd0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd40b2060 0x7f7fd40b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58876/0 (socket says 172.21.15.82:58876) 2023-07-20T09:50:37.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 -- 172.21.15.82:0/2410176461 learned_addr learned my addr 172.21.15.82:0/2410176461 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 -- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 msgr2=0x7f7fd40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 --2- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd40ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 -- 172.21.15.82:0/2410176461 >> v1:172.21.15.183:6789/0 conn(0x7f7fd415a8e0 legacy=0x7f7fd40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.254+0000 7f7fd93d1640 1 -- 172.21.15.82:0/2410176461 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40b1580 con 0x7f7fd40b2060 2023-07-20T09:50:37.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fd93d1640 1 --2- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40b0180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009870 tx=0x7f7fcc01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2b9a804aaa8a9e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fd37fe640 1 -- 172.21.15.82:0/2410176461 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0ab5f0 con 0x7f7fd40b2060 2023-07-20T09:50:37.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fd37fe640 1 -- 172.21.15.82:0/2410176461 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0ab750 con 0x7f7fd40b2060 2023-07-20T09:50:37.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fd37fe640 1 -- 172.21.15.82:0/2410176461 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0abae0 con 0x7f7fd40b2060 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 msgr2=0x7f7fd40b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 --2- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40b0180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc009870 tx=0x7f7fcc01c3f0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- 172.21.15.82:0/2410176461 shutdown_connections 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 --2- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40b0180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 --2- 172.21.15.82:0/2410176461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- 172.21.15.82:0/2410176461 >> 172.21.15.82:0/2410176461 conn(0x7f7fd40cada0 msgr2=0x7f7fd40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- 172.21.15.82:0/2410176461 shutdown_connections 2023-07-20T09:50:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- 172.21.15.82:0/2410176461 wait complete. 2023-07-20T09:50:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 Processor -- start 2023-07-20T09:50:37.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.258+0000 7f7fdae34640 1 -- start start 2023-07-20T09:50:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd4155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40c82e0 con 0x7f7fd415a8e0 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd415c3e0 con 0x7f7fd40b2060 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd415b760 con 0x7f7fd40afda0 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53618/0 (socket says 172.21.15.82:53618) 2023-07-20T09:50:37.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 -- 172.21.15.82:0/3923791937 learned_addr learned my addr 172.21.15.82:0/3923791937 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:37.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd8bd0640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd4155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd3fff640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 -- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 msgr2=0x7f7fd4155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd4155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 -- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 msgr2=0x7f7fd40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 -- 172.21.15.82:0/3923791937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0094d0 con 0x7f7fd415a8e0 2023-07-20T09:50:37.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd93d1640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ad040 tx=0x7f7fcc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0be5f0 con 0x7f7fd415a8e0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0be770 con 0x7f7fd415a8e0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd415ba40 con 0x7f7fd415a8e0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0beb20 con 0x7f7fd415a8e0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd415c000 con 0x7f7fd415a8e0 2023-07-20T09:50:37.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd415c520 con 0x7f7fd415a8e0 2023-07-20T09:50:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.262+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fcc0b43f0 con 0x7f7fd415a8e0 2023-07-20T09:50:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.266+0000 7f7fd17fa640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 0x7f7fc0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.266+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fcc0a8050 con 0x7f7fd415a8e0 2023-07-20T09:50:37.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.266+0000 7f7fd8bd0640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 0x7f7fc0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.266+0000 7f7fd8bd0640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 0x7f7fc0068740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009af0 tx=0x7f7fc4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.270+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fd415c520 con 0x7f7fd415a8e0 2023-07-20T09:50:37.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.418+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd415c520 con 0x7f7fd415a8e0 2023-07-20T09:50:37.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.418+0000 7f7fd17fa640 1 -- 172.21.15.82:0/3923791937 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f7fd415c520 con 0x7f7fd415a8e0 2023-07-20T09:50:37.456 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:37.456 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:37.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.418+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 msgr2=0x7f7fc0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.418+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 0x7f7fc0068740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009af0 tx=0x7f7fc4008040 comp rx=0 tx=0).stop 2023-07-20T09:50:37.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 msgr2=0x7f7fd406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0ad040 tx=0x7f7fcc01ac30 comp rx=0 tx=0).stop 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 shutdown_connections 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fc0066280 0x7f7fc0068740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd415a8e0 0x7f7fd406ccc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd40b2060 0x7f7fd40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 --2- 172.21.15.82:0/3923791937 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd40afda0 0x7f7fd4155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 >> 172.21.15.82:0/3923791937 conn(0x7f7fd40cada0 msgr2=0x7f7fd4156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 shutdown_connections 2023-07-20T09:50:37.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.422+0000 7f7fdae34640 1 -- 172.21.15.82:0/3923791937 wait complete. 2023-07-20T09:50:37.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:37.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:37.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 Processor -- start 2023-07-20T09:50:37.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 -- start start 2023-07-20T09:50:37.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f2120160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200ce4f0 con 0x7f212006c120 2023-07-20T09:50:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200d0970 con 0x7f212006ab10 2023-07-20T09:50:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f2125137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2120160e20 con 0x7f21201602b0 2023-07-20T09:50:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211ed9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f212006c120 0x7f21200cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42704/0 (socket says 172.21.15.82:42704) 2023-07-20T09:50:37.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211ed9d640 1 -- 172.21.15.82:0/3633595135 learned_addr learned my addr 172.21.15.82:0/3633595135 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:37.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211659c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f2120160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926187873 0 0) 0x7f21200ce4f0 con 0x7f212006c120 2023-07-20T09:50:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f210c003530 con 0x7f212006c120 2023-07-20T09:50:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238281002 0 0) 0x7f210c003530 con 0x7f212006c120 2023-07-20T09:50:37.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 msgr2=0x7f2120160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f2120160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 >> v1:172.21.15.183:6789/0 conn(0x7f212006ab10 legacy=0x7f212006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200cd300 con 0x7f212006c120 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2110001680 con 0x7f212006c120 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 >> v1:172.21.15.82:6789/0 conn(0x7f212006c120 legacy=0x7f21200cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c003a20 0x7f210c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f210c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f210c004d10 0x7f210c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120160e20 con 0x7f210c004d10 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c00bba0 con 0x7f210c003a20 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c00bd60 con 0x7f21201602b0 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211f59e640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f210c004d10 0x7f210c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211ed9d640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c003a20 0x7f210c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.582+0000 7f211659c640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f210c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 -- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 msgr2=0x7f210c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21201602b0 0x7f210c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 -- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c003a20 msgr2=0x7f210c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c003a20 0x7f210c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 -- 172.21.15.82:0/3633595135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c003530 con 0x7f210c004d10 2023-07-20T09:50:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f210c004d10 0x7f210c005190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2118001e70 tx=0x7f211801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6d6b65c9969e59 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118003b80 con 0x7f210c004d10 2023-07-20T09:50:37.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118003ce0 con 0x7f210c004d10 2023-07-20T09:50:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211e59c640 1 -- 172.21.15.82:0/3633595135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180052c0 con 0x7f210c004d10 2023-07-20T09:50:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f2125137640 1 -- 172.21.15.82:0/3633595135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f210c004d10 msgr2=0x7f210c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f2125137640 1 --2- 172.21.15.82:0/3633595135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f210c004d10 0x7f210c005190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2118001e70 tx=0x7f211801c760 comp rx=0 tx=0).stop 2023-07-20T09:50:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f211f59e640 1 -- 172.21.15.82:0/3633595135 reap_dead start 2023-07-20T09:50:37.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f2125137640 1 -- 172.21.15.82:0/3633595135 shutdown_connections 2023-07-20T09:50:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f2125137640 1 -- 172.21.15.82:0/3633595135 >> 172.21.15.82:0/3633595135 conn(0x7f212008c0a0 msgr2=0x7f212009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.586+0000 7f2125137640 1 -- 172.21.15.82:0/3633595135 shutdown_connections 2023-07-20T09:50:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 -- 172.21.15.82:0/3633595135 wait complete. 2023-07-20T09:50:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 Processor -- start 2023-07-20T09:50:37.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 -- start start 2023-07-20T09:50:37.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c004d10 0x7f21200c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 0x7f212014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200c7200 con 0x7f21200c6840 2023-07-20T09:50:37.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b3fb0 con 0x7f210c004d10 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f2125137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21200b4290 con 0x7f212014f660 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53642/0 (socket says 172.21.15.82:53642) 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 -- 172.21.15.82:0/3094876754 learned_addr learned my addr 172.21.15.82:0/3094876754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211ed9d640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c004d10 0x7f21200c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211f59e640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 0x7f212014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 -- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 msgr2=0x7f212014fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 0x7f212014fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 -- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c004d10 msgr2=0x7f21200c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c004d10 0x7f21200c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211659c640 1 -- 172.21.15.82:0/3094876754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200b4570 con 0x7f21200c6840 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.590+0000 7f211f59e640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 0x7f212014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f211659c640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21080119d0 tx=0x7f2108011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800fb50 con 0x7f21200c6840 2023-07-20T09:50:37.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800fcb0 con 0x7f21200c6840 2023-07-20T09:50:37.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108014440 con 0x7f21200c6840 2023-07-20T09:50:37.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21200b4850 con 0x7f21200c6840 2023-07-20T09:50:37.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21200b4d70 con 0x7f21200c6840 2023-07-20T09:50:37.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212004da30 con 0x7f21200c6840 2023-07-20T09:50:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f21080145a0 con 0x7f21200c6840 2023-07-20T09:50:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 0x7f2100068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.594+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2108084510 con 0x7f21200c6840 2023-07-20T09:50:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.598+0000 7f211ed9d640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 0x7f2100068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.598+0000 7f211ed9d640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 0x7f2100068770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21100078f0 tx=0x7f2110001520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.598+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21080554d0 con 0x7f21200c6840 2023-07-20T09:50:37.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21200cee40 con 0x7f21200c6840 2023-07-20T09:50:37.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2117fff640 1 -- 172.21.15.82:0/3094876754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2108055060 con 0x7f21200c6840 2023-07-20T09:50:37.787 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:37.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 msgr2=0x7f2100068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 0x7f2100068770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21100078f0 tx=0x7f2110001520 comp rx=0 tx=0).stop 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 msgr2=0x7f21200c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21080119d0 tx=0x7f2108011e90 comp rx=0 tx=0).stop 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 shutdown_connections 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f21000662b0 0x7f2100068770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f212014f660 0x7f212014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21200c6840 0x7f21200c6cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 --2- 172.21.15.82:0/3094876754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f210c004d10 0x7f21200c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 >> 172.21.15.82:0/3094876754 conn(0x7f212008c0a0 msgr2=0x7f21200afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 shutdown_connections 2023-07-20T09:50:37.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.750+0000 7f2125137640 1 -- 172.21.15.82:0/3094876754 wait complete. 2023-07-20T09:50:37.807 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:37.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 Processor -- start 2023-07-20T09:50:37.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 -- start start 2023-07-20T09:50:37.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f828006f710 0x7f828006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8280070030 con 0x7f828015a6f0 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8280071950 con 0x7f82800ca5a0 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f82869d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828015bad0 con 0x7f828006f710 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8284f72640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f828015a6f0 0x7f82800c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42720/0 (socket says 172.21.15.82:42720) 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8284f72640 1 -- 172.21.15.82:0/3134555062 learned_addr learned my addr 172.21.15.82:0/3134555062 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827ffff640 1 --2- 172.21.15.82:0/3134555062 >> v2:172.21.15.183:3300/0 conn(0x7f828006f710 0x7f828006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611500914 0 0) 0x7f8280070030 con 0x7f828015a6f0 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c003530 con 0x7f828015a6f0 2023-07-20T09:50:37.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992774921 0 0) 0x7f826c003530 con 0x7f828015a6f0 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 >> v2:172.21.15.183:3300/0 conn(0x7f828006f710 msgr2=0x7f828006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 --2- 172.21.15.82:0/3134555062 >> v2:172.21.15.183:3300/0 conn(0x7f828006f710 0x7f828006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 >> v1:172.21.15.183:6789/0 conn(0x7f82800ca5a0 legacy=0x7f828015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828015b230 con 0x7f828015a6f0 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f8278001a00 con 0x7f828015a6f0 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 >> v1:172.21.15.82:6789/0 conn(0x7f828015a6f0 legacy=0x7f82800c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f826c0039f0 0x7f826c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f826c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f826c005190 0x7f826c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828015bad0 con 0x7f826c0047d0 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00c0c0 con 0x7f826c005190 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c00c280 con 0x7f826c0039f0 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f826c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f827ffff640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f826c0039f0 0x7f826c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8284f72640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f826c005190 0x7f826c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 -- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f826c0039f0 msgr2=0x7f826c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f826c0039f0 0x7f826c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 -- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f826c005190 msgr2=0x7f826c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f826c005190 0x7f826c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8277fff640 1 -- 172.21.15.82:0/3134555062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c003530 con 0x7f826c0047d0 2023-07-20T09:50:37.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.914+0000 7f8284f72640 1 -- 172.21.15.82:0/3134555062 reap_dead start 2023-07-20T09:50:37.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f8277fff640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f826c004c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8268001750 tx=0x7f826801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178652a889240f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82680052d0 con 0x7f826c0047d0 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680a7050 con 0x7f826c0047d0 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f827f7fe640 1 -- 172.21.15.82:0/3134555062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268003600 con 0x7f826c0047d0 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 -- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 msgr2=0x7f826c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f826c004c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8268001750 tx=0x7f826801c3a0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 -- 172.21.15.82:0/3134555062 shutdown_connections 2023-07-20T09:50:37.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 --2- 172.21.15.82:0/3134555062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f826c004c50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 -- 172.21.15.82:0/3134555062 >> 172.21.15.82:0/3134555062 conn(0x7f82800cad50 msgr2=0x7f82800cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 -- 172.21.15.82:0/3134555062 shutdown_connections 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.918+0000 7f82869d5640 1 -- 172.21.15.82:0/3134555062 wait complete. 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 Processor -- start 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 -- start start 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82800b16d0 0x7f82800b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82801f2200 0x7f82801f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828014cc10 con 0x7f826c0047d0 2023-07-20T09:50:37.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82800b3650 con 0x7f82801f2200 2023-07-20T09:50:37.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280159b60 con 0x7f82800b16d0 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53662/0 (socket says 172.21.15.82:53662) 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 -- 172.21.15.82:0/3090936547 learned_addr learned my addr 172.21.15.82:0/3090936547 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f8277fff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82800b16d0 0x7f82800b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f8284f72640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82801f2200 0x7f82801f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 -- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82800b16d0 msgr2=0x7f82800b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82800b16d0 0x7f82800b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 -- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82801f2200 msgr2=0x7f82801f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:37.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82801f2200 0x7f82801f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:37.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 -- 172.21.15.82:0/3090936547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800b1c00 con 0x7f826c0047d0 2023-07-20T09:50:37.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827ffff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8270011930 tx=0x7f8270011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700095b0 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270004240 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000f880 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.922+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82800b1ee0 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82800b24a0 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800c4f80 con 0x7f826c0047d0 2023-07-20T09:50:37.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f827000f9e0 con 0x7f826c0047d0 2023-07-20T09:50:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f827d7fa640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 0x7f8260068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8270084380 con 0x7f826c0047d0 2023-07-20T09:50:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f8277fff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 0x7f8260068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.926+0000 7f8277fff640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 0x7f8260068770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82800caa50 tx=0x7f82680011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:37.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:37.930+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8270051760 con 0x7f826c0047d0 2023-07-20T09:50:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f828004da30 con 0x7f826c0047d0 2023-07-20T09:50:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f827d7fa640 1 -- 172.21.15.82:0/3090936547 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8270054d80 con 0x7f826c0047d0 2023-07-20T09:50:38.115 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 msgr2=0x7f8260068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 0x7f8260068770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82800caa50 tx=0x7f82680011a0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 msgr2=0x7f828014c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8270011930 tx=0x7f8270011df0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 shutdown_connections 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f82600662b0 0x7f8260068770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82801f2200 0x7f82801f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82800b16d0 0x7f82800b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 --2- 172.21.15.82:0/3090936547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f826c0047d0 0x7f828014c6d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 >> 172.21.15.82:0/3090936547 conn(0x7f82800cad50 msgr2=0x7f82800acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 shutdown_connections 2023-07-20T09:50:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.078+0000 7f82869d5640 1 -- 172.21.15.82:0/3090936547 wait complete. 2023-07-20T09:50:38.135 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.238+0000 7fd62e6d8640 1 Processor -- start 2023-07-20T09:50:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 -- start start 2023-07-20T09:50:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd628159450 0x7fd62815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd628159830 0x7fd6280cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280cc8d0 con 0x7fd6280cc3e0 2023-07-20T09:50:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280cce90 con 0x7fd628159450 2023-07-20T09:50:38.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62e6d8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280ccbb0 con 0x7fd628159830 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd627fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd628159450 0x7fd62815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62cc75640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6280cc3e0 0x7fd6280afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42736/0 (socket says 172.21.15.82:42736) 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd62cc75640 1 -- 172.21.15.82:0/1444158205 learned_addr learned my addr 172.21.15.82:0/1444158205 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd6277fe640 1 --2- 172.21.15.82:0/1444158205 >> v2:172.21.15.183:3300/0 conn(0x7fd628159830 0x7fd6280cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd627fff640 1 -- 172.21.15.82:0/1444158205 >> v2:172.21.15.183:3300/0 conn(0x7fd628159830 msgr2=0x7fd6280cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd627fff640 1 --2- 172.21.15.82:0/1444158205 >> v2:172.21.15.183:3300/0 conn(0x7fd628159830 0x7fd6280cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd627fff640 1 -- 172.21.15.82:0/1444158205 >> v1:172.21.15.82:6789/0 conn(0x7fd6280cc3e0 legacy=0x7fd6280afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd627fff640 1 -- 172.21.15.82:0/1444158205 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd628159cc0 con 0x7fd628159450 2023-07-20T09:50:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.242+0000 7fd626ffd640 1 -- 172.21.15.82:0/1444158205 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856163478 0 0) 0x7fd6280cc8d0 con 0x7fd6280cc3e0 2023-07-20T09:50:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd627fff640 1 --2- 172.21.15.82:0/1444158205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628159450 0x7fd62815a4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd62815e190 tx=0x7fd61801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47057638533e320 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd626ffd640 1 -- 172.21.15.82:0/1444158205 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6180ab610 con 0x7fd628159450 2023-07-20T09:50:38.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd626ffd640 1 -- 172.21.15.82:0/1444158205 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6180ab770 con 0x7fd628159450 2023-07-20T09:50:38.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd626ffd640 1 -- 172.21.15.82:0/1444158205 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6180abb00 con 0x7fd628159450 2023-07-20T09:50:38.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1444158205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628159450 msgr2=0x7fd62815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1444158205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628159450 0x7fd62815a4c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd62815e190 tx=0x7fd61801c430 comp rx=0 tx=0).stop 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1444158205 shutdown_connections 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1444158205 >> v2:172.21.15.183:3300/0 conn(0x7fd628159830 0x7fd6280cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1444158205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd628159450 0x7fd62815a4c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1444158205 >> 172.21.15.82:0/1444158205 conn(0x7fd6280cad50 msgr2=0x7fd6280cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1444158205 shutdown_connections 2023-07-20T09:50:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1444158205 wait complete. 2023-07-20T09:50:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.246+0000 7fd62e6d8640 1 Processor -- start 2023-07-20T09:50:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- start start 2023-07-20T09:50:38.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd628159450 0x7fd6281460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd628146600 0x7fd6280c6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280c6980 con 0x7fd6280cc3e0 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd628146a90 con 0x7fd628159450 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280c5d70 con 0x7fd628146600 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53686/0 (socket says 172.21.15.82:53686) 2023-07-20T09:50:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 -- 172.21.15.82:0/1570239862 learned_addr learned my addr 172.21.15.82:0/1570239862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd6277fe640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd628159450 0x7fd6281460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62cc75640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd628146600 0x7fd6280c6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 -- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd628146600 msgr2=0x7fd6280c6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd628146600 0x7fd6280c6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 -- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd628159450 msgr2=0x7fd6281460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd628159450 0x7fd6281460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 -- 172.21.15.82:0/1570239862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618009420 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd627fff640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd618019040 tx=0x7fd61801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618004220 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6180b9070 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6280c6050 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd618003620 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6280c6610 con 0x7fd6280cc3e0 2023-07-20T09:50:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.250+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6280b0bc0 con 0x7fd6280cc3e0 2023-07-20T09:50:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.254+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd618003780 con 0x7fd6280cc3e0 2023-07-20T09:50:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.254+0000 7fd624ff9640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 0x7fd614068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.254+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6180bb070 con 0x7fd6280cc3e0 2023-07-20T09:50:38.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.254+0000 7fd6277fe640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 0x7fd614068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.254+0000 7fd6277fe640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 0x7fd614068770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6280c1540 tx=0x7fd61c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.258+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6180ebb00 con 0x7fd6280cc3e0 2023-07-20T09:50:38.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.402+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd62804da30 con 0x7fd6280cc3e0 2023-07-20T09:50:38.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.402+0000 7fd624ff9640 1 -- 172.21.15.82:0/1570239862 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6180ef120 con 0x7fd6280cc3e0 2023-07-20T09:50:38.441 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 msgr2=0x7fd614068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 0x7fd614068770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd6280c1540 tx=0x7fd61c008040 comp rx=0 tx=0).stop 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 msgr2=0x7fd6280b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd618019040 tx=0x7fd61801ac70 comp rx=0 tx=0).stop 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 shutdown_connections 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd6140662b0 0x7fd614068770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd628146600 0x7fd6280c6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd628159450 0x7fd6281460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 --2- 172.21.15.82:0/1570239862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280cc3e0 0x7fd6280b3280 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 >> 172.21.15.82:0/1570239862 conn(0x7fd6280cad50 msgr2=0x7fd628158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 shutdown_connections 2023-07-20T09:50:38.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.406+0000 7fd62e6d8640 1 -- 172.21.15.82:0/1570239862 wait complete. 2023-07-20T09:50:38.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:38.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 Processor -- start 2023-07-20T09:50:38.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 -- start start 2023-07-20T09:50:38.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b8c159450 0x7f2b8c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0cc8d0 con 0x7f2b8c0afd50 2023-07-20T09:50:38.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c0ccbb0 con 0x7f2b8c159830 2023-07-20T09:50:38.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b93a9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c0cce90 con 0x7f2b8c159450 2023-07-20T09:50:38.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b92039640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2b8c0afd50 0x7f2b8c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42750/0 (socket says 172.21.15.82:42750) 2023-07-20T09:50:38.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b92039640 1 -- 172.21.15.82:0/2834700952 learned_addr learned my addr 172.21.15.82:0/2834700952 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:38.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b91838640 1 --2- 172.21.15.82:0/2834700952 >> v2:172.21.15.82:3300/0 conn(0x7f2b8c159450 0x7f2b8c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b91838640 1 -- 172.21.15.82:0/2834700952 >> v1:172.21.15.183:6789/0 conn(0x7f2b8c159830 legacy=0x7f2b8c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b91838640 1 -- 172.21.15.82:0/2834700952 >> v1:172.21.15.82:6789/0 conn(0x7f2b8c0afd50 legacy=0x7f2b8c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b91838640 1 -- 172.21.15.82:0/2834700952 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c159cc0 con 0x7f2b8c159450 2023-07-20T09:50:38.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.566+0000 7f2b90836640 1 -- 172.21.15.82:0/2834700952 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543832149 0 0) 0x7f2b8c0cc8d0 con 0x7f2b8c0afd50 2023-07-20T09:50:38.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b91838640 1 --2- 172.21.15.82:0/2834700952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c159450 0x7f2b8c15a4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097c0 tx=0x7f2b8801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314cb1797efd2f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b90836640 1 -- 172.21.15.82:0/2834700952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880a7070 con 0x7f2b8c159450 2023-07-20T09:50:38.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b90836640 1 -- 172.21.15.82:0/2834700952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b880ab430 con 0x7f2b8c159450 2023-07-20T09:50:38.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b90836640 1 -- 172.21.15.82:0/2834700952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880ab7c0 con 0x7f2b8c159450 2023-07-20T09:50:38.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 -- 172.21.15.82:0/2834700952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c159450 msgr2=0x7f2b8c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/2834700952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c159450 0x7f2b8c15a4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097c0 tx=0x7f2b8801c450 comp rx=0 tx=0).stop 2023-07-20T09:50:38.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 -- 172.21.15.82:0/2834700952 shutdown_connections 2023-07-20T09:50:38.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/2834700952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c159450 0x7f2b8c15a4c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 -- 172.21.15.82:0/2834700952 >> 172.21.15.82:0/2834700952 conn(0x7f2b8c0cad50 msgr2=0x7f2b8c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 -- 172.21.15.82:0/2834700952 shutdown_connections 2023-07-20T09:50:38.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.570+0000 7f2b93a9c640 1 -- 172.21.15.82:0/2834700952 wait complete. 2023-07-20T09:50:38.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 Processor -- start 2023-07-20T09:50:38.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- start start 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8c159450 0x7f2b8c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 0x7f2b8c1684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c1575b0 con 0x7f2b8c0afd50 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c157890 con 0x7f2b8c159450 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c157b70 con 0x7f2b8c0c07f0 2023-07-20T09:50:38.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53698/0 (socket says 172.21.15.82:53698) 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 -- 172.21.15.82:0/1875376352 learned_addr learned my addr 172.21.15.82:0/1875376352 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91037640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8c159450 0x7f2b8c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b92039640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 0x7f2b8c1684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 -- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 msgr2=0x7f2b8c1684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 0x7f2b8c1684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 -- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8c159450 msgr2=0x7f2b8c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8c159450 0x7f2b8c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 -- 172.21.15.82:0/1875376352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009420 con 0x7f2b8c0afd50 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b92039640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 0x7f2b8c1684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b91838640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b880ad040 tx=0x7f2b8801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004220 con 0x7f2b8c0afd50 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b880b9070 con 0x7f2b8c0afd50 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c157e50 con 0x7f2b8c0afd50 2023-07-20T09:50:38.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88003620 con 0x7f2b8c0afd50 2023-07-20T09:50:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.574+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c1572a0 con 0x7f2b8c0afd50 2023-07-20T09:50:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c158370 con 0x7f2b8c0afd50 2023-07-20T09:50:38.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b88003780 con 0x7f2b8c0afd50 2023-07-20T09:50:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b827fc640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 0x7f2b70068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b880bb070 con 0x7f2b8c0afd50 2023-07-20T09:50:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b91037640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 0x7f2b70068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.578+0000 7f2b91037640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 0x7f2b70068740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c155370 tx=0x7f2b7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.582+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b8c158370 con 0x7f2b8c0afd50 2023-07-20T09:50:38.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b8c158370 con 0x7f2b8c0afd50 2023-07-20T09:50:38.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b827fc640 1 -- 172.21.15.82:0/1875376352 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b8c158370 con 0x7f2b8c0afd50 2023-07-20T09:50:38.767 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:38.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 msgr2=0x7f2b70068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 0x7f2b70068740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c155370 tx=0x7f2b7c009040 comp rx=0 tx=0).stop 2023-07-20T09:50:38.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 msgr2=0x7f2b8c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2b880ad040 tx=0x7f2b8801ac90 comp rx=0 tx=0).stop 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 shutdown_connections 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2b70066280 0x7f2b70068740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b8c0c07f0 0x7f2b8c1684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b8c159450 0x7f2b8c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 --2- 172.21.15.82:0/1875376352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b8c0afd50 0x7f2b8c0af380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.730+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 >> 172.21.15.82:0/1875376352 conn(0x7f2b8c0cad50 msgr2=0x7f2b8c1558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.734+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 shutdown_connections 2023-07-20T09:50:38.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.734+0000 7f2b93a9c640 1 -- 172.21.15.82:0/1875376352 wait complete. 2023-07-20T09:50:38.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:50:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 Processor -- start 2023-07-20T09:50:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 -- start start 2023-07-20T09:50:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 0x7f94280d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94280d0d10 0x7f94280d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280d16b0 con 0x7f94280cf110 2023-07-20T09:50:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94280d31c0 con 0x7f94280d0d10 2023-07-20T09:50:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f942d540640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280b3520 con 0x7f942815cab0 2023-07-20T09:50:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f94277fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94280cf110 0x7f94280cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42766/0 (socket says 172.21.15.82:42766) 2023-07-20T09:50:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f94277fe640 1 -- 172.21.15.82:0/1058902028 learned_addr learned my addr 172.21.15.82:0/1058902028 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f941e7fc640 1 --2- 172.21.15.82:0/1058902028 >> v2:172.21.15.82:3300/0 conn(0x7f94280d0d10 0x7f94280d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f9426ffd640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 0x7f94280d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f941e7fc640 1 -- 172.21.15.82:0/1058902028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 msgr2=0x7f94280d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f941e7fc640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 0x7f94280d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f941e7fc640 1 -- 172.21.15.82:0/1058902028 >> v1:172.21.15.82:6789/0 conn(0x7f94280cf110 legacy=0x7f94280cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f941e7fc640 1 -- 172.21.15.82:0/1058902028 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280b2910 con 0x7f94280d0d10 2023-07-20T09:50:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f94267fc640 1 -- 172.21.15.82:0/1058902028 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874235835 0 0) 0x7f94280d16b0 con 0x7f94280cf110 2023-07-20T09:50:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.890+0000 7f9426ffd640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 0x7f94280d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f941e7fc640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94280d0d10 0x7f94280d1170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9410009d90 tx=0x7f941001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82c7a26bf60b281 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f94267fc640 1 -- 172.21.15.82:0/1058902028 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94100a59e0 con 0x7f94280d0d10 2023-07-20T09:50:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f94267fc640 1 -- 172.21.15.82:0/1058902028 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94100a5b40 con 0x7f94280d0d10 2023-07-20T09:50:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f94267fc640 1 -- 172.21.15.82:0/1058902028 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94100ad440 con 0x7f94280d0d10 2023-07-20T09:50:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 -- 172.21.15.82:0/1058902028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94280d0d10 msgr2=0x7f94280d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94280d0d10 0x7f94280d1170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9410009d90 tx=0x7f941001c920 comp rx=0 tx=0).stop 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 -- 172.21.15.82:0/1058902028 shutdown_connections 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94280d0d10 0x7f94280d1170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 --2- 172.21.15.82:0/1058902028 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f942815cab0 0x7f94280d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 -- 172.21.15.82:0/1058902028 >> 172.21.15.82:0/1058902028 conn(0x7f942808c120 msgr2=0x7f942809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 -- 172.21.15.82:0/1058902028 shutdown_connections 2023-07-20T09:50:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.894+0000 7f942d540640 1 -- 172.21.15.82:0/1058902028 wait complete. 2023-07-20T09:50:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 Processor -- start 2023-07-20T09:50:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- start start 2023-07-20T09:50:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94280cf110 0x7f94280cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94280d0d10 0x7f94280c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94280b67b0 con 0x7f942815cab0 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428157380 con 0x7f94280d0d10 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280b6a50 con 0x7f94280cf110 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53712/0 (socket says 172.21.15.82:53712) 2023-07-20T09:50:38.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 -- 172.21.15.82:0/3234716327 learned_addr learned my addr 172.21.15.82:0/3234716327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:38.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f9426ffd640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94280cf110 0x7f94280cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f941e7fc640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94280d0d10 0x7f94280c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 -- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94280cf110 msgr2=0x7f94280cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94280cf110 0x7f94280cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 -- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94280d0d10 msgr2=0x7f94280c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94280d0d10 0x7f94280c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 -- 172.21.15.82:0/3234716327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410009a70 con 0x7f942815cab0 2023-07-20T09:50:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f94277fe640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f942000c3c0 tx=0x7f942000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200074e0 con 0x7f942815cab0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420007640 con 0x7f942815cab0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420004a30 con 0x7f942815cab0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94280b6d30 con 0x7f942815cab0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.898+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942806b300 con 0x7f942815cab0 2023-07-20T09:50:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9428073c70 con 0x7f942815cab0 2023-07-20T09:50:38.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9420004b90 con 0x7f942815cab0 2023-07-20T09:50:38.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f941ffff640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 0x7f9408068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:38.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9420083980 con 0x7f942815cab0 2023-07-20T09:50:38.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f9426ffd640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 0x7f9408068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:38.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.902+0000 7f9426ffd640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 0x7f9408068740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f941800ab60 tx=0x7f9418008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:38.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:38.906+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9420050ea0 con 0x7f942815cab0 2023-07-20T09:50:39.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.082+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94280b71e0 con 0x7f942815cab0 2023-07-20T09:50:39.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.082+0000 7f941ffff640 1 -- 172.21.15.82:0/3234716327 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f94200544c0 con 0x7f942815cab0 2023-07-20T09:50:39.121 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:39.121 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:50:39.121 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:50:39.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 msgr2=0x7f9408068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 0x7f9408068740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f941800ab60 tx=0x7f9418008040 comp rx=0 tx=0).stop 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 msgr2=0x7f9428156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f942000c3c0 tx=0x7f942000c880 comp rx=0 tx=0).stop 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 shutdown_connections 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9408066280 0x7f9408068740 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f942815cab0 0x7f9428156c80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94280d0d10 0x7f94280c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 --2- 172.21.15.82:0/3234716327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94280cf110 0x7f94280cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 >> 172.21.15.82:0/3234716327 conn(0x7f942808c120 msgr2=0x7f942815bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 shutdown_connections 2023-07-20T09:50:39.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.086+0000 7f942d540640 1 -- 172.21.15.82:0/3234716327 wait complete. 2023-07-20T09:50:39.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:39.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.242+0000 7f63bc1fa640 1 Processor -- start 2023-07-20T09:50:39.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.242+0000 7f63bc1fa640 1 -- start start 2023-07-20T09:50:39.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63bc1fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 0x7f63b40c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63bc1fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cc560 con 0x7f63b4160bc0 2023-07-20T09:50:39.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63bc1fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40ad7e0 con 0x7f63b40cd830 2023-07-20T09:50:39.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63bc1fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40cc790 con 0x7f63b4160fa0 2023-07-20T09:50:39.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9f96640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f63b4160bc0 0x7f63b406c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42780/0 (socket says 172.21.15.82:42780) 2023-07-20T09:50:39.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9f96640 1 -- 172.21.15.82:0/1964467541 learned_addr learned my addr 172.21.15.82:0/1964467541 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:39.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9795640 1 --2- 172.21.15.82:0/1964467541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 0x7f63b40c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b8f94640 1 -- 172.21.15.82:0/1964467541 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955093738 0 0) 0x7f63b40cc560 con 0x7f63b4160bc0 2023-07-20T09:50:39.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b8f94640 1 -- 172.21.15.82:0/1964467541 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a0003530 con 0x7f63b4160bc0 2023-07-20T09:50:39.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9795640 1 -- 172.21.15.82:0/1964467541 >> v1:172.21.15.183:6789/0 conn(0x7f63b40cd830 legacy=0x7f63b40aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:39.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9795640 1 -- 172.21.15.82:0/1964467541 >> v1:172.21.15.82:6789/0 conn(0x7f63b4160bc0 legacy=0x7f63b406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9795640 1 -- 172.21.15.82:0/1964467541 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40cca70 con 0x7f63b4160fa0 2023-07-20T09:50:39.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.246+0000 7f63b9795640 1 --2- 172.21.15.82:0/1964467541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 0x7f63b40c12f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63a40097f0 tx=0x7f63b40abdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f98ca6811bfc6d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63b8f94640 1 -- 172.21.15.82:0/1964467541 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40ab600 con 0x7f63b4160fa0 2023-07-20T09:50:39.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63b8f94640 1 -- 172.21.15.82:0/1964467541 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a40a7050 con 0x7f63b4160fa0 2023-07-20T09:50:39.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63b8f94640 1 -- 172.21.15.82:0/1964467541 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40ab960 con 0x7f63b4160fa0 2023-07-20T09:50:39.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- 172.21.15.82:0/1964467541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 msgr2=0x7f63b40c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/1964467541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 0x7f63b40c12f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f63a40097f0 tx=0x7f63b40abdb0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- 172.21.15.82:0/1964467541 shutdown_connections 2023-07-20T09:50:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/1964467541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b4160fa0 0x7f63b40c12f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- 172.21.15.82:0/1964467541 >> 172.21.15.82:0/1964467541 conn(0x7f63b40cada0 msgr2=0x7f63b40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- 172.21.15.82:0/1964467541 shutdown_connections 2023-07-20T09:50:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- 172.21.15.82:0/1964467541 wait complete. 2023-07-20T09:50:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 Processor -- start 2023-07-20T09:50:39.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- start start 2023-07-20T09:50:39.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63b4160bc0 0x7f63b41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63b4160fa0 0x7f63b40c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4157500 con 0x7f63b4160fa0 2023-07-20T09:50:39.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4156ef0 con 0x7f63b4160bc0 2023-07-20T09:50:39.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63bc1fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40c2110 con 0x7f63b40cd830 2023-07-20T09:50:39.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63ba797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63b4160fa0 0x7f63b40c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.250+0000 7f63b9f96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:57964/0 (socket says 172.21.15.82:57964) 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 -- 172.21.15.82:0/4278160403 learned_addr learned my addr 172.21.15.82:0/4278160403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9795640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63b4160bc0 0x7f63b41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 -- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63b4160bc0 msgr2=0x7f63b41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63b4160bc0 0x7f63b41538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 -- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63b4160fa0 msgr2=0x7f63b40c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63b4160fa0 0x7f63b40c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 -- 172.21.15.82:0/4278160403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4009420 con 0x7f63b40cd830 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63b9f96640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63b000c450 tx=0x7f63b000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0005cf0 con 0x7f63b40cd830 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0005e50 con 0x7f63b40cd830 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0007290 con 0x7f63b40cd830 2023-07-20T09:50:39.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b40c23f0 con 0x7f63b40cd830 2023-07-20T09:50:39.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b40c1da0 con 0x7f63b40cd830 2023-07-20T09:50:39.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4073c70 con 0x7f63b40cd830 2023-07-20T09:50:39.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.254+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f63b00073f0 con 0x7f63b40cd830 2023-07-20T09:50:39.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.258+0000 7f63aa7fc640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 0x7f6398068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.258+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63b0083400 con 0x7f63b40cd830 2023-07-20T09:50:39.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.258+0000 7f63b9795640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 0x7f6398068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.258+0000 7f63b9795640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 0x7f6398068740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63a40ad000 tx=0x7f63a4004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.258+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63b00509a0 con 0x7f63b40cd830 2023-07-20T09:50:39.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.406+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b40ca890 con 0x7f63b40cd830 2023-07-20T09:50:39.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63aa7fc640 1 -- 172.21.15.82:0/4278160403 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f63b0053fc0 con 0x7f63b40cd830 2023-07-20T09:50:39.446 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:39.447 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 msgr2=0x7f6398068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 0x7f6398068740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63a40ad000 tx=0x7f63a4004740 comp rx=0 tx=0).stop 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 msgr2=0x7f63b4157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63b000c450 tx=0x7f63b000c910 comp rx=0 tx=0).stop 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 shutdown_connections 2023-07-20T09:50:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6398066280 0x7f6398068740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63b4160fa0 0x7f63b40c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63b4160bc0 0x7f63b41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 --2- 172.21.15.82:0/4278160403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63b40cd830 0x7f63b4157990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 >> 172.21.15.82:0/4278160403 conn(0x7f63b40cada0 msgr2=0x7f63b40ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 shutdown_connections 2023-07-20T09:50:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.410+0000 7f63bc1fa640 1 -- 172.21.15.82:0/4278160403 wait complete. 2023-07-20T09:50:39.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:39.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:39.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.570+0000 7f0f0a427640 1 Processor -- start 2023-07-20T09:50:39.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.570+0000 7f0f0a427640 1 -- start start 2023-07-20T09:50:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f0a427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f04159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f0a427640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f04070830 0x7f0f040afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f0a427640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040c8bf0 con 0x7f0f040cb850 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f0a427640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f04071240 con 0x7f0f04070830 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f0a427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040c9790 con 0x7f0f040ca690 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f089c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f04070830 0x7f0f040afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f037fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0f040cb850 0x7f0f040c9080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42788/0 (socket says 172.21.15.82:42788) 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f037fe640 1 -- 172.21.15.82:0/3825020949 learned_addr learned my addr 172.21.15.82:0/3825020949 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f03fff640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f04159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f089c4640 1 -- 172.21.15.82:0/3825020949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 msgr2=0x7f0f04159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f089c4640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f04159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f089c4640 1 -- 172.21.15.82:0/3825020949 >> v1:172.21.15.82:6789/0 conn(0x7f0f040cb850 legacy=0x7f0f040c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f089c4640 1 -- 172.21.15.82:0/3825020949 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0415a3e0 con 0x7f0f04070830 2023-07-20T09:50:39.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.574+0000 7f0f03fff640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f04159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:39.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f089c4640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f04070830 0x7f0f040afc10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009d90 tx=0x7f0efc01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be36a524f2507bff server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f02ffd640 1 -- 172.21.15.82:0/3825020949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a7b00 con 0x7f0f04070830 2023-07-20T09:50:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f02ffd640 1 -- 172.21.15.82:0/3825020949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc0a7c60 con 0x7f0f04070830 2023-07-20T09:50:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f02ffd640 1 -- 172.21.15.82:0/3825020949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0af440 con 0x7f0f04070830 2023-07-20T09:50:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- 172.21.15.82:0/3825020949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f04070830 msgr2=0x7f0f040afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f04070830 0x7f0f040afc10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009d90 tx=0x7f0efc01eb30 comp rx=0 tx=0).stop 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- 172.21.15.82:0/3825020949 shutdown_connections 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f04070830 0x7f0f040afc10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- 172.21.15.82:0/3825020949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f04159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- 172.21.15.82:0/3825020949 >> 172.21.15.82:0/3825020949 conn(0x7f0f040cac10 msgr2=0x7f0f040cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- 172.21.15.82:0/3825020949 shutdown_connections 2023-07-20T09:50:39.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- 172.21.15.82:0/3825020949 wait complete. 2023-07-20T09:50:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 Processor -- start 2023-07-20T09:50:39.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- start start 2023-07-20T09:50:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f04070830 0x7f0f041501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f040c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040b1340 con 0x7f0f040cb850 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04150cb0 con 0x7f0f04070830 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.578+0000 7f0f0a427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040c4ff0 con 0x7f0f040ca690 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53734/0 (socket says 172.21.15.82:53734) 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 -- 172.21.15.82:0/607006665 learned_addr learned my addr 172.21.15.82:0/607006665 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f037fe640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f040c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f03fff640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f04070830 0x7f0f041501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 -- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 msgr2=0x7f0f040c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f040c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 -- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f04070830 msgr2=0x7f0f041501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f04070830 0x7f0f041501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 -- 172.21.15.82:0/607006665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc009a70 con 0x7f0f040cb850 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f089c4640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009d90 tx=0x7f0efc01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0afe40 con 0x7f0f040cb850 2023-07-20T09:50:39.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc009450 con 0x7f0f040cb850 2023-07-20T09:50:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f040c4d10 con 0x7f0f040cb850 2023-07-20T09:50:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0bb690 con 0x7f0f040cb850 2023-07-20T09:50:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f040b0fd0 con 0x7f0f040cb850 2023-07-20T09:50:39.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f040b14f0 con 0x7f0f040cb850 2023-07-20T09:50:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.582+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0efc0bb7f0 con 0x7f0f040cb850 2023-07-20T09:50:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.586+0000 7f0f00ff9640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 0x7f0ef0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.586+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0efc121410 con 0x7f0f040cb850 2023-07-20T09:50:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.586+0000 7f0f03fff640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 0x7f0ef0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.586+0000 7f0f03fff640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 0x7f0ef0068740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f04153de0 tx=0x7f0ef4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.586+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f040b14f0 con 0x7f0f040cb850 2023-07-20T09:50:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.738+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f040b14f0 con 0x7f0f040cb850 2023-07-20T09:50:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.738+0000 7f0f00ff9640 1 -- 172.21.15.82:0/607006665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f040b14f0 con 0x7f0f040cb850 2023-07-20T09:50:39.776 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 msgr2=0x7f0ef0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 0x7f0ef0068740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f04153de0 tx=0x7f0ef4008040 comp rx=0 tx=0).stop 2023-07-20T09:50:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 msgr2=0x7f0f04151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0efc009d90 tx=0x7f0efc01b8d0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 shutdown_connections 2023-07-20T09:50:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0ef0066280 0x7f0ef0068740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f040cb850 0x7f0f04151520 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f040ca690 0x7f0f040c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 --2- 172.21.15.82:0/607006665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f04070830 0x7f0f041501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 >> 172.21.15.82:0/607006665 conn(0x7f0f040cac10 msgr2=0x7f0f0415b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 shutdown_connections 2023-07-20T09:50:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.742+0000 7f0f0a427640 1 -- 172.21.15.82:0/607006665 wait complete. 2023-07-20T09:50:39.797 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.902+0000 7fb5d34cb640 1 Processor -- start 2023-07-20T09:50:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.902+0000 7fb5d34cb640 1 -- start start 2023-07-20T09:50:39.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d34cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5cc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d34cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc0c9370 con 0x7fb5cc160ba0 2023-07-20T09:50:39.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d34cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc161300 con 0x7fb5cc161de0 2023-07-20T09:50:39.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d34cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c9650 con 0x7fb5cc0b0460 2023-07-20T09:50:39.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d1267640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb5cc160ba0 0x7fb5cc0c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42790/0 (socket says 172.21.15.82:42790) 2023-07-20T09:50:39.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d1267640 1 -- 172.21.15.82:0/82403270 learned_addr learned my addr 172.21.15.82:0/82403270 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:39.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194803989 0 0) 0x7fb5cc0c9370 con 0x7fb5cc160ba0 2023-07-20T09:50:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d1a68640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5cc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8003530 con 0x7fb5cc160ba0 2023-07-20T09:50:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152163194 0 0) 0x7fb5b8003530 con 0x7fb5cc160ba0 2023-07-20T09:50:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 msgr2=0x7fb5cc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:39.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5cc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 >> v1:172.21.15.183:6789/0 conn(0x7fb5cc161de0 legacy=0x7fb5cc0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc1615e0 con 0x7fb5cc160ba0 2023-07-20T09:50:39.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fb5c8001a00 con 0x7fb5cc160ba0 2023-07-20T09:50:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 >> v1:172.21.15.82:6789/0 conn(0x7fb5cc160ba0 legacy=0x7fb5cc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5b8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8003fa0 0x7fb5b80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5b8004d10 0x7fb5b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c9650 con 0x7fb5b8003fa0 2023-07-20T09:50:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800baf0 con 0x7fb5b8004d10 2023-07-20T09:50:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b800bcb0 con 0x7fb5cc0b0460 2023-07-20T09:50:39.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8003fa0 0x7fb5b80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d1267640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5b8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d1a68640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5b8004d10 0x7fb5b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 -- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 msgr2=0x7fb5b8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:39.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5cc0b0460 0x7fb5b8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 -- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5b8004d10 msgr2=0x7fb5b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:39.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5b8004d10 0x7fb5b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.906+0000 7fb5d0a66640 1 -- 172.21.15.82:0/82403270 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8003530 con 0x7fb5b8003fa0 2023-07-20T09:50:39.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8003fa0 0x7fb5b80047d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc001780 tx=0x7fb5bc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fb3a9c559f6a13 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0050d0 con 0x7fb5b8003fa0 2023-07-20T09:50:39.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0a7050 con 0x7fb5b8003fa0 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5c3fff640 1 -- 172.21.15.82:0/82403270 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc005490 con 0x7fb5b8003fa0 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- 172.21.15.82:0/82403270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8003fa0 msgr2=0x7fb5b80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/82403270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5b8003fa0 0x7fb5b80047d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc001780 tx=0x7fb5bc01c340 comp rx=0 tx=0).stop 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d1a68640 1 -- 172.21.15.82:0/82403270 reap_dead start 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- 172.21.15.82:0/82403270 shutdown_connections 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- 172.21.15.82:0/82403270 >> 172.21.15.82:0/82403270 conn(0x7fb5cc0cad50 msgr2=0x7fb5cc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- 172.21.15.82:0/82403270 shutdown_connections 2023-07-20T09:50:39.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- 172.21.15.82:0/82403270 wait complete. 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 Processor -- start 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.910+0000 7fb5d34cb640 1 -- start start 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5b8003fa0 0x7fb5cc154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5cc162be0 0x7fb5cc163060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc1619c0 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc0c5ec0 con 0x7fb5cc162be0 2023-07-20T09:50:39.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc1635a0 con 0x7fb5b8003fa0 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53762/0 (socket says 172.21.15.82:53762) 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 -- 172.21.15.82:0/3105464535 learned_addr learned my addr 172.21.15.82:0/3105464535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d1267640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5b8003fa0 0x7fb5cc154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d1a68640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5cc162be0 0x7fb5cc163060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 -- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5b8003fa0 msgr2=0x7fb5cc154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5b8003fa0 0x7fb5cc154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 -- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5cc162be0 msgr2=0x7fb5cc163060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5cc162be0 0x7fb5cc163060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 -- 172.21.15.82:0/3105464535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc154bd0 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d0a66640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc005040 tx=0x7fb5b8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0072d0 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc007430 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5cc0c29c0 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0067e0 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc0c2f80 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc04da30 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.914+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5bc006940 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.918+0000 7fb5c1ffb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 0x7fb5b0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.918+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5bc11e290 con 0x7fb5cc0c60c0 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.918+0000 7fb5d1267640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 0x7fb5b0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.918+0000 7fb5d1267640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 0x7fb5b0068740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80013e0 tx=0x7fb5c8001c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:39.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:39.922+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5bc0eb670 con 0x7fb5cc0c60c0 2023-07-20T09:50:40.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5cc0b4250 con 0x7fb5cc0c60c0 2023-07-20T09:50:40.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5c1ffb640 1 -- 172.21.15.82:0/3105464535 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5bc0eec90 con 0x7fb5cc0c60c0 2023-07-20T09:50:40.106 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:40.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 msgr2=0x7fb5b0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 0x7fb5b0068740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb5c80013e0 tx=0x7fb5c8001c00 comp rx=0 tx=0).stop 2023-07-20T09:50:40.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 msgr2=0x7fb5cc1f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc005040 tx=0x7fb5b8005800 comp rx=0 tx=0).stop 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 shutdown_connections 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb5b0066280 0x7fb5b0068740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5cc162be0 0x7fb5cc163060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5cc0c60c0 0x7fb5cc1f6200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 --2- 172.21.15.82:0/3105464535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5b8003fa0 0x7fb5cc154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 >> 172.21.15.82:0/3105464535 conn(0x7fb5cc0cad50 msgr2=0x7fb5cc164b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 shutdown_connections 2023-07-20T09:50:40.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.070+0000 7fb5d34cb640 1 -- 172.21.15.82:0/3105464535 wait complete. 2023-07-20T09:50:40.126 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:40.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.230+0000 7f98bfcf9640 1 Processor -- start 2023-07-20T09:50:40.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.230+0000 7f98bfcf9640 1 -- start start 2023-07-20T09:50:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.230+0000 7f98bfcf9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98b8158ce0 0x7f98b80c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bfcf9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b80c95d0 con 0x7f98b806bd30 2023-07-20T09:50:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bfcf9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b80c9fa0 con 0x7f98b8070970 2023-07-20T09:50:40.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bfcf9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b81590c0 con 0x7f98b8158ce0 2023-07-20T09:50:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98be296640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98b806bd30 0x7f98b80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42804/0 (socket says 172.21.15.82:42804) 2023-07-20T09:50:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98be296640 1 -- 172.21.15.82:0/1134353016 learned_addr learned my addr 172.21.15.82:0/1134353016 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bda95640 1 --2- 172.21.15.82:0/1134353016 >> v2:172.21.15.82:3300/0 conn(0x7f98b8158ce0 0x7f98b80c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bca93640 1 -- 172.21.15.82:0/1134353016 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236865846 0 0) 0x7f98b80c95d0 con 0x7f98b806bd30 2023-07-20T09:50:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bca93640 1 -- 172.21.15.82:0/1134353016 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a4003530 con 0x7f98b806bd30 2023-07-20T09:50:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bda95640 1 -- 172.21.15.82:0/1134353016 >> v1:172.21.15.183:6789/0 conn(0x7f98b8070970 legacy=0x7f98b806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bda95640 1 -- 172.21.15.82:0/1134353016 >> v1:172.21.15.82:6789/0 conn(0x7f98b806bd30 legacy=0x7f98b80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bda95640 1 -- 172.21.15.82:0/1134353016 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b80c89c0 con 0x7f98b8158ce0 2023-07-20T09:50:40.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bda95640 1 --2- 172.21.15.82:0/1134353016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8158ce0 0x7f98b80c9a60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98b40097c0 tx=0x7f98b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0bfb793d263c0b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.234+0000 7f98bca93640 1 -- 172.21.15.82:0/1134353016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40ab650 con 0x7f98b8158ce0 2023-07-20T09:50:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bca93640 1 -- 172.21.15.82:0/1134353016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40ab7b0 con 0x7f98b8158ce0 2023-07-20T09:50:40.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bca93640 1 -- 172.21.15.82:0/1134353016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40abb20 con 0x7f98b8158ce0 2023-07-20T09:50:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- 172.21.15.82:0/1134353016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8158ce0 msgr2=0x7f98b80c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/1134353016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8158ce0 0x7f98b80c9a60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f98b40097c0 tx=0x7f98b401c450 comp rx=0 tx=0).stop 2023-07-20T09:50:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- 172.21.15.82:0/1134353016 shutdown_connections 2023-07-20T09:50:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/1134353016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8158ce0 0x7f98b80c9a60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- 172.21.15.82:0/1134353016 >> 172.21.15.82:0/1134353016 conn(0x7f98b80cad50 msgr2=0x7f98b80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- 172.21.15.82:0/1134353016 shutdown_connections 2023-07-20T09:50:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- 172.21.15.82:0/1134353016 wait complete. 2023-07-20T09:50:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 Processor -- start 2023-07-20T09:50:40.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- start start 2023-07-20T09:50:40.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98b806bd30 0x7f98b8145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 0x7f98b8147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8168a10 con 0x7f98b8070970 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8167e00 con 0x7f98b8158ce0 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bfcf9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b81680e0 con 0x7f98b806bd30 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bd294640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bd294640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53792/0 (socket says 172.21.15.82:53792) 2023-07-20T09:50:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bd294640 1 -- 172.21.15.82:0/4209395498 learned_addr learned my addr 172.21.15.82:0/4209395498 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98bda95640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98b806bd30 0x7f98b8145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.238+0000 7f98be296640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 0x7f98b8147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 -- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98b806bd30 msgr2=0x7f98b8145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98b806bd30 0x7f98b8145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 -- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 msgr2=0x7f98b8147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 0x7f98b8147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 -- 172.21.15.82:0/4209395498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b4009420 con 0x7f98b8070970 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98be296640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 0x7f98b8147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bd294640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c420 tx=0x7f98a800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a80052d0 con 0x7f98b8070970 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8005430 con 0x7f98b8070970 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8007260 con 0x7f98b8070970 2023-07-20T09:50:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b81683c0 con 0x7f98b8070970 2023-07-20T09:50:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b8146030 con 0x7f98b8070970 2023-07-20T09:50:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b8071930 con 0x7f98b8070970 2023-07-20T09:50:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.242+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98a80073c0 con 0x7f98b8070970 2023-07-20T09:50:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.246+0000 7f98ae7fc640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 0x7f989c068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.246+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98a80830b0 con 0x7f98b8070970 2023-07-20T09:50:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.246+0000 7f98bda95640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 0x7f989c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.246+0000 7f98bda95640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 0x7f989c068770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98b40af000 tx=0x7f98b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.250+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98a80505c0 con 0x7f98b8070970 2023-07-20T09:50:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.394+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98b804da30 con 0x7f98b8070970 2023-07-20T09:50:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98ae7fc640 1 -- 172.21.15.82:0/4209395498 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f98a8053be0 con 0x7f98b8070970 2023-07-20T09:50:40.434 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:40.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 msgr2=0x7f989c068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 0x7f989c068770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98b40af000 tx=0x7f98b4008040 comp rx=0 tx=0).stop 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 msgr2=0x7f98b814e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98a800c420 tx=0x7f98a800c8e0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 shutdown_connections 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f989c0662b0 0x7f989c068770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98b8158ce0 0x7f98b8147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98b8070970 0x7f98b814e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 --2- 172.21.15.82:0/4209395498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98b806bd30 0x7f98b8145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 >> 172.21.15.82:0/4209395498 conn(0x7f98b80cad50 msgr2=0x7f98b80cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 shutdown_connections 2023-07-20T09:50:40.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.398+0000 7f98bfcf9640 1 -- 172.21.15.82:0/4209395498 wait complete. 2023-07-20T09:50:40.454 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 Processor -- start 2023-07-20T09:50:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 -- start start 2023-07-20T09:50:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f383015c870 0x7f38300d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 0x7f38300cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 0x7f38300cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383015cc50 con 0x7f383015c870 2023-07-20T09:50:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38300d1040 con 0x7f38300d0b30 2023-07-20T09:50:40.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f38348bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300d1320 con 0x7f38300d20e0 2023-07-20T09:50:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f383015c870 0x7f38300d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f383015c870 0x7f38300d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53796/0 (socket says 172.21.15.82:53796) 2023-07-20T09:50:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 -- 172.21.15.82:0/1587513515 learned_addr learned my addr 172.21.15.82:0/1587513515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382f59e640 1 --2- 172.21.15.82:0/1587513515 >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 0x7f38300cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382e59c640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 0x7f38300cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 -- 172.21.15.82:0/1587513515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 msgr2=0x7f38300cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 0x7f38300cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 -- 172.21.15.82:0/1587513515 >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 msgr2=0x7f38300cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 --2- 172.21.15.82:0/1587513515 >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 0x7f38300cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382ed9d640 1 -- 172.21.15.82:0/1587513515 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300d1600 con 0x7f383015c870 2023-07-20T09:50:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382f59e640 1 --2- 172.21.15.82:0/1587513515 >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 0x7f38300cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.558+0000 7f382e59c640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 0x7f38300cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f382ed9d640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383015c870 0x7f38300d05f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f38300cee10 tx=0x7f382001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ce9b90a7549359 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f382dd9b640 1 -- 172.21.15.82:0/1587513515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200a5820 con 0x7f383015c870 2023-07-20T09:50:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f382dd9b640 1 -- 172.21.15.82:0/1587513515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38200a5980 con 0x7f383015c870 2023-07-20T09:50:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f382dd9b640 1 -- 172.21.15.82:0/1587513515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38200a5d10 con 0x7f383015c870 2023-07-20T09:50:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 -- 172.21.15.82:0/1587513515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383015c870 msgr2=0x7f38300d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383015c870 0x7f38300d05f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f38300cee10 tx=0x7f382001c9a0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 -- 172.21.15.82:0/1587513515 shutdown_connections 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 --2- 172.21.15.82:0/1587513515 >> v2:172.21.15.183:3300/0 conn(0x7f38300d0b30 0x7f38300cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38300d20e0 0x7f38300cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 --2- 172.21.15.82:0/1587513515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f383015c870 0x7f38300d05f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 -- 172.21.15.82:0/1587513515 >> 172.21.15.82:0/1587513515 conn(0x7f38300654e0 msgr2=0x7f38300658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 -- 172.21.15.82:0/1587513515 shutdown_connections 2023-07-20T09:50:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.562+0000 7f38348bc640 1 -- 172.21.15.82:0/1587513515 wait complete. 2023-07-20T09:50:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 Processor -- start 2023-07-20T09:50:40.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- start start 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38300d0b30 0x7f383014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f383015c870 0x7f383015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38301f7ce0 con 0x7f38300d20e0 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383015a9b0 con 0x7f38300d0b30 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383015ac40 con 0x7f383015c870 2023-07-20T09:50:40.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53810/0 (socket says 172.21.15.82:53810) 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 -- 172.21.15.82:0/981212740 learned_addr learned my addr 172.21.15.82:0/981212740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382ed9d640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38300d0b30 0x7f383014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382f59e640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f383015c870 0x7f383015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 -- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f383015c870 msgr2=0x7f383015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f383015c870 0x7f383015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 -- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38300d0b30 msgr2=0x7f383014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38300d0b30 0x7f383014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 -- 172.21.15.82:0/981212740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820009b30 con 0x7f38300d20e0 2023-07-20T09:50:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f382e59c640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f382400c7c0 tx=0x7f382400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824007a30 con 0x7f38300d20e0 2023-07-20T09:50:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824007b90 con 0x7f38300d20e0 2023-07-20T09:50:40.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383015af20 con 0x7f38300d20e0 2023-07-20T09:50:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400ce70 con 0x7f38300d20e0 2023-07-20T09:50:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.566+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383015b4e0 con 0x7f38300d20e0 2023-07-20T09:50:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383004da30 con 0x7f38300d20e0 2023-07-20T09:50:40.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38240113f0 con 0x7f38300d20e0 2023-07-20T09:50:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f38177fe640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 0x7f381c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38240840b0 con 0x7f38300d20e0 2023-07-20T09:50:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f382ed9d640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 0x7f381c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.570+0000 7f382ed9d640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 0x7f381c068740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38200ae000 tx=0x7f38200a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.574+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38240515d0 con 0x7f38300d20e0 2023-07-20T09:50:40.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.722+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38300c5cc0 con 0x7f38300d20e0 2023-07-20T09:50:40.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.722+0000 7f38177fe640 1 -- 172.21.15.82:0/981212740 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3824054bf0 con 0x7f38300d20e0 2023-07-20T09:50:40.761 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:40.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 msgr2=0x7f381c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 0x7f381c068740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38200ae000 tx=0x7f38200a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 msgr2=0x7f3830159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f382400c7c0 tx=0x7f382400cc80 comp rx=0 tx=0).stop 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 shutdown_connections 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f381c066280 0x7f381c068740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f383015c870 0x7f383015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38300d20e0 0x7f3830159f30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 --2- 172.21.15.82:0/981212740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38300d0b30 0x7f383014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 >> 172.21.15.82:0/981212740 conn(0x7f38300654e0 msgr2=0x7f3830158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 shutdown_connections 2023-07-20T09:50:40.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.726+0000 7f38348bc640 1 -- 172.21.15.82:0/981212740 wait complete. 2023-07-20T09:50:40.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:50:40.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.882+0000 7f5d771e8640 1 Processor -- start 2023-07-20T09:50:40.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.882+0000 7f5d771e8640 1 -- start start 2023-07-20T09:50:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d771e8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 0x7f5d700ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d771e8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d7015c910 0x7f5d7015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d771e8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d700cde70 con 0x7f5d7015d2d0 2023-07-20T09:50:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d771e8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700cbef0 con 0x7f5d7015c910 2023-07-20T09:50:40.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d771e8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d700ca420 con 0x7f5d700ca040 2023-07-20T09:50:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d7015c910 0x7f5d7015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d7015c910 0x7f5d7015cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53820/0 (socket says 172.21.15.82:53820) 2023-07-20T09:50:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 -- 172.21.15.82:0/592179254 learned_addr learned my addr 172.21.15.82:0/592179254 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:40.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d75785640 1 --1- 172.21.15.82:0/592179254 >> v1:172.21.15.82:6789/0 conn(0x7f5d7015d2d0 0x7f5d700c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42808/0 (socket says 172.21.15.82:42808) 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d74f84640 1 --2- 172.21.15.82:0/592179254 >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 0x7f5d700ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 -- 172.21.15.82:0/592179254 >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 msgr2=0x7f5d700ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 --2- 172.21.15.82:0/592179254 >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 0x7f5d700ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 -- 172.21.15.82:0/592179254 >> v1:172.21.15.82:6789/0 conn(0x7f5d7015d2d0 legacy=0x7f5d700c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d67fff640 1 -- 172.21.15.82:0/592179254 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7015d760 con 0x7f5d7015c910 2023-07-20T09:50:40.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.886+0000 7f5d74f84640 1 --2- 172.21.15.82:0/592179254 >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 0x7f5d700ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:40.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d67fff640 1 --2- 172.21.15.82:0/592179254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015c910 0x7f5d7015cd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d70066a70 tx=0x7f5d6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8bf6f39dd76244 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d677fe640 1 -- 172.21.15.82:0/592179254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d600a8050 con 0x7f5d7015c910 2023-07-20T09:50:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d677fe640 1 -- 172.21.15.82:0/592179254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d600ac5f0 con 0x7f5d7015c910 2023-07-20T09:50:40.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d677fe640 1 -- 172.21.15.82:0/592179254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d600ac980 con 0x7f5d7015c910 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- 172.21.15.82:0/592179254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015c910 msgr2=0x7f5d7015cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 --2- 172.21.15.82:0/592179254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015c910 0x7f5d7015cd90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d70066a70 tx=0x7f5d6001c500 comp rx=0 tx=0).stop 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- 172.21.15.82:0/592179254 shutdown_connections 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 --2- 172.21.15.82:0/592179254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015c910 0x7f5d7015cd90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 --2- 172.21.15.82:0/592179254 >> v2:172.21.15.183:3300/0 conn(0x7f5d700ca040 0x7f5d700ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- 172.21.15.82:0/592179254 >> 172.21.15.82:0/592179254 conn(0x7f5d700cada0 msgr2=0x7f5d700cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- 172.21.15.82:0/592179254 shutdown_connections 2023-07-20T09:50:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- 172.21.15.82:0/592179254 wait complete. 2023-07-20T09:50:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 Processor -- start 2023-07-20T09:50:40.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.890+0000 7f5d771e8640 1 -- start start 2023-07-20T09:50:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 0x7f5d700c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d7015c910 0x7f5d70165170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d70165bf0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700c6d90 con 0x7f5d700ca040 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700c64f0 con 0x7f5d7015c910 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53826/0 (socket says 172.21.15.82:53826) 2023-07-20T09:50:40.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 -- 172.21.15.82:0/3086814275 learned_addr learned my addr 172.21.15.82:0/3086814275 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:40.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d74f84640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 0x7f5d700c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d67fff640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d7015c910 0x7f5d70165170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 -- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d7015c910 msgr2=0x7f5d70165170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d7015c910 0x7f5d70165170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 -- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 msgr2=0x7f5d700c2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:40.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 0x7f5d700c2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 -- 172.21.15.82:0/3086814275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600094d0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d74f84640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 0x7f5d700c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d75785640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c700 tx=0x7f5d6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800ce10 con 0x7f5d7015d2d0 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6800a640 con 0x7f5d7015d2d0 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d700c67d0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6800a9b0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701557d0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70155630 con 0x7f5d7015d2d0 2023-07-20T09:50:40.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.894+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d6800ab10 con 0x7f5d7015d2d0 2023-07-20T09:50:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.898+0000 7f5d657fa640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 0x7f5d5c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.898+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d680834d0 con 0x7f5d7015d2d0 2023-07-20T09:50:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.898+0000 7f5d74f84640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 0x7f5d5c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:40.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.898+0000 7f5d74f84640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 0x7f5d5c068740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:40.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:40.902+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d70155630 con 0x7f5d7015d2d0 2023-07-20T09:50:41.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.078+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d70155630 con 0x7f5d7015d2d0 2023-07-20T09:50:41.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.078+0000 7f5d657fa640 1 -- 172.21.15.82:0/3086814275 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f5d70155630 con 0x7f5d7015d2d0 2023-07-20T09:50:41.117 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:41.117 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:50:41.118 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:50:41.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 msgr2=0x7f5d5c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 0x7f5d5c068740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c006fd0 tx=0x7f5d6c008040 comp rx=0 tx=0).stop 2023-07-20T09:50:41.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 msgr2=0x7f5d701656b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c700 tx=0x7f5d6800cbc0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 shutdown_connections 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d5c066280 0x7f5d5c068740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d7015d2d0 0x7f5d701656b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d7015c910 0x7f5d70165170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 --2- 172.21.15.82:0/3086814275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d700ca040 0x7f5d700c2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 >> 172.21.15.82:0/3086814275 conn(0x7f5d700cada0 msgr2=0x7f5d7006bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:41.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 shutdown_connections 2023-07-20T09:50:41.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.082+0000 7f5d771e8640 1 -- 172.21.15.82:0/3086814275 wait complete. 2023-07-20T09:50:41.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.238+0000 7fa3ad283640 1 Processor -- start 2023-07-20T09:50:41.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.238+0000 7fa3ad283640 1 -- start start 2023-07-20T09:50:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3ad283640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3a815cfc0 0x7fa3a80c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3ad283640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8159ef0 con 0x7fa3a8159aa0 2023-07-20T09:50:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3ad283640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a8070df0 con 0x7fa3a806b720 2023-07-20T09:50:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3ad283640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a806c980 con 0x7fa3a815cfc0 2023-07-20T09:50:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3aca82640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa3a8159aa0 0x7fa3a806c270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42820/0 (socket says 172.21.15.82:42820) 2023-07-20T09:50:41.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3aca82640 1 -- 172.21.15.82:0/3534445772 learned_addr learned my addr 172.21.15.82:0/3534445772 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a7fff640 1 --2- 172.21.15.82:0/3534445772 >> v2:172.21.15.183:3300/0 conn(0x7fa3a815cfc0 0x7fa3a80c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a6ffd640 1 -- 172.21.15.82:0/3534445772 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527932343 0 0) 0x7fa3a00014a0 con 0x7fa3a8159aa0 2023-07-20T09:50:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a6ffd640 1 -- 172.21.15.82:0/3534445772 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa390003530 con 0x7fa3a8159aa0 2023-07-20T09:50:41.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a7fff640 1 -- 172.21.15.82:0/3534445772 >> v1:172.21.15.183:6789/0 conn(0x7fa3a806b720 legacy=0x7fa3a806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a7fff640 1 -- 172.21.15.82:0/3534445772 >> v1:172.21.15.82:6789/0 conn(0x7fa3a8159aa0 legacy=0x7fa3a806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.242+0000 7fa3a7fff640 1 -- 172.21.15.82:0/3534445772 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a815d4d0 con 0x7fa3a815cfc0 2023-07-20T09:50:41.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3a7fff640 1 --2- 172.21.15.82:0/3534445772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c86d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097c0 tx=0x7fa39801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65966ea6581c9e6e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3a6ffd640 1 -- 172.21.15.82:0/3534445772 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980ac620 con 0x7fa3a815cfc0 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3a6ffd640 1 -- 172.21.15.82:0/3534445772 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980ac780 con 0x7fa3a815cfc0 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3a6ffd640 1 -- 172.21.15.82:0/3534445772 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980acaf0 con 0x7fa3a815cfc0 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- 172.21.15.82:0/3534445772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a815cfc0 msgr2=0x7fa3a80c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 --2- 172.21.15.82:0/3534445772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c86d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097c0 tx=0x7fa39801c3c0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- 172.21.15.82:0/3534445772 shutdown_connections 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 --2- 172.21.15.82:0/3534445772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c86d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- 172.21.15.82:0/3534445772 >> 172.21.15.82:0/3534445772 conn(0x7fa3a80ce080 msgr2=0x7fa3a80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- 172.21.15.82:0/3534445772 shutdown_connections 2023-07-20T09:50:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- 172.21.15.82:0/3534445772 wait complete. 2023-07-20T09:50:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 Processor -- start 2023-07-20T09:50:41.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.246+0000 7fa3ad283640 1 -- start start 2023-07-20T09:50:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a806b720 0x7fa3a80b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a8159aa0 0x7fa3a80c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a814f920 con 0x7fa3a815cfc0 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81501c0 con 0x7fa3a8159aa0 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80b1dd0 con 0x7fa3a806b720 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 -- 172.21.15.82:0/767000322 learned_addr learned my addr 172.21.15.82:0/767000322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a7fff640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a806b720 0x7fa3a80b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a77fe640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a8159aa0 0x7fa3a80c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 -- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a806b720 msgr2=0x7fa3a80b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a806b720 0x7fa3a80b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 -- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a8159aa0 msgr2=0x7fa3a80c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a8159aa0 0x7fa3a80c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 -- 172.21.15.82:0/767000322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398009420 con 0x7fa3a815cfc0 2023-07-20T09:50:41.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3aca82640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000cb10 tx=0x7fa3a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000ac70 con 0x7fa3a815cfc0 2023-07-20T09:50:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000add0 con 0x7fa3a815cfc0 2023-07-20T09:50:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0012620 con 0x7fa3a815cfc0 2023-07-20T09:50:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80c7740 con 0x7fa3a815cfc0 2023-07-20T09:50:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a814fe50 con 0x7fa3a815cfc0 2023-07-20T09:50:41.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a804da30 con 0x7fa3a815cfc0 2023-07-20T09:50:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.250+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa3a0007070 con 0x7fa3a815cfc0 2023-07-20T09:50:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.254+0000 7fa3a4ff9640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 0x7fa394068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.254+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3a0083b00 con 0x7fa3a815cfc0 2023-07-20T09:50:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.254+0000 7fa3a7fff640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 0x7fa394068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.254+0000 7fa3a7fff640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 0x7fa394068740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3980ae000 tx=0x7fa3980a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.258+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3a0085e60 con 0x7fa3a815cfc0 2023-07-20T09:50:41.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.406+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3a8159ef0 con 0x7fa3a815cfc0 2023-07-20T09:50:41.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.406+0000 7fa3a4ff9640 1 -- 172.21.15.82:0/767000322 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fa3a8159ef0 con 0x7fa3a815cfc0 2023-07-20T09:50:41.444 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:41.444 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:41.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 msgr2=0x7fa394068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 0x7fa394068740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa3980ae000 tx=0x7fa3980a7000 comp rx=0 tx=0).stop 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 msgr2=0x7fa3a80c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000cb10 tx=0x7fa3a000a060 comp rx=0 tx=0).stop 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 shutdown_connections 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa394066280 0x7fa394068740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a815cfc0 0x7fa3a80c53b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a8159aa0 0x7fa3a80c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 --2- 172.21.15.82:0/767000322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a806b720 0x7fa3a80b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 >> 172.21.15.82:0/767000322 conn(0x7fa3a80ce080 msgr2=0x7fa3a815b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 shutdown_connections 2023-07-20T09:50:41.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.410+0000 7fa3ad283640 1 -- 172.21.15.82:0/767000322 wait complete. 2023-07-20T09:50:41.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:50:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 Processor -- start 2023-07-20T09:50:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 -- start start 2023-07-20T09:50:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f424415cab0 0x7f42440d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f42440d0d10 0x7f42440d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440d16b0 con 0x7f42440cf110 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440d31c0 con 0x7f424415cab0 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4249da3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440b3520 con 0x7f42440d0d10 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f42437fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f424415cab0 0x7f42440d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4243fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f42440cf110 0x7f42440cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42822/0 (socket says 172.21.15.82:42822) 2023-07-20T09:50:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4243fff640 1 -- 172.21.15.82:0/3476981666 learned_addr learned my addr 172.21.15.82:0/3476981666 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f423bfff640 1 --2- 172.21.15.82:0/3476981666 >> v2:172.21.15.183:3300/0 conn(0x7f42440d0d10 0x7f42440d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f42437fe640 1 -- 172.21.15.82:0/3476981666 >> v2:172.21.15.183:3300/0 conn(0x7f42440d0d10 msgr2=0x7f42440d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f42437fe640 1 --2- 172.21.15.82:0/3476981666 >> v2:172.21.15.183:3300/0 conn(0x7f42440d0d10 0x7f42440d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f42437fe640 1 -- 172.21.15.82:0/3476981666 >> v1:172.21.15.82:6789/0 conn(0x7f42440cf110 legacy=0x7f42440cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f42437fe640 1 -- 172.21.15.82:0/3476981666 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440b2910 con 0x7f424415cab0 2023-07-20T09:50:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.566+0000 7f4242ffd640 1 -- 172.21.15.82:0/3476981666 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024251295 0 0) 0x7f42440d16b0 con 0x7f42440cf110 2023-07-20T09:50:41.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f42437fe640 1 --2- 172.21.15.82:0/3476981666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f424415cab0 0x7f42440d0300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42440d0190 tx=0x7f423401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3d71ae30f03a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4242ffd640 1 -- 172.21.15.82:0/3476981666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340a7070 con 0x7f424415cab0 2023-07-20T09:50:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4242ffd640 1 -- 172.21.15.82:0/3476981666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42340ab430 con 0x7f424415cab0 2023-07-20T09:50:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4242ffd640 1 -- 172.21.15.82:0/3476981666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42340ab7c0 con 0x7f424415cab0 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 -- 172.21.15.82:0/3476981666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f424415cab0 msgr2=0x7f42440d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 --2- 172.21.15.82:0/3476981666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f424415cab0 0x7f42440d0300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f42440d0190 tx=0x7f423401c430 comp rx=0 tx=0).stop 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 -- 172.21.15.82:0/3476981666 shutdown_connections 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 --2- 172.21.15.82:0/3476981666 >> v2:172.21.15.183:3300/0 conn(0x7f42440d0d10 0x7f42440d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 --2- 172.21.15.82:0/3476981666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f424415cab0 0x7f42440d0300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 -- 172.21.15.82:0/3476981666 >> 172.21.15.82:0/3476981666 conn(0x7f424408c120 msgr2=0x7f424409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 -- 172.21.15.82:0/3476981666 shutdown_connections 2023-07-20T09:50:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.570+0000 7f4249da3640 1 -- 172.21.15.82:0/3476981666 wait complete. 2023-07-20T09:50:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 Processor -- start 2023-07-20T09:50:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- start start 2023-07-20T09:50:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42440cf110 0x7f42440c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f424415cab0 0x7f42441595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244151750 con 0x7f42440d0d10 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42441519d0 con 0x7f424415cab0 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244151cb0 con 0x7f42440cf110 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53836/0 (socket says 172.21.15.82:53836) 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 -- 172.21.15.82:0/1535270751 learned_addr learned my addr 172.21.15.82:0/1535270751 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4243fff640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f424415cab0 0x7f42441595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f42437fe640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42440cf110 0x7f42440c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 -- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42440cf110 msgr2=0x7f42440c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42440cf110 0x7f42440c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 -- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f424415cab0 msgr2=0x7f42441595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f424415cab0 0x7f42441595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 -- 172.21.15.82:0/1535270751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4234009420 con 0x7f42440d0d10 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f423bfff640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e930 tx=0x7f422c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c009690 con 0x7f42440d0d10 2023-07-20T09:50:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00ca00 con 0x7f42440d0d10 2023-07-20T09:50:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cd70 con 0x7f42440d0d10 2023-07-20T09:50:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4244151f90 con 0x7f42440d0d10 2023-07-20T09:50:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.574+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4244150a10 con 0x7f42440d0d10 2023-07-20T09:50:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4244073c70 con 0x7f42440d0d10 2023-07-20T09:50:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f422c013470 con 0x7f42440d0d10 2023-07-20T09:50:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f4240ff9640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 0x7f4224068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f422c083fa0 con 0x7f42440d0d10 2023-07-20T09:50:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f42437fe640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 0x7f4224068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.578+0000 7f42437fe640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 0x7f4224068770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42340af000 tx=0x7f42340a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:41.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.582+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f422c0514f0 con 0x7f42440d0d10 2023-07-20T09:50:41.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.758+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42440d2da0 con 0x7f42440d0d10 2023-07-20T09:50:41.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4240ff9640 1 -- 172.21.15.82:0/1535270751 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f422c017090 con 0x7f42440d0d10 2023-07-20T09:50:41.797 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:41.798 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:50:41.798 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:50:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 msgr2=0x7f4224068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 0x7f4224068770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42340af000 tx=0x7f42340a7000 comp rx=0 tx=0).stop 2023-07-20T09:50:41.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 msgr2=0x7f42441504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e930 tx=0x7f422c00edf0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 shutdown_connections 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f42240662b0 0x7f4224068770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f424415cab0 0x7f42441595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42440d0d10 0x7f42441504d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 --2- 172.21.15.82:0/1535270751 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42440cf110 0x7f42440c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:41.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 >> 172.21.15.82:0/1535270751 conn(0x7f424408c120 msgr2=0x7f424406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 shutdown_connections 2023-07-20T09:50:41.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:41.762+0000 7f4249da3640 1 -- 172.21.15.82:0/1535270751 wait complete. 2023-07-20T09:50:42.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T09:50:26.749521+0000', 'modified': '2023-07-20T09:50:30.705079+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6835/313910073', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 313910073}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 313910073}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T09:50:42.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T09:50:42.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-20T09:50:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 Processor -- start 2023-07-20T09:50:42.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 -- start start 2023-07-20T09:50:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd10c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0b3520 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c0cff30 con 0x7fd10c0d0d10 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd111500640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0d31c0 con 0x7fd10c15cab0 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd10b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd10c0ce4c0 0x7fd10c0cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42834/0 (socket says 172.21.15.82:42834) 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.326+0000 7fd10b7fe640 1 -- 172.21.15.82:0/2038900804 learned_addr learned my addr 172.21.15.82:0/2038900804 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10affd640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd10c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946250396 0 0) 0x7fd10c0b3520 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0f8003530 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3002712694 0 0) 0x7fd0f8003530 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 msgr2=0x7fd10c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd10c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 >> v1:172.21.15.183:6789/0 conn(0x7fd10c0d0d10 legacy=0x7fd10c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0b2910 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd104001a00 con 0x7fd10c0ce4c0 2023-07-20T09:50:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 >> v1:172.21.15.82:6789/0 conn(0x7fd10c0ce4c0 legacy=0x7fd10c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd0f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8003f30 0x7fd0f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f8004d10 0x7fd0f8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f800ba40 con 0x7fd0f8004d10 2023-07-20T09:50:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f800bbb0 con 0x7fd0f8003f30 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f800bd70 con 0x7fd10c15cab0 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f8004d10 0x7fd0f8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10affd640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd0f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd1027fc640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8003f30 0x7fd0f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 -- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 msgr2=0x7fd0f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c15cab0 0x7fd0f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 -- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8003f30 msgr2=0x7fd0f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8003f30 0x7fd0f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.330+0000 7fd10b7fe640 1 -- 172.21.15.82:0/2038900804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8003530 con 0x7fd0f8004d10 2023-07-20T09:50:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f8004d10 0x7fd0f8005190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd10400a800 tx=0x7fd10401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc45b809598ea42 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040072d0 con 0x7fd0f8004d10 2023-07-20T09:50:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1040a8070 con 0x7fd0f8004d10 2023-07-20T09:50:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd10a7fc640 1 -- 172.21.15.82:0/2038900804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040076f0 con 0x7fd0f8004d10 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- 172.21.15.82:0/2038900804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f8004d10 msgr2=0x7fd0f8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 --2- 172.21.15.82:0/2038900804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0f8004d10 0x7fd0f8005190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd10400a800 tx=0x7fd10401d300 comp rx=0 tx=0).stop 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd10b7fe640 1 -- 172.21.15.82:0/2038900804 reap_dead start 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- 172.21.15.82:0/2038900804 shutdown_connections 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- 172.21.15.82:0/2038900804 >> 172.21.15.82:0/2038900804 conn(0x7fd10c08c120 msgr2=0x7fd10c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- 172.21.15.82:0/2038900804 shutdown_connections 2023-07-20T09:50:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- 172.21.15.82:0/2038900804 wait complete. 2023-07-20T09:50:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 Processor -- start 2023-07-20T09:50:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.334+0000 7fd111500640 1 -- start start 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 0x7fd10c151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c0c8790 0x7fd10c0c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c9150 con 0x7fd10c06ab70 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c06b530 con 0x7fd0f8004d10 2023-07-20T09:50:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c15cf30 con 0x7fd10c0c8790 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53852/0 (socket says 172.21.15.82:53852) 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 -- 172.21.15.82:0/755179343 learned_addr learned my addr 172.21.15.82:0/755179343 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10affd640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 0x7fd10c151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd1027fc640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c0c8790 0x7fd10c0c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 -- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c0c8790 msgr2=0x7fd10c0c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c0c8790 0x7fd10c0c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 -- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 msgr2=0x7fd10c151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 0x7fd10c151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 -- 172.21.15.82:0/755179343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c15d180 con 0x7fd10c06ab70 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10affd640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 0x7fd10c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd10401d130 tx=0x7fd0f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd103fff640 1 -- 172.21.15.82:0/755179343 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040bb070 con 0x7fd10c06ab70 2023-07-20T09:50:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd103fff640 1 -- 172.21.15.82:0/755179343 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104001210 con 0x7fd10c06ab70 2023-07-20T09:50:42.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c15d460 con 0x7fd10c06ab70 2023-07-20T09:50:42.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd103fff640 1 -- 172.21.15.82:0/755179343 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004b70 con 0x7fd10c06ab70 2023-07-20T09:50:42.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.338+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c15da20 con 0x7fd10c06ab70 2023-07-20T09:50:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd103fff640 1 -- 172.21.15.82:0/755179343 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd1040aa030 con 0x7fd10c06ab70 2023-07-20T09:50:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd103fff640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 0x7fd0ec068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd103fff640 1 -- 172.21.15.82:0/755179343 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd10411d670 con 0x7fd10c06ab70 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10affd640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 0x7fd0ec068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10affd640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 0x7fd0ec068770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009be0 tx=0x7fd0fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 Processor -- start 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 -- start start 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e363cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e36381950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e362490a0 con 0x559e36381e90 2023-07-20T09:50:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e361d7e40 con 0x559e363cc640 2023-07-20T09:50:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e361d5370 con 0x559e363cbd20 2023-07-20T09:50:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53868/0 (socket says 172.21.15.82:53868) 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 -- 172.21.15.82:0/1143853155 learned_addr learned my addr 172.21.15.82:0/1143853155 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 -- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 msgr2=0x559e363cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e363cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 -- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 msgr2=0x559e36381950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e36381950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.342+0000 7fd10b7fe640 1 -- 172.21.15.82:0/1143853155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e35ecc890 con 0x559e36381e90 2023-07-20T09:50:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd1040ee6a0 tx=0x7fd1040f26d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d208d03239196e08 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd100ff9640 1 -- 172.21.15.82:0/1143853155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040ecab0 con 0x559e36381e90 2023-07-20T09:50:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd100ff9640 1 -- 172.21.15.82:0/1143853155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10400a450 con 0x559e36381e90 2023-07-20T09:50:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd100ff9640 1 -- 172.21.15.82:0/1143853155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1040eae20 con 0x559e36381e90 2023-07-20T09:50:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- 172.21.15.82:0/1143853155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 msgr2=0x559e36382270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd1040ee6a0 tx=0x7fd1040f26d0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- 172.21.15.82:0/1143853155 shutdown_connections 2023-07-20T09:50:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36382270 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e36381950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- 172.21.15.82:0/1143853155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e363cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- 172.21.15.82:0/1143853155 >> 172.21.15.82:0/1143853155 conn(0x559e36379200 msgr2=0x559e36380230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- 172.21.15.82:0/1143853155 shutdown_connections 2023-07-20T09:50:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- 172.21.15.82:0/1143853155 wait complete. 2023-07-20T09:50:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- start start 2023-07-20T09:50:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 Processor -- start 2023-07-20T09:50:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e3638cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e3638d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e361d0c60 con 0x559e363cbd20 2023-07-20T09:50:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3618cae0 con 0x559e363cc640 2023-07-20T09:50:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e3618c780 con 0x559e36381e90 2023-07-20T09:50:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd114852000 10 client.0 _ll_register_callbacks cb 0x559e3636d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T09:50:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53880/0 (socket says 172.21.15.82:53880) 2023-07-20T09:50:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 -- 172.21.15.82:0/2039150991 learned_addr learned my addr 172.21.15.82:0/2039150991 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e3638d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd10affd640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e3638cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 -- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 msgr2=0x559e3638cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e3638cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 -- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 msgr2=0x559e3638d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e3638d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 -- 172.21.15.82:0/2039150991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c15da20 con 0x559e363cbd20 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd1027fc640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001ea0 tx=0x7fd0f4012750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e1a9f0a13335e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.346+0000 7fd0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40052e0 con 0x559e363cbd20 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0f4005440 con 0x559e363cbd20 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e36190fb0 con 0x559e363cbd20 2023-07-20T09:50:42.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0f4003600 con 0x559e363cbd20 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 10 client.4728 fetch_fsmap learned FSMap version 8 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x559e36194d10 con 0x559e363cbd20 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e36190fb0 con 0x559e363cbd20 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd0f4003760 con 0x559e363cbd20 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 10 client.4728 fetch_fsmap finished waiting for FSMap version 8 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 10 client.4728 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T09:50:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 20 client.4728 populate_metadata read hostname 'smithi082' 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e3638e210 0x559e363dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 4 client.4728 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 --> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e361ff410 con 0x559e3638e210 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd10affd640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e3638e210 0x559e363dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd10affd640 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e3638e210 0x559e363dd290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b968867a150a18a3 server_cookie=c060aff716019838 in_seq=0 out_seq=0 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 10 client.4728 ms_handle_connect on v2:172.21.15.183:6834/313910073 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/2039150991 <== mds.0 v2:172.21.15.183:6834/313910073 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x559e361ff410 con 0x559e3638e210 2023-07-20T09:50:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 10 client.4728 handle_command_reply: tid=0 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 client.4728 shutdown 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 msgr2=0x559e3638d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001ea0 tx=0x7fd0f4012750 comp rx=0 tx=0).stop 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 shutdown_connections 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e3638e210 0x559e363dd290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e3638d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e3638d400 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd0e9ffb640 0 client.4728 ms_handle_reset on v2:172.21.15.183:6834/313910073 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 --2- 172.21.15.82:0/2039150991 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e3638cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 >> 172.21.15.82:0/2039150991 conn(0x559e36379200 msgr2=0x559e36380230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 shutdown_connections 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 1 -- 172.21.15.82:0/2039150991 wait complete. 2023-07-20T09:50:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.350+0000 7fd114852000 20 client.4728 trim_cache size 0 max 16384 2023-07-20T09:50:42.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 Processor -- start 2023-07-20T09:50:42.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 -- start start 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e363caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e35e8d940 con 0x559e363cbd20 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e361d37c0 con 0x559e363cc640 2023-07-20T09:50:42.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e361d4c60 con 0x559e36381e90 2023-07-20T09:50:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53884/0 (socket says 172.21.15.82:53884) 2023-07-20T09:50:42.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 -- 172.21.15.82:0/1747374737 learned_addr learned my addr 172.21.15.82:0/1747374737 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:42.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 -- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 msgr2=0x559e363caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e363caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 -- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 msgr2=0x559e363db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 -- 172.21.15.82:0/1747374737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e3617afa0 con 0x559e363cbd20 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1027fc640 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001800 tx=0x7fd0f400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafae9de9237d683 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1017fa640 1 -- 172.21.15.82:0/1747374737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4001ab0 con 0x559e363cbd20 2023-07-20T09:50:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1017fa640 1 -- 172.21.15.82:0/1747374737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40054e0 con 0x559e363cbd20 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.366+0000 7fd1017fa640 1 -- 172.21.15.82:0/1747374737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4003800 con 0x559e363cbd20 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/1747374737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 msgr2=0x559e363cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4001800 tx=0x7fd0f400c000 comp rx=0 tx=0).stop 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/1747374737 shutdown_connections 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e363cbd20 0x559e363cb420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- 172.21.15.82:0/1747374737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e36381e90 0x559e363caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/1747374737 >> 172.21.15.82:0/1747374737 conn(0x559e36379200 msgr2=0x559e363ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/1747374737 shutdown_connections 2023-07-20T09:50:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/1747374737 wait complete. 2023-07-20T09:50:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- start start 2023-07-20T09:50:42.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 Processor -- start 2023-07-20T09:50:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e36429a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363dd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e362449c0 con 0x559e36381e90 2023-07-20T09:50:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e3617f310 con 0x559e363cc640 2023-07-20T09:50:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e36192540 con 0x559e363cbd20 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 10 client.0 _ll_register_callbacks cb 0x559e36248ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53898/0 (socket says 172.21.15.82:53898) 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 -- 172.21.15.82:0/790960837 learned_addr learned my addr 172.21.15.82:0/790960837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd1027fc640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e36429a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10b7fe640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363dd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 -- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 msgr2=0x559e36429a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e36429a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 -- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 msgr2=0x559e363dd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363dd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 -- 172.21.15.82:0/790960837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e36194d10 con 0x559e36381e90 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd10affd640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x559e36290a20 tx=0x7fd0fc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303dcdb59222d0c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc02a070 con 0x559e36381e90 2023-07-20T09:50:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0fc02a1d0 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e36197a20 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0fc02a390 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 10 client.4734 fetch_fsmap learned FSMap version 8 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x559e35ecccc0 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.370+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559e36197a20 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd0fc025840 con 0x559e36381e90 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 10 client.4734 fetch_fsmap finished waiting for FSMap version 8 2023-07-20T09:50:42.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 20 client.4734 populate_metadata read hostname 'smithi082' 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e36430380 0x559e36432770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 4 client.4734 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 --> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559e361c9c40 con 0x559e36430380 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd1027fc640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e36430380 0x559e36432770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd0e9ffb640 10 client.4734 ms_handle_connect on v2:172.21.15.183:6834/313910073 2023-07-20T09:50:42.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd1027fc640 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e36430380 0x559e36432770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed5101530d26a77 server_cookie=907fc7c4282b6a6b in_seq=0 out_seq=0 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd0e9ffb640 1 -- 172.21.15.82:0/790960837 <== mds.0 v2:172.21.15.183:6834/313910073 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x559e361c9c40 con 0x559e36430380 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd0e9ffb640 10 client.4734 handle_command_reply: tid=0 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 client.4734 shutdown 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 msgr2=0x559e36429520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x559e36290a20 tx=0x7fd0fc009190 comp rx=0 tx=0).stop 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 shutdown_connections 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:6834/313910073,v1:172.21.15.183:6835/313910073] conn(0x559e36430380 0x559e36432770 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559e363cc640 0x559e363dd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x559e363cbd20 0x559e36429a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 --2- 172.21.15.82:0/790960837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559e36381e90 0x559e36429520 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 >> 172.21.15.82:0/790960837 conn(0x559e36379200 msgr2=0x559e36386d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd0e9ffb640 0 client.4734 ms_handle_reset on v2:172.21.15.183:6834/313910073 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 shutdown_connections 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 1 -- 172.21.15.82:0/790960837 wait complete. 2023-07-20T09:50:42.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd114852000 20 client.4734 trim_cache size 0 max 16384 2023-07-20T09:50:42.419 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T09:50:42.419 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T09:50:42.419 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T09:50:42.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4291, 2023-07-20T09:50:42.419 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 14.683577699000001, 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 8, 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 23, 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 23, 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 20.873280114 2023-07-20T09:50:42.420 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T09:50:42.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 msgr2=0x7fd0ec068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 0x7fd0ec068770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009be0 tx=0x7fd0fc008040 comp rx=0 tx=0).stop 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 msgr2=0x7fd10c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd10401d130 tx=0x7fd0f8005800 comp rx=0 tx=0).stop 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 shutdown_connections 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd0ec0662b0 0x7fd0ec068770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd10c06ab70 0x7fd10c06aff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd10c0c8790 0x7fd10c0c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 --2- 172.21.15.82:0/755179343 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0f8004d10 0x7fd10c151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 >> 172.21.15.82:0/755179343 conn(0x7fd10c08c120 msgr2=0x7fd10c0d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 shutdown_connections 2023-07-20T09:50:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.374+0000 7fd111500640 1 -- 172.21.15.82:0/755179343 wait complete. 2023-07-20T09:50:42.432 INFO:teuthology.run_tasks:Running task kclient... 2023-07-20T09:50:42.457 INFO:tasks.kclient:Mounting kernel clients... 2023-07-20T09:50:42.458 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-20T09:50:42.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.459 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T09:50:42.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-07-20T09:50:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-07-20T09:50:42.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:50:42.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.534 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T09:50:42.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-07-20T09:50:42.652 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-07-20T09:50:42.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:50:42.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.655 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T09:50:42.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.666 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-07-20T09:50:42.735 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-07-20T09:50:42.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:50:42.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.738 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T09:50:42.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:42.794 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-07-20T09:50:42.860 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-07-20T09:50:42.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T09:50:42.863 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-20T09:50:42.863 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-20T09:50:42.864 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T09:50:42.864 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T09:50:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 Processor -- start 2023-07-20T09:50:43.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 -- start start 2023-07-20T09:50:43.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 0x7f74480d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74480cf110 0x7f74480cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480d31c0 con 0x7f74480cf110 2023-07-20T09:50:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480d16b0 con 0x7f744815cab0 2023-07-20T09:50:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744cb11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480b3520 con 0x7f74480d0d10 2023-07-20T09:50:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74480cf110 0x7f74480cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74480cf110 0x7f74480cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53906/0 (socket says 172.21.15.82:53906) 2023-07-20T09:50:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 -- 172.21.15.82:0/3518785458 learned_addr learned my addr 172.21.15.82:0/3518785458 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744659c640 1 --2- 172.21.15.82:0/3518785458 >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 0x7f74480d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f743dd9b640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 -- 172.21.15.82:0/3518785458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 msgr2=0x7f74480d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 -- 172.21.15.82:0/3518785458 >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 msgr2=0x7f74480d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 --2- 172.21.15.82:0/3518785458 >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 0x7f74480d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f7446d9d640 1 -- 172.21.15.82:0/3518785458 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480b2910 con 0x7f74480cf110 2023-07-20T09:50:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f744659c640 1 --2- 172.21.15.82:0/3518785458 >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 0x7f74480d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:43.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.966+0000 7f743dd9b640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f7446d9d640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74480cf110 0x7f74480cf5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f744806a660 tx=0x7f744001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76c30a4c22cb46 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f7445d9b640 1 -- 172.21.15.82:0/3518785458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400aa5f0 con 0x7f74480cf110 2023-07-20T09:50:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f7445d9b640 1 -- 172.21.15.82:0/3518785458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400aa750 con 0x7f74480cf110 2023-07-20T09:50:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f7445d9b640 1 -- 172.21.15.82:0/3518785458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400aaae0 con 0x7f74480cf110 2023-07-20T09:50:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 -- 172.21.15.82:0/3518785458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74480cf110 msgr2=0x7f74480cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74480cf110 0x7f74480cf5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f744806a660 tx=0x7f744001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 -- 172.21.15.82:0/3518785458 shutdown_connections 2023-07-20T09:50:43.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74480cf110 0x7f74480cf5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 --2- 172.21.15.82:0/3518785458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 --2- 172.21.15.82:0/3518785458 >> v2:172.21.15.183:3300/0 conn(0x7f744815cab0 0x7f74480d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 -- 172.21.15.82:0/3518785458 >> 172.21.15.82:0/3518785458 conn(0x7f744808c120 msgr2=0x7f744809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:43.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 -- 172.21.15.82:0/3518785458 shutdown_connections 2023-07-20T09:50:43.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.970+0000 7f744cb11640 1 -- 172.21.15.82:0/3518785458 wait complete. 2023-07-20T09:50:43.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 Processor -- start 2023-07-20T09:50:43.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- start start 2023-07-20T09:50:43.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 0x7f74480c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c7140 con 0x7f744815cab0 2023-07-20T09:50:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c6490 con 0x7f74480cf110 2023-07-20T09:50:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744815fc80 con 0x7f74480d0d10 2023-07-20T09:50:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53918/0 (socket says 172.21.15.82:53918) 2023-07-20T09:50:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 -- 172.21.15.82:0/4069984053 learned_addr learned my addr 172.21.15.82:0/4069984053 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744659c640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 0x7f74480c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f743dd9b640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 -- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 msgr2=0x7f74480d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:43.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 -- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 msgr2=0x7f74480c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:43.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 0x7f74480c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 -- 172.21.15.82:0/4069984053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74400094d0 con 0x7f744815cab0 2023-07-20T09:50:43.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744659c640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 0x7f74480c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:43.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f7446d9d640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f74400ac040 tx=0x7f744001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:43.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400b3800 con 0x7f744815cab0 2023-07-20T09:50:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400b3960 con 0x7f744815cab0 2023-07-20T09:50:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744815ff60 con 0x7f744815cab0 2023-07-20T09:50:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400b3d10 con 0x7f744815cab0 2023-07-20T09:50:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.974+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74480ca6e0 con 0x7f744815cab0 2023-07-20T09:50:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74481601a0 con 0x7f744815cab0 2023-07-20T09:50:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74400c6390 con 0x7f744815cab0 2023-07-20T09:50:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f743f7fe640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 0x7f7428068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74400a7070 con 0x7f744815cab0 2023-07-20T09:50:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f744659c640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 0x7f7428068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.978+0000 7f744659c640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 0x7f7428068740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7438006fd0 tx=0x7f7438008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:42.982+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74481601a0 con 0x7f744815cab0 2023-07-20T09:50:43.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74480ca260 con 0x7f744815cab0 2023-07-20T09:50:43.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f743f7fe640 1 -- 172.21.15.82:0/4069984053 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f74480ca260 con 0x7f744815cab0 2023-07-20T09:50:43.198 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T09:50:43.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 msgr2=0x7f7428068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:43.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 0x7f7428068740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7438006fd0 tx=0x7f7438008040 comp rx=0 tx=0).stop 2023-07-20T09:50:43.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 msgr2=0x7f74480d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:43.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f74400ac040 tx=0x7f744001ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:43.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 shutdown_connections 2023-07-20T09:50:43.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7428066280 0x7f7428068740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f744815cab0 0x7f74480d2a60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74480d0d10 0x7f74480d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 --2- 172.21.15.82:0/4069984053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74480cf110 0x7f74480c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:43.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 >> 172.21.15.82:0/4069984053 conn(0x7f744808c120 msgr2=0x7f74480af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:43.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 shutdown_connections 2023-07-20T09:50:43.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:43.162+0000 7f744cb11640 1 -- 172.21.15.82:0/4069984053 wait complete. 2023-07-20T09:50:43.219 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-20T09:50:43.219 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T09:50:43.220 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T09:50:43.220 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T09:50:43.220 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T09:50:43.220 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-20T09:50:43.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-20T09:50:43.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T09:50:43.221 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T09:50:43.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.221 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T09:50:43.230 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:43.230 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:43.231 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T09:50:43.232 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42358sec preferred_lft 42358sec 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:43.233 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T09:50:43.234 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:43.234 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-20T09:50:43.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.235 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:43.235 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:43.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2023-07-20T09:50:43.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2023-07-20T09:50:43.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2023-07-20T09:50:43.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-20T09:50:43.236 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:43.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.349 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T09:50:43.368 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T09:50:43.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.370 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T09:50:43.437 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:43.438 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:43.439 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:43.439 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T09:50:43.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.440 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:43.440 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:43.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T09:50:43.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T09:50:43.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T09:50:43.441 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:43.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.536 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T09:50:43.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.547 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-07-20T09:50:43.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.598 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:43.598 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:43.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T09:50:43.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-20T09:50:43.599 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:43.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-20T09:50:43.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.683 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:43.683 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:43.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-20T09:50:43.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-20T09:50:43.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-20T09:50:43.684 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-20T09:50:43.685 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-20T09:50:43.685 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:43.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:43.855 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:43.856 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:43.856 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T09:50:43.857 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2023-07-20T09:50:43.857 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:43.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:43.901 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T09:50:43.953 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T09:50:43.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:43.954 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T09:50:44.004 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T09:50:44.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:50:44.115 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:50:44.115 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:50:44.115 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:50:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:50:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:44.237 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:50:44.249 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:50:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:44.250 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T09:50:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T09:50:44.251 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T09:50:44.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T09:50:44.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T09:50:44.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.277 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:44.350 INFO:teuthology.orchestra.run.smithi082.stdout:client4520 2023-07-20T09:50:44.350 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:44.351 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.401 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:44.465 INFO:teuthology.orchestra.run.smithi082.stdout:client4520 2023-07-20T09:50:44.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.466 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:44.529 INFO:teuthology.orchestra.run.smithi082.stdout:client4520 2023-07-20T09:50:44.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:44.530 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/79d507c4-9484-40cb-9468-5aa547ff1f30.client4520/status') 2023-07-20T09:50:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4520 (3)172.21.15.82:0/2553112777 2023-07-20T09:50:44.600 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2023-07-20T09:50:44.600 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2023-07-20T09:50:44.600 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2023-07-20T09:50:44.600 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 5.0107e-05 s, 1.4 MB/s 2023-07-20T09:50:44.602 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-20T09:50:44.602 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-20T09:50:44.602 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-20T09:50:44.603 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T09:50:44.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 Processor -- start 2023-07-20T09:50:44.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 -- start start 2023-07-20T09:50:44.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f33441596b0 0x7f334415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440ccd90 con 0x7f33440cc900 2023-07-20T09:50:44.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440ad810 con 0x7f33440b2a90 2023-07-20T09:50:44.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334bd8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334415d0d0 con 0x7f33441596b0 2023-07-20T09:50:44.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334932a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f33440cc900 0x7f33440b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57942/0 (socket says 172.21.15.82:57942) 2023-07-20T09:50:44.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f334932a640 1 -- 172.21.15.82:0/3493391718 learned_addr learned my addr 172.21.15.82:0/3493391718 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:44.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> v2:172.21.15.183:3300/0 conn(0x7f33441596b0 0x7f334415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.746+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487807900 0 0) 0x7f33440ccd90 con 0x7f33440cc900 2023-07-20T09:50:44.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3330003530 con 0x7f33440cc900 2023-07-20T09:50:44.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4114660179 0 0) 0x7f3330003530 con 0x7f33440cc900 2023-07-20T09:50:44.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 >> v2:172.21.15.183:3300/0 conn(0x7f33441596b0 msgr2=0x7f334415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:44.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 --2- 172.21.15.82:0/3493391718 >> v2:172.21.15.183:3300/0 conn(0x7f33441596b0 0x7f334415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 >> v1:172.21.15.183:6789/0 conn(0x7f33440b2a90 legacy=0x7f33440c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334415d3b0 con 0x7f33440cc900 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f3334001680 con 0x7f33440cc900 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> v2:172.21.15.183:3300/0 conn(0x7f33441596b0 0x7f334415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 >> v1:172.21.15.82:6789/0 conn(0x7f33440cc900 legacy=0x7f33440b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 0x7f3330003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33300047d0 0x7f3330004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3330005190 0x7f333000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334415d0d0 con 0x7f3330003980 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333000c030 con 0x7f33300047d0 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333000c1f0 con 0x7f3330005190 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 0x7f3330003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f334932a640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33300047d0 0x7f3330004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f334a32c640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3330005190 0x7f333000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 -- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3330005190 msgr2=0x7f333000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3330005190 0x7f333000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 -- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33300047d0 msgr2=0x7f3330004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33300047d0 0x7f3330004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 -- 172.21.15.82:0/3493391718 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330003530 con 0x7f3330003980 2023-07-20T09:50:44.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f334a32c640 1 -- 172.21.15.82:0/3493391718 reap_dead start 2023-07-20T09:50:44.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.750+0000 7f3349b2b640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 0x7f3330003da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f334000e350 tx=0x7f334001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba94e0a21e36058 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400a5d20 con 0x7f3330003980 2023-07-20T09:50:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000f040 con 0x7f3330003980 2023-07-20T09:50:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f3348b29640 1 -- 172.21.15.82:0/3493391718 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400ad640 con 0x7f3330003980 2023-07-20T09:50:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 msgr2=0x7f3330003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 0x7f3330003da0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f334000e350 tx=0x7f334001cdb0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- 172.21.15.82:0/3493391718 shutdown_connections 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 --2- 172.21.15.82:0/3493391718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3330003980 0x7f3330003da0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- 172.21.15.82:0/3493391718 >> 172.21.15.82:0/3493391718 conn(0x7f33440cada0 msgr2=0x7f33440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- 172.21.15.82:0/3493391718 shutdown_connections 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- 172.21.15.82:0/3493391718 wait complete. 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 Processor -- start 2023-07-20T09:50:44.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- start start 2023-07-20T09:50:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3330003980 0x7f334415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f334415a460 0x7f334415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c2ad0 con 0x7f33440c5950 2023-07-20T09:50:44.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c1e50 con 0x7f3330003980 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334bd8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c2130 con 0x7f334415a460 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334932a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334932a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55324/0 (socket says 172.21.15.82:55324) 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.754+0000 7f334932a640 1 -- 172.21.15.82:0/689754816 learned_addr learned my addr 172.21.15.82:0/689754816 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f3349b2b640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3330003980 0x7f334415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334a32c640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f334415a460 0x7f334415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 -- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f334415a460 msgr2=0x7f334415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f334415a460 0x7f334415a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 -- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3330003980 msgr2=0x7f334415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3330003980 0x7f334415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 -- 172.21.15.82:0/689754816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440c2410 con 0x7f33440c5950 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334932a640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3334007320 tx=0x7f3334007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400fa00 con 0x7f33440c5950 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400fb80 con 0x7f33440c5950 2023-07-20T09:50:44.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33440c26f0 con 0x7f33440c5950 2023-07-20T09:50:44.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340133f0 con 0x7f33440c5950 2023-07-20T09:50:44.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334415b780 con 0x7f33440c5950 2023-07-20T09:50:44.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334415b970 con 0x7f33440c5950 2023-07-20T09:50:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3334013550 con 0x7f33440c5950 2023-07-20T09:50:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 0x7f3328068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3334083fe0 con 0x7f33440c5950 2023-07-20T09:50:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.758+0000 7f3349b2b640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 0x7f3328068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.762+0000 7f3349b2b640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 0x7f3328068740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33400af000 tx=0x7f3340004ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:44.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.762+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f334415b970 con 0x7f33440c5950 2023-07-20T09:50:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.942+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33440c2c10 con 0x7f33440c5950 2023-07-20T09:50:44.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.942+0000 7f333a7fc640 1 -- 172.21.15.82:0/689754816 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f33440c2c10 con 0x7f33440c5950 2023-07-20T09:50:44.981 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 msgr2=0x7f3328068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 0x7f3328068740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33400af000 tx=0x7f3340004ac0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 msgr2=0x7f33440c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3334007320 tx=0x7f3334007720 comp rx=0 tx=0).stop 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 shutdown_connections 2023-07-20T09:50:44.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3328066280 0x7f3328068740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f334415a460 0x7f334415a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33440c5950 0x7f33440c5dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 --2- 172.21.15.82:0/689754816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3330003980 0x7f334415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 >> 172.21.15.82:0/689754816 conn(0x7f33440cada0 msgr2=0x7f33440cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 shutdown_connections 2023-07-20T09:50:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:44.946+0000 7f334bd8f640 1 -- 172.21.15.82:0/689754816 wait complete. 2023-07-20T09:50:45.002 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-20T09:50:45.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-20T09:50:45.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T09:50:45.004 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-20T09:50:45.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.004 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T09:50:45.013 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.014 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.015 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42356sec preferred_lft 42356sec 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T09:50:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-20T09:50:45.017 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.018 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T09:50:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T09:50:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T09:50:45.018 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.020 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T09:50:45.079 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T09:50:45.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.082 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T09:50:45.139 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T09:50:45.140 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:45.141 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:45.141 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:45.141 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T09:50:45.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.141 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:45.142 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:45.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T09:50:45.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T09:50:45.143 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T09:50:45.144 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:45.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.237 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T09:50:45.245 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T09:50:45.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.247 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2023-07-20T09:50:45.301 INFO:teuthology.orchestra.run.smithi082.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-20T09:50:45.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.302 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:45.303 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:45.303 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T09:50:45.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-20T09:50:45.304 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:45.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.385 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-20T09:50:45.446 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:45.446 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:4e:9c:af:3d:a5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f04e:9cff:feaf:3da5/64 scope link tentative 2023-07-20T09:50:45.447 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-20T09:50:45.510 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.510 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether f2:4e:9c:af:3d:a5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::f04e:9cff:feaf:3da5/64 scope link tentative 2023-07-20T09:50:45.511 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:45.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-20T09:50:45.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.513 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:45.513 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:45.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-20T09:50:45.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-20T09:50:45.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-20T09:50:45.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-20T09:50:45.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-20T09:50:45.515 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:45.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.655 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:50:45.655 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:50:45.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.1 up 2023-07-20T09:50:45.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.1 master ceph-brx 2023-07-20T09:50:45.657 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:50:45.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:45.701 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-20T09:50:45.753 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-20T09:50:45.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:45.754 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-20T09:50:45.804 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T09:50:45.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-20T09:50:45.895 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-20T09:50:45.895 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-20T09:50:45.895 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:45.910 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-20T09:50:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-20T09:50:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:45.911 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:45.920 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-20T09:50:45.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-20T09:50:45.920 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:50:45.920 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:45.921 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:45.921 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T09:50:45.921 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T09:50:45.921 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T09:50:45.923 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T09:50:45.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.924 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-20T09:50:45.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:45.946 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:46.005 INFO:teuthology.orchestra.run.smithi082.stdout:client4749 2023-07-20T09:50:46.005 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:46.005 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:46.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.057 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:46.112 INFO:teuthology.orchestra.run.smithi082.stdout:client4749 2023-07-20T09:50:46.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.113 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:46.163 INFO:teuthology.orchestra.run.smithi082.stdout:client4749 2023-07-20T09:50:46.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.164 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/79d507c4-9484-40cb-9468-5aa547ff1f30.client4749/status') 2023-07-20T09:50:46.224 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.4749 (3)192.168.0.2:0/3393202508 2023-07-20T09:50:46.225 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2023-07-20T09:50:46.225 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2023-07-20T09:50:46.225 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2023-07-20T09:50:46.225 INFO:teuthology.orchestra.run.smithi082.stderr:69 bytes copied, 6.9116e-05 s, 998 kB/s 2023-07-20T09:50:46.226 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-20T09:50:46.227 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-20T09:50:46.227 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-20T09:50:46.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T09:50:46.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 Processor -- start 2023-07-20T09:50:46.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 -- start start 2023-07-20T09:50:46.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 0x7f597c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f597c0d0d10 0x7f597c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c0d16b0 con 0x7f597c0cf110 2023-07-20T09:50:46.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0d31c0 con 0x7f597c0d0d10 2023-07-20T09:50:46.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f5983448640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0b3520 con 0x7f597c15cab0 2023-07-20T09:50:46.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f597c0d0d10 0x7f597c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f597c0d0d10 0x7f597c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55340/0 (socket says 172.21.15.82:55340) 2023-07-20T09:50:46.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 -- 172.21.15.82:0/3725161322 learned_addr learned my addr 172.21.15.82:0/3725161322 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59811e4640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 0x7f597c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 -- 172.21.15.82:0/3725161322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 msgr2=0x7f597c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 0x7f597c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 -- 172.21.15.82:0/3725161322 >> v1:172.21.15.183:6789/0 conn(0x7f597c0cf110 legacy=0x7f597c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59809e3640 1 -- 172.21.15.82:0/3725161322 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c0b2910 con 0x7f597c0d0d10 2023-07-20T09:50:46.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.374+0000 7f59811e4640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 0x7f597c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:46.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f59809e3640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c0d0d10 0x7f597c0d1170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f596c009870 tx=0x7f596c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70301e4a8d6a9c5b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:46.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5973fff640 1 -- 172.21.15.82:0/3725161322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c0aa5f0 con 0x7f597c0d0d10 2023-07-20T09:50:46.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5973fff640 1 -- 172.21.15.82:0/3725161322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c0aa750 con 0x7f597c0d0d10 2023-07-20T09:50:46.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5973fff640 1 -- 172.21.15.82:0/3725161322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c0aaae0 con 0x7f597c0d0d10 2023-07-20T09:50:46.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 -- 172.21.15.82:0/3725161322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c0d0d10 msgr2=0x7f597c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:46.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c0d0d10 0x7f597c0d1170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f596c009870 tx=0x7f596c01c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 -- 172.21.15.82:0/3725161322 shutdown_connections 2023-07-20T09:50:46.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c0d0d10 0x7f597c0d1170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 --2- 172.21.15.82:0/3725161322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c15cab0 0x7f597c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 -- 172.21.15.82:0/3725161322 >> 172.21.15.82:0/3725161322 conn(0x7f597c08c120 msgr2=0x7f597c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:46.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 -- 172.21.15.82:0/3725161322 shutdown_connections 2023-07-20T09:50:46.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.378+0000 7f5983448640 1 -- 172.21.15.82:0/3725161322 wait complete. 2023-07-20T09:50:46.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 Processor -- start 2023-07-20T09:50:46.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- start start 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c0cf110 0x7f597c157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c0d0d10 0x7f597c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0cab60 con 0x7f597c15cab0 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0c9800 con 0x7f597c0d0d10 2023-07-20T09:50:46.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c0c9ac0 con 0x7f597c0cf110 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55342/0 (socket says 172.21.15.82:55342) 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 -- 172.21.15.82:0/3016471465 learned_addr learned my addr 172.21.15.82:0/3016471465 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59809e3640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c0d0d10 0x7f597c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59811e4640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c0cf110 0x7f597c157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 -- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c0cf110 msgr2=0x7f597c157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:46.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c0cf110 0x7f597c157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 -- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c0d0d10 msgr2=0x7f597c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c0d0d10 0x7f597c15ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 -- 172.21.15.82:0/3016471465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0094d0 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f59819e5640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f597400b970 tx=0x7f597400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597400cb40 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597400cca0 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c0c9da0 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974014680 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c0ca360 con 0x7f597c15cab0 2023-07-20T09:50:46.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.382+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c073c70 con 0x7f597c15cab0 2023-07-20T09:50:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.386+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f597401d3b0 con 0x7f597c15cab0 2023-07-20T09:50:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.386+0000 7f5971ffb640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 0x7f5960068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.386+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5974083b00 con 0x7f597c15cab0 2023-07-20T09:50:46.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.386+0000 7f59811e4640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 0x7f5960068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:46.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.386+0000 7f59811e4640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 0x7f5960068740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f597800a9a0 tx=0x7f5978008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:46.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.390+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5974085e60 con 0x7f597c15cab0 2023-07-20T09:50:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f597c0b2590 con 0x7f597c15cab0 2023-07-20T09:50:46.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5971ffb640 1 -- 172.21.15.82:0/3016471465 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5974051020 con 0x7f597c15cab0 2023-07-20T09:50:46.607 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T09:50:46.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 msgr2=0x7f5960068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:46.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 0x7f5960068740 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f597800a9a0 tx=0x7f5978008040 comp rx=0 tx=0).stop 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 msgr2=0x7f597c15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f597400b970 tx=0x7f597400be30 comp rx=0 tx=0).stop 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 shutdown_connections 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5960066280 0x7f5960068740 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f597c15cab0 0x7f597c15bf70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c0d0d10 0x7f597c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 --2- 172.21.15.82:0/3016471465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f597c0cf110 0x7f597c157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 >> 172.21.15.82:0/3016471465 conn(0x7f597c08c120 msgr2=0x7f597c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 shutdown_connections 2023-07-20T09:50:46.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:46.570+0000 7f5983448640 1 -- 172.21.15.82:0/3016471465 wait complete. 2023-07-20T09:50:46.626 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-20T09:50:46.627 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T09:50:46.627 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-07-20T09:50:46.627 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-20T09:50:46.627 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-20T09:50:46.628 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-20T09:50:46.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-20T09:50:46.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T09:50:46.628 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-20T09:50:46.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.629 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-07-20T09:50:46.639 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:46.639 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:46.640 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T09:50:46.641 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:42:37:b9:57:aa brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T09:50:46.642 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:46.643 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-20T09:50:46.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.644 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:46.644 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:46.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add name ceph-brx type bridge 2023-07-20T09:50:46.645 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr flush dev ceph-brx 2023-07-20T09:50:46.645 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set ceph-brx up 2023-07-20T09:50:46.645 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-20T09:50:46.645 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:46.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.768 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T09:50:46.787 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-07-20T09:50:46.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.789 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-07-20T09:50:46.869 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T09:50:46.870 INFO:teuthology.orchestra.run.smithi183.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:46.871 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:46.871 INFO:teuthology.orchestra.run.smithi183.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:46.871 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T09:50:46.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.871 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:46.872 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:46.872 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T09:50:46.872 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T09:50:46.872 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T09:50:46.873 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:46.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.969 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T09:50:46.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:46.979 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-07-20T09:50:47.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.029 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:47.029 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:47.029 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-20T09:50:47.029 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-20T09:50:47.030 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:47.112 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-20T09:50:47.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.112 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:47.113 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:47.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-20T09:50:47.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-20T09:50:47.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-20T09:50:47.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-20T09:50:47.114 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-20T09:50:47.114 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:47.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.280 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:47.280 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:47.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.0 up 2023-07-20T09:50:47.280 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.0 master ceph-brx 2023-07-20T09:50:47.281 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:47.323 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:47.323 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-20T09:50:47.375 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-20T09:50:47.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:47.376 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-20T09:50:47.426 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T09:50:47.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.452 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-20T09:50:47.525 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-20T09:50:47.525 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-20T09:50:47.525 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:47.640 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-20T09:50:47.641 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-20T09:50:47.641 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:47.641 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:47.641 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:47.651 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T09:50:47.652 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T09:50:47.652 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T09:50:47.654 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T09:50:47.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.655 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-20T09:50:47.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.677 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:47.750 INFO:teuthology.orchestra.run.smithi183.stdout:client4529 2023-07-20T09:50:47.750 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:47.751 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:47.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.804 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:47.858 INFO:teuthology.orchestra.run.smithi183.stdout:client4529 2023-07-20T09:50:47.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.858 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:47.913 INFO:teuthology.orchestra.run.smithi183.stdout:client4529 2023-07-20T09:50:47.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:47.914 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/79d507c4-9484-40cb-9468-5aa547ff1f30.client4529/status') 2023-07-20T09:50:47.976 INFO:teuthology.orchestra.run.smithi183.stdout:instance: client.4529 (3)192.168.0.1:0/3150940068 2023-07-20T09:50:47.976 INFO:teuthology.orchestra.run.smithi183.stdout:blocklisted: false 2023-07-20T09:50:47.976 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records in 2023-07-20T09:50:47.976 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records out 2023-07-20T09:50:47.977 INFO:teuthology.orchestra.run.smithi183.stderr:69 bytes copied, 5.388e-05 s, 1.3 MB/s 2023-07-20T09:50:47.978 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-20T09:50:47.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-20T09:50:47.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-20T09:50:47.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T09:50:48.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.090+0000 7fd67d3f3640 1 Processor -- start 2023-07-20T09:50:48.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd67d3f3640 1 -- start start 2023-07-20T09:50:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd67d3f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd67815a8e0 0x7fd6780ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd67d3f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6780b12a0 con 0x7fd6780afda0 2023-07-20T09:50:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd67d3f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6780b1580 con 0x7fd6780b2060 2023-07-20T09:50:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd67d3f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6780b3160 con 0x7fd67815a8e0 2023-07-20T09:50:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd66e7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd67815a8e0 0x7fd6780ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd676ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6780afda0 0x7fd6780b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57952/0 (socket says 172.21.15.82:57952) 2023-07-20T09:50:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd676ffd640 1 -- 172.21.15.82:0/4226238846 learned_addr learned my addr 172.21.15.82:0/4226238846 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd66e7fc640 1 -- 172.21.15.82:0/4226238846 >> v1:172.21.15.183:6789/0 conn(0x7fd6780b2060 legacy=0x7fd6780b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd66e7fc640 1 -- 172.21.15.82:0/4226238846 >> v1:172.21.15.82:6789/0 conn(0x7fd6780afda0 legacy=0x7fd6780b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.094+0000 7fd66e7fc640 1 -- 172.21.15.82:0/4226238846 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780b1860 con 0x7fd67815a8e0 2023-07-20T09:50:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd66e7fc640 1 --2- 172.21.15.82:0/4226238846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67815a8e0 0x7fd6780ca6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6600097c0 tx=0x7fd66001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a77d9a19b27e7d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:48.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd6767fc640 1 -- 172.21.15.82:0/4226238846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600ab600 con 0x7fd67815a8e0 2023-07-20T09:50:48.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd6767fc640 1 -- 172.21.15.82:0/4226238846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6600a7050 con 0x7fd67815a8e0 2023-07-20T09:50:48.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd6767fc640 1 -- 172.21.15.82:0/4226238846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6600ab980 con 0x7fd67815a8e0 2023-07-20T09:50:48.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- 172.21.15.82:0/4226238846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67815a8e0 msgr2=0x7fd6780ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/4226238846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67815a8e0 0x7fd6780ca6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd6600097c0 tx=0x7fd66001c330 comp rx=0 tx=0).stop 2023-07-20T09:50:48.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- 172.21.15.82:0/4226238846 shutdown_connections 2023-07-20T09:50:48.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/4226238846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd67815a8e0 0x7fd6780ca6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- 172.21.15.82:0/4226238846 >> 172.21.15.82:0/4226238846 conn(0x7fd6780cada0 msgr2=0x7fd6780cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:48.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- 172.21.15.82:0/4226238846 shutdown_connections 2023-07-20T09:50:48.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- 172.21.15.82:0/4226238846 wait complete. 2023-07-20T09:50:48.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 Processor -- start 2023-07-20T09:50:48.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.098+0000 7fd67d3f3640 1 -- start start 2023-07-20T09:50:48.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780b2060 0x7fd678153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67815a8e0 0x7fd6781f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67815afa0 con 0x7fd6780afda0 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67815b280 con 0x7fd67815a8e0 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67815b560 con 0x7fd6780b2060 2023-07-20T09:50:48.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:48.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55366/0 (socket says 172.21.15.82:55366) 2023-07-20T09:50:48.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 -- 172.21.15.82:0/1065893051 learned_addr learned my addr 172.21.15.82:0/1065893051 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:48.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd6777fe640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67815a8e0 0x7fd6781f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:48.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd66e7fc640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780b2060 0x7fd678153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:48.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 -- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780b2060 msgr2=0x7fd678153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780b2060 0x7fd678153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 -- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67815a8e0 msgr2=0x7fd6781f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67815a8e0 0x7fd6781f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 -- 172.21.15.82:0/1065893051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660009420 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd676ffd640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c400 tx=0x7fd66800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668005cf0 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668005e50 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6680072d0 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6781f33f0 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6780ac7b0 con 0x7fd6780afda0 2023-07-20T09:50:48.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6780ac9a0 con 0x7fd6780afda0 2023-07-20T09:50:48.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.102+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd668007430 con 0x7fd6780afda0 2023-07-20T09:50:48.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.106+0000 7fd66ffff640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 0x7fd658068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:48.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.106+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd668083200 con 0x7fd6780afda0 2023-07-20T09:50:48.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.106+0000 7fd66e7fc640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 0x7fd658068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:48.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.106+0000 7fd66e7fc640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 0x7fd658068740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6600ad000 tx=0x7fd6600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:48.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.110+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd668050720 con 0x7fd6780afda0 2023-07-20T09:50:48.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.290+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd678073c70 con 0x7fd6780afda0 2023-07-20T09:50:48.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.290+0000 7fd66ffff640 1 -- 172.21.15.82:0/1065893051 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd668053d40 con 0x7fd6780afda0 2023-07-20T09:50:48.328 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T09:50:48.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.290+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 msgr2=0x7fd658068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 0x7fd658068740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6600ad000 tx=0x7fd6600a6000 comp rx=0 tx=0).stop 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 msgr2=0x7fd6780ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c400 tx=0x7fd66800c8c0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 shutdown_connections 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fd658066280 0x7fd658068740 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd67815a8e0 0x7fd6781f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6780b2060 0x7fd678153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 --2- 172.21.15.82:0/1065893051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6780afda0 0x7fd6780ac270 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 >> 172.21.15.82:0/1065893051 conn(0x7fd6780cada0 msgr2=0x7fd6780acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 shutdown_connections 2023-07-20T09:50:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:48.294+0000 7fd67d3f3640 1 -- 172.21.15.82:0/1065893051 wait complete. 2023-07-20T09:50:48.348 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-20T09:50:48.348 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T09:50:48.349 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi183.front.sepia.ceph.com 2023-07-20T09:50:48.349 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-20T09:50:48.349 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-20T09:50:48.350 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-20T09:50:48.350 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-20T09:50:48.350 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T09:50:48.350 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-20T09:50:48.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.351 DEBUG:teuthology.orchestra.run.smithi183:> ip addr 2023-07-20T09:50:48.360 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:48.360 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:aa brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f0 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:d9:38:ab brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout: altname enp7s0f1 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:84 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0c:c4:7a:88:80:85 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.362 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.21.15.183/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft 42262sec preferred_lft 42262sec 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::ec4:7aff:fe88:8085/64 scope link 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 02:42:37:b9:57:aa brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T09:50:48.363 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.364 INFO:teuthology.orchestra.run.smithi183.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T09:50:48.365 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-20T09:50:48.365 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-20T09:50:48.365 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.366 DEBUG:teuthology.orchestra.run.smithi183:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T09:50:48.421 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-07-20T09:50:48.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.424 DEBUG:teuthology.orchestra.run.smithi183:> route 2023-07-20T09:50:48.477 INFO:teuthology.orchestra.run.smithi183.stdout:Kernel IP routing table 2023-07-20T09:50:48.477 INFO:teuthology.orchestra.run.smithi183.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T09:50:48.477 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T09:50:48.477 INFO:teuthology.orchestra.run.smithi183.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T09:50:48.477 INFO:teuthology.orchestra.run.smithi183.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run.smithi183.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run.smithi183.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run.smithi183.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T09:50:48.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.479 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:48.479 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:48.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T09:50:48.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T09:50:48.480 DEBUG:teuthology.orchestra.run.smithi183:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T09:50:48.480 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:48.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.574 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T09:50:48.584 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-20T09:50:48.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.585 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list-id 2023-07-20T09:50:48.639 INFO:teuthology.orchestra.run.smithi183.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-20T09:50:48.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.640 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:48.640 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:48.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-20T09:50:48.641 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-20T09:50:48.641 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:48.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.724 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-20T09:50:48.788 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:48.788 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:48.788 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:48.788 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.788 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether ea:e5:81:cf:24:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::e8e5:81ff:fecf:24e9/64 scope link tentative 2023-07-20T09:50:48.789 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.790 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-20T09:50:48.852 INFO:teuthology.orchestra.run.smithi183.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:50:48.852 INFO:teuthology.orchestra.run.smithi183.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:50:48.852 INFO:teuthology.orchestra.run.smithi183.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:50:48.852 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.852 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 ::1/128 scope host 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: link/ether ea:e5:81:cf:24:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: inet6 fe80::e8e5:81ff:fecf:24e9/64 scope link tentative 2023-07-20T09:50:48.853 INFO:teuthology.orchestra.run.smithi183.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:50:48.854 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-20T09:50:48.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.855 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:48.855 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:48.855 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-20T09:50:48.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-20T09:50:48.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-20T09:50:48.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-20T09:50:48.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-20T09:50:48.856 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:48.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:48.995 DEBUG:teuthology.orchestra.run.smithi183:> (cd / && exec bash -c ' 2023-07-20T09:50:48.995 DEBUG:teuthology.orchestra.run.smithi183:> set -e 2023-07-20T09:50:48.996 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set brx.1 up 2023-07-20T09:50:48.996 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link set dev brx.1 master ceph-brx 2023-07-20T09:50:48.996 DEBUG:teuthology.orchestra.run.smithi183:> ') 2023-07-20T09:50:49.037 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:49.038 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-20T09:50:49.091 INFO:teuthology.orchestra.run.smithi183.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-20T09:50:49.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:50:49.092 DEBUG:teuthology.orchestra.run.smithi183:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-20T09:50:49.147 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T09:50:49.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.147 DEBUG:teuthology.orchestra.run.smithi183:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-20T09:50:49.237 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-20T09:50:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-20T09:50:49.238 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:49.252 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-20T09:50:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-20T09:50:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:49.253 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-20T09:50:49.261 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:invalid new device string format 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T09:50:49.262 INFO:teuthology.orchestra.run.smithi183.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T09:50:49.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T09:50:49.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.266 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-20T09:50:49.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.288 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:49.341 INFO:teuthology.orchestra.run.smithi183.stdout:client4767 2023-07-20T09:50:49.342 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:50:49.342 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:49.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.396 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:49.453 INFO:teuthology.orchestra.run.smithi183.stdout:client4767 2023-07-20T09:50:49.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.454 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:50:49.505 INFO:teuthology.orchestra.run.smithi183.stdout:client4767 2023-07-20T09:50:49.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:50:49.506 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/79d507c4-9484-40cb-9468-5aa547ff1f30.client4767/status') 2023-07-20T09:50:49.571 INFO:teuthology.orchestra.run.smithi183.stdout:instance: client.4767 (3)172.21.15.183:0/1558790950 2023-07-20T09:50:49.571 INFO:teuthology.orchestra.run.smithi183.stdout:blocklisted: false 2023-07-20T09:50:49.572 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records in 2023-07-20T09:50:49.572 INFO:teuthology.orchestra.run.smithi183.stderr:0+1 records out 2023-07-20T09:50:49.572 INFO:teuthology.orchestra.run.smithi183.stderr:71 bytes copied, 6.2501e-05 s, 1.1 MB/s 2023-07-20T09:50:49.573 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-20T09:50:49.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:49.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 Processor -- start 2023-07-20T09:50:49.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 -- start start 2023-07-20T09:50:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5d200b1f30 0x7f5d200b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5d2015c120 0x7f5d2015c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d200cf4a0 con 0x7f5d2006f350 2023-07-20T09:50:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d200b2900 con 0x7f5d2015c120 2023-07-20T09:50:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.702+0000 7f5d259fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2006ea80 con 0x7f5d200b1f30 2023-07-20T09:50:49.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5d2006f350 0x7f5d2006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57956/0 (socket says 172.21.15.82:57956) 2023-07-20T09:50:49.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1effd640 1 -- 172.21.15.82:0/2590184933 learned_addr learned my addr 172.21.15.82:0/2590184933 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:49.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 --2- 172.21.15.82:0/2590184933 >> v2:172.21.15.82:3300/0 conn(0x7f5d2015c120 0x7f5d2015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1e7fc640 1 --2- 172.21.15.82:0/2590184933 >> v2:172.21.15.183:3300/0 conn(0x7f5d200b1f30 0x7f5d200b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1dffb640 1 -- 172.21.15.82:0/2590184933 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646508804 0 0) 0x7f5d200cf4a0 con 0x7f5d2006f350 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1dffb640 1 -- 172.21.15.82:0/2590184933 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d08003530 con 0x7f5d2006f350 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 -- 172.21.15.82:0/2590184933 >> v2:172.21.15.183:3300/0 conn(0x7f5d200b1f30 msgr2=0x7f5d200b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 --2- 172.21.15.82:0/2590184933 >> v2:172.21.15.183:3300/0 conn(0x7f5d200b1f30 0x7f5d200b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 -- 172.21.15.82:0/2590184933 >> v1:172.21.15.82:6789/0 conn(0x7f5d2006f350 legacy=0x7f5d2006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 -- 172.21.15.82:0/2590184933 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200ce890 con 0x7f5d2015c120 2023-07-20T09:50:49.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1f7fe640 1 --2- 172.21.15.82:0/2590184933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2015c120 0x7f5d2015c530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d200cfe50 tx=0x7f5d1801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ff8b30581b235b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:49.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1dffb640 1 -- 172.21.15.82:0/2590184933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180ab600 con 0x7f5d2015c120 2023-07-20T09:50:49.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1dffb640 1 -- 172.21.15.82:0/2590184933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d180a7050 con 0x7f5d2015c120 2023-07-20T09:50:49.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.706+0000 7f5d1dffb640 1 -- 172.21.15.82:0/2590184933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180ab960 con 0x7f5d2015c120 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- 172.21.15.82:0/2590184933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2015c120 msgr2=0x7f5d2015c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- 172.21.15.82:0/2590184933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2015c120 0x7f5d2015c530 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5d200cfe50 tx=0x7f5d1801c3a0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- 172.21.15.82:0/2590184933 shutdown_connections 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- 172.21.15.82:0/2590184933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d2015c120 0x7f5d2015c530 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- 172.21.15.82:0/2590184933 >> v2:172.21.15.183:3300/0 conn(0x7f5d200b1f30 0x7f5d200b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- 172.21.15.82:0/2590184933 >> 172.21.15.82:0/2590184933 conn(0x7f5d20089fa0 msgr2=0x7f5d200d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- 172.21.15.82:0/2590184933 shutdown_connections 2023-07-20T09:50:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- 172.21.15.82:0/2590184933 wait complete. 2023-07-20T09:50:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 Processor -- start 2023-07-20T09:50:49.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- start start 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d2006f350 0x7f5d20156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d2015c120 0x7f5d200cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200cc4f0 con 0x7f5d200b1f30 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200cbc50 con 0x7f5d2006f350 2023-07-20T09:50:49.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d259fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2014d810 con 0x7f5d2015c120 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d1e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d1e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55382/0 (socket says 172.21.15.82:55382) 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d1e7fc640 1 -- 172.21.15.82:0/1143593045 learned_addr learned my addr 172.21.15.82:0/1143593045 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d1effd640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d2006f350 0x7f5d20156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.710+0000 7f5d1f7fe640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d2015c120 0x7f5d200cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 -- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d2015c120 msgr2=0x7f5d200cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d2015c120 0x7f5d200cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 -- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d2006f350 msgr2=0x7f5d20156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d2006f350 0x7f5d20156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 -- 172.21.15.82:0/1143593045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d18009420 con 0x7f5d200b1f30 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1e7fc640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400e930 tx=0x7f5d1400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14009690 con 0x7f5d200b1f30 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1400ca00 con 0x7f5d200b1f30 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d201567d0 con 0x7f5d200b1f30 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1400cd70 con 0x7f5d200b1f30 2023-07-20T09:50:49.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d200cbea0 con 0x7f5d200b1f30 2023-07-20T09:50:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d200cc6a0 con 0x7f5d200b1f30 2023-07-20T09:50:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5d14013470 con 0x7f5d200b1f30 2023-07-20T09:50:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 0x7f5d0c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:49.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d14083f50 con 0x7f5d200b1f30 2023-07-20T09:50:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.714+0000 7f5d1effd640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 0x7f5d0c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:49.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.718+0000 7f5d1effd640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 0x7f5d0c068740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d10001570 tx=0x7f5d10001aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:49.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.718+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d200cc6a0 con 0x7f5d200b1f30 2023-07-20T09:50:49.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.866+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d200cc6a0 con 0x7f5d200b1f30 2023-07-20T09:50:49.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d07fff640 1 -- 172.21.15.82:0/1143593045 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f5d200cc6a0 con 0x7f5d200b1f30 2023-07-20T09:50:49.905 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:49.906 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:49.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 msgr2=0x7f5d0c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 0x7f5d0c068740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d10001570 tx=0x7f5d10001aa0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 msgr2=0x7f5d20152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:49.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400e930 tx=0x7f5d1400edf0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 shutdown_connections 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5d0c066280 0x7f5d0c068740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5d2015c120 0x7f5d200cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d200b1f30 0x7f5d20152b70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 --2- 172.21.15.82:0/1143593045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5d2006f350 0x7f5d20156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:49.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 >> 172.21.15.82:0/1143593045 conn(0x7f5d20089fa0 msgr2=0x7f5d200ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 shutdown_connections 2023-07-20T09:50:49.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:49.870+0000 7f5d259fa640 1 -- 172.21.15.82:0/1143593045 wait complete. 2023-07-20T09:50:49.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:49.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 Processor -- start 2023-07-20T09:50:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 -- start start 2023-07-20T09:50:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 0x7f09940cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f099406b220 0x7f0994160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09940d0970 con 0x7f09941602b0 2023-07-20T09:50:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0994160e20 con 0x7f099406b220 2023-07-20T09:50:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f099aacb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940cd300 con 0x7f099406c120 2023-07-20T09:50:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f0993fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f09941602b0 0x7f099406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57972/0 (socket says 172.21.15.82:57972) 2023-07-20T09:50:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.034+0000 7f0993fff640 1 -- 172.21.15.82:0/2361833451 learned_addr learned my addr 172.21.15.82:0/2361833451 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:50.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0998867640 1 --2- 172.21.15.82:0/2361833451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 0x7f09940cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0999068640 1 --2- 172.21.15.82:0/2361833451 >> v2:172.21.15.82:3300/0 conn(0x7f099406b220 0x7f0994160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f09937fe640 1 -- 172.21.15.82:0/2361833451 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736503770 0 0) 0x7f09940d0970 con 0x7f09941602b0 2023-07-20T09:50:50.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f09937fe640 1 -- 172.21.15.82:0/2361833451 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0984003530 con 0x7f09941602b0 2023-07-20T09:50:50.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0998867640 1 -- 172.21.15.82:0/2361833451 >> v2:172.21.15.82:3300/0 conn(0x7f099406b220 msgr2=0x7f0994160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:50.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0998867640 1 --2- 172.21.15.82:0/2361833451 >> v2:172.21.15.82:3300/0 conn(0x7f099406b220 0x7f0994160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0998867640 1 -- 172.21.15.82:0/2361833451 >> v1:172.21.15.82:6789/0 conn(0x7f09941602b0 legacy=0x7f099406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.038+0000 7f0998867640 1 -- 172.21.15.82:0/2361833451 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09940cd5e0 con 0x7f099406c120 2023-07-20T09:50:50.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f0998867640 1 --2- 172.21.15.82:0/2361833451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 0x7f09940cdde0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09880097c0 tx=0x7f098801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f23f398c60fdf3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f09937fe640 1 -- 172.21.15.82:0/2361833451 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880ab600 con 0x7f099406c120 2023-07-20T09:50:50.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f09937fe640 1 -- 172.21.15.82:0/2361833451 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880a7050 con 0x7f099406c120 2023-07-20T09:50:50.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f09937fe640 1 -- 172.21.15.82:0/2361833451 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880ab980 con 0x7f099406c120 2023-07-20T09:50:50.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 -- 172.21.15.82:0/2361833451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 msgr2=0x7f09940cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 --2- 172.21.15.82:0/2361833451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 0x7f09940cdde0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09880097c0 tx=0x7f098801c3f0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 -- 172.21.15.82:0/2361833451 shutdown_connections 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 --2- 172.21.15.82:0/2361833451 >> v2:172.21.15.82:3300/0 conn(0x7f099406b220 0x7f0994160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 --2- 172.21.15.82:0/2361833451 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406c120 0x7f09940cdde0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 -- 172.21.15.82:0/2361833451 >> 172.21.15.82:0/2361833451 conn(0x7f099408c0a0 msgr2=0x7f099409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 -- 172.21.15.82:0/2361833451 shutdown_connections 2023-07-20T09:50:50.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.042+0000 7f099aacb640 1 -- 172.21.15.82:0/2361833451 wait complete. 2023-07-20T09:50:50.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 Processor -- start 2023-07-20T09:50:50.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- start start 2023-07-20T09:50:50.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406b220 0x7f09940b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f099406c120 0x7f099414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940b1530 con 0x7f09941602b0 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09941564e0 con 0x7f099406c120 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09941566f0 con 0x7f099406b220 2023-07-20T09:50:50.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55394/0 (socket says 172.21.15.82:55394) 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 -- 172.21.15.82:0/2831711088 learned_addr learned my addr 172.21.15.82:0/2831711088 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0998867640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406b220 0x7f09940b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0993fff640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f099406c120 0x7f099414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 -- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406b220 msgr2=0x7f09940b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406b220 0x7f09940b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 -- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f099406c120 msgr2=0x7f099414ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f099406c120 0x7f099414ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 -- 172.21.15.82:0/2831711088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009420 con 0x7f09941602b0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f0999068640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f098c00efc0 tx=0x7f098c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c014480 con 0x7f09941602b0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c00f040 con 0x7f09941602b0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09941569d0 con 0x7f09941602b0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c014820 con 0x7f09941602b0 2023-07-20T09:50:50.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.046+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994156f90 con 0x7f09941602b0 2023-07-20T09:50:50.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099415b780 con 0x7f09941602b0 2023-07-20T09:50:50.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f098c014980 con 0x7f09941602b0 2023-07-20T09:50:50.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f09917fa640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 0x7f0978068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f098c084b10 con 0x7f09941602b0 2023-07-20T09:50:50.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f0998867640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 0x7f0978068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.050+0000 7f0998867640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 0x7f0978068740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09880ad000 tx=0x7f09880a4f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.054+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f098c051f90 con 0x7f09941602b0 2023-07-20T09:50:50.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.202+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f099404da30 con 0x7f09941602b0 2023-07-20T09:50:50.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.202+0000 7f09917fa640 1 -- 172.21.15.82:0/2831711088 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f098c018020 con 0x7f09941602b0 2023-07-20T09:50:50.241 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:50.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 msgr2=0x7f0978068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 0x7f0978068740 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f09880ad000 tx=0x7f09880a4f90 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 msgr2=0x7f09940d0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f098c00efc0 tx=0x7f098c00c490 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 shutdown_connections 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0978066280 0x7f0978068740 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09941602b0 0x7f09940d0d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f099406c120 0x7f099414ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 --2- 172.21.15.82:0/2831711088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f099406b220 0x7f09940b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 >> 172.21.15.82:0/2831711088 conn(0x7f099408c0a0 msgr2=0x7f099415f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 shutdown_connections 2023-07-20T09:50:50.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.206+0000 7f099aacb640 1 -- 172.21.15.82:0/2831711088 wait complete. 2023-07-20T09:50:50.262 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:50.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.366+0000 7f407d49c640 1 Processor -- start 2023-07-20T09:50:50.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.366+0000 7f407d49c640 1 -- start start 2023-07-20T09:50:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f407d49c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f407806c360 0x7f40780ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f407d49c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4078160ff0 con 0x7f40780ce5a0 2023-07-20T09:50:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f407d49c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40780ce9d0 con 0x7f407815a340 2023-07-20T09:50:50.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f407d49c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407815a720 con 0x7f407806c360 2023-07-20T09:50:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f407806c360 0x7f40780ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f407806c360 0x7f40780ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55406/0 (socket says 172.21.15.82:55406) 2023-07-20T09:50:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 -- 172.21.15.82:0/3893002047 learned_addr learned my addr 172.21.15.82:0/3893002047 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 -- 172.21.15.82:0/3893002047 >> v1:172.21.15.183:6789/0 conn(0x7f407815a340 legacy=0x7f407815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 -- 172.21.15.82:0/3893002047 >> v1:172.21.15.82:6789/0 conn(0x7f40780ce5a0 legacy=0x7f407806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.370+0000 7f406ffff640 1 -- 172.21.15.82:0/3893002047 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40781603e0 con 0x7f407806c360 2023-07-20T09:50:50.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f406ffff640 1 --2- 172.21.15.82:0/3893002047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f40780ce060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4060009870 tx=0x7f406001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663f21a5dca5370 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f40767fc640 1 -- 172.21.15.82:0/3893002047 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600aa670 con 0x7f407806c360 2023-07-20T09:50:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f40767fc640 1 -- 172.21.15.82:0/3893002047 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600aa7d0 con 0x7f407806c360 2023-07-20T09:50:50.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f40767fc640 1 -- 172.21.15.82:0/3893002047 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600aab60 con 0x7f407806c360 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- 172.21.15.82:0/3893002047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 msgr2=0x7f40780ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 --2- 172.21.15.82:0/3893002047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f40780ce060 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4060009870 tx=0x7f406001c510 comp rx=0 tx=0).stop 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- 172.21.15.82:0/3893002047 shutdown_connections 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 --2- 172.21.15.82:0/3893002047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f40780ce060 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- 172.21.15.82:0/3893002047 >> 172.21.15.82:0/3893002047 conn(0x7f4078065310 msgr2=0x7f4078065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- 172.21.15.82:0/3893002047 shutdown_connections 2023-07-20T09:50:50.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- 172.21.15.82:0/3893002047 wait complete. 2023-07-20T09:50:50.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 Processor -- start 2023-07-20T09:50:50.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.374+0000 7f407d49c640 1 -- start start 2023-07-20T09:50:50.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780ce5a0 0x7f4078159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407815a340 0x7f407814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078158e30 con 0x7f407806c360 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407814de30 con 0x7f407815a340 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4078152630 con 0x7f40780ce5a0 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55420/0 (socket says 172.21.15.82:55420) 2023-07-20T09:50:50.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 -- 172.21.15.82:0/1057501240 learned_addr learned my addr 172.21.15.82:0/1057501240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:50.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f40777fe640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407815a340 0x7f407814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f406ffff640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780ce5a0 0x7f4078159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 -- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780ce5a0 msgr2=0x7f4078159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780ce5a0 0x7f4078159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 -- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407815a340 msgr2=0x7f407814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407815a340 0x7f407814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 -- 172.21.15.82:0/1057501240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600094d0 con 0x7f407806c360 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f4076ffd640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f406800c450 tx=0x7f406800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40680052d0 con 0x7f407806c360 2023-07-20T09:50:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4068005430 con 0x7f407806c360 2023-07-20T09:50:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068003890 con 0x7f407806c360 2023-07-20T09:50:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40781587b0 con 0x7f407806c360 2023-07-20T09:50:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4078158a50 con 0x7f407806c360 2023-07-20T09:50:50.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.378+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40781590a0 con 0x7f407806c360 2023-07-20T09:50:50.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.382+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40680039f0 con 0x7f407806c360 2023-07-20T09:50:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.382+0000 7f406f7fe640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 0x7f4058068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.382+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40680836b0 con 0x7f407806c360 2023-07-20T09:50:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.382+0000 7f406ffff640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 0x7f4058068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.382+0000 7f406ffff640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 0x7f4058068770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40600ae000 tx=0x7f40600b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.386+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4068050c70 con 0x7f407806c360 2023-07-20T09:50:50.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.538+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f407804da30 con 0x7f407806c360 2023-07-20T09:50:50.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.538+0000 7f406f7fe640 1 -- 172.21.15.82:0/1057501240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4068054290 con 0x7f407806c360 2023-07-20T09:50:50.576 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 msgr2=0x7f4058068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 0x7f4058068770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f40600ae000 tx=0x7f40600b5040 comp rx=0 tx=0).stop 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 msgr2=0x7f407814d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f406800c450 tx=0x7f406800c910 comp rx=0 tx=0).stop 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 shutdown_connections 2023-07-20T09:50:50.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f40580662b0 0x7f4058068770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f407815a340 0x7f407814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f40780ce5a0 0x7f4078159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 --2- 172.21.15.82:0/1057501240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f407806c360 0x7f407814d8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 >> 172.21.15.82:0/1057501240 conn(0x7f4078065310 msgr2=0x7f407815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 shutdown_connections 2023-07-20T09:50:50.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.542+0000 7f407d49c640 1 -- 172.21.15.82:0/1057501240 wait complete. 2023-07-20T09:50:50.597 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 Processor -- start 2023-07-20T09:50:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 -- start start 2023-07-20T09:50:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa810159450 0x7fa81015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa810159830 0x7fa8100cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8100cc3e0 0x7fa8100afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100cce90 con 0x7fa8100cc3e0 2023-07-20T09:50:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100cc8d0 con 0x7fa810159450 2023-07-20T09:50:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa8166bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100ccbb0 con 0x7fa810159830 2023-07-20T09:50:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.702+0000 7fa814c5a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8100cc3e0 0x7fa8100afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa8100cc3e0 0x7fa8100afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55434/0 (socket says 172.21.15.82:55434) 2023-07-20T09:50:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 -- 172.21.15.82:0/3959694975 learned_addr learned my addr 172.21.15.82:0/3959694975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa80f7fe640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa810159830 0x7fa8100cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa80ffff640 1 --2- 172.21.15.82:0/3959694975 >> v2:172.21.15.183:3300/0 conn(0x7fa810159450 0x7fa81015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 -- 172.21.15.82:0/3959694975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa810159830 msgr2=0x7fa8100cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa810159830 0x7fa8100cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 -- 172.21.15.82:0/3959694975 >> v2:172.21.15.183:3300/0 conn(0x7fa810159450 msgr2=0x7fa81015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 --2- 172.21.15.82:0/3959694975 >> v2:172.21.15.183:3300/0 conn(0x7fa810159450 0x7fa81015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 -- 172.21.15.82:0/3959694975 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810159cc0 con 0x7fa8100cc3e0 2023-07-20T09:50:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa814c5a640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8100cc3e0 0x7fa8100afd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa81006a6c0 tx=0x7fa80801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65d71c6283e9132 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa80effd640 1 -- 172.21.15.82:0/3959694975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080a5730 con 0x7fa8100cc3e0 2023-07-20T09:50:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa80effd640 1 -- 172.21.15.82:0/3959694975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080a5890 con 0x7fa8100cc3e0 2023-07-20T09:50:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.706+0000 7fa80effd640 1 -- 172.21.15.82:0/3959694975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080a5c20 con 0x7fa8100cc3e0 2023-07-20T09:50:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- 172.21.15.82:0/3959694975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8100cc3e0 msgr2=0x7fa8100afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8100cc3e0 0x7fa8100afd50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa81006a6c0 tx=0x7fa80801c9a0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- 172.21.15.82:0/3959694975 shutdown_connections 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8100cc3e0 0x7fa8100afd50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- 172.21.15.82:0/3959694975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa810159830 0x7fa8100cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- 172.21.15.82:0/3959694975 >> v2:172.21.15.183:3300/0 conn(0x7fa810159450 0x7fa81015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- 172.21.15.82:0/3959694975 >> 172.21.15.82:0/3959694975 conn(0x7fa8100cad50 msgr2=0x7fa8100cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- 172.21.15.82:0/3959694975 shutdown_connections 2023-07-20T09:50:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- 172.21.15.82:0/3959694975 wait complete. 2023-07-20T09:50:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 Processor -- start 2023-07-20T09:50:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- start start 2023-07-20T09:50:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8100cc3e0 0x7fa810152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81014f000 0x7fa8101582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c34e0 con 0x7fa810159450 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101526a0 con 0x7fa8100cc3e0 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa8166bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa810152980 con 0x7fa81014f000 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55448/0 (socket says 172.21.15.82:55448) 2023-07-20T09:50:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 -- 172.21.15.82:0/206647651 learned_addr learned my addr 172.21.15.82:0/206647651 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa814c5a640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81014f000 0x7fa8101582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80ffff640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8100cc3e0 0x7fa810152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 -- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81014f000 msgr2=0x7fa8101582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81014f000 0x7fa8101582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 -- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8100cc3e0 msgr2=0x7fa810152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8100cc3e0 0x7fa810152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.710+0000 7fa80f7fe640 1 -- 172.21.15.82:0/206647651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009b30 con 0x7fa810159450 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80f7fe640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e870 tx=0x7fa80400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804009510 con 0x7fa810159450 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400eec0 con 0x7fa810159450 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400cb40 con 0x7fa810159450 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa810152c60 con 0x7fa810159450 2023-07-20T09:50:50.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa810158820 con 0x7fa810159450 2023-07-20T09:50:50.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81004da30 con 0x7fa810159450 2023-07-20T09:50:50.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa80400cca0 con 0x7fa810159450 2023-07-20T09:50:50.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 0x7fa7fc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:50.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa804084120 con 0x7fa810159450 2023-07-20T09:50:50.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.714+0000 7fa80ffff640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 0x7fa7fc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:50.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.718+0000 7fa80ffff640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 0x7fa7fc068740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa800009ae0 tx=0x7fa800009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:50.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.718+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa804051640 con 0x7fa810159450 2023-07-20T09:50:50.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.866+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8100c3620 con 0x7fa810159450 2023-07-20T09:50:50.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.866+0000 7fa80cff9640 1 -- 172.21.15.82:0/206647651 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa804054c60 con 0x7fa810159450 2023-07-20T09:50:50.904 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:50.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 msgr2=0x7fa7fc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 0x7fa7fc068740 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa800009ae0 tx=0x7fa800009190 comp rx=0 tx=0).stop 2023-07-20T09:50:50.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 msgr2=0x7fa8100cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:50.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa80400e870 tx=0x7fa80400ec70 comp rx=0 tx=0).stop 2023-07-20T09:50:50.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 shutdown_connections 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa7fc066280 0x7fa7fc068740 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa81014f000 0x7fa8101582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa810159450 0x7fa8100cebf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 --2- 172.21.15.82:0/206647651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8100cc3e0 0x7fa810152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 >> 172.21.15.82:0/206647651 conn(0x7fa8100cad50 msgr2=0x7fa8100cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 shutdown_connections 2023-07-20T09:50:50.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:50.870+0000 7fa8166bd640 1 -- 172.21.15.82:0/206647651 wait complete. 2023-07-20T09:50:50.925 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 Processor -- start 2023-07-20T09:50:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 -- start start 2023-07-20T09:50:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c8c06c120 0x7f7c8c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 0x7f7c8c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c0d0970 con 0x7f7c8c06ab10 2023-07-20T09:50:51.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c160e20 con 0x7f7c8c06c120 2023-07-20T09:50:51.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9378f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c0cd300 con 0x7f7c8c1602b0 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9152b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c8c06c120 0x7f7c8c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9152b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c8c06c120 0x7f7c8c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55454/0 (socket says 172.21.15.82:55454) 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.030+0000 7f7c9152b640 1 -- 172.21.15.82:0/3302434209 learned_addr learned my addr 172.21.15.82:0/3302434209 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c90d2a640 1 --2- 172.21.15.82:0/3302434209 >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 0x7f7c8c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9152b640 1 -- 172.21.15.82:0/3302434209 >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 msgr2=0x7f7c8c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9152b640 1 --2- 172.21.15.82:0/3302434209 >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 0x7f7c8c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9152b640 1 -- 172.21.15.82:0/3302434209 >> v1:172.21.15.183:6789/0 conn(0x7f7c8c06ab10 legacy=0x7f7c8c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9152b640 1 -- 172.21.15.82:0/3302434209 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0cd5e0 con 0x7f7c8c06c120 2023-07-20T09:50:51.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c90d2a640 1 --2- 172.21.15.82:0/3302434209 >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 0x7f7c8c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9152b640 1 --2- 172.21.15.82:0/3302434209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c06c120 0x7f7c8c0cdde0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c08ca40 tx=0x7f7c8801c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278f4fcdc543e5c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c83fff640 1 -- 172.21.15.82:0/3302434209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880a5720 con 0x7f7c8c06c120 2023-07-20T09:50:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c83fff640 1 -- 172.21.15.82:0/3302434209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c880a5880 con 0x7f7c8c06c120 2023-07-20T09:50:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c83fff640 1 -- 172.21.15.82:0/3302434209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880a5c10 con 0x7f7c8c06c120 2023-07-20T09:50:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 -- 172.21.15.82:0/3302434209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c06c120 msgr2=0x7f7c8c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 --2- 172.21.15.82:0/3302434209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c06c120 0x7f7c8c0cdde0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c08ca40 tx=0x7f7c8801c840 comp rx=0 tx=0).stop 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 -- 172.21.15.82:0/3302434209 shutdown_connections 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 --2- 172.21.15.82:0/3302434209 >> v2:172.21.15.183:3300/0 conn(0x7f7c8c1602b0 0x7f7c8c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 --2- 172.21.15.82:0/3302434209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c06c120 0x7f7c8c0cdde0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.034+0000 7f7c9378f640 1 -- 172.21.15.82:0/3302434209 >> 172.21.15.82:0/3302434209 conn(0x7f7c8c08c0a0 msgr2=0x7f7c8c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- 172.21.15.82:0/3302434209 shutdown_connections 2023-07-20T09:50:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- 172.21.15.82:0/3302434209 wait complete. 2023-07-20T09:50:51.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 Processor -- start 2023-07-20T09:50:51.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- start start 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c8c06ab10 0x7f7c8c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 0x7f7c8c14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c14e360 con 0x7f7c8c1602b0 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0ca7d0 con 0x7f7c8c06c120 2023-07-20T09:50:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0caab0 con 0x7f7c8c06ab10 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55464/0 (socket says 172.21.15.82:55464) 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 -- 172.21.15.82:0/2593486275 learned_addr learned my addr 172.21.15.82:0/2593486275 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9152b640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c8c06ab10 0x7f7c8c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c90d2a640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 0x7f7c8c14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 -- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c8c06ab10 msgr2=0x7f7c8c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c8c06ab10 0x7f7c8c0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 -- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 msgr2=0x7f7c8c14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 0x7f7c8c14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 -- 172.21.15.82:0/2593486275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009b30 con 0x7f7c8c1602b0 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c90d2a640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 0x7f7c8c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c91d2c640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c3c0 tx=0x7f7c8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84011790 con 0x7f7c8c1602b0 2023-07-20T09:50:51.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c840118f0 con 0x7f7c8c1602b0 2023-07-20T09:50:51.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c0cad90 con 0x7f7c8c1602b0 2023-07-20T09:50:51.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.038+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84011ca0 con 0x7f7c8c1602b0 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c0cb350 con 0x7f7c8c1602b0 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c04da30 con 0x7f7c8c1602b0 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7c8401c460 con 0x7f7c8c1602b0 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c81ffb640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 0x7f7c70068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c84083a80 con 0x7f7c8c1602b0 2023-07-20T09:50:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.042+0000 7f7c9152b640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 0x7f7c70068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.046+0000 7f7c9152b640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 0x7f7c70068740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ae000 tx=0x7f7c880a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.046+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c84054a20 con 0x7f7c8c1602b0 2023-07-20T09:50:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c8c0ccaa0 con 0x7f7c8c1602b0 2023-07-20T09:50:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c81ffb640 1 -- 172.21.15.82:0/2593486275 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c840545b0 con 0x7f7c8c1602b0 2023-07-20T09:50:51.231 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 msgr2=0x7f7c70068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 0x7f7c70068740 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ae000 tx=0x7f7c880a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 msgr2=0x7f7c8c0b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400c3c0 tx=0x7f7c8400c880 comp rx=0 tx=0).stop 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 shutdown_connections 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7c70066280 0x7f7c70068740 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c8c1602b0 0x7f7c8c0b03a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c8c06c120 0x7f7c8c14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 --2- 172.21.15.82:0/2593486275 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c8c06ab10 0x7f7c8c0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 >> 172.21.15.82:0/2593486275 conn(0x7f7c8c08c0a0 msgr2=0x7f7c8c15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 shutdown_connections 2023-07-20T09:50:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.194+0000 7f7c9378f640 1 -- 172.21.15.82:0/2593486275 wait complete. 2023-07-20T09:50:51.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:51.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 Processor -- start 2023-07-20T09:50:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 -- start start 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc3840d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3840ce4c0 0x7fc3840d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3840d16b0 con 0x7fc3840d0d10 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3840d31c0 con 0x7fc3840ce4c0 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc38b8f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840b3520 con 0x7fc38415cab0 2023-07-20T09:50:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc3840d0d10 0x7fc3840cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57988/0 (socket says 172.21.15.82:57988) 2023-07-20T09:50:51.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 -- 172.21.15.82:0/1844948392 learned_addr learned my addr 172.21.15.82:0/1844948392 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:51.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc389695640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc3840d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc389e96640 1 --2- 172.21.15.82:0/1844948392 >> v2:172.21.15.183:3300/0 conn(0x7fc3840ce4c0 0x7fc3840d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991077135 0 0) 0x7fc3840d16b0 con 0x7fc3840d0d10 2023-07-20T09:50:51.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc370003530 con 0x7fc3840d0d10 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 852208398 0 0) 0x7fc370003530 con 0x7fc3840d0d10 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 msgr2=0x7fc3840d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc3840d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 >> v2:172.21.15.183:3300/0 conn(0x7fc3840ce4c0 msgr2=0x7fc3840d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 --2- 172.21.15.82:0/1844948392 >> v2:172.21.15.183:3300/0 conn(0x7fc3840ce4c0 0x7fc3840d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840b2910 con 0x7fc3840d0d10 2023-07-20T09:50:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fc374001680 con 0x7fc3840d0d10 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 >> v1:172.21.15.82:6789/0 conn(0x7fc3840d0d10 legacy=0x7fc3840cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc370003980 0x7fc370003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3700047d0 0x7fc370004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc370005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840b3520 con 0x7fc3700047d0 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37000b990 con 0x7fc370003980 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37000bad0 con 0x7fc38415cab0 2023-07-20T09:50:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3700047d0 0x7fc370004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc389695640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc370003980 0x7fc370003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc389e96640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc370005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 -- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 msgr2=0x7fc370005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc38415cab0 0x7fc370005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 -- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc370003980 msgr2=0x7fc370003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc370003980 0x7fc370003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.354+0000 7fc388e94640 1 -- 172.21.15.82:0/1844948392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc370003530 con 0x7fc3700047d0 2023-07-20T09:50:51.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc388e94640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3700047d0 0x7fc370004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c110 tx=0x7fc37401f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebddb3bea11434a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3740a8c10 con 0x7fc3700047d0 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3740a8d90 con 0x7fc3700047d0 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc37bfff640 1 -- 172.21.15.82:0/1844948392 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374005b20 con 0x7fc3700047d0 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 -- 172.21.15.82:0/1844948392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3700047d0 msgr2=0x7fc370004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/1844948392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3700047d0 0x7fc370004c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc37400c110 tx=0x7fc37401f290 comp rx=0 tx=0).stop 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc389e96640 1 -- 172.21.15.82:0/1844948392 reap_dead start 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 -- 172.21.15.82:0/1844948392 shutdown_connections 2023-07-20T09:50:51.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 -- 172.21.15.82:0/1844948392 >> 172.21.15.82:0/1844948392 conn(0x7fc38408c120 msgr2=0x7fc38409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 -- 172.21.15.82:0/1844948392 shutdown_connections 2023-07-20T09:50:51.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.358+0000 7fc38b8f9640 1 -- 172.21.15.82:0/1844948392 wait complete. 2023-07-20T09:50:51.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 Processor -- start 2023-07-20T09:50:51.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- start start 2023-07-20T09:50:51.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3700047d0 0x7fc3840cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 0x7fc3840af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840ca1c0 con 0x7fc3840c9800 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840cbc50 con 0x7fc3700047d0 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3840afdd0 con 0x7fc3840af260 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55478/0 (socket says 172.21.15.82:55478) 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 -- 172.21.15.82:0/3038180712 learned_addr learned my addr 172.21.15.82:0/3038180712 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc388e94640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 0x7fc3840af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389695640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3700047d0 0x7fc3840cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 -- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 msgr2=0x7fc3840af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 0x7fc3840af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 -- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3700047d0 msgr2=0x7fc3840cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3700047d0 0x7fc3840cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 -- 172.21.15.82:0/3038180712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840b00b0 con 0x7fc3840c9800 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc388e94640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 0x7fc3840af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc389e96640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ccd80 tx=0x7fc37c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00e070 con 0x7fc3840c9800 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c011ed0 con 0x7fc3840c9800 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3840b0390 con 0x7fc3840c9800 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c0039a0 con 0x7fc3840c9800 2023-07-20T09:50:51.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.362+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3840b0950 con 0x7fc3840c9800 2023-07-20T09:50:51.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3840b0b70 con 0x7fc3840c9800 2023-07-20T09:50:51.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc37c003b20 con 0x7fc3840c9800 2023-07-20T09:50:51.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc379ffb640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 0x7fc368068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc37c0846a0 con 0x7fc3840c9800 2023-07-20T09:50:51.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc389695640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 0x7fc368068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.366+0000 7fc389695640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 0x7fc368068740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3800099e0 tx=0x7fc380008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.370+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc37c055510 con 0x7fc3840c9800 2023-07-20T09:50:51.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.518+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc384073c70 con 0x7fc3840c9800 2023-07-20T09:50:51.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.518+0000 7fc379ffb640 1 -- 172.21.15.82:0/3038180712 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fc37c0550a0 con 0x7fc3840c9800 2023-07-20T09:50:51.557 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:51.557 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:51.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 msgr2=0x7fc368068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 0x7fc368068740 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc3800099e0 tx=0x7fc380008040 comp rx=0 tx=0).stop 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 msgr2=0x7fc3840c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc3840ccd80 tx=0x7fc37c0115a0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 shutdown_connections 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc368066280 0x7fc368068740 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3840c9800 0x7fc3840c9c80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3840af260 0x7fc3840af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 --2- 172.21.15.82:0/3038180712 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3700047d0 0x7fc3840cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 >> 172.21.15.82:0/3038180712 conn(0x7fc38408c120 msgr2=0x7fc38415b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 shutdown_connections 2023-07-20T09:50:51.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.522+0000 7fc38b8f9640 1 -- 172.21.15.82:0/3038180712 wait complete. 2023-07-20T09:50:51.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:51.578 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 Processor -- start 2023-07-20T09:50:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 -- start start 2023-07-20T09:50:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e4015c870 0x7f1e400d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400d20e0 0x7f1e400cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400b6620 con 0x7f1e400d0b30 2023-07-20T09:50:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4015cc50 con 0x7f1e4015c870 2023-07-20T09:50:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e462af640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400d1040 con 0x7f1e400d20e0 2023-07-20T09:50:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e452ad640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e4015c870 0x7f1e400d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e45aae640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1e400d0b30 0x7f1e400b3f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57996/0 (socket says 172.21.15.82:57996) 2023-07-20T09:50:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e45aae640 1 -- 172.21.15.82:0/1454219888 learned_addr learned my addr 172.21.15.82:0/1454219888 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e44aac640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400d20e0 0x7f1e400cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e37fff640 1 -- 172.21.15.82:0/1454219888 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953579710 0 0) 0x7f1e400b6620 con 0x7f1e400d0b30 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e37fff640 1 -- 172.21.15.82:0/1454219888 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e2c003530 con 0x7f1e400d0b30 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e452ad640 1 -- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400d20e0 msgr2=0x7f1e400cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e452ad640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400d20e0 0x7f1e400cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e452ad640 1 -- 172.21.15.82:0/1454219888 >> v1:172.21.15.82:6789/0 conn(0x7f1e400d0b30 legacy=0x7f1e400b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.686+0000 7f1e452ad640 1 -- 172.21.15.82:0/1454219888 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400d1320 con 0x7f1e4015c870 2023-07-20T09:50:51.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e452ad640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4015c870 0x7f1e400d05f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0097c0 tx=0x7f1e3c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f2f19701da35441 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e37fff640 1 -- 172.21.15.82:0/1454219888 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0ad660 con 0x7f1e4015c870 2023-07-20T09:50:51.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e37fff640 1 -- 172.21.15.82:0/1454219888 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0ad7c0 con 0x7f1e4015c870 2023-07-20T09:50:51.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e37fff640 1 -- 172.21.15.82:0/1454219888 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0adb50 con 0x7f1e4015c870 2023-07-20T09:50:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 -- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4015c870 msgr2=0x7f1e400d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4015c870 0x7f1e400d05f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0097c0 tx=0x7f1e3c01c450 comp rx=0 tx=0).stop 2023-07-20T09:50:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 -- 172.21.15.82:0/1454219888 shutdown_connections 2023-07-20T09:50:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e400d20e0 0x7f1e400cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 --2- 172.21.15.82:0/1454219888 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e4015c870 0x7f1e400d05f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 -- 172.21.15.82:0/1454219888 >> 172.21.15.82:0/1454219888 conn(0x7f1e400654e0 msgr2=0x7f1e400658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 -- 172.21.15.82:0/1454219888 shutdown_connections 2023-07-20T09:50:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.690+0000 7f1e462af640 1 -- 172.21.15.82:0/1454219888 wait complete. 2023-07-20T09:50:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 Processor -- start 2023-07-20T09:50:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 -- start start 2023-07-20T09:50:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e400d20e0 0x7f1e40159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e4015c870 0x7f1e4014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400c5be0 con 0x7f1e400d0b30 2023-07-20T09:50:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014dfb0 con 0x7f1e400d20e0 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4014cc70 con 0x7f1e4015c870 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55482/0 (socket says 172.21.15.82:55482) 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 -- 172.21.15.82:0/818833703 learned_addr learned my addr 172.21.15.82:0/818833703 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e45aae640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e4015c870 0x7f1e4014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e44aac640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e400d20e0 0x7f1e40159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 -- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e4015c870 msgr2=0x7f1e4014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e4015c870 0x7f1e4014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 -- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e400d20e0 msgr2=0x7f1e40159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e400d20e0 0x7f1e40159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 -- 172.21.15.82:0/818833703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c009420 con 0x7f1e400d0b30 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e452ad640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b0040 tx=0x7f1e3c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0b9650 con 0x7f1e400d0b30 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c0b97d0 con 0x7f1e400d0b30 2023-07-20T09:50:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4014d680 con 0x7f1e400d0b30 2023-07-20T09:50:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.694+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0b9b80 con 0x7f1e400d0b30 2023-07-20T09:50:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4014dc40 con 0x7f1e400d0b30 2023-07-20T09:50:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e4004da30 con 0x7f1e400d0b30 2023-07-20T09:50:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e3c0b9ce0 con 0x7f1e400d0b30 2023-07-20T09:50:51.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e35ffb640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:51.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e3c11e6d0 con 0x7f1e400d0b30 2023-07-20T09:50:51.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.698+0000 7f1e44aac640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:51.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.702+0000 7f1e44aac640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b7250 tx=0x7f1e30009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:51.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.702+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e3c0ebb60 con 0x7f1e400d0b30 2023-07-20T09:50:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e400b5100 con 0x7f1e400d0b30 2023-07-20T09:50:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e35ffb640 1 -- 172.21.15.82:0/818833703 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e3c0ef180 con 0x7f1e400d0b30 2023-07-20T09:50:51.890 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 msgr2=0x7f1e24068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e400b7250 tx=0x7f1e30009190 comp rx=0 tx=0).stop 2023-07-20T09:50:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 msgr2=0x7f1e400c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0b0040 tx=0x7f1e3c01ac90 comp rx=0 tx=0).stop 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 shutdown_connections 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e24066280 0x7f1e24068740 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e4015c870 0x7f1e4014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e400d20e0 0x7f1e40159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 --2- 172.21.15.82:0/818833703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e400d0b30 0x7f1e400c56a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 >> 172.21.15.82:0/818833703 conn(0x7f1e400654e0 msgr2=0x7f1e400ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 shutdown_connections 2023-07-20T09:50:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:51.854+0000 7f1e462af640 1 -- 172.21.15.82:0/818833703 wait complete. 2023-07-20T09:50:51.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.014+0000 7fa1d5133640 1 Processor -- start 2023-07-20T09:50:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 -- start start 2023-07-20T09:50:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa1d015c6e0 0x7fa1d00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa1d00d3200 0x7fa1d00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d00cdb40 con 0x7fa1d015cac0 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d00d07a0 con 0x7fa1d015c6e0 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1d5133640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d00cd4f0 con 0x7fa1d00d3200 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa1d015c6e0 0x7fa1d00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa1d015c6e0 0x7fa1d00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55488/0 (socket says 172.21.15.82:55488) 2023-07-20T09:50:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 -- 172.21.15.82:0/2555640246 learned_addr learned my addr 172.21.15.82:0/2555640246 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1c659c640 1 --2- 172.21.15.82:0/2555640246 >> v2:172.21.15.183:3300/0 conn(0x7fa1d00d3200 0x7fa1d00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 -- 172.21.15.82:0/2555640246 >> v2:172.21.15.183:3300/0 conn(0x7fa1d00d3200 msgr2=0x7fa1d00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 --2- 172.21.15.82:0/2555640246 >> v2:172.21.15.183:3300/0 conn(0x7fa1d00d3200 0x7fa1d00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 -- 172.21.15.82:0/2555640246 >> v1:172.21.15.183:6789/0 conn(0x7fa1d015cac0 legacy=0x7fa1d00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.018+0000 7fa1ced9d640 1 -- 172.21.15.82:0/2555640246 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d00cd7d0 con 0x7fa1d015c6e0 2023-07-20T09:50:52.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1ced9d640 1 --2- 172.21.15.82:0/2555640246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015c6e0 0x7fa1d00cf640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ccf90 tx=0x7fa1c001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a74534d6c417c29 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1ce59c640 1 -- 172.21.15.82:0/2555640246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00a5790 con 0x7fa1d015c6e0 2023-07-20T09:50:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1ce59c640 1 -- 172.21.15.82:0/2555640246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c00a58f0 con 0x7fa1d015c6e0 2023-07-20T09:50:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1ce59c640 1 -- 172.21.15.82:0/2555640246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00a5c80 con 0x7fa1d015c6e0 2023-07-20T09:50:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 -- 172.21.15.82:0/2555640246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015c6e0 msgr2=0x7fa1d00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2555640246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015c6e0 0x7fa1d00cf640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ccf90 tx=0x7fa1c001c8b0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 -- 172.21.15.82:0/2555640246 shutdown_connections 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2555640246 >> v2:172.21.15.183:3300/0 conn(0x7fa1d00d3200 0x7fa1d00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2555640246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015c6e0 0x7fa1d00cf640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 -- 172.21.15.82:0/2555640246 >> 172.21.15.82:0/2555640246 conn(0x7fa1d00d2600 msgr2=0x7fa1d00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 -- 172.21.15.82:0/2555640246 shutdown_connections 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 -- 172.21.15.82:0/2555640246 wait complete. 2023-07-20T09:50:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.022+0000 7fa1d5133640 1 Processor -- start 2023-07-20T09:50:52.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- start start 2023-07-20T09:50:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1d00d3200 0x7fa1d01579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1d015c6e0 0x7fa1d00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c7730 con 0x7fa1d015cac0 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c7a10 con 0x7fa1d00d3200 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d00c7cf0 con 0x7fa1d015c6e0 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55504/0 (socket says 172.21.15.82:55504) 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 -- 172.21.15.82:0/2489672605 learned_addr learned my addr 172.21.15.82:0/2489672605 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1ced9d640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1d00d3200 0x7fa1d01579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1c659c640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1d015c6e0 0x7fa1d00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 -- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1d015c6e0 msgr2=0x7fa1d00b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1d015c6e0 0x7fa1d00b6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 -- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1d00d3200 msgr2=0x7fa1d01579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1d00d3200 0x7fa1d01579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 -- 172.21.15.82:0/2489672605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0009b30 con 0x7fa1d015cac0 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1cf59e640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c340 tx=0x7fa1c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8005220 con 0x7fa1d015cac0 2023-07-20T09:50:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8005380 con 0x7fa1d015cac0 2023-07-20T09:50:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8007270 con 0x7fa1d015cac0 2023-07-20T09:50:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d00c7fd0 con 0x7fa1d015cac0 2023-07-20T09:50:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d0157f00 con 0x7fa1d015cac0 2023-07-20T09:50:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.026+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d004da30 con 0x7fa1d015cac0 2023-07-20T09:50:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.030+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1c80073d0 con 0x7fa1d015cac0 2023-07-20T09:50:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.030+0000 7fa1c7fff640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 0x7fa1b0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.030+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1c80831a0 con 0x7fa1d015cac0 2023-07-20T09:50:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.030+0000 7fa1ced9d640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 0x7fa1b0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.030+0000 7fa1ced9d640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 0x7fa1b0068740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ae000 tx=0x7fa1c00a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.034+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1c8050630 con 0x7fa1d015cac0 2023-07-20T09:50:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.182+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa1d00d12c0 con 0x7fa1d015cac0 2023-07-20T09:50:52.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.182+0000 7fa1c7fff640 1 -- 172.21.15.82:0/2489672605 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1c8053c50 con 0x7fa1d015cac0 2023-07-20T09:50:52.219 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 msgr2=0x7fa1b0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 0x7fa1b0068740 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ae000 tx=0x7fa1c00a7070 comp rx=0 tx=0).stop 2023-07-20T09:50:52.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 msgr2=0x7fa1d00cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c340 tx=0x7fa1c800c800 comp rx=0 tx=0).stop 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 shutdown_connections 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fa1b0066280 0x7fa1b0068740 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1d015cac0 0x7fa1d00cee30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1d015c6e0 0x7fa1d00b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 --2- 172.21.15.82:0/2489672605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1d00d3200 0x7fa1d01579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 >> 172.21.15.82:0/2489672605 conn(0x7fa1d00d2600 msgr2=0x7fa1d006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 shutdown_connections 2023-07-20T09:50:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.186+0000 7fa1d5133640 1 -- 172.21.15.82:0/2489672605 wait complete. 2023-07-20T09:50:52.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:52.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 Processor -- start 2023-07-20T09:50:52.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 -- start start 2023-07-20T09:50:52.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafdc0cad70 0x7fafdc0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc070890 0x7fafdc070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafdc06cd80 con 0x7fafdc06de60 2023-07-20T09:50:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafdc0c9600 con 0x7fafdc0cad70 2023-07-20T09:50:52.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafe2434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc15cac0 con 0x7fafdc070890 2023-07-20T09:50:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafdc0cad70 0x7fafdc0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafdc0cad70 0x7fafdc0c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55514/0 (socket says 172.21.15.82:55514) 2023-07-20T09:50:52.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 -- 172.21.15.82:0/3255614713 learned_addr learned my addr 172.21.15.82:0/3255614713 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdb7fe640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc070890 0x7fafdc070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 -- 172.21.15.82:0/3255614713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc070890 msgr2=0x7fafdc070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc070890 0x7fafdc070cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 -- 172.21.15.82:0/3255614713 >> v1:172.21.15.183:6789/0 conn(0x7fafdc06de60 legacy=0x7fafdc160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.346+0000 7fafdbfff640 1 -- 172.21.15.82:0/3255614713 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc06bf20 con 0x7fafdc0cad70 2023-07-20T09:50:52.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafdbfff640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc0c90c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3a9dc551af0168 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafdaffd640 1 -- 172.21.15.82:0/3255614713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ab680 con 0x7fafdc0cad70 2023-07-20T09:50:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafdaffd640 1 -- 172.21.15.82:0/3255614713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafcc0ab7e0 con 0x7fafdc0cad70 2023-07-20T09:50:52.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafdaffd640 1 -- 172.21.15.82:0/3255614713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0abb70 con 0x7fafdc0cad70 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 -- 172.21.15.82:0/3255614713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 msgr2=0x7fafdc0c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc0c90c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009870 tx=0x7fafcc01c480 comp rx=0 tx=0).stop 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 -- 172.21.15.82:0/3255614713 shutdown_connections 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc070890 0x7fafdc070cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 --2- 172.21.15.82:0/3255614713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc0c90c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 -- 172.21.15.82:0/3255614713 >> 172.21.15.82:0/3255614713 conn(0x7fafdc0cf070 msgr2=0x7fafdc0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 -- 172.21.15.82:0/3255614713 shutdown_connections 2023-07-20T09:50:52.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 -- 172.21.15.82:0/3255614713 wait complete. 2023-07-20T09:50:52.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.350+0000 7fafe2434640 1 Processor -- start 2023-07-20T09:50:52.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- start start 2023-07-20T09:50:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc06de60 0x7fafdc0abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc070890 0x7fafdc152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc152ef0 con 0x7fafdc0cad70 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc1531d0 con 0x7fafdc070890 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafdc1534b0 con 0x7fafdc06de60 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55526/0 (socket says 172.21.15.82:55526) 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 -- 172.21.15.82:0/1571772495 learned_addr learned my addr 172.21.15.82:0/1571772495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafdbfff640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc06de60 0x7fafdc0abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafdb7fe640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc070890 0x7fafdc152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 -- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc06de60 msgr2=0x7fafdc0abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc06de60 0x7fafdc0abd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 -- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc070890 msgr2=0x7fafdc152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc070890 0x7fafdc152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 -- 172.21.15.82:0/1571772495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0094d0 con 0x7fafdc0cad70 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe09d1640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafd400c770 tx=0x7fafd400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd4003b80 con 0x7fafdc0cad70 2023-07-20T09:50:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd4003ce0 con 0x7fafdc0cad70 2023-07-20T09:50:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd400aa90 con 0x7fafdc0cad70 2023-07-20T09:50:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafdc153790 con 0x7fafdc0cad70 2023-07-20T09:50:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafdc0ac430 con 0x7fafdc0cad70 2023-07-20T09:50:52.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.354+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafdc04da30 con 0x7fafdc0cad70 2023-07-20T09:50:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.358+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fafd400abf0 con 0x7fafdc0cad70 2023-07-20T09:50:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.358+0000 7fafd8ff9640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 0x7fafc8068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.358+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafd40839b0 con 0x7fafdc0cad70 2023-07-20T09:50:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.358+0000 7fafdbfff640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 0x7fafc8068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.358+0000 7fafdbfff640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 0x7fafc8068770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0af000 tx=0x7fafcc0b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.362+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafd4050ee0 con 0x7fafdc0cad70 2023-07-20T09:50:52.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.506+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafdc06c790 con 0x7fafdc0cad70 2023-07-20T09:50:52.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.506+0000 7fafd8ff9640 1 -- 172.21.15.82:0/1571772495 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafd4054500 con 0x7fafdc0cad70 2023-07-20T09:50:52.545 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:52.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 msgr2=0x7fafc8068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 0x7fafc8068770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0af000 tx=0x7fafcc0b6040 comp rx=0 tx=0).stop 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 msgr2=0x7fafdc158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafd400c770 tx=0x7fafd400cc30 comp rx=0 tx=0).stop 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 shutdown_connections 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fafc80662b0 0x7fafc8068770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafdc0cad70 0x7fafdc158f00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafdc070890 0x7fafdc152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 --2- 172.21.15.82:0/1571772495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafdc06de60 0x7fafdc0abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 >> 172.21.15.82:0/1571772495 conn(0x7fafdc0cf070 msgr2=0x7fafdc0cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 shutdown_connections 2023-07-20T09:50:52.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.510+0000 7fafe2434640 1 -- 172.21.15.82:0/1571772495 wait complete. 2023-07-20T09:50:52.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 Processor -- start 2023-07-20T09:50:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 -- start start 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc6680d3200 0x7fc6680cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc66815cac0 0x7fc6680d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680cdb40 con 0x7fc66815c6e0 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680d07a0 con 0x7fc66815cac0 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66effa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680cd4f0 con 0x7fc6680d3200 2023-07-20T09:50:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc66815cac0 0x7fc6680d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc66815cac0 0x7fc6680d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55540/0 (socket says 172.21.15.82:55540) 2023-07-20T09:50:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 -- 172.21.15.82:0/1421525912 learned_addr learned my addr 172.21.15.82:0/1421525912 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc65ffff640 1 --2- 172.21.15.82:0/1421525912 >> v2:172.21.15.183:3300/0 conn(0x7fc6680d3200 0x7fc6680cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 -- 172.21.15.82:0/1421525912 >> v2:172.21.15.183:3300/0 conn(0x7fc6680d3200 msgr2=0x7fc6680cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 --2- 172.21.15.82:0/1421525912 >> v2:172.21.15.183:3300/0 conn(0x7fc6680d3200 0x7fc6680cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 -- 172.21.15.82:0/1421525912 >> v1:172.21.15.183:6789/0 conn(0x7fc66815c6e0 legacy=0x7fc6680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.670+0000 7fc66d597640 1 -- 172.21.15.82:0/1421525912 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680cd7d0 con 0x7fc66815cac0 2023-07-20T09:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66d597640 1 --2- 172.21.15.82:0/1421525912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc66815cac0 0x7fc6680d0be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ccf90 tx=0x7fc66001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad47e0ec5ee2c8cc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc65f7fe640 1 -- 172.21.15.82:0/1421525912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a5680 con 0x7fc66815cac0 2023-07-20T09:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc65f7fe640 1 -- 172.21.15.82:0/1421525912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600a57e0 con 0x7fc66815cac0 2023-07-20T09:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc65f7fe640 1 -- 172.21.15.82:0/1421525912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a5b70 con 0x7fc66815cac0 2023-07-20T09:50:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 -- 172.21.15.82:0/1421525912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc66815cac0 msgr2=0x7fc6680d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 --2- 172.21.15.82:0/1421525912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc66815cac0 0x7fc6680d0be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc6680ccf90 tx=0x7fc66001c8b0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 -- 172.21.15.82:0/1421525912 shutdown_connections 2023-07-20T09:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 --2- 172.21.15.82:0/1421525912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc66815cac0 0x7fc6680d0be0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 --2- 172.21.15.82:0/1421525912 >> v2:172.21.15.183:3300/0 conn(0x7fc6680d3200 0x7fc6680cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 -- 172.21.15.82:0/1421525912 >> 172.21.15.82:0/1421525912 conn(0x7fc6680d2600 msgr2=0x7fc6680d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 -- 172.21.15.82:0/1421525912 shutdown_connections 2023-07-20T09:50:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.674+0000 7fc66effa640 1 -- 172.21.15.82:0/1421525912 wait complete. 2023-07-20T09:50:52.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 Processor -- start 2023-07-20T09:50:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- start start 2023-07-20T09:50:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc66815c6e0 0x7fc66815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc66815cac0 0x7fc668158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc668159d30 con 0x7fc6680d3200 2023-07-20T09:50:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681f5910 con 0x7fc66815cac0 2023-07-20T09:50:52.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681f4d80 con 0x7fc66815c6e0 2023-07-20T09:50:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55552/0 (socket says 172.21.15.82:55552) 2023-07-20T09:50:52.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 -- 172.21.15.82:0/931341984 learned_addr learned my addr 172.21.15.82:0/931341984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66d597640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc66815cac0 0x7fc668158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc65ffff640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc66815c6e0 0x7fc66815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 -- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc66815c6e0 msgr2=0x7fc66815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc66815c6e0 0x7fc66815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 -- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc66815cac0 msgr2=0x7fc668158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc66815cac0 0x7fc668158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 -- 172.21.15.82:0/931341984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009b30 con 0x7fc6680d3200 2023-07-20T09:50:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66cd96640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc66400c3c0 tx=0x7fc66400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640052d0 con 0x7fc6680d3200 2023-07-20T09:50:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664005430 con 0x7fc6680d3200 2023-07-20T09:50:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664003840 con 0x7fc6680d3200 2023-07-20T09:50:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6681f4fe0 con 0x7fc6680d3200 2023-07-20T09:50:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.678+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6681f55a0 con 0x7fc6680d3200 2023-07-20T09:50:52.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66804da30 con 0x7fc6680d3200 2023-07-20T09:50:52.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6640039a0 con 0x7fc6680d3200 2023-07-20T09:50:52.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc65d7fa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 0x7fc654068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:52.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc664083310 con 0x7fc6680d3200 2023-07-20T09:50:52.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc65ffff640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 0x7fc654068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:52.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.682+0000 7fc65ffff640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 0x7fc654068740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6681f2930 tx=0x7fc658008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:52.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.686+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6640506f0 con 0x7fc6680d3200 2023-07-20T09:50:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.830+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6680b6bb0 con 0x7fc6680d3200 2023-07-20T09:50:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.830+0000 7fc65d7fa640 1 -- 172.21.15.82:0/931341984 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc664053d10 con 0x7fc6680d3200 2023-07-20T09:50:52.869 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 msgr2=0x7fc654068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 0x7fc654068740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6681f2930 tx=0x7fc658008040 comp rx=0 tx=0).stop 2023-07-20T09:50:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 msgr2=0x7fc66815aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc66400c3c0 tx=0x7fc66400c880 comp rx=0 tx=0).stop 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 shutdown_connections 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc654066280 0x7fc654068740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc66815cac0 0x7fc668158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc66815c6e0 0x7fc66815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 --2- 172.21.15.82:0/931341984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6680d3200 0x7fc66815aff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 >> 172.21.15.82:0/931341984 conn(0x7fc6680d2600 msgr2=0x7fc668072900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 shutdown_connections 2023-07-20T09:50:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.834+0000 7fc66effa640 1 -- 172.21.15.82:0/931341984 wait complete. 2023-07-20T09:50:52.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.990+0000 7fb7656bd640 1 Processor -- start 2023-07-20T09:50:53.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.990+0000 7fb7656bd640 1 -- start start 2023-07-20T09:50:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb7656bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb7600d1170 0x7fb7600cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb7656bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7600b3520 con 0x7fb76015cab0 2023-07-20T09:50:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb7656bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7600d0a10 con 0x7fb7600d0d10 2023-07-20T09:50:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb7656bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7600d31c0 con 0x7fb7600d1170 2023-07-20T09:50:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb76015cab0 0x7fb7600d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58010/0 (socket says 172.21.15.82:58010) 2023-07-20T09:50:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75effd640 1 -- 172.21.15.82:0/1414901287 learned_addr learned my addr 172.21.15.82:0/1414901287 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75f7fe640 1 --2- 172.21.15.82:0/1414901287 >> v2:172.21.15.82:3300/0 conn(0x7fb7600d1170 0x7fb7600cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75e7fc640 1 -- 172.21.15.82:0/1414901287 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977684357 0 0) 0x7fb7600b3520 con 0x7fb76015cab0 2023-07-20T09:50:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75e7fc640 1 -- 172.21.15.82:0/1414901287 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb74c003530 con 0x7fb76015cab0 2023-07-20T09:50:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75f7fe640 1 -- 172.21.15.82:0/1414901287 >> v1:172.21.15.183:6789/0 conn(0x7fb7600d0d10 legacy=0x7fb7600cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75f7fe640 1 -- 172.21.15.82:0/1414901287 >> v1:172.21.15.82:6789/0 conn(0x7fb76015cab0 legacy=0x7fb7600d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.994+0000 7fb75f7fe640 1 -- 172.21.15.82:0/1414901287 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600b2910 con 0x7fb7600d1170 2023-07-20T09:50:53.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb75f7fe640 1 --2- 172.21.15.82:0/1414901287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d1170 0x7fb7600cdbc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb758009d90 tx=0x7fb75801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86169870528bb575 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb75e7fc640 1 -- 172.21.15.82:0/1414901287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580a5940 con 0x7fb7600d1170 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb75e7fc640 1 -- 172.21.15.82:0/1414901287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580a5aa0 con 0x7fb7600d1170 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb75e7fc640 1 -- 172.21.15.82:0/1414901287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580a5e30 con 0x7fb7600d1170 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- 172.21.15.82:0/1414901287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d1170 msgr2=0x7fb7600cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 --2- 172.21.15.82:0/1414901287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d1170 0x7fb7600cdbc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb758009d90 tx=0x7fb75801c8f0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- 172.21.15.82:0/1414901287 shutdown_connections 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 --2- 172.21.15.82:0/1414901287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d1170 0x7fb7600cdbc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- 172.21.15.82:0/1414901287 >> 172.21.15.82:0/1414901287 conn(0x7fb76008c120 msgr2=0x7fb76009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- 172.21.15.82:0/1414901287 shutdown_connections 2023-07-20T09:50:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- 172.21.15.82:0/1414901287 wait complete. 2023-07-20T09:50:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 Processor -- start 2023-07-20T09:50:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:52.998+0000 7fb7656bd640 1 -- start start 2023-07-20T09:50:53.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7600d1170 0x7fb76006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 0x7fb760153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76006c080 con 0x7fb7600d0d10 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600c73e0 con 0x7fb7600d1170 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600c76c0 con 0x7fb76015cab0 2023-07-20T09:50:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55570/0 (socket says 172.21.15.82:55570) 2023-07-20T09:50:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 -- 172.21.15.82:0/3325517862 learned_addr learned my addr 172.21.15.82:0/3325517862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7567fc640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7600d1170 0x7fb76006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75f7fe640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 0x7fb760153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 -- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 msgr2=0x7fb760153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 0x7fb760153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 -- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7600d1170 msgr2=0x7fb76006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7600d1170 0x7fb76006bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 -- 172.21.15.82:0/3325517862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009a70 con 0x7fb7600d0d10 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75f7fe640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 0x7fb760153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb75effd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c4d0 tx=0x7fb75000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750005cf0 con 0x7fb7600d0d10 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750005e50 con 0x7fb7600d0d10 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750007270 con 0x7fb7600d0d10 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7600c79a0 con 0x7fb7600d0d10 2023-07-20T09:50:53.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7600c7f60 con 0x7fb7600d0d10 2023-07-20T09:50:53.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb760073c70 con 0x7fb7600d0d10 2023-07-20T09:50:53.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.002+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb7500073d0 con 0x7fb7600d0d10 2023-07-20T09:50:53.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.006+0000 7fb757fff640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 0x7fb740068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.006+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb7500832c0 con 0x7fb7600d0d10 2023-07-20T09:50:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.006+0000 7fb7567fc640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 0x7fb740068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.006+0000 7fb7567fc640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 0x7fb740068740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7600c9280 tx=0x7fb748009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.010+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7500507f0 con 0x7fb7600d0d10 2023-07-20T09:50:53.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.158+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb760157b30 con 0x7fb7600d0d10 2023-07-20T09:50:53.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.158+0000 7fb757fff640 1 -- 172.21.15.82:0/3325517862 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7fb750053e10 con 0x7fb7600d0d10 2023-07-20T09:50:53.197 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:53.197 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 msgr2=0x7fb740068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 0x7fb740068740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7600c9280 tx=0x7fb748009040 comp rx=0 tx=0).stop 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 msgr2=0x7fb76015e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c4d0 tx=0x7fb75000c990 comp rx=0 tx=0).stop 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 shutdown_connections 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb740066280 0x7fb740068740 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb76015cab0 0x7fb760153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7600d1170 0x7fb76006bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 --2- 172.21.15.82:0/3325517862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7600d0d10 0x7fb76015e9e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 >> 172.21.15.82:0/3325517862 conn(0x7fb76008c120 msgr2=0x7fb760158050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 shutdown_connections 2023-07-20T09:50:53.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.162+0000 7fb7656bd640 1 -- 172.21.15.82:0/3325517862 wait complete. 2023-07-20T09:50:53.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:53.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:53.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 Processor -- start 2023-07-20T09:50:53.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 -- start start 2023-07-20T09:50:53.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2934159450 0x7f293415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2934159830 0x7f29340cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340cc8d0 con 0x7f29340cc3e0 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340cce90 con 0x7f2934159830 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f293a337640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340ccbb0 con 0x7f2934159450 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f29337fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2934159830 0x7f29340cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f29337fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2934159830 0x7f29340cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37910/0 (socket says 172.21.15.82:37910) 2023-07-20T09:50:53.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.322+0000 7f29337fe640 1 -- 172.21.15.82:0/1516407387 learned_addr learned my addr 172.21.15.82:0/1516407387 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:53.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f2933fff640 1 --2- 172.21.15.82:0/1516407387 >> v2:172.21.15.183:3300/0 conn(0x7f2934159450 0x7f293415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f29337fe640 1 -- 172.21.15.82:0/1516407387 >> v2:172.21.15.183:3300/0 conn(0x7f2934159450 msgr2=0x7f293415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:53.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f29337fe640 1 --2- 172.21.15.82:0/1516407387 >> v2:172.21.15.183:3300/0 conn(0x7f2934159450 0x7f293415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f29337fe640 1 -- 172.21.15.82:0/1516407387 >> v1:172.21.15.183:6789/0 conn(0x7f29340cc3e0 legacy=0x7f29340afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f29337fe640 1 -- 172.21.15.82:0/1516407387 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934159cc0 con 0x7f2934159830 2023-07-20T09:50:53.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f29337fe640 1 --2- 172.21.15.82:0/1516407387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159830 0x7f29340cbea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f293406a6c0 tx=0x7f292801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bbc7693354640f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f2932ffd640 1 -- 172.21.15.82:0/1516407387 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280aa610 con 0x7f2934159830 2023-07-20T09:50:53.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f2932ffd640 1 -- 172.21.15.82:0/1516407387 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29280a6040 con 0x7f2934159830 2023-07-20T09:50:53.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f2932ffd640 1 -- 172.21.15.82:0/1516407387 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280aa990 con 0x7f2934159830 2023-07-20T09:50:53.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f293a337640 1 -- 172.21.15.82:0/1516407387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159830 msgr2=0x7f29340cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.326+0000 7f293a337640 1 --2- 172.21.15.82:0/1516407387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159830 0x7f29340cbea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f293406a6c0 tx=0x7f292801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- 172.21.15.82:0/1516407387 shutdown_connections 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 --2- 172.21.15.82:0/1516407387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159830 0x7f29340cbea0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 --2- 172.21.15.82:0/1516407387 >> v2:172.21.15.183:3300/0 conn(0x7f2934159450 0x7f293415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- 172.21.15.82:0/1516407387 >> 172.21.15.82:0/1516407387 conn(0x7f29340cad50 msgr2=0x7f29340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- 172.21.15.82:0/1516407387 shutdown_connections 2023-07-20T09:50:53.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- 172.21.15.82:0/1516407387 wait complete. 2023-07-20T09:50:53.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 Processor -- start 2023-07-20T09:50:53.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- start start 2023-07-20T09:50:53.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 0x7f293413ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 0x7f293406b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934071a90 con 0x7f2934159450 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340711f0 con 0x7f29341520c0 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f293a337640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340714d0 con 0x7f29340cc3e0 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37914/0 (socket says 172.21.15.82:37914) 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 -- 172.21.15.82:0/3697650733 learned_addr learned my addr 172.21.15.82:0/3697650733 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f2933fff640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 0x7f293413ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29388d4640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 0x7f293406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 -- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 msgr2=0x7f293413ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 0x7f293413ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 -- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 msgr2=0x7f293406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 0x7f293406b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 -- 172.21.15.82:0/3697650733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280094d0 con 0x7f2934159450 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f2933fff640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 0x7f293413ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29388d4640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 0x7f293406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:53.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.330+0000 7f29337fe640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29280ac040 tx=0x7f292801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280bd5f0 con 0x7f2934159450 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29280bd750 con 0x7f2934159450 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280bdb00 con 0x7f2934159450 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29340717b0 con 0x7f2934159450 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29341404f0 con 0x7f2934159450 2023-07-20T09:50:53.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293404da30 con 0x7f2934159450 2023-07-20T09:50:53.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f29280b33f0 con 0x7f2934159450 2023-07-20T09:50:53.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 0x7f2920068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f292811e960 con 0x7f2934159450 2023-07-20T09:50:53.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2933fff640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 0x7f2920068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.334+0000 7f2933fff640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 0x7f2920068740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2924007a70 tx=0x7f2924008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.338+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29280ebe80 con 0x7f2934159450 2023-07-20T09:50:53.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.486+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29340c2120 con 0x7f2934159450 2023-07-20T09:50:53.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.486+0000 7f2930ff9640 1 -- 172.21.15.82:0/3697650733 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29280c30a0 con 0x7f2934159450 2023-07-20T09:50:53.525 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:53.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 msgr2=0x7f2920068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 0x7f2920068740 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2924007a70 tx=0x7f2924008040 comp rx=0 tx=0).stop 2023-07-20T09:50:53.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 msgr2=0x7f29340c05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29280ac040 tx=0x7f292801ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:53.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 shutdown_connections 2023-07-20T09:50:53.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2920066280 0x7f2920068740 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29341520c0 0x7f293406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2934159450 0x7f29340c05e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 --2- 172.21.15.82:0/3697650733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29340cc3e0 0x7f293413ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 >> 172.21.15.82:0/3697650733 conn(0x7f29340cad50 msgr2=0x7f29340c1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 shutdown_connections 2023-07-20T09:50:53.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.490+0000 7f293a337640 1 -- 172.21.15.82:0/3697650733 wait complete. 2023-07-20T09:50:53.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:53.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 Processor -- start 2023-07-20T09:50:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 -- start start 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f348c06c120 0x7f348c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f348c1602b0 0x7f348c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0d0970 con 0x7f348c06ab10 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c160e20 con 0x7f348c06c120 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3494137640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c0cd300 con 0x7f348c1602b0 2023-07-20T09:50:53.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f348c06c120 0x7f348c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f348c06c120 0x7f348c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37922/0 (socket says 172.21.15.82:37922) 2023-07-20T09:50:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f34926d4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f348c06ab10 0x7f348c06af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52248/0 (socket says 172.21.15.82:52248) 2023-07-20T09:50:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 -- 172.21.15.82:0/1478833083 learned_addr learned my addr 172.21.15.82:0/1478833083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f34916d2640 1 --2- 172.21.15.82:0/1478833083 >> v2:172.21.15.183:3300/0 conn(0x7f348c1602b0 0x7f348c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 -- 172.21.15.82:0/1478833083 >> v2:172.21.15.183:3300/0 conn(0x7f348c1602b0 msgr2=0x7f348c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 --2- 172.21.15.82:0/1478833083 >> v2:172.21.15.183:3300/0 conn(0x7f348c1602b0 0x7f348c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 -- 172.21.15.82:0/1478833083 >> v1:172.21.15.82:6789/0 conn(0x7f348c06ab10 legacy=0x7f348c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3491ed3640 1 -- 172.21.15.82:0/1478833083 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0cd5e0 con 0x7f348c06c120 2023-07-20T09:50:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.650+0000 7f3490ed1640 1 -- 172.21.15.82:0/1478833083 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868968917 0 0) 0x7f348c0d0970 con 0x7f348c06ab10 2023-07-20T09:50:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3491ed3640 1 --2- 172.21.15.82:0/1478833083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c06c120 0x7f348c0cdde0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f348c08ca40 tx=0x7f348801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b912a224085e156f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3490ed1640 1 -- 172.21.15.82:0/1478833083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880ac630 con 0x7f348c06c120 2023-07-20T09:50:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3490ed1640 1 -- 172.21.15.82:0/1478833083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34880ac790 con 0x7f348c06c120 2023-07-20T09:50:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3490ed1640 1 -- 172.21.15.82:0/1478833083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880acb20 con 0x7f348c06c120 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 -- 172.21.15.82:0/1478833083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c06c120 msgr2=0x7f348c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 --2- 172.21.15.82:0/1478833083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c06c120 0x7f348c0cdde0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f348c08ca40 tx=0x7f348801c3b0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 -- 172.21.15.82:0/1478833083 shutdown_connections 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 --2- 172.21.15.82:0/1478833083 >> v2:172.21.15.183:3300/0 conn(0x7f348c1602b0 0x7f348c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 --2- 172.21.15.82:0/1478833083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c06c120 0x7f348c0cdde0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 -- 172.21.15.82:0/1478833083 >> 172.21.15.82:0/1478833083 conn(0x7f348c08c0a0 msgr2=0x7f348c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 -- 172.21.15.82:0/1478833083 shutdown_connections 2023-07-20T09:50:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.654+0000 7f3494137640 1 -- 172.21.15.82:0/1478833083 wait complete. 2023-07-20T09:50:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 Processor -- start 2023-07-20T09:50:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- start start 2023-07-20T09:50:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 0x7f348c154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 0x7f348c0b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0ca4d0 con 0x7f348c1602b0 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0c9850 con 0x7f348c06c120 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0c9b30 con 0x7f348c06ab10 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37930/0 (socket says 172.21.15.82:37930) 2023-07-20T09:50:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 -- 172.21.15.82:0/3233483303 learned_addr learned my addr 172.21.15.82:0/3233483303 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:53.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3491ed3640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 0x7f348c154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34916d2640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 0x7f348c0b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 -- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 msgr2=0x7f348c154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 0x7f348c154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 -- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 msgr2=0x7f348c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 0x7f348c0b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 -- 172.21.15.82:0/3233483303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880094d0 con 0x7f348c1602b0 2023-07-20T09:50:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34916d2640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 0x7f348c0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3491ed3640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 0x7f348c154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34926d4640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3484001570 tx=0x7f348400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400a640 con 0x7f348c1602b0 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400a7c0 con 0x7f348c1602b0 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400ab70 con 0x7f348c1602b0 2023-07-20T09:50:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0c9e10 con 0x7f348c1602b0 2023-07-20T09:50:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.658+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1550b0 con 0x7f348c1602b0 2023-07-20T09:50:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c0ca610 con 0x7f348c1602b0 2023-07-20T09:50:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f348400acd0 con 0x7f348c1602b0 2023-07-20T09:50:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f34827fc640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 0x7f3470068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3484083300 con 0x7f348c1602b0 2023-07-20T09:50:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f3491ed3640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 0x7f3470068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.662+0000 7f3491ed3640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 0x7f3470068740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34880ae000 tx=0x7f3488008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.666+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f348c0ca610 con 0x7f348c1602b0 2023-07-20T09:50:53.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.814+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f348c0ca610 con 0x7f348c1602b0 2023-07-20T09:50:53.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.814+0000 7f34827fc640 1 -- 172.21.15.82:0/3233483303 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3484018020 con 0x7f348c1602b0 2023-07-20T09:50:53.852 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:53.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 msgr2=0x7f3470068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 0x7f3470068740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34880ae000 tx=0x7f3488008040 comp rx=0 tx=0).stop 2023-07-20T09:50:53.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 msgr2=0x7f348c0b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:53.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3484001570 tx=0x7f348400cca0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 shutdown_connections 2023-07-20T09:50:53.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3470066280 0x7f3470068740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f348c1602b0 0x7f348c0b67f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f348c06c120 0x7f348c0b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 --2- 172.21.15.82:0/3233483303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f348c06ab10 0x7f348c154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 >> 172.21.15.82:0/3233483303 conn(0x7f348c08c0a0 msgr2=0x7f348c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 shutdown_connections 2023-07-20T09:50:53.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.818+0000 7f3494137640 1 -- 172.21.15.82:0/3233483303 wait complete. 2023-07-20T09:50:53.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:53.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:50:53.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:50:54.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 Processor -- start 2023-07-20T09:50:54.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 -- start start 2023-07-20T09:50:54.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a4006c120 0x7f0a400cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a4006b220 0x7f0a40160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a400d0970 con 0x7f0a401602b0 2023-07-20T09:50:54.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a40160e20 con 0x7f0a4006b220 2023-07-20T09:50:54.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.982+0000 7f0a44a9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a400cd300 con 0x7f0a4006c120 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a4006b220 0x7f0a40160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a4006b220 0x7f0a40160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37944/0 (socket says 172.21.15.82:37944) 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 -- 172.21.15.82:0/23562050 learned_addr learned my addr 172.21.15.82:0/23562050 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3e59c640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a4006c120 0x7f0a400cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 -- 172.21.15.82:0/23562050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a4006c120 msgr2=0x7f0a400cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a4006c120 0x7f0a400cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 -- 172.21.15.82:0/23562050 >> v1:172.21.15.183:6789/0 conn(0x7f0a401602b0 legacy=0x7f0a4006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 -- 172.21.15.82:0/23562050 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400cd5e0 con 0x7f0a4006b220 2023-07-20T09:50:54.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3ed9d640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a40160710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009e50 tx=0x7f0a3801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c778dda4825e9c26 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3d59a640 1 -- 172.21.15.82:0/23562050 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a5750 con 0x7f0a4006b220 2023-07-20T09:50:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3d59a640 1 -- 172.21.15.82:0/23562050 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a380a58b0 con 0x7f0a4006b220 2023-07-20T09:50:54.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.986+0000 7f0a3d59a640 1 -- 172.21.15.82:0/23562050 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a380a5c40 con 0x7f0a4006b220 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- 172.21.15.82:0/23562050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 msgr2=0x7f0a40160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a40160710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009e50 tx=0x7f0a3801c980 comp rx=0 tx=0).stop 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- 172.21.15.82:0/23562050 shutdown_connections 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a40160710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/23562050 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a4006c120 0x7f0a400cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- 172.21.15.82:0/23562050 >> 172.21.15.82:0/23562050 conn(0x7f0a4008c0a0 msgr2=0x7f0a4009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- 172.21.15.82:0/23562050 shutdown_connections 2023-07-20T09:50:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- 172.21.15.82:0/23562050 wait complete. 2023-07-20T09:50:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 Processor -- start 2023-07-20T09:50:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- start start 2023-07-20T09:50:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 0x7f0a401f9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 0x7f0a40152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a401537f0 con 0x7f0a4006b220 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a40148520 con 0x7f0a4006c120 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a44a9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4014f250 con 0x7f0a401602b0 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a3e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a3e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37952/0 (socket says 172.21.15.82:37952) 2023-07-20T09:50:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.990+0000 7f0a3e59c640 1 -- 172.21.15.82:0/1869631131 learned_addr learned my addr 172.21.15.82:0/1869631131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3ed9d640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 0x7f0a40152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 -- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 msgr2=0x7f0a40152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3dd9b640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 0x7f0a401f9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 0x7f0a40152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 -- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 msgr2=0x7f0a401f9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 0x7f0a401f9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 -- 172.21.15.82:0/1869631131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38009b30 con 0x7f0a4006b220 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3ed9d640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 0x7f0a40152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3dd9b640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 0x7f0a401f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3e59c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000d800 tx=0x7f0a3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000b6c0 con 0x7f0a4006b220 2023-07-20T09:50:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000b820 con 0x7f0a4006b220 2023-07-20T09:50:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a40153230 con 0x7f0a4006b220 2023-07-20T09:50:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3000bb90 con 0x7f0a4006b220 2023-07-20T09:50:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4014eee0 con 0x7f0a4006b220 2023-07-20T09:50:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4014ed40 con 0x7f0a4006b220 2023-07-20T09:50:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a3000bcf0 con 0x7f0a4006b220 2023-07-20T09:50:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 0x7f0a20068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a300842e0 con 0x7f0a4006b220 2023-07-20T09:50:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.994+0000 7f0a3dd9b640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 0x7f0a20068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.998+0000 7f0a3dd9b640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 0x7f0a20068740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0a4014ec90 tx=0x7f0a34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:53.998+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a4014ed40 con 0x7f0a4006b220 2023-07-20T09:50:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.146+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a4014ed40 con 0x7f0a4006b220 2023-07-20T09:50:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.146+0000 7f0a2effd640 1 -- 172.21.15.82:0/1869631131 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a4014ed40 con 0x7f0a4006b220 2023-07-20T09:50:54.184 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:54.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 msgr2=0x7f0a20068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 0x7f0a20068740 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0a4014ec90 tx=0x7f0a34009040 comp rx=0 tx=0).stop 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 msgr2=0x7f0a401f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000d800 tx=0x7f0a3000dcc0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 shutdown_connections 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0a20066280 0x7f0a20068740 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a401602b0 0x7f0a40152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a4006c120 0x7f0a401f9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 --2- 172.21.15.82:0/1869631131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a4006b220 0x7f0a401f8b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 >> 172.21.15.82:0/1869631131 conn(0x7f0a4008c0a0 msgr2=0x7f0a4015b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 shutdown_connections 2023-07-20T09:50:54.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.150+0000 7f0a44a9c640 1 -- 172.21.15.82:0/1869631131 wait complete. 2023-07-20T09:50:54.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:54.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 Processor -- start 2023-07-20T09:50:54.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 -- start start 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00cc15c6e0 0x7f00cc0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc15cac0 0x7f00cc0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0cdb40 con 0x7f00cc0d3200 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc0d07a0 con 0x7f00cc15c6e0 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00d1967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc0cd4f0 con 0x7f00cc15cac0 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00cc15c6e0 0x7f00cc0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00cc15c6e0 0x7f00cc0cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37960/0 (socket says 172.21.15.82:37960) 2023-07-20T09:50:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 -- 172.21.15.82:0/1710956011 learned_addr learned my addr 172.21.15.82:0/1710956011 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00cb7fe640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc15cac0 0x7f00cc0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 -- 172.21.15.82:0/1710956011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc15cac0 msgr2=0x7f00cc0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc15cac0 0x7f00cc0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 -- 172.21.15.82:0/1710956011 >> v1:172.21.15.183:6789/0 conn(0x7f00cc0d3200 legacy=0x7f00cc0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.354+0000 7f00caffd640 1 -- 172.21.15.82:0/1710956011 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0cd7d0 con 0x7f00cc15c6e0 2023-07-20T09:50:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00caffd640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc0cf640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009870 tx=0x7f00bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1375440a21b71e80 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00c9ffb640 1 -- 172.21.15.82:0/1710956011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0ab600 con 0x7f00cc15c6e0 2023-07-20T09:50:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00c9ffb640 1 -- 172.21.15.82:0/1710956011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc0a7050 con 0x7f00cc15c6e0 2023-07-20T09:50:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00c9ffb640 1 -- 172.21.15.82:0/1710956011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0ab980 con 0x7f00cc15c6e0 2023-07-20T09:50:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 -- 172.21.15.82:0/1710956011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 msgr2=0x7f00cc0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc0cf640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009870 tx=0x7f00bc01c3e0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 -- 172.21.15.82:0/1710956011 shutdown_connections 2023-07-20T09:50:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc15cac0 0x7f00cc0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 --2- 172.21.15.82:0/1710956011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc0cf640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 -- 172.21.15.82:0/1710956011 >> 172.21.15.82:0/1710956011 conn(0x7f00cc0d2600 msgr2=0x7f00cc0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 -- 172.21.15.82:0/1710956011 shutdown_connections 2023-07-20T09:50:54.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 -- 172.21.15.82:0/1710956011 wait complete. 2023-07-20T09:50:54.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.358+0000 7f00d1967640 1 Processor -- start 2023-07-20T09:50:54.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- start start 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 0x7f00cc1666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 0x7f00cc0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc167010 con 0x7f00cc15c6e0 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc156050 con 0x7f00cc15cac0 2023-07-20T09:50:54.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc0b2870 con 0x7f00cc0d3200 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37970/0 (socket says 172.21.15.82:37970) 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 -- 172.21.15.82:0/1425814383 learned_addr learned my addr 172.21.15.82:0/1425814383 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00caffd640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 0x7f00cc1666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00cb7fe640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 0x7f00cc0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 -- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 msgr2=0x7f00cc1666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 0x7f00cc1666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 -- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 msgr2=0x7f00cc0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 0x7f00cc0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 -- 172.21.15.82:0/1425814383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0094d0 con 0x7f00cc15c6e0 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00caffd640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 0x7f00cc1666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00cb7fe640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 0x7f00cc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:54.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00ca7fc640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b410 tx=0x7f00c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0004020 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c0004180 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0011630 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc166d30 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc155ce0 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.362+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc1561e0 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.366+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00c0011790 con 0x7f00cc15c6e0 2023-07-20T09:50:54.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.366+0000 7f00b3fff640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 0x7f00b8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.366+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00c0083b10 con 0x7f00cc15c6e0 2023-07-20T09:50:54.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.366+0000 7f00caffd640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 0x7f00b8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.366+0000 7f00caffd640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 0x7f00b8068740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0ad000 tx=0x7f00bc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.370+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00c0050f80 con 0x7f00cc15c6e0 2023-07-20T09:50:54.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00cc0b8580 con 0x7f00cc15c6e0 2023-07-20T09:50:54.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00b3fff640 1 -- 172.21.15.82:0/1425814383 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00c0015020 con 0x7f00cc15c6e0 2023-07-20T09:50:54.555 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:54.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 msgr2=0x7f00b8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 0x7f00b8068740 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0ad000 tx=0x7f00bc0a6000 comp rx=0 tx=0).stop 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 msgr2=0x7f00cc153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b410 tx=0x7f00c000b8d0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 shutdown_connections 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f00b8066280 0x7f00b8068740 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc15cac0 0x7f00cc0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc15c6e0 0x7f00cc153b10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 --2- 172.21.15.82:0/1425814383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc0d3200 0x7f00cc1666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 >> 172.21.15.82:0/1425814383 conn(0x7f00cc0d2600 msgr2=0x7f00cc072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 shutdown_connections 2023-07-20T09:50:54.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.518+0000 7f00d1967640 1 -- 172.21.15.82:0/1425814383 wait complete. 2023-07-20T09:50:54.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 Processor -- start 2023-07-20T09:50:54.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 -- start start 2023-07-20T09:50:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f775c0cac80 0x7f775c06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0ca110 con 0x7f775c0cdf20 2023-07-20T09:50:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0c9500 con 0x7f775c0ca7f0 2023-07-20T09:50:54.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f7761c9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c150920 con 0x7f775c0cac80 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f775c0cac80 0x7f775c06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f775c0cdf20 0x7f775c15a3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52256/0 (socket says 172.21.15.82:52256) 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775b7fe640 1 -- 172.21.15.82:0/3831829308 learned_addr learned my addr 172.21.15.82:0/3831829308 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775bfff640 1 -- 172.21.15.82:0/3831829308 >> v1:172.21.15.183:6789/0 conn(0x7f775c0ca7f0 legacy=0x7f775c06d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775bfff640 1 -- 172.21.15.82:0/3831829308 >> v1:172.21.15.82:6789/0 conn(0x7f775c0cdf20 legacy=0x7f775c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.678+0000 7f775bfff640 1 -- 172.21.15.82:0/3831829308 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0c97e0 con 0x7f775c0cac80 2023-07-20T09:50:54.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f775bfff640 1 --2- 172.21.15.82:0/3831829308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0cac80 0x7f775c06df20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7754009d90 tx=0x7f775401ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206e107cb2411e0d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f775affd640 1 -- 172.21.15.82:0/3831829308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540a7a30 con 0x7f775c0cac80 2023-07-20T09:50:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f775affd640 1 -- 172.21.15.82:0/3831829308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540a7b90 con 0x7f775c0cac80 2023-07-20T09:50:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f775affd640 1 -- 172.21.15.82:0/3831829308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540af440 con 0x7f775c0cac80 2023-07-20T09:50:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 -- 172.21.15.82:0/3831829308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0cac80 msgr2=0x7f775c06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 --2- 172.21.15.82:0/3831829308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0cac80 0x7f775c06df20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7754009d90 tx=0x7f775401ea60 comp rx=0 tx=0).stop 2023-07-20T09:50:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 -- 172.21.15.82:0/3831829308 shutdown_connections 2023-07-20T09:50:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 --2- 172.21.15.82:0/3831829308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0cac80 0x7f775c06df20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 -- 172.21.15.82:0/3831829308 >> 172.21.15.82:0/3831829308 conn(0x7f775c0cb620 msgr2=0x7f775c0cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 -- 172.21.15.82:0/3831829308 shutdown_connections 2023-07-20T09:50:54.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.682+0000 7f7761c9c640 1 -- 172.21.15.82:0/3831829308 wait complete. 2023-07-20T09:50:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 Processor -- start 2023-07-20T09:50:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 -- start start 2023-07-20T09:50:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 0x7f775c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f775c0cdf20 0x7f775c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0c8a20 con 0x7f775c0ca7f0 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0c6550 con 0x7f775c0cdf20 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7761c9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0c7f40 con 0x7f775c0cac80 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37982/0 (socket says 172.21.15.82:37982) 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 -- 172.21.15.82:0/1194114025 learned_addr learned my addr 172.21.15.82:0/1194114025 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775bfff640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f775c0cdf20 0x7f775c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7753fff640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 0x7f775c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 -- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 msgr2=0x7f775c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 0x7f775c0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 -- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f775c0cdf20 msgr2=0x7f775c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f775c0cdf20 0x7f775c06ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 -- 172.21.15.82:0/1194114025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754009a70 con 0x7f775c0ca7f0 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7753fff640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 0x7f775c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:54.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f775b7fe640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c500 tx=0x7f774c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.686+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c005cf0 con 0x7f775c0ca7f0 2023-07-20T09:50:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c005e50 con 0x7f775c0ca7f0 2023-07-20T09:50:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c0072f0 con 0x7f775c0ca7f0 2023-07-20T09:50:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c0c8220 con 0x7f775c0ca7f0 2023-07-20T09:50:54.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c0c54c0 con 0x7f775c0ca7f0 2023-07-20T09:50:54.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c073c70 con 0x7f775c0ca7f0 2023-07-20T09:50:54.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f774c007450 con 0x7f775c0ca7f0 2023-07-20T09:50:54.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7758ff9640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 0x7f773c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:54.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f774c083230 con 0x7f775c0ca7f0 2023-07-20T09:50:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7753fff640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 0x7f773c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:54.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.690+0000 7f7753fff640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 0x7f773c068740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f775c1fce80 tx=0x7f7744008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:54.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.694+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f774c050750 con 0x7f775c0ca7f0 2023-07-20T09:50:54.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.846+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f775c1650e0 con 0x7f775c0ca7f0 2023-07-20T09:50:54.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.846+0000 7f7758ff9640 1 -- 172.21.15.82:0/1194114025 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f774c053d70 con 0x7f775c0ca7f0 2023-07-20T09:50:54.884 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:54.885 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 msgr2=0x7f773c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 0x7f773c068740 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f775c1fce80 tx=0x7f7744008040 comp rx=0 tx=0).stop 2023-07-20T09:50:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 msgr2=0x7f775c0c4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f774c00c500 tx=0x7f774c00c9c0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 shutdown_connections 2023-07-20T09:50:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f773c066280 0x7f773c068740 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f775c0cdf20 0x7f775c06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f775c0cac80 0x7f775c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 --2- 172.21.15.82:0/1194114025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c0ca7f0 0x7f775c0c4f80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 >> 172.21.15.82:0/1194114025 conn(0x7f775c0cb620 msgr2=0x7f775c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 shutdown_connections 2023-07-20T09:50:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:54.850+0000 7f7761c9c640 1 -- 172.21.15.82:0/1194114025 wait complete. 2023-07-20T09:50:54.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:54.907 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:55.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 Processor -- start 2023-07-20T09:50:55.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 -- start start 2023-07-20T09:50:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7701602b0 0x7ff770160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff77006ab10 0x7ff77006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7700ce4f0 con 0x7ff77006c120 2023-07-20T09:50:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77006b4a0 con 0x7ff7701602b0 2023-07-20T09:50:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff776503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700d0970 con 0x7ff77006ab10 2023-07-20T09:50:55.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7701602b0 0x7ff770160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff7701602b0 0x7ff770160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37996/0 (socket says 172.21.15.82:37996) 2023-07-20T09:50:55.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 -- 172.21.15.82:0/3953461182 learned_addr learned my addr 172.21.15.82:0/3953461182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:55.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76ffff640 1 --1- 172.21.15.82:0/3953461182 >> v1:172.21.15.82:6789/0 conn(0x7ff77006c120 0x7ff7700cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52272/0 (socket says 172.21.15.82:52272) 2023-07-20T09:50:55.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff774aa0640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff77006ab10 0x7ff77006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 -- 172.21.15.82:0/3953461182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff77006ab10 msgr2=0x7ff77006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff77006ab10 0x7ff77006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 -- 172.21.15.82:0/3953461182 >> v1:172.21.15.82:6789/0 conn(0x7ff77006c120 legacy=0x7ff7700cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.014+0000 7ff76f7fe640 1 -- 172.21.15.82:0/3953461182 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff770160e20 con 0x7ff7701602b0 2023-07-20T09:50:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701602b0 0x7ff770160740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff764009870 tx=0x7ff76401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7630f527b79c170b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff76effd640 1 -- 172.21.15.82:0/3953461182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640ab680 con 0x7ff7701602b0 2023-07-20T09:50:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff76effd640 1 -- 172.21.15.82:0/3953461182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7640ab7e0 con 0x7ff7701602b0 2023-07-20T09:50:55.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff76effd640 1 -- 172.21.15.82:0/3953461182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640abb70 con 0x7ff7701602b0 2023-07-20T09:50:55.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 -- 172.21.15.82:0/3953461182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701602b0 msgr2=0x7ff770160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701602b0 0x7ff770160740 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff764009870 tx=0x7ff76401c480 comp rx=0 tx=0).stop 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 -- 172.21.15.82:0/3953461182 shutdown_connections 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff77006ab10 0x7ff77006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 --2- 172.21.15.82:0/3953461182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff7701602b0 0x7ff770160740 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 -- 172.21.15.82:0/3953461182 >> 172.21.15.82:0/3953461182 conn(0x7ff77008c0a0 msgr2=0x7ff77009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 -- 172.21.15.82:0/3953461182 shutdown_connections 2023-07-20T09:50:55.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.018+0000 7ff776503640 1 -- 172.21.15.82:0/3953461182 wait complete. 2023-07-20T09:50:55.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 Processor -- start 2023-07-20T09:50:55.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- start start 2023-07-20T09:50:55.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 0x7ff770156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7701602b0 0x7ff770157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700cc480 con 0x7ff77006ab10 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff770156190 con 0x7ff77006c120 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff770155580 con 0x7ff7701602b0 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38008/0 (socket says 172.21.15.82:38008) 2023-07-20T09:50:55.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 -- 172.21.15.82:0/4029940043 learned_addr learned my addr 172.21.15.82:0/4029940043 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:55.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff774aa0640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7701602b0 0x7ff770157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 0x7ff770156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 -- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7701602b0 msgr2=0x7ff770157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7701602b0 0x7ff770157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 -- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 msgr2=0x7ff770156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 0x7ff770156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 -- 172.21.15.82:0/4029940043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640094d0 con 0x7ff77006ab10 2023-07-20T09:50:55.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 0x7ff770156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76ffff640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c4c0 tx=0x7ff76000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760007480 con 0x7ff77006ab10 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7600075e0 con 0x7ff77006ab10 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff770155860 con 0x7ff77006ab10 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760004a10 con 0x7ff77006ab10 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.022+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff770155e20 con 0x7ff77006ab10 2023-07-20T09:50:55.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77015f2a0 con 0x7ff77006ab10 2023-07-20T09:50:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff760004b70 con 0x7ff77006ab10 2023-07-20T09:50:55.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff76cff9640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 0x7ff75c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff760083270 con 0x7ff77006ab10 2023-07-20T09:50:55.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 0x7ff75c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.026+0000 7ff76f7fe640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 0x7ff75c068740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7640af000 tx=0x7ff7640a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.030+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7600505c0 con 0x7ff77006ab10 2023-07-20T09:50:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff77004da30 con 0x7ff77006ab10 2023-07-20T09:50:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff76cff9640 1 -- 172.21.15.82:0/4029940043 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff760053be0 con 0x7ff77006ab10 2023-07-20T09:50:55.215 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:55.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 msgr2=0x7ff75c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 0x7ff75c068740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7640af000 tx=0x7ff7640a7000 comp rx=0 tx=0).stop 2023-07-20T09:50:55.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 msgr2=0x7ff77014d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.178+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff76000c4c0 tx=0x7ff76000c980 comp rx=0 tx=0).stop 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 shutdown_connections 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff75c066280 0x7ff75c068740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff7701602b0 0x7ff770157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff77006c120 0x7ff770156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 --2- 172.21.15.82:0/4029940043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff77006ab10 0x7ff77014d640 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 >> 172.21.15.82:0/4029940043 conn(0x7ff77008c0a0 msgr2=0x7ff7700b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 shutdown_connections 2023-07-20T09:50:55.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.182+0000 7ff776503640 1 -- 172.21.15.82:0/4029940043 wait complete. 2023-07-20T09:50:55.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.342+0000 7f13ec60b640 1 Processor -- start 2023-07-20T09:50:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.342+0000 7f13ec60b640 1 -- start start 2023-07-20T09:50:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.342+0000 7f13ec60b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.342+0000 7f13ec60b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ec60b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e40b06b0 con 0x7f13e4159830 2023-07-20T09:50:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ec60b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e40cce90 con 0x7f13e4159450 2023-07-20T09:50:55.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ec60b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40cc8d0 con 0x7f13e40afd50 2023-07-20T09:50:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ea3a7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13eaba8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ea3a7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:55534/0 (socket says 172.21.15.82:55534) 2023-07-20T09:50:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ea3a7640 1 -- 172.21.15.82:0/1011956487 learned_addr learned my addr 172.21.15.82:0/1011956487 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13e9ba6640 1 --1- 172.21.15.82:0/1011956487 >> v1:172.21.15.183:6789/0 conn(0x7f13e4159830 0x7f13e40cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:40046/0 (socket says 172.21.15.82:40046) 2023-07-20T09:50:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13eaba8640 1 -- 172.21.15.82:0/1011956487 >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 msgr2=0x7f13e415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13eaba8640 1 --2- 172.21.15.82:0/1011956487 >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13eaba8640 1 -- 172.21.15.82:0/1011956487 >> v1:172.21.15.183:6789/0 conn(0x7f13e4159830 legacy=0x7f13e40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13eaba8640 1 -- 172.21.15.82:0/1011956487 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40ccbb0 con 0x7f13e40afd50 2023-07-20T09:50:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.346+0000 7f13ea3a7640 1 --2- 172.21.15.82:0/1011956487 >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:50:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13eaba8640 1 --2- 172.21.15.82:0/1011956487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40b0170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009d90 tx=0x7f13dc01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b4e87f2147f392 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13e93a5640 1 -- 172.21.15.82:0/1011956487 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0a59e0 con 0x7f13e40afd50 2023-07-20T09:50:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13e93a5640 1 -- 172.21.15.82:0/1011956487 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc0a5b40 con 0x7f13e40afd50 2023-07-20T09:50:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13e93a5640 1 -- 172.21.15.82:0/1011956487 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc0ad440 con 0x7f13e40afd50 2023-07-20T09:50:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- 172.21.15.82:0/1011956487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 msgr2=0x7f13e40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- 172.21.15.82:0/1011956487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40b0170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009d90 tx=0x7f13dc01c920 comp rx=0 tx=0).stop 2023-07-20T09:50:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- 172.21.15.82:0/1011956487 shutdown_connections 2023-07-20T09:50:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- 172.21.15.82:0/1011956487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40b0170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- 172.21.15.82:0/1011956487 >> v2:172.21.15.183:3300/0 conn(0x7f13e4159450 0x7f13e415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- 172.21.15.82:0/1011956487 >> 172.21.15.82:0/1011956487 conn(0x7f13e40cad50 msgr2=0x7f13e40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- 172.21.15.82:0/1011956487 shutdown_connections 2023-07-20T09:50:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- 172.21.15.82:0/1011956487 wait complete. 2023-07-20T09:50:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 Processor -- start 2023-07-20T09:50:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- start start 2023-07-20T09:50:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13e4153750 0x7f13e41524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40c84d0 con 0x7f13e4159450 2023-07-20T09:50:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40b3520 con 0x7f13e4153750 2023-07-20T09:50:55.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.350+0000 7f13ec60b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40b3800 con 0x7f13e40afd50 2023-07-20T09:50:55.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38022/0 (socket says 172.21.15.82:38022) 2023-07-20T09:50:55.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 -- 172.21.15.82:0/918149116 learned_addr learned my addr 172.21.15.82:0/918149116 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13ea3a7640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13eaba8640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13e4153750 0x7f13e41524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 -- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 msgr2=0x7f13e40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 -- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13e4153750 msgr2=0x7f13e41524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13e4153750 0x7f13e41524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 -- 172.21.15.82:0/918149116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00094d0 con 0x7f13e4159450 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13e9ba6640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c370 tx=0x7f13d400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40074e0 con 0x7f13e4159450 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d4007640 con 0x7f13e4159450 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc009a70 con 0x7f13e4159450 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d4004a30 con 0x7f13e4159450 2023-07-20T09:50:55.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e40c58e0 con 0x7f13e4159450 2023-07-20T09:50:55.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e40b3cb0 con 0x7f13e4159450 2023-07-20T09:50:55.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.354+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13d4004b90 con 0x7f13e4159450 2023-07-20T09:50:55.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.358+0000 7f13daffd640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 0x7f13c8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.358+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13d4083590 con 0x7f13e4159450 2023-07-20T09:50:55.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.358+0000 7f13ea3a7640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 0x7f13c8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.358+0000 7f13ea3a7640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 0x7f13c8068740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13e0006cb0 tx=0x7f13e0009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.358+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13d4050ac0 con 0x7f13e4159450 2023-07-20T09:50:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.506+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13e40cbbf0 con 0x7f13e4159450 2023-07-20T09:50:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.506+0000 7f13daffd640 1 -- 172.21.15.82:0/918149116 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13d40540e0 con 0x7f13e4159450 2023-07-20T09:50:55.544 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 msgr2=0x7f13c8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 0x7f13c8068740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f13e0006cb0 tx=0x7f13e0009240 comp rx=0 tx=0).stop 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 msgr2=0x7f13e4153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f13d400c370 tx=0x7f13d400c830 comp rx=0 tx=0).stop 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 shutdown_connections 2023-07-20T09:50:55.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f13c8066280 0x7f13c8068740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13e4153750 0x7f13e41524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13e4159450 0x7f13e4153210 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 --2- 172.21.15.82:0/918149116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13e40afd50 0x7f13e40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 >> 172.21.15.82:0/918149116 conn(0x7f13e40cad50 msgr2=0x7f13e40705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 shutdown_connections 2023-07-20T09:50:55.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.510+0000 7f13ec60b640 1 -- 172.21.15.82:0/918149116 wait complete. 2023-07-20T09:50:55.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 Processor -- start 2023-07-20T09:50:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 -- start start 2023-07-20T09:50:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 0x7f9fe00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9fe01602b0 0x7f9fe0160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00d0970 con 0x7f9fe006ab10 2023-07-20T09:50:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe0160e20 con 0x7f9fe01602b0 2023-07-20T09:50:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fe5627640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00cd300 con 0x7f9fe006c120 2023-07-20T09:50:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdf7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9fe006ab10 0x7f9fe006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52274/0 (socket says 172.21.15.82:52274) 2023-07-20T09:50:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdf7fe640 1 -- 172.21.15.82:0/3818928797 learned_addr learned my addr 172.21.15.82:0/3818928797 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fd67fc640 1 --2- 172.21.15.82:0/3818928797 >> v2:172.21.15.183:3300/0 conn(0x7f9fe01602b0 0x7f9fe0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/3818928797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 0x7f9fe00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fde7fc640 1 -- 172.21.15.82:0/3818928797 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748675319 0 0) 0x7f9fe00d0970 con 0x7f9fe006ab10 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fde7fc640 1 -- 172.21.15.82:0/3818928797 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fcc003530 con 0x7f9fe006ab10 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdeffd640 1 -- 172.21.15.82:0/3818928797 >> v2:172.21.15.183:3300/0 conn(0x7f9fe01602b0 msgr2=0x7f9fe0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/3818928797 >> v2:172.21.15.183:3300/0 conn(0x7f9fe01602b0 0x7f9fe0160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdeffd640 1 -- 172.21.15.82:0/3818928797 >> v1:172.21.15.82:6789/0 conn(0x7f9fe006ab10 legacy=0x7f9fe006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.670+0000 7f9fdeffd640 1 -- 172.21.15.82:0/3818928797 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00cd5e0 con 0x7f9fe006c120 2023-07-20T09:50:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/3818928797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 0x7f9fe00cdde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80097c0 tx=0x7f9fc801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52683365246ce552 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fde7fc640 1 -- 172.21.15.82:0/3818928797 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80ab600 con 0x7f9fe006c120 2023-07-20T09:50:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fde7fc640 1 -- 172.21.15.82:0/3818928797 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc80a7050 con 0x7f9fe006c120 2023-07-20T09:50:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fde7fc640 1 -- 172.21.15.82:0/3818928797 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80ab980 con 0x7f9fe006c120 2023-07-20T09:50:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 -- 172.21.15.82:0/3818928797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 msgr2=0x7f9fe00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 --2- 172.21.15.82:0/3818928797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 0x7f9fe00cdde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80097c0 tx=0x7f9fc801c3f0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 -- 172.21.15.82:0/3818928797 shutdown_connections 2023-07-20T09:50:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 --2- 172.21.15.82:0/3818928797 >> v2:172.21.15.183:3300/0 conn(0x7f9fe01602b0 0x7f9fe0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 --2- 172.21.15.82:0/3818928797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006c120 0x7f9fe00cdde0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 -- 172.21.15.82:0/3818928797 >> 172.21.15.82:0/3818928797 conn(0x7f9fe008c0a0 msgr2=0x7f9fe009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 -- 172.21.15.82:0/3818928797 shutdown_connections 2023-07-20T09:50:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.674+0000 7f9fe5627640 1 -- 172.21.15.82:0/3818928797 wait complete. 2023-07-20T09:50:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 Processor -- start 2023-07-20T09:50:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- start start 2023-07-20T09:50:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 0x7f9fe00c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fe01602b0 0x7f9fe01f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0155f70 con 0x7f9fe006c120 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe014d920 con 0x7f9fe01602b0 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe01553f0 con 0x7f9fe006ab10 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38032/0 (socket says 172.21.15.82:38032) 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 -- 172.21.15.82:0/2307802659 learned_addr learned my addr 172.21.15.82:0/2307802659 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 0x7f9fe00c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fdf7fe640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fe01602b0 0x7f9fe01f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 -- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 msgr2=0x7f9fe00c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 0x7f9fe00c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 -- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fe01602b0 msgr2=0x7f9fe01f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fe01602b0 0x7f9fe01f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 -- 172.21.15.82:0/2307802659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009420 con 0x7f9fe006c120 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 0x7f9fe00c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd67fc640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000e870 tx=0x7f9fd000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0009510 con 0x7f9fe006c120 2023-07-20T09:50:55.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd000eec0 con 0x7f9fe006c120 2023-07-20T09:50:55.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe01556d0 con 0x7f9fe006c120 2023-07-20T09:50:55.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000cb40 con 0x7f9fe006c120 2023-07-20T09:50:55.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.678+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe0155c90 con 0x7f9fe006c120 2023-07-20T09:50:55.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe004da30 con 0x7f9fe006c120 2023-07-20T09:50:55.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fd000cca0 con 0x7f9fe006c120 2023-07-20T09:50:55.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fd7fff640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 0x7f9fc0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:55.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fd0083ee0 con 0x7f9fe006c120 2023-07-20T09:50:55.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 0x7f9fc0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:55.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.682+0000 7f9fdeffd640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 0x7f9fc0068740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ad000 tx=0x7f9fc80a4f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:55.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.686+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fd00512c0 con 0x7f9fe006c120 2023-07-20T09:50:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.830+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fe00cee40 con 0x7f9fe006c120 2023-07-20T09:50:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.830+0000 7f9fd7fff640 1 -- 172.21.15.82:0/2307802659 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9fd0017020 con 0x7f9fe006c120 2023-07-20T09:50:55.868 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 msgr2=0x7f9fc0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 0x7f9fc0068740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80ad000 tx=0x7f9fc80a4f90 comp rx=0 tx=0).stop 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 msgr2=0x7f9fe014d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000e870 tx=0x7f9fd000ec70 comp rx=0 tx=0).stop 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 shutdown_connections 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9fc0066280 0x7f9fc0068740 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fe01602b0 0x7f9fe01f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fe006c120 0x7f9fe014d3e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 --2- 172.21.15.82:0/2307802659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9fe006ab10 0x7f9fe00c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 >> 172.21.15.82:0/2307802659 conn(0x7f9fe008c0a0 msgr2=0x7f9fe00d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 shutdown_connections 2023-07-20T09:50:55.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.834+0000 7f9fe5627640 1 -- 172.21.15.82:0/2307802659 wait complete. 2023-07-20T09:50:55.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:56.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 Processor -- start 2023-07-20T09:50:56.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 -- start start 2023-07-20T09:50:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b48158ce0 0x7f6b4815c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b480c9610 con 0x7f6b48069750 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4815d670 con 0x7f6b4806c630 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4ffdb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b481590c0 con 0x7f6b48158ce0 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b48158ce0 0x7f6b4815c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6b48158ce0 0x7f6b4815c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38034/0 (socket says 172.21.15.82:38034) 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 -- 172.21.15.82:0/1306249540 learned_addr learned my addr 172.21.15.82:0/1306249540 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4d576640 1 --1- 172.21.15.82:0/1306249540 >> v1:172.21.15.82:6789/0 conn(0x7f6b48069750 0x7f6b4806bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52288/0 (socket says 172.21.15.82:52288) 2023-07-20T09:50:56.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 -- 172.21.15.82:0/1306249540 >> v1:172.21.15.183:6789/0 conn(0x7f6b4806c630 legacy=0x7f6b480ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:56.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 -- 172.21.15.82:0/1306249540 >> v1:172.21.15.82:6789/0 conn(0x7f6b48069750 legacy=0x7f6b4806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4dd77640 1 -- 172.21.15.82:0/1306249540 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4815d0b0 con 0x7f6b48158ce0 2023-07-20T09:50:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:55.998+0000 7f6b4cd75640 1 -- 172.21.15.82:0/1306249540 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727040130 0 0) 0x7f6b480c9610 con 0x7f6b48069750 2023-07-20T09:50:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4dd77640 1 --2- 172.21.15.82:0/1306249540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b4815c740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400aa10 tx=0x7f6b4401d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5189dbeb1d642d2a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4cd75640 1 -- 172.21.15.82:0/1306249540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a6950 con 0x7f6b48158ce0 2023-07-20T09:50:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4cd75640 1 -- 172.21.15.82:0/1306249540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b440a6ab0 con 0x7f6b48158ce0 2023-07-20T09:50:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4cd75640 1 -- 172.21.15.82:0/1306249540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a6e40 con 0x7f6b48158ce0 2023-07-20T09:50:56.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/1306249540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 msgr2=0x7f6b4815c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/1306249540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b4815c740 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400aa10 tx=0x7f6b4401d8a0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/1306249540 shutdown_connections 2023-07-20T09:50:56.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/1306249540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b4815c740 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/1306249540 >> 172.21.15.82:0/1306249540 conn(0x7f6b480cf070 msgr2=0x7f6b480cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:56.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/1306249540 shutdown_connections 2023-07-20T09:50:56.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.002+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/1306249540 wait complete. 2023-07-20T09:50:56.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 Processor -- start 2023-07-20T09:50:56.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- start start 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 0x7f6b4814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b4806c630 0x7f6b48159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815aab0 con 0x7f6b48158ce0 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815ad90 con 0x7f6b48069750 2023-07-20T09:50:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4815b070 con 0x7f6b4806c630 2023-07-20T09:50:56.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38050/0 (socket says 172.21.15.82:38050) 2023-07-20T09:50:56.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 -- 172.21.15.82:0/2206761290 learned_addr learned my addr 172.21.15.82:0/2206761290 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:56.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4dd77640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 0x7f6b4814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4d576640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b4806c630 0x7f6b48159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 -- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b4806c630 msgr2=0x7f6b48159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b4806c630 0x7f6b48159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 -- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 msgr2=0x7f6b4814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 0x7f6b4814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 -- 172.21.15.82:0/2206761290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4400a670 con 0x7f6b48158ce0 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4dd77640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 0x7f6b4814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4e578640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c780 tx=0x7f6b4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40004b70 con 0x7f6b48158ce0 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000ce90 con 0x7f6b48158ce0 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000a850 con 0x7f6b48158ce0 2023-07-20T09:50:56.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4815b350 con 0x7f6b48158ce0 2023-07-20T09:50:56.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4815a150 con 0x7f6b48158ce0 2023-07-20T09:50:56.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.006+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4804da30 con 0x7f6b48158ce0 2023-07-20T09:50:56.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.010+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b4000a9b0 con 0x7f6b48158ce0 2023-07-20T09:50:56.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.010+0000 7f6b3e7fc640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 0x7f6b2c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.010+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b40083f30 con 0x7f6b48158ce0 2023-07-20T09:50:56.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.010+0000 7f6b4dd77640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 0x7f6b2c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.010+0000 7f6b4dd77640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 0x7f6b2c068740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b0000 tx=0x7f6b44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.014+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b40054da0 con 0x7f6b48158ce0 2023-07-20T09:50:56.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b4806df10 con 0x7f6b48158ce0 2023-07-20T09:50:56.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b3e7fc640 1 -- 172.21.15.82:0/2206761290 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b40054930 con 0x7f6b48158ce0 2023-07-20T09:50:56.198 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 msgr2=0x7f6b2c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 0x7f6b2c068740 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b0000 tx=0x7f6b44008040 comp rx=0 tx=0).stop 2023-07-20T09:50:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 msgr2=0x7f6b48154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000c780 tx=0x7f6b4000cc40 comp rx=0 tx=0).stop 2023-07-20T09:50:56.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 shutdown_connections 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f6b2c066280 0x7f6b2c068740 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b48158ce0 0x7f6b48154d00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6b4806c630 0x7f6b48159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 --2- 172.21.15.82:0/2206761290 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b48069750 0x7f6b4814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 >> 172.21.15.82:0/2206761290 conn(0x7f6b480cf070 msgr2=0x7f6b48069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 shutdown_connections 2023-07-20T09:50:56.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.162+0000 7f6b4ffdb640 1 -- 172.21.15.82:0/2206761290 wait complete. 2023-07-20T09:50:56.225 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-07-20T09:50:56.226 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T09:50:56.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-20T09:50:56.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 Processor -- start 2023-07-20T09:50:56.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 -- start start 2023-07-20T09:50:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff52015c5f0 0x7ff5200b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5200ccfb0 0x7ff5200ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5200ce9a0 0x7ff5200b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200cee50 con 0x7ff5200ccfb0 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5200b7c20 con 0x7ff5200ce9a0 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff524e69640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52015c9d0 con 0x7ff52015c5f0 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5200ccfb0 0x7ff5200ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5200ccfb0 0x7ff5200ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38062/0 (socket says 172.21.15.82:38062) 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 -- 172.21.15.82:0/3668486944 learned_addr learned my addr 172.21.15.82:0/3668486944 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff51ffff640 1 --2- 172.21.15.82:0/3668486944 >> v2:172.21.15.183:3300/0 conn(0x7ff5200ce9a0 0x7ff5200b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff51f7fe640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff52015c5f0 0x7ff5200b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 -- 172.21.15.82:0/3668486944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff52015c5f0 msgr2=0x7ff5200b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff52015c5f0 0x7ff5200b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 -- 172.21.15.82:0/3668486944 >> v2:172.21.15.183:3300/0 conn(0x7ff5200ce9a0 msgr2=0x7ff5200b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 --2- 172.21.15.82:0/3668486944 >> v2:172.21.15.183:3300/0 conn(0x7ff5200ce9a0 0x7ff5200b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.330+0000 7ff516ffd640 1 -- 172.21.15.82:0/3668486944 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200ce030 con 0x7ff5200ccfb0 2023-07-20T09:50:56.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff516ffd640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5200ccfb0 0x7ff5200ce460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5200b5460 tx=0x7ff50801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b351f488c5d8204 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff51effd640 1 -- 172.21.15.82:0/3668486944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080af400 con 0x7ff5200ccfb0 2023-07-20T09:50:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff51effd640 1 -- 172.21.15.82:0/3668486944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5080ab050 con 0x7ff5200ccfb0 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff51effd640 1 -- 172.21.15.82:0/3668486944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5080af780 con 0x7ff5200ccfb0 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 -- 172.21.15.82:0/3668486944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5200ccfb0 msgr2=0x7ff5200ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5200ccfb0 0x7ff5200ce460 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5200b5460 tx=0x7ff50801f1c0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 -- 172.21.15.82:0/3668486944 shutdown_connections 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 --2- 172.21.15.82:0/3668486944 >> v2:172.21.15.183:3300/0 conn(0x7ff5200ce9a0 0x7ff5200b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5200ccfb0 0x7ff5200ce460 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 --2- 172.21.15.82:0/3668486944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff52015c5f0 0x7ff5200b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 -- 172.21.15.82:0/3668486944 >> 172.21.15.82:0/3668486944 conn(0x7ff520065710 msgr2=0x7ff520065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 -- 172.21.15.82:0/3668486944 shutdown_connections 2023-07-20T09:50:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.334+0000 7ff524e69640 1 -- 172.21.15.82:0/3668486944 wait complete. 2023-07-20T09:50:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 Processor -- start 2023-07-20T09:50:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- start start 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5200ccfb0 0x7ff5200a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5200ce9a0 0x7ff5200ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200aa480 con 0x7ff52015c5f0 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200aa720 con 0x7ff5200ccfb0 2023-07-20T09:50:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5200aaa00 con 0x7ff5200ce9a0 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38068/0 (socket says 172.21.15.82:38068) 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 -- 172.21.15.82:0/477018287 learned_addr learned my addr 172.21.15.82:0/477018287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51f7fe640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5200ccfb0 0x7ff5200a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff516ffd640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5200ce9a0 0x7ff5200ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 -- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5200ce9a0 msgr2=0x7ff5200ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5200ce9a0 0x7ff5200ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 -- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5200ccfb0 msgr2=0x7ff5200a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5200ccfb0 0x7ff5200a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 -- 172.21.15.82:0/477018287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508009b30 con 0x7ff52015c5f0 2023-07-20T09:50:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51ffff640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d800 tx=0x7ff51800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5180096c0 con 0x7ff52015c5f0 2023-07-20T09:50:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518009820 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5200aace0 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518009bd0 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5200ab2a0 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.338+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5200ab490 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.342+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff518009d30 con 0x7ff52015c5f0 2023-07-20T09:50:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.342+0000 7ff51cff9640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 0x7ff500068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.342+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff518084460 con 0x7ff52015c5f0 2023-07-20T09:50:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.342+0000 7ff51f7fe640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 0x7ff500068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.342+0000 7ff51f7fe640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 0x7ff500068740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff5200d03e0 tx=0x7ff510008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.346+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff518051840 con 0x7ff52015c5f0 2023-07-20T09:50:56.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.542+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7ff52004da30 con 0x7ff52015c5f0 2023-07-20T09:50:56.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff51cff9640 1 -- 172.21.15.82:0/477018287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff51800b3c0 con 0x7ff52015c5f0 2023-07-20T09:50:56.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 msgr2=0x7ff500068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 0x7ff500068740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff5200d03e0 tx=0x7ff510008040 comp rx=0 tx=0).stop 2023-07-20T09:50:56.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 msgr2=0x7ff5200b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d800 tx=0x7ff51800dcc0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 shutdown_connections 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff500066280 0x7ff500068740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff52015c5f0 0x7ff5200b55d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5200ce9a0 0x7ff5200ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 --2- 172.21.15.82:0/477018287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5200ccfb0 0x7ff5200a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:56.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 >> 172.21.15.82:0/477018287 conn(0x7ff520065710 msgr2=0x7ff5200cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 shutdown_connections 2023-07-20T09:50:56.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:56.922+0000 7ff524e69640 1 -- 172.21.15.82:0/477018287 wait complete. 2023-07-20T09:50:56.980 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 Processor -- start 2023-07-20T09:50:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 -- start start 2023-07-20T09:50:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f2c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9f2c0d0d10 0x7f9f2c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0d16b0 con 0x7f9f2c0cf110 2023-07-20T09:50:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0d31c0 con 0x7f9f2c0d0d10 2023-07-20T09:50:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f32537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b3520 con 0x7f9f2c15cab0 2023-07-20T09:50:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f30ad4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9f2c0cf110 0x7f9f2c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52290/0 (socket says 172.21.15.82:52290) 2023-07-20T09:50:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f30ad4640 1 -- 172.21.15.82:0/3309506976 learned_addr learned my addr 172.21.15.82:0/3309506976 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040534120 0 0) 0x7f9f2c0d16b0 con 0x7f9f2c0cf110 2023-07-20T09:50:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2b7fe640 1 --2- 172.21.15.82:0/3309506976 >> v2:172.21.15.183:3300/0 conn(0x7f9f2c0d0d10 0x7f9f2c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f2c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14003530 con 0x7f9f2c0cf110 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3827685537 0 0) 0x7f9f14003530 con 0x7f9f2c0cf110 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 msgr2=0x7f9f2c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f2c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 >> v2:172.21.15.183:3300/0 conn(0x7f9f2c0d0d10 msgr2=0x7f9f2c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.082+0000 7f9f2affd640 1 --2- 172.21.15.82:0/3309506976 >> v2:172.21.15.183:3300/0 conn(0x7f9f2c0d0d10 0x7f9f2c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0b2910 con 0x7f9f2c0cf110 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f9f24001a00 con 0x7f9f2c0cf110 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 >> v1:172.21.15.82:6789/0 conn(0x7f9f2c0cf110 legacy=0x7f9f2c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f14005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b3520 con 0x7f9f14003980 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400b990 con 0x7f9f140047d0 2023-07-20T09:50:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1400bad0 con 0x7f9f2c15cab0 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f30ad4640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f14005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2b7fe640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 -- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 msgr2=0x7f9f14005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f14005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 -- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f140047d0 msgr2=0x7f9f14004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f140047d0 0x7f9f14004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 -- 172.21.15.82:0/3309506976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14003530 con 0x7f9f14003980 2023-07-20T09:50:57.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f30ad4640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c15cab0 0x7f9f14005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:57.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f14003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009ae0 tx=0x7f9f1c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99389fc8445da37 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0a5510 con 0x7f9f14003980 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c0a5670 con 0x7f9f14003980 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.086+0000 7f9f2affd640 1 -- 172.21.15.82:0/3309506976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0a5a20 con 0x7f9f14003980 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- 172.21.15.82:0/3309506976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 msgr2=0x7f9f14003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 --2- 172.21.15.82:0/3309506976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f14003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009ae0 tx=0x7f9f1c01c9c0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f30ad4640 1 -- 172.21.15.82:0/3309506976 reap_dead start 2023-07-20T09:50:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- 172.21.15.82:0/3309506976 shutdown_connections 2023-07-20T09:50:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- 172.21.15.82:0/3309506976 >> 172.21.15.82:0/3309506976 conn(0x7f9f2c08c120 msgr2=0x7f9f2c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- 172.21.15.82:0/3309506976 shutdown_connections 2023-07-20T09:50:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- 172.21.15.82:0/3309506976 wait complete. 2023-07-20T09:50:57.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 Processor -- start 2023-07-20T09:50:57.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- start start 2023-07-20T09:50:57.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c0b55f0 0x7f9f2c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 0x7f9f2c0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0af2f0 con 0x7f9f14003980 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c74c0 con 0x7f9f2c0b6d60 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f32537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c77a0 con 0x7f9f2c0b55f0 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38084/0 (socket says 172.21.15.82:38084) 2023-07-20T09:50:57.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.090+0000 7f9f2bfff640 1 -- 172.21.15.82:0/1375192977 learned_addr learned my addr 172.21.15.82:0/1375192977 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f30ad4640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 0x7f9f2c0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2b7fe640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c0b55f0 0x7f9f2c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 -- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c0b55f0 msgr2=0x7f9f2c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c0b55f0 0x7f9f2c156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 -- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 msgr2=0x7f9f2c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 0x7f9f2c0b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 -- 172.21.15.82:0/1375192977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0c7a80 con 0x7f9f14003980 2023-07-20T09:50:57.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f30ad4640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 0x7f9f2c0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f2bfff640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0b0040 tx=0x7f9f14005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0be070 con 0x7f9f14003980 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c0a5e60 con 0x7f9f14003980 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0a5510 con 0x7f9f14003980 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c0c7d60 con 0x7f9f14003980 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c0b7730 con 0x7f9f14003980 2023-07-20T09:50:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c0af4a0 con 0x7f9f14003980 2023-07-20T09:50:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f1c0b4040 con 0x7f9f14003980 2023-07-20T09:50:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.094+0000 7f9f28ff9640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 0x7f9f18068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.098+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f1c11d440 con 0x7f9f14003980 2023-07-20T09:50:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.098+0000 7f9f2b7fe640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 0x7f9f18068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.098+0000 7f9f2b7fe640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 0x7f9f18068770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1611f0 tx=0x7f9f20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.098+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f2c0af4a0 con 0x7f9f14003980 2023-07-20T09:50:57.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.246+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f2c0d1990 con 0x7f9f14003980 2023-07-20T09:50:57.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f28ff9640 1 -- 172.21.15.82:0/1375192977 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f9f1c0ee500 con 0x7f9f14003980 2023-07-20T09:50:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:57.286 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 msgr2=0x7f9f18068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 0x7f9f18068770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c1611f0 tx=0x7f9f20008040 comp rx=0 tx=0).stop 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 msgr2=0x7f9f2c0c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0b0040 tx=0x7f9f14005800 comp rx=0 tx=0).stop 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 shutdown_connections 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9f180662b0 0x7f9f18068770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f2c0b6d60 0x7f9f2c0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f2c0b55f0 0x7f9f2c156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 --2- 172.21.15.82:0/1375192977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f14003980 0x7f9f2c0c8ac0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 >> 172.21.15.82:0/1375192977 conn(0x7f9f2c08c120 msgr2=0x7f9f2c0d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 shutdown_connections 2023-07-20T09:50:57.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.250+0000 7f9f32537640 1 -- 172.21.15.82:0/1375192977 wait complete. 2023-07-20T09:50:57.307 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:57.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:57.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 Processor -- start 2023-07-20T09:50:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 -- start start 2023-07-20T09:50:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 0x7f5f400ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f400cd3e0 0x7f5f4006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400caf40 con 0x7f5f4015c720 2023-07-20T09:50:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4006c6a0 con 0x7f5f400cd3e0 2023-07-20T09:50:57.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f44fd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cd870 con 0x7f5f400caae0 2023-07-20T09:50:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f4015c720 0x7f5f400d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52296/0 (socket says 172.21.15.82:52296) 2023-07-20T09:50:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3e59c640 1 -- 172.21.15.82:0/234010719 learned_addr learned my addr 172.21.15.82:0/234010719 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:50:57.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/234010719 >> v2:172.21.15.82:3300/0 conn(0x7f5f400cd3e0 0x7f5f4006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f37fff640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 0x7f5f400ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/234010719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 msgr2=0x7f5f400ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3dd9b640 1 -- 172.21.15.82:0/234010719 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525115622 0 0) 0x7f5f400caf40 con 0x7f5f4015c720 2023-07-20T09:50:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 0x7f5f400ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/234010719 >> v1:172.21.15.82:6789/0 conn(0x7f5f4015c720 legacy=0x7f5f400d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f3ed9d640 1 -- 172.21.15.82:0/234010719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400ce060 con 0x7f5f400cd3e0 2023-07-20T09:50:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.414+0000 7f5f37fff640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 0x7f5f400ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f4006ae90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009d90 tx=0x7f5f3801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9078ac2d85e8b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f3dd9b640 1 -- 172.21.15.82:0/234010719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380a59e0 con 0x7f5f400cd3e0 2023-07-20T09:50:57.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f3dd9b640 1 -- 172.21.15.82:0/234010719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380a5b40 con 0x7f5f400cd3e0 2023-07-20T09:50:57.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f3dd9b640 1 -- 172.21.15.82:0/234010719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f380ad440 con 0x7f5f400cd3e0 2023-07-20T09:50:57.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 -- 172.21.15.82:0/234010719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 msgr2=0x7f5f4006ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f4006ae90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009d90 tx=0x7f5f3801c920 comp rx=0 tx=0).stop 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 -- 172.21.15.82:0/234010719 shutdown_connections 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f4006ae90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/234010719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f400caae0 0x7f5f400ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 -- 172.21.15.82:0/234010719 >> 172.21.15.82:0/234010719 conn(0x7f5f40065310 msgr2=0x7f5f40065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 -- 172.21.15.82:0/234010719 shutdown_connections 2023-07-20T09:50:57.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.418+0000 7f5f44fd5640 1 -- 172.21.15.82:0/234010719 wait complete. 2023-07-20T09:50:57.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 Processor -- start 2023-07-20T09:50:57.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- start start 2023-07-20T09:50:57.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f400caae0 0x7f5f4014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f4015c720 0x7f5f400caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4014fdc0 con 0x7f5f400cd3e0 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400c78d0 con 0x7f5f400caae0 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400c7bb0 con 0x7f5f4015c720 2023-07-20T09:50:57.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38106/0 (socket says 172.21.15.82:38106) 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 -- 172.21.15.82:0/2466625217 learned_addr learned my addr 172.21.15.82:0/2466625217 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f400caae0 0x7f5f4014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f3ed9d640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f4015c720 0x7f5f400caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 -- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f4015c720 msgr2=0x7f5f400caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f4015c720 0x7f5f400caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 -- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f400caae0 msgr2=0x7f5f4014f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f400caae0 0x7f5f4014f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 -- 172.21.15.82:0/2466625217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009a70 con 0x7f5f400cd3e0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f37fff640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c7f0 tx=0x7f5f2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28007820 con 0x7f5f400cd3e0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28007980 con 0x7f5f400cd3e0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400c7e90 con 0x7f5f400cd3e0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28007d30 con 0x7f5f400cd3e0 2023-07-20T09:50:57.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.422+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f400c8450 con 0x7f5f400cd3e0 2023-07-20T09:50:57.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400c8640 con 0x7f5f400cd3e0 2023-07-20T09:50:57.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f280113f0 con 0x7f5f400cd3e0 2023-07-20T09:50:57.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f36ffd640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 0x7f5f20068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f280840b0 con 0x7f5f400cd3e0 2023-07-20T09:50:57.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 0x7f5f20068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.426+0000 7f5f3e59c640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 0x7f5f20068740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f30007fd0 tx=0x7f5f30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.430+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f28051520 con 0x7f5f400cd3e0 2023-07-20T09:50:57.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.578+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f4004da30 con 0x7f5f400cd3e0 2023-07-20T09:50:57.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.578+0000 7f5f36ffd640 1 -- 172.21.15.82:0/2466625217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f28054b40 con 0x7f5f400cd3e0 2023-07-20T09:50:57.616 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 msgr2=0x7f5f20068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 0x7f5f20068740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f30007fd0 tx=0x7f5f30009040 comp rx=0 tx=0).stop 2023-07-20T09:50:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 msgr2=0x7f5f400b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c7f0 tx=0x7f5f2800ccb0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 shutdown_connections 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5f20066280 0x7f5f20068740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f4015c720 0x7f5f400caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f400cd3e0 0x7f5f400b4c40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 --2- 172.21.15.82:0/2466625217 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f400caae0 0x7f5f4014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 >> 172.21.15.82:0/2466625217 conn(0x7f5f40065310 msgr2=0x7f5f400afc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 shutdown_connections 2023-07-20T09:50:57.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.582+0000 7f5f44fd5640 1 -- 172.21.15.82:0/2466625217 wait complete. 2023-07-20T09:50:57.637 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:50:57.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 Processor -- start 2023-07-20T09:50:57.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 -- start start 2023-07-20T09:50:57.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92280ca5a0 0x7f922815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922815ec90 0x7f922815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9228071950 con 0x7f922806f710 2023-07-20T09:50:57.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922815bad0 con 0x7f92280ca5a0 2023-07-20T09:50:57.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922d256640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922815b230 con 0x7f922815ec90 2023-07-20T09:50:57.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92280ca5a0 0x7f922815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92280ca5a0 0x7f922815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38110/0 (socket says 172.21.15.82:38110) 2023-07-20T09:50:57.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.742+0000 7f922659c640 1 -- 172.21.15.82:0/3376864472 learned_addr learned my addr 172.21.15.82:0/3376864472 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:57.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922759e640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922815ec90 0x7f922815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922659c640 1 -- 172.21.15.82:0/3376864472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922815ec90 msgr2=0x7f922815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922659c640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922815ec90 0x7f922815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922659c640 1 -- 172.21.15.82:0/3376864472 >> v1:172.21.15.183:6789/0 conn(0x7f922806f710 legacy=0x7f922806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:57.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922659c640 1 -- 172.21.15.82:0/3376864472 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922815b510 con 0x7f92280ca5a0 2023-07-20T09:50:57.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922659c640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f922815e750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f921c0098a0 tx=0x7f921c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f176918578d424f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f9225d9b640 1 -- 172.21.15.82:0/3376864472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0ad680 con 0x7f92280ca5a0 2023-07-20T09:50:57.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f9225d9b640 1 -- 172.21.15.82:0/3376864472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c0ad7e0 con 0x7f92280ca5a0 2023-07-20T09:50:57.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f9225d9b640 1 -- 172.21.15.82:0/3376864472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0adb70 con 0x7f92280ca5a0 2023-07-20T09:50:57.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922d256640 1 -- 172.21.15.82:0/3376864472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 msgr2=0x7f922815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.746+0000 7f922d256640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f922815e750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f921c0098a0 tx=0x7f921c01c4b0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- 172.21.15.82:0/3376864472 shutdown_connections 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922815ec90 0x7f922815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 --2- 172.21.15.82:0/3376864472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f922815e750 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- 172.21.15.82:0/3376864472 >> 172.21.15.82:0/3376864472 conn(0x7f92280cad50 msgr2=0x7f92280cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- 172.21.15.82:0/3376864472 shutdown_connections 2023-07-20T09:50:57.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- 172.21.15.82:0/3376864472 wait complete. 2023-07-20T09:50:57.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 Processor -- start 2023-07-20T09:50:57.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- start start 2023-07-20T09:50:57.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922806f710 0x7f9228151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f922815ec90 0x7f9228156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228157bd0 con 0x7f92280ca5a0 2023-07-20T09:50:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9228157eb0 con 0x7f922815ec90 2023-07-20T09:50:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922d256640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9228158190 con 0x7f922806f710 2023-07-20T09:50:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38112/0 (socket says 172.21.15.82:38112) 2023-07-20T09:50:57.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 -- 172.21.15.82:0/659829164 learned_addr learned my addr 172.21.15.82:0/659829164 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922759e640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f922815ec90 0x7f9228156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f9226d9d640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922806f710 0x7f9228151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 -- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922806f710 msgr2=0x7f9228151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922806f710 0x7f9228151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 -- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f922815ec90 msgr2=0x7f9228156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.750+0000 7f922659c640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f922815ec90 0x7f9228156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f922659c640 1 -- 172.21.15.82:0/659829164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0094d0 con 0x7f92280ca5a0 2023-07-20T09:50:57.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f922659c640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f921c01ab60 tx=0x7f921c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0ade60 con 0x7f92280ca5a0 2023-07-20T09:50:57.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c0b8420 con 0x7f92280ca5a0 2023-07-20T09:50:57.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9228158470 con 0x7f92280ca5a0 2023-07-20T09:50:57.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0b87b0 con 0x7f92280ca5a0 2023-07-20T09:50:57.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228152830 con 0x7f92280ca5a0 2023-07-20T09:50:57.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922804da30 con 0x7f92280ca5a0 2023-07-20T09:50:57.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f921c0b4040 con 0x7f92280ca5a0 2023-07-20T09:50:57.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 0x7f9214068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:57.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f921c11e0b0 con 0x7f92280ca5a0 2023-07-20T09:50:57.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.754+0000 7f9226d9d640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 0x7f9214068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:57.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.758+0000 7f9226d9d640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 0x7f9214068740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9218005680 tx=0x7f9218003dd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:57.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.758+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f921c0eb650 con 0x7f92280ca5a0 2023-07-20T09:50:57.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9228158920 con 0x7f92280ca5a0 2023-07-20T09:50:57.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f920f7fe640 1 -- 172.21.15.82:0/659829164 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f921c0eec70 con 0x7f92280ca5a0 2023-07-20T09:50:57.947 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:50:57.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 msgr2=0x7f9214068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 0x7f9214068740 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9218005680 tx=0x7f9218003dd0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 msgr2=0x7f92280c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f921c01ab60 tx=0x7f921c01acf0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 shutdown_connections 2023-07-20T09:50:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9214066280 0x7f9214068740 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f922815ec90 0x7f9228156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92280ca5a0 0x7f92280c5aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 --2- 172.21.15.82:0/659829164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f922806f710 0x7f9228151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 >> 172.21.15.82:0/659829164 conn(0x7f92280cad50 msgr2=0x7f92280af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 shutdown_connections 2023-07-20T09:50:57.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:57.910+0000 7f922d256640 1 -- 172.21.15.82:0/659829164 wait complete. 2023-07-20T09:50:57.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:50:58.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 Processor -- start 2023-07-20T09:50:58.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 -- start start 2023-07-20T09:50:58.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29380ad580 0x7f29380b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2938160820 0x7f2938160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2938160390 con 0x7f29380ad580 2023-07-20T09:50:58.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29380b0670 con 0x7f2938160820 2023-07-20T09:50:58.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f293e367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29381611d0 con 0x7f29380afd50 2023-07-20T09:50:58.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f29377fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29380ad580 0x7f29380b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f29377fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29380ad580 0x7f29380b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38118/0 (socket says 172.21.15.82:38118) 2023-07-20T09:50:58.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.078+0000 7f29377fe640 1 -- 172.21.15.82:0/3404112727 learned_addr learned my addr 172.21.15.82:0/3404112727 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293c904640 1 --2- 172.21.15.82:0/3404112727 >> v2:172.21.15.183:3300/0 conn(0x7f2938160820 0x7f2938160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f2937fff640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 -- 172.21.15.82:0/3404112727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 msgr2=0x7f29380ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:58.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 -- 172.21.15.82:0/3404112727 >> v2:172.21.15.183:3300/0 conn(0x7f2938160820 msgr2=0x7f2938160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:58.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 --2- 172.21.15.82:0/3404112727 >> v2:172.21.15.183:3300/0 conn(0x7f2938160820 0x7f2938160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 -- 172.21.15.82:0/3404112727 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29380cc1d0 con 0x7f29380ad580 2023-07-20T09:50:58.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f2937fff640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f29377fe640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29380ad580 0x7f29380b0130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29380cba20 tx=0x7f292c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7981840ce60497a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f2936ffd640 1 -- 172.21.15.82:0/3404112727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0aa5f0 con 0x7f29380ad580 2023-07-20T09:50:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f2936ffd640 1 -- 172.21.15.82:0/3404112727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0aa750 con 0x7f29380ad580 2023-07-20T09:50:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f2936ffd640 1 -- 172.21.15.82:0/3404112727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0aaae0 con 0x7f29380ad580 2023-07-20T09:50:58.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 -- 172.21.15.82:0/3404112727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29380ad580 msgr2=0x7f29380b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29380ad580 0x7f29380b0130 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f29380cba20 tx=0x7f292c01c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 -- 172.21.15.82:0/3404112727 shutdown_connections 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 --2- 172.21.15.82:0/3404112727 >> v2:172.21.15.183:3300/0 conn(0x7f2938160820 0x7f2938160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29380ad580 0x7f29380b0130 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.082+0000 7f293e367640 1 --2- 172.21.15.82:0/3404112727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- 172.21.15.82:0/3404112727 >> 172.21.15.82:0/3404112727 conn(0x7f29380cad50 msgr2=0x7f29380cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- 172.21.15.82:0/3404112727 shutdown_connections 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- 172.21.15.82:0/3404112727 wait complete. 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 Processor -- start 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- start start 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 0x7f293815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293815f170 con 0x7f2938160820 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29380b24e0 con 0x7f29380ad580 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293e367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29380b27c0 con 0x7f29380afd50 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38122/0 (socket says 172.21.15.82:38122) 2023-07-20T09:50:58.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 -- 172.21.15.82:0/1205575080 learned_addr learned my addr 172.21.15.82:0/1205575080 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f29377fe640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 -- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 msgr2=0x7f29380b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f2937fff640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 0x7f293815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 -- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 msgr2=0x7f293815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 0x7f293815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 -- 172.21.15.82:0/1205575080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0094d0 con 0x7f2938160820 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f29377fe640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f2937fff640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 0x7f293815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.086+0000 7f293c904640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2930007e60 tx=0x7f293000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930014420 con 0x7f2938160820 2023-07-20T09:50:58.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29300145a0 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29380b2aa0 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2930014950 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293815b0c0 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293815b2b0 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2930014ab0 con 0x7f2938160820 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 0x7f2924068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29300846f0 con 0x7f2938160820 2023-07-20T09:50:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2937fff640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 0x7f2924068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.090+0000 7f2937fff640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 0x7f2924068740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f292800d940 tx=0x7f2928008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.094+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2930055560 con 0x7f2938160820 2023-07-20T09:50:58.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29380b2f50 con 0x7f2938160820 2023-07-20T09:50:58.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f2934ff9640 1 -- 172.21.15.82:0/1205575080 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29300550f0 con 0x7f2938160820 2023-07-20T09:50:58.278 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 msgr2=0x7f2924068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 0x7f2924068740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f292800d940 tx=0x7f2928008040 comp rx=0 tx=0).stop 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 msgr2=0x7f29380b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2930007e60 tx=0x7f293000e4b0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 shutdown_connections 2023-07-20T09:50:58.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2924066280 0x7f2924068740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2938160820 0x7f29380b1e40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29380afd50 0x7f29380b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 --2- 172.21.15.82:0/1205575080 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29380ad580 0x7f293815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 >> 172.21.15.82:0/1205575080 conn(0x7f29380cad50 msgr2=0x7f29381590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 shutdown_connections 2023-07-20T09:50:58.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.242+0000 7f293e367640 1 -- 172.21.15.82:0/1205575080 wait complete. 2023-07-20T09:50:58.299 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:50:58.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.402+0000 7f70af2e5640 1 Processor -- start 2023-07-20T09:50:58.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 -- start start 2023-07-20T09:50:58.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 0x7f70a815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70a8159830 0x7f70a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80cc8d0 con 0x7f70a80cc3e0 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a80cce90 con 0x7f70a8159830 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70af2e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a80ccbb0 con 0x7f70a8159450 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70a8159830 0x7f70a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70a8159830 0x7f70a80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38130/0 (socket says 172.21.15.82:38130) 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 -- 172.21.15.82:0/2590701939 learned_addr learned my addr 172.21.15.82:0/2590701939 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ad882640 1 --1- 172.21.15.82:0/2590701939 >> v1:172.21.15.82:6789/0 conn(0x7f70a80cc3e0 0x7f70a80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52308/0 (socket says 172.21.15.82:52308) 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ad081640 1 --2- 172.21.15.82:0/2590701939 >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 0x7f70a815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 -- 172.21.15.82:0/2590701939 >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 msgr2=0x7f70a815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 --2- 172.21.15.82:0/2590701939 >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 0x7f70a815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 -- 172.21.15.82:0/2590701939 >> v1:172.21.15.82:6789/0 conn(0x7f70a80cc3e0 legacy=0x7f70a80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ac880640 1 -- 172.21.15.82:0/2590701939 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a8159cc0 con 0x7f70a8159830 2023-07-20T09:50:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.406+0000 7f70ad081640 1 --2- 172.21.15.82:0/2590701939 >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 0x7f70a815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:58.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70ac880640 1 --2- 172.21.15.82:0/2590701939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159830 0x7f70a80cbea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70a806a6c0 tx=0x7f709801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3feb05b3c1d8ab server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f709ffff640 1 -- 172.21.15.82:0/2590701939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980aa610 con 0x7f70a8159830 2023-07-20T09:50:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f709ffff640 1 -- 172.21.15.82:0/2590701939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980a6040 con 0x7f70a8159830 2023-07-20T09:50:58.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f709ffff640 1 -- 172.21.15.82:0/2590701939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980aa990 con 0x7f70a8159830 2023-07-20T09:50:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- 172.21.15.82:0/2590701939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159830 msgr2=0x7f70a80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 --2- 172.21.15.82:0/2590701939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159830 0x7f70a80cbea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70a806a6c0 tx=0x7f709801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- 172.21.15.82:0/2590701939 shutdown_connections 2023-07-20T09:50:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 --2- 172.21.15.82:0/2590701939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159830 0x7f70a80cbea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 --2- 172.21.15.82:0/2590701939 >> v2:172.21.15.183:3300/0 conn(0x7f70a8159450 0x7f70a815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- 172.21.15.82:0/2590701939 >> 172.21.15.82:0/2590701939 conn(0x7f70a80cad50 msgr2=0x7f70a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- 172.21.15.82:0/2590701939 shutdown_connections 2023-07-20T09:50:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- 172.21.15.82:0/2590701939 wait complete. 2023-07-20T09:50:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 Processor -- start 2023-07-20T09:50:58.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.410+0000 7f70af2e5640 1 -- start start 2023-07-20T09:50:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 0x7f70a81547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a80c73b0 0x7f70a80b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80b3950 con 0x7f70a8159450 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8154d00 con 0x7f70a80cc3e0 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80b2dc0 con 0x7f70a80c73b0 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38144/0 (socket says 172.21.15.82:38144) 2023-07-20T09:50:58.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 -- 172.21.15.82:0/134381693 learned_addr learned my addr 172.21.15.82:0/134381693 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ad081640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 0x7f70a81547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ad882640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a80c73b0 0x7f70a80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 -- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a80c73b0 msgr2=0x7f70a80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a80c73b0 0x7f70a80b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 -- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 msgr2=0x7f70a81547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 0x7f70a81547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 -- 172.21.15.82:0/134381693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980094d0 con 0x7f70a8159450 2023-07-20T09:50:58.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ad081640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 0x7f70a81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70ac880640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70980190e0 tx=0x7f709801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980bd5f0 con 0x7f70a8159450 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980bd750 con 0x7f70a8159450 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a80b3060 con 0x7f70a8159450 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980bdb00 con 0x7f70a8159450 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a80b3300 con 0x7f70a8159450 2023-07-20T09:50:58.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a80b3b00 con 0x7f70a8159450 2023-07-20T09:50:58.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.414+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70980b33f0 con 0x7f70a8159450 2023-07-20T09:50:58.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.418+0000 7f709dffb640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 0x7f708c068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.418+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f709811ec50 con 0x7f70a8159450 2023-07-20T09:50:58.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.418+0000 7f70ad081640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 0x7f708c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.418+0000 7f70ad081640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 0x7f708c068770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009970 tx=0x7f70a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.422+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70a80b3b00 con 0x7f70a8159450 2023-07-20T09:50:58.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.566+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70a80b3b00 con 0x7f70a8159450 2023-07-20T09:50:58.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.566+0000 7f709dffb640 1 -- 172.21.15.82:0/134381693 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70a80b3b00 con 0x7f70a8159450 2023-07-20T09:50:58.604 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:50:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 msgr2=0x7f708c068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 0x7f708c068770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009970 tx=0x7f70a4008040 comp rx=0 tx=0).stop 2023-07-20T09:50:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 msgr2=0x7f70a80b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70980190e0 tx=0x7f709801ad10 comp rx=0 tx=0).stop 2023-07-20T09:50:58.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 shutdown_connections 2023-07-20T09:50:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f708c0662b0 0x7f708c068770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70a80c73b0 0x7f70a80b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a8159450 0x7f70a80b0dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 --2- 172.21.15.82:0/134381693 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70a80cc3e0 0x7f70a81547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 >> 172.21.15.82:0/134381693 conn(0x7f70a80cad50 msgr2=0x7f70a8158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 shutdown_connections 2023-07-20T09:50:58.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.570+0000 7f70af2e5640 1 -- 172.21.15.82:0/134381693 wait complete. 2023-07-20T09:50:58.625 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T09:50:58.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 Processor -- start 2023-07-20T09:50:58.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 -- start start 2023-07-20T09:50:58.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb9006c120 0x7ffb900cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffb901602b0 0x7ffb90160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb900d0970 con 0x7ffb9006ab10 2023-07-20T09:50:58.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb90160e20 con 0x7ffb9006c120 2023-07-20T09:50:58.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb97488640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb900cd300 con 0x7ffb901602b0 2023-07-20T09:50:58.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb9006c120 0x7ffb900cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ffb9006c120 0x7ffb900cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38156/0 (socket says 172.21.15.82:38156) 2023-07-20T09:50:58.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 -- 172.21.15.82:0/4274233780 learned_addr learned my addr 172.21.15.82:0/4274233780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb94a23640 1 --2- 172.21.15.82:0/4274233780 >> v2:172.21.15.183:3300/0 conn(0x7ffb901602b0 0x7ffb90160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 -- 172.21.15.82:0/4274233780 >> v2:172.21.15.183:3300/0 conn(0x7ffb901602b0 msgr2=0x7ffb90160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:58.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 --2- 172.21.15.82:0/4274233780 >> v2:172.21.15.183:3300/0 conn(0x7ffb901602b0 0x7ffb90160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 -- 172.21.15.82:0/4274233780 >> v1:172.21.15.82:6789/0 conn(0x7ffb9006ab10 legacy=0x7ffb9006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb95224640 1 -- 172.21.15.82:0/4274233780 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb900cd5e0 con 0x7ffb9006c120 2023-07-20T09:50:58.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.730+0000 7ffb87fff640 1 -- 172.21.15.82:0/4274233780 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558326215 0 0) 0x7ffb900d0970 con 0x7ffb9006ab10 2023-07-20T09:50:58.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb95224640 1 --2- 172.21.15.82:0/4274233780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006c120 0x7ffb900cdde0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffb9008ca40 tx=0x7ffb8c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bed607e8b36e5c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb87fff640 1 -- 172.21.15.82:0/4274233780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0a5760 con 0x7ffb9006c120 2023-07-20T09:50:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb87fff640 1 -- 172.21.15.82:0/4274233780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0a58c0 con 0x7ffb9006c120 2023-07-20T09:50:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb87fff640 1 -- 172.21.15.82:0/4274233780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0a5c50 con 0x7ffb9006c120 2023-07-20T09:50:58.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 -- 172.21.15.82:0/4274233780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006c120 msgr2=0x7ffb900cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 --2- 172.21.15.82:0/4274233780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006c120 0x7ffb900cdde0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffb9008ca40 tx=0x7ffb8c01c880 comp rx=0 tx=0).stop 2023-07-20T09:50:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 -- 172.21.15.82:0/4274233780 shutdown_connections 2023-07-20T09:50:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 --2- 172.21.15.82:0/4274233780 >> v2:172.21.15.183:3300/0 conn(0x7ffb901602b0 0x7ffb90160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 --2- 172.21.15.82:0/4274233780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006c120 0x7ffb900cdde0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 -- 172.21.15.82:0/4274233780 >> 172.21.15.82:0/4274233780 conn(0x7ffb9008c0a0 msgr2=0x7ffb9009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 -- 172.21.15.82:0/4274233780 shutdown_connections 2023-07-20T09:50:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.734+0000 7ffb97488640 1 -- 172.21.15.82:0/4274233780 wait complete. 2023-07-20T09:50:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 Processor -- start 2023-07-20T09:50:58.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- start start 2023-07-20T09:50:58.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 0x7ffb90156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb901602b0 0x7ffb900cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900b7e80 con 0x7ffb9006ab10 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900b6fb0 con 0x7ffb9006c120 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb900b7200 con 0x7ffb901602b0 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38160/0 (socket says 172.21.15.82:38160) 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 -- 172.21.15.82:0/921167816 learned_addr learned my addr 172.21.15.82:0/921167816 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95a25640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb901602b0 0x7ffb900cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 -- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb901602b0 msgr2=0x7ffb900cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb901602b0 0x7ffb900cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 -- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 msgr2=0x7ffb90156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb94a23640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 0x7ffb90156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 0x7ffb90156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 -- 172.21.15.82:0/921167816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c009b30 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb94a23640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 0x7ffb90156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb95224640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0af040 tx=0x7ffb8c019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b8670 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0b87d0 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb900b74e0 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c0b8b80 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.738+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb900b7aa0 con 0x7ffb9006ab10 2023-07-20T09:50:58.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb900c5fb0 con 0x7ffb9006ab10 2023-07-20T09:50:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb8c0b8ce0 con 0x7ffb9006ab10 2023-07-20T09:50:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb85ffb640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 0x7ffb74068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb8c11f2c0 con 0x7ffb9006ab10 2023-07-20T09:50:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb94a23640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 0x7ffb74068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:58.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.742+0000 7ffb94a23640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 0x7ffb74068740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb900c8620 tx=0x7ffb80008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:58.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.746+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb8c0ec7e0 con 0x7ffb9006ab10 2023-07-20T09:50:58.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.898+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ffb9004da30 con 0x7ffb9006ab10 2023-07-20T09:50:58.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.902+0000 7ffb85ffb640 1 -- 172.21.15.82:0/921167816 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb8c0efe00 con 0x7ffb9006ab10 2023-07-20T09:50:58.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 msgr2=0x7ffb74068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 0x7ffb74068740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb900c8620 tx=0x7ffb80008040 comp rx=0 tx=0).stop 2023-07-20T09:50:58.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 msgr2=0x7ffb900cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c0af040 tx=0x7ffb8c019620 comp rx=0 tx=0).stop 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 shutdown_connections 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ffb74066280 0x7ffb74068740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffb901602b0 0x7ffb900cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb9006c120 0x7ffb90156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 --2- 172.21.15.82:0/921167816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb9006ab10 0x7ffb900cc0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 >> 172.21.15.82:0/921167816 conn(0x7ffb9008c0a0 msgr2=0x7ffb900b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 shutdown_connections 2023-07-20T09:50:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:58.906+0000 7ffb97488640 1 -- 172.21.15.82:0/921167816 wait complete. 2023-07-20T09:50:58.961 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T09:50:58.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T09:50:59.040 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T09:50:59.103 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T09:50:59.104 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:59.104 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:59.114 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:59.114 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:59.168 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:50:59.169 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:50:59.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:50:59.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 Processor -- start 2023-07-20T09:50:59.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 -- start start 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f239c0c1a00 0x7f239c0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0cc560 con 0x7f239c160fa0 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c0ad7e0 con 0x7f239c0c1a00 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a3dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0cc790 con 0x7f239c160bc0 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a2397640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f239c0c1a00 0x7f239c0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a2397640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f239c0c1a00 0x7f239c0aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38170/0 (socket says 172.21.15.82:38170) 2023-07-20T09:50:59.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.362+0000 7f23a2397640 1 -- 172.21.15.82:0/3923201731 learned_addr learned my addr 172.21.15.82:0/3923201731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:59.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a1b96640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a2397640 1 -- 172.21.15.82:0/3923201731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 msgr2=0x7f239c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a2397640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a2397640 1 -- 172.21.15.82:0/3923201731 >> v1:172.21.15.82:6789/0 conn(0x7f239c160fa0 legacy=0x7f239c0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a0b94640 1 -- 172.21.15.82:0/3923201731 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028195177 0 0) 0x7f239c0cc560 con 0x7f239c160fa0 2023-07-20T09:50:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a2397640 1 -- 172.21.15.82:0/3923201731 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0cca70 con 0x7f239c0c1a00 2023-07-20T09:50:59.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a1b96640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:50:59.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a2397640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c0aae90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f239401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821710e7e853aa66 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a0b94640 1 -- 172.21.15.82:0/3923201731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a58a0 con 0x7f239c0c1a00 2023-07-20T09:50:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a0b94640 1 -- 172.21.15.82:0/3923201731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940a5a00 con 0x7f239c0c1a00 2023-07-20T09:50:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.366+0000 7f23a0b94640 1 -- 172.21.15.82:0/3923201731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940a5d90 con 0x7f239c0c1a00 2023-07-20T09:50:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3923201731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 msgr2=0x7f239c0aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c0aae90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2394009e50 tx=0x7f239401c9e0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3923201731 shutdown_connections 2023-07-20T09:50:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c0aae90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3923201731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3923201731 >> 172.21.15.82:0/3923201731 conn(0x7f239c0cada0 msgr2=0x7f239c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:59.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3923201731 shutdown_connections 2023-07-20T09:50:59.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3923201731 wait complete. 2023-07-20T09:50:59.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 Processor -- start 2023-07-20T09:50:59.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- start start 2023-07-20T09:50:59.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f239c160fa0 0x7f239c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c1642c0 con 0x7f239c0c1a00 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c156ae0 con 0x7f239c160fa0 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a3dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c155c00 con 0x7f239c160bc0 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38184/0 (socket says 172.21.15.82:38184) 2023-07-20T09:50:59.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 -- 172.21.15.82:0/3648853508 learned_addr learned my addr 172.21.15.82:0/3648853508 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:59.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 -- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 msgr2=0x7f239c163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 -- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f239c160fa0 msgr2=0x7f239c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f239c160fa0 0x7f239c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.370+0000 7f23a1b96640 1 -- 172.21.15.82:0/3648853508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394009b30 con 0x7f239c0c1a00 2023-07-20T09:50:59.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23a1b96640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f239800c7c0 tx=0x7f239800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398007a30 con 0x7f239c0c1a00 2023-07-20T09:50:59.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398007b90 con 0x7f239c0c1a00 2023-07-20T09:50:59.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800ce70 con 0x7f239c0c1a00 2023-07-20T09:50:59.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c1565d0 con 0x7f239c0c1a00 2023-07-20T09:50:59.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c1555b0 con 0x7f239c0c1a00 2023-07-20T09:50:59.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c073c70 con 0x7f239c0c1a00 2023-07-20T09:50:59.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23980113f0 con 0x7f239c0c1a00 2023-07-20T09:50:59.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 0x7f2380068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2398084290 con 0x7f239c0c1a00 2023-07-20T09:50:59.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.374+0000 7f23a1395640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 0x7f2380068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.378+0000 7f23a1395640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 0x7f2380068740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f238c007fd0 tx=0x7f238c007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.378+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2398051670 con 0x7f239c0c1a00 2023-07-20T09:50:59.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.526+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f239c0cd2e0 con 0x7f239c0c1a00 2023-07-20T09:50:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23927fc640 1 -- 172.21.15.82:0/3648853508 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f2398054c90 con 0x7f239c0c1a00 2023-07-20T09:50:59.566 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:50:59.566 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:50:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 msgr2=0x7f2380068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 0x7f2380068740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f238c007fd0 tx=0x7f238c007940 comp rx=0 tx=0).stop 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 msgr2=0x7f239c1621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f239800c7c0 tx=0x7f239800cc80 comp rx=0 tx=0).stop 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 shutdown_connections 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2380066280 0x7f2380068740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f239c160fa0 0x7f239c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f239c160bc0 0x7f239c163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 --2- 172.21.15.82:0/3648853508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f239c0c1a00 0x7f239c1621c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 >> 172.21.15.82:0/3648853508 conn(0x7f239c0cada0 msgr2=0x7f239c0b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 shutdown_connections 2023-07-20T09:50:59.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.530+0000 7f23a3dfa640 1 -- 172.21.15.82:0/3648853508 wait complete. 2023-07-20T09:50:59.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:50:59.587 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:50:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 Processor -- start 2023-07-20T09:50:59.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 -- start start 2023-07-20T09:50:59.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26d41602b0 0x7f26d4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f26d406ab10 0x7f26d406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d40ce4f0 con 0x7f26d406c120 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40d0970 con 0x7f26d41602b0 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d9c34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d4160e20 con 0x7f26d406ab10 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26d41602b0 0x7f26d4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26d41602b0 0x7f26d4160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38198/0 (socket says 172.21.15.82:38198) 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f26d406c120 0x7f26d40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52326/0 (socket says 172.21.15.82:52326) 2023-07-20T09:50:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 -- 172.21.15.82:0/3573544647 learned_addr learned my addr 172.21.15.82:0/3573544647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d3fff640 1 --2- 172.21.15.82:0/3573544647 >> v2:172.21.15.183:3300/0 conn(0x7f26d406ab10 0x7f26d406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 -- 172.21.15.82:0/3573544647 >> v2:172.21.15.183:3300/0 conn(0x7f26d406ab10 msgr2=0x7f26d406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:50:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 --2- 172.21.15.82:0/3573544647 >> v2:172.21.15.183:3300/0 conn(0x7f26d406ab10 0x7f26d406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 -- 172.21.15.82:0/3573544647 >> v1:172.21.15.82:6789/0 conn(0x7f26d406c120 legacy=0x7f26d40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26cbfff640 1 -- 172.21.15.82:0/3573544647 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40cd300 con 0x7f26d41602b0 2023-07-20T09:50:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.694+0000 7f26d2ffd640 1 -- 172.21.15.82:0/3573544647 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993957193 0 0) 0x7f26d40ce4f0 con 0x7f26d406c120 2023-07-20T09:50:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26cbfff640 1 --2- 172.21.15.82:0/3573544647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d4160740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f26d408ceb0 tx=0x7f26bc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa1774032b598d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d2ffd640 1 -- 172.21.15.82:0/3573544647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0ab640 con 0x7f26d41602b0 2023-07-20T09:50:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d2ffd640 1 -- 172.21.15.82:0/3573544647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc0a7070 con 0x7f26d41602b0 2023-07-20T09:50:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d2ffd640 1 -- 172.21.15.82:0/3573544647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0ab9c0 con 0x7f26d41602b0 2023-07-20T09:50:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 -- 172.21.15.82:0/3573544647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 msgr2=0x7f26d4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3573544647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d4160740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f26d408ceb0 tx=0x7f26bc01c440 comp rx=0 tx=0).stop 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 -- 172.21.15.82:0/3573544647 shutdown_connections 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3573544647 >> v2:172.21.15.183:3300/0 conn(0x7f26d406ab10 0x7f26d406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3573544647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d4160740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 -- 172.21.15.82:0/3573544647 >> 172.21.15.82:0/3573544647 conn(0x7f26d408c0a0 msgr2=0x7f26d409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 -- 172.21.15.82:0/3573544647 shutdown_connections 2023-07-20T09:50:59.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.698+0000 7f26d9c34640 1 -- 172.21.15.82:0/3573544647 wait complete. 2023-07-20T09:50:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 Processor -- start 2023-07-20T09:50:59.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- start start 2023-07-20T09:50:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d406ab10 0x7f26d4154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26d406c120 0x7f26d40cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d4154680 con 0x7f26d41602b0 2023-07-20T09:50:59.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40ca730 con 0x7f26d406ab10 2023-07-20T09:50:59.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40ca450 con 0x7f26d406c120 2023-07-20T09:50:59.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38212/0 (socket says 172.21.15.82:38212) 2023-07-20T09:50:59.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 -- 172.21.15.82:0/3482928119 learned_addr learned my addr 172.21.15.82:0/3482928119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:50:59.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d37fe640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d406ab10 0x7f26d4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26cbfff640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26d406c120 0x7f26d40cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 -- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26d406c120 msgr2=0x7f26d40cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26d406c120 0x7f26d40cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 -- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d406ab10 msgr2=0x7f26d4154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d406ab10 0x7f26d4154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 -- 172.21.15.82:0/3482928119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0094d0 con 0x7f26d41602b0 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d3fff640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26cc007e40 tx=0x7f26cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc014620 con 0x7f26d41602b0 2023-07-20T09:50:59.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc00ee90 con 0x7f26d41602b0 2023-07-20T09:50:59.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0149e0 con 0x7f26d41602b0 2023-07-20T09:50:59.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d40cac70 con 0x7f26d41602b0 2023-07-20T09:50:59.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.702+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d40cb230 con 0x7f26d41602b0 2023-07-20T09:50:59.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d40cb420 con 0x7f26d41602b0 2023-07-20T09:50:59.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26cc014b40 con 0x7f26d41602b0 2023-07-20T09:50:59.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d0ff9640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 0x7f26b4068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:50:59.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26cc0844d0 con 0x7f26d41602b0 2023-07-20T09:50:59.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d37fe640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 0x7f26b4068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:50:59.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.706+0000 7f26d37fe640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 0x7f26b4068770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f26c4007fd0 tx=0x7f26c4007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:50:59.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.710+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26cc051a30 con 0x7f26d41602b0 2023-07-20T09:50:59.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.858+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26d404da30 con 0x7f26d41602b0 2023-07-20T09:50:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d0ff9640 1 -- 172.21.15.82:0/3482928119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26cc055050 con 0x7f26d41602b0 2023-07-20T09:50:59.898 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:50:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 msgr2=0x7f26b4068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 0x7f26b4068770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f26c4007fd0 tx=0x7f26c4007d60 comp rx=0 tx=0).stop 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 msgr2=0x7f26d40d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f26cc007e40 tx=0x7f26cc00e4b0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 shutdown_connections 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f26b40662b0 0x7f26b4068770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26d41602b0 0x7f26d40d0ab0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26d406c120 0x7f26d40cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 --2- 172.21.15.82:0/3482928119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d406ab10 0x7f26d4154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:50:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 >> 172.21.15.82:0/3482928119 conn(0x7f26d408c0a0 msgr2=0x7f26d409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:50:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 shutdown_connections 2023-07-20T09:50:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:50:59.862+0000 7f26d9c34640 1 -- 172.21.15.82:0/3482928119 wait complete. 2023-07-20T09:50:59.918 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.022+0000 7fc690d2c640 1 Processor -- start 2023-07-20T09:51:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.022+0000 7fc690d2c640 1 -- start start 2023-07-20T09:51:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc690d2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc68c0afd50 0x7fc68c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc690d2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0b06b0 con 0x7fc68c159450 2023-07-20T09:51:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc690d2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0cc8d0 con 0x7fc68c159830 2023-07-20T09:51:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc690d2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c0cce90 con 0x7fc68c0afd50 2023-07-20T09:51:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc68c159450 0x7fc68c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52340/0 (socket says 172.21.15.82:52340) 2023-07-20T09:51:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68a59c640 1 -- 172.21.15.82:0/4239173271 learned_addr learned my addr 172.21.15.82:0/4239173271 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68ad9d640 1 --2- 172.21.15.82:0/4239173271 >> v2:172.21.15.82:3300/0 conn(0x7fc68c0afd50 0x7fc68c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc689d9b640 1 -- 172.21.15.82:0/4239173271 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087023207 0 0) 0x7fc68c0b06b0 con 0x7fc68c159450 2023-07-20T09:51:00.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc689d9b640 1 -- 172.21.15.82:0/4239173271 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc678005740 con 0x7fc68c159450 2023-07-20T09:51:00.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68ad9d640 1 -- 172.21.15.82:0/4239173271 >> v1:172.21.15.183:6789/0 conn(0x7fc68c159830 legacy=0x7fc68c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68ad9d640 1 -- 172.21.15.82:0/4239173271 >> v1:172.21.15.82:6789/0 conn(0x7fc68c159450 legacy=0x7fc68c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.026+0000 7fc68ad9d640 1 -- 172.21.15.82:0/4239173271 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0ccbb0 con 0x7fc68c0afd50 2023-07-20T09:51:00.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc68ad9d640 1 --2- 172.21.15.82:0/4239173271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0afd50 0x7fc68c0b0170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6840097c0 tx=0x7fc68401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85164542dde360c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc689d9b640 1 -- 172.21.15.82:0/4239173271 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840ab650 con 0x7fc68c0afd50 2023-07-20T09:51:00.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc689d9b640 1 -- 172.21.15.82:0/4239173271 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6840ab7b0 con 0x7fc68c0afd50 2023-07-20T09:51:00.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc689d9b640 1 -- 172.21.15.82:0/4239173271 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840abb40 con 0x7fc68c0afd50 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- 172.21.15.82:0/4239173271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0afd50 msgr2=0x7fc68c0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 --2- 172.21.15.82:0/4239173271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0afd50 0x7fc68c0b0170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6840097c0 tx=0x7fc68401c450 comp rx=0 tx=0).stop 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- 172.21.15.82:0/4239173271 shutdown_connections 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 --2- 172.21.15.82:0/4239173271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0afd50 0x7fc68c0b0170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- 172.21.15.82:0/4239173271 >> 172.21.15.82:0/4239173271 conn(0x7fc68c0cad50 msgr2=0x7fc68c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- 172.21.15.82:0/4239173271 shutdown_connections 2023-07-20T09:51:00.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- 172.21.15.82:0/4239173271 wait complete. 2023-07-20T09:51:00.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 Processor -- start 2023-07-20T09:51:00.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.030+0000 7fc690d2c640 1 -- start start 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c0afd50 0x7fc68c141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c159450 0x7fc68c1f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1f93e0 con 0x7fc68c0c2510 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c141fd0 con 0x7fc68c0afd50 2023-07-20T09:51:00.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c152f00 con 0x7fc68c159450 2023-07-20T09:51:00.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38232/0 (socket says 172.21.15.82:38232) 2023-07-20T09:51:00.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 -- 172.21.15.82:0/396946789 learned_addr learned my addr 172.21.15.82:0/396946789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:00.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68a59c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c0afd50 0x7fc68c141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc681d9b640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c159450 0x7fc68c1f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 -- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c159450 msgr2=0x7fc68c1f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c159450 0x7fc68c1f8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 -- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c0afd50 msgr2=0x7fc68c141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c0afd50 0x7fc68c141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 -- 172.21.15.82:0/396946789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684009420 con 0x7fc68c0c2510 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc68ad9d640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6840ad040 tx=0x7fc68401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684004230 con 0x7fc68c0c2510 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6840b9070 con 0x7fc68c0c2510 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0b26e0 con 0x7fc68c0c2510 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684003620 con 0x7fc68c0c2510 2023-07-20T09:51:00.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c141a10 con 0x7fc68c0c2510 2023-07-20T09:51:00.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.034+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c04da30 con 0x7fc68c0c2510 2023-07-20T09:51:00.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.038+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc684003780 con 0x7fc68c0c2510 2023-07-20T09:51:00.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.038+0000 7fc6837fe640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 0x7fc66c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.038+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6840bb070 con 0x7fc68c0c2510 2023-07-20T09:51:00.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.038+0000 7fc68a59c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 0x7fc66c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.038+0000 7fc68a59c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 0x7fc66c068740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc67c001570 tx=0x7fc67c001aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.042+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6840eb890 con 0x7fc68c0c2510 2023-07-20T09:51:00.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.186+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc68c0c8690 con 0x7fc68c0c2510 2023-07-20T09:51:00.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.186+0000 7fc6837fe640 1 -- 172.21.15.82:0/396946789 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6840eeeb0 con 0x7fc68c0c2510 2023-07-20T09:51:00.225 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 msgr2=0x7fc66c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 0x7fc66c068740 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc67c001570 tx=0x7fc67c001aa0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 msgr2=0x7fc68c1529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc6840ad040 tx=0x7fc68401ac90 comp rx=0 tx=0).stop 2023-07-20T09:51:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 shutdown_connections 2023-07-20T09:51:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc66c066280 0x7fc66c068740 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c0c2510 0x7fc68c1529c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c159450 0x7fc68c1f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 --2- 172.21.15.82:0/396946789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c0afd50 0x7fc68c141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 >> 172.21.15.82:0/396946789 conn(0x7fc68c0cad50 msgr2=0x7fc68c072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 shutdown_connections 2023-07-20T09:51:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.190+0000 7fc690d2c640 1 -- 172.21.15.82:0/396946789 wait complete. 2023-07-20T09:51:00.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:51:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 Processor -- start 2023-07-20T09:51:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 -- start start 2023-07-20T09:51:00.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 0x7f1bec160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec069750 0x7f1bec069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bec06ddc0 0x7f1bec06e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec1601b0 con 0x7f1bec06ddc0 2023-07-20T09:51:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec161100 con 0x7f1bec0ccf10 2023-07-20T09:51:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.350+0000 7f1bf4303640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec06e770 con 0x7f1bec069750 2023-07-20T09:51:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bec06ddc0 0x7f1bec06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bec06ddc0 0x7f1bec06e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38248/0 (socket says 172.21.15.82:38248) 2023-07-20T09:51:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 -- 172.21.15.82:0/1806374923 learned_addr learned my addr 172.21.15.82:0/1806374923 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf209f640 1 --2- 172.21.15.82:0/1806374923 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 0x7f1bec160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf189e640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec069750 0x7f1bec069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 -- 172.21.15.82:0/1806374923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec069750 msgr2=0x7f1bec069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec069750 0x7f1bec069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 -- 172.21.15.82:0/1806374923 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 msgr2=0x7f1bec160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:00.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 --2- 172.21.15.82:0/1806374923 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 0x7f1bec160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 -- 172.21.15.82:0/1806374923 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec06a1d0 con 0x7f1bec06ddc0 2023-07-20T09:51:00.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf209f640 1 --2- 172.21.15.82:0/1806374923 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 0x7f1bec160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:00.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf28a0640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec06ddc0 0x7f1bec06e230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06b1c0 tx=0x7f1be401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68bacdb9decce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf109d640 1 -- 172.21.15.82:0/1806374923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40a5820 con 0x7f1bec06ddc0 2023-07-20T09:51:00.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf109d640 1 -- 172.21.15.82:0/1806374923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be40a5980 con 0x7f1bec06ddc0 2023-07-20T09:51:00.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.354+0000 7f1bf109d640 1 -- 172.21.15.82:0/1806374923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be40a5d10 con 0x7f1bec06ddc0 2023-07-20T09:51:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- 172.21.15.82:0/1806374923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec06ddc0 msgr2=0x7f1bec06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec06ddc0 0x7f1bec06e230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06b1c0 tx=0x7f1be401c9a0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- 172.21.15.82:0/1806374923 shutdown_connections 2023-07-20T09:51:00.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec06ddc0 0x7f1bec06e230 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1806374923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec069750 0x7f1bec069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1806374923 >> v2:172.21.15.183:3300/0 conn(0x7f1bec0ccf10 0x7f1bec160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- 172.21.15.82:0/1806374923 >> 172.21.15.82:0/1806374923 conn(0x7f1bec0cf070 msgr2=0x7f1bec0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- 172.21.15.82:0/1806374923 shutdown_connections 2023-07-20T09:51:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- 172.21.15.82:0/1806374923 wait complete. 2023-07-20T09:51:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 Processor -- start 2023-07-20T09:51:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- start start 2023-07-20T09:51:00.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec06ddc0 0x7f1bec15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0ccf10 0x7f1bec0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b2400 con 0x7f1bec069750 2023-07-20T09:51:00.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b17f0 con 0x7f1bec06ddc0 2023-07-20T09:51:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf4303640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b1ad0 con 0x7f1bec0ccf10 2023-07-20T09:51:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38250/0 (socket says 172.21.15.82:38250) 2023-07-20T09:51:00.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 -- 172.21.15.82:0/1281812129 learned_addr learned my addr 172.21.15.82:0/1281812129 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf189e640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec06ddc0 0x7f1bec15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf28a0640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0ccf10 0x7f1bec0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 -- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0ccf10 msgr2=0x7f1bec0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0ccf10 0x7f1bec0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 -- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec06ddc0 msgr2=0x7f1bec15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec06ddc0 0x7f1bec15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.358+0000 7f1bf209f640 1 -- 172.21.15.82:0/1281812129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be4009b30 con 0x7f1bec069750 2023-07-20T09:51:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1bf209f640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1be800d800 tx=0x7f1be800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800b6c0 con 0x7f1bec069750 2023-07-20T09:51:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be800b820 con 0x7f1bec069750 2023-07-20T09:51:00.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800bbd0 con 0x7f1bec069750 2023-07-20T09:51:00.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec0b1db0 con 0x7f1bec069750 2023-07-20T09:51:00.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec15a9e0 con 0x7f1bec069750 2023-07-20T09:51:00.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bec0659a0 con 0x7f1bec069750 2023-07-20T09:51:00.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1be800bd30 con 0x7f1bec069750 2023-07-20T09:51:00.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 0x7f1bd0068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1be8084090 con 0x7f1bec069750 2023-07-20T09:51:00.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.362+0000 7f1bf189e640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 0x7f1bd0068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.366+0000 7f1bf189e640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 0x7f1bd0068770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0afb50 tx=0x7f1bdc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.366+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1be80515c0 con 0x7f1bec069750 2023-07-20T09:51:00.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bec04da30 con 0x7f1bec069750 2023-07-20T09:51:00.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1be2ffd640 1 -- 172.21.15.82:0/1281812129 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1be8054be0 con 0x7f1bec069750 2023-07-20T09:51:00.562 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:51:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 msgr2=0x7f1bd0068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 0x7f1bd0068770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bec0afb50 tx=0x7f1bdc008040 comp rx=0 tx=0).stop 2023-07-20T09:51:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 msgr2=0x7f1bec15c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1be800d800 tx=0x7f1be800dcc0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 shutdown_connections 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1bd00662b0 0x7f1bd0068770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bec0ccf10 0x7f1bec0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bec06ddc0 0x7f1bec15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 --2- 172.21.15.82:0/1281812129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bec069750 0x7f1bec15c1b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 >> 172.21.15.82:0/1281812129 conn(0x7f1bec0cf070 msgr2=0x7f1bec0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 shutdown_connections 2023-07-20T09:51:00.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.526+0000 7f1bf4303640 1 -- 172.21.15.82:0/1281812129 wait complete. 2023-07-20T09:51:00.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:51:00.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.686+0000 7ff2345df640 1 Processor -- start 2023-07-20T09:51:00.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 -- start start 2023-07-20T09:51:00.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff22c159450 0x7ff22c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff22c0afd50 0x7ff22c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22c0b06b0 con 0x7ff22c159830 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0cce90 con 0x7ff22c159450 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff2345df640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22c0cc8d0 con 0x7ff22c0afd50 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff22c159450 0x7ff22c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff22c159450 0x7ff22c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38266/0 (socket says 172.21.15.82:38266) 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 -- 172.21.15.82:0/3724967092 learned_addr learned my addr 172.21.15.82:0/3724967092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:00.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff232b7c640 1 --2- 172.21.15.82:0/3724967092 >> v2:172.21.15.183:3300/0 conn(0x7ff22c0afd50 0x7ff22c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 -- 172.21.15.82:0/3724967092 >> v2:172.21.15.183:3300/0 conn(0x7ff22c0afd50 msgr2=0x7ff22c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:00.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 --2- 172.21.15.82:0/3724967092 >> v2:172.21.15.183:3300/0 conn(0x7ff22c0afd50 0x7ff22c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 -- 172.21.15.82:0/3724967092 >> v1:172.21.15.183:6789/0 conn(0x7ff22c159830 legacy=0x7ff22c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.690+0000 7ff23237b640 1 -- 172.21.15.82:0/3724967092 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0ccbb0 con 0x7ff22c159450 2023-07-20T09:51:00.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff23237b640 1 --2- 172.21.15.82:0/3724967092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c159450 0x7ff22c15a4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0c1da0 tx=0x7ff22801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5103c57559238e2a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff231379640 1 -- 172.21.15.82:0/3724967092 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a7c70 con 0x7ff22c159450 2023-07-20T09:51:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff231379640 1 -- 172.21.15.82:0/3724967092 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280a7dd0 con 0x7ff22c159450 2023-07-20T09:51:00.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff231379640 1 -- 172.21.15.82:0/3724967092 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280af660 con 0x7ff22c159450 2023-07-20T09:51:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- 172.21.15.82:0/3724967092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c159450 msgr2=0x7ff22c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 --2- 172.21.15.82:0/3724967092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c159450 0x7ff22c15a4c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0c1da0 tx=0x7ff22801eba0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- 172.21.15.82:0/3724967092 shutdown_connections 2023-07-20T09:51:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 --2- 172.21.15.82:0/3724967092 >> v2:172.21.15.183:3300/0 conn(0x7ff22c0afd50 0x7ff22c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 --2- 172.21.15.82:0/3724967092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c159450 0x7ff22c15a4c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- 172.21.15.82:0/3724967092 >> 172.21.15.82:0/3724967092 conn(0x7ff22c0cad50 msgr2=0x7ff22c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- 172.21.15.82:0/3724967092 shutdown_connections 2023-07-20T09:51:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- 172.21.15.82:0/3724967092 wait complete. 2023-07-20T09:51:00.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 Processor -- start 2023-07-20T09:51:00.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.694+0000 7ff2345df640 1 -- start start 2023-07-20T09:51:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c0afd50 0x7ff22c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff22c159450 0x7ff22c14fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c155170 con 0x7ff22c153b00 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0c6880 con 0x7ff22c0afd50 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c0c5f50 con 0x7ff22c159450 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38268/0 (socket says 172.21.15.82:38268) 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 -- 172.21.15.82:0/917659969 learned_addr learned my addr 172.21.15.82:0/917659969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff23237b640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c0afd50 0x7ff22c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff231b7a640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff22c159450 0x7ff22c14fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 -- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff22c159450 msgr2=0x7ff22c14fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff22c159450 0x7ff22c14fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 -- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c0afd50 msgr2=0x7ff22c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c0afd50 0x7ff22c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 -- 172.21.15.82:0/917659969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22800b770 con 0x7ff22c153b00 2023-07-20T09:51:00.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff232b7c640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff22400efc0 tx=0x7ff22400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224014480 con 0x7ff22c153b00 2023-07-20T09:51:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400f040 con 0x7ff22c153b00 2023-07-20T09:51:00.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c0c6230 con 0x7ff22c153b00 2023-07-20T09:51:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224014820 con 0x7ff22c153b00 2023-07-20T09:51:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c154e60 con 0x7ff22c153b00 2023-07-20T09:51:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c0c6a30 con 0x7ff22c153b00 2023-07-20T09:51:00.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.698+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff224014980 con 0x7ff22c153b00 2023-07-20T09:51:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.702+0000 7ff222ffd640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 0x7ff210068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.702+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff224084b30 con 0x7ff22c153b00 2023-07-20T09:51:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.702+0000 7ff23237b640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 0x7ff210068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:00.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.702+0000 7ff23237b640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 0x7ff210068770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2280b1000 tx=0x7ff2280a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:00.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.706+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff22c0c6a30 con 0x7ff22c153b00 2023-07-20T09:51:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff22c0c69f0 con 0x7ff22c153b00 2023-07-20T09:51:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff222ffd640 1 -- 172.21.15.82:0/917659969 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff224018020 con 0x7ff22c153b00 2023-07-20T09:51:00.892 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:51:00.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 msgr2=0x7ff210068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 0x7ff210068770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff2280b1000 tx=0x7ff2280a9070 comp rx=0 tx=0).stop 2023-07-20T09:51:00.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 msgr2=0x7ff22c0c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff22400efc0 tx=0x7ff22400c490 comp rx=0 tx=0).stop 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 shutdown_connections 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff2100662b0 0x7ff210068770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff22c153b00 0x7ff22c0c8900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff22c159450 0x7ff22c14fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 --2- 172.21.15.82:0/917659969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff22c0afd50 0x7ff22c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:00.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 >> 172.21.15.82:0/917659969 conn(0x7ff22c0cad50 msgr2=0x7ff22c0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:00.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 shutdown_connections 2023-07-20T09:51:00.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:00.854+0000 7ff2345df640 1 -- 172.21.15.82:0/917659969 wait complete. 2023-07-20T09:51:00.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T09:51:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.014+0000 7fc3edffa640 1 Processor -- start 2023-07-20T09:51:01.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.014+0000 7fc3edffa640 1 -- start start 2023-07-20T09:51:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3edffa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3e80ad060 0x7fc3e80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3edffa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3e80b0290 0x7fc3e815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3edffa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e80cde70 con 0x7fc3e80afe10 2023-07-20T09:51:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3edffa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80ad440 con 0x7fc3e80ad060 2023-07-20T09:51:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3edffa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80cbef0 con 0x7fc3e80b0290 2023-07-20T09:51:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3e80ad060 0x7fc3e80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3e80ad060 0x7fc3e80ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38276/0 (socket says 172.21.15.82:38276) 2023-07-20T09:51:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 -- 172.21.15.82:0/2548990193 learned_addr learned my addr 172.21.15.82:0/2548990193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e7fff640 1 --2- 172.21.15.82:0/2548990193 >> v2:172.21.15.183:3300/0 conn(0x7fc3e80b0290 0x7fc3e815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 -- 172.21.15.82:0/2548990193 >> v2:172.21.15.183:3300/0 conn(0x7fc3e80b0290 msgr2=0x7fc3e815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 --2- 172.21.15.82:0/2548990193 >> v2:172.21.15.183:3300/0 conn(0x7fc3e80b0290 0x7fc3e815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 -- 172.21.15.82:0/2548990193 >> v1:172.21.15.183:6789/0 conn(0x7fc3e80afe10 legacy=0x7fc3e815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.018+0000 7fc3e77fe640 1 -- 172.21.15.82:0/2548990193 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80cdb40 con 0x7fc3e80ad060 2023-07-20T09:51:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3e77fe640 1 --2- 172.21.15.82:0/2548990193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80ad060 0x7fc3e80ca040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80c8900 tx=0x7fc3d801e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1451c598b7c0bfb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3e67fc640 1 -- 172.21.15.82:0/2548990193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80a8690 con 0x7fc3e80ad060 2023-07-20T09:51:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3e67fc640 1 -- 172.21.15.82:0/2548990193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d80a87f0 con 0x7fc3e80ad060 2023-07-20T09:51:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3e67fc640 1 -- 172.21.15.82:0/2548990193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80a8b80 con 0x7fc3e80ad060 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- 172.21.15.82:0/2548990193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80ad060 msgr2=0x7fc3e80ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 --2- 172.21.15.82:0/2548990193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80ad060 0x7fc3e80ca040 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80c8900 tx=0x7fc3d801e6a0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- 172.21.15.82:0/2548990193 shutdown_connections 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 --2- 172.21.15.82:0/2548990193 >> v2:172.21.15.183:3300/0 conn(0x7fc3e80b0290 0x7fc3e815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 --2- 172.21.15.82:0/2548990193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80ad060 0x7fc3e80ca040 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- 172.21.15.82:0/2548990193 >> 172.21.15.82:0/2548990193 conn(0x7fc3e80cada0 msgr2=0x7fc3e80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- 172.21.15.82:0/2548990193 shutdown_connections 2023-07-20T09:51:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- 172.21.15.82:0/2548990193 wait complete. 2023-07-20T09:51:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 Processor -- start 2023-07-20T09:51:01.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.022+0000 7fc3edffa640 1 -- start start 2023-07-20T09:51:01.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3e80ad060 0x7fc3e80c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3e80b0290 0x7fc3e80ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c2890 con 0x7fc3e80afe10 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8157fe0 con 0x7fc3e80ad060 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80c4c50 con 0x7fc3e80b0290 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38286/0 (socket says 172.21.15.82:38286) 2023-07-20T09:51:01.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 -- 172.21.15.82:0/3741102031 learned_addr learned my addr 172.21.15.82:0/3741102031 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:01.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e77fe640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3e80ad060 0x7fc3e80c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e7fff640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3e80b0290 0x7fc3e80ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 -- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3e80b0290 msgr2=0x7fc3e80ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3e80b0290 0x7fc3e80ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 -- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3e80ad060 msgr2=0x7fc3e80c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3e80ad060 0x7fc3e80c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 -- 172.21.15.82:0/3741102031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80094d0 con 0x7fc3e80afe10 2023-07-20T09:51:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3e6ffd640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c450 tx=0x7fc3dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc012830 con 0x7fc3e80afe10 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc0129b0 con 0x7fc3e80afe10 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc012d60 con 0x7fc3e80afe10 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80c1ef0 con 0x7fc3e80afe10 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e80c24b0 con 0x7fc3e80afe10 2023-07-20T09:51:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e8073c70 con 0x7fc3e80afe10 2023-07-20T09:51:01.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.026+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3dc01c460 con 0x7fc3e80afe10 2023-07-20T09:51:01.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.030+0000 7fc3cffff640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 0x7fc3d4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.030+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3dc083ab0 con 0x7fc3e80afe10 2023-07-20T09:51:01.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.030+0000 7fc3e77fe640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 0x7fc3d4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.030+0000 7fc3e77fe640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 0x7fc3d4068740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b0000 tx=0x7fc3d80a9000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.034+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3dc050fd0 con 0x7fc3e80afe10 2023-07-20T09:51:01.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.190+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc3e80cbbd0 con 0x7fc3e80afe10 2023-07-20T09:51:01.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.190+0000 7fc3cffff640 1 -- 172.21.15.82:0/3741102031 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc3dc0545f0 con 0x7fc3e80afe10 2023-07-20T09:51:01.228 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 msgr2=0x7fc3d4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 0x7fc3d4068740 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80b0000 tx=0x7fc3d80a9000 comp rx=0 tx=0).stop 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 msgr2=0x7fc3e80aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00c450 tx=0x7fc3dc00c910 comp rx=0 tx=0).stop 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 shutdown_connections 2023-07-20T09:51:01.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc3d4066280 0x7fc3d4068740 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3e80b0290 0x7fc3e80ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3e80afe10 0x7fc3e80aae90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 --2- 172.21.15.82:0/3741102031 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3e80ad060 0x7fc3e80c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 >> 172.21.15.82:0/3741102031 conn(0x7fc3e80cada0 msgr2=0x7fc3e80704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 shutdown_connections 2023-07-20T09:51:01.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.194+0000 7fc3edffa640 1 -- 172.21.15.82:0/3741102031 wait complete. 2023-07-20T09:51:01.249 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T09:51:01.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:01.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-20T09:51:01.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:51:01.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:01.557 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T09:51:01.582 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:01.582 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:01.593 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:01.594 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:01.643 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:01.644 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:01.696 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 Processor -- start 2023-07-20T09:51:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 -- start start 2023-07-20T09:51:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44bc1596b0 0x7f44bc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0ccd60 con 0x7f44bc0b2380 2023-07-20T09:51:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc0ad600 con 0x7f44bc1596b0 2023-07-20T09:51:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44c0b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ad810 con 0x7f44bc0cc900 2023-07-20T09:51:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44ba59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f44bc1596b0 0x7f44bc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44bad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f44bc0b2380 0x7f44bc0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52344/0 (socket says 172.21.15.82:52344) 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44bad9d640 1 -- 172.21.15.82:0/3825027211 learned_addr learned my addr 172.21.15.82:0/3825027211 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44b9d9b640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44ba59c640 1 -- 172.21.15.82:0/3825027211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 msgr2=0x7f44bc0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44ba59c640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44ba59c640 1 -- 172.21.15.82:0/3825027211 >> v1:172.21.15.82:6789/0 conn(0x7f44bc0b2380 legacy=0x7f44bc0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44ba59c640 1 -- 172.21.15.82:0/3825027211 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc15d0d0 con 0x7f44bc1596b0 2023-07-20T09:51:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.802+0000 7f44b959a640 1 -- 172.21.15.82:0/3825027211 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114450110 0 0) 0x7f44bc0ccd60 con 0x7f44bc0b2380 2023-07-20T09:51:01.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44ba59c640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc15dbb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97245f2d4d3a323b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44b959a640 1 -- 172.21.15.82:0/3825027211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ab650 con 0x7f44bc1596b0 2023-07-20T09:51:01.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44b959a640 1 -- 172.21.15.82:0/3825027211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0ab7b0 con 0x7f44bc1596b0 2023-07-20T09:51:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44b959a640 1 -- 172.21.15.82:0/3825027211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0abb40 con 0x7f44bc1596b0 2023-07-20T09:51:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 -- 172.21.15.82:0/3825027211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 msgr2=0x7f44bc15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc15dbb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c450 comp rx=0 tx=0).stop 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 -- 172.21.15.82:0/3825027211 shutdown_connections 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 --2- 172.21.15.82:0/3825027211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc15dbb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 -- 172.21.15.82:0/3825027211 >> 172.21.15.82:0/3825027211 conn(0x7f44bc0cada0 msgr2=0x7f44bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 -- 172.21.15.82:0/3825027211 shutdown_connections 2023-07-20T09:51:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.806+0000 7f44c0b37640 1 -- 172.21.15.82:0/3825027211 wait complete. 2023-07-20T09:51:01.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 Processor -- start 2023-07-20T09:51:01.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- start start 2023-07-20T09:51:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44bc0b2380 0x7f44bc150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0c2ea0 con 0x7f44bc1596b0 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0c7840 con 0x7f44bc0b2380 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0c7b20 con 0x7f44bc0cc900 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38302/0 (socket says 172.21.15.82:38302) 2023-07-20T09:51:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 -- 172.21.15.82:0/1800331133 learned_addr learned my addr 172.21.15.82:0/1800331133 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44b9d9b640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44ba59c640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44bc0b2380 0x7f44bc150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 -- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 msgr2=0x7f44bc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 -- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44bc0b2380 msgr2=0x7f44bc150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44bc0b2380 0x7f44bc150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 -- 172.21.15.82:0/1800331133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009420 con 0x7f44bc1596b0 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44bad9d640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c470 tx=0x7f44b400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40074e0 con 0x7f44bc1596b0 2023-07-20T09:51:01.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b4007640 con 0x7f44bc1596b0 2023-07-20T09:51:01.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4004a30 con 0x7f44bc1596b0 2023-07-20T09:51:01.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0c7e00 con 0x7f44bc1596b0 2023-07-20T09:51:01.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.810+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc0c7510 con 0x7f44bc1596b0 2023-07-20T09:51:01.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0c3010 con 0x7f44bc1596b0 2023-07-20T09:51:01.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44b4004b90 con 0x7f44bc1596b0 2023-07-20T09:51:01.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44aaffd640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 0x7f449c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:01.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44b4082fe0 con 0x7f44bc1596b0 2023-07-20T09:51:01.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44ba59c640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 0x7f449c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:01.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.814+0000 7f44ba59c640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 0x7f449c068740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0af000 tx=0x7f44ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:01.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.818+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44b4050470 con 0x7f44bc1596b0 2023-07-20T09:51:02.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.970+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44bc073c70 con 0x7f44bc1596b0 2023-07-20T09:51:02.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.970+0000 7f44aaffd640 1 -- 172.21.15.82:0/1800331133 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f44b4018070 con 0x7f44bc1596b0 2023-07-20T09:51:02.008 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:02.009 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 msgr2=0x7f449c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 0x7f449c068740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0af000 tx=0x7f44ac008040 comp rx=0 tx=0).stop 2023-07-20T09:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 msgr2=0x7f44bc159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f44b400c470 tx=0x7f44b400c930 comp rx=0 tx=0).stop 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 shutdown_connections 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f449c066280 0x7f449c068740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44bc1596b0 0x7f44bc159fd0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44bc0cc900 0x7f44bc159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 --2- 172.21.15.82:0/1800331133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44bc0b2380 0x7f44bc150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 >> 172.21.15.82:0/1800331133 conn(0x7f44bc0cada0 msgr2=0x7f44bc0cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 shutdown_connections 2023-07-20T09:51:02.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:01.974+0000 7f44c0b37640 1 -- 172.21.15.82:0/1800331133 wait complete. 2023-07-20T09:51:02.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:51:02.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:51:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.134+0000 7f1e381fa640 1 Processor -- start 2023-07-20T09:51:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.134+0000 7f1e381fa640 1 -- start start 2023-07-20T09:51:02.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e381fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1e30070970 0x7f1e30070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e381fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e3006b620 0x7f1e3006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e381fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300c95d0 con 0x7f1e30158ce0 2023-07-20T09:51:02.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e381fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3006bff0 con 0x7f1e30070970 2023-07-20T09:51:02.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e381fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301590c0 con 0x7f1e3006b620 2023-07-20T09:51:02.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35f96640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1e30158ce0 0x7f1e300c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52356/0 (socket says 172.21.15.82:52356) 2023-07-20T09:51:02.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35f96640 1 -- 172.21.15.82:0/3834487283 learned_addr learned my addr 172.21.15.82:0/3834487283 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:02.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35795640 1 --2- 172.21.15.82:0/3834487283 >> v2:172.21.15.183:3300/0 conn(0x7f1e30070970 0x7f1e30070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e36797640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e3006b620 0x7f1e3006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e34f94640 1 -- 172.21.15.82:0/3834487283 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829483583 0 0) 0x7f1e300c95d0 con 0x7f1e30158ce0 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e34f94640 1 -- 172.21.15.82:0/3834487283 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e1c003450 con 0x7f1e30158ce0 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35795640 1 -- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e3006b620 msgr2=0x7f1e3006bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35795640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e3006b620 0x7f1e3006bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35795640 1 -- 172.21.15.82:0/3834487283 >> v1:172.21.15.82:6789/0 conn(0x7f1e30158ce0 legacy=0x7f1e300c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.138+0000 7f1e35795640 1 -- 172.21.15.82:0/3834487283 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300c89c0 con 0x7f1e30070970 2023-07-20T09:51:02.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e35795640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e30070970 0x7f1e30070e00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e200097c0 tx=0x7f1e2001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa79a023841d30d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e34f94640 1 -- 172.21.15.82:0/3834487283 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200ab600 con 0x7f1e30070970 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e34f94640 1 -- 172.21.15.82:0/3834487283 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200a7050 con 0x7f1e30070970 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e34f94640 1 -- 172.21.15.82:0/3834487283 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200ab980 con 0x7f1e30070970 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e30070970 msgr2=0x7f1e30070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e30070970 0x7f1e30070e00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e200097c0 tx=0x7f1e2001c480 comp rx=0 tx=0).stop 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- 172.21.15.82:0/3834487283 shutdown_connections 2023-07-20T09:51:02.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e3006b620 0x7f1e3006bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3834487283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e30070970 0x7f1e30070e00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- 172.21.15.82:0/3834487283 >> 172.21.15.82:0/3834487283 conn(0x7f1e300cad50 msgr2=0x7f1e300cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- 172.21.15.82:0/3834487283 shutdown_connections 2023-07-20T09:51:02.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- 172.21.15.82:0/3834487283 wait complete. 2023-07-20T09:51:02.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 Processor -- start 2023-07-20T09:51:02.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.142+0000 7f1e381fa640 1 -- start start 2023-07-20T09:51:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e3006b620 0x7f1e30148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e30070970 0x7f1e3014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b0ef0 con 0x7f1e30158ce0 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b1d50 con 0x7f1e3006b620 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30148ab0 con 0x7f1e30070970 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38318/0 (socket says 172.21.15.82:38318) 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 -- 172.21.15.82:0/3462417988 learned_addr learned my addr 172.21.15.82:0/3462417988 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e35795640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e30070970 0x7f1e3014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e35f96640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e3006b620 0x7f1e30148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 -- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e30070970 msgr2=0x7f1e3014c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e30070970 0x7f1e3014c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 -- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e3006b620 msgr2=0x7f1e30148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e3006b620 0x7f1e30148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 -- 172.21.15.82:0/3462417988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20009420 con 0x7f1e30158ce0 2023-07-20T09:51:02.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e36797640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800e960 tx=0x7f1e2800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280096b0 con 0x7f1e30158ce0 2023-07-20T09:51:02.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2800c9a0 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3014cd90 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2800cd30 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e300b1420 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e300b1ee0 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.146+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e28013470 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.150+0000 7f1e267fc640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 0x7f1e14068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.150+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e28083f60 con 0x7f1e30158ce0 2023-07-20T09:51:02.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.150+0000 7f1e35f96640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 0x7f1e14068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.150+0000 7f1e35f96640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 0x7f1e14068740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c001570 tx=0x7f1e2c001a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.154+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e280513f0 con 0x7f1e30158ce0 2023-07-20T09:51:02.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.298+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e3004da30 con 0x7f1e30158ce0 2023-07-20T09:51:02.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.298+0000 7f1e267fc640 1 -- 172.21.15.82:0/3462417988 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e280170a0 con 0x7f1e30158ce0 2023-07-20T09:51:02.337 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:51:02.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 msgr2=0x7f1e14068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 0x7f1e14068740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c001570 tx=0x7f1e2c001a00 comp rx=0 tx=0).stop 2023-07-20T09:51:02.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 msgr2=0x7f1e300c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800e960 tx=0x7f1e2800ee20 comp rx=0 tx=0).stop 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 shutdown_connections 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f1e14066280 0x7f1e14068740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e30158ce0 0x7f1e300c9a60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1e30070970 0x7f1e3014c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 --2- 172.21.15.82:0/3462417988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e3006b620 0x7f1e30148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 >> 172.21.15.82:0/3462417988 conn(0x7f1e300cad50 msgr2=0x7f1e300adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 shutdown_connections 2023-07-20T09:51:02.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.302+0000 7f1e381fa640 1 -- 172.21.15.82:0/3462417988 wait complete. 2023-07-20T09:51:02.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 Processor -- start 2023-07-20T09:51:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 -- start start 2023-07-20T09:51:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7dc406b220 0x7f7dc4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40ce4f0 con 0x7f7dc406c120 2023-07-20T09:51:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc40d0970 con 0x7f7dc41602b0 2023-07-20T09:51:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcc7f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc4160e20 con 0x7f7dc406b220 2023-07-20T09:51:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dca58f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7dc406c120 0x7f7dc40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52366/0 (socket says 172.21.15.82:52366) 2023-07-20T09:51:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dca58f640 1 -- 172.21.15.82:0/1270806496 learned_addr learned my addr 172.21.15.82:0/1270806496 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcad90640 1 --2- 172.21.15.82:0/1270806496 >> v2:172.21.15.82:3300/0 conn(0x7f7dc406b220 0x7f7dc4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dc958d640 1 -- 172.21.15.82:0/1270806496 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253872199 0 0) 0x7f7dc40ce4f0 con 0x7f7dc406c120 2023-07-20T09:51:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dc958d640 1 -- 172.21.15.82:0/1270806496 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db0003530 con 0x7f7dc406c120 2023-07-20T09:51:02.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcad90640 1 -- 172.21.15.82:0/1270806496 >> v1:172.21.15.183:6789/0 conn(0x7f7dc41602b0 legacy=0x7f7dc406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcad90640 1 -- 172.21.15.82:0/1270806496 >> v1:172.21.15.82:6789/0 conn(0x7f7dc406c120 legacy=0x7f7dc40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.462+0000 7f7dcad90640 1 -- 172.21.15.82:0/1270806496 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc40cd300 con 0x7f7dc406b220 2023-07-20T09:51:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcad90640 1 --2- 172.21.15.82:0/1270806496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406b220 0x7f7dc4160740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097c0 tx=0x7f7dbc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f9e8cb865dc68b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dc958d640 1 -- 172.21.15.82:0/1270806496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0ab600 con 0x7f7dc406b220 2023-07-20T09:51:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dc958d640 1 -- 172.21.15.82:0/1270806496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc0a7050 con 0x7f7dc406b220 2023-07-20T09:51:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dc958d640 1 -- 172.21.15.82:0/1270806496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0ab980 con 0x7f7dc406b220 2023-07-20T09:51:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1270806496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406b220 msgr2=0x7f7dc4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1270806496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406b220 0x7f7dc4160740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0097c0 tx=0x7f7dbc01c330 comp rx=0 tx=0).stop 2023-07-20T09:51:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1270806496 shutdown_connections 2023-07-20T09:51:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1270806496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406b220 0x7f7dc4160740 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1270806496 >> 172.21.15.82:0/1270806496 conn(0x7f7dc408c0a0 msgr2=0x7f7dc409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1270806496 shutdown_connections 2023-07-20T09:51:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.466+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1270806496 wait complete. 2023-07-20T09:51:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 Processor -- start 2023-07-20T09:51:02.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- start start 2023-07-20T09:51:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc406b220 0x7f7dc40b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 0x7f7dc4156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40c85e0 con 0x7f7dc406c120 2023-07-20T09:51:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40b7b70 con 0x7f7dc406b220 2023-07-20T09:51:02.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc40c7680 con 0x7f7dc41602b0 2023-07-20T09:51:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38330/0 (socket says 172.21.15.82:38330) 2023-07-20T09:51:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 -- 172.21.15.82:0/1220595238 learned_addr learned my addr 172.21.15.82:0/1220595238 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:02.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dca58f640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc406b220 0x7f7dc40b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcad90640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 0x7f7dc4156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 -- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 msgr2=0x7f7dc4156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 0x7f7dc4156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 -- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc406b220 msgr2=0x7f7dc40b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc406b220 0x7f7dc40b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 -- 172.21.15.82:0/1220595238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009420 con 0x7f7dc406c120 2023-07-20T09:51:02.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcad90640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 0x7f7dc4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dc9d8e640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c3f0 tx=0x7f7db400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db40052d0 con 0x7f7dc406c120 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db4005430 con 0x7f7dc406c120 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc40c7960 con 0x7f7dc406c120 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db4003840 con 0x7f7dc406c120 2023-07-20T09:51:02.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.470+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc40c7f20 con 0x7f7dc406c120 2023-07-20T09:51:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc404da30 con 0x7f7dc406c120 2023-07-20T09:51:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7db40039a0 con 0x7f7dc406c120 2023-07-20T09:51:02.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dbaffd640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 0x7f7da8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7db4083250 con 0x7f7dc406c120 2023-07-20T09:51:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dca58f640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 0x7f7da8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.474+0000 7f7dca58f640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 0x7f7da8068740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001570 tx=0x7f7dc0001aa0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.478+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7db4050770 con 0x7f7dc406c120 2023-07-20T09:51:02.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7dc406a8f0 con 0x7f7dc406c120 2023-07-20T09:51:02.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dbaffd640 1 -- 172.21.15.82:0/1220595238 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7db4053d90 con 0x7f7dc406c120 2023-07-20T09:51:02.667 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:02.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 msgr2=0x7f7da8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 0x7f7da8068740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001570 tx=0x7f7dc0001aa0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 msgr2=0x7f7dc40c8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c3f0 tx=0x7f7db400c8b0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 shutdown_connections 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7da8066280 0x7f7da8068740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7dc41602b0 0x7f7dc4156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dc406c120 0x7f7dc40c8a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 --2- 172.21.15.82:0/1220595238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7dc406b220 0x7f7dc40b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 >> 172.21.15.82:0/1220595238 conn(0x7f7dc408c0a0 msgr2=0x7f7dc406ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 shutdown_connections 2023-07-20T09:51:02.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.630+0000 7f7dcc7f3640 1 -- 172.21.15.82:0/1220595238 wait complete. 2023-07-20T09:51:02.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:51:02.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.790+0000 7f56d3634640 1 Processor -- start 2023-07-20T09:51:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.790+0000 7f56d3634640 1 -- start start 2023-07-20T09:51:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d3634640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56cc06c120 0x7f56cc0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d3634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d3634640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0d0970 con 0x7f56cc06ab10 2023-07-20T09:51:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d3634640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc160e20 con 0x7f56cc06c120 2023-07-20T09:51:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d3634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0cd300 con 0x7f56cc1602b0 2023-07-20T09:51:02.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d13d0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56cc06c120 0x7f56cc0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:50718/0 (socket says 172.21.15.82:50718) 2023-07-20T09:51:02.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 -- 172.21.15.82:0/3348730652 learned_addr learned my addr 172.21.15.82:0/3348730652 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d1bd1640 1 --1- 172.21.15.82:0/3348730652 >> v1:172.21.15.183:6789/0 conn(0x7f56cc06ab10 0x7f56cc06af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:40108/0 (socket says 172.21.15.82:40108) 2023-07-20T09:51:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 -- 172.21.15.82:0/3348730652 >> v2:172.21.15.183:3300/0 conn(0x7f56cc06c120 msgr2=0x7f56cc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 --2- 172.21.15.82:0/3348730652 >> v2:172.21.15.183:3300/0 conn(0x7f56cc06c120 0x7f56cc0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 -- 172.21.15.82:0/3348730652 >> v1:172.21.15.183:6789/0 conn(0x7f56cc06ab10 legacy=0x7f56cc06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.794+0000 7f56d0bcf640 1 -- 172.21.15.82:0/3348730652 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0cd5e0 con 0x7f56cc1602b0 2023-07-20T09:51:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d0bcf640 1 --2- 172.21.15.82:0/3348730652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009870 tx=0x7f56bc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418a19fb1d383d61 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56c3fff640 1 -- 172.21.15.82:0/3348730652 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0ac620 con 0x7f56cc1602b0 2023-07-20T09:51:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56c3fff640 1 -- 172.21.15.82:0/3348730652 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc0ac780 con 0x7f56cc1602b0 2023-07-20T09:51:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56c3fff640 1 -- 172.21.15.82:0/3348730652 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0acb10 con 0x7f56cc1602b0 2023-07-20T09:51:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- 172.21.15.82:0/3348730652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 msgr2=0x7f56cc160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 --2- 172.21.15.82:0/3348730652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009870 tx=0x7f56bc01c4b0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- 172.21.15.82:0/3348730652 shutdown_connections 2023-07-20T09:51:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 --2- 172.21.15.82:0/3348730652 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc1602b0 0x7f56cc160710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 --2- 172.21.15.82:0/3348730652 >> v2:172.21.15.183:3300/0 conn(0x7f56cc06c120 0x7f56cc0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- 172.21.15.82:0/3348730652 >> 172.21.15.82:0/3348730652 conn(0x7f56cc08c0a0 msgr2=0x7f56cc09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- 172.21.15.82:0/3348730652 shutdown_connections 2023-07-20T09:51:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- 172.21.15.82:0/3348730652 wait complete. 2023-07-20T09:51:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 Processor -- start 2023-07-20T09:51:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.798+0000 7f56d3634640 1 -- start start 2023-07-20T09:51:02.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 0x7f56cc14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 0x7f56cc156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc157500 con 0x7f56cc1602b0 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc156b30 con 0x7f56cc06ab10 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc156540 con 0x7f56cc06c120 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38346/0 (socket says 172.21.15.82:38346) 2023-07-20T09:51:02.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 -- 172.21.15.82:0/438089062 learned_addr learned my addr 172.21.15.82:0/438089062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:02.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d0bcf640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 0x7f56cc156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d13d0640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 0x7f56cc14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 -- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 msgr2=0x7f56cc156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 0x7f56cc156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 -- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 msgr2=0x7f56cc14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 0x7f56cc14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 -- 172.21.15.82:0/438089062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc0094d0 con 0x7f56cc1602b0 2023-07-20T09:51:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d0bcf640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 0x7f56cc156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d13d0640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 0x7f56cc14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d1bd1640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c7d0 tx=0x7f56c400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400a640 con 0x7f56cc1602b0 2023-07-20T09:51:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400a7a0 con 0x7f56cc1602b0 2023-07-20T09:51:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc14d7c0 con 0x7f56cc1602b0 2023-07-20T09:51:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400ab10 con 0x7f56cc1602b0 2023-07-20T09:51:02.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1567c0 con 0x7f56cc1602b0 2023-07-20T09:51:02.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc14dca0 con 0x7f56cc1602b0 2023-07-20T09:51:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.802+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56c400ac70 con 0x7f56cc1602b0 2023-07-20T09:51:02.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.806+0000 7f56c1ffb640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 0x7f56b0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.806+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56c4083550 con 0x7f56cc1602b0 2023-07-20T09:51:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.806+0000 7f56d13d0640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 0x7f56b0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:02.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.806+0000 7f56d13d0640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 0x7f56b0068740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14f1a0 tx=0x7f56c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:02.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.810+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56cc14dca0 con 0x7f56cc1602b0 2023-07-20T09:51:02.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56cc14dca0 con 0x7f56cc1602b0 2023-07-20T09:51:02.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56c1ffb640 1 -- 172.21.15.82:0/438089062 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56cc14dca0 con 0x7f56cc1602b0 2023-07-20T09:51:02.995 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:51:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 msgr2=0x7f56b0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 0x7f56b0068740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f56cc14f1a0 tx=0x7f56c8008040 comp rx=0 tx=0).stop 2023-07-20T09:51:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 msgr2=0x7f56cc14e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.958+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f56c400c7d0 tx=0x7f56c400cc90 comp rx=0 tx=0).stop 2023-07-20T09:51:02.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 shutdown_connections 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f56b0066280 0x7f56b0068740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56cc1602b0 0x7f56cc14e050 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56cc06c120 0x7f56cc156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 --2- 172.21.15.82:0/438089062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56cc06ab10 0x7f56cc14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 >> 172.21.15.82:0/438089062 conn(0x7f56cc08c0a0 msgr2=0x7f56cc0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:02.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 shutdown_connections 2023-07-20T09:51:02.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:02.962+0000 7f56d3634640 1 -- 172.21.15.82:0/438089062 wait complete. 2023-07-20T09:51:03.016 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:51:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 Processor -- start 2023-07-20T09:51:03.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 -- start start 2023-07-20T09:51:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f232006bd30 0x7f2320070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200c95d0 con 0x7f2320070970 2023-07-20T09:51:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23201590c0 con 0x7f2320158ce0 2023-07-20T09:51:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2326856640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200c89c0 con 0x7f232006bd30 2023-07-20T09:51:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2320070970 0x7f232006b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52374/0 (socket says 172.21.15.82:52374) 2023-07-20T09:51:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231f7fe640 1 -- 172.21.15.82:0/94148973 learned_addr learned my addr 172.21.15.82:0/94148973 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2324df3640 1 --2- 172.21.15.82:0/94148973 >> v2:172.21.15.183:3300/0 conn(0x7f232006bd30 0x7f2320070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184499434 0 0) 0x7f23200c95d0 con 0x7f2320070970 2023-07-20T09:51:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2308004640 con 0x7f2320070970 2023-07-20T09:51:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014355042 0 0) 0x7f23201590c0 con 0x7f2320158ce0 2023-07-20T09:51:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23200c95d0 con 0x7f2320158ce0 2023-07-20T09:51:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2324df3640 1 -- 172.21.15.82:0/94148973 >> v1:172.21.15.183:6789/0 conn(0x7f2320158ce0 legacy=0x7f23200c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2324df3640 1 -- 172.21.15.82:0/94148973 >> v1:172.21.15.82:6789/0 conn(0x7f2320070970 legacy=0x7f232006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.122+0000 7f2324df3640 1 -- 172.21.15.82:0/94148973 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200c8ca0 con 0x7f232006bd30 2023-07-20T09:51:03.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2324df3640 1 --2- 172.21.15.82:0/94148973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232006bd30 0x7f2320070e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839ec932ccdd52a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5880 con 0x7f232006bd30 2023-07-20T09:51:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180a59e0 con 0x7f232006bd30 2023-07-20T09:51:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f231effd640 1 -- 172.21.15.82:0/94148973 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5d70 con 0x7f232006bd30 2023-07-20T09:51:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 -- 172.21.15.82:0/94148973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232006bd30 msgr2=0x7f2320070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 --2- 172.21.15.82:0/94148973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232006bd30 0x7f2320070e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231801c950 comp rx=0 tx=0).stop 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 -- 172.21.15.82:0/94148973 shutdown_connections 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 --2- 172.21.15.82:0/94148973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232006bd30 0x7f2320070e00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 -- 172.21.15.82:0/94148973 >> 172.21.15.82:0/94148973 conn(0x7f23200cad50 msgr2=0x7f23200cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 -- 172.21.15.82:0/94148973 shutdown_connections 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.126+0000 7f2326856640 1 -- 172.21.15.82:0/94148973 wait complete. 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 Processor -- start 2023-07-20T09:51:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- start start 2023-07-20T09:51:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320070970 0x7f23201511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2320158ce0 0x7f2320156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320152840 con 0x7f232006bd30 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320151bc0 con 0x7f2320070970 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320151ea0 con 0x7f2320158ce0 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38352/0 (socket says 172.21.15.82:38352) 2023-07-20T09:51:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 -- 172.21.15.82:0/2743514701 learned_addr learned my addr 172.21.15.82:0/2743514701 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231f7fe640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320070970 0x7f23201511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2324df3640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2320158ce0 0x7f2320156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 -- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2320158ce0 msgr2=0x7f2320156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2320158ce0 0x7f2320156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 -- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320070970 msgr2=0x7f23201511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320070970 0x7f23201511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 -- 172.21.15.82:0/2743514701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318009a70 con 0x7f232006bd30 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231ffff640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f231000c430 tx=0x7f231000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100052d0 con 0x7f232006bd30 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310005450 con 0x7f232006bd30 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310003840 con 0x7f232006bd30 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320152180 con 0x7f232006bd30 2023-07-20T09:51:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320152e90 con 0x7f232006bd30 2023-07-20T09:51:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.130+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320152b60 con 0x7f232006bd30 2023-07-20T09:51:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.134+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23100039a0 con 0x7f232006bd30 2023-07-20T09:51:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.134+0000 7f231cff9640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 0x7f230c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.134+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2310083350 con 0x7f232006bd30 2023-07-20T09:51:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.134+0000 7f231f7fe640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 0x7f230c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.134+0000 7f231f7fe640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 0x7f230c068740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23201f8620 tx=0x7f2314007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.138+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23100507e0 con 0x7f232006bd30 2023-07-20T09:51:03.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.282+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23200b4250 con 0x7f232006bd30 2023-07-20T09:51:03.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.282+0000 7f231cff9640 1 -- 172.21.15.82:0/2743514701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2310053e00 con 0x7f232006bd30 2023-07-20T09:51:03.321 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:51:03.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 msgr2=0x7f230c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 0x7f230c068740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23201f8620 tx=0x7f2314007d40 comp rx=0 tx=0).stop 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 msgr2=0x7f232014fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f231000c430 tx=0x7f231000c8f0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 shutdown_connections 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f230c066280 0x7f230c068740 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2320158ce0 0x7f2320156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2320070970 0x7f23201511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 --2- 172.21.15.82:0/2743514701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232006bd30 0x7f232014fea0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 >> 172.21.15.82:0/2743514701 conn(0x7f23200cad50 msgr2=0x7f2320157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 shutdown_connections 2023-07-20T09:51:03.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.286+0000 7f2326856640 1 -- 172.21.15.82:0/2743514701 wait complete. 2023-07-20T09:51:03.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T09:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.442+0000 7f15c0abd640 1 Processor -- start 2023-07-20T09:51:03.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.442+0000 7f15c0abd640 1 -- start start 2023-07-20T09:51:03.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15c0abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15bc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15c0abd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc0ccd90 con 0x7f15bc1596b0 2023-07-20T09:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15c0abd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc0ad810 con 0x7f15bc0cc900 2023-07-20T09:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15c0abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc15d0d0 con 0x7f15bc0b2a90 2023-07-20T09:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f15bc1596b0 0x7f15bc0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36194/0 (socket says 172.21.15.82:36194) 2023-07-20T09:51:03.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 -- 172.21.15.82:0/330874727 learned_addr learned my addr 172.21.15.82:0/330874727 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:03.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15bc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538866686 0 0) 0x7f15bc0ccd90 con 0x7f15bc1596b0 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a8003530 con 0x7f15bc1596b0 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393286930 0 0) 0x7f15bc0ad810 con 0x7f15bc0cc900 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc0ccd90 con 0x7f15bc0cc900 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196734585 0 0) 0x7f15a8003530 con 0x7f15bc1596b0 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 msgr2=0x7f15bc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15bc15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 >> v1:172.21.15.183:6789/0 conn(0x7f15bc0cc900 legacy=0x7f15bc0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc15d3b0 con 0x7f15bc1596b0 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f15ac001680 con 0x7f15bc1596b0 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 >> v1:172.21.15.82:6789/0 conn(0x7f15bc1596b0 legacy=0x7f15bc0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a8003b40 0x7f15a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a80047d0 0x7f15a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc15d0d0 con 0x7f15a8003b40 2023-07-20T09:51:03.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a800ba70 con 0x7f15a80047d0 2023-07-20T09:51:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a800de40 con 0x7f15bc0b2a90 2023-07-20T09:51:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a8003b40 0x7f15a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a80047d0 0x7f15a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15bad9d640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 -- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 msgr2=0x7f15a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15bc0b2a90 0x7f15a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 -- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a80047d0 msgr2=0x7f15a8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a80047d0 0x7f15a8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15ba59c640 1 -- 172.21.15.82:0/330874727 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8003530 con 0x7f15a8003b40 2023-07-20T09:51:03.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.446+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15a80047d0 0x7f15a8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:03.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15ba59c640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a8003b40 0x7f15a8003f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fa0 tx=0x7f15ac01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35705168ec20fd77 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac005ae0 con 0x7f15a8003b40 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac005c40 con 0x7f15a8003b40 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15b9d9b640 1 -- 172.21.15.82:0/330874727 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac007070 con 0x7f15a8003b40 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 -- 172.21.15.82:0/330874727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a8003b40 msgr2=0x7f15a8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 --2- 172.21.15.82:0/330874727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15a8003b40 0x7f15a8003f40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15ac007fa0 tx=0x7f15ac01cad0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15bad9d640 1 -- 172.21.15.82:0/330874727 reap_dead start 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 -- 172.21.15.82:0/330874727 shutdown_connections 2023-07-20T09:51:03.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 -- 172.21.15.82:0/330874727 >> 172.21.15.82:0/330874727 conn(0x7f15bc0cada0 msgr2=0x7f15bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 -- 172.21.15.82:0/330874727 shutdown_connections 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.450+0000 7f15c0abd640 1 -- 172.21.15.82:0/330874727 wait complete. 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 Processor -- start 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- start start 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8003b40 0x7f15bc098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 0x7f15bc15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc06d6c0 con 0x7f15bc06d260 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1559d0 con 0x7f15bc15e0d0 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc098ff0 con 0x7f15a8003b40 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33004/0 (socket says 172.21.15.82:33004) 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 -- 172.21.15.82:0/359481739 learned_addr learned my addr 172.21.15.82:0/359481739 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:03.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 -- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8003b40 msgr2=0x7f15bc098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8003b40 0x7f15bc098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15bad9d640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 0x7f15bc15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 -- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 msgr2=0x7f15bc15e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 0x7f15bc15e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 -- 172.21.15.82:0/359481739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0992d0 con 0x7f15bc06d260 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15bad9d640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 0x7f15bc15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:03.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b1d9b640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f15a40101f0 tx=0x7f15a40106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400e050 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400f040 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4003bc0 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc0995b0 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc0ac700 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.454+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc099f90 con 0x7f15bc06d260 2023-07-20T09:51:03.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.458+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15a4003d20 con 0x7f15bc06d260 2023-07-20T09:51:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.458+0000 7f15b37fe640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 0x7f159c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.458+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15a4084a90 con 0x7f15bc06d260 2023-07-20T09:51:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.458+0000 7f15ba59c640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 0x7f159c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:03.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.458+0000 7f15ba59c640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 0x7f159c068740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ab000 tx=0x7f15ac001940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:03.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.462+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15bc099f90 con 0x7f15bc06d260 2023-07-20T09:51:03.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.618+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15bc099f90 con 0x7f15bc06d260 2023-07-20T09:51:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.618+0000 7f15b37fe640 1 -- 172.21.15.82:0/359481739 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f15bc099f90 con 0x7f15bc06d260 2023-07-20T09:51:03.656 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-07-20T09:51:03.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 msgr2=0x7f159c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 0x7f159c068740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ab000 tx=0x7f15ac001940 comp rx=0 tx=0).stop 2023-07-20T09:51:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 msgr2=0x7f15bc0ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f15a40101f0 tx=0x7f15a40106b0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 shutdown_connections 2023-07-20T09:51:03.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f159c066280 0x7f159c068740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15bc15e0d0 0x7f15bc15e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15bc06d260 0x7f15bc0ac1c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 --2- 172.21.15.82:0/359481739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15a8003b40 0x7f15bc098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:03.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 >> 172.21.15.82:0/359481739 conn(0x7f15bc0cada0 msgr2=0x7f15bc0aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:03.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 shutdown_connections 2023-07-20T09:51:03.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:03.622+0000 7f15c0abd640 1 -- 172.21.15.82:0/359481739 wait complete. 2023-07-20T09:51:03.676 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-20T09:51:03.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:03.677 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-20T09:51:03.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:51:03.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:03.757 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-20T09:51:03.827 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:51:03.827 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:03.836 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:51:03.836 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:03.884 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:51:03.885 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:03.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:04.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 Processor -- start 2023-07-20T09:51:04.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 -- start start 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 0x7f4c900ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9015a8e0 0x7f4c900b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c900b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900b3160 con 0x7f4c9015a8e0 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900b2ee0 con 0x7f4c900afda0 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.082+0000 7f4c9849e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900b06c0 con 0x7f4c900b2060 2023-07-20T09:51:04.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9015a8e0 0x7f4c900b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9015a8e0 0x7f4c900b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33012/0 (socket says 172.21.15.82:33012) 2023-07-20T09:51:04.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 -- 172.21.15.82:0/3233714729 learned_addr learned my addr 172.21.15.82:0/3233714729 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:04.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c9623a640 1 --2- 172.21.15.82:0/3233714729 >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 0x7f4c900ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c96a3b640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c900b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 -- 172.21.15.82:0/3233714729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 msgr2=0x7f4c900b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c900b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 -- 172.21.15.82:0/3233714729 >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 msgr2=0x7f4c900ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 --2- 172.21.15.82:0/3233714729 >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 0x7f4c900ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 -- 172.21.15.82:0/3233714729 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900b12a0 con 0x7f4c9015a8e0 2023-07-20T09:51:04.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c9623a640 1 --2- 172.21.15.82:0/3233714729 >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 0x7f4c900ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:04.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c96a3b640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c900b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:04.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95a39640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c900b29a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b0b40 tx=0x7f4c8001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b79fc22bd5bd0f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95238640 1 -- 172.21.15.82:0/3233714729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800ab600 con 0x7f4c9015a8e0 2023-07-20T09:51:04.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95238640 1 -- 172.21.15.82:0/3233714729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c800a7050 con 0x7f4c9015a8e0 2023-07-20T09:51:04.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.086+0000 7f4c95238640 1 -- 172.21.15.82:0/3233714729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800ab980 con 0x7f4c9015a8e0 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- 172.21.15.82:0/3233714729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 msgr2=0x7f4c900b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c900b29a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b0b40 tx=0x7f4c8001c3b0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- 172.21.15.82:0/3233714729 shutdown_connections 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c900b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3233714729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c900b29a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3233714729 >> v2:172.21.15.183:3300/0 conn(0x7f4c900afda0 0x7f4c900ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- 172.21.15.82:0/3233714729 >> 172.21.15.82:0/3233714729 conn(0x7f4c900cada0 msgr2=0x7f4c900cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- 172.21.15.82:0/3233714729 shutdown_connections 2023-07-20T09:51:04.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- 172.21.15.82:0/3233714729 wait complete. 2023-07-20T09:51:04.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 Processor -- start 2023-07-20T09:51:04.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- start start 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c900afda0 0x7f4c90153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c90153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90154100 con 0x7f4c9015a8e0 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900abc60 con 0x7f4c900afda0 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9849e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900abf40 con 0x7f4c900b2060 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33022/0 (socket says 172.21.15.82:33022) 2023-07-20T09:51:04.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 -- 172.21.15.82:0/3170207952 learned_addr learned my addr 172.21.15.82:0/3170207952 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:04.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c9623a640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c900afda0 0x7f4c90153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c95a39640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c90153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 -- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 msgr2=0x7f4c90153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c90153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 -- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c900afda0 msgr2=0x7f4c90153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c900afda0 0x7f4c90153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.090+0000 7f4c96a3b640 1 -- 172.21.15.82:0/3170207952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800094d0 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c96a3b640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800cd50 tx=0x7f4c8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800f680 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8800f800 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800fbb0 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900ac220 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c900ac870 con 0x7f4c9015a8e0 2023-07-20T09:51:04.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c90073c70 con 0x7f4c9015a8e0 2023-07-20T09:51:04.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c8800b040 con 0x7f4c9015a8e0 2023-07-20T09:51:04.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 0x7f4c74068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.094+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c88084680 con 0x7f4c9015a8e0 2023-07-20T09:51:04.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.098+0000 7f4c9623a640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 0x7f4c74068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.098+0000 7f4c9623a640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 0x7f4c74068740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00aaf0 tx=0x7f4c8c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.098+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c88051b00 con 0x7f4c9015a8e0 2023-07-20T09:51:04.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c900cb990 con 0x7f4c9015a8e0 2023-07-20T09:51:04.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c86ffd640 1 -- 172.21.15.82:0/3170207952 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f4c88055120 con 0x7f4c9015a8e0 2023-07-20T09:51:04.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:04.287 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:04.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 msgr2=0x7f4c74068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 0x7f4c74068740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00aaf0 tx=0x7f4c8c008040 comp rx=0 tx=0).stop 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 msgr2=0x7f4c90158a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800cd50 tx=0x7f4c8800a650 comp rx=0 tx=0).stop 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 shutdown_connections 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4c74066280 0x7f4c74068740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9015a8e0 0x7f4c90158a90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c900b2060 0x7f4c90153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 --2- 172.21.15.82:0/3170207952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c900afda0 0x7f4c90153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 >> 172.21.15.82:0/3170207952 conn(0x7f4c900cada0 msgr2=0x7f4c90159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 shutdown_connections 2023-07-20T09:51:04.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.250+0000 7f4c9849e640 1 -- 172.21.15.82:0/3170207952 wait complete. 2023-07-20T09:51:04.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:51:04.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:51:04.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 Processor -- start 2023-07-20T09:51:04.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 -- start start 2023-07-20T09:51:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1880ccf10 0x7ff188160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18806a1d0 con 0x7ff188069750 2023-07-20T09:51:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1881601b0 con 0x7ff1880ccf10 2023-07-20T09:51:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff18e18f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188161100 con 0x7ff18806e4d0 2023-07-20T09:51:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1880ccf10 0x7ff188160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1880ccf10 0x7ff188160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33024/0 (socket says 172.21.15.82:33024) 2023-07-20T09:51:04.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 -- 172.21.15.82:0/2109815668 learned_addr learned my addr 172.21.15.82:0/2109815668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:04.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff187fff640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 -- 172.21.15.82:0/2109815668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 msgr2=0x7ff188069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 -- 172.21.15.82:0/2109815668 >> v1:172.21.15.183:6789/0 conn(0x7ff188069750 legacy=0x7ff18806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff1877fe640 1 -- 172.21.15.82:0/2109815668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18806a4b0 con 0x7ff1880ccf10 2023-07-20T09:51:04.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.414+0000 7ff187fff640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:04.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff1877fe640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ccf10 0x7ff188160bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff178009870 tx=0x7ff17801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95e93855ad6b003 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff1867fc640 1 -- 172.21.15.82:0/2109815668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780aa5f0 con 0x7ff1880ccf10 2023-07-20T09:51:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff1867fc640 1 -- 172.21.15.82:0/2109815668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780aa750 con 0x7ff1880ccf10 2023-07-20T09:51:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff1867fc640 1 -- 172.21.15.82:0/2109815668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780aaae0 con 0x7ff1880ccf10 2023-07-20T09:51:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 -- 172.21.15.82:0/2109815668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ccf10 msgr2=0x7ff188160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ccf10 0x7ff188160bc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff178009870 tx=0x7ff17801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 -- 172.21.15.82:0/2109815668 shutdown_connections 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2109815668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1880ccf10 0x7ff188160bc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 -- 172.21.15.82:0/2109815668 >> 172.21.15.82:0/2109815668 conn(0x7ff1880cf070 msgr2=0x7ff1880cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 -- 172.21.15.82:0/2109815668 shutdown_connections 2023-07-20T09:51:04.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 -- 172.21.15.82:0/2109815668 wait complete. 2023-07-20T09:51:04.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.418+0000 7ff18e18f640 1 Processor -- start 2023-07-20T09:51:04.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- start start 2023-07-20T09:51:04.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1880ccf10 0x7ff18815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff188152570 con 0x7ff188069750 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff188152c40 con 0x7ff1880ccf10 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188152f20 con 0x7ff18806e4d0 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33034/0 (socket says 172.21.15.82:33034) 2023-07-20T09:51:04.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 -- 172.21.15.82:0/2265718446 learned_addr learned my addr 172.21.15.82:0/2265718446 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff186ffd640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff187fff640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1880ccf10 0x7ff18815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 -- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 msgr2=0x7ff188152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 -- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1880ccf10 msgr2=0x7ff18815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1880ccf10 0x7ff18815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 -- 172.21.15.82:0/2265718446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780094d0 con 0x7ff188069750 2023-07-20T09:51:04.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff1877fe640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff17801ab80 tx=0x7ff17801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b3800 con 0x7ff188069750 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1780b3980 con 0x7ff188069750 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188153200 con 0x7ff188069750 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b3d30 con 0x7ff188069750 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1881537c0 con 0x7ff188069750 2023-07-20T09:51:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.422+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18804da30 con 0x7ff188069750 2023-07-20T09:51:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.426+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1780b2380 con 0x7ff188069750 2023-07-20T09:51:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.426+0000 7ff16ffff640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 0x7ff174068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.426+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1780a7070 con 0x7ff188069750 2023-07-20T09:51:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.426+0000 7ff186ffd640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 0x7ff174068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.426+0000 7ff186ffd640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 0x7ff174068740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1880afb30 tx=0x7ff17c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.430+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1780eb7b0 con 0x7ff188069750 2023-07-20T09:51:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.574+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1880ce210 con 0x7ff188069750 2023-07-20T09:51:04.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.574+0000 7ff16ffff640 1 -- 172.21.15.82:0/2265718446 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1780eedd0 con 0x7ff188069750 2023-07-20T09:51:04.612 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:51:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 msgr2=0x7ff174068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 0x7ff174068740 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff1880afb30 tx=0x7ff17c009040 comp rx=0 tx=0).stop 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 msgr2=0x7ff1880b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff17801ab80 tx=0x7ff17801ad10 comp rx=0 tx=0).stop 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 shutdown_connections 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff174066280 0x7ff174068740 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1880ccf10 0x7ff18815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff18806e4d0 0x7ff188152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 --2- 172.21.15.82:0/2265718446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff188069750 0x7ff1880b4350 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 >> 172.21.15.82:0/2265718446 conn(0x7ff1880cf070 msgr2=0x7ff18806a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 shutdown_connections 2023-07-20T09:51:04.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.578+0000 7ff18e18f640 1 -- 172.21.15.82:0/2265718446 wait complete. 2023-07-20T09:51:04.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:04.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.734+0000 7f0e20167640 1 Processor -- start 2023-07-20T09:51:04.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.734+0000 7f0e20167640 1 -- start start 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e20167640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0e18159450 0x7f0e1815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e20167640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180cc8d0 con 0x7f0e18159830 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e20167640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180ccbb0 con 0x7f0e180afd50 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e20167640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180cce90 con 0x7f0e18159450 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1d702640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0e18159830 0x7f0e180cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36208/0 (socket says 172.21.15.82:36208) 2023-07-20T09:51:04.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1d702640 1 -- 172.21.15.82:0/240085654 learned_addr learned my addr 172.21.15.82:0/240085654 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814106234 0 0) 0x7f0e180cc8d0 con 0x7f0e18159830 2023-07-20T09:51:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e04003530 con 0x7f0e18159830 2023-07-20T09:51:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 --2- 172.21.15.82:0/240085654 >> v2:172.21.15.183:3300/0 conn(0x7f0e18159450 0x7f0e1815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316337922 0 0) 0x7f0e04003530 con 0x7f0e18159830 2023-07-20T09:51:04.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 >> v2:172.21.15.183:3300/0 conn(0x7f0e18159450 msgr2=0x7f0e1815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 --2- 172.21.15.82:0/240085654 >> v2:172.21.15.183:3300/0 conn(0x7f0e18159450 0x7f0e1815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 >> v1:172.21.15.183:6789/0 conn(0x7f0e180afd50 legacy=0x7f0e180b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18159cc0 con 0x7f0e18159830 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f0e08001680 con 0x7f0e18159830 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 >> v1:172.21.15.82:6789/0 conn(0x7f0e18159830 legacy=0x7f0e180cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 0x7f0e04003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e040047d0 0x7f0e04004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e040051e0 0x7f0e0400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cce90 con 0x7f0e04003a40 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0400c110 con 0x7f0e040051e0 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0400c2d0 con 0x7f0e040047d0 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 0x7f0e04003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1d702640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e040047d0 0x7f0e04004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1e704640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e040051e0 0x7f0e0400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 -- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e040047d0 msgr2=0x7f0e04004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e040047d0 0x7f0e04004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 -- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e040051e0 msgr2=0x7f0e0400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e040051e0 0x7f0e0400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1df03640 1 -- 172.21.15.82:0/240085654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04003530 con 0x7f0e04003a40 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1e704640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e040051e0 0x7f0e0400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:04.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.738+0000 7f0e1e704640 1 -- 172.21.15.82:0/240085654 reap_dead start 2023-07-20T09:51:04.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e1df03640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 0x7f0e04003e60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009fc0 tx=0x7f0e1401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c06c278cf9cc9b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140a5b00 con 0x7f0e04003a40 2023-07-20T09:51:04.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1400f040 con 0x7f0e04003a40 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e1cf01640 1 -- 172.21.15.82:0/240085654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140a5ea0 con 0x7f0e04003a40 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 -- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 msgr2=0x7f0e04003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 0x7f0e04003e60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009fc0 tx=0x7f0e1401cc30 comp rx=0 tx=0).stop 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 -- 172.21.15.82:0/240085654 shutdown_connections 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 --2- 172.21.15.82:0/240085654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e04003a40 0x7f0e04003e60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 -- 172.21.15.82:0/240085654 >> 172.21.15.82:0/240085654 conn(0x7f0e180cad50 msgr2=0x7f0e180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 -- 172.21.15.82:0/240085654 shutdown_connections 2023-07-20T09:51:04.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.742+0000 7f0e20167640 1 -- 172.21.15.82:0/240085654 wait complete. 2023-07-20T09:51:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 Processor -- start 2023-07-20T09:51:04.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- start start 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 0x7f0e181589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e181f4d80 0x7f0e1815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18157860 con 0x7f0e180c63f0 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180c6be0 con 0x7f0e04003a40 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1814a0f0 con 0x7f0e181f4d80 2023-07-20T09:51:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33058/0 (socket says 172.21.15.82:33058) 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 -- 172.21.15.82:0/354619541 learned_addr learned my addr 172.21.15.82:0/354619541 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1df03640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 0x7f0e181589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 -- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e181f4d80 msgr2=0x7f0e1815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e181f4d80 0x7f0e1815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 -- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 msgr2=0x7f0e181589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 0x7f0e181589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 -- 172.21.15.82:0/354619541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180c6900 con 0x7f0e180c63f0 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1df03640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 0x7f0e181589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e1d702640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800e7b0 tx=0x7f0e0800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800c6c0 con 0x7f0e180c63f0 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0800c820 con 0x7f0e180c63f0 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0800cbd0 con 0x7f0e180c63f0 2023-07-20T09:51:04.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18157f00 con 0x7f0e180c63f0 2023-07-20T09:51:04.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e181584c0 con 0x7f0e180c63f0 2023-07-20T09:51:04.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.746+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e18157d60 con 0x7f0e180c63f0 2023-07-20T09:51:04.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.750+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e0800cd30 con 0x7f0e180c63f0 2023-07-20T09:51:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.750+0000 7f0e0e7fc640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 0x7f0dfc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.750+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e08083c50 con 0x7f0e180c63f0 2023-07-20T09:51:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.750+0000 7f0e1df03640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 0x7f0dfc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:04.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.750+0000 7f0e1df03640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 0x7f0dfc068740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e140af000 tx=0x7f0e140a7040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:04.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.754+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e18157d60 con 0x7f0e180c63f0 2023-07-20T09:51:04.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.902+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e18157d60 con 0x7f0e180c63f0 2023-07-20T09:51:04.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.902+0000 7f0e0e7fc640 1 -- 172.21.15.82:0/354619541 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e18157d60 con 0x7f0e180c63f0 2023-07-20T09:51:04.940 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:04.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.902+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 msgr2=0x7f0dfc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.902+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 0x7f0dfc068740 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e140af000 tx=0x7f0e140a7040 comp rx=0 tx=0).stop 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 msgr2=0x7f0e18149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800e7b0 tx=0x7f0e0800ec70 comp rx=0 tx=0).stop 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 shutdown_connections 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0dfc066280 0x7f0dfc068740 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e181f4d80 0x7f0e1815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e180c63f0 0x7f0e18149bb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 --2- 172.21.15.82:0/354619541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e04003a40 0x7f0e181589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:04.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 >> 172.21.15.82:0/354619541 conn(0x7f0e180cad50 msgr2=0x7f0e18070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:04.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 shutdown_connections 2023-07-20T09:51:04.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:04.906+0000 7f0e20167640 1 -- 172.21.15.82:0/354619541 wait complete. 2023-07-20T09:51:04.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:51:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 Processor -- start 2023-07-20T09:51:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 -- start start 2023-07-20T09:51:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f76040cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040cdb40 con 0x7f760415c6e0 2023-07-20T09:51:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040d07a0 con 0x7f760415cac0 2023-07-20T09:51:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76092bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cd4f0 con 0x7f76040d3200 2023-07-20T09:51:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f7602ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f760415c6e0 0x7f76040cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36220/0 (socket says 172.21.15.82:36220) 2023-07-20T09:51:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f7602ffd640 1 -- 172.21.15.82:0/597979626 learned_addr learned my addr 172.21.15.82:0/597979626 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f76027fc640 1 --2- 172.21.15.82:0/597979626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f76040cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215670050 0 0) 0x7f76040cdb40 con 0x7f760415c6e0 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.066+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f0003530 con 0x7f760415c6e0 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536664246 0 0) 0x7f76040d07a0 con 0x7f760415cac0 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76040cdb40 con 0x7f760415cac0 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76027fc640 1 -- 172.21.15.82:0/597979626 >> v1:172.21.15.183:6789/0 conn(0x7f760415cac0 legacy=0x7f76040d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76027fc640 1 -- 172.21.15.82:0/597979626 >> v1:172.21.15.82:6789/0 conn(0x7f760415c6e0 legacy=0x7f76040cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2783003743 0 0) 0x7f75f0003530 con 0x7f760415c6e0 2023-07-20T09:51:05.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76027fc640 1 -- 172.21.15.82:0/597979626 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040cd7d0 con 0x7f76040d3200 2023-07-20T09:51:05.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76027fc640 1 --2- 172.21.15.82:0/597979626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f76040cf640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f75f40097f0 tx=0x7f75f401c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452dee76804edf50 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec001680 con 0x7f76040d3200 2023-07-20T09:51:05.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f40a7050 con 0x7f76040d3200 2023-07-20T09:51:05.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f7601ffb640 1 -- 172.21.15.82:0/597979626 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40ab600 con 0x7f76040d3200 2023-07-20T09:51:05.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76092bd640 1 -- 172.21.15.82:0/597979626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 msgr2=0x7f76040cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.070+0000 7f76092bd640 1 --2- 172.21.15.82:0/597979626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f76040cf640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f75f40097f0 tx=0x7f75f401c2c0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- 172.21.15.82:0/597979626 shutdown_connections 2023-07-20T09:51:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 --2- 172.21.15.82:0/597979626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f76040cf640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- 172.21.15.82:0/597979626 >> 172.21.15.82:0/597979626 conn(0x7f76040d2600 msgr2=0x7f76040d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- 172.21.15.82:0/597979626 shutdown_connections 2023-07-20T09:51:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- 172.21.15.82:0/597979626 wait complete. 2023-07-20T09:51:05.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 Processor -- start 2023-07-20T09:51:05.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- start start 2023-07-20T09:51:05.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f7604156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 0x7f760415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cb130 con 0x7f760415c6e0 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cb380 con 0x7f760415cac0 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76092bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040cb660 con 0x7f76040d3200 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33068/0 (socket says 172.21.15.82:33068) 2023-07-20T09:51:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 -- 172.21.15.82:0/2511154788 learned_addr learned my addr 172.21.15.82:0/2511154788 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f7602ffd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f7604156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76037fe640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 0x7f760415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 -- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 msgr2=0x7f7604156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f7604156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 -- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 msgr2=0x7f760415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 0x7f760415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 -- 172.21.15.82:0/2511154788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4009420 con 0x7f760415c6e0 2023-07-20T09:51:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76037fe640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 0x7f760415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.074+0000 7f76027fc640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f75f4019ef0 tx=0x7f75f4019060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4003ab0 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4003c10 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76040cb940 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40b5410 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76040cbf00 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76040cc0f0 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75f40b2050 con 0x7f760415c6e0 2023-07-20T09:51:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 0x7f75e4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f411dff0 con 0x7f760415c6e0 2023-07-20T09:51:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f7602ffd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 0x7f75e4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.078+0000 7f7602ffd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 0x7f75e4068740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000fe0 tx=0x7f75ec0016a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.082+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75f40eb5c0 con 0x7f760415c6e0 2023-07-20T09:51:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.226+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f760404da30 con 0x7f760415c6e0 2023-07-20T09:51:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f75fb7fe640 1 -- 172.21.15.82:0/2511154788 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75f40eebe0 con 0x7f760415c6e0 2023-07-20T09:51:05.265 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:51:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 msgr2=0x7f75e4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 0x7f75e4068740 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000fe0 tx=0x7f75ec0016a0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 msgr2=0x7f7604159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f75f4019ef0 tx=0x7f75f4019060 comp rx=0 tx=0).stop 2023-07-20T09:51:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 shutdown_connections 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f75e4066280 0x7f75e4068740 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f760415cac0 0x7f760415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f760415c6e0 0x7f7604159ad0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 --2- 172.21.15.82:0/2511154788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040d3200 0x7f7604156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 >> 172.21.15.82:0/2511154788 conn(0x7f76040d2600 msgr2=0x7f76040d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 shutdown_connections 2023-07-20T09:51:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.230+0000 7f76092bd640 1 -- 172.21.15.82:0/2511154788 wait complete. 2023-07-20T09:51:05.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:51:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 Processor -- start 2023-07-20T09:51:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 -- start start 2023-07-20T09:51:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c7c06f710 0x7f9c7c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c15a6f0 0x7f9c7c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c070030 con 0x7f9c7c0ca5a0 2023-07-20T09:51:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c15bad0 con 0x7f9c7c06f710 2023-07-20T09:51:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.390+0000 7f9c82ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c071950 con 0x7f9c7c15a6f0 2023-07-20T09:51:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c81468640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c15a6f0 0x7f9c7c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c7c06f710 0x7f9c7c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c73fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9c7c0ca5a0 0x7f9c7c15e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:51010/0 (socket says 172.21.15.82:51010) 2023-07-20T09:51:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c73fff640 1 -- 172.21.15.82:0/2548083878 learned_addr learned my addr 172.21.15.82:0/2548083878 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 -- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c15a6f0 msgr2=0x7f9c7c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 --2- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c15a6f0 0x7f9c7c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 -- 172.21.15.82:0/2548083878 >> v1:172.21.15.183:6789/0 conn(0x7f9c7c0ca5a0 legacy=0x7f9c7c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 -- 172.21.15.82:0/2548083878 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c15b230 con 0x7f9c7c06f710 2023-07-20T09:51:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.394+0000 7f9c80c67640 1 --2- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c06f710 0x7f9c7c06faf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009d90 tx=0x7f9c7801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f794f336cb6816 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c737fe640 1 -- 172.21.15.82:0/2548083878 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a59e0 con 0x7f9c7c06f710 2023-07-20T09:51:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c737fe640 1 -- 172.21.15.82:0/2548083878 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780a5b40 con 0x7f9c7c06f710 2023-07-20T09:51:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c737fe640 1 -- 172.21.15.82:0/2548083878 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780ad440 con 0x7f9c7c06f710 2023-07-20T09:51:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c06f710 msgr2=0x7f9c7c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c06f710 0x7f9c7c06faf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009d90 tx=0x7f9c7801c920 comp rx=0 tx=0).stop 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- 172.21.15.82:0/2548083878 shutdown_connections 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c15a6f0 0x7f9c7c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/2548083878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c06f710 0x7f9c7c06faf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- 172.21.15.82:0/2548083878 >> 172.21.15.82:0/2548083878 conn(0x7f9c7c0cad50 msgr2=0x7f9c7c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- 172.21.15.82:0/2548083878 shutdown_connections 2023-07-20T09:51:05.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- 172.21.15.82:0/2548083878 wait complete. 2023-07-20T09:51:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 Processor -- start 2023-07-20T09:51:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- start start 2023-07-20T09:51:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0ca5a0 0x7f9c7c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 0x7f9c7c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c13d0a0 con 0x7f9c7c06f710 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c155fc0 con 0x7f9c7c15a6f0 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.398+0000 7f9c82ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1562a0 con 0x7f9c7c0ca5a0 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33070/0 (socket says 172.21.15.82:33070) 2023-07-20T09:51:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 -- 172.21.15.82:0/225376463 learned_addr learned my addr 172.21.15.82:0/225376463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:05.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c73fff640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0ca5a0 0x7f9c7c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c81468640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 0x7f9c7c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 -- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0ca5a0 msgr2=0x7f9c7c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0ca5a0 0x7f9c7c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 -- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 msgr2=0x7f9c7c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 0x7f9c7c156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 -- 172.21.15.82:0/225376463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009a70 con 0x7f9c7c06f710 2023-07-20T09:51:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c81468640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 0x7f9c7c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c80c67640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9c7801a550 tx=0x7f9c780196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780addb0 con 0x7f9c7c06f710 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c78009450 con 0x7f9c7c06f710 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c13d360 con 0x7f9c7c06f710 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780b7630 con 0x7f9c7c06f710 2023-07-20T09:51:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c153350 con 0x7f9c7c06f710 2023-07-20T09:51:05.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c04da30 con 0x7f9c7c06f710 2023-07-20T09:51:05.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.402+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c780b4050 con 0x7f9c7c06f710 2023-07-20T09:51:05.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.406+0000 7f9c717fa640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.406+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c7811ee70 con 0x7f9c7c06f710 2023-07-20T09:51:05.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.406+0000 7f9c73fff640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.406+0000 7f9c73fff640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ad8c0 tx=0x7f9c6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.406+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c780ec300 con 0x7f9c7c06f710 2023-07-20T09:51:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.554+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c7c15c0c0 con 0x7f9c7c06f710 2023-07-20T09:51:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.554+0000 7f9c717fa640 1 -- 172.21.15.82:0/225376463 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c780b2020 con 0x7f9c7c06f710 2023-07-20T09:51:05.592 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:51:05.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 msgr2=0x7f9c68068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ad8c0 tx=0x7f9c6c009040 comp rx=0 tx=0).stop 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 msgr2=0x7f9c7c0c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9c7801a550 tx=0x7f9c780196c0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 shutdown_connections 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c15a6f0 0x7f9c7c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0ca5a0 0x7f9c7c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 --2- 172.21.15.82:0/225376463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c06f710 0x7f9c7c0c40f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 >> 172.21.15.82:0/225376463 conn(0x7f9c7c0cad50 msgr2=0x7f9c7c159830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 shutdown_connections 2023-07-20T09:51:05.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.558+0000 7f9c82ecb640 1 -- 172.21.15.82:0/225376463 wait complete. 2023-07-20T09:51:05.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T09:51:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.714+0000 7f10d9dfa640 1 Processor -- start 2023-07-20T09:51:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.714+0000 7f10d9dfa640 1 -- start start 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d9dfa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f10d415dbb0 0x7f10d40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d9dfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40ad810 con 0x7f10d41596b0 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d9dfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d415d0d0 con 0x7f10d40b2a90 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d9dfa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d415e000 con 0x7f10d415dbb0 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f10d41596b0 0x7f10d40b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36222/0 (socket says 172.21.15.82:36222) 2023-07-20T09:51:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d37fe640 1 -- 172.21.15.82:0/1716595322 learned_addr learned my addr 172.21.15.82:0/1716595322 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:05.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d3fff640 1 --2- 172.21.15.82:0/1716595322 >> v2:172.21.15.183:3300/0 conn(0x7f10d415dbb0 0x7f10d40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189999000 0 0) 0x7f10d40ad810 con 0x7f10d41596b0 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c0003530 con 0x7f10d41596b0 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210470070 0 0) 0x7f10d415d0d0 con 0x7f10d40b2a90 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d40ad810 con 0x7f10d40b2a90 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d3fff640 1 -- 172.21.15.82:0/1716595322 >> v1:172.21.15.183:6789/0 conn(0x7f10d40b2a90 legacy=0x7f10d40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d3fff640 1 -- 172.21.15.82:0/1716595322 >> v1:172.21.15.82:6789/0 conn(0x7f10d41596b0 legacy=0x7f10d40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.718+0000 7f10d3fff640 1 -- 172.21.15.82:0/1716595322 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d415d3b0 con 0x7f10d415dbb0 2023-07-20T09:51:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d3fff640 1 --2- 172.21.15.82:0/1716595322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d40cc900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097f0 tx=0x7f10cc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a794c211919f68 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0ab5f0 con 0x7f10d415dbb0 2023-07-20T09:51:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc0ab750 con 0x7f10d415dbb0 2023-07-20T09:51:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d2ffd640 1 -- 172.21.15.82:0/1716595322 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0abae0 con 0x7f10d415dbb0 2023-07-20T09:51:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- 172.21.15.82:0/1716595322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 msgr2=0x7f10d40cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/1716595322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d40cc900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10cc0097f0 tx=0x7f10cc01c450 comp rx=0 tx=0).stop 2023-07-20T09:51:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- 172.21.15.82:0/1716595322 shutdown_connections 2023-07-20T09:51:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/1716595322 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d40cc900 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- 172.21.15.82:0/1716595322 >> 172.21.15.82:0/1716595322 conn(0x7f10d40cada0 msgr2=0x7f10d40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- 172.21.15.82:0/1716595322 shutdown_connections 2023-07-20T09:51:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- 172.21.15.82:0/1716595322 wait complete. 2023-07-20T09:51:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 Processor -- start 2023-07-20T09:51:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.722+0000 7f10d9dfa640 1 -- start start 2023-07-20T09:51:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d41596b0 0x7f10d41548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d4154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40cce40 con 0x7f10d40b2a90 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d41f9320 con 0x7f10d415dbb0 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d406f780 con 0x7f10d41596b0 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33086/0 (socket says 172.21.15.82:33086) 2023-07-20T09:51:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 -- 172.21.15.82:0/2247638566 learned_addr learned my addr 172.21.15.82:0/2247638566 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 -- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d41596b0 msgr2=0x7f10d41548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d41596b0 0x7f10d41548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 -- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 msgr2=0x7f10d4154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d4154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 -- 172.21.15.82:0/2247638566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009420 con 0x7f10d40b2a90 2023-07-20T09:51:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d37fe640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c520 tx=0x7f10c400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4005cf0 con 0x7f10d40b2a90 2023-07-20T09:51:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4005e50 con 0x7f10d40b2a90 2023-07-20T09:51:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4007270 con 0x7f10d40b2a90 2023-07-20T09:51:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d41f8450 con 0x7f10d40b2a90 2023-07-20T09:51:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d41f8980 con 0x7f10d40b2a90 2023-07-20T09:51:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d40c2a80 con 0x7f10d40b2a90 2023-07-20T09:51:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.726+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10c40073d0 con 0x7f10d40b2a90 2023-07-20T09:51:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.730+0000 7f10d0ff9640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 0x7f10b4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.730+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10c40832d0 con 0x7f10d40b2a90 2023-07-20T09:51:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.730+0000 7f10caffd640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 0x7f10b4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.730+0000 7f10caffd640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 0x7f10b4068740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007fd0 tx=0x7f10bc007ce0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.734+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10c40541f0 con 0x7f10d40b2a90 2023-07-20T09:51:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.894+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10d4073c70 con 0x7f10d40b2a90 2023-07-20T09:51:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d0ff9640 1 -- 172.21.15.82:0/2247638566 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f10c4053d80 con 0x7f10d40b2a90 2023-07-20T09:51:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-07-20T09:51:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 msgr2=0x7f10b4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 0x7f10b4068740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10bc007fd0 tx=0x7f10bc007ce0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 msgr2=0x7f10d4157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f10c400c520 tx=0x7f10c400c9e0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 shutdown_connections 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f10b4066280 0x7f10b4068740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10d415dbb0 0x7f10d4154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10d41596b0 0x7f10d41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 --2- 172.21.15.82:0/2247638566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10d40b2a90 0x7f10d4157840 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 >> 172.21.15.82:0/2247638566 conn(0x7f10d40cada0 msgr2=0x7f10d40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:05.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 shutdown_connections 2023-07-20T09:51:05.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:05.898+0000 7f10d9dfa640 1 -- 172.21.15.82:0/2247638566 wait complete. 2023-07-20T09:51:05.954 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-20T09:51:05.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:05.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-20T09:51:06.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T09:51:06.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:06.006 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-20T09:51:06.015 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:06.016 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:06.026 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:06.027 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:06.076 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T09:51:06.076 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:06.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 Processor -- start 2023-07-20T09:51:06.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 -- start start 2023-07-20T09:51:06.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9aa015cab0 0x7f9aa00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa00d0d10 0x7f9aa00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00d16b0 con 0x7f9aa00cf110 2023-07-20T09:51:06.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa00d31c0 con 0x7f9aa015cab0 2023-07-20T09:51:06.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9aa5207640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00b3520 con 0x7f9aa00d0d10 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9ed9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9aa015cab0 0x7f9aa00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9f59e640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9aa00cf110 0x7f9aa00cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:51022/0 (socket says 172.21.15.82:51022) 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9e59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa00d0d10 0x7f9aa00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9f59e640 1 -- 172.21.15.82:0/3523368825 learned_addr learned my addr 172.21.15.82:0/3523368825 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa00d0d10 msgr2=0x7f9aa00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9ed9d640 1 --2- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa00d0d10 0x7f9aa00d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/3523368825 >> v1:172.21.15.183:6789/0 conn(0x7f9aa00cf110 legacy=0x7f9aa00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.230+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/3523368825 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00b2910 con 0x7f9aa015cab0 2023-07-20T09:51:06.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9a9ed9d640 1 --2- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa015cab0 0x7f9aa00d0300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009d90 tx=0x7f9a9001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=197e1735e453b369 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9a9dd9b640 1 -- 172.21.15.82:0/3523368825 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900a59e0 con 0x7f9aa015cab0 2023-07-20T09:51:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9a9dd9b640 1 -- 172.21.15.82:0/3523368825 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a900a5b40 con 0x7f9aa015cab0 2023-07-20T09:51:06.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9a9dd9b640 1 -- 172.21.15.82:0/3523368825 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900ad440 con 0x7f9aa015cab0 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 -- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa015cab0 msgr2=0x7f9aa00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 --2- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa015cab0 0x7f9aa00d0300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009d90 tx=0x7f9a9001c920 comp rx=0 tx=0).stop 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 -- 172.21.15.82:0/3523368825 shutdown_connections 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 --2- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa00d0d10 0x7f9aa00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 --2- 172.21.15.82:0/3523368825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa015cab0 0x7f9aa00d0300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 -- 172.21.15.82:0/3523368825 >> 172.21.15.82:0/3523368825 conn(0x7f9aa008c120 msgr2=0x7f9aa009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:06.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 -- 172.21.15.82:0/3523368825 shutdown_connections 2023-07-20T09:51:06.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.234+0000 7f9aa5207640 1 -- 172.21.15.82:0/3523368825 wait complete. 2023-07-20T09:51:06.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 Processor -- start 2023-07-20T09:51:06.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 -- start start 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa00d0d10 0x7f9aa0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa015cab0 0x7f9aa0152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01542f0 con 0x7f9aa00cf110 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01545d0 con 0x7f9aa00d0d10 2023-07-20T09:51:06.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9aa5207640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01548b0 con 0x7f9aa015cab0 2023-07-20T09:51:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33094/0 (socket says 172.21.15.82:33094) 2023-07-20T09:51:06.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/4159296554 learned_addr learned my addr 172.21.15.82:0/4159296554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:06.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9e59c640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa00d0d10 0x7f9aa0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9f59e640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa015cab0 0x7f9aa0152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa015cab0 msgr2=0x7f9aa0152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa015cab0 0x7f9aa0152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa00d0d10 msgr2=0x7f9aa0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa00d0d10 0x7f9aa0155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 -- 172.21.15.82:0/4159296554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009a70 con 0x7f9aa00cf110 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.238+0000 7f9a9ed9d640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a9001a550 tx=0x7f9a900196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900adb10 con 0x7f9aa00cf110 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a900adc70 con 0x7f9aa00cf110 2023-07-20T09:51:06.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900b8420 con 0x7f9aa00cf110 2023-07-20T09:51:06.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0154b90 con 0x7f9aa00cf110 2023-07-20T09:51:06.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00b1750 con 0x7f9aa00cf110 2023-07-20T09:51:06.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa0073c70 con 0x7f9aa00cf110 2023-07-20T09:51:06.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a900b8580 con 0x7f9aa00cf110 2023-07-20T09:51:06.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 0x7f9a8c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.242+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a9011f560 con 0x7f9aa00cf110 2023-07-20T09:51:06.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.246+0000 7f9a9e59c640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 0x7f9a8c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.246+0000 7f9a9e59c640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 0x7f9a8c068740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006bb70 tx=0x7f9a94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.246+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a900ec9e0 con 0x7f9aa00cf110 2023-07-20T09:51:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.398+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9aa00cf6d0 con 0x7f9aa00cf110 2023-07-20T09:51:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9a877fe640 1 -- 172.21.15.82:0/4159296554 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18255 (secure 0 0 0) 0x7f9a900f0000 con 0x7f9aa00cf110 2023-07-20T09:51:06.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:06.437 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":23,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:50:28.665542+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 msgr2=0x7f9a8c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 0x7f9a8c068740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9aa006bb70 tx=0x7f9a94008040 comp rx=0 tx=0).stop 2023-07-20T09:51:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 msgr2=0x7f9aa00b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a9001a550 tx=0x7f9a900196c0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 shutdown_connections 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9a8c066280 0x7f9a8c068740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa015cab0 0x7f9aa0152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa00d0d10 0x7f9aa0155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 --2- 172.21.15.82:0/4159296554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa00cf110 0x7f9aa00b1210 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 >> 172.21.15.82:0/4159296554 conn(0x7f9aa008c120 msgr2=0x7f9aa006c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:06.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 shutdown_connections 2023-07-20T09:51:06.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.402+0000 7f9aa5207640 1 -- 172.21.15.82:0/4159296554 wait complete. 2023-07-20T09:51:06.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:51:06.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:51:06.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 Processor -- start 2023-07-20T09:51:06.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 -- start start 2023-07-20T09:51:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e380cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0e380d3200 0x7f0e380cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e380cdb40 con 0x7f0e3815cac0 2023-07-20T09:51:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e380d07a0 con 0x7f0e380d3200 2023-07-20T09:51:06.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3ed67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cd4f0 con 0x7f0e3815c6e0 2023-07-20T09:51:06.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3d304640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0e3815cac0 0x7f0e380d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36234/0 (socket says 172.21.15.82:36234) 2023-07-20T09:51:06.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3d304640 1 -- 172.21.15.82:0/4286251336 learned_addr learned my addr 172.21.15.82:0/4286251336 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:06.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e380cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2ffff640 1 --2- 172.21.15.82:0/4286251336 >> v2:172.21.15.183:3300/0 conn(0x7f0e380d3200 0x7f0e380cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222956464 0 0) 0x7f0e380cdb40 con 0x7f0e3815cac0 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e20003530 con 0x7f0e3815cac0 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2194145788 0 0) 0x7f0e20003530 con 0x7f0e3815cac0 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 msgr2=0x7f0e380cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e380cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 >> v2:172.21.15.183:3300/0 conn(0x7f0e380d3200 msgr2=0x7f0e380cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 --2- 172.21.15.82:0/4286251336 >> v2:172.21.15.183:3300/0 conn(0x7f0e380d3200 0x7f0e380cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380cd7d0 con 0x7f0e3815cac0 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f0e30001a00 con 0x7f0e3815cac0 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.566+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 >> v1:172.21.15.82:6789/0 conn(0x7f0e3815cac0 legacy=0x7f0e380d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e200039f0 0x7f0e20003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e20004d10 0x7f0e20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380d07a0 con 0x7f0e200039f0 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380cd4f0 con 0x7f0e20004d10 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2000baf0 con 0x7f0e3815c6e0 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e200039f0 0x7f0e20003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3d304640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e20004d10 0x7f0e20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2ffff640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 -- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 msgr2=0x7f0e200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e3815c6e0 0x7f0e200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 -- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e20004d10 msgr2=0x7f0e20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e20004d10 0x7f0e20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 -- 172.21.15.82:0/4286251336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20003530 con 0x7f0e200039f0 2023-07-20T09:51:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3d304640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e20004d10 0x7f0e20005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:06.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e200039f0 0x7f0e20003e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009ae0 tx=0x7f0e3401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9954c8e8b58ded6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340a5650 con 0x7f0e200039f0 2023-07-20T09:51:06.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e340a57b0 con 0x7f0e200039f0 2023-07-20T09:51:06.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.570+0000 7f0e2f7fe640 1 -- 172.21.15.82:0/4286251336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e340a5b60 con 0x7f0e200039f0 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- 172.21.15.82:0/4286251336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e200039f0 msgr2=0x7f0e20003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/4286251336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e200039f0 0x7f0e20003e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009ae0 tx=0x7f0e3401ca00 comp rx=0 tx=0).stop 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3d304640 1 -- 172.21.15.82:0/4286251336 reap_dead start 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- 172.21.15.82:0/4286251336 shutdown_connections 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- 172.21.15.82:0/4286251336 >> 172.21.15.82:0/4286251336 conn(0x7f0e380d2600 msgr2=0x7f0e380d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- 172.21.15.82:0/4286251336 shutdown_connections 2023-07-20T09:51:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- 172.21.15.82:0/4286251336 wait complete. 2023-07-20T09:51:06.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 Processor -- start 2023-07-20T09:51:06.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- start start 2023-07-20T09:51:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e200039f0 0x7f0e381f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 0x7f0e380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e381e9830 con 0x7f0e381e93b0 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e381f8b40 con 0x7f0e381e8490 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3ed67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e380b4420 con 0x7f0e200039f0 2023-07-20T09:51:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e2ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33110/0 (socket says 172.21.15.82:33110) 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e2ffff640 1 -- 172.21.15.82:0/983406574 learned_addr learned my addr 172.21.15.82:0/983406574 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e200039f0 0x7f0e381f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.574+0000 7f0e3d304640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 0x7f0e380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 -- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e200039f0 msgr2=0x7f0e381f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e200039f0 0x7f0e381f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 -- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 msgr2=0x7f0e380b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 0x7f0e380b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 -- 172.21.15.82:0/983406574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e380c7840 con 0x7f0e381e93b0 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e3d304640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 0x7f0e380b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2ffff640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e280116c0 tx=0x7f0e28011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800f9c0 con 0x7f0e381e93b0 2023-07-20T09:51:06.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800fb20 con 0x7f0e381e93b0 2023-07-20T09:51:06.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e381f4bc0 con 0x7f0e381e93b0 2023-07-20T09:51:06.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2800fe90 con 0x7f0e381e93b0 2023-07-20T09:51:06.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e381f5180 con 0x7f0e381e93b0 2023-07-20T09:51:06.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e380c79d0 con 0x7f0e381e93b0 2023-07-20T09:51:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0e28015460 con 0x7f0e381e93b0 2023-07-20T09:51:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 0x7f0e24068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.578+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0e280845d0 con 0x7f0e381e93b0 2023-07-20T09:51:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.582+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 0x7f0e24068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.582+0000 7f0e3cb03640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 0x7f0e24068770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e340af000 tx=0x7f0e340046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.586+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e280519b0 con 0x7f0e381e93b0 2023-07-20T09:51:06.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.734+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e3804da30 con 0x7f0e381e93b0 2023-07-20T09:51:06.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.734+0000 7f0e2d7fa640 1 -- 172.21.15.82:0/983406574 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e28054fd0 con 0x7f0e381e93b0 2023-07-20T09:51:06.773 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:51:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 msgr2=0x7f0e24068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 0x7f0e24068770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e340af000 tx=0x7f0e340046d0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 msgr2=0x7f0e381f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e280116c0 tx=0x7f0e28011b80 comp rx=0 tx=0).stop 2023-07-20T09:51:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 shutdown_connections 2023-07-20T09:51:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f0e240662b0 0x7f0e24068770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e381e8490 0x7f0e380b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e381e93b0 0x7f0e381f8600 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 --2- 172.21.15.82:0/983406574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e200039f0 0x7f0e381f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 >> 172.21.15.82:0/983406574 conn(0x7f0e380d2600 msgr2=0x7f0e380af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 shutdown_connections 2023-07-20T09:51:06.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.738+0000 7f0e3ed67640 1 -- 172.21.15.82:0/983406574 wait complete. 2023-07-20T09:51:06.796 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 Processor -- start 2023-07-20T09:51:06.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 -- start start 2023-07-20T09:51:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59c40ae060 0x7f59c406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c4160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c40ae440 con 0x7f59c4160db0 2023-07-20T09:51:06.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c406ce50 con 0x7f59c40ae060 2023-07-20T09:51:06.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.902+0000 7f59ca86d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c415cac0 con 0x7f59c4070ce0 2023-07-20T09:51:06.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59c40ae060 0x7f59c406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c4160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f59c40ae060 0x7f59c406bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:42258/0 (socket says 172.21.15.82:42258) 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c4160870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:54788/0 (socket says 172.21.15.82:54788) 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 -- 172.21.15.82:0/3775328452 learned_addr learned my addr 172.21.15.82:0/3775328452 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c8e0a640 1 --1- 172.21.15.82:0/3775328452 >> v1:172.21.15.183:6789/0 conn(0x7f59c4160db0 0x7f59c40c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:51032/0 (socket says 172.21.15.82:51032) 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 -- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 msgr2=0x7f59c4160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 --2- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c4160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 -- 172.21.15.82:0/3775328452 >> v1:172.21.15.183:6789/0 conn(0x7f59c4160db0 legacy=0x7f59c40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 -- 172.21.15.82:0/3775328452 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c406c5b0 con 0x7f59c40ae060 2023-07-20T09:51:06.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c3fff640 1 --2- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c40ae060 0x7f59c406bf20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009870 tx=0x7f59b401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88818e01c121b27 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c37fe640 1 -- 172.21.15.82:0/3775328452 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a95f0 con 0x7f59c40ae060 2023-07-20T09:51:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c37fe640 1 -- 172.21.15.82:0/3775328452 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a9750 con 0x7f59c40ae060 2023-07-20T09:51:06.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.906+0000 7f59c37fe640 1 -- 172.21.15.82:0/3775328452 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a9ae0 con 0x7f59c40ae060 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c40ae060 msgr2=0x7f59c406bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c40ae060 0x7f59c406bf20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009870 tx=0x7f59b401c510 comp rx=0 tx=0).stop 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- 172.21.15.82:0/3775328452 shutdown_connections 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c4160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- 172.21.15.82:0/3775328452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c40ae060 0x7f59c406bf20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- 172.21.15.82:0/3775328452 >> 172.21.15.82:0/3775328452 conn(0x7f59c40cf070 msgr2=0x7f59c40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:06.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- 172.21.15.82:0/3775328452 shutdown_connections 2023-07-20T09:51:06.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- 172.21.15.82:0/3775328452 wait complete. 2023-07-20T09:51:06.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 Processor -- start 2023-07-20T09:51:06.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- start start 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 0x7f59c40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40c6380 con 0x7f59c40ae060 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4155890 con 0x7f59c4160db0 2023-07-20T09:51:06.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59ca86d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4155000 con 0x7f59c4070ce0 2023-07-20T09:51:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33118/0 (socket says 172.21.15.82:33118) 2023-07-20T09:51:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.910+0000 7f59bbfff640 1 -- 172.21.15.82:0/2356432944 learned_addr learned my addr 172.21.15.82:0/2356432944 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 -- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 msgr2=0x7f59c40c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c40c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 -- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 msgr2=0x7f59c40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c8e0a640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 0x7f59c40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 0x7f59c40c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:06.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 -- 172.21.15.82:0/2356432944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40094d0 con 0x7f59c40ae060 2023-07-20T09:51:06.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c8e0a640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 0x7f59c40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:06.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59bbfff640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e930 tx=0x7f59ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac009690 con 0x7f59c40ae060 2023-07-20T09:51:06.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00ca00 con 0x7f59c40ae060 2023-07-20T09:51:06.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c40c7800 con 0x7f59c40ae060 2023-07-20T09:51:06.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00cd70 con 0x7f59c40ae060 2023-07-20T09:51:06.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40c5fa0 con 0x7f59c40ae060 2023-07-20T09:51:06.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c404da30 con 0x7f59c40ae060 2023-07-20T09:51:06.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59ac013470 con 0x7f59c40ae060 2023-07-20T09:51:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 0x7f59a4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f59ac084140 con 0x7f59c40ae060 2023-07-20T09:51:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.914+0000 7f59c3fff640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 0x7f59a4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:06.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.918+0000 7f59c3fff640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 0x7f59a4068740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ae000 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:06.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:06.918+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59ac051520 con 0x7f59c40ae060 2023-07-20T09:51:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.066+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59c40af230 con 0x7f59c40ae060 2023-07-20T09:51:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59c17fa640 1 -- 172.21.15.82:0/2356432944 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59ac054b40 con 0x7f59c40ae060 2023-07-20T09:51:07.106 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 msgr2=0x7f59a4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 0x7f59a4068740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ae000 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2023-07-20T09:51:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 msgr2=0x7f59c40c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e930 tx=0x7f59ac00edf0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 shutdown_connections 2023-07-20T09:51:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f59a4066280 0x7f59a4068740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59c4160db0 0x7f59c40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59c40ae060 0x7f59c40c67a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 --2- 172.21.15.82:0/2356432944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59c4070ce0 0x7f59c40c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 >> 172.21.15.82:0/2356432944 conn(0x7f59c40cf070 msgr2=0x7f59c415bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 shutdown_connections 2023-07-20T09:51:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.070+0000 7f59ca86d640 1 -- 172.21.15.82:0/2356432944 wait complete. 2023-07-20T09:51:07.126 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:51:07.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 Processor -- start 2023-07-20T09:51:07.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 -- start start 2023-07-20T09:51:07.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f216c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0c95d0 con 0x7f216c06bd30 2023-07-20T09:51:07.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0c9fa0 con 0x7f216c070970 2023-07-20T09:51:07.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2172700640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1590c0 con 0x7f216c158ce0 2023-07-20T09:51:07.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2170c9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f216c06bd30 0x7f216c0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36238/0 (socket says 172.21.15.82:36238) 2023-07-20T09:51:07.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.230+0000 7f2170c9d640 1 -- 172.21.15.82:0/886798702 learned_addr learned my addr 172.21.15.82:0/886798702 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:07.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f216c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189521756 0 0) 0x7f216c0c95d0 con 0x7f216c06bd30 2023-07-20T09:51:07.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2154003530 con 0x7f216c06bd30 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 493527841 0 0) 0x7f2154003530 con 0x7f216c06bd30 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 msgr2=0x7f216c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f216c0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 >> v1:172.21.15.183:6789/0 conn(0x7f216c070970 legacy=0x7f216c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0c89c0 con 0x7f216c06bd30 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2164001a00 con 0x7f216c06bd30 2023-07-20T09:51:07.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 >> v1:172.21.15.82:6789/0 conn(0x7f216c06bd30 legacy=0x7f216c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f2154003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21540047d0 0x7f2154004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f2154005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1590c0 con 0x7f2154003a20 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215400dca0 con 0x7f21540047d0 2023-07-20T09:51:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215400de60 con 0x7f216c158ce0 2023-07-20T09:51:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f2154003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f2170c9d640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f2154005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216b7fe640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21540047d0 0x7f2154004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 -- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 msgr2=0x7f2154005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f2154005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 -- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21540047d0 msgr2=0x7f2154004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21540047d0 0x7f2154004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216bfff640 1 -- 172.21.15.82:0/886798702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154003530 con 0x7f2154003a20 2023-07-20T09:51:07.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f216b7fe640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21540047d0 0x7f2154004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:07.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.234+0000 7f2170c9d640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c158ce0 0x7f2154005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:07.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f216bfff640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f2154003e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f215c00aa60 tx=0x7f215c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377eaa14dba6a54b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0a5a30 con 0x7f2154003a20 2023-07-20T09:51:07.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c0a5b90 con 0x7f2154003a20 2023-07-20T09:51:07.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f216affd640 1 -- 172.21.15.82:0/886798702 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0ad440 con 0x7f2154003a20 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- 172.21.15.82:0/886798702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 msgr2=0x7f2154003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 --2- 172.21.15.82:0/886798702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f2154003e40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f215c00aa60 tx=0x7f215c01cbe0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2170c9d640 1 -- 172.21.15.82:0/886798702 reap_dead start 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- 172.21.15.82:0/886798702 shutdown_connections 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- 172.21.15.82:0/886798702 >> 172.21.15.82:0/886798702 conn(0x7f216c0cad50 msgr2=0x7f216c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- 172.21.15.82:0/886798702 shutdown_connections 2023-07-20T09:51:07.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- 172.21.15.82:0/886798702 wait complete. 2023-07-20T09:51:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 Processor -- start 2023-07-20T09:51:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.238+0000 7f2172700640 1 -- start start 2023-07-20T09:51:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 0x7f216c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f216c0c20b0 0x7f216c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c3270 con 0x7f2154003a20 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c14b8b0 con 0x7f216c0c20b0 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0c25f0 con 0x7f216c0c1c30 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33140/0 (socket says 172.21.15.82:33140) 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 -- 172.21.15.82:0/1364057387 learned_addr learned my addr 172.21.15.82:0/1364057387 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2170c9d640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f216c0c20b0 0x7f216c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216b7fe640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 0x7f216c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 -- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 msgr2=0x7f216c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 0x7f216c0c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 -- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f216c0c20b0 msgr2=0x7f216c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f216c0c20b0 0x7f216c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 -- 172.21.15.82:0/1364057387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0c28d0 con 0x7f2154003a20 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216b7fe640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 0x7f216c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:07.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f216bfff640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f215c00aa60 tx=0x7f2154005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0ad9c0 con 0x7f2154003a20 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c0adb20 con 0x7f2154003a20 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0ade90 con 0x7f2154003a20 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0c2bb0 con 0x7f2154003a20 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c14bbd0 con 0x7f2154003a20 2023-07-20T09:51:07.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c04da30 con 0x7f2154003a20 2023-07-20T09:51:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.242+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f215c0b4040 con 0x7f2154003a20 2023-07-20T09:51:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.246+0000 7f2168ff9640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 0x7f2158068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.246+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f215c11e4f0 con 0x7f2154003a20 2023-07-20T09:51:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.246+0000 7f216b7fe640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 0x7f2158068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.246+0000 7f216b7fe640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 0x7f2158068740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f216c0cd480 tx=0x7f2160009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.250+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f215c0ebaf0 con 0x7f2154003a20 2023-07-20T09:51:07.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.394+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f216c0b4250 con 0x7f2154003a20 2023-07-20T09:51:07.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.394+0000 7f2168ff9640 1 -- 172.21.15.82:0/1364057387 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f215c00b040 con 0x7f2154003a20 2023-07-20T09:51:07.432 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:51:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 msgr2=0x7f2158068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 0x7f2158068740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f216c0cd480 tx=0x7f2160009040 comp rx=0 tx=0).stop 2023-07-20T09:51:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 msgr2=0x7f216c14b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f215c00aa60 tx=0x7f2154005800 comp rx=0 tx=0).stop 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 shutdown_connections 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2158066280 0x7f2158068740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f216c0c20b0 0x7f216c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f216c0c1c30 0x7f216c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 --2- 172.21.15.82:0/1364057387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2154003a20 0x7f216c14b370 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 >> 172.21.15.82:0/1364057387 conn(0x7f216c0cad50 msgr2=0x7f216c153370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 shutdown_connections 2023-07-20T09:51:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.398+0000 7f2172700640 1 -- 172.21.15.82:0/1364057387 wait complete. 2023-07-20T09:51:07.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:51:07.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 Processor -- start 2023-07-20T09:51:07.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 -- start start 2023-07-20T09:51:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e58159450 0x7f4e5815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e580afd50 0x7f4e580b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e580b06b0 con 0x7f4e58159830 2023-07-20T09:51:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580cce90 con 0x7f4e580afd50 2023-07-20T09:51:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5cc6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580cc8d0 con 0x7f4e58159450 2023-07-20T09:51:07.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e580afd50 0x7f4e580b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e580afd50 0x7f4e580b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33142/0 (socket says 172.21.15.82:33142) 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 -- 172.21.15.82:0/4150758346 learned_addr learned my addr 172.21.15.82:0/4150758346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e5659c640 1 --2- 172.21.15.82:0/4150758346 >> v2:172.21.15.183:3300/0 conn(0x7f4e58159450 0x7f4e5815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 -- 172.21.15.82:0/4150758346 >> v2:172.21.15.183:3300/0 conn(0x7f4e58159450 msgr2=0x7f4e5815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 --2- 172.21.15.82:0/4150758346 >> v2:172.21.15.183:3300/0 conn(0x7f4e58159450 0x7f4e5815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 -- 172.21.15.82:0/4150758346 >> v1:172.21.15.183:6789/0 conn(0x7f4e58159830 legacy=0x7f4e580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.558+0000 7f4e56d9d640 1 -- 172.21.15.82:0/4150758346 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580ccbb0 con 0x7f4e580afd50 2023-07-20T09:51:07.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e56d9d640 1 --2- 172.21.15.82:0/4150758346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e580b0170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806a6c0 tx=0x7f4e5001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589615986870a90c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e55d9b640 1 -- 172.21.15.82:0/4150758346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500a7c70 con 0x7f4e580afd50 2023-07-20T09:51:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e55d9b640 1 -- 172.21.15.82:0/4150758346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500a7dd0 con 0x7f4e580afd50 2023-07-20T09:51:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e55d9b640 1 -- 172.21.15.82:0/4150758346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500af660 con 0x7f4e580afd50 2023-07-20T09:51:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/4150758346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 msgr2=0x7f4e580b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/4150758346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e580b0170 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806a6c0 tx=0x7f4e5001eba0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/4150758346 shutdown_connections 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/4150758346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e580b0170 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/4150758346 >> v2:172.21.15.183:3300/0 conn(0x7f4e58159450 0x7f4e5815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/4150758346 >> 172.21.15.82:0/4150758346 conn(0x7f4e580cad50 msgr2=0x7f4e580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/4150758346 shutdown_connections 2023-07-20T09:51:07.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.562+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/4150758346 wait complete. 2023-07-20T09:51:07.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 Processor -- start 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- start start 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 0x7f4e5814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 0x7f4e580c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e58150580 con 0x7f4e580afd50 2023-07-20T09:51:07.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580c6340 con 0x7f4e581500f0 2023-07-20T09:51:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580c6620 con 0x7f4e58159450 2023-07-20T09:51:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33156/0 (socket says 172.21.15.82:33156) 2023-07-20T09:51:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 -- 172.21.15.82:0/2777486757 learned_addr learned my addr 172.21.15.82:0/2777486757 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:07.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e56d9d640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 0x7f4e580c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 -- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 msgr2=0x7f4e5814fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e4dd9b640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 0x7f4e5814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 0x7f4e5814fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 -- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 msgr2=0x7f4e580c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 0x7f4e580c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 -- 172.21.15.82:0/2777486757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5000b770 con 0x7f4e580afd50 2023-07-20T09:51:07.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e56d9d640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 0x7f4e580c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e4dd9b640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 0x7f4e5814fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5659c640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e930 tx=0x7f4e4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48009690 con 0x7f4e580afd50 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4800ca00 con 0x7f4e580afd50 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e580c6900 con 0x7f4e580afd50 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800cd70 con 0x7f4e580afd50 2023-07-20T09:51:07.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.566+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e580c6ec0 con 0x7f4e580afd50 2023-07-20T09:51:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5804da30 con 0x7f4e580afd50 2023-07-20T09:51:07.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e48013470 con 0x7f4e580afd50 2023-07-20T09:51:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e4f7fe640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 0x7f4e38068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4e48084060 con 0x7f4e580afd50 2023-07-20T09:51:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e4dd9b640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 0x7f4e38068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.570+0000 7f4e4dd9b640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 0x7f4e38068740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e58071020 tx=0x7f4e40007ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.574+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e480b4700 con 0x7f4e580afd50 2023-07-20T09:51:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e5815a9d0 con 0x7f4e580afd50 2023-07-20T09:51:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e4f7fe640 1 -- 172.21.15.82:0/2777486757 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e480170a0 con 0x7f4e580afd50 2023-07-20T09:51:07.770 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:51:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 msgr2=0x7f4e38068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 0x7f4e38068740 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e58071020 tx=0x7f4e40007ed0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 msgr2=0x7f4e5813c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e930 tx=0x7f4e4800edf0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 shutdown_connections 2023-07-20T09:51:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4e38066280 0x7f4e38068740 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e581500f0 0x7f4e580c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e58159450 0x7f4e5814fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 --2- 172.21.15.82:0/2777486757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e580afd50 0x7f4e5813c4a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 >> 172.21.15.82:0/2777486757 conn(0x7f4e580cad50 msgr2=0x7f4e581546b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 shutdown_connections 2023-07-20T09:51:07.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.734+0000 7f4e5cc6a640 1 -- 172.21.15.82:0/2777486757 wait complete. 2023-07-20T09:51:07.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T09:51:07.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 Processor -- start 2023-07-20T09:51:07.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 -- start start 2023-07-20T09:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f232015d060 0x7f232006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200c86d0 0x7f23200ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015d440 0x7f2320070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200cd2a0 con 0x7f23200c86d0 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200ca6f0 con 0x7f232015d060 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f232740b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2320070660 con 0x7f232015d440 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200c86d0 0x7f23200ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200c86d0 0x7f23200ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33162/0 (socket says 172.21.15.82:33162) 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 -- 172.21.15.82:0/2052183288 learned_addr learned my addr 172.21.15.82:0/2052183288 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 -- 172.21.15.82:0/2052183288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015d440 msgr2=0x7f2320070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 --2- 172.21.15.82:0/2052183288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015d440 0x7f2320070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 -- 172.21.15.82:0/2052183288 >> v2:172.21.15.183:3300/0 conn(0x7f232015d060 msgr2=0x7f232006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 --2- 172.21.15.82:0/2052183288 >> v2:172.21.15.183:3300/0 conn(0x7f232015d060 0x7f232006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.894+0000 7f2325c08640 1 -- 172.21.15.82:0/2052183288 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200cd490 con 0x7f23200c86d0 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f2325c08640 1 --2- 172.21.15.82:0/2052183288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200c86d0 0x7f23200ccd60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2320071f00 tx=0x7f231001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a617a07e19f795fb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f2325407640 1 -- 172.21.15.82:0/2052183288 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100a7c30 con 0x7f23200c86d0 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f2325407640 1 -- 172.21.15.82:0/2052183288 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23100a7d90 con 0x7f23200c86d0 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f2325407640 1 -- 172.21.15.82:0/2052183288 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23100af660 con 0x7f23200c86d0 2023-07-20T09:51:07.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 -- 172.21.15.82:0/2052183288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200c86d0 msgr2=0x7f23200ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 --2- 172.21.15.82:0/2052183288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200c86d0 0x7f23200ccd60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2320071f00 tx=0x7f231001eba0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 -- 172.21.15.82:0/2052183288 shutdown_connections 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 --2- 172.21.15.82:0/2052183288 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015d440 0x7f2320070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 --2- 172.21.15.82:0/2052183288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200c86d0 0x7f23200ccd60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 --2- 172.21.15.82:0/2052183288 >> v2:172.21.15.183:3300/0 conn(0x7f232015d060 0x7f232006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 -- 172.21.15.82:0/2052183288 >> 172.21.15.82:0/2052183288 conn(0x7f23200ce080 msgr2=0x7f23200ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:07.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 -- 172.21.15.82:0/2052183288 shutdown_connections 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.898+0000 7f232740b640 1 -- 172.21.15.82:0/2052183288 wait complete. 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 Processor -- start 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- start start 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200c86d0 0x7f232014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015d060 0x7f232014f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200aefd0 con 0x7f232015d440 2023-07-20T09:51:07.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200aea10 con 0x7f232015d060 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200aecf0 con 0x7f23200c86d0 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33168/0 (socket says 172.21.15.82:33168) 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 -- 172.21.15.82:0/2193207929 learned_addr learned my addr 172.21.15.82:0/2193207929 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2325c08640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015d060 0x7f232014f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326409640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200c86d0 0x7f232014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 -- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200c86d0 msgr2=0x7f232014f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200c86d0 0x7f232014f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 -- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015d060 msgr2=0x7f232014f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015d060 0x7f232014f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 -- 172.21.15.82:0/2193207929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231000b770 con 0x7f232015d440 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2326c0a640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f231800b970 tx=0x7f231800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800cb40 con 0x7f232015d440 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231800ccc0 con 0x7f232015d440 2023-07-20T09:51:07.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318014680 con 0x7f232015d440 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320156230 con 0x7f232015d440 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232014fdd0 con 0x7f232015d440 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.902+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320156090 con 0x7f232015d440 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.906+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f231801d3b0 con 0x7f232015d440 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.906+0000 7f2316ffd640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 0x7f2304068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:07.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.906+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2318083cf0 con 0x7f232015d440 2023-07-20T09:51:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.906+0000 7f2326409640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 0x7f2304068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.906+0000 7f2326409640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 0x7f2304068770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f231c006fd0 tx=0x7f231c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:07.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:07.910+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2320156090 con 0x7f232015d440 2023-07-20T09:51:08.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.070+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2320156090 con 0x7f232015d440 2023-07-20T09:51:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f2316ffd640 1 -- 172.21.15.82:0/2193207929 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2320156090 con 0x7f232015d440 2023-07-20T09:51:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:listed 0 entries 2023-07-20T09:51:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 msgr2=0x7f2304068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 0x7f2304068770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f231c006fd0 tx=0x7f231c008040 comp rx=0 tx=0).stop 2023-07-20T09:51:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 msgr2=0x7f2320159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f231800b970 tx=0x7f231800be30 comp rx=0 tx=0).stop 2023-07-20T09:51:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 shutdown_connections 2023-07-20T09:51:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f23040662b0 0x7f2304068770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f232015d440 0x7f2320159000 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015d060 0x7f232014f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 --2- 172.21.15.82:0/2193207929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200c86d0 0x7f232014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 >> 172.21.15.82:0/2193207929 conn(0x7f23200ce080 msgr2=0x7f23200c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:08.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 shutdown_connections 2023-07-20T09:51:08.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.074+0000 7f232740b640 1 -- 172.21.15.82:0/2193207929 wait complete. 2023-07-20T09:51:08.130 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-20T09:51:08.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:08.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-20T09:51:08.204 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T09:51:08.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:08.204 DEBUG:teuthology.orchestra.run.smithi183:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-20T09:51:08.215 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T09:51:08.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:08.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 Processor -- start 2023-07-20T09:51:08.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 -- start start 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9940afda0 0x7fb9940ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb9940b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9940b2ee0 con 0x7fb9940b2060 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9940b3160 con 0x7fb9940afda0 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb9992f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940b12a0 con 0x7fb99415a8e0 2023-07-20T09:51:08.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9940afda0 0x7fb9940ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9940afda0 0x7fb9940ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33180/0 (socket says 172.21.15.82:33180) 2023-07-20T09:51:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 -- 172.21.15.82:0/402282329 learned_addr learned my addr 172.21.15.82:0/402282329 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:08.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb98a7fc640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb9940b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 -- 172.21.15.82:0/402282329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 msgr2=0x7fb9940b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb9940b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 -- 172.21.15.82:0/402282329 >> v1:172.21.15.183:6789/0 conn(0x7fb9940b2060 legacy=0x7fb9940b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb992ffd640 1 -- 172.21.15.82:0/402282329 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940b1580 con 0x7fb9940afda0 2023-07-20T09:51:08.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.318+0000 7fb98a7fc640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb9940b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:08.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb992ffd640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940ca6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9840098a0 tx=0x7fb98401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78bf0e98abedfa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9927fc640 1 -- 172.21.15.82:0/402282329 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984004230 con 0x7fb9940afda0 2023-07-20T09:51:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9927fc640 1 -- 172.21.15.82:0/402282329 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840a7050 con 0x7fb9940afda0 2023-07-20T09:51:08.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9927fc640 1 -- 172.21.15.82:0/402282329 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984003620 con 0x7fb9940afda0 2023-07-20T09:51:08.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 -- 172.21.15.82:0/402282329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 msgr2=0x7fb9940ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940ca6b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9840098a0 tx=0x7fb98401c390 comp rx=0 tx=0).stop 2023-07-20T09:51:08.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 -- 172.21.15.82:0/402282329 shutdown_connections 2023-07-20T09:51:08.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb9940b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 --2- 172.21.15.82:0/402282329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940ca6b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 -- 172.21.15.82:0/402282329 >> 172.21.15.82:0/402282329 conn(0x7fb9940cada0 msgr2=0x7fb9940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 -- 172.21.15.82:0/402282329 shutdown_connections 2023-07-20T09:51:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.322+0000 7fb9992f9640 1 -- 172.21.15.82:0/402282329 wait complete. 2023-07-20T09:51:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 Processor -- start 2023-07-20T09:51:08.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 -- start start 2023-07-20T09:51:08.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9940b2060 0x7fb9941f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb994159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9941f91c0 con 0x7fb9940afda0 2023-07-20T09:51:08.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99415a110 con 0x7fb9940b2060 2023-07-20T09:51:08.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9940cbd50 con 0x7fb99415a8e0 2023-07-20T09:51:08.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33184/0 (socket says 172.21.15.82:33184) 2023-07-20T09:51:08.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 -- 172.21.15.82:0/2756899620 learned_addr learned my addr 172.21.15.82:0/2756899620 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:08.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb98a7fc640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9940b2060 0x7fb9941f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9937fe640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb994159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 -- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 msgr2=0x7fb994159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb994159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 -- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9940b2060 msgr2=0x7fb9941f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9940b2060 0x7fb9941f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 -- 172.21.15.82:0/2756899620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840094d0 con 0x7fb9940afda0 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb992ffd640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9840ae040 tx=0x7fb984019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984003d60 con 0x7fb9940afda0 2023-07-20T09:51:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840ab440 con 0x7fb9940afda0 2023-07-20T09:51:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9840ab7f0 con 0x7fb9940afda0 2023-07-20T09:51:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.326+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9940cbff0 con 0x7fb9940afda0 2023-07-20T09:51:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9940cc5b0 con 0x7fb9940afda0 2023-07-20T09:51:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9940cc7a0 con 0x7fb9940afda0 2023-07-20T09:51:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9840ab950 con 0x7fb9940afda0 2023-07-20T09:51:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb98bfff640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 0x7fb978068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb98411e370 con 0x7fb9940afda0 2023-07-20T09:51:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb98a7fc640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 0x7fb978068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.330+0000 7fb98a7fc640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 0x7fb978068740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb994154340 tx=0x7fb97c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.334+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9840eb7e0 con 0x7fb9940afda0 2023-07-20T09:51:08.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.510+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb994073c70 con 0x7fb9940afda0 2023-07-20T09:51:08.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.510+0000 7fb98bfff640 1 -- 172.21.15.82:0/2756899620 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fb9840eee00 con 0x7fb9940afda0 2023-07-20T09:51:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:08.549 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:51:08.550 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:51:08.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 msgr2=0x7fb978068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 0x7fb978068740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb994154340 tx=0x7fb97c008040 comp rx=0 tx=0).stop 2023-07-20T09:51:08.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 msgr2=0x7fb9940cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9840ae040 tx=0x7fb984019130 comp rx=0 tx=0).stop 2023-07-20T09:51:08.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 shutdown_connections 2023-07-20T09:51:08.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb978066280 0x7fb978068740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb99415a8e0 0x7fb994159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9940b2060 0x7fb9941f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 --2- 172.21.15.82:0/2756899620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9940afda0 0x7fb9940cd8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 >> 172.21.15.82:0/2756899620 conn(0x7fb9940cada0 msgr2=0x7fb994071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:08.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 shutdown_connections 2023-07-20T09:51:08.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.514+0000 7fb9992f9640 1 -- 172.21.15.82:0/2756899620 wait complete. 2023-07-20T09:51:08.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 Processor -- start 2023-07-20T09:51:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 -- start start 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc15cab0 0x7f2adc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2adc0d0d10 0x7f2adc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc0d16b0 con 0x7f2adc0cf110 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0d31c0 con 0x7f2adc0d0d10 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ae0ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b3520 con 0x7f2adc15cab0 2023-07-20T09:51:08.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad9d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2adc0d0d10 0x7f2adc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2adad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2adc0cf110 0x7f2adc0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36250/0 (socket says 172.21.15.82:36250) 2023-07-20T09:51:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2adad9d640 1 -- 172.21.15.82:0/285205366 learned_addr learned my addr 172.21.15.82:0/285205366 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ada59c640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc15cab0 0x7f2adc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/285205366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc15cab0 msgr2=0x7f2adc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad9d9b640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc15cab0 0x7f2adc0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/285205366 >> v1:172.21.15.82:6789/0 conn(0x7f2adc0cf110 legacy=0x7f2adc0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/285205366 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0b2910 con 0x7f2adc0d0d10 2023-07-20T09:51:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.670+0000 7f2ad959a640 1 -- 172.21.15.82:0/285205366 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662862786 0 0) 0x7f2adc0d16b0 con 0x7f2adc0cf110 2023-07-20T09:51:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ad9d9b640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0d1170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00097c0 tx=0x7f2ad001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c216b7633a6c0331 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ad959a640 1 -- 172.21.15.82:0/285205366 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00ab650 con 0x7f2adc0d0d10 2023-07-20T09:51:08.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ad959a640 1 -- 172.21.15.82:0/285205366 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad00ab7b0 con 0x7f2adc0d0d10 2023-07-20T09:51:08.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ad959a640 1 -- 172.21.15.82:0/285205366 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00abb40 con 0x7f2adc0d0d10 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/285205366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 msgr2=0x7f2adc0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0d1170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00097c0 tx=0x7f2ad001c450 comp rx=0 tx=0).stop 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/285205366 shutdown_connections 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0d1170 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/285205366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc15cab0 0x7f2adc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/285205366 >> 172.21.15.82:0/285205366 conn(0x7f2adc08c120 msgr2=0x7f2adc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/285205366 shutdown_connections 2023-07-20T09:51:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.674+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/285205366 wait complete. 2023-07-20T09:51:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 Processor -- start 2023-07-20T09:51:08.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- start start 2023-07-20T09:51:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 0x7f2adc155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 0x7f2adc156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b7bf0 con 0x7f2adc0d0d10 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc15e870 con 0x7f2adc15cab0 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b72f0 con 0x7f2adc0cf110 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33198/0 (socket says 172.21.15.82:33198) 2023-07-20T09:51:08.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/1910633096 learned_addr learned my addr 172.21.15.82:0/1910633096 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2adad9d640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 0x7f2adc156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ada59c640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 0x7f2adc155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 msgr2=0x7f2adc155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 0x7f2adc155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 msgr2=0x7f2adc156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 0x7f2adc156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 -- 172.21.15.82:0/1910633096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009420 con 0x7f2adc0d0d10 2023-07-20T09:51:08.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ada59c640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 0x7f2adc155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2adad9d640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 0x7f2adc156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ad9d9b640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ad040 tx=0x7f2ad001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0004220 con 0x7f2adc0d0d10 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad00b9070 con 0x7f2adc0d0d10 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0003620 con 0x7f2adc0d0d10 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0b7e40 con 0x7f2adc0d0d10 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.678+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc15eac0 con 0x7f2adc0d0d10 2023-07-20T09:51:08.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc0b8640 con 0x7f2adc0d0d10 2023-07-20T09:51:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ad0003780 con 0x7f2adc0d0d10 2023-07-20T09:51:08.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2acaffd640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 0x7f2abc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:08.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2ad00bb070 con 0x7f2adc0d0d10 2023-07-20T09:51:08.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2ada59c640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 0x7f2abc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:08.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.682+0000 7f2ada59c640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 0x7f2abc068740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0074c0 tx=0x7f2acc00b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:08.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.686+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ad00ebc60 con 0x7f2adc0d0d10 2023-07-20T09:51:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.834+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2adc0b82f0 con 0x7f2adc0d0d10 2023-07-20T09:51:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.834+0000 7f2acaffd640 1 -- 172.21.15.82:0/1910633096 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f2ad00ef280 con 0x7f2adc0d0d10 2023-07-20T09:51:08.871 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:08.872 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:07.672286+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 msgr2=0x7f2abc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 0x7f2abc068740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2acc0074c0 tx=0x7f2acc00b040 comp rx=0 tx=0).stop 2023-07-20T09:51:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 msgr2=0x7f2adc0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00ad040 tx=0x7f2ad001ac90 comp rx=0 tx=0).stop 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 shutdown_connections 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2abc066280 0x7f2abc068740 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2adc15cab0 0x7f2adc156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2adc0d0d10 0x7f2adc0b6db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 --2- 172.21.15.82:0/1910633096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2adc0cf110 0x7f2adc155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 >> 172.21.15.82:0/1910633096 conn(0x7f2adc08c120 msgr2=0x7f2adc0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:08.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 shutdown_connections 2023-07-20T09:51:08.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:08.838+0000 7f2ae0ffa640 1 -- 172.21.15.82:0/1910633096 wait complete. 2023-07-20T09:51:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:50:24.400019+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:50:25.754235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:51:08.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:51:09.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 Processor -- start 2023-07-20T09:51:09.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 -- start start 2023-07-20T09:51:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9640afd50 0x7fb9640b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640b06b0 con 0x7fb964159830 2023-07-20T09:51:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cc8d0 con 0x7fb964159450 2023-07-20T09:51:09.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb96ad67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640cce90 con 0x7fb9640afd50 2023-07-20T09:51:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb95bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb964159830 0x7fb9640cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36266/0 (socket says 172.21.15.82:36266) 2023-07-20T09:51:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb95bfff640 1 -- 172.21.15.82:0/1393366326 learned_addr learned my addr 172.21.15.82:0/1393366326 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:09.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb969304640 1 --2- 172.21.15.82:0/1393366326 >> v2:172.21.15.82:3300/0 conn(0x7fb9640afd50 0x7fb9640b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027204343 0 0) 0x7fb9640b06b0 con 0x7fb964159830 2023-07-20T09:51:09.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb94c005740 con 0x7fb964159830 2023-07-20T09:51:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb969304640 1 -- 172.21.15.82:0/1393366326 >> v1:172.21.15.183:6789/0 conn(0x7fb964159450 legacy=0x7fb96415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374068540 0 0) 0x7fb9640cc8d0 con 0x7fb964159450 2023-07-20T09:51:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb969304640 1 -- 172.21.15.82:0/1393366326 >> v1:172.21.15.82:6789/0 conn(0x7fb964159830 legacy=0x7fb9640cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.002+0000 7fb969304640 1 -- 172.21.15.82:0/1393366326 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640ccbb0 con 0x7fb9640afd50 2023-07-20T09:51:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb969304640 1 --2- 172.21.15.82:0/1393366326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640afd50 0x7fb9640b0170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a9d692f1e54c7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab650 con 0x7fb9640afd50 2023-07-20T09:51:09.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0ab7b0 con 0x7fb9640afd50 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb95b7fe640 1 -- 172.21.15.82:0/1393366326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0abb20 con 0x7fb9640afd50 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 -- 172.21.15.82:0/1393366326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640afd50 msgr2=0x7fb9640b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 --2- 172.21.15.82:0/1393366326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640afd50 0x7fb9640b0170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c450 comp rx=0 tx=0).stop 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 -- 172.21.15.82:0/1393366326 shutdown_connections 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 --2- 172.21.15.82:0/1393366326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640afd50 0x7fb9640b0170 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 -- 172.21.15.82:0/1393366326 >> 172.21.15.82:0/1393366326 conn(0x7fb9640cad50 msgr2=0x7fb9640cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 -- 172.21.15.82:0/1393366326 shutdown_connections 2023-07-20T09:51:09.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 -- 172.21.15.82:0/1393366326 wait complete. 2023-07-20T09:51:09.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.006+0000 7fb96ad67640 1 Processor -- start 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- start start 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9640afd50 0x7fb964153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb964159450 0x7fb9641570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640c4a30 con 0x7fb9640c4040 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964154040 con 0x7fb964159450 2023-07-20T09:51:09.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb964157610 con 0x7fb9640afd50 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33216/0 (socket says 172.21.15.82:33216) 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 -- 172.21.15.82:0/2168014787 learned_addr learned my addr 172.21.15.82:0/2168014787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb968b03640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9640afd50 0x7fb964153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb95bfff640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb964159450 0x7fb9641570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 -- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9640afd50 msgr2=0x7fb964153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9640afd50 0x7fb964153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 -- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb964159450 msgr2=0x7fb9641570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb964159450 0x7fb9641570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 -- 172.21.15.82:0/2168014787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009420 con 0x7fb9640c4040 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb969304640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb95c019060 tx=0x7fb95c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0bf610 con 0x7fb9640c4040 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0bf770 con 0x7fb9640c4040 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0bfae0 con 0x7fb9640c4040 2023-07-20T09:51:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9641578e0 con 0x7fb9640c4040 2023-07-20T09:51:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9640c1c30 con 0x7fb9640c4040 2023-07-20T09:51:09.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.010+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb964157d90 con 0x7fb9640c4040 2023-07-20T09:51:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.014+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb95c0b5400 con 0x7fb9640c4040 2023-07-20T09:51:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.014+0000 7fb9597fa640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 0x7fb950068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.014+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb95c11eb00 con 0x7fb9640c4040 2023-07-20T09:51:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.014+0000 7fb968b03640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 0x7fb950068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.014+0000 7fb968b03640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 0x7fb950068740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb960007fd0 tx=0x7fb960009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.018+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb95c0ec0f0 con 0x7fb9640c4040 2023-07-20T09:51:09.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.166+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb96404da30 con 0x7fb9640c4040 2023-07-20T09:51:09.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.166+0000 7fb9597fa640 1 -- 172.21.15.82:0/2168014787 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb95c0ef710 con 0x7fb9640c4040 2023-07-20T09:51:09.205 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:51:09.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 msgr2=0x7fb950068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 0x7fb950068740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb960007fd0 tx=0x7fb960009040 comp rx=0 tx=0).stop 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 msgr2=0x7fb9640c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb95c019060 tx=0x7fb95c01ac90 comp rx=0 tx=0).stop 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 shutdown_connections 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb950066280 0x7fb950068740 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9640c4040 0x7fb9640c44f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb964159450 0x7fb9641570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 --2- 172.21.15.82:0/2168014787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9640afd50 0x7fb964153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 >> 172.21.15.82:0/2168014787 conn(0x7fb9640cad50 msgr2=0x7fb964071210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 shutdown_connections 2023-07-20T09:51:09.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.170+0000 7fb96ad67640 1 -- 172.21.15.82:0/2168014787 wait complete. 2023-07-20T09:51:09.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:09.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 Processor -- start 2023-07-20T09:51:09.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 -- start start 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67d006c120 0x7f67d00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f67d006ab10 0x7f67d006af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d006b4c0 con 0x7f67d006c120 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d00d0970 con 0x7f67d006ab10 2023-07-20T09:51:09.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d6a93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d0160e20 con 0x7f67d01602b0 2023-07-20T09:51:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67d006c120 0x7f67d00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67d006c120 0x7f67d00cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33220/0 (socket says 172.21.15.82:33220) 2023-07-20T09:51:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 -- 172.21.15.82:0/3056848277 learned_addr learned my addr 172.21.15.82:0/3056848277 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:09.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 -- 172.21.15.82:0/3056848277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 msgr2=0x7f67d0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 --2- 172.21.15.82:0/3056848277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 -- 172.21.15.82:0/3056848277 >> v2:172.21.15.183:3300/0 conn(0x7f67d006ab10 msgr2=0x7f67d006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 --2- 172.21.15.82:0/3056848277 >> v2:172.21.15.183:3300/0 conn(0x7f67d006ab10 0x7f67d006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.330+0000 7f67d482f640 1 -- 172.21.15.82:0/3056848277 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d00cd300 con 0x7f67d006c120 2023-07-20T09:51:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d482f640 1 --2- 172.21.15.82:0/3056848277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006c120 0x7f67d00cdde0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67d008b920 tx=0x7f67cc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e3e6681ac86feb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67c77fe640 1 -- 172.21.15.82:0/3056848277 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0ab600 con 0x7f67d006c120 2023-07-20T09:51:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67c77fe640 1 -- 172.21.15.82:0/3056848277 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0a7050 con 0x7f67d006c120 2023-07-20T09:51:09.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67c77fe640 1 -- 172.21.15.82:0/3056848277 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0ab980 con 0x7f67d006c120 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 -- 172.21.15.82:0/3056848277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006c120 msgr2=0x7f67d00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 --2- 172.21.15.82:0/3056848277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006c120 0x7f67d00cdde0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f67d008b920 tx=0x7f67cc01c470 comp rx=0 tx=0).stop 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 -- 172.21.15.82:0/3056848277 shutdown_connections 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 --2- 172.21.15.82:0/3056848277 >> v2:172.21.15.183:3300/0 conn(0x7f67d006ab10 0x7f67d006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 --2- 172.21.15.82:0/3056848277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 --2- 172.21.15.82:0/3056848277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006c120 0x7f67d00cdde0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 -- 172.21.15.82:0/3056848277 >> 172.21.15.82:0/3056848277 conn(0x7f67d008c0a0 msgr2=0x7f67d009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 -- 172.21.15.82:0/3056848277 shutdown_connections 2023-07-20T09:51:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.334+0000 7f67d6a93640 1 -- 172.21.15.82:0/3056848277 wait complete. 2023-07-20T09:51:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 Processor -- start 2023-07-20T09:51:09.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- start start 2023-07-20T09:51:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67d006c120 0x7f67d015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00ca820 con 0x7f67d006ab10 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c97c0 con 0x7f67d006c120 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c9a60 con 0x7f67d01602b0 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33222/0 (socket says 172.21.15.82:33222) 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 -- 172.21.15.82:0/1573475306 learned_addr learned my addr 172.21.15.82:0/1573475306 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67c7fff640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67d006c120 0x7f67d015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d5030640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 -- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 msgr2=0x7f67d0151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 -- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67d006c120 msgr2=0x7f67d015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67d006c120 0x7f67d015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 -- 172.21.15.82:0/1573475306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc0094d0 con 0x7f67d006ab10 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d5030640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d482f640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0ae040 tx=0x7f67cc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0b6620 con 0x7f67d006ab10 2023-07-20T09:51:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc0b67a0 con 0x7f67d006ab10 2023-07-20T09:51:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc0b6b50 con 0x7f67d006ab10 2023-07-20T09:51:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d00c9d40 con 0x7f67d006ab10 2023-07-20T09:51:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.338+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d00ca300 con 0x7f67d006ab10 2023-07-20T09:51:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d004da30 con 0x7f67d006ab10 2023-07-20T09:51:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67cc0b2040 con 0x7f67d006ab10 2023-07-20T09:51:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67c57fa640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 0x7f67bc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f67cc11e270 con 0x7f67d006ab10 2023-07-20T09:51:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67c7fff640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 0x7f67bc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.342+0000 7f67c7fff640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 0x7f67bc068740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67d00d10f0 tx=0x7f67c0006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.346+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67cc0eb760 con 0x7f67d006ab10 2023-07-20T09:51:09.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67d00cee40 con 0x7f67d006ab10 2023-07-20T09:51:09.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67c57fa640 1 -- 172.21.15.82:0/1573475306 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67cc0eed80 con 0x7f67d006ab10 2023-07-20T09:51:09.531 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 msgr2=0x7f67bc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 0x7f67bc068740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67d00d10f0 tx=0x7f67c0006f90 comp rx=0 tx=0).stop 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 msgr2=0x7f67d00b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f67cc0ae040 tx=0x7f67cc01acb0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 shutdown_connections 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f67bc066280 0x7f67bc068740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67d01602b0 0x7f67d0151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67d006c120 0x7f67d015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 --2- 172.21.15.82:0/1573475306 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67d006ab10 0x7f67d00b37c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 >> 172.21.15.82:0/1573475306 conn(0x7f67d008c0a0 msgr2=0x7f67d0158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 shutdown_connections 2023-07-20T09:51:09.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.494+0000 7f67d6a93640 1 -- 172.21.15.82:0/1573475306 wait complete. 2023-07-20T09:51:09.552 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T09:51:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.654+0000 7f2c02a6d640 1 Processor -- start 2023-07-20T09:51:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.654+0000 7f2c02a6d640 1 -- start start 2023-07-20T09:51:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c02a6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 0x7f2bfc06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c02a6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 0x7f2bfc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c02a6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc070030 con 0x7f2bfc15ec90 2023-07-20T09:51:09.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c02a6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc15bad0 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c02a6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc071950 con 0x7f2bfc06f710 2023-07-20T09:51:09.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c00809640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 0x7f2bfc06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c0100a640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f2bfc15ec90 0x7f2bfc15a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:51086/0 (socket says 172.21.15.82:51086) 2023-07-20T09:51:09.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2bf3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 0x7f2bfc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c0100a640 1 -- 172.21.15.82:0/2870982568 learned_addr learned my addr 172.21.15.82:0/2870982568 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2bf37fe640 1 -- 172.21.15.82:0/2870982568 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640666469 0 0) 0x7f2bfc070030 con 0x7f2bfc15ec90 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2bf37fe640 1 -- 172.21.15.82:0/2870982568 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be4003530 con 0x7f2bfc15ec90 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c00809640 1 -- 172.21.15.82:0/2870982568 >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 msgr2=0x7f2bfc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c00809640 1 --2- 172.21.15.82:0/2870982568 >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 0x7f2bfc15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c00809640 1 -- 172.21.15.82:0/2870982568 >> v1:172.21.15.183:6789/0 conn(0x7f2bfc15ec90 legacy=0x7f2bfc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2c00809640 1 -- 172.21.15.82:0/2870982568 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc15b230 con 0x7f2bfc06f710 2023-07-20T09:51:09.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.658+0000 7f2bf3fff640 1 --2- 172.21.15.82:0/2870982568 >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 0x7f2bfc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:09.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c00809640 1 --2- 172.21.15.82:0/2870982568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 0x7f2bfc06faf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80097c0 tx=0x7f2bf801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b359d622508e52a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2bf37fe640 1 -- 172.21.15.82:0/2870982568 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80ad660 con 0x7f2bfc06f710 2023-07-20T09:51:09.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2bf37fe640 1 -- 172.21.15.82:0/2870982568 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80ad7c0 con 0x7f2bfc06f710 2023-07-20T09:51:09.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2bf37fe640 1 -- 172.21.15.82:0/2870982568 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80adb30 con 0x7f2bfc06f710 2023-07-20T09:51:09.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2870982568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 msgr2=0x7f2bfc06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2870982568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 0x7f2bfc06faf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80097c0 tx=0x7f2bf801c450 comp rx=0 tx=0).stop 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2870982568 shutdown_connections 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2870982568 >> v2:172.21.15.183:3300/0 conn(0x7f2bfc0ca5a0 0x7f2bfc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2870982568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc06f710 0x7f2bfc06faf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2870982568 >> 172.21.15.82:0/2870982568 conn(0x7f2bfc0cad50 msgr2=0x7f2bfc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2870982568 shutdown_connections 2023-07-20T09:51:09.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2870982568 wait complete. 2023-07-20T09:51:09.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.662+0000 7f2c02a6d640 1 Processor -- start 2023-07-20T09:51:09.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- start start 2023-07-20T09:51:09.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 0x7f2bfc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc15ec90 0x7f2bfc0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1585c0 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0c51a0 con 0x7f2bfc06f710 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc151500 con 0x7f2bfc15ec90 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33238/0 (socket says 172.21.15.82:33238) 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 -- 172.21.15.82:0/2143844423 learned_addr learned my addr 172.21.15.82:0/2143844423 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c0100a640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc15ec90 0x7f2bfc0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c00809640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 0x7f2bfc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 -- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc15ec90 msgr2=0x7f2bfc0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc15ec90 0x7f2bfc0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 -- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 msgr2=0x7f2bfc157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 0x7f2bfc157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 -- 172.21.15.82:0/2143844423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009420 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c00809640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 0x7f2bfc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:09.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf3fff640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e980 tx=0x7f2bec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00ca00 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00cb60 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec013470 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf8009420 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc151ac0 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.666+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc04da30 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.670+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bec0135d0 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.670+0000 7f2bf17fa640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 0x7f2be8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.670+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2bec083f90 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.670+0000 7f2c00809640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 0x7f2be8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.670+0000 7f2c00809640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 0x7f2be8068740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80af000 tx=0x7f2bf80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.674+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bec0b4700 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.818+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bfc0704d0 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.818+0000 7f2bf17fa640 1 -- 172.21.15.82:0/2143844423 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bec017020 con 0x7f2bfc0ca5a0 2023-07-20T09:51:09.857 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T09:51:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 msgr2=0x7f2be8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 0x7f2be8068740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80af000 tx=0x7f2bf80a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 msgr2=0x7f2bfc164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00e980 tx=0x7f2bec00ee40 comp rx=0 tx=0).stop 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 shutdown_connections 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2be8066280 0x7f2be8068740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2bfc15ec90 0x7f2bfc0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bfc0ca5a0 0x7f2bfc164ae0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 --2- 172.21.15.82:0/2143844423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2bfc06f710 0x7f2bfc157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 >> 172.21.15.82:0/2143844423 conn(0x7f2bfc0cad50 msgr2=0x7f2bfc0ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 shutdown_connections 2023-07-20T09:51:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.822+0000 7f2c02a6d640 1 -- 172.21.15.82:0/2143844423 wait complete. 2023-07-20T09:51:09.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T09:51:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.982+0000 7f50f8ecb640 1 Processor -- start 2023-07-20T09:51:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.982+0000 7f50f8ecb640 1 -- start start 2023-07-20T09:51:10.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f8ecb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50f4159830 0x7f50f40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f8ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f8ecb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40cc8d0 con 0x7f50f4159450 2023-07-20T09:51:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f8ecb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f40cce90 con 0x7f50f4159830 2023-07-20T09:51:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f8ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40ccbb0 con 0x7f50f40cc3e0 2023-07-20T09:51:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50f4159830 0x7f50f40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f2d9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50f4159830 0x7f50f40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:42394/0 (socket says 172.21.15.82:42394) 2023-07-20T09:51:10.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3932496282 learned_addr learned my addr 172.21.15.82:0/3932496282 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f259c640 1 --1- 172.21.15.82:0/3932496282 >> v1:172.21.15.183:6789/0 conn(0x7f50f4159450 0x7f50f415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:51090/0 (socket says 172.21.15.82:51090) 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 msgr2=0x7f50f40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 --2- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3932496282 >> v1:172.21.15.183:6789/0 conn(0x7f50f4159450 legacy=0x7f50f415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3932496282 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4159cc0 con 0x7f50f4159830 2023-07-20T09:51:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.986+0000 7f50f1d9b640 1 -- 172.21.15.82:0/3932496282 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979002084 0 0) 0x7f50f40cc8d0 con 0x7f50f4159450 2023-07-20T09:51:10.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50e9d9b640 1 --2- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f4159830 0x7f50f40cbea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d150 tx=0x7f50dc01ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ea5cb70132c9e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f1d9b640 1 -- 172.21.15.82:0/3932496282 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00b2d0 con 0x7f50f4159830 2023-07-20T09:51:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f1d9b640 1 -- 172.21.15.82:0/3932496282 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00b430 con 0x7f50f4159830 2023-07-20T09:51:10.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f1d9b640 1 -- 172.21.15.82:0/3932496282 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0a7be0 con 0x7f50f4159830 2023-07-20T09:51:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f4159830 msgr2=0x7f50f40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f4159830 0x7f50f40cbea0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d150 tx=0x7f50dc01ebe0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3932496282 shutdown_connections 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3932496282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f4159830 0x7f50f40cbea0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3932496282 >> 172.21.15.82:0/3932496282 conn(0x7f50f40cad50 msgr2=0x7f50f40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3932496282 shutdown_connections 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3932496282 wait complete. 2023-07-20T09:51:10.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.990+0000 7f50f8ecb640 1 Processor -- start 2023-07-20T09:51:10.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- start start 2023-07-20T09:51:10.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f40b1e20 0x7f50f41581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41578f0 con 0x7f50f4159450 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40b23b0 con 0x7f50f40b1e20 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f40b2690 con 0x7f50f40cc3e0 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33248/0 (socket says 172.21.15.82:33248) 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3511838042 learned_addr learned my addr 172.21.15.82:0/3511838042 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f259c640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f2d9d640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f40b1e20 0x7f50f41581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 msgr2=0x7f50f40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f40b1e20 msgr2=0x7f50f41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f40b1e20 0x7f50f41581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 -- 172.21.15.82:0/3511838042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc00bd40 con 0x7f50f4159450 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50e9d9b640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0b1040 tx=0x7f50dc01b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc009800 con 0x7f50f4159450 2023-07-20T09:51:10.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0099a0 con 0x7f50f4159450 2023-07-20T09:51:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f40b2970 con 0x7f50f4159450 2023-07-20T09:51:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc009d50 con 0x7f50f4159450 2023-07-20T09:51:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f40b2f30 con 0x7f50f4159450 2023-07-20T09:51:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.994+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f404da30 con 0x7f50f4159450 2023-07-20T09:51:10.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.998+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50dc0ba470 con 0x7f50f4159450 2023-07-20T09:51:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.998+0000 7f50eb7fe640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 0x7f50d4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.998+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f50dc121400 con 0x7f50f4159450 2023-07-20T09:51:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.998+0000 7f50f259c640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 0x7f50d4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:09.998+0000 7f50f259c640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 0x7f50d4068740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50e4007fd0 tx=0x7f50e4007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.002+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50dc0ee8e0 con 0x7f50f4159450 2023-07-20T09:51:10.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.146+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50f415c540 con 0x7f50f4159450 2023-07-20T09:51:10.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.146+0000 7f50eb7fe640 1 -- 172.21.15.82:0/3511838042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50dc0f1f00 con 0x7f50f4159450 2023-07-20T09:51:10.184 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 msgr2=0x7f50d4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 0x7f50d4068740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f50e4007fd0 tx=0x7f50e4007d60 comp rx=0 tx=0).stop 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 msgr2=0x7f50f41573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0b1040 tx=0x7f50dc01b980 comp rx=0 tx=0).stop 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 shutdown_connections 2023-07-20T09:51:10.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f50d4066280 0x7f50d4068740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50f40b1e20 0x7f50f41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50f4159450 0x7f50f41573b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 --2- 172.21.15.82:0/3511838042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50f40cc3e0 0x7f50f40b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 >> 172.21.15.82:0/3511838042 conn(0x7f50f40cad50 msgr2=0x7f50f40c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 shutdown_connections 2023-07-20T09:51:10.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.150+0000 7f50f8ecb640 1 -- 172.21.15.82:0/3511838042 wait complete. 2023-07-20T09:51:10.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 Processor -- start 2023-07-20T09:51:10.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 -- start start 2023-07-20T09:51:10.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 0x7fadf00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00d16b0 con 0x7fadf015cab0 2023-07-20T09:51:10.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00b3520 con 0x7fadf00cd4b0 2023-07-20T09:51:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf83ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00d31c0 con 0x7fadf00d0d10 2023-07-20T09:51:10.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf6156640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fadf015cab0 0x7fadf00d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36282/0 (socket says 172.21.15.82:36282) 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf6156640 1 -- 172.21.15.82:0/491971892 learned_addr learned my addr 172.21.15.82:0/491971892 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5955640 1 --2- 172.21.15.82:0/491971892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 0x7fadf00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524142854 0 0) 0x7fadf00d16b0 con 0x7fadf015cab0 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003530 con 0x7fadf015cab0 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188549101 0 0) 0x7fadf00b3520 con 0x7fadf00cd4b0 2023-07-20T09:51:10.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00d16b0 con 0x7fadf00cd4b0 2023-07-20T09:51:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477166729 0 0) 0x7faddc003530 con 0x7fadf015cab0 2023-07-20T09:51:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5955640 1 -- 172.21.15.82:0/491971892 >> v1:172.21.15.183:6789/0 conn(0x7fadf00cd4b0 legacy=0x7fadf00cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5955640 1 -- 172.21.15.82:0/491971892 >> v1:172.21.15.82:6789/0 conn(0x7fadf015cab0 legacy=0x7fadf00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.306+0000 7fadf5955640 1 -- 172.21.15.82:0/491971892 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00d0a10 con 0x7fadf00d0d10 2023-07-20T09:51:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf5955640 1 --2- 172.21.15.82:0/491971892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 0x7fadf00d1170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fade00097f0 tx=0x7fade001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1a141515d29956 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec001680 con 0x7fadf00d0d10 2023-07-20T09:51:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00a7050 con 0x7fadf00d0d10 2023-07-20T09:51:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf5154640 1 -- 172.21.15.82:0/491971892 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00ab600 con 0x7fadf00d0d10 2023-07-20T09:51:10.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 -- 172.21.15.82:0/491971892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 msgr2=0x7fadf00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 --2- 172.21.15.82:0/491971892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 0x7fadf00d1170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fade00097f0 tx=0x7fade001c3b0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 -- 172.21.15.82:0/491971892 shutdown_connections 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 --2- 172.21.15.82:0/491971892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00d0d10 0x7fadf00d1170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 -- 172.21.15.82:0/491971892 >> 172.21.15.82:0/491971892 conn(0x7fadf008c120 msgr2=0x7fadf009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 -- 172.21.15.82:0/491971892 shutdown_connections 2023-07-20T09:51:10.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.310+0000 7fadf83ba640 1 -- 172.21.15.82:0/491971892 wait complete. 2023-07-20T09:51:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 Processor -- start 2023-07-20T09:51:10.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- start start 2023-07-20T09:51:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cd4b0 0x7fadf00ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 0x7fadf00cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cc7d0 con 0x7fadf015cab0 2023-07-20T09:51:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ca910 con 0x7fadf00d0d10 2023-07-20T09:51:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cabf0 con 0x7fadf00cd4b0 2023-07-20T09:51:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33250/0 (socket says 172.21.15.82:33250) 2023-07-20T09:51:10.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 -- 172.21.15.82:0/2408278130 learned_addr learned my addr 172.21.15.82:0/2408278130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:10.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf5955640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 0x7fadf00cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6156640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cd4b0 0x7fadf00ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 -- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cd4b0 msgr2=0x7fadf00ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cd4b0 0x7fadf00ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 -- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 msgr2=0x7fadf00cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 0x7fadf00cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 -- 172.21.15.82:0/2408278130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade0009420 con 0x7fadf015cab0 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf5955640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 0x7fadf00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf6957640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fade800c730 tx=0x7fade800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8003b80 con 0x7fadf015cab0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade8003ce0 con 0x7fadf015cab0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade800aa90 con 0x7fadf015cab0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00caed0 con 0x7fadf015cab0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.314+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00b6110 con 0x7fadf015cab0 2023-07-20T09:51:10.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00b6390 con 0x7fadf015cab0 2023-07-20T09:51:10.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fade800abf0 con 0x7fadf015cab0 2023-07-20T09:51:10.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fade6ffd640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 0x7fadd4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fade8083cd0 con 0x7fadf015cab0 2023-07-20T09:51:10.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fadf6156640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 0x7fadd4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.318+0000 7fadf6156640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 0x7fadd4068740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fadec0011f0 tx=0x7fadec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.322+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fade8051070 con 0x7fadf015cab0 2023-07-20T09:51:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.498+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf0073c70 con 0x7fadf015cab0 2023-07-20T09:51:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fade6ffd640 1 -- 172.21.15.82:0/2408278130 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7fade8054690 con 0x7fadf015cab0 2023-07-20T09:51:10.538 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:10.538 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:51:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:51:10.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 msgr2=0x7fadd4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 0x7fadd4068740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fadec0011f0 tx=0x7fadec009040 comp rx=0 tx=0).stop 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 msgr2=0x7fadf00b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fade800c730 tx=0x7fade800cbf0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 shutdown_connections 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fadd4066280 0x7fadd4068740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf015cab0 0x7fadf00b7f70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf00d0d10 0x7fadf00cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 --2- 172.21.15.82:0/2408278130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cd4b0 0x7fadf00ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 >> 172.21.15.82:0/2408278130 conn(0x7fadf008c120 msgr2=0x7fadf00af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 shutdown_connections 2023-07-20T09:51:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.502+0000 7fadf83ba640 1 -- 172.21.15.82:0/2408278130 wait complete. 2023-07-20T09:51:10.558 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.658+0000 7fb81b12c640 1 Processor -- start 2023-07-20T09:51:10.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.658+0000 7fb81b12c640 1 -- start start 2023-07-20T09:51:10.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb81b12c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb8140c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb81b12c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb81406a400 con 0x7fb8140ce680 2023-07-20T09:51:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb81b12c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8140697f0 con 0x7fb814160240 2023-07-20T09:51:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb81b12c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140ae3b0 con 0x7fb8140adfd0 2023-07-20T09:51:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb813fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb8140ce680 0x7fb81406a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36298/0 (socket says 172.21.15.82:36298) 2023-07-20T09:51:10.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb813fff640 1 -- 172.21.15.82:0/693721064 learned_addr learned my addr 172.21.15.82:0/693721064 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb818ec8640 1 --2- 172.21.15.82:0/693721064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb8140c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb818ec8640 1 -- 172.21.15.82:0/693721064 >> v1:172.21.15.183:6789/0 conn(0x7fb814160240 legacy=0x7fb81406c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb818ec8640 1 -- 172.21.15.82:0/693721064 >> v1:172.21.15.82:6789/0 conn(0x7fb8140ce680 legacy=0x7fb81406a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.662+0000 7fb818ec8640 1 -- 172.21.15.82:0/693721064 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814069ad0 con 0x7fb8140adfd0 2023-07-20T09:51:10.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb818ec8640 1 --2- 172.21.15.82:0/693721064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb8140c91f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8080097f0 tx=0x7fb80801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cbf0068cc6c9af6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb8137fe640 1 -- 172.21.15.82:0/693721064 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8080ac410 con 0x7fb8140adfd0 2023-07-20T09:51:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb8137fe640 1 -- 172.21.15.82:0/693721064 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8080ac570 con 0x7fb8140adfd0 2023-07-20T09:51:10.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb8137fe640 1 -- 172.21.15.82:0/693721064 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8080ac900 con 0x7fb8140adfd0 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- 172.21.15.82:0/693721064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 msgr2=0x7fb8140c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 --2- 172.21.15.82:0/693721064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb8140c91f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8080097f0 tx=0x7fb80801c4c0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- 172.21.15.82:0/693721064 shutdown_connections 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 --2- 172.21.15.82:0/693721064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb8140c91f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- 172.21.15.82:0/693721064 >> 172.21.15.82:0/693721064 conn(0x7fb8140cb620 msgr2=0x7fb8140cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- 172.21.15.82:0/693721064 shutdown_connections 2023-07-20T09:51:10.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- 172.21.15.82:0/693721064 wait complete. 2023-07-20T09:51:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 Processor -- start 2023-07-20T09:51:10.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.666+0000 7fb81b12c640 1 -- start start 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb814160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8140ce680 0x7fb814154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8140c2870 con 0x7fb814160240 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8141556a0 con 0x7fb8140ce680 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb814155440 con 0x7fb8140adfd0 2023-07-20T09:51:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33262/0 (socket says 172.21.15.82:33262) 2023-07-20T09:51:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 -- 172.21.15.82:0/642472684 learned_addr learned my addr 172.21.15.82:0/642472684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb818ec8640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb814160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb813fff640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8140ce680 0x7fb814154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 -- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 msgr2=0x7fb814160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb814160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 -- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8140ce680 msgr2=0x7fb814154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8140ce680 0x7fb814154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 -- 172.21.15.82:0/642472684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb808009420 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8196c9640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c770 tx=0x7fb80c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c003b80 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c003ce0 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00aa90 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81415ea20 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81415efe0 con 0x7fb814160240 2023-07-20T09:51:10.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.670+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8140c29b0 con 0x7fb814160240 2023-07-20T09:51:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.674+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb80c00abf0 con 0x7fb814160240 2023-07-20T09:51:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.674+0000 7fb8117fa640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 0x7fb7f8068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:10.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.674+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb80c083970 con 0x7fb814160240 2023-07-20T09:51:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.674+0000 7fb818ec8640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 0x7fb7f8068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.674+0000 7fb818ec8640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 0x7fb7f8068770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb8080ae000 tx=0x7fb808008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:10.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.678+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8140c29b0 con 0x7fb814160240 2023-07-20T09:51:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.826+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8140c29b0 con 0x7fb814160240 2023-07-20T09:51:10.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.826+0000 7fb8117fa640 1 -- 172.21.15.82:0/642472684 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fb8140c29b0 con 0x7fb814160240 2023-07-20T09:51:10.863 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:10.864 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:07.672286+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:10.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 msgr2=0x7fb7f8068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 0x7fb7f8068770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb8080ae000 tx=0x7fb808008040 comp rx=0 tx=0).stop 2023-07-20T09:51:10.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 msgr2=0x7fb814154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c770 tx=0x7fb80c00cc30 comp rx=0 tx=0).stop 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 shutdown_connections 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb7f80662b0 0x7fb7f8068770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb814160240 0x7fb814154760 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8140ce680 0x7fb814154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 --2- 172.21.15.82:0/642472684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8140adfd0 0x7fb814160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 >> 172.21.15.82:0/642472684 conn(0x7fb8140cb620 msgr2=0x7fb8140aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 shutdown_connections 2023-07-20T09:51:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.830+0000 7fb81b12c640 1 -- 172.21.15.82:0/642472684 wait complete. 2023-07-20T09:51:10.885 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T09:51:10.886 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 Processor -- start 2023-07-20T09:51:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 -- start start 2023-07-20T09:51:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc1c0cc900 0x7efc1c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc1c0b2380 0x7efc1c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0b2d50 con 0x7efc1c0b2380 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c0ad600 con 0x7efc1c0cc900 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc22d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0ccd60 con 0x7efc1c1596b0 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc1c0b2380 0x7efc1c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc1c0b2380 0x7efc1c0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33268/0 (socket says 172.21.15.82:33268) 2023-07-20T09:51:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 -- 172.21.15.82:0/1177442002 learned_addr learned my addr 172.21.15.82:0/1177442002 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc20a9c640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc1bfff640 1 --2- 172.21.15.82:0/1177442002 >> v2:172.21.15.183:3300/0 conn(0x7efc1c0cc900 0x7efc1c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 -- 172.21.15.82:0/1177442002 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 msgr2=0x7efc1c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 -- 172.21.15.82:0/1177442002 >> v2:172.21.15.183:3300/0 conn(0x7efc1c0cc900 msgr2=0x7efc1c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 --2- 172.21.15.82:0/1177442002 >> v2:172.21.15.183:3300/0 conn(0x7efc1c0cc900 0x7efc1c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.990+0000 7efc2129d640 1 -- 172.21.15.82:0/1177442002 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0ad810 con 0x7efc1c0b2380 2023-07-20T09:51:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc2129d640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0b2380 0x7efc1c0b2810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0cf380 tx=0x7efc1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7837863729f1467 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc1b7fe640 1 -- 172.21.15.82:0/1177442002 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140a5820 con 0x7efc1c0b2380 2023-07-20T09:51:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc1b7fe640 1 -- 172.21.15.82:0/1177442002 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc140a5980 con 0x7efc1c0b2380 2023-07-20T09:51:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc1b7fe640 1 -- 172.21.15.82:0/1177442002 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc140a5d10 con 0x7efc1c0b2380 2023-07-20T09:51:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 -- 172.21.15.82:0/1177442002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0b2380 msgr2=0x7efc1c0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0b2380 0x7efc1c0b2810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0cf380 tx=0x7efc1401c9a0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 -- 172.21.15.82:0/1177442002 shutdown_connections 2023-07-20T09:51:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 --2- 172.21.15.82:0/1177442002 >> v2:172.21.15.183:3300/0 conn(0x7efc1c0cc900 0x7efc1c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0b2380 0x7efc1c0b2810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 --2- 172.21.15.82:0/1177442002 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 -- 172.21.15.82:0/1177442002 >> 172.21.15.82:0/1177442002 conn(0x7efc1c0cada0 msgr2=0x7efc1c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 -- 172.21.15.82:0/1177442002 shutdown_connections 2023-07-20T09:51:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.994+0000 7efc22d00640 1 -- 172.21.15.82:0/1177442002 wait complete. 2023-07-20T09:51:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 Processor -- start 2023-07-20T09:51:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- start start 2023-07-20T09:51:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 0x7efc1c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15bc10 con 0x7efc1c0cc900 2023-07-20T09:51:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0c3df0 con 0x7efc1c0b2380 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15acb0 con 0x7efc1c1596b0 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33278/0 (socket says 172.21.15.82:33278) 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 -- 172.21.15.82:0/2143054910 learned_addr learned my addr 172.21.15.82:0/2143054910 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc20a9c640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 0x7efc1c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc2129d640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 -- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 msgr2=0x7efc1c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 -- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 msgr2=0x7efc1c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 0x7efc1c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 -- 172.21.15.82:0/2143054910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009b30 con 0x7efc1c0cc900 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc20a9c640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 0x7efc1c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc1bfff640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d800 tx=0x7efc0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c0096a0 con 0x7efc1c0cc900 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c009800 con 0x7efc1c0cc900 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c009b70 con 0x7efc1c0cc900 2023-07-20T09:51:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c15af90 con 0x7efc1c0cc900 2023-07-20T09:51:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:10.998+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c15b550 con 0x7efc1c0cc900 2023-07-20T09:51:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c15bd50 con 0x7efc1c0cc900 2023-07-20T09:51:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc0c009cd0 con 0x7efc1c0cc900 2023-07-20T09:51:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc197fa640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 0x7efbfc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efc0c084420 con 0x7efc1c0cc900 2023-07-20T09:51:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc20a9c640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 0x7efbfc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.002+0000 7efc20a9c640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 0x7efbfc068740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc1c15cb00 tx=0x7efc04008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.006+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc1c15bd50 con 0x7efc1c0cc900 2023-07-20T09:51:11.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc1c15bd50 con 0x7efc1c0cc900 2023-07-20T09:51:11.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc197fa640 1 -- 172.21.15.82:0/2143054910 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7efc1c15bd50 con 0x7efc1c0cc900 2023-07-20T09:51:11.223 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:11.223 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:51:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:51:11.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 msgr2=0x7efbfc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 0x7efbfc068740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc1c15cb00 tx=0x7efc04008040 comp rx=0 tx=0).stop 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 msgr2=0x7efc1c0c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d800 tx=0x7efc0c00dcc0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 shutdown_connections 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7efbfc066280 0x7efbfc068740 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc1c1596b0 0x7efc1c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc1c0cc900 0x7efc1c0c38b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 --2- 172.21.15.82:0/2143054910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc1c0b2380 0x7efc1c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 >> 172.21.15.82:0/2143054910 conn(0x7efc1c0cada0 msgr2=0x7efc1c0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 shutdown_connections 2023-07-20T09:51:11.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.186+0000 7efc22d00640 1 -- 172.21.15.82:0/2143054910 wait complete. 2023-07-20T09:51:11.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 Processor -- start 2023-07-20T09:51:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 -- start start 2023-07-20T09:51:11.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c0b2060 0x7f8a4c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0b06c0 con 0x7f8a4c15a8e0 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0b3160 con 0x7f8a4c0afda0 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a535ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0b12a0 con 0x7f8a4c0b2060 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33290/0 (socket says 172.21.15.82:33290) 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 -- 172.21.15.82:0/4050172379 learned_addr learned my addr 172.21.15.82:0/4050172379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:11.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51b57640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c0b2060 0x7f8a4c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 -- 172.21.15.82:0/4050172379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c0b2060 msgr2=0x7f8a4c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:11.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c0b2060 0x7f8a4c0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.346+0000 7f8a51356640 1 -- 172.21.15.82:0/4050172379 >> v1:172.21.15.183:6789/0 conn(0x7f8a4c15a8e0 legacy=0x7f8a4c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:11.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a51356640 1 -- 172.21.15.82:0/4050172379 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0b1580 con 0x7f8a4c0afda0 2023-07-20T09:51:11.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a51356640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264ad3855bdede05 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a43fff640 1 -- 172.21.15.82:0/4050172379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480ab5f0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a43fff640 1 -- 172.21.15.82:0/4050172379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480ab750 con 0x7f8a4c0afda0 2023-07-20T09:51:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a43fff640 1 -- 172.21.15.82:0/4050172379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480abae0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 -- 172.21.15.82:0/4050172379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 msgr2=0x7f8a4c0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4801c3f0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 -- 172.21.15.82:0/4050172379 shutdown_connections 2023-07-20T09:51:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c0b2060 0x7f8a4c0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 --2- 172.21.15.82:0/4050172379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0ca6b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.350+0000 7f8a535ba640 1 -- 172.21.15.82:0/4050172379 >> 172.21.15.82:0/4050172379 conn(0x7f8a4c0cada0 msgr2=0x7f8a4c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- 172.21.15.82:0/4050172379 shutdown_connections 2023-07-20T09:51:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- 172.21.15.82:0/4050172379 wait complete. 2023-07-20T09:51:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 Processor -- start 2023-07-20T09:51:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- start start 2023-07-20T09:51:11.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c0b2060 0x7f8a4c163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 0x7f8a4c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c164120 con 0x7f8a4c0afda0 2023-07-20T09:51:11.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0cd2e0 con 0x7f8a4c0b2060 2023-07-20T09:51:11.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a535ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c162e20 con 0x7f8a4c15a8e0 2023-07-20T09:51:11.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33294/0 (socket says 172.21.15.82:33294) 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 -- 172.21.15.82:0/2293642866 learned_addr learned my addr 172.21.15.82:0/2293642866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a50b55640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c0b2060 0x7f8a4c163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51b57640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 0x7f8a4c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 -- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 msgr2=0x7f8a4c0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 0x7f8a4c0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 -- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c0b2060 msgr2=0x7f8a4c163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c0b2060 0x7f8a4c163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 -- 172.21.15.82:0/2293642866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480094d0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51b57640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 0x7f8a4c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a51356640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ad040 tx=0x7f8a4801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.354+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480be5f0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a480be750 con 0x7f8a4c0afda0 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a480beb00 con 0x7f8a4c0afda0 2023-07-20T09:51:11.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c163100 con 0x7f8a4c0afda0 2023-07-20T09:51:11.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c1636c0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c073c70 con 0x7f8a4c0afda0 2023-07-20T09:51:11.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a480b43f0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a41ffb640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 0x7f8a30068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8a480a8050 con 0x7f8a4c0afda0 2023-07-20T09:51:11.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.358+0000 7f8a50b55640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 0x7f8a30068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.362+0000 7f8a50b55640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 0x7f8a30068740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c06d7d0 tx=0x7f8a3c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.362+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a480ebfa0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.542+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a4c0cb990 con 0x7f8a4c0afda0 2023-07-20T09:51:11.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.542+0000 7f8a41ffb640 1 -- 172.21.15.82:0/2293642866 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4665 (secure 0 0 0) 0x7f8a480ef5c0 con 0x7f8a4c0afda0 2023-07-20T09:51:11.580 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:11.580 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3341867642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3341867642},{"type":"v1","addr":"172.21.15.183:6833","nonce":3341867642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1938876417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1938876417},{"type":"v1","addr":"172.21.15.82:6835","nonce":1938876417}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/364510897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":364510897},{"type":"v1","addr":"172.21.15.82:6837","nonce":364510897}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:50:26.749521+0000","modified":"2023-07-20T09:50:30.705079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/313910073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":313910073},{"type":"v1","addr":"172.21.15.183:6835","nonce":313910073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-20T09:51:11.580 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2023-07-20T09:51:11.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 msgr2=0x7f8a30068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 0x7f8a30068740 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c06d7d0 tx=0x7f8a3c009040 comp rx=0 tx=0).stop 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 msgr2=0x7f8a4c0accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a480ad040 tx=0x7f8a4801ac30 comp rx=0 tx=0).stop 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 shutdown_connections 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a30066280 0x7f8a30068740 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a4c15a8e0 0x7f8a4c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c0b2060 0x7f8a4c163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 --2- 172.21.15.82:0/2293642866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a4c0afda0 0x7f8a4c0accb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 >> 172.21.15.82:0/2293642866 conn(0x7f8a4c0cada0 msgr2=0x7f8a4c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 shutdown_connections 2023-07-20T09:51:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.546+0000 7f8a535ba640 1 -- 172.21.15.82:0/2293642866 wait complete. 2023-07-20T09:51:11.601 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:11.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 Processor -- start 2023-07-20T09:51:11.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 -- start start 2023-07-20T09:51:11.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe2dc1596b0 0x7fe2dc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0ccd90 con 0x7fe2dc0cc900 2023-07-20T09:51:11.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc0ad810 con 0x7fe2dc0b2a90 2023-07-20T09:51:11.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e3c96640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc15d0d0 con 0x7fe2dc1596b0 2023-07-20T09:51:11.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e1231640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe2dc0cc900 0x7fe2dc0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36304/0 (socket says 172.21.15.82:36304) 2023-07-20T09:51:11.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e1231640 1 -- 172.21.15.82:0/616877584 learned_addr learned my addr 172.21.15.82:0/616877584 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:11.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e1a32640 1 --2- 172.21.15.82:0/616877584 >> v2:172.21.15.183:3300/0 conn(0x7fe2dc1596b0 0x7fe2dc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e0a30640 1 -- 172.21.15.82:0/616877584 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571939681 0 0) 0x7fe2dc0ccd90 con 0x7fe2dc0cc900 2023-07-20T09:51:11.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.702+0000 7fe2e0a30640 1 -- 172.21.15.82:0/616877584 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c8003530 con 0x7fe2dc0cc900 2023-07-20T09:51:11.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e1a32640 1 -- 172.21.15.82:0/616877584 >> v1:172.21.15.183:6789/0 conn(0x7fe2dc0b2a90 legacy=0x7fe2dc0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e1a32640 1 -- 172.21.15.82:0/616877584 >> v1:172.21.15.82:6789/0 conn(0x7fe2dc0cc900 legacy=0x7fe2dc0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e1a32640 1 -- 172.21.15.82:0/616877584 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc15d3b0 con 0x7fe2dc1596b0 2023-07-20T09:51:11.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e1a32640 1 --2- 172.21.15.82:0/616877584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc1596b0 0x7fe2dc15dbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80097f0 tx=0x7fe2d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9221478d457559a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e0a30640 1 -- 172.21.15.82:0/616877584 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80ab5f0 con 0x7fe2dc1596b0 2023-07-20T09:51:11.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e0a30640 1 -- 172.21.15.82:0/616877584 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d80ab750 con 0x7fe2dc1596b0 2023-07-20T09:51:11.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e0a30640 1 -- 172.21.15.82:0/616877584 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80abac0 con 0x7fe2dc1596b0 2023-07-20T09:51:11.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e3c96640 1 -- 172.21.15.82:0/616877584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc1596b0 msgr2=0x7fe2dc15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/616877584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc1596b0 0x7fe2dc15dbb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80097f0 tx=0x7fe2d801c450 comp rx=0 tx=0).stop 2023-07-20T09:51:11.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e3c96640 1 -- 172.21.15.82:0/616877584 shutdown_connections 2023-07-20T09:51:11.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.706+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/616877584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc1596b0 0x7fe2dc15dbb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- 172.21.15.82:0/616877584 >> 172.21.15.82:0/616877584 conn(0x7fe2dc0cada0 msgr2=0x7fe2dc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- 172.21.15.82:0/616877584 shutdown_connections 2023-07-20T09:51:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- 172.21.15.82:0/616877584 wait complete. 2023-07-20T09:51:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 Processor -- start 2023-07-20T09:51:11.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- start start 2023-07-20T09:51:11.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc0b2a90 0x7fe2dc0c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 0x7fe2dc156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0aceb0 con 0x7fe2dc0cc900 2023-07-20T09:51:11.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c1f80 con 0x7fe2dc0b2a90 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e3c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc0c2260 con 0x7fe2dc1596b0 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33308/0 (socket says 172.21.15.82:33308) 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 -- 172.21.15.82:0/2222085439 learned_addr learned my addr 172.21.15.82:0/2222085439 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1a32640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc0b2a90 0x7fe2dc0c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e2233640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 0x7fe2dc156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 -- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 msgr2=0x7fe2dc156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 0x7fe2dc156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 -- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc0b2a90 msgr2=0x7fe2dc0c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc0b2a90 0x7fe2dc0c17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 -- 172.21.15.82:0/2222085439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8009420 con 0x7fe2dc0cc900 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e2233640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 0x7fe2dc156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.710+0000 7fe2e1231640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c4d0 tx=0x7fe2cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc005cf0 con 0x7fe2dc0cc900 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc005e50 con 0x7fe2dc0cc900 2023-07-20T09:51:11.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc0c2540 con 0x7fe2dc0cc900 2023-07-20T09:51:11.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc007270 con 0x7fe2dc0cc900 2023-07-20T09:51:11.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc0c2d40 con 0x7fe2dc0cc900 2023-07-20T09:51:11.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc073c70 con 0x7fe2dc0cc900 2023-07-20T09:51:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2cc0073d0 con 0x7fe2dc0cc900 2023-07-20T09:51:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 0x7fe2c0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe2cc083270 con 0x7fe2dc0cc900 2023-07-20T09:51:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2e1a32640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 0x7fe2c0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:11.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.714+0000 7fe2e1a32640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 0x7fe2c0068740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:11.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.718+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2cc050750 con 0x7fe2dc0cc900 2023-07-20T09:51:11.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.866+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2dc0c29f0 con 0x7fe2dc0cc900 2023-07-20T09:51:11.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2d27fc640 1 -- 172.21.15.82:0/2222085439 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fe2cc053d70 con 0x7fe2dc0cc900 2023-07-20T09:51:11.906 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:11.906 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:07.672286+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:50:24.400019+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-20T09:50:25.754235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 msgr2=0x7fe2c0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 0x7fe2c0068740 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d80a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 msgr2=0x7fe2dc0c45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c4d0 tx=0x7fe2cc00c990 comp rx=0 tx=0).stop 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 shutdown_connections 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fe2c0066280 0x7fe2c0068740 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe2dc1596b0 0x7fe2dc156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2dc0cc900 0x7fe2dc0c45d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 --2- 172.21.15.82:0/2222085439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe2dc0b2a90 0x7fe2dc0c17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:11.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 >> 172.21.15.82:0/2222085439 conn(0x7fe2dc0cada0 msgr2=0x7fe2dc1674e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:11.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 shutdown_connections 2023-07-20T09:51:11.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:11.870+0000 7fe2e3c96640 1 -- 172.21.15.82:0/2222085439 wait complete. 2023-07-20T09:51:11.928 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T09:51:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.030+0000 7f08e9ed8640 1 Processor -- start 2023-07-20T09:51:12.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e9ed8640 1 -- start start 2023-07-20T09:51:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e9ed8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 0x7f08e415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e9ed8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40cde70 con 0x7f08e40ca040 2023-07-20T09:51:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e9ed8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40cbef0 con 0x7f08e40b1170 2023-07-20T09:51:12.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e9ed8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40ca420 con 0x7f08e40ad060 2023-07-20T09:51:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f08e40ca040 0x7f08e415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36320/0 (socket says 172.21.15.82:36320) 2023-07-20T09:51:12.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e37fe640 1 -- 172.21.15.82:0/3146725175 learned_addr learned my addr 172.21.15.82:0/3146725175 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/3146725175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 0x7f08e415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378545467 0 0) 0x7f08e40cde70 con 0x7f08e40ca040 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc003530 con 0x7f08e40ca040 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608692145 0 0) 0x7f08e40cbef0 con 0x7f08e40b1170 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e40cde70 con 0x7f08e40b1170 2023-07-20T09:51:12.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279017731 0 0) 0x7f08cc003530 con 0x7f08e40ca040 2023-07-20T09:51:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e2ffd640 1 -- 172.21.15.82:0/3146725175 >> v1:172.21.15.183:6789/0 conn(0x7f08e40b1170 legacy=0x7f08e40b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e2ffd640 1 -- 172.21.15.82:0/3146725175 >> v1:172.21.15.82:6789/0 conn(0x7f08e40ca040 legacy=0x7f08e415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.034+0000 7f08e2ffd640 1 -- 172.21.15.82:0/3146725175 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40cdb40 con 0x7f08e40ad060 2023-07-20T09:51:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/3146725175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 0x7f08e415d020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097f0 tx=0x7f08d801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a48ffc353fdd5c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4001680 con 0x7f08e40ad060 2023-07-20T09:51:12.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d80a7050 con 0x7f08e40ad060 2023-07-20T09:51:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e27fc640 1 -- 172.21.15.82:0/3146725175 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80ab620 con 0x7f08e40ad060 2023-07-20T09:51:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 -- 172.21.15.82:0/3146725175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 msgr2=0x7f08e415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/3146725175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 0x7f08e415d020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f08d80097f0 tx=0x7f08d801c3b0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 -- 172.21.15.82:0/3146725175 shutdown_connections 2023-07-20T09:51:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/3146725175 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ad060 0x7f08e415d020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 -- 172.21.15.82:0/3146725175 >> 172.21.15.82:0/3146725175 conn(0x7f08e40cada0 msgr2=0x7f08e40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 -- 172.21.15.82:0/3146725175 shutdown_connections 2023-07-20T09:51:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 -- 172.21.15.82:0/3146725175 wait complete. 2023-07-20T09:51:12.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.038+0000 7f08e9ed8640 1 Processor -- start 2023-07-20T09:51:12.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- start start 2023-07-20T09:51:12.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 0x7f08e4157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ca040 0x7f08e40aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4099b30 con 0x7f08e40ad060 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4099e10 con 0x7f08e40b1170 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e409a0f0 con 0x7f08e40ca040 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33318/0 (socket says 172.21.15.82:33318) 2023-07-20T09:51:12.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 -- 172.21.15.82:0/1397376369 learned_addr learned my addr 172.21.15.82:0/1397376369 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:12.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 0x7f08e4157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e3fff640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ca040 0x7f08e40aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 -- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ca040 msgr2=0x7f08e40aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ca040 0x7f08e40aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 -- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 msgr2=0x7f08e4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 0x7f08e4157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 -- 172.21.15.82:0/1397376369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009420 con 0x7f08e40ad060 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 0x7f08e4157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:12.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e37fe640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c730 tx=0x7f08d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005ae0 con 0x7f08e40ad060 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d4005c40 con 0x7f08e40ad060 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e409a3d0 con 0x7f08e40ad060 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4007070 con 0x7f08e40ad060 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4099740 con 0x7f08e40ad060 2023-07-20T09:51:12.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.042+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e406d720 con 0x7f08e40ad060 2023-07-20T09:51:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.046+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08d40071d0 con 0x7f08e40ad060 2023-07-20T09:51:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.046+0000 7f08cbfff640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 0x7f08d0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.046+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f08d4083ac0 con 0x7f08e40ad060 2023-07-20T09:51:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.046+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 0x7f08d0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.046+0000 7f08e2ffd640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 0x7f08d0068740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f08d80ad000 tx=0x7f08d80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.050+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08d4050ef0 con 0x7f08e40ad060 2023-07-20T09:51:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.230+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08e4073c70 con 0x7f08e40ad060 2023-07-20T09:51:12.266 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T09:51:12.230+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T09:51:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08cbfff640 1 -- 172.21.15.82:0/1397376369 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08d4054510 con 0x7f08e40ad060 2023-07-20T09:51:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T09:51:12.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 msgr2=0x7f08d0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 0x7f08d0068740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f08d80ad000 tx=0x7f08d80a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 msgr2=0x7f08e4099200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c730 tx=0x7f08d400cbf0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 shutdown_connections 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f08d0066280 0x7f08d0068740 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08e40ca040 0x7f08e40aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08e40b1170 0x7f08e4157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 --2- 172.21.15.82:0/1397376369 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08e40ad060 0x7f08e4099200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 >> 172.21.15.82:0/1397376369 conn(0x7f08e40cada0 msgr2=0x7f08e41589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 shutdown_connections 2023-07-20T09:51:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.238+0000 7f08e9ed8640 1 -- 172.21.15.82:0/1397376369 wait complete. 2023-07-20T09:51:12.285 INFO:tasks.ceph.mds.d.smithi183.stderr: -6851> 2023-07-20T09:50:32.507+0000 7f8c0da20640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T09:51:12.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T09:51:12.338 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T09:51:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 Processor -- start 2023-07-20T09:51:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 -- start start 2023-07-20T09:51:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9c00cb610 0x7fb9c00b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c00c9190 con 0x7fb9c015c7e0 2023-07-20T09:51:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c015cbc0 con 0x7fb9c006cb80 2023-07-20T09:51:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.398+0000 7fb9c8311640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c0160ba0 con 0x7fb9c00cb610 2023-07-20T09:51:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c60ad640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb9c015c7e0 0x7fb9c0160370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36322/0 (socket says 172.21.15.82:36322) 2023-07-20T09:51:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c60ad640 1 -- 172.21.15.82:0/3879450549 learned_addr learned my addr 172.21.15.82:0/3879450549 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c68ae640 1 --2- 172.21.15.82:0/3879450549 >> v2:172.21.15.82:3300/0 conn(0x7fb9c00cb610 0x7fb9c00b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c68ae640 1 -- 172.21.15.82:0/3879450549 >> v1:172.21.15.183:6789/0 conn(0x7fb9c006cb80 legacy=0x7fb9c00caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c68ae640 1 -- 172.21.15.82:0/3879450549 >> v1:172.21.15.82:6789/0 conn(0x7fb9c015c7e0 legacy=0x7fb9c0160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c68ae640 1 -- 172.21.15.82:0/3879450549 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0160e80 con 0x7fb9c00cb610 2023-07-20T09:51:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c68ae640 1 --2- 172.21.15.82:0/3879450549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c00b2230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009d90 tx=0x7fb9b801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e3d94da20fcffb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c50ab640 1 -- 172.21.15.82:0/3879450549 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80a59a0 con 0x7fb9c00cb610 2023-07-20T09:51:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c50ab640 1 -- 172.21.15.82:0/3879450549 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b80a5b00 con 0x7fb9c00cb610 2023-07-20T09:51:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.402+0000 7fb9c50ab640 1 -- 172.21.15.82:0/3879450549 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80a5e90 con 0x7fb9c00cb610 2023-07-20T09:51:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- 172.21.15.82:0/3879450549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 msgr2=0x7fb9c00b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 --2- 172.21.15.82:0/3879450549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c00b2230 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009d90 tx=0x7fb9b801c8e0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- 172.21.15.82:0/3879450549 shutdown_connections 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 --2- 172.21.15.82:0/3879450549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c00b2230 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- 172.21.15.82:0/3879450549 >> 172.21.15.82:0/3879450549 conn(0x7fb9c0065710 msgr2=0x7fb9c0069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- 172.21.15.82:0/3879450549 shutdown_connections 2023-07-20T09:51:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- 172.21.15.82:0/3879450549 wait complete. 2023-07-20T09:51:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 Processor -- start 2023-07-20T09:51:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- start start 2023-07-20T09:51:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9c006cb80 0x7fb9c015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 0x7fb9c006fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c015e750 con 0x7fb9c00cb610 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01542c0 con 0x7fb9c006cb80 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c8311640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01545a0 con 0x7fb9c015c7e0 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33334/0 (socket says 172.21.15.82:33334) 2023-07-20T09:51:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 -- 172.21.15.82:0/1610671954 learned_addr learned my addr 172.21.15.82:0/1610671954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c68ae640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 0x7fb9c006fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c60ad640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9c006cb80 0x7fb9c015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 -- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 msgr2=0x7fb9c006fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 0x7fb9c006fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 -- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9c006cb80 msgr2=0x7fb9c015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9c006cb80 0x7fb9c015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c58ac640 1 -- 172.21.15.82:0/1610671954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8009a70 con 0x7fb9c00cb610 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.406+0000 7fb9c68ae640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 0x7fb9c006fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9c58ac640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000b410 tx=0x7fb9b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0004020 con 0x7fb9c00cb610 2023-07-20T09:51:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0004180 con 0x7fb9c00cb610 2023-07-20T09:51:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0154880 con 0x7fb9c00cb610 2023-07-20T09:51:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0011630 con 0x7fb9c00cb610 2023-07-20T09:51:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0154e40 con 0x7fb9c00cb610 2023-07-20T09:51:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c004da30 con 0x7fb9c00cb610 2023-07-20T09:51:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9b0011790 con 0x7fb9c00cb610 2023-07-20T09:51:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 0x7fb9a4068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fb9b0083b20 con 0x7fb9c00cb610 2023-07-20T09:51:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.410+0000 7fb9c60ad640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 0x7fb9a4068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.414+0000 7fb9c60ad640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 0x7fb9a4068740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc005890 tx=0x7fb9bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.414+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9b0050f00 con 0x7fb9c00cb610 2023-07-20T09:51:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:12.594+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9c006a520 con 0x7fb9c00cb610 2023-07-20T09:51:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.234+0000 7fb9b6ffd640 1 -- 172.21.15.82:0/1610671954 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9b0054520 con 0x7fb9c00cb610 2023-07-20T09:51:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 msgr2=0x7fb9a4068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 0x7fb9a4068740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc005890 tx=0x7fb9bc009040 comp rx=0 tx=0).stop 2023-07-20T09:51:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 msgr2=0x7fb9c0155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000b410 tx=0x7fb9b000b8d0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 shutdown_connections 2023-07-20T09:51:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb9a4066280 0x7fb9a4068740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9c015c7e0 0x7fb9c006fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9c00cb610 0x7fb9c0155360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 --2- 172.21.15.82:0/1610671954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9c006cb80 0x7fb9c015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 >> 172.21.15.82:0/1610671954 conn(0x7fb9c0065710 msgr2=0x7fb9c00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 shutdown_connections 2023-07-20T09:51:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.238+0000 7fb9c8311640 1 -- 172.21.15.82:0/1610671954 wait complete. 2023-07-20T09:51:13.295 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T09:51:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 Processor -- start 2023-07-20T09:51:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 -- start start 2023-07-20T09:51:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1dc158ce0 0x7ff1dc0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc0c95d0 con 0x7ff1dc070970 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc0c9fa0 con 0x7ff1dc06bd30 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.402+0000 7ff1e1137640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc1590c0 con 0x7ff1dc158ce0 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1dad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1dc158ce0 0x7ff1dc0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1d259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff1dc070970 0x7ff1dc06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55468/0 (socket says 172.21.15.82:55468) 2023-07-20T09:51:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1d259c640 1 -- 172.21.15.82:0/2092399213 learned_addr learned my addr 172.21.15.82:0/2092399213 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1dad9d640 1 -- 172.21.15.82:0/2092399213 >> v1:172.21.15.183:6789/0 conn(0x7ff1dc06bd30 legacy=0x7ff1dc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1dad9d640 1 -- 172.21.15.82:0/2092399213 >> v1:172.21.15.82:6789/0 conn(0x7ff1dc070970 legacy=0x7ff1dc06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1dad9d640 1 -- 172.21.15.82:0/2092399213 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0c89c0 con 0x7ff1dc158ce0 2023-07-20T09:51:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1dad9d640 1 --2- 172.21.15.82:0/2092399213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc0c9a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40097c0 tx=0x7ff1c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f6102a2d67dbff server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1da59c640 1 -- 172.21.15.82:0/2092399213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40ab650 con 0x7ff1dc158ce0 2023-07-20T09:51:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1da59c640 1 -- 172.21.15.82:0/2092399213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40ab7b0 con 0x7ff1dc158ce0 2023-07-20T09:51:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.406+0000 7ff1da59c640 1 -- 172.21.15.82:0/2092399213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40abb40 con 0x7ff1dc158ce0 2023-07-20T09:51:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- 172.21.15.82:0/2092399213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc158ce0 msgr2=0x7ff1dc0c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 --2- 172.21.15.82:0/2092399213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc0c9a60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40097c0 tx=0x7ff1c401c450 comp rx=0 tx=0).stop 2023-07-20T09:51:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- 172.21.15.82:0/2092399213 shutdown_connections 2023-07-20T09:51:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 --2- 172.21.15.82:0/2092399213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc0c9a60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- 172.21.15.82:0/2092399213 >> 172.21.15.82:0/2092399213 conn(0x7ff1dc0cad50 msgr2=0x7ff1dc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- 172.21.15.82:0/2092399213 shutdown_connections 2023-07-20T09:51:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- 172.21.15.82:0/2092399213 wait complete. 2023-07-20T09:51:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 Processor -- start 2023-07-20T09:51:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- start start 2023-07-20T09:51:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1dc070970 0x7ff1dc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c2f90 con 0x7ff1dc06bd30 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c2380 con 0x7ff1dc158ce0 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1e1137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc0c2660 con 0x7ff1dc070970 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1dad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55074/0 (socket says 172.21.15.82:55074) 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1dad9d640 1 -- 172.21.15.82:0/499682930 learned_addr learned my addr 172.21.15.82:0/499682930 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1d259c640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1dc070970 0x7ff1dc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.410+0000 7ff1db59e640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 -- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1dc070970 msgr2=0x7ff1dc14c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1dc070970 0x7ff1dc14c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 -- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 msgr2=0x7ff1dc157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 -- 172.21.15.82:0/499682930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009420 con 0x7ff1dc06bd30 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1db59e640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1dad9d640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40ad040 tx=0x7ff1c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40b5810 con 0x7ff1dc06bd30 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40b5970 con 0x7ff1dc06bd30 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc0c2940 con 0x7ff1dc06bd30 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40b5d20 con 0x7ff1dc06bd30 2023-07-20T09:51:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc0c2010 con 0x7ff1dc06bd30 2023-07-20T09:51:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc04da30 con 0x7ff1dc06bd30 2023-07-20T09:51:13.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1c40bf410 con 0x7ff1dc06bd30 2023-07-20T09:51:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 0x7ff1bc068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7ff1c411ed40 con 0x7ff1dc06bd30 2023-07-20T09:51:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.414+0000 7ff1d259c640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 0x7ff1bc068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:13.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.418+0000 7ff1d259c640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 0x7ff1bc068770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b3610 tx=0x7ff1cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:13.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.418+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1c40ec300 con 0x7ff1dc06bd30 2023-07-20T09:51:13.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:13.566+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1dc0b4250 con 0x7ff1dc06bd30 2023-07-20T09:51:14.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.245+0000 7ff1d3fff640 1 -- 172.21.15.82:0/499682930 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1c40ef920 con 0x7ff1dc06bd30 2023-07-20T09:51:14.286 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T09:51:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 msgr2=0x7ff1bc068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 0x7ff1bc068770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0b3610 tx=0x7ff1cc009040 comp rx=0 tx=0).stop 2023-07-20T09:51:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 msgr2=0x7ff1dc0c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40ad040 tx=0x7ff1c401ac90 comp rx=0 tx=0).stop 2023-07-20T09:51:14.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 shutdown_connections 2023-07-20T09:51:14.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff1bc0662b0 0x7ff1bc068770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff1dc158ce0 0x7ff1dc157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1dc070970 0x7ff1dc14c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 --2- 172.21.15.82:0/499682930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1dc06bd30 0x7ff1dc0c3420 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 >> 172.21.15.82:0/499682930 conn(0x7ff1dc0cad50 msgr2=0x7ff1dc0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 shutdown_connections 2023-07-20T09:51:14.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.253+0000 7ff1e1137640 1 -- 172.21.15.82:0/499682930 wait complete. 2023-07-20T09:51:14.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T09:51:14.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 Processor -- start 2023-07-20T09:51:14.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 -- start start 2023-07-20T09:51:14.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5ba40ad580 0x7f5ba40ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba4160390 con 0x7f5ba40afd50 2023-07-20T09:51:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40cc1d0 con 0x7f5ba4160820 2023-07-20T09:51:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba918f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba40cc4b0 con 0x7f5ba40ad580 2023-07-20T09:51:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba2d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5ba40afd50 0x7f5ba40b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55470/0 (socket says 172.21.15.82:55470) 2023-07-20T09:51:14.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba2d9d640 1 -- 172.21.15.82:0/3157645170 learned_addr learned my addr 172.21.15.82:0/3157645170 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba259c640 1 --2- 172.21.15.82:0/3157645170 >> v2:172.21.15.82:3300/0 conn(0x7f5ba40ad580 0x7f5ba40ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba1d9b640 1 -- 172.21.15.82:0/3157645170 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825756942 0 0) 0x7f5ba4160390 con 0x7f5ba40afd50 2023-07-20T09:51:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba1d9b640 1 -- 172.21.15.82:0/3157645170 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8c003530 con 0x7f5ba40afd50 2023-07-20T09:51:14.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba259c640 1 -- 172.21.15.82:0/3157645170 >> v1:172.21.15.183:6789/0 conn(0x7f5ba4160820 legacy=0x7f5ba4160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba259c640 1 -- 172.21.15.82:0/3157645170 >> v1:172.21.15.82:6789/0 conn(0x7f5ba40afd50 legacy=0x7f5ba40b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.425+0000 7f5ba259c640 1 -- 172.21.15.82:0/3157645170 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40cc790 con 0x7f5ba40ad580 2023-07-20T09:51:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba259c640 1 --2- 172.21.15.82:0/3157645170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba40ac770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b980097c0 tx=0x7f5b9801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611ecd01d5d0b2cc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:14.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba1d9b640 1 -- 172.21.15.82:0/3157645170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980ab620 con 0x7f5ba40ad580 2023-07-20T09:51:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba1d9b640 1 -- 172.21.15.82:0/3157645170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b980ab780 con 0x7f5ba40ad580 2023-07-20T09:51:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba1d9b640 1 -- 172.21.15.82:0/3157645170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980abb10 con 0x7f5ba40ad580 2023-07-20T09:51:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 -- 172.21.15.82:0/3157645170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 msgr2=0x7f5ba40ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 --2- 172.21.15.82:0/3157645170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba40ac770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b980097c0 tx=0x7f5b9801c480 comp rx=0 tx=0).stop 2023-07-20T09:51:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 -- 172.21.15.82:0/3157645170 shutdown_connections 2023-07-20T09:51:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 --2- 172.21.15.82:0/3157645170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba40ac770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 -- 172.21.15.82:0/3157645170 >> 172.21.15.82:0/3157645170 conn(0x7f5ba40cad50 msgr2=0x7f5ba40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 -- 172.21.15.82:0/3157645170 shutdown_connections 2023-07-20T09:51:14.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.429+0000 7f5ba918f640 1 -- 172.21.15.82:0/3157645170 wait complete. 2023-07-20T09:51:14.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 Processor -- start 2023-07-20T09:51:14.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- start start 2023-07-20T09:51:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:14.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 0x7f5ba415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ba4160820 0x7f5ba415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4155260 con 0x7f5ba40ad580 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415b610 con 0x7f5ba40afd50 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415fd60 con 0x7f5ba4160820 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55090/0 (socket says 172.21.15.82:55090) 2023-07-20T09:51:14.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 -- 172.21.15.82:0/22758805 learned_addr learned my addr 172.21.15.82:0/22758805 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba259c640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 0x7f5ba415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:14.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba359e640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ba4160820 0x7f5ba415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 -- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ba4160820 msgr2=0x7f5ba415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ba4160820 0x7f5ba415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 -- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 msgr2=0x7f5ba415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 0x7f5ba415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:14.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 -- 172.21.15.82:0/22758805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009420 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba259c640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 0x7f5ba415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba2d9d640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c4d0 tx=0x7f5b9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94005cf0 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94005e50 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94007270 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba415da10 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415dfd0 con 0x7f5ba40ad580 2023-07-20T09:51:14.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.433+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba41553a0 con 0x7f5ba40ad580 2023-07-20T09:51:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.437+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b940073d0 con 0x7f5ba40ad580 2023-07-20T09:51:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.437+0000 7f5b8b7fe640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 0x7f5b90068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.437+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f5b94083150 con 0x7f5ba40ad580 2023-07-20T09:51:14.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.437+0000 7f5ba259c640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 0x7f5b90068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:14.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.437+0000 7f5ba259c640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 0x7f5b90068740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b980af000 tx=0x7f5b980a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.441+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b94050780 con 0x7f5ba40ad580 2023-07-20T09:51:14.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:14.589+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ba404da30 con 0x7f5ba40ad580 2023-07-20T09:51:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.261+0000 7f5b8b7fe640 1 -- 172.21.15.82:0/22758805 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5b94053da0 con 0x7f5ba40ad580 2023-07-20T09:51:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T09:51:15.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.269+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 msgr2=0x7f5b90068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.269+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 0x7f5b90068740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b980af000 tx=0x7f5b980a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:15.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.269+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 msgr2=0x7f5ba4152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.269+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400c4d0 tx=0x7f5b9400c990 comp rx=0 tx=0).stop 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 shutdown_connections 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f5b90066280 0x7f5b90068740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ba4160820 0x7f5ba415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ba40afd50 0x7f5ba415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 --2- 172.21.15.82:0/22758805 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ba40ad580 0x7f5ba4152b30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 >> 172.21.15.82:0/22758805 conn(0x7f5ba40cad50 msgr2=0x7f5ba40ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 shutdown_connections 2023-07-20T09:51:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.273+0000 7f5ba918f640 1 -- 172.21.15.82:0/22758805 wait complete. 2023-07-20T09:51:15.338 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T09:51:15.338 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T09:51:15.338 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T09:51:15.339 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T09:51:15.339 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T09:51:15.339 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T09:51:15.339 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T09:51:15.340 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T09:51:15.340 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T09:51:15.340 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T09:51:15.340 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T09:51:15.340 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T09:51:15.341 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T09:51:15.341 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T09:51:15.341 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T09:51:15.341 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T09:51:15.354 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T09:51:15.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T09:51:15.355 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T09:51:15.356 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T09:51:15.356 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T09:51:15.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T09:51:15.357 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T09:51:15.357 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T09:51:15.400 INFO:tasks.ceph.mds.c:Started 2023-07-20T09:51:15.400 DEBUG:teuthology.parallel:result is None 2023-07-20T09:51:15.401 INFO:tasks.ceph.mds.a:Started 2023-07-20T09:51:15.402 DEBUG:teuthology.parallel:result is None 2023-07-20T09:51:15.406 INFO:tasks.ceph.mds.b:Started 2023-07-20T09:51:15.406 DEBUG:teuthology.parallel:result is None 2023-07-20T09:51:15.408 INFO:tasks.ceph.mds.d:Started 2023-07-20T09:51:15.408 DEBUG:teuthology.parallel:result is None 2023-07-20T09:51:15.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T09:51:15.488 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T09:51:15.489 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T09:51:15.498 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T09:51:15.499 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T09:51:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 Processor -- start 2023-07-20T09:51:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 -- start start 2023-07-20T09:51:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef5415c5f0 0x7fef540b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef540b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540b7c20 con 0x7fef540ccfb0 2023-07-20T09:51:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5415c9d0 con 0x7fef5415c5f0 2023-07-20T09:51:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5a0a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ce030 con 0x7fef540ceb70 2023-07-20T09:51:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef5415c5f0 0x7fef540b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fef5415c5f0 0x7fef540b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55146/0 (socket says 172.21.15.82:55146) 2023-07-20T09:51:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 -- 172.21.15.82:0/1480184197 learned_addr learned my addr 172.21.15.82:0/1480184197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef598a0640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef540b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 -- 172.21.15.82:0/1480184197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 msgr2=0x7fef540b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef540b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 -- 172.21.15.82:0/1480184197 >> v1:172.21.15.82:6789/0 conn(0x7fef540ccfb0 legacy=0x7fef540ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef5909f640 1 -- 172.21.15.82:0/1480184197 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540cd4b0 con 0x7fef5415c5f0 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef4bfff640 1 -- 172.21.15.82:0/1480184197 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131370738 0 0) 0x7fef540b7c20 con 0x7fef540ccfb0 2023-07-20T09:51:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.521+0000 7fef598a0640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef540b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5909f640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef540b4270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e50 tx=0x7fef5001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21e83e5fa548c90 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef4bfff640 1 -- 172.21.15.82:0/1480184197 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500af400 con 0x7fef5415c5f0 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef4bfff640 1 -- 172.21.15.82:0/1480184197 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef500ab050 con 0x7fef5415c5f0 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef4bfff640 1 -- 172.21.15.82:0/1480184197 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef500af780 con 0x7fef5415c5f0 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 -- 172.21.15.82:0/1480184197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 msgr2=0x7fef540b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef540b4270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fef50009e50 tx=0x7fef5001f1f0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 -- 172.21.15.82:0/1480184197 shutdown_connections 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef540b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/1480184197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef540b4270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 -- 172.21.15.82:0/1480184197 >> 172.21.15.82:0/1480184197 conn(0x7fef54065710 msgr2=0x7fef54065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 -- 172.21.15.82:0/1480184197 shutdown_connections 2023-07-20T09:51:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.525+0000 7fef5a0a1640 1 -- 172.21.15.82:0/1480184197 wait complete. 2023-07-20T09:51:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 Processor -- start 2023-07-20T09:51:15.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- start start 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef540ccfb0 0x7fef540b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef541544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540cb590 con 0x7fef5415c5f0 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ca630 con 0x7fef540ccfb0 2023-07-20T09:51:15.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540ca910 con 0x7fef540ceb70 2023-07-20T09:51:15.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55160/0 (socket says 172.21.15.82:55160) 2023-07-20T09:51:15.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 -- 172.21.15.82:0/2510768481 learned_addr learned my addr 172.21.15.82:0/2510768481 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:15.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5909f640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef540ccfb0 0x7fef540b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5889e640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef541544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 -- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 msgr2=0x7fef541544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef541544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 -- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef540ccfb0 msgr2=0x7fef540b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef540ccfb0 0x7fef540b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:15.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 -- 172.21.15.82:0/2510768481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009b30 con 0x7fef5415c5f0 2023-07-20T09:51:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef598a0640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c7f0 tx=0x7fef4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007820 con 0x7fef5415c5f0 2023-07-20T09:51:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c0079c0 con 0x7fef5415c5f0 2023-07-20T09:51:15.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c007d70 con 0x7fef5415c5f0 2023-07-20T09:51:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef540cabf0 con 0x7fef5415c5f0 2023-07-20T09:51:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.529+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef540cb1b0 con 0x7fef5415c5f0 2023-07-20T09:51:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5404da30 con 0x7fef5415c5f0 2023-07-20T09:51:15.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef4c0113f0 con 0x7fef5415c5f0 2023-07-20T09:51:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef49ffb640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 0x7fef38068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fef4c083d10 con 0x7fef5415c5f0 2023-07-20T09:51:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef5909f640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 0x7fef38068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:15.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.533+0000 7fef5909f640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 0x7fef38068740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef500b1000 tx=0x7fef500aa000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:15.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.537+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef4c089020 con 0x7fef5415c5f0 2023-07-20T09:51:15.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:15.721+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fef5415cdc0 con 0x7fef5415c5f0 2023-07-20T09:51:16.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef49ffb640 1 -- 172.21.15.82:0/2510768481 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7fef4c01f080 con 0x7fef5415c5f0 2023-07-20T09:51:16.734 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T09:51:16.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 msgr2=0x7fef38068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 0x7fef38068740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fef500b1000 tx=0x7fef500aa000 comp rx=0 tx=0).stop 2023-07-20T09:51:16.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 msgr2=0x7fef54154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00c7f0 tx=0x7fef4c00ccb0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 shutdown_connections 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fef38066280 0x7fef38068740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef5415c5f0 0x7fef54154a10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fef540ceb70 0x7fef541544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 --2- 172.21.15.82:0/2510768481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fef540ccfb0 0x7fef540b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 >> 172.21.15.82:0/2510768481 conn(0x7fef54065710 msgr2=0x7fef5406a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:16.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 shutdown_connections 2023-07-20T09:51:16.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.697+0000 7fef5a0a1640 1 -- 172.21.15.82:0/2510768481 wait complete. 2023-07-20T09:51:16.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T09:51:16.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 Processor -- start 2023-07-20T09:51:16.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 -- start start 2023-07-20T09:51:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80680d0d10 0x7f80680d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680cd4b0 0x7f80680cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680d16b0 con 0x7f806815cab0 2023-07-20T09:51:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680d31c0 con 0x7f80680d0d10 2023-07-20T09:51:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806fe93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80680b3520 con 0x7f80680cd4b0 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80680d0d10 0x7f80680d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f80680d0d10 0x7f80680d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55176/0 (socket says 172.21.15.82:55176) 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 -- 172.21.15.82:0/1192047000 learned_addr learned my addr 172.21.15.82:0/1192047000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806e430640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680cd4b0 0x7f80680cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 -- 172.21.15.82:0/1192047000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680cd4b0 msgr2=0x7f80680cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680cd4b0 0x7f80680cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 -- 172.21.15.82:0/1192047000 >> v1:172.21.15.82:6789/0 conn(0x7f806815cab0 legacy=0x7f80680d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806d42e640 1 -- 172.21.15.82:0/1192047000 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680d0a10 con 0x7f80680d0d10 2023-07-20T09:51:16.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.865+0000 7f806cc2d640 1 -- 172.21.15.82:0/1192047000 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045762187 0 0) 0x7f80680d16b0 con 0x7f806815cab0 2023-07-20T09:51:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806d42e640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680d0d10 0x7f80680d1170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8058009870 tx=0x7f805801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a496b95ab483ea server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:16.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806cc2d640 1 -- 172.21.15.82:0/1192047000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580aa670 con 0x7f80680d0d10 2023-07-20T09:51:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806cc2d640 1 -- 172.21.15.82:0/1192047000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80580aa7d0 con 0x7f80680d0d10 2023-07-20T09:51:16.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806cc2d640 1 -- 172.21.15.82:0/1192047000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80580aab60 con 0x7f80680d0d10 2023-07-20T09:51:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 -- 172.21.15.82:0/1192047000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680d0d10 msgr2=0x7f80680d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680d0d10 0x7f80680d1170 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8058009870 tx=0x7f805801c510 comp rx=0 tx=0).stop 2023-07-20T09:51:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 -- 172.21.15.82:0/1192047000 shutdown_connections 2023-07-20T09:51:16.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680cd4b0 0x7f80680cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 --2- 172.21.15.82:0/1192047000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680d0d10 0x7f80680d1170 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 -- 172.21.15.82:0/1192047000 >> 172.21.15.82:0/1192047000 conn(0x7f806808c120 msgr2=0x7f806809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 -- 172.21.15.82:0/1192047000 shutdown_connections 2023-07-20T09:51:16.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.869+0000 7f806fe93640 1 -- 172.21.15.82:0/1192047000 wait complete. 2023-07-20T09:51:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 Processor -- start 2023-07-20T09:51:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- start start 2023-07-20T09:51:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 0x7f806814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 0x7f8068154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068155320 con 0x7f80680cd4b0 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806814bcd0 con 0x7f806815cab0 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806814a5f0 con 0x7f80680d0d10 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55192/0 (socket says 172.21.15.82:55192) 2023-07-20T09:51:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 -- 172.21.15.82:0/466831851 learned_addr learned my addr 172.21.15.82:0/466831851 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806d42e640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 0x7f806814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806e430640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 0x7f8068154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 -- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 msgr2=0x7f806814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 0x7f806814b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 -- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 msgr2=0x7f8068154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 0x7f8068154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 -- 172.21.15.82:0/466831851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580094d0 con 0x7f80680cd4b0 2023-07-20T09:51:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806e430640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 0x7f8068154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806d42e640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 0x7f806814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806dc2f640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8064001ec0 tx=0x7f806400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640054e0 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8064003600 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640039b0 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806814a8d0 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.873+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806814ae90 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806814b080 con 0x7f80680cd4b0 2023-07-20T09:51:16.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8064003b10 con 0x7f80680cd4b0 2023-07-20T09:51:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f805e7fc640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 0x7f804c068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f80640830a0 con 0x7f80680cd4b0 2023-07-20T09:51:16.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f806d42e640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 0x7f804c068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.877+0000 7f806d42e640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 0x7f804c068770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80580ae000 tx=0x7f80580a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:16.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:16.881+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80640541e0 con 0x7f80680cd4b0 2023-07-20T09:51:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8068073c70 con 0x7f80680cd4b0 2023-07-20T09:51:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f805e7fc640 1 -- 172.21.15.82:0/466831851 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8064001130 con 0x7f80680cd4b0 2023-07-20T09:51:17.115 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.116 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.117 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T09:51:17.119 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.120 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.121 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.124 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.125 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.126 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T09:51:17.127 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.128 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T09:51:17.131 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T09:51:17.133 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T09:51:17.135 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T09:51:17.136 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mds", 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkPLCPMxAAR5t/QfIHxDmzbrOmo3T1lw==", 2023-07-20T09:51:17.137 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mds" 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-mgr", 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkIryPMxAA50ca8oxZRh1TOLm6EFkvMQ==", 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.138 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-osd", 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkfsSPMxAAETpUd35p9uL9jCOsH/Cygg==", 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-osd" 2023-07-20T09:51:17.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd", 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkmcyPMxAA1Kp4AJ+rItNdEiLNfhtMPA==", 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkA9WPMxAA9B1qn5aG1U0qx2cKSkc03Q==", 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.bootstrap-rgw", 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBIA7lkod2PMxAAgsmJypyYLLSkM20DV5xB0A==", 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T09:51:17.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:17.145 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T09:51:17.145 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T09:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 msgr2=0x7f804c068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 0x7f804c068770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f80580ae000 tx=0x7f80580a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 msgr2=0x7f8068154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8064001ec0 tx=0x7f806400c8e0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 shutdown_connections 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f804c0662b0 0x7f804c068770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f806815cab0 0x7f8068154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80680d0d10 0x7f806814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 --2- 172.21.15.82:0/466831851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80680cd4b0 0x7f8068154d40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.077+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 >> 172.21.15.82:0/466831851 conn(0x7f806808c120 msgr2=0x7f806806b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.081+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 shutdown_connections 2023-07-20T09:51:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.081+0000 7f806fe93640 1 -- 172.21.15.82:0/466831851 wait complete. 2023-07-20T09:51:17.148 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-20T09:51:17.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.249+0000 7f8c7fdd5640 1 Processor -- start 2023-07-20T09:51:17.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.249+0000 7f8c7fdd5640 1 -- start start 2023-07-20T09:51:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.249+0000 7f8c7fdd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 0x7f8c780d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7fdd5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780b3520 con 0x7f8c780ce4c0 2023-07-20T09:51:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7fdd5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c780cff30 con 0x7f8c780d0d10 2023-07-20T09:51:17.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7fdd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c780d31c0 con 0x7f8c7815cab0 2023-07-20T09:51:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7e372640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8c780ce4c0 0x7f8c780cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55502/0 (socket says 172.21.15.82:55502) 2023-07-20T09:51:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7e372640 1 -- 172.21.15.82:0/1404800386 learned_addr learned my addr 172.21.15.82:0/1404800386 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7db71640 1 --2- 172.21.15.82:0/1404800386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 0x7f8c780d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784289759 0 0) 0x7f8c780b3520 con 0x7f8c780ce4c0 2023-07-20T09:51:17.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c64003530 con 0x7f8c780ce4c0 2023-07-20T09:51:17.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764287971 0 0) 0x7f8c780cff30 con 0x7f8c780d0d10 2023-07-20T09:51:17.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c780b3520 con 0x7f8c780d0d10 2023-07-20T09:51:17.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7db71640 1 -- 172.21.15.82:0/1404800386 >> v1:172.21.15.183:6789/0 conn(0x7f8c780d0d10 legacy=0x7f8c780cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7db71640 1 -- 172.21.15.82:0/1404800386 >> v1:172.21.15.82:6789/0 conn(0x7f8c780ce4c0 legacy=0x7f8c780cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7db71640 1 -- 172.21.15.82:0/1404800386 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780b2910 con 0x7f8c7815cab0 2023-07-20T09:51:17.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.253+0000 7f8c7db71640 1 --2- 172.21.15.82:0/1404800386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 0x7f8c780d0300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c740097f0 tx=0x7f8c7401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36642a96fac04fbd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740aa5f0 con 0x7f8c7815cab0 2023-07-20T09:51:17.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c740aa750 con 0x7f8c7815cab0 2023-07-20T09:51:17.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7cb6f640 1 -- 172.21.15.82:0/1404800386 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740aaac0 con 0x7f8c7815cab0 2023-07-20T09:51:17.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/1404800386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 msgr2=0x7f8c780d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/1404800386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 0x7f8c780d0300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c740097f0 tx=0x7f8c7401c490 comp rx=0 tx=0).stop 2023-07-20T09:51:17.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/1404800386 shutdown_connections 2023-07-20T09:51:17.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/1404800386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c7815cab0 0x7f8c780d0300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/1404800386 >> 172.21.15.82:0/1404800386 conn(0x7f8c7808c120 msgr2=0x7f8c7809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:17.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/1404800386 shutdown_connections 2023-07-20T09:51:17.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/1404800386 wait complete. 2023-07-20T09:51:17.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 Processor -- start 2023-07-20T09:51:17.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- start start 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780ce4c0 0x7f8c7814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c780d0d10 0x7f8c780cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78156820 con 0x7f8c7815cab0 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78155c10 con 0x7f8c780ce4c0 2023-07-20T09:51:17.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.257+0000 7f8c7fdd5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c78155ef0 con 0x7f8c780d0d10 2023-07-20T09:51:17.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55204/0 (socket says 172.21.15.82:55204) 2023-07-20T09:51:17.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 -- 172.21.15.82:0/2086448949 learned_addr learned my addr 172.21.15.82:0/2086448949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:17.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7d370640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c780d0d10 0x7f8c780cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7db71640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780ce4c0 0x7f8c7814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 -- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c780d0d10 msgr2=0x7f8c780cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c780d0d10 0x7f8c780cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 -- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780ce4c0 msgr2=0x7f8c7814d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780ce4c0 0x7f8c7814d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 -- 172.21.15.82:0/2086448949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74009420 con 0x7f8c7815cab0 2023-07-20T09:51:17.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.261+0000 7f8c7e372640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000ca70 tx=0x7f8c7000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000abd0 con 0x7f8c7815cab0 2023-07-20T09:51:17.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c781561d0 con 0x7f8c7815cab0 2023-07-20T09:51:17.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000ad50 con 0x7f8c7815cab0 2023-07-20T09:51:17.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70012640 con 0x7f8c7815cab0 2023-07-20T09:51:17.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7814d800 con 0x7f8c7815cab0 2023-07-20T09:51:17.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c78073c70 con 0x7f8c7815cab0 2023-07-20T09:51:17.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.265+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c70007070 con 0x7f8c7815cab0 2023-07-20T09:51:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.269+0000 7f8c6e7fc640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 0x7f8c5c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.269+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8c70083940 con 0x7f8c7815cab0 2023-07-20T09:51:17.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.269+0000 7f8c7db71640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 0x7f8c5c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.269+0000 7f8c7db71640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 0x7f8c5c068740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c740ae000 tx=0x7f8c740a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.273+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c70051130 con 0x7f8c7815cab0 2023-07-20T09:51:17.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.469+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f8c781580a0 con 0x7f8c7815cab0 2023-07-20T09:51:17.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.473+0000 7f8c6e7fc640 1 -- 172.21.15.82:0/2086448949 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c70054750 con 0x7f8c7815cab0 2023-07-20T09:51:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 msgr2=0x7f8c5c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 0x7f8c5c068740 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8c740ae000 tx=0x7f8c740a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 msgr2=0x7f8c780cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000ca70 tx=0x7f8c7000cf30 comp rx=0 tx=0).stop 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 shutdown_connections 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8c5c066280 0x7f8c5c068740 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c7815cab0 0x7f8c780cfa30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8c780d0d10 0x7f8c780cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 --2- 172.21.15.82:0/2086448949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8c780ce4c0 0x7f8c7814d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 >> 172.21.15.82:0/2086448949 conn(0x7f8c7808c120 msgr2=0x7f8c7806bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:17.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 shutdown_connections 2023-07-20T09:51:17.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.477+0000 7f8c7fdd5640 1 -- 172.21.15.82:0/2086448949 wait complete. 2023-07-20T09:51:17.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-20T09:51:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 Processor -- start 2023-07-20T09:51:17.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 -- start start 2023-07-20T09:51:17.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa44160bc0 0x7faa4406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440cc560 con 0x7faa440c1a00 2023-07-20T09:51:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440ad7e0 con 0x7faa44160fa0 2023-07-20T09:51:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.633+0000 7faa4bc6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa440cc790 con 0x7faa44160bc0 2023-07-20T09:51:17.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa44160bc0 0x7faa4406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa44160bc0 0x7faa4406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55218/0 (socket says 172.21.15.82:55218) 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 -- 172.21.15.82:0/3005311630 learned_addr learned my addr 172.21.15.82:0/3005311630 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa4a20a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faa440c1a00 0x7faa440aae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55514/0 (socket says 172.21.15.82:55514) 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 -- 172.21.15.82:0/3005311630 >> v1:172.21.15.183:6789/0 conn(0x7faa44160fa0 legacy=0x7faa440c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 -- 172.21.15.82:0/3005311630 >> v1:172.21.15.82:6789/0 conn(0x7faa440c1a00 legacy=0x7faa440aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa48a07640 1 -- 172.21.15.82:0/3005311630 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186619706 0 0) 0x7faa440cc560 con 0x7faa440c1a00 2023-07-20T09:51:17.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 -- 172.21.15.82:0/3005311630 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440cca70 con 0x7faa44160bc0 2023-07-20T09:51:17.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa49a09640 1 --2- 172.21.15.82:0/3005311630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160bc0 0x7faa4406c1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa40009870 tx=0x7faa4001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3392b9227d26e3ac server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa48a07640 1 -- 172.21.15.82:0/3005311630 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400aa430 con 0x7faa44160bc0 2023-07-20T09:51:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa48a07640 1 -- 172.21.15.82:0/3005311630 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa400aa590 con 0x7faa44160bc0 2023-07-20T09:51:17.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.637+0000 7faa48a07640 1 -- 172.21.15.82:0/3005311630 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400aa920 con 0x7faa44160bc0 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- 172.21.15.82:0/3005311630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160bc0 msgr2=0x7faa4406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/3005311630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160bc0 0x7faa4406c1c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa40009870 tx=0x7faa4001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- 172.21.15.82:0/3005311630 shutdown_connections 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/3005311630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160bc0 0x7faa4406c1c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- 172.21.15.82:0/3005311630 >> 172.21.15.82:0/3005311630 conn(0x7faa440cada0 msgr2=0x7faa440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- 172.21.15.82:0/3005311630 shutdown_connections 2023-07-20T09:51:17.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- 172.21.15.82:0/3005311630 wait complete. 2023-07-20T09:51:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 Processor -- start 2023-07-20T09:51:17.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- start start 2023-07-20T09:51:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa440c1a00 0x7faa4415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa44160bc0 0x7faa440b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415abd0 con 0x7faa44160fa0 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4415b5d0 con 0x7faa440c1a00 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4bc6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa44158740 con 0x7faa44160bc0 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55234/0 (socket says 172.21.15.82:55234) 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 -- 172.21.15.82:0/891993024 learned_addr learned my addr 172.21.15.82:0/891993024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:17.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa49a09640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa440c1a00 0x7faa4415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa49208640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa44160bc0 0x7faa440b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 -- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa44160bc0 msgr2=0x7faa440b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa44160bc0 0x7faa440b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 -- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa440c1a00 msgr2=0x7faa4415a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa440c1a00 0x7faa4415a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.641+0000 7faa4a20a640 1 -- 172.21.15.82:0/891993024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400094d0 con 0x7faa44160fa0 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa4a20a640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa3c001570 tx=0x7faa3c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00a640 con 0x7faa44160fa0 2023-07-20T09:51:17.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00a7c0 con 0x7faa44160fa0 2023-07-20T09:51:17.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00ab70 con 0x7faa44160fa0 2023-07-20T09:51:17.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa440c2540 con 0x7faa44160fa0 2023-07-20T09:51:17.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa440c2260 con 0x7faa44160fa0 2023-07-20T09:51:17.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4415b3a0 con 0x7faa44160fa0 2023-07-20T09:51:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa3c00acd0 con 0x7faa44160fa0 2023-07-20T09:51:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 0x7faa28068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:17.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa3c082e50 con 0x7faa44160fa0 2023-07-20T09:51:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.645+0000 7faa49a09640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 0x7faa28068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:17.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.649+0000 7faa49a09640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 0x7faa28068770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa400ae000 tx=0x7faa400b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:17.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.649+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa4415b3a0 con 0x7faa44160fa0 2023-07-20T09:51:17.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.849+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7faa4415b740 con 0x7faa44160fa0 2023-07-20T09:51:17.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.853+0000 7faa3a7fc640 1 -- 172.21.15.82:0/891993024 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7faa4415b740 con 0x7faa44160fa0 2023-07-20T09:51:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 msgr2=0x7faa28068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 0x7faa28068770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faa400ae000 tx=0x7faa400b5040 comp rx=0 tx=0).stop 2023-07-20T09:51:17.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 msgr2=0x7faa440b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa3c001570 tx=0x7faa3c00cca0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 shutdown_connections 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7faa280662b0 0x7faa28068770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa44160fa0 0x7faa440b1480 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa44160bc0 0x7faa440b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 --2- 172.21.15.82:0/891993024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa440c1a00 0x7faa4415a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:17.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 >> 172.21.15.82:0/891993024 conn(0x7faa440cada0 msgr2=0x7faa440cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 shutdown_connections 2023-07-20T09:51:17.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:17.857+0000 7faa4bc6d640 1 -- 172.21.15.82:0/891993024 wait complete. 2023-07-20T09:51:17.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-20T09:51:18.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 Processor -- start 2023-07-20T09:51:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 -- start start 2023-07-20T09:51:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 0x7f81ec15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0ccd60 con 0x7f81ec0b2a90 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0ad810 con 0x7f81ec0cc900 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f2537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec15d0d0 con 0x7f81ec1596b0 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f0ad4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f81ec0b2a90 0x7f81ec0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55518/0 (socket says 172.21.15.82:55518) 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81f0ad4640 1 -- 172.21.15.82:0/528027482 learned_addr learned my addr 172.21.15.82:0/528027482 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:18.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81ebfff640 1 --2- 172.21.15.82:0/528027482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 0x7f81ec15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639412651 0 0) 0x7f81ec0ccd60 con 0x7f81ec0b2a90 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d4005740 con 0x7f81ec0b2a90 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196146637 0 0) 0x7f81ec0ad810 con 0x7f81ec0cc900 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ec0ccd60 con 0x7f81ec0cc900 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228015606 0 0) 0x7f81d4005740 con 0x7f81ec0b2a90 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81ebfff640 1 -- 172.21.15.82:0/528027482 >> v1:172.21.15.183:6789/0 conn(0x7f81ec0cc900 legacy=0x7f81ec0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81ebfff640 1 -- 172.21.15.82:0/528027482 >> v1:172.21.15.82:6789/0 conn(0x7f81ec0b2a90 legacy=0x7f81ec0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.017+0000 7f81ebfff640 1 -- 172.21.15.82:0/528027482 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec15d3b0 con 0x7f81ec1596b0 2023-07-20T09:51:18.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81ebfff640 1 --2- 172.21.15.82:0/528027482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 0x7f81ec15dbb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097f0 tx=0x7f81dc01c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=756567b4d36359fc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4001a00 con 0x7f81ec1596b0 2023-07-20T09:51:18.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc0a7050 con 0x7f81ec1596b0 2023-07-20T09:51:18.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81eaffd640 1 -- 172.21.15.82:0/528027482 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0ab620 con 0x7f81ec1596b0 2023-07-20T09:51:18.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 -- 172.21.15.82:0/528027482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 msgr2=0x7f81ec15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 --2- 172.21.15.82:0/528027482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 0x7f81ec15dbb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097f0 tx=0x7f81dc01c3b0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 -- 172.21.15.82:0/528027482 shutdown_connections 2023-07-20T09:51:18.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 --2- 172.21.15.82:0/528027482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec1596b0 0x7f81ec15dbb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 -- 172.21.15.82:0/528027482 >> 172.21.15.82:0/528027482 conn(0x7f81ec0cada0 msgr2=0x7f81ec0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:18.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 -- 172.21.15.82:0/528027482 shutdown_connections 2023-07-20T09:51:18.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.021+0000 7f81f2537640 1 -- 172.21.15.82:0/528027482 wait complete. 2023-07-20T09:51:18.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 Processor -- start 2023-07-20T09:51:18.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- start start 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec0b2a90 0x7f81ec0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81ec1596b0 0x7f81ec152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0c40d0 con 0x7f81ec0cc900 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0c7ee0 con 0x7f81ec1596b0 2023-07-20T09:51:18.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec0c81c0 con 0x7f81ec0b2a90 2023-07-20T09:51:18.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55238/0 (socket says 172.21.15.82:55238) 2023-07-20T09:51:18.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 -- 172.21.15.82:0/2476545723 learned_addr learned my addr 172.21.15.82:0/2476545723 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:18.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f0ad4640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81ec1596b0 0x7f81ec152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81ebfff640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec0b2a90 0x7f81ec0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 -- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec0b2a90 msgr2=0x7f81ec0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec0b2a90 0x7f81ec0c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 -- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81ec1596b0 msgr2=0x7f81ec152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81ec1596b0 0x7f81ec152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 -- 172.21.15.82:0/2476545723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc009420 con 0x7f81ec0cc900 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81eb7fe640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c490 tx=0x7f81e000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e00052d0 con 0x7f81ec0cc900 2023-07-20T09:51:18.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e0005430 con 0x7f81ec0cc900 2023-07-20T09:51:18.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0012870 con 0x7f81ec0cc900 2023-07-20T09:51:18.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec0c4320 con 0x7f81ec0cc900 2023-07-20T09:51:18.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.025+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec0c7b60 con 0x7f81ec0cc900 2023-07-20T09:51:18.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec073c70 con 0x7f81ec0cc900 2023-07-20T09:51:18.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81e00129d0 con 0x7f81ec0cc900 2023-07-20T09:51:18.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81e8ff9640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 0x7f81d8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f81e0083450 con 0x7f81ec0cc900 2023-07-20T09:51:18.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81ebfff640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 0x7f81d8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.029+0000 7f81ebfff640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 0x7f81d8068740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0ad000 tx=0x7f81dc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.033+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81e0050cc0 con 0x7f81ec0cc900 2023-07-20T09:51:18.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.237+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f81ec0c47d0 con 0x7f81ec0cc900 2023-07-20T09:51:18.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.241+0000 7f81e8ff9640 1 -- 172.21.15.82:0/2476545723 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f81e00542e0 con 0x7f81ec0cc900 2023-07-20T09:51:18.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 msgr2=0x7f81d8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 0x7f81d8068740 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0ad000 tx=0x7f81dc0a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 msgr2=0x7f81ec1fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c490 tx=0x7f81e000c950 comp rx=0 tx=0).stop 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 shutdown_connections 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f81d8066280 0x7f81d8068740 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81ec1596b0 0x7f81ec152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81ec0cc900 0x7f81ec1fcd30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 --2- 172.21.15.82:0/2476545723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81ec0b2a90 0x7f81ec0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 >> 172.21.15.82:0/2476545723 conn(0x7f81ec0cada0 msgr2=0x7f81ec0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:18.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 shutdown_connections 2023-07-20T09:51:18.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.245+0000 7f81f2537640 1 -- 172.21.15.82:0/2476545723 wait complete. 2023-07-20T09:51:18.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-20T09:51:18.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.401+0000 7f8e94767640 1 Processor -- start 2023-07-20T09:51:18.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.401+0000 7f8e94767640 1 -- start start 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e94767640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e94767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e8c0b2060 0x7f8e8c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e94767640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8c0b06c0 con 0x7f8e8c15a8e0 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e94767640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b3160 con 0x7f8e8c0afda0 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e94767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8c0b12a0 con 0x7f8e8c0b2060 2023-07-20T09:51:18.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55244/0 (socket says 172.21.15.82:55244) 2023-07-20T09:51:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 -- 172.21.15.82:0/2134371868 learned_addr learned my addr 172.21.15.82:0/2134371868 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 -- 172.21.15.82:0/2134371868 >> v2:172.21.15.183:3300/0 conn(0x7f8e8c0b2060 msgr2=0x7f8e8c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 --2- 172.21.15.82:0/2134371868 >> v2:172.21.15.183:3300/0 conn(0x7f8e8c0b2060 0x7f8e8c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 -- 172.21.15.82:0/2134371868 >> v1:172.21.15.183:6789/0 conn(0x7f8e8c15a8e0 legacy=0x7f8e8c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:18.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.405+0000 7f8e92503640 1 -- 172.21.15.82:0/2134371868 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0b1580 con 0x7f8e8c0afda0 2023-07-20T09:51:18.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e92503640 1 --2- 172.21.15.82:0/2134371868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c071ec0 tx=0x7f8e8801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f4e9e08c7d9cf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e91501640 1 -- 172.21.15.82:0/2134371868 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab600 con 0x7f8e8c0afda0 2023-07-20T09:51:18.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e91501640 1 -- 172.21.15.82:0/2134371868 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e880a7050 con 0x7f8e8c0afda0 2023-07-20T09:51:18.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e91501640 1 -- 172.21.15.82:0/2134371868 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880ab980 con 0x7f8e8c0afda0 2023-07-20T09:51:18.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- 172.21.15.82:0/2134371868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0afda0 msgr2=0x7f8e8c0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- 172.21.15.82:0/2134371868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c071ec0 tx=0x7f8e8801c370 comp rx=0 tx=0).stop 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- 172.21.15.82:0/2134371868 shutdown_connections 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- 172.21.15.82:0/2134371868 >> v2:172.21.15.183:3300/0 conn(0x7f8e8c0b2060 0x7f8e8c0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- 172.21.15.82:0/2134371868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c0ca6b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- 172.21.15.82:0/2134371868 >> 172.21.15.82:0/2134371868 conn(0x7f8e8c0cada0 msgr2=0x7f8e8c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- 172.21.15.82:0/2134371868 shutdown_connections 2023-07-20T09:51:18.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- 172.21.15.82:0/2134371868 wait complete. 2023-07-20T09:51:18.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 Processor -- start 2023-07-20T09:51:18.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- start start 2023-07-20T09:51:18.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 0x7f8e8c0c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c159bf0 con 0x7f8e8c0b2060 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c7e60 con 0x7f8e8c0afda0 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.409+0000 7f8e94767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c0c7340 con 0x7f8e8c15a8e0 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55252/0 (socket says 172.21.15.82:55252) 2023-07-20T09:51:18.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 -- 172.21.15.82:0/3109774739 learned_addr learned my addr 172.21.15.82:0/3109774739 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e92503640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e92d04640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 0x7f8e8c0c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 -- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 msgr2=0x7f8e8c0c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 0x7f8e8c0c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 -- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e8c0afda0 msgr2=0x7f8e8c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 -- 172.21.15.82:0/3109774739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880094d0 con 0x7f8e8c0b2060 2023-07-20T09:51:18.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e92d04640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 0x7f8e8c0c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:18.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e91d02640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b3e0 tx=0x7f8e7c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011830 con 0x7f8e8c0b2060 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c011990 con 0x7f8e8c0b2060 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c011d60 con 0x7f8e8c0b2060 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c0c75c0 con 0x7f8e8c0b2060 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c0c7b80 con 0x7f8e8c0b2060 2023-07-20T09:51:18.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c073c70 con 0x7f8e8c0b2060 2023-07-20T09:51:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.413+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e7c01a400 con 0x7f8e8c0b2060 2023-07-20T09:51:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.417+0000 7f8e82ffd640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 0x7f8e70068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.417+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8e7c083a30 con 0x7f8e8c0b2060 2023-07-20T09:51:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.417+0000 7f8e92503640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 0x7f8e70068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.417+0000 7f8e92503640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 0x7f8e70068770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad000 tx=0x7f8e880a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.421+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e7c051290 con 0x7f8e8c0b2060 2023-07-20T09:51:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.617+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8e8c0cb990 con 0x7f8e8c0b2060 2023-07-20T09:51:18.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e82ffd640 1 -- 172.21.15.82:0/3109774739 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8e7c05a070 con 0x7f8e8c0b2060 2023-07-20T09:51:18.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 msgr2=0x7f8e70068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 0x7f8e70068770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ad000 tx=0x7f8e880a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 msgr2=0x7f8e8c1596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00b3e0 tx=0x7f8e7c00b8a0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 shutdown_connections 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8e700662b0 0x7f8e70068770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e8c15a8e0 0x7f8e8c0c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e8c0b2060 0x7f8e8c1596b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 --2- 172.21.15.82:0/3109774739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e8c0afda0 0x7f8e8c15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 >> 172.21.15.82:0/3109774739 conn(0x7f8e8c0cada0 msgr2=0x7f8e8c0cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:18.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 shutdown_connections 2023-07-20T09:51:18.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.625+0000 7f8e94767640 1 -- 172.21.15.82:0/3109774739 wait complete. 2023-07-20T09:51:18.682 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-20T09:51:18.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 Processor -- start 2023-07-20T09:51:18.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 -- start start 2023-07-20T09:51:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb0e806f350 0x7fb0e806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e815c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80cf4a0 con 0x7fb0e806b970 2023-07-20T09:51:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e806ea80 con 0x7fb0e806f350 2023-07-20T09:51:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0ed3ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80ce890 con 0x7fb0e80b2640 2023-07-20T09:51:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb0e806f350 0x7fb0e806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e815c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:54804/0 (socket says 172.21.15.82:54804) 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb0e806f350 0x7fb0e806b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:40222/0 (socket says 172.21.15.82:40222) 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e77fe640 1 -- 172.21.15.82:0/921296952 learned_addr learned my addr 172.21.15.82:0/921296952 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 msgr2=0x7fb0e815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 --2- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/921296952 >> v1:172.21.15.183:6789/0 conn(0x7fb0e806b970 legacy=0x7fb0e80b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.785+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/921296952 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80ceb70 con 0x7fb0e806f350 2023-07-20T09:51:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0e6ffd640 1 --2- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e806b430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009d90 tx=0x7fb0d801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff9056b4bc45545 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0e67fc640 1 -- 172.21.15.82:0/921296952 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a5860 con 0x7fb0e806f350 2023-07-20T09:51:18.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0e67fc640 1 -- 172.21.15.82:0/921296952 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d80a59c0 con 0x7fb0e806f350 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0e67fc640 1 -- 172.21.15.82:0/921296952 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a5d50 con 0x7fb0e806f350 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 msgr2=0x7fb0e806b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e806b430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009d90 tx=0x7fb0d801c890 comp rx=0 tx=0).stop 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/921296952 shutdown_connections 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/921296952 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e806b430 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/921296952 >> 172.21.15.82:0/921296952 conn(0x7fb0e8089fa0 msgr2=0x7fb0e80d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/921296952 shutdown_connections 2023-07-20T09:51:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.789+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/921296952 wait complete. 2023-07-20T09:51:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 Processor -- start 2023-07-20T09:51:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- start start 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e80caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e80ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e81599e0 con 0x7fb0e806b970 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e8159cc0 con 0x7fb0e806f350 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e80c55c0 con 0x7fb0e80b2640 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55264/0 (socket says 172.21.15.82:55264) 2023-07-20T09:51:18.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/1343507647 learned_addr learned my addr 172.21.15.82:0/1343507647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:18.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e77fe640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e80ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0de7fc640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e80caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 msgr2=0x7fb0e80ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e80ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 msgr2=0x7fb0e80caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e80caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 -- 172.21.15.82:0/1343507647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d8009a70 con 0x7fb0e806b970 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0e6ffd640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80b0040 tx=0x7fb0d8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a5860 con 0x7fb0e806b970 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d80ad850 con 0x7fb0e806b970 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e80cfab0 con 0x7fb0e806b970 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80adc00 con 0x7fb0e806b970 2023-07-20T09:51:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e80c5b80 con 0x7fb0e806b970 2023-07-20T09:51:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.793+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80c5420 con 0x7fb0e806b970 2023-07-20T09:51:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.797+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0d80b4050 con 0x7fb0e806b970 2023-07-20T09:51:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.797+0000 7fb0dffff640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 0x7fb0c8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.797+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb0d811ec20 con 0x7fb0e806b970 2023-07-20T09:51:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.797+0000 7fb0de7fc640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 0x7fb0c8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:18.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.797+0000 7fb0de7fc640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 0x7fb0c8068740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8155720 tx=0x7fb0d0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:18.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:18.801+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0e80c5420 con 0x7fb0e806b970 2023-07-20T09:51:19.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.005+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb0e80c5420 con 0x7fb0e806b970 2023-07-20T09:51:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.009+0000 7fb0dffff640 1 -- 172.21.15.82:0/1343507647 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb0e80c5420 con 0x7fb0e806b970 2023-07-20T09:51:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 msgr2=0x7fb0c8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 0x7fb0c8068740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8155720 tx=0x7fb0d0009040 comp rx=0 tx=0).stop 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 msgr2=0x7fb0e8159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80b0040 tx=0x7fb0d8019630 comp rx=0 tx=0).stop 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 shutdown_connections 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fb0c8066280 0x7fb0c8068740 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0e80b2640 0x7fb0e80ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb0e806f350 0x7fb0e80caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 --2- 172.21.15.82:0/1343507647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0e806b970 0x7fb0e8159400 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 >> 172.21.15.82:0/1343507647 conn(0x7fb0e8089fa0 msgr2=0x7fb0e80b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 shutdown_connections 2023-07-20T09:51:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.013+0000 7fb0ed3ba640 1 -- 172.21.15.82:0/1343507647 wait complete. 2023-07-20T09:51:19.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-20T09:51:19.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 Processor -- start 2023-07-20T09:51:19.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 -- start start 2023-07-20T09:51:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f05600cd4b0 0x7f05600cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05600d16b0 con 0x7f056015cab0 2023-07-20T09:51:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05600d31c0 con 0x7f05600cd4b0 2023-07-20T09:51:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f056558f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600b3520 con 0x7f05600d0d10 2023-07-20T09:51:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f055effd640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f056015cab0 0x7f05600d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:35700/0 (socket says 172.21.15.82:35700) 2023-07-20T09:51:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f055effd640 1 -- 172.21.15.82:0/3667358 learned_addr learned my addr 172.21.15.82:0/3667358 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f0557fff640 1 --2- 172.21.15.82:0/3667358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.169+0000 7f055f7fe640 1 --2- 172.21.15.82:0/3667358 >> v2:172.21.15.183:3300/0 conn(0x7f05600cd4b0 0x7f05600cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f055e7fc640 1 -- 172.21.15.82:0/3667358 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878980639 0 0) 0x7f05600d16b0 con 0x7f056015cab0 2023-07-20T09:51:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f0557fff640 1 -- 172.21.15.82:0/3667358 >> v2:172.21.15.183:3300/0 conn(0x7f05600cd4b0 msgr2=0x7f05600cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f0557fff640 1 --2- 172.21.15.82:0/3667358 >> v2:172.21.15.183:3300/0 conn(0x7f05600cd4b0 0x7f05600cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f0557fff640 1 -- 172.21.15.82:0/3667358 >> v1:172.21.15.183:6789/0 conn(0x7f056015cab0 legacy=0x7f05600d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f0557fff640 1 -- 172.21.15.82:0/3667358 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600d0a10 con 0x7f05600d0d10 2023-07-20T09:51:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f0557fff640 1 --2- 172.21.15.82:0/3667358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600d1170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a1c5af16ee117c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f055e7fc640 1 -- 172.21.15.82:0/3667358 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480ab650 con 0x7f05600d0d10 2023-07-20T09:51:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f055e7fc640 1 -- 172.21.15.82:0/3667358 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480ab7b0 con 0x7f05600d0d10 2023-07-20T09:51:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f055e7fc640 1 -- 172.21.15.82:0/3667358 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480abb40 con 0x7f05600d0d10 2023-07-20T09:51:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 -- 172.21.15.82:0/3667358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 msgr2=0x7f05600d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 --2- 172.21.15.82:0/3667358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600d1170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05480097c0 tx=0x7f054801c450 comp rx=0 tx=0).stop 2023-07-20T09:51:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 -- 172.21.15.82:0/3667358 shutdown_connections 2023-07-20T09:51:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 --2- 172.21.15.82:0/3667358 >> v2:172.21.15.183:3300/0 conn(0x7f05600cd4b0 0x7f05600cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 --2- 172.21.15.82:0/3667358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600d1170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.173+0000 7f056558f640 1 -- 172.21.15.82:0/3667358 >> 172.21.15.82:0/3667358 conn(0x7f056008c120 msgr2=0x7f056009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- 172.21.15.82:0/3667358 shutdown_connections 2023-07-20T09:51:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- 172.21.15.82:0/3667358 wait complete. 2023-07-20T09:51:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 Processor -- start 2023-07-20T09:51:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- start start 2023-07-20T09:51:19.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05600cd4b0 0x7f05600c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c8a00 con 0x7f056015cab0 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c71d0 con 0x7f05600cd4b0 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c8030 con 0x7f05600d0d10 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55268/0 (socket says 172.21.15.82:55268) 2023-07-20T09:51:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 -- 172.21.15.82:0/955990847 learned_addr learned my addr 172.21.15.82:0/955990847 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055effd640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05600cd4b0 0x7f05600c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f0557fff640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 -- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 msgr2=0x7f05600cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 -- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05600cd4b0 msgr2=0x7f05600c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05600cd4b0 0x7f05600c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 -- 172.21.15.82:0/955990847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009420 con 0x7f056015cab0 2023-07-20T09:51:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f055f7fe640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f055800efc0 tx=0x7f055800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558009ba0 con 0x7f056015cab0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800f040 con 0x7f056015cab0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580146c0 con 0x7f056015cab0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.177+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05600c7420 con 0x7f056015cab0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05600c79e0 con 0x7f056015cab0 2023-07-20T09:51:19.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05600c81a0 con 0x7f056015cab0 2023-07-20T09:51:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0558014820 con 0x7f056015cab0 2023-07-20T09:51:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f05577fe640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 0x7f0540068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0558084390 con 0x7f056015cab0 2023-07-20T09:51:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f055effd640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 0x7f0540068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.181+0000 7f055effd640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 0x7f0540068770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f70 tx=0x7f0550007df0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.185+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0558051c00 con 0x7f056015cab0 2023-07-20T09:51:19.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.381+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f0560073c70 con 0x7f056015cab0 2023-07-20T09:51:19.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f05577fe640 1 -- 172.21.15.82:0/955990847 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0558055220 con 0x7f056015cab0 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 msgr2=0x7f0540068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 0x7f0540068770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0550000f70 tx=0x7f0550007df0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 msgr2=0x7f056015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f055800efc0 tx=0x7f055800c490 comp rx=0 tx=0).stop 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 shutdown_connections 2023-07-20T09:51:19.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f05400662b0 0x7f0540068770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f056015cab0 0x7f056015ba30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05600d0d10 0x7f05600cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 --2- 172.21.15.82:0/955990847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05600cd4b0 0x7f05600c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 >> 172.21.15.82:0/955990847 conn(0x7f056008c120 msgr2=0x7f05600b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 shutdown_connections 2023-07-20T09:51:19.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.389+0000 7f056558f640 1 -- 172.21.15.82:0/955990847 wait complete. 2023-07-20T09:51:19.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:19.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 Processor -- start 2023-07-20T09:51:19.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 -- start start 2023-07-20T09:51:19.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9814160bc0 0x7f981406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140cc560 con 0x7f98140c1a00 2023-07-20T09:51:19.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140ad7e0 con 0x7f9814160fa0 2023-07-20T09:51:19.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f981b967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140cc790 con 0x7f9814160bc0 2023-07-20T09:51:19.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819f04640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98140c1a00 0x7f98140aae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55520/0 (socket says 172.21.15.82:55520) 2023-07-20T09:51:19.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819f04640 1 -- 172.21.15.82:0/3115754999 learned_addr learned my addr 172.21.15.82:0/3115754999 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:19.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819703640 1 --2- 172.21.15.82:0/3115754999 >> v2:172.21.15.183:3300/0 conn(0x7f9814160bc0 0x7f981406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9807fff640 1 -- 172.21.15.82:0/3115754999 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36549063 0 0) 0x7f98140cc560 con 0x7f98140c1a00 2023-07-20T09:51:19.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9807fff640 1 -- 172.21.15.82:0/3115754999 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800003530 con 0x7f98140c1a00 2023-07-20T09:51:19.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819703640 1 -- 172.21.15.82:0/3115754999 >> v1:172.21.15.183:6789/0 conn(0x7f9814160fa0 legacy=0x7f98140c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819703640 1 -- 172.21.15.82:0/3115754999 >> v1:172.21.15.82:6789/0 conn(0x7f98140c1a00 legacy=0x7f98140aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.549+0000 7f9819703640 1 -- 172.21.15.82:0/3115754999 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140cca70 con 0x7f9814160bc0 2023-07-20T09:51:19.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f9819703640 1 --2- 172.21.15.82:0/3115754999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160bc0 0x7f981406c1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98080097c0 tx=0x7f980801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c399e631cb4b37ef server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f9807fff640 1 -- 172.21.15.82:0/3115754999 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080ab650 con 0x7f9814160bc0 2023-07-20T09:51:19.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f9807fff640 1 -- 172.21.15.82:0/3115754999 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080ab7b0 con 0x7f9814160bc0 2023-07-20T09:51:19.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f9807fff640 1 -- 172.21.15.82:0/3115754999 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080abb40 con 0x7f9814160bc0 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 -- 172.21.15.82:0/3115754999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160bc0 msgr2=0x7f981406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 --2- 172.21.15.82:0/3115754999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160bc0 0x7f981406c1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98080097c0 tx=0x7f980801c450 comp rx=0 tx=0).stop 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 -- 172.21.15.82:0/3115754999 shutdown_connections 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 --2- 172.21.15.82:0/3115754999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160bc0 0x7f981406c1c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 -- 172.21.15.82:0/3115754999 >> 172.21.15.82:0/3115754999 conn(0x7f98140cada0 msgr2=0x7f98140cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 -- 172.21.15.82:0/3115754999 shutdown_connections 2023-07-20T09:51:19.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.553+0000 7f981b967640 1 -- 172.21.15.82:0/3115754999 wait complete. 2023-07-20T09:51:19.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 Processor -- start 2023-07-20T09:51:19.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 -- start start 2023-07-20T09:51:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9814160bc0 0x7f98141528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160fa0 0x7f98140affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9814098f50 con 0x7f98140c1a00 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9814152e10 con 0x7f9814160fa0 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f981b967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981409b950 con 0x7f9814160bc0 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55276/0 (socket says 172.21.15.82:55276) 2023-07-20T09:51:19.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 -- 172.21.15.82:0/3936158356 learned_addr learned my addr 172.21.15.82:0/3936158356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:19.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9818f02640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9814160bc0 0x7f98141528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819f04640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160fa0 0x7f98140affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 -- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9814160bc0 msgr2=0x7f98141528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9814160bc0 0x7f98141528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 -- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160fa0 msgr2=0x7f98140affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160fa0 0x7f98140affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 -- 172.21.15.82:0/3936158356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009420 con 0x7f98140c1a00 2023-07-20T09:51:19.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9819703640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f98080ad040 tx=0x7f980801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080bf610 con 0x7f98140c1a00 2023-07-20T09:51:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080bf790 con 0x7f98140c1a00 2023-07-20T09:51:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.557+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98080bfb40 con 0x7f98140c1a00 2023-07-20T09:51:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981409b670 con 0x7f98140c1a00 2023-07-20T09:51:19.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140aec30 con 0x7f98140c1a00 2023-07-20T09:51:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9814073c70 con 0x7f98140c1a00 2023-07-20T09:51:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98080b5400 con 0x7f98140c1a00 2023-07-20T09:51:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f9805ffb640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 0x7f97f8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f980811eb30 con 0x7f98140c1a00 2023-07-20T09:51:19.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.561+0000 7f9818f02640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 0x7f97f8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.565+0000 7f9818f02640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 0x7f97f8068740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f981409a190 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.565+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98080ec410 con 0x7f98140c1a00 2023-07-20T09:51:19.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.713+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f981409bff0 con 0x7f98140c1a00 2023-07-20T09:51:19.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.713+0000 7f9805ffb640 1 -- 172.21.15.82:0/3936158356 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f98080c4090 con 0x7f98140c1a00 2023-07-20T09:51:19.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:19.752 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:16.687307+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:19.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 msgr2=0x7f97f8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 0x7f97f8068740 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f981409a190 tx=0x7f9810009040 comp rx=0 tx=0).stop 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 msgr2=0x7f9814098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f98080ad040 tx=0x7f980801ac90 comp rx=0 tx=0).stop 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 shutdown_connections 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f97f8066280 0x7f97f8068740 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9814160fa0 0x7f98140affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9814160bc0 0x7f98141528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 --2- 172.21.15.82:0/3936158356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98140c1a00 0x7f9814098a10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 >> 172.21.15.82:0/3936158356 conn(0x7f98140cada0 msgr2=0x7f981406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 shutdown_connections 2023-07-20T09:51:19.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.717+0000 7f981b967640 1 -- 172.21.15.82:0/3936158356 wait complete. 2023-07-20T09:51:19.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T09:51:19.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T09:51:19.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 Processor -- start 2023-07-20T09:51:19.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 -- start start 2023-07-20T09:51:19.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c58159830 0x7f2c580cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c580cc8d0 con 0x7f2c58159450 2023-07-20T09:51:19.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c580ccbb0 con 0x7f2c580cc3e0 2023-07-20T09:51:19.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c5d66a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580cce90 con 0x7f2c58159830 2023-07-20T09:51:19.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c56ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2c58159450 0x7f2c5815a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55526/0 (socket says 172.21.15.82:55526) 2023-07-20T09:51:19.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c56ffd640 1 -- 172.21.15.82:0/2974502149 learned_addr learned my addr 172.21.15.82:0/2974502149 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c4e7fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c58159830 0x7f2c580cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171460123 0 0) 0x7f2c580cc8d0 con 0x7f2c58159450 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c44003530 con 0x7f2c58159450 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522975179 0 0) 0x7f2c580ccbb0 con 0x7f2c580cc3e0 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c580cc8d0 con 0x7f2c580cc3e0 2023-07-20T09:51:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 484666221 0 0) 0x7f2c44003530 con 0x7f2c58159450 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c58159830 msgr2=0x7f2c580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c58159830 0x7f2c580cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 >> v1:172.21.15.183:6789/0 conn(0x7f2c580cc3e0 legacy=0x7f2c580afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c58159cc0 con 0x7f2c58159450 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2c480016a0 con 0x7f2c58159450 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 >> v1:172.21.15.82:6789/0 conn(0x7f2c58159450 legacy=0x7f2c5815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c44003bb0 0x7f2c44003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c440047d0 0x7f2c44004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c44005150 0x7f2c4400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580cce90 con 0x7f2c44005150 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4400bed0 con 0x7f2c44003bb0 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.877+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4400c090 con 0x7f2c440047d0 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c44005150 0x7f2c4400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c4e7fc640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c440047d0 0x7f2c44004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c56ffd640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c44003bb0 0x7f2c44003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 -- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c440047d0 msgr2=0x7f2c44004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c440047d0 0x7f2c44004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 -- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c44003bb0 msgr2=0x7f2c44003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c44003bb0 0x7f2c44003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 -- 172.21.15.82:0/2974502149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44003530 con 0x7f2c44005150 2023-07-20T09:51:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c56ffd640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c44003bb0 0x7f2c44003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c577fe640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c44005150 0x7f2c4400b990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c580c88d0 tx=0x7f2c5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9bfb55acb4bb5e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c500052d0 con 0x7f2c44005150 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50005450 con 0x7f2c44005150 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.881+0000 7f2c567fc640 1 -- 172.21.15.82:0/2974502149 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50003840 con 0x7f2c44005150 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2974502149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c44005150 msgr2=0x7f2c4400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2974502149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c44005150 0x7f2c4400b990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c580c88d0 tx=0x7f2c5001c520 comp rx=0 tx=0).stop 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c577fe640 1 -- 172.21.15.82:0/2974502149 reap_dead start 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2974502149 shutdown_connections 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2974502149 >> 172.21.15.82:0/2974502149 conn(0x7f2c580cad50 msgr2=0x7f2c580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:19.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2974502149 shutdown_connections 2023-07-20T09:51:19.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2974502149 wait complete. 2023-07-20T09:51:19.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 Processor -- start 2023-07-20T09:51:19.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- start start 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c44005150 0x7f2c58152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c581f95f0 0x7f2c581f9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c9190 con 0x7f2c58152980 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c8610 con 0x7f2c581f95f0 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c5d66a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c580c88f0 con 0x7f2c44005150 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c4e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c4e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55288/0 (socket says 172.21.15.82:55288) 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c4e7fc640 1 -- 172.21.15.82:0/2333217848 learned_addr learned my addr 172.21.15.82:0/2333217848 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c56ffd640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c44005150 0x7f2c58152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.885+0000 7f2c577fe640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c581f95f0 0x7f2c581f9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 -- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c44005150 msgr2=0x7f2c58152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c44005150 0x7f2c58152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 -- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c581f95f0 msgr2=0x7f2c581f9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:19.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c581f95f0 0x7f2c581f9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 -- 172.21.15.82:0/2333217848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c580c8bd0 con 0x7f2c58152980 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4e7fc640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c40011e30 tx=0x7f2c4000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000e040 con 0x7f2c58152980 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000f040 con 0x7f2c58152980 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40009c00 con 0x7f2c58152980 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c580c8eb0 con 0x7f2c58152980 2023-07-20T09:51:19.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c580c8250 con 0x7f2c58152980 2023-07-20T09:51:19.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c580c1a90 con 0x7f2c58152980 2023-07-20T09:51:19.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.889+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c40015850 con 0x7f2c58152980 2023-07-20T09:51:19.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.893+0000 7f2c4ffff640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 0x7f2c38068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:19.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.893+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2c40084800 con 0x7f2c58152980 2023-07-20T09:51:19.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.893+0000 7f2c56ffd640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 0x7f2c38068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:19.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.893+0000 7f2c56ffd640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 0x7f2c38068770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2c48001b90 tx=0x7f2c48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:19.897+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c580c1a90 con 0x7f2c58152980 2023-07-20T09:51:20.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.041+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c580c1a90 con 0x7f2c58152980 2023-07-20T09:51:20.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c4ffff640 1 -- 172.21.15.82:0/2333217848 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c580c1a90 con 0x7f2c58152980 2023-07-20T09:51:20.081 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T09:51:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 msgr2=0x7f2c38068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 0x7f2c38068770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2c48001b90 tx=0x7f2c48009040 comp rx=0 tx=0).stop 2023-07-20T09:51:20.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 msgr2=0x7f2c581f90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2c40011e30 tx=0x7f2c4000f580 comp rx=0 tx=0).stop 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 shutdown_connections 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2c380662b0 0x7f2c38068770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c581f95f0 0x7f2c581f9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c58152980 0x7f2c581f90b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 --2- 172.21.15.82:0/2333217848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c44005150 0x7f2c58152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 >> 172.21.15.82:0/2333217848 conn(0x7f2c580cad50 msgr2=0x7f2c5815c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 shutdown_connections 2023-07-20T09:51:20.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.045+0000 7f2c5d66a640 1 -- 172.21.15.82:0/2333217848 wait complete. 2023-07-20T09:51:20.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T09:51:20.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.205+0000 7f1570537640 1 Processor -- start 2023-07-20T09:51:20.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.205+0000 7f1570537640 1 -- start start 2023-07-20T09:51:20.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f1570537640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 0x7f15680cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f1570537640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15681602b0 0x7f1568160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f1570537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15680d0970 con 0x7f156806ab10 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f1570537640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1568160e20 con 0x7f15681602b0 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f1570537640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15680cd300 con 0x7f156806c120 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156dad2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f15681602b0 0x7f1568160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156ead4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f156806ab10 0x7f156806af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55542/0 (socket says 172.21.15.82:55542) 2023-07-20T09:51:20.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156ead4640 1 -- 172.21.15.82:0/4275649651 learned_addr learned my addr 172.21.15.82:0/4275649651 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156e2d3640 1 --2- 172.21.15.82:0/4275649651 >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 0x7f15680cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156dad2640 1 -- 172.21.15.82:0/4275649651 >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 msgr2=0x7f15680cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:20.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156dad2640 1 --2- 172.21.15.82:0/4275649651 >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 0x7f15680cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156dad2640 1 -- 172.21.15.82:0/4275649651 >> v1:172.21.15.82:6789/0 conn(0x7f156806ab10 legacy=0x7f156806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156dad2640 1 -- 172.21.15.82:0/4275649651 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680cd5e0 con 0x7f15681602b0 2023-07-20T09:51:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156e2d3640 1 --2- 172.21.15.82:0/4275649651 >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 0x7f15680cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.209+0000 7f156d2d1640 1 -- 172.21.15.82:0/4275649651 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248425142 0 0) 0x7f15680d0970 con 0x7f156806ab10 2023-07-20T09:51:20.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156dad2640 1 --2- 172.21.15.82:0/4275649651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15681602b0 0x7f1568160740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f15680d00e0 tx=0x7f155801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8283ccaeabd8c75c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156d2d1640 1 -- 172.21.15.82:0/4275649651 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580ab600 con 0x7f15681602b0 2023-07-20T09:51:20.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156d2d1640 1 -- 172.21.15.82:0/4275649651 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580a7050 con 0x7f15681602b0 2023-07-20T09:51:20.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156d2d1640 1 -- 172.21.15.82:0/4275649651 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580ab980 con 0x7f15681602b0 2023-07-20T09:51:20.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- 172.21.15.82:0/4275649651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15681602b0 msgr2=0x7f1568160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- 172.21.15.82:0/4275649651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15681602b0 0x7f1568160740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f15680d00e0 tx=0x7f155801c310 comp rx=0 tx=0).stop 2023-07-20T09:51:20.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- 172.21.15.82:0/4275649651 shutdown_connections 2023-07-20T09:51:20.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- 172.21.15.82:0/4275649651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15681602b0 0x7f1568160740 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- 172.21.15.82:0/4275649651 >> v2:172.21.15.183:3300/0 conn(0x7f156806c120 0x7f15680cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- 172.21.15.82:0/4275649651 >> 172.21.15.82:0/4275649651 conn(0x7f156808c0a0 msgr2=0x7f156809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- 172.21.15.82:0/4275649651 shutdown_connections 2023-07-20T09:51:20.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- 172.21.15.82:0/4275649651 wait complete. 2023-07-20T09:51:20.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 Processor -- start 2023-07-20T09:51:20.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- start start 2023-07-20T09:51:20.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 0x7f15680c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 0x7f15680c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1568155c20 con 0x7f156806c120 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15680c6890 con 0x7f15681602b0 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f1570537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15680b0b00 con 0x7f156806ab10 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156dad2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156dad2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55314/0 (socket says 172.21.15.82:55314) 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.213+0000 7f156dad2640 1 -- 172.21.15.82:0/389338083 learned_addr learned my addr 172.21.15.82:0/389338083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156e2d3640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 0x7f15680c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156ead4640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 0x7f15680c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 -- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 msgr2=0x7f15680c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 0x7f15680c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 -- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 msgr2=0x7f15680c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 0x7f15680c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 -- 172.21.15.82:0/389338083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009420 con 0x7f156806c120 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156e2d3640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 0x7f15680c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156ead4640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 0x7f15680c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f156dad2640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1558018f20 tx=0x7f15580190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580b4400 con 0x7f156806c120 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580b4560 con 0x7f156806c120 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15680b0540 con 0x7f156806c120 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580b48d0 con 0x7f156806c120 2023-07-20T09:51:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15680c73a0 con 0x7f156806c120 2023-07-20T09:51:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1568155d60 con 0x7f156806c120 2023-07-20T09:51:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15580b2040 con 0x7f156806c120 2023-07-20T09:51:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 0x7f154c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.217+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f155811db30 con 0x7f156806c120 2023-07-20T09:51:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.221+0000 7f156e2d3640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 0x7f154c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.221+0000 7f156e2d3640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 0x7f154c068740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15680c5f80 tx=0x7f1564007550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.221+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1568155d60 con 0x7f156806c120 2023-07-20T09:51:20.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.369+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1568155d60 con 0x7f156806c120 2023-07-20T09:51:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.369+0000 7f155effd640 1 -- 172.21.15.82:0/389338083 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1568155d60 con 0x7f156806c120 2023-07-20T09:51:20.408 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 msgr2=0x7f154c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 0x7f154c068740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f15680c5f80 tx=0x7f1564007550 comp rx=0 tx=0).stop 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 msgr2=0x7f1568156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1558018f20 tx=0x7f15580190b0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 shutdown_connections 2023-07-20T09:51:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f154c066280 0x7f154c068740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f15681602b0 0x7f15680c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156806c120 0x7f1568156040 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 --2- 172.21.15.82:0/389338083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156806ab10 0x7f15680c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 >> 172.21.15.82:0/389338083 conn(0x7f156808c0a0 msgr2=0x7f156809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 shutdown_connections 2023-07-20T09:51:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.373+0000 7f1570537640 1 -- 172.21.15.82:0/389338083 wait complete. 2023-07-20T09:51:20.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T09:51:20.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 Processor -- start 2023-07-20T09:51:20.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 -- start start 2023-07-20T09:51:20.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3441596b0 0x7fc34415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3440cc900 0x7fc3440ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3440b2380 0x7fc3440b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3440b2d50 con 0x7fc3440b2380 2023-07-20T09:51:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3440ad600 con 0x7fc3440cc900 2023-07-20T09:51:20.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34be27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440ccd60 con 0x7fc3441596b0 2023-07-20T09:51:20.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3440b2380 0x7fc3440b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc3440b2380 0x7fc3440b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55320/0 (socket says 172.21.15.82:55320) 2023-07-20T09:51:20.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2843498045 learned_addr learned my addr 172.21.15.82:0/2843498045 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc3493c2640 1 --2- 172.21.15.82:0/2843498045 >> v2:172.21.15.183:3300/0 conn(0x7fc3440cc900 0x7fc3440ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc349bc3640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3441596b0 0x7fc34415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2843498045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3441596b0 msgr2=0x7fc34415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3441596b0 0x7fc34415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2843498045 >> v2:172.21.15.183:3300/0 conn(0x7fc3440cc900 msgr2=0x7fc3440ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:20.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2843498045 >> v2:172.21.15.183:3300/0 conn(0x7fc3440cc900 0x7fc3440ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.533+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2843498045 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440ad810 con 0x7fc3440b2380 2023-07-20T09:51:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3440b2380 0x7fc3440b2810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc3440cf380 tx=0x7fc33c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57d928018468ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc348bc1640 1 -- 172.21.15.82:0/2843498045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0aa5f0 con 0x7fc3440b2380 2023-07-20T09:51:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc348bc1640 1 -- 172.21.15.82:0/2843498045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0aa750 con 0x7fc3440b2380 2023-07-20T09:51:20.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc348bc1640 1 -- 172.21.15.82:0/2843498045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0aaae0 con 0x7fc3440b2380 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 -- 172.21.15.82:0/2843498045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3440b2380 msgr2=0x7fc3440b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3440b2380 0x7fc3440b2810 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc3440cf380 tx=0x7fc33c01c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 -- 172.21.15.82:0/2843498045 shutdown_connections 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 --2- 172.21.15.82:0/2843498045 >> v2:172.21.15.183:3300/0 conn(0x7fc3440cc900 0x7fc3440ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3440b2380 0x7fc3440b2810 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 --2- 172.21.15.82:0/2843498045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3441596b0 0x7fc34415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 -- 172.21.15.82:0/2843498045 >> 172.21.15.82:0/2843498045 conn(0x7fc3440cada0 msgr2=0x7fc3440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 -- 172.21.15.82:0/2843498045 shutdown_connections 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.537+0000 7fc34be27640 1 -- 172.21.15.82:0/2843498045 wait complete. 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 Processor -- start 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- start start 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3440b2380 0x7fc3440aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3440cc900 0x7fc3440c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440ab4e0 con 0x7fc3441596b0 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440ab7c0 con 0x7fc3440cc900 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440abaa0 con 0x7fc3440b2380 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55334/0 (socket says 172.21.15.82:55334) 2023-07-20T09:51:20.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2928065911 learned_addr learned my addr 172.21.15.82:0/2928065911 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc349bc3640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3440b2380 0x7fc3440aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc3493c2640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3440cc900 0x7fc3440c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3440b2380 msgr2=0x7fc3440aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3440b2380 0x7fc3440aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3440cc900 msgr2=0x7fc3440c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3440cc900 0x7fc3440c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 -- 172.21.15.82:0/2928065911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c0094d0 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34a3c4640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0ac040 tx=0x7fc33c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0b3800 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c0b3980 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c0b3d30 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3440abd80 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.541+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3440c4120 con 0x7fc3441596b0 2023-07-20T09:51:20.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc344073c70 con 0x7fc3441596b0 2023-07-20T09:51:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc33c0b2380 con 0x7fc3441596b0 2023-07-20T09:51:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc33a7fc640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 0x7fc328068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc33c0a7070 con 0x7fc3441596b0 2023-07-20T09:51:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc349bc3640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 0x7fc328068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.545+0000 7fc349bc3640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 0x7fc328068740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc344163c80 tx=0x7fc340009830 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.549+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc33c122070 con 0x7fc3441596b0 2023-07-20T09:51:20.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3440cbbd0 con 0x7fc3441596b0 2023-07-20T09:51:20.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc33a7fc640 1 -- 172.21.15.82:0/2928065911 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc33c0eb7b0 con 0x7fc3441596b0 2023-07-20T09:51:20.739 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:20.739 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T09:51:20.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:20.739 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:20.740 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T09:51:20.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 msgr2=0x7fc328068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 0x7fc328068740 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc344163c80 tx=0x7fc340009830 comp rx=0 tx=0).stop 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 msgr2=0x7fc344070b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0ac040 tx=0x7fc33c01ad10 comp rx=0 tx=0).stop 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 shutdown_connections 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc328066280 0x7fc328068740 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3441596b0 0x7fc344070b60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3440cc900 0x7fc3440c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 --2- 172.21.15.82:0/2928065911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3440b2380 0x7fc3440aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 >> 172.21.15.82:0/2928065911 conn(0x7fc3440cada0 msgr2=0x7fc34406c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 shutdown_connections 2023-07-20T09:51:20.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.701+0000 7fc34be27640 1 -- 172.21.15.82:0/2928065911 wait complete. 2023-07-20T09:51:20.760 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T09:51:20.760 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T09:51:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 Processor -- start 2023-07-20T09:51:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 -- start start 2023-07-20T09:51:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff858070970 0x7ff858070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580c95d0 con 0x7ff85806b620 2023-07-20T09:51:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8581590c0 con 0x7ff858158ce0 2023-07-20T09:51:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff85d293640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580c89c0 con 0x7ff858070970 2023-07-20T09:51:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff84e7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff858070970 0x7ff858070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff8577fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff85806b620 0x7ff8580cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55554/0 (socket says 172.21.15.82:55554) 2023-07-20T09:51:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff8577fe640 1 -- 172.21.15.82:0/1710761503 learned_addr learned my addr 172.21.15.82:0/1710761503 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff84e7fc640 1 -- 172.21.15.82:0/1710761503 >> v1:172.21.15.183:6789/0 conn(0x7ff858158ce0 legacy=0x7ff8580c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff84e7fc640 1 -- 172.21.15.82:0/1710761503 >> v1:172.21.15.82:6789/0 conn(0x7ff85806b620 legacy=0x7ff8580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff84e7fc640 1 -- 172.21.15.82:0/1710761503 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580c8ca0 con 0x7ff858070970 2023-07-20T09:51:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.865+0000 7ff8567fc640 1 -- 172.21.15.82:0/1710761503 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294077850 0 0) 0x7ff8580c95d0 con 0x7ff85806b620 2023-07-20T09:51:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff84e7fc640 1 --2- 172.21.15.82:0/1710761503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff858070e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff84000aea0 tx=0x7ff84001da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693b9c836c543cb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff8567fc640 1 -- 172.21.15.82:0/1710761503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84000a2d0 con 0x7ff858070970 2023-07-20T09:51:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff8567fc640 1 -- 172.21.15.82:0/1710761503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400a6800 con 0x7ff858070970 2023-07-20T09:51:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff8567fc640 1 -- 172.21.15.82:0/1710761503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400a6b90 con 0x7ff858070970 2023-07-20T09:51:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 -- 172.21.15.82:0/1710761503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 msgr2=0x7ff858070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 --2- 172.21.15.82:0/1710761503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff858070e00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff84000aea0 tx=0x7ff84001da50 comp rx=0 tx=0).stop 2023-07-20T09:51:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 -- 172.21.15.82:0/1710761503 shutdown_connections 2023-07-20T09:51:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 --2- 172.21.15.82:0/1710761503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff858070e00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 -- 172.21.15.82:0/1710761503 >> 172.21.15.82:0/1710761503 conn(0x7ff8580cad50 msgr2=0x7ff8580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 -- 172.21.15.82:0/1710761503 shutdown_connections 2023-07-20T09:51:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.869+0000 7ff85d293640 1 -- 172.21.15.82:0/1710761503 wait complete. 2023-07-20T09:51:20.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 Processor -- start 2023-07-20T09:51:20.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- start start 2023-07-20T09:51:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 0x7ff85814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff858158ce0 0x7ff8580cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580ac7c0 con 0x7ff858070970 2023-07-20T09:51:20.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85814fad0 con 0x7ff85806b620 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580c7e80 con 0x7ff858158ce0 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55354/0 (socket says 172.21.15.82:55354) 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 -- 172.21.15.82:0/299664959 learned_addr learned my addr 172.21.15.82:0/299664959 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff8577fe640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff858158ce0 0x7ff8580cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff856ffd640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 0x7ff85814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 -- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff858158ce0 msgr2=0x7ff8580cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff858158ce0 0x7ff8580cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 -- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 msgr2=0x7ff85814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 0x7ff85814f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 -- 172.21.15.82:0/299664959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84000ab80 con 0x7ff858070970 2023-07-20T09:51:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff856ffd640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 0x7ff85814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84e7fc640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff84001b680 tx=0x7ff84001a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400b7680 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8400b7800 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8400b7bb0 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8580c8160 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.873+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85813a680 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858071930 con 0x7ff858070970 2023-07-20T09:51:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8400b7d10 con 0x7ff858070970 2023-07-20T09:51:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff84ffff640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 0x7ff838068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff84011ee70 con 0x7ff858070970 2023-07-20T09:51:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff856ffd640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 0x7ff838068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.877+0000 7ff856ffd640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 0x7ff838068740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8580cd7c0 tx=0x7ff848009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:20.881+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8400ec640 con 0x7ff858070970 2023-07-20T09:51:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.029+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff85804da30 con 0x7ff858070970 2023-07-20T09:51:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.673+0000 7ff84ffff640 1 -- 172.21.15.82:0/299664959 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8400efc60 con 0x7ff858070970 2023-07-20T09:51:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T09:51:21.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 msgr2=0x7ff838068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 0x7ff838068740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff8580cd7c0 tx=0x7ff848009040 comp rx=0 tx=0).stop 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 msgr2=0x7ff8580cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff84001b680 tx=0x7ff84001a7f0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 shutdown_connections 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7ff838066280 0x7ff838068740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff858158ce0 0x7ff8580cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff858070970 0x7ff8580cb130 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 --2- 172.21.15.82:0/299664959 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff85806b620 0x7ff85814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 >> 172.21.15.82:0/299664959 conn(0x7ff8580cad50 msgr2=0x7ff8580af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:21.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 shutdown_connections 2023-07-20T09:51:21.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.681+0000 7ff85d293640 1 -- 172.21.15.82:0/299664959 wait complete. 2023-07-20T09:51:21.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T09:51:21.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.853+0000 7f8ab1c9c640 1 Processor -- start 2023-07-20T09:51:21.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.853+0000 7f8ab1c9c640 1 -- start start 2023-07-20T09:51:21.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8ab1c9c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 0x7f8aac15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8ab1c9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8aac159830 0x7f8aac0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8ab1c9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0cc8d0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8ab1c9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0cce90 con 0x7f8aac159830 2023-07-20T09:51:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8ab1c9c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0ccbb0 con 0x7f8aac159450 2023-07-20T09:51:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8aac159830 0x7f8aac0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8aac159830 0x7f8aac0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55362/0 (socket says 172.21.15.82:55362) 2023-07-20T09:51:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 -- 172.21.15.82:0/2983628089 learned_addr learned my addr 172.21.15.82:0/2983628089 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aabfff640 1 --1- 172.21.15.82:0/2983628089 >> v1:172.21.15.82:6789/0 conn(0x7f8aac0cc3e0 0x7f8aac0afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55570/0 (socket says 172.21.15.82:55570) 2023-07-20T09:51:21.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 -- 172.21.15.82:0/2983628089 >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 msgr2=0x7f8aac15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:21.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aab7fe640 1 --2- 172.21.15.82:0/2983628089 >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 0x7f8aac15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 --2- 172.21.15.82:0/2983628089 >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 0x7f8aac15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 -- 172.21.15.82:0/2983628089 >> v1:172.21.15.82:6789/0 conn(0x7f8aac0cc3e0 legacy=0x7f8aac0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaaffd640 1 -- 172.21.15.82:0/2983628089 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac159cc0 con 0x7f8aac159830 2023-07-20T09:51:21.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aaa7fc640 1 -- 172.21.15.82:0/2983628089 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858281921 0 0) 0x7f8aac0cc8d0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.857+0000 7f8aab7fe640 1 --2- 172.21.15.82:0/2983628089 >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 0x7f8aac15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8aaaffd640 1 --2- 172.21.15.82:0/2983628089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac159830 0x7f8aac0cbea0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8aac06a6c0 tx=0x7f8aa001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fd713bee373422 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:21.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8aaa7fc640 1 -- 172.21.15.82:0/2983628089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00aa610 con 0x7f8aac159830 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8aaa7fc640 1 -- 172.21.15.82:0/2983628089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00a6040 con 0x7f8aac159830 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8aaa7fc640 1 -- 172.21.15.82:0/2983628089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00aa990 con 0x7f8aac159830 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2983628089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac159830 msgr2=0x7f8aac0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2983628089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac159830 0x7f8aac0cbea0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8aac06a6c0 tx=0x7f8aa001c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2983628089 shutdown_connections 2023-07-20T09:51:21.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2983628089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac159830 0x7f8aac0cbea0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2983628089 >> v2:172.21.15.183:3300/0 conn(0x7f8aac159450 0x7f8aac15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2983628089 >> 172.21.15.82:0/2983628089 conn(0x7f8aac0cad50 msgr2=0x7f8aac0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:21.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2983628089 shutdown_connections 2023-07-20T09:51:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2983628089 wait complete. 2023-07-20T09:51:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 Processor -- start 2023-07-20T09:51:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.861+0000 7f8ab1c9c640 1 -- start start 2023-07-20T09:51:21.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8aac159450 0x7f8aac0b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8aac1541a0 0x7f8aac1582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15caa0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0b2f60 con 0x7f8aac1541a0 2023-07-20T09:51:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0b3240 con 0x7f8aac159450 2023-07-20T09:51:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55374/0 (socket says 172.21.15.82:55374) 2023-07-20T09:51:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 -- 172.21.15.82:0/2024954789 learned_addr learned my addr 172.21.15.82:0/2024954789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aaaffd640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8aac159450 0x7f8aac0b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aabfff640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8aac1541a0 0x7f8aac1582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 -- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8aac159450 msgr2=0x7f8aac0b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8aac159450 0x7f8aac0b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 -- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8aac1541a0 msgr2=0x7f8aac1582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8aac1541a0 0x7f8aac1582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:21.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 -- 172.21.15.82:0/2024954789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00094d0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8aab7fe640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c7c0 tx=0x7f8a9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c007a30 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c007b90 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00ce70 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac0b3520 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac0b1350 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac04da30 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.865+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a9c0113f0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.869+0000 7f8a93fff640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 0x7f8a98068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.869+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8a9c0840b0 con 0x7f8aac0cc3e0 2023-07-20T09:51:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.869+0000 7f8aaaffd640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 0x7f8a98068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:21.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.869+0000 7f8aaaffd640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 0x7f8a98068770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ae000 tx=0x7f8aa00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:21.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:21.873+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a9c051680 con 0x7f8aac0cc3e0 2023-07-20T09:51:22.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.021+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8aac13d350 con 0x7f8aac0cc3e0 2023-07-20T09:51:22.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.681+0000 7f8a93fff640 1 -- 172.21.15.82:0/2024954789 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8a9c054ca0 con 0x7f8aac0cc3e0 2023-07-20T09:51:22.721 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T09:51:22.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.697+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 msgr2=0x7f8a98068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.697+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 0x7f8a98068770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00ae000 tx=0x7f8aa00a7000 comp rx=0 tx=0).stop 2023-07-20T09:51:22.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.697+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 msgr2=0x7f8aac0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.697+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c7c0 tx=0x7f8a9c00cc80 comp rx=0 tx=0).stop 2023-07-20T09:51:22.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 shutdown_connections 2023-07-20T09:51:22.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8a980662b0 0x7f8a98068770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8aac1541a0 0x7f8aac1582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8aac159450 0x7f8aac0b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 --2- 172.21.15.82:0/2024954789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8aac0cc3e0 0x7f8aac0b2880 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 >> 172.21.15.82:0/2024954789 conn(0x7f8aac0cad50 msgr2=0x7f8aac15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 shutdown_connections 2023-07-20T09:51:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.705+0000 7f8ab1c9c640 1 -- 172.21.15.82:0/2024954789 wait complete. 2023-07-20T09:51:22.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T09:51:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 Processor -- start 2023-07-20T09:51:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 -- start start 2023-07-20T09:51:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e41602b0 0x7f51e4160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f51e406ab10 0x7f51e406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40ce4f0 con 0x7f51e406c120 2023-07-20T09:51:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e406b4c0 con 0x7f51e406ab10 2023-07-20T09:51:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e9537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40d0970 con 0x7f51e41602b0 2023-07-20T09:51:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f51e406c120 0x7f51e40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55582/0 (socket says 172.21.15.82:55582) 2023-07-20T09:51:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e2ffd640 1 -- 172.21.15.82:0/3565574828 learned_addr learned my addr 172.21.15.82:0/3565574828 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e27fc640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e41602b0 0x7f51e4160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e37fe640 1 --2- 172.21.15.82:0/3565574828 >> v2:172.21.15.183:3300/0 conn(0x7f51e406ab10 0x7f51e406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842812727 0 0) 0x7f51e40ce4f0 con 0x7f51e406c120 2023-07-20T09:51:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.869+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51cc003530 con 0x7f51e406c120 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812729914 0 0) 0x7f51cc003530 con 0x7f51e406c120 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e41602b0 msgr2=0x7f51e4160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51e41602b0 0x7f51e4160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 >> v2:172.21.15.183:3300/0 conn(0x7f51e406ab10 msgr2=0x7f51e406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 --2- 172.21.15.82:0/3565574828 >> v2:172.21.15.183:3300/0 conn(0x7f51e406ab10 0x7f51e406af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4160e20 con 0x7f51e406c120 2023-07-20T09:51:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f51d4001680 con 0x7f51e406c120 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 >> v1:172.21.15.82:6789/0 conn(0x7f51e406c120 legacy=0x7f51e40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0039f0 0x7f51cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51cc0047d0 0x7f51cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51cc005190 0x7f51cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e406b4c0 con 0x7f51cc0047d0 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40d0970 con 0x7f51cc005190 2023-07-20T09:51:22.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc00bf80 con 0x7f51cc0039f0 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51cc0047d0 0x7f51cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e2ffd640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0039f0 0x7f51cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e37fe640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51cc005190 0x7f51cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 -- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0039f0 msgr2=0x7f51cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0039f0 0x7f51cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 -- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51cc005190 msgr2=0x7f51cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51cc005190 0x7f51cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 -- 172.21.15.82:0/3565574828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc003530 con 0x7f51cc0047d0 2023-07-20T09:51:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e27fc640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51cc0047d0 0x7f51cc004c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51d80099a0 tx=0x7f51d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fafd2e1e1bd5ff4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.873+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80b0400 con 0x7f51cc0047d0 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80b0560 con 0x7f51cc0047d0 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e1ffb640 1 -- 172.21.15.82:0/3565574828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80b0910 con 0x7f51cc0047d0 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- 172.21.15.82:0/3565574828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51cc0047d0 msgr2=0x7f51cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 --2- 172.21.15.82:0/3565574828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51cc0047d0 0x7f51cc004c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51d80099a0 tx=0x7f51d801c8e0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e37fe640 1 -- 172.21.15.82:0/3565574828 reap_dead start 2023-07-20T09:51:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- 172.21.15.82:0/3565574828 shutdown_connections 2023-07-20T09:51:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- 172.21.15.82:0/3565574828 >> 172.21.15.82:0/3565574828 conn(0x7f51e408c0a0 msgr2=0x7f51e409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- 172.21.15.82:0/3565574828 shutdown_connections 2023-07-20T09:51:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- 172.21.15.82:0/3565574828 wait complete. 2023-07-20T09:51:22.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 Processor -- start 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- start start 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0047d0 0x7f51e40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40af220 0x7f51e40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40cc3d0 con 0x7f51e40c7f80 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40afbe0 con 0x7f51e40af220 2023-07-20T09:51:22.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e9537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40c9a70 con 0x7f51cc0047d0 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55386/0 (socket says 172.21.15.82:55386) 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e27fc640 1 -- 172.21.15.82:0/928148725 learned_addr learned my addr 172.21.15.82:0/928148725 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.877+0000 7f51e37fe640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40af220 0x7f51e40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e2ffd640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0047d0 0x7f51e40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 -- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0047d0 msgr2=0x7f51e40caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0047d0 0x7f51e40caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 -- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40af220 msgr2=0x7f51e40af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40af220 0x7f51e40af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 -- 172.21.15.82:0/928148725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40cb750 con 0x7f51e40c7f80 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e27fc640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f51d80099a0 tx=0x7f51cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8004340 con 0x7f51e40c7f80 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80044a0 con 0x7f51e40c7f80 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80b0910 con 0x7f51e40c7f80 2023-07-20T09:51:22.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40cba30 con 0x7f51e40c7f80 2023-07-20T09:51:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e40cbff0 con 0x7f51e40c7f80 2023-07-20T09:51:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e404da30 con 0x7f51e40c7f80 2023-07-20T09:51:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.881+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51d80ba070 con 0x7f51e40c7f80 2023-07-20T09:51:22.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.885+0000 7f51cb7fe640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 0x7f51d0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.885+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f51d811dc60 con 0x7f51e40c7f80 2023-07-20T09:51:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.885+0000 7f51e2ffd640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 0x7f51d0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:22.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.885+0000 7f51e2ffd640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 0x7f51d0068740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001560 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:22.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:22.889+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51d80eb340 con 0x7f51e40c7f80 2023-07-20T09:51:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.065+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f51e40cee40 con 0x7f51e40c7f80 2023-07-20T09:51:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.685+0000 7f51cb7fe640 1 -- 172.21.15.82:0/928148725 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f51d80ee960 con 0x7f51e40c7f80 2023-07-20T09:51:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 5 and data pool 6 2023-07-20T09:51:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 msgr2=0x7f51d0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 0x7f51d0068740 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f51d4001560 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2023-07-20T09:51:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 msgr2=0x7f51e414ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f51d80099a0 tx=0x7f51cc005800 comp rx=0 tx=0).stop 2023-07-20T09:51:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 shutdown_connections 2023-07-20T09:51:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f51d0066280 0x7f51d0068740 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51e40af220 0x7f51e40af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51e40c7f80 0x7f51e414ca10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 --2- 172.21.15.82:0/928148725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f51cc0047d0 0x7f51e40caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 >> 172.21.15.82:0/928148725 conn(0x7f51e408c0a0 msgr2=0x7f51e40d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 shutdown_connections 2023-07-20T09:51:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.693+0000 7f51e9537640 1 -- 172.21.15.82:0/928148725 wait complete. 2023-07-20T09:51:23.772 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.873+0000 7f9c827d2640 1 Processor -- start 2023-07-20T09:51:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.873+0000 7f9c827d2640 1 -- start start 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c827d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c827d2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 0x7f9c7c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c827d2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c0b2ee0 con 0x7f9c7c0b2060 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c827d2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b3160 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c827d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0b12a0 con 0x7f9c7c0afda0 2023-07-20T09:51:23.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c80d6f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9c7c0b2060 0x7f9c7c0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36666/0 (socket says 172.21.15.82:36666) 2023-07-20T09:51:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c80d6f640 1 -- 172.21.15.82:0/1941902272 learned_addr learned my addr 172.21.15.82:0/1941902272 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:23.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1941902272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7b7fe640 1 --2- 172.21.15.82:0/1941902272 >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 0x7f9c7c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7affd640 1 -- 172.21.15.82:0/1941902272 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022547166 0 0) 0x7f9c7c0b2ee0 con 0x7f9c7c0b2060 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7affd640 1 -- 172.21.15.82:0/1941902272 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c64003530 con 0x7f9c7c0b2060 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7bfff640 1 -- 172.21.15.82:0/1941902272 >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 msgr2=0x7f9c7c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1941902272 >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 0x7f9c7c0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7bfff640 1 -- 172.21.15.82:0/1941902272 >> v1:172.21.15.82:6789/0 conn(0x7f9c7c0b2060 legacy=0x7f9c7c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7bfff640 1 -- 172.21.15.82:0/1941902272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0b1580 con 0x7f9c7c0afda0 2023-07-20T09:51:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.877+0000 7f9c7b7fe640 1 --2- 172.21.15.82:0/1941902272 >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 0x7f9c7c0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:23.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1941902272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0ca6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009dc0 tx=0x7f9c6c01c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d95ed61fdcffb4b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c7affd640 1 -- 172.21.15.82:0/1941902272 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0a58a0 con 0x7f9c7c0afda0 2023-07-20T09:51:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c7affd640 1 -- 172.21.15.82:0/1941902272 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0a5a00 con 0x7f9c7c0afda0 2023-07-20T09:51:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c7affd640 1 -- 172.21.15.82:0/1941902272 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0a5d90 con 0x7f9c7c0afda0 2023-07-20T09:51:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- 172.21.15.82:0/1941902272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 msgr2=0x7f9c7c0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1941902272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0ca6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009dc0 tx=0x7f9c6c01c7e0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- 172.21.15.82:0/1941902272 shutdown_connections 2023-07-20T09:51:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1941902272 >> v2:172.21.15.183:3300/0 conn(0x7f9c7c15a8e0 0x7f9c7c0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1941902272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0ca6b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- 172.21.15.82:0/1941902272 >> 172.21.15.82:0/1941902272 conn(0x7f9c7c0cada0 msgr2=0x7f9c7c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- 172.21.15.82:0/1941902272 shutdown_connections 2023-07-20T09:51:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- 172.21.15.82:0/1941902272 wait complete. 2023-07-20T09:51:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 Processor -- start 2023-07-20T09:51:23.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.881+0000 7f9c827d2640 1 -- start start 2023-07-20T09:51:23.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c0b2060 0x7f9c7c1575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c0aee90 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c15a070 con 0x7f9c7c0b2060 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1522d0 con 0x7f9c7c0afda0 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52980/0 (socket says 172.21.15.82:52980) 2023-07-20T09:51:23.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 -- 172.21.15.82:0/1324116509 learned_addr learned my addr 172.21.15.82:0/1324116509 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c7b7fe640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c0b2060 0x7f9c7c1575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 -- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 msgr2=0x7f9c7c0adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 -- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c0b2060 msgr2=0x7f9c7c1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:23.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c0b2060 0x7f9c7c1575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 -- 172.21.15.82:0/1324116509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c70009420 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c80d6f640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c450 tx=0x7f9c7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c74005cf0 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74005e50 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c009a70 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c740072b0 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c0aeb20 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.885+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c06d710 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.889+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c74007410 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.889+0000 7f9c78ff9640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:23.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.889+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c74083160 con 0x7f9c7c15a8e0 2023-07-20T09:51:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.889+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:23.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.889+0000 7f9c7bfff640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0af000 tx=0x7f9c6c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:23.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:23.893+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c74050680 con 0x7f9c7c15a8e0 2023-07-20T09:51:24.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:51:24.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:51:24.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.041+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c7c073c70 con 0x7f9c7c15a8e0 2023-07-20T09:51:24.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.041+0000 7f9c78ff9640 1 -- 172.21.15.82:0/1324116509 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f9c74053ca0 con 0x7f9c7c15a8e0 2023-07-20T09:51:24.080 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:24.080 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:23.069694+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 msgr2=0x7f9c68068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0af000 tx=0x7f9c6c0a7070 comp rx=0 tx=0).stop 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 msgr2=0x7f9c7c157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c450 tx=0x7f9c7400c910 comp rx=0 tx=0).stop 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 shutdown_connections 2023-07-20T09:51:24.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f9c68066280 0x7f9c68068740 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c7c15a8e0 0x7f9c7c157ae0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9c7c0b2060 0x7f9c7c1575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 --2- 172.21.15.82:0/1324116509 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9c7c0afda0 0x7f9c7c0adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 >> 172.21.15.82:0/1324116509 conn(0x7f9c7c0cada0 msgr2=0x7f9c7c06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 shutdown_connections 2023-07-20T09:51:24.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.045+0000 7f9c827d2640 1 -- 172.21.15.82:0/1324116509 wait complete. 2023-07-20T09:51:24.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 Processor -- start 2023-07-20T09:51:24.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 -- start start 2023-07-20T09:51:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f306415cab0 0x7f30640d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 0x7f30640d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30640cf110 0x7f30640cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640d31c0 con 0x7f30640cf110 2023-07-20T09:51:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640d16b0 con 0x7f306415cab0 2023-07-20T09:51:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306c5db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640b3520 con 0x7f30640d0d10 2023-07-20T09:51:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30640cf110 0x7f30640cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30640cf110 0x7f30640cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52992/0 (socket says 172.21.15.82:52992) 2023-07-20T09:51:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 -- 172.21.15.82:0/1846198005 learned_addr learned my addr 172.21.15.82:0/1846198005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:24.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f3069b76640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 0x7f30640d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306a377640 1 --2- 172.21.15.82:0/1846198005 >> v2:172.21.15.183:3300/0 conn(0x7f306415cab0 0x7f30640d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 -- 172.21.15.82:0/1846198005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 msgr2=0x7f30640d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 0x7f30640d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 -- 172.21.15.82:0/1846198005 >> v2:172.21.15.183:3300/0 conn(0x7f306415cab0 msgr2=0x7f30640d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:24.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 --2- 172.21.15.82:0/1846198005 >> v2:172.21.15.183:3300/0 conn(0x7f306415cab0 0x7f30640d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f306ab78640 1 -- 172.21.15.82:0/1846198005 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640b2910 con 0x7f30640cf110 2023-07-20T09:51:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.249+0000 7f3069b76640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 0x7f30640d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306ab78640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30640cf110 0x7f30640cf5a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f306406a660 tx=0x7f305c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9843df763efaa37c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f3069375640 1 -- 172.21.15.82:0/1846198005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0a5820 con 0x7f30640cf110 2023-07-20T09:51:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f3069375640 1 -- 172.21.15.82:0/1846198005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0a5980 con 0x7f30640cf110 2023-07-20T09:51:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f3069375640 1 -- 172.21.15.82:0/1846198005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0a5d10 con 0x7f30640cf110 2023-07-20T09:51:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 -- 172.21.15.82:0/1846198005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30640cf110 msgr2=0x7f30640cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30640cf110 0x7f30640cf5a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f306406a660 tx=0x7f305c01c9a0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 -- 172.21.15.82:0/1846198005 shutdown_connections 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30640cf110 0x7f30640cf5a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 --2- 172.21.15.82:0/1846198005 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640d0d10 0x7f30640d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 --2- 172.21.15.82:0/1846198005 >> v2:172.21.15.183:3300/0 conn(0x7f306415cab0 0x7f30640d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 -- 172.21.15.82:0/1846198005 >> 172.21.15.82:0/1846198005 conn(0x7f306408c120 msgr2=0x7f306409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 -- 172.21.15.82:0/1846198005 shutdown_connections 2023-07-20T09:51:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.253+0000 7f306c5db640 1 -- 172.21.15.82:0/1846198005 wait complete. 2023-07-20T09:51:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 Processor -- start 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- start start 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640cf110 0x7f30640c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 0x7f30641425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3064142af0 con 0x7f306415cab0 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640c84c0 con 0x7f30640d0d10 2023-07-20T09:51:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640c87a0 con 0x7f30640cf110 2023-07-20T09:51:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53000/0 (socket says 172.21.15.82:53000) 2023-07-20T09:51:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 -- 172.21.15.82:0/4064417577 learned_addr learned my addr 172.21.15.82:0/4064417577 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306a377640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640cf110 0x7f30640c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f3069b76640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 0x7f30641425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 -- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640cf110 msgr2=0x7f30640c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640cf110 0x7f30640c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 -- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 msgr2=0x7f30641425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 0x7f30641425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 -- 172.21.15.82:0/4064417577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c009b30 con 0x7f306415cab0 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f3069b76640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 0x7f30641425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306ab78640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f305c01b050 tx=0x7f305c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b8670 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c0b87f0 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0b8ba0 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30640c8a80 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30640c9040 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.257+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3064153c70 con 0x7f306415cab0 2023-07-20T09:51:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.261+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f305c0b8d00 con 0x7f306415cab0 2023-07-20T09:51:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.261+0000 7f305affd640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.261+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f305c11f250 con 0x7f306415cab0 2023-07-20T09:51:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.261+0000 7f306a377640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.261+0000 7f306a377640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30641f8ac0 tx=0x7f3060008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.265+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3064153c70 con 0x7f306415cab0 2023-07-20T09:51:24.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.413+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3064153c70 con 0x7f306415cab0 2023-07-20T09:51:24.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.413+0000 7f305affd640 1 -- 172.21.15.82:0/4064417577 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f3064153c70 con 0x7f306415cab0 2023-07-20T09:51:24.452 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:24.452 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":36,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:23.069694+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:24.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 msgr2=0x7f3048068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f30641f8ac0 tx=0x7f3060008040 comp rx=0 tx=0).stop 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 msgr2=0x7f30640cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f305c01b050 tx=0x7f305c019740 comp rx=0 tx=0).stop 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 shutdown_connections 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f3048066280 0x7f3048068740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f306415cab0 0x7f30640cc190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30640d0d10 0x7f30641425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 --2- 172.21.15.82:0/4064417577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30640cf110 0x7f30640c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 >> 172.21.15.82:0/4064417577 conn(0x7f306408c120 msgr2=0x7f30640d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 shutdown_connections 2023-07-20T09:51:24.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.417+0000 7f306c5db640 1 -- 172.21.15.82:0/4064417577 wait complete. 2023-07-20T09:51:24.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T09:51:24.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 Processor -- start 2023-07-20T09:51:24.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 -- start start 2023-07-20T09:51:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bc015c6e0 0x7f4bc00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc00d3200 0x7f4bc00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00cdb40 con 0x7f4bc015cac0 2023-07-20T09:51:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00d07a0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc7219640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00cd4f0 con 0x7f4bc00d3200 2023-07-20T09:51:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bc015c6e0 0x7f4bc00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc57b6640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4bc015cac0 0x7f4bc00d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36676/0 (socket says 172.21.15.82:36676) 2023-07-20T09:51:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bc015c6e0 0x7f4bc00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53012/0 (socket says 172.21.15.82:53012) 2023-07-20T09:51:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc57b6640 1 -- 172.21.15.82:0/4101786418 learned_addr learned my addr 172.21.15.82:0/4101786418 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bb7fff640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc00d3200 0x7f4bc00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 -- 172.21.15.82:0/4101786418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc00d3200 msgr2=0x7f4bc00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:24.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc00d3200 0x7f4bc00cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 -- 172.21.15.82:0/4101786418 >> v1:172.21.15.82:6789/0 conn(0x7f4bc015cac0 legacy=0x7f4bc00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bc4fb5640 1 -- 172.21.15.82:0/4101786418 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00cd7d0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.577+0000 7f4bb77fe640 1 -- 172.21.15.82:0/4101786418 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033740541 0 0) 0x7f4bc00cdb40 con 0x7f4bc015cac0 2023-07-20T09:51:24.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc4fb5640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc00cf640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0097c0 tx=0x7f4bbc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4536a854fa5786 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bb77fe640 1 -- 172.21.15.82:0/4101786418 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0ab600 con 0x7f4bc015c6e0 2023-07-20T09:51:24.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bb77fe640 1 -- 172.21.15.82:0/4101786418 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0a7050 con 0x7f4bc015c6e0 2023-07-20T09:51:24.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bb77fe640 1 -- 172.21.15.82:0/4101786418 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0ab980 con 0x7f4bc015c6e0 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 -- 172.21.15.82:0/4101786418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 msgr2=0x7f4bc00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc00cf640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0097c0 tx=0x7f4bbc01c360 comp rx=0 tx=0).stop 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 -- 172.21.15.82:0/4101786418 shutdown_connections 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc00d3200 0x7f4bc00cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 --2- 172.21.15.82:0/4101786418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc00cf640 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 -- 172.21.15.82:0/4101786418 >> 172.21.15.82:0/4101786418 conn(0x7f4bc00d2600 msgr2=0x7f4bc00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:24.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 -- 172.21.15.82:0/4101786418 shutdown_connections 2023-07-20T09:51:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.581+0000 7f4bc7219640 1 -- 172.21.15.82:0/4101786418 wait complete. 2023-07-20T09:51:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 Processor -- start 2023-07-20T09:51:24.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 -- start start 2023-07-20T09:51:24.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bc00d3200 0x7f4bc00b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc015cac0 0x7f4bc00b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01543d0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01546b0 con 0x7f4bc00d3200 2023-07-20T09:51:24.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc7219640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc0154990 con 0x7f4bc015cac0 2023-07-20T09:51:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53026/0 (socket says 172.21.15.82:53026) 2023-07-20T09:51:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 -- 172.21.15.82:0/1891583859 learned_addr learned my addr 172.21.15.82:0/1891583859 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc4fb5640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bc00d3200 0x7f4bc00b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bc57b6640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc015cac0 0x7f4bc00b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 -- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc015cac0 msgr2=0x7f4bc00b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc015cac0 0x7f4bc00b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 -- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bc00d3200 msgr2=0x7f4bc00b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bc00d3200 0x7f4bc00b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:24.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 -- 172.21.15.82:0/1891583859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009420 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb7fff640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d7d0 tx=0x7f4bb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000b6c0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000b820 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.585+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000bbb0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc0154c70 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc00c6c70 con 0x7f4bc015c6e0 2023-07-20T09:51:24.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc004da30 con 0x7f4bc015c6e0 2023-07-20T09:51:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bb000bd10 con 0x7f4bc015c6e0 2023-07-20T09:51:24.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bb57fa640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 0x7f4bac068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bb0084160 con 0x7f4bc015c6e0 2023-07-20T09:51:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bc4fb5640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 0x7f4bac068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.589+0000 7f4bc4fb5640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 0x7f4bac068770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00662a0 tx=0x7f4bbc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:24.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.593+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bb00515f0 con 0x7f4bc015c6e0 2023-07-20T09:51:24.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:24.777+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4bc00b8580 con 0x7f4bc015c6e0 2023-07-20T09:51:25.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.713+0000 7f4bb57fa640 1 -- 172.21.15.82:0/1891583859 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4bb0054c10 con 0x7f4bc015c6e0 2023-07-20T09:51:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 msgr2=0x7f4bac068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 0x7f4bac068770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00662a0 tx=0x7f4bbc0a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 msgr2=0x7f4bc0153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000d7d0 tx=0x7f4bb000dc90 comp rx=0 tx=0).stop 2023-07-20T09:51:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 shutdown_connections 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f4bac0662b0 0x7f4bac068770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bc015cac0 0x7f4bc00b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bc015c6e0 0x7f4bc0153a30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 --2- 172.21.15.82:0/1891583859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bc00d3200 0x7f4bc00b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 >> 172.21.15.82:0/1891583859 conn(0x7f4bc00d2600 msgr2=0x7f4bc015bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 shutdown_connections 2023-07-20T09:51:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.717+0000 7f4bc7219640 1 -- 172.21.15.82:0/1891583859 wait complete. 2023-07-20T09:51:25.776 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T09:51:25.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T09:51:25.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 Processor -- start 2023-07-20T09:51:25.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 -- start start 2023-07-20T09:51:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f454c0cd610 0x7f454c160690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c06dd50 con 0x7f454c160230 2023-07-20T09:51:25.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c06e310 con 0x7f454c0cd610 2023-07-20T09:51:25.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4551f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c15cad0 con 0x7f454c15c6f0 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f454b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f454bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f454c0cd610 0x7f454c160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f454bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f454c0cd610 0x7f454c160690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:47114/0 (socket says 172.21.15.82:47114) 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f454bfff640 1 -- 172.21.15.82:0/4181020864 learned_addr learned my addr 172.21.15.82:0/4181020864 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f454b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c0c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:49570/0 (socket says 172.21.15.82:49570) 2023-07-20T09:51:25.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.885+0000 7f4543fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f454c160230 0x7f454c0ccf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59518/0 (socket says 172.21.15.82:59518) 2023-07-20T09:51:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454bfff640 1 -- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 msgr2=0x7f454c0c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454bfff640 1 --2- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c0c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454bfff640 1 -- 172.21.15.82:0/4181020864 >> v1:172.21.15.183:6789/0 conn(0x7f454c160230 legacy=0x7f454c0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454bfff640 1 -- 172.21.15.82:0/4181020864 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c070990 con 0x7f454c0cd610 2023-07-20T09:51:25.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454bfff640 1 --2- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c160690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4544009e50 tx=0x7f454401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3151870cfd08fd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454affd640 1 -- 172.21.15.82:0/4181020864 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440a58a0 con 0x7f454c0cd610 2023-07-20T09:51:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454affd640 1 -- 172.21.15.82:0/4181020864 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45440a5a00 con 0x7f454c0cd610 2023-07-20T09:51:25.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.889+0000 7f454affd640 1 -- 172.21.15.82:0/4181020864 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440a5d90 con 0x7f454c0cd610 2023-07-20T09:51:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 msgr2=0x7f454c160690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c160690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4544009e50 tx=0x7f454401c9e0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- 172.21.15.82:0/4181020864 shutdown_connections 2023-07-20T09:51:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c160690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- 172.21.15.82:0/4181020864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c0c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- 172.21.15.82:0/4181020864 >> 172.21.15.82:0/4181020864 conn(0x7f454c0b0eb0 msgr2=0x7f454c0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- 172.21.15.82:0/4181020864 shutdown_connections 2023-07-20T09:51:25.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- 172.21.15.82:0/4181020864 wait complete. 2023-07-20T09:51:25.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 Processor -- start 2023-07-20T09:51:25.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- start start 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c155fe0 con 0x7f454c160230 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b2ef0 con 0x7f454c0cd610 2023-07-20T09:51:25.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4551f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1544b0 con 0x7f454c15c6f0 2023-07-20T09:51:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53028/0 (socket says 172.21.15.82:53028) 2023-07-20T09:51:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454bfff640 1 -- 172.21.15.82:0/3774500898 learned_addr learned my addr 172.21.15.82:0/3774500898 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454b7fe640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 -- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 msgr2=0x7f454c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 -- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 msgr2=0x7f454c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f4543fff640 1 -- 172.21.15.82:0/3774500898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544009b30 con 0x7f454c15c6f0 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454bfff640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.893+0000 7f454b7fe640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4543fff640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c153f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f453400c390 tx=0x7f453400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340074e0 con 0x7f454c15c6f0 2023-07-20T09:51:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534007640 con 0x7f454c15c6f0 2023-07-20T09:51:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c155a00 con 0x7f454c15c6f0 2023-07-20T09:51:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534004a10 con 0x7f454c15c6f0 2023-07-20T09:51:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c155720 con 0x7f454c15c6f0 2023-07-20T09:51:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c04da30 con 0x7f454c15c6f0 2023-07-20T09:51:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4534004b70 con 0x7f454c15c6f0 2023-07-20T09:51:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 0x7f452c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4534083590 con 0x7f454c15c6f0 2023-07-20T09:51:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.897+0000 7f454b7fe640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 0x7f452c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.901+0000 7f454b7fe640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 0x7f452c068740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f454c06d830 tx=0x7f453c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:25.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:25.905+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4534050ab0 con 0x7f454c15c6f0 2023-07-20T09:51:26.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.081+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f454c0ce590 con 0x7f454c15c6f0 2023-07-20T09:51:26.301 INFO:tasks.ceph.mds.a.smithi082.stderr:2023-07-20T09:51:26.265+0000 7fc550049640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T09:51:26.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.721+0000 7f4548ff9640 1 -- 172.21.15.82:0/3774500898 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45340540d0 con 0x7f454c15c6f0 2023-07-20T09:51:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 msgr2=0x7f452c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:26.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 0x7f452c068740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f454c06d830 tx=0x7f453c009190 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 msgr2=0x7f454c153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c153f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f453400c390 tx=0x7f453400c850 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 shutdown_connections 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f452c066280 0x7f452c068740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f454c160230 0x7f454c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f454c15c6f0 0x7f454c153f70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 --2- 172.21.15.82:0/3774500898 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f454c0cd610 0x7f454c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 >> 172.21.15.82:0/3774500898 conn(0x7f454c0b0eb0 msgr2=0x7f454c0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 shutdown_connections 2023-07-20T09:51:26.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.725+0000 7f4551f03640 1 -- 172.21.15.82:0/3774500898 wait complete. 2023-07-20T09:51:26.784 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T09:51:26.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:26.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 Processor -- start 2023-07-20T09:51:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 -- start start 2023-07-20T09:51:26.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fd80ca040 0x7f7fd80ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 0x7f7fd815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd815d2d0 0x7f7fd80c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd80cde70 con 0x7f7fd815d2d0 2023-07-20T09:51:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd815d760 con 0x7f7fd80ca040 2023-07-20T09:51:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdf340640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80cbef0 con 0x7f7fd815c910 2023-07-20T09:51:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd815d2d0 0x7f7fd80c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd815d2d0 0x7f7fd80c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53036/0 (socket says 172.21.15.82:53036) 2023-07-20T09:51:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 -- 172.21.15.82:0/540458529 learned_addr learned my addr 172.21.15.82:0/540458529 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:26.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd0dc640 1 --2- 172.21.15.82:0/540458529 >> v2:172.21.15.183:3300/0 conn(0x7f7fd80ca040 0x7f7fd80ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdc8db640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 0x7f7fd815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 -- 172.21.15.82:0/540458529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 msgr2=0x7f7fd815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 0x7f7fd815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 -- 172.21.15.82:0/540458529 >> v2:172.21.15.183:3300/0 conn(0x7f7fd80ca040 msgr2=0x7f7fd80ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 --2- 172.21.15.82:0/540458529 >> v2:172.21.15.183:3300/0 conn(0x7f7fd80ca040 0x7f7fd80ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdd8dd640 1 -- 172.21.15.82:0/540458529 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80ca420 con 0x7f7fd815d2d0 2023-07-20T09:51:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.893+0000 7f7fdc8db640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 0x7f7fd815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdd8dd640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815d2d0 0x7f7fd80c8970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8066a70 tx=0x7f7fd001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34563c1d41ee7c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:26.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fcffff640 1 -- 172.21.15.82:0/540458529 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00a56e0 con 0x7f7fd815d2d0 2023-07-20T09:51:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fcffff640 1 -- 172.21.15.82:0/540458529 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd00a5840 con 0x7f7fd815d2d0 2023-07-20T09:51:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fcffff640 1 -- 172.21.15.82:0/540458529 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd00a5bd0 con 0x7f7fd815d2d0 2023-07-20T09:51:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 -- 172.21.15.82:0/540458529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815d2d0 msgr2=0x7f7fd80c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815d2d0 0x7f7fd80c8970 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8066a70 tx=0x7f7fd001c9d0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 -- 172.21.15.82:0/540458529 shutdown_connections 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815d2d0 0x7f7fd80c8970 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 --2- 172.21.15.82:0/540458529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815c910 0x7f7fd815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 --2- 172.21.15.82:0/540458529 >> v2:172.21.15.183:3300/0 conn(0x7f7fd80ca040 0x7f7fd80ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 -- 172.21.15.82:0/540458529 >> 172.21.15.82:0/540458529 conn(0x7f7fd80cada0 msgr2=0x7f7fd80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 -- 172.21.15.82:0/540458529 shutdown_connections 2023-07-20T09:51:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.897+0000 7f7fdf340640 1 -- 172.21.15.82:0/540458529 wait complete. 2023-07-20T09:51:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 Processor -- start 2023-07-20T09:51:26.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- start start 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd80ca040 0x7f7fd8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815d2d0 0x7f7fd8150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd806f780 con 0x7f7fd815c910 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd81542b0 con 0x7f7fd80ca040 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd80aec50 con 0x7f7fd815d2d0 2023-07-20T09:51:26.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53046/0 (socket says 172.21.15.82:53046) 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 -- 172.21.15.82:0/3064218793 learned_addr learned my addr 172.21.15.82:0/3064218793 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdd8dd640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815d2d0 0x7f7fd8150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdd0dc640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd80ca040 0x7f7fd8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 -- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815d2d0 msgr2=0x7f7fd8150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815d2d0 0x7f7fd8150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 -- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd80ca040 msgr2=0x7f7fd8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:26.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd80ca040 0x7f7fd8153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:26.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 -- 172.21.15.82:0/3064218793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009b30 con 0x7f7fd815c910 2023-07-20T09:51:26.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdc8db640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800e810 tx=0x7f7fc800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:26.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800c8d0 con 0x7f7fd815c910 2023-07-20T09:51:26.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc800ca30 con 0x7f7fd815c910 2023-07-20T09:51:26.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd80aef30 con 0x7f7fd815c910 2023-07-20T09:51:26.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc800cdc0 con 0x7f7fd815c910 2023-07-20T09:51:26.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd80af4f0 con 0x7f7fd815c910 2023-07-20T09:51:26.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.901+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd8073c70 con 0x7f7fd815c910 2023-07-20T09:51:26.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.905+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fc8013410 con 0x7f7fd815c910 2023-07-20T09:51:26.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.905+0000 7f7fcdffb640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 0x7f7fbc068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:26.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.905+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fc8083a00 con 0x7f7fd815c910 2023-07-20T09:51:26.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.905+0000 7f7fdd0dc640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 0x7f7fbc068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:26.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.905+0000 7f7fdd0dc640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 0x7f7fbc068770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009ae0 tx=0x7f7fd4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:26.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:26.909+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fc8050f30 con 0x7f7fd815c910 2023-07-20T09:51:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.085+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fd80cb180 con 0x7f7fd815c910 2023-07-20T09:51:27.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fcdffb640 1 -- 172.21.15.82:0/3064218793 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f7fc8009480 con 0x7f7fd815c910 2023-07-20T09:51:27.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:27.126 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T09:51:27.126 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T09:51:27.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 msgr2=0x7f7fbc068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 0x7f7fbc068770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4009ae0 tx=0x7f7fd4009190 comp rx=0 tx=0).stop 2023-07-20T09:51:27.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 msgr2=0x7f7fd814fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800e810 tx=0x7f7fc800ecd0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 shutdown_connections 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f7fbc0662b0 0x7f7fbc068770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd815d2d0 0x7f7fd8150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd815c910 0x7f7fd814fad0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 --2- 172.21.15.82:0/3064218793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd80ca040 0x7f7fd8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 >> 172.21.15.82:0/3064218793 conn(0x7f7fd80cada0 msgr2=0x7f7fd81549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 shutdown_connections 2023-07-20T09:51:27.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.089+0000 7f7fdf340640 1 -- 172.21.15.82:0/3064218793 wait complete. 2023-07-20T09:51:27.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T09:51:27.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.245+0000 7f2e5f2cb640 1 Processor -- start 2023-07-20T09:51:27.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.245+0000 7f2e5f2cb640 1 -- start start 2023-07-20T09:51:27.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.245+0000 7f2e5f2cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2e5815c5e0 0x7f2e580adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5f2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e580ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5f2cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e580cd080 0x7f2e58160210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5f2cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e580cd4f0 con 0x7f2e580cd080 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5f2cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e580ab890 con 0x7f2e5815c5e0 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5f2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58069ac0 con 0x7f2e580c91f0 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e580cd080 0x7f2e58160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e580cd080 0x7f2e58160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53058/0 (socket says 172.21.15.82:53058) 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 -- 172.21.15.82:0/998323131 learned_addr learned my addr 172.21.15.82:0/998323131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d067640 1 --2- 172.21.15.82:0/998323131 >> v2:172.21.15.183:3300/0 conn(0x7f2e5815c5e0 0x7f2e580adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5c866640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e580ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 -- 172.21.15.82:0/998323131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 msgr2=0x7f2e580ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e580ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 -- 172.21.15.82:0/998323131 >> v2:172.21.15.183:3300/0 conn(0x7f2e5815c5e0 msgr2=0x7f2e580adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 --2- 172.21.15.82:0/998323131 >> v2:172.21.15.183:3300/0 conn(0x7f2e5815c5e0 0x7f2e580adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 -- 172.21.15.82:0/998323131 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580ce2d0 con 0x7f2e580cd080 2023-07-20T09:51:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5c866640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e580ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:27.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e5d868640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e580cd080 0x7f2e58160210 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e580cc690 tx=0x7f2e5001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74b6657d12e0ac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.249+0000 7f2e4ffff640 1 -- 172.21.15.82:0/998323131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500a5560 con 0x7f2e580cd080 2023-07-20T09:51:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e4ffff640 1 -- 172.21.15.82:0/998323131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e500a56c0 con 0x7f2e580cd080 2023-07-20T09:51:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e4ffff640 1 -- 172.21.15.82:0/998323131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500a5a50 con 0x7f2e580cd080 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/998323131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e580cd080 msgr2=0x7f2e58160210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e580cd080 0x7f2e58160210 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e580cc690 tx=0x7f2e5001c6e0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/998323131 shutdown_connections 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e580cd080 0x7f2e58160210 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/998323131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e580ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/998323131 >> v2:172.21.15.183:3300/0 conn(0x7f2e5815c5e0 0x7f2e580adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/998323131 >> 172.21.15.82:0/998323131 conn(0x7f2e580cb620 msgr2=0x7f2e580cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/998323131 shutdown_connections 2023-07-20T09:51:27.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/998323131 wait complete. 2023-07-20T09:51:27.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 Processor -- start 2023-07-20T09:51:27.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- start start 2023-07-20T09:51:27.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e5806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e580cd080 0x7f2e580c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5814f620 con 0x7f2e5815c5e0 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5806e9c0 con 0x7f2e580cd080 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5f2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5815f1c0 con 0x7f2e580c91f0 2023-07-20T09:51:27.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5d868640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5d067640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e5806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.253+0000 7f2e5d868640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53064/0 (socket says 172.21.15.82:53064) 2023-07-20T09:51:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 -- 172.21.15.82:0/3264985677 learned_addr learned my addr 172.21.15.82:0/3264985677 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5c866640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e580cd080 0x7f2e580c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 -- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 msgr2=0x7f2e5806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e5806d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 -- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e580cd080 msgr2=0x7f2e580c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e580cd080 0x7f2e580c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 -- 172.21.15.82:0/3264985677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e50009b30 con 0x7f2e5815c5e0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5d868640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e5001ad90 tx=0x7f2e50019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500a5560 con 0x7f2e5815c5e0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e500b8670 con 0x7f2e5815c5e0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e500b8a00 con 0x7f2e5815c5e0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5815f4a0 con 0x7f2e5815c5e0 2023-07-20T09:51:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5815fa60 con 0x7f2e5815c5e0 2023-07-20T09:51:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5814f760 con 0x7f2e5815c5e0 2023-07-20T09:51:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.257+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e500b8b60 con 0x7f2e5815c5e0 2023-07-20T09:51:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.261+0000 7f2e4dffb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 0x7f2e3c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.261+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e5011ef00 con 0x7f2e5815c5e0 2023-07-20T09:51:27.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.261+0000 7f2e5d067640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 0x7f2e3c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.261+0000 7f2e5d067640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 0x7f2e3c068740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e580c4fd0 tx=0x7f2e54009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.265+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e5814f760 con 0x7f2e5815c5e0 2023-07-20T09:51:27.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.413+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e5814f760 con 0x7f2e5815c5e0 2023-07-20T09:51:27.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.413+0000 7f2e4dffb640 1 -- 172.21.15.82:0/3264985677 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f2e5814f760 con 0x7f2e5815c5e0 2023-07-20T09:51:27.451 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:27.452 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":37,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T09:51:24.698582+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T09:51:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 msgr2=0x7f2e3c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 0x7f2e3c068740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2e580c4fd0 tx=0x7f2e54009190 comp rx=0 tx=0).stop 2023-07-20T09:51:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 msgr2=0x7f2e5815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2e5001ad90 tx=0x7f2e50019480 comp rx=0 tx=0).stop 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 shutdown_connections 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f2e3c066280 0x7f2e3c068740 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e5815c5e0 0x7f2e5815ccb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e580cd080 0x7f2e580c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 --2- 172.21.15.82:0/3264985677 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e580c91f0 0x7f2e5806d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 >> 172.21.15.82:0/3264985677 conn(0x7f2e580cb620 msgr2=0x7f2e581518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 shutdown_connections 2023-07-20T09:51:27.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.417+0000 7f2e5f2cb640 1 -- 172.21.15.82:0/3264985677 wait complete. 2023-07-20T09:51:27.472 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T09:51:27.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:51:27.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 Processor -- start 2023-07-20T09:51:27.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 -- start start 2023-07-20T09:51:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4e01596b0 0x7fc4e015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e00cc900 0x7fc4e00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc4e00b2380 0x7fc4e00b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00b2d50 con 0x7fc4e01596b0 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00ad600 con 0x7fc4e00b2380 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.573+0000 7fc4e60ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00ccd60 con 0x7fc4e00cc900 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4e01596b0 0x7fc4e015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc4e01596b0 0x7fc4e015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53080/0 (socket says 172.21.15.82:53080) 2023-07-20T09:51:27.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1605630565 learned_addr learned my addr 172.21.15.82:0/1605630565 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4d7fff640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e00cc900 0x7fc4e00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4dffff640 1 --2- 172.21.15.82:0/1605630565 >> v2:172.21.15.183:3300/0 conn(0x7fc4e00b2380 0x7fc4e00b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1605630565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e00cc900 msgr2=0x7fc4e00ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e00cc900 0x7fc4e00ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1605630565 >> v2:172.21.15.183:3300/0 conn(0x7fc4e00b2380 msgr2=0x7fc4e00b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1605630565 >> v2:172.21.15.183:3300/0 conn(0x7fc4e00b2380 0x7fc4e00b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1605630565 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00ad810 con 0x7fc4e01596b0 2023-07-20T09:51:27.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e01596b0 0x7fc4e015dbb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00b0e20 tx=0x7fc4d001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa830b4e78ae434a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4deffd640 1 -- 172.21.15.82:0/1605630565 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00a7c30 con 0x7fc4e01596b0 2023-07-20T09:51:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4deffd640 1 -- 172.21.15.82:0/1605630565 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d00a7d90 con 0x7fc4e01596b0 2023-07-20T09:51:27.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.577+0000 7fc4deffd640 1 -- 172.21.15.82:0/1605630565 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00af660 con 0x7fc4e01596b0 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1605630565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e01596b0 msgr2=0x7fc4e015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e01596b0 0x7fc4e015dbb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00b0e20 tx=0x7fc4d001eba0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1605630565 shutdown_connections 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1605630565 >> v2:172.21.15.183:3300/0 conn(0x7fc4e00b2380 0x7fc4e00b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e00cc900 0x7fc4e00ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1605630565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e01596b0 0x7fc4e015dbb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1605630565 >> 172.21.15.82:0/1605630565 conn(0x7fc4e00cada0 msgr2=0x7fc4e00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1605630565 shutdown_connections 2023-07-20T09:51:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1605630565 wait complete. 2023-07-20T09:51:27.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 Processor -- start 2023-07-20T09:51:27.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- start start 2023-07-20T09:51:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4e00cc900 0x7fc4e0155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e01596b0 0x7fc4e00c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00c5870 con 0x7fc4e00b2380 2023-07-20T09:51:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0155f70 con 0x7fc4e00cc900 2023-07-20T09:51:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4e60ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00c7a80 con 0x7fc4e01596b0 2023-07-20T09:51:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53092/0 (socket says 172.21.15.82:53092) 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1060032974 learned_addr learned my addr 172.21.15.82:0/1060032974 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4dffff640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e01596b0 0x7fc4e00c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4d7fff640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4e00cc900 0x7fc4e0155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e01596b0 msgr2=0x7fc4e00c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e01596b0 0x7fc4e00c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4e00cc900 msgr2=0x7fc4e0155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4e00cc900 0x7fc4e0155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.581+0000 7fc4df7fe640 1 -- 172.21.15.82:0/1060032974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d000b770 con 0x7fc4e00b2380 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4df7fe640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000b2c0 tx=0x7fc4d001d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00afe20 con 0x7fc4e00b2380 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ba480 con 0x7fc4e00b2380 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00ba830 con 0x7fc4e00b2380 2023-07-20T09:51:27.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00ad3d0 con 0x7fc4e00b2380 2023-07-20T09:51:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e00ad0f0 con 0x7fc4e00b2380 2023-07-20T09:51:27.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0073c70 con 0x7fc4e00b2380 2023-07-20T09:51:27.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4d00ba990 con 0x7fc4e00b2380 2023-07-20T09:51:27.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 0x7fc4c0068770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc4d011f380 con 0x7fc4e00b2380 2023-07-20T09:51:27.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.585+0000 7fc4d7fff640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 0x7fc4c0068770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.589+0000 7fc4d7fff640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 0x7fc4c0068770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00c9ba0 tx=0x7fc4c8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.589+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4d00ec7f0 con 0x7fc4e00b2380 2023-07-20T09:51:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.737+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4e00adaf0 con 0x7fc4c00662b0 2023-07-20T09:51:27.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.745+0000 7fc4dcff9640 1 -- 172.21.15.82:0/1060032974 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311313 (secure 0 0 0) 0x7fc4c800b200 con 0x7fc4c00662b0 2023-07-20T09:51:27.786 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:27.787 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:51:27.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 msgr2=0x7fc4c0068770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 0x7fc4c0068770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00c9ba0 tx=0x7fc4c8008040 comp rx=0 tx=0).stop 2023-07-20T09:51:27.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 msgr2=0x7fc4e00ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000b2c0 tx=0x7fc4d001d3e0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 shutdown_connections 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fc4c00662b0 0x7fc4c0068770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4e01596b0 0x7fc4e00c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4e00cc900 0x7fc4e0155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 --2- 172.21.15.82:0/1060032974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4e00b2380 0x7fc4e00ac710 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 >> 172.21.15.82:0/1060032974 conn(0x7fc4e00cada0 msgr2=0x7fc4e00b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 shutdown_connections 2023-07-20T09:51:27.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.749+0000 7fc4e60ec640 1 -- 172.21.15.82:0/1060032974 wait complete. 2023-07-20T09:51:27.806 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-07-20T09:51:25.848506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220468,"kb_used_data":4284,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754252,"statfs":{"total":773094113280,"available":772868354048,"internally_reserved":0,"allocated":4386816,"data_stored":2481324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.171858"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.715811+0000","last_change":"2023-07-20T09:51:23.711575+0000","last_active":"2023-07-20T09:51:23.715811+0000","last_peered":"2023-07-20T09:51:23.715811+0000","last_clean":"2023-07-20T09:51:23.715811+0000","last_became_active":"2023-07-20T09:51:23.711247+0000","last_became_peered":"2023-07-20T09:51:23.711247+0000","last_unstale":"2023-07-20T09:51:23.715811+0000","last_undegraded":"2023-07-20T09:51:23.715811+0000","last_fullsized":"2023-07-20T09:51:23.715811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:15.764501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.710771+0000","last_change":"2023-07-20T09:51:23.709238+0000","last_active":"2023-07-20T09:51:23.710771+0000","last_peered":"2023-07-20T09:51:23.710771+0000","last_clean":"2023-07-20T09:51:23.710771+0000","last_became_active":"2023-07-20T09:51:23.708966+0000","last_became_peered":"2023-07-20T09:51:23.708966+0000","last_unstale":"2023-07-20T09:51:23.710771+0000","last_undegraded":"2023-07-20T09:51:23.710771+0000","last_fullsized":"2023-07-20T09:51:23.710771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:44.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732312+0000","last_change":"2023-07-20T09:51:23.731058+0000","last_active":"2023-07-20T09:51:23.732312+0000","last_peered":"2023-07-20T09:51:23.732312+0000","last_clean":"2023-07-20T09:51:23.732312+0000","last_became_active":"2023-07-20T09:51:23.730766+0000","last_became_peered":"2023-07-20T09:51:23.730766+0000","last_unstale":"2023-07-20T09:51:23.732312+0000","last_undegraded":"2023-07-20T09:51:23.732312+0000","last_fullsized":"2023-07-20T09:51:23.732312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:19.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720583+0000","last_change":"2023-07-20T09:51:23.710347+0000","last_active":"2023-07-20T09:51:23.720583+0000","last_peered":"2023-07-20T09:51:23.720583+0000","last_clean":"2023-07-20T09:51:23.720583+0000","last_became_active":"2023-07-20T09:51:23.710082+0000","last_became_peered":"2023-07-20T09:51:23.710082+0000","last_unstale":"2023-07-20T09:51:23.720583+0000","last_undegraded":"2023-07-20T09:51:23.720583+0000","last_fullsized":"2023-07-20T09:51:23.720583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:41.001314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716119+0000","last_change":"2023-07-20T09:51:23.705364+0000","last_active":"2023-07-20T09:51:23.716119+0000","last_peered":"2023-07-20T09:51:23.716119+0000","last_clean":"2023-07-20T09:51:23.716119+0000","last_became_active":"2023-07-20T09:51:23.705036+0000","last_became_peered":"2023-07-20T09:51:23.705036+0000","last_unstale":"2023-07-20T09:51:23.716119+0000","last_undegraded":"2023-07-20T09:51:23.716119+0000","last_fullsized":"2023-07-20T09:51:23.716119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:37.950765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.717563+0000","last_change":"2023-07-20T09:51:23.713605+0000","last_active":"2023-07-20T09:51:23.717563+0000","last_peered":"2023-07-20T09:51:23.717563+0000","last_clean":"2023-07-20T09:51:23.717563+0000","last_became_active":"2023-07-20T09:51:23.713349+0000","last_became_peered":"2023-07-20T09:51:23.713349+0000","last_unstale":"2023-07-20T09:51:23.717563+0000","last_undegraded":"2023-07-20T09:51:23.717563+0000","last_fullsized":"2023-07-20T09:51:23.717563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:51.965201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732047+0000","last_change":"2023-07-20T09:51:23.724201+0000","last_active":"2023-07-20T09:51:23.732047+0000","last_peered":"2023-07-20T09:51:23.732047+0000","last_clean":"2023-07-20T09:51:23.732047+0000","last_became_active":"2023-07-20T09:51:23.723892+0000","last_became_peered":"2023-07-20T09:51:23.723892+0000","last_unstale":"2023-07-20T09:51:23.732047+0000","last_undegraded":"2023-07-20T09:51:23.732047+0000","last_fullsized":"2023-07-20T09:51:23.732047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:27:48.623519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732033+0000","last_change":"2023-07-20T09:51:23.729858+0000","last_active":"2023-07-20T09:51:23.732033+0000","last_peered":"2023-07-20T09:51:23.732033+0000","last_clean":"2023-07-20T09:51:23.732033+0000","last_became_active":"2023-07-20T09:51:23.729587+0000","last_became_peered":"2023-07-20T09:51:23.729587+0000","last_unstale":"2023-07-20T09:51:23.732033+0000","last_undegraded":"2023-07-20T09:51:23.732033+0000","last_fullsized":"2023-07-20T09:51:23.732033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:37.960841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732298+0000","last_change":"2023-07-20T09:51:23.731016+0000","last_active":"2023-07-20T09:51:23.732298+0000","last_peered":"2023-07-20T09:51:23.732298+0000","last_clean":"2023-07-20T09:51:23.732298+0000","last_became_active":"2023-07-20T09:51:23.730830+0000","last_became_peered":"2023-07-20T09:51:23.730830+0000","last_unstale":"2023-07-20T09:51:23.732298+0000","last_undegraded":"2023-07-20T09:51:23.732298+0000","last_fullsized":"2023-07-20T09:51:23.732298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:39:40.805278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731961+0000","last_change":"2023-07-20T09:51:23.722315+0000","last_active":"2023-07-20T09:51:23.731961+0000","last_peered":"2023-07-20T09:51:23.731961+0000","last_clean":"2023-07-20T09:51:23.731961+0000","last_became_active":"2023-07-20T09:51:23.722009+0000","last_became_peered":"2023-07-20T09:51:23.722009+0000","last_unstale":"2023-07-20T09:51:23.731961+0000","last_undegraded":"2023-07-20T09:51:23.731961+0000","last_fullsized":"2023-07-20T09:51:23.731961+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:08.423804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731968+0000","last_change":"2023-07-20T09:51:23.722428+0000","last_active":"2023-07-20T09:51:23.731968+0000","last_peered":"2023-07-20T09:51:23.731968+0000","last_clean":"2023-07-20T09:51:23.731968+0000","last_became_active":"2023-07-20T09:51:23.722145+0000","last_became_peered":"2023-07-20T09:51:23.722145+0000","last_unstale":"2023-07-20T09:51:23.731968+0000","last_undegraded":"2023-07-20T09:51:23.731968+0000","last_fullsized":"2023-07-20T09:51:23.731968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:34.109802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720541+0000","last_change":"2023-07-20T09:51:23.718379+0000","last_active":"2023-07-20T09:51:23.720541+0000","last_peered":"2023-07-20T09:51:23.720541+0000","last_clean":"2023-07-20T09:51:23.720541+0000","last_became_active":"2023-07-20T09:51:23.718069+0000","last_became_peered":"2023-07-20T09:51:23.718069+0000","last_unstale":"2023-07-20T09:51:23.720541+0000","last_undegraded":"2023-07-20T09:51:23.720541+0000","last_fullsized":"2023-07-20T09:51:23.720541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:33.648340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732002+0000","last_change":"2023-07-20T09:51:23.723855+0000","last_active":"2023-07-20T09:51:23.732002+0000","last_peered":"2023-07-20T09:51:23.732002+0000","last_clean":"2023-07-20T09:51:23.732002+0000","last_became_active":"2023-07-20T09:51:23.723465+0000","last_became_peered":"2023-07-20T09:51:23.723465+0000","last_unstale":"2023-07-20T09:51:23.732002+0000","last_undegraded":"2023-07-20T09:51:23.732002+0000","last_fullsized":"2023-07-20T09:51:23.732002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:39.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714152+0000","last_change":"2023-07-20T09:51:23.703689+0000","last_active":"2023-07-20T09:51:23.714152+0000","last_peered":"2023-07-20T09:51:23.714152+0000","last_clean":"2023-07-20T09:51:23.714152+0000","last_became_active":"2023-07-20T09:51:23.703413+0000","last_became_peered":"2023-07-20T09:51:23.703413+0000","last_unstale":"2023-07-20T09:51:23.714152+0000","last_undegraded":"2023-07-20T09:51:23.714152+0000","last_fullsized":"2023-07-20T09:51:23.714152+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:30:29.810250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732061+0000","last_change":"2023-07-20T09:51:23.724438+0000","last_active":"2023-07-20T09:51:23.732061+0000","last_peered":"2023-07-20T09:51:23.732061+0000","last_clean":"2023-07-20T09:51:23.732061+0000","last_became_active":"2023-07-20T09:51:23.722574+0000","last_became_peered":"2023-07-20T09:51:23.722574+0000","last_unstale":"2023-07-20T09:51:23.732061+0000","last_undegraded":"2023-07-20T09:51:23.732061+0000","last_fullsized":"2023-07-20T09:51:23.732061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:41.022380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731591+0000","last_change":"2023-07-20T09:51:23.729133+0000","last_active":"2023-07-20T09:51:23.731591+0000","last_peered":"2023-07-20T09:51:23.731591+0000","last_clean":"2023-07-20T09:51:23.731591+0000","last_became_active":"2023-07-20T09:51:23.728869+0000","last_became_peered":"2023-07-20T09:51:23.728869+0000","last_unstale":"2023-07-20T09:51:23.731591+0000","last_undegraded":"2023-07-20T09:51:23.731591+0000","last_fullsized":"2023-07-20T09:51:23.731591+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:27:48.623519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731640+0000","last_change":"2023-07-20T09:51:23.729912+0000","last_active":"2023-07-20T09:51:23.731640+0000","last_peered":"2023-07-20T09:51:23.731640+0000","last_clean":"2023-07-20T09:51:23.731640+0000","last_became_active":"2023-07-20T09:51:23.729633+0000","last_became_peered":"2023-07-20T09:51:23.729633+0000","last_unstale":"2023-07-20T09:51:23.731640+0000","last_undegraded":"2023-07-20T09:51:23.731640+0000","last_fullsized":"2023-07-20T09:51:23.731640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:34.109802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719398+0000","last_change":"2023-07-20T09:51:23.708451+0000","last_active":"2023-07-20T09:51:23.719398+0000","last_peered":"2023-07-20T09:51:23.719398+0000","last_clean":"2023-07-20T09:51:23.719398+0000","last_became_active":"2023-07-20T09:51:23.708151+0000","last_became_peered":"2023-07-20T09:51:23.708151+0000","last_unstale":"2023-07-20T09:51:23.719398+0000","last_undegraded":"2023-07-20T09:51:23.719398+0000","last_fullsized":"2023-07-20T09:51:23.719398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720525+0000","last_change":"2023-07-20T09:51:23.711245+0000","last_active":"2023-07-20T09:51:23.720525+0000","last_peered":"2023-07-20T09:51:23.720525+0000","last_clean":"2023-07-20T09:51:23.720525+0000","last_became_active":"2023-07-20T09:51:23.710969+0000","last_became_peered":"2023-07-20T09:51:23.710969+0000","last_unstale":"2023-07-20T09:51:23.720525+0000","last_undegraded":"2023-07-20T09:51:23.720525+0000","last_fullsized":"2023-07-20T09:51:23.720525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:12.940839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719434+0000","last_change":"2023-07-20T09:51:23.708527+0000","last_active":"2023-07-20T09:51:23.719434+0000","last_peered":"2023-07-20T09:51:23.719434+0000","last_clean":"2023-07-20T09:51:23.719434+0000","last_became_active":"2023-07-20T09:51:23.708221+0000","last_became_peered":"2023-07-20T09:51:23.708221+0000","last_unstale":"2023-07-20T09:51:23.719434+0000","last_undegraded":"2023-07-20T09:51:23.719434+0000","last_fullsized":"2023-07-20T09:51:23.719434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:31.270839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732151+0000","last_change":"2023-07-20T09:51:23.727462+0000","last_active":"2023-07-20T09:51:23.732151+0000","last_peered":"2023-07-20T09:51:23.732151+0000","last_clean":"2023-07-20T09:51:23.732151+0000","last_became_active":"2023-07-20T09:51:23.725969+0000","last_became_peered":"2023-07-20T09:51:23.725969+0000","last_unstale":"2023-07-20T09:51:23.732151+0000","last_undegraded":"2023-07-20T09:51:23.732151+0000","last_fullsized":"2023-07-20T09:51:23.732151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:05.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714113+0000","last_change":"2023-07-20T09:51:23.702991+0000","last_active":"2023-07-20T09:51:23.714113+0000","last_peered":"2023-07-20T09:51:23.714113+0000","last_clean":"2023-07-20T09:51:23.714113+0000","last_became_active":"2023-07-20T09:51:23.702431+0000","last_became_peered":"2023-07-20T09:51:23.702431+0000","last_unstale":"2023-07-20T09:51:23.714113+0000","last_undegraded":"2023-07-20T09:51:23.714113+0000","last_fullsized":"2023-07-20T09:51:23.714113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:14.351009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714109+0000","last_change":"2023-07-20T09:51:23.710863+0000","last_active":"2023-07-20T09:51:23.714109+0000","last_peered":"2023-07-20T09:51:23.714109+0000","last_clean":"2023-07-20T09:51:23.714109+0000","last_became_active":"2023-07-20T09:51:23.710591+0000","last_became_peered":"2023-07-20T09:51:23.710591+0000","last_unstale":"2023-07-20T09:51:23.714109+0000","last_undegraded":"2023-07-20T09:51:23.714109+0000","last_fullsized":"2023-07-20T09:51:23.714109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:39.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.721467+0000","last_change":"2023-07-20T09:51:23.717244+0000","last_active":"2023-07-20T09:51:23.721467+0000","last_peered":"2023-07-20T09:51:23.721467+0000","last_clean":"2023-07-20T09:51:23.721467+0000","last_became_active":"2023-07-20T09:51:23.716932+0000","last_became_peered":"2023-07-20T09:51:23.716932+0000","last_unstale":"2023-07-20T09:51:23.721467+0000","last_undegraded":"2023-07-20T09:51:23.721467+0000","last_fullsized":"2023-07-20T09:51:23.721467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:45:34.117192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719820+0000","last_change":"2023-07-20T09:51:23.711722+0000","last_active":"2023-07-20T09:51:23.719820+0000","last_peered":"2023-07-20T09:51:23.719820+0000","last_clean":"2023-07-20T09:51:23.719820+0000","last_became_active":"2023-07-20T09:51:23.711462+0000","last_became_peered":"2023-07-20T09:51:23.711462+0000","last_unstale":"2023-07-20T09:51:23.719820+0000","last_undegraded":"2023-07-20T09:51:23.719820+0000","last_fullsized":"2023-07-20T09:51:23.719820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:43:17.628328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733764+0000","last_change":"2023-07-20T09:51:23.730312+0000","last_active":"2023-07-20T09:51:23.733764+0000","last_peered":"2023-07-20T09:51:23.733764+0000","last_clean":"2023-07-20T09:51:23.733764+0000","last_became_active":"2023-07-20T09:51:23.729588+0000","last_became_peered":"2023-07-20T09:51:23.729588+0000","last_unstale":"2023-07-20T09:51:23.733764+0000","last_undegraded":"2023-07-20T09:51:23.733764+0000","last_fullsized":"2023-07-20T09:51:23.733764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:25.535678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.706797+0000","last_change":"2023-07-20T09:51:23.697413+0000","last_active":"2023-07-20T09:51:23.706797+0000","last_peered":"2023-07-20T09:51:23.706797+0000","last_clean":"2023-07-20T09:51:23.706797+0000","last_became_active":"2023-07-20T09:51:23.697065+0000","last_became_peered":"2023-07-20T09:51:23.697065+0000","last_unstale":"2023-07-20T09:51:23.706797+0000","last_undegraded":"2023-07-20T09:51:23.706797+0000","last_fullsized":"2023-07-20T09:51:23.706797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:18.852895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732070+0000","last_change":"2023-07-20T09:51:23.724722+0000","last_active":"2023-07-20T09:51:23.732070+0000","last_peered":"2023-07-20T09:51:23.732070+0000","last_clean":"2023-07-20T09:51:23.732070+0000","last_became_active":"2023-07-20T09:51:23.724364+0000","last_became_peered":"2023-07-20T09:51:23.724364+0000","last_unstale":"2023-07-20T09:51:23.732070+0000","last_undegraded":"2023-07-20T09:51:23.732070+0000","last_fullsized":"2023-07-20T09:51:23.732070+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:38.769747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719666+0000","last_change":"2023-07-20T09:51:23.711000+0000","last_active":"2023-07-20T09:51:23.719666+0000","last_peered":"2023-07-20T09:51:23.719666+0000","last_clean":"2023-07-20T09:51:23.719666+0000","last_became_active":"2023-07-20T09:51:23.710653+0000","last_became_peered":"2023-07-20T09:51:23.710653+0000","last_unstale":"2023-07-20T09:51:23.719666+0000","last_undegraded":"2023-07-20T09:51:23.719666+0000","last_fullsized":"2023-07-20T09:51:23.719666+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:26:43.317056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719541+0000","last_change":"2023-07-20T09:51:23.709888+0000","last_active":"2023-07-20T09:51:23.719541+0000","last_peered":"2023-07-20T09:51:23.719541+0000","last_clean":"2023-07-20T09:51:23.719541+0000","last_became_active":"2023-07-20T09:51:23.709622+0000","last_became_peered":"2023-07-20T09:51:23.709622+0000","last_unstale":"2023-07-20T09:51:23.719541+0000","last_undegraded":"2023-07-20T09:51:23.719541+0000","last_fullsized":"2023-07-20T09:51:23.719541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:12.940839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714131+0000","last_change":"2023-07-20T09:51:23.711239+0000","last_active":"2023-07-20T09:51:23.714131+0000","last_peered":"2023-07-20T09:51:23.714131+0000","last_clean":"2023-07-20T09:51:23.714131+0000","last_became_active":"2023-07-20T09:51:23.710937+0000","last_became_peered":"2023-07-20T09:51:23.710937+0000","last_unstale":"2023-07-20T09:51:23.714131+0000","last_undegraded":"2023-07-20T09:51:23.714131+0000","last_fullsized":"2023-07-20T09:51:23.714131+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:08.423804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.709624+0000","last_change":"2023-07-20T09:51:23.705899+0000","last_active":"2023-07-20T09:51:23.709624+0000","last_peered":"2023-07-20T09:51:23.709624+0000","last_clean":"2023-07-20T09:51:23.709624+0000","last_became_active":"2023-07-20T09:51:23.705542+0000","last_became_peered":"2023-07-20T09:51:23.705542+0000","last_unstale":"2023-07-20T09:51:23.709624+0000","last_undegraded":"2023-07-20T09:51:23.709624+0000","last_fullsized":"2023-07-20T09:51:23.709624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:44.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731608+0000","last_change":"2023-07-20T09:51:23.729173+0000","last_active":"2023-07-20T09:51:23.731608+0000","last_peered":"2023-07-20T09:51:23.731608+0000","last_clean":"2023-07-20T09:51:23.731608+0000","last_became_active":"2023-07-20T09:51:23.728861+0000","last_became_peered":"2023-07-20T09:51:23.728861+0000","last_unstale":"2023-07-20T09:51:23.731608+0000","last_undegraded":"2023-07-20T09:51:23.731608+0000","last_fullsized":"2023-07-20T09:51:23.731608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:30:29.810250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719742+0000","last_change":"2023-07-20T09:51:22.709505+0000","last_active":"2023-07-20T09:51:23.719742+0000","last_peered":"2023-07-20T09:51:23.719742+0000","last_clean":"2023-07-20T09:51:23.719742+0000","last_became_active":"2023-07-20T09:51:22.707848+0000","last_became_peered":"2023-07-20T09:51:22.707848+0000","last_unstale":"2023-07-20T09:51:23.719742+0000","last_undegraded":"2023-07-20T09:51:23.719742+0000","last_fullsized":"2023-07-20T09:51:23.719742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:29.601203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733812+0000","last_change":"2023-07-20T09:51:23.730546+0000","last_active":"2023-07-20T09:51:23.733812+0000","last_peered":"2023-07-20T09:51:23.733812+0000","last_clean":"2023-07-20T09:51:23.733812+0000","last_became_active":"2023-07-20T09:51:23.729701+0000","last_became_peered":"2023-07-20T09:51:23.729701+0000","last_unstale":"2023-07-20T09:51:23.733812+0000","last_undegraded":"2023-07-20T09:51:23.733812+0000","last_fullsized":"2023-07-20T09:51:23.733812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:11.940317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719063+0000","last_change":"2023-07-20T09:51:22.706601+0000","last_active":"2023-07-20T09:51:23.719063+0000","last_peered":"2023-07-20T09:51:23.719063+0000","last_clean":"2023-07-20T09:51:23.719063+0000","last_became_active":"2023-07-20T09:51:22.706281+0000","last_became_peered":"2023-07-20T09:51:22.706281+0000","last_unstale":"2023-07-20T09:51:23.719063+0000","last_undegraded":"2023-07-20T09:51:23.719063+0000","last_fullsized":"2023-07-20T09:51:23.719063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:58.946264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714133+0000","last_change":"2023-07-20T09:51:23.704453+0000","last_active":"2023-07-20T09:51:23.714133+0000","last_peered":"2023-07-20T09:51:23.714133+0000","last_clean":"2023-07-20T09:51:23.714133+0000","last_became_active":"2023-07-20T09:51:23.704201+0000","last_became_peered":"2023-07-20T09:51:23.704201+0000","last_unstale":"2023-07-20T09:51:23.714133+0000","last_undegraded":"2023-07-20T09:51:23.714133+0000","last_fullsized":"2023-07-20T09:51:23.714133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:51.965201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720890+0000","last_change":"2023-07-20T09:51:22.704859+0000","last_active":"2023-07-20T09:51:23.720890+0000","last_peered":"2023-07-20T09:51:23.720890+0000","last_clean":"2023-07-20T09:51:23.720890+0000","last_became_active":"2023-07-20T09:51:22.704328+0000","last_became_peered":"2023-07-20T09:51:22.704328+0000","last_unstale":"2023-07-20T09:51:23.720890+0000","last_undegraded":"2023-07-20T09:51:23.720890+0000","last_fullsized":"2023-07-20T09:51:23.720890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:53.621987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.721001+0000","last_change":"2023-07-20T09:51:23.716401+0000","last_active":"2023-07-20T09:51:23.721001+0000","last_peered":"2023-07-20T09:51:23.721001+0000","last_clean":"2023-07-20T09:51:23.721001+0000","last_became_active":"2023-07-20T09:51:23.716100+0000","last_became_peered":"2023-07-20T09:51:23.716100+0000","last_unstale":"2023-07-20T09:51:23.721001+0000","last_undegraded":"2023-07-20T09:51:23.721001+0000","last_fullsized":"2023-07-20T09:51:23.721001+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.730836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716438+0000","last_change":"2023-07-20T09:51:22.702722+0000","last_active":"2023-07-20T09:51:23.716438+0000","last_peered":"2023-07-20T09:51:23.716438+0000","last_clean":"2023-07-20T09:51:23.716438+0000","last_became_active":"2023-07-20T09:51:22.702438+0000","last_became_peered":"2023-07-20T09:51:22.702438+0000","last_unstale":"2023-07-20T09:51:23.716438+0000","last_undegraded":"2023-07-20T09:51:23.716438+0000","last_fullsized":"2023-07-20T09:51:23.716438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:38.761858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.725577+0000","last_change":"2023-07-20T09:51:23.721940+0000","last_active":"2023-07-20T09:51:23.725577+0000","last_peered":"2023-07-20T09:51:23.725577+0000","last_clean":"2023-07-20T09:51:23.725577+0000","last_became_active":"2023-07-20T09:51:23.721659+0000","last_became_peered":"2023-07-20T09:51:23.721659+0000","last_unstale":"2023-07-20T09:51:23.725577+0000","last_undegraded":"2023-07-20T09:51:23.725577+0000","last_fullsized":"2023-07-20T09:51:23.725577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:20.287561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.727892+0000","last_change":"2023-07-20T09:51:22.712809+0000","last_active":"2023-07-20T09:51:23.727892+0000","last_peered":"2023-07-20T09:51:23.727892+0000","last_clean":"2023-07-20T09:51:23.727892+0000","last_became_active":"2023-07-20T09:51:22.712386+0000","last_became_peered":"2023-07-20T09:51:22.712386+0000","last_unstale":"2023-07-20T09:51:23.727892+0000","last_undegraded":"2023-07-20T09:51:23.727892+0000","last_fullsized":"2023-07-20T09:51:23.727892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:41.877496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732144+0000","last_change":"2023-07-20T09:51:23.727377+0000","last_active":"2023-07-20T09:51:23.732144+0000","last_peered":"2023-07-20T09:51:23.732144+0000","last_clean":"2023-07-20T09:51:23.732144+0000","last_became_active":"2023-07-20T09:51:23.725904+0000","last_became_peered":"2023-07-20T09:51:23.725904+0000","last_unstale":"2023-07-20T09:51:23.732144+0000","last_undegraded":"2023-07-20T09:51:23.732144+0000","last_fullsized":"2023-07-20T09:51:23.732144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:17.235480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.712452+0000","last_change":"2023-07-20T09:51:22.708256+0000","last_active":"2023-07-20T09:51:23.712452+0000","last_peered":"2023-07-20T09:51:23.712452+0000","last_clean":"2023-07-20T09:51:23.712452+0000","last_became_active":"2023-07-20T09:51:22.707920+0000","last_became_peered":"2023-07-20T09:51:22.707920+0000","last_unstale":"2023-07-20T09:51:23.712452+0000","last_undegraded":"2023-07-20T09:51:23.712452+0000","last_fullsized":"2023-07-20T09:51:23.712452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:41.877496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.727660+0000","last_change":"2023-07-20T09:51:23.723377+0000","last_active":"2023-07-20T09:51:23.727660+0000","last_peered":"2023-07-20T09:51:23.727660+0000","last_clean":"2023-07-20T09:51:23.727660+0000","last_became_active":"2023-07-20T09:51:23.723064+0000","last_became_peered":"2023-07-20T09:51:23.723064+0000","last_unstale":"2023-07-20T09:51:23.727660+0000","last_undegraded":"2023-07-20T09:51:23.727660+0000","last_fullsized":"2023-07-20T09:51:23.727660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:31:45.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.699863+0000","last_change":"2023-07-20T09:51:22.708477+0000","last_active":"2023-07-20T09:51:23.699863+0000","last_peered":"2023-07-20T09:51:23.699863+0000","last_clean":"2023-07-20T09:51:23.699863+0000","last_became_active":"2023-07-20T09:51:22.708184+0000","last_became_peered":"2023-07-20T09:51:22.708184+0000","last_unstale":"2023-07-20T09:51:23.699863+0000","last_undegraded":"2023-07-20T09:51:23.699863+0000","last_fullsized":"2023-07-20T09:51:23.699863+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:01.853376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718542+0000","last_change":"2023-07-20T09:51:23.713960+0000","last_active":"2023-07-20T09:51:23.718542+0000","last_peered":"2023-07-20T09:51:23.718542+0000","last_clean":"2023-07-20T09:51:23.718542+0000","last_became_active":"2023-07-20T09:51:23.713702+0000","last_became_peered":"2023-07-20T09:51:23.713702+0000","last_unstale":"2023-07-20T09:51:23.718542+0000","last_undegraded":"2023-07-20T09:51:23.718542+0000","last_fullsized":"2023-07-20T09:51:23.718542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:49:31.488754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692258+0000","last_change":"2023-07-20T09:51:22.703798+0000","last_active":"2023-07-20T09:51:23.692258+0000","last_peered":"2023-07-20T09:51:23.692258+0000","last_clean":"2023-07-20T09:51:23.692258+0000","last_became_active":"2023-07-20T09:51:22.703472+0000","last_became_peered":"2023-07-20T09:51:22.703472+0000","last_unstale":"2023-07-20T09:51:23.692258+0000","last_undegraded":"2023-07-20T09:51:23.692258+0000","last_fullsized":"2023-07-20T09:51:23.692258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:37.761056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716191+0000","last_change":"2023-07-20T09:51:23.705416+0000","last_active":"2023-07-20T09:51:23.716191+0000","last_peered":"2023-07-20T09:51:23.716191+0000","last_clean":"2023-07-20T09:51:23.716191+0000","last_became_active":"2023-07-20T09:51:23.705140+0000","last_became_peered":"2023-07-20T09:51:23.705140+0000","last_unstale":"2023-07-20T09:51:23.716191+0000","last_undegraded":"2023-07-20T09:51:23.716191+0000","last_fullsized":"2023-07-20T09:51:23.716191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:43.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700642+0000","last_change":"2023-07-20T09:51:22.703658+0000","last_active":"2023-07-20T09:51:23.700642+0000","last_peered":"2023-07-20T09:51:23.700642+0000","last_clean":"2023-07-20T09:51:23.700642+0000","last_became_active":"2023-07-20T09:51:22.703406+0000","last_became_peered":"2023-07-20T09:51:22.703406+0000","last_unstale":"2023-07-20T09:51:23.700642+0000","last_undegraded":"2023-07-20T09:51:23.700642+0000","last_fullsized":"2023-07-20T09:51:23.700642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:10.931626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719002+0000","last_change":"2023-07-20T09:51:23.714621+0000","last_active":"2023-07-20T09:51:23.719002+0000","last_peered":"2023-07-20T09:51:23.719002+0000","last_clean":"2023-07-20T09:51:23.719002+0000","last_became_active":"2023-07-20T09:51:23.714304+0000","last_became_peered":"2023-07-20T09:51:23.714304+0000","last_unstale":"2023-07-20T09:51:23.719002+0000","last_undegraded":"2023-07-20T09:51:23.719002+0000","last_fullsized":"2023-07-20T09:51:23.719002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:21.642369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.696829+0000","last_change":"2023-07-20T09:51:22.712617+0000","last_active":"2023-07-20T09:51:23.696829+0000","last_peered":"2023-07-20T09:51:23.696829+0000","last_clean":"2023-07-20T09:51:23.696829+0000","last_became_active":"2023-07-20T09:51:22.712276+0000","last_became_peered":"2023-07-20T09:51:22.712276+0000","last_unstale":"2023-07-20T09:51:23.696829+0000","last_undegraded":"2023-07-20T09:51:23.696829+0000","last_fullsized":"2023-07-20T09:51:23.696829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:04:32.331066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723667+0000","last_change":"2023-07-20T09:51:23.719636+0000","last_active":"2023-07-20T09:51:23.723667+0000","last_peered":"2023-07-20T09:51:23.723667+0000","last_clean":"2023-07-20T09:51:23.723667+0000","last_became_active":"2023-07-20T09:51:23.719365+0000","last_became_peered":"2023-07-20T09:51:23.719365+0000","last_unstale":"2023-07-20T09:51:23.723667+0000","last_undegraded":"2023-07-20T09:51:23.723667+0000","last_fullsized":"2023-07-20T09:51:23.723667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:49:31.488754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728120+0000","last_change":"2023-07-20T09:51:22.704439+0000","last_active":"2023-07-20T09:51:23.728120+0000","last_peered":"2023-07-20T09:51:23.728120+0000","last_clean":"2023-07-20T09:51:23.728120+0000","last_became_active":"2023-07-20T09:51:22.704170+0000","last_became_peered":"2023-07-20T09:51:22.704170+0000","last_unstale":"2023-07-20T09:51:23.728120+0000","last_undegraded":"2023-07-20T09:51:23.728120+0000","last_fullsized":"2023-07-20T09:51:23.728120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:59:16.943232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714183+0000","last_change":"2023-07-20T09:51:23.704084+0000","last_active":"2023-07-20T09:51:23.714183+0000","last_peered":"2023-07-20T09:51:23.714183+0000","last_clean":"2023-07-20T09:51:23.714183+0000","last_became_active":"2023-07-20T09:51:23.701435+0000","last_became_peered":"2023-07-20T09:51:23.701435+0000","last_unstale":"2023-07-20T09:51:23.714183+0000","last_undegraded":"2023-07-20T09:51:23.714183+0000","last_fullsized":"2023-07-20T09:51:23.714183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:21:39.358557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732994+0000","last_change":"2023-07-20T09:51:22.702817+0000","last_active":"2023-07-20T09:51:23.732994+0000","last_peered":"2023-07-20T09:51:23.732994+0000","last_clean":"2023-07-20T09:51:23.732994+0000","last_became_active":"2023-07-20T09:51:22.702551+0000","last_became_peered":"2023-07-20T09:51:22.702551+0000","last_unstale":"2023-07-20T09:51:23.732994+0000","last_undegraded":"2023-07-20T09:51:23.732994+0000","last_fullsized":"2023-07-20T09:51:23.732994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:28:19.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731319+0000","last_change":"2023-07-20T09:51:23.730326+0000","last_active":"2023-07-20T09:51:23.731319+0000","last_peered":"2023-07-20T09:51:23.731319+0000","last_clean":"2023-07-20T09:51:23.731319+0000","last_became_active":"2023-07-20T09:51:23.730038+0000","last_became_peered":"2023-07-20T09:51:23.730038+0000","last_unstale":"2023-07-20T09:51:23.731319+0000","last_undegraded":"2023-07-20T09:51:23.731319+0000","last_fullsized":"2023-07-20T09:51:23.731319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:48.514841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.711644+0000","last_change":"2023-07-20T09:51:22.707161+0000","last_active":"2023-07-20T09:51:23.711644+0000","last_peered":"2023-07-20T09:51:23.711644+0000","last_clean":"2023-07-20T09:51:23.711644+0000","last_became_active":"2023-07-20T09:51:22.704502+0000","last_became_peered":"2023-07-20T09:51:22.704502+0000","last_unstale":"2023-07-20T09:51:23.711644+0000","last_undegraded":"2023-07-20T09:51:23.711644+0000","last_fullsized":"2023-07-20T09:51:23.711644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:18.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.715885+0000","last_change":"2023-07-20T09:51:23.711824+0000","last_active":"2023-07-20T09:51:23.715885+0000","last_peered":"2023-07-20T09:51:23.715885+0000","last_clean":"2023-07-20T09:51:23.715885+0000","last_became_active":"2023-07-20T09:51:23.711568+0000","last_became_peered":"2023-07-20T09:51:23.711568+0000","last_unstale":"2023-07-20T09:51:23.715885+0000","last_undegraded":"2023-07-20T09:51:23.715885+0000","last_fullsized":"2023-07-20T09:51:23.715885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:59.954955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.702820+0000","last_change":"2023-07-20T09:51:22.714516+0000","last_active":"2023-07-20T09:51:23.702820+0000","last_peered":"2023-07-20T09:51:23.702820+0000","last_clean":"2023-07-20T09:51:23.702820+0000","last_became_active":"2023-07-20T09:51:22.714191+0000","last_became_peered":"2023-07-20T09:51:22.714191+0000","last_unstale":"2023-07-20T09:51:23.702820+0000","last_undegraded":"2023-07-20T09:51:23.702820+0000","last_fullsized":"2023-07-20T09:51:23.702820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:13.342318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714784+0000","last_change":"2023-07-20T09:51:23.711475+0000","last_active":"2023-07-20T09:51:23.714784+0000","last_peered":"2023-07-20T09:51:23.714784+0000","last_clean":"2023-07-20T09:51:23.714784+0000","last_became_active":"2023-07-20T09:51:23.711176+0000","last_became_peered":"2023-07-20T09:51:23.711176+0000","last_unstale":"2023-07-20T09:51:23.714784+0000","last_undegraded":"2023-07-20T09:51:23.714784+0000","last_fullsized":"2023-07-20T09:51:23.714784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:38.769747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692172+0000","last_change":"2023-07-20T09:51:22.708995+0000","last_active":"2023-07-20T09:51:23.692172+0000","last_peered":"2023-07-20T09:51:23.692172+0000","last_clean":"2023-07-20T09:51:23.692172+0000","last_became_active":"2023-07-20T09:51:22.708726+0000","last_became_peered":"2023-07-20T09:51:22.708726+0000","last_unstale":"2023-07-20T09:51:23.692172+0000","last_undegraded":"2023-07-20T09:51:23.692172+0000","last_fullsized":"2023-07-20T09:51:23.692172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:02.245049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718318+0000","last_change":"2023-07-20T09:51:23.712134+0000","last_active":"2023-07-20T09:51:23.718318+0000","last_peered":"2023-07-20T09:51:23.718318+0000","last_clean":"2023-07-20T09:51:23.718318+0000","last_became_active":"2023-07-20T09:51:23.711868+0000","last_became_peered":"2023-07-20T09:51:23.711868+0000","last_unstale":"2023-07-20T09:51:23.718318+0000","last_undegraded":"2023-07-20T09:51:23.718318+0000","last_fullsized":"2023-07-20T09:51:23.718318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:20.287561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.722035+0000","last_change":"2023-07-20T09:51:22.707552+0000","last_active":"2023-07-20T09:51:23.722035+0000","last_peered":"2023-07-20T09:51:23.722035+0000","last_clean":"2023-07-20T09:51:23.722035+0000","last_became_active":"2023-07-20T09:51:22.707155+0000","last_became_peered":"2023-07-20T09:51:22.707155+0000","last_unstale":"2023-07-20T09:51:23.722035+0000","last_undegraded":"2023-07-20T09:51:23.722035+0000","last_fullsized":"2023-07-20T09:51:23.722035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:25:40.312171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.712032+0000","last_change":"2023-07-20T09:51:23.710617+0000","last_active":"2023-07-20T09:51:23.712032+0000","last_peered":"2023-07-20T09:51:23.712032+0000","last_clean":"2023-07-20T09:51:23.712032+0000","last_became_active":"2023-07-20T09:51:23.710343+0000","last_became_peered":"2023-07-20T09:51:23.710343+0000","last_unstale":"2023-07-20T09:51:23.712032+0000","last_undegraded":"2023-07-20T09:51:23.712032+0000","last_fullsized":"2023-07-20T09:51:23.712032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:46.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728750+0000","last_change":"2023-07-20T09:51:22.712849+0000","last_active":"2023-07-20T09:51:23.728750+0000","last_peered":"2023-07-20T09:51:23.728750+0000","last_clean":"2023-07-20T09:51:23.728750+0000","last_became_active":"2023-07-20T09:51:22.712558+0000","last_became_peered":"2023-07-20T09:51:22.712558+0000","last_unstale":"2023-07-20T09:51:23.728750+0000","last_undegraded":"2023-07-20T09:51:23.728750+0000","last_fullsized":"2023-07-20T09:51:23.728750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:22.364329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732132+0000","last_change":"2023-07-20T09:51:23.727381+0000","last_active":"2023-07-20T09:51:23.732132+0000","last_peered":"2023-07-20T09:51:23.732132+0000","last_clean":"2023-07-20T09:51:23.732132+0000","last_became_active":"2023-07-20T09:51:23.725909+0000","last_became_peered":"2023-07-20T09:51:23.725909+0000","last_unstale":"2023-07-20T09:51:23.732132+0000","last_undegraded":"2023-07-20T09:51:23.732132+0000","last_fullsized":"2023-07-20T09:51:23.732132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:12.501062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728635+0000","last_change":"2023-07-20T09:51:22.713562+0000","last_active":"2023-07-20T09:51:23.728635+0000","last_peered":"2023-07-20T09:51:23.728635+0000","last_clean":"2023-07-20T09:51:23.728635+0000","last_became_active":"2023-07-20T09:51:22.713283+0000","last_became_peered":"2023-07-20T09:51:22.713283+0000","last_unstale":"2023-07-20T09:51:23.728635+0000","last_undegraded":"2023-07-20T09:51:23.728635+0000","last_fullsized":"2023-07-20T09:51:23.728635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:20.633678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.717190+0000","last_change":"2023-07-20T09:51:23.711833+0000","last_active":"2023-07-20T09:51:23.717190+0000","last_peered":"2023-07-20T09:51:23.717190+0000","last_clean":"2023-07-20T09:51:23.717190+0000","last_became_active":"2023-07-20T09:51:23.711493+0000","last_became_peered":"2023-07-20T09:51:23.711493+0000","last_unstale":"2023-07-20T09:51:23.717190+0000","last_undegraded":"2023-07-20T09:51:23.717190+0000","last_fullsized":"2023-07-20T09:51:23.717190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:12:49.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716746+0000","last_change":"2023-07-20T09:51:22.699495+0000","last_active":"2023-07-20T09:51:23.716746+0000","last_peered":"2023-07-20T09:51:23.716746+0000","last_clean":"2023-07-20T09:51:23.716746+0000","last_became_active":"2023-07-20T09:51:22.699194+0000","last_became_peered":"2023-07-20T09:51:22.699194+0000","last_unstale":"2023-07-20T09:51:23.716746+0000","last_undegraded":"2023-07-20T09:51:23.716746+0000","last_fullsized":"2023-07-20T09:51:23.716746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:29.601203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720509+0000","last_change":"2023-07-20T09:51:23.712445+0000","last_active":"2023-07-20T09:51:23.720509+0000","last_peered":"2023-07-20T09:51:23.720509+0000","last_clean":"2023-07-20T09:51:23.720509+0000","last_became_active":"2023-07-20T09:51:23.712175+0000","last_became_peered":"2023-07-20T09:51:23.712175+0000","last_unstale":"2023-07-20T09:51:23.720509+0000","last_undegraded":"2023-07-20T09:51:23.720509+0000","last_fullsized":"2023-07-20T09:51:23.720509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:22:34.853294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700845+0000","last_change":"2023-07-20T09:51:22.707532+0000","last_active":"2023-07-20T09:51:23.700845+0000","last_peered":"2023-07-20T09:51:23.700845+0000","last_clean":"2023-07-20T09:51:23.700845+0000","last_became_active":"2023-07-20T09:51:22.707246+0000","last_became_peered":"2023-07-20T09:51:22.707246+0000","last_unstale":"2023-07-20T09:51:23.700845+0000","last_undegraded":"2023-07-20T09:51:23.700845+0000","last_fullsized":"2023-07-20T09:51:23.700845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:12.012579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718848+0000","last_change":"2023-07-20T09:51:23.713418+0000","last_active":"2023-07-20T09:51:23.718848+0000","last_peered":"2023-07-20T09:51:23.718848+0000","last_clean":"2023-07-20T09:51:23.718848+0000","last_became_active":"2023-07-20T09:51:23.713077+0000","last_became_peered":"2023-07-20T09:51:23.713077+0000","last_unstale":"2023-07-20T09:51:23.718848+0000","last_undegraded":"2023-07-20T09:51:23.718848+0000","last_fullsized":"2023-07-20T09:51:23.718848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:41.022380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716035+0000","last_change":"2023-07-20T09:51:22.706868+0000","last_active":"2023-07-20T09:51:23.716035+0000","last_peered":"2023-07-20T09:51:23.716035+0000","last_clean":"2023-07-20T09:51:23.716035+0000","last_became_active":"2023-07-20T09:51:22.706583+0000","last_became_peered":"2023-07-20T09:51:22.706583+0000","last_unstale":"2023-07-20T09:51:23.716035+0000","last_undegraded":"2023-07-20T09:51:23.716035+0000","last_fullsized":"2023-07-20T09:51:23.716035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:30.262148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723591+0000","last_change":"2023-07-20T09:51:23.718863+0000","last_active":"2023-07-20T09:51:23.723591+0000","last_peered":"2023-07-20T09:51:23.723591+0000","last_clean":"2023-07-20T09:51:23.723591+0000","last_became_active":"2023-07-20T09:51:23.718646+0000","last_became_peered":"2023-07-20T09:51:23.718646+0000","last_unstale":"2023-07-20T09:51:23.723591+0000","last_undegraded":"2023-07-20T09:51:23.723591+0000","last_fullsized":"2023-07-20T09:51:23.723591+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:01.290633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.691272+0000","last_change":"2023-07-20T09:51:22.706846+0000","last_active":"2023-07-20T09:51:23.691272+0000","last_peered":"2023-07-20T09:51:23.691272+0000","last_clean":"2023-07-20T09:51:23.691272+0000","last_became_active":"2023-07-20T09:51:22.706540+0000","last_became_peered":"2023-07-20T09:51:22.706540+0000","last_unstale":"2023-07-20T09:51:23.691272+0000","last_undegraded":"2023-07-20T09:51:23.691272+0000","last_fullsized":"2023-07-20T09:51:23.691272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:17.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731977+0000","last_change":"2023-07-20T09:51:23.722550+0000","last_active":"2023-07-20T09:51:23.731977+0000","last_peered":"2023-07-20T09:51:23.731977+0000","last_clean":"2023-07-20T09:51:23.731977+0000","last_became_active":"2023-07-20T09:51:23.722108+0000","last_became_peered":"2023-07-20T09:51:23.722108+0000","last_unstale":"2023-07-20T09:51:23.731977+0000","last_undegraded":"2023-07-20T09:51:23.731977+0000","last_fullsized":"2023-07-20T09:51:23.731977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:24:36.380230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698112+0000","last_change":"2023-07-20T09:51:22.713809+0000","last_active":"2023-07-20T09:51:23.698112+0000","last_peered":"2023-07-20T09:51:23.698112+0000","last_clean":"2023-07-20T09:51:23.698112+0000","last_became_active":"2023-07-20T09:51:22.713530+0000","last_became_peered":"2023-07-20T09:51:22.713530+0000","last_unstale":"2023-07-20T09:51:23.698112+0000","last_undegraded":"2023-07-20T09:51:23.698112+0000","last_fullsized":"2023-07-20T09:51:23.698112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:04.599640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718519+0000","last_change":"2023-07-20T09:51:23.713816+0000","last_active":"2023-07-20T09:51:23.718519+0000","last_peered":"2023-07-20T09:51:23.718519+0000","last_clean":"2023-07-20T09:51:23.718519+0000","last_became_active":"2023-07-20T09:51:23.713563+0000","last_became_peered":"2023-07-20T09:51:23.713563+0000","last_unstale":"2023-07-20T09:51:23.718519+0000","last_undegraded":"2023-07-20T09:51:23.718519+0000","last_fullsized":"2023-07-20T09:51:23.718519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:48.514841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.689909+0000","last_change":"2023-07-20T09:51:22.701342+0000","last_active":"2023-07-20T09:51:23.689909+0000","last_peered":"2023-07-20T09:51:23.689909+0000","last_clean":"2023-07-20T09:51:23.689909+0000","last_became_active":"2023-07-20T09:51:22.701066+0000","last_became_peered":"2023-07-20T09:51:22.701066+0000","last_unstale":"2023-07-20T09:51:23.689909+0000","last_undegraded":"2023-07-20T09:51:23.689909+0000","last_fullsized":"2023-07-20T09:51:23.689909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:51.866529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733820+0000","last_change":"2023-07-20T09:51:23.729031+0000","last_active":"2023-07-20T09:51:23.733820+0000","last_peered":"2023-07-20T09:51:23.733820+0000","last_clean":"2023-07-20T09:51:23.733820+0000","last_became_active":"2023-07-20T09:51:23.728087+0000","last_became_peered":"2023-07-20T09:51:23.728087+0000","last_unstale":"2023-07-20T09:51:23.733820+0000","last_undegraded":"2023-07-20T09:51:23.733820+0000","last_fullsized":"2023-07-20T09:51:23.733820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:43:48.554800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698334+0000","last_change":"2023-07-20T09:51:22.707507+0000","last_active":"2023-07-20T09:51:23.698334+0000","last_peered":"2023-07-20T09:51:23.698334+0000","last_clean":"2023-07-20T09:51:23.698334+0000","last_became_active":"2023-07-20T09:51:22.707204+0000","last_became_peered":"2023-07-20T09:51:22.707204+0000","last_unstale":"2023-07-20T09:51:23.698334+0000","last_undegraded":"2023-07-20T09:51:23.698334+0000","last_fullsized":"2023-07-20T09:51:23.698334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:16.226789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700676+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:51:23.700676+0000","last_peered":"2023-07-20T09:51:23.700676+0000","last_clean":"2023-07-20T09:51:23.700676+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:51:23.700676+0000","last_undegraded":"2023-07-20T09:51:23.700676+0000","last_fullsized":"2023-07-20T09:51:23.700676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:19:04.107621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.697101+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:51:23.697101+0000","last_peered":"2023-07-20T09:51:23.697101+0000","last_clean":"2023-07-20T09:51:23.697101+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:51:23.697101+0000","last_undegraded":"2023-07-20T09:51:23.697101+0000","last_fullsized":"2023-07-20T09:51:23.697101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:24:38.967909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733790+0000","last_change":"2023-07-20T09:51:23.730449+0000","last_active":"2023-07-20T09:51:23.733790+0000","last_peered":"2023-07-20T09:51:23.733790+0000","last_clean":"2023-07-20T09:51:23.733790+0000","last_became_active":"2023-07-20T09:51:23.730135+0000","last_became_peered":"2023-07-20T09:51:23.730135+0000","last_unstale":"2023-07-20T09:51:23.733790+0000","last_undegraded":"2023-07-20T09:51:23.733790+0000","last_fullsized":"2023-07-20T09:51:23.733790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.730836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728650+0000","last_change":"2023-07-20T09:51:22.711442+0000","last_active":"2023-07-20T09:51:23.728650+0000","last_peered":"2023-07-20T09:51:23.728650+0000","last_clean":"2023-07-20T09:51:23.728650+0000","last_became_active":"2023-07-20T09:51:22.711160+0000","last_became_peered":"2023-07-20T09:51:22.711160+0000","last_unstale":"2023-07-20T09:51:23.728650+0000","last_undegraded":"2023-07-20T09:51:23.728650+0000","last_fullsized":"2023-07-20T09:51:23.728650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:31:19.801832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.702098+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:51:23.702098+0000","last_peered":"2023-07-20T09:51:23.702098+0000","last_clean":"2023-07-20T09:51:23.702098+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:51:23.702098+0000","last_undegraded":"2023-07-20T09:51:23.702098+0000","last_fullsized":"2023-07-20T09:51:23.702098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:58:15.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719020+0000","last_change":"2023-07-20T09:51:23.714664+0000","last_active":"2023-07-20T09:51:23.719020+0000","last_peered":"2023-07-20T09:51:23.719020+0000","last_clean":"2023-07-20T09:51:23.719020+0000","last_became_active":"2023-07-20T09:51:23.714368+0000","last_became_peered":"2023-07-20T09:51:23.714368+0000","last_unstale":"2023-07-20T09:51:23.719020+0000","last_undegraded":"2023-07-20T09:51:23.719020+0000","last_fullsized":"2023-07-20T09:51:23.719020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:24:36.380230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.690525+0000","last_change":"2023-07-20T09:51:22.708683+0000","last_active":"2023-07-20T09:51:23.690525+0000","last_peered":"2023-07-20T09:51:23.690525+0000","last_clean":"2023-07-20T09:51:23.690525+0000","last_became_active":"2023-07-20T09:51:22.708310+0000","last_became_peered":"2023-07-20T09:51:22.708310+0000","last_unstale":"2023-07-20T09:51:23.690525+0000","last_undegraded":"2023-07-20T09:51:23.690525+0000","last_fullsized":"2023-07-20T09:51:23.690525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:43:16.619637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.689957+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:51:23.689957+0000","last_peered":"2023-07-20T09:51:23.689957+0000","last_clean":"2023-07-20T09:51:23.689957+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:51:23.689957+0000","last_undegraded":"2023-07-20T09:51:23.689957+0000","last_fullsized":"2023-07-20T09:51:23.689957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:19.673210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716550+0000","last_change":"2023-07-20T09:51:23.711402+0000","last_active":"2023-07-20T09:51:23.716550+0000","last_peered":"2023-07-20T09:51:23.716550+0000","last_clean":"2023-07-20T09:51:23.716550+0000","last_became_active":"2023-07-20T09:51:23.711099+0000","last_became_peered":"2023-07-20T09:51:23.711099+0000","last_unstale":"2023-07-20T09:51:23.716550+0000","last_undegraded":"2023-07-20T09:51:23.716550+0000","last_fullsized":"2023-07-20T09:51:23.716550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:46.554601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.707854+0000","last_change":"2023-07-20T09:51:22.703949+0000","last_active":"2023-07-20T09:51:23.707854+0000","last_peered":"2023-07-20T09:51:23.707854+0000","last_clean":"2023-07-20T09:51:23.707854+0000","last_became_active":"2023-07-20T09:51:22.703633+0000","last_became_peered":"2023-07-20T09:51:22.703633+0000","last_unstale":"2023-07-20T09:51:23.707854+0000","last_undegraded":"2023-07-20T09:51:23.707854+0000","last_fullsized":"2023-07-20T09:51:23.707854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:45.753770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.697560+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:51:23.697560+0000","last_peered":"2023-07-20T09:51:23.697560+0000","last_clean":"2023-07-20T09:51:23.697560+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:51:23.697560+0000","last_undegraded":"2023-07-20T09:51:23.697560+0000","last_fullsized":"2023-07-20T09:51:23.697560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:53.317032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723632+0000","last_change":"2023-07-20T09:51:23.719613+0000","last_active":"2023-07-20T09:51:23.723632+0000","last_peered":"2023-07-20T09:51:23.723632+0000","last_clean":"2023-07-20T09:51:23.723632+0000","last_became_active":"2023-07-20T09:51:23.719326+0000","last_became_peered":"2023-07-20T09:51:23.719326+0000","last_unstale":"2023-07-20T09:51:23.723632+0000","last_undegraded":"2023-07-20T09:51:23.723632+0000","last_fullsized":"2023-07-20T09:51:23.723632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:50:06.676322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.708273+0000","last_change":"2023-07-20T09:51:22.711895+0000","last_active":"2023-07-20T09:51:23.708273+0000","last_peered":"2023-07-20T09:51:23.708273+0000","last_clean":"2023-07-20T09:51:23.708273+0000","last_became_active":"2023-07-20T09:51:22.711708+0000","last_became_peered":"2023-07-20T09:51:22.711708+0000","last_unstale":"2023-07-20T09:51:23.708273+0000","last_undegraded":"2023-07-20T09:51:23.708273+0000","last_fullsized":"2023-07-20T09:51:23.708273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:36.952150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700921+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:51:23.700921+0000","last_peered":"2023-07-20T09:51:23.700921+0000","last_clean":"2023-07-20T09:51:23.700921+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:51:23.700921+0000","last_undegraded":"2023-07-20T09:51:23.700921+0000","last_fullsized":"2023-07-20T09:51:23.700921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:57:43.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719110+0000","last_change":"2023-07-20T09:51:23.717086+0000","last_active":"2023-07-20T09:51:23.719110+0000","last_peered":"2023-07-20T09:51:23.719110+0000","last_clean":"2023-07-20T09:51:23.719110+0000","last_became_active":"2023-07-20T09:51:23.716792+0000","last_became_peered":"2023-07-20T09:51:23.716792+0000","last_unstale":"2023-07-20T09:51:23.719110+0000","last_undegraded":"2023-07-20T09:51:23.719110+0000","last_fullsized":"2023-07-20T09:51:23.719110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:15.764501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692493+0000","last_change":"2023-07-20T09:51:22.708969+0000","last_active":"2023-07-20T09:51:23.692493+0000","last_peered":"2023-07-20T09:51:23.692493+0000","last_clean":"2023-07-20T09:51:23.692493+0000","last_became_active":"2023-07-20T09:51:22.708682+0000","last_became_peered":"2023-07-20T09:51:22.708682+0000","last_unstale":"2023-07-20T09:51:23.692493+0000","last_undegraded":"2023-07-20T09:51:23.692493+0000","last_fullsized":"2023-07-20T09:51:23.692493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:35:22.749341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698335+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:51:23.698335+0000","last_peered":"2023-07-20T09:51:23.698335+0000","last_clean":"2023-07-20T09:51:23.698335+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:51:23.698335+0000","last_undegraded":"2023-07-20T09:51:23.698335+0000","last_fullsized":"2023-07-20T09:51:23.698335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:30.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714134+0000","last_change":"2023-07-20T09:51:23.703174+0000","last_active":"2023-07-20T09:51:23.714134+0000","last_peered":"2023-07-20T09:51:23.714134+0000","last_clean":"2023-07-20T09:51:23.714134+0000","last_became_active":"2023-07-20T09:51:23.702762+0000","last_became_peered":"2023-07-20T09:51:23.702762+0000","last_unstale":"2023-07-20T09:51:23.714134+0000","last_undegraded":"2023-07-20T09:51:23.714134+0000","last_fullsized":"2023-07-20T09:51:23.714134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:27.798506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.690674+0000","last_change":"2023-07-20T09:51:22.704923+0000","last_active":"2023-07-20T09:51:23.690674+0000","last_peered":"2023-07-20T09:51:23.690674+0000","last_clean":"2023-07-20T09:51:23.690674+0000","last_became_active":"2023-07-20T09:51:22.704668+0000","last_became_peered":"2023-07-20T09:51:22.704668+0000","last_unstale":"2023-07-20T09:51:23.690674+0000","last_undegraded":"2023-07-20T09:51:23.690674+0000","last_fullsized":"2023-07-20T09:51:23.690674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:53.621987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.701477+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:51:23.701477+0000","last_peered":"2023-07-20T09:51:23.701477+0000","last_clean":"2023-07-20T09:51:23.701477+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:51:23.701477+0000","last_undegraded":"2023-07-20T09:51:23.701477+0000","last_fullsized":"2023-07-20T09:51:23.701477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:24:01.855041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.725123+0000","last_change":"2023-07-20T09:51:23.720507+0000","last_active":"2023-07-20T09:51:23.725123+0000","last_peered":"2023-07-20T09:51:23.725123+0000","last_clean":"2023-07-20T09:51:23.725123+0000","last_became_active":"2023-07-20T09:51:23.719982+0000","last_became_peered":"2023-07-20T09:51:23.719982+0000","last_unstale":"2023-07-20T09:51:23.725123+0000","last_undegraded":"2023-07-20T09:51:23.725123+0000","last_fullsized":"2023-07-20T09:51:23.725123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:55.669985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.696439+0000","last_change":"2023-07-20T09:51:22.697896+0000","last_active":"2023-07-20T09:51:23.696439+0000","last_peered":"2023-07-20T09:51:23.696439+0000","last_clean":"2023-07-20T09:51:23.696439+0000","last_became_active":"2023-07-20T09:51:22.697558+0000","last_became_peered":"2023-07-20T09:51:22.697558+0000","last_unstale":"2023-07-20T09:51:23.696439+0000","last_undegraded":"2023-07-20T09:51:23.696439+0000","last_fullsized":"2023-07-20T09:51:23.696439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:57:36.017511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.691544+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:51:23.691544+0000","last_peered":"2023-07-20T09:51:23.691544+0000","last_clean":"2023-07-20T09:51:23.691544+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:51:23.691544+0000","last_undegraded":"2023-07-20T09:51:23.691544+0000","last_fullsized":"2023-07-20T09:51:23.691544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:21:32.500341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.752}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.749},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.877},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63}]},{"osd":1,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.748},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":169339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.501},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.434}]},{"osd":1,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.438},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.496}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.625}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.749}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:51:27.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T09:51:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 Processor -- start 2023-07-20T09:51:27.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 -- start start 2023-07-20T09:51:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcadc160bc0 0x7fcadc06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 0x7fcadc0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0cc560 con 0x7fcadc160bc0 2023-07-20T09:51:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0ad7e0 con 0x7fcadc160fa0 2023-07-20T09:51:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae3311640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0cc790 con 0x7fcadc06c700 2023-07-20T09:51:27.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae10ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcadc160bc0 0x7fcadc06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae10ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcadc160bc0 0x7fcadc06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53098/0 (socket says 172.21.15.82:53098) 2023-07-20T09:51:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae10ad640 1 -- 172.21.15.82:0/7971339 learned_addr learned my addr 172.21.15.82:0/7971339 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae08ac640 1 --2- 172.21.15.82:0/7971339 >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 0x7fcadc0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.949+0000 7fcae18ae640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 -- 172.21.15.82:0/7971339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 msgr2=0x7fcadc0c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 -- 172.21.15.82:0/7971339 >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 msgr2=0x7fcadc0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 --2- 172.21.15.82:0/7971339 >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 0x7fcadc0c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 -- 172.21.15.82:0/7971339 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0cca70 con 0x7fcadc160bc0 2023-07-20T09:51:27.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae08ac640 1 --2- 172.21.15.82:0/7971339 >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 0x7fcadc0c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae10ad640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160bc0 0x7fcadc06c1c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06a740 tx=0x7fcad801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5056a06f8d5f814 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcad3fff640 1 -- 172.21.15.82:0/7971339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80a5820 con 0x7fcadc160bc0 2023-07-20T09:51:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcad3fff640 1 -- 172.21.15.82:0/7971339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80a5980 con 0x7fcadc160bc0 2023-07-20T09:51:27.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcad3fff640 1 -- 172.21.15.82:0/7971339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80a5d10 con 0x7fcadc160bc0 2023-07-20T09:51:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 -- 172.21.15.82:0/7971339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160bc0 msgr2=0x7fcadc06c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160bc0 0x7fcadc06c1c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcadc06a740 tx=0x7fcad801c9a0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 -- 172.21.15.82:0/7971339 shutdown_connections 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 --2- 172.21.15.82:0/7971339 >> v2:172.21.15.183:3300/0 conn(0x7fcadc160fa0 0x7fcadc0c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 --2- 172.21.15.82:0/7971339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160bc0 0x7fcadc06c1c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.953+0000 7fcae3311640 1 -- 172.21.15.82:0/7971339 >> 172.21.15.82:0/7971339 conn(0x7fcadc0cada0 msgr2=0x7fcadc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- 172.21.15.82:0/7971339 shutdown_connections 2023-07-20T09:51:27.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- 172.21.15.82:0/7971339 wait complete. 2023-07-20T09:51:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 Processor -- start 2023-07-20T09:51:27.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- start start 2023-07-20T09:51:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc160bc0 0x7fcadc154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0afb60 con 0x7fcadc160fa0 2023-07-20T09:51:27.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0aeac0 con 0x7fcadc160bc0 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae3311640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0aeda0 con 0x7fcadc06c700 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53114/0 (socket says 172.21.15.82:53114) 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 -- 172.21.15.82:0/800953278 learned_addr learned my addr 172.21.15.82:0/800953278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae10ad640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae08ac640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc160bc0 0x7fcadc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:27.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 -- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 msgr2=0x7fcadc0abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 -- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc160bc0 msgr2=0x7fcadc154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc160bc0 0x7fcadc154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 -- 172.21.15.82:0/800953278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009b30 con 0x7fcadc160fa0 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.957+0000 7fcae18ae640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d800 tx=0x7fcad400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:27.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400b6c0 con 0x7fcadc160fa0 2023-07-20T09:51:28.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400b820 con 0x7fcadc160fa0 2023-07-20T09:51:28.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400bbd0 con 0x7fcadc160fa0 2023-07-20T09:51:28.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0af080 con 0x7fcadc160fa0 2023-07-20T09:51:28.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0af640 con 0x7fcadc160fa0 2023-07-20T09:51:28.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc073c70 con 0x7fcadc160fa0 2023-07-20T09:51:28.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcad400bd30 con 0x7fcadc160fa0 2023-07-20T09:51:28.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 0x7fcac0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcad40841d0 con 0x7fcadc160fa0 2023-07-20T09:51:28.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.961+0000 7fcae10ad640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 0x7fcac0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.965+0000 7fcae10ad640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 0x7fcac0068740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcad80ae000 tx=0x7fcad80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:27.965+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcad4051660 con 0x7fcadc160fa0 2023-07-20T09:51:28.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.109+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcadc0cd310 con 0x7fcac0066280 2023-07-20T09:51:28.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.117+0000 7fcad1ffb640 1 -- 172.21.15.82:0/800953278 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311313 (secure 0 0 0) 0x7fcad80091d0 con 0x7fcac0066280 2023-07-20T09:51:28.159 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:28.160 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T09:51:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 msgr2=0x7fcac0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 0x7fcac0068740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcad80ae000 tx=0x7fcad80a7070 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 msgr2=0x7fcadc154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcad400d800 tx=0x7fcad400dcc0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 shutdown_connections 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7fcac0066280 0x7fcac0068740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcadc160fa0 0x7fcadc154d70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcadc160bc0 0x7fcadc154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 --2- 172.21.15.82:0/800953278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcadc06c700 0x7fcadc0abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 >> 172.21.15.82:0/800953278 conn(0x7fcadc0cada0 msgr2=0x7fcadc0b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 shutdown_connections 2023-07-20T09:51:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.121+0000 7fcae3311640 1 -- 172.21.15.82:0/800953278 wait complete. 2023-07-20T09:51:28.179 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-07-20T09:51:27.848773+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220468,"kb_used_data":4284,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754252,"statfs":{"total":773094113280,"available":772868354048,"internally_reserved":0,"allocated":4386816,"data_stored":2481324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000918"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.715811+0000","last_change":"2023-07-20T09:51:23.711575+0000","last_active":"2023-07-20T09:51:23.715811+0000","last_peered":"2023-07-20T09:51:23.715811+0000","last_clean":"2023-07-20T09:51:23.715811+0000","last_became_active":"2023-07-20T09:51:23.711247+0000","last_became_peered":"2023-07-20T09:51:23.711247+0000","last_unstale":"2023-07-20T09:51:23.715811+0000","last_undegraded":"2023-07-20T09:51:23.715811+0000","last_fullsized":"2023-07-20T09:51:23.715811+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:15.764501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.710771+0000","last_change":"2023-07-20T09:51:23.709238+0000","last_active":"2023-07-20T09:51:23.710771+0000","last_peered":"2023-07-20T09:51:23.710771+0000","last_clean":"2023-07-20T09:51:23.710771+0000","last_became_active":"2023-07-20T09:51:23.708966+0000","last_became_peered":"2023-07-20T09:51:23.708966+0000","last_unstale":"2023-07-20T09:51:23.710771+0000","last_undegraded":"2023-07-20T09:51:23.710771+0000","last_fullsized":"2023-07-20T09:51:23.710771+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:44.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732312+0000","last_change":"2023-07-20T09:51:23.731058+0000","last_active":"2023-07-20T09:51:23.732312+0000","last_peered":"2023-07-20T09:51:23.732312+0000","last_clean":"2023-07-20T09:51:23.732312+0000","last_became_active":"2023-07-20T09:51:23.730766+0000","last_became_peered":"2023-07-20T09:51:23.730766+0000","last_unstale":"2023-07-20T09:51:23.732312+0000","last_undegraded":"2023-07-20T09:51:23.732312+0000","last_fullsized":"2023-07-20T09:51:23.732312+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:19.636626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720583+0000","last_change":"2023-07-20T09:51:23.710347+0000","last_active":"2023-07-20T09:51:23.720583+0000","last_peered":"2023-07-20T09:51:23.720583+0000","last_clean":"2023-07-20T09:51:23.720583+0000","last_became_active":"2023-07-20T09:51:23.710082+0000","last_became_peered":"2023-07-20T09:51:23.710082+0000","last_unstale":"2023-07-20T09:51:23.720583+0000","last_undegraded":"2023-07-20T09:51:23.720583+0000","last_fullsized":"2023-07-20T09:51:23.720583+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:41.001314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716119+0000","last_change":"2023-07-20T09:51:23.705364+0000","last_active":"2023-07-20T09:51:23.716119+0000","last_peered":"2023-07-20T09:51:23.716119+0000","last_clean":"2023-07-20T09:51:23.716119+0000","last_became_active":"2023-07-20T09:51:23.705036+0000","last_became_peered":"2023-07-20T09:51:23.705036+0000","last_unstale":"2023-07-20T09:51:23.716119+0000","last_undegraded":"2023-07-20T09:51:23.716119+0000","last_fullsized":"2023-07-20T09:51:23.716119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:37.950765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.717563+0000","last_change":"2023-07-20T09:51:23.713605+0000","last_active":"2023-07-20T09:51:23.717563+0000","last_peered":"2023-07-20T09:51:23.717563+0000","last_clean":"2023-07-20T09:51:23.717563+0000","last_became_active":"2023-07-20T09:51:23.713349+0000","last_became_peered":"2023-07-20T09:51:23.713349+0000","last_unstale":"2023-07-20T09:51:23.717563+0000","last_undegraded":"2023-07-20T09:51:23.717563+0000","last_fullsized":"2023-07-20T09:51:23.717563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:51.965201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732047+0000","last_change":"2023-07-20T09:51:23.724201+0000","last_active":"2023-07-20T09:51:23.732047+0000","last_peered":"2023-07-20T09:51:23.732047+0000","last_clean":"2023-07-20T09:51:23.732047+0000","last_became_active":"2023-07-20T09:51:23.723892+0000","last_became_peered":"2023-07-20T09:51:23.723892+0000","last_unstale":"2023-07-20T09:51:23.732047+0000","last_undegraded":"2023-07-20T09:51:23.732047+0000","last_fullsized":"2023-07-20T09:51:23.732047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:27:48.623519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732033+0000","last_change":"2023-07-20T09:51:23.729858+0000","last_active":"2023-07-20T09:51:23.732033+0000","last_peered":"2023-07-20T09:51:23.732033+0000","last_clean":"2023-07-20T09:51:23.732033+0000","last_became_active":"2023-07-20T09:51:23.729587+0000","last_became_peered":"2023-07-20T09:51:23.729587+0000","last_unstale":"2023-07-20T09:51:23.732033+0000","last_undegraded":"2023-07-20T09:51:23.732033+0000","last_fullsized":"2023-07-20T09:51:23.732033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:37.960841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732298+0000","last_change":"2023-07-20T09:51:23.731016+0000","last_active":"2023-07-20T09:51:23.732298+0000","last_peered":"2023-07-20T09:51:23.732298+0000","last_clean":"2023-07-20T09:51:23.732298+0000","last_became_active":"2023-07-20T09:51:23.730830+0000","last_became_peered":"2023-07-20T09:51:23.730830+0000","last_unstale":"2023-07-20T09:51:23.732298+0000","last_undegraded":"2023-07-20T09:51:23.732298+0000","last_fullsized":"2023-07-20T09:51:23.732298+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:39:40.805278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731961+0000","last_change":"2023-07-20T09:51:23.722315+0000","last_active":"2023-07-20T09:51:23.731961+0000","last_peered":"2023-07-20T09:51:23.731961+0000","last_clean":"2023-07-20T09:51:23.731961+0000","last_became_active":"2023-07-20T09:51:23.722009+0000","last_became_peered":"2023-07-20T09:51:23.722009+0000","last_unstale":"2023-07-20T09:51:23.731961+0000","last_undegraded":"2023-07-20T09:51:23.731961+0000","last_fullsized":"2023-07-20T09:51:23.731961+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:08.423804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731968+0000","last_change":"2023-07-20T09:51:23.722428+0000","last_active":"2023-07-20T09:51:23.731968+0000","last_peered":"2023-07-20T09:51:23.731968+0000","last_clean":"2023-07-20T09:51:23.731968+0000","last_became_active":"2023-07-20T09:51:23.722145+0000","last_became_peered":"2023-07-20T09:51:23.722145+0000","last_unstale":"2023-07-20T09:51:23.731968+0000","last_undegraded":"2023-07-20T09:51:23.731968+0000","last_fullsized":"2023-07-20T09:51:23.731968+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:34.109802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720541+0000","last_change":"2023-07-20T09:51:23.718379+0000","last_active":"2023-07-20T09:51:23.720541+0000","last_peered":"2023-07-20T09:51:23.720541+0000","last_clean":"2023-07-20T09:51:23.720541+0000","last_became_active":"2023-07-20T09:51:23.718069+0000","last_became_peered":"2023-07-20T09:51:23.718069+0000","last_unstale":"2023-07-20T09:51:23.720541+0000","last_undegraded":"2023-07-20T09:51:23.720541+0000","last_fullsized":"2023-07-20T09:51:23.720541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:33.648340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732002+0000","last_change":"2023-07-20T09:51:23.723855+0000","last_active":"2023-07-20T09:51:23.732002+0000","last_peered":"2023-07-20T09:51:23.732002+0000","last_clean":"2023-07-20T09:51:23.732002+0000","last_became_active":"2023-07-20T09:51:23.723465+0000","last_became_peered":"2023-07-20T09:51:23.723465+0000","last_unstale":"2023-07-20T09:51:23.732002+0000","last_undegraded":"2023-07-20T09:51:23.732002+0000","last_fullsized":"2023-07-20T09:51:23.732002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:39.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714152+0000","last_change":"2023-07-20T09:51:23.703689+0000","last_active":"2023-07-20T09:51:23.714152+0000","last_peered":"2023-07-20T09:51:23.714152+0000","last_clean":"2023-07-20T09:51:23.714152+0000","last_became_active":"2023-07-20T09:51:23.703413+0000","last_became_peered":"2023-07-20T09:51:23.703413+0000","last_unstale":"2023-07-20T09:51:23.714152+0000","last_undegraded":"2023-07-20T09:51:23.714152+0000","last_fullsized":"2023-07-20T09:51:23.714152+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:30:29.810250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732061+0000","last_change":"2023-07-20T09:51:23.724438+0000","last_active":"2023-07-20T09:51:23.732061+0000","last_peered":"2023-07-20T09:51:23.732061+0000","last_clean":"2023-07-20T09:51:23.732061+0000","last_became_active":"2023-07-20T09:51:23.722574+0000","last_became_peered":"2023-07-20T09:51:23.722574+0000","last_unstale":"2023-07-20T09:51:23.732061+0000","last_undegraded":"2023-07-20T09:51:23.732061+0000","last_fullsized":"2023-07-20T09:51:23.732061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:41.022380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731591+0000","last_change":"2023-07-20T09:51:23.729133+0000","last_active":"2023-07-20T09:51:23.731591+0000","last_peered":"2023-07-20T09:51:23.731591+0000","last_clean":"2023-07-20T09:51:23.731591+0000","last_became_active":"2023-07-20T09:51:23.728869+0000","last_became_peered":"2023-07-20T09:51:23.728869+0000","last_unstale":"2023-07-20T09:51:23.731591+0000","last_undegraded":"2023-07-20T09:51:23.731591+0000","last_fullsized":"2023-07-20T09:51:23.731591+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:27:48.623519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731640+0000","last_change":"2023-07-20T09:51:23.729912+0000","last_active":"2023-07-20T09:51:23.731640+0000","last_peered":"2023-07-20T09:51:23.731640+0000","last_clean":"2023-07-20T09:51:23.731640+0000","last_became_active":"2023-07-20T09:51:23.729633+0000","last_became_peered":"2023-07-20T09:51:23.729633+0000","last_unstale":"2023-07-20T09:51:23.731640+0000","last_undegraded":"2023-07-20T09:51:23.731640+0000","last_fullsized":"2023-07-20T09:51:23.731640+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:34.109802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719398+0000","last_change":"2023-07-20T09:51:23.708451+0000","last_active":"2023-07-20T09:51:23.719398+0000","last_peered":"2023-07-20T09:51:23.719398+0000","last_clean":"2023-07-20T09:51:23.719398+0000","last_became_active":"2023-07-20T09:51:23.708151+0000","last_became_peered":"2023-07-20T09:51:23.708151+0000","last_unstale":"2023-07-20T09:51:23.719398+0000","last_undegraded":"2023-07-20T09:51:23.719398+0000","last_fullsized":"2023-07-20T09:51:23.719398+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:26.808309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720525+0000","last_change":"2023-07-20T09:51:23.711245+0000","last_active":"2023-07-20T09:51:23.720525+0000","last_peered":"2023-07-20T09:51:23.720525+0000","last_clean":"2023-07-20T09:51:23.720525+0000","last_became_active":"2023-07-20T09:51:23.710969+0000","last_became_peered":"2023-07-20T09:51:23.710969+0000","last_unstale":"2023-07-20T09:51:23.720525+0000","last_undegraded":"2023-07-20T09:51:23.720525+0000","last_fullsized":"2023-07-20T09:51:23.720525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:12.940839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719434+0000","last_change":"2023-07-20T09:51:23.708527+0000","last_active":"2023-07-20T09:51:23.719434+0000","last_peered":"2023-07-20T09:51:23.719434+0000","last_clean":"2023-07-20T09:51:23.719434+0000","last_became_active":"2023-07-20T09:51:23.708221+0000","last_became_peered":"2023-07-20T09:51:23.708221+0000","last_unstale":"2023-07-20T09:51:23.719434+0000","last_undegraded":"2023-07-20T09:51:23.719434+0000","last_fullsized":"2023-07-20T09:51:23.719434+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:31.270839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732151+0000","last_change":"2023-07-20T09:51:23.727462+0000","last_active":"2023-07-20T09:51:23.732151+0000","last_peered":"2023-07-20T09:51:23.732151+0000","last_clean":"2023-07-20T09:51:23.732151+0000","last_became_active":"2023-07-20T09:51:23.725969+0000","last_became_peered":"2023-07-20T09:51:23.725969+0000","last_unstale":"2023-07-20T09:51:23.732151+0000","last_undegraded":"2023-07-20T09:51:23.732151+0000","last_fullsized":"2023-07-20T09:51:23.732151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:05.608331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714113+0000","last_change":"2023-07-20T09:51:23.702991+0000","last_active":"2023-07-20T09:51:23.714113+0000","last_peered":"2023-07-20T09:51:23.714113+0000","last_clean":"2023-07-20T09:51:23.714113+0000","last_became_active":"2023-07-20T09:51:23.702431+0000","last_became_peered":"2023-07-20T09:51:23.702431+0000","last_unstale":"2023-07-20T09:51:23.714113+0000","last_undegraded":"2023-07-20T09:51:23.714113+0000","last_fullsized":"2023-07-20T09:51:23.714113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:14.351009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714109+0000","last_change":"2023-07-20T09:51:23.710863+0000","last_active":"2023-07-20T09:51:23.714109+0000","last_peered":"2023-07-20T09:51:23.714109+0000","last_clean":"2023-07-20T09:51:23.714109+0000","last_became_active":"2023-07-20T09:51:23.710591+0000","last_became_peered":"2023-07-20T09:51:23.710591+0000","last_unstale":"2023-07-20T09:51:23.714109+0000","last_undegraded":"2023-07-20T09:51:23.714109+0000","last_fullsized":"2023-07-20T09:51:23.714109+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:39.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.721467+0000","last_change":"2023-07-20T09:51:23.717244+0000","last_active":"2023-07-20T09:51:23.721467+0000","last_peered":"2023-07-20T09:51:23.721467+0000","last_clean":"2023-07-20T09:51:23.721467+0000","last_became_active":"2023-07-20T09:51:23.716932+0000","last_became_peered":"2023-07-20T09:51:23.716932+0000","last_unstale":"2023-07-20T09:51:23.721467+0000","last_undegraded":"2023-07-20T09:51:23.721467+0000","last_fullsized":"2023-07-20T09:51:23.721467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:45:34.117192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719820+0000","last_change":"2023-07-20T09:51:23.711722+0000","last_active":"2023-07-20T09:51:23.719820+0000","last_peered":"2023-07-20T09:51:23.719820+0000","last_clean":"2023-07-20T09:51:23.719820+0000","last_became_active":"2023-07-20T09:51:23.711462+0000","last_became_peered":"2023-07-20T09:51:23.711462+0000","last_unstale":"2023-07-20T09:51:23.719820+0000","last_undegraded":"2023-07-20T09:51:23.719820+0000","last_fullsized":"2023-07-20T09:51:23.719820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:43:17.628328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733764+0000","last_change":"2023-07-20T09:51:23.730312+0000","last_active":"2023-07-20T09:51:23.733764+0000","last_peered":"2023-07-20T09:51:23.733764+0000","last_clean":"2023-07-20T09:51:23.733764+0000","last_became_active":"2023-07-20T09:51:23.729588+0000","last_became_peered":"2023-07-20T09:51:23.729588+0000","last_unstale":"2023-07-20T09:51:23.733764+0000","last_undegraded":"2023-07-20T09:51:23.733764+0000","last_fullsized":"2023-07-20T09:51:23.733764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:25.535678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.706797+0000","last_change":"2023-07-20T09:51:23.697413+0000","last_active":"2023-07-20T09:51:23.706797+0000","last_peered":"2023-07-20T09:51:23.706797+0000","last_clean":"2023-07-20T09:51:23.706797+0000","last_became_active":"2023-07-20T09:51:23.697065+0000","last_became_peered":"2023-07-20T09:51:23.697065+0000","last_unstale":"2023-07-20T09:51:23.706797+0000","last_undegraded":"2023-07-20T09:51:23.706797+0000","last_fullsized":"2023-07-20T09:51:23.706797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:18.852895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732070+0000","last_change":"2023-07-20T09:51:23.724722+0000","last_active":"2023-07-20T09:51:23.732070+0000","last_peered":"2023-07-20T09:51:23.732070+0000","last_clean":"2023-07-20T09:51:23.732070+0000","last_became_active":"2023-07-20T09:51:23.724364+0000","last_became_peered":"2023-07-20T09:51:23.724364+0000","last_unstale":"2023-07-20T09:51:23.732070+0000","last_undegraded":"2023-07-20T09:51:23.732070+0000","last_fullsized":"2023-07-20T09:51:23.732070+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:38.769747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719666+0000","last_change":"2023-07-20T09:51:23.711000+0000","last_active":"2023-07-20T09:51:23.719666+0000","last_peered":"2023-07-20T09:51:23.719666+0000","last_clean":"2023-07-20T09:51:23.719666+0000","last_became_active":"2023-07-20T09:51:23.710653+0000","last_became_peered":"2023-07-20T09:51:23.710653+0000","last_unstale":"2023-07-20T09:51:23.719666+0000","last_undegraded":"2023-07-20T09:51:23.719666+0000","last_fullsized":"2023-07-20T09:51:23.719666+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:26:43.317056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719541+0000","last_change":"2023-07-20T09:51:23.709888+0000","last_active":"2023-07-20T09:51:23.719541+0000","last_peered":"2023-07-20T09:51:23.719541+0000","last_clean":"2023-07-20T09:51:23.719541+0000","last_became_active":"2023-07-20T09:51:23.709622+0000","last_became_peered":"2023-07-20T09:51:23.709622+0000","last_unstale":"2023-07-20T09:51:23.719541+0000","last_undegraded":"2023-07-20T09:51:23.719541+0000","last_fullsized":"2023-07-20T09:51:23.719541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:12.940839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714131+0000","last_change":"2023-07-20T09:51:23.711239+0000","last_active":"2023-07-20T09:51:23.714131+0000","last_peered":"2023-07-20T09:51:23.714131+0000","last_clean":"2023-07-20T09:51:23.714131+0000","last_became_active":"2023-07-20T09:51:23.710937+0000","last_became_peered":"2023-07-20T09:51:23.710937+0000","last_unstale":"2023-07-20T09:51:23.714131+0000","last_undegraded":"2023-07-20T09:51:23.714131+0000","last_fullsized":"2023-07-20T09:51:23.714131+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:08.423804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.709624+0000","last_change":"2023-07-20T09:51:23.705899+0000","last_active":"2023-07-20T09:51:23.709624+0000","last_peered":"2023-07-20T09:51:23.709624+0000","last_clean":"2023-07-20T09:51:23.709624+0000","last_became_active":"2023-07-20T09:51:23.705542+0000","last_became_peered":"2023-07-20T09:51:23.705542+0000","last_unstale":"2023-07-20T09:51:23.709624+0000","last_undegraded":"2023-07-20T09:51:23.709624+0000","last_fullsized":"2023-07-20T09:51:23.709624+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:44.959017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731608+0000","last_change":"2023-07-20T09:51:23.729173+0000","last_active":"2023-07-20T09:51:23.731608+0000","last_peered":"2023-07-20T09:51:23.731608+0000","last_clean":"2023-07-20T09:51:23.731608+0000","last_became_active":"2023-07-20T09:51:23.728861+0000","last_became_peered":"2023-07-20T09:51:23.728861+0000","last_unstale":"2023-07-20T09:51:23.731608+0000","last_undegraded":"2023-07-20T09:51:23.731608+0000","last_fullsized":"2023-07-20T09:51:23.731608+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:30:29.810250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719742+0000","last_change":"2023-07-20T09:51:22.709505+0000","last_active":"2023-07-20T09:51:23.719742+0000","last_peered":"2023-07-20T09:51:23.719742+0000","last_clean":"2023-07-20T09:51:23.719742+0000","last_became_active":"2023-07-20T09:51:22.707848+0000","last_became_peered":"2023-07-20T09:51:22.707848+0000","last_unstale":"2023-07-20T09:51:23.719742+0000","last_undegraded":"2023-07-20T09:51:23.719742+0000","last_fullsized":"2023-07-20T09:51:23.719742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:29.601203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733812+0000","last_change":"2023-07-20T09:51:23.730546+0000","last_active":"2023-07-20T09:51:23.733812+0000","last_peered":"2023-07-20T09:51:23.733812+0000","last_clean":"2023-07-20T09:51:23.733812+0000","last_became_active":"2023-07-20T09:51:23.729701+0000","last_became_peered":"2023-07-20T09:51:23.729701+0000","last_unstale":"2023-07-20T09:51:23.733812+0000","last_undegraded":"2023-07-20T09:51:23.733812+0000","last_fullsized":"2023-07-20T09:51:23.733812+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:11.940317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719063+0000","last_change":"2023-07-20T09:51:22.706601+0000","last_active":"2023-07-20T09:51:23.719063+0000","last_peered":"2023-07-20T09:51:23.719063+0000","last_clean":"2023-07-20T09:51:23.719063+0000","last_became_active":"2023-07-20T09:51:22.706281+0000","last_became_peered":"2023-07-20T09:51:22.706281+0000","last_unstale":"2023-07-20T09:51:23.719063+0000","last_undegraded":"2023-07-20T09:51:23.719063+0000","last_fullsized":"2023-07-20T09:51:23.719063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:58.946264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714133+0000","last_change":"2023-07-20T09:51:23.704453+0000","last_active":"2023-07-20T09:51:23.714133+0000","last_peered":"2023-07-20T09:51:23.714133+0000","last_clean":"2023-07-20T09:51:23.714133+0000","last_became_active":"2023-07-20T09:51:23.704201+0000","last_became_peered":"2023-07-20T09:51:23.704201+0000","last_unstale":"2023-07-20T09:51:23.714133+0000","last_undegraded":"2023-07-20T09:51:23.714133+0000","last_fullsized":"2023-07-20T09:51:23.714133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:51.965201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720890+0000","last_change":"2023-07-20T09:51:22.704859+0000","last_active":"2023-07-20T09:51:23.720890+0000","last_peered":"2023-07-20T09:51:23.720890+0000","last_clean":"2023-07-20T09:51:23.720890+0000","last_became_active":"2023-07-20T09:51:22.704328+0000","last_became_peered":"2023-07-20T09:51:22.704328+0000","last_unstale":"2023-07-20T09:51:23.720890+0000","last_undegraded":"2023-07-20T09:51:23.720890+0000","last_fullsized":"2023-07-20T09:51:23.720890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:53.621987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.721001+0000","last_change":"2023-07-20T09:51:23.716401+0000","last_active":"2023-07-20T09:51:23.721001+0000","last_peered":"2023-07-20T09:51:23.721001+0000","last_clean":"2023-07-20T09:51:23.721001+0000","last_became_active":"2023-07-20T09:51:23.716100+0000","last_became_peered":"2023-07-20T09:51:23.716100+0000","last_unstale":"2023-07-20T09:51:23.721001+0000","last_undegraded":"2023-07-20T09:51:23.721001+0000","last_fullsized":"2023-07-20T09:51:23.721001+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.730836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716438+0000","last_change":"2023-07-20T09:51:22.702722+0000","last_active":"2023-07-20T09:51:23.716438+0000","last_peered":"2023-07-20T09:51:23.716438+0000","last_clean":"2023-07-20T09:51:23.716438+0000","last_became_active":"2023-07-20T09:51:22.702438+0000","last_became_peered":"2023-07-20T09:51:22.702438+0000","last_unstale":"2023-07-20T09:51:23.716438+0000","last_undegraded":"2023-07-20T09:51:23.716438+0000","last_fullsized":"2023-07-20T09:51:23.716438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:38.761858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.725577+0000","last_change":"2023-07-20T09:51:23.721940+0000","last_active":"2023-07-20T09:51:23.725577+0000","last_peered":"2023-07-20T09:51:23.725577+0000","last_clean":"2023-07-20T09:51:23.725577+0000","last_became_active":"2023-07-20T09:51:23.721659+0000","last_became_peered":"2023-07-20T09:51:23.721659+0000","last_unstale":"2023-07-20T09:51:23.725577+0000","last_undegraded":"2023-07-20T09:51:23.725577+0000","last_fullsized":"2023-07-20T09:51:23.725577+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:20.287561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.727892+0000","last_change":"2023-07-20T09:51:22.712809+0000","last_active":"2023-07-20T09:51:23.727892+0000","last_peered":"2023-07-20T09:51:23.727892+0000","last_clean":"2023-07-20T09:51:23.727892+0000","last_became_active":"2023-07-20T09:51:22.712386+0000","last_became_peered":"2023-07-20T09:51:22.712386+0000","last_unstale":"2023-07-20T09:51:23.727892+0000","last_undegraded":"2023-07-20T09:51:23.727892+0000","last_fullsized":"2023-07-20T09:51:23.727892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:41.877496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732144+0000","last_change":"2023-07-20T09:51:23.727377+0000","last_active":"2023-07-20T09:51:23.732144+0000","last_peered":"2023-07-20T09:51:23.732144+0000","last_clean":"2023-07-20T09:51:23.732144+0000","last_became_active":"2023-07-20T09:51:23.725904+0000","last_became_peered":"2023-07-20T09:51:23.725904+0000","last_unstale":"2023-07-20T09:51:23.732144+0000","last_undegraded":"2023-07-20T09:51:23.732144+0000","last_fullsized":"2023-07-20T09:51:23.732144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:17.235480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.712452+0000","last_change":"2023-07-20T09:51:22.708256+0000","last_active":"2023-07-20T09:51:23.712452+0000","last_peered":"2023-07-20T09:51:23.712452+0000","last_clean":"2023-07-20T09:51:23.712452+0000","last_became_active":"2023-07-20T09:51:22.707920+0000","last_became_peered":"2023-07-20T09:51:22.707920+0000","last_unstale":"2023-07-20T09:51:23.712452+0000","last_undegraded":"2023-07-20T09:51:23.712452+0000","last_fullsized":"2023-07-20T09:51:23.712452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:41.877496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.727660+0000","last_change":"2023-07-20T09:51:23.723377+0000","last_active":"2023-07-20T09:51:23.727660+0000","last_peered":"2023-07-20T09:51:23.727660+0000","last_clean":"2023-07-20T09:51:23.727660+0000","last_became_active":"2023-07-20T09:51:23.723064+0000","last_became_peered":"2023-07-20T09:51:23.723064+0000","last_unstale":"2023-07-20T09:51:23.727660+0000","last_undegraded":"2023-07-20T09:51:23.727660+0000","last_fullsized":"2023-07-20T09:51:23.727660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:31:45.811006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.699863+0000","last_change":"2023-07-20T09:51:22.708477+0000","last_active":"2023-07-20T09:51:23.699863+0000","last_peered":"2023-07-20T09:51:23.699863+0000","last_clean":"2023-07-20T09:51:23.699863+0000","last_became_active":"2023-07-20T09:51:22.708184+0000","last_became_peered":"2023-07-20T09:51:22.708184+0000","last_unstale":"2023-07-20T09:51:23.699863+0000","last_undegraded":"2023-07-20T09:51:23.699863+0000","last_fullsized":"2023-07-20T09:51:23.699863+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:01.853376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718542+0000","last_change":"2023-07-20T09:51:23.713960+0000","last_active":"2023-07-20T09:51:23.718542+0000","last_peered":"2023-07-20T09:51:23.718542+0000","last_clean":"2023-07-20T09:51:23.718542+0000","last_became_active":"2023-07-20T09:51:23.713702+0000","last_became_peered":"2023-07-20T09:51:23.713702+0000","last_unstale":"2023-07-20T09:51:23.718542+0000","last_undegraded":"2023-07-20T09:51:23.718542+0000","last_fullsized":"2023-07-20T09:51:23.718542+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:49:31.488754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692258+0000","last_change":"2023-07-20T09:51:22.703798+0000","last_active":"2023-07-20T09:51:23.692258+0000","last_peered":"2023-07-20T09:51:23.692258+0000","last_clean":"2023-07-20T09:51:23.692258+0000","last_became_active":"2023-07-20T09:51:22.703472+0000","last_became_peered":"2023-07-20T09:51:22.703472+0000","last_unstale":"2023-07-20T09:51:23.692258+0000","last_undegraded":"2023-07-20T09:51:23.692258+0000","last_fullsized":"2023-07-20T09:51:23.692258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:37.761056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716191+0000","last_change":"2023-07-20T09:51:23.705416+0000","last_active":"2023-07-20T09:51:23.716191+0000","last_peered":"2023-07-20T09:51:23.716191+0000","last_clean":"2023-07-20T09:51:23.716191+0000","last_became_active":"2023-07-20T09:51:23.705140+0000","last_became_peered":"2023-07-20T09:51:23.705140+0000","last_unstale":"2023-07-20T09:51:23.716191+0000","last_undegraded":"2023-07-20T09:51:23.716191+0000","last_fullsized":"2023-07-20T09:51:23.716191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:43.535375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700642+0000","last_change":"2023-07-20T09:51:22.703658+0000","last_active":"2023-07-20T09:51:23.700642+0000","last_peered":"2023-07-20T09:51:23.700642+0000","last_clean":"2023-07-20T09:51:23.700642+0000","last_became_active":"2023-07-20T09:51:22.703406+0000","last_became_peered":"2023-07-20T09:51:22.703406+0000","last_unstale":"2023-07-20T09:51:23.700642+0000","last_undegraded":"2023-07-20T09:51:23.700642+0000","last_fullsized":"2023-07-20T09:51:23.700642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:10.931626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719002+0000","last_change":"2023-07-20T09:51:23.714621+0000","last_active":"2023-07-20T09:51:23.719002+0000","last_peered":"2023-07-20T09:51:23.719002+0000","last_clean":"2023-07-20T09:51:23.719002+0000","last_became_active":"2023-07-20T09:51:23.714304+0000","last_became_peered":"2023-07-20T09:51:23.714304+0000","last_unstale":"2023-07-20T09:51:23.719002+0000","last_undegraded":"2023-07-20T09:51:23.719002+0000","last_fullsized":"2023-07-20T09:51:23.719002+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:21.642369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.696829+0000","last_change":"2023-07-20T09:51:22.712617+0000","last_active":"2023-07-20T09:51:23.696829+0000","last_peered":"2023-07-20T09:51:23.696829+0000","last_clean":"2023-07-20T09:51:23.696829+0000","last_became_active":"2023-07-20T09:51:22.712276+0000","last_became_peered":"2023-07-20T09:51:22.712276+0000","last_unstale":"2023-07-20T09:51:23.696829+0000","last_undegraded":"2023-07-20T09:51:23.696829+0000","last_fullsized":"2023-07-20T09:51:23.696829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:04:32.331066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723667+0000","last_change":"2023-07-20T09:51:23.719636+0000","last_active":"2023-07-20T09:51:23.723667+0000","last_peered":"2023-07-20T09:51:23.723667+0000","last_clean":"2023-07-20T09:51:23.723667+0000","last_became_active":"2023-07-20T09:51:23.719365+0000","last_became_peered":"2023-07-20T09:51:23.719365+0000","last_unstale":"2023-07-20T09:51:23.723667+0000","last_undegraded":"2023-07-20T09:51:23.723667+0000","last_fullsized":"2023-07-20T09:51:23.723667+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:49:31.488754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728120+0000","last_change":"2023-07-20T09:51:22.704439+0000","last_active":"2023-07-20T09:51:23.728120+0000","last_peered":"2023-07-20T09:51:23.728120+0000","last_clean":"2023-07-20T09:51:23.728120+0000","last_became_active":"2023-07-20T09:51:22.704170+0000","last_became_peered":"2023-07-20T09:51:22.704170+0000","last_unstale":"2023-07-20T09:51:23.728120+0000","last_undegraded":"2023-07-20T09:51:23.728120+0000","last_fullsized":"2023-07-20T09:51:23.728120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:59:16.943232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714183+0000","last_change":"2023-07-20T09:51:23.704084+0000","last_active":"2023-07-20T09:51:23.714183+0000","last_peered":"2023-07-20T09:51:23.714183+0000","last_clean":"2023-07-20T09:51:23.714183+0000","last_became_active":"2023-07-20T09:51:23.701435+0000","last_became_peered":"2023-07-20T09:51:23.701435+0000","last_unstale":"2023-07-20T09:51:23.714183+0000","last_undegraded":"2023-07-20T09:51:23.714183+0000","last_fullsized":"2023-07-20T09:51:23.714183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:21:39.358557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732994+0000","last_change":"2023-07-20T09:51:22.702817+0000","last_active":"2023-07-20T09:51:23.732994+0000","last_peered":"2023-07-20T09:51:23.732994+0000","last_clean":"2023-07-20T09:51:23.732994+0000","last_became_active":"2023-07-20T09:51:22.702551+0000","last_became_peered":"2023-07-20T09:51:22.702551+0000","last_unstale":"2023-07-20T09:51:23.732994+0000","last_undegraded":"2023-07-20T09:51:23.732994+0000","last_fullsized":"2023-07-20T09:51:23.732994+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:28:19.804560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731319+0000","last_change":"2023-07-20T09:51:23.730326+0000","last_active":"2023-07-20T09:51:23.731319+0000","last_peered":"2023-07-20T09:51:23.731319+0000","last_clean":"2023-07-20T09:51:23.731319+0000","last_became_active":"2023-07-20T09:51:23.730038+0000","last_became_peered":"2023-07-20T09:51:23.730038+0000","last_unstale":"2023-07-20T09:51:23.731319+0000","last_undegraded":"2023-07-20T09:51:23.731319+0000","last_fullsized":"2023-07-20T09:51:23.731319+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:48.514841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.711644+0000","last_change":"2023-07-20T09:51:22.707161+0000","last_active":"2023-07-20T09:51:23.711644+0000","last_peered":"2023-07-20T09:51:23.711644+0000","last_clean":"2023-07-20T09:51:23.711644+0000","last_became_active":"2023-07-20T09:51:22.704502+0000","last_became_peered":"2023-07-20T09:51:22.704502+0000","last_unstale":"2023-07-20T09:51:23.711644+0000","last_undegraded":"2023-07-20T09:51:23.711644+0000","last_fullsized":"2023-07-20T09:51:23.711644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:18.627935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.715885+0000","last_change":"2023-07-20T09:51:23.711824+0000","last_active":"2023-07-20T09:51:23.715885+0000","last_peered":"2023-07-20T09:51:23.715885+0000","last_clean":"2023-07-20T09:51:23.715885+0000","last_became_active":"2023-07-20T09:51:23.711568+0000","last_became_peered":"2023-07-20T09:51:23.711568+0000","last_unstale":"2023-07-20T09:51:23.715885+0000","last_undegraded":"2023-07-20T09:51:23.715885+0000","last_fullsized":"2023-07-20T09:51:23.715885+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:59.954955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.702820+0000","last_change":"2023-07-20T09:51:22.714516+0000","last_active":"2023-07-20T09:51:23.702820+0000","last_peered":"2023-07-20T09:51:23.702820+0000","last_clean":"2023-07-20T09:51:23.702820+0000","last_became_active":"2023-07-20T09:51:22.714191+0000","last_became_peered":"2023-07-20T09:51:22.714191+0000","last_unstale":"2023-07-20T09:51:23.702820+0000","last_undegraded":"2023-07-20T09:51:23.702820+0000","last_fullsized":"2023-07-20T09:51:23.702820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:13.342318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714784+0000","last_change":"2023-07-20T09:51:23.711475+0000","last_active":"2023-07-20T09:51:23.714784+0000","last_peered":"2023-07-20T09:51:23.714784+0000","last_clean":"2023-07-20T09:51:23.714784+0000","last_became_active":"2023-07-20T09:51:23.711176+0000","last_became_peered":"2023-07-20T09:51:23.711176+0000","last_unstale":"2023-07-20T09:51:23.714784+0000","last_undegraded":"2023-07-20T09:51:23.714784+0000","last_fullsized":"2023-07-20T09:51:23.714784+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:38.769747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692172+0000","last_change":"2023-07-20T09:51:22.708995+0000","last_active":"2023-07-20T09:51:23.692172+0000","last_peered":"2023-07-20T09:51:23.692172+0000","last_clean":"2023-07-20T09:51:23.692172+0000","last_became_active":"2023-07-20T09:51:22.708726+0000","last_became_peered":"2023-07-20T09:51:22.708726+0000","last_unstale":"2023-07-20T09:51:23.692172+0000","last_undegraded":"2023-07-20T09:51:23.692172+0000","last_fullsized":"2023-07-20T09:51:23.692172+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:02.245049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718318+0000","last_change":"2023-07-20T09:51:23.712134+0000","last_active":"2023-07-20T09:51:23.718318+0000","last_peered":"2023-07-20T09:51:23.718318+0000","last_clean":"2023-07-20T09:51:23.718318+0000","last_became_active":"2023-07-20T09:51:23.711868+0000","last_became_peered":"2023-07-20T09:51:23.711868+0000","last_unstale":"2023-07-20T09:51:23.718318+0000","last_undegraded":"2023-07-20T09:51:23.718318+0000","last_fullsized":"2023-07-20T09:51:23.718318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:20.287561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.722035+0000","last_change":"2023-07-20T09:51:22.707552+0000","last_active":"2023-07-20T09:51:23.722035+0000","last_peered":"2023-07-20T09:51:23.722035+0000","last_clean":"2023-07-20T09:51:23.722035+0000","last_became_active":"2023-07-20T09:51:22.707155+0000","last_became_peered":"2023-07-20T09:51:22.707155+0000","last_unstale":"2023-07-20T09:51:23.722035+0000","last_undegraded":"2023-07-20T09:51:23.722035+0000","last_fullsized":"2023-07-20T09:51:23.722035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:25:40.312171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.712032+0000","last_change":"2023-07-20T09:51:23.710617+0000","last_active":"2023-07-20T09:51:23.712032+0000","last_peered":"2023-07-20T09:51:23.712032+0000","last_clean":"2023-07-20T09:51:23.712032+0000","last_became_active":"2023-07-20T09:51:23.710343+0000","last_became_peered":"2023-07-20T09:51:23.710343+0000","last_unstale":"2023-07-20T09:51:23.712032+0000","last_undegraded":"2023-07-20T09:51:23.712032+0000","last_fullsized":"2023-07-20T09:51:23.712032+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:46.762461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728750+0000","last_change":"2023-07-20T09:51:22.712849+0000","last_active":"2023-07-20T09:51:23.728750+0000","last_peered":"2023-07-20T09:51:23.728750+0000","last_clean":"2023-07-20T09:51:23.728750+0000","last_became_active":"2023-07-20T09:51:22.712558+0000","last_became_peered":"2023-07-20T09:51:22.712558+0000","last_unstale":"2023-07-20T09:51:23.728750+0000","last_undegraded":"2023-07-20T09:51:23.728750+0000","last_fullsized":"2023-07-20T09:51:23.728750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:22.364329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.732132+0000","last_change":"2023-07-20T09:51:23.727381+0000","last_active":"2023-07-20T09:51:23.732132+0000","last_peered":"2023-07-20T09:51:23.732132+0000","last_clean":"2023-07-20T09:51:23.732132+0000","last_became_active":"2023-07-20T09:51:23.725909+0000","last_became_peered":"2023-07-20T09:51:23.725909+0000","last_unstale":"2023-07-20T09:51:23.732132+0000","last_undegraded":"2023-07-20T09:51:23.732132+0000","last_fullsized":"2023-07-20T09:51:23.732132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:12.501062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728635+0000","last_change":"2023-07-20T09:51:22.713562+0000","last_active":"2023-07-20T09:51:23.728635+0000","last_peered":"2023-07-20T09:51:23.728635+0000","last_clean":"2023-07-20T09:51:23.728635+0000","last_became_active":"2023-07-20T09:51:22.713283+0000","last_became_peered":"2023-07-20T09:51:22.713283+0000","last_unstale":"2023-07-20T09:51:23.728635+0000","last_undegraded":"2023-07-20T09:51:23.728635+0000","last_fullsized":"2023-07-20T09:51:23.728635+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:20.633678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.717190+0000","last_change":"2023-07-20T09:51:23.711833+0000","last_active":"2023-07-20T09:51:23.717190+0000","last_peered":"2023-07-20T09:51:23.717190+0000","last_clean":"2023-07-20T09:51:23.717190+0000","last_became_active":"2023-07-20T09:51:23.711493+0000","last_became_peered":"2023-07-20T09:51:23.711493+0000","last_unstale":"2023-07-20T09:51:23.717190+0000","last_undegraded":"2023-07-20T09:51:23.717190+0000","last_fullsized":"2023-07-20T09:51:23.717190+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:12:49.680453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716746+0000","last_change":"2023-07-20T09:51:22.699495+0000","last_active":"2023-07-20T09:51:23.716746+0000","last_peered":"2023-07-20T09:51:23.716746+0000","last_clean":"2023-07-20T09:51:23.716746+0000","last_became_active":"2023-07-20T09:51:22.699194+0000","last_became_peered":"2023-07-20T09:51:22.699194+0000","last_unstale":"2023-07-20T09:51:23.716746+0000","last_undegraded":"2023-07-20T09:51:23.716746+0000","last_fullsized":"2023-07-20T09:51:23.716746+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:29.601203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.720509+0000","last_change":"2023-07-20T09:51:23.712445+0000","last_active":"2023-07-20T09:51:23.720509+0000","last_peered":"2023-07-20T09:51:23.720509+0000","last_clean":"2023-07-20T09:51:23.720509+0000","last_became_active":"2023-07-20T09:51:23.712175+0000","last_became_peered":"2023-07-20T09:51:23.712175+0000","last_unstale":"2023-07-20T09:51:23.720509+0000","last_undegraded":"2023-07-20T09:51:23.720509+0000","last_fullsized":"2023-07-20T09:51:23.720509+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:22:34.853294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700845+0000","last_change":"2023-07-20T09:51:22.707532+0000","last_active":"2023-07-20T09:51:23.700845+0000","last_peered":"2023-07-20T09:51:23.700845+0000","last_clean":"2023-07-20T09:51:23.700845+0000","last_became_active":"2023-07-20T09:51:22.707246+0000","last_became_peered":"2023-07-20T09:51:22.707246+0000","last_unstale":"2023-07-20T09:51:23.700845+0000","last_undegraded":"2023-07-20T09:51:23.700845+0000","last_fullsized":"2023-07-20T09:51:23.700845+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:12.012579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718848+0000","last_change":"2023-07-20T09:51:23.713418+0000","last_active":"2023-07-20T09:51:23.718848+0000","last_peered":"2023-07-20T09:51:23.718848+0000","last_clean":"2023-07-20T09:51:23.718848+0000","last_became_active":"2023-07-20T09:51:23.713077+0000","last_became_peered":"2023-07-20T09:51:23.713077+0000","last_unstale":"2023-07-20T09:51:23.718848+0000","last_undegraded":"2023-07-20T09:51:23.718848+0000","last_fullsized":"2023-07-20T09:51:23.718848+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:41.022380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716035+0000","last_change":"2023-07-20T09:51:22.706868+0000","last_active":"2023-07-20T09:51:23.716035+0000","last_peered":"2023-07-20T09:51:23.716035+0000","last_clean":"2023-07-20T09:51:23.716035+0000","last_became_active":"2023-07-20T09:51:22.706583+0000","last_became_peered":"2023-07-20T09:51:22.706583+0000","last_unstale":"2023-07-20T09:51:23.716035+0000","last_undegraded":"2023-07-20T09:51:23.716035+0000","last_fullsized":"2023-07-20T09:51:23.716035+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:30.262148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723591+0000","last_change":"2023-07-20T09:51:23.718863+0000","last_active":"2023-07-20T09:51:23.723591+0000","last_peered":"2023-07-20T09:51:23.723591+0000","last_clean":"2023-07-20T09:51:23.723591+0000","last_became_active":"2023-07-20T09:51:23.718646+0000","last_became_peered":"2023-07-20T09:51:23.718646+0000","last_unstale":"2023-07-20T09:51:23.723591+0000","last_undegraded":"2023-07-20T09:51:23.723591+0000","last_fullsized":"2023-07-20T09:51:23.723591+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:01.290633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.691272+0000","last_change":"2023-07-20T09:51:22.706846+0000","last_active":"2023-07-20T09:51:23.691272+0000","last_peered":"2023-07-20T09:51:23.691272+0000","last_clean":"2023-07-20T09:51:23.691272+0000","last_became_active":"2023-07-20T09:51:22.706540+0000","last_became_peered":"2023-07-20T09:51:22.706540+0000","last_unstale":"2023-07-20T09:51:23.691272+0000","last_undegraded":"2023-07-20T09:51:23.691272+0000","last_fullsized":"2023-07-20T09:51:23.691272+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:17.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.731977+0000","last_change":"2023-07-20T09:51:23.722550+0000","last_active":"2023-07-20T09:51:23.731977+0000","last_peered":"2023-07-20T09:51:23.731977+0000","last_clean":"2023-07-20T09:51:23.731977+0000","last_became_active":"2023-07-20T09:51:23.722108+0000","last_became_peered":"2023-07-20T09:51:23.722108+0000","last_unstale":"2023-07-20T09:51:23.731977+0000","last_undegraded":"2023-07-20T09:51:23.731977+0000","last_fullsized":"2023-07-20T09:51:23.731977+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:24:36.380230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698112+0000","last_change":"2023-07-20T09:51:22.713809+0000","last_active":"2023-07-20T09:51:23.698112+0000","last_peered":"2023-07-20T09:51:23.698112+0000","last_clean":"2023-07-20T09:51:23.698112+0000","last_became_active":"2023-07-20T09:51:22.713530+0000","last_became_peered":"2023-07-20T09:51:22.713530+0000","last_unstale":"2023-07-20T09:51:23.698112+0000","last_undegraded":"2023-07-20T09:51:23.698112+0000","last_fullsized":"2023-07-20T09:51:23.698112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:04.599640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.718519+0000","last_change":"2023-07-20T09:51:23.713816+0000","last_active":"2023-07-20T09:51:23.718519+0000","last_peered":"2023-07-20T09:51:23.718519+0000","last_clean":"2023-07-20T09:51:23.718519+0000","last_became_active":"2023-07-20T09:51:23.713563+0000","last_became_peered":"2023-07-20T09:51:23.713563+0000","last_unstale":"2023-07-20T09:51:23.718519+0000","last_undegraded":"2023-07-20T09:51:23.718519+0000","last_fullsized":"2023-07-20T09:51:23.718519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:48.514841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.689909+0000","last_change":"2023-07-20T09:51:22.701342+0000","last_active":"2023-07-20T09:51:23.689909+0000","last_peered":"2023-07-20T09:51:23.689909+0000","last_clean":"2023-07-20T09:51:23.689909+0000","last_became_active":"2023-07-20T09:51:22.701066+0000","last_became_peered":"2023-07-20T09:51:22.701066+0000","last_unstale":"2023-07-20T09:51:23.689909+0000","last_undegraded":"2023-07-20T09:51:23.689909+0000","last_fullsized":"2023-07-20T09:51:23.689909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:51.866529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733820+0000","last_change":"2023-07-20T09:51:23.729031+0000","last_active":"2023-07-20T09:51:23.733820+0000","last_peered":"2023-07-20T09:51:23.733820+0000","last_clean":"2023-07-20T09:51:23.733820+0000","last_became_active":"2023-07-20T09:51:23.728087+0000","last_became_peered":"2023-07-20T09:51:23.728087+0000","last_unstale":"2023-07-20T09:51:23.733820+0000","last_undegraded":"2023-07-20T09:51:23.733820+0000","last_fullsized":"2023-07-20T09:51:23.733820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:43:48.554800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698334+0000","last_change":"2023-07-20T09:51:22.707507+0000","last_active":"2023-07-20T09:51:23.698334+0000","last_peered":"2023-07-20T09:51:23.698334+0000","last_clean":"2023-07-20T09:51:23.698334+0000","last_became_active":"2023-07-20T09:51:22.707204+0000","last_became_peered":"2023-07-20T09:51:22.707204+0000","last_unstale":"2023-07-20T09:51:23.698334+0000","last_undegraded":"2023-07-20T09:51:23.698334+0000","last_fullsized":"2023-07-20T09:51:23.698334+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:16.226789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700676+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T09:51:23.700676+0000","last_peered":"2023-07-20T09:51:23.700676+0000","last_clean":"2023-07-20T09:51:23.700676+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T09:51:23.700676+0000","last_undegraded":"2023-07-20T09:51:23.700676+0000","last_fullsized":"2023-07-20T09:51:23.700676+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:19:04.107621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.697101+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T09:51:23.697101+0000","last_peered":"2023-07-20T09:51:23.697101+0000","last_clean":"2023-07-20T09:51:23.697101+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T09:51:23.697101+0000","last_undegraded":"2023-07-20T09:51:23.697101+0000","last_fullsized":"2023-07-20T09:51:23.697101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:24:38.967909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.733790+0000","last_change":"2023-07-20T09:51:23.730449+0000","last_active":"2023-07-20T09:51:23.733790+0000","last_peered":"2023-07-20T09:51:23.733790+0000","last_clean":"2023-07-20T09:51:23.733790+0000","last_became_active":"2023-07-20T09:51:23.730135+0000","last_became_peered":"2023-07-20T09:51:23.730135+0000","last_unstale":"2023-07-20T09:51:23.733790+0000","last_undegraded":"2023-07-20T09:51:23.733790+0000","last_fullsized":"2023-07-20T09:51:23.733790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.730836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.728650+0000","last_change":"2023-07-20T09:51:22.711442+0000","last_active":"2023-07-20T09:51:23.728650+0000","last_peered":"2023-07-20T09:51:23.728650+0000","last_clean":"2023-07-20T09:51:23.728650+0000","last_became_active":"2023-07-20T09:51:22.711160+0000","last_became_peered":"2023-07-20T09:51:22.711160+0000","last_unstale":"2023-07-20T09:51:23.728650+0000","last_undegraded":"2023-07-20T09:51:23.728650+0000","last_fullsized":"2023-07-20T09:51:23.728650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:31:19.801832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.702098+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T09:51:23.702098+0000","last_peered":"2023-07-20T09:51:23.702098+0000","last_clean":"2023-07-20T09:51:23.702098+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T09:51:23.702098+0000","last_undegraded":"2023-07-20T09:51:23.702098+0000","last_fullsized":"2023-07-20T09:51:23.702098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:58:15.598970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719020+0000","last_change":"2023-07-20T09:51:23.714664+0000","last_active":"2023-07-20T09:51:23.719020+0000","last_peered":"2023-07-20T09:51:23.719020+0000","last_clean":"2023-07-20T09:51:23.719020+0000","last_became_active":"2023-07-20T09:51:23.714368+0000","last_became_peered":"2023-07-20T09:51:23.714368+0000","last_unstale":"2023-07-20T09:51:23.719020+0000","last_undegraded":"2023-07-20T09:51:23.719020+0000","last_fullsized":"2023-07-20T09:51:23.719020+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:24:36.380230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.690525+0000","last_change":"2023-07-20T09:51:22.708683+0000","last_active":"2023-07-20T09:51:23.690525+0000","last_peered":"2023-07-20T09:51:23.690525+0000","last_clean":"2023-07-20T09:51:23.690525+0000","last_became_active":"2023-07-20T09:51:22.708310+0000","last_became_peered":"2023-07-20T09:51:22.708310+0000","last_unstale":"2023-07-20T09:51:23.690525+0000","last_undegraded":"2023-07-20T09:51:23.690525+0000","last_fullsized":"2023-07-20T09:51:23.690525+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:43:16.619637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.689957+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T09:51:23.689957+0000","last_peered":"2023-07-20T09:51:23.689957+0000","last_clean":"2023-07-20T09:51:23.689957+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T09:51:23.689957+0000","last_undegraded":"2023-07-20T09:51:23.689957+0000","last_fullsized":"2023-07-20T09:51:23.689957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:19.673210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.716550+0000","last_change":"2023-07-20T09:51:23.711402+0000","last_active":"2023-07-20T09:51:23.716550+0000","last_peered":"2023-07-20T09:51:23.716550+0000","last_clean":"2023-07-20T09:51:23.716550+0000","last_became_active":"2023-07-20T09:51:23.711099+0000","last_became_peered":"2023-07-20T09:51:23.711099+0000","last_unstale":"2023-07-20T09:51:23.716550+0000","last_undegraded":"2023-07-20T09:51:23.716550+0000","last_fullsized":"2023-07-20T09:51:23.716550+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:46.554601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.707854+0000","last_change":"2023-07-20T09:51:22.703949+0000","last_active":"2023-07-20T09:51:23.707854+0000","last_peered":"2023-07-20T09:51:23.707854+0000","last_clean":"2023-07-20T09:51:23.707854+0000","last_became_active":"2023-07-20T09:51:22.703633+0000","last_became_peered":"2023-07-20T09:51:22.703633+0000","last_unstale":"2023-07-20T09:51:23.707854+0000","last_undegraded":"2023-07-20T09:51:23.707854+0000","last_fullsized":"2023-07-20T09:51:23.707854+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:45.753770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.697560+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T09:51:23.697560+0000","last_peered":"2023-07-20T09:51:23.697560+0000","last_clean":"2023-07-20T09:51:23.697560+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T09:51:23.697560+0000","last_undegraded":"2023-07-20T09:51:23.697560+0000","last_fullsized":"2023-07-20T09:51:23.697560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:53.317032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.723632+0000","last_change":"2023-07-20T09:51:23.719613+0000","last_active":"2023-07-20T09:51:23.723632+0000","last_peered":"2023-07-20T09:51:23.723632+0000","last_clean":"2023-07-20T09:51:23.723632+0000","last_became_active":"2023-07-20T09:51:23.719326+0000","last_became_peered":"2023-07-20T09:51:23.719326+0000","last_unstale":"2023-07-20T09:51:23.723632+0000","last_undegraded":"2023-07-20T09:51:23.723632+0000","last_fullsized":"2023-07-20T09:51:23.723632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:50:06.676322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.708273+0000","last_change":"2023-07-20T09:51:22.711895+0000","last_active":"2023-07-20T09:51:23.708273+0000","last_peered":"2023-07-20T09:51:23.708273+0000","last_clean":"2023-07-20T09:51:23.708273+0000","last_became_active":"2023-07-20T09:51:22.711708+0000","last_became_peered":"2023-07-20T09:51:22.711708+0000","last_unstale":"2023-07-20T09:51:23.708273+0000","last_undegraded":"2023-07-20T09:51:23.708273+0000","last_fullsized":"2023-07-20T09:51:23.708273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:36.952150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.700921+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T09:51:23.700921+0000","last_peered":"2023-07-20T09:51:23.700921+0000","last_clean":"2023-07-20T09:51:23.700921+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T09:51:23.700921+0000","last_undegraded":"2023-07-20T09:51:23.700921+0000","last_fullsized":"2023-07-20T09:51:23.700921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:57:43.822703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.719110+0000","last_change":"2023-07-20T09:51:23.717086+0000","last_active":"2023-07-20T09:51:23.719110+0000","last_peered":"2023-07-20T09:51:23.719110+0000","last_clean":"2023-07-20T09:51:23.719110+0000","last_became_active":"2023-07-20T09:51:23.716792+0000","last_became_peered":"2023-07-20T09:51:23.716792+0000","last_unstale":"2023-07-20T09:51:23.719110+0000","last_undegraded":"2023-07-20T09:51:23.719110+0000","last_fullsized":"2023-07-20T09:51:23.719110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:15.764501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.692493+0000","last_change":"2023-07-20T09:51:22.708969+0000","last_active":"2023-07-20T09:51:23.692493+0000","last_peered":"2023-07-20T09:51:23.692493+0000","last_clean":"2023-07-20T09:51:23.692493+0000","last_became_active":"2023-07-20T09:51:22.708682+0000","last_became_peered":"2023-07-20T09:51:22.708682+0000","last_unstale":"2023-07-20T09:51:23.692493+0000","last_undegraded":"2023-07-20T09:51:23.692493+0000","last_fullsized":"2023-07-20T09:51:23.692493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:35:22.749341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.698335+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T09:51:23.698335+0000","last_peered":"2023-07-20T09:51:23.698335+0000","last_clean":"2023-07-20T09:51:23.698335+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T09:51:23.698335+0000","last_undegraded":"2023-07-20T09:51:23.698335+0000","last_fullsized":"2023-07-20T09:51:23.698335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:30.986804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.714134+0000","last_change":"2023-07-20T09:51:23.703174+0000","last_active":"2023-07-20T09:51:23.714134+0000","last_peered":"2023-07-20T09:51:23.714134+0000","last_clean":"2023-07-20T09:51:23.714134+0000","last_became_active":"2023-07-20T09:51:23.702762+0000","last_became_peered":"2023-07-20T09:51:23.702762+0000","last_unstale":"2023-07-20T09:51:23.714134+0000","last_undegraded":"2023-07-20T09:51:23.714134+0000","last_fullsized":"2023-07-20T09:51:23.714134+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:27.798506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.690674+0000","last_change":"2023-07-20T09:51:22.704923+0000","last_active":"2023-07-20T09:51:23.690674+0000","last_peered":"2023-07-20T09:51:23.690674+0000","last_clean":"2023-07-20T09:51:23.690674+0000","last_became_active":"2023-07-20T09:51:22.704668+0000","last_became_peered":"2023-07-20T09:51:22.704668+0000","last_unstale":"2023-07-20T09:51:23.690674+0000","last_undegraded":"2023-07-20T09:51:23.690674+0000","last_fullsized":"2023-07-20T09:51:23.690674+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:53.621987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.701477+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T09:51:23.701477+0000","last_peered":"2023-07-20T09:51:23.701477+0000","last_clean":"2023-07-20T09:51:23.701477+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T09:51:23.701477+0000","last_undegraded":"2023-07-20T09:51:23.701477+0000","last_fullsized":"2023-07-20T09:51:23.701477+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:24:01.855041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.725123+0000","last_change":"2023-07-20T09:51:23.720507+0000","last_active":"2023-07-20T09:51:23.725123+0000","last_peered":"2023-07-20T09:51:23.725123+0000","last_clean":"2023-07-20T09:51:23.725123+0000","last_became_active":"2023-07-20T09:51:23.719982+0000","last_became_peered":"2023-07-20T09:51:23.719982+0000","last_unstale":"2023-07-20T09:51:23.725123+0000","last_undegraded":"2023-07-20T09:51:23.725123+0000","last_fullsized":"2023-07-20T09:51:23.725123+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:22.677079+0000","last_clean_scrub_stamp":"2023-07-20T09:51:22.677079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:55.669985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.696439+0000","last_change":"2023-07-20T09:51:22.697896+0000","last_active":"2023-07-20T09:51:23.696439+0000","last_peered":"2023-07-20T09:51:23.696439+0000","last_clean":"2023-07-20T09:51:23.696439+0000","last_became_active":"2023-07-20T09:51:22.697558+0000","last_became_peered":"2023-07-20T09:51:22.697558+0000","last_unstale":"2023-07-20T09:51:23.696439+0000","last_undegraded":"2023-07-20T09:51:23.696439+0000","last_fullsized":"2023-07-20T09:51:23.696439+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:51:21.668388+0000","last_clean_scrub_stamp":"2023-07-20T09:51:21.668388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:57:36.017511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-20T09:51:23.691544+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T09:51:23.691544+0000","last_peered":"2023-07-20T09:51:23.691544+0000","last_clean":"2023-07-20T09:51:23.691544+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T09:51:23.691544+0000","last_undegraded":"2023-07-20T09:51:23.691544+0000","last_fullsized":"2023-07-20T09:51:23.691544+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:21:32.500341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52600000000000002}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.752}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71899999999999997}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.749},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.877},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.63}]},{"osd":1,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.61799999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.748},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jul 20 09:51:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.76100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":169339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.501},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8239999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":0.434}]},{"osd":1,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.624}]},{"osd":5,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jul 20 09:51:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.57699999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.438},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.496}]},{"osd":2,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.79400000000000004}]},{"osd":6,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 20 09:51:17 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.75}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.625}]},{"osd":5,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.749}]},{"osd":6,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jul 20 09:51:16 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T09:51:28.186 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T09:51:28.187 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T09:51:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.329+0000 7f64c10a1640 1 Processor -- start 2023-07-20T09:51:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 -- start start 2023-07-20T09:51:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc156be0 0x7f64bc1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f64bc160600 0x7f64bc0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64bc0ce8b0 con 0x7f64bc0ce450 2023-07-20T09:51:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64bc0cfd80 con 0x7f64bc160600 2023-07-20T09:51:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64c10a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc15dea0 con 0x7f64bc156be0 2023-07-20T09:51:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f64bc160600 0x7f64bc0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f64bc160600 0x7f64bc0cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53120/0 (socket says 172.21.15.82:53120) 2023-07-20T09:51:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 -- 172.21.15.82:0/2594374606 learned_addr learned my addr 172.21.15.82:0/2594374606 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bbfff640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc156be0 0x7f64bc1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 -- 172.21.15.82:0/2594374606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc156be0 msgr2=0x7f64bc1600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc156be0 0x7f64bc1600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 -- 172.21.15.82:0/2594374606 >> v1:172.21.15.82:6789/0 conn(0x7f64bc0ce450 legacy=0x7f64bc06da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.333+0000 7f64bb7fe640 1 -- 172.21.15.82:0/2594374606 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc156fc0 con 0x7f64bc160600 2023-07-20T09:51:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64bb7fe640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0cdf10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009870 tx=0x7f64b001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2061c21ae2964fac server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64baffd640 1 -- 172.21.15.82:0/2594374606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00ab600 con 0x7f64bc160600 2023-07-20T09:51:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64baffd640 1 -- 172.21.15.82:0/2594374606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b00a7050 con 0x7f64bc160600 2023-07-20T09:51:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64baffd640 1 -- 172.21.15.82:0/2594374606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b00ab980 con 0x7f64bc160600 2023-07-20T09:51:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- 172.21.15.82:0/2594374606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 msgr2=0x7f64bc0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0cdf10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009870 tx=0x7f64b001c340 comp rx=0 tx=0).stop 2023-07-20T09:51:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- 172.21.15.82:0/2594374606 shutdown_connections 2023-07-20T09:51:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0cdf10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 --2- 172.21.15.82:0/2594374606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc156be0 0x7f64bc1600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- 172.21.15.82:0/2594374606 >> 172.21.15.82:0/2594374606 conn(0x7f64bc0b1e50 msgr2=0x7f64bc0b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- 172.21.15.82:0/2594374606 shutdown_connections 2023-07-20T09:51:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- 172.21.15.82:0/2594374606 wait complete. 2023-07-20T09:51:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 Processor -- start 2023-07-20T09:51:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.337+0000 7f64c10a1640 1 -- start start 2023-07-20T09:51:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0ce450 0x7f64bc1554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc156be0 0x7f64bc0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc1e7340 con 0x7f64bc160600 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc156350 con 0x7f64bc156be0 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc155d90 con 0x7f64bc0ce450 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53136/0 (socket says 172.21.15.82:53136) 2023-07-20T09:51:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 -- 172.21.15.82:0/35218325 learned_addr learned my addr 172.21.15.82:0/35218325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64bbfff640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0ce450 0x7f64bc1554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64bb7fe640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc156be0 0x7f64bc0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 -- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0ce450 msgr2=0x7f64bc1554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0ce450 0x7f64bc1554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 -- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc156be0 msgr2=0x7f64bc0c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc156be0 0x7f64bc0c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 -- 172.21.15.82:0/35218325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00094d0 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c08a0640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f64b4002240 tx=0x7f64b400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4018070 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b4003980 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4003d30 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64bc156070 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64bc1559f0 con 0x7f64bc160600 2023-07-20T09:51:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.341+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64bc04da30 con 0x7f64bc160600 2023-07-20T09:51:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.345+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f64b40135b0 con 0x7f64bc160600 2023-07-20T09:51:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.345+0000 7f64b8ff9640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 0x7f64a8068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.345+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64b40862c0 con 0x7f64bc160600 2023-07-20T09:51:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.345+0000 7f64bbfff640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 0x7f64a8068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.345+0000 7f64bbfff640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 0x7f64a8068740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64ac007a60 tx=0x7f64ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.349+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64b4053750 con 0x7f64bc160600 2023-07-20T09:51:28.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.545+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f64bc1e7480 con 0x7f64bc160600 2023-07-20T09:51:28.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.549+0000 7f64b8ff9640 1 -- 172.21.15.82:0/35218325 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f64b4056d70 con 0x7f64bc160600 2023-07-20T09:51:28.589 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T09:51:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T09:51:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T09:51:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T09:51:28.589 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T09:51:28.590 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 msgr2=0x7f64a8068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 0x7f64a8068740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f64ac007a60 tx=0x7f64ac008040 comp rx=0 tx=0).stop 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 msgr2=0x7f64bc0c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f64b4002240 tx=0x7f64b400c850 comp rx=0 tx=0).stop 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 shutdown_connections 2023-07-20T09:51:28.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f64a8066280 0x7f64a8068740 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64bc160600 0x7f64bc0c6290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f64bc156be0 0x7f64bc0c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 --2- 172.21.15.82:0/35218325 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64bc0ce450 0x7f64bc1554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 >> 172.21.15.82:0/35218325 conn(0x7f64bc0b1e50 msgr2=0x7f64bc0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 shutdown_connections 2023-07-20T09:51:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.553+0000 7f64c10a1640 1 -- 172.21.15.82:0/35218325 wait complete. 2023-07-20T09:51:28.610 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T09:51:28.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.709+0000 7f679fc6a640 1 Processor -- start 2023-07-20T09:51:28.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.709+0000 7f679fc6a640 1 -- start start 2023-07-20T09:51:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679fc6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 0x7f67980c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679fc6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67980ca440 0x7f679815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679fc6a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67980c9780 con 0x7f679815d490 2023-07-20T09:51:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679fc6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679815d930 con 0x7f67980ca440 2023-07-20T09:51:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679fc6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679815dc10 con 0x7f67980ca060 2023-07-20T09:51:28.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67980ca440 0x7f679815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67980ca440 0x7f679815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53144/0 (socket says 172.21.15.82:53144) 2023-07-20T09:51:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 -- 172.21.15.82:0/2364170639 learned_addr learned my addr 172.21.15.82:0/2364170639 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679e207640 1 --1- 172.21.15.82:0/2364170639 >> v1:172.21.15.82:6789/0 conn(0x7f679815d490 0x7f67980cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36686/0 (socket says 172.21.15.82:36686) 2023-07-20T09:51:28.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679da06640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 0x7f67980c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 -- 172.21.15.82:0/2364170639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 msgr2=0x7f67980c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 0x7f67980c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 -- 172.21.15.82:0/2364170639 >> v1:172.21.15.82:6789/0 conn(0x7f679815d490 legacy=0x7f67980cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679d205640 1 -- 172.21.15.82:0/2364170639 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67980c8a60 con 0x7f67980ca440 2023-07-20T09:51:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679da06640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 0x7f67980c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.713+0000 7f679ca04640 1 -- 172.21.15.82:0/2364170639 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272435053 0 0) 0x7f67980c9780 con 0x7f679815d490 2023-07-20T09:51:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679d205640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679815cf50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6788006fd0 tx=0x7f678801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de9d8bdef8399e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679ca04640 1 -- 172.21.15.82:0/2364170639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880aa670 con 0x7f67980ca440 2023-07-20T09:51:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679ca04640 1 -- 172.21.15.82:0/2364170639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880aa7d0 con 0x7f67980ca440 2023-07-20T09:51:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679ca04640 1 -- 172.21.15.82:0/2364170639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880aab60 con 0x7f67980ca440 2023-07-20T09:51:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- 172.21.15.82:0/2364170639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 msgr2=0x7f679815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679815cf50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6788006fd0 tx=0x7f678801c4f0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- 172.21.15.82:0/2364170639 shutdown_connections 2023-07-20T09:51:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679815cf50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 --2- 172.21.15.82:0/2364170639 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67980ca060 0x7f67980c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- 172.21.15.82:0/2364170639 >> 172.21.15.82:0/2364170639 conn(0x7f679806b7c0 msgr2=0x7f679806bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:28.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- 172.21.15.82:0/2364170639 shutdown_connections 2023-07-20T09:51:28.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- 172.21.15.82:0/2364170639 wait complete. 2023-07-20T09:51:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 Processor -- start 2023-07-20T09:51:28.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.717+0000 7f679fc6a640 1 -- start start 2023-07-20T09:51:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 0x7f6798163150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 0x7f67981636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679814c7d0 con 0x7f67980ca440 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6798162390 con 0x7f67980ca060 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6798162670 con 0x7f679815d490 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53148/0 (socket says 172.21.15.82:53148) 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 -- 172.21.15.82:0/298106432 learned_addr learned my addr 172.21.15.82:0/298106432 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679da06640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 0x7f6798163150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 -- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 msgr2=0x7f67981636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679e207640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 0x7f67981636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 0x7f67981636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 -- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 msgr2=0x7f6798163150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 0x7f6798163150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 -- 172.21.15.82:0/298106432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009480 con 0x7f67980ca440 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679da06640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 0x7f6798163150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679e207640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 0x7f67981636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679d205640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f678801cd90 tx=0x7f6788019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880bb070 con 0x7f67980ca440 2023-07-20T09:51:28.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880aa630 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6798162950 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880aab80 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6798166160 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.721+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679804da30 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.725+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f67880aace0 con 0x7f67980ca440 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.725+0000 7f678e7fc640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 0x7f677c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:28.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.725+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f678811e010 con 0x7f67980ca440 2023-07-20T09:51:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.725+0000 7f679da06640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 0x7f677c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:28.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.725+0000 7f679da06640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 0x7f677c068740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6794007f40 tx=0x7f6794007490 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:28.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.729+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67880eb520 con 0x7f67980ca440 2023-07-20T09:51:28.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f679815a600 con 0x7f67980ca440 2023-07-20T09:51:28.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f678e7fc640 1 -- 172.21.15.82:0/298106432 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f67880eeb40 con 0x7f67980ca440 2023-07-20T09:51:28.947 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T09:51:28.947 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T09:51:28.947 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T09:51:28.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 msgr2=0x7f677c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 0x7f677c068740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6794007f40 tx=0x7f6794007490 comp rx=0 tx=0).stop 2023-07-20T09:51:28.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 msgr2=0x7f679814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:28.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f678801cd90 tx=0x7f6788019290 comp rx=0 tx=0).stop 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 shutdown_connections 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f677c066280 0x7f677c068740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f679815d490 0x7f67981636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67980ca440 0x7f679814c290 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 --2- 172.21.15.82:0/298106432 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67980ca060 0x7f6798163150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 >> 172.21.15.82:0/298106432 conn(0x7f679806b7c0 msgr2=0x7f6798158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 shutdown_connections 2023-07-20T09:51:28.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:28.909+0000 7f679fc6a640 1 -- 172.21.15.82:0/298106432 wait complete. 2023-07-20T09:51:29.369 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T09:51:23.070016+0000', 'modified': '2023-07-20T09:51:26.717548+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5229}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5229': {'gid': 5229, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.82:6837/1206692867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 1206692867}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1206692867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T09:51:29.370 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T09:51:29.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-20T09:51:29.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 Processor -- start 2023-07-20T09:51:29.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 -- start start 2023-07-20T09:51:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b380ad060 0x7f8b3815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8b380b1170 0x7f8b380b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b380cde70 con 0x7f8b380ca040 2023-07-20T09:51:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b380cbef0 con 0x7f8b380ad060 2023-07-20T09:51:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b3cb37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b380ca420 con 0x7f8b380b1170 2023-07-20T09:51:29.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b2dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b380ad060 0x7f8b3815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b2dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8b380ad060 0x7f8b3815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53152/0 (socket says 172.21.15.82:53152) 2023-07-20T09:51:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.477+0000 7f8b2dd9b640 1 -- 172.21.15.82:0/1834752287 learned_addr learned my addr 172.21.15.82:0/1834752287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/1834752287 >> v2:172.21.15.183:3300/0 conn(0x7f8b380b1170 0x7f8b380b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b2dd9b640 1 -- 172.21.15.82:0/1834752287 >> v2:172.21.15.183:3300/0 conn(0x7f8b380b1170 msgr2=0x7f8b380b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/1834752287 >> v2:172.21.15.183:3300/0 conn(0x7f8b380b1170 0x7f8b380b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b2dd9b640 1 -- 172.21.15.82:0/1834752287 >> v1:172.21.15.183:6789/0 conn(0x7f8b380ca040 legacy=0x7f8b3815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b2dd9b640 1 -- 172.21.15.82:0/1834752287 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380cdb40 con 0x7f8b380ad060 2023-07-20T09:51:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/1834752287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ad060 0x7f8b3815d020 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8b3815c850 tx=0x7f8b2801e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a449baa737f0472 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b35d9b640 1 -- 172.21.15.82:0/1834752287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004230 con 0x7f8b380ad060 2023-07-20T09:51:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b35d9b640 1 -- 172.21.15.82:0/1834752287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b280ab070 con 0x7f8b380ad060 2023-07-20T09:51:29.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b35d9b640 1 -- 172.21.15.82:0/1834752287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280a77b0 con 0x7f8b380ad060 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 -- 172.21.15.82:0/1834752287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ad060 msgr2=0x7f8b3815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/1834752287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ad060 0x7f8b3815d020 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8b3815c850 tx=0x7f8b2801e940 comp rx=0 tx=0).stop 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 -- 172.21.15.82:0/1834752287 shutdown_connections 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/1834752287 >> v2:172.21.15.183:3300/0 conn(0x7f8b380b1170 0x7f8b380b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/1834752287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ad060 0x7f8b3815d020 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.481+0000 7f8b3cb37640 1 -- 172.21.15.82:0/1834752287 >> 172.21.15.82:0/1834752287 conn(0x7f8b380cada0 msgr2=0x7f8b380cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- 172.21.15.82:0/1834752287 shutdown_connections 2023-07-20T09:51:29.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- 172.21.15.82:0/1834752287 wait complete. 2023-07-20T09:51:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 Processor -- start 2023-07-20T09:51:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- start start 2023-07-20T09:51:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b380ad060 0x7f8b3809b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b380b1170 0x7f8b38161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b381622e0 con 0x7f8b380ca040 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38162580 con 0x7f8b380ad060 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3cb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38162860 con 0x7f8b380b1170 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53156/0 (socket says 172.21.15.82:53156) 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 -- 172.21.15.82:0/881876740 learned_addr learned my addr 172.21.15.82:0/881876740 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b3659c640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b380ad060 0x7f8b3809b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b380b1170 0x7f8b38161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 -- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b380b1170 msgr2=0x7f8b38161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b380b1170 0x7f8b38161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 -- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b380ad060 msgr2=0x7f8b3809b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b380ad060 0x7f8b3809b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 -- 172.21.15.82:0/881876740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2800b780 con 0x7f8b380ca040 2023-07-20T09:51:29.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.485+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8b30007e40 tx=0x7f8b3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 -- 172.21.15.82:0/881876740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30014620 con 0x7f8b380ca040 2023-07-20T09:51:29.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 -- 172.21.15.82:0/881876740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000ee90 con 0x7f8b380ca040 2023-07-20T09:51:29.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 -- 172.21.15.82:0/881876740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b300149e0 con 0x7f8b380ca040 2023-07-20T09:51:29.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38162b40 con 0x7f8b380ca040 2023-07-20T09:51:29.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b38163100 con 0x7f8b380ca040 2023-07-20T09:51:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 -- 172.21.15.82:0/881876740 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b30014b40 con 0x7f8b380ca040 2023-07-20T09:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 0x7f8b18068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b2f7fe640 1 -- 172.21.15.82:0/881876740 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b30084590 con 0x7f8b380ca040 2023-07-20T09:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.489+0000 7f8b3659c640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 0x7f8b18068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 Processor -- start 2023-07-20T09:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 0x7f8b18068740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007fd0 tx=0x7f8b20007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- start start 2023-07-20T09:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 0x561a514e9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a513b10a0 con 0x561a51533d20 2023-07-20T09:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a5133fe40 con 0x561a51534640 2023-07-20T09:51:29.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a5133d370 con 0x561a514e9e90 2023-07-20T09:51:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53162/0 (socket says 172.21.15.82:53162) 2023-07-20T09:51:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 -- 172.21.15.82:0/2038959788 learned_addr learned my addr 172.21.15.82:0/2038959788 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 0x561a514e9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 -- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 msgr2=0x561a514ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514ea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 -- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 msgr2=0x561a514e9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 0x561a514e9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 -- 172.21.15.82:0/2038959788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a51034890 con 0x561a51533d20 2023-07-20T09:51:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 0x561a514e9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3659c640 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000fb20 tx=0x7f8b20012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70693e2259395906 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b17fff640 1 -- 172.21.15.82:0/2038959788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20004980 con 0x561a51533d20 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b17fff640 1 -- 172.21.15.82:0/2038959788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20019070 con 0x561a51533d20 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b17fff640 1 -- 172.21.15.82:0/2038959788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20020440 con 0x561a51533d20 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- 172.21.15.82:0/2038959788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 msgr2=0x561a51534100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000fb20 tx=0x7f8b20012000 comp rx=0 tx=0).stop 2023-07-20T09:51:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- 172.21.15.82:0/2038959788 shutdown_connections 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51534640 0x561a514e9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/2038959788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51533d20 0x561a51534100 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- 172.21.15.82:0/2038959788 >> 172.21.15.82:0/2038959788 conn(0x561a514e1200 msgr2=0x561a514e8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- 172.21.15.82:0/2038959788 shutdown_connections 2023-07-20T09:51:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.493+0000 7f8b3fea0000 1 -- 172.21.15.82:0/2038959788 wait complete. 2023-07-20T09:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- start start 2023-07-20T09:51:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 Processor -- start 2023-07-20T09:51:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a514f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a51338c60 con 0x561a51534640 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a512f4ae0 con 0x561a51533d20 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a512f4780 con 0x561a514e9e90 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 10 client.0 _ll_register_callbacks cb 0x561a514d5820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53166/0 (socket says 172.21.15.82:53166) 2023-07-20T09:51:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 -- 172.21.15.82:0/521404954 learned_addr learned my addr 172.21.15.82:0/521404954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3659c640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a514f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 -- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 msgr2=0x561a514f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 -- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 msgr2=0x561a514f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a514f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 -- 172.21.15.82:0/521404954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2000f850 con 0x561a51534640 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b30051c70 tx=0x7f8b3005da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfffc6be82a65469 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3005d780 con 0x561a51534640 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b30053bd0 con 0x561a51534640 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a512f8fb0 con 0x561a51534640 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b30059170 con 0x561a51534640 2023-07-20T09:51:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 10 client.5415 fetch_fsmap learned FSMap version 16 2023-07-20T09:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561a512fcd10 con 0x561a51534640 2023-07-20T09:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a512f8fb0 con 0x561a51534640 2023-07-20T09:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8b30082d20 con 0x561a51534640 2023-07-20T09:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 10 client.5415 fetch_fsmap finished waiting for FSMap version 16 2023-07-20T09:51:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 10 client.5415 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 20 client.5415 populate_metadata read hostname 'smithi082' 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a514f6210 0x561a51545290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 4 client.5415 mds_command: new command op to 5229 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 --> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a51367410 con 0x561a514f6210 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.497+0000 7f8b3659c640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a514f6210 0x561a51545290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3659c640 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a514f6210 0x561a51545290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d03d084b6cf6965 server_cookie=654541acb6a1f17c in_seq=0 out_seq=0 2023-07-20T09:51:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b157fa640 10 client.5415 ms_handle_connect on v2:172.21.15.82:6836/1206692867 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b157fa640 1 -- 172.21.15.82:0/521404954 <== mds.0 v2:172.21.15.82:6836/1206692867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x561a51367410 con 0x561a514f6210 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b157fa640 10 client.5415 handle_command_reply: tid=0 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 client.5415 shutdown 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 msgr2=0x561a514f5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b30051c70 tx=0x7f8b3005da90 comp rx=0 tx=0).stop 2023-07-20T09:51:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 shutdown_connections 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a514f6210 0x561a51545290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a514f5940 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a514f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/521404954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a514f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 >> 172.21.15.82:0/521404954 conn(0x561a514e1200 msgr2=0x561a514e8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b157fa640 0 client.5415 ms_handle_reset on v2:172.21.15.82:6836/1206692867 2023-07-20T09:51:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 shutdown_connections 2023-07-20T09:51:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 1 -- 172.21.15.82:0/521404954 wait complete. 2023-07-20T09:51:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.501+0000 7f8b3fea0000 20 client.5415 trim_cache size 0 max 16384 2023-07-20T09:51:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 Processor -- start 2023-07-20T09:51:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- start start 2023-07-20T09:51:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a51533420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a51534640 0x561a51543280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a50ff5940 con 0x561a514e9e90 2023-07-20T09:51:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a5133cc60 con 0x561a51533d20 2023-07-20T09:51:29.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a514ec7a0 con 0x561a51534640 2023-07-20T09:51:29.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53180/0 (socket says 172.21.15.82:53180) 2023-07-20T09:51:29.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 -- 172.21.15.82:0/1562561826 learned_addr learned my addr 172.21.15.82:0/1562561826 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a51533420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a51534640 0x561a51543280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 -- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a51534640 msgr2=0x561a51543280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a51534640 0x561a51543280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 -- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 msgr2=0x561a51533420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a51533420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 -- 172.21.15.82:0/1562561826 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a512e2fa0 con 0x561a514e9e90 2023-07-20T09:51:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3659c640 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b20011010 tx=0x7f8b20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9491677d59ff86b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b2cd99640 1 -- 172.21.15.82:0/1562561826 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20014f00 con 0x561a514e9e90 2023-07-20T09:51:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b2cd99640 1 -- 172.21.15.82:0/1562561826 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b20019040 con 0x561a514e9e90 2023-07-20T09:51:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b2cd99640 1 -- 172.21.15.82:0/1562561826 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20032450 con 0x561a514e9e90 2023-07-20T09:51:29.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- 172.21.15.82:0/1562561826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 msgr2=0x561a51532ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8b20011010 tx=0x7f8b20014000 comp rx=0 tx=0).stop 2023-07-20T09:51:29.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- 172.21.15.82:0/1562561826 shutdown_connections 2023-07-20T09:51:29.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a51534640 0x561a51543280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a51533420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/1562561826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a514e9e90 0x561a51532ee0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- 172.21.15.82:0/1562561826 >> 172.21.15.82:0/1562561826 conn(0x561a514e1200 msgr2=0x561a515327d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- 172.21.15.82:0/1562561826 shutdown_connections 2023-07-20T09:51:29.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- 172.21.15.82:0/1562561826 wait complete. 2023-07-20T09:51:29.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 -- start start 2023-07-20T09:51:29.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.517+0000 7f8b3fea0000 1 Processor -- start 2023-07-20T09:51:29.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a5158dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a515459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a51270a00 con 0x561a51534640 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a5133b7c0 con 0x561a51533d20 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x561a51332f60 con 0x561a514e9e90 2023-07-20T09:51:29.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 10 client.0 _ll_register_callbacks cb 0x561a513b0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53182/0 (socket says 172.21.15.82:53182) 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 -- 172.21.15.82:0/346862128 learned_addr learned my addr 172.21.15.82:0/346862128 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3659c640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a5158dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a515459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 -- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 msgr2=0x561a5158dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a5158dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 -- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 msgr2=0x561a515459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a515459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 -- 172.21.15.82:0/346862128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a51034890 con 0x561a51534640 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b2dd9b640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a515459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b36d9d640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8b30055700 tx=0x7f8b30082820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d99ed6833263ca server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30055540 con 0x561a51534640 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b30053bd0 con 0x561a51534640 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a514e9d20 con 0x561a51534640 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b300552b0 con 0x561a51534640 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 10 client.5421 fetch_fsmap learned FSMap version 16 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561a51034cc0 con 0x561a51534640 2023-07-20T09:51:29.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561a514e9d20 con 0x561a51534640 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8b30005d20 con 0x561a51534640 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 10 client.5421 fetch_fsmap finished waiting for FSMap version 16 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 10 client.5421 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 20 client.5421 populate_metadata read hostname 'smithi082' 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a51546430 0x561a51546810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 4 client.5421 mds_command: new command op to 5229 tid=0[{"prefix": "status"}] 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 --> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561a512ffa20 con 0x561a51546430 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3659c640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a51546430 0x561a51546810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3659c640 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a51546430 0x561a51546810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5628c442c4386358 server_cookie=c0748459416b22a0 in_seq=0 out_seq=0 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 10 client.5421 ms_handle_connect on v2:172.21.15.82:6836/1206692867 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 1 -- 172.21.15.82:0/346862128 <== mds.0 v2:172.21.15.82:6836/1206692867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561a512ffa20 con 0x561a51546430 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 10 client.5421 handle_command_reply: tid=0 2023-07-20T09:51:29.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 client.5421 shutdown 2023-07-20T09:51:29.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 msgr2=0x561a51545ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8b30055700 tx=0x7f8b30082820 comp rx=0 tx=0).stop 2023-07-20T09:51:29.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 shutdown_connections 2023-07-20T09:51:29.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:6836/1206692867,v1:172.21.15.82:6837/1206692867] conn(0x561a51546430 0x561a51546810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a51534640 0x561a51545ef0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x561a51533d20 0x561a515459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 --2- 172.21.15.82:0/346862128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x561a514e9e90 0x561a5158dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 >> 172.21.15.82:0/346862128 conn(0x561a514e1200 msgr2=0x561a514eab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.521+0000 7f8b157fa640 0 client.5421 ms_handle_reset on v2:172.21.15.82:6836/1206692867 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 shutdown_connections 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3fea0000 1 -- 172.21.15.82:0/346862128 wait complete. 2023-07-20T09:51:29.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3fea0000 20 client.5421 trim_cache size 0 max 16384 2023-07-20T09:51:29.578 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T09:51:29.578 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T09:51:29.578 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T09:51:29.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5229, 2023-07-20T09:51:29.578 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T09:51:29.579 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T09:51:29.579 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T09:51:29.579 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 5.8403089399999999, 2023-07-20T09:51:29.579 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 16, 2023-07-20T09:51:29.579 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 37, 2023-07-20T09:51:29.580 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 37, 2023-07-20T09:51:29.580 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 14.065686900999999 2023-07-20T09:51:29.580 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T09:51:29.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 msgr2=0x7f8b18068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 0x7f8b18068740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007fd0 tx=0x7f8b20007e40 comp rx=0 tx=0).stop 2023-07-20T09:51:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 msgr2=0x7f8b38099150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8b30007e40 tx=0x7f8b3000e4b0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 shutdown_connections 2023-07-20T09:51:29.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f8b18066280 0x7f8b18068740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b380ca040 0x7f8b38099150 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8b380b1170 0x7f8b38161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 --2- 172.21.15.82:0/881876740 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b380ad060 0x7f8b3809b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 >> 172.21.15.82:0/881876740 conn(0x7f8b380cada0 msgr2=0x7f8b3806c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 shutdown_connections 2023-07-20T09:51:29.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.525+0000 7f8b3cb37640 1 -- 172.21.15.82:0/881876740 wait complete. 2023-07-20T09:51:29.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T09:51:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 Processor -- start 2023-07-20T09:51:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 -- start start 2023-07-20T09:51:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 0x7f19180d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 0x7f19180cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19180d16b0 con 0x7f191815cab0 2023-07-20T09:51:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19180d31c0 con 0x7f19180cd4b0 2023-07-20T09:51:29.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191fbf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19180b3520 con 0x7f19180d0d10 2023-07-20T09:51:29.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d98f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f191815cab0 0x7f19180d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36700/0 (socket says 172.21.15.82:36700) 2023-07-20T09:51:29.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d98f640 1 -- 172.21.15.82:0/2055894082 learned_addr learned my addr 172.21.15.82:0/2055894082 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d18e640 1 --2- 172.21.15.82:0/2055894082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 0x7f19180d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191e190640 1 --2- 172.21.15.82:0/2055894082 >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 0x7f19180cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773211772 0 0) 0x7f19180d16b0 con 0x7f191815cab0 2023-07-20T09:51:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1904003530 con 0x7f191815cab0 2023-07-20T09:51:29.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2614020606 0 0) 0x7f1904003530 con 0x7f191815cab0 2023-07-20T09:51:29.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d18e640 1 -- 172.21.15.82:0/2055894082 >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 msgr2=0x7f19180cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:29.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d18e640 1 --2- 172.21.15.82:0/2055894082 >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 0x7f19180cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d18e640 1 -- 172.21.15.82:0/2055894082 >> v1:172.21.15.82:6789/0 conn(0x7f191815cab0 legacy=0x7f19180d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191d18e640 1 -- 172.21.15.82:0/2055894082 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180d0a10 con 0x7f19180d0d10 2023-07-20T09:51:29.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.685+0000 7f191e190640 1 --2- 172.21.15.82:0/2055894082 >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 0x7f19180cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:29.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191d18e640 1 --2- 172.21.15.82:0/2055894082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 0x7f19180d1170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19080097c0 tx=0x7f190801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e3c030cd31b5dd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914001a00 con 0x7f19180d0d10 2023-07-20T09:51:29.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19080a7050 con 0x7f19180d0d10 2023-07-20T09:51:29.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191c98d640 1 -- 172.21.15.82:0/2055894082 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080ab600 con 0x7f19180d0d10 2023-07-20T09:51:29.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 -- 172.21.15.82:0/2055894082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 msgr2=0x7f19180d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 --2- 172.21.15.82:0/2055894082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 0x7f19180d1170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f19080097c0 tx=0x7f190801c370 comp rx=0 tx=0).stop 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 -- 172.21.15.82:0/2055894082 shutdown_connections 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 --2- 172.21.15.82:0/2055894082 >> v2:172.21.15.183:3300/0 conn(0x7f19180cd4b0 0x7f19180cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 --2- 172.21.15.82:0/2055894082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180d0d10 0x7f19180d1170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 -- 172.21.15.82:0/2055894082 >> 172.21.15.82:0/2055894082 conn(0x7f191808c120 msgr2=0x7f191809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 -- 172.21.15.82:0/2055894082 shutdown_connections 2023-07-20T09:51:29.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.689+0000 7f191fbf3640 1 -- 172.21.15.82:0/2055894082 wait complete. 2023-07-20T09:51:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 Processor -- start 2023-07-20T09:51:29.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 -- start start 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180cd4b0 0x7f1918153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191815cab0 0x7f19180d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191814a4a0 con 0x7f19180d0d10 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191814bf20 con 0x7f191815cab0 2023-07-20T09:51:29.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191fbf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19181530b0 con 0x7f19180cd4b0 2023-07-20T09:51:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53186/0 (socket says 172.21.15.82:53186) 2023-07-20T09:51:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 -- 172.21.15.82:0/1984681681 learned_addr learned my addr 172.21.15.82:0/1984681681 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d98f640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180cd4b0 0x7f1918153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191e190640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191815cab0 0x7f19180d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 -- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180cd4b0 msgr2=0x7f1918153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180cd4b0 0x7f1918153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 -- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191815cab0 msgr2=0x7f19180d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191815cab0 0x7f19180d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 -- 172.21.15.82:0/1984681681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910009420 con 0x7f19180d0d10 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.693+0000 7f191d18e640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1908000c10 tx=0x7f1908019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1908003a30 con 0x7f19180d0d10 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1908003b90 con 0x7f19180d0d10 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080b5410 con 0x7f19180d0d10 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1908009420 con 0x7f19180d0d10 2023-07-20T09:51:29.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19180b1730 con 0x7f19180d0d10 2023-07-20T09:51:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1918073c70 con 0x7f19180d0d10 2023-07-20T09:51:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19080b2050 con 0x7f19180d0d10 2023-07-20T09:51:29.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 0x7f18fc068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f190811dca0 con 0x7f19180d0d10 2023-07-20T09:51:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f191d98f640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 0x7f18fc068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:29.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.697+0000 7f191d98f640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 0x7f18fc068740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f191400f3c0 tx=0x7f1914009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.701+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19080eb1c0 con 0x7f19180d0d10 2023-07-20T09:51:29.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.881+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f19180b1730 con 0x7f19180d0d10 2023-07-20T09:51:29.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.881+0000 7f190e7fc640 1 -- 172.21.15.82:0/1984681681 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f19180b1730 con 0x7f19180d0d10 2023-07-20T09:51:29.921 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T09:51:29.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 msgr2=0x7f18fc068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 0x7f18fc068740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f191400f3c0 tx=0x7f1914009040 comp rx=0 tx=0).stop 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 msgr2=0x7f1918149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1908000c10 tx=0x7f1908019110 comp rx=0 tx=0).stop 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 shutdown_connections 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f18fc066280 0x7f18fc068740 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f191815cab0 0x7f19180d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19180d0d10 0x7f1918149f60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 --2- 172.21.15.82:0/1984681681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19180cd4b0 0x7f1918153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 >> 172.21.15.82:0/1984681681 conn(0x7f191808c120 msgr2=0x7f1918159390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 shutdown_connections 2023-07-20T09:51:29.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:29.885+0000 7f191fbf3640 1 -- 172.21.15.82:0/1984681681 wait complete. 2023-07-20T09:51:29.941 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T09:51:29.942 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T09:51:29.942 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T09:51:29.943 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T09:51:29.943 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T09:51:29.943 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T09:51:29.944 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T09:51:29.944 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T09:51:29.945 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T09:51:29.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:29.946 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T09:51:29.957 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T09:51:29.957 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T09:51:29.958 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T09:51:29.958 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.958 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T09:51:29.958 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.959 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:51:29.959 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.959 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T09:51:29.960 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:51:29.960 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.960 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T09:51:29.960 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T09:51:29.961 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.961 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T09:51:29.961 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.961 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T09:51:29.962 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-07-20T09:51:29.962 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T09:51:29.962 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.962 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T09:51:29.963 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.963 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T09:51:29.963 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.963 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T09:51:29.964 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T09:51:29.964 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T09:51:29.964 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.964 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T09:51:29.965 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.965 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T09:51:29.965 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T09:51:29.965 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T09:51:29.966 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.966 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T09:51:29.966 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T09:51:29.967 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T09:51:29.967 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T09:51:29.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:29.968 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T09:51:30.019 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T09:51:30.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.021 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T09:51:30.079 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T09:51:30.080 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T09:51:30.080 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T09:51:30.080 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T09:51:30.080 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T09:51:30.080 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T09:51:30.081 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:51:30.081 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:51:30.081 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T09:51:30.081 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T09:51:30.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.082 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T09:51:30.082 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T09:51:30.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T09:51:30.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T09:51:30.083 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T09:51:30.083 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T09:51:30.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.177 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T09:51:30.186 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T09:51:30.186 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T09:51:30.187 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T09:51:30.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T09:51:30.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:51:30.253 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T09:51:30.304 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T09:51:30.305 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T09:51:30.305 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T09:51:30.356 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T09:51:30.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:51:30.447 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:51:30.448 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:51:30.448 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:51:30.462 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:51:30.462 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:51:30.463 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:51:30.463 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:51:30.463 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:51:30.481 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T09:51:30.481 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T09:51:30.482 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T09:51:30.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T09:51:30.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T09:51:30.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:30.506 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T09:51:30.568 INFO:teuthology.orchestra.run.smithi082.stdout:client4967 2023-07-20T09:51:30.569 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T09:51:30.569 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T09:51:30.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T09:51:30.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 Processor -- start 2023-07-20T09:51:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 -- start start 2023-07-20T09:51:30.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f560c15cab0 0x7f560c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f560c0ce4c0 0x7f560c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0d16b0 con 0x7f560c0d0d10 2023-07-20T09:51:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0d31c0 con 0x7f560c15cab0 2023-07-20T09:51:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f56137d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0b3520 con 0x7f560c0ce4c0 2023-07-20T09:51:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f560c15cab0 0x7f560c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f560c15cab0 0x7f560c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53196/0 (socket says 172.21.15.82:53196) 2023-07-20T09:51:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 -- 172.21.15.82:0/4101609005 learned_addr learned my addr 172.21.15.82:0/4101609005 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5610d70640 1 --1- 172.21.15.82:0/4101609005 >> v1:172.21.15.82:6789/0 conn(0x7f560c0d0d10 0x7f560c0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36714/0 (socket says 172.21.15.82:36714) 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611d72640 1 --2- 172.21.15.82:0/4101609005 >> v2:172.21.15.183:3300/0 conn(0x7f560c0ce4c0 0x7f560c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 -- 172.21.15.82:0/4101609005 >> v2:172.21.15.183:3300/0 conn(0x7f560c0ce4c0 msgr2=0x7f560c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 --2- 172.21.15.82:0/4101609005 >> v2:172.21.15.183:3300/0 conn(0x7f560c0ce4c0 0x7f560c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 -- 172.21.15.82:0/4101609005 >> v1:172.21.15.82:6789/0 conn(0x7f560c0d0d10 legacy=0x7f560c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5611571640 1 -- 172.21.15.82:0/4101609005 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0b2910 con 0x7f560c15cab0 2023-07-20T09:51:30.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.773+0000 7f5603fff640 1 -- 172.21.15.82:0/4101609005 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171478520 0 0) 0x7f560c0d16b0 con 0x7f560c0d0d10 2023-07-20T09:51:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f5611571640 1 --2- 172.21.15.82:0/4101609005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c15cab0 0x7f560c0d0300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f560c071cd0 tx=0x7f560801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b969f6ead1fe6c4f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:30.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f5603fff640 1 -- 172.21.15.82:0/4101609005 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080ab5f0 con 0x7f560c15cab0 2023-07-20T09:51:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f5603fff640 1 -- 172.21.15.82:0/4101609005 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56080ab750 con 0x7f560c15cab0 2023-07-20T09:51:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f5603fff640 1 -- 172.21.15.82:0/4101609005 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080abae0 con 0x7f560c15cab0 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 -- 172.21.15.82:0/4101609005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c15cab0 msgr2=0x7f560c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 --2- 172.21.15.82:0/4101609005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c15cab0 0x7f560c0d0300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f560c071cd0 tx=0x7f560801c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 -- 172.21.15.82:0/4101609005 shutdown_connections 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 --2- 172.21.15.82:0/4101609005 >> v2:172.21.15.183:3300/0 conn(0x7f560c0ce4c0 0x7f560c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 --2- 172.21.15.82:0/4101609005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c15cab0 0x7f560c0d0300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 -- 172.21.15.82:0/4101609005 >> 172.21.15.82:0/4101609005 conn(0x7f560c08c120 msgr2=0x7f560c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.777+0000 7f56137d5640 1 -- 172.21.15.82:0/4101609005 shutdown_connections 2023-07-20T09:51:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 -- 172.21.15.82:0/4101609005 wait complete. 2023-07-20T09:51:30.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 Processor -- start 2023-07-20T09:51:30.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 -- start start 2023-07-20T09:51:30.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c0d0d10 0x7f560c15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 0x7f560c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c8d70 con 0x7f560c0ce4c0 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b7830 con 0x7f560c15cab0 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f56137d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0b6c20 con 0x7f560c0d0d10 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53206/0 (socket says 172.21.15.82:53206) 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 -- 172.21.15.82:0/3885561380 learned_addr learned my addr 172.21.15.82:0/3885561380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5610d70640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c0d0d10 0x7f560c15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611d72640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 0x7f560c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 -- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c0d0d10 msgr2=0x7f560c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c0d0d10 0x7f560c15bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 -- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 msgr2=0x7f560c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 0x7f560c0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 -- 172.21.15.82:0/3885561380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080094d0 con 0x7f560c0ce4c0 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611d72640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 0x7f560c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:30.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5611571640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f56080ad040 tx=0x7f560801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080abcd0 con 0x7f560c0ce4c0 2023-07-20T09:51:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.781+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56080b8070 con 0x7f560c0ce4c0 2023-07-20T09:51:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c0b6f00 con 0x7f560c0ce4c0 2023-07-20T09:51:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608004220 con 0x7f560c0ce4c0 2023-07-20T09:51:30.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c0b74c0 con 0x7f560c0ce4c0 2023-07-20T09:51:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c06c1e0 con 0x7f560c0ce4c0 2023-07-20T09:51:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5608004380 con 0x7f560c0ce4c0 2023-07-20T09:51:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f5601ffb640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 0x7f55f0068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:30.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f56080a8050 con 0x7f560c0ce4c0 2023-07-20T09:51:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.785+0000 7f5610d70640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 0x7f55f0068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:30.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.789+0000 7f5610d70640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 0x7f55f0068740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f560c1f7f10 tx=0x7f55fc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:30.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.789+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56080eb310 con 0x7f560c0ce4c0 2023-07-20T09:51:31.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.969+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f560c0b25c0 con 0x7f55f0066280 2023-07-20T09:51:31.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.969+0000 7f5601ffb640 1 -- 172.21.15.82:0/3885561380 <== mgr.4099 v2:172.21.15.82:6832/2623212404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f55fc001c80 con 0x7f55f0066280 2023-07-20T09:51:31.007 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T09:51:31.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T09:51:31.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T09:51:31.008 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T09:51:31.008 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T09:51:31.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 msgr2=0x7f55f0068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 0x7f55f0068740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f560c1f7f10 tx=0x7f55fc009040 comp rx=0 tx=0).stop 2023-07-20T09:51:31.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 msgr2=0x7f560c15b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f56080ad040 tx=0x7f560801ad10 comp rx=0 tx=0).stop 2023-07-20T09:51:31.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 shutdown_connections 2023-07-20T09:51:31.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f55f0066280 0x7f55f0068740 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15cab0 0x7f560c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c0d0d10 0x7f560c15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 --2- 172.21.15.82:0/3885561380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0ce4c0 0x7f560c15b890 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 >> 172.21.15.82:0/3885561380 conn(0x7f560c08c120 msgr2=0x7f560c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 shutdown_connections 2023-07-20T09:51:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:30.973+0000 7f56137d5640 1 -- 172.21.15.82:0/3885561380 wait complete. 2023-07-20T09:51:31.029 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T09:51:31.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 Processor -- start 2023-07-20T09:51:31.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 -- start start 2023-07-20T09:51:31.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f072c159450 0x7f072c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c0afd50 0x7f072c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c0b06b0 con 0x7f072c159830 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0cce90 con 0x7f072c159450 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0731a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0cc8d0 con 0x7f072c0afd50 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.137+0000 7f0723fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f072c159830 0x7f072c0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36728/0 (socket says 172.21.15.82:36728) 2023-07-20T09:51:31.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f0723fff640 1 -- 172.21.15.82:0/3132022310 learned_addr learned my addr 172.21.15.82:0/3132022310 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 --2- 172.21.15.82:0/3132022310 >> v2:172.21.15.183:3300/0 conn(0x7f072c159450 0x7f072c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072bfff640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c0afd50 0x7f072c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072affd640 1 -- 172.21.15.82:0/3132022310 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964687647 0 0) 0x7f072c0b06b0 con 0x7f072c159830 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072affd640 1 -- 172.21.15.82:0/3132022310 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0718003530 con 0x7f072c159830 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 -- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c0afd50 msgr2=0x7f072c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c0afd50 0x7f072c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 -- 172.21.15.82:0/3132022310 >> v1:172.21.15.82:6789/0 conn(0x7f072c159830 legacy=0x7f072c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 -- 172.21.15.82:0/3132022310 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c0ccbb0 con 0x7f072c159450 2023-07-20T09:51:31.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.141+0000 7f072b7fe640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c15a4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f071c0097c0 tx=0x7f071c01e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07f0108e24057c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:31.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072affd640 1 -- 172.21.15.82:0/3132022310 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0a8630 con 0x7f072c159450 2023-07-20T09:51:31.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072affd640 1 -- 172.21.15.82:0/3132022310 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0a8790 con 0x7f072c159450 2023-07-20T09:51:31.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072affd640 1 -- 172.21.15.82:0/3132022310 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0a8b20 con 0x7f072c159450 2023-07-20T09:51:31.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 msgr2=0x7f072c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c15a4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f071c0097c0 tx=0x7f071c01e660 comp rx=0 tx=0).stop 2023-07-20T09:51:31.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- 172.21.15.82:0/3132022310 shutdown_connections 2023-07-20T09:51:31.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c0afd50 0x7f072c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- 172.21.15.82:0/3132022310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c15a4c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- 172.21.15.82:0/3132022310 >> 172.21.15.82:0/3132022310 conn(0x7f072c0cad50 msgr2=0x7f072c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- 172.21.15.82:0/3132022310 shutdown_connections 2023-07-20T09:51:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- 172.21.15.82:0/3132022310 wait complete. 2023-07-20T09:51:31.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 Processor -- start 2023-07-20T09:51:31.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- start start 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 0x7f072c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c157060 con 0x7f072c0afd50 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c156df0 con 0x7f072c159450 2023-07-20T09:51:31.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f0731a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0c4230 con 0x7f072c156430 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53212/0 (socket says 172.21.15.82:53212) 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.145+0000 7f072b7fe640 1 -- 172.21.15.82:0/2487584063 learned_addr learned my addr 172.21.15.82:0/2487584063 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072bfff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 0x7f072c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 -- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 msgr2=0x7f072c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0723fff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 0x7f072c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 -- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 msgr2=0x7f072c158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 -- 172.21.15.82:0/2487584063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009420 con 0x7f072c0afd50 2023-07-20T09:51:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072bfff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 0x7f072c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:31.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0723fff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f072b7fe640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f071c01c290 tx=0x7f071c01cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0b3450 con 0x7f072c0afd50 2023-07-20T09:51:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0b35f0 con 0x7f072c0afd50 2023-07-20T09:51:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0b39a0 con 0x7f072c0afd50 2023-07-20T09:51:31.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c0c3190 con 0x7f072c0afd50 2023-07-20T09:51:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c0c3750 con 0x7f072c0afd50 2023-07-20T09:51:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c15a9c0 con 0x7f072c0afd50 2023-07-20T09:51:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f071c0b3b00 con 0x7f072c0afd50 2023-07-20T09:51:31.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 0x7f070c068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f071c11e160 con 0x7f072c0afd50 2023-07-20T09:51:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.149+0000 7f0723fff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 0x7f070c068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.153+0000 7f0723fff640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 0x7f070c068740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072c154db0 tx=0x7f0714007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.153+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f071c0eb540 con 0x7f072c0afd50 2023-07-20T09:51:31.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.337+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f072c04da30 con 0x7f072c0afd50 2023-07-20T09:51:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f071c0eb910 con 0x7f072c0afd50 2023-07-20T09:51:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0728ff9640 1 -- 172.21.15.82:0/2487584063 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f071c105950 con 0x7f072c0afd50 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 msgr2=0x7f070c068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 0x7f070c068740 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072c154db0 tx=0x7f0714007a90 comp rx=0 tx=0).stop 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 msgr2=0x7f072c153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f071c01c290 tx=0x7f071c01cea0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 shutdown_connections 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f070c066280 0x7f070c068740 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f072c156430 0x7f072c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f072c159450 0x7f072c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 --2- 172.21.15.82:0/2487584063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f072c0afd50 0x7f072c153720 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 >> 172.21.15.82:0/2487584063 conn(0x7f072c0cad50 msgr2=0x7f072c072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 shutdown_connections 2023-07-20T09:51:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.757+0000 7f0731a88640 1 -- 172.21.15.82:0/2487584063 wait complete. 2023-07-20T09:51:31.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T09:51:31.961 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:31.925+0000 7fde7be21180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T09:51:31.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.925+0000 7feef8fba640 1 Processor -- start 2023-07-20T09:51:31.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.925+0000 7feef8fba640 1 -- start start 2023-07-20T09:51:31.965 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:31.929+0000 7f615f053180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T09:51:31.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef8fba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef406c120 0x7feef40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef8fba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 0x7feef4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef8fba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef40d0970 con 0x7feef41602b0 2023-07-20T09:51:31.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef8fba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef4160e20 con 0x7feef406c120 2023-07-20T09:51:31.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef8fba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40cd300 con 0x7feef406b220 2023-07-20T09:51:31.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef406c120 0x7feef40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef406c120 0x7feef40cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53248/0 (socket says 172.21.15.82:53248) 2023-07-20T09:51:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 -- 172.21.15.82:0/1400524014 learned_addr learned my addr 172.21.15.82:0/1400524014 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef2d9d640 1 --2- 172.21.15.82:0/1400524014 >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 0x7feef4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 -- 172.21.15.82:0/1400524014 >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 msgr2=0x7feef4160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:31.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 --2- 172.21.15.82:0/1400524014 >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 0x7feef4160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 -- 172.21.15.82:0/1400524014 >> v1:172.21.15.183:6789/0 conn(0x7feef41602b0 legacy=0x7feef406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef259c640 1 -- 172.21.15.82:0/1400524014 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40cd5e0 con 0x7feef406c120 2023-07-20T09:51:31.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.929+0000 7feef2d9d640 1 --2- 172.21.15.82:0/1400524014 >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 0x7feef4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef259c640 1 --2- 172.21.15.82:0/1400524014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406c120 0x7feef40cdde0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feef408ceb0 tx=0x7feee401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18421f03d8fc5db1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef159a640 1 -- 172.21.15.82:0/1400524014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee40ac630 con 0x7feef406c120 2023-07-20T09:51:31.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef159a640 1 -- 172.21.15.82:0/1400524014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee40ac790 con 0x7feef406c120 2023-07-20T09:51:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef159a640 1 -- 172.21.15.82:0/1400524014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee40acb20 con 0x7feef406c120 2023-07-20T09:51:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- 172.21.15.82:0/1400524014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406c120 msgr2=0x7feef40cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 --2- 172.21.15.82:0/1400524014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406c120 0x7feef40cdde0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feef408ceb0 tx=0x7feee401c3b0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- 172.21.15.82:0/1400524014 shutdown_connections 2023-07-20T09:51:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 --2- 172.21.15.82:0/1400524014 >> v2:172.21.15.183:3300/0 conn(0x7feef406b220 0x7feef4160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 --2- 172.21.15.82:0/1400524014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406c120 0x7feef40cdde0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- 172.21.15.82:0/1400524014 >> 172.21.15.82:0/1400524014 conn(0x7feef408c0a0 msgr2=0x7feef409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:31.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- 172.21.15.82:0/1400524014 shutdown_connections 2023-07-20T09:51:31.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- 172.21.15.82:0/1400524014 wait complete. 2023-07-20T09:51:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 Processor -- start 2023-07-20T09:51:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.933+0000 7feef8fba640 1 -- start start 2023-07-20T09:51:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 0x7feef40b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 0x7feef414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef41602b0 0x7feef40affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40c67b0 con 0x7feef406b220 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40c6180 con 0x7feef406c120 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef414dea0 con 0x7feef41602b0 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 0x7feef40b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 0x7feef414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 0x7feef40b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53262/0 (socket says 172.21.15.82:53262) 2023-07-20T09:51:31.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef259c640 1 -- 172.21.15.82:0/706824018 learned_addr learned my addr 172.21.15.82:0/706824018 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef2d9d640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef41602b0 0x7feef40affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 -- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef41602b0 msgr2=0x7feef40affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef41602b0 0x7feef40affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 -- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 msgr2=0x7feef40b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 0x7feef40b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 -- 172.21.15.82:0/706824018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40094d0 con 0x7feef406c120 2023-07-20T09:51:31.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef1d9b640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 0x7feef414adf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feee8000f70 tx=0x7feee800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80052d0 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8005430 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef41568e0 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8003840 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef40c63d0 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.937+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef40c68f0 con 0x7feef406c120 2023-07-20T09:51:31.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.941+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7feee80039a0 con 0x7feef406c120 2023-07-20T09:51:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.941+0000 7feee2ffd640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 0x7feed40687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.941+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feee80831d0 con 0x7feef406c120 2023-07-20T09:51:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.941+0000 7feef259c640 1 -- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 msgr2=0x7feed40687c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:31.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.941+0000 7feef259c640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 0x7feed40687c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T09:51:31.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:31.945+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feef40c68f0 con 0x7feef406c120 2023-07-20T09:51:32.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.097+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7feef40c68f0 con 0x7feef406c120 2023-07-20T09:51:32.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.105+0000 7feee2ffd640 1 -- 172.21.15.82:0/706824018 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7feef40c68f0 con 0x7feef406c120 2023-07-20T09:51:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.105+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 msgr2=0x7feed40687c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T09:51:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.105+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 0x7feed40687c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 msgr2=0x7feef414adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 0x7feef414adf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feee8000f70 tx=0x7feee800c820 comp rx=0 tx=0).stop 2023-07-20T09:51:32.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 shutdown_connections 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feed4066300 0x7feed40687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef41602b0 0x7feef40affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef406c120 0x7feef414adf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 --2- 172.21.15.82:0/706824018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef406b220 0x7feef40b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 >> 172.21.15.82:0/706824018 conn(0x7feef408c0a0 msgr2=0x7feef40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 shutdown_connections 2023-07-20T09:51:32.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.109+0000 7feef8fba640 1 -- 172.21.15.82:0/706824018 wait complete. 2023-07-20T09:51:32.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T09:51:32.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.269+0000 7feeff7a3640 1 Processor -- start 2023-07-20T09:51:32.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.269+0000 7feeff7a3640 1 -- start start 2023-07-20T09:51:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 0x7feef80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feef81602b0 0x7feef8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef806b4c0 con 0x7feef806ab10 2023-07-20T09:51:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef80d0970 con 0x7feef81602b0 2023-07-20T09:51:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feeff7a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef8160e20 con 0x7feef806c120 2023-07-20T09:51:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefdd40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefdd40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53276/0 (socket says 172.21.15.82:53276) 2023-07-20T09:51:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefdd40640 1 -- 172.21.15.82:0/1704616905 learned_addr learned my addr 172.21.15.82:0/1704616905 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefd53f640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 0x7feef80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 --2- 172.21.15.82:0/1704616905 >> v2:172.21.15.183:3300/0 conn(0x7feef81602b0 0x7feef8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 -- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 msgr2=0x7feef80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:32.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 0x7feef80cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 -- 172.21.15.82:0/1704616905 >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 msgr2=0x7feef806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:32.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 --2- 172.21.15.82:0/1704616905 >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefcd3e640 1 -- 172.21.15.82:0/1704616905 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80cd300 con 0x7feef81602b0 2023-07-20T09:51:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefdd40640 1 --2- 172.21.15.82:0/1704616905 >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.273+0000 7feefd53f640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 0x7feef80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feefcd3e640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef81602b0 0x7feef8160710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feef80d3750 tx=0x7feee801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9384cacd182be91e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeeffff640 1 -- 172.21.15.82:0/1704616905 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80ab600 con 0x7feef81602b0 2023-07-20T09:51:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeeffff640 1 -- 172.21.15.82:0/1704616905 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80a7050 con 0x7feef81602b0 2023-07-20T09:51:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeeffff640 1 -- 172.21.15.82:0/1704616905 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80ab980 con 0x7feef81602b0 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef81602b0 msgr2=0x7feef8160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef81602b0 0x7feef8160710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feef80d3750 tx=0x7feee801c3d0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- 172.21.15.82:0/1704616905 shutdown_connections 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef81602b0 0x7feef8160710 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 --2- 172.21.15.82:0/1704616905 >> v2:172.21.15.82:3300/0 conn(0x7feef806ab10 0x7feef806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 --2- 172.21.15.82:0/1704616905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef806c120 0x7feef80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- 172.21.15.82:0/1704616905 >> 172.21.15.82:0/1704616905 conn(0x7feef808c0a0 msgr2=0x7feef809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- 172.21.15.82:0/1704616905 shutdown_connections 2023-07-20T09:51:32.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- 172.21.15.82:0/1704616905 wait complete. 2023-07-20T09:51:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 Processor -- start 2023-07-20T09:51:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.277+0000 7feeff7a3640 1 -- start start 2023-07-20T09:51:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 0x7feef80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef81602b0 0x7feef80cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c9000 con 0x7feef806ab10 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c7ce0 con 0x7feef806c120 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c7f60 con 0x7feef81602b0 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefd53f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefd53f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53278/0 (socket says 172.21.15.82:53278) 2023-07-20T09:51:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefd53f640 1 -- 172.21.15.82:0/2700240854 learned_addr learned my addr 172.21.15.82:0/2700240854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 0x7feef80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefdd40640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef81602b0 0x7feef80cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 -- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef81602b0 msgr2=0x7feef80cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef81602b0 0x7feef80cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 -- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 msgr2=0x7feef80c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 -- 172.21.15.82:0/2700240854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009b30 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefd53f640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feefcd3e640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 0x7feef80c6180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feef80d0ab0 tx=0x7feee8019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80b4400 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80b45a0 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80b4950 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef4009420 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8009420 con 0x7feef806c120 2023-07-20T09:51:32.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.281+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8140350 con 0x7feef806c120 2023-07-20T09:51:32.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7feee80b2040 con 0x7feef806c120 2023-07-20T09:51:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feeedffb640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 0x7feedc068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feee811e400 con 0x7feef806c120 2023-07-20T09:51:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feefd53f640 1 -- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 msgr2=0x7feedc068790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:32.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feefd53f640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 0x7feedc068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T09:51:32.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.285+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feee80ebab0 con 0x7feef806c120 2023-07-20T09:51:32.380 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:32.345+0000 7fde7be21180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T09:51:32.398 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:32.361+0000 7f615f053180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T09:51:32.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.441+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7feef804da30 con 0x7feef806c120 2023-07-20T09:51:32.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.445+0000 7feeedffb640 1 -- 172.21.15.82:0/2700240854 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7feee80ef0d0 con 0x7feef806c120 2023-07-20T09:51:32.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 msgr2=0x7feedc068790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T09:51:32.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 0x7feedc068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 msgr2=0x7feef80c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 0x7feef80c6180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feef80d0ab0 tx=0x7feee8019170 comp rx=0 tx=0).stop 2023-07-20T09:51:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 shutdown_connections 2023-07-20T09:51:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7feedc0662d0 0x7feedc068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feef81602b0 0x7feef80cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feef806c120 0x7feef80c6180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 --2- 172.21.15.82:0/2700240854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feef806ab10 0x7feef80c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 >> 172.21.15.82:0/2700240854 conn(0x7feef808c0a0 msgr2=0x7feef815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 shutdown_connections 2023-07-20T09:51:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.449+0000 7feeff7a3640 1 -- 172.21.15.82:0/2700240854 wait complete. 2023-07-20T09:51:32.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:32.507 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T09:51:32.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:32.524 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-07-20T09:51:32.532 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:32.497+0000 7fde7be21180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T09:51:32.555 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:32.517+0000 7f615f053180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T09:51:32.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-07-20T09:51:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 Processor -- start 2023-07-20T09:51:32.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 -- start start 2023-07-20T09:51:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 0x7f845c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0d0970 con 0x7f845c1602b0 2023-07-20T09:51:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c160e20 con 0x7f845c06c120 2023-07-20T09:51:32.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f846091e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0cd300 con 0x7f845c06b220 2023-07-20T09:51:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f8453fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f845c1602b0 0x7f845c06ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36748/0 (socket says 172.21.15.82:36748) 2023-07-20T09:51:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f8453fff640 1 -- 172.21.15.82:0/755558476 learned_addr learned my addr 172.21.15.82:0/755558476 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845ad9d640 1 --2- 172.21.15.82:0/755558476 >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 0x7f845c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f8459d9b640 1 -- 172.21.15.82:0/755558476 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888112428 0 0) 0x7f845c0d0970 con 0x7f845c1602b0 2023-07-20T09:51:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f8459d9b640 1 -- 172.21.15.82:0/755558476 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8448003530 con 0x7f845c1602b0 2023-07-20T09:51:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845a59c640 1 -- 172.21.15.82:0/755558476 >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 msgr2=0x7f845c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845a59c640 1 --2- 172.21.15.82:0/755558476 >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 0x7f845c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845a59c640 1 -- 172.21.15.82:0/755558476 >> v1:172.21.15.82:6789/0 conn(0x7f845c1602b0 legacy=0x7f845c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845a59c640 1 -- 172.21.15.82:0/755558476 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0cd5e0 con 0x7f845c06c120 2023-07-20T09:51:32.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.717+0000 7f845ad9d640 1 --2- 172.21.15.82:0/755558476 >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 0x7f845c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:32.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f845a59c640 1 --2- 172.21.15.82:0/755558476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c06c120 0x7f845c0cdde0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f845c08ceb0 tx=0x7f844c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d839db021beaf83 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:32.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f8459d9b640 1 -- 172.21.15.82:0/755558476 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a58a0 con 0x7f845c06c120 2023-07-20T09:51:32.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f8459d9b640 1 -- 172.21.15.82:0/755558476 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0a5a00 con 0x7f845c06c120 2023-07-20T09:51:32.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f8459d9b640 1 -- 172.21.15.82:0/755558476 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a5d70 con 0x7f845c06c120 2023-07-20T09:51:32.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 -- 172.21.15.82:0/755558476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c06c120 msgr2=0x7f845c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 --2- 172.21.15.82:0/755558476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c06c120 0x7f845c0cdde0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f845c08ceb0 tx=0x7f844c01c7c0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 -- 172.21.15.82:0/755558476 shutdown_connections 2023-07-20T09:51:32.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 --2- 172.21.15.82:0/755558476 >> v2:172.21.15.183:3300/0 conn(0x7f845c06b220 0x7f845c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 --2- 172.21.15.82:0/755558476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c06c120 0x7f845c0cdde0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 -- 172.21.15.82:0/755558476 >> 172.21.15.82:0/755558476 conn(0x7f845c08c0a0 msgr2=0x7f845c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 -- 172.21.15.82:0/755558476 shutdown_connections 2023-07-20T09:51:32.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.721+0000 7f846091e640 1 -- 172.21.15.82:0/755558476 wait complete. 2023-07-20T09:51:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 Processor -- start 2023-07-20T09:51:32.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- start start 2023-07-20T09:51:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06b220 0x7f845c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cae00 con 0x7f845c1602b0 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0cc030 con 0x7f845c06b220 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c157640 con 0x7f845c06c120 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06b220 0x7f845c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53294/0 (socket says 172.21.15.82:53294) 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 -- 172.21.15.82:0/298747326 learned_addr learned my addr 172.21.15.82:0/298747326 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f8453fff640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 msgr2=0x7f845c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f845c06c120 0x7f845c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06b220 msgr2=0x7f845c0cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:32.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f845c06b220 0x7f845c0cbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009a70 con 0x7f845c1602b0 2023-07-20T09:51:32.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f845ad9d640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0c8590 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f845400e870 tx=0x7f845400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400c8d0 con 0x7f845c1602b0 2023-07-20T09:51:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845400ca30 con 0x7f845c1602b0 2023-07-20T09:51:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0c8150 con 0x7f845c1602b0 2023-07-20T09:51:32.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845400cde0 con 0x7f845c1602b0 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.725+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c0cb2f0 con 0x7f845c1602b0 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c04da30 con 0x7f845c1602b0 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f8454013410 con 0x7f845c1602b0 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f8452ffd640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f845a59c640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 msgr2=0x7f843c068790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8454083a80 con 0x7f845c1602b0 2023-07-20T09:51:32.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.729+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T09:51:32.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.733+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8454051070 con 0x7f845c1602b0 2023-07-20T09:51:32.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.913+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f845c15f2d0 con 0x7f843c0662d0 2023-07-20T09:51:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.933+0000 7f845a59c640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 msgr2=0x7f843c068790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:32.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:32.933+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T09:51:33.011 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:32.977+0000 7fde7be21180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T09:51:33.052 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.013+0000 7f615f053180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T09:51:33.069 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.033+0000 7fde7be21180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T09:51:33.111 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.073+0000 7f615f053180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T09:51:33.124 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.089+0000 7fde7be21180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T09:51:33.166 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.129+0000 7f615f053180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T09:51:33.209 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.173+0000 7fde7be21180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T09:51:33.251 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.213+0000 7f615f053180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T09:51:33.267 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.229+0000 7fde7be21180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T09:51:33.308 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.269+0000 7f615f053180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T09:51:33.350 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.313+0000 7fde7be21180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T09:51:33.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:33.337+0000 7f845a59c640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 msgr2=0x7f843c068790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:33.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:33.337+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T09:51:33.392 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.353+0000 7f615f053180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T09:51:33.407 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.369+0000 7fde7be21180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T09:51:33.448 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.409+0000 7f615f053180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T09:51:33.548 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.513+0000 7fde7be21180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T09:51:33.591 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.553+0000 7f615f053180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T09:51:33.605 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.569+0000 7fde7be21180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T09:51:33.648 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.609+0000 7f615f053180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T09:51:33.844 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T09:51:33.844 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T09:51:33.844 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T09:51:33.852 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.817+0000 7fde7be21180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T09:51:33.889 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T09:51:33.889 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T09:51:33.889 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T09:51:33.897 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.861+0000 7f615f053180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T09:51:33.985 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:33.949+0000 7fde7be21180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:51:34.031 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:33.993+0000 7f615f053180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:51:34.109 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:34.073+0000 7fde7be21180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T09:51:34.154 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:34.117+0000 7f615f053180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T09:51:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:34.141+0000 7f845a59c640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 msgr2=0x7f843c068790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2623212404 2023-07-20T09:51:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:34.141+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T09:51:34.178 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:34.141+0000 7fde7be21180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T09:51:34.224 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:34.185+0000 7f615f053180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T09:51:34.312 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:34.277+0000 7fde7be21180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:51:34.358 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:34.321+0000 7f615f053180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T09:51:34.843 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:34.805+0000 7fde7be21180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T09:51:34.890 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:34.853+0000 7f615f053180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T09:51:34.928 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:34.893+0000 7fde7be21180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T09:51:34.975 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:34.937+0000 7f615f053180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T09:51:35.075 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:35.037+0000 7fde7be21180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T09:51:35.121 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.085+0000 7f615f053180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T09:51:35.158 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:35.121+0000 7fde7be21180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T09:51:35.204 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.165+0000 7f615f053180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T09:51:35.425 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:35.389+0000 7fde7be21180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T09:51:35.470 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.433+0000 7f615f053180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T09:51:35.484 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T09:51:35.449+0000 7fde7be21180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T09:51:35.532 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.493+0000 7f615f053180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T09:51:35.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:35.509+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f8454051440 con 0x7f845c1602b0 2023-07-20T09:51:35.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:35.509+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 msgr2=0x7f843c068790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T09:51:35.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:35.509+0000 7f8452ffd640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/2623212404,v1:172.21.15.82:6833/2623212404] conn(0x7f843c0662d0 0x7f843c068790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:35.675 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e5184640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e5184640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e5184640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e5184640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e5184640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e197d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e197d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.676 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e197d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.677 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e197d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:35.677 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:51:35.637+0000 7f60e197d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:51:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.529+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8454070f60 con 0x7f845c1602b0 2023-07-20T09:51:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.529+0000 7f8452ffd640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f843c033ba0 0x7f843c0707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.529+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f843c033f80 con 0x7f843c033ba0 2023-07-20T09:51:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.529+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f843c033ba0 0x7f843c0707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.533+0000 7f845a59c640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f843c033ba0 0x7f843c0707b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0a7070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.617+0000 7f8452ffd640 1 -- 172.21.15.82:0/298747326 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f843c033f80 con 0x7f843c033ba0 2023-07-20T09:51:36.656 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir0 2023-07-20T09:51:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f843c033ba0 msgr2=0x7f843c0707b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f843c033ba0 0x7f843c0707b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f844c0af000 tx=0x7f844c0a7070 comp rx=0 tx=0).stop 2023-07-20T09:51:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 msgr2=0x7f845c0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 --2- 172.21.15.82:0/298747326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f845c1602b0 0x7f845c0c8590 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f845400e870 tx=0x7f845400ed30 comp rx=0 tx=0).stop 2023-07-20T09:51:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f845ad9d640 1 -- 172.21.15.82:0/298747326 reap_dead start 2023-07-20T09:51:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 shutdown_connections 2023-07-20T09:51:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 >> 172.21.15.82:0/298747326 conn(0x7f845c08c0a0 msgr2=0x7f845c06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 shutdown_connections 2023-07-20T09:51:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.621+0000 7f846091e640 1 -- 172.21.15.82:0/298747326 wait complete. 2023-07-20T09:51:36.678 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-07-20T09:51:36.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:36.679 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-07-20T09:51:36.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-07-20T09:51:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.837+0000 7f6bfa66a640 1 Processor -- start 2023-07-20T09:51:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.837+0000 7f6bfa66a640 1 -- start start 2023-07-20T09:51:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bfa66a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bfa66a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 0x7f6bf415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bfa66a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf4071950 con 0x7f6bf406f710 2023-07-20T09:51:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bfa66a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf415bad0 con 0x7f6bf415ec90 2023-07-20T09:51:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bfa66a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf415b230 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6bf406f710 0x7f6bf406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48936/0 (socket says 172.21.15.82:48936) 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf3fff640 1 -- 172.21.15.82:0/1462062767 learned_addr learned my addr 172.21.15.82:0/1462062767 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1462062767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf8c07640 1 --2- 172.21.15.82:0/1462062767 >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 0x7f6bf415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/1462062767 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065406758 0 0) 0x7f6bf4071950 con 0x7f6bf406f710 2023-07-20T09:51:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/1462062767 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bdc003530 con 0x7f6bf406f710 2023-07-20T09:51:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf37fe640 1 -- 172.21.15.82:0/1462062767 >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 msgr2=0x7f6bf415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1462062767 >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 0x7f6bf415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf37fe640 1 -- 172.21.15.82:0/1462062767 >> v1:172.21.15.82:6789/0 conn(0x7f6bf406f710 legacy=0x7f6bf406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf37fe640 1 -- 172.21.15.82:0/1462062767 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf415b510 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.841+0000 7f6bf8c07640 1 --2- 172.21.15.82:0/1462062767 >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 0x7f6bf415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1462062767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf415e750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097c0 tx=0x7f6be801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f45b3846502e24aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/1462062767 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80ad660 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/1462062767 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be80ad7c0 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bf2ffd640 1 -- 172.21.15.82:0/1462062767 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be80adb50 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1462062767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 msgr2=0x7f6bf415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1462062767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf415e750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6be80097c0 tx=0x7f6be801c450 comp rx=0 tx=0).stop 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1462062767 shutdown_connections 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1462062767 >> v2:172.21.15.183:3300/0 conn(0x7f6bf415ec90 0x7f6bf415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1462062767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf415e750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1462062767 >> 172.21.15.82:0/1462062767 conn(0x7f6bf40cad50 msgr2=0x7f6bf40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1462062767 shutdown_connections 2023-07-20T09:51:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1462062767 wait complete. 2023-07-20T09:51:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 Processor -- start 2023-07-20T09:51:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.845+0000 7f6bfa66a640 1 -- start start 2023-07-20T09:51:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 0x7f6bf40c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4159d50 con 0x7f6bf406f710 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40b2a70 con 0x7f6bf415ec90 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40b2d50 con 0x7f6bf40ca5a0 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50120/0 (socket says 172.21.15.82:50120) 2023-07-20T09:51:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 -- 172.21.15.82:0/1180949123 learned_addr learned my addr 172.21.15.82:0/1180949123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf8c07640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 0x7f6bf40c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 -- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 msgr2=0x7f6bf40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 -- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 msgr2=0x7f6bf40c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 0x7f6bf40c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 -- 172.21.15.82:0/1180949123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009a70 con 0x7f6bf406f710 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf8c07640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 0x7f6bf40c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf3fff640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c420 tx=0x7f6be400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4005cf0 con 0x7f6bf406f710 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4005e50 con 0x7f6bf406f710 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be8009420 con 0x7f6bf406f710 2023-07-20T09:51:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40072d0 con 0x7f6bf406f710 2023-07-20T09:51:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf40b3310 con 0x7f6bf406f710 2023-07-20T09:51:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf404da30 con 0x7f6bf406f710 2023-07-20T09:51:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.849+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f6be4007430 con 0x7f6bf406f710 2023-07-20T09:51:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.853+0000 7f6bf0ff9640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 0x7f6be00685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.853+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6be4082fd0 con 0x7f6bf406f710 2023-07-20T09:51:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.853+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 0x7f6be00685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.853+0000 7f6bf37fe640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 0x7f6be00685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6be80af000 tx=0x7f6be8008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:36.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:36.857+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6be4050720 con 0x7f6bf406f710 2023-07-20T09:51:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.021+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bf40cb940 con 0x7f6be0066120 2023-07-20T09:51:37.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bf0ff9640 1 -- 172.21.15.82:0/1180949123 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6bf40cb940 con 0x7f6be0066120 2023-07-20T09:51:37.118 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir1 2023-07-20T09:51:37.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 msgr2=0x7f6be00685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 0x7f6be00685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6be80af000 tx=0x7f6be8008040 comp rx=0 tx=0).stop 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 msgr2=0x7f6bf4159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c420 tx=0x7f6be400c8e0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 shutdown_connections 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f6be0066120 0x7f6be00685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bf415ec90 0x7f6bf40c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bf40ca5a0 0x7f6bf40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 --2- 172.21.15.82:0/1180949123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bf406f710 0x7f6bf4159810 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 >> 172.21.15.82:0/1180949123 conn(0x7f6bf40cad50 msgr2=0x7f6bf415bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 shutdown_connections 2023-07-20T09:51:37.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.081+0000 7f6bfa66a640 1 -- 172.21.15.82:0/1180949123 wait complete. 2023-07-20T09:51:37.138 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-07-20T09:51:37.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:37.139 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-07-20T09:51:37.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-07-20T09:51:37.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 Processor -- start 2023-07-20T09:51:37.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 -- start start 2023-07-20T09:51:37.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd901602b0 0x7fcd90160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900ce4f0 con 0x7fcd9006c120 2023-07-20T09:51:37.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900d0970 con 0x7fcd9006ab10 2023-07-20T09:51:37.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd961ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd90160e20 con 0x7fcd901602b0 2023-07-20T09:51:37.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcd9006c120 0x7fcd900cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48940/0 (socket says 172.21.15.82:48940) 2023-07-20T09:51:37.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8f7fe640 1 -- 172.21.15.82:0/4085179528 learned_addr learned my addr 172.21.15.82:0/4085179528 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:37.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210158076 0 0) 0x7fcd900ce4f0 con 0x7fcd9006c120 2023-07-20T09:51:37.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7c003530 con 0x7fcd9006c120 2023-07-20T09:51:37.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/4085179528 >> v2:172.21.15.183:3300/0 conn(0x7fcd901602b0 0x7fcd90160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557185882 0 0) 0x7fcd7c003530 con 0x7fcd9006c120 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 >> v2:172.21.15.183:3300/0 conn(0x7fcd901602b0 msgr2=0x7fcd90160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 --2- 172.21.15.82:0/4085179528 >> v2:172.21.15.183:3300/0 conn(0x7fcd901602b0 0x7fcd90160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 >> v1:172.21.15.183:6789/0 conn(0x7fcd9006ab10 legacy=0x7fcd9006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900cd300 con 0x7fcd9006c120 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.301+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fcd80001680 con 0x7fcd9006c120 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 >> v1:172.21.15.82:6789/0 conn(0x7fcd9006c120 legacy=0x7fcd900cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c003a40 0x7fcd7c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0047d0 0x7fcd7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd7c00b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90160e20 con 0x7fcd7c005390 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c00c2d0 con 0x7fcd7c003a40 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c00c490 con 0x7fcd7c0047d0 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8f7fe640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c003a40 0x7fcd7c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd7c00b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0047d0 0x7fcd7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 -- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0047d0 msgr2=0x7fcd7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd7c0047d0 0x7fcd7c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 -- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c003a40 msgr2=0x7fcd7c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c003a40 0x7fcd7c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 -- 172.21.15.82:0/4085179528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c003530 con 0x7fcd7c005390 2023-07-20T09:51:37.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8f7fe640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7c003a40 0x7fcd7c003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:37.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 -- 172.21.15.82:0/4085179528 reap_dead start 2023-07-20T09:51:37.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd7c00b9f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd88001780 tx=0x7fcd8801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6135ba3a980836d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd880052d0 con 0x7fcd7c005390 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd880a7050 con 0x7fcd7c005390 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.305+0000 7fcd8effd640 1 -- 172.21.15.82:0/4085179528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd88003840 con 0x7fcd7c005390 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 msgr2=0x7fcd7c00b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd7c00b9f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd88001780 tx=0x7fcd8801c3d0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- 172.21.15.82:0/4085179528 shutdown_connections 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 --2- 172.21.15.82:0/4085179528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd7c00b9f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- 172.21.15.82:0/4085179528 >> 172.21.15.82:0/4085179528 conn(0x7fcd9008c0a0 msgr2=0x7fcd9009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:37.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- 172.21.15.82:0/4085179528 shutdown_connections 2023-07-20T09:51:37.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- 172.21.15.82:0/4085179528 wait complete. 2023-07-20T09:51:37.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 Processor -- start 2023-07-20T09:51:37.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- start start 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 0x7fcd90153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 0x7fcd90153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90154210 con 0x7fcd7c005390 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900c65e0 con 0x7fcd900b7a50 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd961ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd900b0b80 con 0x7fcd900b75d0 2023-07-20T09:51:37.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50140/0 (socket says 172.21.15.82:50140) 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.309+0000 7fcd8f7fe640 1 -- 172.21.15.82:0/2983517526 learned_addr learned my addr 172.21.15.82:0/2983517526 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 0x7fcd90153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 0x7fcd90153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 -- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 msgr2=0x7fcd90153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 0x7fcd90153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 -- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 msgr2=0x7fcd90153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 0x7fcd90153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 -- 172.21.15.82:0/2983517526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900b0600 con 0x7fcd7c005390 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 0x7fcd90153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8ffff640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 0x7fcd90153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8f7fe640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001210 tx=0x7fcd80007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000f9c0 con 0x7fcd7c005390 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8000fb20 con 0x7fcd7c005390 2023-07-20T09:51:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd900c62b0 con 0x7fcd7c005390 2023-07-20T09:51:37.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000feb0 con 0x7fcd7c005390 2023-07-20T09:51:37.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd900c8e90 con 0x7fcd7c005390 2023-07-20T09:51:37.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9004da30 con 0x7fcd7c005390 2023-07-20T09:51:37.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fcd8001d460 con 0x7fcd7c005390 2023-07-20T09:51:37.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 0x7fcd700685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fcd80083cf0 con 0x7fcd7c005390 2023-07-20T09:51:37.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.313+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 0x7fcd700685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.317+0000 7fcd86ffd640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 0x7fcd700685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd901f8780 tx=0x7fcd78009760 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.317+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd80051300 con 0x7fcd7c005390 2023-07-20T09:51:37.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.485+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd90161100 con 0x7fcd70066120 2023-07-20T09:51:37.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.533+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 9) v1 ==== 85778+0+0 (secure 0 0 0) 0x7fcd800516d0 con 0x7fcd7c005390 2023-07-20T09:51:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.545+0000 7fcd8cff9640 1 -- 172.21.15.82:0/2983517526 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fcd78009d20 con 0x7fcd70066120 2023-07-20T09:51:37.584 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir2 2023-07-20T09:51:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 msgr2=0x7fcd700685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 0x7fcd700685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcd901f8780 tx=0x7fcd78009760 comp rx=0 tx=0).stop 2023-07-20T09:51:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 msgr2=0x7fcd900c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcd80001210 tx=0x7fcd80007720 comp rx=0 tx=0).stop 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 shutdown_connections 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fcd70066120 0x7fcd700685e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd900b7a50 0x7fcd90153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd900b75d0 0x7fcd90153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 --2- 172.21.15.82:0/2983517526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7c005390 0x7fcd900c8950 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 >> 172.21.15.82:0/2983517526 conn(0x7fcd9008c0a0 msgr2=0x7fcd900b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:37.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 shutdown_connections 2023-07-20T09:51:37.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.549+0000 7fcd961ba640 1 -- 172.21.15.82:0/2983517526 wait complete. 2023-07-20T09:51:37.607 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-07-20T09:51:37.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:37.608 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-07-20T09:51:37.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-07-20T09:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.769+0000 7fd92bb37640 1 Processor -- start 2023-07-20T09:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92bb37640 1 -- start start 2023-07-20T09:51:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92bb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd92415a6f0 0x7fd92415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92bb37640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd924071950 con 0x7fd92406f710 2023-07-20T09:51:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92bb37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92415b230 con 0x7fd9240ca5a0 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92bb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92415bad0 con 0x7fd92415a6f0 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd92406f710 0x7fd92406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48942/0 (socket says 172.21.15.82:48942) 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 -- 172.21.15.82:0/858013982 learned_addr learned my addr 172.21.15.82:0/858013982 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92a0d4640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd92415a6f0 0x7fd92415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301082304 0 0) 0x7fd924071950 con 0x7fd92406f710 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd910003530 con 0x7fd92406f710 2023-07-20T09:51:37.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309799472 0 0) 0x7fd92415b230 con 0x7fd9240ca5a0 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd924071950 con 0x7fd9240ca5a0 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757108555 0 0) 0x7fd910003530 con 0x7fd92406f710 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd92415a6f0 msgr2=0x7fd92415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd92415a6f0 0x7fd92415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 >> v1:172.21.15.183:6789/0 conn(0x7fd9240ca5a0 legacy=0x7fd92415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92415b510 con 0x7fd92406f710 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd920001680 con 0x7fd92406f710 2023-07-20T09:51:37.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 >> v1:172.21.15.82:6789/0 conn(0x7fd92406f710 legacy=0x7fd92406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd910003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9100047d0 0x7fd910004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd910005190 0x7fd91000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92415bad0 con 0x7fd910005190 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91000c060 con 0x7fd9100047d0 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91000c220 con 0x7fd910003bb0 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92a0d4640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd92415a6f0 0x7fd92415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd910003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd92a0d4640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd910005190 0x7fd91000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9290d2640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9100047d0 0x7fd910004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 -- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9100047d0 msgr2=0x7fd910004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9100047d0 0x7fd910004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 -- 172.21.15.82:0/858013982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd910005190 msgr2=0x7fd91000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd910005190 0x7fd91000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.773+0000 7fd9298d3640 1 -- 172.21.15.82:0/858013982 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910003530 con 0x7fd910003bb0 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd9298d3640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd910003fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd920007fb0 tx=0x7fd92001f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6849c7ebe6a4067 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200a8e90 con 0x7fd910003bb0 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9200058e0 con 0x7fd910003bb0 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd9288d1640 1 -- 172.21.15.82:0/858013982 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920005d10 con 0x7fd910003bb0 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 -- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 msgr2=0x7fd910003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 --2- 172.21.15.82:0/858013982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd910003fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd920007fb0 tx=0x7fd92001f270 comp rx=0 tx=0).stop 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92a0d4640 1 -- 172.21.15.82:0/858013982 reap_dead start 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 -- 172.21.15.82:0/858013982 shutdown_connections 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 -- 172.21.15.82:0/858013982 >> 172.21.15.82:0/858013982 conn(0x7fd9240cad50 msgr2=0x7fd9240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 -- 172.21.15.82:0/858013982 shutdown_connections 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.777+0000 7fd92bb37640 1 -- 172.21.15.82:0/858013982 wait complete. 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 Processor -- start 2023-07-20T09:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- start start 2023-07-20T09:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd9241f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9240af0d0 0x7fd9241558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924155e30 con 0x7fd9240aec50 2023-07-20T09:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9241f3090 con 0x7fd9240af0d0 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240c81c0 con 0x7fd910003bb0 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50166/0 (socket says 172.21.15.82:50166) 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 -- 172.21.15.82:0/2110705013 learned_addr learned my addr 172.21.15.82:0/2110705013 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9298d3640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd9241f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92a0d4640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9240af0d0 0x7fd9241558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 -- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 msgr2=0x7fd9241f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd9241f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 -- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9240af0d0 msgr2=0x7fd9241558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9240af0d0 0x7fd9241558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 -- 172.21.15.82:0/2110705013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240b2200 con 0x7fd9240aec50 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd9290d2640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd91400f7d0 tx=0x7fd91400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914005320 con 0x7fd9240aec50 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd914005480 con 0x7fd9240aec50 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914006a20 con 0x7fd9240aec50 2023-07-20T09:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9240b24e0 con 0x7fd9240aec50 2023-07-20T09:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9240b2aa0 con 0x7fd9240aec50 2023-07-20T09:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.781+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92404da30 con 0x7fd9240aec50 2023-07-20T09:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.785+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 85778+0+0 (secure 0 0 0) 0x7fd914006b80 con 0x7fd9240aec50 2023-07-20T09:51:37.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.785+0000 7fd91a7fc640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 0x7fd9080688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:37.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.785+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd914083780 con 0x7fd9240aec50 2023-07-20T09:51:37.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.785+0000 7fd9298d3640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 0x7fd9080688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:37.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.785+0000 7fd9298d3640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 0x7fd9080688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd920007f80 tx=0x7fd9200aa070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.789+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd914050970 con 0x7fd9240aec50 2023-07-20T09:51:37.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:37.953+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd92415e230 con 0x7fd9080663f0 2023-07-20T09:51:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.013+0000 7fd91a7fc640 1 -- 172.21.15.82:0/2110705013 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd9200b8040 con 0x7fd9080663f0 2023-07-20T09:51:38.052 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir3 2023-07-20T09:51:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 msgr2=0x7fd9080688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 0x7fd9080688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd920007f80 tx=0x7fd9200aa070 comp rx=0 tx=0).stop 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 msgr2=0x7fd9241553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd91400f7d0 tx=0x7fd91400fc90 comp rx=0 tx=0).stop 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 shutdown_connections 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd9080663f0 0x7fd9080688b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9240af0d0 0x7fd9241558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9240aec50 0x7fd9241553b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 --2- 172.21.15.82:0/2110705013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd910003bb0 0x7fd9241f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 >> 172.21.15.82:0/2110705013 conn(0x7fd9240cad50 msgr2=0x7fd9240ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 shutdown_connections 2023-07-20T09:51:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.017+0000 7fd92bb37640 1 -- 172.21.15.82:0/2110705013 wait complete. 2023-07-20T09:51:38.072 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-07-20T09:51:38.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:38.074 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-07-20T09:51:38.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-07-20T09:51:38.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 Processor -- start 2023-07-20T09:51:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 -- start start 2023-07-20T09:51:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb4200cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4200d0970 con 0x7fb4201602b0 2023-07-20T09:51:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb420160e20 con 0x7fb42006b220 2023-07-20T09:51:38.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb425511640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200cd300 con 0x7fb42006c120 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb4167fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb4201602b0 0x7fb42006ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48946/0 (socket says 172.21.15.82:48946) 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb4167fc640 1 -- 172.21.15.82:0/520991759 learned_addr learned my addr 172.21.15.82:0/520991759 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41effd640 1 --2- 172.21.15.82:0/520991759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb4200cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538040203 0 0) 0x7fb4200d0970 con 0x7fb4201602b0 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb40c003530 con 0x7fb4201602b0 2023-07-20T09:51:38.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836552154 0 0) 0x7fb420160e20 con 0x7fb42006b220 2023-07-20T09:51:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4200d0970 con 0x7fb42006b220 2023-07-20T09:51:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41effd640 1 -- 172.21.15.82:0/520991759 >> v1:172.21.15.183:6789/0 conn(0x7fb42006b220 legacy=0x7fb4200d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3546060109 0 0) 0x7fb40c003530 con 0x7fb4201602b0 2023-07-20T09:51:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41effd640 1 -- 172.21.15.82:0/520991759 >> v1:172.21.15.82:6789/0 conn(0x7fb4201602b0 legacy=0x7fb42006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.233+0000 7fb41effd640 1 -- 172.21.15.82:0/520991759 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4200cd5e0 con 0x7fb42006c120 2023-07-20T09:51:38.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb41effd640 1 --2- 172.21.15.82:0/520991759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb4200cdde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4100097f0 tx=0x7fb41001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627aa0c537b8f534 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408001a00 con 0x7fb42006c120 2023-07-20T09:51:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100a7050 con 0x7fb42006c120 2023-07-20T09:51:38.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb41e7fc640 1 -- 172.21.15.82:0/520991759 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100ab620 con 0x7fb42006c120 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 -- 172.21.15.82:0/520991759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 msgr2=0x7fb4200cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 --2- 172.21.15.82:0/520991759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb4200cdde0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb4100097f0 tx=0x7fb41001c320 comp rx=0 tx=0).stop 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 -- 172.21.15.82:0/520991759 shutdown_connections 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 --2- 172.21.15.82:0/520991759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb4200cdde0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 -- 172.21.15.82:0/520991759 >> 172.21.15.82:0/520991759 conn(0x7fb42008c0a0 msgr2=0x7fb42009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:38.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 -- 172.21.15.82:0/520991759 shutdown_connections 2023-07-20T09:51:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.237+0000 7fb425511640 1 -- 172.21.15.82:0/520991759 wait complete. 2023-07-20T09:51:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 Processor -- start 2023-07-20T09:51:38.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 -- start start 2023-07-20T09:51:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb420152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4201602b0 0x7fb420152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420152020 con 0x7fb42006b220 2023-07-20T09:51:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4201513a0 con 0x7fb4201602b0 2023-07-20T09:51:38.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb420151680 con 0x7fb42006c120 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50180/0 (socket says 172.21.15.82:50180) 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 -- 172.21.15.82:0/2881230698 learned_addr learned my addr 172.21.15.82:0/2881230698 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb4167fc640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb420152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41f7fe640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4201602b0 0x7fb420152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 -- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 msgr2=0x7fb420152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb420152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 -- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4201602b0 msgr2=0x7fb420152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4201602b0 0x7fb420152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 -- 172.21.15.82:0/2881230698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009420 con 0x7fb42006b220 2023-07-20T09:51:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb41effd640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb4100ae040 tx=0x7fb41001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100abcd0 con 0x7fb42006b220 2023-07-20T09:51:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100abe50 con 0x7fb42006b220 2023-07-20T09:51:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410004260 con 0x7fb42006b220 2023-07-20T09:51:38.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.241+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420151960 con 0x7fb42006b220 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4200b0300 con 0x7fb42006b220 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb420152290 con 0x7fb42006b220 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 85778+0+0 (secure 0 0 0) 0x7fb4100043c0 con 0x7fb42006b220 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb417fff640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 0x7fb4000688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fb41011e200 con 0x7fb42006b220 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb4167fc640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 0x7fb4000688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.245+0000 7fb4167fc640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 0x7fb4000688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4200d23e0 tx=0x7fb408009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.249+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4100eb390 con 0x7fb42006b220 2023-07-20T09:51:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.413+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb420160b20 con 0x7fb4000663f0 2023-07-20T09:51:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.485+0000 7fb417fff640 1 -- 172.21.15.82:0/2881230698 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fb408001ef0 con 0x7fb4000663f0 2023-07-20T09:51:38.524 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir4 2023-07-20T09:51:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 msgr2=0x7fb4000688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 0x7fb4000688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4200d23e0 tx=0x7fb408009040 comp rx=0 tx=0).stop 2023-07-20T09:51:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 msgr2=0x7fb4200afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb4100ae040 tx=0x7fb41001ab60 comp rx=0 tx=0).stop 2023-07-20T09:51:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 shutdown_connections 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb4000663f0 0x7fb4000688b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4201602b0 0x7fb420152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb42006c120 0x7fb420152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 --2- 172.21.15.82:0/2881230698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb42006b220 0x7fb4200afdc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 >> 172.21.15.82:0/2881230698 conn(0x7fb42008c0a0 msgr2=0x7fb420072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 shutdown_connections 2023-07-20T09:51:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.489+0000 7fb425511640 1 -- 172.21.15.82:0/2881230698 wait complete. 2023-07-20T09:51:38.544 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-07-20T09:51:38.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:38.545 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-07-20T09:51:38.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-07-20T09:51:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 Processor -- start 2023-07-20T09:51:38.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 -- start start 2023-07-20T09:51:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 0x7f9aa80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9aa806b720 0x7f9aa806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa815a880 con 0x7f9aa8071530 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa806c0f0 con 0x7f9aa806b720 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9aad5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8071990 con 0x7f9aa815a4a0 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9a9ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9aa8071530 0x7f9aa80b0eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48960/0 (socket says 172.21.15.82:48960) 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.713+0000 7f9a9ffff640 1 -- 172.21.15.82:0/635964499 learned_addr learned my addr 172.21.15.82:0/635964499 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:38.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa6ffd640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 0x7f9aa80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 --2- 172.21.15.82:0/635964499 >> v2:172.21.15.183:3300/0 conn(0x7f9aa806b720 0x7f9aa806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa67fc640 1 -- 172.21.15.82:0/635964499 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233909844 0 0) 0x7f9aa815a880 con 0x7f9aa8071530 2023-07-20T09:51:38.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa67fc640 1 -- 172.21.15.82:0/635964499 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94003530 con 0x7f9aa8071530 2023-07-20T09:51:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 -- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 msgr2=0x7f9aa80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 0x7f9aa80cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 -- 172.21.15.82:0/635964499 >> v1:172.21.15.82:6789/0 conn(0x7f9aa8071530 legacy=0x7f9aa80b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 -- 172.21.15.82:0/635964499 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80cce80 con 0x7f9aa806b720 2023-07-20T09:51:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa6ffd640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 0x7f9aa80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa77fe640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa806b720 0x7f9aa806bbb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009dc0 tx=0x7f9aa001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd4a053ad852ac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa67fc640 1 -- 172.21.15.82:0/635964499 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00a5930 con 0x7f9aa806b720 2023-07-20T09:51:38.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa67fc640 1 -- 172.21.15.82:0/635964499 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00a5a90 con 0x7f9aa806b720 2023-07-20T09:51:38.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.717+0000 7f9aa67fc640 1 -- 172.21.15.82:0/635964499 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00a5e20 con 0x7f9aa806b720 2023-07-20T09:51:38.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa806b720 msgr2=0x7f9aa806bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa806b720 0x7f9aa806bbb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009dc0 tx=0x7f9aa001c870 comp rx=0 tx=0).stop 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- 172.21.15.82:0/635964499 shutdown_connections 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa806b720 0x7f9aa806bbb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/635964499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa815a4a0 0x7f9aa80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- 172.21.15.82:0/635964499 >> 172.21.15.82:0/635964499 conn(0x7f9aa80ce080 msgr2=0x7f9aa80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- 172.21.15.82:0/635964499 shutdown_connections 2023-07-20T09:51:38.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- 172.21.15.82:0/635964499 wait complete. 2023-07-20T09:51:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 Processor -- start 2023-07-20T09:51:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- start start 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa8071530 0x7f9aa8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa815a4a0 0x7f9aa8154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa814d810 con 0x7f9aa806b720 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c43c0 con 0x7f9aa815a4a0 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aad5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa80c3b20 con 0x7f9aa8071530 2023-07-20T09:51:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50188/0 (socket says 172.21.15.82:50188) 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 -- 172.21.15.82:0/1321657360 learned_addr learned my addr 172.21.15.82:0/1321657360 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9a9ffff640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa8071530 0x7f9aa8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa77fe640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa815a4a0 0x7f9aa8154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 -- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa8071530 msgr2=0x7f9aa8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa8071530 0x7f9aa8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 -- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa815a4a0 msgr2=0x7f9aa8154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa815a4a0 0x7f9aa8154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:38.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.721+0000 7f9aa6ffd640 1 -- 172.21.15.82:0/1321657360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009420 con 0x7f9aa806b720 2023-07-20T09:51:38.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9aa6ffd640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e980 tx=0x7f9a9800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800ca00 con 0x7f9aa806b720 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800cb60 con 0x7f9aa806b720 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0009a70 con 0x7f9aa806b720 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98013470 con 0x7f9aa806b720 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80c40e0 con 0x7f9aa806b720 2023-07-20T09:51:38.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa804da30 con 0x7f9aa806b720 2023-07-20T09:51:38.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 85778+0+0 (secure 0 0 0) 0x7f9a980135d0 con 0x7f9aa806b720 2023-07-20T09:51:38.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 0x7f9a880688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:38.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f9a98084240 con 0x7f9aa806b720 2023-07-20T09:51:38.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.725+0000 7f9a9ffff640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 0x7f9a880688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:38.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.729+0000 7f9a9ffff640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 0x7f9a880688b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9aa815ce30 tx=0x7f9a90009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:38.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.729+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a98051540 con 0x7f9aa806b720 2023-07-20T09:51:38.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.901+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa80ccb10 con 0x7f9a880663f0 2023-07-20T09:51:38.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9a9f7fe640 1 -- 172.21.15.82:0/1321657360 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9a90001cf0 con 0x7f9a880663f0 2023-07-20T09:51:38.999 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir5 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 msgr2=0x7f9a880688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 0x7f9a880688b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9aa815ce30 tx=0x7f9a90009040 comp rx=0 tx=0).stop 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 msgr2=0x7f9aa814d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800e980 tx=0x7f9a9800ee40 comp rx=0 tx=0).stop 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 shutdown_connections 2023-07-20T09:51:39.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9a880663f0 0x7f9a880688b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aa815a4a0 0x7f9aa8154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aa8071530 0x7f9aa8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 --2- 172.21.15.82:0/1321657360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aa806b720 0x7f9aa814d2d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.961+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 >> 172.21.15.82:0/1321657360 conn(0x7f9aa80ce080 msgr2=0x7f9aa8155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.965+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 shutdown_connections 2023-07-20T09:51:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:38.965+0000 7f9aad5ba640 1 -- 172.21.15.82:0/1321657360 wait complete. 2023-07-20T09:51:39.019 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-07-20T09:51:39.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:39.020 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-07-20T09:51:39.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-07-20T09:51:39.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 Processor -- start 2023-07-20T09:51:39.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 -- start start 2023-07-20T09:51:39.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cd006f710 0x7f7cd006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7cd015a6f0 0x7f7cd015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd0070030 con 0x7f7cd00ca5a0 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd015bad0 con 0x7f7cd006f710 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cd5234640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd0071950 con 0x7f7cd015a6f0 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cced9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cd006f710 0x7f7cd006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cced9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7cd006f710 0x7f7cd006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50190/0 (socket says 172.21.15.82:50190) 2023-07-20T09:51:39.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.177+0000 7f7cced9d640 1 -- 172.21.15.82:0/2417093672 learned_addr learned my addr 172.21.15.82:0/2417093672 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:39.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7ccf59e640 1 --2- 172.21.15.82:0/2417093672 >> v2:172.21.15.183:3300/0 conn(0x7f7cd015a6f0 0x7f7cd015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cced9d640 1 -- 172.21.15.82:0/2417093672 >> v2:172.21.15.183:3300/0 conn(0x7f7cd015a6f0 msgr2=0x7f7cd015ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:39.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2417093672 >> v2:172.21.15.183:3300/0 conn(0x7f7cd015a6f0 0x7f7cd015ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cced9d640 1 -- 172.21.15.82:0/2417093672 >> v1:172.21.15.183:6789/0 conn(0x7f7cd00ca5a0 legacy=0x7f7cd015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:39.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cced9d640 1 -- 172.21.15.82:0/2417093672 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd015b230 con 0x7f7cd006f710 2023-07-20T09:51:39.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2417093672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd006f710 0x7f7cd006faf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cd015dfd0 tx=0x7f7cc001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a801dc1d8c44b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cce59c640 1 -- 172.21.15.82:0/2417093672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00a5780 con 0x7f7cd006f710 2023-07-20T09:51:39.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cce59c640 1 -- 172.21.15.82:0/2417093672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a58e0 con 0x7f7cd006f710 2023-07-20T09:51:39.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cce59c640 1 -- 172.21.15.82:0/2417093672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00a5c70 con 0x7f7cd006f710 2023-07-20T09:51:39.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cd5234640 1 -- 172.21.15.82:0/2417093672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd006f710 msgr2=0x7f7cd006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.181+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2417093672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd006f710 0x7f7cd006faf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7cd015dfd0 tx=0x7f7cc001c9d0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- 172.21.15.82:0/2417093672 shutdown_connections 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2417093672 >> v2:172.21.15.183:3300/0 conn(0x7f7cd015a6f0 0x7f7cd015ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2417093672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd006f710 0x7f7cd006faf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- 172.21.15.82:0/2417093672 >> 172.21.15.82:0/2417093672 conn(0x7f7cd00cad50 msgr2=0x7f7cd00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- 172.21.15.82:0/2417093672 shutdown_connections 2023-07-20T09:51:39.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- 172.21.15.82:0/2417093672 wait complete. 2023-07-20T09:51:39.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 Processor -- start 2023-07-20T09:51:39.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- start start 2023-07-20T09:51:39.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 0x7f7cd01491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cd00ca5a0 0x7f7cd014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b23c0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b1bf0 con 0x7f7cd00ca5a0 2023-07-20T09:51:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cd5234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b1e00 con 0x7f7cd006f710 2023-07-20T09:51:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50200/0 (socket says 172.21.15.82:50200) 2023-07-20T09:51:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 -- 172.21.15.82:0/2150216236 learned_addr learned my addr 172.21.15.82:0/2150216236 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:39.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cc659c640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cd00ca5a0 0x7f7cd014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 0x7f7cd01491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 -- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 msgr2=0x7f7cd01491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 0x7f7cd01491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 -- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cd00ca5a0 msgr2=0x7f7cd014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.185+0000 7f7ccf59e640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cd00ca5a0 0x7f7cd014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7ccf59e640 1 -- 172.21.15.82:0/2150216236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0009b30 con 0x7f7cd015a6f0 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 0x7f7cd01491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7ccf59e640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800d800 tx=0x7f7cc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800b6c0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800b820 con 0x7f7cd015a6f0 2023-07-20T09:51:39.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd00b20e0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800bbd0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd00c6870 con 0x7f7cd015a6f0 2023-07-20T09:51:39.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd00c63f0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) v1 ==== 85778+0+0 (secure 0 0 0) 0x7f7cc800bd30 con 0x7f7cd015a6f0 2023-07-20T09:51:39.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 0x7f7cb00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f7cc8084430 con 0x7f7cd015a6f0 2023-07-20T09:51:39.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.189+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 0x7f7cb00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.193+0000 7f7cced9d640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 0x7f7cb00688e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ae000 tx=0x7f7cc00a7070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.193+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7cd00c63f0 con 0x7f7cd015a6f0 2023-07-20T09:51:39.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.361+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cd015e230 con 0x7f7cb0066420 2023-07-20T09:51:39.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cc7fff640 1 -- 172.21.15.82:0/2150216236 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7cc00bc0d0 con 0x7f7cb0066420 2023-07-20T09:51:39.461 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir6 2023-07-20T09:51:39.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 msgr2=0x7f7cb00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 0x7f7cb00688e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00ae000 tx=0x7f7cc00a7070 comp rx=0 tx=0).stop 2023-07-20T09:51:39.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 msgr2=0x7f7cd00b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800d800 tx=0x7f7cc800dcc0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 shutdown_connections 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f7cb0066420 0x7f7cb00688e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cd015a6f0 0x7f7cd00b16b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cd00ca5a0 0x7f7cd014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 --2- 172.21.15.82:0/2150216236 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7cd006f710 0x7f7cd01491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 >> 172.21.15.82:0/2150216236 conn(0x7f7cd00cad50 msgr2=0x7f7cd015e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:39.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 shutdown_connections 2023-07-20T09:51:39.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.425+0000 7f7cd5234640 1 -- 172.21.15.82:0/2150216236 wait complete. 2023-07-20T09:51:39.481 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-07-20T09:51:39.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:39.482 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-07-20T09:51:39.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-07-20T09:51:39.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 Processor -- start 2023-07-20T09:51:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 -- start start 2023-07-20T09:51:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff6ec15c6e0 0x7ff6ec0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec0cdb40 con 0x7ff6ec15cac0 2023-07-20T09:51:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ec0d07a0 con 0x7ff6ec0d3200 2023-07-20T09:51:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6f1034640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ec0cd4f0 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6eb59e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff6ec15cac0 0x7ff6ec0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48962/0 (socket says 172.21.15.82:48962) 2023-07-20T09:51:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6eb59e640 1 -- 172.21.15.82:0/1695016251 learned_addr learned my addr 172.21.15.82:0/1695016251 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ead9d640 1 --2- 172.21.15.82:0/1695016251 >> v2:172.21.15.183:3300/0 conn(0x7ff6ec15c6e0 0x7ff6ec0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004592868 0 0) 0x7ff6ec0cdb40 con 0x7ff6ec15cac0 2023-07-20T09:51:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6d8003530 con 0x7ff6ec15cac0 2023-07-20T09:51:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580021329 0 0) 0x7ff6ec0d07a0 con 0x7ff6ec0d3200 2023-07-20T09:51:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ec0cdb40 con 0x7ff6ec0d3200 2023-07-20T09:51:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ead9d640 1 -- 172.21.15.82:0/1695016251 >> v1:172.21.15.183:6789/0 conn(0x7ff6ec0d3200 legacy=0x7ff6ec0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ead9d640 1 -- 172.21.15.82:0/1695016251 >> v1:172.21.15.82:6789/0 conn(0x7ff6ec15cac0 legacy=0x7ff6ec0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.649+0000 7ff6ead9d640 1 -- 172.21.15.82:0/1695016251 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec0cd7d0 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6ead9d640 1 --2- 172.21.15.82:0/1695016251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15c6e0 0x7ff6ec0cf640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009d90 tx=0x7ff6dc01c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a9d30f761a4394 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0a57c0 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0a5920 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6ea59c640 1 -- 172.21.15.82:0/1695016251 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0a5cb0 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 -- 172.21.15.82:0/1695016251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15c6e0 msgr2=0x7ff6ec0cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 --2- 172.21.15.82:0/1695016251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15c6e0 0x7ff6ec0cf640 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc009d90 tx=0x7ff6dc01c7f0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 -- 172.21.15.82:0/1695016251 shutdown_connections 2023-07-20T09:51:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 --2- 172.21.15.82:0/1695016251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15c6e0 0x7ff6ec0cf640 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 -- 172.21.15.82:0/1695016251 >> 172.21.15.82:0/1695016251 conn(0x7ff6ec0d2600 msgr2=0x7ff6ec0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 -- 172.21.15.82:0/1695016251 shutdown_connections 2023-07-20T09:51:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.653+0000 7ff6f1034640 1 -- 172.21.15.82:0/1695016251 wait complete. 2023-07-20T09:51:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 Processor -- start 2023-07-20T09:51:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 -- start start 2023-07-20T09:51:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6ec15c6e0 0x7ff6ec15e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec15f960 con 0x7ff6ec0d3200 2023-07-20T09:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec15f150 con 0x7ff6ec15cac0 2023-07-20T09:51:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec0c8ee0 con 0x7ff6ec15c6e0 2023-07-20T09:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6eb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6eb59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:52632/0 (socket says 172.21.15.82:52632) 2023-07-20T09:51:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50204/0 (socket says 172.21.15.82:50204) 2023-07-20T09:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6eb59e640 1 -- 172.21.15.82:0/2423633903 learned_addr learned my addr 172.21.15.82:0/2423633903 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6e259c640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6ec15c6e0 0x7ff6ec15e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 -- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6ec15c6e0 msgr2=0x7ff6ec15e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6ec15c6e0 0x7ff6ec15e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 -- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 msgr2=0x7ff6ec0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 -- 172.21.15.82:0/2423633903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc009a70 con 0x7ff6ec0d3200 2023-07-20T09:51:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6eb59e640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6ead9d640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0ce740 tx=0x7ff6dc019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0b9650 con 0x7ff6ec0d3200 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0b97b0 con 0x7ff6ec0d3200 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec15f3a0 con 0x7ff6ec0d3200 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.657+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0b9b20 con 0x7ff6ec0d3200 2023-07-20T09:51:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec0c6cc0 con 0x7ff6ec0d3200 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ec0c6b20 con 0x7ff6ec0d3200 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ff6dc0b9c80 con 0x7ff6ec0d3200 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6e3fff640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 0x7ff6cc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7ff6dc11e870 con 0x7ff6ec0d3200 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6e259c640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 0x7ff6cc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.661+0000 7ff6e259c640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 0x7ff6cc068940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b82b0 tx=0x7ff6d4009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.665+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6ec0c6b20 con 0x7ff6ec0d3200 2023-07-20T09:51:39.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.833+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6ec06b000 con 0x7ff6cc066480 2023-07-20T09:51:39.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.897+0000 7ff6e3fff640 1 -- 172.21.15.82:0/2423633903 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff6d400f820 con 0x7ff6cc066480 2023-07-20T09:51:39.936 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir7 2023-07-20T09:51:39.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 msgr2=0x7ff6cc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 0x7ff6cc068940 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0b82b0 tx=0x7ff6d4009040 comp rx=0 tx=0).stop 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 msgr2=0x7ff6ec0c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0ce740 tx=0x7ff6dc019590 comp rx=0 tx=0).stop 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 shutdown_connections 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6cc066480 0x7ff6cc068940 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6ec15cac0 0x7ff6ec0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6ec15c6e0 0x7ff6ec15e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 --2- 172.21.15.82:0/2423633903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6ec0d3200 0x7ff6ec0c96d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 >> 172.21.15.82:0/2423633903 conn(0x7ff6ec0d2600 msgr2=0x7ff6ec0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 shutdown_connections 2023-07-20T09:51:39.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:39.901+0000 7ff6f1034640 1 -- 172.21.15.82:0/2423633903 wait complete. 2023-07-20T09:51:39.957 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-07-20T09:51:39.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:39.958 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-07-20T09:51:39.968 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-07-20T09:51:40.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.117+0000 7ff6e8137640 1 Processor -- start 2023-07-20T09:51:40.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.117+0000 7ff6e8137640 1 -- start start 2023-07-20T09:51:40.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e8137640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff6e00ca5a0 0x7ff6e015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e8137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e0071950 con 0x7ff6e015ec90 2023-07-20T09:51:40.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e8137640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e015b230 con 0x7ff6e006f710 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e8137640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e015bad0 con 0x7ff6e00ca5a0 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e66d4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff6e015ec90 0x7ff6e015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48976/0 (socket says 172.21.15.82:48976) 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e66d4640 1 -- 172.21.15.82:0/3554500909 learned_addr learned my addr 172.21.15.82:0/3554500909 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/3554500909 >> v2:172.21.15.183:3300/0 conn(0x7ff6e00ca5a0 0x7ff6e015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469001172 0 0) 0x7ff6e0071950 con 0x7ff6e015ec90 2023-07-20T09:51:40.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc003530 con 0x7ff6e015ec90 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250495174 0 0) 0x7ff6cc003530 con 0x7ff6e015ec90 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 >> v2:172.21.15.183:3300/0 conn(0x7ff6e00ca5a0 msgr2=0x7ff6e015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 --2- 172.21.15.82:0/3554500909 >> v2:172.21.15.183:3300/0 conn(0x7ff6e00ca5a0 0x7ff6e015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 >> v1:172.21.15.183:6789/0 conn(0x7ff6e006f710 legacy=0x7ff6e006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e015b510 con 0x7ff6e015ec90 2023-07-20T09:51:40.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7ff6d8001a00 con 0x7ff6e015ec90 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/3554500909 >> v2:172.21.15.183:3300/0 conn(0x7ff6e00ca5a0 0x7ff6e015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 >> v1:172.21.15.82:6789/0 conn(0x7ff6e015ec90 legacy=0x7ff6e015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 0x7ff6cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc0047d0 0x7ff6cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6cc005190 0x7ff6cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e015bad0 con 0x7ff6cc003a20 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc00c030 con 0x7ff6cc005190 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc00c1f0 con 0x7ff6cc0047d0 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 0x7ff6cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e66d4640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6cc005190 0x7ff6cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc0047d0 0x7ff6cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 -- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc0047d0 msgr2=0x7ff6cc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:40.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc0047d0 0x7ff6cc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 -- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6cc005190 msgr2=0x7ff6cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6cc005190 0x7ff6cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e5ed3640 1 -- 172.21.15.82:0/3554500909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc003530 con 0x7ff6cc003a20 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e66d4640 1 -- 172.21.15.82:0/3554500909 reap_dead start 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.121+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc0047d0 0x7ff6cc004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 0x7ff6cc003e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001860 tx=0x7ff6dc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0fae6bf6cc7f5d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0ab600 con 0x7ff6cc003a20 2023-07-20T09:51:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0a7050 con 0x7ff6cc003a20 2023-07-20T09:51:40.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e4ed1640 1 -- 172.21.15.82:0/3554500909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0ab9e0 con 0x7ff6cc003a20 2023-07-20T09:51:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 -- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 msgr2=0x7ff6cc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 0x7ff6cc003e00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001860 tx=0x7ff6dc01c4b0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 -- 172.21.15.82:0/3554500909 shutdown_connections 2023-07-20T09:51:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 --2- 172.21.15.82:0/3554500909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6cc003a20 0x7ff6cc003e00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 -- 172.21.15.82:0/3554500909 >> 172.21.15.82:0/3554500909 conn(0x7ff6e00cad50 msgr2=0x7ff6e00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 -- 172.21.15.82:0/3554500909 shutdown_connections 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 -- 172.21.15.82:0/3554500909 wait complete. 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.125+0000 7ff6e8137640 1 Processor -- start 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- start start 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc003a20 0x7ff6e00c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6e01f0300 0x7ff6e00ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00c30a0 con 0x7ff6e014bf60 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e014c3c0 con 0x7ff6e01f0300 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00c2490 con 0x7ff6cc003a20 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50214/0 (socket says 172.21.15.82:50214) 2023-07-20T09:51:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 -- 172.21.15.82:0/587911136 learned_addr learned my addr 172.21.15.82:0/587911136 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc003a20 0x7ff6e00c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e66d4640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6e01f0300 0x7ff6e00ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 -- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc003a20 msgr2=0x7ff6e00c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc003a20 0x7ff6e00c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 -- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6e01f0300 msgr2=0x7ff6e00ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6e01f0300 0x7ff6e00ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 -- 172.21.15.82:0/587911136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00c2770 con 0x7ff6e014bf60 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e56d2640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0011800 tx=0x7ff6d0011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000f9c0 con 0x7ff6e014bf60 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000fb20 con 0x7ff6e014bf60 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000fe90 con 0x7ff6e014bf60 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e00c2a50 con 0x7ff6e014bf60 2023-07-20T09:51:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e01f0780 con 0x7ff6e014bf60 2023-07-20T09:51:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.129+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e00c3210 con 0x7ff6e014bf60 2023-07-20T09:51:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.133+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ff6d0015460 con 0x7ff6e014bf60 2023-07-20T09:51:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.133+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 0x7ff6c4068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.133+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7ff6d00845e0 con 0x7ff6e014bf60 2023-07-20T09:51:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.133+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 0x7ff6c4068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.133+0000 7ff6e5ed3640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 0x7ff6c4068940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0ad000 tx=0x7ff6dc0a6000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.137+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6d0051660 con 0x7ff6e014bf60 2023-07-20T09:51:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.301+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e015af00 con 0x7ff6c4066480 2023-07-20T09:51:40.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6d67fc640 1 -- 172.21.15.82:0/587911136 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff6dc006ae0 con 0x7ff6c4066480 2023-07-20T09:51:40.398 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir8 2023-07-20T09:51:40.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 msgr2=0x7ff6c4068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 0x7ff6c4068940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0ad000 tx=0x7ff6dc0a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 msgr2=0x7ff6e01f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0011800 tx=0x7ff6d0011c00 comp rx=0 tx=0).stop 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 shutdown_connections 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff6c4066480 0x7ff6c4068940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6e01f0300 0x7ff6e00ae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6e014bf60 0x7ff6e01f4aa0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 --2- 172.21.15.82:0/587911136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6cc003a20 0x7ff6e00c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 >> 172.21.15.82:0/587911136 conn(0x7ff6e00cad50 msgr2=0x7ff6e00af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:40.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 shutdown_connections 2023-07-20T09:51:40.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.361+0000 7ff6e8137640 1 -- 172.21.15.82:0/587911136 wait complete. 2023-07-20T09:51:40.419 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-07-20T09:51:40.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T09:51:40.419 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-07-20T09:51:40.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-07-20T09:51:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 Processor -- start 2023-07-20T09:51:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 -- start start 2023-07-20T09:51:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff94070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940c95d0 con 0x7eff94158ce0 2023-07-20T09:51:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff941590c0 con 0x7eff94070970 2023-07-20T09:51:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff98dba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c89c0 con 0x7eff9406bd30 2023-07-20T09:51:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff9259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7eff94158ce0 0x7eff940c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48986/0 (socket says 172.21.15.82:48986) 2023-07-20T09:51:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff9259c640 1 -- 172.21.15.82:0/1837970933 learned_addr learned my addr 172.21.15.82:0/1837970933 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff92d9d640 1 --2- 172.21.15.82:0/1837970933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff94070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318230372 0 0) 0x7eff940c95d0 con 0x7eff94158ce0 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff80003530 con 0x7eff94158ce0 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489200869 0 0) 0x7eff941590c0 con 0x7eff94070970 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff940c95d0 con 0x7eff94070970 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff92d9d640 1 -- 172.21.15.82:0/1837970933 >> v1:172.21.15.183:6789/0 conn(0x7eff94070970 legacy=0x7eff9406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631549972 0 0) 0x7eff80003530 con 0x7eff94158ce0 2023-07-20T09:51:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff92d9d640 1 -- 172.21.15.82:0/1837970933 >> v1:172.21.15.82:6789/0 conn(0x7eff94158ce0 legacy=0x7eff940c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.585+0000 7eff92d9d640 1 -- 172.21.15.82:0/1837970933 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940c8ca0 con 0x7eff9406bd30 2023-07-20T09:51:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff92d9d640 1 --2- 172.21.15.82:0/1837970933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff94070e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00aed0 tx=0x7eff8c01d9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2beca47dca947521 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84001680 con 0x7eff9406bd30 2023-07-20T09:51:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00a0d0 con 0x7eff9406bd30 2023-07-20T09:51:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff91d9b640 1 -- 172.21.15.82:0/1837970933 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0a6640 con 0x7eff9406bd30 2023-07-20T09:51:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 -- 172.21.15.82:0/1837970933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 msgr2=0x7eff94070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 --2- 172.21.15.82:0/1837970933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff94070e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00aed0 tx=0x7eff8c01d9b0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 -- 172.21.15.82:0/1837970933 shutdown_connections 2023-07-20T09:51:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 --2- 172.21.15.82:0/1837970933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff94070e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 -- 172.21.15.82:0/1837970933 >> 172.21.15.82:0/1837970933 conn(0x7eff940cad50 msgr2=0x7eff940cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 -- 172.21.15.82:0/1837970933 shutdown_connections 2023-07-20T09:51:40.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.589+0000 7eff98dba640 1 -- 172.21.15.82:0/1837970933 wait complete. 2023-07-20T09:51:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 Processor -- start 2023-07-20T09:51:40.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- start start 2023-07-20T09:51:40.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff9414ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff94070970 0x7eff941556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940c3410 con 0x7eff94158ce0 2023-07-20T09:51:40.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff940b1ae0 con 0x7eff94070970 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940b1dc0 con 0x7eff9406bd30 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50230/0 (socket says 172.21.15.82:50230) 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 -- 172.21.15.82:0/3608826948 learned_addr learned my addr 172.21.15.82:0/3608826948 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff9259c640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff9414ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff89d9b640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff94070970 0x7eff941556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 -- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 msgr2=0x7eff9414ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff9414ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 -- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff94070970 msgr2=0x7eff941556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff94070970 0x7eff941556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 -- 172.21.15.82:0/3608826948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c00ab80 con 0x7eff94158ce0 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff9259c640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff9414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff92d9d640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7eff8c01c060 tx=0x7eff8c01a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00a560 con 0x7eff94158ce0 2023-07-20T09:51:40.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c0b7480 con 0x7eff94158ce0 2023-07-20T09:51:40.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0b7810 con 0x7eff94158ce0 2023-07-20T09:51:40.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940c30a0 con 0x7eff94158ce0 2023-07-20T09:51:40.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9414b3d0 con 0x7eff94158ce0 2023-07-20T09:51:40.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.593+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff940c3580 con 0x7eff94158ce0 2023-07-20T09:51:40.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.597+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7eff8c0b7970 con 0x7eff94158ce0 2023-07-20T09:51:40.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.597+0000 7eff8b7fe640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 0x7eff74068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:40.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.597+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7eff8c11f110 con 0x7eff94158ce0 2023-07-20T09:51:40.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.597+0000 7eff9259c640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 0x7eff74068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:40.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.597+0000 7eff9259c640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 0x7eff74068940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff84001ec0 tx=0x7eff840016c0 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:40.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.601+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff8c0ec410 con 0x7eff94158ce0 2023-07-20T09:51:40.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.769+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7eff940719b0 con 0x7eff74066480 2023-07-20T09:51:40.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff8b7fe640 1 -- 172.21.15.82:0/3608826948 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7eff8400fd50 con 0x7eff74066480 2023-07-20T09:51:40.862 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/dir9 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 msgr2=0x7eff74068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 0x7eff74068940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff84001ec0 tx=0x7eff840016c0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 msgr2=0x7eff94155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7eff8c01c060 tx=0x7eff8c01a750 comp rx=0 tx=0).stop 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 shutdown_connections 2023-07-20T09:51:40.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7eff74066480 0x7eff74068940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff94158ce0 0x7eff94155be0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff94070970 0x7eff941556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 --2- 172.21.15.82:0/3608826948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7eff9406bd30 0x7eff9414ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 >> 172.21.15.82:0/3608826948 conn(0x7eff940cad50 msgr2=0x7eff940ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 shutdown_connections 2023-07-20T09:51:40.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.825+0000 7eff98dba640 1 -- 172.21.15.82:0/3608826948 wait complete. 2023-07-20T09:51:40.882 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-07-20T09:51:40.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-20T09:51:41.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 Processor -- start 2023-07-20T09:51:41.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 -- start start 2023-07-20T09:51:41.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f00dc06f710 0x7f00dc06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc070030 con 0x7f00dc15ec90 2023-07-20T09:51:41.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc15bad0 con 0x7f00dc06f710 2023-07-20T09:51:41.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e2711640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc071950 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00db7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e0cae640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f00dc15ec90 0x7f00dc15a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:55838/0 (socket says 172.21.15.82:55838) 2023-07-20T09:51:41.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00e0cae640 1 -- 172.21.15.82:0/2533020139 learned_addr learned my addr 172.21.15.82:0/2533020139 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:41.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.989+0000 7f00dbfff640 1 --2- 172.21.15.82:0/2533020139 >> v2:172.21.15.183:3300/0 conn(0x7f00dc06f710 0x7f00dc06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00db7fe640 1 -- 172.21.15.82:0/2533020139 >> v2:172.21.15.183:3300/0 conn(0x7f00dc06f710 msgr2=0x7f00dc06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00db7fe640 1 --2- 172.21.15.82:0/2533020139 >> v2:172.21.15.183:3300/0 conn(0x7f00dc06f710 0x7f00dc06faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00db7fe640 1 -- 172.21.15.82:0/2533020139 >> v1:172.21.15.183:6789/0 conn(0x7f00dc15ec90 legacy=0x7f00dc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00db7fe640 1 -- 172.21.15.82:0/2533020139 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc15b230 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00db7fe640 1 --2- 172.21.15.82:0/2533020139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc15e750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00d00097c0 tx=0x7f00d001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d9ce4e07893a30 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00daffd640 1 -- 172.21.15.82:0/2533020139 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00ad660 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00daffd640 1 -- 172.21.15.82:0/2533020139 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d00ad7c0 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00daffd640 1 -- 172.21.15.82:0/2533020139 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00adb50 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 -- 172.21.15.82:0/2533020139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 msgr2=0x7f00dc15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 --2- 172.21.15.82:0/2533020139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc15e750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f00d00097c0 tx=0x7f00d001c450 comp rx=0 tx=0).stop 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 -- 172.21.15.82:0/2533020139 shutdown_connections 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 --2- 172.21.15.82:0/2533020139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc15e750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 --2- 172.21.15.82:0/2533020139 >> v2:172.21.15.183:3300/0 conn(0x7f00dc06f710 0x7f00dc06faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.993+0000 7f00e2711640 1 -- 172.21.15.82:0/2533020139 >> 172.21.15.82:0/2533020139 conn(0x7f00dc0cad50 msgr2=0x7f00dc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- 172.21.15.82:0/2533020139 shutdown_connections 2023-07-20T09:51:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- 172.21.15.82:0/2533020139 wait complete. 2023-07-20T09:51:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 Processor -- start 2023-07-20T09:51:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- start start 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00dc15ec90 0x7f00dc152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc157f30 con 0x7f00dc06f710 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1599e0 con 0x7f00dc15ec90 2023-07-20T09:51:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e2711640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1578b0 con 0x7f00dc0ca5a0 2023-07-20T09:51:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50234/0 (socket says 172.21.15.82:50234) 2023-07-20T09:51:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 -- 172.21.15.82:0/3601605689 learned_addr learned my addr 172.21.15.82:0/3601605689 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00db7fe640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00e0cae640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00dc15ec90 0x7f00dc152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 -- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 msgr2=0x7f00dc158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 -- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00dc15ec90 msgr2=0x7f00dc152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00dc15ec90 0x7f00dc152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:40.997+0000 7f00dbfff640 1 -- 172.21.15.82:0/3601605689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0009420 con 0x7f00dc06f710 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00dbfff640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e930 tx=0x7f00cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc009690 con 0x7f00dc06f710 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc00ca00 con 0x7f00dc06f710 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc159700 con 0x7f00dc06f710 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc00cd70 con 0x7f00dc06f710 2023-07-20T09:51:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc153a40 con 0x7f00dc06f710 2023-07-20T09:51:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc1581a0 con 0x7f00dc06f710 2023-07-20T09:51:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f00cc013470 con 0x7f00dc06f710 2023-07-20T09:51:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 0x7f00c8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f00cc0842e0 con 0x7f00dc06f710 2023-07-20T09:51:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.001+0000 7f00db7fe640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 0x7f00c8068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.005+0000 7f00db7fe640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 0x7f00c8068940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00d00af000 tx=0x7f00d0008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.005+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00cc051610 con 0x7f00dc06f710 2023-07-20T09:51:41.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.173+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00dc15e230 con 0x7f00c8066480 2023-07-20T09:51:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.213+0000 7f00d8ff9640 1 -- 172.21.15.82:0/3601605689 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f00d00be0d0 con 0x7f00c8066480 2023-07-20T09:51:41.253 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-07-20T09:51:41.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 msgr2=0x7f00c8068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 0x7f00c8068940 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00d00af000 tx=0x7f00d0008040 comp rx=0 tx=0).stop 2023-07-20T09:51:41.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 msgr2=0x7f00dc0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00e930 tx=0x7f00cc00edf0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 shutdown_connections 2023-07-20T09:51:41.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f00c8066480 0x7f00c8068940 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00dc15ec90 0x7f00dc152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00dc0ca5a0 0x7f00dc158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 --2- 172.21.15.82:0/3601605689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00dc06f710 0x7f00dc0cc0e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 >> 172.21.15.82:0/3601605689 conn(0x7f00dc0cad50 msgr2=0x7f00dc15a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:41.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 shutdown_connections 2023-07-20T09:51:41.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.217+0000 7f00e2711640 1 -- 172.21.15.82:0/3601605689 wait complete. 2023-07-20T09:51:41.272 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-07-20T09:51:41.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-20T09:51:41.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 Processor -- start 2023-07-20T09:51:41.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 -- start start 2023-07-20T09:51:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 0x7fb71c0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0c9370 con 0x7fb71c0b0460 2023-07-20T09:51:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c161300 con 0x7fb71c0c8e60 2023-07-20T09:51:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb7239f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c9650 con 0x7fb71c160ba0 2023-07-20T09:51:41.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb721f90640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb71c0b0460 0x7fb71c0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48992/0 (socket says 172.21.15.82:48992) 2023-07-20T09:51:41.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb721f90640 1 -- 172.21.15.82:0/3509419000 learned_addr learned my addr 172.21.15.82:0/3509419000 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb72178f640 1 --2- 172.21.15.82:0/3509419000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 0x7fb71c0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246092177 0 0) 0x7fb71c0c9370 con 0x7fb71c0b0460 2023-07-20T09:51:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb708003530 con 0x7fb71c0b0460 2023-07-20T09:51:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347903744 0 0) 0x7fb71c161300 con 0x7fb71c0c8e60 2023-07-20T09:51:41.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb72178f640 1 -- 172.21.15.82:0/3509419000 >> v1:172.21.15.183:6789/0 conn(0x7fb71c0c8e60 legacy=0x7fb71c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb72178f640 1 -- 172.21.15.82:0/3509419000 >> v1:172.21.15.82:6789/0 conn(0x7fb71c0b0460 legacy=0x7fb71c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.381+0000 7fb72178f640 1 -- 172.21.15.82:0/3509419000 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c1615e0 con 0x7fb71c160ba0 2023-07-20T09:51:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb72178f640 1 --2- 172.21.15.82:0/3509419000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 0x7fb71c0c8920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7180097f0 tx=0x7fb71801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d700fdd5a855b90 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb714001a00 con 0x7fb71c160ba0 2023-07-20T09:51:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180a7050 con 0x7fb71c160ba0 2023-07-20T09:51:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb713fff640 1 -- 172.21.15.82:0/3509419000 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7180ab620 con 0x7fb71c160ba0 2023-07-20T09:51:41.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 -- 172.21.15.82:0/3509419000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 msgr2=0x7fb71c0c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3509419000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 0x7fb71c0c8920 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7180097f0 tx=0x7fb71801c300 comp rx=0 tx=0).stop 2023-07-20T09:51:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 -- 172.21.15.82:0/3509419000 shutdown_connections 2023-07-20T09:51:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3509419000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c160ba0 0x7fb71c0c8920 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 -- 172.21.15.82:0/3509419000 >> 172.21.15.82:0/3509419000 conn(0x7fb71c0cad50 msgr2=0x7fb71c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:41.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 -- 172.21.15.82:0/3509419000 shutdown_connections 2023-07-20T09:51:41.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.385+0000 7fb7239f3640 1 -- 172.21.15.82:0/3509419000 wait complete. 2023-07-20T09:51:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 Processor -- start 2023-07-20T09:51:41.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- start start 2023-07-20T09:51:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c0b0460 0x7fb71c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c160ba0 0x7fb71c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1619c0 con 0x7fb71c0c8e60 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c5e20 con 0x7fb71c160ba0 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0b1d50 con 0x7fb71c0b0460 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50248/0 (socket says 172.21.15.82:50248) 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 -- 172.21.15.82:0/3556916030 learned_addr learned my addr 172.21.15.82:0/3556916030 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb72178f640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c0b0460 0x7fb71c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb721f90640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c160ba0 0x7fb71c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 -- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c0b0460 msgr2=0x7fb71c0c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c0b0460 0x7fb71c0c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 -- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c160ba0 msgr2=0x7fb71c0b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c160ba0 0x7fb71c0b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 -- 172.21.15.82:0/3556916030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009420 con 0x7fb71c0c8e60 2023-07-20T09:51:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb720f8e640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c520 tx=0x7fb70c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c003600 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c003780 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c0c8360 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c003b30 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.389+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c0b11d0 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c0c5fb0 con 0x7fb71c0c8e60 2023-07-20T09:51:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fb70c003c90 con 0x7fb71c0c8e60 2023-07-20T09:51:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb711ffb640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 0x7fb700068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fb70c0835f0 con 0x7fb71c0c8e60 2023-07-20T09:51:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb72178f640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 0x7fb700068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.393+0000 7fb72178f640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 0x7fb700068970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ad000 tx=0x7fb7180a6000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.397+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb71c0c5fb0 con 0x7fb71c0c8e60 2023-07-20T09:51:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.569+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb71c0c5fb0 con 0x7fb7000664b0 2023-07-20T09:51:41.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.613+0000 7fb711ffb640 1 -- 172.21.15.82:0/3556916030 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb71c0c5fb0 con 0x7fb7000664b0 2023-07-20T09:51:41.652 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-07-20T09:51:41.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 msgr2=0x7fb700068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 0x7fb700068970 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7180ad000 tx=0x7fb7180a6000 comp rx=0 tx=0).stop 2023-07-20T09:51:41.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 msgr2=0x7fb71c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c520 tx=0x7fb70c00c9e0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 shutdown_connections 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb7000664b0 0x7fb700068970 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c160ba0 0x7fb71c0b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0c8e60 0x7fb71c0b3490 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 --2- 172.21.15.82:0/3556916030 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c0b0460 0x7fb71c0c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 >> 172.21.15.82:0/3556916030 conn(0x7fb71c0cad50 msgr2=0x7fb71c163a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:41.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 shutdown_connections 2023-07-20T09:51:41.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.617+0000 7fb7239f3640 1 -- 172.21.15.82:0/3556916030 wait complete. 2023-07-20T09:51:41.673 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-07-20T09:51:41.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-20T09:51:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.781+0000 7f9ede300640 1 Processor -- start 2023-07-20T09:51:41.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.781+0000 7f9ede300640 1 -- start start 2023-07-20T09:51:41.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ede300640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ed8159830 0x7f9ed80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ede300640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ed80cc3e0 0x7f9ed80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ede300640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80cc8d0 con 0x7f9ed8159450 2023-07-20T09:51:41.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ede300640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80cce90 con 0x7f9ed8159830 2023-07-20T09:51:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ede300640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80ccbb0 con 0x7f9ed80cc3e0 2023-07-20T09:51:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ed8159830 0x7f9ed80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ed8159830 0x7f9ed80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50250/0 (socket says 172.21.15.82:50250) 2023-07-20T09:51:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3958085420 learned_addr learned my addr 172.21.15.82:0/3958085420 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9edc89d640 1 --2- 172.21.15.82:0/3958085420 >> v2:172.21.15.183:3300/0 conn(0x7f9ed80cc3e0 0x7f9ed80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3958085420 >> v2:172.21.15.183:3300/0 conn(0x7f9ed80cc3e0 msgr2=0x7f9ed80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:41.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 --2- 172.21.15.82:0/3958085420 >> v2:172.21.15.183:3300/0 conn(0x7f9ed80cc3e0 0x7f9ed80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3958085420 >> v1:172.21.15.183:6789/0 conn(0x7f9ed8159450 legacy=0x7f9ed815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3958085420 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8159cc0 con 0x7f9ed8159830 2023-07-20T09:51:41.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.785+0000 7f9ed77fe640 1 --2- 172.21.15.82:0/3958085420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159830 0x7f9ed80cbea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80c1da0 tx=0x7f9ecc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c982a00c1b0af4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ed6ffd640 1 -- 172.21.15.82:0/3958085420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0ac640 con 0x7f9ed8159830 2023-07-20T09:51:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ed6ffd640 1 -- 172.21.15.82:0/3958085420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0ac7a0 con 0x7f9ed8159830 2023-07-20T09:51:41.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ed6ffd640 1 -- 172.21.15.82:0/3958085420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0acb30 con 0x7f9ed8159830 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- 172.21.15.82:0/3958085420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159830 msgr2=0x7f9ed80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- 172.21.15.82:0/3958085420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159830 0x7f9ed80cbea0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80c1da0 tx=0x7f9ecc01c4d0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- 172.21.15.82:0/3958085420 shutdown_connections 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- 172.21.15.82:0/3958085420 >> v2:172.21.15.183:3300/0 conn(0x7f9ed80cc3e0 0x7f9ed80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- 172.21.15.82:0/3958085420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159830 0x7f9ed80cbea0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- 172.21.15.82:0/3958085420 >> 172.21.15.82:0/3958085420 conn(0x7f9ed80cad50 msgr2=0x7f9ed80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:41.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- 172.21.15.82:0/3958085420 shutdown_connections 2023-07-20T09:51:41.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- 172.21.15.82:0/3958085420 wait complete. 2023-07-20T09:51:41.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 Processor -- start 2023-07-20T09:51:41.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- start start 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ed80cc3e0 0x7f9ed80c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ed80aeb70 0x7f9ed80b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80c86b0 con 0x7f9ed8159450 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed80af000 con 0x7f9ed80cc3e0 2023-07-20T09:51:41.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ede300640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8146020 con 0x7f9ed80aeb70 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.789+0000 7f9ed77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50258/0 (socket says 172.21.15.82:50258) 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3839158421 learned_addr learned my addr 172.21.15.82:0/3839158421 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed7fff640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ed80cc3e0 0x7f9ed80c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9edc89d640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ed80aeb70 0x7f9ed80b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ed80aeb70 msgr2=0x7f9ed80b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ed80aeb70 0x7f9ed80b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ed80cc3e0 msgr2=0x7f9ed80c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:41.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ed80cc3e0 0x7f9ed80c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:41.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 -- 172.21.15.82:0/3839158421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0094d0 con 0x7f9ed8159450 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed77fe640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0190e0 tx=0x7f9ecc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b7650 con 0x7f9ed8159450 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0b77d0 con 0x7f9ed8159450 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed80c7a30 con 0x7f9ed8159450 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0b7b80 con 0x7f9ed8159450 2023-07-20T09:51:41.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed80c7ff0 con 0x7f9ed8159450 2023-07-20T09:51:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed804da30 con 0x7f9ed8159450 2023-07-20T09:51:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f9ecc0b3070 con 0x7f9ed8159450 2023-07-20T09:51:41.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.793+0000 7f9ed4ff9640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 0x7f9ec4068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.797+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f9ecc11e9b0 con 0x7f9ed8159450 2023-07-20T09:51:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.797+0000 7f9ed7fff640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 0x7f9ec4068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:41.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.797+0000 7f9ed7fff640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 0x7f9ec4068940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8007fd0 tx=0x7f9ec8009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:41.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.797+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ecc0ebb70 con 0x7f9ed8159450 2023-07-20T09:51:42.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:41.969+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ed80cbbf0 con 0x7f9ec4066480 2023-07-20T09:51:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.021+0000 7f9ed4ff9640 1 -- 172.21.15.82:0/3839158421 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9ed80cbbf0 con 0x7f9ec4066480 2023-07-20T09:51:42.061 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 msgr2=0x7f9ec4068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 0x7f9ec4068940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ec8007fd0 tx=0x7f9ec8009040 comp rx=0 tx=0).stop 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 msgr2=0x7f9ed80c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0190e0 tx=0x7f9ecc01ad10 comp rx=0 tx=0).stop 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 shutdown_connections 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ec4066480 0x7f9ec4068940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ed80aeb70 0x7f9ed80b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ed8159450 0x7f9ed80c1690 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 --2- 172.21.15.82:0/3839158421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ed80cc3e0 0x7f9ed80c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 >> 172.21.15.82:0/3839158421 conn(0x7f9ed80cad50 msgr2=0x7f9ed80af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 shutdown_connections 2023-07-20T09:51:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.025+0000 7f9ede300640 1 -- 172.21.15.82:0/3839158421 wait complete. 2023-07-20T09:51:42.081 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-07-20T09:51:42.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-20T09:51:42.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 Processor -- start 2023-07-20T09:51:42.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 -- start start 2023-07-20T09:51:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a70159450 0x7f8a7015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 0x7f8a700b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700b06b0 con 0x7f8a70159830 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700cce90 con 0x7f8a70159450 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a75796640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700cc8d0 con 0x7f8a700afd50 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a70159450 0x7f8a7015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a667fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8a70159830 0x7f8a700cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49000/0 (socket says 172.21.15.82:49000) 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a667fc640 1 -- 172.21.15.82:0/2626918121 learned_addr learned my addr 172.21.15.82:0/2626918121 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6f7fe640 1 --2- 172.21.15.82:0/2626918121 >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 0x7f8a700b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6effd640 1 -- 172.21.15.82:0/2626918121 >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 msgr2=0x7f8a700b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6effd640 1 --2- 172.21.15.82:0/2626918121 >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 0x7f8a700b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6effd640 1 -- 172.21.15.82:0/2626918121 >> v1:172.21.15.82:6789/0 conn(0x7f8a70159830 legacy=0x7f8a700cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6effd640 1 -- 172.21.15.82:0/2626918121 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700ccbb0 con 0x7f8a70159450 2023-07-20T09:51:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.189+0000 7f8a6f7fe640 1 --2- 172.21.15.82:0/2626918121 >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 0x7f8a700b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:42.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a6effd640 1 --2- 172.21.15.82:0/2626918121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a7015a4c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8a700c1da0 tx=0x7f8a6001eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6225066450fab1d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a6e7fc640 1 -- 172.21.15.82:0/2626918121 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000b2d0 con 0x7f8a70159450 2023-07-20T09:51:42.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a6e7fc640 1 -- 172.21.15.82:0/2626918121 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a600a79b0 con 0x7f8a70159450 2023-07-20T09:51:42.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a6e7fc640 1 -- 172.21.15.82:0/2626918121 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600a7d40 con 0x7f8a70159450 2023-07-20T09:51:42.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- 172.21.15.82:0/2626918121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 msgr2=0x7f8a7015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 --2- 172.21.15.82:0/2626918121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a7015a4c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8a700c1da0 tx=0x7f8a6001eae0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- 172.21.15.82:0/2626918121 shutdown_connections 2023-07-20T09:51:42.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 --2- 172.21.15.82:0/2626918121 >> v2:172.21.15.183:3300/0 conn(0x7f8a700afd50 0x7f8a700b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 --2- 172.21.15.82:0/2626918121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a7015a4c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- 172.21.15.82:0/2626918121 >> 172.21.15.82:0/2626918121 conn(0x7f8a700cad50 msgr2=0x7f8a700cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:42.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- 172.21.15.82:0/2626918121 shutdown_connections 2023-07-20T09:51:42.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- 172.21.15.82:0/2626918121 wait complete. 2023-07-20T09:51:42.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 Processor -- start 2023-07-20T09:51:42.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.193+0000 7f8a75796640 1 -- start start 2023-07-20T09:51:42.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700afd50 0x7f8a700c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a70158090 0x7f8a70148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70155bb0 con 0x7f8a70159450 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70157c00 con 0x7f8a70158090 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a700c4a10 con 0x7f8a700afd50 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50280/0 (socket says 172.21.15.82:50280) 2023-07-20T09:51:42.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 -- 172.21.15.82:0/3574581769 learned_addr learned my addr 172.21.15.82:0/3574581769 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:42.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a6f7fe640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a70158090 0x7f8a70148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a6effd640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700afd50 0x7f8a700c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 -- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700afd50 msgr2=0x7f8a700c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700afd50 0x7f8a700c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 -- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a70158090 msgr2=0x7f8a70148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a70158090 0x7f8a70148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 -- 172.21.15.82:0/3574581769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6000bc80 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a667fc640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c400 tx=0x7f8a5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a58005cf0 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58005e50 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a70148cb0 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a580072d0 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a701575b0 con 0x7f8a70159450 2023-07-20T09:51:42.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a70157db0 con 0x7f8a70159450 2023-07-20T09:51:42.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.197+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f8a58007430 con 0x7f8a70159450 2023-07-20T09:51:42.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.201+0000 7f8a67fff640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 0x7f8a50068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.201+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f8a58083510 con 0x7f8a70159450 2023-07-20T09:51:42.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.201+0000 7f8a6effd640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 0x7f8a50068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.201+0000 7f8a6effd640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 0x7f8a50068940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a600b0000 tx=0x7f8a600a9070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.205+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a70157db0 con 0x7f8a70159450 2023-07-20T09:51:42.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.369+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a700cc5b0 con 0x7f8a50066480 2023-07-20T09:51:42.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a67fff640 1 -- 172.21.15.82:0/3574581769 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8a600a7b20 con 0x7f8a50066480 2023-07-20T09:51:42.454 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-07-20T09:51:42.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 msgr2=0x7f8a50068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 0x7f8a50068940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a600b0000 tx=0x7f8a600a9070 comp rx=0 tx=0).stop 2023-07-20T09:51:42.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 msgr2=0x7f8a700c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800c400 tx=0x7f8a5800c8c0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 shutdown_connections 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8a50066480 0x7f8a50068940 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a70158090 0x7f8a70148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a70159450 0x7f8a700c4330 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 --2- 172.21.15.82:0/3574581769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a700afd50 0x7f8a700c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 >> 172.21.15.82:0/3574581769 conn(0x7f8a700cad50 msgr2=0x7f8a70071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 shutdown_connections 2023-07-20T09:51:42.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.417+0000 7f8a75796640 1 -- 172.21.15.82:0/3574581769 wait complete. 2023-07-20T09:51:42.475 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-07-20T09:51:42.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-20T09:51:42.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 Processor -- start 2023-07-20T09:51:42.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 -- start start 2023-07-20T09:51:42.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe11806f710 0x7fe11806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1180ca5a0 0x7fe11815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe11815ec90 0x7fe11815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11815bad0 con 0x7fe11815ec90 2023-07-20T09:51:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe118070030 con 0x7fe11806f710 2023-07-20T09:51:42.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.581+0000 7fe120133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe118071950 con 0x7fe1180ca5a0 2023-07-20T09:51:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe11815ec90 0x7fe11815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe11815ec90 0x7fe11815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50282/0 (socket says 172.21.15.82:50282) 2023-07-20T09:51:42.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 -- 172.21.15.82:0/3489917239 learned_addr learned my addr 172.21.15.82:0/3489917239 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11decf640 1 --2- 172.21.15.82:0/3489917239 >> v2:172.21.15.183:3300/0 conn(0x7fe11806f710 0x7fe11806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11d6ce640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1180ca5a0 0x7fe11815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 -- 172.21.15.82:0/3489917239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1180ca5a0 msgr2=0x7fe11815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1180ca5a0 0x7fe11815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 -- 172.21.15.82:0/3489917239 >> v2:172.21.15.183:3300/0 conn(0x7fe11806f710 msgr2=0x7fe11806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:42.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 --2- 172.21.15.82:0/3489917239 >> v2:172.21.15.183:3300/0 conn(0x7fe11806f710 0x7fe11806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 -- 172.21.15.82:0/3489917239 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11815b230 con 0x7fe11815ec90 2023-07-20T09:51:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11e6d0640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe11815ec90 0x7fe11815a6f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe1180ce230 tx=0x7fe11001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a3eccf79945f25 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11cecd640 1 -- 172.21.15.82:0/3489917239 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a5730 con 0x7fe11815ec90 2023-07-20T09:51:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11cecd640 1 -- 172.21.15.82:0/3489917239 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1100a5890 con 0x7fe11815ec90 2023-07-20T09:51:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.585+0000 7fe11cecd640 1 -- 172.21.15.82:0/3489917239 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1100a5c20 con 0x7fe11815ec90 2023-07-20T09:51:42.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- 172.21.15.82:0/3489917239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe11815ec90 msgr2=0x7fe11815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe11815ec90 0x7fe11815a6f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe1180ce230 tx=0x7fe11001c9a0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- 172.21.15.82:0/3489917239 shutdown_connections 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe11815ec90 0x7fe11815a6f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- 172.21.15.82:0/3489917239 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1180ca5a0 0x7fe11815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- 172.21.15.82:0/3489917239 >> v2:172.21.15.183:3300/0 conn(0x7fe11806f710 0x7fe11806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- 172.21.15.82:0/3489917239 >> 172.21.15.82:0/3489917239 conn(0x7fe1180cad50 msgr2=0x7fe1180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- 172.21.15.82:0/3489917239 shutdown_connections 2023-07-20T09:51:42.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- 172.21.15.82:0/3489917239 wait complete. 2023-07-20T09:51:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 Processor -- start 2023-07-20T09:51:42.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- start start 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe11815ec90 0x7fe1180cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1180b1200 con 0x7fe1180ca5a0 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1181565d0 con 0x7fe11815ec90 2023-07-20T09:51:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe120133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe118154490 con 0x7fe11806f710 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11d6ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11decf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11d6ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50286/0 (socket says 172.21.15.82:50286) 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11d6ce640 1 -- 172.21.15.82:0/3691332463 learned_addr learned my addr 172.21.15.82:0/3691332463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11decf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56138/0 (socket says 172.21.15.82:56138) 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.589+0000 7fe11e6d0640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe11815ec90 0x7fe1180cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 -- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe11815ec90 msgr2=0x7fe1180cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe11815ec90 0x7fe1180cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 -- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 msgr2=0x7fe1180b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 -- 172.21.15.82:0/3691332463 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe110009b30 con 0x7fe11806f710 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11d6ce640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:42.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11decf640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e7f0 tx=0x7fe11400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400c940 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11400caa0 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11400ce10 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe118154770 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe118154d30 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11804da30 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe114013470 con 0x7fe11806f710 2023-07-20T09:51:42.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 0x7fe0fc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:42.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe114084280 con 0x7fe11806f710 2023-07-20T09:51:42.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.593+0000 7fe11d6ce640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 0x7fe0fc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:42.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.597+0000 7fe11d6ce640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 0x7fe0fc068940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1180c9be0 tx=0x7fe108009190 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:42.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.601+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe114051460 con 0x7fe11806f710 2023-07-20T09:51:42.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.769+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe11815e230 con 0x7fe0fc066480 2023-07-20T09:51:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe10e7fc640 1 -- 172.21.15.82:0/3691332463 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe108009d40 con 0x7fe0fc066480 2023-07-20T09:51:42.858 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-07-20T09:51:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 msgr2=0x7fe0fc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 0x7fe0fc068940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1180c9be0 tx=0x7fe108009190 comp rx=0 tx=0).stop 2023-07-20T09:51:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 msgr2=0x7fe11814fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e7f0 tx=0x7fe11400ecb0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 shutdown_connections 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe0fc066480 0x7fe0fc068940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe11815ec90 0x7fe1180cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1180ca5a0 0x7fe1180b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 --2- 172.21.15.82:0/3691332463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe11806f710 0x7fe11814fcc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 >> 172.21.15.82:0/3691332463 conn(0x7fe1180cad50 msgr2=0x7fe1180cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 shutdown_connections 2023-07-20T09:51:42.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.821+0000 7fe120133640 1 -- 172.21.15.82:0/3691332463 wait complete. 2023-07-20T09:51:42.878 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-07-20T09:51:42.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-20T09:51:43.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.985+0000 7fb2fcfa2640 1 Processor -- start 2023-07-20T09:51:43.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.985+0000 7fb2fcfa2640 1 -- start start 2023-07-20T09:51:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2fcfa2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb2f8070450 0x7fb2f80c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2fcfa2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f8159670 con 0x7fb2f80c9da0 2023-07-20T09:51:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2fcfa2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f815d1f0 con 0x7fb2f8159290 2023-07-20T09:51:43.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2fcfa2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f80ca250 con 0x7fb2f8070450 2023-07-20T09:51:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2effff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb2f8070450 0x7fb2f80c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2f7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb2f80c9da0 0x7fb2f806ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49016/0 (socket says 172.21.15.82:49016) 2023-07-20T09:51:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2f7fff640 1 -- 172.21.15.82:0/3095718901 learned_addr learned my addr 172.21.15.82:0/3095718901 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2effff640 1 -- 172.21.15.82:0/3095718901 >> v1:172.21.15.183:6789/0 conn(0x7fb2f8159290 legacy=0x7fb2f80cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2effff640 1 -- 172.21.15.82:0/3095718901 >> v1:172.21.15.82:6789/0 conn(0x7fb2f80c9da0 legacy=0x7fb2f806ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2effff640 1 -- 172.21.15.82:0/3095718901 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f815d4d0 con 0x7fb2f8070450 2023-07-20T09:51:43.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.989+0000 7fb2effff640 1 --2- 172.21.15.82:0/3095718901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c9860 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00097c0 tx=0x7fb2e001e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0da786deac9dc65 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f6ffd640 1 -- 172.21.15.82:0/3095718901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00ad650 con 0x7fb2f8070450 2023-07-20T09:51:43.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f6ffd640 1 -- 172.21.15.82:0/3095718901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e00ad7b0 con 0x7fb2f8070450 2023-07-20T09:51:43.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f6ffd640 1 -- 172.21.15.82:0/3095718901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00adb40 con 0x7fb2f8070450 2023-07-20T09:51:43.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/3095718901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 msgr2=0x7fb2f80c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/3095718901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c9860 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00097c0 tx=0x7fb2e001e540 comp rx=0 tx=0).stop 2023-07-20T09:51:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/3095718901 shutdown_connections 2023-07-20T09:51:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/3095718901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c9860 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/3095718901 >> 172.21.15.82:0/3095718901 conn(0x7fb2f80ce080 msgr2=0x7fb2f80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:43.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/3095718901 shutdown_connections 2023-07-20T09:51:43.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/3095718901 wait complete. 2023-07-20T09:51:43.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 Processor -- start 2023-07-20T09:51:43.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- start start 2023-07-20T09:51:43.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2f80c9da0 0x7fb2f8159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2f8159290 0x7fb2f80ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f815a1f0 con 0x7fb2f8070450 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b15e0 con 0x7fb2f80c9da0 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2fcfa2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f80b17f0 con 0x7fb2f8159290 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50298/0 (socket says 172.21.15.82:50298) 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.993+0000 7fb2f77fe640 1 -- 172.21.15.82:0/2799675777 learned_addr learned my addr 172.21.15.82:0/2799675777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f7fff640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2f8159290 0x7fb2f80ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2effff640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2f80c9da0 0x7fb2f8159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 -- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2f8159290 msgr2=0x7fb2f80ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2f8159290 0x7fb2f80ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 -- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2f80c9da0 msgr2=0x7fb2f8159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2f80c9da0 0x7fb2f8159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 -- 172.21.15.82:0/2799675777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009420 con 0x7fb2f8070450 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f77fe640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c500 tx=0x7fb2e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8005220 con 0x7fb2f8070450 2023-07-20T09:51:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8005380 con 0x7fb2f8070450 2023-07-20T09:51:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8007270 con 0x7fb2f8070450 2023-07-20T09:51:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f80b1ad0 con 0x7fb2f8070450 2023-07-20T09:51:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f80b2090 con 0x7fb2f8070450 2023-07-20T09:51:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f80b2280 con 0x7fb2f8070450 2023-07-20T09:51:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fb2e80073d0 con 0x7fb2f8070450 2023-07-20T09:51:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 0x7fb2d8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:42.997+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fb2e80839c0 con 0x7fb2f8070450 2023-07-20T09:51:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.001+0000 7fb2effff640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 0x7fb2d8068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.001+0000 7fb2effff640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 0x7fb2d8068940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b1000 tx=0x7fb2e00a9000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.001+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2e8050b00 con 0x7fb2f8070450 2023-07-20T09:51:43.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.165+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2f8070890 con 0x7fb2d8066480 2023-07-20T09:51:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.213+0000 7fb2f4ff9640 1 -- 172.21.15.82:0/2799675777 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb2e00bb070 con 0x7fb2d8066480 2023-07-20T09:51:43.253 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-07-20T09:51:43.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 msgr2=0x7fb2d8068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 0x7fb2d8068940 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b1000 tx=0x7fb2e00a9000 comp rx=0 tx=0).stop 2023-07-20T09:51:43.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 msgr2=0x7fb2f80c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c500 tx=0x7fb2e800c9c0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 shutdown_connections 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb2d8066480 0x7fb2d8068940 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb2f8159290 0x7fb2f80ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2f80c9da0 0x7fb2f8159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 --2- 172.21.15.82:0/2799675777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2f8070450 0x7fb2f80c4360 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 >> 172.21.15.82:0/2799675777 conn(0x7fb2f80ce080 msgr2=0x7fb2f80ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:43.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 shutdown_connections 2023-07-20T09:51:43.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.217+0000 7fb2fcfa2640 1 -- 172.21.15.82:0/2799675777 wait complete. 2023-07-20T09:51:43.273 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-07-20T09:51:43.273 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-20T09:51:43.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 Processor -- start 2023-07-20T09:51:43.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 -- start start 2023-07-20T09:51:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8918159450 0x7f891815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180cc8d0 con 0x7f8918159830 2023-07-20T09:51:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89180ccbb0 con 0x7f89180afd50 2023-07-20T09:51:43.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f891db37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89180cce90 con 0x7f8918159450 2023-07-20T09:51:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f8916ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8918159830 0x7f89180cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:35862/0 (socket says 172.21.15.82:35862) 2023-07-20T09:51:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f8916ffd640 1 -- 172.21.15.82:0/3470774784 learned_addr learned my addr 172.21.15.82:0/3470774784 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T09:51:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8918159450 0x7f891815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224354798 0 0) 0x7f89180cc8d0 con 0x7f8918159830 2023-07-20T09:51:43.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8900003530 con 0x7f8918159830 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756125650 0 0) 0x7f89180ccbb0 con 0x7f89180afd50 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89180cc8d0 con 0x7f89180afd50 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715773571 0 0) 0x7f8900003530 con 0x7f8918159830 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8918159450 msgr2=0x7f891815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8918159450 0x7f891815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 >> v1:172.21.15.183:6789/0 conn(0x7f89180afd50 legacy=0x7f891815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918159cc0 con 0x7f8918159830 2023-07-20T09:51:43.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f890c001680 con 0x7f8918159830 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8918159450 0x7f891815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 >> v1:172.21.15.82:6789/0 conn(0x7f8918159830 legacy=0x7f89180cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900003bb0 0x7f8900003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000047d0 0x7f8900004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900005190 0x7f890000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89180cce90 con 0x7f8900003bb0 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890000c030 con 0x7f89000047d0 2023-07-20T09:51:43.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890000c1f0 con 0x7f8900005190 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900003bb0 0x7f8900003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f8917fff640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900005190 0x7f890000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f8916ffd640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000047d0 0x7f8900004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 -- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900005190 msgr2=0x7f890000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900005190 0x7f890000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 -- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000047d0 msgr2=0x7f8900004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000047d0 0x7f8900004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.381+0000 7f89177fe640 1 -- 172.21.15.82:0/3470774784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900003530 con 0x7f8900003bb0 2023-07-20T09:51:43.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f89177fe640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900003bb0 0x7f8900003fb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8918066c60 tx=0x7f890801f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb2934e3703968f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908004030 con 0x7f8900003bb0 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8908004190 con 0x7f8900003bb0 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f89167fc640 1 -- 172.21.15.82:0/3470774784 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908004500 con 0x7f8900003bb0 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 -- 172.21.15.82:0/3470774784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900003bb0 msgr2=0x7f8900003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 --2- 172.21.15.82:0/3470774784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8900003bb0 0x7f8900003fb0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8918066c60 tx=0x7f890801f650 comp rx=0 tx=0).stop 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f8917fff640 1 -- 172.21.15.82:0/3470774784 reap_dead start 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 -- 172.21.15.82:0/3470774784 shutdown_connections 2023-07-20T09:51:43.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 -- 172.21.15.82:0/3470774784 >> 172.21.15.82:0/3470774784 conn(0x7f89180cad50 msgr2=0x7f89180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:43.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 -- 172.21.15.82:0/3470774784 shutdown_connections 2023-07-20T09:51:43.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.385+0000 7f891db37640 1 -- 172.21.15.82:0/3470774784 wait complete. 2023-07-20T09:51:43.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 Processor -- start 2023-07-20T09:51:43.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- start start 2023-07-20T09:51:43.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900003bb0 0x7f89180c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89181f18c0 0x7f89181f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181f51f0 con 0x7f89181f4d70 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89180c3880 con 0x7f89181f18c0 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89181582e0 con 0x7f8900003bb0 2023-07-20T09:51:43.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58384/0 (socket says 172.21.15.82:58384) 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 -- 172.21.15.82:0/2952067682 learned_addr learned my addr 172.21.15.82:0/2952067682 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f89177fe640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900003bb0 0x7f89180c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8916ffd640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89181f18c0 0x7f89181f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 -- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900003bb0 msgr2=0x7f89180c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900003bb0 0x7f89180c2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 -- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89181f18c0 msgr2=0x7f89181f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89181f18c0 0x7f89181f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 -- 172.21.15.82:0/2952067682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89180b06f0 con 0x7f89181f4d70 2023-07-20T09:51:43.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f8917fff640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f891815e1c0 tx=0x7f891000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910003b90 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910003d10 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89180c32d0 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910005310 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.389+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89181f0de0 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89181f0c40 con 0x7f89181f4d70 2023-07-20T09:51:43.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f8910005470 con 0x7f89181f4d70 2023-07-20T09:51:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f88fffff640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 0x7f8904068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f89100841b0 con 0x7f89181f4d70 2023-07-20T09:51:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f89177fe640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 0x7f8904068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.393+0000 7f89177fe640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 0x7f8904068970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89080b0000 tx=0x7f8908004740 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.397+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89181f0c40 con 0x7f89181f4d70 2023-07-20T09:51:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.569+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89180b0570 con 0x7f89040664b0 2023-07-20T09:51:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.609+0000 7f88fffff640 1 -- 172.21.15.82:0/2952067682 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8908004400 con 0x7f89040664b0 2023-07-20T09:51:43.647 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-07-20T09:51:43.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 msgr2=0x7f8904068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 0x7f8904068970 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89080b0000 tx=0x7f8908004740 comp rx=0 tx=0).stop 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 msgr2=0x7f891815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f891815e1c0 tx=0x7f891000feb0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 shutdown_connections 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f89040664b0 0x7f8904068970 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89181f4d70 0x7f891815b230 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89181f18c0 0x7f89181f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 --2- 172.21.15.82:0/2952067682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8900003bb0 0x7f89180c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 >> 172.21.15.82:0/2952067682 conn(0x7f89180cad50 msgr2=0x7f89180ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 shutdown_connections 2023-07-20T09:51:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.613+0000 7f891db37640 1 -- 172.21.15.82:0/2952067682 wait complete. 2023-07-20T09:51:43.668 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-07-20T09:51:43.668 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-20T09:51:43.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 Processor -- start 2023-07-20T09:51:43.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 -- start start 2023-07-20T09:51:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40ae060 0x7f31b406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31b40c90c0 0x7f31b40c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b40ae440 con 0x7f31b4070ce0 2023-07-20T09:51:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b406ce50 con 0x7f31b40c90c0 2023-07-20T09:51:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b898f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b415cac0 con 0x7f31b40ae060 2023-07-20T09:51:43.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31b40c90c0 0x7f31b40c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31b40c90c0 0x7f31b40c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58392/0 (socket says 172.21.15.82:58392) 2023-07-20T09:51:43.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 -- 172.21.15.82:0/1415990495 learned_addr learned my addr 172.21.15.82:0/1415990495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:43.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b259c640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40ae060 0x7f31b406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 -- 172.21.15.82:0/1415990495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40ae060 msgr2=0x7f31b406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40ae060 0x7f31b406bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 -- 172.21.15.82:0/1415990495 >> v1:172.21.15.183:6789/0 conn(0x7f31b4070ce0 legacy=0x7f31b4160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.777+0000 7f31b2d9d640 1 -- 172.21.15.82:0/1415990495 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b406c5b0 con 0x7f31b40c90c0 2023-07-20T09:51:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b2d9d640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b40c90c0 0x7f31b40c9520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e50 tx=0x7f31ac01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bd35f3e351366d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b1d9b640 1 -- 172.21.15.82:0/1415990495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0a58a0 con 0x7f31b40c90c0 2023-07-20T09:51:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b1d9b640 1 -- 172.21.15.82:0/1415990495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac0a5a00 con 0x7f31b40c90c0 2023-07-20T09:51:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b1d9b640 1 -- 172.21.15.82:0/1415990495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0a5d90 con 0x7f31b40c90c0 2023-07-20T09:51:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 -- 172.21.15.82:0/1415990495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b40c90c0 msgr2=0x7f31b40c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b40c90c0 0x7f31b40c9520 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009e50 tx=0x7f31ac01c9e0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 -- 172.21.15.82:0/1415990495 shutdown_connections 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b40c90c0 0x7f31b40c9520 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 --2- 172.21.15.82:0/1415990495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40ae060 0x7f31b406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 -- 172.21.15.82:0/1415990495 >> 172.21.15.82:0/1415990495 conn(0x7f31b40cf070 msgr2=0x7f31b40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 -- 172.21.15.82:0/1415990495 shutdown_connections 2023-07-20T09:51:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.781+0000 7f31b898f640 1 -- 172.21.15.82:0/1415990495 wait complete. 2023-07-20T09:51:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 Processor -- start 2023-07-20T09:51:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- start start 2023-07-20T09:51:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31b40ae060 0x7f31b40c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40c90c0 0x7f31b40c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40ca620 con 0x7f31b4070ce0 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40ca3f0 con 0x7f31b40ae060 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40c8200 con 0x7f31b40c90c0 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58402/0 (socket says 172.21.15.82:58402) 2023-07-20T09:51:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 -- 172.21.15.82:0/4006130215 learned_addr learned my addr 172.21.15.82:0/4006130215 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b2d9d640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40c90c0 0x7f31b40c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31a9d9b640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31b40ae060 0x7f31b40c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 -- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40c90c0 msgr2=0x7f31b40c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40c90c0 0x7f31b40c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 -- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31b40ae060 msgr2=0x7f31b40c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31b40ae060 0x7f31b40c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 -- 172.21.15.82:0/4006130215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009b30 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b259c640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d800 tx=0x7f31a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400b6c0 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a400b820 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40c7630 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a400bb90 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40c7bb0 con 0x7f31b4070ce0 2023-07-20T09:51:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.785+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b404da30 con 0x7f31b4070ce0 2023-07-20T09:51:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.789+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f31a400bcf0 con 0x7f31b4070ce0 2023-07-20T09:51:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.789+0000 7f31ab7fe640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 0x7f3194068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.789+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f31a4084540 con 0x7f31b4070ce0 2023-07-20T09:51:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.789+0000 7f31a9d9b640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 0x7f3194068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.789+0000 7f31a9d9b640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 0x7f3194068940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31b4144830 tx=0x7f319c009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.793+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31a4051780 con 0x7f31b4070ce0 2023-07-20T09:51:43.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:43.961+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f31b4160350 con 0x7f3194066480 2023-07-20T09:51:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31ab7fe640 1 -- 172.21.15.82:0/4006130215 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f319c0014f0 con 0x7f3194066480 2023-07-20T09:51:44.052 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-07-20T09:51:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 msgr2=0x7f3194068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 0x7f3194068940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f31b4144830 tx=0x7f319c009040 comp rx=0 tx=0).stop 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 msgr2=0x7f31b40c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f31a400d800 tx=0x7f31a400dcc0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 shutdown_connections 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3194066480 0x7f3194068940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31b40c90c0 0x7f31b40c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31b40ae060 0x7f31b40c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 --2- 172.21.15.82:0/4006130215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31b4070ce0 0x7f31b40c5d00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 >> 172.21.15.82:0/4006130215 conn(0x7f31b40cf070 msgr2=0x7f31b40ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:44.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 shutdown_connections 2023-07-20T09:51:44.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.013+0000 7f31b898f640 1 -- 172.21.15.82:0/4006130215 wait complete. 2023-07-20T09:51:44.071 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-07-20T09:51:44.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-20T09:51:44.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 Processor -- start 2023-07-20T09:51:44.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 -- start start 2023-07-20T09:51:44.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18b806c120 0x7f18b80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f18b81602b0 0x7f18b8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b806b4a0 con 0x7f18b806c120 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80d0970 con 0x7f18b81602b0 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18bc8f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8160e20 con 0x7f18b806ab10 2023-07-20T09:51:44.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18b806c120 0x7f18b80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f18b806c120 0x7f18b80cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58412/0 (socket says 172.21.15.82:58412) 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 -- 172.21.15.82:0/3380654743 learned_addr learned my addr 172.21.15.82:0/3380654743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b5d9b640 1 --2- 172.21.15.82:0/3380654743 >> v2:172.21.15.183:3300/0 conn(0x7f18b81602b0 0x7f18b8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b6d9d640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 -- 172.21.15.82:0/3380654743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 msgr2=0x7f18b806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 -- 172.21.15.82:0/3380654743 >> v2:172.21.15.183:3300/0 conn(0x7f18b81602b0 msgr2=0x7f18b8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:44.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 --2- 172.21.15.82:0/3380654743 >> v2:172.21.15.183:3300/0 conn(0x7f18b81602b0 0x7f18b8160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b659c640 1 -- 172.21.15.82:0/3380654743 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80cd300 con 0x7f18b806c120 2023-07-20T09:51:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.177+0000 7f18b6d9d640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:44.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18b659c640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806c120 0x7f18b80cdde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f18b808ca40 tx=0x7f18a801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e348b19fe5ed3bd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18b559a640 1 -- 172.21.15.82:0/3380654743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80ab600 con 0x7f18b806c120 2023-07-20T09:51:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18b559a640 1 -- 172.21.15.82:0/3380654743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80ab760 con 0x7f18b806c120 2023-07-20T09:51:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18b559a640 1 -- 172.21.15.82:0/3380654743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80abaf0 con 0x7f18b806c120 2023-07-20T09:51:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 -- 172.21.15.82:0/3380654743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806c120 msgr2=0x7f18b80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806c120 0x7f18b80cdde0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f18b808ca40 tx=0x7f18a801c440 comp rx=0 tx=0).stop 2023-07-20T09:51:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 -- 172.21.15.82:0/3380654743 shutdown_connections 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/3380654743 >> v2:172.21.15.183:3300/0 conn(0x7f18b81602b0 0x7f18b8160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/3380654743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b806c120 0x7f18b80cdde0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 -- 172.21.15.82:0/3380654743 >> 172.21.15.82:0/3380654743 conn(0x7f18b808c0a0 msgr2=0x7f18b809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 -- 172.21.15.82:0/3380654743 shutdown_connections 2023-07-20T09:51:44.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.181+0000 7f18bc8f9640 1 -- 172.21.15.82:0/3380654743 wait complete. 2023-07-20T09:51:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 Processor -- start 2023-07-20T09:51:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 -- start start 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18b806c120 0x7f18b814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81565e0 con 0x7f18b81602b0 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b81568c0 con 0x7f18b806c120 2023-07-20T09:51:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18bc8f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8156ba0 con 0x7f18b806ab10 2023-07-20T09:51:44.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58418/0 (socket says 172.21.15.82:58418) 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 -- 172.21.15.82:0/2250275719 learned_addr learned my addr 172.21.15.82:0/2250275719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b659c640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b5d9b640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18b806c120 0x7f18b814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 -- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 msgr2=0x7f18b8157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b8157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 -- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18b806c120 msgr2=0x7f18b814f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18b806c120 0x7f18b814f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 -- 172.21.15.82:0/2250275719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80094d0 con 0x7f18b81602b0 2023-07-20T09:51:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18b6d9d640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007e10 tx=0x7f18b000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0003ba0 con 0x7f18b81602b0 2023-07-20T09:51:44.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000f040 con 0x7f18b81602b0 2023-07-20T09:51:44.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.185+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000de80 con 0x7f18b81602b0 2023-07-20T09:51:44.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8156e80 con 0x7f18b81602b0 2023-07-20T09:51:44.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b814be30 con 0x7f18b81602b0 2023-07-20T09:51:44.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b804da30 con 0x7f18b81602b0 2023-07-20T09:51:44.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f18b0004030 con 0x7f18b81602b0 2023-07-20T09:51:44.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18aeffd640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 0x7f1898068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f18b00844e0 con 0x7f18b81602b0 2023-07-20T09:51:44.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18b659c640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 0x7f1898068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.189+0000 7f18b659c640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 0x7f1898068940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18a80af000 tx=0x7f18a80b6040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.193+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18b0051640 con 0x7f18b81602b0 2023-07-20T09:51:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.361+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18b8161100 con 0x7f1898066480 2023-07-20T09:51:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18aeffd640 1 -- 172.21.15.82:0/2250275719 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f18a80ab8d0 con 0x7f1898066480 2023-07-20T09:51:44.442 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-07-20T09:51:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 msgr2=0x7f1898068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 0x7f1898068940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18a80af000 tx=0x7f18a80b6040 comp rx=0 tx=0).stop 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 msgr2=0x7f18b814fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f18b0007e10 tx=0x7f18b000d4a0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 shutdown_connections 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1898066480 0x7f1898068940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18b81602b0 0x7f18b814fef0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f18b806c120 0x7f18b814f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 --2- 172.21.15.82:0/2250275719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f18b806ab10 0x7f18b8157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 >> 172.21.15.82:0/2250275719 conn(0x7f18b808c0a0 msgr2=0x7f18b80af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 shutdown_connections 2023-07-20T09:51:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.405+0000 7f18bc8f9640 1 -- 172.21.15.82:0/2250275719 wait complete. 2023-07-20T09:51:44.463 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-07-20T09:51:44.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-20T09:51:44.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 Processor -- start 2023-07-20T09:51:44.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 -- start start 2023-07-20T09:51:44.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe60406c120 0x7fe6040cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 0x7fe604160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6040d0970 con 0x7fe6041602b0 2023-07-20T09:51:44.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe604160e20 con 0x7fe60406c120 2023-07-20T09:51:44.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe6091fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040cd300 con 0x7fe60406b220 2023-07-20T09:51:44.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe60406c120 0x7fe6040cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe60406c120 0x7fe6040cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58422/0 (socket says 172.21.15.82:58422) 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe60259c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe6041602b0 0x7fe60406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34092/0 (socket says 172.21.15.82:34092) 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 -- 172.21.15.82:0/1097222433 learned_addr learned my addr 172.21.15.82:0/1097222433 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe60359e640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 0x7fe604160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 -- 172.21.15.82:0/1097222433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 msgr2=0x7fe604160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T09:51:44.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 0x7fe604160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 -- 172.21.15.82:0/1097222433 >> v1:172.21.15.183:6789/0 conn(0x7fe6041602b0 legacy=0x7fe60406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe602d9d640 1 -- 172.21.15.82:0/1097222433 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6040cd5e0 con 0x7fe60406c120 2023-07-20T09:51:44.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.569+0000 7fe60359e640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 0x7fe604160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T09:51:44.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe602d9d640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe60406c120 0x7fe6040cdde0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009e50 tx=0x7fe5f401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17302042d46bf5ce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe601d9b640 1 -- 172.21.15.82:0/1097222433 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40a5830 con 0x7fe60406c120 2023-07-20T09:51:44.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe601d9b640 1 -- 172.21.15.82:0/1097222433 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f40a5990 con 0x7fe60406c120 2023-07-20T09:51:44.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe601d9b640 1 -- 172.21.15.82:0/1097222433 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40a5d20 con 0x7fe60406c120 2023-07-20T09:51:44.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 -- 172.21.15.82:0/1097222433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe60406c120 msgr2=0x7fe6040cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe60406c120 0x7fe6040cdde0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009e50 tx=0x7fe5f401c950 comp rx=0 tx=0).stop 2023-07-20T09:51:44.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 -- 172.21.15.82:0/1097222433 shutdown_connections 2023-07-20T09:51:44.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406b220 0x7fe604160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 --2- 172.21.15.82:0/1097222433 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe60406c120 0x7fe6040cdde0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 -- 172.21.15.82:0/1097222433 >> 172.21.15.82:0/1097222433 conn(0x7fe60408c0a0 msgr2=0x7fe60409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:44.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 -- 172.21.15.82:0/1097222433 shutdown_connections 2023-07-20T09:51:44.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.573+0000 7fe6091fa640 1 -- 172.21.15.82:0/1097222433 wait complete. 2023-07-20T09:51:44.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 Processor -- start 2023-07-20T09:51:44.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- start start 2023-07-20T09:51:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe60406b220 0x7fe60415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406c120 0x7fe60414ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040ca260 con 0x7fe6041602b0 2023-07-20T09:51:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040c8ee0 con 0x7fe60406b220 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6040c8000 con 0x7fe60406c120 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58428/0 (socket says 172.21.15.82:58428) 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 -- 172.21.15.82:0/538971023 learned_addr learned my addr 172.21.15.82:0/538971023 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60259c640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406c120 0x7fe60414ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe602d9d640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe60406b220 0x7fe60415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 -- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406c120 msgr2=0x7fe60414ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406c120 0x7fe60414ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 -- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe60406b220 msgr2=0x7fe60415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe60406b220 0x7fe60415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 -- 172.21.15.82:0/538971023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4009b30 con 0x7fe6041602b0 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe60359e640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e810 tx=0x7fe5fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00c6d0 con 0x7fe6041602b0 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00c830 con 0x7fe6041602b0 2023-07-20T09:51:44.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6040c82e0 con 0x7fe6041602b0 2023-07-20T09:51:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00cbe0 con 0x7fe6041602b0 2023-07-20T09:51:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.577+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60414b0c0 con 0x7fe6041602b0 2023-07-20T09:51:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60415f290 con 0x7fe6041602b0 2023-07-20T09:51:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 10) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe5fc00cd40 con 0x7fe6041602b0 2023-07-20T09:51:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe5eb7fe640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 0x7fe5f0068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T09:51:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe5fc083fa0 con 0x7fe6041602b0 2023-07-20T09:51:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe602d9d640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 0x7fe5f0068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T09:51:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.581+0000 7fe602d9d640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 0x7fe5f0068940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ae000 tx=0x7fe5f40a7070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T09:51:44.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.585+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5fc051070 con 0x7fe6041602b0 2023-07-20T09:51:44.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.753+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe60404da30 con 0x7fe5f0066480 2023-07-20T09:51:44.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.793+0000 7fe5eb7fe640 1 -- 172.21.15.82:0/538971023 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe60404da30 con 0x7fe5f0066480 2023-07-20T09:51:44.832 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-07-20T09:51:44.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 msgr2=0x7fe5f0068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 0x7fe5f0068940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40ae000 tx=0x7fe5f40a7070 comp rx=0 tx=0).stop 2023-07-20T09:51:44.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 msgr2=0x7fe604159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc00e810 tx=0x7fe5fc00ecd0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 shutdown_connections 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe5f0066480 0x7fe5f0068940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6041602b0 0x7fe604159a20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe60406c120 0x7fe60414ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 --2- 172.21.15.82:0/538971023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe60406b220 0x7fe60415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T09:51:44.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 >> 172.21.15.82:0/538971023 conn(0x7fe60408c0a0 msgr2=0x7fe6040d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T09:51:44.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 shutdown_connections 2023-07-20T09:51:44.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T09:51:44.797+0000 7fe6091fa640 1 -- 172.21.15.82:0/538971023 wait complete. 2023-07-20T09:51:44.853 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-07-20T09:51:54.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:51:54.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:52:00.062 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:52:00.025+0000 7f60cd855640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:52:00.062 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:52:00.025+0000 7f60cd855640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:52:00.062 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:52:00.025+0000 7f60cd855640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:52:00.063 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:52:00.025+0000 7f60cd855640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:52:00.063 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:52:00.025+0000 7f60cd855640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:52:24.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:52:24.155 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:52:54.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:52:54.213 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:53:24.269 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:53:24.274 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:53:54.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:53:54.567 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:54:24.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:54:24.617 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:54:54.706 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:54:54.710 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:55:24.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:55:24.851 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:55:54.932 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:55:54.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:56:24.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:56:24.989 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:56:55.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:56:55.107 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:57:00.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:57:00.220+0000 7f60d4963640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:57:00.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:57:00.220+0000 7f60d4963640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:57:00.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:57:00.220+0000 7f60d4963640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:57:00.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:57:00.220+0000 7f60d4963640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:57:00.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T09:57:00.220+0000 7f60d4963640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T09:57:25.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:57:25.323 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:57:55.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:57:55.680 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:58:25.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:58:25.742 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:58:55.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:58:55.802 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:59:26.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:59:26.097 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:59:56.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T09:59:56.157 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:00:26.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:00:26.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:00:56.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:00:56.322 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:01:26.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:01:26.375 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:01:56.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:01:56.437 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:02:19.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-20T10:02:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 Processor -- start 2023-07-20T10:02:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 -- start start 2023-07-20T10:02:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07f006c120 0x7f07f00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07f01602b0 0x7f07f0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f006ab10 0x7f07f006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f006b4a0 con 0x7f07f01602b0 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f00d0970 con 0x7f07f006c120 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07f5234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0160e20 con 0x7f07f006ab10 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07f01602b0 0x7f07f0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07f01602b0 0x7f07f0160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39796/0 (socket says 172.21.15.82:39796) 2023-07-20T10:02:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 -- 172.21.15.82:0/4144962479 learned_addr learned my addr 172.21.15.82:0/4144962479 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:20.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07eed9d640 1 --2- 172.21.15.82:0/4144962479 >> v2:172.21.15.183:3300/0 conn(0x7f07f006c120 0x7f07f00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ef59e640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f006ab10 0x7f07f006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 -- 172.21.15.82:0/4144962479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f006ab10 msgr2=0x7f07f006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f006ab10 0x7f07f006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 -- 172.21.15.82:0/4144962479 >> v2:172.21.15.183:3300/0 conn(0x7f07f006c120 msgr2=0x7f07f00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 --2- 172.21.15.82:0/4144962479 >> v2:172.21.15.183:3300/0 conn(0x7f07f006c120 0x7f07f00cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.023+0000 7f07ee59c640 1 -- 172.21.15.82:0/4144962479 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00cd300 con 0x7f07f01602b0 2023-07-20T10:02:20.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07ee59c640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f01602b0 0x7f07f0160740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07f00d00e0 tx=0x7f07e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7082a65960e59e06 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07edd9b640 1 -- 172.21.15.82:0/4144962479 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40ab600 con 0x7f07f01602b0 2023-07-20T10:02:20.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07edd9b640 1 -- 172.21.15.82:0/4144962479 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e40ab760 con 0x7f07f01602b0 2023-07-20T10:02:20.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07edd9b640 1 -- 172.21.15.82:0/4144962479 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40abaf0 con 0x7f07f01602b0 2023-07-20T10:02:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 -- 172.21.15.82:0/4144962479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f01602b0 msgr2=0x7f07f0160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f01602b0 0x7f07f0160740 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07f00d00e0 tx=0x7f07e401c440 comp rx=0 tx=0).stop 2023-07-20T10:02:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 -- 172.21.15.82:0/4144962479 shutdown_connections 2023-07-20T10:02:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f006ab10 0x7f07f006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 --2- 172.21.15.82:0/4144962479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f01602b0 0x7f07f0160740 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 --2- 172.21.15.82:0/4144962479 >> v2:172.21.15.183:3300/0 conn(0x7f07f006c120 0x7f07f00cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 -- 172.21.15.82:0/4144962479 >> 172.21.15.82:0/4144962479 conn(0x7f07f008c0a0 msgr2=0x7f07f009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 -- 172.21.15.82:0/4144962479 shutdown_connections 2023-07-20T10:02:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.027+0000 7f07f5234640 1 -- 172.21.15.82:0/4144962479 wait complete. 2023-07-20T10:02:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 Processor -- start 2023-07-20T10:02:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- start start 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07f006c120 0x7f07f015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f01602b0 0x7f07f015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0158140 con 0x7f07f006ab10 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c98a0 con 0x7f07f006c120 2023-07-20T10:02:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c9b80 con 0x7f07f01602b0 2023-07-20T10:02:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39804/0 (socket says 172.21.15.82:39804) 2023-07-20T10:02:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 -- 172.21.15.82:0/829521551 learned_addr learned my addr 172.21.15.82:0/829521551 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07ef59e640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f01602b0 0x7f07f015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07ee59c640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07f006c120 0x7f07f015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 -- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f01602b0 msgr2=0x7f07f015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f01602b0 0x7f07f015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 -- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07f006c120 msgr2=0x7f07f015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07f006c120 0x7f07f015a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 -- 172.21.15.82:0/829521551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40094d0 con 0x7f07f006ab10 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07eed9d640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007ef0 tx=0x7f07e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0014620 con 0x7f07f006ab10 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0014780 con 0x7f07f006ab10 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0014b30 con 0x7f07f006ab10 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f00c9e60 con 0x7f07f006ab10 2023-07-20T10:02:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.031+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f00ca420 con 0x7f07f006ab10 2023-07-20T10:02:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f004da30 con 0x7f07f006ab10 2023-07-20T10:02:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f07e0014c90 con 0x7f07f006ab10 2023-07-20T10:02:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07d77fe640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 0x7f07dc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f07e0084a50 con 0x7f07f006ab10 2023-07-20T10:02:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07ee59c640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 0x7f07dc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.035+0000 7f07ee59c640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 0x7f07dc068940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07e40af000 tx=0x7f07e40a7000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.039+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07e0051c70 con 0x7f07f006ab10 2023-07-20T10:02:20.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.207+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07f0161100 con 0x7f07dc066480 2023-07-20T10:02:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.271+0000 7f07d77fe640 1 -- 172.21.15.82:0/829521551 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f07e40ab580 con 0x7f07dc066480 2023-07-20T10:02:20.262 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 msgr2=0x7f07dc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 0x7f07dc068940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f07e40af000 tx=0x7f07e40a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 msgr2=0x7f07f0157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f07e0007ef0 tx=0x7f07e000e4b0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 shutdown_connections 2023-07-20T10:02:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f07dc066480 0x7f07dc068940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07f01602b0 0x7f07f015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07f006c120 0x7f07f015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 --2- 172.21.15.82:0/829521551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f006ab10 0x7f07f0157480 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 >> 172.21.15.82:0/829521551 conn(0x7f07f008c0a0 msgr2=0x7f07f015ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 shutdown_connections 2023-07-20T10:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.275+0000 7f07f5234640 1 -- 172.21.15.82:0/829521551 wait complete. 2023-07-20T10:02:20.283 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-07-20T10:02:20.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-20T10:02:20.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 Processor -- start 2023-07-20T10:02:20.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 -- start start 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178160ba0 0x7f41780c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41780c8e60 0x7f41780afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41780c9370 con 0x7f4178161de0 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780c9650 con 0x7f41780c8e60 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417f567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41781619c0 con 0x7f4178160ba0 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41780c8e60 0x7f41780afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f41780c8e60 0x7f41780afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39816/0 (socket says 172.21.15.82:39816) 2023-07-20T10:02:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 -- 172.21.15.82:0/1108744985 learned_addr learned my addr 172.21.15.82:0/1108744985 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417d303640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178160ba0 0x7f41780c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 -- 172.21.15.82:0/1108744985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178160ba0 msgr2=0x7f41780c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178160ba0 0x7f41780c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 -- 172.21.15.82:0/1108744985 >> v1:172.21.15.183:6789/0 conn(0x7f4178161de0 legacy=0x7f41780cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.439+0000 7f417cb02640 1 -- 172.21.15.82:0/1108744985 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178161300 con 0x7f41780c8e60 2023-07-20T10:02:20.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417cb02640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41780c8e60 0x7f41780afd50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f416801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd5b08a8d1f9f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f416ffff640 1 -- 172.21.15.82:0/1108744985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680ab620 con 0x7f41780c8e60 2023-07-20T10:02:20.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f416ffff640 1 -- 172.21.15.82:0/1108744985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680ab780 con 0x7f41780c8e60 2023-07-20T10:02:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f416ffff640 1 -- 172.21.15.82:0/1108744985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680abb10 con 0x7f41780c8e60 2023-07-20T10:02:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 -- 172.21.15.82:0/1108744985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41780c8e60 msgr2=0x7f41780afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41780c8e60 0x7f41780afd50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4168009870 tx=0x7f416801c510 comp rx=0 tx=0).stop 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 -- 172.21.15.82:0/1108744985 shutdown_connections 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41780c8e60 0x7f41780afd50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 --2- 172.21.15.82:0/1108744985 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178160ba0 0x7f41780c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 -- 172.21.15.82:0/1108744985 >> 172.21.15.82:0/1108744985 conn(0x7f41780cad50 msgr2=0x7f41780cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 -- 172.21.15.82:0/1108744985 shutdown_connections 2023-07-20T10:02:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.443+0000 7f417f567640 1 -- 172.21.15.82:0/1108744985 wait complete. 2023-07-20T10:02:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 Processor -- start 2023-07-20T10:02:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- start start 2023-07-20T10:02:20.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41780c8e60 0x7f41781641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178161de0 0x7f417815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178163890 con 0x7f4178160ba0 2023-07-20T10:02:20.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c21a0 con 0x7f41780c8e60 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c2480 con 0x7f4178161de0 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39826/0 (socket says 172.21.15.82:39826) 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 -- 172.21.15.82:0/3865863759 learned_addr learned my addr 172.21.15.82:0/3865863759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417d303640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41780c8e60 0x7f41781641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417db04640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178161de0 0x7f417815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 -- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178161de0 msgr2=0x7f417815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178161de0 0x7f417815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 -- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41780c8e60 msgr2=0x7f41781641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41780c8e60 0x7f41781641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 -- 172.21.15.82:0/3865863759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41680094d0 con 0x7f4178160ba0 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417cb02640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f416801a140 tx=0x7f416801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680be3f0 con 0x7f4178160ba0 2023-07-20T10:02:20.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41680be550 con 0x7f4178160ba0 2023-07-20T10:02:20.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680be900 con 0x7f4178160ba0 2023-07-20T10:02:20.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780c2760 con 0x7f4178160ba0 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.447+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780c1e90 con 0x7f4178160ba0 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417804da30 con 0x7f4178160ba0 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f41680b43f0 con 0x7f4178160ba0 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f416dffb640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 0x7f415c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f416811e620 con 0x7f4178160ba0 2023-07-20T10:02:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f417d303640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 0x7f415c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.451+0000 7f417d303640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 0x7f415c068940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41780af200 tx=0x7f417400b040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.455+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41680eb600 con 0x7f4178160ba0 2023-07-20T10:02:20.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.623+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f417816da80 con 0x7f415c066480 2023-07-20T10:02:20.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.687+0000 7f416dffb640 1 -- 172.21.15.82:0/3865863759 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f4174016420 con 0x7f415c066480 2023-07-20T10:02:20.677 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-07-20T10:02:20.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 msgr2=0x7f415c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 0x7f415c068940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41780af200 tx=0x7f417400b040 comp rx=0 tx=0).stop 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 msgr2=0x7f41780c2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f416801a140 tx=0x7f416801ad50 comp rx=0 tx=0).stop 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 shutdown_connections 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f415c066480 0x7f415c068940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4178161de0 0x7f417815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4178160ba0 0x7f41780c2f60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 --2- 172.21.15.82:0/3865863759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f41780c8e60 0x7f41781641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 >> 172.21.15.82:0/3865863759 conn(0x7f41780cad50 msgr2=0x7f41780ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 shutdown_connections 2023-07-20T10:02:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.691+0000 7f417f567640 1 -- 172.21.15.82:0/3865863759 wait complete. 2023-07-20T10:02:20.698 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-07-20T10:02:20.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-20T10:02:20.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 Processor -- start 2023-07-20T10:02:20.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 -- start start 2023-07-20T10:02:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf58160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf580ce4f0 con 0x7faf5806c120 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf580d0970 con 0x7faf581602b0 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5e8d8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf58160e20 con 0x7faf5806b220 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf57fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faf5806c120 0x7faf580cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40598/0 (socket says 172.21.15.82:40598) 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf57fff640 1 -- 172.21.15.82:0/2624219192 learned_addr learned my addr 172.21.15.82:0/2624219192 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf58160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251542828 0 0) 0x7faf580ce4f0 con 0x7faf5806c120 2023-07-20T10:02:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf40003530 con 0x7faf5806c120 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003319811 0 0) 0x7faf580d0970 con 0x7faf581602b0 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf580ce4f0 con 0x7faf581602b0 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1658677030 0 0) 0x7faf40003530 con 0x7faf5806c120 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 msgr2=0x7faf58160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf58160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 >> v1:172.21.15.183:6789/0 conn(0x7faf581602b0 legacy=0x7faf5806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580cd300 con 0x7faf5806c120 2023-07-20T10:02:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7faf48001680 con 0x7faf5806c120 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf58160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 >> v1:172.21.15.82:6789/0 conn(0x7faf5806c120 legacy=0x7faf580cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40003bb0 0x7faf40003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf40004d10 0x7faf40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf58160e20 con 0x7faf40004d10 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4000bb20 con 0x7faf40003bb0 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4000bcb0 con 0x7faf5806b220 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf57fff640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40003bb0 0x7faf40003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf40004d10 0x7faf40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf577fe640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 -- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 msgr2=0x7faf400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf5806b220 0x7faf400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 -- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40003bb0 msgr2=0x7faf40003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40003bb0 0x7faf40003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf5ce75640 1 -- 172.21.15.82:0/2624219192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50009a70 con 0x7faf40004d10 2023-07-20T10:02:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.855+0000 7faf57fff640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40003bb0 0x7faf40003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5ce75640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf40004d10 0x7faf40005190 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf5000e380 tx=0x7faf5001cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be5d2dd0b5865ed server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500a5df0 con 0x7faf40004d10 2023-07-20T10:02:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5000f040 con 0x7faf40004d10 2023-07-20T10:02:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf56ffd640 1 -- 172.21.15.82:0/2624219192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500ad640 con 0x7faf40004d10 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 -- 172.21.15.82:0/2624219192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf40004d10 msgr2=0x7faf40005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/2624219192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf40004d10 0x7faf40005190 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7faf5000e380 tx=0x7faf5001cde0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5ce75640 1 -- 172.21.15.82:0/2624219192 reap_dead start 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 -- 172.21.15.82:0/2624219192 shutdown_connections 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 -- 172.21.15.82:0/2624219192 >> 172.21.15.82:0/2624219192 conn(0x7faf5808c0a0 msgr2=0x7faf5809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 -- 172.21.15.82:0/2624219192 shutdown_connections 2023-07-20T10:02:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.859+0000 7faf5e8d8640 1 -- 172.21.15.82:0/2624219192 wait complete. 2023-07-20T10:02:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 Processor -- start 2023-07-20T10:02:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- start start 2023-07-20T10:02:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40004d10 0x7faf580c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf580cae50 0x7faf580b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580b2c50 con 0x7faf58154b00 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf580cb2d0 con 0x7faf40004d10 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf580c9db0 con 0x7faf580cae50 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39854/0 (socket says 172.21.15.82:39854) 2023-07-20T10:02:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 -- 172.21.15.82:0/30678736 learned_addr learned my addr 172.21.15.82:0/30678736 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf577fe640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf580cae50 0x7faf580b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf57fff640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40004d10 0x7faf580c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 -- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf580cae50 msgr2=0x7faf580b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf580cae50 0x7faf580b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 -- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40004d10 msgr2=0x7faf580c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40004d10 0x7faf580c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 -- 172.21.15.82:0/30678736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf580ca090 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5ce75640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5000e380 tx=0x7faf50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500aed50 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf500039a0 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50003d50 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf580ca370 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.863+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf580ca930 con 0x7faf58154b00 2023-07-20T10:02:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5804da30 con 0x7faf58154b00 2023-07-20T10:02:20.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7faf500b4040 con 0x7faf58154b00 2023-07-20T10:02:20.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf54ff9640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 0x7faf44068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:20.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7faf4c001d30 con 0x7faf58154b00 2023-07-20T10:02:20.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf57fff640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 0x7faf44068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:20.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.867+0000 7faf57fff640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 0x7faf44068940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf48001c50 tx=0x7faf48001e30 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:20.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:20.871+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf500eb4f0 con 0x7faf58154b00 2023-07-20T10:02:21.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.039+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7faf580cd8c0 con 0x7faf44066480 2023-07-20T10:02:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.099+0000 7faf54ff9640 1 -- 172.21.15.82:0/30678736 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7faf48007700 con 0x7faf44066480 2023-07-20T10:02:21.090 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 msgr2=0x7faf44068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 0x7faf44068940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf48001c50 tx=0x7faf48001e30 comp rx=0 tx=0).stop 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 msgr2=0x7faf580b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf5000e380 tx=0x7faf50009750 comp rx=0 tx=0).stop 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 shutdown_connections 2023-07-20T10:02:21.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7faf44066480 0x7faf44068940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf58154b00 0x7faf580b3370 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf580cae50 0x7faf580b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 --2- 172.21.15.82:0/30678736 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf40004d10 0x7faf580c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 >> 172.21.15.82:0/30678736 conn(0x7faf5808c0a0 msgr2=0x7faf580d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 shutdown_connections 2023-07-20T10:02:21.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.103+0000 7faf5e8d8640 1 -- 172.21.15.82:0/30678736 wait complete. 2023-07-20T10:02:21.112 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-07-20T10:02:21.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-20T10:02:21.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 Processor -- start 2023-07-20T10:02:21.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 -- start start 2023-07-20T10:02:21.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b4415c6e0 0x7f9b440cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440cdb40 con 0x7f9b4415cac0 2023-07-20T10:02:21.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440d07a0 con 0x7f9b440d3200 2023-07-20T10:02:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b496e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b440cd4f0 con 0x7f9b4415c6e0 2023-07-20T10:02:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b437fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b4415cac0 0x7f9b440d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40612/0 (socket says 172.21.15.82:40612) 2023-07-20T10:02:21.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b437fe640 1 -- 172.21.15.82:0/2065435116 learned_addr learned my addr 172.21.15.82:0/2065435116 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b42ffd640 1 --2- 172.21.15.82:0/2065435116 >> v2:172.21.15.183:3300/0 conn(0x7f9b4415c6e0 0x7f9b440cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.267+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549936293 0 0) 0x7f9b440cdb40 con 0x7f9b4415cac0 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b30003530 con 0x7f9b4415cac0 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291969704 0 0) 0x7f9b440d07a0 con 0x7f9b440d3200 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b440cdb40 con 0x7f9b440d3200 2023-07-20T10:02:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508234782 0 0) 0x7f9b30003530 con 0x7f9b4415cac0 2023-07-20T10:02:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b42ffd640 1 -- 172.21.15.82:0/2065435116 >> v1:172.21.15.183:6789/0 conn(0x7f9b440d3200 legacy=0x7f9b440cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b42ffd640 1 -- 172.21.15.82:0/2065435116 >> v1:172.21.15.82:6789/0 conn(0x7f9b4415cac0 legacy=0x7f9b440d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b42ffd640 1 -- 172.21.15.82:0/2065435116 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440cd7d0 con 0x7f9b4415c6e0 2023-07-20T10:02:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b42ffd640 1 --2- 172.21.15.82:0/2065435116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415c6e0 0x7f9b440cf640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097c0 tx=0x7f9b3401c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=430190a2ab7841cd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c001a00 con 0x7f9b4415c6e0 2023-07-20T10:02:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340a7050 con 0x7f9b4415c6e0 2023-07-20T10:02:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b427fc640 1 -- 172.21.15.82:0/2065435116 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b340ab620 con 0x7f9b4415c6e0 2023-07-20T10:02:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b496e5640 1 -- 172.21.15.82:0/2065435116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415c6e0 msgr2=0x7f9b440cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.271+0000 7f9b496e5640 1 --2- 172.21.15.82:0/2065435116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415c6e0 0x7f9b440cf640 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b340097c0 tx=0x7f9b3401c280 comp rx=0 tx=0).stop 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- 172.21.15.82:0/2065435116 shutdown_connections 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 --2- 172.21.15.82:0/2065435116 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415c6e0 0x7f9b440cf640 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- 172.21.15.82:0/2065435116 >> 172.21.15.82:0/2065435116 conn(0x7f9b440d2600 msgr2=0x7f9b440d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- 172.21.15.82:0/2065435116 shutdown_connections 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- 172.21.15.82:0/2065435116 wait complete. 2023-07-20T10:02:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 Processor -- start 2023-07-20T10:02:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- start start 2023-07-20T10:02:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b440d3200 0x7f9b440b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415cac0 0x7f9b4415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44156b00 con 0x7f9b4415c6e0 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4414fc60 con 0x7f9b4415cac0 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b496e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4415cea0 con 0x7f9b440d3200 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39860/0 (socket says 172.21.15.82:39860) 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 -- 172.21.15.82:0/1593567315 learned_addr learned my addr 172.21.15.82:0/1593567315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:21.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b42ffd640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b440d3200 0x7f9b440b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b437fe640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415cac0 0x7f9b4415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 -- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b440d3200 msgr2=0x7f9b440b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b440d3200 0x7f9b440b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 -- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415cac0 msgr2=0x7f9b4415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415cac0 0x7f9b4415f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 -- 172.21.15.82:0/1593567315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34009420 con 0x7f9b4415c6e0 2023-07-20T10:02:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3a7fc640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c500 tx=0x7f9b2c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.275+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0052d0 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c005430 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4415d180 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c012870 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b44156d10 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4404da30 con 0x7f9b4415c6e0 2023-07-20T10:02:21.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9b2c0129d0 con 0x7f9b4415c6e0 2023-07-20T10:02:21.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b3bfff640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 0x7f9b24068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9b2c083d70 con 0x7f9b4415c6e0 2023-07-20T10:02:21.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.279+0000 7f9b42ffd640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 0x7f9b24068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.283+0000 7f9b42ffd640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 0x7f9b24068970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b340ad000 tx=0x7f9b340a6000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.283+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b2c050e70 con 0x7f9b4415c6e0 2023-07-20T10:02:21.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.451+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b4406b000 con 0x7f9b240664b0 2023-07-20T10:02:21.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.515+0000 7f9b3bfff640 1 -- 172.21.15.82:0/1593567315 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9b340ab660 con 0x7f9b240664b0 2023-07-20T10:02:21.505 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 msgr2=0x7f9b24068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 0x7f9b24068970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9b340ad000 tx=0x7f9b340a6000 comp rx=0 tx=0).stop 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 msgr2=0x7f9b4415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00c500 tx=0x7f9b2c00c9c0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 shutdown_connections 2023-07-20T10:02:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9b240664b0 0x7f9b24068970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b4415cac0 0x7f9b4415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b4415c6e0 0x7f9b4415d860 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 --2- 172.21.15.82:0/1593567315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b440d3200 0x7f9b440b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 >> 172.21.15.82:0/1593567315 conn(0x7f9b440d2600 msgr2=0x7f9b440d0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 shutdown_connections 2023-07-20T10:02:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.519+0000 7f9b496e5640 1 -- 172.21.15.82:0/1593567315 wait complete. 2023-07-20T10:02:21.525 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-07-20T10:02:21.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-20T10:02:21.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 Processor -- start 2023-07-20T10:02:21.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 -- start start 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8be8160ba0 0x7f8be80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80c9370 con 0x7f8be80b0460 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be8161300 con 0x7f8be80c8e60 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8befa9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80c9650 con 0x7f8be8160ba0 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8be8160ba0 0x7f8be80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8be8160ba0 0x7f8be80c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39866/0 (socket says 172.21.15.82:39866) 2023-07-20T10:02:21.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 -- 172.21.15.82:0/1283505144 learned_addr learned my addr 172.21.15.82:0/1283505144 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:21.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 -- 172.21.15.82:0/1283505144 >> v1:172.21.15.183:6789/0 conn(0x7f8be80c8e60 legacy=0x7f8be80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 -- 172.21.15.82:0/1283505144 >> v1:172.21.15.82:6789/0 conn(0x7f8be80b0460 legacy=0x7f8be80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.683+0000 7f8bed838640 1 -- 172.21.15.82:0/1283505144 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be81615e0 con 0x7f8be8160ba0 2023-07-20T10:02:21.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8bed838640 1 --2- 172.21.15.82:0/1283505144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80c8920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009870 tx=0x7f8be401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f23f211654d0dd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8bec836640 1 -- 172.21.15.82:0/1283505144 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a9620 con 0x7f8be8160ba0 2023-07-20T10:02:21.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8bec836640 1 -- 172.21.15.82:0/1283505144 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be81656c0 con 0x7f8be8160ba0 2023-07-20T10:02:21.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8bec836640 1 -- 172.21.15.82:0/1283505144 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a99a0 con 0x7f8be8160ba0 2023-07-20T10:02:21.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 -- 172.21.15.82:0/1283505144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 msgr2=0x7f8be80c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 --2- 172.21.15.82:0/1283505144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80c8920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009870 tx=0x7f8be401c540 comp rx=0 tx=0).stop 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 -- 172.21.15.82:0/1283505144 shutdown_connections 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 --2- 172.21.15.82:0/1283505144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80c8920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 -- 172.21.15.82:0/1283505144 >> 172.21.15.82:0/1283505144 conn(0x7f8be80cad50 msgr2=0x7f8be80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 -- 172.21.15.82:0/1283505144 shutdown_connections 2023-07-20T10:02:21.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.687+0000 7f8befa9c640 1 -- 172.21.15.82:0/1283505144 wait complete. 2023-07-20T10:02:21.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 Processor -- start 2023-07-20T10:02:21.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- start start 2023-07-20T10:02:21.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be80b0460 0x7f8be80c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8be80c8e60 0x7f8be80b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be81619c0 con 0x7f8be8160ba0 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b2650 con 0x7f8be80c8e60 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80c5ee0 con 0x7f8be80b0460 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39868/0 (socket says 172.21.15.82:39868) 2023-07-20T10:02:21.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 -- 172.21.15.82:0/4107596840 learned_addr learned my addr 172.21.15.82:0/4107596840 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:21.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bed838640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be80b0460 0x7f8be80c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bed037640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8be80c8e60 0x7f8be80b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 -- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be80b0460 msgr2=0x7f8be80c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be80b0460 0x7f8be80c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 -- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8be80c8e60 msgr2=0x7f8be80b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8be80c8e60 0x7f8be80b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 -- 172.21.15.82:0/4107596840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be40094d0 con 0x7f8be8160ba0 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bee039640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c7a0 tx=0x7f8be000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0003b80 con 0x7f8be8160ba0 2023-07-20T10:02:21.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0003ce0 con 0x7f8be8160ba0 2023-07-20T10:02:21.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80b2370 con 0x7f8be8160ba0 2023-07-20T10:02:21.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000aa30 con 0x7f8be8160ba0 2023-07-20T10:02:21.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be80c6460 con 0x7f8be8160ba0 2023-07-20T10:02:21.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.691+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be804da30 con 0x7f8be8160ba0 2023-07-20T10:02:21.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.695+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f8be000ab90 con 0x7f8be8160ba0 2023-07-20T10:02:21.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.695+0000 7f8bde7fc640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 0x7f8bcc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:21.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.695+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8be0083ed0 con 0x7f8be8160ba0 2023-07-20T10:02:21.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.695+0000 7f8bed838640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 0x7f8bcc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:21.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.695+0000 7f8bed838640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 0x7f8bcc068940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ae000 tx=0x7f8be4009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:21.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.699+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8be0051060 con 0x7f8be8160ba0 2023-07-20T10:02:21.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.863+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8be806f7b0 con 0x7f8bcc066480 2023-07-20T10:02:21.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.927+0000 7f8bde7fc640 1 -- 172.21.15.82:0/4107596840 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8be806f7b0 con 0x7f8bcc066480 2023-07-20T10:02:21.917 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-07-20T10:02:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 msgr2=0x7f8bcc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 0x7f8bcc068940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8be40ae000 tx=0x7f8be4009040 comp rx=0 tx=0).stop 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 msgr2=0x7f8be80b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c7a0 tx=0x7f8be000cc60 comp rx=0 tx=0).stop 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 shutdown_connections 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8bcc066480 0x7f8bcc068940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8be8160ba0 0x7f8be80b3770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8be80c8e60 0x7f8be80b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 --2- 172.21.15.82:0/4107596840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8be80b0460 0x7f8be80c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 >> 172.21.15.82:0/4107596840 conn(0x7f8be80cad50 msgr2=0x7f8be81648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 shutdown_connections 2023-07-20T10:02:21.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:21.931+0000 7f8befa9c640 1 -- 172.21.15.82:0/4107596840 wait complete. 2023-07-20T10:02:21.936 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-07-20T10:02:21.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-20T10:02:22.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.091+0000 7f5f1118f640 1 Processor -- start 2023-07-20T10:02:22.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.091+0000 7f5f1118f640 1 -- start start 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f0c06f710 0x7f5f0c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c0ca5a0 0x7f5f0c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f0c15ec90 0x7f5f0c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c15bad0 con 0x7f5f0c06f710 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c070030 con 0x7f5f0c15ec90 2023-07-20T10:02:22.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f1118f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c071950 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f0c06f710 0x7f5f0c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f0c06f710 0x7f5f0c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39876/0 (socket says 172.21.15.82:39876) 2023-07-20T10:02:22.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 -- 172.21.15.82:0/2060495872 learned_addr learned my addr 172.21.15.82:0/2060495872 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:22.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 -- 172.21.15.82:0/2060495872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c0ca5a0 msgr2=0x7f5f0c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:22.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/2060495872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c0ca5a0 0x7f5f0c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 -- 172.21.15.82:0/2060495872 >> v2:172.21.15.183:3300/0 conn(0x7f5f0c15ec90 msgr2=0x7f5f0c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:22.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/2060495872 >> v2:172.21.15.183:3300/0 conn(0x7f5f0c15ec90 0x7f5f0c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.095+0000 7f5f0ad9d640 1 -- 172.21.15.82:0/2060495872 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c15b230 con 0x7f5f0c06f710 2023-07-20T10:02:22.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/2060495872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c06f710 0x7f5f0c06faf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0702d0 tx=0x7f5efc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb3612fca996edc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f0a59c640 1 -- 172.21.15.82:0/2060495872 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0a5730 con 0x7f5f0c06f710 2023-07-20T10:02:22.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f0a59c640 1 -- 172.21.15.82:0/2060495872 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc0a5890 con 0x7f5f0c06f710 2023-07-20T10:02:22.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f0a59c640 1 -- 172.21.15.82:0/2060495872 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0a5c20 con 0x7f5f0c06f710 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- 172.21.15.82:0/2060495872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c06f710 msgr2=0x7f5f0c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 --2- 172.21.15.82:0/2060495872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c06f710 0x7f5f0c06faf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c0702d0 tx=0x7f5efc01c9a0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- 172.21.15.82:0/2060495872 shutdown_connections 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 --2- 172.21.15.82:0/2060495872 >> v2:172.21.15.183:3300/0 conn(0x7f5f0c15ec90 0x7f5f0c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 --2- 172.21.15.82:0/2060495872 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c0ca5a0 0x7f5f0c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 --2- 172.21.15.82:0/2060495872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c06f710 0x7f5f0c06faf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- 172.21.15.82:0/2060495872 >> 172.21.15.82:0/2060495872 conn(0x7f5f0c0cad50 msgr2=0x7f5f0c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:22.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- 172.21.15.82:0/2060495872 shutdown_connections 2023-07-20T10:02:22.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- 172.21.15.82:0/2060495872 wait complete. 2023-07-20T10:02:22.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 Processor -- start 2023-07-20T10:02:22.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.099+0000 7f5f1118f640 1 -- start start 2023-07-20T10:02:22.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f0c06f710 0x7f5f0c0ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c15ec90 0x7f5f0c142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b1fe0 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b0cc0 con 0x7f5f0c06f710 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0b0f60 con 0x7f5f0c15ec90 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39890/0 (socket says 172.21.15.82:39890) 2023-07-20T10:02:22.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 -- 172.21.15.82:0/1477560499 learned_addr learned my addr 172.21.15.82:0/1477560499 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f0c06f710 0x7f5f0c0ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0b59e640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c15ec90 0x7f5f0c142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 -- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c15ec90 msgr2=0x7f5f0c142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c15ec90 0x7f5f0c142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 -- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f0c06f710 msgr2=0x7f5f0c0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f0c06f710 0x7f5f0c0ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 -- 172.21.15.82:0/1477560499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc009b30 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f0259c640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400b550 tx=0x7f5ef400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4010870 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40109f0 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4010da0 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c0b1240 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c0b1800 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c1519b0 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.103+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f5ef400f3c0 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.107+0000 7f5f03fff640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 0x7f5eec068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.107+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f5ef4084270 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.107+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 0x7f5eec068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.107+0000 7f5f0ad9d640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 0x7f5eec068940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0ae000 tx=0x7f5efc0a7070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.111+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ef4051350 con 0x7f5f0c0ca5a0 2023-07-20T10:02:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.275+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f0c15e230 con 0x7f5eec066480 2023-07-20T10:02:22.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f03fff640 1 -- 172.21.15.82:0/1477560499 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5efc0a5af0 con 0x7f5eec066480 2023-07-20T10:02:22.323 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-07-20T10:02:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 msgr2=0x7f5eec068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 0x7f5eec068940 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0ae000 tx=0x7f5efc0a7070 comp rx=0 tx=0).stop 2023-07-20T10:02:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 msgr2=0x7f5f0c153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400b550 tx=0x7f5ef400ba10 comp rx=0 tx=0).stop 2023-07-20T10:02:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 shutdown_connections 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5eec066480 0x7f5eec068940 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f0c15ec90 0x7f5f0c142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f0c0ca5a0 0x7f5f0c153d40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 --2- 172.21.15.82:0/1477560499 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f0c06f710 0x7f5f0c0ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 >> 172.21.15.82:0/1477560499 conn(0x7f5f0c0cad50 msgr2=0x7f5f0c0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 shutdown_connections 2023-07-20T10:02:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.335+0000 7f5f1118f640 1 -- 172.21.15.82:0/1477560499 wait complete. 2023-07-20T10:02:22.343 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-07-20T10:02:22.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-20T10:02:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 Processor -- start 2023-07-20T10:02:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 -- start start 2023-07-20T10:02:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f93c8161de0 0x7f93c80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c80b06e0 con 0x7f93c8160ba0 2023-07-20T10:02:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c80c9650 con 0x7f93c8161de0 2023-07-20T10:02:22.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cf86d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81619c0 con 0x7f93c80b0290 2023-07-20T10:02:22.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cde0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cde0a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:52004/0 (socket says 172.21.15.82:52004) 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cde0a640 1 -- 172.21.15.82:0/1492094329 learned_addr learned my addr 172.21.15.82:0/1492094329 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.499+0000 7f93cce08640 1 --2- 172.21.15.82:0/1492094329 >> v2:172.21.15.183:3300/0 conn(0x7f93c8161de0 0x7f93c80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cde0a640 1 -- 172.21.15.82:0/1492094329 >> v2:172.21.15.183:3300/0 conn(0x7f93c8161de0 msgr2=0x7f93c80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cde0a640 1 --2- 172.21.15.82:0/1492094329 >> v2:172.21.15.183:3300/0 conn(0x7f93c8161de0 0x7f93c80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cde0a640 1 -- 172.21.15.82:0/1492094329 >> v1:172.21.15.183:6789/0 conn(0x7f93c8160ba0 legacy=0x7f93c80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cde0a640 1 -- 172.21.15.82:0/1492094329 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80c9370 con 0x7f93c80b0290 2023-07-20T10:02:22.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cde0a640 1 --2- 172.21.15.82:0/1492094329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009e50 tx=0x7f93c001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e19c9e2e5e2695 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93bffff640 1 -- 172.21.15.82:0/1492094329 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00a58a0 con 0x7f93c80b0290 2023-07-20T10:02:22.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93bffff640 1 -- 172.21.15.82:0/1492094329 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c00a5a00 con 0x7f93c80b0290 2023-07-20T10:02:22.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93bffff640 1 -- 172.21.15.82:0/1492094329 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00a5d90 con 0x7f93c80b0290 2023-07-20T10:02:22.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cf86d640 1 -- 172.21.15.82:0/1492094329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 msgr2=0x7f93c80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.503+0000 7f93cf86d640 1 --2- 172.21.15.82:0/1492094329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009e50 tx=0x7f93c001c9e0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- 172.21.15.82:0/1492094329 shutdown_connections 2023-07-20T10:02:22.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 --2- 172.21.15.82:0/1492094329 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c80b0290 0x7f93c80cbea0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 --2- 172.21.15.82:0/1492094329 >> v2:172.21.15.183:3300/0 conn(0x7f93c8161de0 0x7f93c80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- 172.21.15.82:0/1492094329 >> 172.21.15.82:0/1492094329 conn(0x7f93c80cad50 msgr2=0x7f93c80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- 172.21.15.82:0/1492094329 shutdown_connections 2023-07-20T10:02:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- 172.21.15.82:0/1492094329 wait complete. 2023-07-20T10:02:22.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 Processor -- start 2023-07-20T10:02:22.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- start start 2023-07-20T10:02:22.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 0x7f93c80ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 0x7f93c815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 0x7f93c815f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80b4090 con 0x7f93c8161de0 2023-07-20T10:02:22.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80b0e50 con 0x7f93c80b0290 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cf86d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8163ea0 con 0x7f93c8160ba0 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cde0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 0x7f93c815f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cd609640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 0x7f93c80ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cd609640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 0x7f93c80ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:37714/0 (socket says 172.21.15.82:37714) 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cd609640 1 -- 172.21.15.82:0/2193423949 learned_addr learned my addr 172.21.15.82:0/2193423949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cde0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 0x7f93c815f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39898/0 (socket says 172.21.15.82:39898) 2023-07-20T10:02:22.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 0x7f93c815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 -- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 msgr2=0x7f93c80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 0x7f93c80ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 -- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 msgr2=0x7f93c815f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 0x7f93c815f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 -- 172.21.15.82:0/2193423949 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009b30 con 0x7f93c8160ba0 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.507+0000 7f93cce08640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 0x7f93c815b8a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e8a0 tx=0x7f93b800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8009e80 con 0x7f93c8160ba0 2023-07-20T10:02:22.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b800c940 con 0x7f93c8160ba0 2023-07-20T10:02:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b800ccb0 con 0x7f93c8160ba0 2023-07-20T10:02:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c8162e00 con 0x7f93c8160ba0 2023-07-20T10:02:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c81633c0 con 0x7f93c8160ba0 2023-07-20T10:02:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c80afe30 con 0x7f93c8160ba0 2023-07-20T10:02:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f93b80059a0 con 0x7f93c8160ba0 2023-07-20T10:02:22.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 0x7f93ac068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f93b8084760 con 0x7f93c8160ba0 2023-07-20T10:02:22.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.511+0000 7f93cd609640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 0x7f93ac068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.515+0000 7f93cd609640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 0x7f93ac068970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93c40018b0 tx=0x7f93c4009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.515+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93b80518f0 con 0x7f93c8160ba0 2023-07-20T10:02:22.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.683+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f93c80c9030 con 0x7f93ac0664b0 2023-07-20T10:02:22.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.747+0000 7f93bdffb640 1 -- 172.21.15.82:0/2193423949 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f93c400f850 con 0x7f93ac0664b0 2023-07-20T10:02:22.737 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-07-20T10:02:22.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 msgr2=0x7f93ac068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 0x7f93ac068970 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93c40018b0 tx=0x7f93c4009040 comp rx=0 tx=0).stop 2023-07-20T10:02:22.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 msgr2=0x7f93c815b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 0x7f93c815b8a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93b800e8a0 tx=0x7f93b800ed60 comp rx=0 tx=0).stop 2023-07-20T10:02:22.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 shutdown_connections 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f93ac0664b0 0x7f93ac068970 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93c8161de0 0x7f93c815f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93c8160ba0 0x7f93c815b8a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 --2- 172.21.15.82:0/2193423949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f93c80b0290 0x7f93c80ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 >> 172.21.15.82:0/2193423949 conn(0x7f93c80cad50 msgr2=0x7f93c80af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 shutdown_connections 2023-07-20T10:02:22.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.751+0000 7f93cf86d640 1 -- 172.21.15.82:0/2193423949 wait complete. 2023-07-20T10:02:22.757 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-07-20T10:02:22.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-20T10:02:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.911+0000 7f8795f8f640 1 Processor -- start 2023-07-20T10:02:22.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.911+0000 7f8795f8f640 1 -- start start 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8795f8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f879015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8795f8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87900cc8d0 con 0x7f8790159830 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8795f8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87900ccbb0 con 0x7f87900afd50 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8795f8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87900cce90 con 0x7f8790159450 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8786ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8790159830 0x7f87900cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40622/0 (socket says 172.21.15.82:40622) 2023-07-20T10:02:22.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f8786ffd640 1 -- 172.21.15.82:0/3371285619 learned_addr learned my addr 172.21.15.82:0/3371285619 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878f7fe640 1 --2- 172.21.15.82:0/3371285619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f879015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179072965 0 0) 0x7f87900cc8d0 con 0x7f8790159830 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f877c003530 con 0x7f8790159830 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320946580 0 0) 0x7f87900ccbb0 con 0x7f87900afd50 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87900cc8d0 con 0x7f87900afd50 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878f7fe640 1 -- 172.21.15.82:0/3371285619 >> v1:172.21.15.183:6789/0 conn(0x7f87900afd50 legacy=0x7f879015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878f7fe640 1 -- 172.21.15.82:0/3371285619 >> v1:172.21.15.82:6789/0 conn(0x7f8790159830 legacy=0x7f87900cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.915+0000 7f878f7fe640 1 -- 172.21.15.82:0/3371285619 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790159cc0 con 0x7f8790159450 2023-07-20T10:02:22.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f878f7fe640 1 --2- 172.21.15.82:0/3371285619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f879015a4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87800097f0 tx=0x7f878001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfd5dd38843ccce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800ab600 con 0x7f8790159450 2023-07-20T10:02:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87800a7050 con 0x7f8790159450 2023-07-20T10:02:22.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f878effd640 1 -- 172.21.15.82:0/3371285619 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800ab980 con 0x7f8790159450 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- 172.21.15.82:0/3371285619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 msgr2=0x7f879015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 --2- 172.21.15.82:0/3371285619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f879015a4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f87800097f0 tx=0x7f878001c490 comp rx=0 tx=0).stop 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- 172.21.15.82:0/3371285619 shutdown_connections 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 --2- 172.21.15.82:0/3371285619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f879015a4c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- 172.21.15.82:0/3371285619 >> 172.21.15.82:0/3371285619 conn(0x7f87900cad50 msgr2=0x7f87900cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- 172.21.15.82:0/3371285619 shutdown_connections 2023-07-20T10:02:22.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- 172.21.15.82:0/3371285619 wait complete. 2023-07-20T10:02:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 Processor -- start 2023-07-20T10:02:22.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.919+0000 7f8795f8f640 1 -- start start 2023-07-20T10:02:22.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 0x7f87900aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f87900b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900ab890 con 0x7f87900b0ba0 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900abb70 con 0x7f87900afd50 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8790150e10 con 0x7f8790159450 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39904/0 (socket says 172.21.15.82:39904) 2023-07-20T10:02:22.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 -- 172.21.15.82:0/1669673961 learned_addr learned my addr 172.21.15.82:0/1669673961 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878f7fe640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 0x7f87900aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8786ffd640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f87900b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 -- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 msgr2=0x7f87900b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f87900b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 -- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 msgr2=0x7f87900aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:22.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 0x7f87900aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 -- 172.21.15.82:0/1669673961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009420 con 0x7f87900b0ba0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878f7fe640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 0x7f87900aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878ffff640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f878800c7c0 tx=0x7f878800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8788003b80 con 0x7f87900b0ba0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8788003ce0 con 0x7f87900b0ba0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878800a9f0 con 0x7f87900b0ba0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87901510f0 con 0x7f87900b0ba0 2023-07-20T10:02:22.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87901509e0 con 0x7f87900b0ba0 2023-07-20T10:02:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879004da30 con 0x7f87900b0ba0 2023-07-20T10:02:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.923+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f878800ab50 con 0x7f87900b0ba0 2023-07-20T10:02:22.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.927+0000 7f878cff9640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 0x7f8770068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.927+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8788084070 con 0x7f87900b0ba0 2023-07-20T10:02:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.927+0000 7f878f7fe640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 0x7f8770068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:22.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.927+0000 7f878f7fe640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 0x7f8770068940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87800ad000 tx=0x7f87800a6000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:22.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:22.931+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8788051150 con 0x7f87900b0ba0 2023-07-20T10:02:23.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.099+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f879015dbc0 con 0x7f8770066480 2023-07-20T10:02:23.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.159+0000 7f878cff9640 1 -- 172.21.15.82:0/1669673961 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f87800bc0d0 con 0x7f8770066480 2023-07-20T10:02:23.149 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-07-20T10:02:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 msgr2=0x7f8770068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 0x7f8770068940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87800ad000 tx=0x7f87800a6000 comp rx=0 tx=0).stop 2023-07-20T10:02:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 msgr2=0x7f879014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f878800c7c0 tx=0x7f878800cc80 comp rx=0 tx=0).stop 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 shutdown_connections 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8770066480 0x7f8770068940 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87900b0ba0 0x7f879014e890 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8790159450 0x7f87900b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 --2- 172.21.15.82:0/1669673961 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87900afd50 0x7f87900aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 >> 172.21.15.82:0/1669673961 conn(0x7f87900cad50 msgr2=0x7f879006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:23.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 shutdown_connections 2023-07-20T10:02:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.163+0000 7f8795f8f640 1 -- 172.21.15.82:0/1669673961 wait complete. 2023-07-20T10:02:23.170 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-07-20T10:02:23.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-20T10:02:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 Processor -- start 2023-07-20T10:02:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 -- start start 2023-07-20T10:02:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f20e806c120 0x7f20e80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e80d0970 con 0x7f20e806b220 2023-07-20T10:02:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e8160e20 con 0x7f20e81602b0 2023-07-20T10:02:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ef903640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e80cd300 con 0x7f20e806c120 2023-07-20T10:02:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20edea0640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f20e806b220 0x7f20e80d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58226/0 (socket says 172.21.15.82:58226) 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20edea0640 1 -- 172.21.15.82:0/2404234472 learned_addr learned my addr 172.21.15.82:0/2404234472 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ed69f640 1 --2- 172.21.15.82:0/2404234472 >> v2:172.21.15.183:3300/0 conn(0x7f20e806c120 0x7f20e80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243261830 0 0) 0x7f20e80d0970 con 0x7f20e806b220 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d4003530 con 0x7f20e806b220 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910367720 0 0) 0x7f20e8160e20 con 0x7f20e81602b0 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e80d0970 con 0x7f20e81602b0 2023-07-20T10:02:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ed69f640 1 -- 172.21.15.82:0/2404234472 >> v1:172.21.15.183:6789/0 conn(0x7f20e81602b0 legacy=0x7f20e806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ed69f640 1 -- 172.21.15.82:0/2404234472 >> v1:172.21.15.82:6789/0 conn(0x7f20e806b220 legacy=0x7f20e80d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3162786432 0 0) 0x7f20d4003530 con 0x7f20e806b220 2023-07-20T10:02:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.327+0000 7f20ed69f640 1 -- 172.21.15.82:0/2404234472 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e80cd5e0 con 0x7f20e806c120 2023-07-20T10:02:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ed69f640 1 --2- 172.21.15.82:0/2404234472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e80cdde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097c0 tx=0x7f20e401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c746c490d35504 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e0001a00 con 0x7f20e806c120 2023-07-20T10:02:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40a7050 con 0x7f20e806c120 2023-07-20T10:02:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20dffff640 1 -- 172.21.15.82:0/2404234472 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40ab600 con 0x7f20e806c120 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 -- 172.21.15.82:0/2404234472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 msgr2=0x7f20e80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 --2- 172.21.15.82:0/2404234472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e80cdde0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f20e40097c0 tx=0x7f20e401c250 comp rx=0 tx=0).stop 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 -- 172.21.15.82:0/2404234472 shutdown_connections 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 --2- 172.21.15.82:0/2404234472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e80cdde0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 -- 172.21.15.82:0/2404234472 >> 172.21.15.82:0/2404234472 conn(0x7f20e808c0a0 msgr2=0x7f20e809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 -- 172.21.15.82:0/2404234472 shutdown_connections 2023-07-20T10:02:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.331+0000 7f20ef903640 1 -- 172.21.15.82:0/2404234472 wait complete. 2023-07-20T10:02:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 Processor -- start 2023-07-20T10:02:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- start start 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e8156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 0x7f20e80b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8151bc0 con 0x7f20e806b220 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c8500 con 0x7f20e806c120 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80c87e0 con 0x7f20e81602b0 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39004/0 (socket says 172.21.15.82:39004) 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 -- 172.21.15.82:0/2448654500 learned_addr learned my addr 172.21.15.82:0/2448654500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ece9e640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e8156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20edea0640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 0x7f20e80b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 -- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 msgr2=0x7f20e80b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 0x7f20e80b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 -- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 msgr2=0x7f20e8156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e8156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 -- 172.21.15.82:0/2448654500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4009420 con 0x7f20e806b220 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ece9e640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20edea0640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 0x7f20e80b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ed69f640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c10 tx=0x7f20e4018ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40abe70 con 0x7f20e806b220 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e40b4400 con 0x7f20e806b220 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40b4770 con 0x7f20e806b220 2023-07-20T10:02:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80c8ac0 con 0x7f20e806b220 2023-07-20T10:02:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.335+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e8151fc0 con 0x7f20e806b220 2023-07-20T10:02:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e804da30 con 0x7f20e806b220 2023-07-20T10:02:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f20e40b2040 con 0x7f20e806b220 2023-07-20T10:02:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ddffb640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 0x7f20cc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f20e411e770 con 0x7f20e806b220 2023-07-20T10:02:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ece9e640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 0x7f20cc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.339+0000 7f20ece9e640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 0x7f20cc068940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20e80cca30 tx=0x7f20d8009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.343+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20e40eb8b0 con 0x7f20e806b220 2023-07-20T10:02:23.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.507+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f20e8160ad0 con 0x7f20cc066480 2023-07-20T10:02:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.567+0000 7f20ddffb640 1 -- 172.21.15.82:0/2448654500 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f20d8001360 con 0x7f20cc066480 2023-07-20T10:02:23.557 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-07-20T10:02:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 msgr2=0x7f20cc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 0x7f20cc068940 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20e80cca30 tx=0x7f20d8009040 comp rx=0 tx=0).stop 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 msgr2=0x7f20e8151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c10 tx=0x7f20e4018ff0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 shutdown_connections 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f20cc066480 0x7f20cc068940 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20e81602b0 0x7f20e80b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20e806c120 0x7f20e8156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 --2- 172.21.15.82:0/2448654500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20e806b220 0x7f20e8151680 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 >> 172.21.15.82:0/2448654500 conn(0x7f20e808c0a0 msgr2=0x7f20e80d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 shutdown_connections 2023-07-20T10:02:23.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.571+0000 7f20ef903640 1 -- 172.21.15.82:0/2448654500 wait complete. 2023-07-20T10:02:23.578 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-07-20T10:02:23.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-20T10:02:23.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 Processor -- start 2023-07-20T10:02:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 -- start start 2023-07-20T10:02:23.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd13806e300 0x7fd13815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13806e750 con 0x7fd1380ccf10 2023-07-20T10:02:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1381601b0 con 0x7fd13806e300 2023-07-20T10:02:23.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13f0cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13806a1d0 con 0x7fd138160bc0 2023-07-20T10:02:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13d668640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd13806e300 0x7fd13815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13ce67640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fd1380ccf10 0x7fd138069750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:45740/0 (socket says 172.21.15.82:45740) 2023-07-20T10:02:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:45116/0 (socket says 172.21.15.82:45116) 2023-07-20T10:02:23.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd13ce67640 1 -- 172.21.15.82:0/3718132793 learned_addr learned my addr 172.21.15.82:0/3718132793 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 -- 172.21.15.82:0/3718132793 >> v2:172.21.15.183:3300/0 conn(0x7fd13806e300 msgr2=0x7fd13815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 --2- 172.21.15.82:0/3718132793 >> v2:172.21.15.183:3300/0 conn(0x7fd13806e300 0x7fd13815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 -- 172.21.15.82:0/3718132793 >> v1:172.21.15.183:6789/0 conn(0x7fd1380ccf10 legacy=0x7fd138069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.735+0000 7fd137fff640 1 -- 172.21.15.82:0/3718132793 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13806a4b0 con 0x7fd138160bc0 2023-07-20T10:02:23.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd137fff640 1 --2- 172.21.15.82:0/3718132793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1240097c0 tx=0x7fd12401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c05b7be26cf9f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd1377fe640 1 -- 172.21.15.82:0/3718132793 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240ab650 con 0x7fd138160bc0 2023-07-20T10:02:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd1377fe640 1 -- 172.21.15.82:0/3718132793 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240ab7b0 con 0x7fd138160bc0 2023-07-20T10:02:23.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd1377fe640 1 -- 172.21.15.82:0/3718132793 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1240abb40 con 0x7fd138160bc0 2023-07-20T10:02:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 -- 172.21.15.82:0/3718132793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 msgr2=0x7fd13806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/3718132793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1240097c0 tx=0x7fd12401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 -- 172.21.15.82:0/3718132793 shutdown_connections 2023-07-20T10:02:23.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/3718132793 >> v2:172.21.15.183:3300/0 conn(0x7fd13806e300 0x7fd13815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/3718132793 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd138160bc0 0x7fd13806ddc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 -- 172.21.15.82:0/3718132793 >> 172.21.15.82:0/3718132793 conn(0x7fd1380cf070 msgr2=0x7fd1380cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 -- 172.21.15.82:0/3718132793 shutdown_connections 2023-07-20T10:02:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.739+0000 7fd13f0cb640 1 -- 172.21.15.82:0/3718132793 wait complete. 2023-07-20T10:02:23.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 Processor -- start 2023-07-20T10:02:23.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- start start 2023-07-20T10:02:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1380ccf10 0x7fd1380b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd138160bc0 0x7fd138155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380aefc0 con 0x7fd13806e300 2023-07-20T10:02:23.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380af820 con 0x7fd138160bc0 2023-07-20T10:02:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381540b0 con 0x7fd1380ccf10 2023-07-20T10:02:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39008/0 (socket says 172.21.15.82:39008) 2023-07-20T10:02:23.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 -- 172.21.15.82:0/1995009378 learned_addr learned my addr 172.21.15.82:0/1995009378 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd137fff640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1380ccf10 0x7fd1380b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13d668640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd138160bc0 0x7fd138155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 -- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1380ccf10 msgr2=0x7fd1380b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1380ccf10 0x7fd1380b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 -- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd138160bc0 msgr2=0x7fd138155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd138160bc0 0x7fd138155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 -- 172.21.15.82:0/1995009378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124009420 con 0x7fd13806e300 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13ce67640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c500 tx=0x7fd12c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c005cf0 con 0x7fd13806e300 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c005e50 con 0x7fd13806e300 2023-07-20T10:02:23.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380af1d0 con 0x7fd13806e300 2023-07-20T10:02:23.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c0072f0 con 0x7fd13806e300 2023-07-20T10:02:23.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.743+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380b2e90 con 0x7fd13806e300 2023-07-20T10:02:23.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13804da30 con 0x7fd13806e300 2023-07-20T10:02:23.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fd12c007450 con 0x7fd13806e300 2023-07-20T10:02:23.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd1357fa640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 0x7fd11c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:23.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fd12c0834a0 con 0x7fd13806e300 2023-07-20T10:02:23.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd137fff640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 0x7fd11c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:23.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.747+0000 7fd137fff640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 0x7fd11c068940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd1240af000 tx=0x7fd1240b6040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:23.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.751+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd12c0506c0 con 0x7fd13806e300 2023-07-20T10:02:23.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.915+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd138069e60 con 0x7fd11c066480 2023-07-20T10:02:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.975+0000 7fd1357fa640 1 -- 172.21.15.82:0/1995009378 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd1240ab920 con 0x7fd11c066480 2023-07-20T10:02:23.965 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 msgr2=0x7fd11c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 0x7fd11c068940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd1240af000 tx=0x7fd1240b6040 comp rx=0 tx=0).stop 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 msgr2=0x7fd1380b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c500 tx=0x7fd12c00c9c0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 shutdown_connections 2023-07-20T10:02:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fd11c066480 0x7fd11c068940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd138160bc0 0x7fd138155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1380ccf10 0x7fd1380b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 --2- 172.21.15.82:0/1995009378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd13806e300 0x7fd1380b4380 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 >> 172.21.15.82:0/1995009378 conn(0x7fd1380cf070 msgr2=0x7fd1380acae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 shutdown_connections 2023-07-20T10:02:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:23.979+0000 7fd13f0cb640 1 -- 172.21.15.82:0/1995009378 wait complete. 2023-07-20T10:02:23.985 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-07-20T10:02:23.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:23.986 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-20T10:02:23.998 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:23.999 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:24.000 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:24.000 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:24.000 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:24.001 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:24.001 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-07-20T10:02:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 Processor -- start 2023-07-20T10:02:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 -- start start 2023-07-20T10:02:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae60159830 0x7fae600cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae600cc3e0 0x7fae600afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae600cc8d0 con 0x7fae60159450 2023-07-20T10:02:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600cce90 con 0x7fae600cc3e0 2023-07-20T10:02:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae66ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600ccbb0 con 0x7fae60159830 2023-07-20T10:02:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae64d96640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fae60159450 0x7fae6015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58238/0 (socket says 172.21.15.82:58238) 2023-07-20T10:02:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae64d96640 1 -- 172.21.15.82:0/1425996620 learned_addr learned my addr 172.21.15.82:0/1425996620 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:24.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae65597640 1 --2- 172.21.15.82:0/1425996620 >> v2:172.21.15.183:3300/0 conn(0x7fae600cc3e0 0x7fae600afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340562522 0 0) 0x7fae600cc8d0 con 0x7fae60159450 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae60159830 0x7fae600cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae50005740 con 0x7fae60159450 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2683202799 0 0) 0x7fae50005740 con 0x7fae60159450 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae60159830 msgr2=0x7fae600cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae60159830 0x7fae600cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 >> v2:172.21.15.183:3300/0 conn(0x7fae600cc3e0 msgr2=0x7fae600afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 --2- 172.21.15.82:0/1425996620 >> v2:172.21.15.183:3300/0 conn(0x7fae600cc3e0 0x7fae600afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae60159cc0 con 0x7fae60159450 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fae54001a20 con 0x7fae60159450 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 >> v1:172.21.15.82:6789/0 conn(0x7fae60159450 legacy=0x7fae6015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae50005c00 0x7fae50006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae500069e0 0x7fae50006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae500073a0 0x7fae5000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600cce90 con 0x7fae500069e0 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600ccbb0 con 0x7fae500073a0 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5000e0e0 con 0x7fae50005c00 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae65597640 1 --2- 172.21.15.82:0/1425996620 >> v2:172.21.15.183:3300/0 conn(0x7fae600cc3e0 0x7fae600afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae500069e0 0x7fae50006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.195+0000 7fae64d96640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae50005c00 0x7fae50006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae65597640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae500073a0 0x7fae5000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 -- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae50005c00 msgr2=0x7fae50006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae50005c00 0x7fae50006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 -- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae500073a0 msgr2=0x7fae5000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae500073a0 0x7fae5000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 -- 172.21.15.82:0/1425996620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50005740 con 0x7fae500069e0 2023-07-20T10:02:24.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae500069e0 0x7fae50006e60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0099d0 tx=0x7fae4c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fdc984877bc35a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a8460 con 0x7fae500069e0 2023-07-20T10:02:24.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c0a85c0 con 0x7fae500069e0 2023-07-20T10:02:24.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae5f7fe640 1 -- 172.21.15.82:0/1425996620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0a8970 con 0x7fae500069e0 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae66ffa640 1 -- 172.21.15.82:0/1425996620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae500069e0 msgr2=0x7fae50006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1425996620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae500069e0 0x7fae50006e60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0099d0 tx=0x7fae4c01c8b0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.199+0000 7fae65597640 1 -- 172.21.15.82:0/1425996620 reap_dead start 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- 172.21.15.82:0/1425996620 shutdown_connections 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- 172.21.15.82:0/1425996620 >> 172.21.15.82:0/1425996620 conn(0x7fae600cad50 msgr2=0x7fae600cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- 172.21.15.82:0/1425996620 shutdown_connections 2023-07-20T10:02:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- 172.21.15.82:0/1425996620 wait complete. 2023-07-20T10:02:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 Processor -- start 2023-07-20T10:02:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- start start 2023-07-20T10:02:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae500069e0 0x7fae60147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae600ab890 0x7fae6006b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae60147ec0 con 0x7fae600abcf0 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6014a2f0 con 0x7fae600ab890 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae66ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6014a5d0 con 0x7fae500069e0 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39034/0 (socket says 172.21.15.82:39034) 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae64d96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae500069e0 0x7fae60147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 -- 172.21.15.82:0/1987826517 learned_addr learned my addr 172.21.15.82:0/1987826517 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae5ffff640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae600ab890 0x7fae6006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 -- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae500069e0 msgr2=0x7fae60147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae500069e0 0x7fae60147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 -- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae600ab890 msgr2=0x7fae6006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae600ab890 0x7fae6006b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.203+0000 7fae65597640 1 -- 172.21.15.82:0/1987826517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6014a8b0 con 0x7fae600abcf0 2023-07-20T10:02:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae65597640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae600c1da0 tx=0x7fae58011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800fa40 con 0x7fae600abcf0 2023-07-20T10:02:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800fba0 con 0x7fae600abcf0 2023-07-20T10:02:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6014ab90 con 0x7fae600abcf0 2023-07-20T10:02:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58014440 con 0x7fae600abcf0 2023-07-20T10:02:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae60156590 con 0x7fae600abcf0 2023-07-20T10:02:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6004da30 con 0x7fae600abcf0 2023-07-20T10:02:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fae580145a0 con 0x7fae600abcf0 2023-07-20T10:02:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.207+0000 7fae5d7fa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 0x7fae44068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.211+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fae58084580 con 0x7fae600abcf0 2023-07-20T10:02:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.211+0000 7fae64d96640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 0x7fae44068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.211+0000 7fae64d96640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 0x7fae44068940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae54000f90 tx=0x7fae5400a060 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.211+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae580515c0 con 0x7fae600abcf0 2023-07-20T10:02:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.379+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae60159fa0 con 0x7fae44066480 2023-07-20T10:02:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae5d7fa640 1 -- 172.21.15.82:0/1987826517 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fae54001980 con 0x7fae44066480 2023-07-20T10:02:24.375 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:24.375 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:36", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 msgr2=0x7fae44068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 0x7fae44068940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae54000f90 tx=0x7fae5400a060 comp rx=0 tx=0).stop 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 msgr2=0x7fae6006bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fae600c1da0 tx=0x7fae58011d70 comp rx=0 tx=0).stop 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 shutdown_connections 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae44066480 0x7fae44068940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae600abcf0 0x7fae6006bb60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae600ab890 0x7fae6006b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 --2- 172.21.15.82:0/1987826517 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae500069e0 0x7fae60147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 >> 172.21.15.82:0/1987826517 conn(0x7fae600cad50 msgr2=0x7fae6015b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 shutdown_connections 2023-07-20T10:02:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.387+0000 7fae66ffa640 1 -- 172.21.15.82:0/1987826517 wait complete. 2023-07-20T10:02:24.395 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:36", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:24.396 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:36', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:24.396 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:24.396 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:24.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:24.397 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-20T10:02:24.406 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:24.407 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:24.408 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:24.408 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:24.408 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:24.409 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:24.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-07-20T10:02:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 Processor -- start 2023-07-20T10:02:24.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 -- start start 2023-07-20T10:02:24.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe8e8159450 0x7fe8e815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e8159830 0x7fe8e80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80cc8d0 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80cce90 con 0x7fe8e8159450 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8ede0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ccbb0 con 0x7fe8e8159830 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe8e80cc3e0 0x7fe8e80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58246/0 (socket says 172.21.15.82:58246) 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e7fff640 1 -- 172.21.15.82:0/756086164 learned_addr learned my addr 172.21.15.82:0/756086164 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/756086164 >> v2:172.21.15.183:3300/0 conn(0x7fe8e8159450 0x7fe8e815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8deffd640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e8159830 0x7fe8e80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e6ffd640 1 -- 172.21.15.82:0/756086164 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659192374 0 0) 0x7fe8e80cc8d0 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e6ffd640 1 -- 172.21.15.82:0/756086164 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003530 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e77fe640 1 -- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e8159830 msgr2=0x7fe8e80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:24.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e8159830 0x7fe8e80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e77fe640 1 -- 172.21.15.82:0/756086164 >> v1:172.21.15.82:6789/0 conn(0x7fe8e80cc3e0 legacy=0x7fe8e80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.603+0000 7fe8e77fe640 1 -- 172.21.15.82:0/756086164 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8159cc0 con 0x7fe8e8159450 2023-07-20T10:02:24.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815a4c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097c0 tx=0x7fe8d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5ee03dfc2cb347f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8e6ffd640 1 -- 172.21.15.82:0/756086164 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80a7070 con 0x7fe8e8159450 2023-07-20T10:02:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8e6ffd640 1 -- 172.21.15.82:0/756086164 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d80ab430 con 0x7fe8e8159450 2023-07-20T10:02:24.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8e6ffd640 1 -- 172.21.15.82:0/756086164 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80ab7c0 con 0x7fe8e8159450 2023-07-20T10:02:24.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 -- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 msgr2=0x7fe8e815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815a4c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097c0 tx=0x7fe8d801c450 comp rx=0 tx=0).stop 2023-07-20T10:02:24.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 -- 172.21.15.82:0/756086164 shutdown_connections 2023-07-20T10:02:24.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e8159830 0x7fe8e80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/756086164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815a4c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 -- 172.21.15.82:0/756086164 >> 172.21.15.82:0/756086164 conn(0x7fe8e80cad50 msgr2=0x7fe8e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:24.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 -- 172.21.15.82:0/756086164 shutdown_connections 2023-07-20T10:02:24.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.607+0000 7fe8ede0b640 1 -- 172.21.15.82:0/756086164 wait complete. 2023-07-20T10:02:24.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 Processor -- start 2023-07-20T10:02:24.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- start start 2023-07-20T10:02:24.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 0x7fe8e80c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c6230 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c53a0 con 0x7fe8e8159450 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c55b0 con 0x7fe8e80c6650 2023-07-20T10:02:24.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39040/0 (socket says 172.21.15.82:39040) 2023-07-20T10:02:24.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 -- 172.21.15.82:0/2196435120 learned_addr learned my addr 172.21.15.82:0/2196435120 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e7fff640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 0x7fe8e80c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8deffd640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 -- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 msgr2=0x7fe8e80c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 0x7fe8e80c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 -- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 msgr2=0x7fe8e815b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 -- 172.21.15.82:0/2196435120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8009420 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e7fff640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 0x7fe8e80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8deffd640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e77fe640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80ad040 tx=0x7fe8d80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80bc070 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d80b43f0 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e80c5890 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80b47a0 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.611+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80c5e50 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80c6370 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe8d80b4900 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8e4ff9640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 0x7fe8c8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fe8d811dea0 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8deffd640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 0x7fe8c8068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.615+0000 7fe8deffd640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 0x7fe8c8068940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cd9d0 tx=0x7fe8d000b040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.619+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8e80c6370 con 0x7fe8e80cc3e0 2023-07-20T10:02:24.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.783+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8e80b0460 con 0x7fe8c8066480 2023-07-20T10:02:24.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8e4ff9640 1 -- 172.21.15.82:0/2196435120 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe8d000f050 con 0x7fe8c8066480 2023-07-20T10:02:24.779 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:24.779 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 msgr2=0x7fe8c8068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 0x7fe8c8068940 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80cd9d0 tx=0x7fe8d000b040 comp rx=0 tx=0).stop 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 msgr2=0x7fe8e80c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80ad040 tx=0x7fe8d80191f0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 shutdown_connections 2023-07-20T10:02:24.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe8c8066480 0x7fe8c8068940 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe8e80c6650 0x7fe8e80c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe8e8159450 0x7fe8e815b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 --2- 172.21.15.82:0/2196435120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe8e80cc3e0 0x7fe8e80c7cd0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 >> 172.21.15.82:0/2196435120 conn(0x7fe8e80cad50 msgr2=0x7fe8e80713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 shutdown_connections 2023-07-20T10:02:24.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:24.791+0000 7fe8ede0b640 1 -- 172.21.15.82:0/2196435120 wait complete. 2023-07-20T10:02:24.800 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:24.800 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:37', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:24.801 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:24.801 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:24.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:24.801 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-20T10:02:24.811 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:24.812 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:24.813 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:24.813 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:24.813 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:24.813 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:24.814 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:24.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-07-20T10:02:24.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 Processor -- start 2023-07-20T10:02:25.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 -- start start 2023-07-20T10:02:25.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ec00ad580 0x7f9ec00ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec0160390 con 0x7f9ec00afd50 2023-07-20T10:02:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00cc1d0 con 0x7f9ec0160820 2023-07-20T10:02:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ec5503640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00cc4b0 con 0x7f9ec00ad580 2023-07-20T10:02:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebeffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ec00afd50 0x7f9ec00b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58256/0 (socket says 172.21.15.82:58256) 2023-07-20T10:02:25.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebeffd640 1 -- 172.21.15.82:0/907785563 learned_addr learned my addr 172.21.15.82:0/907785563 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:25.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9eb67fc640 1 --2- 172.21.15.82:0/907785563 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00ad580 0x7f9ec00ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854843477 0 0) 0x7f9ec0160390 con 0x7f9ec00afd50 2023-07-20T10:02:25.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eac003530 con 0x7f9ec00afd50 2023-07-20T10:02:25.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4039101416 0 0) 0x7f9eac003530 con 0x7f9ec00afd50 2023-07-20T10:02:25.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00ad580 msgr2=0x7f9ec00ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 --2- 172.21.15.82:0/907785563 >> v2:172.21.15.183:3300/0 conn(0x7f9ec00ad580 0x7f9ec00ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 >> v1:172.21.15.183:6789/0 conn(0x7f9ec0160820 legacy=0x7f9ec0160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00cc790 con 0x7f9ec00afd50 2023-07-20T10:02:25.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f9eb0001680 con 0x7f9ec00afd50 2023-07-20T10:02:25.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 >> v1:172.21.15.82:6789/0 conn(0x7f9ec00afd50 legacy=0x7f9ec00b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac0039f0 0x7f9eac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eac0047d0 0x7f9eac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.011+0000 7f9ebe7fc640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 0x7f9eac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00cc4b0 con 0x7f9eac005190 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac00c010 con 0x7f9eac0039f0 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac00c1d0 con 0x7f9eac0047d0 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac0039f0 0x7f9eac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 0x7f9eac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9eb67fc640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eac0047d0 0x7f9eac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eac0047d0 msgr2=0x7f9eac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eac0047d0 0x7f9eac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac0039f0 msgr2=0x7f9eac003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac0039f0 0x7f9eac003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/907785563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac003530 con 0x7f9eac005190 2023-07-20T10:02:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/907785563 reap_dead start 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 0x7f9eac00b990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8001f60 tx=0x7f9eb801c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3083f1bd0ad84cb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0007ea0 con 0x7f9eac005190 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb80a5750 con 0x7f9eac005190 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.015+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/907785563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80a5ae0 con 0x7f9eac005190 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 msgr2=0x7f9eac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 0x7f9eac00b990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8001f60 tx=0x7f9eb801c860 comp rx=0 tx=0).stop 2023-07-20T10:02:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- 172.21.15.82:0/907785563 shutdown_connections 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 --2- 172.21.15.82:0/907785563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eac005190 0x7f9eac00b990 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- 172.21.15.82:0/907785563 >> 172.21.15.82:0/907785563 conn(0x7f9ec00cad50 msgr2=0x7f9ec00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- 172.21.15.82:0/907785563 shutdown_connections 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- 172.21.15.82:0/907785563 wait complete. 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 Processor -- start 2023-07-20T10:02:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- start start 2023-07-20T10:02:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac005190 0x7f9ec00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015c9d0 0x7f9ec0153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00b3ab0 con 0x7f9ec01541e0 2023-07-20T10:02:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00c2bf0 con 0x7f9eac005190 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ec5503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01549f0 con 0x7f9ec015c9d0 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39056/0 (socket says 172.21.15.82:39056) 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/3323872341 learned_addr learned my addr 172.21.15.82:0/3323872341 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac005190 0x7f9ec00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.019+0000 7f9eb67fc640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015c9d0 0x7f9ec0153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015c9d0 msgr2=0x7f9ec0153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015c9d0 0x7f9ec0153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac005190 msgr2=0x7f9ec00b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac005190 0x7f9ec00b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/3323872341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00c2e60 con 0x7f9ec01541e0 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9eb801d100 tx=0x7f9eac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8006d70 con 0x7f9ec01541e0 2023-07-20T10:02:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb80a58c0 con 0x7f9ec01541e0 2023-07-20T10:02:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80a5c30 con 0x7f9ec01541e0 2023-07-20T10:02:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec00c3140 con 0x7f9ec01541e0 2023-07-20T10:02:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec00b3ce0 con 0x7f9ec01541e0 2023-07-20T10:02:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec004da30 con 0x7f9ec01541e0 2023-07-20T10:02:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9eb80050e0 con 0x7f9ec01541e0 2023-07-20T10:02:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.023+0000 7f9eb7fff640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 0x7f9ea0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.027+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9eb811d950 con 0x7f9ec01541e0 2023-07-20T10:02:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.027+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 0x7f9ea0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.027+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 0x7f9ea0068970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0001060 tx=0x7f9eb0001160 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.027+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9eb80ea990 con 0x7f9ec01541e0 2023-07-20T10:02:25.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.191+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ec00cca70 con 0x7f9ea00664b0 2023-07-20T10:02:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.199+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3323872341 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9eb0005550 con 0x7f9ea00664b0 2023-07-20T10:02:25.188 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:25.188 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 msgr2=0x7f9ea0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 0x7f9ea0068970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0001060 tx=0x7f9eb0001160 comp rx=0 tx=0).stop 2023-07-20T10:02:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 msgr2=0x7f9ec00ac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9eb801d100 tx=0x7f9eac005800 comp rx=0 tx=0).stop 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 shutdown_connections 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9ea00664b0 0x7f9ea0068970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec01541e0 0x7f9ec00ac730 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015c9d0 0x7f9ec0153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 --2- 172.21.15.82:0/3323872341 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eac005190 0x7f9ec00b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 >> 172.21.15.82:0/3323872341 conn(0x7f9ec00cad50 msgr2=0x7f9ec00c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 shutdown_connections 2023-07-20T10:02:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.203+0000 7f9ec5503640 1 -- 172.21.15.82:0/3323872341 wait complete. 2023-07-20T10:02:25.209 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:25.209 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:37', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:25.209 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:25.210 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:25.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:25.210 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:25.221 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_01_UTC 2023-07-20T10:02:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:25.222 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:25.223 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_01_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:25.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-07-20T10:02:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 Processor -- start 2023-07-20T10:02:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 -- start start 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d4159450 0x7fb9d415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb9d4159830 0x7fb9d40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9d40cc3e0 0x7fb9d40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40cce90 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40cc8d0 con 0x7fb9d4159830 2023-07-20T10:02:25.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9dbf8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40ccbb0 con 0x7fb9d4159450 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9d40cc3e0 0x7fb9d40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9d40cc3e0 0x7fb9d40afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39062/0 (socket says 172.21.15.82:39062) 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 -- 172.21.15.82:0/180377465 learned_addr learned my addr 172.21.15.82:0/180377465 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9d9d2b640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d4159450 0x7fb9d415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9d952a640 1 --2- 172.21.15.82:0/180377465 >> v2:172.21.15.183:3300/0 conn(0x7fb9d4159830 0x7fb9d40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 -- 172.21.15.82:0/180377465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d4159450 msgr2=0x7fb9d415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d4159450 0x7fb9d415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 -- 172.21.15.82:0/180377465 >> v2:172.21.15.183:3300/0 conn(0x7fb9d4159830 msgr2=0x7fb9d40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 --2- 172.21.15.82:0/180377465 >> v2:172.21.15.183:3300/0 conn(0x7fb9d4159830 0x7fb9d40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.419+0000 7fb9da52c640 1 -- 172.21.15.82:0/180377465 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4159cc0 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9da52c640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d40cc3e0 0x7fb9d40afd50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb9d406a5d0 tx=0x7fb9cc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77522cb38aa28906 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9d8d29640 1 -- 172.21.15.82:0/180377465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a5730 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9d8d29640 1 -- 172.21.15.82:0/180377465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0a5890 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9d8d29640 1 -- 172.21.15.82:0/180377465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0a5c20 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/180377465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d40cc3e0 msgr2=0x7fb9d40afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d40cc3e0 0x7fb9d40afd50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb9d406a5d0 tx=0x7fb9cc01c9a0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/180377465 shutdown_connections 2023-07-20T10:02:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/180377465 >> v2:172.21.15.183:3300/0 conn(0x7fb9d4159830 0x7fb9d40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d40cc3e0 0x7fb9d40afd50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/180377465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d4159450 0x7fb9d415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/180377465 >> 172.21.15.82:0/180377465 conn(0x7fb9d40cad50 msgr2=0x7fb9d40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/180377465 shutdown_connections 2023-07-20T10:02:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.423+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/180377465 wait complete. 2023-07-20T10:02:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 Processor -- start 2023-07-20T10:02:25.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- start start 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d40cc3e0 0x7fb9d40a8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 0x7fb9d4154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d41f4e90 con 0x7fb9d4159450 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d41f5130 con 0x7fb9d40a79c0 2023-07-20T10:02:25.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40ac580 con 0x7fb9d40cc3e0 2023-07-20T10:02:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39074/0 (socket says 172.21.15.82:39074) 2023-07-20T10:02:25.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 -- 172.21.15.82:0/4132950636 learned_addr learned my addr 172.21.15.82:0/4132950636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d9d2b640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d40cc3e0 0x7fb9d40a8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 -- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d40cc3e0 msgr2=0x7fb9d40a8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9da52c640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 0x7fb9d4154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d40cc3e0 0x7fb9d40a8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 -- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 msgr2=0x7fb9d4154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 0x7fb9d4154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 -- 172.21.15.82:0/4132950636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc009b30 con 0x7fb9d4159450 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9da52c640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 0x7fb9d4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9d952a640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400d620 tx=0x7fb9c400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400b620 con 0x7fb9d4159450 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400b780 con 0x7fb9d4159450 2023-07-20T10:02:25.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d40abce0 con 0x7fb9d4159450 2023-07-20T10:02:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400bb10 con 0x7fb9d4159450 2023-07-20T10:02:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.427+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d40ac070 con 0x7fb9d4159450 2023-07-20T10:02:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d41f52a0 con 0x7fb9d4159450 2023-07-20T10:02:25.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fb9c400bc70 con 0x7fb9d4159450 2023-07-20T10:02:25.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9ca7fc640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 0x7fb9b8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fb9c4084720 con 0x7fb9d4159450 2023-07-20T10:02:25.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9d9d2b640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 0x7fb9b8068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.431+0000 7fb9d9d2b640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 0x7fb9b8068970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009710 tx=0x7fb9d0008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.435+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9c40517f0 con 0x7fb9d4159450 2023-07-20T10:02:25.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.599+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9d40cbbf0 con 0x7fb9b80664b0 2023-07-20T10:02:25.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.607+0000 7fb9ca7fc640 1 -- 172.21.15.82:0/4132950636 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fb9d40cbbf0 con 0x7fb9b80664b0 2023-07-20T10:02:25.597 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:25.597 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:25.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 msgr2=0x7fb9b8068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 0x7fb9b8068970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009710 tx=0x7fb9d0008040 comp rx=0 tx=0).stop 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 msgr2=0x7fb9d40a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400d620 tx=0x7fb9c400dae0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 shutdown_connections 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fb9b80664b0 0x7fb9b8068970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9d40a79c0 0x7fb9d4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d4159450 0x7fb9d40a7480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 --2- 172.21.15.82:0/4132950636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9d40cc3e0 0x7fb9d40a8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 >> 172.21.15.82:0/4132950636 conn(0x7fb9d40cad50 msgr2=0x7fb9d406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 shutdown_connections 2023-07-20T10:02:25.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.611+0000 7fb9dbf8f640 1 -- 172.21.15.82:0/4132950636 wait complete. 2023-07-20T10:02:25.617 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:37", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:25.618 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:37', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:25.618 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:25.618 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:25.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:25.619 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-20T10:02:25.629 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_01_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:25.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:25.631 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:25.631 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:25.631 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_01_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:25.632 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-07-20T10:02:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 Processor -- start 2023-07-20T10:02:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 -- start start 2023-07-20T10:02:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa25806f710 0x7fa25806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa25815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa258070030 con 0x7fa2580ca5a0 2023-07-20T10:02:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25815bad0 con 0x7fa25806f710 2023-07-20T10:02:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25f196640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa258071950 con 0x7fa25815a6f0 2023-07-20T10:02:25.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa2580ca5a0 0x7fa25815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58264/0 (socket says 172.21.15.82:58264) 2023-07-20T10:02:25.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24ffff640 1 -- 172.21.15.82:0/2727124847 learned_addr learned my addr 172.21.15.82:0/2727124847 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25d733640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa25815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 --2- 172.21.15.82:0/2727124847 >> v2:172.21.15.183:3300/0 conn(0x7fa25806f710 0x7fa25806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588538391 0 0) 0x7fa258070030 con 0x7fa2580ca5a0 2023-07-20T10:02:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa240003530 con 0x7fa2580ca5a0 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005122683 0 0) 0x7fa240003530 con 0x7fa2580ca5a0 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 msgr2=0x7fa25815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa25815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 >> v2:172.21.15.183:3300/0 conn(0x7fa25806f710 msgr2=0x7fa25806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 --2- 172.21.15.82:0/2727124847 >> v2:172.21.15.183:3300/0 conn(0x7fa25806f710 0x7fa25806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25815b230 con 0x7fa2580ca5a0 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fa248001680 con 0x7fa2580ca5a0 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 >> v1:172.21.15.82:6789/0 conn(0x7fa2580ca5a0 legacy=0x7fa25815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa240003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa2400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa240004d10 0x7fa240005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25815bad0 con 0x7fa2400039f0 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258071950 con 0x7fa240004d10 2023-07-20T10:02:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24000b990 con 0x7fa25815a6f0 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa240003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa24ffff640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa2400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25d733640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa240004d10 0x7fa240005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 -- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 msgr2=0x7fa2400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa25815a6f0 0x7fa2400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 -- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa240004d10 msgr2=0x7fa240005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa240004d10 0x7fa240005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.827+0000 7fa25cf32640 1 -- 172.21.15.82:0/2727124847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240003530 con 0x7fa2400039f0 2023-07-20T10:02:25.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25cf32640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa240003e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ae0 tx=0x7fa25401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49afeb6c528b078 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a5630 con 0x7fa2400039f0 2023-07-20T10:02:25.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540a5790 con 0x7fa2400039f0 2023-07-20T10:02:25.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa24f7fe640 1 -- 172.21.15.82:0/2727124847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a5b40 con 0x7fa2400039f0 2023-07-20T10:02:25.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 -- 172.21.15.82:0/2727124847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 msgr2=0x7fa240003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 --2- 172.21.15.82:0/2727124847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa240003e10 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ae0 tx=0x7fa25401ca60 comp rx=0 tx=0).stop 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25d733640 1 -- 172.21.15.82:0/2727124847 reap_dead start 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 -- 172.21.15.82:0/2727124847 shutdown_connections 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 -- 172.21.15.82:0/2727124847 >> 172.21.15.82:0/2727124847 conn(0x7fa2580cad50 msgr2=0x7fa2580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 -- 172.21.15.82:0/2727124847 shutdown_connections 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.831+0000 7fa25f196640 1 -- 172.21.15.82:0/2727124847 wait complete. 2023-07-20T10:02:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 Processor -- start 2023-07-20T10:02:25.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- start start 2023-07-20T10:02:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 0x7fa2580c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2581604e0 0x7fa258160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa258159430 con 0x7fa2400039f0 2023-07-20T10:02:25.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2581f3820 con 0x7fa2581604e0 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580c7670 con 0x7fa2580c68f0 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39100/0 (socket says 172.21.15.82:39100) 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 -- 172.21.15.82:0/321872930 learned_addr learned my addr 172.21.15.82:0/321872930 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa24ffff640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 0x7fa2580c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25d733640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2581604e0 0x7fa258160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 -- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 msgr2=0x7fa2580c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 0x7fa2580c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 -- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2581604e0 msgr2=0x7fa258160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2581604e0 0x7fa258160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 -- 172.21.15.82:0/321872930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25815f720 con 0x7fa2400039f0 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa24ffff640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 0x7fa2580c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25cf32640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ae0 tx=0x7fa240005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540a5630 con 0x7fa2400039f0 2023-07-20T10:02:25.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254004020 con 0x7fa2400039f0 2023-07-20T10:02:25.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa258159430 con 0x7fa2400039f0 2023-07-20T10:02:25.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254004390 con 0x7fa2400039f0 2023-07-20T10:02:25.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.835+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25815fce0 con 0x7fa2400039f0 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25804da30 con 0x7fa2400039f0 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fa2540b4040 con 0x7fa2400039f0 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa24d7fa640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 0x7fa244068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fa25411e4a0 con 0x7fa2400039f0 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa24ffff640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 0x7fa244068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:25.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.839+0000 7fa24ffff640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 0x7fa244068940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa248000f70 tx=0x7fa248000ee0 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:25.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:25.843+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2540eb7c0 con 0x7fa2400039f0 2023-07-20T10:02:25.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.007+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa25815af10 con 0x7fa244066480 2023-07-20T10:02:26.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa24d7fa640 1 -- 172.21.15.82:0/321872930 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa24800f7c0 con 0x7fa244066480 2023-07-20T10:02:26.006 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:26.006 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:38", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 msgr2=0x7fa244068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 0x7fa244068940 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa248000f70 tx=0x7fa248000ee0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 msgr2=0x7fa2581f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ae0 tx=0x7fa240005800 comp rx=0 tx=0).stop 2023-07-20T10:02:26.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 shutdown_connections 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fa244066480 0x7fa244068940 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2581604e0 0x7fa258160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2580c68f0 0x7fa2580c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 --2- 172.21.15.82:0/321872930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2400039f0 0x7fa2581f32e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 >> 172.21.15.82:0/321872930 conn(0x7fa2580cad50 msgr2=0x7fa2580af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 shutdown_connections 2023-07-20T10:02:26.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.019+0000 7fa25f196640 1 -- 172.21.15.82:0/321872930 wait complete. 2023-07-20T10:02:26.027 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:38", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.027 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:38', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:26.028 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:26.028 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:26.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:26.029 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-20T10:02:26.039 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:26.040 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:26.040 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:26.040 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:26.040 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:26.040 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:26.041 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:26.041 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:26.041 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:26.041 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:26.041 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:26.042 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:26.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-07-20T10:02:26.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 Processor -- start 2023-07-20T10:02:26.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 -- start start 2023-07-20T10:02:26.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff99c1602b0 0x7ff99c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff99c06ab10 0x7ff99c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0ce4f0 con 0x7ff99c06c120 2023-07-20T10:02:26.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0d0970 con 0x7ff99c06ab10 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff9a206d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c160e20 con 0x7ff99c1602b0 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff99c06ab10 0x7ff99c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff99c06ab10 0x7ff99c06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39116/0 (socket says 172.21.15.82:39116) 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 -- 172.21.15.82:0/2184534171 learned_addr learned my addr 172.21.15.82:0/2184534171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff993fff640 1 --2- 172.21.15.82:0/2184534171 >> v2:172.21.15.183:3300/0 conn(0x7ff99c1602b0 0x7ff99c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 -- 172.21.15.82:0/2184534171 >> v2:172.21.15.183:3300/0 conn(0x7ff99c1602b0 msgr2=0x7ff99c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 --2- 172.21.15.82:0/2184534171 >> v2:172.21.15.183:3300/0 conn(0x7ff99c1602b0 0x7ff99c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 -- 172.21.15.82:0/2184534171 >> v1:172.21.15.82:6789/0 conn(0x7ff99c06c120 legacy=0x7ff99c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.239+0000 7ff99bfff640 1 -- 172.21.15.82:0/2184534171 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0cd300 con 0x7ff99c06ab10 2023-07-20T10:02:26.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff99bfff640 1 --2- 172.21.15.82:0/2184534171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06ab10 0x7ff99c06af10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff99c08ca40 tx=0x7ff99401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8058950f6de41287 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff99affd640 1 -- 172.21.15.82:0/2184534171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a57d0 con 0x7ff99c06ab10 2023-07-20T10:02:26.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff99affd640 1 -- 172.21.15.82:0/2184534171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940a5930 con 0x7ff99c06ab10 2023-07-20T10:02:26.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff99affd640 1 -- 172.21.15.82:0/2184534171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940a5cc0 con 0x7ff99c06ab10 2023-07-20T10:02:26.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 -- 172.21.15.82:0/2184534171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06ab10 msgr2=0x7ff99c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 --2- 172.21.15.82:0/2184534171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06ab10 0x7ff99c06af10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff99c08ca40 tx=0x7ff99401c910 comp rx=0 tx=0).stop 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 -- 172.21.15.82:0/2184534171 shutdown_connections 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 --2- 172.21.15.82:0/2184534171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06ab10 0x7ff99c06af10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 --2- 172.21.15.82:0/2184534171 >> v2:172.21.15.183:3300/0 conn(0x7ff99c1602b0 0x7ff99c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 -- 172.21.15.82:0/2184534171 >> 172.21.15.82:0/2184534171 conn(0x7ff99c08c0a0 msgr2=0x7ff99c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:26.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 -- 172.21.15.82:0/2184534171 shutdown_connections 2023-07-20T10:02:26.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.243+0000 7ff9a206d640 1 -- 172.21.15.82:0/2184534171 wait complete. 2023-07-20T10:02:26.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 Processor -- start 2023-07-20T10:02:26.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- start start 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff99c06ab10 0x7ff99c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 0x7ff99c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0ca680 con 0x7ff99c06c120 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c157b70 con 0x7ff99c06ab10 2023-07-20T10:02:26.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c154bf0 con 0x7ff99c1602b0 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39130/0 (socket says 172.21.15.82:39130) 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 -- 172.21.15.82:0/3988761804 learned_addr learned my addr 172.21.15.82:0/3988761804 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff99b7fe640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff99c06ab10 0x7ff99c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff99bfff640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 0x7ff99c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 -- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 msgr2=0x7ff99c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 0x7ff99c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 -- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff99c06ab10 msgr2=0x7ff99c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff99c06ab10 0x7ff99c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 -- 172.21.15.82:0/3988761804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009b30 con 0x7ff99c06c120 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff99bfff640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 0x7ff99c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff993fff640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d5f0 tx=0x7ff98400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9840125f0 con 0x7ff99c06c120 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984012750 con 0x7ff99c06c120 2023-07-20T10:02:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984012ae0 con 0x7ff99c06c120 2023-07-20T10:02:26.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c0c9720 con 0x7ff99c06c120 2023-07-20T10:02:26.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.247+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0c9ce0 con 0x7ff99c06c120 2023-07-20T10:02:26.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c04da30 con 0x7ff99c06c120 2023-07-20T10:02:26.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff984012c40 con 0x7ff99c06c120 2023-07-20T10:02:26.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff998ff9640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 0x7ff97c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7ff984084590 con 0x7ff99c06c120 2023-07-20T10:02:26.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff99b7fe640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 0x7ff97c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.251+0000 7ff99b7fe640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 0x7ff97c068940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007fd0 tx=0x7ff98c009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.255+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff984051700 con 0x7ff99c06c120 2023-07-20T10:02:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.419+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff99c161100 con 0x7ff97c066480 2023-07-20T10:02:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.427+0000 7ff998ff9640 1 -- 172.21.15.82:0/3988761804 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff98c0014f0 con 0x7ff97c066480 2023-07-20T10:02:26.417 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:26.418 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:38", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 msgr2=0x7ff97c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 0x7ff97c068940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff98c007fd0 tx=0x7ff98c009040 comp rx=0 tx=0).stop 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 msgr2=0x7ff99c1546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff98400d5f0 tx=0x7ff98400dab0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 shutdown_connections 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff97c066480 0x7ff97c068940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff99c1602b0 0x7ff99c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff99c06c120 0x7ff99c1546b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 --2- 172.21.15.82:0/3988761804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff99c06ab10 0x7ff99c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 >> 172.21.15.82:0/3988761804 conn(0x7ff99c08c0a0 msgr2=0x7ff99c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:26.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 shutdown_connections 2023-07-20T10:02:26.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.431+0000 7ff9a206d640 1 -- 172.21.15.82:0/3988761804 wait complete. 2023-07-20T10:02:26.439 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:38", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.439 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:38', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:26.439 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:26.439 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:26.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:26.440 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-20T10:02:26.450 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:26.451 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:26.452 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:26.452 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:26.453 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:26.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-07-20T10:02:26.507 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:02:26.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:02:26.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.647+0000 7ff36a5ba640 1 Processor -- start 2023-07-20T10:02:26.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.647+0000 7ff36a5ba640 1 -- start start 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.647+0000 7ff36a5ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff364159450 0x7ff36415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff36a5ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640cc8d0 con 0x7ff3640afd50 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff36a5ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640ccbb0 con 0x7ff364159830 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff36a5ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3640cce90 con 0x7ff364159450 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff368b57640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff3640afd50 0x7ff3640b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58274/0 (socket says 172.21.15.82:58274) 2023-07-20T10:02:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff368b57640 1 -- 172.21.15.82:0/790242388 learned_addr learned my addr 172.21.15.82:0/790242388 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff363fff640 1 --2- 172.21.15.82:0/790242388 >> v2:172.21.15.183:3300/0 conn(0x7ff364159450 0x7ff36415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154769653 0 0) 0x7ff3640cc8d0 con 0x7ff3640afd50 2023-07-20T10:02:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c003530 con 0x7ff3640afd50 2023-07-20T10:02:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771244886 0 0) 0x7ff3640ccbb0 con 0x7ff364159830 2023-07-20T10:02:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3640cc8d0 con 0x7ff364159830 2023-07-20T10:02:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff363fff640 1 -- 172.21.15.82:0/790242388 >> v1:172.21.15.183:6789/0 conn(0x7ff364159830 legacy=0x7ff3640cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff363fff640 1 -- 172.21.15.82:0/790242388 >> v1:172.21.15.82:6789/0 conn(0x7ff3640afd50 legacy=0x7ff3640b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.651+0000 7ff363fff640 1 -- 172.21.15.82:0/790242388 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364159cc0 con 0x7ff364159450 2023-07-20T10:02:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff363fff640 1 --2- 172.21.15.82:0/790242388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364159450 0x7ff36415a4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff3540097c0 tx=0x7ff35401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c052cda1f72d2ff server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540a7070 con 0x7ff364159450 2023-07-20T10:02:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3540ab430 con 0x7ff364159450 2023-07-20T10:02:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff362ffd640 1 -- 172.21.15.82:0/790242388 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540ab7c0 con 0x7ff364159450 2023-07-20T10:02:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- 172.21.15.82:0/790242388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364159450 msgr2=0x7ff36415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/790242388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364159450 0x7ff36415a4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff3540097c0 tx=0x7ff35401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- 172.21.15.82:0/790242388 shutdown_connections 2023-07-20T10:02:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/790242388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364159450 0x7ff36415a4c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- 172.21.15.82:0/790242388 >> 172.21.15.82:0/790242388 conn(0x7ff3640cad50 msgr2=0x7ff3640cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- 172.21.15.82:0/790242388 shutdown_connections 2023-07-20T10:02:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- 172.21.15.82:0/790242388 wait complete. 2023-07-20T10:02:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 Processor -- start 2023-07-20T10:02:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- start start 2023-07-20T10:02:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3640afd50 0x7ff3640af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 0x7ff3641539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3641503b0 con 0x7ff364159450 2023-07-20T10:02:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640af750 con 0x7ff364150580 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.655+0000 7ff36a5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff364156350 con 0x7ff3640afd50 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39132/0 (socket says 172.21.15.82:39132) 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 -- 172.21.15.82:0/1376234734 learned_addr learned my addr 172.21.15.82:0/1376234734 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff363fff640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3640afd50 0x7ff3640af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff368b57640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 0x7ff3641539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 -- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3640afd50 msgr2=0x7ff3640af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3640afd50 0x7ff3640af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 -- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 msgr2=0x7ff3641539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 0x7ff3641539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 -- 172.21.15.82:0/1376234734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff354009420 con 0x7ff364159450 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff368b57640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 0x7ff3641539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff3637fe640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c430 tx=0x7ff35800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580052d0 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358005450 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358003840 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff364151100 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff364150080 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3641567c0 con 0x7ff364159450 2023-07-20T10:02:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff3580039a0 con 0x7ff364159450 2023-07-20T10:02:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 0x7ff350068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.659+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7ff358083750 con 0x7ff364159450 2023-07-20T10:02:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.663+0000 7ff363fff640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 0x7ff350068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.663+0000 7ff363fff640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 0x7ff350068970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3540af000 tx=0x7ff3540a7000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:26.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.667+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3641567c0 con 0x7ff364159450 2023-07-20T10:02:26.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.831+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3640cc5b0 con 0x7ff3500664b0 2023-07-20T10:02:26.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.839+0000 7ff360ff9640 1 -- 172.21.15.82:0/1376234734 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7ff3540ab800 con 0x7ff3500664b0 2023-07-20T10:02:26.829 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:26.829 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:39", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 msgr2=0x7ff350068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 0x7ff350068970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff3540af000 tx=0x7ff3540a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 msgr2=0x7ff364153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c430 tx=0x7ff35800c8f0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 shutdown_connections 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff3500664b0 0x7ff350068970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff364150580 0x7ff3641539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff364159450 0x7ff364153470 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 --2- 172.21.15.82:0/1376234734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3640afd50 0x7ff3640af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 >> 172.21.15.82:0/1376234734 conn(0x7ff3640cad50 msgr2=0x7ff364071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 shutdown_connections 2023-07-20T10:02:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:26.843+0000 7ff36a5ba640 1 -- 172.21.15.82:0/1376234734 wait complete. 2023-07-20T10:02:26.851 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:39", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:26.851 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:39', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:26.851 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:26.852 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:26.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:26.852 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-20T10:02:26.862 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:26.863 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:26.864 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:26.864 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:26.864 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:26.864 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:26.865 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:26.865 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-07-20T10:02:27.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 Processor -- start 2023-07-20T10:02:27.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 -- start start 2023-07-20T10:02:27.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4159450 0x7fbfd415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfd40afd50 0x7fbfd40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40cc8d0 con 0x7fbfd4159830 2023-07-20T10:02:27.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40cce90 con 0x7fbfd40afd50 2023-07-20T10:02:27.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfdad67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40b0700 con 0x7fbfd4159450 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfd40afd50 0x7fbfd40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbfd40afd50 0x7fbfd40b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39136/0 (socket says 172.21.15.82:39136) 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 -- 172.21.15.82:0/4005395159 learned_addr learned my addr 172.21.15.82:0/4005395159 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd8b03640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4159450 0x7fbfd415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 -- 172.21.15.82:0/4005395159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4159450 msgr2=0x7fbfd415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4159450 0x7fbfd415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 -- 172.21.15.82:0/4005395159 >> v1:172.21.15.183:6789/0 conn(0x7fbfd4159830 legacy=0x7fbfd40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.059+0000 7fbfd9304640 1 -- 172.21.15.82:0/4005395159 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40ccbb0 con 0x7fbfd40afd50 2023-07-20T10:02:27.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfd9304640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd40afd50 0x7fbfd40b01c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0098a0 tx=0x7fbfcc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7039524ec5b1f332 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfd37fe640 1 -- 172.21.15.82:0/4005395159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0aa650 con 0x7fbfd40afd50 2023-07-20T10:02:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfd37fe640 1 -- 172.21.15.82:0/4005395159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0aa7b0 con 0x7fbfd40afd50 2023-07-20T10:02:27.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfd37fe640 1 -- 172.21.15.82:0/4005395159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0aab40 con 0x7fbfd40afd50 2023-07-20T10:02:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 -- 172.21.15.82:0/4005395159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd40afd50 msgr2=0x7fbfd40b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd40afd50 0x7fbfd40b01c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0098a0 tx=0x7fbfcc01c4f0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 -- 172.21.15.82:0/4005395159 shutdown_connections 2023-07-20T10:02:27.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd40afd50 0x7fbfd40b01c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 --2- 172.21.15.82:0/4005395159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd4159450 0x7fbfd415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 -- 172.21.15.82:0/4005395159 >> 172.21.15.82:0/4005395159 conn(0x7fbfd40cad50 msgr2=0x7fbfd40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:27.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 -- 172.21.15.82:0/4005395159 shutdown_connections 2023-07-20T10:02:27.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.063+0000 7fbfdad67640 1 -- 172.21.15.82:0/4005395159 wait complete. 2023-07-20T10:02:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 Processor -- start 2023-07-20T10:02:27.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- start start 2023-07-20T10:02:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd40afd50 0x7fbfd414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd414fbc0 0x7fbfd4151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c59f0 con 0x7fbfd4159450 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4150eb0 con 0x7fbfd414fbc0 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4150610 con 0x7fbfd40afd50 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39142/0 (socket says 172.21.15.82:39142) 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 -- 172.21.15.82:0/1266540258 learned_addr learned my addr 172.21.15.82:0/1266540258 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd8b03640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd40afd50 0x7fbfd414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd9304640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd414fbc0 0x7fbfd4151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 -- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd40afd50 msgr2=0x7fbfd414f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd40afd50 0x7fbfd414f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 -- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd414fbc0 msgr2=0x7fbfd4151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd414fbc0 0x7fbfd4151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 -- 172.21.15.82:0/1266540258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc0094d0 con 0x7fbfd4159450 2023-07-20T10:02:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd3fff640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c7a0 tx=0x7fbfc800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003b80 con 0x7fbfd4159450 2023-07-20T10:02:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8003ce0 con 0x7fbfd4159450 2023-07-20T10:02:27.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc800aa90 con 0x7fbfd4159450 2023-07-20T10:02:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41508f0 con 0x7fbfd4159450 2023-07-20T10:02:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.067+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40adeb0 con 0x7fbfd4159450 2023-07-20T10:02:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd404da30 con 0x7fbfd4159450 2023-07-20T10:02:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fbfc800abf0 con 0x7fbfd4159450 2023-07-20T10:02:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfd17fa640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 0x7fbfc0068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fbfc8084080 con 0x7fbfd4159450 2023-07-20T10:02:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfd8b03640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 0x7fbfc0068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.071+0000 7fbfd8b03640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 0x7fbfc0068940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4152110 tx=0x7fbfc4008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.075+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfc80b4700 con 0x7fbfd4159450 2023-07-20T10:02:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.243+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfd40cc5b0 con 0x7fbfc0066480 2023-07-20T10:02:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfd17fa640 1 -- 172.21.15.82:0/1266540258 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fbfc4010a80 con 0x7fbfc0066480 2023-07-20T10:02:27.239 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:27.240 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:39", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 msgr2=0x7fbfc0068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 0x7fbfc0068940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4152110 tx=0x7fbfc4008040 comp rx=0 tx=0).stop 2023-07-20T10:02:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 msgr2=0x7fbfd40c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c7a0 tx=0x7fbfc800cc60 comp rx=0 tx=0).stop 2023-07-20T10:02:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 shutdown_connections 2023-07-20T10:02:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbfc0066480 0x7fbfc0068940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbfd414fbc0 0x7fbfd4151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbfd4159450 0x7fbfd40c54b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 --2- 172.21.15.82:0/1266540258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbfd40afd50 0x7fbfd414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 >> 172.21.15.82:0/1266540258 conn(0x7fbfd40cad50 msgr2=0x7fbfd4155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:27.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 shutdown_connections 2023-07-20T10:02:27.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.251+0000 7fbfdad67640 1 -- 172.21.15.82:0/1266540258 wait complete. 2023-07-20T10:02:27.260 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:39", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:27.260 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:39', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:27.261 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:27.261 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:27.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:27.261 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-20T10:02:27.273 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:27.274 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:27.274 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_01_UTC 2023-07-20T10:02:27.275 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:27.276 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:27.276 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_01_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:27.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-07-20T10:02:27.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 Processor -- start 2023-07-20T10:02:27.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 -- start start 2023-07-20T10:02:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f91040d3200 0x7f91040cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91040cdb40 con 0x7f910415c6e0 2023-07-20T10:02:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040d07a0 con 0x7f91040d3200 2023-07-20T10:02:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f910a488640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040cd4f0 con 0x7f910415cac0 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:45270/0 (socket says 172.21.15.82:45270) 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 -- 172.21.15.82:0/1141766369 learned_addr learned my addr 172.21.15.82:0/1141766369 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f91037fe640 1 --2- 172.21.15.82:0/1141766369 >> v2:172.21.15.183:3300/0 conn(0x7f91040d3200 0x7f91040cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 -- 172.21.15.82:0/1141766369 >> v2:172.21.15.183:3300/0 conn(0x7f91040d3200 msgr2=0x7f91040cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 --2- 172.21.15.82:0/1141766369 >> v2:172.21.15.183:3300/0 conn(0x7f91040d3200 0x7f91040cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.475+0000 7f9108a25640 1 -- 172.21.15.82:0/1141766369 >> v1:172.21.15.183:6789/0 conn(0x7f910415c6e0 legacy=0x7f91040cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9108a25640 1 -- 172.21.15.82:0/1141766369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040cd7d0 con 0x7f910415cac0 2023-07-20T10:02:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9102ffd640 1 -- 172.21.15.82:0/1141766369 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081673736 0 0) 0x7f91040cdb40 con 0x7f910415c6e0 2023-07-20T10:02:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9108a25640 1 --2- 172.21.15.82:0/1141766369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009e50 tx=0x7f90fc01c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e4a98ec0dd2b198 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9102ffd640 1 -- 172.21.15.82:0/1141766369 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0a56c0 con 0x7f910415cac0 2023-07-20T10:02:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9102ffd640 1 -- 172.21.15.82:0/1141766369 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc0a5820 con 0x7f910415cac0 2023-07-20T10:02:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f9102ffd640 1 -- 172.21.15.82:0/1141766369 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0a5bb0 con 0x7f910415cac0 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 -- 172.21.15.82:0/1141766369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 msgr2=0x7f91040d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 --2- 172.21.15.82:0/1141766369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f90fc009e50 tx=0x7f90fc01c8f0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 -- 172.21.15.82:0/1141766369 shutdown_connections 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 --2- 172.21.15.82:0/1141766369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f91040d0be0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 --2- 172.21.15.82:0/1141766369 >> v2:172.21.15.183:3300/0 conn(0x7f91040d3200 0x7f91040cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 -- 172.21.15.82:0/1141766369 >> 172.21.15.82:0/1141766369 conn(0x7f91040d2600 msgr2=0x7f91040d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 -- 172.21.15.82:0/1141766369 shutdown_connections 2023-07-20T10:02:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.479+0000 7f910a488640 1 -- 172.21.15.82:0/1141766369 wait complete. 2023-07-20T10:02:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 Processor -- start 2023-07-20T10:02:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 -- start start 2023-07-20T10:02:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91040d3200 0x7f9104158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f910415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91041530f0 con 0x7f910415c6e0 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91041533d0 con 0x7f91040d3200 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91041536b0 con 0x7f910415cac0 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39144/0 (socket says 172.21.15.82:39144) 2023-07-20T10:02:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 -- 172.21.15.82:0/1210418383 learned_addr learned my addr 172.21.15.82:0/1210418383 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f9103fff640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91040d3200 0x7f9104158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f9108a25640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f910415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 -- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 msgr2=0x7f910415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f910415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 -- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91040d3200 msgr2=0x7f9104158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91040d3200 0x7f9104158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 -- 172.21.15.82:0/1210418383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc009b30 con 0x7f910415c6e0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f91037fe640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90f800e930 tx=0x7f90f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8009690 con 0x7f910415c6e0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f800ca00 con 0x7f910415c6e0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f800cd70 con 0x7f910415c6e0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.483+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9104153990 con 0x7f910415c6e0 2023-07-20T10:02:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91040c64e0 con 0x7f910415c6e0 2023-07-20T10:02:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910404da30 con 0x7f910415c6e0 2023-07-20T10:02:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f90f8013470 con 0x7f910415c6e0 2023-07-20T10:02:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f9100ff9640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 0x7f90f0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f90f80842e0 con 0x7f910415c6e0 2023-07-20T10:02:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.487+0000 7f9103fff640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 0x7f90f0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.491+0000 7f9103fff640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 0x7f90f0068970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90f4000f70 tx=0x7f90f4009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.491+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90f8051510 con 0x7f910415c6e0 2023-07-20T10:02:27.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.659+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9104153540 con 0x7f90f00664b0 2023-07-20T10:02:27.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f9100ff9640 1 -- 172.21.15.82:0/1210418383 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9104153540 con 0x7f90f00664b0 2023-07-20T10:02:27.655 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:27.655 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:40", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:27.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 msgr2=0x7f90f0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 0x7f90f0068970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f90f4000f70 tx=0x7f90f4009040 comp rx=0 tx=0).stop 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 msgr2=0x7f9104158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f90f800e930 tx=0x7f90f800edf0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 shutdown_connections 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f90f00664b0 0x7f90f0068970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f910415cac0 0x7f910415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f910415c6e0 0x7f9104158ea0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 --2- 172.21.15.82:0/1210418383 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91040d3200 0x7f9104158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 >> 172.21.15.82:0/1210418383 conn(0x7f91040d2600 msgr2=0x7f91040b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:27.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 shutdown_connections 2023-07-20T10:02:27.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.667+0000 7f910a488640 1 -- 172.21.15.82:0/1210418383 wait complete. 2023-07-20T10:02:27.676 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:40", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:27.677 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:40', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:27.677 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:27.677 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:27.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:27.679 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-20T10:02:27.690 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:27.690 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:27.690 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:27.690 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:27.690 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:27.691 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:27.691 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-09_52_00_UTC', 'scheduled-2023-07-20-09_53_00_UTC', 'scheduled-2023-07-20-09_54_00_UTC', 'scheduled-2023-07-20-09_55_00_UTC', 'scheduled-2023-07-20-09_56_00_UTC', 'scheduled-2023-07-20-09_57_00_UTC', 'scheduled-2023-07-20-09_58_00_UTC', 'scheduled-2023-07-20-09_59_00_UTC', 'scheduled-2023-07-20-10_00_00_UTC', 'scheduled-2023-07-20-10_01_00_UTC', 'scheduled-2023-07-20-10_02_00_UTC'] 2023-07-20T10:02:27.692 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-07-20T10:02:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 Processor -- start 2023-07-20T10:02:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 -- start start 2023-07-20T10:02:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabe00afd50 0x7fabe00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe00cc8d0 con 0x7fabe0159830 2023-07-20T10:02:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe00cce90 con 0x7fabe00afd50 2023-07-20T10:02:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabe5c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b0700 con 0x7fabe0159450 2023-07-20T10:02:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabdffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabe00afd50 0x7fabe00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabdffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabe00afd50 0x7fabe00b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39150/0 (socket says 172.21.15.82:39150) 2023-07-20T10:02:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabdffff640 1 -- 172.21.15.82:0/2749674295 learned_addr learned my addr 172.21.15.82:0/2749674295 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.887+0000 7fabdf7fe640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabdffff640 1 -- 172.21.15.82:0/2749674295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 msgr2=0x7fabe015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabdffff640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabdffff640 1 -- 172.21.15.82:0/2749674295 >> v1:172.21.15.183:6789/0 conn(0x7fabe0159830 legacy=0x7fabe00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabdffff640 1 -- 172.21.15.82:0/2749674295 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe00ccbb0 con 0x7fabe00afd50 2023-07-20T10:02:27.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabdffff640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00afd50 0x7fabe00b01c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009e80 tx=0x7fabd801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a6d59e6d8cf2d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabde7fc640 1 -- 172.21.15.82:0/2749674295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80a5880 con 0x7fabe00afd50 2023-07-20T10:02:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabde7fc640 1 -- 172.21.15.82:0/2749674295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80a59e0 con 0x7fabe00afd50 2023-07-20T10:02:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabde7fc640 1 -- 172.21.15.82:0/2749674295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80a5d70 con 0x7fabe00afd50 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 -- 172.21.15.82:0/2749674295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00afd50 msgr2=0x7fabe00b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00afd50 0x7fabe00b01c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009e80 tx=0x7fabd801c9c0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 -- 172.21.15.82:0/2749674295 shutdown_connections 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00afd50 0x7fabe00b01c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 --2- 172.21.15.82:0/2749674295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 -- 172.21.15.82:0/2749674295 >> 172.21.15.82:0/2749674295 conn(0x7fabe00cad50 msgr2=0x7fabe00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 -- 172.21.15.82:0/2749674295 shutdown_connections 2023-07-20T10:02:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.891+0000 7fabe5c34640 1 -- 172.21.15.82:0/2749674295 wait complete. 2023-07-20T10:02:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 Processor -- start 2023-07-20T10:02:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 -- start start 2023-07-20T10:02:27.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe00afd50 0x7fabe00b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00b0ba0 con 0x7fabe00c1380 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00c7e40 con 0x7fabe00afd50 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabe5c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe00c8120 con 0x7fabe0159450 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39160/0 (socket says 172.21.15.82:39160) 2023-07-20T10:02:27.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 -- 172.21.15.82:0/3441840029 learned_addr learned my addr 172.21.15.82:0/3441840029 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:27.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdf7fe640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe00afd50 0x7fabe00b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdeffd640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 -- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 msgr2=0x7fabe0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 -- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe00afd50 msgr2=0x7fabe00b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe00afd50 0x7fabe00b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 -- 172.21.15.82:0/3441840029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009b30 con 0x7fabe00c1380 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.895+0000 7fabdffff640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fabd80af040 tx=0x7fabd8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b8670 con 0x7fabe00c1380 2023-07-20T10:02:27.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80b87f0 con 0x7fabe00c1380 2023-07-20T10:02:27.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b8ba0 con 0x7fabe00c1380 2023-07-20T10:02:27.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe00c8400 con 0x7fabe00c1380 2023-07-20T10:02:27.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe00b38f0 con 0x7fabe00c1380 2023-07-20T10:02:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe004da30 con 0x7fabe00c1380 2023-07-20T10:02:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fabd80b8d00 con 0x7fabe00c1380 2023-07-20T10:02:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 0x7fabcc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fabd811f860 con 0x7fabe00c1380 2023-07-20T10:02:27.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.899+0000 7fabdf7fe640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 0x7fabcc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:27.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.903+0000 7fabdf7fe640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 0x7fabcc068940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009b60 tx=0x7fabd0009190 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:27.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:27.903+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabd80ec9e0 con 0x7fabe00c1380 2023-07-20T10:02:28.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.071+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabe00c8590 con 0x7fabcc066480 2023-07-20T10:02:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.079+0000 7fabc7fff640 1 -- 172.21.15.82:0/3441840029 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fabe00c8590 con 0x7fabcc066480 2023-07-20T10:02:28.069 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:28.069 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:40", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 msgr2=0x7fabcc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 0x7fabcc068940 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabd0009b60 tx=0x7fabd0009190 comp rx=0 tx=0).stop 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 msgr2=0x7fabe0157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fabd80af040 tx=0x7fabd8019760 comp rx=0 tx=0).stop 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 shutdown_connections 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fabcc066480 0x7fabcc068940 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabe00c1380 0x7fabe0157410 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabe0159450 0x7fabe0155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 --2- 172.21.15.82:0/3441840029 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabe00afd50 0x7fabe00b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 >> 172.21.15.82:0/3441840029 conn(0x7fabe00cad50 msgr2=0x7fabe00c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 shutdown_connections 2023-07-20T10:02:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.083+0000 7fabe5c34640 1 -- 172.21.15.82:0/3441840029 wait complete. 2023-07-20T10:02:28.089 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T09:51:40", "first": "2023-07-20T09:52:00", "last": "2023-07-20T10:02:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-20T10:02:28.090 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T09:51:40', 'first': '2023-07-20T09:52:00', 'last': '2023-07-20T10:02:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-20T10:02:28.090 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T10:02:28.090 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T10:02:28.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-07-20T10:02:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 Processor -- start 2023-07-20T10:02:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 -- start start 2023-07-20T10:02:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efed80c89f0 0x7efed8164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed80ccdb0 con 0x7efed80afc10 2023-07-20T10:02:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80cd090 con 0x7efed80c89f0 2023-07-20T10:02:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.246+0000 7efedf7db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80cd370 con 0x7efed80c1220 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedd577640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedd577640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:45304/0 (socket says 172.21.15.82:45304) 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedd577640 1 -- 172.21.15.82:0/2399644594 learned_addr learned my addr 172.21.15.82:0/2399644594 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 --2- 172.21.15.82:0/2399644594 >> v2:172.21.15.183:3300/0 conn(0x7efed80c89f0 0x7efed8164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efecffff640 1 -- 172.21.15.82:0/2399644594 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350571631 0 0) 0x7efed80ccdb0 con 0x7efed80afc10 2023-07-20T10:02:28.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efecffff640 1 -- 172.21.15.82:0/2399644594 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4003530 con 0x7efed80afc10 2023-07-20T10:02:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 -- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 msgr2=0x7efed80cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 -- 172.21.15.82:0/2399644594 >> v1:172.21.15.183:6789/0 conn(0x7efed80afc10 legacy=0x7efed81611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 -- 172.21.15.82:0/2399644594 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed81647b0 con 0x7efed80c89f0 2023-07-20T10:02:28.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedd577640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.250+0000 7efedcd76640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c89f0 0x7efed8164fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efec80097a0 tx=0x7efec801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34db8a719fa6c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efecffff640 1 -- 172.21.15.82:0/2399644594 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80a8950 con 0x7efed80c89f0 2023-07-20T10:02:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efecffff640 1 -- 172.21.15.82:0/2399644594 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec80a8ab0 con 0x7efed80c89f0 2023-07-20T10:02:28.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efecffff640 1 -- 172.21.15.82:0/2399644594 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec80a8e40 con 0x7efed80c89f0 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c89f0 msgr2=0x7efed8164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c89f0 0x7efed8164fb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efec80097a0 tx=0x7efec801ec50 comp rx=0 tx=0).stop 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- 172.21.15.82:0/2399644594 shutdown_connections 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c89f0 0x7efed8164fb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- 172.21.15.82:0/2399644594 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c1220 0x7efed80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- 172.21.15.82:0/2399644594 >> 172.21.15.82:0/2399644594 conn(0x7efed80cac10 msgr2=0x7efed80cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:28.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- 172.21.15.82:0/2399644594 shutdown_connections 2023-07-20T10:02:28.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- 172.21.15.82:0/2399644594 wait complete. 2023-07-20T10:02:28.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 Processor -- start 2023-07-20T10:02:28.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- start start 2023-07-20T10:02:28.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c1220 0x7efed80c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c89f0 0x7efed80c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c33f0 con 0x7efed80afc10 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed8157f80 con 0x7efed80c1220 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.254+0000 7efedf7db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80c3640 con 0x7efed80c89f0 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39166/0 (socket says 172.21.15.82:39166) 2023-07-20T10:02:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 -- 172.21.15.82:0/2869303876 learned_addr learned my addr 172.21.15.82:0/2869303876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedcd76640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c1220 0x7efed80c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efeddd78640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c89f0 0x7efed80c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 -- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c89f0 msgr2=0x7efed80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c89f0 0x7efed80c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 -- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c1220 msgr2=0x7efed80c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c1220 0x7efed80c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 -- 172.21.15.82:0/2869303876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed40094d0 con 0x7efed80afc10 2023-07-20T10:02:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedd577640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efed400e9d0 tx=0x7efed400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400ca60 con 0x7efed80afc10 2023-07-20T10:02:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400cbc0 con 0x7efed80afc10 2023-07-20T10:02:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec80093b0 con 0x7efed80afc10 2023-07-20T10:02:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed4013470 con 0x7efed80afc10 2023-07-20T10:02:28.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed80c3c00 con 0x7efed80afc10 2023-07-20T10:02:28.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed804da30 con 0x7efed80afc10 2023-07-20T10:02:28.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7efed40135d0 con 0x7efed80afc10 2023-07-20T10:02:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 0x7efebc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.258+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7efed4084410 con 0x7efed80afc10 2023-07-20T10:02:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.262+0000 7efedcd76640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 0x7efebc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.262+0000 7efedcd76640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 0x7efebc068940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efec80b2000 tx=0x7efec80aa070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:28.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.262+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efed40515b0 con 0x7efed80afc10 2023-07-20T10:02:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.430+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efed80cca80 con 0x7efebc066480 2023-07-20T10:02:28.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efecdffb640 1 -- 172.21.15.82:0/2869303876 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7efec80ba440 con 0x7efebc066480 2023-07-20T10:02:28.492 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-07-20T10:02:28.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 msgr2=0x7efebc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 0x7efebc068940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efec80b2000 tx=0x7efec80aa070 comp rx=0 tx=0).stop 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 msgr2=0x7efed8157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7efed400e9d0 tx=0x7efed400ee90 comp rx=0 tx=0).stop 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 shutdown_connections 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7efebc066480 0x7efebc068940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efed80c89f0 0x7efed80c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efed80c1220 0x7efed80c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 --2- 172.21.15.82:0/2869303876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efed80afc10 0x7efed8157a40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.502+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 >> 172.21.15.82:0/2869303876 conn(0x7efed80cac10 msgr2=0x7efed806f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.506+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 shutdown_connections 2023-07-20T10:02:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:28.506+0000 7efedf7db640 1 -- 172.21.15.82:0/2869303876 wait complete. 2023-07-20T10:02:28.512 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-07-20T10:02:28.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.513 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-20T10:02:28.522 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:28.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:28.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:28.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:28.524 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:28.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.525 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:28.585 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:28.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.585 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:28.640 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:28.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.641 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:28.696 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:28.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.697 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:28.752 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:28.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.753 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:28.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:28.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.808 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:28.868 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:28.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.869 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:28.924 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:28.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.925 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:28.983 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:28.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:28.984 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:29.040 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:29.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.040 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:29.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:29.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.096 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:29.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.153 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-07-20T10:02:29.210 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-07-20T10:02:29.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.406+0000 7ff93fe6d640 1 Processor -- start 2023-07-20T10:02:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 -- start start 2023-07-20T10:02:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 0x7ff93806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9380ca5a0 0x7ff93815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff938070030 con 0x7ff93815ec90 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff93815bad0 con 0x7ff9380ca5a0 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93fe6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff938071950 con 0x7ff93806f710 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9380ca5a0 0x7ff93815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9380ca5a0 0x7ff93815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39178/0 (socket says 172.21.15.82:39178) 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 -- 172.21.15.82:0/1113131008 learned_addr learned my addr 172.21.15.82:0/1113131008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93dc09640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 0x7ff93806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 -- 172.21.15.82:0/1113131008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 msgr2=0x7ff93806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 0x7ff93806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 -- 172.21.15.82:0/1113131008 >> v1:172.21.15.183:6789/0 conn(0x7ff93815ec90 legacy=0x7ff93815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93d408640 1 -- 172.21.15.82:0/1113131008 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93815b230 con 0x7ff9380ca5a0 2023-07-20T10:02:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.410+0000 7ff93dc09640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 0x7ff93806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93d408640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9380ca5a0 0x7ff93815e750 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff928009870 tx=0x7ff92801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3ff4a8c2b1a2bf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93cc07640 1 -- 172.21.15.82:0/1113131008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280ab620 con 0x7ff9380ca5a0 2023-07-20T10:02:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93cc07640 1 -- 172.21.15.82:0/1113131008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9280ab780 con 0x7ff9380ca5a0 2023-07-20T10:02:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93cc07640 1 -- 172.21.15.82:0/1113131008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280abb10 con 0x7ff9380ca5a0 2023-07-20T10:02:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- 172.21.15.82:0/1113131008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9380ca5a0 msgr2=0x7ff93815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9380ca5a0 0x7ff93815e750 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff928009870 tx=0x7ff92801c510 comp rx=0 tx=0).stop 2023-07-20T10:02:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- 172.21.15.82:0/1113131008 shutdown_connections 2023-07-20T10:02:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9380ca5a0 0x7ff93815e750 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/1113131008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff93806f710 0x7ff93806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- 172.21.15.82:0/1113131008 >> 172.21.15.82:0/1113131008 conn(0x7ff9380cad50 msgr2=0x7ff9380cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- 172.21.15.82:0/1113131008 shutdown_connections 2023-07-20T10:02:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- 172.21.15.82:0/1113131008 wait complete. 2023-07-20T10:02:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 Processor -- start 2023-07-20T10:02:29.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.414+0000 7ff93fe6d640 1 -- start start 2023-07-20T10:02:29.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff93806f710 0x7ff93814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9380ca5a0 0x7ff9380cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380cd490 con 0x7ff93815ec90 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93814f630 con 0x7ff93806f710 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380cc880 con 0x7ff9380ca5a0 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39184/0 (socket says 172.21.15.82:39184) 2023-07-20T10:02:29.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 -- 172.21.15.82:0/931817776 learned_addr learned my addr 172.21.15.82:0/931817776 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:29.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93d408640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9380ca5a0 0x7ff9380cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93dc09640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff93806f710 0x7ff93814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 -- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9380ca5a0 msgr2=0x7ff9380cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9380ca5a0 0x7ff9380cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 -- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff93806f710 msgr2=0x7ff93814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff93806f710 0x7ff93814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 -- 172.21.15.82:0/931817776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280094d0 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93e40a640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c760 tx=0x7ff93000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff930003b80 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff930003ce0 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380ccb60 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000aa30 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380cd120 con 0x7ff93815ec90 2023-07-20T10:02:29.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.418+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9380cd600 con 0x7ff93815ec90 2023-07-20T10:02:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.422+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff93000ab90 con 0x7ff93815ec90 2023-07-20T10:02:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.422+0000 7ff92e7fc640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 0x7ff91c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.422+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7ff930083f00 con 0x7ff93815ec90 2023-07-20T10:02:29.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.422+0000 7ff93dc09640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 0x7ff91c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:29.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.422+0000 7ff93dc09640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 0x7ff91c068940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9380ad8c0 tx=0x7ff934008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:29.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.426+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff930051070 con 0x7ff93815ec90 2023-07-20T10:02:29.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.590+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff93815e230 con 0x7ff91c066480 2023-07-20T10:02:29.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.662+0000 7ff92e7fc640 1 -- 172.21.15.82:0/931817776 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff93400a670 con 0x7ff91c066480 2023-07-20T10:02:29.652 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-07-20T10:02:29.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 msgr2=0x7ff91c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:29.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 0x7ff91c068940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9380ad8c0 tx=0x7ff934008040 comp rx=0 tx=0).stop 2023-07-20T10:02:29.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 msgr2=0x7ff9380cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:29.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff93000c760 tx=0x7ff93000cc20 comp rx=0 tx=0).stop 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 shutdown_connections 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7ff91c066480 0x7ff91c068940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff93815ec90 0x7ff9380cc030 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9380ca5a0 0x7ff9380cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 --2- 172.21.15.82:0/931817776 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff93806f710 0x7ff93814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 >> 172.21.15.82:0/931817776 conn(0x7ff9380cad50 msgr2=0x7ff9380ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:29.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 shutdown_connections 2023-07-20T10:02:29.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:29.666+0000 7ff93fe6d640 1 -- 172.21.15.82:0/931817776 wait complete. 2023-07-20T10:02:29.673 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-07-20T10:02:29.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.673 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-20T10:02:29.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:29.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:29.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:29.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:29.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:29.685 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:29.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.686 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:29.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:29.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.746 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:29.808 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:29.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.809 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:29.865 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:29.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.866 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:29.920 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:29.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.921 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:29.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:29.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:29.977 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:30.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:30.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.036 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:30.092 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:30.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.093 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:30.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:30.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.153 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:30.210 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:30.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.211 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:30.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:30.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.269 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:30.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.325 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-07-20T10:02:30.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-07-20T10:02:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 Processor -- start 2023-07-20T10:02:30.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 -- start start 2023-07-20T10:02:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c159830 0x7fae5c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae5c0cc3e0 0x7fae5c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c0cc8d0 con 0x7fae5c159450 2023-07-20T10:02:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c0cce90 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae60d33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0ccbb0 con 0x7fae5c159830 2023-07-20T10:02:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5ad9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fae5c0cc3e0 0x7fae5c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c159830 0x7fae5c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5a59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fae5c159450 0x7fae5c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:45818/0 (socket says 172.21.15.82:45818) 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5a59c640 1 -- 172.21.15.82:0/3376313784 learned_addr learned my addr 172.21.15.82:0/3376313784 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5ad9d640 1 -- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c159830 msgr2=0x7fae5c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5ad9d640 1 --2- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c159830 0x7fae5c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5ad9d640 1 -- 172.21.15.82:0/3376313784 >> v1:172.21.15.183:6789/0 conn(0x7fae5c159450 legacy=0x7fae5c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.578+0000 7fae5ad9d640 1 -- 172.21.15.82:0/3376313784 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c159cc0 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae5ad9d640 1 --2- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c0afd50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae540097c0 tx=0x7fae5401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49f1ac750b1d0b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae59d9b640 1 -- 172.21.15.82:0/3376313784 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540ad660 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae59d9b640 1 -- 172.21.15.82:0/3376313784 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae540ad7c0 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae59d9b640 1 -- 172.21.15.82:0/3376313784 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540adb50 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 -- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 msgr2=0x7fae5c0afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 --2- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c0afd50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fae540097c0 tx=0x7fae5401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 -- 172.21.15.82:0/3376313784 shutdown_connections 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 --2- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c0afd50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 --2- 172.21.15.82:0/3376313784 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c159830 0x7fae5c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 -- 172.21.15.82:0/3376313784 >> 172.21.15.82:0/3376313784 conn(0x7fae5c0cad50 msgr2=0x7fae5c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 -- 172.21.15.82:0/3376313784 shutdown_connections 2023-07-20T10:02:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.582+0000 7fae60d33640 1 -- 172.21.15.82:0/3376313784 wait complete. 2023-07-20T10:02:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 Processor -- start 2023-07-20T10:02:30.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- start start 2023-07-20T10:02:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 0x7fae5c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c15e880 con 0x7fae5c159450 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0c2de0 con 0x7fae5c0cc3e0 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c0c24b0 con 0x7fae5c1f4bb0 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39198/0 (socket says 172.21.15.82:39198) 2023-07-20T10:02:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 -- 172.21.15.82:0/1944958143 learned_addr learned my addr 172.21.15.82:0/1944958143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae5ad9d640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 0x7fae5c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae5a59c640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 -- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 msgr2=0x7fae5c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 0x7fae5c0b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 -- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 msgr2=0x7fae5c15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 -- 172.21.15.82:0/1944958143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54009420 con 0x7fae5c159450 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae5ad9d640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 0x7fae5c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae5a59c640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae51d9b640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae4400efc0 tx=0x7fae4400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44009b80 con 0x7fae5c159450 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400f040 con 0x7fae5c159450 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440146a0 con 0x7fae5c159450 2023-07-20T10:02:30.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5c0c2790 con 0x7fae5c159450 2023-07-20T10:02:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.586+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c0b1e90 con 0x7fae5c159450 2023-07-20T10:02:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c0c2f50 con 0x7fae5c159450 2023-07-20T10:02:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fae44014800 con 0x7fae5c159450 2023-07-20T10:02:30.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae537fe640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 0x7fae3c068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fae44084c20 con 0x7fae5c159450 2023-07-20T10:02:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae5a59c640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 0x7fae3c068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:30.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.590+0000 7fae5a59c640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 0x7fae3c068940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f70 tx=0x7fae4c009040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:30.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.594+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae44051d10 con 0x7fae5c159450 2023-07-20T10:02:30.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.758+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fae5c04da30 con 0x7fae3c066480 2023-07-20T10:02:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.826+0000 7fae537fe640 1 -- 172.21.15.82:0/1944958143 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fae5c04da30 con 0x7fae3c066480 2023-07-20T10:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 msgr2=0x7fae3c068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 0x7fae3c068940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fae4c000f70 tx=0x7fae4c009040 comp rx=0 tx=0).stop 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 msgr2=0x7fae5c1f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fae4400efc0 tx=0x7fae4400c490 comp rx=0 tx=0).stop 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 shutdown_connections 2023-07-20T10:02:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fae3c066480 0x7fae3c068940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fae5c1f4bb0 0x7fae5c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5c159450 0x7fae5c1f4670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 --2- 172.21.15.82:0/1944958143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fae5c0cc3e0 0x7fae5c15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 >> 172.21.15.82:0/1944958143 conn(0x7fae5c0cad50 msgr2=0x7fae5c0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 shutdown_connections 2023-07-20T10:02:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:30.830+0000 7fae60d33640 1 -- 172.21.15.82:0/1944958143 wait complete. 2023-07-20T10:02:30.837 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-07-20T10:02:30.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.838 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-20T10:02:30.848 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:30.848 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:30.848 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:30.848 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:30.849 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:30.850 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:30.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.851 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:30.968 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:30.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:30.969 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:31.004 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:31.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.005 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:31.071 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:31.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.073 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:31.132 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:31.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.133 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:31.188 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:31.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.189 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:31.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:31.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.249 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:31.315 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:31.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.316 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:31.376 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:31.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.377 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:31.432 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:31.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.433 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:31.488 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:31.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.489 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:31.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:31.545 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-07-20T10:02:31.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-07-20T10:02:31.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.790+0000 7fecb7427640 1 Processor -- start 2023-07-20T10:02:31.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.790+0000 7fecb7427640 1 -- start start 2023-07-20T10:02:31.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb7427640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fecb00ca5a0 0x7fecb015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb7427640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb0071950 con 0x7fecb015ec90 2023-07-20T10:02:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb7427640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb015b230 con 0x7fecb006f710 2023-07-20T10:02:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb7427640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb015bad0 con 0x7fecb00ca5a0 2023-07-20T10:02:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb59c4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fecb015ec90 0x7fecb015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58282/0 (socket says 172.21.15.82:58282) 2023-07-20T10:02:31.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb59c4640 1 -- 172.21.15.82:0/3660106555 learned_addr learned my addr 172.21.15.82:0/3660106555 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb49c2640 1 --2- 172.21.15.82:0/3660106555 >> v2:172.21.15.183:3300/0 conn(0x7fecb00ca5a0 0x7fecb015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524614156 0 0) 0x7fecb0071950 con 0x7fecb015ec90 2023-07-20T10:02:31.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec9c003530 con 0x7fecb015ec90 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734031805 0 0) 0x7fecb015b230 con 0x7fecb006f710 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb0071950 con 0x7fecb006f710 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3023966670 0 0) 0x7fec9c003530 con 0x7fecb015ec90 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb49c2640 1 -- 172.21.15.82:0/3660106555 >> v1:172.21.15.183:6789/0 conn(0x7fecb006f710 legacy=0x7fecb006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb49c2640 1 -- 172.21.15.82:0/3660106555 >> v1:172.21.15.82:6789/0 conn(0x7fecb015ec90 legacy=0x7fecb015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:31.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.794+0000 7fecb49c2640 1 -- 172.21.15.82:0/3660106555 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb015b510 con 0x7fecb00ca5a0 2023-07-20T10:02:31.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb49c2640 1 --2- 172.21.15.82:0/3660106555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb015e750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feca00097f0 tx=0x7feca001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e31fd78ef29e941 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8001680 con 0x7fecb00ca5a0 2023-07-20T10:02:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00a7050 con 0x7fecb00ca5a0 2023-07-20T10:02:31.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7feca7fff640 1 -- 172.21.15.82:0/3660106555 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00ab620 con 0x7fecb00ca5a0 2023-07-20T10:02:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 -- 172.21.15.82:0/3660106555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 msgr2=0x7fecb015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 --2- 172.21.15.82:0/3660106555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb015e750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feca00097f0 tx=0x7feca001c370 comp rx=0 tx=0).stop 2023-07-20T10:02:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 -- 172.21.15.82:0/3660106555 shutdown_connections 2023-07-20T10:02:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 --2- 172.21.15.82:0/3660106555 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb015e750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:31.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 -- 172.21.15.82:0/3660106555 >> 172.21.15.82:0/3660106555 conn(0x7fecb00cad50 msgr2=0x7fecb00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 -- 172.21.15.82:0/3660106555 shutdown_connections 2023-07-20T10:02:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.798+0000 7fecb7427640 1 -- 172.21.15.82:0/3660106555 wait complete. 2023-07-20T10:02:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 Processor -- start 2023-07-20T10:02:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- start start 2023-07-20T10:02:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb01f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 0x7fecb00cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0146c00 con 0x7fecb006f710 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00c5710 con 0x7fecb00ca5a0 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00c59f0 con 0x7fecb015ec90 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39204/0 (socket says 172.21.15.82:39204) 2023-07-20T10:02:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 -- 172.21.15.82:0/3680970647 learned_addr learned my addr 172.21.15.82:0/3680970647 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb49c2640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb01f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb59c4640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 0x7fecb00cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 -- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 msgr2=0x7fecb00cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 0x7fecb00cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 -- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 msgr2=0x7fecb01f5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb01f5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 -- 172.21.15.82:0/3680970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009420 con 0x7fecb006f710 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb59c4640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 0x7fecb00cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb51c3640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c870 tx=0x7fecac00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac003b80 con 0x7fecb006f710 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac003ce0 con 0x7fecb006f710 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac00aa30 con 0x7fecb006f710 2023-07-20T10:02:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00c5cd0 con 0x7fecb006f710 2023-07-20T10:02:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb00c6290 con 0x7fecb006f710 2023-07-20T10:02:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.802+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb004da30 con 0x7fecb006f710 2023-07-20T10:02:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.806+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fecac00ab90 con 0x7fecb006f710 2023-07-20T10:02:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.806+0000 7feca5ffb640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 0x7fec94068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.806+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7045+0+0 (secure 0 0 0) 0x7fecac084410 con 0x7fecb006f710 2023-07-20T10:02:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.806+0000 7fecb49c2640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 0x7fec94068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.806+0000 7fecb49c2640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 0x7fec94068940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feca00ad000 tx=0x7feca0008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.810+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecac051190 con 0x7fecb006f710 2023-07-20T10:02:31.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:31.982+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fecb0168440 con 0x7fec94066480 2023-07-20T10:02:32.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7feca5ffb640 1 -- 172.21.15.82:0/3680970647 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7feca00bc0d0 con 0x7fec94066480 2023-07-20T10:02:32.055 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-07-20T10:02:32.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 msgr2=0x7fec94068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:32.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 0x7fec94068940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feca00ad000 tx=0x7feca0008040 comp rx=0 tx=0).stop 2023-07-20T10:02:32.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 msgr2=0x7fecb01466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fecac00c870 tx=0x7fecac00cd30 comp rx=0 tx=0).stop 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 shutdown_connections 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fec94066480 0x7fec94068940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fecb015ec90 0x7fecb00cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb00ca5a0 0x7fecb01f5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 --2- 172.21.15.82:0/3680970647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecb006f710 0x7fecb01466c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:32.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 >> 172.21.15.82:0/3680970647 conn(0x7fecb00cad50 msgr2=0x7fecb00adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:32.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 shutdown_connections 2023-07-20T10:02:32.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:32.066+0000 7fecb7427640 1 -- 172.21.15.82:0/3680970647 wait complete. 2023-07-20T10:02:32.075 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-07-20T10:02:32.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.076 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-20T10:02:32.089 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:32.089 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:32.089 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:32.089 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:32.089 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_01_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:32.090 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:32.091 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:32.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.092 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:32.154 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:32.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.154 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:32.216 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:32.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.217 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:32.272 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:32.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.273 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:32.328 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:32.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.329 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:32.388 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:32.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.389 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:32.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:32.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.445 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:32.501 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_59_01_UTC 2023-07-20T10:02:32.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.502 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-09_59_01_UTC) 2023-07-20T10:02:32.560 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:32.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.561 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:32.616 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:32.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.617 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:32.676 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:32.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.677 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:32.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:32.732 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-07-20T10:02:32.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-07-20T10:02:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 Processor -- start 2023-07-20T10:02:33.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 -- start start 2023-07-20T10:02:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30e806c120 0x7f30e80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30e81602b0 0x7f30e8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e80d0970 con 0x7f30e806ab10 2023-07-20T10:02:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e8160e20 con 0x7f30e81602b0 2023-07-20T10:02:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30ed7e8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80cd300 con 0x7f30e806c120 2023-07-20T10:02:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30dffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30e81602b0 0x7f30e8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30dffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30e81602b0 0x7f30e8160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39210/0 (socket says 172.21.15.82:39210) 2023-07-20T10:02:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30dffff640 1 -- 172.21.15.82:0/3319954057 learned_addr learned my addr 172.21.15.82:0/3319954057 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.034+0000 7f30e6ffd640 1 --2- 172.21.15.82:0/3319954057 >> v2:172.21.15.183:3300/0 conn(0x7f30e806c120 0x7f30e80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30dffff640 1 -- 172.21.15.82:0/3319954057 >> v2:172.21.15.183:3300/0 conn(0x7f30e806c120 msgr2=0x7f30e80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30dffff640 1 --2- 172.21.15.82:0/3319954057 >> v2:172.21.15.183:3300/0 conn(0x7f30e806c120 0x7f30e80cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30dffff640 1 -- 172.21.15.82:0/3319954057 >> v1:172.21.15.183:6789/0 conn(0x7f30e806ab10 legacy=0x7f30e806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30dffff640 1 -- 172.21.15.82:0/3319954057 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80cd5e0 con 0x7f30e81602b0 2023-07-20T10:02:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30dffff640 1 --2- 172.21.15.82:0/3319954057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8160740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d00e0 tx=0x7f30d001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a063315b1ef62b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:33.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30e67fc640 1 -- 172.21.15.82:0/3319954057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00ac630 con 0x7f30e81602b0 2023-07-20T10:02:33.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30e67fc640 1 -- 172.21.15.82:0/3319954057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d00ac790 con 0x7f30e81602b0 2023-07-20T10:02:33.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30e67fc640 1 -- 172.21.15.82:0/3319954057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00acb20 con 0x7f30e81602b0 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3319954057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 msgr2=0x7f30e8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3319954057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8160740 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d00e0 tx=0x7f30d001c3b0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3319954057 shutdown_connections 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3319954057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8160740 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3319954057 >> v2:172.21.15.183:3300/0 conn(0x7f30e806c120 0x7f30e80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.038+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3319954057 >> 172.21.15.82:0/3319954057 conn(0x7f30e808c0a0 msgr2=0x7f30e809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3319954057 shutdown_connections 2023-07-20T10:02:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3319954057 wait complete. 2023-07-20T10:02:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 Processor -- start 2023-07-20T10:02:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- start start 2023-07-20T10:02:33.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30e806ab10 0x7f30e80c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30e806c120 0x7f30e81542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80c6c80 con 0x7f30e81602b0 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e815a290 con 0x7f30e806ab10 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30ed7e8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80c6320 con 0x7f30e806c120 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39220/0 (socket says 172.21.15.82:39220) 2023-07-20T10:02:33.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 -- 172.21.15.82:0/3961954521 learned_addr learned my addr 172.21.15.82:0/3961954521 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:33.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e6ffd640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30e806ab10 0x7f30e80c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30dffff640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30e806c120 0x7f30e81542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 -- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30e806c120 msgr2=0x7f30e81542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30e806c120 0x7f30e81542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 -- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30e806ab10 msgr2=0x7f30e80c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30e806ab10 0x7f30e80c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 -- 172.21.15.82:0/3961954521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d00094d0 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.042+0000 7f30e77fe640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c7a0 tx=0x7f30e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e0003b80 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e0003ce0 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e80c65c0 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e000aa90 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8159f80 con 0x7f30e81602b0 2023-07-20T10:02:33.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e80c6dc0 con 0x7f30e81602b0 2023-07-20T10:02:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f30e000abf0 con 0x7f30e81602b0 2023-07-20T10:02:33.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 0x7f30c8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6901+0+0 (secure 0 0 0) 0x7f30e0084240 con 0x7f30e81602b0 2023-07-20T10:02:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30e6ffd640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 0x7f30c8068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:33.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.046+0000 7f30e6ffd640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 0x7f30c8068940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30e81685e0 tx=0x7f30d8009190 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:33.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.050+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30e80c6dc0 con 0x7f30e81602b0 2023-07-20T10:02:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.218+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f30e815f2d0 con 0x7f30c8066480 2023-07-20T10:02:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.290+0000 7f30df7fe640 1 -- 172.21.15.82:0/3961954521 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f30d8011b50 con 0x7f30c8066480 2023-07-20T10:02:33.280 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-07-20T10:02:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.290+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 msgr2=0x7f30c8068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.290+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 0x7f30c8068940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f30e81685e0 tx=0x7f30d8009190 comp rx=0 tx=0).stop 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.290+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 msgr2=0x7f30e8159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.290+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c7a0 tx=0x7f30e000cc60 comp rx=0 tx=0).stop 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 shutdown_connections 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f30c8066480 0x7f30c8068940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30e81602b0 0x7f30e8159a40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30e806c120 0x7f30e81542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 --2- 172.21.15.82:0/3961954521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30e806ab10 0x7f30e80c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:33.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 >> 172.21.15.82:0/3961954521 conn(0x7f30e808c0a0 msgr2=0x7f30e806af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:33.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 shutdown_connections 2023-07-20T10:02:33.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:33.294+0000 7f30ed7e8640 1 -- 172.21.15.82:0/3961954521 wait complete. 2023-07-20T10:02:33.300 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-07-20T10:02:33.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.301 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-20T10:02:33.311 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:33.311 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:33.311 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_01_UTC 2023-07-20T10:02:33.311 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:33.311 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:33.312 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:33.313 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:33.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.314 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:33.374 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:33.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.375 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:33.431 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_54_01_UTC 2023-07-20T10:02:33.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.432 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_54_01_UTC) 2023-07-20T10:02:33.488 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:33.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.489 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:33.544 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:33.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.545 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:33.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:33.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.601 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:33.656 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:33.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.657 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:33.716 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:33.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.717 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:33.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:33.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.780 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:33.835 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:33.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.836 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:33.892 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:33.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.893 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:33.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:33.965 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-07-20T10:02:34.016 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-07-20T10:02:34.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 Processor -- start 2023-07-20T10:02:34.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 -- start start 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 0x7f5f9015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900cc8d0 con 0x7f5f90159830 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f900ccbb0 con 0x7f5f900afd50 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f956cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900cce90 con 0x7f5f90159450 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f867fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f90159830 0x7f5f900cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50030/0 (socket says 172.21.15.82:50030) 2023-07-20T10:02:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.250+0000 7f5f867fc640 1 -- 172.21.15.82:0/3554936822 learned_addr learned my addr 172.21.15.82:0/3554936822 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8effd640 1 --2- 172.21.15.82:0/3554936822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 0x7f5f9015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326765123 0 0) 0x7f5f900cc8d0 con 0x7f5f90159830 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f7c003530 con 0x7f5f90159830 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887065130 0 0) 0x7f5f900ccbb0 con 0x7f5f900afd50 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f900cc8d0 con 0x7f5f900afd50 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8effd640 1 -- 172.21.15.82:0/3554936822 >> v1:172.21.15.183:6789/0 conn(0x7f5f900afd50 legacy=0x7f5f9015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 807786082 0 0) 0x7f5f7c003530 con 0x7f5f90159830 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8effd640 1 -- 172.21.15.82:0/3554936822 >> v1:172.21.15.82:6789/0 conn(0x7f5f90159830 legacy=0x7f5f900cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8effd640 1 -- 172.21.15.82:0/3554936822 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f90159cc0 con 0x7f5f90159450 2023-07-20T10:02:34.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8effd640 1 --2- 172.21.15.82:0/3554936822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 0x7f5f9015a4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009dc0 tx=0x7f5f8001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62c8eaff5ea65d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:34.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78001680 con 0x7f5f90159450 2023-07-20T10:02:34.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f800a5680 con 0x7f5f90159450 2023-07-20T10:02:34.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.254+0000 7f5f8e7fc640 1 -- 172.21.15.82:0/3554936822 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800a5a10 con 0x7f5f90159450 2023-07-20T10:02:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- 172.21.15.82:0/3554936822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 msgr2=0x7f5f9015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 --2- 172.21.15.82:0/3554936822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 0x7f5f9015a4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009dc0 tx=0x7f5f8001c860 comp rx=0 tx=0).stop 2023-07-20T10:02:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- 172.21.15.82:0/3554936822 shutdown_connections 2023-07-20T10:02:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 --2- 172.21.15.82:0/3554936822 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90159450 0x7f5f9015a4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- 172.21.15.82:0/3554936822 >> 172.21.15.82:0/3554936822 conn(0x7f5f900cad50 msgr2=0x7f5f900cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:34.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- 172.21.15.82:0/3554936822 shutdown_connections 2023-07-20T10:02:34.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- 172.21.15.82:0/3554936822 wait complete. 2023-07-20T10:02:34.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 Processor -- start 2023-07-20T10:02:34.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- start start 2023-07-20T10:02:34.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f90159450 0x7f5f900c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90153680 0x7f5f9006b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c4720 con 0x7f5f900afd50 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c4a00 con 0x7f5f90159450 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f956cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f900c4ce0 con 0x7f5f90153680 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:34.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41110/0 (socket says 172.21.15.82:41110) 2023-07-20T10:02:34.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 -- 172.21.15.82:0/1033068987 learned_addr learned my addr 172.21.15.82:0/1033068987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:34.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8f7fe640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90153680 0x7f5f9006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:34.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f867fc640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f90159450 0x7f5f900c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 -- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90153680 msgr2=0x7f5f9006b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90153680 0x7f5f9006b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 -- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f90159450 msgr2=0x7f5f900c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f90159450 0x7f5f900c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.258+0000 7f5f8effd640 1 -- 172.21.15.82:0/1033068987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f80009a70 con 0x7f5f900afd50 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f8effd640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001af10 tx=0x7f5f80019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800bf070 con 0x7f5f900afd50 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f80009450 con 0x7f5f900afd50 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f900c4fc0 con 0x7f5f900afd50 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f800ad890 con 0x7f5f900afd50 2023-07-20T10:02:34.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f900b38a0 con 0x7f5f900afd50 2023-07-20T10:02:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9004da30 con 0x7f5f900afd50 2023-07-20T10:02:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f5f800b4050 con 0x7f5f900afd50 2023-07-20T10:02:34.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 0x7f5f70068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:34.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7045+0+0 (secure 0 0 0) 0x7f5f8011e760 con 0x7f5f900afd50 2023-07-20T10:02:34.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.262+0000 7f5f867fc640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 0x7f5f70068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:34.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.266+0000 7f5f867fc640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 0x7f5f70068940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f900b1430 tx=0x7f5f780016c0 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:34.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.266+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f800eb610 con 0x7f5f900afd50 2023-07-20T10:02:34.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.430+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f900c4b70 con 0x7f5f70066480 2023-07-20T10:02:34.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f87fff640 1 -- 172.21.15.82:0/1033068987 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5f900c4b70 con 0x7f5f70066480 2023-07-20T10:02:34.491 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-07-20T10:02:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 msgr2=0x7f5f70068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 0x7f5f70068940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f900b1430 tx=0x7f5f780016c0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 msgr2=0x7f5f900c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f8001af10 tx=0x7f5f80019600 comp rx=0 tx=0).stop 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 shutdown_connections 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f5f70066480 0x7f5f70068940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f90153680 0x7f5f9006b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f90159450 0x7f5f900c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 --2- 172.21.15.82:0/1033068987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f900afd50 0x7f5f900c2810 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.502+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 >> 172.21.15.82:0/1033068987 conn(0x7f5f900cad50 msgr2=0x7f5f90158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.506+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 shutdown_connections 2023-07-20T10:02:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:34.506+0000 7f5f956cb640 1 -- 172.21.15.82:0/1033068987 wait complete. 2023-07-20T10:02:34.511 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-07-20T10:02:34.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.512 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-20T10:02:34.522 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:34.523 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:34.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:34.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:34.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:34.524 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:34.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:34.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.526 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:34.590 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:34.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.591 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:34.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:34.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.648 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:34.705 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:34.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.705 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:34.760 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:34.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.761 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:34.816 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:34.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.817 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:34.872 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:34.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.873 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:34.946 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:34.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:34.948 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:35.004 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:35.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.005 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:35.072 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:35.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.073 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:35.131 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:35.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.132 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:35.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.188 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-07-20T10:02:35.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-07-20T10:02:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.442+0000 7f4cffc19640 1 Processor -- start 2023-07-20T10:02:35.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.442+0000 7f4cffc19640 1 -- start start 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cffc19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 0x7f4cf815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cffc19640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4cf8159830 0x7f4cf80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cffc19640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf80cc8d0 con 0x7f4cf80cc3e0 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cffc19640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf80cce90 con 0x7f4cf8159830 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cffc19640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf80ccbb0 con 0x7f4cf8159450 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfe1b6640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4cf80cc3e0 0x7f4cf80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50036/0 (socket says 172.21.15.82:50036) 2023-07-20T10:02:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfe1b6640 1 -- 172.21.15.82:0/2027069167 learned_addr learned my addr 172.21.15.82:0/2027069167 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/2027069167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 0x7f4cf815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd1b4640 1 --2- 172.21.15.82:0/2027069167 >> v2:172.21.15.183:3300/0 conn(0x7f4cf8159830 0x7f4cf80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfc9b3640 1 -- 172.21.15.82:0/2027069167 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909576026 0 0) 0x7f4cf80cc8d0 con 0x7f4cf80cc3e0 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfc9b3640 1 -- 172.21.15.82:0/2027069167 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce4003530 con 0x7f4cf80cc3e0 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd9b5640 1 -- 172.21.15.82:0/2027069167 >> v2:172.21.15.183:3300/0 conn(0x7f4cf8159830 msgr2=0x7f4cf80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/2027069167 >> v2:172.21.15.183:3300/0 conn(0x7f4cf8159830 0x7f4cf80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd9b5640 1 -- 172.21.15.82:0/2027069167 >> v1:172.21.15.82:6789/0 conn(0x7f4cf80cc3e0 legacy=0x7f4cf80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.446+0000 7f4cfd9b5640 1 -- 172.21.15.82:0/2027069167 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8159cc0 con 0x7f4cf8159450 2023-07-20T10:02:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/2027069167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 0x7f4cf815a4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097c0 tx=0x7f4cf401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16df054dbc2ecba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cfc9b3640 1 -- 172.21.15.82:0/2027069167 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40a7070 con 0x7f4cf8159450 2023-07-20T10:02:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cfc9b3640 1 -- 172.21.15.82:0/2027069167 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf40ab430 con 0x7f4cf8159450 2023-07-20T10:02:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cfc9b3640 1 -- 172.21.15.82:0/2027069167 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf40ab7c0 con 0x7f4cf8159450 2023-07-20T10:02:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- 172.21.15.82:0/2027069167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 msgr2=0x7f4cf815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 --2- 172.21.15.82:0/2027069167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 0x7f4cf815a4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40097c0 tx=0x7f4cf401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- 172.21.15.82:0/2027069167 shutdown_connections 2023-07-20T10:02:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 --2- 172.21.15.82:0/2027069167 >> v2:172.21.15.183:3300/0 conn(0x7f4cf8159830 0x7f4cf80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 --2- 172.21.15.82:0/2027069167 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf8159450 0x7f4cf815a4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- 172.21.15.82:0/2027069167 >> 172.21.15.82:0/2027069167 conn(0x7f4cf80cad50 msgr2=0x7f4cf80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- 172.21.15.82:0/2027069167 shutdown_connections 2023-07-20T10:02:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- 172.21.15.82:0/2027069167 wait complete. 2023-07-20T10:02:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 Processor -- start 2023-07-20T10:02:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.450+0000 7f4cffc19640 1 -- start start 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf80cc3e0 0x7f4cf80c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf8159450 0x7f4cf8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8154860 con 0x7f4cf8155e40 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8154b40 con 0x7f4cf8159450 2023-07-20T10:02:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8154e20 con 0x7f4cf80cc3e0 2023-07-20T10:02:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41118/0 (socket says 172.21.15.82:41118) 2023-07-20T10:02:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 -- 172.21.15.82:0/3591496259 learned_addr learned my addr 172.21.15.82:0/3591496259 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf80cc3e0 0x7f4cf80c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfd1b4640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf8159450 0x7f4cf8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 -- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf80cc3e0 msgr2=0x7f4cf80c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf80cc3e0 0x7f4cf80c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 -- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf8159450 msgr2=0x7f4cf8155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf8159450 0x7f4cf8155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 -- 172.21.15.82:0/3591496259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009420 con 0x7f4cf8155e40 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cfe1b6640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cbc0 tx=0x7f4cf000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000aca0 con 0x7f4cf8155e40 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf000ae00 con 0x7f4cf8155e40 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0012620 con 0x7f4cf8155e40 2023-07-20T10:02:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf8155100 con 0x7f4cf8155e40 2023-07-20T10:02:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf80c90a0 con 0x7f4cf8155e40 2023-07-20T10:02:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf804da30 con 0x7f4cf8155e40 2023-07-20T10:02:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.454+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f4cf0007070 con 0x7f4cf8155e40 2023-07-20T10:02:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.458+0000 7f4cee7fc640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 0x7f4cdc068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.458+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7205+0+0 (secure 0 0 0) 0x7f4cf0084590 con 0x7f4cf8155e40 2023-07-20T10:02:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.458+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 0x7f4cdc068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.458+0000 7f4cfd9b5640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 0x7f4cdc068970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40af000 tx=0x7f4cf4008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.462+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4cf0051260 con 0x7f4cf8155e40 2023-07-20T10:02:35.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.630+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf8154cb0 con 0x7f4cdc0664b0 2023-07-20T10:02:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cee7fc640 1 -- 172.21.15.82:0/3591496259 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f4cf8154cb0 con 0x7f4cdc0664b0 2023-07-20T10:02:35.690 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-07-20T10:02:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 msgr2=0x7f4cdc068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 0x7f4cdc068970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cf40af000 tx=0x7f4cf4008040 comp rx=0 tx=0).stop 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 msgr2=0x7f4cf80c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4cf000cbc0 tx=0x7f4cf000a060 comp rx=0 tx=0).stop 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 shutdown_connections 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f4cdc0664b0 0x7f4cdc068970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4cf8155e40 0x7f4cf80c1e00 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4cf8159450 0x7f4cf8155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 --2- 172.21.15.82:0/3591496259 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4cf80cc3e0 0x7f4cf80c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 >> 172.21.15.82:0/3591496259 conn(0x7f4cf80cad50 msgr2=0x7f4cf815bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 shutdown_connections 2023-07-20T10:02:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:35.702+0000 7f4cffc19640 1 -- 172.21.15.82:0/3591496259 wait complete. 2023-07-20T10:02:35.710 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-07-20T10:02:35.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.710 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-20T10:02:35.721 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:35.721 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:35.722 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:35.723 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:35.723 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:35.723 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:35.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.724 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:35.779 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:35.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.780 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:35.836 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:35.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.837 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:35.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:35.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.900 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:35.956 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:35.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:35.957 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:36.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:36.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.014 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:36.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:36.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.075 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:36.138 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:36.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.139 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:36.201 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:36.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.202 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:36.263 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:36.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.264 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:36.323 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:36.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.325 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:36.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.380 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-07-20T10:02:36.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-07-20T10:02:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.634+0000 7f0774100640 1 Processor -- start 2023-07-20T10:02:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.634+0000 7f0774100640 1 -- start start 2023-07-20T10:02:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0774100640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 0x7f076c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0774100640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f076c070970 0x7f076c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0774100640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f076c0c95d0 con 0x7f076c06b620 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0774100640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0c9fa0 con 0x7f076c070970 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0774100640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c1590c0 con 0x7f076c158ce0 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f076c070970 0x7f076c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f076c070970 0x7f076c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41122/0 (socket says 172.21.15.82:41122) 2023-07-20T10:02:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 -- 172.21.15.82:0/2960119458 learned_addr learned my addr 172.21.15.82:0/2960119458 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0771e9c640 1 --2- 172.21.15.82:0/2960119458 >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 0x7f076c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 -- 172.21.15.82:0/2960119458 >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 msgr2=0x7f076c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 --2- 172.21.15.82:0/2960119458 >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 0x7f076c0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 -- 172.21.15.82:0/2960119458 >> v1:172.21.15.82:6789/0 conn(0x7f076c06b620 legacy=0x7f076c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f077169b640 1 -- 172.21.15.82:0/2960119458 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0c89c0 con 0x7f076c070970 2023-07-20T10:02:36.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.638+0000 7f0771e9c640 1 --2- 172.21.15.82:0/2960119458 >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 0x7f076c0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:36.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f077169b640 1 --2- 172.21.15.82:0/2960119458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c070970 0x7f076c070e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f076c06a6c0 tx=0x7f075c01e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6853cfb70bc2234 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0770e9a640 1 -- 172.21.15.82:0/2960119458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c004230 con 0x7f076c070970 2023-07-20T10:02:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0770e9a640 1 -- 172.21.15.82:0/2960119458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c0ab070 con 0x7f076c070970 2023-07-20T10:02:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0770e9a640 1 -- 172.21.15.82:0/2960119458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0a7770 con 0x7f076c070970 2023-07-20T10:02:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- 172.21.15.82:0/2960119458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c070970 msgr2=0x7f076c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 --2- 172.21.15.82:0/2960119458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c070970 0x7f076c070e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f076c06a6c0 tx=0x7f075c01e9b0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- 172.21.15.82:0/2960119458 shutdown_connections 2023-07-20T10:02:36.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 --2- 172.21.15.82:0/2960119458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c070970 0x7f076c070e00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 --2- 172.21.15.82:0/2960119458 >> v2:172.21.15.183:3300/0 conn(0x7f076c158ce0 0x7f076c0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- 172.21.15.82:0/2960119458 >> 172.21.15.82:0/2960119458 conn(0x7f076c0cad50 msgr2=0x7f076c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:36.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- 172.21.15.82:0/2960119458 shutdown_connections 2023-07-20T10:02:36.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- 172.21.15.82:0/2960119458 wait complete. 2023-07-20T10:02:36.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 Processor -- start 2023-07-20T10:02:36.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.642+0000 7f0774100640 1 -- start start 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 0x7f076c14c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 0x7f076c14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0afba0 con 0x7f076c06b620 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c144940 con 0x7f076c158ce0 2023-07-20T10:02:36.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0aeb00 con 0x7f076c070970 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41138/0 (socket says 172.21.15.82:41138) 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 -- 172.21.15.82:0/2618647192 learned_addr learned my addr 172.21.15.82:0/2618647192 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 -- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 msgr2=0x7f076c14c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f077169b640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 0x7f076c14c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 0x7f076c14c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f077269d640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 0x7f076c14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 -- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 msgr2=0x7f076c14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 0x7f076c14cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 -- 172.21.15.82:0/2618647192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c00b780 con 0x7f076c06b620 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f077169b640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 0x7f076c14c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f077269d640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 0x7f076c14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0771e9c640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f076800d800 tx=0x7f076800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:36.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07680096c0 con 0x7f076c06b620 2023-07-20T10:02:36.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0768009820 con 0x7f076c06b620 2023-07-20T10:02:36.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0768009bd0 con 0x7f076c06b620 2023-07-20T10:02:36.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c0aede0 con 0x7f076c06b620 2023-07-20T10:02:36.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0af3a0 con 0x7f076c06b620 2023-07-20T10:02:36.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c04da30 con 0x7f076c06b620 2023-07-20T10:02:36.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.646+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f0768009d30 con 0x7f076c06b620 2023-07-20T10:02:36.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.650+0000 7f07627fc640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 0x7f0750068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:36.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.650+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7633+0+0 (secure 0 0 0) 0x7f0768084d90 con 0x7f076c06b620 2023-07-20T10:02:36.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.650+0000 7f077169b640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 0x7f0750068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:36.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.650+0000 7f077169b640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 0x7f0750068940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f075c0b1000 tx=0x7f075c0a9070 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:36.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.654+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07680519f0 con 0x7f076c06b620 2023-07-20T10:02:36.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.814+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f076c0719b0 con 0x7f0750066480 2023-07-20T10:02:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.906+0000 7f07627fc640 1 -- 172.21.15.82:0/2618647192 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f075c004130 con 0x7f0750066480 2023-07-20T10:02:36.896 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-07-20T10:02:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 msgr2=0x7f0750068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 0x7f0750068940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f075c0b1000 tx=0x7f075c0a9070 comp rx=0 tx=0).stop 2023-07-20T10:02:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 msgr2=0x7f076c144400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f076800d800 tx=0x7f076800dcc0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 shutdown_connections 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f0750066480 0x7f0750068940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f076c158ce0 0x7f076c14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f076c070970 0x7f076c14c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 --2- 172.21.15.82:0/2618647192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f076c06b620 0x7f076c144400 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 >> 172.21.15.82:0/2618647192 conn(0x7f076c0cad50 msgr2=0x7f076c1592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 shutdown_connections 2023-07-20T10:02:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:36.910+0000 7f0774100640 1 -- 172.21.15.82:0/2618647192 wait complete. 2023-07-20T10:02:36.917 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-07-20T10:02:36.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.918 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:36.928 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:36.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:36.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:36.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:36.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:36.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:36.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:36.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.931 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:36.989 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:36.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:36.990 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:37.047 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:37.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.048 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:37.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:37.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.104 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:37.159 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:37.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.160 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:37.219 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:37.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.220 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:37.275 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:37.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.275 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:37.331 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:37.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.332 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:37.388 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:37.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.389 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:37.443 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:37.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.444 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:37.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:37.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.505 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:37.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:37.560 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-07-20T10:02:37.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-07-20T10:02:37.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.806+0000 7f381eb96640 1 Processor -- start 2023-07-20T10:02:37.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.806+0000 7f381eb96640 1 -- start start 2023-07-20T10:02:37.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3818159450 0x7f381815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3818159830 0x7f38180cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f38180cc3e0 0x7f38180afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180cce90 con 0x7f3818159450 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180cc8d0 con 0x7f38180cc3e0 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381eb96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180ccbb0 con 0x7f3818159830 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3818159450 0x7f381815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3818159450 0x7f381815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41148/0 (socket says 172.21.15.82:41148) 2023-07-20T10:02:37.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 -- 172.21.15.82:0/1716928948 learned_addr learned my addr 172.21.15.82:0/1716928948 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f380ffff640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3818159830 0x7f38180cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381d133640 1 --2- 172.21.15.82:0/1716928948 >> v2:172.21.15.183:3300/0 conn(0x7f38180cc3e0 0x7f38180afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 -- 172.21.15.82:0/1716928948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3818159830 msgr2=0x7f38180cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3818159830 0x7f38180cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 -- 172.21.15.82:0/1716928948 >> v2:172.21.15.183:3300/0 conn(0x7f38180cc3e0 msgr2=0x7f38180afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 --2- 172.21.15.82:0/1716928948 >> v2:172.21.15.183:3300/0 conn(0x7f38180cc3e0 0x7f38180afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 -- 172.21.15.82:0/1716928948 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818159cc0 con 0x7f3818159450 2023-07-20T10:02:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.810+0000 7f381c932640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3818159450 0x7f381815a4c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f38180ce1b0 tx=0x7f381401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a447811a1562e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f380f7fe640 1 -- 172.21.15.82:0/1716928948 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140ac600 con 0x7f3818159450 2023-07-20T10:02:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f380f7fe640 1 -- 172.21.15.82:0/1716928948 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140a8050 con 0x7f3818159450 2023-07-20T10:02:37.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f380f7fe640 1 -- 172.21.15.82:0/1716928948 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140ac980 con 0x7f3818159450 2023-07-20T10:02:37.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- 172.21.15.82:0/1716928948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3818159450 msgr2=0x7f381815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:37.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3818159450 0x7f381815a4c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f38180ce1b0 tx=0x7f381401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- 172.21.15.82:0/1716928948 shutdown_connections 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- 172.21.15.82:0/1716928948 >> v2:172.21.15.183:3300/0 conn(0x7f38180cc3e0 0x7f38180afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3818159830 0x7f38180cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- 172.21.15.82:0/1716928948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3818159450 0x7f381815a4c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- 172.21.15.82:0/1716928948 >> 172.21.15.82:0/1716928948 conn(0x7f38180cad50 msgr2=0x7f38180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- 172.21.15.82:0/1716928948 shutdown_connections 2023-07-20T10:02:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- 172.21.15.82:0/1716928948 wait complete. 2023-07-20T10:02:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 Processor -- start 2023-07-20T10:02:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- start start 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38180cc3e0 0x7f3818152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3818159450 0x7f3818150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181532c0 con 0x7f38181516a0 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38181508e0 con 0x7f3818159450 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.814+0000 7f381eb96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3818150bc0 con 0x7f38180cc3e0 2023-07-20T10:02:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41152/0 (socket says 172.21.15.82:41152) 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 -- 172.21.15.82:0/1300171690 learned_addr learned my addr 172.21.15.82:0/1300171690 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381c932640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38180cc3e0 0x7f3818152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380ffff640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3818159450 0x7f3818150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 -- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38180cc3e0 msgr2=0x7f3818152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38180cc3e0 0x7f3818152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 -- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3818159450 msgr2=0x7f3818150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3818159450 0x7f3818150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 -- 172.21.15.82:0/1300171690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140094d0 con 0x7f38181516a0 2023-07-20T10:02:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381d133640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3810007e30 tx=0x7f381000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810014420 con 0x7f38181516a0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810014580 con 0x7f38181516a0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3818150ea0 con 0x7f38181516a0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810014930 con 0x7f38181516a0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3818151b20 con 0x7f38181516a0 2023-07-20T10:02:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381804da30 con 0x7f38181516a0 2023-07-20T10:02:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3810014a90 con 0x7f38181516a0 2023-07-20T10:02:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 0x7f3804068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.818+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f3810084d00 con 0x7f38181516a0 2023-07-20T10:02:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.822+0000 7f381c932640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 0x7f3804068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:37.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.822+0000 7f381c932640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 0x7f3804068940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38140ae000 tx=0x7f38140a7000 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:37.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:37.822+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3810051b60 con 0x7f38181516a0 2023-07-20T10:02:38.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.010+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3818150a50 con 0x7f3804066480 2023-07-20T10:02:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.130+0000 7f380d7fa640 1 -- 172.21.15.82:0/1300171690 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3818150a50 con 0x7f3804066480 2023-07-20T10:02:38.121 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-07-20T10:02:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 msgr2=0x7f3804068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 0x7f3804068940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f38140ae000 tx=0x7f38140a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 msgr2=0x7f3818155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3810007e30 tx=0x7f381000e4b0 comp rx=0 tx=0).stop 2023-07-20T10:02:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 shutdown_connections 2023-07-20T10:02:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3804066480 0x7f3804068940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38181516a0 0x7f3818155bf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3818159450 0x7f3818150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 --2- 172.21.15.82:0/1300171690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f38180cc3e0 0x7f3818152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 >> 172.21.15.82:0/1300171690 conn(0x7f38180cad50 msgr2=0x7f3818070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 shutdown_connections 2023-07-20T10:02:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:38.134+0000 7f381eb96640 1 -- 172.21.15.82:0/1300171690 wait complete. 2023-07-20T10:02:38.151 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-07-20T10:02:38.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.151 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-20T10:02:38.161 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:38.161 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:38.162 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_01_UTC 2023-07-20T10:02:38.163 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:38.163 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:38.163 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:38.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.164 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:38.221 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:38.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.221 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:38.279 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:38.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.281 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:38.335 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:38.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.336 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:38.391 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:38.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.392 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:38.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:38.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.448 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:38.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:38.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.508 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:38.564 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:38.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.565 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:38.619 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_00_01_UTC 2023-07-20T10:02:38.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.620 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_00_01_UTC) 2023-07-20T10:02:38.683 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:38.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.684 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:38.740 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:38.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.741 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:38.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:38.796 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-07-20T10:02:38.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-07-20T10:02:39.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.066+0000 7fe1c766d640 1 Processor -- start 2023-07-20T10:02:39.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.066+0000 7fe1c766d640 1 -- start start 2023-07-20T10:02:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.066+0000 7fe1c766d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1c0160ba0 0x7fe1c00c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.066+0000 7fe1c766d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c00c8e60 0x7fe1c00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c766d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00c9370 con 0x7fe1c0161de0 2023-07-20T10:02:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c766d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00c9650 con 0x7fe1c0160ba0 2023-07-20T10:02:39.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c766d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01619c0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1c0160ba0 0x7fe1c00c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1c0160ba0 0x7fe1c00c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41166/0 (socket says 172.21.15.82:41166) 2023-07-20T10:02:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 -- 172.21.15.82:0/2712055737 learned_addr learned my addr 172.21.15.82:0/2712055737 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c4c08640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c00c8e60 0x7fe1c00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 -- 172.21.15.82:0/2712055737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c00c8e60 msgr2=0x7fe1c00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:39.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c00c8e60 0x7fe1c00afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 -- 172.21.15.82:0/2712055737 >> v1:172.21.15.183:6789/0 conn(0x7fe1c0161de0 legacy=0x7fe1c00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.070+0000 7fe1c5409640 1 -- 172.21.15.82:0/2712055737 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0161300 con 0x7fe1c0160ba0 2023-07-20T10:02:39.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c5409640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c0160ba0 0x7fe1c00c8920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009870 tx=0x7fe1bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbda5afca9b0e414 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1b7fff640 1 -- 172.21.15.82:0/2712055737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0ab620 con 0x7fe1c0160ba0 2023-07-20T10:02:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1b7fff640 1 -- 172.21.15.82:0/2712055737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0ab780 con 0x7fe1c0160ba0 2023-07-20T10:02:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1b7fff640 1 -- 172.21.15.82:0/2712055737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0abb10 con 0x7fe1c0160ba0 2023-07-20T10:02:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 -- 172.21.15.82:0/2712055737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c0160ba0 msgr2=0x7fe1c00c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c0160ba0 0x7fe1c00c8920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009870 tx=0x7fe1bc01c510 comp rx=0 tx=0).stop 2023-07-20T10:02:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 -- 172.21.15.82:0/2712055737 shutdown_connections 2023-07-20T10:02:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c00c8e60 0x7fe1c00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 --2- 172.21.15.82:0/2712055737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c0160ba0 0x7fe1c00c8920 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.074+0000 7fe1c766d640 1 -- 172.21.15.82:0/2712055737 >> 172.21.15.82:0/2712055737 conn(0x7fe1c00cad50 msgr2=0x7fe1c00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- 172.21.15.82:0/2712055737 shutdown_connections 2023-07-20T10:02:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- 172.21.15.82:0/2712055737 wait complete. 2023-07-20T10:02:39.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 Processor -- start 2023-07-20T10:02:39.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- start start 2023-07-20T10:02:39.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1c0160ba0 0x7fe1c006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c0161de0 0x7fe1c006fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b34f0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b2230 con 0x7fe1c0160ba0 2023-07-20T10:02:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.078+0000 7fe1c766d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00b2510 con 0x7fe1c0161de0 2023-07-20T10:02:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41176/0 (socket says 172.21.15.82:41176) 2023-07-20T10:02:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 -- 172.21.15.82:0/978313356 learned_addr learned my addr 172.21.15.82:0/978313356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:39.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c4c08640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1c0160ba0 0x7fe1c006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5c0a640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c0161de0 0x7fe1c006fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 -- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c0161de0 msgr2=0x7fe1c006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c0161de0 0x7fe1c006fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 -- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1c0160ba0 msgr2=0x7fe1c006f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1c0160ba0 0x7fe1c006f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 -- 172.21.15.82:0/978313356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc0094d0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c5409640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0ad040 tx=0x7fe1bc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0be3f0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0be570 con 0x7fe1c00c8e60 2023-07-20T10:02:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0be920 con 0x7fe1c00c8e60 2023-07-20T10:02:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c766d640 1 -- 172.21.15.82:0/978313356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c015a6e0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1c766d640 1 -- 172.21.15.82:0/978313356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c015aca0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19c005260 con 0x7fe1c00c8e60 2023-07-20T10:02:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.082+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe1bc0b43f0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.086+0000 7fe1b5ffb640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 0x7fe1a4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.086+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7125+0+0 (secure 0 0 0) 0x7fe1bc11e860 con 0x7fe1c00c8e60 2023-07-20T10:02:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.086+0000 7fe1c4c08640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 0x7fe1a4068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:39.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.086+0000 7fe1c4c08640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 0x7fe1a4068970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0165380 tx=0x7fe1b0008040 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:39.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.090+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1bc0eb5e0 con 0x7fe1c00c8e60 2023-07-20T10:02:39.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.298+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 --> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe19c000bd0 con 0x7fe1a40664b0 2023-07-20T10:02:39.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1b5ffb640 1 -- 172.21.15.82:0/978313356 <== mgr.5457 v2:172.21.15.82:6832/3054777588 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe19c000bd0 con 0x7fe1a40664b0 2023-07-20T10:02:39.359 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-07-20T10:02:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 msgr2=0x7fe1a4068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 0x7fe1a4068970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0165380 tx=0x7fe1b0008040 comp rx=0 tx=0).stop 2023-07-20T10:02:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 msgr2=0x7fe1c00b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:39.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc0ad040 tx=0x7fe1bc01ad50 comp rx=0 tx=0).stop 2023-07-20T10:02:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 shutdown_connections 2023-07-20T10:02:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe1a40664b0 0x7fe1a4068970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1c0161de0 0x7fe1c006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1c0160ba0 0x7fe1c006f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 --2- 172.21.15.82:0/978313356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1c00c8e60 0x7fe1c00b2fb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 >> 172.21.15.82:0/978313356 conn(0x7fe1c00cad50 msgr2=0x7fe1c01635b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 shutdown_connections 2023-07-20T10:02:39.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:39.370+0000 7fe1a37fe640 1 -- 172.21.15.82:0/978313356 wait complete. 2023-07-20T10:02:39.379 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-07-20T10:02:39.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.380 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-20T10:02:39.389 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:39.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:39.391 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:39.391 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:39.391 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:39.391 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:39.392 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_52_00_UTC 2023-07-20T10:02:39.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.392 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_52_00_UTC) 2023-07-20T10:02:39.448 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_53_00_UTC 2023-07-20T10:02:39.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.449 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_53_00_UTC) 2023-07-20T10:02:39.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_54_00_UTC 2023-07-20T10:02:39.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.508 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_54_00_UTC) 2023-07-20T10:02:39.564 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_55_00_UTC 2023-07-20T10:02:39.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.564 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_55_00_UTC) 2023-07-20T10:02:39.620 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_56_00_UTC 2023-07-20T10:02:39.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.621 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_56_00_UTC) 2023-07-20T10:02:39.676 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_57_00_UTC 2023-07-20T10:02:39.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.676 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_57_00_UTC) 2023-07-20T10:02:39.732 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_58_00_UTC 2023-07-20T10:02:39.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.732 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_58_00_UTC) 2023-07-20T10:02:39.788 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_59_00_UTC 2023-07-20T10:02:39.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.788 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-09_59_00_UTC) 2023-07-20T10:02:39.847 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_00_00_UTC 2023-07-20T10:02:39.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.848 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_00_00_UTC) 2023-07-20T10:02:39.948 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_01_00_UTC 2023-07-20T10:02:39.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.949 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_01_00_UTC) 2023-07-20T10:02:39.968 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_02_00_UTC 2023-07-20T10:02:39.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:39.968 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-20-10_02_00_UTC) 2023-07-20T10:02:40.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:40.041 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-07-20T10:02:40.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:02:40.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.290+0000 7fbd13848640 1 Processor -- start 2023-07-20T10:02:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.290+0000 7fbd13848640 1 -- start start 2023-07-20T10:02:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd0c159830 0x7fbd0c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd0c0cc3e0 0x7fbd0c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0cce90 con 0x7fbd0c159830 2023-07-20T10:02:40.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0cc8d0 con 0x7fbd0c0cc3e0 2023-07-20T10:02:40.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd13848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0ccbb0 con 0x7fbd0c159450 2023-07-20T10:02:40.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd0c159830 0x7fbd0c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:40.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd0c159830 0x7fbd0c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41178/0 (socket says 172.21.15.82:41178) 2023-07-20T10:02:40.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 -- 172.21.15.82:0/620651969 learned_addr learned my addr 172.21.15.82:0/620651969 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 -- 172.21.15.82:0/620651969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 msgr2=0x7fbd0c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 --2- 172.21.15.82:0/620651969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 -- 172.21.15.82:0/620651969 >> v2:172.21.15.183:3300/0 conn(0x7fbd0c0cc3e0 msgr2=0x7fbd0c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 --2- 172.21.15.82:0/620651969 >> v2:172.21.15.183:3300/0 conn(0x7fbd0c0cc3e0 0x7fbd0c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.294+0000 7fbd10de3640 1 -- 172.21.15.82:0/620651969 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c159cc0 con 0x7fbd0c159830 2023-07-20T10:02:40.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd10de3640 1 --2- 172.21.15.82:0/620651969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c159830 0x7fbd0c0cbea0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0ce1b0 tx=0x7fbcfc01e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988f0d3ccd2272aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd03fff640 1 -- 172.21.15.82:0/620651969 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0a7740 con 0x7fbd0c159830 2023-07-20T10:02:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd03fff640 1 -- 172.21.15.82:0/620651969 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc0a78a0 con 0x7fbd0c159830 2023-07-20T10:02:40.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd03fff640 1 -- 172.21.15.82:0/620651969 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0a7c30 con 0x7fbd0c159830 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- 172.21.15.82:0/620651969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c159830 msgr2=0x7fbd0c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 --2- 172.21.15.82:0/620651969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c159830 0x7fbd0c0cbea0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0ce1b0 tx=0x7fbcfc01e9a0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- 172.21.15.82:0/620651969 shutdown_connections 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 --2- 172.21.15.82:0/620651969 >> v2:172.21.15.183:3300/0 conn(0x7fbd0c0cc3e0 0x7fbd0c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 --2- 172.21.15.82:0/620651969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c159830 0x7fbd0c0cbea0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 --2- 172.21.15.82:0/620651969 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- 172.21.15.82:0/620651969 >> 172.21.15.82:0/620651969 conn(0x7fbd0c0cad50 msgr2=0x7fbd0c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- 172.21.15.82:0/620651969 shutdown_connections 2023-07-20T10:02:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- 172.21.15.82:0/620651969 wait complete. 2023-07-20T10:02:40.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 Processor -- start 2023-07-20T10:02:40.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.298+0000 7fbd13848640 1 -- start start 2023-07-20T10:02:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0c0cc3e0 0x7fbd0c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c152dc0 con 0x7fbd0c1514e0 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c151f10 con 0x7fbd0c0cc3e0 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c1521b0 con 0x7fbd0c159450 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd115e4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0c0cc3e0 0x7fbd0c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:40.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41182/0 (socket says 172.21.15.82:41182) 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 -- 172.21.15.82:0/444054262 learned_addr learned my addr 172.21.15.82:0/444054262 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd10de3640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 -- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 msgr2=0x7fbd0c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 -- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0c0cc3e0 msgr2=0x7fbd0c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0c0cc3e0 0x7fbd0c158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 -- 172.21.15.82:0/444054262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc00bb30 con 0x7fbd0c1514e0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd11de5640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400b9e0 tx=0x7fbd0400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400cb20 con 0x7fbd0c1514e0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400cc80 con 0x7fbd0c1514e0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04014680 con 0x7fbd0c1514e0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c152490 con 0x7fbd0c1514e0 2023-07-20T10:02:40.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c152a50 con 0x7fbd0c1514e0 2023-07-20T10:02:40.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c04da30 con 0x7fbd0c1514e0 2023-07-20T10:02:40.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.302+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fbd0401d3b0 con 0x7fbd0c1514e0 2023-07-20T10:02:40.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.306+0000 7fbd01ffb640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 0x7fbcf0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:40.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.306+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fbd040842c0 con 0x7fbd0c1514e0 2023-07-20T10:02:40.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.306+0000 7fbd115e4640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 0x7fbcf0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:40.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.306+0000 7fbd115e4640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 0x7fbcf0068970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009990 tx=0x7fbd08009110 comp rx=0 tx=0).ready entity=mgr.5457 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.310+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd04051200 con 0x7fbd0c1514e0 2023-07-20T10:02:40.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.494+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fbd0c0cbf40 con 0x7fbd0c1514e0 2023-07-20T10:02:40.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.950+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fbd04005d50 con 0x7fbd0c1514e0 2023-07-20T10:02:40.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd01ffb640 1 -- 172.21.15.82:0/444054262 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7fbd0406f530 con 0x7fbd0c1514e0 2023-07-20T10:02:40.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 msgr2=0x7fbcf0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:40.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 0x7fbcf0068970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009990 tx=0x7fbd08009110 comp rx=0 tx=0).stop 2023-07-20T10:02:40.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 msgr2=0x7fbd0c14e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:40.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400b9e0 tx=0x7fbd0400bea0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 shutdown_connections 2023-07-20T10:02:40.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fbcf00664b0 0x7fbcf0068970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0c1514e0 0x7fbd0c14e360 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd0c159450 0x7fbd0c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 --2- 172.21.15.82:0/444054262 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd0c0cc3e0 0x7fbd0c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:40.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 >> 172.21.15.82:0/444054262 conn(0x7fbd0c0cad50 msgr2=0x7fbd0c0afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:40.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 shutdown_connections 2023-07-20T10:02:40.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:40.954+0000 7fbd13848640 1 -- 172.21.15.82:0/444054262 wait complete. 2023-07-20T10:02:40.966 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:02:40.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:02:41.033 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:02:41.092 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:02:41.093 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:02:41.093 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:41.103 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:02:41.104 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:41.151 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:41.164+0000 7f60342ef180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:02:41.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:41.172 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:41.182+0000 7f83c6741180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:02:41.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 Processor -- start 2023-07-20T10:02:41.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 -- start start 2023-07-20T10:02:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d840d1170 0x7f9d840cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840b3520 con 0x7f9d840d0d10 2023-07-20T10:02:41.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840d0a10 con 0x7f9d8415cab0 2023-07-20T10:02:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d89d8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840d31c0 con 0x7f9d840d1170 2023-07-20T10:02:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d83fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9d840d1170 0x7f9d840cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d7bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9d840d0d10 0x7f9d840cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50064/0 (socket says 172.21.15.82:50064) 2023-07-20T10:02:41.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d7bfff640 1 -- 172.21.15.82:0/1115557728 learned_addr learned my addr 172.21.15.82:0/1115557728 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:41.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d83fff640 1 -- 172.21.15.82:0/1115557728 >> v1:172.21.15.183:6789/0 conn(0x7f9d8415cab0 legacy=0x7f9d840d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d83fff640 1 -- 172.21.15.82:0/1115557728 >> v1:172.21.15.82:6789/0 conn(0x7f9d840d0d10 legacy=0x7f9d840cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d83fff640 1 -- 172.21.15.82:0/1115557728 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840b2910 con 0x7f9d840d1170 2023-07-20T10:02:41.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.334+0000 7f9d82ffd640 1 -- 172.21.15.82:0/1115557728 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147430089 0 0) 0x7f9d840b3520 con 0x7f9d840d0d10 2023-07-20T10:02:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d83fff640 1 --2- 172.21.15.82:0/1115557728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d840d1170 0x7f9d840cdbc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95aa09614628c63 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d82ffd640 1 -- 172.21.15.82:0/1115557728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0a5920 con 0x7f9d840d1170 2023-07-20T10:02:41.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d82ffd640 1 -- 172.21.15.82:0/1115557728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0a5a80 con 0x7f9d840d1170 2023-07-20T10:02:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d82ffd640 1 -- 172.21.15.82:0/1115557728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0a5e10 con 0x7f9d840d1170 2023-07-20T10:02:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 -- 172.21.15.82:0/1115557728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d840d1170 msgr2=0x7f9d840cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/1115557728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d840d1170 0x7f9d840cdbc0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009d90 tx=0x7f9d7c01c8f0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 -- 172.21.15.82:0/1115557728 shutdown_connections 2023-07-20T10:02:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/1115557728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d840d1170 0x7f9d840cdbc0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 -- 172.21.15.82:0/1115557728 >> 172.21.15.82:0/1115557728 conn(0x7f9d8408c120 msgr2=0x7f9d8409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 -- 172.21.15.82:0/1115557728 shutdown_connections 2023-07-20T10:02:41.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.338+0000 7f9d89d8f640 1 -- 172.21.15.82:0/1115557728 wait complete. 2023-07-20T10:02:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 Processor -- start 2023-07-20T10:02:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 -- start start 2023-07-20T10:02:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d840d0d10 0x7f9d84153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d840d1170 0x7f9d840cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840c8310 con 0x7f9d8415cab0 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840c7d50 con 0x7f9d840d0d10 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d89d8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840c8030 con 0x7f9d840d1170 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41192/0 (socket says 172.21.15.82:41192) 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 -- 172.21.15.82:0/4158700912 learned_addr learned my addr 172.21.15.82:0/4158700912 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d837fe640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d840d0d10 0x7f9d84153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d7bfff640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d840d1170 0x7f9d840cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 -- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d840d1170 msgr2=0x7f9d840cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d840d1170 0x7f9d840cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 -- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d840d0d10 msgr2=0x7f9d84153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d840d0d10 0x7f9d84153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 -- 172.21.15.82:0/4158700912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c009a70 con 0x7f9d8415cab0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.342+0000 7f9d83fff640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0b0040 tx=0x7f9d7c019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0ade40 con 0x7f9d8415cab0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0b9450 con 0x7f9d8415cab0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d840cb1c0 con 0x7f9d8415cab0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0b9800 con 0x7f9d8415cab0 2023-07-20T10:02:41.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84156d30 con 0x7f9d8415cab0 2023-07-20T10:02:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84073c70 con 0x7f9d8415cab0 2023-07-20T10:02:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f9d7c0b9960 con 0x7f9d8415cab0 2023-07-20T10:02:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 0x7f9d640688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d837fe640 1 -- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 msgr2=0x7f9d640688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7969+0+0 (secure 0 0 0) 0x7f9d7c1200f0 con 0x7f9d8415cab0 2023-07-20T10:02:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.346+0000 7f9d837fe640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 0x7f9d640688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:41.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.350+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d7c0ecc20 con 0x7f9d8415cab0 2023-07-20T10:02:41.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.514+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d840c8170 con 0x7f9d8415cab0 2023-07-20T10:02:41.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.514+0000 7f9d80ff9640 1 -- 172.21.15.82:0/4158700912 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+21223 (secure 0 0 0) 0x7f9d840c8170 con 0x7f9d8415cab0 2023-07-20T10:02:41.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:41.504 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":51,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:40.861412+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1031146939":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3996830125":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3113011850":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/2172384118":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6833/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6832/2623212404":"2023-07-21T09:51:35.501102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":177,"length":44}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":20,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":42,"length":1},{"begin":53,"length":1},{"begin":64,"length":1},{"begin":74,"length":1},{"begin":85,"length":1},{"begin":96,"length":1},{"begin":102,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1},{"begin":11,"length":1},{"begin":13,"length":1},{"begin":15,"length":1},{"begin":17,"length":1},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":31,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":43,"length":1},{"begin":45,"length":1},{"begin":47,"length":1},{"begin":49,"length":1},{"begin":54,"length":1},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":67,"length":1},{"begin":69,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":2},{"begin":86,"length":1},{"begin":88,"length":1},{"begin":90,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":99,"length":1},{"begin":101,"length":1},{"begin":103,"length":1},{"begin":105,"length":1},{"begin":107,"length":1},{"begin":109,"length":1},{"begin":133,"length":44}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:41.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 msgr2=0x7f9d640688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:41.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 0x7f9d640688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 msgr2=0x7f9d840c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c0b0040 tx=0x7f9d7c019690 comp rx=0 tx=0).stop 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 shutdown_connections 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f9d64066430 0x7f9d640688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d8415cab0 0x7f9d840c72b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d840d1170 0x7f9d840cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 --2- 172.21.15.82:0/4158700912 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d840d0d10 0x7f9d84153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 >> 172.21.15.82:0/4158700912 conn(0x7f9d8408c120 msgr2=0x7f9d841580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 shutdown_connections 2023-07-20T10:02:41.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.518+0000 7f9d89d8f640 1 -- 172.21.15.82:0/4158700912 wait complete. 2023-07-20T10:02:41.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:51:21.078613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:51:22.067872+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:02:41.526 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:02:41.575 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:41.588+0000 7f60342ef180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:02:41.620 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:41.630+0000 7f83c6741180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:02:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 Processor -- start 2023-07-20T10:02:41.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 -- start start 2023-07-20T10:02:41.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cf015fb70 0x7f3cf00b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3cf00d0970 0x7f3cf00b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf015ff50 con 0x7f3cf00b44d0 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf00b4960 con 0x7f3cf015fb70 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf6198640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf00d0d80 con 0x7f3cf00d0970 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cf015fb70 0x7f3cf00b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3cf015fb70 0x7f3cf00b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41208/0 (socket says 172.21.15.82:41208) 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 -- 172.21.15.82:0/3948389437 learned_addr learned my addr 172.21.15.82:0/3948389437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:41.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5997640 1 --2- 172.21.15.82:0/3948389437 >> v2:172.21.15.183:3300/0 conn(0x7f3cf00d0970 0x7f3cf00b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 -- 172.21.15.82:0/3948389437 >> v2:172.21.15.183:3300/0 conn(0x7f3cf00d0970 msgr2=0x7f3cf00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 --2- 172.21.15.82:0/3948389437 >> v2:172.21.15.183:3300/0 conn(0x7f3cf00d0970 0x7f3cf00b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 -- 172.21.15.82:0/3948389437 >> v1:172.21.15.183:6789/0 conn(0x7f3cf00b44d0 legacy=0x7f3cf00d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.686+0000 7f3cf5196640 1 -- 172.21.15.82:0/3948389437 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00d0f90 con 0x7f3cf015fb70 2023-07-20T10:02:41.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf5196640 1 --2- 172.21.15.82:0/3948389437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf015fb70 0x7f3cf00b3f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00b7e60 tx=0x7f3cec01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42121aa95ce17a38 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:41.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3ce7fff640 1 -- 172.21.15.82:0/3948389437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0a5740 con 0x7f3cf015fb70 2023-07-20T10:02:41.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3ce7fff640 1 -- 172.21.15.82:0/3948389437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0a58a0 con 0x7f3cf015fb70 2023-07-20T10:02:41.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3ce7fff640 1 -- 172.21.15.82:0/3948389437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0a5c30 con 0x7f3cf015fb70 2023-07-20T10:02:41.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 -- 172.21.15.82:0/3948389437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf015fb70 msgr2=0x7f3cf00b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 --2- 172.21.15.82:0/3948389437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf015fb70 0x7f3cf00b3f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00b7e60 tx=0x7f3cec01c880 comp rx=0 tx=0).stop 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 -- 172.21.15.82:0/3948389437 shutdown_connections 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 --2- 172.21.15.82:0/3948389437 >> v2:172.21.15.183:3300/0 conn(0x7f3cf00d0970 0x7f3cf00b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 --2- 172.21.15.82:0/3948389437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf015fb70 0x7f3cf00b3f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 -- 172.21.15.82:0/3948389437 >> 172.21.15.82:0/3948389437 conn(0x7f3cf0065710 msgr2=0x7f3cf0065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 -- 172.21.15.82:0/3948389437 shutdown_connections 2023-07-20T10:02:41.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.690+0000 7f3cf6198640 1 -- 172.21.15.82:0/3948389437 wait complete. 2023-07-20T10:02:41.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 Processor -- start 2023-07-20T10:02:41.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- start start 2023-07-20T10:02:41.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cf00d0970 0x7f3cf01f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf015fb70 0x7f3cf01f8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf015edd0 con 0x7f3cf00b44d0 2023-07-20T10:02:41.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0159770 con 0x7f3cf015fb70 2023-07-20T10:02:41.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf015e530 con 0x7f3cf00d0970 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41222/0 (socket says 172.21.15.82:41222) 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 -- 172.21.15.82:0/825046696 learned_addr learned my addr 172.21.15.82:0/825046696 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5997640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf015fb70 0x7f3cf01f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf4995640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cf00d0970 0x7f3cf01f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 -- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cf00d0970 msgr2=0x7f3cf01f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cf00d0970 0x7f3cf01f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 -- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf015fb70 msgr2=0x7f3cf01f8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf015fb70 0x7f3cf01f8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 -- 172.21.15.82:0/825046696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec009b30 con 0x7f3cf00b44d0 2023-07-20T10:02:41.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf5196640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3cec019490 tx=0x7f3cec019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:41.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b8670 con 0x7f3cf00b44d0 2023-07-20T10:02:41.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec0b87f0 con 0x7f3cf00b44d0 2023-07-20T10:02:41.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec0b8ba0 con 0x7f3cf00b44d0 2023-07-20T10:02:41.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf015e810 con 0x7f3cf00b44d0 2023-07-20T10:02:41.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.694+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf00c9f90 con 0x7f3cf00b44d0 2023-07-20T10:02:41.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf0159560 con 0x7f3cf00b44d0 2023-07-20T10:02:41.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f3cec0b8d00 con 0x7f3cf00b44d0 2023-07-20T10:02:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3ce5ffb640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 0x7f3cd40688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7969+0+0 (secure 0 0 0) 0x7f3cec11fe40 con 0x7f3cf00b44d0 2023-07-20T10:02:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3cf4995640 1 -- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 msgr2=0x7f3cd40688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:41.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.698+0000 7f3cf4995640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 0x7f3cd40688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:41.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.702+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cec0ec9d0 con 0x7f3cf00b44d0 2023-07-20T10:02:41.726 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:41.740+0000 7f60342ef180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:02:41.776 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:41.786+0000 7f83c6741180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:02:41.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cf004da30 con 0x7f3cf00b44d0 2023-07-20T10:02:41.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3ce5ffb640 1 -- 172.21.15.82:0/825046696 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cec0bc070 con 0x7f3cf00b44d0 2023-07-20T10:02:41.843 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:02:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 msgr2=0x7f3cd40688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 0x7f3cd40688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 msgr2=0x7f3cf00c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3cec019490 tx=0x7f3cec019620 comp rx=0 tx=0).stop 2023-07-20T10:02:41.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 shutdown_connections 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3cd4066430 0x7f3cd40688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cf015fb70 0x7f3cf01f8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3cf00d0970 0x7f3cf01f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 --2- 172.21.15.82:0/825046696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3cf00b44d0 0x7f3cf00c9a50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.854+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 >> 172.21.15.82:0/825046696 conn(0x7f3cf0065710 msgr2=0x7f3cf00b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:41.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.858+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 shutdown_connections 2023-07-20T10:02:41.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:41.858+0000 7f3cf6198640 1 -- 172.21.15.82:0/825046696 wait complete. 2023-07-20T10:02:41.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:02:42.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.022+0000 7fadcd26d640 1 Processor -- start 2023-07-20T10:02:42.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.022+0000 7fadcd26d640 1 -- start start 2023-07-20T10:02:42.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadcd26d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 0x7fadc806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadcd26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 0x7fadc815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadcd26d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc806e730 con 0x7fadc80ccf10 2023-07-20T10:02:42.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadcd26d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc81601b0 con 0x7fadc8160bc0 2023-07-20T10:02:42.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadcd26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8161050 con 0x7fadc806e300 2023-07-20T10:02:42.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fadc80ccf10 0x7fadc8069750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50070/0 (socket says 172.21.15.82:50070) 2023-07-20T10:02:42.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc6ffd640 1 -- 172.21.15.82:0/3699029920 learned_addr learned my addr 172.21.15.82:0/3699029920 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:42.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadbffff640 1 --2- 172.21.15.82:0/3699029920 >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 0x7fadc806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc77fe640 1 --2- 172.21.15.82:0/3699029920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 0x7fadc815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc67fc640 1 -- 172.21.15.82:0/3699029920 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275476997 0 0) 0x7fadc806e730 con 0x7fadc80ccf10 2023-07-20T10:02:42.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc67fc640 1 -- 172.21.15.82:0/3699029920 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadb4003530 con 0x7fadc80ccf10 2023-07-20T10:02:42.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc77fe640 1 -- 172.21.15.82:0/3699029920 >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 msgr2=0x7fadc806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:42.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc77fe640 1 --2- 172.21.15.82:0/3699029920 >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 0x7fadc806ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc77fe640 1 -- 172.21.15.82:0/3699029920 >> v1:172.21.15.82:6789/0 conn(0x7fadc80ccf10 legacy=0x7fadc8069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadc77fe640 1 -- 172.21.15.82:0/3699029920 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc806a1d0 con 0x7fadc806e300 2023-07-20T10:02:42.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.026+0000 7fadbffff640 1 --2- 172.21.15.82:0/3699029920 >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 0x7fadc806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:42.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadc77fe640 1 --2- 172.21.15.82:0/3699029920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 0x7fadc815cac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009d90 tx=0x7fadc001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f7c6709a2ebb6e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadc67fc640 1 -- 172.21.15.82:0/3699029920 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00a59e0 con 0x7fadc806e300 2023-07-20T10:02:42.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadc67fc640 1 -- 172.21.15.82:0/3699029920 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc00a5b40 con 0x7fadc806e300 2023-07-20T10:02:42.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadc67fc640 1 -- 172.21.15.82:0/3699029920 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00ad440 con 0x7fadc806e300 2023-07-20T10:02:42.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- 172.21.15.82:0/3699029920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 msgr2=0x7fadc815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 --2- 172.21.15.82:0/3699029920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 0x7fadc815cac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009d90 tx=0x7fadc001c920 comp rx=0 tx=0).stop 2023-07-20T10:02:42.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- 172.21.15.82:0/3699029920 shutdown_connections 2023-07-20T10:02:42.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 --2- 172.21.15.82:0/3699029920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc806e300 0x7fadc815cac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 --2- 172.21.15.82:0/3699029920 >> v2:172.21.15.183:3300/0 conn(0x7fadc8160bc0 0x7fadc806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- 172.21.15.82:0/3699029920 >> 172.21.15.82:0/3699029920 conn(0x7fadc80cf070 msgr2=0x7fadc80cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- 172.21.15.82:0/3699029920 shutdown_connections 2023-07-20T10:02:42.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- 172.21.15.82:0/3699029920 wait complete. 2023-07-20T10:02:42.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 Processor -- start 2023-07-20T10:02:42.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.030+0000 7fadcd26d640 1 -- start start 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadc80ccf10 0x7fadc80b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc8160bc0 0x7fadc815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80b4550 con 0x7fadc806e300 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8152280 con 0x7fadc80ccf10 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc80b2440 con 0x7fadc8160bc0 2023-07-20T10:02:42.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41236/0 (socket says 172.21.15.82:41236) 2023-07-20T10:02:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 -- 172.21.15.82:0/2574853168 learned_addr learned my addr 172.21.15.82:0/2574853168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc77fe640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc8160bc0 0x7fadc815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadbffff640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadc80ccf10 0x7fadc80b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 -- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc8160bc0 msgr2=0x7fadc815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc8160bc0 0x7fadc815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 -- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadc80ccf10 msgr2=0x7fadc80b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadc80ccf10 0x7fadc80b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 -- 172.21.15.82:0/2574853168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009420 con 0x7fadc806e300 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadc6ffd640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c4d0 tx=0x7fadb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8005cf0 con 0x7fadc806e300 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8005e50 con 0x7fadc806e300 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc0009a70 con 0x7fadc806e300 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb8007270 con 0x7fadc806e300 2023-07-20T10:02:42.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc8154900 con 0x7fadc806e300 2023-07-20T10:02:42.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc804da30 con 0x7fadc806e300 2023-07-20T10:02:42.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.034+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fadb80073d0 con 0x7fadc806e300 2023-07-20T10:02:42.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.038+0000 7fadbf7fe640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 0x7fada80688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.038+0000 7fadbffff640 1 -- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 msgr2=0x7fada80688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:42.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.038+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fadb8083a60 con 0x7fadc806e300 2023-07-20T10:02:42.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.038+0000 7fadbffff640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 0x7fada80688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:42.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.042+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadb8050930 con 0x7fadc806e300 2023-07-20T10:02:42.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.202+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fadc8070600 con 0x7fadc806e300 2023-07-20T10:02:42.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.202+0000 7fadbf7fe640 1 -- 172.21.15.82:0/2574853168 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7fadb8017020 con 0x7fadc806e300 2023-07-20T10:02:42.192 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 msgr2=0x7fada80688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 0x7fada80688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 msgr2=0x7fadc80b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fadb800c4d0 tx=0x7fadb800c990 comp rx=0 tx=0).stop 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 shutdown_connections 2023-07-20T10:02:42.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fada8066430 0x7fada80688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadc8160bc0 0x7fadc815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadc80ccf10 0x7fadc80b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 --2- 172.21.15.82:0/2574853168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadc806e300 0x7fadc80b4010 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 >> 172.21.15.82:0/2574853168 conn(0x7fadc80cf070 msgr2=0x7fadc8069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 shutdown_connections 2023-07-20T10:02:42.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.206+0000 7fadcd26d640 1 -- 172.21.15.82:0/2574853168 wait complete. 2023-07-20T10:02:42.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:02:42.219 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.232+0000 7f60342ef180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:02:42.277 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.292+0000 7f60342ef180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:02:42.290 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.302+0000 7f83c6741180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:02:42.333 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.348+0000 7f60342ef180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:02:42.351 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.362+0000 7f83c6741180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:02:42.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.370+0000 7f80af12c640 1 Processor -- start 2023-07-20T10:02:42.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.370+0000 7f80af12c640 1 -- start start 2023-07-20T10:02:42.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80af12c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 0x7f80a8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80af12c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80ce4f0 con 0x7f80a806ab10 2023-07-20T10:02:42.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80af12c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a80d0970 con 0x7f80a806c120 2023-07-20T10:02:42.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80af12c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8160e20 con 0x7f80a81602b0 2023-07-20T10:02:42.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80ad6c9640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f80a806ab10 0x7f80a806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50074/0 (socket says 172.21.15.82:50074) 2023-07-20T10:02:42.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80ad6c9640 1 -- 172.21.15.82:0/1611685042 learned_addr learned my addr 172.21.15.82:0/1611685042 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:42.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a7fff640 1 --2- 172.21.15.82:0/1611685042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 0x7f80a8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431387395 0 0) 0x7f80a80ce4f0 con 0x7f80a806ab10 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8098003530 con 0x7f80a806ab10 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504375353 0 0) 0x7f80a80d0970 con 0x7f80a806c120 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a80ce4f0 con 0x7f80a806c120 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a7fff640 1 -- 172.21.15.82:0/1611685042 >> v1:172.21.15.183:6789/0 conn(0x7f80a806c120 legacy=0x7f80a80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a7fff640 1 -- 172.21.15.82:0/1611685042 >> v1:172.21.15.82:6789/0 conn(0x7f80a806ab10 legacy=0x7f80a806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.374+0000 7f80a7fff640 1 -- 172.21.15.82:0/1611685042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80cd300 con 0x7f80a81602b0 2023-07-20T10:02:42.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80a7fff640 1 --2- 172.21.15.82:0/1611685042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 0x7f80a8160710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80940097f0 tx=0x7f809401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b27d3631ae2ddc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940ab600 con 0x7f80a81602b0 2023-07-20T10:02:42.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80940a7050 con 0x7f80a81602b0 2023-07-20T10:02:42.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80a77fe640 1 -- 172.21.15.82:0/1611685042 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940ab980 con 0x7f80a81602b0 2023-07-20T10:02:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- 172.21.15.82:0/1611685042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 msgr2=0x7f80a8160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 --2- 172.21.15.82:0/1611685042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 0x7f80a8160710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f80940097f0 tx=0x7f809401c430 comp rx=0 tx=0).stop 2023-07-20T10:02:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- 172.21.15.82:0/1611685042 shutdown_connections 2023-07-20T10:02:42.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 --2- 172.21.15.82:0/1611685042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a81602b0 0x7f80a8160710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- 172.21.15.82:0/1611685042 >> 172.21.15.82:0/1611685042 conn(0x7f80a808c0a0 msgr2=0x7f80a809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- 172.21.15.82:0/1611685042 shutdown_connections 2023-07-20T10:02:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- 172.21.15.82:0/1611685042 wait complete. 2023-07-20T10:02:42.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 Processor -- start 2023-07-20T10:02:42.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- start start 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 0x7f80a8154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a806c120 0x7f80a80b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8153ce0 con 0x7f80a81602b0 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8153340 con 0x7f80a806c120 2023-07-20T10:02:42.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.378+0000 7f80af12c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8153620 con 0x7f80a806ab10 2023-07-20T10:02:42.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80acec8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 0x7f80a8154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80a7fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a806c120 0x7f80a80b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41238/0 (socket says 172.21.15.82:41238) 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 -- 172.21.15.82:0/3991852458 learned_addr learned my addr 172.21.15.82:0/3991852458 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 -- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 msgr2=0x7f80a8154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 0x7f80a8154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 -- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a806c120 msgr2=0x7f80a80b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a806c120 0x7f80a80b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 -- 172.21.15.82:0/3991852458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8094009420 con 0x7f80a81602b0 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80acec8640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 0x7f80a8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80ad6c9640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80a000cb40 tx=0x7f80a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000aca0 con 0x7f80a81602b0 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000ae20 con 0x7f80a81602b0 2023-07-20T10:02:42.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a8153900 con 0x7f80a81602b0 2023-07-20T10:02:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0012640 con 0x7f80a81602b0 2023-07-20T10:02:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a8155520 con 0x7f80a81602b0 2023-07-20T10:02:42.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8153e20 con 0x7f80a81602b0 2023-07-20T10:02:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.382+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f80a0007070 con 0x7f80a81602b0 2023-07-20T10:02:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.386+0000 7f80a57fa640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 0x7f808c0688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.386+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f80a0084380 con 0x7f80a81602b0 2023-07-20T10:02:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.386+0000 7f80acec8640 1 -- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 msgr2=0x7f808c0688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.386+0000 7f80acec8640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 0x7f808c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.390+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80a8153e20 con 0x7f80a81602b0 2023-07-20T10:02:42.412 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.422+0000 7f83c6741180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:02:42.420 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.432+0000 7f60342ef180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:02:42.476 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.488+0000 7f60342ef180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:02:42.499 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.510+0000 7f83c6741180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:02:42.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.538+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80a8153e20 con 0x7f80a81602b0 2023-07-20T10:02:42.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80a57fa640 1 -- 172.21.15.82:0/3991852458 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80a8153e20 con 0x7f80a81602b0 2023-07-20T10:02:42.530 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 msgr2=0x7f808c0688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 0x7f808c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 msgr2=0x7f80a81549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f80a000cb40 tx=0x7f80a000a060 comp rx=0 tx=0).stop 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 shutdown_connections 2023-07-20T10:02:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f808c066430 0x7f808c0688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80a81602b0 0x7f80a81549b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f80a806c120 0x7f80a80b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 --2- 172.21.15.82:0/3991852458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f80a806ab10 0x7f80a8154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 >> 172.21.15.82:0/3991852458 conn(0x7f80a808c0a0 msgr2=0x7f80a815f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 shutdown_connections 2023-07-20T10:02:42.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.542+0000 7f80af12c640 1 -- 172.21.15.82:0/3991852458 wait complete. 2023-07-20T10:02:42.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:02:42.559 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.572+0000 7f60342ef180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:02:42.560 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.570+0000 7f83c6741180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:02:42.614 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.628+0000 7f60342ef180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:02:42.647 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.658+0000 7f83c6741180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:02:42.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.706+0000 7f3f54a48640 1 Processor -- start 2023-07-20T10:02:42.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.706+0000 7f3f54a48640 1 -- start start 2023-07-20T10:02:42.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f54a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f54a48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f5006ab10 0x7f3f5006af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f54a48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500ce4f0 con 0x7f3f5006c120 2023-07-20T10:02:42.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f54a48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5006b4c0 con 0x7f3f5006ab10 2023-07-20T10:02:42.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f54a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500d0970 con 0x7f3f501602b0 2023-07-20T10:02:42.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f4ed9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f5006ab10 0x7f3f5006af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:50770/0 (socket says 172.21.15.82:50770) 2023-07-20T10:02:42.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 -- 172.21.15.82:0/4273451840 learned_addr learned my addr 172.21.15.82:0/4273451840 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:42.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f4e59c640 1 --1- 172.21.15.82:0/4273451840 >> v1:172.21.15.183:6789/0 conn(0x7f3f5006c120 0x7f3f500cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59436/0 (socket says 172.21.15.82:59436) 2023-07-20T10:02:42.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 -- 172.21.15.82:0/4273451840 >> v2:172.21.15.183:3300/0 conn(0x7f3f5006ab10 msgr2=0x7f3f5006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:42.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 --2- 172.21.15.82:0/4273451840 >> v2:172.21.15.183:3300/0 conn(0x7f3f5006ab10 0x7f3f5006af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 -- 172.21.15.82:0/4273451840 >> v1:172.21.15.183:6789/0 conn(0x7f3f5006c120 legacy=0x7f3f500cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.710+0000 7f3f47fff640 1 -- 172.21.15.82:0/4273451840 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50160e20 con 0x7f3f501602b0 2023-07-20T10:02:42.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f47fff640 1 --2- 172.21.15.82:0/4273451840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009870 tx=0x7f3f3801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a036610626c7ae server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f4dd9b640 1 -- 172.21.15.82:0/4273451840 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380ac600 con 0x7f3f501602b0 2023-07-20T10:02:42.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f4dd9b640 1 -- 172.21.15.82:0/4273451840 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380a8050 con 0x7f3f501602b0 2023-07-20T10:02:42.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f4dd9b640 1 -- 172.21.15.82:0/4273451840 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380ac980 con 0x7f3f501602b0 2023-07-20T10:02:42.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- 172.21.15.82:0/4273451840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 msgr2=0x7f3f50160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 --2- 172.21.15.82:0/4273451840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009870 tx=0x7f3f3801c4b0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- 172.21.15.82:0/4273451840 shutdown_connections 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 --2- 172.21.15.82:0/4273451840 >> v2:172.21.15.183:3300/0 conn(0x7f3f5006ab10 0x7f3f5006af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 --2- 172.21.15.82:0/4273451840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f501602b0 0x7f3f50160710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- 172.21.15.82:0/4273451840 >> 172.21.15.82:0/4273451840 conn(0x7f3f5008c0a0 msgr2=0x7f3f5009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- 172.21.15.82:0/4273451840 shutdown_connections 2023-07-20T10:02:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- 172.21.15.82:0/4273451840 wait complete. 2023-07-20T10:02:42.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 Processor -- start 2023-07-20T10:02:42.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.714+0000 7f3f54a48640 1 -- start start 2023-07-20T10:02:42.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5006ab10 0x7f3f50157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f501602b0 0x7f3f501541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50154730 con 0x7f3f5006c120 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500b00e0 con 0x7f3f501602b0 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500c7990 con 0x7f3f5006ab10 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f4e59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5006ab10 0x7f3f50157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41240/0 (socket says 172.21.15.82:41240) 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 -- 172.21.15.82:0/914261733 learned_addr learned my addr 172.21.15.82:0/914261733 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f4ed9d640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f501602b0 0x7f3f501541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:42.708 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f83c6741180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 -- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5006ab10 msgr2=0x7f3f50157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5006ab10 0x7f3f50157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 -- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f501602b0 msgr2=0x7f3f501541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f501602b0 0x7f3f501541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 -- 172.21.15.82:0/914261733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380094d0 con 0x7f3f5006c120 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f47fff640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f3801ab60 tx=0x7f3f38019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380b6440 con 0x7f3f5006c120 2023-07-20T10:02:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380b65a0 con 0x7f3f5006c120 2023-07-20T10:02:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500c7c70 con 0x7f3f5006c120 2023-07-20T10:02:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380b6950 con 0x7f3f5006c120 2023-07-20T10:02:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f500c8230 con 0x7f3f5006c120 2023-07-20T10:02:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.718+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500c8420 con 0x7f3f5006c120 2023-07-20T10:02:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.722+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f3f380b6ab0 con 0x7f3f5006c120 2023-07-20T10:02:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.722+0000 7f3f46ffd640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 0x7f3f300688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.722+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f3f3811e550 con 0x7f3f5006c120 2023-07-20T10:02:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.722+0000 7f3f4e59c640 1 -- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 msgr2=0x7f3f300688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.722+0000 7f3f4e59c640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 0x7f3f300688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.726+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f380eb2d0 con 0x7f3f5006c120 2023-07-20T10:02:42.759 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.772+0000 7f60342ef180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:02:42.816 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:42.828+0000 7f60342ef180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:02:42.854 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.866+0000 7f83c6741180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:02:42.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.874+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f5004da30 con 0x7f3f5006c120 2023-07-20T10:02:42.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.874+0000 7f3f46ffd640 1 -- 172.21.15.82:0/914261733 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f380ba020 con 0x7f3f5006c120 2023-07-20T10:02:42.864 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:02:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 msgr2=0x7f3f300688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 0x7f3f300688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 msgr2=0x7f3f50153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3f3801ab60 tx=0x7f3f38019250 comp rx=0 tx=0).stop 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 shutdown_connections 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f3f30066430 0x7f3f300688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f501602b0 0x7f3f501541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f5006c120 0x7f3f50153cb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 --2- 172.21.15.82:0/914261733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5006ab10 0x7f3f50157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 >> 172.21.15.82:0/914261733 conn(0x7f3f5008c0a0 msgr2=0x7f3f500cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:42.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 shutdown_connections 2023-07-20T10:02:42.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:42.878+0000 7f3f54a48640 1 -- 172.21.15.82:0/914261733 wait complete. 2023-07-20T10:02:42.887 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:02:42.916 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:42.926+0000 7f83c6741180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:02:43.056 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:02:43.056 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:02:43.056 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:02:43.064 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:43.076+0000 7f60342ef180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:02:43.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 Processor -- start 2023-07-20T10:02:43.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 -- start start 2023-07-20T10:02:43.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 0x7f8dc80b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8dc80cb170 0x7f8dc80cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc806c690 con 0x7f8dc806c200 2023-07-20T10:02:43.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc806bde0 con 0x7f8dc815c630 2023-07-20T10:02:43.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dccd11640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc806b7b0 con 0x7f8dc80cb170 2023-07-20T10:02:43.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dc6d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8dc80cb170 0x7f8dc80cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dc5d9b640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f8dc806c200 0x7f8dc806c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59448/0 (socket says 172.21.15.82:59448) 2023-07-20T10:02:43.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dc5d9b640 1 -- 172.21.15.82:0/2154571246 learned_addr learned my addr 172.21.15.82:0/2154571246 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:43.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.082+0000 7f8dc659c640 1 --2- 172.21.15.82:0/2154571246 >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 0x7f8dc80b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.086+0000 7f8dc6d9d640 1 -- 172.21.15.82:0/2154571246 >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 msgr2=0x7f8dc80b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:43.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.086+0000 7f8dc6d9d640 1 --2- 172.21.15.82:0/2154571246 >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 0x7f8dc80b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.086+0000 7f8dc6d9d640 1 -- 172.21.15.82:0/2154571246 >> v1:172.21.15.183:6789/0 conn(0x7f8dc806c200 legacy=0x7f8dc806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.086+0000 7f8dc6d9d640 1 -- 172.21.15.82:0/2154571246 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80cbae0 con 0x7f8dc80cb170 2023-07-20T10:02:43.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.086+0000 7f8dc659c640 1 --2- 172.21.15.82:0/2154571246 >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 0x7f8dc80b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:43.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.090+0000 7f8dc6d9d640 1 --2- 172.21.15.82:0/2154571246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc80cb170 0x7f8dc80cb5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80b17b0 tx=0x7f8dc001c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41fc8deccfa25625 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:43.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.090+0000 7f8dc559a640 1 -- 172.21.15.82:0/2154571246 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00a6650 con 0x7f8dc80cb170 2023-07-20T10:02:43.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.090+0000 7f8dc559a640 1 -- 172.21.15.82:0/2154571246 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc00a67b0 con 0x7f8dc80cb170 2023-07-20T10:02:43.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.090+0000 7f8dc559a640 1 -- 172.21.15.82:0/2154571246 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00a6b40 con 0x7f8dc80cb170 2023-07-20T10:02:43.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 -- 172.21.15.82:0/2154571246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc80cb170 msgr2=0x7f8dc80cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 --2- 172.21.15.82:0/2154571246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc80cb170 0x7f8dc80cb5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80b17b0 tx=0x7f8dc001c710 comp rx=0 tx=0).stop 2023-07-20T10:02:43.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 -- 172.21.15.82:0/2154571246 shutdown_connections 2023-07-20T10:02:43.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 --2- 172.21.15.82:0/2154571246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc80cb170 0x7f8dc80cb5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 --2- 172.21.15.82:0/2154571246 >> v2:172.21.15.82:3300/0 conn(0x7f8dc815c630 0x7f8dc80b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 -- 172.21.15.82:0/2154571246 >> 172.21.15.82:0/2154571246 conn(0x7f8dc8069750 msgr2=0x7f8dc8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:43.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 -- 172.21.15.82:0/2154571246 shutdown_connections 2023-07-20T10:02:43.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.094+0000 7f8dccd11640 1 -- 172.21.15.82:0/2154571246 wait complete. 2023-07-20T10:02:43.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 Processor -- start 2023-07-20T10:02:43.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 -- start start 2023-07-20T10:02:43.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc80cb170 0x7f8dc809b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 0x7f8dc80711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc815f2c0 con 0x7f8dc80cb170 2023-07-20T10:02:43.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc815f560 con 0x7f8dc815c630 2023-07-20T10:02:43.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dccd11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc815f840 con 0x7f8dc806c200 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc6d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 0x7f8dc80711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:50790/0 (socket says 172.21.15.82:50790) 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 -- 172.21.15.82:0/2082910915 learned_addr learned my addr 172.21.15.82:0/2082910915 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc5d9b640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc80cb170 0x7f8dc809b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 -- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 msgr2=0x7f8dc80711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 0x7f8dc80711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 -- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc80cb170 msgr2=0x7f8dc809b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc80cb170 0x7f8dc809b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc659c640 1 -- 172.21.15.82:0/2082910915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db8009420 con 0x7f8dc806c200 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.098+0000 7f8dc6d9d640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 0x7f8dc80711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:43.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8dc659c640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e980 tx=0x7f8db800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:43.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ca00 con 0x7f8dc806c200 2023-07-20T10:02:43.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8dccd11640 1 -- 172.21.15.82:0/2082910915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc0009a70 con 0x7f8dc806c200 2023-07-20T10:02:43.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800cb60 con 0x7f8dc806c200 2023-07-20T10:02:43.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800ced0 con 0x7f8dc806c200 2023-07-20T10:02:43.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.102+0000 7f8dccd11640 1 -- 172.21.15.82:0/2082910915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc809bc60 con 0x7f8dc806c200 2023-07-20T10:02:43.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f8db8013470 con 0x7f8dc806c200 2023-07-20T10:02:43.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc815fd60 con 0x7f8dc806c200 2023-07-20T10:02:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8db6ffd640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 0x7f8da8068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8dc5d9b640 1 -- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 msgr2=0x7f8da8068940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8dc5d9b640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 0x7f8da8068940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:43.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.106+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f8db80849b0 con 0x7f8dc806c200 2023-07-20T10:02:43.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.110+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8dc815fd60 con 0x7f8dc806c200 2023-07-20T10:02:43.163 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:02:43.163 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:02:43.164 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:02:43.172 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:43.182+0000 7f83c6741180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:02:43.199 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:43.212+0000 7f60342ef180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:02:43.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.294+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8dc815fd60 con 0x7f8dc806c200 2023-07-20T10:02:43.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db6ffd640 1 -- 172.21.15.82:0/2082910915 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v52) v1 ==== 80+0+354 (secure 0 0 0) 0x7f8dc815fd60 con 0x7f8dc806c200 2023-07-20T10:02:43.286 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1031146939 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.286 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3996830125 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.286 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3113011850 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.286 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2172384118 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.287 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/2623212404 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.287 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/2623212404 2023-07-21T09:51:35.501102+0000 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:listed 6 entries 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 msgr2=0x7f8da8068940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 0x7f8da8068940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 msgr2=0x7f8dc8155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e980 tx=0x7f8db800ee40 comp rx=0 tx=0).stop 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 shutdown_connections 2023-07-20T10:02:43.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f8da8066480 0x7f8da8068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc815c630 0x7f8dc80711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc80cb170 0x7f8dc809b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 --2- 172.21.15.82:0/2082910915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc806c200 0x7f8dc8155aa0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 >> 172.21.15.82:0/2082910915 conn(0x7f8dc8069750 msgr2=0x7f8dc806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 shutdown_connections 2023-07-20T10:02:43.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.298+0000 7f8db4ff9640 1 -- 172.21.15.82:0/2082910915 wait complete. 2023-07-20T10:02:43.307 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:02:43.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:43.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:02:43.311 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:43.322+0000 7f83c6741180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:02:43.323 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:43.336+0000 7f60342ef180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:02:43.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:02:43.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:02:43.382 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:02:43.391 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:02:43.392 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:43.395 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:43.408+0000 7f60342ef180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:02:43.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:02:43.401 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:02:43.401 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:43.439 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:43.450+0000 7f83c6741180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:02:43.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:02:43.442 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:02:43.442 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:43.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:02:43.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:02:43.511 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:43.522+0000 7f83c6741180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:02:43.530 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:43.544+0000 7f60342ef180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:02:43.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 Processor -- start 2023-07-20T10:02:43.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 -- start start 2023-07-20T10:02:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 0x7f25340d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340d16b0 con 0x7f25340cf110 2023-07-20T10:02:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340d31c0 con 0x7f25340d0d10 2023-07-20T10:02:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f253a2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b3520 con 0x7f253415cab0 2023-07-20T10:02:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f25337fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 0x7f25340d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2538868640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f25340cf110 0x7f25340cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59530/0 (socket says 172.21.15.82:59530) 2023-07-20T10:02:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2533fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2538868640 1 -- 172.21.15.82:0/1646213332 learned_addr learned my addr 172.21.15.82:0/1646213332 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2532ffd640 1 -- 172.21.15.82:0/1646213332 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713213424 0 0) 0x7f25340d16b0 con 0x7f25340cf110 2023-07-20T10:02:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2532ffd640 1 -- 172.21.15.82:0/1646213332 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c003530 con 0x7f25340cf110 2023-07-20T10:02:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2533fff640 1 -- 172.21.15.82:0/1646213332 >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 msgr2=0x7f25340d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2533fff640 1 --2- 172.21.15.82:0/1646213332 >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 0x7f25340d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2533fff640 1 -- 172.21.15.82:0/1646213332 >> v1:172.21.15.183:6789/0 conn(0x7f25340cf110 legacy=0x7f25340cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f2533fff640 1 -- 172.21.15.82:0/1646213332 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340b2910 con 0x7f253415cab0 2023-07-20T10:02:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.638+0000 7f25337fe640 1 --2- 172.21.15.82:0/1646213332 >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 0x7f25340d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:43.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f2533fff640 1 --2- 172.21.15.82:0/1646213332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340d0300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25240097c0 tx=0x7f252401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105c3e62ee97040d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:43.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f2532ffd640 1 -- 172.21.15.82:0/1646213332 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240ab650 con 0x7f253415cab0 2023-07-20T10:02:43.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f2532ffd640 1 -- 172.21.15.82:0/1646213332 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25240ab7b0 con 0x7f253415cab0 2023-07-20T10:02:43.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f2532ffd640 1 -- 172.21.15.82:0/1646213332 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240abb40 con 0x7f253415cab0 2023-07-20T10:02:43.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 -- 172.21.15.82:0/1646213332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 msgr2=0x7f25340d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 --2- 172.21.15.82:0/1646213332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340d0300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f25240097c0 tx=0x7f252401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:43.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 -- 172.21.15.82:0/1646213332 shutdown_connections 2023-07-20T10:02:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 --2- 172.21.15.82:0/1646213332 >> v2:172.21.15.183:3300/0 conn(0x7f25340d0d10 0x7f25340d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 --2- 172.21.15.82:0/1646213332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340d0300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 -- 172.21.15.82:0/1646213332 >> 172.21.15.82:0/1646213332 conn(0x7f253408c120 msgr2=0x7f253409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 -- 172.21.15.82:0/1646213332 shutdown_connections 2023-07-20T10:02:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.642+0000 7f253a2cb640 1 -- 172.21.15.82:0/1646213332 wait complete. 2023-07-20T10:02:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 Processor -- start 2023-07-20T10:02:43.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- start start 2023-07-20T10:02:43.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340cf110 0x7f2534155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b81f0 con 0x7f25340d0d10 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b7950 con 0x7f25340cf110 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b7c30 con 0x7f253415cab0 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51642/0 (socket says 172.21.15.82:51642) 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 -- 172.21.15.82:0/3947895173 learned_addr learned my addr 172.21.15.82:0/3947895173 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f2538868640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f2533fff640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340cf110 0x7f2534155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 -- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 msgr2=0x7f25340c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 -- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340cf110 msgr2=0x7f2534155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340cf110 0x7f2534155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 -- 172.21.15.82:0/3947895173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009420 con 0x7f25340d0d10 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f25337fe640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f252800ebe0 tx=0x7f252800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800eee0 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800cc30 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2524009420 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528013470 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340c6400 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.646+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25340c65c0 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.650+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f25280135d0 con 0x7f25340d0d10 2023-07-20T10:02:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.650+0000 7f2530ff9640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 0x7f25200688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:43.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.650+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f25280845b0 con 0x7f25340d0d10 2023-07-20T10:02:43.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.650+0000 7f2533fff640 1 -- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 msgr2=0x7f25200688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:43.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.650+0000 7f2533fff640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 0x7f25200688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:43.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.654+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25280514f0 con 0x7f25340d0d10 2023-07-20T10:02:43.652 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:43.662+0000 7f83c6741180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:02:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25340c6260 con 0x7f25340d0d10 2023-07-20T10:02:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f2530ff9640 1 -- 172.21.15.82:0/3947895173 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f25340c6260 con 0x7f25340d0d10 2023-07-20T10:02:43.827 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:43.827 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T10:02:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T10:02:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 msgr2=0x7f25200688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 0x7f25200688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 msgr2=0x7f253415da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f252800ebe0 tx=0x7f252800c520 comp rx=0 tx=0).stop 2023-07-20T10:02:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 shutdown_connections 2023-07-20T10:02:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f2520066430 0x7f25200688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f253415cab0 0x7f25340c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25340d0d10 0x7f253415da50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 --2- 172.21.15.82:0/3947895173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f25340cf110 0x7f2534155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 >> 172.21.15.82:0/3947895173 conn(0x7f253408c120 msgr2=0x7f253415bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 shutdown_connections 2023-07-20T10:02:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:43.838+0000 7f253a2cb640 1 -- 172.21.15.82:0/3947895173 wait complete. 2023-07-20T10:02:43.847 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:44.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 Processor -- start 2023-07-20T10:02:44.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 -- start start 2023-07-20T10:02:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f582815cab0 0x7f58280d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58280ce4c0 0x7f58280d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280d16b0 con 0x7f58280d0d10 2023-07-20T10:02:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280d31c0 con 0x7f582815cab0 2023-07-20T10:02:44.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582f1f3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280b3520 con 0x7f58280ce4c0 2023-07-20T10:02:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f582815cab0 0x7f58280d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f582815cab0 0x7f58280d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51650/0 (socket says 172.21.15.82:51650) 2023-07-20T10:02:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 -- 172.21.15.82:0/2147773526 learned_addr learned my addr 172.21.15.82:0/2147773526 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582d790640 1 --2- 172.21.15.82:0/2147773526 >> v2:172.21.15.183:3300/0 conn(0x7f58280ce4c0 0x7f58280d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 -- 172.21.15.82:0/2147773526 >> v2:172.21.15.183:3300/0 conn(0x7f58280ce4c0 msgr2=0x7f58280d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 --2- 172.21.15.82:0/2147773526 >> v2:172.21.15.183:3300/0 conn(0x7f58280ce4c0 0x7f58280d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 -- 172.21.15.82:0/2147773526 >> v1:172.21.15.183:6789/0 conn(0x7f58280d0d10 legacy=0x7f58280cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.050+0000 7f582cf8f640 1 -- 172.21.15.82:0/2147773526 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280b2910 con 0x7f582815cab0 2023-07-20T10:02:44.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582cf8f640 1 --2- 172.21.15.82:0/2147773526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582815cab0 0x7f58280d0300 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5828071cd0 tx=0x7f581c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0d515e827f3afe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f58277fe640 1 -- 172.21.15.82:0/2147773526 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0ab5f0 con 0x7f582815cab0 2023-07-20T10:02:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f58277fe640 1 -- 172.21.15.82:0/2147773526 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0ab750 con 0x7f582815cab0 2023-07-20T10:02:44.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f58277fe640 1 -- 172.21.15.82:0/2147773526 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0abae0 con 0x7f582815cab0 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 -- 172.21.15.82:0/2147773526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582815cab0 msgr2=0x7f58280d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 --2- 172.21.15.82:0/2147773526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582815cab0 0x7f58280d0300 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5828071cd0 tx=0x7f581c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 -- 172.21.15.82:0/2147773526 shutdown_connections 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 --2- 172.21.15.82:0/2147773526 >> v2:172.21.15.183:3300/0 conn(0x7f58280ce4c0 0x7f58280d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 --2- 172.21.15.82:0/2147773526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582815cab0 0x7f58280d0300 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 -- 172.21.15.82:0/2147773526 >> 172.21.15.82:0/2147773526 conn(0x7f582808c120 msgr2=0x7f582809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 -- 172.21.15.82:0/2147773526 shutdown_connections 2023-07-20T10:02:44.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.054+0000 7f582f1f3640 1 -- 172.21.15.82:0/2147773526 wait complete. 2023-07-20T10:02:44.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 Processor -- start 2023-07-20T10:02:44.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 -- start start 2023-07-20T10:02:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58280d0d10 0x7f582815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582815cab0 0x7f582815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c9c30 con 0x7f58280ce4c0 2023-07-20T10:02:44.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c6050 con 0x7f582815cab0 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582f1f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280cbbc0 con 0x7f58280d0d10 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51658/0 (socket says 172.21.15.82:51658) 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 -- 172.21.15.82:0/3873059843 learned_addr learned my addr 172.21.15.82:0/3873059843 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f5827fff640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58280d0d10 0x7f582815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582d790640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582815cab0 0x7f582815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 -- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58280d0d10 msgr2=0x7f582815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58280d0d10 0x7f582815e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 -- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582815cab0 msgr2=0x7f582815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582815cab0 0x7f582815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 -- 172.21.15.82:0/3873059843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0094d0 con 0x7f58280ce4c0 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.058+0000 7f582cf8f640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f581c0190e0 tx=0x7f581c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0be5f0 con 0x7f58280ce4c0 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0be770 con 0x7f58280ce4c0 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0beb20 con 0x7f58280ce4c0 2023-07-20T10:02:44.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58280c8aa0 con 0x7f58280ce4c0 2023-07-20T10:02:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58280c8d70 con 0x7f58280ce4c0 2023-07-20T10:02:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828073c70 con 0x7f58280ce4c0 2023-07-20T10:02:44.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f581c0b43f0 con 0x7f58280ce4c0 2023-07-20T10:02:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 0x7f580c0688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f581c0a8050 con 0x7f58280ce4c0 2023-07-20T10:02:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f5827fff640 1 -- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 msgr2=0x7f580c0688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:44.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.062+0000 7f5827fff640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 0x7f580c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:44.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.066+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f581c0ebd50 con 0x7f58280ce4c0 2023-07-20T10:02:44.074 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.088+0000 7f60342ef180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:02:44.158 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.172+0000 7f60342ef180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:02:44.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.250+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58280b2590 con 0x7f58280ce4c0 2023-07-20T10:02:44.240 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.250+0000 7f83c6741180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:02:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f58257fa640 1 -- 172.21.15.82:0/3873059843 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+19927 (secure 0 0 0) 0x7f581c0ef370 con 0x7f58280ce4c0 2023-07-20T10:02:44.241 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:44.241 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":52,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:41.868688+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1031146939":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3996830125":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3113011850":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/2172384118":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6833/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6832/2623212404":"2023-07-21T09:51:35.501102+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":177,"length":45}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":106,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 msgr2=0x7f580c0688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 0x7f580c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 msgr2=0x7f58280cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f581c0190e0 tx=0x7f581c01ad10 comp rx=0 tx=0).stop 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 shutdown_connections 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f580c066430 0x7f580c0688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582815cab0 0x7f582815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58280d0d10 0x7f582815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 --2- 172.21.15.82:0/3873059843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58280ce4c0 0x7f58280cc0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 >> 172.21.15.82:0/3873059843 conn(0x7f582808c120 msgr2=0x7f58280af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 shutdown_connections 2023-07-20T10:02:44.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.254+0000 7f582f1f3640 1 -- 172.21.15.82:0/3873059843 wait complete. 2023-07-20T10:02:44.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T09:51:21.078613+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T09:51:22.067872+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 221, 'snap_epoch': 52, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:02:44.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:02:44.304 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.316+0000 7f60342ef180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:02:44.328 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.338+0000 7f83c6741180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:02:44.386 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.400+0000 7f60342ef180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:02:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 Processor -- start 2023-07-20T10:02:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 -- start start 2023-07-20T10:02:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe05806b220 0x7fe058160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580ce4f0 con 0x7fe05806c120 2023-07-20T10:02:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0580d0970 con 0x7fe0581602b0 2023-07-20T10:02:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05f096640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058160e20 con 0x7fe05806b220 2023-07-20T10:02:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05d633640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe05806b220 0x7fe058160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05ce32640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe05806c120 0x7fe0580cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48702/0 (socket says 172.21.15.82:48702) 2023-07-20T10:02:44.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05ce32640 1 -- 172.21.15.82:0/3298487085 learned_addr learned my addr 172.21.15.82:0/3298487085 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:44.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05d633640 1 -- 172.21.15.82:0/3298487085 >> v1:172.21.15.183:6789/0 conn(0x7fe0581602b0 legacy=0x7fe05806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05d633640 1 -- 172.21.15.82:0/3298487085 >> v1:172.21.15.82:6789/0 conn(0x7fe05806c120 legacy=0x7fe0580cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe05d633640 1 -- 172.21.15.82:0/3298487085 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580cd300 con 0x7fe05806b220 2023-07-20T10:02:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.418+0000 7fe0577fe640 1 -- 172.21.15.82:0/3298487085 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735759290 0 0) 0x7fe0580ce4f0 con 0x7fe05806c120 2023-07-20T10:02:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05d633640 1 --2- 172.21.15.82:0/3298487085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe05806b220 0x7fe058160740 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe050009d90 tx=0x7fe05001c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb4eae75e84256f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe0577fe640 1 -- 172.21.15.82:0/3298487085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500a58c0 con 0x7fe05806b220 2023-07-20T10:02:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe0577fe640 1 -- 172.21.15.82:0/3298487085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500a5a20 con 0x7fe05806b220 2023-07-20T10:02:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe0577fe640 1 -- 172.21.15.82:0/3298487085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500a5db0 con 0x7fe05806b220 2023-07-20T10:02:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 -- 172.21.15.82:0/3298487085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe05806b220 msgr2=0x7fe058160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 --2- 172.21.15.82:0/3298487085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe05806b220 0x7fe058160740 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe050009d90 tx=0x7fe05001c800 comp rx=0 tx=0).stop 2023-07-20T10:02:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 -- 172.21.15.82:0/3298487085 shutdown_connections 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 --2- 172.21.15.82:0/3298487085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe05806b220 0x7fe058160740 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 -- 172.21.15.82:0/3298487085 >> 172.21.15.82:0/3298487085 conn(0x7fe05808c0a0 msgr2=0x7fe05809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 -- 172.21.15.82:0/3298487085 shutdown_connections 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.422+0000 7fe05f096640 1 -- 172.21.15.82:0/3298487085 wait complete. 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 Processor -- start 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 -- start start 2023-07-20T10:02:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe05806b220 0x7fe05814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 0x7fe0580cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815f120 con 0x7fe0581602b0 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580cc570 con 0x7fe05806c120 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05f096640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05814e160 con 0x7fe05806b220 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe057fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 0x7fe0580cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51672/0 (socket says 172.21.15.82:51672) 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05ce32640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe05806b220 0x7fe05814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 -- 172.21.15.82:0/228428507 learned_addr learned my addr 172.21.15.82:0/228428507 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 -- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe05806b220 msgr2=0x7fe05814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe05806b220 0x7fe05814dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 -- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 msgr2=0x7fe0580cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 0x7fe0580cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 -- 172.21.15.82:0/228428507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050009a70 con 0x7fe0581602b0 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe057fff640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 0x7fe0580cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.426+0000 7fe05d633640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe05001a430 tx=0x7fe0500195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500ad850 con 0x7fe0581602b0 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500ad9b0 con 0x7fe0581602b0 2023-07-20T10:02:44.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0580cbfb0 con 0x7fe0581602b0 2023-07-20T10:02:44.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500add20 con 0x7fe0581602b0 2023-07-20T10:02:44.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0580ca890 con 0x7fe0581602b0 2023-07-20T10:02:44.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0580caa80 con 0x7fe0581602b0 2023-07-20T10:02:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fe0500b4050 con 0x7fe0581602b0 2023-07-20T10:02:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 0x7fe03c0688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe05ce32640 1 -- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 msgr2=0x7fe03c0688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7fe05011f390 con 0x7fe0581602b0 2023-07-20T10:02:44.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.430+0000 7fe05ce32640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 0x7fe03c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:44.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.434+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0500ec2d0 con 0x7fe0581602b0 2023-07-20T10:02:44.483 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.494+0000 7f83c6741180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:02:44.567 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.578+0000 7f83c6741180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:02:44.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.582+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe05804da30 con 0x7fe0581602b0 2023-07-20T10:02:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe0557fa640 1 -- 172.21.15.82:0/228428507 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0500b20a0 con 0x7fe0581602b0 2023-07-20T10:02:44.573 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:02:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 msgr2=0x7fe03c0688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 0x7fe03c0688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 msgr2=0x7fe0580cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fe05001a430 tx=0x7fe0500195a0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 shutdown_connections 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7fe03c066430 0x7fe03c0688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0581602b0 0x7fe0580cf5a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe05806c120 0x7fe0580cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 --2- 172.21.15.82:0/228428507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe05806b220 0x7fe05814dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 >> 172.21.15.82:0/228428507 conn(0x7fe05808c0a0 msgr2=0x7fe05806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 shutdown_connections 2023-07-20T10:02:44.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.586+0000 7fe05f096640 1 -- 172.21.15.82:0/228428507 wait complete. 2023-07-20T10:02:44.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:02:44.654 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.668+0000 7f60342ef180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:02:44.713 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:02:44.728+0000 7f60342ef180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:02:44.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 Processor -- start 2023-07-20T10:02:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 -- start start 2023-07-20T10:02:44.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f149406c120 0x7f14940cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406b220 0x7f1494160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14940d0970 con 0x7f14941602b0 2023-07-20T10:02:44.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1494160e20 con 0x7f149406c120 2023-07-20T10:02:44.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f149b9fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940cd300 con 0x7f149406b220 2023-07-20T10:02:44.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f149406c120 0x7f14940cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f149406c120 0x7f14940cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51686/0 (socket says 172.21.15.82:51686) 2023-07-20T10:02:44.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1498f95640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f14941602b0 0x7f149406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48710/0 (socket says 172.21.15.82:48710) 2023-07-20T10:02:44.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 -- 172.21.15.82:0/4590323 learned_addr learned my addr 172.21.15.82:0/4590323 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:44.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499f97640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406b220 0x7f1494160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 -- 172.21.15.82:0/4590323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406b220 msgr2=0x7f1494160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406b220 0x7f1494160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f148bfff640 1 -- 172.21.15.82:0/4590323 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676973854 0 0) 0x7f14940d0970 con 0x7f14941602b0 2023-07-20T10:02:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 -- 172.21.15.82:0/4590323 >> v1:172.21.15.82:6789/0 conn(0x7f14941602b0 legacy=0x7f149406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.750+0000 7f1499796640 1 -- 172.21.15.82:0/4590323 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940cd5e0 con 0x7f149406c120 2023-07-20T10:02:44.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f1499796640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f149406c120 0x7f14940cdde0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1490009870 tx=0x7f149001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fea286a8c5fd8ea server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f148bfff640 1 -- 172.21.15.82:0/4590323 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900a6040 con 0x7f149406c120 2023-07-20T10:02:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f148bfff640 1 -- 172.21.15.82:0/4590323 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14900aa600 con 0x7f149406c120 2023-07-20T10:02:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f148bfff640 1 -- 172.21.15.82:0/4590323 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900aa990 con 0x7f149406c120 2023-07-20T10:02:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 -- 172.21.15.82:0/4590323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f149406c120 msgr2=0x7f14940cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f149406c120 0x7f14940cdde0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1490009870 tx=0x7f149001c480 comp rx=0 tx=0).stop 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 -- 172.21.15.82:0/4590323 shutdown_connections 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406b220 0x7f1494160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 --2- 172.21.15.82:0/4590323 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f149406c120 0x7f14940cdde0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 -- 172.21.15.82:0/4590323 >> 172.21.15.82:0/4590323 conn(0x7f149408c0a0 msgr2=0x7f149409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 -- 172.21.15.82:0/4590323 shutdown_connections 2023-07-20T10:02:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.754+0000 7f149b9fa640 1 -- 172.21.15.82:0/4590323 wait complete. 2023-07-20T10:02:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 Processor -- start 2023-07-20T10:02:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- start start 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149406b220 0x7f1494156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406c120 0x7f14940d0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494156fb0 con 0x7f14941602b0 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14940b5b00 con 0x7f149406b220 2023-07-20T10:02:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940b6900 con 0x7f149406c120 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51690/0 (socket says 172.21.15.82:51690) 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 -- 172.21.15.82:0/1575799780 learned_addr learned my addr 172.21.15.82:0/1575799780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1498f95640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406c120 0x7f14940d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499796640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149406b220 0x7f1494156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:44.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 -- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406c120 msgr2=0x7f14940d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406c120 0x7f14940d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 -- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149406b220 msgr2=0x7f1494156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149406b220 0x7f1494156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 -- 172.21.15.82:0/1575799780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900094d0 con 0x7f14941602b0 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1499f97640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f148c009dd0 tx=0x7f148c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c014480 con 0x7f14941602b0 2023-07-20T10:02:44.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c00f040 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14940c8230 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c014840 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.758+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14940c87f0 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14940c8a10 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 14) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f148c0149a0 con 0x7f14941602b0 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f1489ffb640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 0x7f14780688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:44.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f1499796640 1 -- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 msgr2=0x7f14780688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3054777588 2023-07-20T10:02:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7109+0+0 (secure 0 0 0) 0x7f148c0850f0 con 0x7f14941602b0 2023-07-20T10:02:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.762+0000 7f1499796640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 0x7f14780688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:02:44.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.766+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f148c051dc0 con 0x7f14941602b0 2023-07-20T10:02:44.848 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.858+0000 7f83c6741180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:02:44.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.918+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f149404da30 con 0x7f14941602b0 2023-07-20T10:02:44.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.918+0000 7f1489ffb640 1 -- 172.21.15.82:0/1575799780 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f148c0553e0 con 0x7f14941602b0 2023-07-20T10:02:44.908 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:02:44.909 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f83c6741180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 msgr2=0x7f14780688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 0x7f14780688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 msgr2=0x7f14940d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f148c009dd0 tx=0x7f148c00c490 comp rx=0 tx=0).stop 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 shutdown_connections 2023-07-20T10:02:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:6832/3054777588,v1:172.21.15.82:6833/3054777588] conn(0x7f1478066430 0x7f14780688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14941602b0 0x7f14940d0eb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f149406c120 0x7f14940d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 --2- 172.21.15.82:0/1575799780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f149406b220 0x7f1494156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 >> 172.21.15.82:0/1575799780 conn(0x7f149408c0a0 msgr2=0x7f149406ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 shutdown_connections 2023-07-20T10:02:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:44.922+0000 7f149b9fa640 1 -- 172.21.15.82:0/1575799780 wait complete. 2023-07-20T10:02:44.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:02:44.989 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.998+0000 7f8352880640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.989 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.998+0000 7f8352880640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.990 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.998+0000 7f8352880640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.990 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.998+0000 7f8352880640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.990 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:44.998+0000 7f8352880640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.991 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:45.002+0000 7f834f079640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.991 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:45.002+0000 7f834f079640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.991 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:45.002+0000 7f834f079640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.991 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:45.002+0000 7f834f079640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:44.991 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:02:45.002+0000 7f834f079640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:02:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.102+0000 7f5fa0d2c640 1 Processor -- start 2023-07-20T10:02:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.102+0000 7f5fa0d2c640 1 -- start start 2023-07-20T10:02:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f9c159450 0x7f5f9c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c159830 0x7f5f9c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0cce90 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0cc8d0 con 0x7f5f9c159450 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5fa0d2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0ccbb0 con 0x7f5f9c159830 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51784/0 (socket says 172.21.15.82:51784) 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 -- 172.21.15.82:0/369135283 learned_addr learned my addr 172.21.15.82:0/369135283 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:45.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f91d9b640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c159830 0x7f5f9c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9a59c640 1 --2- 172.21.15.82:0/369135283 >> v2:172.21.15.183:3300/0 conn(0x7f5f9c159450 0x7f5f9c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 -- 172.21.15.82:0/369135283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c159830 msgr2=0x7f5f9c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c159830 0x7f5f9c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 -- 172.21.15.82:0/369135283 >> v2:172.21.15.183:3300/0 conn(0x7f5f9c159450 msgr2=0x7f5f9c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 --2- 172.21.15.82:0/369135283 >> v2:172.21.15.183:3300/0 conn(0x7f5f9c159450 0x7f5f9c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.106+0000 7f5f9ad9d640 1 -- 172.21.15.82:0/369135283 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c159cc0 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5f9ad9d640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c06a6c0 tx=0x7f5f9401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9f4d40aa96b1ee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5f99d9b640 1 -- 172.21.15.82:0/369135283 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940a7b40 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5f99d9b640 1 -- 172.21.15.82:0/369135283 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f940a7ca0 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5f99d9b640 1 -- 172.21.15.82:0/369135283 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940af660 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/369135283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c0cc3e0 msgr2=0x7f5f9c0afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c06a6c0 tx=0x7f5f9401eba0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/369135283 shutdown_connections 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c0cc3e0 0x7f5f9c0afd50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/369135283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c159830 0x7f5f9c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/369135283 >> v2:172.21.15.183:3300/0 conn(0x7f5f9c159450 0x7f5f9c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/369135283 >> 172.21.15.82:0/369135283 conn(0x7f5f9c0cad50 msgr2=0x7f5f9c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/369135283 shutdown_connections 2023-07-20T10:02:45.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/369135283 wait complete. 2023-07-20T10:02:45.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 Processor -- start 2023-07-20T10:02:45.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.110+0000 7f5fa0d2c640 1 -- start start 2023-07-20T10:02:45.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f9c159450 0x7f5f9c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 0x7f5f9c158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0c3260 con 0x7f5f9c14f870 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0c2f30 con 0x7f5f9c159450 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c157ab0 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 0x7f5f9c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:37366/0 (socket says 172.21.15.82:37366) 2023-07-20T10:02:45.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 -- 172.21.15.82:0/1908504272 learned_addr learned my addr 172.21.15.82:0/1908504272 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:45.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f91d9b640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f9c159450 0x7f5f9c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 -- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f9c159450 msgr2=0x7f5f9c158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f9c159450 0x7f5f9c158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 -- 172.21.15.82:0/1908504272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 msgr2=0x7f5f9c158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 0x7f5f9c158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 -- 172.21.15.82:0/1908504272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9400b770 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9ad9d640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 0x7f5f9c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f9a59c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00eed0 tx=0x7f5f8c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c010040 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c009e80 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c156f70 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c014620 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c1574f0 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c04da30 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.114+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 15) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5f8c014780 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.118+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f5f8c084320 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.122+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f8c051730 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.266+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f9c0cbbf0 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.266+0000 7f5f937fe640 1 -- 172.21.15.82:0/1908504272 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f8c054d50 con 0x7f5f9c0cc3e0 2023-07-20T10:02:45.256 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:02:45.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 msgr2=0x7f5f9c156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00eed0 tx=0x7f5f8c00b480 comp rx=0 tx=0).stop 2023-07-20T10:02:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 shutdown_connections 2023-07-20T10:02:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f9c14f870 0x7f5f9c158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f9c159450 0x7f5f9c158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 --2- 172.21.15.82:0/1908504272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f9c0cc3e0 0x7f5f9c156a30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 >> 172.21.15.82:0/1908504272 conn(0x7f5f9c0cad50 msgr2=0x7f5f9c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 shutdown_connections 2023-07-20T10:02:45.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.270+0000 7f5fa0d2c640 1 -- 172.21.15.82:0/1908504272 wait complete. 2023-07-20T10:02:45.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:02:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 Processor -- start 2023-07-20T10:02:45.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 -- start start 2023-07-20T10:02:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f7984160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f798406ab10 0x7f798406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79840ce4f0 con 0x7f798406c120 2023-07-20T10:02:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798406b4c0 con 0x7f798406ab10 2023-07-20T10:02:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79895fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840d0970 con 0x7f79841602b0 2023-07-20T10:02:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f7982ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f798406c120 0x7f79840cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48718/0 (socket says 172.21.15.82:48718) 2023-07-20T10:02:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f7982ffd640 1 -- 172.21.15.82:0/2998247323 learned_addr learned my addr 172.21.15.82:0/2998247323 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79837fe640 1 --2- 172.21.15.82:0/2998247323 >> v2:172.21.15.183:3300/0 conn(0x7f798406ab10 0x7f798406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f797a7fc640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f7984160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79827fc640 1 -- 172.21.15.82:0/2998247323 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727945266 0 0) 0x7f79840ce4f0 con 0x7f798406c120 2023-07-20T10:02:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79827fc640 1 -- 172.21.15.82:0/2998247323 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7970003530 con 0x7f798406c120 2023-07-20T10:02:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79837fe640 1 -- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 msgr2=0x7f7984160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79837fe640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f7984160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79837fe640 1 -- 172.21.15.82:0/2998247323 >> v1:172.21.15.82:6789/0 conn(0x7f798406c120 legacy=0x7f79840cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f79837fe640 1 -- 172.21.15.82:0/2998247323 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984160e20 con 0x7f798406ab10 2023-07-20T10:02:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.430+0000 7f797a7fc640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f7984160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:45.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79837fe640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f798406af80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f797c0097c0 tx=0x7f797c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcda23937745f49 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79827fc640 1 -- 172.21.15.82:0/2998247323 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c0ab600 con 0x7f798406ab10 2023-07-20T10:02:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79827fc640 1 -- 172.21.15.82:0/2998247323 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0a7050 con 0x7f798406ab10 2023-07-20T10:02:45.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79827fc640 1 -- 172.21.15.82:0/2998247323 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c0ab980 con 0x7f798406ab10 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 -- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 msgr2=0x7f798406af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f798406af80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f797c0097c0 tx=0x7f797c01c3f0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 -- 172.21.15.82:0/2998247323 shutdown_connections 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f798406af80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 --2- 172.21.15.82:0/2998247323 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f7984160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 -- 172.21.15.82:0/2998247323 >> 172.21.15.82:0/2998247323 conn(0x7f798408c0a0 msgr2=0x7f798409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 -- 172.21.15.82:0/2998247323 shutdown_connections 2023-07-20T10:02:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.434+0000 7f79895fa640 1 -- 172.21.15.82:0/2998247323 wait complete. 2023-07-20T10:02:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 Processor -- start 2023-07-20T10:02:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- start start 2023-07-20T10:02:45.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f79840b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f79841555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840b1490 con 0x7f798406c120 2023-07-20T10:02:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cbc90 con 0x7f798406ab10 2023-07-20T10:02:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cbf10 con 0x7f79841602b0 2023-07-20T10:02:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51806/0 (socket says 172.21.15.82:51806) 2023-07-20T10:02:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 -- 172.21.15.82:0/438413764 learned_addr learned my addr 172.21.15.82:0/438413764 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 -- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 msgr2=0x7f79841555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f79841555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 -- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 msgr2=0x7f79840b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f79840b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 -- 172.21.15.82:0/438413764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c009420 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797a7fc640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e9b0 tx=0x7f796c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00ca00 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c00cb60 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c009420 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c013470 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.438+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840cc4d0 con 0x7f798406c120 2023-07-20T10:02:45.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.442+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798415f280 con 0x7f798406c120 2023-07-20T10:02:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.442+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f796c0135d0 con 0x7f798406c120 2023-07-20T10:02:45.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.442+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f796c0840c0 con 0x7f798406c120 2023-07-20T10:02:45.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.446+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f796c051330 con 0x7f798406c120 2023-07-20T10:02:45.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.594+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f798404da30 con 0x7f798406c120 2023-07-20T10:02:45.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.594+0000 7f797bfff640 1 -- 172.21.15.82:0/438413764 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f796c054950 con 0x7f798406c120 2023-07-20T10:02:45.584 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:02:45.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 msgr2=0x7f79840b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f796c00e9b0 tx=0x7f796c00ee70 comp rx=0 tx=0).stop 2023-07-20T10:02:45.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 shutdown_connections 2023-07-20T10:02:45.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79841602b0 0x7f79841555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f798406c120 0x7f79840b04d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 --2- 172.21.15.82:0/438413764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f798406ab10 0x7f79840b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 >> 172.21.15.82:0/438413764 conn(0x7f798408c0a0 msgr2=0x7f79840cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 shutdown_connections 2023-07-20T10:02:45.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.598+0000 7f79895fa640 1 -- 172.21.15.82:0/438413764 wait complete. 2023-07-20T10:02:45.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:02:45.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.754+0000 7f8a7e66d640 1 Processor -- start 2023-07-20T10:02:45.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.754+0000 7f8a7e66d640 1 -- start start 2023-07-20T10:02:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.754+0000 7f8a7e66d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a780afda0 0x7f8a780ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a7e66d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a780b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a7e66d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a780b06c0 con 0x7f8a7815a8e0 2023-07-20T10:02:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a7e66d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a780b3160 con 0x7f8a780afda0 2023-07-20T10:02:45.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a7e66d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780b12a0 con 0x7f8a780b2060 2023-07-20T10:02:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8a780afda0 0x7f8a780ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a777fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8a7815a8e0 0x7f8a780b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48734/0 (socket says 172.21.15.82:48734) 2023-07-20T10:02:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a777fe640 1 -- 172.21.15.82:0/2171184646 learned_addr learned my addr 172.21.15.82:0/2171184646 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:45.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a7cc0a640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a780b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 -- 172.21.15.82:0/2171184646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 msgr2=0x7f8a780b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a780b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 -- 172.21.15.82:0/2171184646 >> v1:172.21.15.82:6789/0 conn(0x7f8a7815a8e0 legacy=0x7f8a780b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 -- 172.21.15.82:0/2171184646 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a780b1580 con 0x7f8a780afda0 2023-07-20T10:02:45.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a77fff640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a780afda0 0x7f8a780ca6b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097c0 tx=0x7f8a6801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be43cd8bb1cadee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a76ffd640 1 -- 172.21.15.82:0/2171184646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680ab600 con 0x7f8a780afda0 2023-07-20T10:02:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a76ffd640 1 -- 172.21.15.82:0/2171184646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680a7050 con 0x7f8a780afda0 2023-07-20T10:02:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.758+0000 7f8a76ffd640 1 -- 172.21.15.82:0/2171184646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680ab980 con 0x7f8a780afda0 2023-07-20T10:02:45.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- 172.21.15.82:0/2171184646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a780afda0 msgr2=0x7f8a780ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a780afda0 0x7f8a780ca6b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097c0 tx=0x7f8a6801c330 comp rx=0 tx=0).stop 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- 172.21.15.82:0/2171184646 shutdown_connections 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a780b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/2171184646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a780afda0 0x7f8a780ca6b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- 172.21.15.82:0/2171184646 >> 172.21.15.82:0/2171184646 conn(0x7f8a780cada0 msgr2=0x7f8a780cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- 172.21.15.82:0/2171184646 shutdown_connections 2023-07-20T10:02:45.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- 172.21.15.82:0/2171184646 wait complete. 2023-07-20T10:02:45.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 Processor -- start 2023-07-20T10:02:45.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- start start 2023-07-20T10:02:45.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a780afda0 0x7f8a78159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a78152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780c6170 con 0x7f8a7815a8e0 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780c6450 con 0x7f8a780afda0 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7e66d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780c6730 con 0x7f8a780b2060 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7cc0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7cc0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51812/0 (socket says 172.21.15.82:51812) 2023-07-20T10:02:45.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a7cc0a640 1 -- 172.21.15.82:0/1019042241 learned_addr learned my addr 172.21.15.82:0/1019042241 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:45.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a777fe640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a78152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.762+0000 7f8a77fff640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a780afda0 0x7f8a78159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 -- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 msgr2=0x7f8a78152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a78152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 -- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a780afda0 msgr2=0x7f8a78159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a780afda0 0x7f8a78159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 -- 172.21.15.82:0/1019042241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a68009420 con 0x7f8a7815a8e0 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7cc0a640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8a70007e40 tx=0x7f8a7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a70014620 con 0x7f8a7815a8e0 2023-07-20T10:02:45.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7000ee90 con 0x7f8a7815a8e0 2023-07-20T10:02:45.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a780c6a10 con 0x7f8a7815a8e0 2023-07-20T10:02:45.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700149e0 con 0x7f8a7815a8e0 2023-07-20T10:02:45.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a78152660 con 0x7f8a7815a8e0 2023-07-20T10:02:45.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78073c70 con 0x7f8a7815a8e0 2023-07-20T10:02:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.766+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8a70014b40 con 0x7f8a7815a8e0 2023-07-20T10:02:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.770+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f8a70084580 con 0x7f8a7815a8e0 2023-07-20T10:02:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.770+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a70051990 con 0x7f8a7815a8e0 2023-07-20T10:02:45.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.938+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 16) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8a70051440 con 0x7f8a7815a8e0 2023-07-20T10:02:45.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.938+0000 7f8a74ff9640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 0x7f8a6406eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:45.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.942+0000 7f8a77fff640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 0x7f8a6406eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:45.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.942+0000 7f8a77fff640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 0x7f8a6406eda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ad000 tx=0x7f8a68008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:45.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.958+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a780cb990 con 0x7f8a7815a8e0 2023-07-20T10:02:45.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a74ff9640 1 -- 172.21.15.82:0/1019042241 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f8a7007ffc0 con 0x7f8a7815a8e0 2023-07-20T10:02:45.950 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:45.950 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T10:02:45.950 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T10:02:45.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 msgr2=0x7f8a6406eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 0x7f8a6406eda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ad000 tx=0x7f8a68008040 comp rx=0 tx=0).stop 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 msgr2=0x7f8a780c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8a70007e40 tx=0x7f8a7000e4b0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 shutdown_connections 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8a6406c9b0 0x7f8a6406eda0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8a7815a8e0 0x7f8a780c9930 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8a780b2060 0x7f8a78152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 --2- 172.21.15.82:0/1019042241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a780afda0 0x7f8a78159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:45.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 >> 172.21.15.82:0/1019042241 conn(0x7f8a780cada0 msgr2=0x7f8a78159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:45.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 shutdown_connections 2023-07-20T10:02:45.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:45.962+0000 7f8a7e66d640 1 -- 172.21.15.82:0/1019042241 wait complete. 2023-07-20T10:02:45.971 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 Processor -- start 2023-07-20T10:02:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 -- start start 2023-07-20T10:02:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00d0d10 0x7fa8b00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00d16b0 con 0x7fa8b015cab0 2023-07-20T10:02:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b00b3520 con 0x7fa8b00cd4b0 2023-07-20T10:02:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b7b96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00d31c0 con 0x7fa8b00d0d10 2023-07-20T10:02:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5932640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa8b015cab0 0x7fa8b00d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48738/0 (socket says 172.21.15.82:48738) 2023-07-20T10:02:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5932640 1 -- 172.21.15.82:0/2076024975 learned_addr learned my addr 172.21.15.82:0/2076024975 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00d0d10 0x7fa8b00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106469650 0 0) 0x7fa8b00d16b0 con 0x7fa8b015cab0 2023-07-20T10:02:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c003530 con 0x7fa8b015cab0 2023-07-20T10:02:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039760469 0 0) 0x7fa8b00b3520 con 0x7fa8b00cd4b0 2023-07-20T10:02:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b00d16b0 con 0x7fa8b00cd4b0 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1283344681 0 0) 0x7fa89c003530 con 0x7fa8b015cab0 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00d0d10 msgr2=0x7fa8b00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00d0d10 0x7fa8b00d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 >> v1:172.21.15.183:6789/0 conn(0x7fa8b00cd4b0 legacy=0x7fa8b00cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00d0a10 con 0x7fa8b015cab0 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fa8ac001a00 con 0x7fa8b015cab0 2023-07-20T10:02:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00d0d10 0x7fa8b00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 >> v1:172.21.15.82:6789/0 conn(0x7fa8b015cab0 legacy=0x7fa8b00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa89c003b40 0x7fa89c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa89c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa89c005190 0x7fa89c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00bf80 con 0x7fa89c0047d0 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00c0c0 con 0x7fa89c005190 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c00c280 con 0x7fa89c003b40 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa89c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b5932640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa89c003b40 0x7fa89c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.122+0000 7fa8b6133640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa89c005190 0x7fa89c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 -- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa89c003b40 msgr2=0x7fa89c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa89c003b40 0x7fa89c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 -- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa89c005190 msgr2=0x7fa89c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:46.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa89c005190 0x7fa89c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 -- 172.21.15.82:0/2076024975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c003530 con 0x7fa89c0047d0 2023-07-20T10:02:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b5131640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa89c004c50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00d1b30 tx=0x7fa8a001cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eb03b290d61c60 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004030 con 0x7fa89c0047d0 2023-07-20T10:02:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0004190 con 0x7fa89c0047d0 2023-07-20T10:02:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b4930640 1 -- 172.21.15.82:0/2076024975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0004500 con 0x7fa89c0047d0 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b7b96640 1 -- 172.21.15.82:0/2076024975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 msgr2=0x7fa89c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/2076024975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa89c004c50 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00d1b30 tx=0x7fa8a001cad0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b6133640 1 -- 172.21.15.82:0/2076024975 reap_dead start 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b7b96640 1 -- 172.21.15.82:0/2076024975 shutdown_connections 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.126+0000 7fa8b7b96640 1 -- 172.21.15.82:0/2076024975 >> 172.21.15.82:0/2076024975 conn(0x7fa8b008c120 msgr2=0x7fa8b009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- 172.21.15.82:0/2076024975 shutdown_connections 2023-07-20T10:02:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- 172.21.15.82:0/2076024975 wait complete. 2023-07-20T10:02:46.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 Processor -- start 2023-07-20T10:02:46.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- start start 2023-07-20T10:02:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00c7510 0x7fa8b00c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 0x7fa8b00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00ce280 con 0x7fa89c0047d0 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b0152490 con 0x7fa8b00cd890 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b00c8080 con 0x7fa8b00c7510 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51830/0 (socket says 172.21.15.82:51830) 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 -- 172.21.15.82:0/1831792464 learned_addr learned my addr 172.21.15.82:0/1831792464 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5131640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00c7510 0x7fa8b00c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b6133640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 0x7fa8b00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 -- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00c7510 msgr2=0x7fa8b00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00c7510 0x7fa8b00c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 -- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 msgr2=0x7fa8b00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 0x7fa8b00cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 -- 172.21.15.82:0/1831792464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b00c8360 con 0x7fa89c0047d0 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b6133640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 0x7fa8b00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b5932640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0077f0 tx=0x7fa8ac00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00ae70 con 0x7fa89c0047d0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac007af0 con 0x7fa89c0047d0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac013610 con 0x7fa89c0047d0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.130+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b00c8640 con 0x7fa89c0047d0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b00b79c0 con 0x7fa89c0047d0 2023-07-20T10:02:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b0073c70 con 0x7fa89c0047d0 2023-07-20T10:02:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa8ac013770 con 0x7fa89c0047d0 2023-07-20T10:02:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8a67fc640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 0x7fa8940685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7fa8ac084ab0 con 0x7fa89c0047d0 2023-07-20T10:02:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8b5131640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 0x7fa8940685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.134+0000 7fa8b5131640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 0x7fa8940685c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ae000 tx=0x7fa8a00046d0 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.138+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8ac051c30 con 0x7fa89c0047d0 2023-07-20T10:02:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8b00b2ea0 con 0x7fa89c0047d0 2023-07-20T10:02:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8a67fc640 1 -- 172.21.15.82:0/1831792464 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20417 (secure 0 0 0) 0x7fa8ac017090 con 0x7fa89c0047d0 2023-07-20T10:02:46.279 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:46.279 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:44.925974+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/848832508":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6833/3054777588":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6832/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6833/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/2172384118":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3113011850":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3996830125":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/1031146939":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/4080479193":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/33451035":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/909240107":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/1087456933":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/3543495401":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/2511013614":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6832/3054777588":"2023-07-21T10:02:44.925940+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":177,"length":45}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 msgr2=0x7fa8940685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 0x7fa8940685c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00ae000 tx=0x7fa8a00046d0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 msgr2=0x7fa8b0151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0077f0 tx=0x7fa8ac00a6a0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 shutdown_connections 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8b00cd890 0x7fa8b00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8b00c7510 0x7fa8b00c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa894066100 0x7fa8940685c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 --2- 172.21.15.82:0/1831792464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa89c0047d0 0x7fa8b0151f50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 >> 172.21.15.82:0/1831792464 conn(0x7fa8b008c120 msgr2=0x7fa8b00b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 shutdown_connections 2023-07-20T10:02:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.290+0000 7fa8b7b96640 1 -- 172.21.15.82:0/1831792464 wait complete. 2023-07-20T10:02:46.299 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:02:46.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:02:46.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 Processor -- start 2023-07-20T10:02:46.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 -- start start 2023-07-20T10:02:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb59415dbb0 0x7fb5940cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940ad810 con 0x7fb5940b2a90 2023-07-20T10:02:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59415d0d0 con 0x7fb5941596b0 2023-07-20T10:02:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb5989ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59415e000 con 0x7fb59415dbb0 2023-07-20T10:02:46.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb591d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb5940b2a90 0x7fb5940c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48750/0 (socket says 172.21.15.82:48750) 2023-07-20T10:02:46.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb591d9b640 1 -- 172.21.15.82:0/2840072474 learned_addr learned my addr 172.21.15.82:0/2840072474 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:46.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb592d9d640 1 --2- 172.21.15.82:0/2840072474 >> v2:172.21.15.82:3300/0 conn(0x7fb59415dbb0 0x7fb5940cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb59159a640 1 -- 172.21.15.82:0/2840072474 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957095164 0 0) 0x7fb5940ad810 con 0x7fb5940b2a90 2023-07-20T10:02:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb59159a640 1 -- 172.21.15.82:0/2840072474 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57c003530 con 0x7fb5940b2a90 2023-07-20T10:02:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb592d9d640 1 -- 172.21.15.82:0/2840072474 >> v1:172.21.15.183:6789/0 conn(0x7fb5941596b0 legacy=0x7fb5940b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb592d9d640 1 -- 172.21.15.82:0/2840072474 >> v1:172.21.15.82:6789/0 conn(0x7fb5940b2a90 legacy=0x7fb5940c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.450+0000 7fb592d9d640 1 -- 172.21.15.82:0/2840072474 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59415d3b0 con 0x7fb59415dbb0 2023-07-20T10:02:46.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb592d9d640 1 --2- 172.21.15.82:0/2840072474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940cc900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f4972b8410405a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb59159a640 1 -- 172.21.15.82:0/2840072474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0a5960 con 0x7fb59415dbb0 2023-07-20T10:02:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb59159a640 1 -- 172.21.15.82:0/2840072474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c0a5ac0 con 0x7fb59415dbb0 2023-07-20T10:02:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb59159a640 1 -- 172.21.15.82:0/2840072474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0a5e50 con 0x7fb59415dbb0 2023-07-20T10:02:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 -- 172.21.15.82:0/2840072474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 msgr2=0x7fb5940cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2840072474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940cc900 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dc0 tx=0x7fb58c01c900 comp rx=0 tx=0).stop 2023-07-20T10:02:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 -- 172.21.15.82:0/2840072474 shutdown_connections 2023-07-20T10:02:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2840072474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940cc900 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 -- 172.21.15.82:0/2840072474 >> 172.21.15.82:0/2840072474 conn(0x7fb5940cada0 msgr2=0x7fb5940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:46.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 -- 172.21.15.82:0/2840072474 shutdown_connections 2023-07-20T10:02:46.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.454+0000 7fb5989ba640 1 -- 172.21.15.82:0/2840072474 wait complete. 2023-07-20T10:02:46.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 Processor -- start 2023-07-20T10:02:46.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- start start 2023-07-20T10:02:46.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 0x7fb5941f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 0x7fb5940b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940cce40 con 0x7fb59415dbb0 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940abaa0 con 0x7fb5941596b0 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940aae90 con 0x7fb5940b2a90 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51848/0 (socket says 172.21.15.82:51848) 2023-07-20T10:02:46.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 -- 172.21.15.82:0/2567403931 learned_addr learned my addr 172.21.15.82:0/2567403931 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb59259c640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 0x7fb5941f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb591d9b640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 0x7fb5940b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 -- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 msgr2=0x7fb5941f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 0x7fb5941f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 -- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 msgr2=0x7fb5940b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 0x7fb5940b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 -- 172.21.15.82:0/2567403931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c009a70 con 0x7fb59415dbb0 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb59259c640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 0x7fb5941f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb591d9b640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 0x7fb5940b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb592d9d640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb58c01a530 tx=0x7fb58c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0aed80 con 0x7fb59415dbb0 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c009450 con 0x7fb59415dbb0 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5940ab170 con 0x7fb59415dbb0 2023-07-20T10:02:46.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0b7650 con 0x7fb59415dbb0 2023-07-20T10:02:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.458+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5940ab730 con 0x7fb59415dbb0 2023-07-20T10:02:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940cdb70 con 0x7fb59415dbb0 2023-07-20T10:02:46.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb58c0b4050 con 0x7fb59415dbb0 2023-07-20T10:02:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb582ffd640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 0x7fb574068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7fb58c11f070 con 0x7fb59415dbb0 2023-07-20T10:02:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb59259c640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 0x7fb574068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.462+0000 7fb59259c640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 0x7fb574068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb584000f70 tx=0x7fb584009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.466+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb58c0ec310 con 0x7fb59415dbb0 2023-07-20T10:02:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb594073c70 con 0x7fb59415dbb0 2023-07-20T10:02:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb582ffd640 1 -- 172.21.15.82:0/2567403931 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7fb58c0b2020 con 0x7fb59415dbb0 2023-07-20T10:02:46.630 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:46.631 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T10:02:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T10:02:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 msgr2=0x7fb574068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 0x7fb574068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb584000f70 tx=0x7fb584009040 comp rx=0 tx=0).stop 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 msgr2=0x7fb5940b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb58c01a530 tx=0x7fb58c0196a0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 shutdown_connections 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb5740660d0 0x7fb574068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb59415dbb0 0x7fb5940b2350 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5941596b0 0x7fb5940b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 --2- 172.21.15.82:0/2567403931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb5940b2a90 0x7fb5941f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 >> 172.21.15.82:0/2567403931 conn(0x7fb5940cada0 msgr2=0x7fb59406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 shutdown_connections 2023-07-20T10:02:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.642+0000 7fb5989ba640 1 -- 172.21.15.82:0/2567403931 wait complete. 2023-07-20T10:02:46.651 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:02:46.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 Processor -- start 2023-07-20T10:02:46.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 -- start start 2023-07-20T10:02:46.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 0x7f07cc0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc0cde70 con 0x7f07cc15c910 2023-07-20T10:02:46.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07cc0cbef0 con 0x7f07cc0ca040 2023-07-20T10:02:46.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07d19ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0ca420 con 0x7f07cc15d4a0 2023-07-20T10:02:46.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07cb7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07cb7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:37456/0 (socket says 172.21.15.82:37456) 2023-07-20T10:02:46.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07cb7fe640 1 -- 172.21.15.82:0/4115440100 learned_addr learned my addr 172.21.15.82:0/4115440100 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:46.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.802+0000 7f07caffd640 1 --2- 172.21.15.82:0/4115440100 >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 0x7f07cc0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07ca7fc640 1 -- 172.21.15.82:0/4115440100 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717134292 0 0) 0x7f07cc0cde70 con 0x7f07cc15c910 2023-07-20T10:02:46.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07cb7fe640 1 -- 172.21.15.82:0/4115440100 >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 msgr2=0x7f07cc0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:46.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07cb7fe640 1 --2- 172.21.15.82:0/4115440100 >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 0x7f07cc0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07cb7fe640 1 -- 172.21.15.82:0/4115440100 >> v1:172.21.15.183:6789/0 conn(0x7f07cc15c910 legacy=0x7f07cc15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07cb7fe640 1 -- 172.21.15.82:0/4115440100 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0cdb40 con 0x7f07cc15d4a0 2023-07-20T10:02:46.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07caffd640 1 --2- 172.21.15.82:0/4115440100 >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 0x7f07cc0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07cb7fe640 1 --2- 172.21.15.82:0/4115440100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07c400bb10 tx=0x7f07c401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8334057f8c9e89 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07ca7fc640 1 -- 172.21.15.82:0/4115440100 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c40a7c50 con 0x7f07cc15d4a0 2023-07-20T10:02:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07ca7fc640 1 -- 172.21.15.82:0/4115440100 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c40a7db0 con 0x7f07cc15d4a0 2023-07-20T10:02:46.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07ca7fc640 1 -- 172.21.15.82:0/4115440100 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c40af660 con 0x7f07cc15d4a0 2023-07-20T10:02:46.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07d19ba640 1 -- 172.21.15.82:0/4115440100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 msgr2=0x7f07cc0b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07d19ba640 1 --2- 172.21.15.82:0/4115440100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07c400bb10 tx=0x7f07c401ebe0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07d19ba640 1 -- 172.21.15.82:0/4115440100 shutdown_connections 2023-07-20T10:02:46.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.806+0000 7f07d19ba640 1 --2- 172.21.15.82:0/4115440100 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc0b1170 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 --2- 172.21.15.82:0/4115440100 >> v2:172.21.15.183:3300/0 conn(0x7f07cc0ca040 0x7f07cc0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- 172.21.15.82:0/4115440100 >> 172.21.15.82:0/4115440100 conn(0x7f07cc0cada0 msgr2=0x7f07cc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:46.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- 172.21.15.82:0/4115440100 shutdown_connections 2023-07-20T10:02:46.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- 172.21.15.82:0/4115440100 wait complete. 2023-07-20T10:02:46.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 Processor -- start 2023-07-20T10:02:46.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- start start 2023-07-20T10:02:46.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07cc15c910 0x7f07cc1f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0aae90 con 0x7f07cc0ca040 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1f9530 con 0x7f07cc15c910 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07d19ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0ae2d0 con 0x7f07cc15d4a0 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51860/0 (socket says 172.21.15.82:51860) 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 -- 172.21.15.82:0/956967059 learned_addr learned my addr 172.21.15.82:0/956967059 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:46.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07c27fc640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07cc15c910 0x7f07cc1f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07cb7fe640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 -- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 msgr2=0x7f07cc15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 -- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07cc15c910 msgr2=0x7f07cc1f8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07cc15c910 0x7f07cc1f8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.810+0000 7f07caffd640 1 -- 172.21.15.82:0/956967059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc009420 con 0x7f07cc0ca040 2023-07-20T10:02:46.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07caffd640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00ebe0 tx=0x7f07bc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00eee0 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00cc30 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc013470 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c400b770 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc0ae890 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc073c70 con 0x7f07cc0ca040 2023-07-20T10:02:46.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f07bc0135d0 con 0x7f07cc0ca040 2023-07-20T10:02:46.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 0x7f07ac0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:46.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f07bc084480 con 0x7f07cc0ca040 2023-07-20T10:02:46.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.814+0000 7f07c27fc640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 0x7f07ac0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:46.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.818+0000 7f07c27fc640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 0x7f07ac0685c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07cc159110 tx=0x7f07b4009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:46.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.818+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07bc051780 con 0x7f07cc0ca040 2023-07-20T10:02:46.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:46.986+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 17) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f07bc051b50 con 0x7f07cc0ca040 2023-07-20T10:02:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.014+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07cc0c47f0 con 0x7f07cc0ca040 2023-07-20T10:02:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.014+0000 7f07c8ff9640 1 -- 172.21.15.82:0/956967059 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f07bc06d550 con 0x7f07cc0ca040 2023-07-20T10:02:47.004 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:47.004 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T09:51:23.070016+0000","modified":"2023-07-20T09:51:26.717548+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5229},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5229":{"gid":5229,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.82:6837/1206692867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1206692867},{"type":"v1","addr":"172.21.15.82:6837","nonce":1206692867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-20T10:02:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 16 2023-07-20T10:02:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 msgr2=0x7f07ac0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 0x7f07ac0685c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07cc159110 tx=0x7f07b4009040 comp rx=0 tx=0).stop 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 msgr2=0x7f07cc0adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00ebe0 tx=0x7f07bc00c520 comp rx=0 tx=0).stop 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 shutdown_connections 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07cc15d4a0 0x7f07cc15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07cc15c910 0x7f07cc1f8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f07ac066100 0x7f07ac0685c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 --2- 172.21.15.82:0/956967059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07cc0ca040 0x7f07cc0adc80 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 >> 172.21.15.82:0/956967059 conn(0x7f07cc0cada0 msgr2=0x7f07cc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 shutdown_connections 2023-07-20T10:02:47.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.018+0000 7f07d19ba640 1 -- 172.21.15.82:0/956967059 wait complete. 2023-07-20T10:02:47.025 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.174+0000 7f8eabf11640 1 Processor -- start 2023-07-20T10:02:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.174+0000 7f8eabf11640 1 -- start start 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eabf11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8ea415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eabf11640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40ccd90 con 0x7f8ea40cc900 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eabf11640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea40ad810 con 0x7f8ea41596b0 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eabf11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea415d0d0 con 0x7f8ea40b2a90 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eaa4ae640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8ea40cc900 0x7f8ea40c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48760/0 (socket says 172.21.15.82:48760) 2023-07-20T10:02:47.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eaa4ae640 1 -- 172.21.15.82:0/497955154 learned_addr learned my addr 172.21.15.82:0/497955154 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:47.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8ea415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144799289 0 0) 0x7f8ea40ccd90 con 0x7f8ea40cc900 2023-07-20T10:02:47.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e90003530 con 0x7f8ea40cc900 2023-07-20T10:02:47.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1582214705 0 0) 0x7f8e90003530 con 0x7f8ea40cc900 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 msgr2=0x7f8ea415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8ea415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 >> v1:172.21.15.183:6789/0 conn(0x7f8ea41596b0 legacy=0x7f8ea40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea415d3b0 con 0x7f8ea40cc900 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f8e9c001a00 con 0x7f8ea40cc900 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 >> v1:172.21.15.82:6789/0 conn(0x7f8ea40cc900 legacy=0x7f8ea40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e900039b0 0x7f8e90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e90004360 0x7f8e90004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8e90005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea415d0d0 con 0x7f8e90004360 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9000b9c0 con 0x7f8e900039b0 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9000bb80 con 0x7f8ea40b2a90 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e900039b0 0x7f8e90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e90004360 0x7f8e90004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8eaa4ae640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8e90005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 -- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 msgr2=0x7f8e90005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40b2a90 0x7f8e90005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 -- 172.21.15.82:0/497955154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e90004360 msgr2=0x7f8e90004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e90004360 0x7f8e90004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea9cad640 1 -- 172.21.15.82:0/497955154 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90003530 con 0x7f8e900039b0 2023-07-20T10:02:47.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.178+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e90004360 0x7f8e90004830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:47.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e900039b0 0x7f8e90003d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001910 tx=0x7f8ea001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0ea3c7ba0d2bd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00a88f0 con 0x7f8e900039b0 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00a8a70 con 0x7f8e900039b0 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8ea8cab640 1 -- 172.21.15.82:0/497955154 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00a8e20 con 0x7f8e900039b0 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 -- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e900039b0 msgr2=0x7f8e90003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 --2- 172.21.15.82:0/497955154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e900039b0 0x7f8e90003d90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0001910 tx=0x7f8ea001ecd0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eaa4ae640 1 -- 172.21.15.82:0/497955154 reap_dead start 2023-07-20T10:02:47.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 -- 172.21.15.82:0/497955154 shutdown_connections 2023-07-20T10:02:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 -- 172.21.15.82:0/497955154 >> 172.21.15.82:0/497955154 conn(0x7f8ea40cada0 msgr2=0x7f8ea40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 -- 172.21.15.82:0/497955154 shutdown_connections 2023-07-20T10:02:47.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.182+0000 7f8eabf11640 1 -- 172.21.15.82:0/497955154 wait complete. 2023-07-20T10:02:47.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 Processor -- start 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- start start 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ea4070980 0x7f8ea4070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40ab0c0 0x7f8ea40ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4071340 con 0x7f8e900039b0 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4150f20 con 0x7f8ea4070980 2023-07-20T10:02:47.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40abdf0 con 0x7f8ea40ab0c0 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51892/0 (socket says 172.21.15.82:51892) 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 -- 172.21.15.82:0/3814788856 learned_addr learned my addr 172.21.15.82:0/3814788856 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ea4070980 0x7f8ea4070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eaa4ae640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40ab0c0 0x7f8ea40ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 -- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40ab0c0 msgr2=0x7f8ea40ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40ab0c0 0x7f8ea40ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 -- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ea4070980 msgr2=0x7f8ea4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ea4070980 0x7f8ea4070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 -- 172.21.15.82:0/3814788856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40c1e50 con 0x7f8e900039b0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8ea9cad640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b3040 tx=0x7f8e90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea00052c0 con 0x7f8e900039b0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea0005420 con 0x7f8e900039b0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea40c2130 con 0x7f8e900039b0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0003800 con 0x7f8e900039b0 2023-07-20T10:02:47.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea40c26f0 con 0x7f8e900039b0 2023-07-20T10:02:47.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.186+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea4073c70 con 0x7f8e900039b0 2023-07-20T10:02:47.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.190+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f8ea00b7040 con 0x7f8e900039b0 2023-07-20T10:02:47.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.190+0000 7f8e9a7fc640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 0x7f8e880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.190+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f8ea01211a0 con 0x7f8e900039b0 2023-07-20T10:02:47.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.190+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 0x7f8e880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.190+0000 7f8ea94ac640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 0x7f8e880687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ea41547f0 tx=0x7f8e94008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.194+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ea00ee070 con 0x7f8e900039b0 2023-07-20T10:02:47.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ea40cbbd0 con 0x7f8e900039b0 2023-07-20T10:02:47.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8e9a7fc640 1 -- 172.21.15.82:0/3814788856 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20417 (secure 0 0 0) 0x7f8ea00f1690 con 0x7f8e900039b0 2023-07-20T10:02:47.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:47.332 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":53,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:44.925974+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-20T09:51:21.078613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-20T09:51:22.067872+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":52,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/848832508":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6833/3054777588":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6832/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6833/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/2172384118":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3113011850":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3996830125":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/1031146939":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/4080479193":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/33451035":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/909240107":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/1087456933":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/3543495401":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/2511013614":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6832/3054777588":"2023-07-21T10:02:44.925940+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":177,"length":45}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:47.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 msgr2=0x7f8e880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 0x7f8e880687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8ea41547f0 tx=0x7f8e94008040 comp rx=0 tx=0).stop 2023-07-20T10:02:47.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 msgr2=0x7f8ea41509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.342+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00b3040 tx=0x7f8e90005800 comp rx=0 tx=0).stop 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 shutdown_connections 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8ea40ab0c0 0x7f8ea40ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ea4070980 0x7f8ea4070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f8e88066310 0x7f8e880687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 --2- 172.21.15.82:0/3814788856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e900039b0 0x7f8ea41509e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 >> 172.21.15.82:0/3814788856 conn(0x7f8ea40cada0 msgr2=0x7f8ea40c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 shutdown_connections 2023-07-20T10:02:47.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.346+0000 7f8eabf11640 1 -- 172.21.15.82:0/3814788856 wait complete. 2023-07-20T10:02:47.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:02:47.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.502+0000 7f81d30bd640 1 Processor -- start 2023-07-20T10:02:47.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.502+0000 7f81d30bd640 1 -- start start 2023-07-20T10:02:47.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d30bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc069e60 0x7f81cc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d30bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81cc0b3ac0 0x7f81cc06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d30bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc15e300 con 0x7f81cc15a8a0 2023-07-20T10:02:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d30bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc15ac80 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d30bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc15e5e0 con 0x7f81cc069e60 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81cc0b3ac0 0x7f81cc06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d0e59640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f81cc15a8a0 0x7f81cc069750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59596/0 (socket says 172.21.15.82:59596) 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81cc0b3ac0 0x7f81cc06c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51906/0 (socket says 172.21.15.82:51906) 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d0e59640 1 -- 172.21.15.82:0/2259323659 learned_addr learned my addr 172.21.15.82:0/2259323659 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81c3fff640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc069e60 0x7f81cc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 -- 172.21.15.82:0/2259323659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc069e60 msgr2=0x7f81cc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc069e60 0x7f81cc06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81c37fe640 1 -- 172.21.15.82:0/2259323659 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498357510 0 0) 0x7f81cc15e300 con 0x7f81cc15a8a0 2023-07-20T10:02:47.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 -- 172.21.15.82:0/2259323659 >> v1:172.21.15.183:6789/0 conn(0x7f81cc15a8a0 legacy=0x7f81cc069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.506+0000 7f81d165a640 1 -- 172.21.15.82:0/2259323659 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc15e8c0 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d165a640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc06c690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009d90 tx=0x7f81c401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a61f5f1c130237 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81c37fe640 1 -- 172.21.15.82:0/2259323659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40a59e0 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81c37fe640 1 -- 172.21.15.82:0/2259323659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c40a5b40 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81c37fe640 1 -- 172.21.15.82:0/2259323659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40ad440 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- 172.21.15.82:0/2259323659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc0b3ac0 msgr2=0x7f81cc06c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc06c690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009d90 tx=0x7f81c401c920 comp rx=0 tx=0).stop 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- 172.21.15.82:0/2259323659 shutdown_connections 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc06c690 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 --2- 172.21.15.82:0/2259323659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc069e60 0x7f81cc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- 172.21.15.82:0/2259323659 >> 172.21.15.82:0/2259323659 conn(0x7f81cc0ce710 msgr2=0x7f81cc0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- 172.21.15.82:0/2259323659 shutdown_connections 2023-07-20T10:02:47.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- 172.21.15.82:0/2259323659 wait complete. 2023-07-20T10:02:47.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 Processor -- start 2023-07-20T10:02:47.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.510+0000 7f81d30bd640 1 -- start start 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 0x7f81cc164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1565f0 con 0x7f81cc069e60 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc155970 con 0x7f81cc0b3ac0 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc155c50 con 0x7f81cc15a8a0 2023-07-20T10:02:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51912/0 (socket says 172.21.15.82:51912) 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 -- 172.21.15.82:0/4225123719 learned_addr learned my addr 172.21.15.82:0/4225123719 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c3fff640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d165a640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 0x7f81cc164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 -- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 msgr2=0x7f81cc164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 0x7f81cc164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 -- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 msgr2=0x7f81cc0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 -- 172.21.15.82:0/4225123719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009a70 con 0x7f81cc069e60 2023-07-20T10:02:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d165a640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 0x7f81cc164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c3fff640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d0e59640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c480 tx=0x7f81c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80074e0 con 0x7f81cc069e60 2023-07-20T10:02:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8007660 con 0x7f81cc069e60 2023-07-20T10:02:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc155f30 con 0x7f81cc069e60 2023-07-20T10:02:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8004a30 con 0x7f81cc069e60 2023-07-20T10:02:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc154330 con 0x7f81cc069e60 2023-07-20T10:02:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc073c70 con 0x7f81cc069e60 2023-07-20T10:02:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.514+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f81c8004b90 con 0x7f81cc069e60 2023-07-20T10:02:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.518+0000 7f81c17fa640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 0x7f81b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.518+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7452+0+0 (secure 0 0 0) 0x7f81c80834a0 con 0x7f81cc069e60 2023-07-20T10:02:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.518+0000 7f81c3fff640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 0x7f81b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.518+0000 7f81c3fff640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 0x7f81b80687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81cc06a620 tx=0x7f81bc008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.522+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81c8053ee0 con 0x7f81cc069e60 2023-07-20T10:02:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.698+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f81cc069c10 con 0x7f81cc069e60 2023-07-20T10:02:47.687 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:02:47.698+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:02:47.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81c17fa640 1 -- 172.21.15.82:0/4225123719 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f81c8018020 con 0x7f81cc069e60 2023-07-20T10:02:47.694 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:02:47.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 msgr2=0x7f81b80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 0x7f81b80687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81cc06a620 tx=0x7f81bc008040 comp rx=0 tx=0).stop 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 msgr2=0x7f81cc153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f81c800c480 tx=0x7f81c800c940 comp rx=0 tx=0).stop 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 shutdown_connections 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81cc15a8a0 0x7f81cc164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81cc0b3ac0 0x7f81cc0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f81b8066310 0x7f81b80687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 --2- 172.21.15.82:0/4225123719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81cc069e60 0x7f81cc153df0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 >> 172.21.15.82:0/4225123719 conn(0x7f81cc0ce710 msgr2=0x7f81cc0ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 shutdown_connections 2023-07-20T10:02:47.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.706+0000 7f81d30bd640 1 -- 172.21.15.82:0/4225123719 wait complete. 2023-07-20T10:02:47.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:02:47.756 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:02:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 Processor -- start 2023-07-20T10:02:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 -- start start 2023-07-20T10:02:47.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb52c159450 0x7fb52c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52c0cc8d0 con 0x7fb52c0afd50 2023-07-20T10:02:47.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52c0ccbb0 con 0x7fb52c159830 2023-07-20T10:02:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb5308cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb52c0cce90 con 0x7fb52c159450 2023-07-20T10:02:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52ad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb52c0afd50 0x7fb52c0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48770/0 (socket says 172.21.15.82:48770) 2023-07-20T10:02:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52ad9d640 1 -- 172.21.15.82:0/2499366156 learned_addr learned my addr 172.21.15.82:0/2499366156 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52a59c640 1 --2- 172.21.15.82:0/2499366156 >> v2:172.21.15.183:3300/0 conn(0x7fb52c159450 0x7fb52c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875872502 0 0) 0x7fb52c0cc8d0 con 0x7fb52c0afd50 2023-07-20T10:02:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb518003530 con 0x7fb52c0afd50 2023-07-20T10:02:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086308590 0 0) 0x7fb52c0ccbb0 con 0x7fb52c159830 2023-07-20T10:02:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52a59c640 1 -- 172.21.15.82:0/2499366156 >> v1:172.21.15.183:6789/0 conn(0x7fb52c159830 legacy=0x7fb52c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52a59c640 1 -- 172.21.15.82:0/2499366156 >> v1:172.21.15.82:6789/0 conn(0x7fb52c0afd50 legacy=0x7fb52c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.874+0000 7fb52a59c640 1 -- 172.21.15.82:0/2499366156 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c159cc0 con 0x7fb52c159450 2023-07-20T10:02:47.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb52a59c640 1 --2- 172.21.15.82:0/2499366156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c159450 0x7fb52c15a4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0097c0 tx=0x7fb51c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413382ceb4d4c4ab server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0a7070 con 0x7fb52c159450 2023-07-20T10:02:47.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0ab430 con 0x7fb52c159450 2023-07-20T10:02:47.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb529d9b640 1 -- 172.21.15.82:0/2499366156 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0ab7c0 con 0x7fb52c159450 2023-07-20T10:02:47.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 -- 172.21.15.82:0/2499366156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c159450 msgr2=0x7fb52c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 --2- 172.21.15.82:0/2499366156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c159450 0x7fb52c15a4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0097c0 tx=0x7fb51c01c450 comp rx=0 tx=0).stop 2023-07-20T10:02:47.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 -- 172.21.15.82:0/2499366156 shutdown_connections 2023-07-20T10:02:47.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 --2- 172.21.15.82:0/2499366156 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c159450 0x7fb52c15a4c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 -- 172.21.15.82:0/2499366156 >> 172.21.15.82:0/2499366156 conn(0x7fb52c0cad50 msgr2=0x7fb52c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:47.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 -- 172.21.15.82:0/2499366156 shutdown_connections 2023-07-20T10:02:47.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.878+0000 7fb5308cb640 1 -- 172.21.15.82:0/2499366156 wait complete. 2023-07-20T10:02:47.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 Processor -- start 2023-07-20T10:02:47.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- start start 2023-07-20T10:02:47.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb52c0afd50 0x7fb52c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 0x7fb52c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c0b1800 con 0x7fb52c159450 2023-07-20T10:02:47.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c15ca90 con 0x7fb52c0b1350 2023-07-20T10:02:47.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52c15bf10 con 0x7fb52c0afd50 2023-07-20T10:02:47.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51940/0 (socket says 172.21.15.82:51940) 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 -- 172.21.15.82:0/1321327496 learned_addr learned my addr 172.21.15.82:0/1321327496 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb52a59c640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb52c0afd50 0x7fb52c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb52ad9d640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 0x7fb52c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 -- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb52c0afd50 msgr2=0x7fb52c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb52c0afd50 0x7fb52c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 -- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 msgr2=0x7fb52c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 0x7fb52c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 -- 172.21.15.82:0/1321327496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c009420 con 0x7fb52c159450 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb52ad9d640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 0x7fb52c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb521d9b640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c7a0 tx=0x7fb51400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514003db0 con 0x7fb52c159450 2023-07-20T10:02:47.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514005070 con 0x7fb52c159450 2023-07-20T10:02:47.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52c15c1f0 con 0x7fb52c159450 2023-07-20T10:02:47.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514005420 con 0x7fb52c159450 2023-07-20T10:02:47.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.882+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52c15c7b0 con 0x7fb52c159450 2023-07-20T10:02:47.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52c13c600 con 0x7fb52c159450 2023-07-20T10:02:47.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fb514005580 con 0x7fb52c159450 2023-07-20T10:02:47.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb5237fe640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 0x7fb50c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:47.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7538+0+0 (secure 0 0 0) 0x7fb514083b00 con 0x7fb52c159450 2023-07-20T10:02:47.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb52a59c640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 0x7fb50c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:47.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.886+0000 7fb52a59c640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 0x7fb50c0687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0af000 tx=0x7fb51c0a7000 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:47.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:47.890+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb52c13c600 con 0x7fb52c159450 2023-07-20T10:02:48.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.074+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb52c13c600 con 0x7fb52c159450 2023-07-20T10:02:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.706+0000 7fb5237fe640 1 -- 172.21.15.82:0/1321327496 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb52c13c600 con 0x7fb52c159450 2023-07-20T10:02:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 msgr2=0x7fb50c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 0x7fb50c0687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0af000 tx=0x7fb51c0a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 msgr2=0x7fb52c0b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb51400c7a0 tx=0x7fb51400cc60 comp rx=0 tx=0).stop 2023-07-20T10:02:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 shutdown_connections 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb52c0b1350 0x7fb52c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb50c066310 0x7fb50c0687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb52c159450 0x7fb52c0b0e10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 --2- 172.21.15.82:0/1321327496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb52c0afd50 0x7fb52c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 >> 172.21.15.82:0/1321327496 conn(0x7fb52c0cad50 msgr2=0x7fb52c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 shutdown_connections 2023-07-20T10:02:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.710+0000 7fb5308cb640 1 -- 172.21.15.82:0/1321327496 wait complete. 2023-07-20T10:02:48.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:02:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 Processor -- start 2023-07-20T10:02:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 -- start start 2023-07-20T10:02:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f343015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f34300afd50 0x7f34300b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34300cc8d0 con 0x7f3430159830 2023-07-20T10:02:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34300cce90 con 0x7f34300afd50 2023-07-20T10:02:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.922+0000 7f3436d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300b0700 con 0x7f3430159450 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f34300afd50 0x7f34300b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f3427fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f3430159830 0x7f34300cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59628/0 (socket says 172.21.15.82:59628) 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f3427fff640 1 -- 172.21.15.82:0/3206869680 learned_addr learned my addr 172.21.15.82:0/3206869680 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f3434a9c640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f343015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 -- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 msgr2=0x7f343015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f343015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 -- 172.21.15.82:0/3206869680 >> v1:172.21.15.183:6789/0 conn(0x7f3430159830 legacy=0x7f34300cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 -- 172.21.15.82:0/3206869680 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34300ccbb0 con 0x7f34300afd50 2023-07-20T10:02:48.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f343529d640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300b01c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34280097f0 tx=0x7f342801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5406a8efb42fa0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:48.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f34277fe640 1 -- 172.21.15.82:0/3206869680 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280ab650 con 0x7f34300afd50 2023-07-20T10:02:48.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f34277fe640 1 -- 172.21.15.82:0/3206869680 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34280ab7b0 con 0x7f34300afd50 2023-07-20T10:02:48.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.926+0000 7f34277fe640 1 -- 172.21.15.82:0/3206869680 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280abb40 con 0x7f34300afd50 2023-07-20T10:02:48.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 msgr2=0x7f34300b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300b01c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34280097f0 tx=0x7f342801c450 comp rx=0 tx=0).stop 2023-07-20T10:02:48.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- 172.21.15.82:0/3206869680 shutdown_connections 2023-07-20T10:02:48.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300b01c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- 172.21.15.82:0/3206869680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f343015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- 172.21.15.82:0/3206869680 >> 172.21.15.82:0/3206869680 conn(0x7f34300cad50 msgr2=0x7f34300cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- 172.21.15.82:0/3206869680 shutdown_connections 2023-07-20T10:02:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- 172.21.15.82:0/3206869680 wait complete. 2023-07-20T10:02:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 Processor -- start 2023-07-20T10:02:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- start start 2023-07-20T10:02:48.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f34300c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c9290 con 0x7f34300c88d0 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34300b1630 con 0x7f34300afd50 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f3436d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34300c5990 con 0x7f3430159450 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f343529d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f343529d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51948/0 (socket says 172.21.15.82:51948) 2023-07-20T10:02:48.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.930+0000 7f343529d640 1 -- 172.21.15.82:0/607034484 learned_addr learned my addr 172.21.15.82:0/607034484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:48.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3434a9c640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3427fff640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f34300c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 -- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 msgr2=0x7f34300c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f34300c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 -- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 msgr2=0x7f34300c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 -- 172.21.15.82:0/607034484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428009420 con 0x7f34300c88d0 2023-07-20T10:02:48.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3427fff640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f34300c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f343529d640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f342801a080 tx=0x7f342801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280bf610 con 0x7f34300c88d0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34280bf770 con 0x7f34300c88d0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280bfb20 con 0x7f34300c88d0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34300b0d00 con 0x7f34300c88d0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34300b12c0 con 0x7f34300c88d0 2023-07-20T10:02:48.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343004da30 con 0x7f34300c88d0 2023-07-20T10:02:48.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f34280b5400 con 0x7f34300c88d0 2023-07-20T10:02:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 0x7f341c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7538+0+0 (secure 0 0 0) 0x7f342811f060 con 0x7f34300c88d0 2023-07-20T10:02:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.934+0000 7f3434a9c640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 0x7f341c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.938+0000 7f3434a9c640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 0x7f341c068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f342c0074a0 tx=0x7f342c00b040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:48.938+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34280ebd90 con 0x7f34300c88d0 2023-07-20T10:02:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.090+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f34300b1770 con 0x7f34300c88d0 2023-07-20T10:02:49.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.718+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34280ec160 con 0x7f34300c88d0 2023-07-20T10:02:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.990+0000 7f34257fa640 1 -- 172.21.15.82:0/607034484 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7f34280c0810 con 0x7f34300c88d0 2023-07-20T10:02:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:02:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 msgr2=0x7f341c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 0x7f341c068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f342c0074a0 tx=0x7f342c00b040 comp rx=0 tx=0).stop 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 msgr2=0x7f34300c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f342801a080 tx=0x7f342801ac90 comp rx=0 tx=0).stop 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 shutdown_connections 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f341c066340 0x7f341c068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34300c88d0 0x7f34300c8d50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:49.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3430159450 0x7f34300c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 --2- 172.21.15.82:0/607034484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34300afd50 0x7f34300c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 >> 172.21.15.82:0/607034484 conn(0x7f34300cad50 msgr2=0x7f3430155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 shutdown_connections 2023-07-20T10:02:49.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:49.994+0000 7f3436d00640 1 -- 172.21.15.82:0/607034484 wait complete. 2023-07-20T10:02:50.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:02:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 Processor -- start 2023-07-20T10:02:50.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 -- start start 2023-07-20T10:02:50.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e0160ba0 0x7f85e00c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85e00b0460 0x7f85e00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00c9370 con 0x7f85e00c8e60 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00c9650 con 0x7f85e00b0460 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e7ff3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01619c0 con 0x7f85e0160ba0 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85e00b0460 0x7f85e00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85e00b0460 0x7f85e00cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51958/0 (socket says 172.21.15.82:51958) 2023-07-20T10:02:50.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 -- 172.21.15.82:0/723369747 learned_addr learned my addr 172.21.15.82:0/723369747 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e5d8f640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e0160ba0 0x7f85e00c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 -- 172.21.15.82:0/723369747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e0160ba0 msgr2=0x7f85e00c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:50.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e0160ba0 0x7f85e00c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 -- 172.21.15.82:0/723369747 >> v1:172.21.15.183:6789/0 conn(0x7f85e00c8e60 legacy=0x7f85e00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.170+0000 7f85e6590640 1 -- 172.21.15.82:0/723369747 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0161300 con 0x7f85e00b0460 2023-07-20T10:02:50.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.174+0000 7f85e6590640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00b0460 0x7f85e00cbea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009e50 tx=0x7f85d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5896a80ab3c483a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:50.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e4d8d640 1 -- 172.21.15.82:0/723369747 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a58d0 con 0x7f85e00b0460 2023-07-20T10:02:50.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e4d8d640 1 -- 172.21.15.82:0/723369747 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80a5a30 con 0x7f85e00b0460 2023-07-20T10:02:50.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e4d8d640 1 -- 172.21.15.82:0/723369747 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80a5dc0 con 0x7f85e00b0460 2023-07-20T10:02:50.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 -- 172.21.15.82:0/723369747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00b0460 msgr2=0x7f85e00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00b0460 0x7f85e00cbea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009e50 tx=0x7f85d801c9e0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 -- 172.21.15.82:0/723369747 shutdown_connections 2023-07-20T10:02:50.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00b0460 0x7f85e00cbea0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/723369747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e0160ba0 0x7f85e00c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.178+0000 7f85e7ff3640 1 -- 172.21.15.82:0/723369747 >> 172.21.15.82:0/723369747 conn(0x7f85e00cad50 msgr2=0x7f85e00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:50.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.182+0000 7f85e7ff3640 1 -- 172.21.15.82:0/723369747 shutdown_connections 2023-07-20T10:02:50.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.182+0000 7f85e7ff3640 1 -- 172.21.15.82:0/723369747 wait complete. 2023-07-20T10:02:50.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.182+0000 7f85e7ff3640 1 Processor -- start 2023-07-20T10:02:50.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.186+0000 7f85e7ff3640 1 -- start start 2023-07-20T10:02:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 0x7f85e015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 0x7f85e015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 0x7f85e0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c74b0 con 0x7f85e0160ba0 2023-07-20T10:02:50.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e015ad90 con 0x7f85e00b0460 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00c8220 con 0x7f85e00c8e60 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e558e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 0x7f85e015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e5d8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 0x7f85e015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e5d8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 0x7f85e015b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:33490/0 (socket says 172.21.15.82:33490) 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e558e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 0x7f85e015b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:37604/0 (socket says 172.21.15.82:37604) 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e5d8f640 1 -- 172.21.15.82:0/15803599 learned_addr learned my addr 172.21.15.82:0/15803599 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:50.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 0x7f85e0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 -- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 msgr2=0x7f85e015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 0x7f85e015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 -- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 msgr2=0x7f85e015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 0x7f85e015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 -- 172.21.15.82:0/15803599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8009b30 con 0x7f85e0160ba0 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e6590640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 0x7f85e0150d40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ab000 tx=0x7f85d8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80b8880 con 0x7f85e0160ba0 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d80b89e0 con 0x7f85e0160ba0 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d80b8d90 con 0x7f85e0160ba0 2023-07-20T10:02:50.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00c76a0 con 0x7f85e0160ba0 2023-07-20T10:02:50.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.190+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00c7c60 con 0x7f85e0160ba0 2023-07-20T10:02:50.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.194+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8005260 con 0x7f85e0160ba0 2023-07-20T10:02:50.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.194+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85e00ccbf0 con 0x7f85e0160ba0 2023-07-20T10:02:50.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.194+0000 7f85d67fc640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 0x7f85c4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:50.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.194+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7100+0+0 (secure 0 0 0) 0x7f85d811edb0 con 0x7f85e0160ba0 2023-07-20T10:02:50.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.194+0000 7f85e5d8f640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 0x7f85c4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:50.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.198+0000 7f85e5d8f640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 0x7f85c4068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85e015aa90 tx=0x7f85dc008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:50.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.198+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85d80ebe50 con 0x7f85e0160ba0 2023-07-20T10:02:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.346+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85c8005510 con 0x7f85e0160ba0 2023-07-20T10:02:50.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.878+0000 7f85d67fc640 1 -- 172.21.15.82:0/15803599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7f85d80ef470 con 0x7f85e0160ba0 2023-07-20T10:02:50.868 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:02:50.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 msgr2=0x7f85c4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 0x7f85c4068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85e015aa90 tx=0x7f85dc008040 comp rx=0 tx=0).stop 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 msgr2=0x7f85e0150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 0x7f85e0150d40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ab000 tx=0x7f85d8019780 comp rx=0 tx=0).stop 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 shutdown_connections 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f85c40663a0 0x7f85c4068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e0160ba0 0x7f85e0150d40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00c8e60 0x7f85e015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 --2- 172.21.15.82:0/15803599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e00b0460 0x7f85e015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:50.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 >> 172.21.15.82:0/15803599 conn(0x7f85e00cad50 msgr2=0x7f85e006fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:50.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 shutdown_connections 2023-07-20T10:02:50.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:50.882+0000 7f85e7ff3640 1 -- 172.21.15.82:0/15803599 wait complete. 2023-07-20T10:02:50.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:02:51.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 Processor -- start 2023-07-20T10:02:51.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 -- start start 2023-07-20T10:02:51.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 0x7febe40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 0x7febe40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40cc8d0 con 0x7febe4159450 2023-07-20T10:02:51.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40cce90 con 0x7febe4159830 2023-07-20T10:02:51.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febeaa6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40ccbb0 con 0x7febe40cc3e0 2023-07-20T10:02:51.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe8809640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7febe4159450 0x7febe415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48776/0 (socket says 172.21.15.82:48776) 2023-07-20T10:02:51.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe8809640 1 -- 172.21.15.82:0/374247964 learned_addr learned my addr 172.21.15.82:0/374247964 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe900a640 1 --2- 172.21.15.82:0/374247964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 0x7febe40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe3fff640 1 --2- 172.21.15.82:0/374247964 >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 0x7febe40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925569391 0 0) 0x7febe40cc8d0 con 0x7febe4159450 2023-07-20T10:02:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003530 con 0x7febe4159450 2023-07-20T10:02:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790416475 0 0) 0x7febc4003530 con 0x7febe4159450 2023-07-20T10:02:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe900a640 1 -- 172.21.15.82:0/374247964 >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 msgr2=0x7febe40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe900a640 1 --2- 172.21.15.82:0/374247964 >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 0x7febe40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe900a640 1 -- 172.21.15.82:0/374247964 >> v1:172.21.15.82:6789/0 conn(0x7febe4159450 legacy=0x7febe415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe900a640 1 -- 172.21.15.82:0/374247964 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4159cc0 con 0x7febe40cc3e0 2023-07-20T10:02:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.054+0000 7febe3fff640 1 --2- 172.21.15.82:0/374247964 >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 0x7febe40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:51.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febe900a640 1 --2- 172.21.15.82:0/374247964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 0x7febe40afd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc01c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f3887fe1416bcb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4001680 con 0x7febe40cc3e0 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc0a5550 con 0x7febe40cc3e0 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febe37fe640 1 -- 172.21.15.82:0/374247964 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0a58e0 con 0x7febe40cc3e0 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 -- 172.21.15.82:0/374247964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 msgr2=0x7febe40afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 --2- 172.21.15.82:0/374247964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 0x7febe40afd50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7febdc009d90 tx=0x7febdc01c840 comp rx=0 tx=0).stop 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 -- 172.21.15.82:0/374247964 shutdown_connections 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 --2- 172.21.15.82:0/374247964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe40cc3e0 0x7febe40afd50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 --2- 172.21.15.82:0/374247964 >> v2:172.21.15.183:3300/0 conn(0x7febe4159830 0x7febe40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 -- 172.21.15.82:0/374247964 >> 172.21.15.82:0/374247964 conn(0x7febe40cad50 msgr2=0x7febe40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 -- 172.21.15.82:0/374247964 shutdown_connections 2023-07-20T10:02:51.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.058+0000 7febeaa6d640 1 -- 172.21.15.82:0/374247964 wait complete. 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 Processor -- start 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 -- start start 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febe40cc3e0 0x7febe41488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe4159450 0x7febe40c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4148e20 con 0x7febe41f8ed0 2023-07-20T10:02:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4147e90 con 0x7febe40cc3e0 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febeaa6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe41f9990 con 0x7febe4159450 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51974/0 (socket says 172.21.15.82:51974) 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 -- 172.21.15.82:0/198650456 learned_addr learned my addr 172.21.15.82:0/198650456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe8809640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febe40cc3e0 0x7febe41488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe3fff640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe4159450 0x7febe40c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 -- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe4159450 msgr2=0x7febe40c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe4159450 0x7febe40c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 -- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febe40cc3e0 msgr2=0x7febe41488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febe40cc3e0 0x7febe41488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 -- 172.21.15.82:0/198650456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009420 con 0x7febe41f8ed0 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.062+0000 7febe900a640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b0040 tx=0x7febdc0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0ad640 con 0x7febe41f8ed0 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc0ad7a0 con 0x7febe41f8ed0 2023-07-20T10:02:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc009a70 con 0x7febe41f8ed0 2023-07-20T10:02:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0adb90 con 0x7febe41f8ed0 2023-07-20T10:02:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe41480e0 con 0x7febe41f8ed0 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe404da30 con 0x7febe41f8ed0 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7febdc0b4050 con 0x7febe41f8ed0 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 0x7febc8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7febdc11edb0 con 0x7febe41f8ed0 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.066+0000 7febe8809640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 0x7febc8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.070+0000 7febe8809640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 0x7febc8068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febd4001190 tx=0x7febd4001120 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.070+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febdc123070 con 0x7febe41f8ed0 2023-07-20T10:02:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.218+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7febe40cbbf0 con 0x7febe41f8ed0 2023-07-20T10:02:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febe17fa640 1 -- 172.21.15.82:0/198650456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7febdc0b20b0 con 0x7febe41f8ed0 2023-07-20T10:02:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 msgr2=0x7febc8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 0x7febc8068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7febd4001190 tx=0x7febd4001120 comp rx=0 tx=0).stop 2023-07-20T10:02:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 msgr2=0x7febe41f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b0040 tx=0x7febdc0195e0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 shutdown_connections 2023-07-20T10:02:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7febc80663a0 0x7febc8068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febe41f8ed0 0x7febe41f9350 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febe4159450 0x7febe40c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 --2- 172.21.15.82:0/198650456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febe40cc3e0 0x7febe41488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 >> 172.21.15.82:0/198650456 conn(0x7febe40cad50 msgr2=0x7febe4155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 shutdown_connections 2023-07-20T10:02:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.226+0000 7febeaa6d640 1 -- 172.21.15.82:0/198650456 wait complete. 2023-07-20T10:02:51.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:02:51.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.386+0000 7fcd7f4cb640 1 Processor -- start 2023-07-20T10:02:51.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.386+0000 7fcd7f4cb640 1 -- start start 2023-07-20T10:02:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 0x7fcd78070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd7806b620 0x7fcd7806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd78071310 con 0x7fcd7806b620 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7806bff0 con 0x7fcd78070970 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7f4cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd780c95d0 con 0x7fcd78158ce0 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd7806b620 0x7fcd7806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcd7806b620 0x7fcd7806bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51982/0 (socket says 172.21.15.82:51982) 2023-07-20T10:02:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 -- 172.21.15.82:0/2465048707 learned_addr learned my addr 172.21.15.82:0/2465048707 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7d267640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 -- 172.21.15.82:0/2465048707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 msgr2=0x7fcd780c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7ca66640 1 --2- 172.21.15.82:0/2465048707 >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 0x7fcd78070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 -- 172.21.15.82:0/2465048707 >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 msgr2=0x7fcd78070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 --2- 172.21.15.82:0/2465048707 >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 0x7fcd78070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7da68640 1 -- 172.21.15.82:0/2465048707 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780c9fa0 con 0x7fcd7806b620 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7d267640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.390+0000 7fcd7ca66640 1 --2- 172.21.15.82:0/2465048707 >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 0x7fcd78070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:51.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7da68640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7806b620 0x7fcd7806bab0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcd7806a5d0 tx=0x7fcd7001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7df8c270b8d50c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd6ffff640 1 -- 172.21.15.82:0/2465048707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a57d0 con 0x7fcd7806b620 2023-07-20T10:02:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd6ffff640 1 -- 172.21.15.82:0/2465048707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700a5930 con 0x7fcd7806b620 2023-07-20T10:02:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd6ffff640 1 -- 172.21.15.82:0/2465048707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a5cc0 con 0x7fcd7806b620 2023-07-20T10:02:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/2465048707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7806b620 msgr2=0x7fcd7806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7806b620 0x7fcd7806bab0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcd7806a5d0 tx=0x7fcd7001c9d0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/2465048707 shutdown_connections 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/2465048707 >> v2:172.21.15.183:3300/0 conn(0x7fcd78070970 0x7fcd78070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd7806b620 0x7fcd7806bab0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/2465048707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/2465048707 >> 172.21.15.82:0/2465048707 conn(0x7fcd780cad50 msgr2=0x7fcd780cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/2465048707 shutdown_connections 2023-07-20T10:02:51.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/2465048707 wait complete. 2023-07-20T10:02:51.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 Processor -- start 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.394+0000 7fcd7f4cb640 1 -- start start 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7806b620 0x7fcd780b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd78159ce0 con 0x7fcd78070970 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd780b3ef0 con 0x7fcd7806b620 2023-07-20T10:02:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd78159f30 con 0x7fcd78158ce0 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51990/0 (socket says 172.21.15.82:51990) 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 -- 172.21.15.82:0/359760464 learned_addr learned my addr 172.21.15.82:0/359760464 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7da68640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7d267640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7806b620 0x7fcd780b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 -- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 msgr2=0x7fcd780c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 -- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7806b620 msgr2=0x7fcd780b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7806b620 0x7fcd780b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 -- 172.21.15.82:0/359760464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009b30 con 0x7fcd78070970 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7ca66640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800c7c0 tx=0x7fcd6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68007a30 con 0x7fcd78070970 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68007b90 con 0x7fcd78070970 2023-07-20T10:02:51.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800ce70 con 0x7fcd78070970 2023-07-20T10:02:51.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7815a210 con 0x7fcd78070970 2023-07-20T10:02:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7814be00 con 0x7fcd78070970 2023-07-20T10:02:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7804da30 con 0x7fcd78070970 2023-07-20T10:02:51.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.398+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcd680113f0 con 0x7fcd78070970 2023-07-20T10:02:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.402+0000 7fcd6dffb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 0x7fcd5c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.402+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7fcd68084200 con 0x7fcd78070970 2023-07-20T10:02:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.402+0000 7fcd7d267640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 0x7fcd5c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.402+0000 7fcd7d267640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 0x7fcd5c068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400ab60 tx=0x7fcd74008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.406+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd68051340 con 0x7fcd78070970 2023-07-20T10:02:51.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.554+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fcd780b4250 con 0x7fcd78070970 2023-07-20T10:02:51.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.558+0000 7fcd6dffb640 1 -- 172.21.15.82:0/359760464 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7fcd68054960 con 0x7fcd78070970 2023-07-20T10:02:51.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 msgr2=0x7fcd5c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 0x7fcd5c068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400ab60 tx=0x7fcd74008040 comp rx=0 tx=0).stop 2023-07-20T10:02:51.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 msgr2=0x7fcd7814c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcd6800c7c0 tx=0x7fcd6800cc80 comp rx=0 tx=0).stop 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 shutdown_connections 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd78158ce0 0x7fcd780c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fcd5c0663a0 0x7fcd5c068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd78070970 0x7fcd7814c6a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 --2- 172.21.15.82:0/359760464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd7806b620 0x7fcd780b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 >> 172.21.15.82:0/359760464 conn(0x7fcd780cad50 msgr2=0x7fcd780cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 shutdown_connections 2023-07-20T10:02:51.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.562+0000 7fcd7f4cb640 1 -- 172.21.15.82:0/359760464 wait complete. 2023-07-20T10:02:51.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:02:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 Processor -- start 2023-07-20T10:02:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 -- start start 2023-07-20T10:02:51.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7340ad580 0x7fb7340ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb734160820 0x7fb734160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb734160390 con 0x7fb7340afd50 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7341611f0 con 0x7fb734160820 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73c782640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340cc1d0 con 0x7fb7340ad580 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73ad1f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb734160820 0x7fb734160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73a51e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb7340afd50 0x7fb7340b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48780/0 (socket says 172.21.15.82:48780) 2023-07-20T10:02:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73a51e640 1 -- 172.21.15.82:0/444312634 learned_addr learned my addr 172.21.15.82:0/444312634 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73ad1f640 1 -- 172.21.15.82:0/444312634 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7340ad580 msgr2=0x7fb7340ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb739d1d640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7340ad580 0x7fb7340ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73ad1f640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7340ad580 0x7fb7340ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73ad1f640 1 -- 172.21.15.82:0/444312634 >> v1:172.21.15.82:6789/0 conn(0x7fb7340afd50 legacy=0x7fb7340b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73951c640 1 -- 172.21.15.82:0/444312634 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994055530 0 0) 0x7fb734160390 con 0x7fb7340afd50 2023-07-20T10:02:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.722+0000 7fb73ad1f640 1 -- 172.21.15.82:0/444312634 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7340cc4b0 con 0x7fb734160820 2023-07-20T10:02:51.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73ad1f640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734160820 0x7fb734160cb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b9377970eef38b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73951c640 1 -- 172.21.15.82:0/444312634 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0a5980 con 0x7fb734160820 2023-07-20T10:02:51.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73951c640 1 -- 172.21.15.82:0/444312634 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c0a5ae0 con 0x7fb734160820 2023-07-20T10:02:51.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73951c640 1 -- 172.21.15.82:0/444312634 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0a5e70 con 0x7fb734160820 2023-07-20T10:02:51.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 -- 172.21.15.82:0/444312634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734160820 msgr2=0x7fb734160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734160820 0x7fb734160cb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009d90 tx=0x7fb72c01c920 comp rx=0 tx=0).stop 2023-07-20T10:02:51.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 -- 172.21.15.82:0/444312634 shutdown_connections 2023-07-20T10:02:51.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb734160820 0x7fb734160cb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 --2- 172.21.15.82:0/444312634 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7340ad580 0x7fb7340ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 -- 172.21.15.82:0/444312634 >> 172.21.15.82:0/444312634 conn(0x7fb7340cad50 msgr2=0x7fb7340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 -- 172.21.15.82:0/444312634 shutdown_connections 2023-07-20T10:02:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.726+0000 7fb73c782640 1 -- 172.21.15.82:0/444312634 wait complete. 2023-07-20T10:02:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 Processor -- start 2023-07-20T10:02:51.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- start start 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 0x7fb7340c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb734160820 0x7fb734157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734156770 con 0x7fb7340ad580 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb734156fd0 con 0x7fb7340afd50 2023-07-20T10:02:51.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7340c4b10 con 0x7fb734160820 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52016/0 (socket says 172.21.15.82:52016) 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 -- 172.21.15.82:0/2557367978 learned_addr learned my addr 172.21.15.82:0/2557367978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73ad1f640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb734160820 0x7fb734157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb739d1d640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 0x7fb7340c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 -- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb734160820 msgr2=0x7fb734157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb734160820 0x7fb734157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 -- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 msgr2=0x7fb7340c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 0x7fb7340c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 -- 172.21.15.82:0/2557367978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009a70 con 0x7fb7340ad580 2023-07-20T10:02:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb739d1d640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 0x7fb7340c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73a51e640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7300011f0 tx=0x7fb73000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300074e0 con 0x7fb7340ad580 2023-07-20T10:02:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb730007640 con 0x7fb7340ad580 2023-07-20T10:02:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730004a10 con 0x7fb7340ad580 2023-07-20T10:02:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb734156980 con 0x7fb7340ad580 2023-07-20T10:02:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.730+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7340c4750 con 0x7fb7340ad580 2023-07-20T10:02:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73404da30 con 0x7fb7340ad580 2023-07-20T10:02:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb730004b70 con 0x7fb7340ad580 2023-07-20T10:02:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb72affd640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 0x7fb718068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7fb7300832a0 con 0x7fb7340ad580 2023-07-20T10:02:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb739d1d640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 0x7fb718068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.734+0000 7fb739d1d640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 0x7fb718068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb73415b800 tx=0x7fb724008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:51.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.738+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7300503c0 con 0x7fb7340ad580 2023-07-20T10:02:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.886+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb734156550 con 0x7fb7340ad580 2023-07-20T10:02:51.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.894+0000 7fb72affd640 1 -- 172.21.15.82:0/2557367978 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb7300539e0 con 0x7fb7340ad580 2023-07-20T10:02:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 msgr2=0x7fb718068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 0x7fb718068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb73415b800 tx=0x7fb724008040 comp rx=0 tx=0).stop 2023-07-20T10:02:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 msgr2=0x7fb7341548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb7300011f0 tx=0x7fb73000c9b0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 shutdown_connections 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb734160820 0x7fb734157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7340afd50 0x7fb7340c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fb7180663d0 0x7fb718068890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 --2- 172.21.15.82:0/2557367978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7340ad580 0x7fb7341548c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 >> 172.21.15.82:0/2557367978 conn(0x7fb7340cad50 msgr2=0x7fb7340af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 shutdown_connections 2023-07-20T10:02:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:51.898+0000 7fb73c782640 1 -- 172.21.15.82:0/2557367978 wait complete. 2023-07-20T10:02:51.905 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-20T10:02:52.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 Processor -- start 2023-07-20T10:02:52.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 -- start start 2023-07-20T10:02:52.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9e0815c5f0 0x7f9e080b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e080ceb70 0x7f9e080b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080b7c20 con 0x7f9e080ccfb0 2023-07-20T10:02:52.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0815c9d0 con 0x7f9e080ceb70 2023-07-20T10:02:52.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0c869640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080ce030 con 0x7f9e0815c5f0 2023-07-20T10:02:52.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e080ccfb0 0x7f9e080ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48792/0 (socket says 172.21.15.82:48792) 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0659c640 1 -- 172.21.15.82:0/3756016203 learned_addr learned my addr 172.21.15.82:0/3756016203 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0759e640 1 --2- 172.21.15.82:0/3756016203 >> v2:172.21.15.82:3300/0 conn(0x7f9e080ceb70 0x7f9e080b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/3756016203 >> v2:172.21.15.183:3300/0 conn(0x7f9e0815c5f0 0x7f9e080b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0759e640 1 -- 172.21.15.82:0/3756016203 >> v2:172.21.15.183:3300/0 conn(0x7f9e0815c5f0 msgr2=0x7f9e080b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0759e640 1 --2- 172.21.15.82:0/3756016203 >> v2:172.21.15.183:3300/0 conn(0x7f9e0815c5f0 0x7f9e080b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0759e640 1 -- 172.21.15.82:0/3756016203 >> v1:172.21.15.82:6789/0 conn(0x7f9e080ccfb0 legacy=0x7f9e080ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e0759e640 1 -- 172.21.15.82:0/3756016203 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080cd4b0 con 0x7f9e080ceb70 2023-07-20T10:02:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.062+0000 7f9e05d9b640 1 -- 172.21.15.82:0/3756016203 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695897760 0 0) 0x7f9e080b7c20 con 0x7f9e080ccfb0 2023-07-20T10:02:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0759e640 1 --2- 172.21.15.82:0/3756016203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080ceb70 0x7f9e080b0f70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9e080d2470 tx=0x7f9e0001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1b8ff764a5a054 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e05d9b640 1 -- 172.21.15.82:0/3756016203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b0440 con 0x7f9e080ceb70 2023-07-20T10:02:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e05d9b640 1 -- 172.21.15.82:0/3756016203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000b05a0 con 0x7f9e080ceb70 2023-07-20T10:02:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e05d9b640 1 -- 172.21.15.82:0/3756016203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b0930 con 0x7f9e080ceb70 2023-07-20T10:02:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 -- 172.21.15.82:0/3756016203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080ceb70 msgr2=0x7f9e080b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 --2- 172.21.15.82:0/3756016203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080ceb70 0x7f9e080b0f70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9e080d2470 tx=0x7f9e0001f0f0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 -- 172.21.15.82:0/3756016203 shutdown_connections 2023-07-20T10:02:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 --2- 172.21.15.82:0/3756016203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080ceb70 0x7f9e080b0f70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 --2- 172.21.15.82:0/3756016203 >> v2:172.21.15.183:3300/0 conn(0x7f9e0815c5f0 0x7f9e080b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 -- 172.21.15.82:0/3756016203 >> 172.21.15.82:0/3756016203 conn(0x7f9e08065710 msgr2=0x7f9e08065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:52.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 -- 172.21.15.82:0/3756016203 shutdown_connections 2023-07-20T10:02:52.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.066+0000 7f9e0c869640 1 -- 172.21.15.82:0/3756016203 wait complete. 2023-07-20T10:02:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 Processor -- start 2023-07-20T10:02:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- start start 2023-07-20T10:02:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 0x7f9e080c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e080ceb70 0x7f9e08156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08154f40 con 0x7f9e0815c5f0 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e081540b0 con 0x7f9e080ceb70 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e081542c0 con 0x7f9e080ccfb0 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52028/0 (socket says 172.21.15.82:52028) 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 -- 172.21.15.82:0/4232184240 learned_addr learned my addr 172.21.15.82:0/4232184240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0659c640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e080ceb70 0x7f9e08156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 0x7f9e080c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 -- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 msgr2=0x7f9e080c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 0x7f9e080c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 -- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e080ceb70 msgr2=0x7f9e08156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e080ceb70 0x7f9e08156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 -- 172.21.15.82:0/4232184240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009a70 con 0x7f9e0815c5f0 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 0x7f9e080c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0759e640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b3040 tx=0x7f9e0001be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b0440 con 0x7f9e0815c5f0 2023-07-20T10:02:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000bc860 con 0x7f9e0815c5f0 2023-07-20T10:02:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000bcc50 con 0x7f9e0815c5f0 2023-07-20T10:02:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e081545a0 con 0x7f9e0815c5f0 2023-07-20T10:02:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.070+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e08154b60 con 0x7f9e0815c5f0 2023-07-20T10:02:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08155080 con 0x7f9e0815c5f0 2023-07-20T10:02:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e000c7460 con 0x7f9e0815c5f0 2023-07-20T10:02:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9def7fe640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 0x7f9df4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f9e00122d70 con 0x7f9e0815c5f0 2023-07-20T10:02:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 0x7f9df4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.074+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 0x7f9df4068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b9f0 tx=0x7f9df8008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.078+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e08155080 con 0x7f9e0815c5f0 2023-07-20T10:02:52.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:52.282+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f9e08155080 con 0x7f9e0815c5f0 2023-07-20T10:02:52.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9def7fe640 1 -- 172.21.15.82:0/4232184240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v451) v1 ==== 158+0+0 (secure 0 0 0) 0x7f9e08155080 con 0x7f9e0815c5f0 2023-07-20T10:02:53.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 msgr2=0x7f9df4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 0x7f9df4068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9df800b9f0 tx=0x7f9df8008040 comp rx=0 tx=0).stop 2023-07-20T10:02:53.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 msgr2=0x7f9e081f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9e000b3040 tx=0x7f9e0001be90 comp rx=0 tx=0).stop 2023-07-20T10:02:53.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 shutdown_connections 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f9df40663a0 0x7f9df4068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0815c5f0 0x7f9e081f4de0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e080ceb70 0x7f9e08156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 --2- 172.21.15.82:0/4232184240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080ccfb0 0x7f9e080c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 >> 172.21.15.82:0/4232184240 conn(0x7f9e08065710 msgr2=0x7f9e080ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 shutdown_connections 2023-07-20T10:02:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.010+0000 7f9e0c869640 1 -- 172.21.15.82:0/4232184240 wait complete. 2023-07-20T10:02:53.021 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-07-20T10:02:53.021 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-07-20T10:02:53.021 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:02:53.022 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-20T10:02:53.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 Processor -- start 2023-07-20T10:02:53.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 -- start start 2023-07-20T10:02:53.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c700d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700b3520 con 0x7f0c700d0d10 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700cff30 con 0x7f0c700ce4c0 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c757c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700d31c0 con 0x7f0c7015cab0 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c667fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0c700d0d10 0x7f0c700cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48804/0 (socket says 172.21.15.82:48804) 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c667fc640 1 -- 172.21.15.82:0/168593956 learned_addr learned my addr 172.21.15.82:0/168593956 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6effd640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c700d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128953905 0 0) 0x7f0c700b3520 con 0x7f0c700d0d10 2023-07-20T10:02:53.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c003530 con 0x7f0c700d0d10 2023-07-20T10:02:53.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1309765810 0 0) 0x7f0c5c003530 con 0x7f0c700d0d10 2023-07-20T10:02:53.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 msgr2=0x7f0c700d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:53.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c700d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 >> v1:172.21.15.183:6789/0 conn(0x7f0c700ce4c0 legacy=0x7f0c700cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700b2910 con 0x7f0c700d0d10 2023-07-20T10:02:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f0c60001680 con 0x7f0c700d0d10 2023-07-20T10:02:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 >> v1:172.21.15.82:6789/0 conn(0x7f0c700d0d10 legacy=0x7f0c700cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c5c004360 0x7f0c5c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c5c005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00b990 con 0x7f0c5c0039b0 2023-07-20T10:02:53.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00bad0 con 0x7f0c5c004360 2023-07-20T10:02:53.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c00bc90 con 0x7f0c7015cab0 2023-07-20T10:02:53.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.174+0000 7f0c6effd640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6f7fe640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c5c005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c667fc640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c5c004360 0x7f0c5c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 -- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 msgr2=0x7f0c5c005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:53.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015cab0 0x7f0c5c005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 -- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c5c004360 msgr2=0x7f0c5c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:53.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c5c004360 0x7f0c5c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 -- 172.21.15.82:0/168593956 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c003530 con 0x7f0c5c0039b0 2023-07-20T10:02:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6effd640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003d90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ae0 tx=0x7f0c5801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09a5db30a9577ad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580a5640 con 0x7f0c5c0039b0 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580a57a0 con 0x7f0c5c0039b0 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6e7fc640 1 -- 172.21.15.82:0/168593956 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580a5b50 con 0x7f0c5c0039b0 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 -- 172.21.15.82:0/168593956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 msgr2=0x7f0c5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 --2- 172.21.15.82:0/168593956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c5c003d90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009ae0 tx=0x7f0c5801ca50 comp rx=0 tx=0).stop 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c6f7fe640 1 -- 172.21.15.82:0/168593956 reap_dead start 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 -- 172.21.15.82:0/168593956 shutdown_connections 2023-07-20T10:02:53.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 -- 172.21.15.82:0/168593956 >> 172.21.15.82:0/168593956 conn(0x7f0c7008c120 msgr2=0x7f0c7009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 -- 172.21.15.82:0/168593956 shutdown_connections 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.178+0000 7f0c757c5640 1 -- 172.21.15.82:0/168593956 wait complete. 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 Processor -- start 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 -- start start 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015fbb0 0x7f0c7015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c7015eba0 0x7f0c7015f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c6610 con 0x7f0c5c0039b0 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c68f0 con 0x7f0c7015eba0 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c757c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c6bd0 con 0x7f0c7015fbb0 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52044/0 (socket says 172.21.15.82:52044) 2023-07-20T10:02:53.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 -- 172.21.15.82:0/3624758986 learned_addr learned my addr 172.21.15.82:0/3624758986 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c667fc640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015fbb0 0x7f0c7015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6f7fe640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c7015eba0 0x7f0c7015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 -- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015fbb0 msgr2=0x7f0c7015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015fbb0 0x7f0c7015cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 -- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c7015eba0 msgr2=0x7f0c7015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c7015eba0 0x7f0c7015f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 -- 172.21.15.82:0/3624758986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700c6eb0 con 0x7f0c5c0039b0 2023-07-20T10:02:53.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.182+0000 7f0c6effd640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b0040 tx=0x7f0c5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:53.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004220 con 0x7f0c5c0039b0 2023-07-20T10:02:53.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58004380 con 0x7f0c5c0039b0 2023-07-20T10:02:53.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c700c7190 con 0x7f0c5c0039b0 2023-07-20T10:02:53.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ad890 con 0x7f0c5c0039b0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c701e6980 con 0x7f0c5c0039b0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c70073c70 con 0x7f0c5c0039b0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c580b4040 con 0x7f0c5c0039b0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 0x7f0c50068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f0c5811e650 con 0x7f0c5c0039b0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.186+0000 7f0c667fc640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 0x7f0c50068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:53.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.190+0000 7f0c667fc640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 0x7f0c50068890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0c600017b0 tx=0x7f0c60007040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:53.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.190+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c580eb770 con 0x7f0c5c0039b0 2023-07-20T10:02:53.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:53.390+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f0c700b2ea0 con 0x7f0c5c0039b0 2023-07-20T10:02:54.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.014+0000 7f0c67fff640 1 -- 172.21.15.82:0/3624758986 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v452) v1 ==== 157+0+0 (secure 0 0 0) 0x7f0c580044f0 con 0x7f0c5c0039b0 2023-07-20T10:02:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 msgr2=0x7f0c50068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 0x7f0c50068890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0c600017b0 tx=0x7f0c60007040 comp rx=0 tx=0).stop 2023-07-20T10:02:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 msgr2=0x7f0c701e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b0040 tx=0x7f0c5c005800 comp rx=0 tx=0).stop 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 shutdown_connections 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c7015eba0 0x7f0c7015f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c7015fbb0 0x7f0c7015cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f0c500663d0 0x7f0c50068890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 --2- 172.21.15.82:0/3624758986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c5c0039b0 0x7f0c701e6440 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 >> 172.21.15.82:0/3624758986 conn(0x7f0c7008c120 msgr2=0x7f0c700d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 shutdown_connections 2023-07-20T10:02:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.018+0000 7f0c757c5640 1 -- 172.21.15.82:0/3624758986 wait complete. 2023-07-20T10:02:54.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:54.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 Processor -- start 2023-07-20T10:02:54.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 -- start start 2023-07-20T10:02:54.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69500afda0 0x7f69500ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500b12a0 con 0x7f695015a8e0 2023-07-20T10:02:54.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500b1580 con 0x7f69500b2060 2023-07-20T10:02:54.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f6955861640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69500b3160 con 0x7f69500afda0 2023-07-20T10:02:54.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f69467fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f695015a8e0 0x7f69500b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53952/0 (socket says 172.21.15.82:53952) 2023-07-20T10:02:54.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f694effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69500afda0 0x7f69500ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f69467fc640 1 -- 172.21.15.82:0/2859271474 learned_addr learned my addr 172.21.15.82:0/2859271474 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:54.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f694effd640 1 -- 172.21.15.82:0/2859271474 >> v1:172.21.15.183:6789/0 conn(0x7f69500b2060 legacy=0x7f69500b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:54.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f694effd640 1 -- 172.21.15.82:0/2859271474 >> v1:172.21.15.82:6789/0 conn(0x7f695015a8e0 legacy=0x7f69500b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f694effd640 1 -- 172.21.15.82:0/2859271474 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500b1860 con 0x7f69500afda0 2023-07-20T10:02:54.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.182+0000 7f694e7fc640 1 -- 172.21.15.82:0/2859271474 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761938505 0 0) 0x7f69500b12a0 con 0x7f695015a8e0 2023-07-20T10:02:54.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f694effd640 1 --2- 172.21.15.82:0/2859271474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500afda0 0x7f69500ca6b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69400097c0 tx=0x7f694001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a754e6fad27c99 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f694e7fc640 1 -- 172.21.15.82:0/2859271474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400ab600 con 0x7f69500afda0 2023-07-20T10:02:54.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f694e7fc640 1 -- 172.21.15.82:0/2859271474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69400a7050 con 0x7f69500afda0 2023-07-20T10:02:54.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f694e7fc640 1 -- 172.21.15.82:0/2859271474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400ab980 con 0x7f69500afda0 2023-07-20T10:02:54.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 -- 172.21.15.82:0/2859271474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500afda0 msgr2=0x7f69500ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 --2- 172.21.15.82:0/2859271474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500afda0 0x7f69500ca6b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69400097c0 tx=0x7f694001c2f0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 -- 172.21.15.82:0/2859271474 shutdown_connections 2023-07-20T10:02:54.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 --2- 172.21.15.82:0/2859271474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500afda0 0x7f69500ca6b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 -- 172.21.15.82:0/2859271474 >> 172.21.15.82:0/2859271474 conn(0x7f69500cada0 msgr2=0x7f69500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 -- 172.21.15.82:0/2859271474 shutdown_connections 2023-07-20T10:02:54.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.186+0000 7f6955861640 1 -- 172.21.15.82:0/2859271474 wait complete. 2023-07-20T10:02:54.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 Processor -- start 2023-07-20T10:02:54.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- start start 2023-07-20T10:02:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69500afda0 0x7f695015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 0x7f695015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500ab900 con 0x7f69500b2060 2023-07-20T10:02:54.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695015db70 con 0x7f695015a8e0 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695015d2d0 con 0x7f69500afda0 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41112/0 (socket says 172.21.15.82:41112) 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 -- 172.21.15.82:0/2240209915 learned_addr learned my addr 172.21.15.82:0/2240209915 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 -- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69500afda0 msgr2=0x7f695015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69500afda0 0x7f695015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f694f7fe640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 0x7f695015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 -- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 msgr2=0x7f695015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 0x7f695015ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 -- 172.21.15.82:0/2240209915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940009420 con 0x7f69500b2060 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f694f7fe640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 0x7f695015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f69467fc640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f693800c480 tx=0x7f693800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380074e0 con 0x7f69500b2060 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6938007640 con 0x7f69500b2060 2023-07-20T10:02:54.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695015d5b0 con 0x7f69500b2060 2023-07-20T10:02:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380049f0 con 0x7f69500b2060 2023-07-20T10:02:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.190+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500c7f10 con 0x7f69500b2060 2023-07-20T10:02:54.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6950073c70 con 0x7f69500b2060 2023-07-20T10:02:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6938004b50 con 0x7f69500b2060 2023-07-20T10:02:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f694cff9640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 0x7f6934068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f6938083360 con 0x7f69500b2060 2023-07-20T10:02:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f694effd640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 0x7f6934068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.194+0000 7f694effd640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 0x7f6934068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69400ad000 tx=0x7f6940004740 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.198+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6938053ef0 con 0x7f69500b2060 2023-07-20T10:02:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.350+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69500cb990 con 0x7f69500b2060 2023-07-20T10:02:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.350+0000 7f694cff9640 1 -- 172.21.15.82:0/2240209915 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16762 (secure 0 0 0) 0x7f6938018090 con 0x7f69500b2060 2023-07-20T10:02:54.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:54.339 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":56,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:50.871692+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/848832508":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6833/3054777588":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6837/1206692867":"2023-07-21T10:02:47.702391+0000","172.21.15.82:6832/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:6833/2623212404":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/2172384118":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3113011850":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/3996830125":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/1031146939":"2023-07-21T09:51:35.501102+0000","172.21.15.82:0/4080479193":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/33451035":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/909240107":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/1087456933":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/3543495401":"2023-07-21T10:02:44.925940+0000","172.21.15.82:0/2511013614":"2023-07-21T10:02:44.925940+0000","172.21.15.82:6836/1206692867":"2023-07-21T10:02:47.702391+0000","172.21.15.82:6832/3054777588":"2023-07-21T10:02:44.925940+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":177,"length":45}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 msgr2=0x7f6934068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 0x7f6934068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69400ad000 tx=0x7f6940004740 comp rx=0 tx=0).stop 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 msgr2=0x7f69501486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f693800c480 tx=0x7f693800c940 comp rx=0 tx=0).stop 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 shutdown_connections 2023-07-20T10:02:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f695015a8e0 0x7f695015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f69340663a0 0x7f6934068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69500b2060 0x7f69501486a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 --2- 172.21.15.82:0/2240209915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69500afda0 0x7f695015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 >> 172.21.15.82:0/2240209915 conn(0x7f69500cada0 msgr2=0x7f6950072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 shutdown_connections 2023-07-20T10:02:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.354+0000 7f6955861640 1 -- 172.21.15.82:0/2240209915 wait complete. 2023-07-20T10:02:54.360 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:02:54.361 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:02:54.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 Processor -- start 2023-07-20T10:02:54.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 -- start start 2023-07-20T10:02:54.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5418159450 0x7f541815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 0x7f54180b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180b06b0 con 0x7f5418159830 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54180cce90 con 0x7f5418159450 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541e38f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180cc8d0 con 0x7f54180afd50 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5418159450 0x7f541815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f54177fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5418159830 0x7f54180cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53960/0 (socket says 172.21.15.82:53960) 2023-07-20T10:02:54.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5418159450 0x7f541815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41126/0 (socket says 172.21.15.82:41126) 2023-07-20T10:02:54.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f54177fe640 1 -- 172.21.15.82:0/3698568579 learned_addr learned my addr 172.21.15.82:0/3698568579 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:54.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541c92c640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 0x7f54180b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 -- 172.21.15.82:0/3698568579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 msgr2=0x7f54180b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:54.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 0x7f54180b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 -- 172.21.15.82:0/3698568579 >> v1:172.21.15.82:6789/0 conn(0x7f5418159830 legacy=0x7f54180cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5417fff640 1 -- 172.21.15.82:0/3698568579 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180ccbb0 con 0x7f5418159450 2023-07-20T10:02:54.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f541c92c640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 0x7f54180b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:54.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.514+0000 7f5416ffd640 1 -- 172.21.15.82:0/3698568579 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260347603 0 0) 0x7f54180b06b0 con 0x7f5418159830 2023-07-20T10:02:54.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f5417fff640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5418159450 0x7f541815a4c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f54080097c0 tx=0x7f540801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9910d3dddb75975 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f5416ffd640 1 -- 172.21.15.82:0/3698568579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080ab650 con 0x7f5418159450 2023-07-20T10:02:54.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f5416ffd640 1 -- 172.21.15.82:0/3698568579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080ab7b0 con 0x7f5418159450 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f5416ffd640 1 -- 172.21.15.82:0/3698568579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080abb40 con 0x7f5418159450 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 -- 172.21.15.82:0/3698568579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5418159450 msgr2=0x7f541815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5418159450 0x7f541815a4c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f54080097c0 tx=0x7f540801c450 comp rx=0 tx=0).stop 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 -- 172.21.15.82:0/3698568579 shutdown_connections 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54180afd50 0x7f54180b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 --2- 172.21.15.82:0/3698568579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5418159450 0x7f541815a4c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 -- 172.21.15.82:0/3698568579 >> 172.21.15.82:0/3698568579 conn(0x7f54180cad50 msgr2=0x7f54180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 -- 172.21.15.82:0/3698568579 shutdown_connections 2023-07-20T10:02:54.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.518+0000 7f541e38f640 1 -- 172.21.15.82:0/3698568579 wait complete. 2023-07-20T10:02:54.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 Processor -- start 2023-07-20T10:02:54.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- start start 2023-07-20T10:02:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 0x7f5418154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 0x7f54180ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418157c20 con 0x7f54180afd50 2023-07-20T10:02:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180c4a70 con 0x7f5418159450 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54180c3e60 con 0x7f5418154550 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41130/0 (socket says 172.21.15.82:41130) 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 -- 172.21.15.82:0/1516200883 learned_addr learned my addr 172.21.15.82:0/1516200883 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f54177fe640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 0x7f5418154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541c92c640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 0x7f54180ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 -- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 msgr2=0x7f54180ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 0x7f54180ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 -- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 msgr2=0x7f5418154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 0x7f5418154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 -- 172.21.15.82:0/1516200883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009420 con 0x7f54180afd50 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541c92c640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 0x7f54180ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f54177fe640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 0x7f5418154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:54.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5417fff640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54080097c0 tx=0x7f540801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408004220 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080b9070 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080ab610 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54180c4140 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54180c4700 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.522+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541804da30 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.526+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f54080b4610 con 0x7f54180afd50 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.526+0000 7f5414ff9640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 0x7f5404068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.526+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f54080bb070 con 0x7f54180afd50 2023-07-20T10:02:54.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.526+0000 7f54177fe640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 0x7f5404068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.526+0000 7f54177fe640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 0x7f5404068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54181f80c0 tx=0x7f540c007cb0 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.530+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54080ebe60 con 0x7f54180afd50 2023-07-20T10:02:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54180cbbf0 con 0x7f54180afd50 2023-07-20T10:02:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f5414ff9640 1 -- 172.21.15.82:0/1516200883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54080c4020 con 0x7f54180afd50 2023-07-20T10:02:54.667 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:02:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 msgr2=0x7f5404068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 0x7f5404068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f54181f80c0 tx=0x7f540c007cb0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 msgr2=0x7f541814e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f54080097c0 tx=0x7f540801ac90 comp rx=0 tx=0).stop 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 shutdown_connections 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5418154550 0x7f54180ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5418159450 0x7f5418154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f54040663a0 0x7f5404068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 --2- 172.21.15.82:0/1516200883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54180afd50 0x7f541814e3a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.678+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 >> 172.21.15.82:0/1516200883 conn(0x7f54180cad50 msgr2=0x7f5418071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.682+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 shutdown_connections 2023-07-20T10:02:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.682+0000 7f541e38f640 1 -- 172.21.15.82:0/1516200883 wait complete. 2023-07-20T10:02:54.687 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:02:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 Processor -- start 2023-07-20T10:02:54.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 -- start start 2023-07-20T10:02:54.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f888c15a6f0 0x7f888c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c071950 con 0x7f888c06f710 2023-07-20T10:02:54.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c15b230 con 0x7f888c0ca5a0 2023-07-20T10:02:54.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8893af9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c15bad0 con 0x7f888c15a6f0 2023-07-20T10:02:54.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f888c06f710 0x7f888c06faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53962/0 (socket says 172.21.15.82:53962) 2023-07-20T10:02:54.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 -- 172.21.15.82:0/1969777608 learned_addr learned my addr 172.21.15.82:0/1969777608 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8892096640 1 --2- 172.21.15.82:0/1969777608 >> v2:172.21.15.183:3300/0 conn(0x7f888c15a6f0 0x7f888c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440252188 0 0) 0x7f888c071950 con 0x7f888c06f710 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8878003530 con 0x7f888c06f710 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3737103533 0 0) 0x7f8878003530 con 0x7f888c06f710 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 >> v2:172.21.15.183:3300/0 conn(0x7f888c15a6f0 msgr2=0x7f888c15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 --2- 172.21.15.82:0/1969777608 >> v2:172.21.15.183:3300/0 conn(0x7f888c15a6f0 0x7f888c15ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 >> v1:172.21.15.183:6789/0 conn(0x7f888c0ca5a0 legacy=0x7f888c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c15b510 con 0x7f888c06f710 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f8888001a00 con 0x7f888c06f710 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 >> v1:172.21.15.82:6789/0 conn(0x7f888c06f710 legacy=0x7f888c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 0x7f8878003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88780051e0 0x7f887800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c15bad0 con 0x7f8878003a40 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887800c110 con 0x7f88780047d0 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887800c2d0 con 0x7f88780051e0 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 0x7f8878003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891094640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8892096640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88780051e0 0x7f887800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 -- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88780051e0 msgr2=0x7f887800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88780051e0 0x7f887800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 -- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88780047d0 msgr2=0x7f8878004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891895640 1 -- 172.21.15.82:0/1969777608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878003530 con 0x7f8878003a40 2023-07-20T10:02:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8891094640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88780047d0 0x7f8878004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.842+0000 7f8892096640 1 -- 172.21.15.82:0/1969777608 reap_dead start 2023-07-20T10:02:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8891895640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 0x7f8878003e60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f888800a760 tx=0x7f888801d1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac6ab228702dbd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880ad630 con 0x7f8878003a40 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88880a8070 con 0x7f8878003a40 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8890893640 1 -- 172.21.15.82:0/1969777608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880ada50 con 0x7f8878003a40 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 -- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 msgr2=0x7f8878003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 0x7f8878003e60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f888800a760 tx=0x7f888801d1b0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 -- 172.21.15.82:0/1969777608 shutdown_connections 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 --2- 172.21.15.82:0/1969777608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8878003a40 0x7f8878003e60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 -- 172.21.15.82:0/1969777608 >> 172.21.15.82:0/1969777608 conn(0x7f888c0cad50 msgr2=0x7f888c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 -- 172.21.15.82:0/1969777608 shutdown_connections 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.846+0000 7f8893af9640 1 -- 172.21.15.82:0/1969777608 wait complete. 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 Processor -- start 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- start start 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 0x7f888c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 0x7f888c1f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c84a0 con 0x7f888c0abf00 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0ac8c0 con 0x7f8878003a40 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0c8010 con 0x7f888c0c6e90 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41136/0 (socket says 172.21.15.82:41136) 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 -- 172.21.15.82:0/3461249570 learned_addr learned my addr 172.21.15.82:0/3461249570 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8891895640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 0x7f888c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8891094640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 0x7f888c1f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 -- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 msgr2=0x7f888c1f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 0x7f888c1f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 -- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 msgr2=0x7f888c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 0x7f888c0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 -- 172.21.15.82:0/3461249570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0c7400 con 0x7f888c0abf00 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8891094640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 0x7f888c1f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8891895640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 0x7f888c0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8892096640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ce0d0 tx=0x7f8884011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884004500 con 0x7f888c0abf00 2023-07-20T10:02:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884003620 con 0x7f888c0abf00 2023-07-20T10:02:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88840039d0 con 0x7f888c0abf00 2023-07-20T10:02:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c0c76e0 con 0x7f888c0abf00 2023-07-20T10:02:54.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.850+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c0c7ca0 con 0x7f888c0abf00 2023-07-20T10:02:54.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c0c81a0 con 0x7f888c0abf00 2023-07-20T10:02:54.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8884003b30 con 0x7f888c0abf00 2023-07-20T10:02:54.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f88827fc640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 0x7f8870068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:54.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f8884084620 con 0x7f888c0abf00 2023-07-20T10:02:54.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f8891895640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 0x7f8870068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:54.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.854+0000 7f8891895640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 0x7f8870068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88880ad000 tx=0x7f88880a7000 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:54.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:54.858+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8884051690 con 0x7f888c0abf00 2023-07-20T10:02:54.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.010+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f888c04da30 con 0x7f888c0abf00 2023-07-20T10:02:54.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.010+0000 7f88827fc640 1 -- 172.21.15.82:0/3461249570 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8884054cb0 con 0x7f888c0abf00 2023-07-20T10:02:54.999 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:02:55.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 msgr2=0x7f8870068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 0x7f8870068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f88880ad000 tx=0x7f88880a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:55.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 msgr2=0x7f888c0ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f888c0ce0d0 tx=0x7f8884011920 comp rx=0 tx=0).stop 2023-07-20T10:02:55.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 shutdown_connections 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f88700663a0 0x7f8870068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f888c0abf00 0x7f888c0ac380 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f888c0c6e90 0x7f888c1f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 --2- 172.21.15.82:0/3461249570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8878003a40 0x7f888c0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 >> 172.21.15.82:0/3461249570 conn(0x7f888c0cad50 msgr2=0x7f888c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 shutdown_connections 2023-07-20T10:02:55.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.014+0000 7f8893af9640 1 -- 172.21.15.82:0/3461249570 wait complete. 2023-07-20T10:02:55.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:02:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.174+0000 7f8948fdb640 1 Processor -- start 2023-07-20T10:02:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.174+0000 7f8948fdb640 1 -- start start 2023-07-20T10:02:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8948fdb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8944158ce0 0x7f89440c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8948fdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f894406bd30 0x7f8944070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8948fdb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440c95d0 con 0x7f8944070970 2023-07-20T10:02:55.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8948fdb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440c9fa0 con 0x7f8944158ce0 2023-07-20T10:02:55.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8948fdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89441590c0 con 0x7f894406bd30 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8944158ce0 0x7f89440c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8944158ce0 0x7f89440c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41144/0 (socket says 172.21.15.82:41144) 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 -- 172.21.15.82:0/3780764138 learned_addr learned my addr 172.21.15.82:0/3780764138 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f8942d9d640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f894406bd30 0x7f8944070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 -- 172.21.15.82:0/3780764138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f894406bd30 msgr2=0x7f8944070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:55.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f894406bd30 0x7f8944070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 -- 172.21.15.82:0/3780764138 >> v1:172.21.15.183:6789/0 conn(0x7f8944070970 legacy=0x7f894406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.178+0000 7f894259c640 1 -- 172.21.15.82:0/3780764138 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89440c89c0 con 0x7f8944158ce0 2023-07-20T10:02:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f894259c640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944158ce0 0x7f89440c9a60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893401d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50654c1393375133 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8941d9b640 1 -- 172.21.15.82:0/3780764138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340a76a0 con 0x7f8944158ce0 2023-07-20T10:02:55.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8941d9b640 1 -- 172.21.15.82:0/3780764138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89340a7800 con 0x7f8944158ce0 2023-07-20T10:02:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8941d9b640 1 -- 172.21.15.82:0/3780764138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89340a7b90 con 0x7f8944158ce0 2023-07-20T10:02:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- 172.21.15.82:0/3780764138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944158ce0 msgr2=0x7f89440c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944158ce0 0x7f89440c9a60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8934009870 tx=0x7f893401d770 comp rx=0 tx=0).stop 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- 172.21.15.82:0/3780764138 shutdown_connections 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f894406bd30 0x7f8944070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 --2- 172.21.15.82:0/3780764138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944158ce0 0x7f89440c9a60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- 172.21.15.82:0/3780764138 >> 172.21.15.82:0/3780764138 conn(0x7f89440cad50 msgr2=0x7f89440cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- 172.21.15.82:0/3780764138 shutdown_connections 2023-07-20T10:02:55.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- 172.21.15.82:0/3780764138 wait complete. 2023-07-20T10:02:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 Processor -- start 2023-07-20T10:02:55.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.182+0000 7f8948fdb640 1 -- start start 2023-07-20T10:02:55.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894406bd30 0x7f89441537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8944158ce0 0x7f89440b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440b3cd0 con 0x7f8944070970 2023-07-20T10:02:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89440acbf0 con 0x7f894406bd30 2023-07-20T10:02:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89440aced0 con 0x7f8944158ce0 2023-07-20T10:02:55.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41154/0 (socket says 172.21.15.82:41154) 2023-07-20T10:02:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f894259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894406bd30 0x7f89441537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 -- 172.21.15.82:0/2369286789 learned_addr learned my addr 172.21.15.82:0/2369286789 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:55.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8942d9d640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8944158ce0 0x7f89440b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 -- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8944158ce0 msgr2=0x7f89440b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8944158ce0 0x7f89440b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 -- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894406bd30 msgr2=0x7f89441537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894406bd30 0x7f89441537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 -- 172.21.15.82:0/2369286789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89340094d0 con 0x7f8944070970 2023-07-20T10:02:55.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8939d9b640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c500 tx=0x7f892c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c005220 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c005380 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c007270 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89440ad1b0 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89440b1270 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894404da30 con 0x7f8944070970 2023-07-20T10:02:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.186+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f892c0073d0 con 0x7f8944070970 2023-07-20T10:02:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.190+0000 7f893b7fe640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 0x7f8924068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.190+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f892c083920 con 0x7f8944070970 2023-07-20T10:02:55.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.190+0000 7f894259c640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 0x7f8924068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.190+0000 7f894259c640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 0x7f8924068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89340af000 tx=0x7f8934009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.194+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f892c050a50 con 0x7f8944070970 2023-07-20T10:02:55.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.338+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f89440b4250 con 0x7f8944070970 2023-07-20T10:02:55.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.346+0000 7f893b7fe640 1 -- 172.21.15.82:0/2369286789 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f892c054070 con 0x7f8944070970 2023-07-20T10:02:55.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.346+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 msgr2=0x7f8924068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.346+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 0x7f8924068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89340af000 tx=0x7f8934009040 comp rx=0 tx=0).stop 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.346+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 msgr2=0x7f89441531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.346+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f892c00c500 tx=0x7f892c00c9c0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 shutdown_connections 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8944158ce0 0x7f89440b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f89240663a0 0x7f8924068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8944070970 0x7f89441531d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 --2- 172.21.15.82:0/2369286789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f894406bd30 0x7f89441537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 >> 172.21.15.82:0/2369286789 conn(0x7f89440cad50 msgr2=0x7f894406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 shutdown_connections 2023-07-20T10:02:55.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.350+0000 7f8948fdb640 1 -- 172.21.15.82:0/2369286789 wait complete. 2023-07-20T10:02:55.356 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:02:55.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:02:55.407 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:02:55.451 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:02:55.452 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:02:55.452 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:55.461 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:02:55.461 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:02:55.461 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:55.501 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:02:55.501 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:02:55.502 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:55.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:02:55.512 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:02:55.512 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:02:55.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:02:55.557 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:02:55.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:02:55.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.706+0000 7f2ad3634640 1 Processor -- start 2023-07-20T10:02:55.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.706+0000 7f2ad3634640 1 -- start start 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad3634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 0x7f2acc0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad3634640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2acc0cd250 0x7f2acc069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad3634640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc0ab890 con 0x7f2acc0c91f0 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad3634640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc069ac0 con 0x7f2acc0cd250 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad3634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0ce2d0 con 0x7f2acc15c5e0 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2acc0cd250 0x7f2acc069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2acc0cd250 0x7f2acc069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41160/0 (socket says 172.21.15.82:41160) 2023-07-20T10:02:55.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/3548387685 learned_addr learned my addr 172.21.15.82:0/3548387685 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:55.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/3548387685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 msgr2=0x7f2acc0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 0x7f2acc0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 0x7f2acc0adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/3548387685 >> v1:172.21.15.183:6789/0 conn(0x7f2acc0c91f0 legacy=0x7f2acc0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/3548387685 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0ce5b0 con 0x7f2acc0cd250 2023-07-20T10:02:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.710+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 0x7f2acc0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad1bd1640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc0cd250 0x7f2acc069f50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009e50 tx=0x7f2ac401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b70ceccc86f1c78 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ac3fff640 1 -- 172.21.15.82:0/3548387685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40a58a0 con 0x7f2acc0cd250 2023-07-20T10:02:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ac3fff640 1 -- 172.21.15.82:0/3548387685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac40a5a00 con 0x7f2acc0cd250 2023-07-20T10:02:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ac3fff640 1 -- 172.21.15.82:0/3548387685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40a5d90 con 0x7f2acc0cd250 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- 172.21.15.82:0/3548387685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc0cd250 msgr2=0x7f2acc069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc0cd250 0x7f2acc069f50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009e50 tx=0x7f2ac401c9e0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- 172.21.15.82:0/3548387685 shutdown_connections 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc0cd250 0x7f2acc069f50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 --2- 172.21.15.82:0/3548387685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc15c5e0 0x7f2acc0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- 172.21.15.82:0/3548387685 >> 172.21.15.82:0/3548387685 conn(0x7f2acc0cb620 msgr2=0x7f2acc0cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- 172.21.15.82:0/3548387685 shutdown_connections 2023-07-20T10:02:55.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- 172.21.15.82:0/3548387685 wait complete. 2023-07-20T10:02:55.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 Processor -- start 2023-07-20T10:02:55.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.714+0000 7f2ad3634640 1 -- start start 2023-07-20T10:02:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 0x7f2acc15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 0x7f2acc14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0aba20 con 0x7f2acc15c5e0 2023-07-20T10:02:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b17c0 con 0x7f2acc0c91f0 2023-07-20T10:02:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc14ecf0 con 0x7f2acc0cd250 2023-07-20T10:02:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41162/0 (socket says 172.21.15.82:41162) 2023-07-20T10:02:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/2093564176 learned_addr learned my addr 172.21.15.82:0/2093564176 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 0x7f2acc15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 msgr2=0x7f2acc14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad0bcf640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 0x7f2acc14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 0x7f2acc14d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 msgr2=0x7f2acc15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 0x7f2acc15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 -- 172.21.15.82:0/2093564176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4009b30 con 0x7f2acc15c5e0 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 0x7f2acc15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad0bcf640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 0x7f2acc14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad1bd1640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40af040 tx=0x7f2ac4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40b8670 con 0x7f2acc15c5e0 2023-07-20T10:02:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac40b87d0 con 0x7f2acc15c5e0 2023-07-20T10:02:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc15cb40 con 0x7f2acc15c5e0 2023-07-20T10:02:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40b8b80 con 0x7f2acc15c5e0 2023-07-20T10:02:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0b2f50 con 0x7f2acc15c5e0 2023-07-20T10:02:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.718+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc073c70 con 0x7f2acc15c5e0 2023-07-20T10:02:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.722+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2ac40b8ce0 con 0x7f2acc15c5e0 2023-07-20T10:02:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.722+0000 7f2ac1ffb640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 0x7f2ab0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.722+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7f2ac411f980 con 0x7f2acc15c5e0 2023-07-20T10:02:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.722+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 0x7f2ab0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.722+0000 7f2ad13d0640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 0x7f2ab0068890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8008890 tx=0x7f2ac8008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.726+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ac40ecb20 con 0x7f2acc15c5e0 2023-07-20T10:02:55.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2acc0cc920 con 0x7f2acc15c5e0 2023-07-20T10:02:55.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ac1ffb640 1 -- 172.21.15.82:0/2093564176 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f2ac40bcde0 con 0x7f2acc15c5e0 2023-07-20T10:02:55.894 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:55.894 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5026,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4046370534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4046370534},{"type":"v1","addr":"172.21.15.183:6834","nonce":4046370534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/436017193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":436017193},{"type":"v1","addr":"172.21.15.183:6835","nonce":436017193}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1592623341","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1592623341},{"type":"v1","addr":"172.21.15.82:6835","nonce":1592623341}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/4125502689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4125502689},{"type":"v1","addr":"172.21.15.82:6837","nonce":4125502689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-07-20T10:02:55.894 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 18 2023-07-20T10:02:55.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 msgr2=0x7f2ab0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 0x7f2ab0068890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8008890 tx=0x7f2ac8008040 comp rx=0 tx=0).stop 2023-07-20T10:02:55.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 msgr2=0x7f2acc0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40af040 tx=0x7f2ac4019780 comp rx=0 tx=0).stop 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 shutdown_connections 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2ab00663d0 0x7f2ab0068890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2acc15c5e0 0x7f2acc0b20a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2acc0cd250 0x7f2acc14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 --2- 172.21.15.82:0/2093564176 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2acc0c91f0 0x7f2acc15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:55.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 >> 172.21.15.82:0/2093564176 conn(0x7f2acc0cb620 msgr2=0x7f2acc0c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:55.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 shutdown_connections 2023-07-20T10:02:55.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:55.906+0000 7f2ad3634640 1 -- 172.21.15.82:0/2093564176 wait complete. 2023-07-20T10:02:55.914 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:02:55.914 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:02:55.915 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:02:55.915 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:02:55.915 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:02:55.915 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:02:55.916 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:02:55.916 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:02:55.916 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:02:55.916 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:02:55.916 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:02:55.917 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:02:55.917 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:02:55.917 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:02:55.917 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:02:55.917 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:02:55.926 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:02:55.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:02:55.928 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:02:55.928 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:02:55.931 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:02:55.931 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:02:55.932 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:02:55.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:02:55.975 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:02:55.975 DEBUG:teuthology.parallel:result is None 2023-07-20T10:02:55.977 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:02:55.977 DEBUG:teuthology.parallel:result is None 2023-07-20T10:02:55.978 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:02:55.979 DEBUG:teuthology.parallel:result is None 2023-07-20T10:02:55.981 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:02:55.982 DEBUG:teuthology.parallel:result is None 2023-07-20T10:02:55.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:02:56.066 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:02:56.067 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:02:56.074 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:02:56.074 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:02:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 Processor -- start 2023-07-20T10:02:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 -- start start 2023-07-20T10:02:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 0x7fda700adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda700cd250 0x7fda70069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda700ab890 con 0x7fda700c91f0 2023-07-20T10:02:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda70069ac0 con 0x7fda700cd250 2023-07-20T10:02:56.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda76f96640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda700ce2d0 con 0x7fda7015c5e0 2023-07-20T10:02:56.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda6ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fda700c91f0 0x7fda700ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53988/0 (socket says 172.21.15.82:53988) 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda6ffff640 1 -- 172.21.15.82:0/690748313 learned_addr learned my addr 172.21.15.82:0/690748313 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda75533640 1 --2- 172.21.15.82:0/690748313 >> v2:172.21.15.82:3300/0 conn(0x7fda700cd250 0x7fda70069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda74d32640 1 --2- 172.21.15.82:0/690748313 >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 0x7fda700adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda6f7fe640 1 -- 172.21.15.82:0/690748313 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37628967 0 0) 0x7fda700ab890 con 0x7fda700c91f0 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda6f7fe640 1 -- 172.21.15.82:0/690748313 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda60003530 con 0x7fda700c91f0 2023-07-20T10:02:56.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda75533640 1 -- 172.21.15.82:0/690748313 >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 msgr2=0x7fda700adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:56.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda75533640 1 --2- 172.21.15.82:0/690748313 >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 0x7fda700adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda75533640 1 -- 172.21.15.82:0/690748313 >> v1:172.21.15.82:6789/0 conn(0x7fda700c91f0 legacy=0x7fda700ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:56.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda75533640 1 -- 172.21.15.82:0/690748313 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700ce5b0 con 0x7fda700cd250 2023-07-20T10:02:56.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.142+0000 7fda74d32640 1 --2- 172.21.15.82:0/690748313 >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 0x7fda700adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:56.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda75533640 1 --2- 172.21.15.82:0/690748313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda70069f50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda700cc690 tx=0x7fda6801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8344e354b240461e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:56.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda6f7fe640 1 -- 172.21.15.82:0/690748313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda680a59a0 con 0x7fda700cd250 2023-07-20T10:02:56.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda6f7fe640 1 -- 172.21.15.82:0/690748313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda680a5b00 con 0x7fda700cd250 2023-07-20T10:02:56.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda6f7fe640 1 -- 172.21.15.82:0/690748313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda680a5e70 con 0x7fda700cd250 2023-07-20T10:02:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 -- 172.21.15.82:0/690748313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 msgr2=0x7fda70069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 --2- 172.21.15.82:0/690748313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda70069f50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fda700cc690 tx=0x7fda6801c8e0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 -- 172.21.15.82:0/690748313 shutdown_connections 2023-07-20T10:02:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 --2- 172.21.15.82:0/690748313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda70069f50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 --2- 172.21.15.82:0/690748313 >> v2:172.21.15.183:3300/0 conn(0x7fda7015c5e0 0x7fda700adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 -- 172.21.15.82:0/690748313 >> 172.21.15.82:0/690748313 conn(0x7fda700cb620 msgr2=0x7fda700cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 -- 172.21.15.82:0/690748313 shutdown_connections 2023-07-20T10:02:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.146+0000 7fda76f96640 1 -- 172.21.15.82:0/690748313 wait complete. 2023-07-20T10:02:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 Processor -- start 2023-07-20T10:02:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- start start 2023-07-20T10:02:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda700c91f0 0x7fda700b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 0x7fda700c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b38a0 con 0x7fda700cd250 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b2500 con 0x7fda700c91f0 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda700b18f0 con 0x7fda7015c5e0 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41210/0 (socket says 172.21.15.82:41210) 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 -- 172.21.15.82:0/3960894739 learned_addr learned my addr 172.21.15.82:0/3960894739 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda75533640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 0x7fda700c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda74d32640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda700c91f0 0x7fda700b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 -- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 msgr2=0x7fda700c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 0x7fda700c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 -- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda700c91f0 msgr2=0x7fda700b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda700c91f0 0x7fda700b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 -- 172.21.15.82:0/3960894739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64009420 con 0x7fda700cd250 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda75533640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 0x7fda700c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6ffff640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c3c0 tx=0x7fda5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c005cf0 con 0x7fda700cd250 2023-07-20T10:02:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c005e50 con 0x7fda700cd250 2023-07-20T10:02:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda68009a70 con 0x7fda700cd250 2023-07-20T10:02:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0072f0 con 0x7fda700cd250 2023-07-20T10:02:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7015cb40 con 0x7fda700cd250 2023-07-20T10:02:56.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.150+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda700b2670 con 0x7fda700cd250 2023-07-20T10:02:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.154+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fda5c007450 con 0x7fda700cd250 2023-07-20T10:02:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.154+0000 7fda6d7fa640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 0x7fda54068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.154+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6657+0+0 (secure 0 0 0) 0x7fda5c0835b0 con 0x7fda700cd250 2023-07-20T10:02:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.154+0000 7fda74d32640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 0x7fda54068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:56.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.154+0000 7fda74d32640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 0x7fda54068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda64009cf0 tx=0x7fda64009190 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:56.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.158+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda5c0507e0 con 0x7fda700cd250 2023-07-20T10:02:56.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:56.318+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fda70073c70 con 0x7fda700cd250 2023-07-20T10:02:56.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:02:56.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:02:57.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.046+0000 7fda6d7fa640 1 -- 172.21.15.82:0/3960894739 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda5c053e00 con 0x7fda700cd250 2023-07-20T10:02:57.035 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:02:57.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 msgr2=0x7fda54068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 0x7fda54068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda64009cf0 tx=0x7fda64009190 comp rx=0 tx=0).stop 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 msgr2=0x7fda7015e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00c3c0 tx=0x7fda5c00c880 comp rx=0 tx=0).stop 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 shutdown_connections 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda7015c5e0 0x7fda700c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fda540663a0 0x7fda54068860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda700cd250 0x7fda7015e7b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 --2- 172.21.15.82:0/3960894739 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda700c91f0 0x7fda700b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 >> 172.21.15.82:0/3960894739 conn(0x7fda700cb620 msgr2=0x7fda700ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 shutdown_connections 2023-07-20T10:02:57.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.050+0000 7fda76f96640 1 -- 172.21.15.82:0/3960894739 wait complete. 2023-07-20T10:02:57.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:02:57.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 Processor -- start 2023-07-20T10:02:57.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 -- start start 2023-07-20T10:02:57.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc0b2060 0x7fdccc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0b06c0 con 0x7fdccc0afda0 2023-07-20T10:02:57.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0b3160 con 0x7fdccc15a8e0 2023-07-20T10:02:57.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd36cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b12a0 con 0x7fdccc0b2060 2023-07-20T10:02:57.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41224/0 (socket says 172.21.15.82:41224) 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 -- 172.21.15.82:0/1575274712 learned_addr learned my addr 172.21.15.82:0/1575274712 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd1c68640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc0b2060 0x7fdccc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 -- 172.21.15.82:0/1575274712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc0b2060 msgr2=0x7fdccc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc0b2060 0x7fdccc0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 -- 172.21.15.82:0/1575274712 >> v1:172.21.15.183:6789/0 conn(0x7fdccc0afda0 legacy=0x7fdccc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:57.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.218+0000 7fdcd0c66640 1 -- 172.21.15.82:0/1575274712 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0b1580 con 0x7fdccc15a8e0 2023-07-20T10:02:57.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd0c66640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009870 tx=0x7fdcbc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae0e6c13b1ad761 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcc3fff640 1 -- 172.21.15.82:0/1575274712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0ab5f0 con 0x7fdccc15a8e0 2023-07-20T10:02:57.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcc3fff640 1 -- 172.21.15.82:0/1575274712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0ab750 con 0x7fdccc15a8e0 2023-07-20T10:02:57.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcc3fff640 1 -- 172.21.15.82:0/1575274712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0abae0 con 0x7fdccc15a8e0 2023-07-20T10:02:57.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 -- 172.21.15.82:0/1575274712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc15a8e0 msgr2=0x7fdccc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009870 tx=0x7fdcbc01c3f0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 -- 172.21.15.82:0/1575274712 shutdown_connections 2023-07-20T10:02:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc0b2060 0x7fdccc0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/1575274712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc15a8e0 0x7fdccc0ca6b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 -- 172.21.15.82:0/1575274712 >> 172.21.15.82:0/1575274712 conn(0x7fdccc0cada0 msgr2=0x7fdccc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 -- 172.21.15.82:0/1575274712 shutdown_connections 2023-07-20T10:02:57.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.222+0000 7fdcd36cb640 1 -- 172.21.15.82:0/1575274712 wait complete. 2023-07-20T10:02:57.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 Processor -- start 2023-07-20T10:02:57.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- start start 2023-07-20T10:02:57.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdccc0afda0 0x7fdccc0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc15a8e0 0x7fdccc14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc15acf0 con 0x7fdccc0b2060 2023-07-20T10:02:57.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc14fb70 con 0x7fdccc0afda0 2023-07-20T10:02:57.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc153fb0 con 0x7fdccc15a8e0 2023-07-20T10:02:57.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41234/0 (socket says 172.21.15.82:41234) 2023-07-20T10:02:57.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 -- 172.21.15.82:0/2184443818 learned_addr learned my addr 172.21.15.82:0/2184443818 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:57.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd1c68640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc15a8e0 0x7fdccc14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd1467640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdccc0afda0 0x7fdccc0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 -- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc15a8e0 msgr2=0x7fdccc14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc15a8e0 0x7fdccc14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 -- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdccc0afda0 msgr2=0x7fdccc0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdccc0afda0 0x7fdccc0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 -- 172.21.15.82:0/2184443818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0094d0 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd0c66640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad040 tx=0x7fdcbc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0b5810 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0b59b0 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0b5d60 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc15aed0 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.226+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc15b490 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc0b0fa0 con 0x7fdccc0b2060 2023-07-20T10:02:57.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdcbc0c93f0 con 0x7fdccc0b2060 2023-07-20T10:02:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcc1ffb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 0x7fdcb0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdcbc0a8050 con 0x7fdccc0b2060 2023-07-20T10:02:57.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcd1467640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 0x7fdcb0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.230+0000 7fdcd1467640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 0x7fdcb0068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f70 tx=0x7fdcc8009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.234+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcbc0ebd60 con 0x7fdccc0b2060 2023-07-20T10:02:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.434+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdccc073c70 con 0x7fdccc0b2060 2023-07-20T10:02:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.434+0000 7fdcc1ffb640 1 -- 172.21.15.82:0/2184443818 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdcbc0ab5b0 con 0x7fdccc0b2060 2023-07-20T10:02:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:57.426 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:02:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:02:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:02:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:02:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:02:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:02:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:02:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:02:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:02:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:02:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:02:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:02:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:02:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:02:57.451 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:02:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 msgr2=0x7fdcb0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 0x7fdcb0068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f70 tx=0x7fdcc8009040 comp rx=0 tx=0).stop 2023-07-20T10:02:57.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 msgr2=0x7fdccc14f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0ad040 tx=0x7fdcbc019190 comp rx=0 tx=0).stop 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 shutdown_connections 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdccc15a8e0 0x7fdccc14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fdcb00663d0 0x7fdcb0068890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdccc0b2060 0x7fdccc14f0f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 --2- 172.21.15.82:0/2184443818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdccc0afda0 0x7fdccc0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 >> 172.21.15.82:0/2184443818 conn(0x7fdccc0cada0 msgr2=0x7fdccc159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 shutdown_connections 2023-07-20T10:02:57.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.438+0000 7fdcd36cb640 1 -- 172.21.15.82:0/2184443818 wait complete. 2023-07-20T10:02:57.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 Processor -- start 2023-07-20T10:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 -- start start 2023-07-20T10:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 0x7efe2c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe2c0d0d10 0x7efe2c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0d31c0 con 0x7efe2c0d0d10 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0d16b0 con 0x7efe2c15cab0 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe31fa3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b3520 con 0x7efe2c0cf110 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe2c0d0d10 0x7efe2c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe2c0d0d10 0x7efe2c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41242/0 (socket says 172.21.15.82:41242) 2023-07-20T10:02:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 -- 172.21.15.82:0/3034490501 learned_addr learned my addr 172.21.15.82:0/3034490501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe2bfff640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 -- 172.21.15.82:0/3034490501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 msgr2=0x7efe2c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe2b7fe640 1 --2- 172.21.15.82:0/3034490501 >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 0x7efe2c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 -- 172.21.15.82:0/3034490501 >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 msgr2=0x7efe2c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 --2- 172.21.15.82:0/3034490501 >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 0x7efe2c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe22ffd640 1 -- 172.21.15.82:0/3034490501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0b2910 con 0x7efe2c0d0d10 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe2bfff640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.606+0000 7efe2b7fe640 1 --2- 172.21.15.82:0/3034490501 >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 0x7efe2c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe22ffd640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c0d1170 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe2c06a660 tx=0x7efe1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd8e75b93180b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe2affd640 1 -- 172.21.15.82:0/3034490501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140a5820 con 0x7efe2c0d0d10 2023-07-20T10:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe2affd640 1 -- 172.21.15.82:0/3034490501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe140a5980 con 0x7efe2c0d0d10 2023-07-20T10:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe2affd640 1 -- 172.21.15.82:0/3034490501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140a5d10 con 0x7efe2c0d0d10 2023-07-20T10:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 -- 172.21.15.82:0/3034490501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 msgr2=0x7efe2c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c0d1170 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe2c06a660 tx=0x7efe1401c9a0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 -- 172.21.15.82:0/3034490501 shutdown_connections 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 --2- 172.21.15.82:0/3034490501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c0d1170 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 --2- 172.21.15.82:0/3034490501 >> v2:172.21.15.183:3300/0 conn(0x7efe2c15cab0 0x7efe2c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 -- 172.21.15.82:0/3034490501 >> 172.21.15.82:0/3034490501 conn(0x7efe2c08c120 msgr2=0x7efe2c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 -- 172.21.15.82:0/3034490501 shutdown_connections 2023-07-20T10:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.610+0000 7efe31fa3640 1 -- 172.21.15.82:0/3034490501 wait complete. 2023-07-20T10:02:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 Processor -- start 2023-07-20T10:02:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- start start 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2c15cab0 0x7efe2c15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0c8be0 con 0x7efe2c0d0d10 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c06b700 con 0x7efe2c15cab0 2023-07-20T10:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c15fd30 con 0x7efe2c0cf110 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41250/0 (socket says 172.21.15.82:41250) 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 -- 172.21.15.82:0/2469218746 learned_addr learned my addr 172.21.15.82:0/2469218746 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe2b7fe640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe2bfff640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2c15cab0 0x7efe2c15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 -- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 msgr2=0x7efe2c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 -- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2c15cab0 msgr2=0x7efe2c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2c15cab0 0x7efe2c15f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 -- 172.21.15.82:0/2469218746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14009b30 con 0x7efe2c0d0d10 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe22ffd640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efe140af040 tx=0x7efe14019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140b8880 con 0x7efe2c0d0d10 2023-07-20T10:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe140b8a20 con 0x7efe2c0d0d10 2023-07-20T10:02:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140b8dd0 con 0x7efe2c0d0d10 2023-07-20T10:02:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c15e750 con 0x7efe2c0d0d10 2023-07-20T10:02:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.614+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c15ed10 con 0x7efe2c0d0d10 2023-07-20T10:02:57.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c0af800 con 0x7efe2c0d0d10 2023-07-20T10:02:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe140c3460 con 0x7efe2c0d0d10 2023-07-20T10:02:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe28ff9640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 0x7efe0c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe1411f350 con 0x7efe2c0d0d10 2023-07-20T10:02:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe2b7fe640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 0x7efe0c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.618+0000 7efe2b7fe640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 0x7efe0c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe1c006fd0 tx=0x7efe1c008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.622+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe140ecb40 con 0x7efe2c0d0d10 2023-07-20T10:02:57.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.770+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe2c073c70 con 0x7efe2c0d0d10 2023-07-20T10:02:57.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.770+0000 7efe28ff9640 1 -- 172.21.15.82:0/2469218746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14615 (secure 0 0 0) 0x7efe140f0160 con 0x7efe2c0d0d10 2023-07-20T10:02:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:57.761 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":60,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:02:57.061350+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 msgr2=0x7efe0c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 0x7efe0c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efe1c006fd0 tx=0x7efe1c008040 comp rx=0 tx=0).stop 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 msgr2=0x7efe2c06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efe140af040 tx=0x7efe14019740 comp rx=0 tx=0).stop 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 shutdown_connections 2023-07-20T10:02:57.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe2c15cab0 0x7efe2c15f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7efe0c0663a0 0x7efe0c068860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe2c0d0d10 0x7efe2c06b1c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 --2- 172.21.15.82:0/2469218746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe2c0cf110 0x7efe2c1561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 >> 172.21.15.82:0/2469218746 conn(0x7efe2c08c120 msgr2=0x7efe2c0cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 shutdown_connections 2023-07-20T10:02:57.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.774+0000 7efe31fa3640 1 -- 172.21.15.82:0/2469218746 wait complete. 2023-07-20T10:02:57.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:02:57.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:02:57.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 Processor -- start 2023-07-20T10:02:57.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 -- start start 2023-07-20T10:02:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc6f806f710 0x7fc6f806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f8070030 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f815bad0 con 0x7fc6f806f710 2023-07-20T10:02:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fe607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f8071950 con 0x7fc6f815a6f0 2023-07-20T10:02:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc6f80ca5a0 0x7fc6f815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54002/0 (socket says 172.21.15.82:54002) 2023-07-20T10:02:57.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f77fe640 1 -- 172.21.15.82:0/1159074082 learned_addr learned my addr 172.21.15.82:0/1159074082 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/1159074082 >> v2:172.21.15.183:3300/0 conn(0x7fc6f806f710 0x7fc6f806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fcba4640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f6ffd640 1 -- 172.21.15.82:0/1159074082 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985228289 0 0) 0x7fc6f8070030 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f6ffd640 1 -- 172.21.15.82:0/1159074082 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e0003530 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f7fff640 1 -- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 msgr2=0x7fc6f815ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:57.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f815ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f7fff640 1 -- 172.21.15.82:0/1159074082 >> v1:172.21.15.82:6789/0 conn(0x7fc6f80ca5a0 legacy=0x7fc6f815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6f7fff640 1 -- 172.21.15.82:0/1159074082 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f815b230 con 0x7fc6f806f710 2023-07-20T10:02:57.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.938+0000 7fc6fcba4640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:02:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f806faf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80097c0 tx=0x7fc6e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9144b9782b25da server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6f6ffd640 1 -- 172.21.15.82:0/1159074082 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80ab650 con 0x7fc6f806f710 2023-07-20T10:02:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6f6ffd640 1 -- 172.21.15.82:0/1159074082 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e80ab7b0 con 0x7fc6f806f710 2023-07-20T10:02:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6f6ffd640 1 -- 172.21.15.82:0/1159074082 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80abb40 con 0x7fc6f806f710 2023-07-20T10:02:57.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 -- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 msgr2=0x7fc6f806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f806faf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80097c0 tx=0x7fc6e801c450 comp rx=0 tx=0).stop 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 -- 172.21.15.82:0/1159074082 shutdown_connections 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f815ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 --2- 172.21.15.82:0/1159074082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f806faf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 -- 172.21.15.82:0/1159074082 >> 172.21.15.82:0/1159074082 conn(0x7fc6f80cad50 msgr2=0x7fc6f80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 -- 172.21.15.82:0/1159074082 shutdown_connections 2023-07-20T10:02:57.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.942+0000 7fc6fe607640 1 -- 172.21.15.82:0/1159074082 wait complete. 2023-07-20T10:02:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 Processor -- start 2023-07-20T10:02:57.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- start start 2023-07-20T10:02:57.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f81593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80c5b20 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80afef0 con 0x7fc6f806f710 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f80afc10 con 0x7fc6f815a6f0 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41252/0 (socket says 172.21.15.82:41252) 2023-07-20T10:02:57.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 -- 172.21.15.82:0/3005394244 learned_addr learned my addr 172.21.15.82:0/3005394244 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fcba4640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f81593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 -- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 msgr2=0x7fc6f81593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f81593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 -- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 msgr2=0x7fc6f80cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f80cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 -- 172.21.15.82:0/3005394244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f0009a70 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f77fe640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec001ec0 tx=0x7fc6ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec005cf0 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec005e50 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e8009420 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec0072d0 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.946+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f80c57b0 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f80c5cd0 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc6ec007430 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6f4ff9640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 0x7fc6e4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:57.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc6ec083100 con 0x7fc6f80ca5a0 2023-07-20T10:02:57.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 0x7fc6e4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:57.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.950+0000 7fc6f7fff640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 0x7fc6e4068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80af000 tx=0x7fc6e80a7000 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:57.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:57.954+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6f80c5cd0 con 0x7fc6f80ca5a0 2023-07-20T10:02:58.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.106+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6f804da30 con 0x7fc6f80ca5a0 2023-07-20T10:02:58.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.106+0000 7fc6f4ff9640 1 -- 172.21.15.82:0/3005394244 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6ec050920 con 0x7fc6f80ca5a0 2023-07-20T10:02:58.096 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:02:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 msgr2=0x7fc6e4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 0x7fc6e4068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80af000 tx=0x7fc6e80a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 msgr2=0x7fc6f814a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec001ec0 tx=0x7fc6ec00c8a0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 shutdown_connections 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc6f815a6f0 0x7fc6f81593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc6e40663a0 0x7fc6e4068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f80ca5a0 0x7fc6f814a400 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 --2- 172.21.15.82:0/3005394244 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc6f806f710 0x7fc6f80cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 >> 172.21.15.82:0/3005394244 conn(0x7fc6f80cad50 msgr2=0x7fc6f80cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 shutdown_connections 2023-07-20T10:02:58.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.110+0000 7fc6fe607640 1 -- 172.21.15.82:0/3005394244 wait complete. 2023-07-20T10:02:58.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:02:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.270+0000 7febb0a55640 1 Processor -- start 2023-07-20T10:02:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.270+0000 7febb0a55640 1 -- start start 2023-07-20T10:02:58.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febb0a55640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7febac159450 0x7febac15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febb0a55640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7febac159830 0x7febac0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febb0a55640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0cc8d0 con 0x7febac0cc3e0 2023-07-20T10:02:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febb0a55640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0cce90 con 0x7febac159450 2023-07-20T10:02:58.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febb0a55640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febac0ccbb0 con 0x7febac159830 2023-07-20T10:02:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7febac159450 0x7febac15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7febac159450 0x7febac15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41264/0 (socket says 172.21.15.82:41264) 2023-07-20T10:02:58.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 -- 172.21.15.82:0/2024713382 learned_addr learned my addr 172.21.15.82:0/2024713382 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7feba9d9b640 1 --2- 172.21.15.82:0/2024713382 >> v2:172.21.15.183:3300/0 conn(0x7febac159830 0x7febac0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 -- 172.21.15.82:0/2024713382 >> v2:172.21.15.183:3300/0 conn(0x7febac159830 msgr2=0x7febac0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 --2- 172.21.15.82:0/2024713382 >> v2:172.21.15.183:3300/0 conn(0x7febac159830 0x7febac0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 -- 172.21.15.82:0/2024713382 >> v1:172.21.15.183:6789/0 conn(0x7febac0cc3e0 legacy=0x7febac0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 -- 172.21.15.82:0/2024713382 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac159cc0 con 0x7febac159450 2023-07-20T10:02:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.274+0000 7febaa59c640 1 --2- 172.21.15.82:0/2024713382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac159450 0x7febac15a4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7febac15e190 tx=0x7feb9c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257ed70fbeb7c2bd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7feba959a640 1 -- 172.21.15.82:0/2024713382 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0aa610 con 0x7febac159450 2023-07-20T10:02:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7feba959a640 1 -- 172.21.15.82:0/2024713382 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0a6040 con 0x7febac159450 2023-07-20T10:02:58.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7feba959a640 1 -- 172.21.15.82:0/2024713382 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0aa990 con 0x7febac159450 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- 172.21.15.82:0/2024713382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac159450 msgr2=0x7febac15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- 172.21.15.82:0/2024713382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac159450 0x7febac15a4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7febac15e190 tx=0x7feb9c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- 172.21.15.82:0/2024713382 shutdown_connections 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- 172.21.15.82:0/2024713382 >> v2:172.21.15.183:3300/0 conn(0x7febac159830 0x7febac0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- 172.21.15.82:0/2024713382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac159450 0x7febac15a4c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- 172.21.15.82:0/2024713382 >> 172.21.15.82:0/2024713382 conn(0x7febac0cad50 msgr2=0x7febac0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- 172.21.15.82:0/2024713382 shutdown_connections 2023-07-20T10:02:58.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- 172.21.15.82:0/2024713382 wait complete. 2023-07-20T10:02:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 Processor -- start 2023-07-20T10:02:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- start start 2023-07-20T10:02:58.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 0x7febac150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febac159450 0x7febac0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac151a40 con 0x7febac0c5c30 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac150e30 con 0x7febac159450 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.278+0000 7febb0a55640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac151110 con 0x7febac0cc3e0 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41266/0 (socket says 172.21.15.82:41266) 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feba9d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febac159450 0x7febac0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 -- 172.21.15.82:0/1819981111 learned_addr learned my addr 172.21.15.82:0/1819981111 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaa59c640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 0x7febac150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 -- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 msgr2=0x7febac150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 0x7febac150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 -- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febac159450 msgr2=0x7febac0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febac159450 0x7febac0c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 -- 172.21.15.82:0/1819981111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0094d0 con 0x7febac0c5c30 2023-07-20T10:02:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaa59c640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 0x7febac150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febaad9d640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feba400c7a0 tx=0x7feba400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4003b80 con 0x7febac0c5c30 2023-07-20T10:02:58.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4003ce0 con 0x7febac0c5c30 2023-07-20T10:02:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac1513f0 con 0x7febac0c5c30 2023-07-20T10:02:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba400aa30 con 0x7febac0c5c30 2023-07-20T10:02:58.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac150ac0 con 0x7febac0c5c30 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac151bf0 con 0x7febac0c5c30 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feba400ab90 con 0x7febac0c5c30 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.282+0000 7feb9affd640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 0x7feb8c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.286+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feba40838e0 con 0x7febac0c5c30 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.286+0000 7febaa59c640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 0x7feb8c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.286+0000 7febaa59c640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 0x7feb8c068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c0a7000 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.286+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febac151bf0 con 0x7febac0c5c30 2023-07-20T10:02:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7febac04da30 con 0x7febac0c5c30 2023-07-20T10:02:58.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7feb9affd640 1 -- 172.21.15.82:0/1819981111 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7feba4050fa0 con 0x7febac0c5c30 2023-07-20T10:02:58.426 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:02:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 msgr2=0x7feb8c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 0x7feb8c068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0ae000 tx=0x7feb9c0a7000 comp rx=0 tx=0).stop 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 msgr2=0x7febac15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feba400c7a0 tx=0x7feba400cc60 comp rx=0 tx=0).stop 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 shutdown_connections 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7feb8c0663a0 0x7feb8c068860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febac0c5c30 0x7febac15bc60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febac159450 0x7febac0c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 --2- 172.21.15.82:0/1819981111 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febac0cc3e0 0x7febac150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 >> 172.21.15.82:0/1819981111 conn(0x7febac0cad50 msgr2=0x7febac0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 shutdown_connections 2023-07-20T10:02:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.438+0000 7febb0a55640 1 -- 172.21.15.82:0/1819981111 wait complete. 2023-07-20T10:02:58.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:02:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 Processor -- start 2023-07-20T10:02:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 -- start start 2023-07-20T10:02:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc1815cab0 0x7fbc180d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180b3520 con 0x7fbc180d0d10 2023-07-20T10:02:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180cff30 con 0x7fbc180ce4c0 2023-07-20T10:02:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc2058f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc180d31c0 con 0x7fbc1815cab0 2023-07-20T10:02:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1e32b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc1815cab0 0x7fbc180d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1db2a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbc180d0d10 0x7fbc180cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54008/0 (socket says 172.21.15.82:54008) 2023-07-20T10:02:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1e32b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbc1815cab0 0x7fbc180d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41268/0 (socket says 172.21.15.82:41268) 2023-07-20T10:02:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1db2a640 1 -- 172.21.15.82:0/3108580029 learned_addr learned my addr 172.21.15.82:0/3108580029 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:02:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1e32b640 1 -- 172.21.15.82:0/3108580029 >> v1:172.21.15.183:6789/0 conn(0x7fbc180ce4c0 legacy=0x7fbc180cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1e32b640 1 -- 172.21.15.82:0/3108580029 >> v1:172.21.15.82:6789/0 conn(0x7fbc180d0d10 legacy=0x7fbc180cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1d329640 1 -- 172.21.15.82:0/3108580029 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208193730 0 0) 0x7fbc180b3520 con 0x7fbc180d0d10 2023-07-20T10:02:58.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.598+0000 7fbc1e32b640 1 -- 172.21.15.82:0/3108580029 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180b2910 con 0x7fbc1815cab0 2023-07-20T10:02:58.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc1e32b640 1 --2- 172.21.15.82:0/3108580029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc1815cab0 0x7fbc180d0300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097c0 tx=0x7fbc1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be8ca9010f39216 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc1d329640 1 -- 172.21.15.82:0/3108580029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140ab650 con 0x7fbc1815cab0 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc1d329640 1 -- 172.21.15.82:0/3108580029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140ab7b0 con 0x7fbc1815cab0 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc1d329640 1 -- 172.21.15.82:0/3108580029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140abb40 con 0x7fbc1815cab0 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 -- 172.21.15.82:0/3108580029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc1815cab0 msgr2=0x7fbc180d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 --2- 172.21.15.82:0/3108580029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc1815cab0 0x7fbc180d0300 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097c0 tx=0x7fbc1401c450 comp rx=0 tx=0).stop 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 -- 172.21.15.82:0/3108580029 shutdown_connections 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 --2- 172.21.15.82:0/3108580029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc1815cab0 0x7fbc180d0300 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 -- 172.21.15.82:0/3108580029 >> 172.21.15.82:0/3108580029 conn(0x7fbc1808c120 msgr2=0x7fbc1809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 -- 172.21.15.82:0/3108580029 shutdown_connections 2023-07-20T10:02:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.602+0000 7fbc2058f640 1 -- 172.21.15.82:0/3108580029 wait complete. 2023-07-20T10:02:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 Processor -- start 2023-07-20T10:02:58.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- start start 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc180d0d10 0x7fbc181f91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1815cab0 0x7fbc1814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc1814a190 con 0x7fbc180ce4c0 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18153480 con 0x7fbc180d0d10 2023-07-20T10:02:58.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181f8d50 con 0x7fbc1815cab0 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41284/0 (socket says 172.21.15.82:41284) 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 -- 172.21.15.82:0/675011821 learned_addr learned my addr 172.21.15.82:0/675011821 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1db2a640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc180d0d10 0x7fbc181f91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1eb2c640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1815cab0 0x7fbc1814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 -- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1815cab0 msgr2=0x7fbc1814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1815cab0 0x7fbc1814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 -- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc180d0d10 msgr2=0x7fbc181f91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc180d0d10 0x7fbc181f91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 -- 172.21.15.82:0/675011821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc14009420 con 0x7fbc180ce4c0 2023-07-20T10:02:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc1e32b640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ad040 tx=0x7fbc1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140b5810 con 0x7fbc180ce4c0 2023-07-20T10:02:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc140b59b0 con 0x7fbc180ce4c0 2023-07-20T10:02:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18152910 con 0x7fbc180ce4c0 2023-07-20T10:02:58.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc140b5d60 con 0x7fbc180ce4c0 2023-07-20T10:02:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181536d0 con 0x7fbc180ce4c0 2023-07-20T10:02:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.606+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc181538c0 con 0x7fbc180ce4c0 2023-07-20T10:02:58.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.610+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc140b4390 con 0x7fbc180ce4c0 2023-07-20T10:02:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.610+0000 7fbc0effd640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 0x7fbbfc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.610+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbc1411e7a0 con 0x7fbc180ce4c0 2023-07-20T10:02:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.610+0000 7fbc1db2a640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 0x7fbbfc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.610+0000 7fbc1db2a640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 0x7fbbfc068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc180b85e0 tx=0x7fbc08007d10 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.614+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc140ebe60 con 0x7fbc180ce4c0 2023-07-20T10:02:58.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.762+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbc18073c70 con 0x7fbc180ce4c0 2023-07-20T10:02:58.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.762+0000 7fbc0effd640 1 -- 172.21.15.82:0/675011821 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbc140ef480 con 0x7fbc180ce4c0 2023-07-20T10:02:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:02:58.752 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:02:58.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:02:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:02:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:02:58.753 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:02:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:02:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:02:58.754 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:02:58.755 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:02:58.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 msgr2=0x7fbbfc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 0x7fbbfc068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc180b85e0 tx=0x7fbc08007d10 comp rx=0 tx=0).stop 2023-07-20T10:02:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 msgr2=0x7fbc18146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ad040 tx=0x7fbc1401ac90 comp rx=0 tx=0).stop 2023-07-20T10:02:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 shutdown_connections 2023-07-20T10:02:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbc1815cab0 0x7fbc1814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc180d0d10 0x7fbc181f91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbbfc0663a0 0x7fbbfc068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 --2- 172.21.15.82:0/675011821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc180ce4c0 0x7fbc18146ea0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 >> 172.21.15.82:0/675011821 conn(0x7fbc1808c120 msgr2=0x7fbc1806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 shutdown_connections 2023-07-20T10:02:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.766+0000 7fbc2058f640 1 -- 172.21.15.82:0/675011821 wait complete. 2023-07-20T10:02:58.772 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:02:58.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:02:58.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.926+0000 7f850a503640 1 Processor -- start 2023-07-20T10:02:58.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.926+0000 7f850a503640 1 -- start start 2023-07-20T10:02:58.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 0x7f850406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f850415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f850415ec90 0x7f850415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850415bad0 con 0x7f850415ec90 2023-07-20T10:02:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8504070030 con 0x7f850406f710 2023-07-20T10:02:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f850a503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8504071950 con 0x7f85040ca5a0 2023-07-20T10:02:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f850415ec90 0x7f850415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f850415ec90 0x7f850415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41288/0 (socket says 172.21.15.82:41288) 2023-07-20T10:02:58.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 -- 172.21.15.82:0/3553008092 learned_addr learned my addr 172.21.15.82:0/3553008092 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f85037fe640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f850415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8503fff640 1 --2- 172.21.15.82:0/3553008092 >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 0x7f850406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 -- 172.21.15.82:0/3553008092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 msgr2=0x7f850415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f850415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 -- 172.21.15.82:0/3553008092 >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 msgr2=0x7f850406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:02:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 --2- 172.21.15.82:0/3553008092 >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 0x7f850406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8508aa0640 1 -- 172.21.15.82:0/3553008092 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850415b230 con 0x7f850415ec90 2023-07-20T10:02:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f8503fff640 1 --2- 172.21.15.82:0/3553008092 >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 0x7f850406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.930+0000 7f85037fe640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f850415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:02:58.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f8508aa0640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850415ec90 0x7f850415a6f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f85040ce230 tx=0x7f84fc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3646542bad6793b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f8502ffd640 1 -- 172.21.15.82:0/3553008092 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0a5730 con 0x7f850415ec90 2023-07-20T10:02:58.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f8502ffd640 1 -- 172.21.15.82:0/3553008092 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84fc0a5890 con 0x7f850415ec90 2023-07-20T10:02:58.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f8502ffd640 1 -- 172.21.15.82:0/3553008092 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84fc0a5c20 con 0x7f850415ec90 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- 172.21.15.82:0/3553008092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850415ec90 msgr2=0x7f850415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850415ec90 0x7f850415a6f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f85040ce230 tx=0x7f84fc01c9a0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- 172.21.15.82:0/3553008092 shutdown_connections 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850415ec90 0x7f850415a6f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 --2- 172.21.15.82:0/3553008092 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f850415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 --2- 172.21.15.82:0/3553008092 >> v2:172.21.15.183:3300/0 conn(0x7f850406f710 0x7f850406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- 172.21.15.82:0/3553008092 >> 172.21.15.82:0/3553008092 conn(0x7f85040cad50 msgr2=0x7f85040cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:02:58.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- 172.21.15.82:0/3553008092 shutdown_connections 2023-07-20T10:02:58.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- 172.21.15.82:0/3553008092 wait complete. 2023-07-20T10:02:58.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 Processor -- start 2023-07-20T10:02:58.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.934+0000 7f850a503640 1 -- start start 2023-07-20T10:02:58.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f85040cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 0x7f85040cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85041599d0 con 0x7f850406f710 2023-07-20T10:02:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8504155160 con 0x7f850415ec90 2023-07-20T10:02:58.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8504154550 con 0x7f85040ca5a0 2023-07-20T10:02:58.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41294/0 (socket says 172.21.15.82:41294) 2023-07-20T10:02:58.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 -- 172.21.15.82:0/4095090580 learned_addr learned my addr 172.21.15.82:0/4095090580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:02:58.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f85037fe640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f85040cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8508aa0640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 0x7f85040cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 -- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 msgr2=0x7f85040cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f85040cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 -- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 msgr2=0x7f85040cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:02:58.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 0x7f85040cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:02:58.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 -- 172.21.15.82:0/4095090580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc009b30 con 0x7f850406f710 2023-07-20T10:02:58.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8508aa0640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 0x7f85040cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:02:58.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8503fff640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c7c0 tx=0x7f84f400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4007a30 con 0x7f850406f710 2023-07-20T10:02:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4007b90 con 0x7f850406f710 2023-07-20T10:02:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8504154830 con 0x7f850406f710 2023-07-20T10:02:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400ce70 con 0x7f850406f710 2023-07-20T10:02:58.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504154df0 con 0x7f850406f710 2023-07-20T10:02:58.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850404da30 con 0x7f850406f710 2023-07-20T10:02:58.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.938+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84f40113f0 con 0x7f850406f710 2023-07-20T10:02:58.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.942+0000 7f8500ff9640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 0x7f84f0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:02:58.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.942+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f84f4083d60 con 0x7f850406f710 2023-07-20T10:02:58.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.942+0000 7f85037fe640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 0x7f84f0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:02:58.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.942+0000 7f85037fe640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 0x7f84f0068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85041f83b0 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:02:58.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:58.946+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84f4051320 con 0x7f850406f710 2023-07-20T10:02:59.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:02:59.098+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f850406fdb0 con 0x7f850406f710 2023-07-20T10:03:00.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.062+0000 7f8500ff9640 1 -- 172.21.15.82:0/4095090580 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v61) v1 ==== 138+0+0 (secure 0 0 0) 0x7f84f4054940 con 0x7f850406f710 2023-07-20T10:03:00.053 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:03:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 msgr2=0x7f84f0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 0x7f84f0068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85041f83b0 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2023-07-20T10:03:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 msgr2=0x7f850414ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f84f400c7c0 tx=0x7f84f400cc80 comp rx=0 tx=0).stop 2023-07-20T10:03:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 shutdown_connections 2023-07-20T10:03:00.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f850415ec90 0x7f85040cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85040ca5a0 0x7f85040cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f84f00663a0 0x7f84f0068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 --2- 172.21.15.82:0/4095090580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f850406f710 0x7f850414ce70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 >> 172.21.15.82:0/4095090580 conn(0x7f85040cad50 msgr2=0x7f85040cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:00.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 shutdown_connections 2023-07-20T10:03:00.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.066+0000 7f850a503640 1 -- 172.21.15.82:0/4095090580 wait complete. 2023-07-20T10:03:00.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:03:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.238+0000 7fa80cbe8640 1 Processor -- start 2023-07-20T10:03:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.238+0000 7fa80cbe8640 1 -- start start 2023-07-20T10:03:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80cbe8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa808159450 0x7fa80815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80cbe8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8080afd50 0x7fa8080b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80cbe8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8080b06b0 con 0x7fa808159830 2023-07-20T10:03:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80cbe8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8080cce90 con 0x7fa808159450 2023-07-20T10:03:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80cbe8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080cc8d0 con 0x7fa8080afd50 2023-07-20T10:03:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa7fdd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa808159830 0x7fa8080cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54012/0 (socket says 172.21.15.82:54012) 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa7fdd9b640 1 -- 172.21.15.82:0/63262024 learned_addr learned my addr 172.21.15.82:0/63262024 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80659c640 1 --2- 172.21.15.82:0/63262024 >> v2:172.21.15.183:3300/0 conn(0x7fa808159450 0x7fa80815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa806d9d640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8080afd50 0x7fa8080b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa805d9b640 1 -- 172.21.15.82:0/63262024 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757961493 0 0) 0x7fa8080b06b0 con 0x7fa808159830 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa805d9b640 1 -- 172.21.15.82:0/63262024 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4003530 con 0x7fa808159830 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80659c640 1 -- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8080afd50 msgr2=0x7fa8080b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80659c640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8080afd50 0x7fa8080b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80659c640 1 -- 172.21.15.82:0/63262024 >> v1:172.21.15.82:6789/0 conn(0x7fa808159830 legacy=0x7fa8080cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.242+0000 7fa80659c640 1 -- 172.21.15.82:0/63262024 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8080ccbb0 con 0x7fa808159450 2023-07-20T10:03:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80659c640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80815a4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009d90 tx=0x7fa7f801eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6902c5a0c62af10 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa805d9b640 1 -- 172.21.15.82:0/63262024 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80a7c00 con 0x7fa808159450 2023-07-20T10:03:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa805d9b640 1 -- 172.21.15.82:0/63262024 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f80a7d60 con 0x7fa808159450 2023-07-20T10:03:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa805d9b640 1 -- 172.21.15.82:0/63262024 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80af660 con 0x7fa808159450 2023-07-20T10:03:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 -- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 msgr2=0x7fa80815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80815a4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8009d90 tx=0x7fa7f801eb30 comp rx=0 tx=0).stop 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 -- 172.21.15.82:0/63262024 shutdown_connections 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8080afd50 0x7fa8080b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/63262024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80815a4c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 -- 172.21.15.82:0/63262024 >> 172.21.15.82:0/63262024 conn(0x7fa8080cad50 msgr2=0x7fa8080cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 -- 172.21.15.82:0/63262024 shutdown_connections 2023-07-20T10:03:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 -- 172.21.15.82:0/63262024 wait complete. 2023-07-20T10:03:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.246+0000 7fa80cbe8640 1 Processor -- start 2023-07-20T10:03:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- start start 2023-07-20T10:03:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 0x7fa8080c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c32a0 con 0x7fa8080afd50 2023-07-20T10:03:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c3580 con 0x7fa808159450 2023-07-20T10:03:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8080c3860 con 0x7fa80814d310 2023-07-20T10:03:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41310/0 (socket says 172.21.15.82:41310) 2023-07-20T10:03:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 -- 172.21.15.82:0/3207477274 learned_addr learned my addr 172.21.15.82:0/3207477274 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa806d9d640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 0x7fa8080c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa7fdd9b640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 -- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 msgr2=0x7fa8080c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 0x7fa8080c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 -- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 msgr2=0x7fa80814cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80814cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 -- 172.21.15.82:0/3207477274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f8009a70 con 0x7fa8080afd50 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa806d9d640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 0x7fa8080c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa7fdd9b640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80659c640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80b2040 tx=0x7fa7f801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80afd60 con 0x7fa8080afd50 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8009450 con 0x7fa8080afd50 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8080c3b40 con 0x7fa8080afd50 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80bb690 con 0x7fa8080afd50 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80814d7a0 con 0x7fa8080afd50 2023-07-20T10:03:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.250+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80804da30 con 0x7fa8080afd50 2023-07-20T10:03:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.254+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa7f80bb7f0 con 0x7fa8080afd50 2023-07-20T10:03:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.254+0000 7fa7ff7fe640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 0x7fa7e8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.254+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fa7f8121e70 con 0x7fa8080afd50 2023-07-20T10:03:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.254+0000 7fa7fdd9b640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 0x7fa7e8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.254+0000 7fa7fdd9b640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 0x7fa7e8068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa80814fb50 tx=0x7fa7f0009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.258+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7f80ef490 con 0x7fa8080afd50 2023-07-20T10:03:00.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:00.402+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa8080cbbf0 con 0x7fa8080afd50 2023-07-20T10:03:01.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.078+0000 7fa7ff7fe640 1 -- 172.21.15.82:0/3207477274 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v62) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa7f80b4020 con 0x7fa8080afd50 2023-07-20T10:03:01.065 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:03:01.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.094+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 msgr2=0x7fa7e8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.094+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 0x7fa7e8068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa80814fb50 tx=0x7fa7f0009040 comp rx=0 tx=0).stop 2023-07-20T10:03:01.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.094+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 msgr2=0x7fa80814fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.094+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa7f80b2040 tx=0x7fa7f801b8d0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 shutdown_connections 2023-07-20T10:03:01.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa80814d310 0x7fa8080c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa808159450 0x7fa80814cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa7e80663a0 0x7fa7e8068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 --2- 172.21.15.82:0/3207477274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8080afd50 0x7fa80814fe20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 >> 172.21.15.82:0/3207477274 conn(0x7fa8080cad50 msgr2=0x7fa808071160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:01.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 shutdown_connections 2023-07-20T10:03:01.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.098+0000 7fa80cbe8640 1 -- 172.21.15.82:0/3207477274 wait complete. 2023-07-20T10:03:01.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:03:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 Processor -- start 2023-07-20T10:03:01.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 -- start start 2023-07-20T10:03:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 0x7f3f1c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f1c0afd50 0x7f3f1c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0cc8d0 con 0x7f3f1c159830 2023-07-20T10:03:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c0cce90 con 0x7f3f1c0afd50 2023-07-20T10:03:01.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.262+0000 7f3f209db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0b0700 con 0x7f3f1c159450 2023-07-20T10:03:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f11d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3f1c159830 0x7f3f1c0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54022/0 (socket says 172.21.15.82:54022) 2023-07-20T10:03:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f11d9b640 1 -- 172.21.15.82:0/1151821235 learned_addr learned my addr 172.21.15.82:0/1151821235 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:01.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 --2- 172.21.15.82:0/1151821235 >> v2:172.21.15.183:3300/0 conn(0x7f3f1c0afd50 0x7f3f1c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1a59c640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 0x7f3f1c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142715628 0 0) 0x7f3f1c0cc8d0 con 0x7f3f1c159830 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f08005740 con 0x7f3f1c159830 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 -- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 msgr2=0x7f3f1c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 0x7f3f1c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 -- 172.21.15.82:0/1151821235 >> v1:172.21.15.82:6789/0 conn(0x7f3f1c159830 legacy=0x7f3f1c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167513505 0 0) 0x7f3f08005740 con 0x7f3f1c159830 2023-07-20T10:03:01.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 -- 172.21.15.82:0/1151821235 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0ccbb0 con 0x7f3f1c0afd50 2023-07-20T10:03:01.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1a59c640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 0x7f3f1c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:01.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.266+0000 7f3f1ad9d640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c0afd50 0x7f3f1c0b01c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097f0 tx=0x7f3f1401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f16de569064e6d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:01.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140ab650 con 0x7f3f1c0afd50 2023-07-20T10:03:01.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f140ab7b0 con 0x7f3f1c0afd50 2023-07-20T10:03:01.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f19d9b640 1 -- 172.21.15.82:0/1151821235 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140abb40 con 0x7f3f1c0afd50 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c0afd50 msgr2=0x7f3f1c0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c0afd50 0x7f3f1c0b01c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097f0 tx=0x7f3f1401c450 comp rx=0 tx=0).stop 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- 172.21.15.82:0/1151821235 shutdown_connections 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c0afd50 0x7f3f1c0b01c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- 172.21.15.82:0/1151821235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c159450 0x7f3f1c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- 172.21.15.82:0/1151821235 >> 172.21.15.82:0/1151821235 conn(0x7f3f1c0cad50 msgr2=0x7f3f1c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:01.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- 172.21.15.82:0/1151821235 shutdown_connections 2023-07-20T10:03:01.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- 172.21.15.82:0/1151821235 wait complete. 2023-07-20T10:03:01.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 Processor -- start 2023-07-20T10:03:01.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- start start 2023-07-20T10:03:01.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c0afd50 0x7f3f1c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c1589b0 0x7f3f1c1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c158e30 con 0x7f3f1c159450 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0c63e0 con 0x7f3f1c1589b0 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.270+0000 7f3f209db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c15bfa0 con 0x7f3f1c0afd50 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41314/0 (socket says 172.21.15.82:41314) 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 -- 172.21.15.82:0/2224686947 learned_addr learned my addr 172.21.15.82:0/2224686947 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f1ad9d640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c1589b0 0x7f3f1c1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f1a59c640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c0afd50 0x7f3f1c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 -- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c0afd50 msgr2=0x7f3f1c15b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c0afd50 0x7f3f1c15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 -- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c1589b0 msgr2=0x7f3f1c1f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c1589b0 0x7f3f1c1f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 -- 172.21.15.82:0/2224686947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c009420 con 0x7f3f1c159450 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f11d9b640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400cc10 tx=0x7f3f0400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400ad40 con 0x7f3f1c159450 2023-07-20T10:03:01.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04012400 con 0x7f3f1c159450 2023-07-20T10:03:01.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14009420 con 0x7f3f1c159450 2023-07-20T10:03:01.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0400aea0 con 0x7f3f1c159450 2023-07-20T10:03:01.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c15c560 con 0x7f3f1c159450 2023-07-20T10:03:01.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0c65a0 con 0x7f3f1c159450 2023-07-20T10:03:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.274+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f040127d0 con 0x7f3f1c159450 2023-07-20T10:03:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.278+0000 7f3f137fe640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 0x7f3efc068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.278+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3f04084310 con 0x7f3f1c159450 2023-07-20T10:03:01.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.278+0000 7f3f1a59c640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 0x7f3efc068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:01.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.278+0000 7f3f1a59c640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 0x7f3efc068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009cf0 tx=0x7f3f0c009190 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:01.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.282+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f04051780 con 0x7f3f1c159450 2023-07-20T10:03:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:01.458+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f1c04da30 con 0x7f3f1c159450 2023-07-20T10:03:02.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.078+0000 7f3f137fe640 1 -- 172.21.15.82:0/2224686947 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3f04054da0 con 0x7f3f1c159450 2023-07-20T10:03:02.066 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 7 and data pool 8 2023-07-20T10:03:02.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 msgr2=0x7f3efc068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 0x7f3efc068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009cf0 tx=0x7f3f0c009190 comp rx=0 tx=0).stop 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 msgr2=0x7f3f1c158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400cc10 tx=0x7f3f0400a430 comp rx=0 tx=0).stop 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 shutdown_connections 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f1c1589b0 0x7f3f1c1f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f3efc0663d0 0x7f3efc068890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f1c159450 0x7f3f1c158470 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 --2- 172.21.15.82:0/2224686947 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f1c0afd50 0x7f3f1c15b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 >> 172.21.15.82:0/2224686947 conn(0x7f3f1c0cad50 msgr2=0x7f3f1c157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 shutdown_connections 2023-07-20T10:03:02.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.082+0000 7f3f209db640 1 -- 172.21.15.82:0/2224686947 wait complete. 2023-07-20T10:03:02.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:03:02.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 Processor -- start 2023-07-20T10:03:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 -- start start 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9880ca040 0x7fa9880ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa98815d4a0 0x7fa9880b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9880cde70 con 0x7fa98815c910 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880cbef0 con 0x7fa9880ca040 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa98da18640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9880ca420 con 0x7fa98815d4a0 2023-07-20T10:03:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9880ca040 0x7fa9880ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9880ca040 0x7fa9880ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41326/0 (socket says 172.21.15.82:41326) 2023-07-20T10:03:02.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 -- 172.21.15.82:0/3199897379 learned_addr learned my addr 172.21.15.82:0/3199897379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:02.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa97ffff640 1 --1- 172.21.15.82:0/3199897379 >> v1:172.21.15.82:6789/0 conn(0x7fa98815c910 0x7fa98815cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54030/0 (socket says 172.21.15.82:54030) 2023-07-20T10:03:02.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa9877fe640 1 --2- 172.21.15.82:0/3199897379 >> v2:172.21.15.183:3300/0 conn(0x7fa98815d4a0 0x7fa9880b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 -- 172.21.15.82:0/3199897379 >> v2:172.21.15.183:3300/0 conn(0x7fa98815d4a0 msgr2=0x7fa9880b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 --2- 172.21.15.82:0/3199897379 >> v2:172.21.15.183:3300/0 conn(0x7fa98815d4a0 0x7fa9880b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 -- 172.21.15.82:0/3199897379 >> v1:172.21.15.82:6789/0 conn(0x7fa98815c910 legacy=0x7fa98815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.254+0000 7fa986ffd640 1 -- 172.21.15.82:0/3199897379 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880cdb40 con 0x7fa9880ca040 2023-07-20T10:03:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa986ffd640 1 --2- 172.21.15.82:0/3199897379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa9880ad060 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa98815c850 tx=0x7fa97801d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32079a135a0b3ac1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa9867fc640 1 -- 172.21.15.82:0/3199897379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780a6910 con 0x7fa9880ca040 2023-07-20T10:03:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa9867fc640 1 -- 172.21.15.82:0/3199897379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780a6a70 con 0x7fa9880ca040 2023-07-20T10:03:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa9867fc640 1 -- 172.21.15.82:0/3199897379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780a6e00 con 0x7fa9880ca040 2023-07-20T10:03:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 -- 172.21.15.82:0/3199897379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 msgr2=0x7fa9880ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 --2- 172.21.15.82:0/3199897379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa9880ad060 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa98815c850 tx=0x7fa97801d8a0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 -- 172.21.15.82:0/3199897379 shutdown_connections 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 --2- 172.21.15.82:0/3199897379 >> v2:172.21.15.183:3300/0 conn(0x7fa98815d4a0 0x7fa9880b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 --2- 172.21.15.82:0/3199897379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa9880ad060 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 -- 172.21.15.82:0/3199897379 >> 172.21.15.82:0/3199897379 conn(0x7fa9880cada0 msgr2=0x7fa9880cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 -- 172.21.15.82:0/3199897379 shutdown_connections 2023-07-20T10:03:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.258+0000 7fa98da18640 1 -- 172.21.15.82:0/3199897379 wait complete. 2023-07-20T10:03:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 Processor -- start 2023-07-20T10:03:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- start start 2023-07-20T10:03:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa98815c910 0x7fa9880c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98815d4a0 0x7fa9880c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa988157740 con 0x7fa9880ca040 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c6400 con 0x7fa98815d4a0 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880c66e0 con 0x7fa98815c910 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41332/0 (socket says 172.21.15.82:41332) 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 -- 172.21.15.82:0/4043497765 learned_addr learned my addr 172.21.15.82:0/4043497765 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 -- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa98815c910 msgr2=0x7fa9880c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa98815c910 0x7fa9880c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 -- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98815d4a0 msgr2=0x7fa9880c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98815d4a0 0x7fa9880c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 -- 172.21.15.82:0/4043497765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97800a670 con 0x7fa9880ca040 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa986ffd640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa97800a1c0 tx=0x7fa97801a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780ae9d0 con 0x7fa9880ca040 2023-07-20T10:03:02.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780aeb30 con 0x7fa9880ca040 2023-07-20T10:03:02.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780aeea0 con 0x7fa9880ca040 2023-07-20T10:03:02.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9880c69c0 con 0x7fa9880ca040 2023-07-20T10:03:02.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.262+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa988156290 con 0x7fa9880ca040 2023-07-20T10:03:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988073c70 con 0x7fa9880ca040 2023-07-20T10:03:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa9780b9480 con 0x7fa9880ca040 2023-07-20T10:03:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa984ff9640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 0x7fa968068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa97811ef20 con 0x7fa9880ca040 2023-07-20T10:03:02.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa97ffff640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 0x7fa968068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.266+0000 7fa97ffff640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 0x7fa968068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa9880c1c00 tx=0x7fa9700079d0 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.270+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9780ec280 con 0x7fa9880ca040 2023-07-20T10:03:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.418+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9880cbbd0 con 0x7fa9880ca040 2023-07-20T10:03:02.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa984ff9640 1 -- 172.21.15.82:0/4043497765 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18340 (secure 0 0 0) 0x7fa9780b3070 con 0x7fa9880ca040 2023-07-20T10:03:02.409 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:02.409 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":63,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:03:01.463859+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:03:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 msgr2=0x7fa968068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 0x7fa968068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa9880c1c00 tx=0x7fa9700079d0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 msgr2=0x7fa988155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa97800a1c0 tx=0x7fa97801a640 comp rx=0 tx=0).stop 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 shutdown_connections 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa98815d4a0 0x7fa9880c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa98815c910 0x7fa9880c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fa9680663a0 0x7fa968068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 --2- 172.21.15.82:0/4043497765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9880ca040 0x7fa988155d50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 >> 172.21.15.82:0/4043497765 conn(0x7fa9880cada0 msgr2=0x7fa9880b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 shutdown_connections 2023-07-20T10:03:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.422+0000 7fa98da18640 1 -- 172.21.15.82:0/4043497765 wait complete. 2023-07-20T10:03:02.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:03:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 Processor -- start 2023-07-20T10:03:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 -- start start 2023-07-20T10:03:02.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f475c0ce9a0 0x7f475c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c0b7c20 con 0x7f475c15c5f0 2023-07-20T10:03:02.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c0cee50 con 0x7f475c0ce9a0 2023-07-20T10:03:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f476160b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b4980 con 0x7f475c0ccfb0 2023-07-20T10:03:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f475c0ce9a0 0x7f475c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f475c0ce9a0 0x7f475c0b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41346/0 (socket says 172.21.15.82:41346) 2023-07-20T10:03:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 -- 172.21.15.82:0/1831673063 learned_addr learned my addr 172.21.15.82:0/1831673063 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f475b7fe640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 -- 172.21.15.82:0/1831673063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 msgr2=0x7f475c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c0ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 -- 172.21.15.82:0/1831673063 >> v1:172.21.15.183:6789/0 conn(0x7f475c15c5f0 legacy=0x7f475c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f4760e0a640 1 -- 172.21.15.82:0/1831673063 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c15c9d0 con 0x7f475c0ce9a0 2023-07-20T10:03:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.582+0000 7f475b7fe640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f4760e0a640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b0f70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc54b60d49a856c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f475affd640 1 -- 172.21.15.82:0/1831673063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540af400 con 0x7f475c0ce9a0 2023-07-20T10:03:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f475affd640 1 -- 172.21.15.82:0/1831673063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47540ab050 con 0x7f475c0ce9a0 2023-07-20T10:03:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f475affd640 1 -- 172.21.15.82:0/1831673063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540af780 con 0x7f475c0ce9a0 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 -- 172.21.15.82:0/1831673063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c0ce9a0 msgr2=0x7f475c0b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b0f70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475401f1f0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 -- 172.21.15.82:0/1831673063 shutdown_connections 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b0f70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 --2- 172.21.15.82:0/1831673063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c0ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 -- 172.21.15.82:0/1831673063 >> 172.21.15.82:0/1831673063 conn(0x7f475c065710 msgr2=0x7f475c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 -- 172.21.15.82:0/1831673063 shutdown_connections 2023-07-20T10:03:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 -- 172.21.15.82:0/1831673063 wait complete. 2023-07-20T10:03:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.586+0000 7f476160b640 1 Processor -- start 2023-07-20T10:03:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- start start 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0c8940 con 0x7f475c15c5f0 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1533e0 con 0x7f475c0ce9a0 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b6840 con 0x7f475c0ccfb0 2023-07-20T10:03:02.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41358/0 (socket says 172.21.15.82:41358) 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 -- 172.21.15.82:0/3462645263 learned_addr learned my addr 172.21.15.82:0/3462645263 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f475bfff640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f475b7fe640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 -- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 msgr2=0x7f475c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 -- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0ce9a0 msgr2=0x7f475c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 -- 172.21.15.82:0/3462645263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009b30 con 0x7f475c15c5f0 2023-07-20T10:03:02.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4760e0a640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f475401ce20 tx=0x7f475401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540afde0 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4754009510 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c153100 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540ba660 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c0b6d30 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.590+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0b6f20 con 0x7f475c15c5f0 2023-07-20T10:03:02.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.594+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f47540b6040 con 0x7f475c15c5f0 2023-07-20T10:03:02.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.594+0000 7f4758ff9640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 0x7f4748068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.594+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4754121f10 con 0x7f475c15c5f0 2023-07-20T10:03:02.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.594+0000 7f475bfff640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 0x7f4748068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.594+0000 7f475bfff640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 0x7f4748068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f474c007fd0 tx=0x7f474c009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.598+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47540ef2e0 con 0x7f475c15c5f0 2023-07-20T10:03:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.746+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f475c15c9d0 con 0x7f475c15c5f0 2023-07-20T10:03:02.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f4758ff9640 1 -- 172.21.15.82:0/3462645263 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18340 (secure 0 0 0) 0x7f475c15c9d0 con 0x7f475c15c5f0 2023-07-20T10:03:02.737 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:02.738 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":63,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:03:01.463859+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:03:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 msgr2=0x7f4748068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 0x7f4748068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f474c007fd0 tx=0x7f474c009040 comp rx=0 tx=0).stop 2023-07-20T10:03:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 msgr2=0x7f475c0b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f475401ce20 tx=0x7f475401bf90 comp rx=0 tx=0).stop 2023-07-20T10:03:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 shutdown_connections 2023-07-20T10:03:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f47480663a0 0x7f4748068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475c15c5f0 0x7f475c0b5d30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475c0ce9a0 0x7f475c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 --2- 172.21.15.82:0/3462645263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475c0ccfb0 0x7f475c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 >> 172.21.15.82:0/3462645263 conn(0x7f475c065710 msgr2=0x7f475c15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 shutdown_connections 2023-07-20T10:03:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.750+0000 7f476160b640 1 -- 172.21.15.82:0/3462645263 wait complete. 2023-07-20T10:03:02.760 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:03:02.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.914+0000 7ff64b967640 1 Processor -- start 2023-07-20T10:03:02.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.914+0000 7ff64b967640 1 -- start start 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff64b967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff6440b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff64b967640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440b06b0 con 0x7ff644159450 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff64b967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6440cc8d0 con 0x7ff644159830 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff64b967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440cce90 con 0x7ff6440afd50 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649703640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff644159450 0x7ff64415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54036/0 (socket says 172.21.15.82:54036) 2023-07-20T10:03:02.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649703640 1 -- 172.21.15.82:0/2229089704 learned_addr learned my addr 172.21.15.82:0/2229089704 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452813505 0 0) 0x7ff6440b06b0 con 0x7ff644159450 2023-07-20T10:03:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff630003530 con 0x7ff644159450 2023-07-20T10:03:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff6440b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2112805114 0 0) 0x7ff630003530 con 0x7ff644159450 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 msgr2=0x7ff6440b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff6440b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 >> v1:172.21.15.183:6789/0 conn(0x7ff644159830 legacy=0x7ff6440cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440ccbb0 con 0x7ff644159450 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7ff640001680 con 0x7ff644159450 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 >> v1:172.21.15.82:6789/0 conn(0x7ff644159450 legacy=0x7ff64415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff630003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff630004050 0x7ff6300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6300051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440cce90 con 0x7ff630004d60 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63000ddb0 con 0x7ff630004050 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63000df70 con 0x7ff6440afd50 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6300051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff648f02640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff630004050 0x7ff6300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649703640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff630003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 -- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 msgr2=0x7ff630003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440afd50 0x7ff630003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 -- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff630004050 msgr2=0x7ff6300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff630004050 0x7ff6300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.918+0000 7ff649f04640 1 -- 172.21.15.82:0/2229089704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630003530 con 0x7ff630004d60 2023-07-20T10:03:02.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff649f04640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6300051e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff63c007360 tx=0x7ff63c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6af4ae5e216949 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0a5d20 con 0x7ff630004d60 2023-07-20T10:03:02.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c0a5e80 con 0x7ff630004d60 2023-07-20T10:03:02.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff63bfff640 1 -- 172.21.15.82:0/2229089704 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0ad660 con 0x7ff630004d60 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 -- 172.21.15.82:0/2229089704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 msgr2=0x7ff6300051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 --2- 172.21.15.82:0/2229089704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6300051e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff63c007360 tx=0x7ff63c01ce20 comp rx=0 tx=0).stop 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff649f04640 1 -- 172.21.15.82:0/2229089704 reap_dead start 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 -- 172.21.15.82:0/2229089704 shutdown_connections 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 -- 172.21.15.82:0/2229089704 >> 172.21.15.82:0/2229089704 conn(0x7ff6440cad50 msgr2=0x7ff6440cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 -- 172.21.15.82:0/2229089704 shutdown_connections 2023-07-20T10:03:02.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.922+0000 7ff64b967640 1 -- 172.21.15.82:0/2229089704 wait complete. 2023-07-20T10:03:02.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 Processor -- start 2023-07-20T10:03:02.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- start start 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440a8560 0x7ff6441f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6441f27a0 0x7ff64415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440c3fc0 con 0x7ff630004d60 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440a89e0 con 0x7ff6441f27a0 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6440c3340 con 0x7ff6440a8560 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41388/0 (socket says 172.21.15.82:41388) 2023-07-20T10:03:02.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 -- 172.21.15.82:0/937372379 learned_addr learned my addr 172.21.15.82:0/937372379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:02.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 -- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440a8560 msgr2=0x7ff6441f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440a8560 0x7ff6441f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 -- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6441f27a0 msgr2=0x7ff64415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6441f27a0 0x7ff64415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 -- 172.21.15.82:0/937372379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440c3620 con 0x7ff630004d60 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff649703640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff640007290 tx=0x7ff640007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000f8e0 con 0x7ff630004d60 2023-07-20T10:03:02.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000fa60 con 0x7ff630004d60 2023-07-20T10:03:02.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000fe10 con 0x7ff630004d60 2023-07-20T10:03:02.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6440c3900 con 0x7ff630004d60 2023-07-20T10:03:02.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6441f2c20 con 0x7ff630004d60 2023-07-20T10:03:02.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.926+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6440c4100 con 0x7ff630004d60 2023-07-20T10:03:02.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.930+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff64001d460 con 0x7ff630004d60 2023-07-20T10:03:02.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.930+0000 7ff639ffb640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 0x7ff628068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:02.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.930+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff640083fe0 con 0x7ff630004d60 2023-07-20T10:03:02.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.930+0000 7ff648f02640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 0x7ff628068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:02.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.930+0000 7ff648f02640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 0x7ff628068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff64415c340 tx=0x7ff634009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:02.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:02.934+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6440c4100 con 0x7ff630004d60 2023-07-20T10:03:03.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:03.118+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff6440c4100 con 0x7ff630004d60 2023-07-20T10:03:04.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.102+0000 7ff639ffb640 1 -- 172.21.15.82:0/937372379 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff6440c4100 con 0x7ff630004d60 2023-07-20T10:03:04.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.102+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 msgr2=0x7ff628068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.102+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 0x7ff628068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff64415c340 tx=0x7ff634009040 comp rx=0 tx=0).stop 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.102+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 msgr2=0x7ff6441f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.102+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff640007290 tx=0x7ff640007750 comp rx=0 tx=0).stop 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 shutdown_connections 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6441f27a0 0x7ff64415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff6440a8560 0x7ff6441f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7ff6280663d0 0x7ff628068890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 --2- 172.21.15.82:0/937372379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff630004d60 0x7ff6441f2ee0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 >> 172.21.15.82:0/937372379 conn(0x7ff6440cad50 msgr2=0x7ff6440710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:04.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 shutdown_connections 2023-07-20T10:03:04.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.106+0000 7ff64b967640 1 -- 172.21.15.82:0/937372379 wait complete. 2023-07-20T10:03:04.114 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:03:04.115 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:03:04.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 Processor -- start 2023-07-20T10:03:04.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 -- start start 2023-07-20T10:03:04.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 0x7f45e815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e80b06b0 con 0x7f45e8159830 2023-07-20T10:03:04.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e80cce90 con 0x7f45e8159450 2023-07-20T10:03:04.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45ed7c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e80cc8d0 con 0x7f45e80afd50 2023-07-20T10:03:04.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e6ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 0x7f45e815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:58934/0 (socket says 172.21.15.82:58934) 2023-07-20T10:03:04.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 -- 172.21.15.82:0/2813876419 learned_addr learned my addr 172.21.15.82:0/2813876419 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:04.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e67fc640 1 --1- 172.21.15.82:0/2813876419 >> v1:172.21.15.183:6789/0 conn(0x7f45e8159830 0x7f45e80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:42762/0 (socket says 172.21.15.82:42762) 2023-07-20T10:03:04.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 -- 172.21.15.82:0/2813876419 >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 msgr2=0x7f45e815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:04.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 --2- 172.21.15.82:0/2813876419 >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 0x7f45e815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 -- 172.21.15.82:0/2813876419 >> v1:172.21.15.183:6789/0 conn(0x7f45e8159830 legacy=0x7f45e80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e77fe640 1 -- 172.21.15.82:0/2813876419 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80ccbb0 con 0x7f45e80afd50 2023-07-20T10:03:04.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.274+0000 7f45e6ffd640 1 --2- 172.21.15.82:0/2813876419 >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 0x7f45e815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:04.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45e77fe640 1 --2- 172.21.15.82:0/2813876419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e66eb0d7c081234b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:04.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45e5ffb640 1 -- 172.21.15.82:0/2813876419 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00a58a0 con 0x7f45e80afd50 2023-07-20T10:03:04.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45e5ffb640 1 -- 172.21.15.82:0/2813876419 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e00a5a00 con 0x7f45e80afd50 2023-07-20T10:03:04.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45e5ffb640 1 -- 172.21.15.82:0/2813876419 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00a5d90 con 0x7f45e80afd50 2023-07-20T10:03:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 -- 172.21.15.82:0/2813876419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 msgr2=0x7f45e80b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/2813876419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009e50 tx=0x7f45e001c9e0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 -- 172.21.15.82:0/2813876419 shutdown_connections 2023-07-20T10:03:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/2813876419 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e80afd50 0x7f45e80b0170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/2813876419 >> v2:172.21.15.183:3300/0 conn(0x7f45e8159450 0x7f45e815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 -- 172.21.15.82:0/2813876419 >> 172.21.15.82:0/2813876419 conn(0x7f45e80cad50 msgr2=0x7f45e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 -- 172.21.15.82:0/2813876419 shutdown_connections 2023-07-20T10:03:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.278+0000 7f45ed7c5640 1 -- 172.21.15.82:0/2813876419 wait complete. 2023-07-20T10:03:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 Processor -- start 2023-07-20T10:03:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- start start 2023-07-20T10:03:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e80afd50 0x7f45e8150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e8159450 0x7f45e81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8158460 con 0x7f45e8151a20 2023-07-20T10:03:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e8157fd0 con 0x7f45e80afd50 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e81573c0 con 0x7f45e8159450 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43642/0 (socket says 172.21.15.82:43642) 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 -- 172.21.15.82:0/1849888552 learned_addr learned my addr 172.21.15.82:0/1849888552 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e6ffd640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e80afd50 0x7f45e8150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e67fc640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e8159450 0x7f45e81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 -- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e8159450 msgr2=0x7f45e81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e8159450 0x7f45e81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 -- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e80afd50 msgr2=0x7f45e8150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e80afd50 0x7f45e8150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 -- 172.21.15.82:0/1849888552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8009420 con 0x7f45e8151a20 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45e77fe640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45e001b090 tx=0x7f45e0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00b8670 con 0x7f45e8151a20 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e00b87f0 con 0x7f45e8151a20 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e0009b30 con 0x7f45e8151a20 2023-07-20T10:03:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e00b8ba0 con 0x7f45e8151a20 2023-07-20T10:03:04.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.282+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e8157980 con 0x7f45e8151a20 2023-07-20T10:03:04.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e8158180 con 0x7f45e8151a20 2023-07-20T10:03:04.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f45e00b8d00 con 0x7f45e8151a20 2023-07-20T10:03:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45cf7fe640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 0x7f45d4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45e011f330 con 0x7f45e8151a20 2023-07-20T10:03:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45e6ffd640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 0x7f45d4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.286+0000 7f45e6ffd640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 0x7f45d4068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e81f5c70 tx=0x7f45d8009190 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.290+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45e8158180 con 0x7f45e8151a20 2023-07-20T10:03:04.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:04.470+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f45e8158180 con 0x7f45e8151a20 2023-07-20T10:03:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.110+0000 7f45cf7fe640 1 -- 172.21.15.82:0/1849888552 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45e8158180 con 0x7f45e8151a20 2023-07-20T10:03:05.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 msgr2=0x7f45d4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 0x7f45d4068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45e81f5c70 tx=0x7f45d8009190 comp rx=0 tx=0).stop 2023-07-20T10:03:05.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 msgr2=0x7f45e815bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f45e001b090 tx=0x7f45e0019780 comp rx=0 tx=0).stop 2023-07-20T10:03:05.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 shutdown_connections 2023-07-20T10:03:05.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f45d40663a0 0x7f45d4068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45e8151a20 0x7f45e815bd00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45e8159450 0x7f45e81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 --2- 172.21.15.82:0/1849888552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45e80afd50 0x7f45e8150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 >> 172.21.15.82:0/1849888552 conn(0x7f45e80cad50 msgr2=0x7f45e815b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 shutdown_connections 2023-07-20T10:03:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.114+0000 7f45ed7c5640 1 -- 172.21.15.82:0/1849888552 wait complete. 2023-07-20T10:03:05.122 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:03:05.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:03:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.278+0000 7f352a034640 1 Processor -- start 2023-07-20T10:03:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.278+0000 7f352a034640 1 -- start start 2023-07-20T10:03:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f352a034640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 0x7f352415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f352a034640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35240cc900 0x7f35240ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f352a034640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35240ccd50 con 0x7f35241596b0 2023-07-20T10:03:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f352a034640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240ad600 con 0x7f35240cc900 2023-07-20T10:03:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f352a034640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240ad810 con 0x7f35240b2a90 2023-07-20T10:03:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35240cc900 0x7f35240ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f35240cc900 0x7f35240ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43648/0 (socket says 172.21.15.82:43648) 2023-07-20T10:03:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 -- 172.21.15.82:0/3766191193 learned_addr learned my addr 172.21.15.82:0/3766191193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f351affd640 1 --2- 172.21.15.82:0/3766191193 >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 0x7f352415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 -- 172.21.15.82:0/3766191193 >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 msgr2=0x7f352415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 --2- 172.21.15.82:0/3766191193 >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 0x7f352415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 -- 172.21.15.82:0/3766191193 >> v1:172.21.15.183:6789/0 conn(0x7f35241596b0 legacy=0x7f35240b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f3523fff640 1 -- 172.21.15.82:0/3766191193 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352415d0d0 con 0x7f35240cc900 2023-07-20T10:03:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.282+0000 7f351affd640 1 --2- 172.21.15.82:0/3766191193 >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 0x7f352415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f3523fff640 1 --2- 172.21.15.82:0/3766191193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240cc900 0x7f35240ad0c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f351c009870 tx=0x7f351c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f8a1fa74c55d78 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f3522ffd640 1 -- 172.21.15.82:0/3766191193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0aa430 con 0x7f35240cc900 2023-07-20T10:03:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f3522ffd640 1 -- 172.21.15.82:0/3766191193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c0aa590 con 0x7f35240cc900 2023-07-20T10:03:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f3522ffd640 1 -- 172.21.15.82:0/3766191193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0aa920 con 0x7f35240cc900 2023-07-20T10:03:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- 172.21.15.82:0/3766191193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240cc900 msgr2=0x7f35240ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 --2- 172.21.15.82:0/3766191193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240cc900 0x7f35240ad0c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f351c009870 tx=0x7f351c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- 172.21.15.82:0/3766191193 shutdown_connections 2023-07-20T10:03:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 --2- 172.21.15.82:0/3766191193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240cc900 0x7f35240ad0c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 --2- 172.21.15.82:0/3766191193 >> v2:172.21.15.183:3300/0 conn(0x7f35240b2a90 0x7f352415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- 172.21.15.82:0/3766191193 >> 172.21.15.82:0/3766191193 conn(0x7f35240cada0 msgr2=0x7f35240cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- 172.21.15.82:0/3766191193 shutdown_connections 2023-07-20T10:03:05.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- 172.21.15.82:0/3766191193 wait complete. 2023-07-20T10:03:05.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 Processor -- start 2023-07-20T10:03:05.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.286+0000 7f352a034640 1 -- start start 2023-07-20T10:03:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35240cc900 0x7f352409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35241596b0 0x7f3524153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c44e0 con 0x7f35240b2a90 2023-07-20T10:03:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352409b330 con 0x7f35240cc900 2023-07-20T10:03:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352409b580 con 0x7f35241596b0 2023-07-20T10:03:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43654/0 (socket says 172.21.15.82:43654) 2023-07-20T10:03:05.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 -- 172.21.15.82:0/4158335873 learned_addr learned my addr 172.21.15.82:0/4158335873 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f351affd640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35240cc900 0x7f352409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f3523fff640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35241596b0 0x7f3524153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 -- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35241596b0 msgr2=0x7f3524153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35241596b0 0x7f3524153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 -- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35240cc900 msgr2=0x7f352409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35240cc900 0x7f352409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 -- 172.21.15.82:0/4158335873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c0094d0 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f35237fe640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f351400c3f0 tx=0x7f351400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35140052d0 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514005430 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352409b820 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514003840 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35240c4170 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524073c70 con 0x7f35240b2a90 2023-07-20T10:03:05.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.290+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f35140039a0 con 0x7f35240b2a90 2023-07-20T10:03:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.294+0000 7f3520ff9640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 0x7f3504068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.294+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3514083430 con 0x7f35240b2a90 2023-07-20T10:03:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.294+0000 7f351affd640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 0x7f3504068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.294+0000 7f351affd640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 0x7f3504068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35240c1d00 tx=0x7f350c009890 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.298+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35140507b0 con 0x7f35240b2a90 2023-07-20T10:03:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.482+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3524158fe0 con 0x7f35240b2a90 2023-07-20T10:03:05.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.482+0000 7f3520ff9640 1 -- 172.21.15.82:0/4158335873 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f3514053dd0 con 0x7f35240b2a90 2023-07-20T10:03:05.471 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:05.471 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:03:05.471 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:03:05.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 msgr2=0x7f3504068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 0x7f3504068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35240c1d00 tx=0x7f350c009890 comp rx=0 tx=0).stop 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 msgr2=0x7f352409a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f351400c3f0 tx=0x7f351400c8b0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 shutdown_connections 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35241596b0 0x7f3524153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35240cc900 0x7f352409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f35040663a0 0x7f3504068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 --2- 172.21.15.82:0/4158335873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35240b2a90 0x7f352409a8b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 >> 172.21.15.82:0/4158335873 conn(0x7f35240cada0 msgr2=0x7f3524155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 shutdown_connections 2023-07-20T10:03:05.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.486+0000 7f352a034640 1 -- 172.21.15.82:0/4158335873 wait complete. 2023-07-20T10:03:05.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:03:05.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 Processor -- start 2023-07-20T10:03:05.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 -- start start 2023-07-20T10:03:05.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76041596b0 0x7f760415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 0x7f76040ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040ccd90 con 0x7f76040cc900 2023-07-20T10:03:05.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040ad600 con 0x7f76041596b0 2023-07-20T10:03:05.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7609967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040ad810 con 0x7f76040b2a90 2023-07-20T10:03:05.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76041596b0 0x7f760415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76041596b0 0x7f760415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43660/0 (socket says 172.21.15.82:43660) 2023-07-20T10:03:05.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 -- 172.21.15.82:0/1554911488 learned_addr learned my addr 172.21.15.82:0/1554911488 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 -- 172.21.15.82:0/1554911488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 msgr2=0x7f76040ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f76037fe640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 0x7f76040ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 0x7f76040ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 -- 172.21.15.82:0/1554911488 >> v1:172.21.15.183:6789/0 conn(0x7f76040cc900 legacy=0x7f76040b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f7602ffd640 1 -- 172.21.15.82:0/1554911488 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760415d0d0 con 0x7f76041596b0 2023-07-20T10:03:05.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.646+0000 7f76037fe640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 0x7f76040ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:05.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7602ffd640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76041596b0 0x7f760415dbb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098a0 tx=0x7f75ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c74d601634afc8d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f76027fc640 1 -- 172.21.15.82:0/1554911488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0ab670 con 0x7f76041596b0 2023-07-20T10:03:05.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f76027fc640 1 -- 172.21.15.82:0/1554911488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0ab7d0 con 0x7f76041596b0 2023-07-20T10:03:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f76027fc640 1 -- 172.21.15.82:0/1554911488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0abb60 con 0x7f76041596b0 2023-07-20T10:03:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 -- 172.21.15.82:0/1554911488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76041596b0 msgr2=0x7f760415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76041596b0 0x7f760415dbb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0098a0 tx=0x7f75ec01c4b0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 -- 172.21.15.82:0/1554911488 shutdown_connections 2023-07-20T10:03:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76040b2a90 0x7f76040ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 --2- 172.21.15.82:0/1554911488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76041596b0 0x7f760415dbb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 -- 172.21.15.82:0/1554911488 >> 172.21.15.82:0/1554911488 conn(0x7f76040cada0 msgr2=0x7f76040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 -- 172.21.15.82:0/1554911488 shutdown_connections 2023-07-20T10:03:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.650+0000 7f7609967640 1 -- 172.21.15.82:0/1554911488 wait complete. 2023-07-20T10:03:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 Processor -- start 2023-07-20T10:03:05.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- start start 2023-07-20T10:03:05.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 0x7f76041539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76041596b0 0x7f7604070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604162a90 con 0x7f76040b2a90 2023-07-20T10:03:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604163290 con 0x7f76040cc900 2023-07-20T10:03:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7604162cd0 con 0x7f76041596b0 2023-07-20T10:03:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43666/0 (socket says 172.21.15.82:43666) 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 -- 172.21.15.82:0/1209763442 learned_addr learned my addr 172.21.15.82:0/1209763442 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f76037fe640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76041596b0 0x7f7604070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f75fa7fc640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 0x7f76041539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 -- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76041596b0 msgr2=0x7f7604070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76041596b0 0x7f7604070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 -- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 msgr2=0x7f76041539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 0x7f76041539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 -- 172.21.15.82:0/1209763442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec0094d0 con 0x7f76040b2a90 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f75fa7fc640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 0x7f76041539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7602ffd640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ad040 tx=0x7f75ec01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0b4800 con 0x7f76040b2a90 2023-07-20T10:03:05.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec0b4960 con 0x7f76040b2a90 2023-07-20T10:03:05.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0b4d10 con 0x7f76040b2a90 2023-07-20T10:03:05.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7604162fb0 con 0x7f76040b2a90 2023-07-20T10:03:05.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.654+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7604165710 con 0x7f76040b2a90 2023-07-20T10:03:05.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7604073c70 con 0x7f76040b2a90 2023-07-20T10:03:05.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f75ec0be3f0 con 0x7f76040b2a90 2023-07-20T10:03:05.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f7600ff9640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 0x7f75e4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75ec11ea70 con 0x7f76040b2a90 2023-07-20T10:03:05.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f75fa7fc640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 0x7f75e4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.658+0000 7f75fa7fc640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 0x7f75e4068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f76040c4c30 tx=0x7f75f4009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.662+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75ec0ebd80 con 0x7f76040b2a90 2023-07-20T10:03:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76040cbbd0 con 0x7f76040b2a90 2023-07-20T10:03:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7600ff9640 1 -- 172.21.15.82:0/1209763442 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+18327 (secure 0 0 0) 0x7f75ec0ef3a0 con 0x7f76040b2a90 2023-07-20T10:03:05.798 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:05.798 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":64,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:03:02.884725+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:03:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 msgr2=0x7f75e4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 0x7f75e4068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f76040c4c30 tx=0x7f75f4009040 comp rx=0 tx=0).stop 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 msgr2=0x7f7604162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0ad040 tx=0x7f75ec01acf0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 shutdown_connections 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76041596b0 0x7f7604070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76040cc900 0x7f76041539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f75e40663a0 0x7f75e4068860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 --2- 172.21.15.82:0/1209763442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76040b2a90 0x7f7604162550 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 >> 172.21.15.82:0/1209763442 conn(0x7f76040cada0 msgr2=0x7f76040acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 shutdown_connections 2023-07-20T10:03:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.810+0000 7f7609967640 1 -- 172.21.15.82:0/1209763442 wait complete. 2023-07-20T10:03:05.819 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:03:05.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:03:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.970+0000 7f68acb40640 1 Processor -- start 2023-07-20T10:03:05.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.970+0000 7f68acb40640 1 -- start start 2023-07-20T10:03:05.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68acb40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a81596b0 0x7f68a815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68acb40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68a80cc900 0x7f68a80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68acb40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a80ccd60 con 0x7f68a80b2380 2023-07-20T10:03:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68acb40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a80ad600 con 0x7f68a80cc900 2023-07-20T10:03:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68acb40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80ad810 con 0x7f68a81596b0 2023-07-20T10:03:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68a80cc900 0x7f68a80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f68a80cc900 0x7f68a80ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43670/0 (socket says 172.21.15.82:43670) 2023-07-20T10:03:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 -- 172.21.15.82:0/1166282608 learned_addr learned my addr 172.21.15.82:0/1166282608 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f68a6d9d640 1 --1- 172.21.15.82:0/1166282608 >> v1:172.21.15.82:6789/0 conn(0x7f68a80b2380 0x7f68a80c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52554/0 (socket says 172.21.15.82:52554) 2023-07-20T10:03:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 -- 172.21.15.82:0/1166282608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a81596b0 msgr2=0x7f68a815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 --2- 172.21.15.82:0/1166282608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a81596b0 0x7f68a815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 -- 172.21.15.82:0/1166282608 >> v1:172.21.15.82:6789/0 conn(0x7f68a80b2380 legacy=0x7f68a80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.974+0000 7f689dd9b640 1 -- 172.21.15.82:0/1166282608 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a815d0d0 con 0x7f68a80cc900 2023-07-20T10:03:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f689dd9b640 1 --2- 172.21.15.82:0/1166282608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a80ad0c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6898009870 tx=0x7f689801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f31b5b4746cbc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68a5d9b640 1 -- 172.21.15.82:0/1166282608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980aa670 con 0x7f68a80cc900 2023-07-20T10:03:05.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68a5d9b640 1 -- 172.21.15.82:0/1166282608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980aa7d0 con 0x7f68a80cc900 2023-07-20T10:03:05.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68a5d9b640 1 -- 172.21.15.82:0/1166282608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980aab60 con 0x7f68a80cc900 2023-07-20T10:03:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- 172.21.15.82:0/1166282608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 msgr2=0x7f68a80ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 --2- 172.21.15.82:0/1166282608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a80ad0c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6898009870 tx=0x7f689801c510 comp rx=0 tx=0).stop 2023-07-20T10:03:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- 172.21.15.82:0/1166282608 shutdown_connections 2023-07-20T10:03:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 --2- 172.21.15.82:0/1166282608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a80ad0c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 --2- 172.21.15.82:0/1166282608 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a81596b0 0x7f68a815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- 172.21.15.82:0/1166282608 >> 172.21.15.82:0/1166282608 conn(0x7f68a80cada0 msgr2=0x7f68a80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- 172.21.15.82:0/1166282608 shutdown_connections 2023-07-20T10:03:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- 172.21.15.82:0/1166282608 wait complete. 2023-07-20T10:03:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 Processor -- start 2023-07-20T10:03:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.978+0000 7f68acb40640 1 -- start start 2023-07-20T10:03:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80b2380 0x7f68a8164a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a81596b0 0x7f68a806f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a81500a0 con 0x7f68a80cc900 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a814b2d0 con 0x7f68a81596b0 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8165060 con 0x7f68a80b2380 2023-07-20T10:03:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43686/0 (socket says 172.21.15.82:43686) 2023-07-20T10:03:05.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 -- 172.21.15.82:0/595052679 learned_addr learned my addr 172.21.15.82:0/595052679 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68a659c640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80b2380 0x7f68a8164a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68a6d9d640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a81596b0 0x7f68a806f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 -- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80b2380 msgr2=0x7f68a8164a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80b2380 0x7f68a8164a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 -- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a81596b0 msgr2=0x7f68a806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a81596b0 0x7f68a806f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 -- 172.21.15.82:0/595052679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68980094d0 con 0x7f68a80cc900 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689dd9b640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f68980ac040 tx=0x7f689801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980b3800 con 0x7f68a80cc900 2023-07-20T10:03:05.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980b3980 con 0x7f68a80cc900 2023-07-20T10:03:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a80b2d20 con 0x7f68a80cc900 2023-07-20T10:03:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980b3d30 con 0x7f68a80cc900 2023-07-20T10:03:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a80716c0 con 0x7f68a80cc900 2023-07-20T10:03:05.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a8073c70 con 0x7f68a80cc900 2023-07-20T10:03:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.982+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68980c6390 con 0x7f68a80cc900 2023-07-20T10:03:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.986+0000 7f689f7fe640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 0x7f6888068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.986+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f689811ecd0 con 0x7f68a80cc900 2023-07-20T10:03:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.986+0000 7f68a659c640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 0x7f6888068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:05.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.986+0000 7f68a659c640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 0x7f6888068890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6890006fd0 tx=0x7f6890008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:05.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:05.990+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68980ebf20 con 0x7f68a80cc900 2023-07-20T10:03:06.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.138+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68a80c87c0 con 0x7f68880663d0 2023-07-20T10:03:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.146+0000 7f689f7fe640 1 -- 172.21.15.82:0/595052679 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7f68a80c87c0 con 0x7f68880663d0 2023-07-20T10:03:06.137 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 msgr2=0x7f6888068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 0x7f6888068890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6890006fd0 tx=0x7f6890008040 comp rx=0 tx=0).stop 2023-07-20T10:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 msgr2=0x7f68a814fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f68980ac040 tx=0x7f689801ad50 comp rx=0 tx=0).stop 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 shutdown_connections 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f68a81596b0 0x7f68a806f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f68880663d0 0x7f6888068890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68a80cc900 0x7f68a814fb60 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 --2- 172.21.15.82:0/595052679 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f68a80b2380 0x7f68a8164a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 >> 172.21.15.82:0/595052679 conn(0x7f68a80cada0 msgr2=0x7f68a80aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 shutdown_connections 2023-07-20T10:03:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.150+0000 7f68acb40640 1 -- 172.21.15.82:0/595052679 wait complete. 2023-07-20T10:03:06.157 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:03:04.954009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300028,"kb_used_data":6788,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754674692,"statfs":{"total":773094113280,"available":772786884608,"internally_reserved":0,"allocated":6950912,"data_stored":3984834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.888117"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077769+0000","last_change":"2023-07-20T10:03:00.077769+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077769+0000","last_undegraded":"2023-07-20T10:03:00.077769+0000","last_fullsized":"2023-07-20T10:03:00.077769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075116+0000","last_change":"2023-07-20T10:03:00.075116+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075116+0000","last_undegraded":"2023-07-20T10:03:00.075116+0000","last_fullsized":"2023-07-20T10:03:00.075116+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075541+0000","last_change":"2023-07-20T10:03:00.075541+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075541+0000","last_undegraded":"2023-07-20T10:03:00.075541+0000","last_fullsized":"2023-07-20T10:03:00.075541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072993+0000","last_change":"2023-07-20T10:03:00.072993+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072993+0000","last_undegraded":"2023-07-20T10:03:00.072993+0000","last_fullsized":"2023-07-20T10:03:00.072993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077297+0000","last_change":"2023-07-20T10:03:00.077297+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077297+0000","last_undegraded":"2023-07-20T10:03:00.077297+0000","last_fullsized":"2023-07-20T10:03:00.077297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072073+0000","last_change":"2023-07-20T10:03:00.072073+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072073+0000","last_undegraded":"2023-07-20T10:03:00.072073+0000","last_fullsized":"2023-07-20T10:03:00.072073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073724+0000","last_change":"2023-07-20T10:03:00.073724+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073724+0000","last_undegraded":"2023-07-20T10:03:00.073724+0000","last_fullsized":"2023-07-20T10:03:00.073724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077326+0000","last_change":"2023-07-20T10:03:00.077326+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077326+0000","last_undegraded":"2023-07-20T10:03:00.077326+0000","last_fullsized":"2023-07-20T10:03:00.077326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074486+0000","last_change":"2023-07-20T10:03:00.074486+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074486+0000","last_undegraded":"2023-07-20T10:03:00.074486+0000","last_fullsized":"2023-07-20T10:03:00.074486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075952+0000","last_change":"2023-07-20T10:03:00.075952+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075952+0000","last_undegraded":"2023-07-20T10:03:00.075952+0000","last_fullsized":"2023-07-20T10:03:00.075952+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072592+0000","last_change":"2023-07-20T10:03:00.072592+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072592+0000","last_undegraded":"2023-07-20T10:03:00.072592+0000","last_fullsized":"2023-07-20T10:03:00.072592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073949+0000","last_change":"2023-07-20T10:03:00.073949+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073949+0000","last_undegraded":"2023-07-20T10:03:00.073949+0000","last_fullsized":"2023-07-20T10:03:00.073949+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075312+0000","last_change":"2023-07-20T10:03:00.075312+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075312+0000","last_undegraded":"2023-07-20T10:03:00.075312+0000","last_fullsized":"2023-07-20T10:03:00.075312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072095+0000","last_change":"2023-07-20T10:03:00.072095+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072095+0000","last_undegraded":"2023-07-20T10:03:00.072095+0000","last_fullsized":"2023-07-20T10:03:00.072095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068808+0000","last_change":"2023-07-20T10:03:00.068808+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068808+0000","last_undegraded":"2023-07-20T10:03:00.068808+0000","last_fullsized":"2023-07-20T10:03:00.068808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077145+0000","last_change":"2023-07-20T10:03:00.077145+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077145+0000","last_undegraded":"2023-07-20T10:03:00.077145+0000","last_fullsized":"2023-07-20T10:03:00.077145+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076965+0000","last_change":"2023-07-20T10:03:00.076965+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076965+0000","last_undegraded":"2023-07-20T10:03:00.076965+0000","last_fullsized":"2023-07-20T10:03:00.076965+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074857+0000","last_change":"2023-07-20T10:03:00.074857+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074857+0000","last_undegraded":"2023-07-20T10:03:00.074857+0000","last_fullsized":"2023-07-20T10:03:00.074857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075822+0000","last_change":"2023-07-20T10:03:00.075822+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075822+0000","last_undegraded":"2023-07-20T10:03:00.075822+0000","last_fullsized":"2023-07-20T10:03:00.075822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072106+0000","last_change":"2023-07-20T10:03:00.072106+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072106+0000","last_undegraded":"2023-07-20T10:03:00.072106+0000","last_fullsized":"2023-07-20T10:03:00.072106+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068875+0000","last_change":"2023-07-20T10:03:00.068875+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068875+0000","last_undegraded":"2023-07-20T10:03:00.068875+0000","last_fullsized":"2023-07-20T10:03:00.068875+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072417+0000","last_change":"2023-07-20T10:03:00.072417+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072417+0000","last_undegraded":"2023-07-20T10:03:00.072417+0000","last_fullsized":"2023-07-20T10:03:00.072417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072914+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:03:00.072914+0000","last_peered":"2023-07-20T10:03:00.072914+0000","last_clean":"2023-07-20T10:03:00.072914+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:03:00.072914+0000","last_undegraded":"2023-07-20T10:03:00.072914+0000","last_fullsized":"2023-07-20T10:03:00.072914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:35:18.116474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072924+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:03:00.072924+0000","last_peered":"2023-07-20T10:03:00.072924+0000","last_clean":"2023-07-20T10:03:00.072924+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:03:00.072924+0000","last_undegraded":"2023-07-20T10:03:00.072924+0000","last_fullsized":"2023-07-20T10:03:00.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:19:02.517047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073944+0000","last_change":"2023-07-20T10:03:00.073944+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073944+0000","last_undegraded":"2023-07-20T10:03:00.073944+0000","last_fullsized":"2023-07-20T10:03:00.073944+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072808+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:03:00.072808+0000","last_peered":"2023-07-20T10:03:00.072808+0000","last_clean":"2023-07-20T10:03:00.072808+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:03:00.072808+0000","last_undegraded":"2023-07-20T10:03:00.072808+0000","last_fullsized":"2023-07-20T10:03:00.072808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:21:11.045272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072090+0000","last_change":"2023-07-20T10:03:00.072090+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072090+0000","last_undegraded":"2023-07-20T10:03:00.072090+0000","last_fullsized":"2023-07-20T10:03:00.072090+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.067545+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:03:00.067545+0000","last_peered":"2023-07-20T10:03:00.067545+0000","last_clean":"2023-07-20T10:03:00.067545+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:03:00.067545+0000","last_undegraded":"2023-07-20T10:03:00.067545+0000","last_fullsized":"2023-07-20T10:03:00.067545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:40.352851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077317+0000","last_change":"2023-07-20T10:03:00.077317+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077317+0000","last_undegraded":"2023-07-20T10:03:00.077317+0000","last_fullsized":"2023-07-20T10:03:00.077317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072784+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:03:00.072784+0000","last_peered":"2023-07-20T10:03:00.072784+0000","last_clean":"2023-07-20T10:03:00.072784+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:03:00.072784+0000","last_undegraded":"2023-07-20T10:03:00.072784+0000","last_fullsized":"2023-07-20T10:03:00.072784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:31:21.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077915+0000","last_change":"2023-07-20T10:03:00.077915+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077915+0000","last_undegraded":"2023-07-20T10:03:00.077915+0000","last_fullsized":"2023-07-20T10:03:00.077915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.076212+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:03:00.076212+0000","last_peered":"2023-07-20T10:03:00.076212+0000","last_clean":"2023-07-20T10:03:00.076212+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:03:00.076212+0000","last_undegraded":"2023-07-20T10:03:00.076212+0000","last_fullsized":"2023-07-20T10:03:00.076212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:42:04.032408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072825+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:03:00.072825+0000","last_peered":"2023-07-20T10:03:00.072825+0000","last_clean":"2023-07-20T10:03:00.072825+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:03:00.072825+0000","last_undegraded":"2023-07-20T10:03:00.072825+0000","last_fullsized":"2023-07-20T10:03:00.072825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:00:17.649026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076528+0000","last_change":"2023-07-20T10:03:00.076528+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076528+0000","last_undegraded":"2023-07-20T10:03:00.076528+0000","last_fullsized":"2023-07-20T10:03:00.076528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.077103+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:03:00.077103+0000","last_peered":"2023-07-20T10:03:00.077103+0000","last_clean":"2023-07-20T10:03:00.077103+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:03:00.077103+0000","last_undegraded":"2023-07-20T10:03:00.077103+0000","last_fullsized":"2023-07-20T10:03:00.077103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:34:34.331538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075364+0000","last_change":"2023-07-20T10:03:00.075364+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075364+0000","last_undegraded":"2023-07-20T10:03:00.075364+0000","last_fullsized":"2023-07-20T10:03:00.075364+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.078721+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:03:00.078721+0000","last_peered":"2023-07-20T10:03:00.078721+0000","last_clean":"2023-07-20T10:03:00.078721+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:03:00.078721+0000","last_undegraded":"2023-07-20T10:03:00.078721+0000","last_fullsized":"2023-07-20T10:03:00.078721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:58.906211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54548,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317292,"statfs":{"total":96636764160,"available":96580907008,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.69399999999999995},"min":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.57499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65800000000000003,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0780000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95599999999999996,"5min":0.98499999999999999,"15min":1.2010000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":1.1259999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":1.103},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":1.2230000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.496,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0149999999999999,"15min":1.25},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.93200000000000005,"5min":0.94999999999999996,"15min":1.272},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.88,"15min":0.92000000000000004},"last":0.996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.0389999999999999,"15min":1.0649999999999999},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94799999999999995,"5min":1.0609999999999999,"15min":1.155},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.94299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.871,"5min":0.96999999999999997,"15min":0.97199999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.879}]},{"osd":3,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76700000000000002,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":0.996},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.94899999999999995,"5min":1.0089999999999999,"15min":1.016},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.3080000000000001},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.145},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38400000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.085},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.141},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.433},"max":{"1min":1.22,"5min":1.22,"15min":1.363},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.3620000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.747},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.212},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.93500000000000005,"15min":1.196},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.90800000000000003,"5min":1.004,"15min":1.4970000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":0.93200000000000005,"5min":1.0209999999999999,"15min":1.538},"last":0.752}]},{"osd":7,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.753,"5min":1.0009999999999999,"15min":1.597},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.50800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.29299999999999998},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.435},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":1.099},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":1.381,"15min":1.381},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.98299999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0920000000000001,"5min":1.274,"15min":1.274},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.131,"15min":1.1950000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.496},"max":{"1min":0.94299999999999995,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.54200000000000004},"max":{"1min":1.0509999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53968,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317872,"statfs":{"total":96636764160,"available":96581500928,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.623,"5min":0.89300000000000002,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":1.6599999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.25700000000000001},"max":{"1min":0.83799999999999997,"5min":0.876,"15min":0.876},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71799999999999997,"5min":0.92600000000000005,"15min":0.93000000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":1.246,"15min":1.25},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.2689999999999999,"15min":1.383},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.1899999999999999,"15min":1.2470000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0189999999999999,"5min":1.169,"15min":1.51},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0600000000000001,"5min":1.292,"15min":1.5820000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0720000000000001,"5min":1.393,"15min":1.393},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.76700000000000002,"15min":0.89600000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.626,"5min":0.69699999999999995,"15min":1.0800000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":1.052},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.65600000000000003,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.1930000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.048,"5min":1.117,"15min":1.117},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.1559999999999999,"15min":1.355},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":1.107,"15min":1.1879999999999999},"last":1.006}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0129999999999999,"5min":1.117,"15min":1.6060000000000001},"last":1.048},{"interface":"front","average":{"1min":0.751,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2529999999999999},"last":0.93899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.49199999999999999,"15min":0.45200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.312},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58899999999999997,"15min":0.52600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.68300000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.36799999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.627,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":10.631,"5min":10.631,"15min":10.631},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.60799999999999998,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.83699999999999997,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.89800000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":7.4340000000000002,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.84899999999999998,"15min":0.81200000000000006},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":3.161,"5min":3.161,"15min":3.161},"last":0.63},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.878,"15min":0.82599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.46600000000000003},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.89400000000000002,"15min":0.84299999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":5.1970000000000001,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.82799999999999996,"15min":0.80800000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:03:06.169 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:03:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 Processor -- start 2023-07-20T10:03:06.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 -- start start 2023-07-20T10:03:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ca040 0x7f007415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f007415ce50 0x7f007415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740cde70 con 0x7f00740ad060 2023-07-20T10:03:06.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00740ca4c0 con 0x7f007415ce50 2023-07-20T10:03:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0079827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740ad440 con 0x7f00740ca040 2023-07-20T10:03:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0072ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00740ad060 0x7f00740afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52566/0 (socket says 172.21.15.82:52566) 2023-07-20T10:03:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f0072ffd640 1 -- 172.21.15.82:0/2015841629 learned_addr learned my addr 172.21.15.82:0/2015841629 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f00737fe640 1 --2- 172.21.15.82:0/2015841629 >> v2:172.21.15.82:3300/0 conn(0x7f007415ce50 0x7f007415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.350+0000 7f006a7fc640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ca040 0x7f007415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00727fc640 1 -- 172.21.15.82:0/2015841629 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942785463 0 0) 0x7f00740cde70 con 0x7f00740ad060 2023-07-20T10:03:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00727fc640 1 -- 172.21.15.82:0/2015841629 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0060003530 con 0x7f00740ad060 2023-07-20T10:03:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00737fe640 1 -- 172.21.15.82:0/2015841629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ca040 msgr2=0x7f007415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00737fe640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ca040 0x7f007415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00737fe640 1 -- 172.21.15.82:0/2015841629 >> v1:172.21.15.82:6789/0 conn(0x7f00740ad060 legacy=0x7f00740afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00737fe640 1 -- 172.21.15.82:0/2015841629 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740cbef0 con 0x7f007415ce50 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00737fe640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f007415d2e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32688a38111eeb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00727fc640 1 -- 172.21.15.82:0/2015841629 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a5810 con 0x7f007415ce50 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00727fc640 1 -- 172.21.15.82:0/2015841629 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0a5970 con 0x7f007415ce50 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f00727fc640 1 -- 172.21.15.82:0/2015841629 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0a5d00 con 0x7f007415ce50 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 -- 172.21.15.82:0/2015841629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 msgr2=0x7f007415d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f007415d2e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f006c009d90 tx=0x7f006c01c950 comp rx=0 tx=0).stop 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 -- 172.21.15.82:0/2015841629 shutdown_connections 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f007415d2e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 --2- 172.21.15.82:0/2015841629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ca040 0x7f007415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.354+0000 7f0079827640 1 -- 172.21.15.82:0/2015841629 >> 172.21.15.82:0/2015841629 conn(0x7f00740cada0 msgr2=0x7f00740cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- 172.21.15.82:0/2015841629 shutdown_connections 2023-07-20T10:03:06.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- 172.21.15.82:0/2015841629 wait complete. 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 Processor -- start 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- start start 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ad060 0x7f0074099900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 0x7f007409ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740994e0 con 0x7f007415ce50 2023-07-20T10:03:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740acbd0 con 0x7f00740ca040 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0079827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074098b40 con 0x7f00740ad060 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43704/0 (socket says 172.21.15.82:43704) 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 -- 172.21.15.82:0/136354470 learned_addr learned my addr 172.21.15.82:0/136354470 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f0072ffd640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ad060 0x7f0074099900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f006a7fc640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 0x7f007409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 -- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ad060 msgr2=0x7f0074099900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ad060 0x7f0074099900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 -- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 msgr2=0x7f007409ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 0x7f007409ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f00737fe640 1 -- 172.21.15.82:0/136354470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009a70 con 0x7f007415ce50 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.358+0000 7f006a7fc640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 0x7f007409ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f00737fe640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f006c01b000 tx=0x7f006c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0b9650 con 0x7f007415ce50 2023-07-20T10:03:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0b97b0 con 0x7f007415ce50 2023-07-20T10:03:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074098e20 con 0x7f007415ce50 2023-07-20T10:03:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c0b9b20 con 0x7f007415ce50 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007409b070 con 0x7f007415ce50 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074099620 con 0x7f007415ce50 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f006c0b9c80 con 0x7f007415ce50 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 0x7f0054068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f006c11f070 con 0x7f007415ce50 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0072ffd640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 0x7f0054068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.362+0000 7f0072ffd640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 0x7f0054068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00640011f0 tx=0x7f0064009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.366+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f006c14f700 con 0x7f007415ce50 2023-07-20T10:03:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.510+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00740b1170 con 0x7f00540663a0 2023-07-20T10:03:06.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.518+0000 7f0070ff9640 1 -- 172.21.15.82:0/136354470 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7f0064001cf0 con 0x7f00540663a0 2023-07-20T10:03:06.509 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:06.513 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:03:06.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 msgr2=0x7f0054068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 0x7f0054068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00640011f0 tx=0x7f0064009040 comp rx=0 tx=0).stop 2023-07-20T10:03:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 msgr2=0x7f0074070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f006c01b000 tx=0x7f006c0196f0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 shutdown_connections 2023-07-20T10:03:06.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f00540663a0 0x7f0054068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f007415ce50 0x7f0074070240 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00740ca040 0x7f007409ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 --2- 172.21.15.82:0/136354470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00740ad060 0x7f0074099900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 >> 172.21.15.82:0/136354470 conn(0x7f00740cada0 msgr2=0x7f00740afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 shutdown_connections 2023-07-20T10:03:06.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.522+0000 7f0079827640 1 -- 172.21.15.82:0/136354470 wait complete. 2023-07-20T10:03:06.530 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:03:04.954009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300028,"kb_used_data":6788,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754674692,"statfs":{"total":773094113280,"available":772786884608,"internally_reserved":0,"allocated":6950912,"data_stored":3984834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.888117"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077769+0000","last_change":"2023-07-20T10:03:00.077769+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077769+0000","last_undegraded":"2023-07-20T10:03:00.077769+0000","last_fullsized":"2023-07-20T10:03:00.077769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075116+0000","last_change":"2023-07-20T10:03:00.075116+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075116+0000","last_undegraded":"2023-07-20T10:03:00.075116+0000","last_fullsized":"2023-07-20T10:03:00.075116+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075541+0000","last_change":"2023-07-20T10:03:00.075541+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075541+0000","last_undegraded":"2023-07-20T10:03:00.075541+0000","last_fullsized":"2023-07-20T10:03:00.075541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072993+0000","last_change":"2023-07-20T10:03:00.072993+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072993+0000","last_undegraded":"2023-07-20T10:03:00.072993+0000","last_fullsized":"2023-07-20T10:03:00.072993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077297+0000","last_change":"2023-07-20T10:03:00.077297+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077297+0000","last_undegraded":"2023-07-20T10:03:00.077297+0000","last_fullsized":"2023-07-20T10:03:00.077297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072073+0000","last_change":"2023-07-20T10:03:00.072073+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072073+0000","last_undegraded":"2023-07-20T10:03:00.072073+0000","last_fullsized":"2023-07-20T10:03:00.072073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073724+0000","last_change":"2023-07-20T10:03:00.073724+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073724+0000","last_undegraded":"2023-07-20T10:03:00.073724+0000","last_fullsized":"2023-07-20T10:03:00.073724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077326+0000","last_change":"2023-07-20T10:03:00.077326+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077326+0000","last_undegraded":"2023-07-20T10:03:00.077326+0000","last_fullsized":"2023-07-20T10:03:00.077326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074486+0000","last_change":"2023-07-20T10:03:00.074486+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074486+0000","last_undegraded":"2023-07-20T10:03:00.074486+0000","last_fullsized":"2023-07-20T10:03:00.074486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075952+0000","last_change":"2023-07-20T10:03:00.075952+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075952+0000","last_undegraded":"2023-07-20T10:03:00.075952+0000","last_fullsized":"2023-07-20T10:03:00.075952+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072592+0000","last_change":"2023-07-20T10:03:00.072592+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072592+0000","last_undegraded":"2023-07-20T10:03:00.072592+0000","last_fullsized":"2023-07-20T10:03:00.072592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073949+0000","last_change":"2023-07-20T10:03:00.073949+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073949+0000","last_undegraded":"2023-07-20T10:03:00.073949+0000","last_fullsized":"2023-07-20T10:03:00.073949+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075312+0000","last_change":"2023-07-20T10:03:00.075312+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075312+0000","last_undegraded":"2023-07-20T10:03:00.075312+0000","last_fullsized":"2023-07-20T10:03:00.075312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072095+0000","last_change":"2023-07-20T10:03:00.072095+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072095+0000","last_undegraded":"2023-07-20T10:03:00.072095+0000","last_fullsized":"2023-07-20T10:03:00.072095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068808+0000","last_change":"2023-07-20T10:03:00.068808+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068808+0000","last_undegraded":"2023-07-20T10:03:00.068808+0000","last_fullsized":"2023-07-20T10:03:00.068808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077145+0000","last_change":"2023-07-20T10:03:00.077145+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077145+0000","last_undegraded":"2023-07-20T10:03:00.077145+0000","last_fullsized":"2023-07-20T10:03:00.077145+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076965+0000","last_change":"2023-07-20T10:03:00.076965+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076965+0000","last_undegraded":"2023-07-20T10:03:00.076965+0000","last_fullsized":"2023-07-20T10:03:00.076965+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074857+0000","last_change":"2023-07-20T10:03:00.074857+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074857+0000","last_undegraded":"2023-07-20T10:03:00.074857+0000","last_fullsized":"2023-07-20T10:03:00.074857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075822+0000","last_change":"2023-07-20T10:03:00.075822+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075822+0000","last_undegraded":"2023-07-20T10:03:00.075822+0000","last_fullsized":"2023-07-20T10:03:00.075822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072106+0000","last_change":"2023-07-20T10:03:00.072106+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072106+0000","last_undegraded":"2023-07-20T10:03:00.072106+0000","last_fullsized":"2023-07-20T10:03:00.072106+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068875+0000","last_change":"2023-07-20T10:03:00.068875+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068875+0000","last_undegraded":"2023-07-20T10:03:00.068875+0000","last_fullsized":"2023-07-20T10:03:00.068875+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072417+0000","last_change":"2023-07-20T10:03:00.072417+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072417+0000","last_undegraded":"2023-07-20T10:03:00.072417+0000","last_fullsized":"2023-07-20T10:03:00.072417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072914+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:03:00.072914+0000","last_peered":"2023-07-20T10:03:00.072914+0000","last_clean":"2023-07-20T10:03:00.072914+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:03:00.072914+0000","last_undegraded":"2023-07-20T10:03:00.072914+0000","last_fullsized":"2023-07-20T10:03:00.072914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:35:18.116474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072924+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:03:00.072924+0000","last_peered":"2023-07-20T10:03:00.072924+0000","last_clean":"2023-07-20T10:03:00.072924+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:03:00.072924+0000","last_undegraded":"2023-07-20T10:03:00.072924+0000","last_fullsized":"2023-07-20T10:03:00.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:19:02.517047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073944+0000","last_change":"2023-07-20T10:03:00.073944+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073944+0000","last_undegraded":"2023-07-20T10:03:00.073944+0000","last_fullsized":"2023-07-20T10:03:00.073944+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072808+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:03:00.072808+0000","last_peered":"2023-07-20T10:03:00.072808+0000","last_clean":"2023-07-20T10:03:00.072808+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:03:00.072808+0000","last_undegraded":"2023-07-20T10:03:00.072808+0000","last_fullsized":"2023-07-20T10:03:00.072808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:21:11.045272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072090+0000","last_change":"2023-07-20T10:03:00.072090+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072090+0000","last_undegraded":"2023-07-20T10:03:00.072090+0000","last_fullsized":"2023-07-20T10:03:00.072090+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.067545+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:03:00.067545+0000","last_peered":"2023-07-20T10:03:00.067545+0000","last_clean":"2023-07-20T10:03:00.067545+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:03:00.067545+0000","last_undegraded":"2023-07-20T10:03:00.067545+0000","last_fullsized":"2023-07-20T10:03:00.067545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:40.352851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077317+0000","last_change":"2023-07-20T10:03:00.077317+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077317+0000","last_undegraded":"2023-07-20T10:03:00.077317+0000","last_fullsized":"2023-07-20T10:03:00.077317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072784+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:03:00.072784+0000","last_peered":"2023-07-20T10:03:00.072784+0000","last_clean":"2023-07-20T10:03:00.072784+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:03:00.072784+0000","last_undegraded":"2023-07-20T10:03:00.072784+0000","last_fullsized":"2023-07-20T10:03:00.072784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:31:21.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077915+0000","last_change":"2023-07-20T10:03:00.077915+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077915+0000","last_undegraded":"2023-07-20T10:03:00.077915+0000","last_fullsized":"2023-07-20T10:03:00.077915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.076212+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:03:00.076212+0000","last_peered":"2023-07-20T10:03:00.076212+0000","last_clean":"2023-07-20T10:03:00.076212+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:03:00.076212+0000","last_undegraded":"2023-07-20T10:03:00.076212+0000","last_fullsized":"2023-07-20T10:03:00.076212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:42:04.032408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072825+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:03:00.072825+0000","last_peered":"2023-07-20T10:03:00.072825+0000","last_clean":"2023-07-20T10:03:00.072825+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:03:00.072825+0000","last_undegraded":"2023-07-20T10:03:00.072825+0000","last_fullsized":"2023-07-20T10:03:00.072825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:00:17.649026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076528+0000","last_change":"2023-07-20T10:03:00.076528+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076528+0000","last_undegraded":"2023-07-20T10:03:00.076528+0000","last_fullsized":"2023-07-20T10:03:00.076528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.077103+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:03:00.077103+0000","last_peered":"2023-07-20T10:03:00.077103+0000","last_clean":"2023-07-20T10:03:00.077103+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:03:00.077103+0000","last_undegraded":"2023-07-20T10:03:00.077103+0000","last_fullsized":"2023-07-20T10:03:00.077103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:34:34.331538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075364+0000","last_change":"2023-07-20T10:03:00.075364+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075364+0000","last_undegraded":"2023-07-20T10:03:00.075364+0000","last_fullsized":"2023-07-20T10:03:00.075364+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.078721+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:03:00.078721+0000","last_peered":"2023-07-20T10:03:00.078721+0000","last_clean":"2023-07-20T10:03:00.078721+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:03:00.078721+0000","last_undegraded":"2023-07-20T10:03:00.078721+0000","last_fullsized":"2023-07-20T10:03:00.078721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:58.906211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54548,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317292,"statfs":{"total":96636764160,"available":96580907008,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.69399999999999995},"min":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.57499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65800000000000003,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0780000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95599999999999996,"5min":0.98499999999999999,"15min":1.2010000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":1.1259999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":1.103},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":1.2230000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.496,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0149999999999999,"15min":1.25},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.93200000000000005,"5min":0.94999999999999996,"15min":1.272},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.88,"15min":0.92000000000000004},"last":0.996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.0389999999999999,"15min":1.0649999999999999},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94799999999999995,"5min":1.0609999999999999,"15min":1.155},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.94299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.871,"5min":0.96999999999999997,"15min":0.97199999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.879}]},{"osd":3,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76700000000000002,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":0.996},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.94899999999999995,"5min":1.0089999999999999,"15min":1.016},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.3080000000000001},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.145},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38400000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.085},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.141},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.433},"max":{"1min":1.22,"5min":1.22,"15min":1.363},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.3620000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.747},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.212},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.93500000000000005,"15min":1.196},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.90800000000000003,"5min":1.004,"15min":1.4970000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":0.93200000000000005,"5min":1.0209999999999999,"15min":1.538},"last":0.752}]},{"osd":7,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.753,"5min":1.0009999999999999,"15min":1.597},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.50800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.29299999999999998},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.435},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":1.099},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":1.381,"15min":1.381},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.98299999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0920000000000001,"5min":1.274,"15min":1.274},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.131,"15min":1.1950000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.496},"max":{"1min":0.94299999999999995,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.54200000000000004},"max":{"1min":1.0509999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53968,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317872,"statfs":{"total":96636764160,"available":96581500928,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.623,"5min":0.89300000000000002,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":1.6599999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.25700000000000001},"max":{"1min":0.83799999999999997,"5min":0.876,"15min":0.876},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71799999999999997,"5min":0.92600000000000005,"15min":0.93000000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":1.246,"15min":1.25},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.2689999999999999,"15min":1.383},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.1899999999999999,"15min":1.2470000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0189999999999999,"5min":1.169,"15min":1.51},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0600000000000001,"5min":1.292,"15min":1.5820000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0720000000000001,"5min":1.393,"15min":1.393},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.76700000000000002,"15min":0.89600000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.626,"5min":0.69699999999999995,"15min":1.0800000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":1.052},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.65600000000000003,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.1930000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.048,"5min":1.117,"15min":1.117},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.1559999999999999,"15min":1.355},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":1.107,"15min":1.1879999999999999},"last":1.006}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0129999999999999,"5min":1.117,"15min":1.6060000000000001},"last":1.048},{"interface":"front","average":{"1min":0.751,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2529999999999999},"last":0.93899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.49199999999999999,"15min":0.45200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.312},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58899999999999997,"15min":0.52600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.68300000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.36799999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.627,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":10.631,"5min":10.631,"15min":10.631},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.60799999999999998,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.83699999999999997,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.89800000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":7.4340000000000002,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.84899999999999998,"15min":0.81200000000000006},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":3.161,"5min":3.161,"15min":3.161},"last":0.63},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.878,"15min":0.82599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.46600000000000003},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.89400000000000002,"15min":0.84299999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":5.1970000000000001,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.82799999999999996,"15min":0.80800000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:03:06.538 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:03:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.726+0000 7fefff234640 1 Processor -- start 2023-07-20T10:03:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.726+0000 7fefff234640 1 -- start start 2023-07-20T10:03:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefff234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7feff80b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefff234640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80cdd60 con 0x7feff80b04b0 2023-07-20T10:03:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefff234640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff80b20a0 con 0x7feff80ad720 2023-07-20T10:03:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefff234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff80cd430 con 0x7feff80b1cc0 2023-07-20T10:03:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feff80b04b0 0x7feff8160660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52578/0 (socket says 172.21.15.82:52578) 2023-07-20T10:03:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 -- 172.21.15.82:0/980794278 learned_addr learned my addr 172.21.15.82:0/980794278 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffcfd0640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7feff80b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572903494 0 0) 0x7feff80cdd60 con 0x7feff80b04b0 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe0003530 con 0x7feff80b04b0 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3244763396 0 0) 0x7fefe0003530 con 0x7feff80b04b0 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 msgr2=0x7feff80b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7feff80b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 >> v1:172.21.15.183:6789/0 conn(0x7feff80ad720 legacy=0x7feff80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff80cd710 con 0x7feff80b04b0 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7feff0001a00 con 0x7feff80b04b0 2023-07-20T10:03:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 >> v1:172.21.15.82:6789/0 conn(0x7feff80b04b0 legacy=0x7feff8160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefe00039b0 0x7fefe0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7fefe00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe0004d10 0x7fefe0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80cd430 con 0x7fefe0004d10 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe000bac0 con 0x7fefe00039b0 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe000bc80 con 0x7feff80b1cc0 2023-07-20T10:03:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe0004d10 0x7fefe0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffcfd0640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefe00039b0 0x7fefe0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7fefeffff640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7fefe00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 -- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 msgr2=0x7fefe00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feff80b1cc0 0x7fefe00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 -- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefe00039b0 msgr2=0x7fefe0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefe00039b0 0x7fefe0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffd7d1640 1 -- 172.21.15.82:0/980794278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0003530 con 0x7fefe0004d10 2023-07-20T10:03:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.730+0000 7feffcfd0640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefe00039b0 0x7fefe0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:06.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7feffd7d1640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe0004d10 0x7fefe0005190 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feff000a830 tx=0x7feff001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3ed31cc431f298 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00aa6d0 con 0x7fefe0004d10 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00aa830 con 0x7fefe0004d10 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefef7fe640 1 -- 172.21.15.82:0/980794278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00aac20 con 0x7fefe0004d10 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 -- 172.21.15.82:0/980794278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe0004d10 msgr2=0x7fefe0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 --2- 172.21.15.82:0/980794278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefe0004d10 0x7fefe0005190 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feff000a830 tx=0x7feff001faa0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7feffd7d1640 1 -- 172.21.15.82:0/980794278 reap_dead start 2023-07-20T10:03:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 -- 172.21.15.82:0/980794278 shutdown_connections 2023-07-20T10:03:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 -- 172.21.15.82:0/980794278 >> 172.21.15.82:0/980794278 conn(0x7feff80cada0 msgr2=0x7feff80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 -- 172.21.15.82:0/980794278 shutdown_connections 2023-07-20T10:03:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.734+0000 7fefff234640 1 -- 172.21.15.82:0/980794278 wait complete. 2023-07-20T10:03:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 Processor -- start 2023-07-20T10:03:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- start start 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefe0004d10 0x7feff8155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff80c9ee0 0x7feff8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff80ca360 con 0x7feff80ae790 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff8156000 con 0x7feff80c9ee0 2023-07-20T10:03:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff809a540 con 0x7fefe0004d10 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43716/0 (socket says 172.21.15.82:43716) 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 -- 172.21.15.82:0/217229045 learned_addr learned my addr 172.21.15.82:0/217229045 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7feffcfd0640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefe0004d10 0x7feff8155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7feffd7d1640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff80c9ee0 0x7feff8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 -- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefe0004d10 msgr2=0x7feff8155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefe0004d10 0x7feff8155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 -- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff80c9ee0 msgr2=0x7feff8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff80c9ee0 0x7feff8098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 -- 172.21.15.82:0/217229045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff809a820 con 0x7feff80ae790 2023-07-20T10:03:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefeffff640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fefe800f5e0 tx=0x7fefe800f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe80052e0 con 0x7feff80ae790 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe8005440 con 0x7feff80ae790 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe8003820 con 0x7feff80ae790 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff809ab00 con 0x7feff80ae790 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff809b0c0 con 0x7feff80ae790 2023-07-20T10:03:06.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.738+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff8073c70 con 0x7feff80ae790 2023-07-20T10:03:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.742+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fefe8003980 con 0x7feff80ae790 2023-07-20T10:03:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.742+0000 7fefed7fa640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 0x7fefe4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.742+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefe8083bb0 con 0x7feff80ae790 2023-07-20T10:03:06.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.742+0000 7feffcfd0640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 0x7fefe4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.742+0000 7feffcfd0640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 0x7fefe4068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feff815cf80 tx=0x7feff4009190 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:06.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.746+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefe8050f20 con 0x7feff80ae790 2023-07-20T10:03:06.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.890+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feff80c5f70 con 0x7fefe40663a0 2023-07-20T10:03:06.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.898+0000 7fefed7fa640 1 -- 172.21.15.82:0/217229045 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299215 (secure 0 0 0) 0x7feff80c5f70 con 0x7fefe40663a0 2023-07-20T10:03:06.887 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:06.888 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:03:06.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 msgr2=0x7fefe4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 0x7fefe4068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feff815cf80 tx=0x7feff4009190 comp rx=0 tx=0).stop 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 msgr2=0x7feff80c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fefe800f5e0 tx=0x7fefe800f9e0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 shutdown_connections 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feff80c9ee0 0x7feff8098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fefe40663a0 0x7fefe4068860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feff80ae790 0x7feff80c99a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 --2- 172.21.15.82:0/217229045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefe0004d10 0x7feff8155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 >> 172.21.15.82:0/217229045 conn(0x7feff80cada0 msgr2=0x7feff8070030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 shutdown_connections 2023-07-20T10:03:06.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:06.902+0000 7fefff234640 1 -- 172.21.15.82:0/217229045 wait complete. 2023-07-20T10:03:06.907 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:03:04.954009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300028,"kb_used_data":6788,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754674692,"statfs":{"total":773094113280,"available":772786884608,"internally_reserved":0,"allocated":6950912,"data_stored":3984834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.888117"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077769+0000","last_change":"2023-07-20T10:03:00.077769+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077769+0000","last_undegraded":"2023-07-20T10:03:00.077769+0000","last_fullsized":"2023-07-20T10:03:00.077769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075116+0000","last_change":"2023-07-20T10:03:00.075116+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075116+0000","last_undegraded":"2023-07-20T10:03:00.075116+0000","last_fullsized":"2023-07-20T10:03:00.075116+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075541+0000","last_change":"2023-07-20T10:03:00.075541+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075541+0000","last_undegraded":"2023-07-20T10:03:00.075541+0000","last_fullsized":"2023-07-20T10:03:00.075541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072993+0000","last_change":"2023-07-20T10:03:00.072993+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072993+0000","last_undegraded":"2023-07-20T10:03:00.072993+0000","last_fullsized":"2023-07-20T10:03:00.072993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077297+0000","last_change":"2023-07-20T10:03:00.077297+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077297+0000","last_undegraded":"2023-07-20T10:03:00.077297+0000","last_fullsized":"2023-07-20T10:03:00.077297+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072073+0000","last_change":"2023-07-20T10:03:00.072073+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072073+0000","last_undegraded":"2023-07-20T10:03:00.072073+0000","last_fullsized":"2023-07-20T10:03:00.072073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073724+0000","last_change":"2023-07-20T10:03:00.073724+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073724+0000","last_undegraded":"2023-07-20T10:03:00.073724+0000","last_fullsized":"2023-07-20T10:03:00.073724+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077326+0000","last_change":"2023-07-20T10:03:00.077326+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077326+0000","last_undegraded":"2023-07-20T10:03:00.077326+0000","last_fullsized":"2023-07-20T10:03:00.077326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074486+0000","last_change":"2023-07-20T10:03:00.074486+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074486+0000","last_undegraded":"2023-07-20T10:03:00.074486+0000","last_fullsized":"2023-07-20T10:03:00.074486+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075952+0000","last_change":"2023-07-20T10:03:00.075952+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075952+0000","last_undegraded":"2023-07-20T10:03:00.075952+0000","last_fullsized":"2023-07-20T10:03:00.075952+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072592+0000","last_change":"2023-07-20T10:03:00.072592+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072592+0000","last_undegraded":"2023-07-20T10:03:00.072592+0000","last_fullsized":"2023-07-20T10:03:00.072592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076802+0000","last_change":"2023-07-20T10:03:00.076802+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076802+0000","last_undegraded":"2023-07-20T10:03:00.076802+0000","last_fullsized":"2023-07-20T10:03:00.076802+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073949+0000","last_change":"2023-07-20T10:03:00.073949+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073949+0000","last_undegraded":"2023-07-20T10:03:00.073949+0000","last_fullsized":"2023-07-20T10:03:00.073949+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075312+0000","last_change":"2023-07-20T10:03:00.075312+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075312+0000","last_undegraded":"2023-07-20T10:03:00.075312+0000","last_fullsized":"2023-07-20T10:03:00.075312+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072095+0000","last_change":"2023-07-20T10:03:00.072095+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072095+0000","last_undegraded":"2023-07-20T10:03:00.072095+0000","last_fullsized":"2023-07-20T10:03:00.072095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068808+0000","last_change":"2023-07-20T10:03:00.068808+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068808+0000","last_undegraded":"2023-07-20T10:03:00.068808+0000","last_fullsized":"2023-07-20T10:03:00.068808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077145+0000","last_change":"2023-07-20T10:03:00.077145+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077145+0000","last_undegraded":"2023-07-20T10:03:00.077145+0000","last_fullsized":"2023-07-20T10:03:00.077145+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076965+0000","last_change":"2023-07-20T10:03:00.076965+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076965+0000","last_undegraded":"2023-07-20T10:03:00.076965+0000","last_fullsized":"2023-07-20T10:03:00.076965+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.074857+0000","last_change":"2023-07-20T10:03:00.074857+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.074857+0000","last_undegraded":"2023-07-20T10:03:00.074857+0000","last_fullsized":"2023-07-20T10:03:00.074857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075822+0000","last_change":"2023-07-20T10:03:00.075822+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075822+0000","last_undegraded":"2023-07-20T10:03:00.075822+0000","last_fullsized":"2023-07-20T10:03:00.075822+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072106+0000","last_change":"2023-07-20T10:03:00.072106+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072106+0000","last_undegraded":"2023-07-20T10:03:00.072106+0000","last_fullsized":"2023-07-20T10:03:00.072106+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.068875+0000","last_change":"2023-07-20T10:03:00.068875+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.068875+0000","last_undegraded":"2023-07-20T10:03:00.068875+0000","last_fullsized":"2023-07-20T10:03:00.068875+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072417+0000","last_change":"2023-07-20T10:03:00.072417+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072417+0000","last_undegraded":"2023-07-20T10:03:00.072417+0000","last_fullsized":"2023-07-20T10:03:00.072417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072914+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:03:00.072914+0000","last_peered":"2023-07-20T10:03:00.072914+0000","last_clean":"2023-07-20T10:03:00.072914+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:03:00.072914+0000","last_undegraded":"2023-07-20T10:03:00.072914+0000","last_fullsized":"2023-07-20T10:03:00.072914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:35:18.116474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072924+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:03:00.072924+0000","last_peered":"2023-07-20T10:03:00.072924+0000","last_clean":"2023-07-20T10:03:00.072924+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:03:00.072924+0000","last_undegraded":"2023-07-20T10:03:00.072924+0000","last_fullsized":"2023-07-20T10:03:00.072924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:19:02.517047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073944+0000","last_change":"2023-07-20T10:03:00.073944+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073944+0000","last_undegraded":"2023-07-20T10:03:00.073944+0000","last_fullsized":"2023-07-20T10:03:00.073944+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072808+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:03:00.072808+0000","last_peered":"2023-07-20T10:03:00.072808+0000","last_clean":"2023-07-20T10:03:00.072808+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:03:00.072808+0000","last_undegraded":"2023-07-20T10:03:00.072808+0000","last_fullsized":"2023-07-20T10:03:00.072808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:21:11.045272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.072090+0000","last_change":"2023-07-20T10:03:00.072090+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.072090+0000","last_undegraded":"2023-07-20T10:03:00.072090+0000","last_fullsized":"2023-07-20T10:03:00.072090+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.067545+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:03:00.067545+0000","last_peered":"2023-07-20T10:03:00.067545+0000","last_clean":"2023-07-20T10:03:00.067545+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:03:00.067545+0000","last_undegraded":"2023-07-20T10:03:00.067545+0000","last_fullsized":"2023-07-20T10:03:00.067545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:40.352851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077317+0000","last_change":"2023-07-20T10:03:00.077317+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077317+0000","last_undegraded":"2023-07-20T10:03:00.077317+0000","last_fullsized":"2023-07-20T10:03:00.077317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072784+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:03:00.072784+0000","last_peered":"2023-07-20T10:03:00.072784+0000","last_clean":"2023-07-20T10:03:00.072784+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:03:00.072784+0000","last_undegraded":"2023-07-20T10:03:00.072784+0000","last_fullsized":"2023-07-20T10:03:00.072784+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:31:21.429495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.077915+0000","last_change":"2023-07-20T10:03:00.077915+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.077915+0000","last_undegraded":"2023-07-20T10:03:00.077915+0000","last_fullsized":"2023-07-20T10:03:00.077915+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.076212+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:03:00.076212+0000","last_peered":"2023-07-20T10:03:00.076212+0000","last_clean":"2023-07-20T10:03:00.076212+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:03:00.076212+0000","last_undegraded":"2023-07-20T10:03:00.076212+0000","last_fullsized":"2023-07-20T10:03:00.076212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:42:04.032408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.073634+0000","last_change":"2023-07-20T10:03:00.073634+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.073634+0000","last_undegraded":"2023-07-20T10:03:00.073634+0000","last_fullsized":"2023-07-20T10:03:00.073634+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.072825+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:03:00.072825+0000","last_peered":"2023-07-20T10:03:00.072825+0000","last_clean":"2023-07-20T10:03:00.072825+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:03:00.072825+0000","last_undegraded":"2023-07-20T10:03:00.072825+0000","last_fullsized":"2023-07-20T10:03:00.072825+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:00:17.649026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.076528+0000","last_change":"2023-07-20T10:03:00.076528+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.076528+0000","last_undegraded":"2023-07-20T10:03:00.076528+0000","last_fullsized":"2023-07-20T10:03:00.076528+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.077103+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:03:00.077103+0000","last_peered":"2023-07-20T10:03:00.077103+0000","last_clean":"2023-07-20T10:03:00.077103+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:03:00.077103+0000","last_undegraded":"2023-07-20T10:03:00.077103+0000","last_fullsized":"2023-07-20T10:03:00.077103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:34:34.331538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:03:01.065630+0000","last_change":"2023-07-20T10:03:01.065630+0000","last_active":"2023-07-20T10:03:01.065630+0000","last_peered":"2023-07-20T10:03:01.065630+0000","last_clean":"2023-07-20T10:03:01.065630+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:01.065630+0000","last_undegraded":"2023-07-20T10:03:01.065630+0000","last_fullsized":"2023-07-20T10:03:01.065630+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":61,"state":"creating+peering","last_fresh":"2023-07-20T10:03:00.075364+0000","last_change":"2023-07-20T10:03:00.075364+0000","last_active":"2023-07-20T10:03:00.056217+0000","last_peered":"2023-07-20T10:03:00.056217+0000","last_clean":"2023-07-20T10:03:00.056217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:03:00.075364+0000","last_undegraded":"2023-07-20T10:03:00.075364+0000","last_fullsized":"2023-07-20T10:03:00.075364+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-20T10:03:00.078721+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:03:00.078721+0000","last_peered":"2023-07-20T10:03:00.078721+0000","last_clean":"2023-07-20T10:03:00.078721+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:03:00.078721+0000","last_undegraded":"2023-07-20T10:03:00.078721+0000","last_fullsized":"2023-07-20T10:03:00.078721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:58.906211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54548,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317292,"statfs":{"total":96636764160,"available":96580907008,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.69399999999999995},"min":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.57499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65800000000000003,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0780000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95599999999999996,"5min":0.98499999999999999,"15min":1.2010000000000001},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":1.1259999999999999},"last":0.748},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":1.103},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":1.2230000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.496,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0149999999999999,"15min":1.25},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.93200000000000005,"5min":0.94999999999999996,"15min":1.272},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.88,"15min":0.92000000000000004},"last":0.996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.0389999999999999,"15min":1.0649999999999999},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94799999999999995,"5min":1.0609999999999999,"15min":1.155},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.94299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31820,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340020,"statfs":{"total":96636764160,"available":96604180480,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.871,"5min":0.96999999999999997,"15min":0.97199999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.879}]},{"osd":3,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76700000000000002,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":0.996},"last":0.85199999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.94899999999999995,"5min":1.0089999999999999,"15min":1.016},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.3080000000000001},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.145},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38400000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.085},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.141},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.433},"max":{"1min":1.22,"5min":1.22,"15min":1.363},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.3620000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.747},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.212},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.93500000000000005,"15min":1.196},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.90800000000000003,"5min":1.004,"15min":1.4970000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":0.93200000000000005,"5min":1.0209999999999999,"15min":1.538},"last":0.752}]},{"osd":7,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.623},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.753,"5min":1.0009999999999999,"15min":1.597},"last":0.53900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.50800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.29299999999999998},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.435},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":1.099},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":1.381,"15min":1.381},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.98299999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0920000000000001,"5min":1.274,"15min":1.274},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.131,"15min":1.1950000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.496},"max":{"1min":0.94299999999999995,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.54200000000000004},"max":{"1min":1.0509999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.68200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575002,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53968,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317872,"statfs":{"total":96636764160,"available":96581500928,"internally_reserved":0,"allocated":712704,"data_stored":346656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.623,"5min":0.89300000000000002,"15min":0.92700000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":1.6599999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.25700000000000001},"max":{"1min":0.83799999999999997,"5min":0.876,"15min":0.876},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71799999999999997,"5min":0.92600000000000005,"15min":0.93000000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":1.246,"15min":1.25},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.2689999999999999,"15min":1.383},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.1899999999999999,"15min":1.2470000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0189999999999999,"5min":1.169,"15min":1.51},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0600000000000001,"5min":1.292,"15min":1.5820000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0720000000000001,"5min":1.393,"15min":1.393},"last":0.66100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":724992,"data_stored":352826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.76700000000000002,"15min":0.89600000000000002},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.626,"5min":0.69699999999999995,"15min":1.0800000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":1.052},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.65600000000000003,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.1930000000000001},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.048,"5min":1.117,"15min":1.117},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.1559999999999999,"15min":1.355},"last":0.92400000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":1.107,"15min":1.1879999999999999},"last":1.006}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0129999999999999,"5min":1.117,"15min":1.6060000000000001},"last":1.048},{"interface":"front","average":{"1min":0.751,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2529999999999999},"last":0.93899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1318912,"data_stored":943194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.49199999999999999,"15min":0.45200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.312},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58899999999999997,"15min":0.52600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.68300000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.36799999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.627,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":10.631,"5min":10.631,"15min":10.631},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.60799999999999998,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.83699999999999997,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.89800000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":7.4340000000000002,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.84899999999999998,"15min":0.81200000000000006},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":3.161,"5min":3.161,"15min":3.161},"last":0.63},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.878,"15min":0.82599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.46600000000000003},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.89400000000000002,"15min":0.84299999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":5.1970000000000001,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.82799999999999996,"15min":0.80800000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:03:06.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-07-20T10:03:06.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-20T10:03:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-20T10:03:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-07-20T10:03:06.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-07-20T10:03:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-07-20T10:03:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-20T10:03:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-20T10:03:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-20T10:03:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-07-20T10:03:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-07-20T10:03:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-20T10:03:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-07-20T10:03:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-07-20T10:03:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-07-20T10:03:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-07-20T10:03:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-07-20T10:03:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-07-20T10:03:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-20T10:03:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-20T10:03:06.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-07-20T10:03:06.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-20T10:03:06.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-20T10:03:06.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-20T10:03:06.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-07-20T10:03:06.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-20T10:03:06.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-07-20T10:03:06.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-20T10:03:06.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-07-20T10:03:06.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-20T10:03:06.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-20T10:03:06.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-20T10:03:06.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-20T10:03:06.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-07-20T10:03:06.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077769+0000', 'last_change': '2023-07-20T10:03:00.077769+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077769+0000', 'last_undegraded': '2023-07-20T10:03:00.077769+0000', 'last_fullsized': '2023-07-20T10:03:00.077769+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-20T10:03:06.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-07-20T10:03:06.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075116+0000', 'last_change': '2023-07-20T10:03:00.075116+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075116+0000', 'last_undegraded': '2023-07-20T10:03:00.075116+0000', 'last_fullsized': '2023-07-20T10:03:00.075116+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:03:06.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-20T10:03:06.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-07-20T10:03:06.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075541+0000', 'last_change': '2023-07-20T10:03:00.075541+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075541+0000', 'last_undegraded': '2023-07-20T10:03:00.075541+0000', 'last_fullsized': '2023-07-20T10:03:00.075541+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:03:06.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-20T10:03:06.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-07-20T10:03:06.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.073634+0000', 'last_change': '2023-07-20T10:03:00.073634+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.073634+0000', 'last_undegraded': '2023-07-20T10:03:00.073634+0000', 'last_fullsized': '2023-07-20T10:03:00.073634+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:03:06.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-07-20T10:03:06.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-07-20T10:03:06.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072993+0000', 'last_change': '2023-07-20T10:03:00.072993+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072993+0000', 'last_undegraded': '2023-07-20T10:03:00.072993+0000', 'last_fullsized': '2023-07-20T10:03:00.072993+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-20T10:03:06.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-07-20T10:03:06.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.076802+0000', 'last_change': '2023-07-20T10:03:00.076802+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.076802+0000', 'last_undegraded': '2023-07-20T10:03:00.076802+0000', 'last_fullsized': '2023-07-20T10:03:00.076802+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:03:06.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-20T10:03:06.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-07-20T10:03:06.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077297+0000', 'last_change': '2023-07-20T10:03:00.077297+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077297+0000', 'last_undegraded': '2023-07-20T10:03:00.077297+0000', 'last_fullsized': '2023-07-20T10:03:00.077297+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-07-20T10:03:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-07-20T10:03:06.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072073+0000', 'last_change': '2023-07-20T10:03:00.072073+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072073+0000', 'last_undegraded': '2023-07-20T10:03:00.072073+0000', 'last_fullsized': '2023-07-20T10:03:00.072073+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-07-20T10:03:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-07-20T10:03:06.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.073724+0000', 'last_change': '2023-07-20T10:03:00.073724+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.073724+0000', 'last_undegraded': '2023-07-20T10:03:00.073724+0000', 'last_fullsized': '2023-07-20T10:03:00.073724+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:03:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-07-20T10:03:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-07-20T10:03:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077326+0000', 'last_change': '2023-07-20T10:03:00.077326+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077326+0000', 'last_undegraded': '2023-07-20T10:03:00.077326+0000', 'last_fullsized': '2023-07-20T10:03:00.077326+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:03:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-07-20T10:03:06.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-07-20T10:03:06.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.074486+0000', 'last_change': '2023-07-20T10:03:00.074486+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.074486+0000', 'last_undegraded': '2023-07-20T10:03:00.074486+0000', 'last_fullsized': '2023-07-20T10:03:00.074486+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:03:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-07-20T10:03:06.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-07-20T10:03:06.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075952+0000', 'last_change': '2023-07-20T10:03:00.075952+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075952+0000', 'last_undegraded': '2023-07-20T10:03:00.075952+0000', 'last_fullsized': '2023-07-20T10:03:00.075952+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:03:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-20T10:03:06.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-07-20T10:03:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072592+0000', 'last_change': '2023-07-20T10:03:00.072592+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072592+0000', 'last_undegraded': '2023-07-20T10:03:00.072592+0000', 'last_fullsized': '2023-07-20T10:03:00.072592+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-07-20T10:03:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-07-20T10:03:06.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.076802+0000', 'last_change': '2023-07-20T10:03:00.076802+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.076802+0000', 'last_undegraded': '2023-07-20T10:03:00.076802+0000', 'last_fullsized': '2023-07-20T10:03:00.076802+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-20T10:03:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-07-20T10:03:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.073949+0000', 'last_change': '2023-07-20T10:03:00.073949+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.073949+0000', 'last_undegraded': '2023-07-20T10:03:00.073949+0000', 'last_fullsized': '2023-07-20T10:03:00.073949+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:03:06.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-20T10:03:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-07-20T10:03:06.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075312+0000', 'last_change': '2023-07-20T10:03:00.075312+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075312+0000', 'last_undegraded': '2023-07-20T10:03:00.075312+0000', 'last_fullsized': '2023-07-20T10:03:00.075312+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:03:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-20T10:03:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-07-20T10:03:06.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072095+0000', 'last_change': '2023-07-20T10:03:00.072095+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072095+0000', 'last_undegraded': '2023-07-20T10:03:00.072095+0000', 'last_fullsized': '2023-07-20T10:03:00.072095+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-07-20T10:03:06.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-07-20T10:03:06.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.068808+0000', 'last_change': '2023-07-20T10:03:00.068808+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.068808+0000', 'last_undegraded': '2023-07-20T10:03:00.068808+0000', 'last_fullsized': '2023-07-20T10:03:00.068808+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:03:06.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-07-20T10:03:06.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-07-20T10:03:06.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077145+0000', 'last_change': '2023-07-20T10:03:00.077145+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077145+0000', 'last_undegraded': '2023-07-20T10:03:00.077145+0000', 'last_fullsized': '2023-07-20T10:03:00.077145+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-07-20T10:03:06.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-07-20T10:03:06.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.076965+0000', 'last_change': '2023-07-20T10:03:00.076965+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.076965+0000', 'last_undegraded': '2023-07-20T10:03:00.076965+0000', 'last_fullsized': '2023-07-20T10:03:00.076965+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-20T10:03:06.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-07-20T10:03:06.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.074857+0000', 'last_change': '2023-07-20T10:03:00.074857+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.074857+0000', 'last_undegraded': '2023-07-20T10:03:00.074857+0000', 'last_fullsized': '2023-07-20T10:03:00.074857+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:03:06.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-07-20T10:03:06.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-07-20T10:03:06.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075822+0000', 'last_change': '2023-07-20T10:03:00.075822+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075822+0000', 'last_undegraded': '2023-07-20T10:03:00.075822+0000', 'last_fullsized': '2023-07-20T10:03:00.075822+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:03:06.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-07-20T10:03:06.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-07-20T10:03:06.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072106+0000', 'last_change': '2023-07-20T10:03:00.072106+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072106+0000', 'last_undegraded': '2023-07-20T10:03:00.072106+0000', 'last_fullsized': '2023-07-20T10:03:00.072106+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-07-20T10:03:06.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-07-20T10:03:06.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.068875+0000', 'last_change': '2023-07-20T10:03:00.068875+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.068875+0000', 'last_undegraded': '2023-07-20T10:03:00.068875+0000', 'last_fullsized': '2023-07-20T10:03:00.068875+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:03:06.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-07-20T10:03:06.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-07-20T10:03:06.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072417+0000', 'last_change': '2023-07-20T10:03:00.072417+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072417+0000', 'last_undegraded': '2023-07-20T10:03:00.072417+0000', 'last_fullsized': '2023-07-20T10:03:00.072417+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-07-20T10:03:06.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-07-20T10:03:06.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.073944+0000', 'last_change': '2023-07-20T10:03:00.073944+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.073944+0000', 'last_undegraded': '2023-07-20T10:03:00.073944+0000', 'last_fullsized': '2023-07-20T10:03:00.073944+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:03:06.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-20T10:03:06.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-07-20T10:03:06.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.072090+0000', 'last_change': '2023-07-20T10:03:00.072090+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.072090+0000', 'last_undegraded': '2023-07-20T10:03:00.072090+0000', 'last_fullsized': '2023-07-20T10:03:00.072090+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:03:06.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-07-20T10:03:06.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-07-20T10:03:06.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077317+0000', 'last_change': '2023-07-20T10:03:00.077317+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077317+0000', 'last_undegraded': '2023-07-20T10:03:00.077317+0000', 'last_fullsized': '2023-07-20T10:03:00.077317+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:03:06.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-20T10:03:06.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-07-20T10:03:06.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.077915+0000', 'last_change': '2023-07-20T10:03:00.077915+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.077915+0000', 'last_undegraded': '2023-07-20T10:03:00.077915+0000', 'last_fullsized': '2023-07-20T10:03:00.077915+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:03:06.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-20T10:03:06.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-07-20T10:03:06.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.073634+0000', 'last_change': '2023-07-20T10:03:00.073634+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.073634+0000', 'last_undegraded': '2023-07-20T10:03:00.073634+0000', 'last_fullsized': '2023-07-20T10:03:00.073634+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:03:06.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-20T10:03:06.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-07-20T10:03:06.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.076528+0000', 'last_change': '2023-07-20T10:03:00.076528+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.076528+0000', 'last_undegraded': '2023-07-20T10:03:00.076528+0000', 'last_fullsized': '2023-07-20T10:03:00.076528+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:03:06.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-20T10:03:06.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:03:01.065630+0000', 'last_change': '2023-07-20T10:03:01.065630+0000', 'last_active': '2023-07-20T10:03:01.065630+0000', 'last_peered': '2023-07-20T10:03:01.065630+0000', 'last_clean': '2023-07-20T10:03:01.065630+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:01.065630+0000', 'last_undegraded': '2023-07-20T10:03:01.065630+0000', 'last_fullsized': '2023-07-20T10:03:01.065630+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:01.065630+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:03:06.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-07-20T10:03:06.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 61, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:03:00.075364+0000', 'last_change': '2023-07-20T10:03:00.075364+0000', 'last_active': '2023-07-20T10:03:00.056217+0000', 'last_peered': '2023-07-20T10:03:00.056217+0000', 'last_clean': '2023-07-20T10:03:00.056217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:03:00.075364+0000', 'last_undegraded': '2023-07-20T10:03:00.075364+0000', 'last_fullsized': '2023-07-20T10:03:00.075364+0000', 'mapping_epoch': 61, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 61, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'last_clean_scrub_stamp': '2023-07-20T10:03:00.056217+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:03:07.000 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:03:07.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.150+0000 7f504bacb640 1 Processor -- start 2023-07-20T10:03:07.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.150+0000 7f504bacb640 1 -- start start 2023-07-20T10:03:07.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504bacb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50441596b0 0x7f504415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504bacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f50440ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504bacb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50440ccd90 con 0x7f50440cc900 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504bacb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50440ad600 con 0x7f50441596b0 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504bacb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50440ad810 con 0x7f50440b2a90 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50441596b0 0x7f504415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50441596b0 0x7f504415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43726/0 (socket says 172.21.15.82:43726) 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 -- 172.21.15.82:0/984076938 learned_addr learned my addr 172.21.15.82:0/984076938 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f504a068640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f50440ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 -- 172.21.15.82:0/984076938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 msgr2=0x7f50440ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f50440ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 -- 172.21.15.82:0/984076938 >> v1:172.21.15.183:6789/0 conn(0x7f50440cc900 legacy=0x7f50440b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 -- 172.21.15.82:0/984076938 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415d0d0 con 0x7f50441596b0 2023-07-20T10:03:07.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5049867640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50441596b0 0x7f504415dbb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50400098a0 tx=0x7f504001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212ab6e571f0b283 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5048865640 1 -- 172.21.15.82:0/984076938 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400aa650 con 0x7f50441596b0 2023-07-20T10:03:07.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5048865640 1 -- 172.21.15.82:0/984076938 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50400aa7b0 con 0x7f50441596b0 2023-07-20T10:03:07.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.154+0000 7f5048865640 1 -- 172.21.15.82:0/984076938 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400aab40 con 0x7f50441596b0 2023-07-20T10:03:07.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- 172.21.15.82:0/984076938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50441596b0 msgr2=0x7f504415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50441596b0 0x7f504415dbb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f50400098a0 tx=0x7f504001c4f0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- 172.21.15.82:0/984076938 shutdown_connections 2023-07-20T10:03:07.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f50440ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- 172.21.15.82:0/984076938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50441596b0 0x7f504415dbb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- 172.21.15.82:0/984076938 >> 172.21.15.82:0/984076938 conn(0x7f50440cada0 msgr2=0x7f50440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- 172.21.15.82:0/984076938 shutdown_connections 2023-07-20T10:03:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- 172.21.15.82:0/984076938 wait complete. 2023-07-20T10:03:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 Processor -- start 2023-07-20T10:03:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- start start 2023-07-20T10:03:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f5044150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50441596b0 0x7f5044153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044165e60 con 0x7f50440cc900 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044150c10 con 0x7f50441596b0 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504bacb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044165530 con 0x7f50440b2a90 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f5049066640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f5049066640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43740/0 (socket says 172.21.15.82:43740) 2023-07-20T10:03:07.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f5049066640 1 -- 172.21.15.82:0/528578441 learned_addr learned my addr 172.21.15.82:0/528578441 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:07.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f5049867640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f5044150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.158+0000 7f504a068640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50441596b0 0x7f5044153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 -- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 msgr2=0x7f5044150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f5044150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 -- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50441596b0 msgr2=0x7f5044153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50441596b0 0x7f5044153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 -- 172.21.15.82:0/528578441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400094d0 con 0x7f50440cc900 2023-07-20T10:03:07.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049066640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f503400c500 tx=0x7f503400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034005220 con 0x7f50440cc900 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5034005380 con 0x7f50440cc900 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034007270 con 0x7f50440cc900 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5044165810 con 0x7f50440cc900 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50441666b0 con 0x7f50440cc900 2023-07-20T10:03:07.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5044073c70 con 0x7f50440cc900 2023-07-20T10:03:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50340073d0 con 0x7f50440cc900 2023-07-20T10:03:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 0x7f5028068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50340836c0 con 0x7f50440cc900 2023-07-20T10:03:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.162+0000 7f5049867640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 0x7f5028068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.166+0000 7f5049867640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 0x7f5028068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50400ae000 tx=0x7f50400b5040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.166+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5034050a50 con 0x7f50440cc900 2023-07-20T10:03:07.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.366+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f50440ad3e0 con 0x7f50440cc900 2023-07-20T10:03:07.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.366+0000 7f503a7fc640 1 -- 172.21.15.82:0/528578441 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f5034054070 con 0x7f50440cc900 2023-07-20T10:03:07.356 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:07.356 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":786,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":64,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":307617792,"bytes_avail":772786495488,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5836}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-07-20T09:52:37.538084+0000","services":{}},"progress_events":{}} 2023-07-20T10:03:07.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 msgr2=0x7f5028068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 0x7f5028068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f50400ae000 tx=0x7f50400b5040 comp rx=0 tx=0).stop 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 msgr2=0x7f5044153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f503400c500 tx=0x7f503400c9c0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 shutdown_connections 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50441596b0 0x7f5044153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f50280663a0 0x7f5028068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50440cc900 0x7f5044153230 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 --2- 172.21.15.82:0/528578441 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50440b2a90 0x7f5044150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 >> 172.21.15.82:0/528578441 conn(0x7f50440cada0 msgr2=0x7f5044158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:07.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 shutdown_connections 2023-07-20T10:03:07.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.370+0000 7f504bacb640 1 -- 172.21.15.82:0/528578441 wait complete. 2023-07-20T10:03:07.376 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:03:07.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:03:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 Processor -- start 2023-07-20T10:03:07.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 -- start start 2023-07-20T10:03:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 0x7fe3180cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3180ad810 con 0x7fe3180b2a90 2023-07-20T10:03:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31815d0d0 con 0x7fe3181596b0 2023-07-20T10:03:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.526+0000 7fe31fd59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180cce40 con 0x7fe31815dbb0 2023-07-20T10:03:07.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31d2f4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe3180b2a90 0x7fe3180c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52590/0 (socket says 172.21.15.82:52590) 2023-07-20T10:03:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31d2f4640 1 -- 172.21.15.82:0/2620450073 learned_addr learned my addr 172.21.15.82:0/2620450073 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31e2f6640 1 --2- 172.21.15.82:0/2620450073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 0x7fe3180cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417553137 0 0) 0x7fe3180ad810 con 0x7fe3180b2a90 2023-07-20T10:03:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304003530 con 0x7fe3180b2a90 2023-07-20T10:03:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31e2f6640 1 -- 172.21.15.82:0/2620450073 >> v1:172.21.15.183:6789/0 conn(0x7fe3181596b0 legacy=0x7fe3180b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31e2f6640 1 -- 172.21.15.82:0/2620450073 >> v1:172.21.15.82:6789/0 conn(0x7fe3180b2a90 legacy=0x7fe3180c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853823636 0 0) 0x7fe304003530 con 0x7fe3180b2a90 2023-07-20T10:03:07.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31e2f6640 1 -- 172.21.15.82:0/2620450073 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31815d3b0 con 0x7fe31815dbb0 2023-07-20T10:03:07.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.530+0000 7fe31e2f6640 1 --2- 172.21.15.82:0/2620450073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 0x7fe3180cc900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe310009820 tx=0x7fe31001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e5c59642871bc5a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308001680 con 0x7fe31815dbb0 2023-07-20T10:03:07.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100a7050 con 0x7fe31815dbb0 2023-07-20T10:03:07.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31caf3640 1 -- 172.21.15.82:0/2620450073 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ab620 con 0x7fe31815dbb0 2023-07-20T10:03:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- 172.21.15.82:0/2620450073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 msgr2=0x7fe3180cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 --2- 172.21.15.82:0/2620450073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 0x7fe3180cc900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe310009820 tx=0x7fe31001c390 comp rx=0 tx=0).stop 2023-07-20T10:03:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- 172.21.15.82:0/2620450073 shutdown_connections 2023-07-20T10:03:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 --2- 172.21.15.82:0/2620450073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe31815dbb0 0x7fe3180cc900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- 172.21.15.82:0/2620450073 >> 172.21.15.82:0/2620450073 conn(0x7fe3180cada0 msgr2=0x7fe3180cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- 172.21.15.82:0/2620450073 shutdown_connections 2023-07-20T10:03:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- 172.21.15.82:0/2620450073 wait complete. 2023-07-20T10:03:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 Processor -- start 2023-07-20T10:03:07.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- start start 2023-07-20T10:03:07.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3180b2a90 0x7fe3180abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe31815dbb0 0x7fe31814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180acf20 con 0x7fe3181596b0 2023-07-20T10:03:07.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3181560a0 con 0x7fe31815dbb0 2023-07-20T10:03:07.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31fd59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe318156380 con 0x7fe3180b2a90 2023-07-20T10:03:07.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31d2f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31d2f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43746/0 (socket says 172.21.15.82:43746) 2023-07-20T10:03:07.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31d2f4640 1 -- 172.21.15.82:0/943510908 learned_addr learned my addr 172.21.15.82:0/943510908 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:07.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31daf5640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3180b2a90 0x7fe3180abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.534+0000 7fe31e2f6640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe31815dbb0 0x7fe31814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 -- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3180b2a90 msgr2=0x7fe3180abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3180b2a90 0x7fe3180abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 -- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe31815dbb0 msgr2=0x7fe31814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe31815dbb0 0x7fe31814e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 -- 172.21.15.82:0/943510908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009420 con 0x7fe3181596b0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31d2f4640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c6b0 tx=0x7fe30800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308005cf0 con 0x7fe3181596b0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308005e50 con 0x7fe3181596b0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308007290 con 0x7fe3181596b0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe318156660 con 0x7fe3181596b0 2023-07-20T10:03:07.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3180ac360 con 0x7fe3181596b0 2023-07-20T10:03:07.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe318156b80 con 0x7fe3181596b0 2023-07-20T10:03:07.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.538+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3080073f0 con 0x7fe3181596b0 2023-07-20T10:03:07.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.542+0000 7fe30e7fc640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 0x7fe2fc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:07.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.542+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe308083560 con 0x7fe3181596b0 2023-07-20T10:03:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.542+0000 7fe31daf5640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 0x7fe2fc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.542+0000 7fe31daf5640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 0x7fe2fc068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ab520 tx=0x7fe314009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:07.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.546+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe318156b80 con 0x7fe3181596b0 2023-07-20T10:03:07.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.686+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3180ad4d0 con 0x7fe2fc0663a0 2023-07-20T10:03:07.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.694+0000 7fe30e7fc640 1 -- 172.21.15.82:0/943510908 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311088 (secure 0 0 0) 0x7fe314002040 con 0x7fe2fc0663a0 2023-07-20T10:03:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:07.688 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:03:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 msgr2=0x7fe2fc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 0x7fe2fc068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ab520 tx=0x7fe314009040 comp rx=0 tx=0).stop 2023-07-20T10:03:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 msgr2=0x7fe318154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe30800c6b0 tx=0x7fe30800cab0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 shutdown_connections 2023-07-20T10:03:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe31815dbb0 0x7fe31814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fe2fc0663a0 0x7fe2fc068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3181596b0 0x7fe318154220 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 --2- 172.21.15.82:0/943510908 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3180b2a90 0x7fe3180abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 >> 172.21.15.82:0/943510908 conn(0x7fe3180cada0 msgr2=0x7fe3181673a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 shutdown_connections 2023-07-20T10:03:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:07.698+0000 7fe31fd59640 1 -- 172.21.15.82:0/943510908 wait complete. 2023-07-20T10:03:07.706 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:03:06.954560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300408,"kb_used_data":7176,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754674312,"statfs":{"total":773094113280,"available":772786495488,"internally_reserved":0,"allocated":7348224,"data_stored":4171340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001411"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891772+0000","last_change":"2023-07-20T10:03:01.904635+0000","last_active":"2023-07-20T10:03:02.891772+0000","last_peered":"2023-07-20T10:03:02.891772+0000","last_clean":"2023-07-20T10:03:02.891772+0000","last_became_active":"2023-07-20T10:03:01.904268+0000","last_became_peered":"2023-07-20T10:03:01.904268+0000","last_unstale":"2023-07-20T10:03:02.891772+0000","last_undegraded":"2023-07-20T10:03:02.891772+0000","last_fullsized":"2023-07-20T10:03:02.891772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:55.907626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578622+0000","last_change":"2023-07-20T10:03:01.908723+0000","last_active":"2023-07-20T10:03:04.578622+0000","last_peered":"2023-07-20T10:03:04.578622+0000","last_clean":"2023-07-20T10:03:04.578622+0000","last_became_active":"2023-07-20T10:03:01.908098+0000","last_became_peered":"2023-07-20T10:03:01.908098+0000","last_unstale":"2023-07-20T10:03:04.578622+0000","last_undegraded":"2023-07-20T10:03:04.578622+0000","last_fullsized":"2023-07-20T10:03:04.578622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:18.110300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739174+0000","last_change":"2023-07-20T10:03:01.910101+0000","last_active":"2023-07-20T10:03:03.739174+0000","last_peered":"2023-07-20T10:03:03.739174+0000","last_clean":"2023-07-20T10:03:03.739174+0000","last_became_active":"2023-07-20T10:03:01.907378+0000","last_became_peered":"2023-07-20T10:03:01.907378+0000","last_unstale":"2023-07-20T10:03:03.739174+0000","last_undegraded":"2023-07-20T10:03:03.739174+0000","last_fullsized":"2023-07-20T10:03:03.739174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:20.253957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578683+0000","last_change":"2023-07-20T10:03:01.913635+0000","last_active":"2023-07-20T10:03:04.578683+0000","last_peered":"2023-07-20T10:03:04.578683+0000","last_clean":"2023-07-20T10:03:04.578683+0000","last_became_active":"2023-07-20T10:03:01.913357+0000","last_became_peered":"2023-07-20T10:03:01.913357+0000","last_unstale":"2023-07-20T10:03:04.578683+0000","last_undegraded":"2023-07-20T10:03:04.578683+0000","last_fullsized":"2023-07-20T10:03:04.578683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:38.586300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881117+0000","last_change":"2023-07-20T10:03:01.904830+0000","last_active":"2023-07-20T10:03:04.881117+0000","last_peered":"2023-07-20T10:03:04.881117+0000","last_clean":"2023-07-20T10:03:04.881117+0000","last_became_active":"2023-07-20T10:03:01.904556+0000","last_became_peered":"2023-07-20T10:03:01.904556+0000","last_unstale":"2023-07-20T10:03:04.881117+0000","last_undegraded":"2023-07-20T10:03:04.881117+0000","last_fullsized":"2023-07-20T10:03:04.881117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:46.834429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891921+0000","last_change":"2023-07-20T10:03:01.903593+0000","last_active":"2023-07-20T10:03:02.891921+0000","last_peered":"2023-07-20T10:03:02.891921+0000","last_clean":"2023-07-20T10:03:02.891921+0000","last_became_active":"2023-07-20T10:03:01.903272+0000","last_became_peered":"2023-07-20T10:03:01.903272+0000","last_unstale":"2023-07-20T10:03:02.891921+0000","last_undegraded":"2023-07-20T10:03:02.891921+0000","last_fullsized":"2023-07-20T10:03:02.891921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:17.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738790+0000","last_change":"2023-07-20T10:03:01.911003+0000","last_active":"2023-07-20T10:03:03.738790+0000","last_peered":"2023-07-20T10:03:03.738790+0000","last_clean":"2023-07-20T10:03:03.738790+0000","last_became_active":"2023-07-20T10:03:01.910677+0000","last_became_peered":"2023-07-20T10:03:01.910677+0000","last_unstale":"2023-07-20T10:03:03.738790+0000","last_undegraded":"2023-07-20T10:03:03.738790+0000","last_fullsized":"2023-07-20T10:03:03.738790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:04.651371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889746+0000","last_change":"2023-07-20T10:03:01.904858+0000","last_active":"2023-07-20T10:03:02.889746+0000","last_peered":"2023-07-20T10:03:02.889746+0000","last_clean":"2023-07-20T10:03:02.889746+0000","last_became_active":"2023-07-20T10:03:01.904594+0000","last_became_peered":"2023-07-20T10:03:01.904594+0000","last_unstale":"2023-07-20T10:03:02.889746+0000","last_undegraded":"2023-07-20T10:03:02.889746+0000","last_fullsized":"2023-07-20T10:03:02.889746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:55.907626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890427+0000","last_change":"2023-07-20T10:03:01.910579+0000","last_active":"2023-07-20T10:03:02.890427+0000","last_peered":"2023-07-20T10:03:02.890427+0000","last_clean":"2023-07-20T10:03:02.890427+0000","last_became_active":"2023-07-20T10:03:01.910313+0000","last_became_peered":"2023-07-20T10:03:01.910313+0000","last_unstale":"2023-07-20T10:03:02.890427+0000","last_undegraded":"2023-07-20T10:03:02.890427+0000","last_fullsized":"2023-07-20T10:03:02.890427+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:37:09.281104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891633+0000","last_change":"2023-07-20T10:03:01.900712+0000","last_active":"2023-07-20T10:03:02.891633+0000","last_peered":"2023-07-20T10:03:02.891633+0000","last_clean":"2023-07-20T10:03:02.891633+0000","last_became_active":"2023-07-20T10:03:01.900378+0000","last_became_peered":"2023-07-20T10:03:01.900378+0000","last_unstale":"2023-07-20T10:03:02.891633+0000","last_undegraded":"2023-07-20T10:03:02.891633+0000","last_fullsized":"2023-07-20T10:03:02.891633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:02:17.958109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135934+0000","last_change":"2023-07-20T10:03:01.910137+0000","last_active":"2023-07-20T10:03:03.135934+0000","last_peered":"2023-07-20T10:03:03.135934+0000","last_clean":"2023-07-20T10:03:03.135934+0000","last_became_active":"2023-07-20T10:03:01.909870+0000","last_became_peered":"2023-07-20T10:03:01.909870+0000","last_unstale":"2023-07-20T10:03:03.135934+0000","last_undegraded":"2023-07-20T10:03:03.135934+0000","last_fullsized":"2023-07-20T10:03:03.135934+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:46:06.009954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890034+0000","last_change":"2023-07-20T10:03:01.899792+0000","last_active":"2023-07-20T10:03:02.890034+0000","last_peered":"2023-07-20T10:03:02.890034+0000","last_clean":"2023-07-20T10:03:02.890034+0000","last_became_active":"2023-07-20T10:03:01.899534+0000","last_became_peered":"2023-07-20T10:03:01.899534+0000","last_unstale":"2023-07-20T10:03:02.890034+0000","last_undegraded":"2023-07-20T10:03:02.890034+0000","last_fullsized":"2023-07-20T10:03:02.890034+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:38:51.773098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891593+0000","last_change":"2023-07-20T10:03:01.900806+0000","last_active":"2023-07-20T10:03:02.891593+0000","last_peered":"2023-07-20T10:03:02.891593+0000","last_clean":"2023-07-20T10:03:02.891593+0000","last_became_active":"2023-07-20T10:03:01.900466+0000","last_became_peered":"2023-07-20T10:03:01.900466+0000","last_unstale":"2023-07-20T10:03:02.891593+0000","last_undegraded":"2023-07-20T10:03:02.891593+0000","last_fullsized":"2023-07-20T10:03:02.891593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:18:03.950677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738843+0000","last_change":"2023-07-20T10:03:01.914246+0000","last_active":"2023-07-20T10:03:03.738843+0000","last_peered":"2023-07-20T10:03:03.738843+0000","last_clean":"2023-07-20T10:03:03.738843+0000","last_became_active":"2023-07-20T10:03:01.913934+0000","last_became_peered":"2023-07-20T10:03:01.913934+0000","last_unstale":"2023-07-20T10:03:03.738843+0000","last_undegraded":"2023-07-20T10:03:03.738843+0000","last_fullsized":"2023-07-20T10:03:03.738843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:23:54.938805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578253+0000","last_change":"2023-07-20T10:03:01.910515+0000","last_active":"2023-07-20T10:03:04.578253+0000","last_peered":"2023-07-20T10:03:04.578253+0000","last_clean":"2023-07-20T10:03:04.578253+0000","last_became_active":"2023-07-20T10:03:01.910227+0000","last_became_peered":"2023-07-20T10:03:01.910227+0000","last_unstale":"2023-07-20T10:03:04.578253+0000","last_undegraded":"2023-07-20T10:03:04.578253+0000","last_fullsized":"2023-07-20T10:03:04.578253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:58.241180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891481+0000","last_change":"2023-07-20T10:03:01.901927+0000","last_active":"2023-07-20T10:03:02.891481+0000","last_peered":"2023-07-20T10:03:02.891481+0000","last_clean":"2023-07-20T10:03:02.891481+0000","last_became_active":"2023-07-20T10:03:01.901645+0000","last_became_peered":"2023-07-20T10:03:01.901645+0000","last_unstale":"2023-07-20T10:03:02.891481+0000","last_undegraded":"2023-07-20T10:03:02.891481+0000","last_fullsized":"2023-07-20T10:03:02.891481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:36.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739309+0000","last_change":"2023-07-20T10:03:01.909940+0000","last_active":"2023-07-20T10:03:03.739309+0000","last_peered":"2023-07-20T10:03:03.739309+0000","last_clean":"2023-07-20T10:03:03.739309+0000","last_became_active":"2023-07-20T10:03:01.906461+0000","last_became_peered":"2023-07-20T10:03:01.906461+0000","last_unstale":"2023-07-20T10:03:03.739309+0000","last_undegraded":"2023-07-20T10:03:03.739309+0000","last_fullsized":"2023-07-20T10:03:03.739309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:54:44.773912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578752+0000","last_change":"2023-07-20T10:03:01.908922+0000","last_active":"2023-07-20T10:03:04.578752+0000","last_peered":"2023-07-20T10:03:04.578752+0000","last_clean":"2023-07-20T10:03:04.578752+0000","last_became_active":"2023-07-20T10:03:01.908429+0000","last_became_peered":"2023-07-20T10:03:01.908429+0000","last_unstale":"2023-07-20T10:03:04.578752+0000","last_undegraded":"2023-07-20T10:03:04.578752+0000","last_fullsized":"2023-07-20T10:03:04.578752+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:03.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739327+0000","last_change":"2023-07-20T10:03:01.905290+0000","last_active":"2023-07-20T10:03:03.739327+0000","last_peered":"2023-07-20T10:03:03.739327+0000","last_clean":"2023-07-20T10:03:03.739327+0000","last_became_active":"2023-07-20T10:03:01.904763+0000","last_became_peered":"2023-07-20T10:03:01.904763+0000","last_unstale":"2023-07-20T10:03:03.739327+0000","last_undegraded":"2023-07-20T10:03:03.739327+0000","last_fullsized":"2023-07-20T10:03:03.739327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:12.025713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894251+0000","last_change":"2023-07-20T10:03:01.906268+0000","last_active":"2023-07-20T10:03:04.894251+0000","last_peered":"2023-07-20T10:03:04.894251+0000","last_clean":"2023-07-20T10:03:04.894251+0000","last_became_active":"2023-07-20T10:03:01.905362+0000","last_became_peered":"2023-07-20T10:03:01.905362+0000","last_unstale":"2023-07-20T10:03:04.894251+0000","last_undegraded":"2023-07-20T10:03:04.894251+0000","last_fullsized":"2023-07-20T10:03:04.894251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:59.676420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894301+0000","last_change":"2023-07-20T10:03:01.906626+0000","last_active":"2023-07-20T10:03:04.894301+0000","last_peered":"2023-07-20T10:03:04.894301+0000","last_clean":"2023-07-20T10:03:04.894301+0000","last_became_active":"2023-07-20T10:03:01.906317+0000","last_became_peered":"2023-07-20T10:03:01.906317+0000","last_unstale":"2023-07-20T10:03:04.894301+0000","last_undegraded":"2023-07-20T10:03:04.894301+0000","last_fullsized":"2023-07-20T10:03:04.894301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:22:59.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889765+0000","last_change":"2023-07-20T10:03:01.914705+0000","last_active":"2023-07-20T10:03:02.889765+0000","last_peered":"2023-07-20T10:03:02.889765+0000","last_clean":"2023-07-20T10:03:02.889765+0000","last_became_active":"2023-07-20T10:03:01.914398+0000","last_became_peered":"2023-07-20T10:03:01.914398+0000","last_unstale":"2023-07-20T10:03:02.889765+0000","last_undegraded":"2023-07-20T10:03:02.889765+0000","last_fullsized":"2023-07-20T10:03:02.889765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:06.586058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135711+0000","last_change":"2023-07-20T10:03:01.902998+0000","last_active":"2023-07-20T10:03:03.135711+0000","last_peered":"2023-07-20T10:03:03.135711+0000","last_clean":"2023-07-20T10:03:03.135711+0000","last_became_active":"2023-07-20T10:03:01.902707+0000","last_became_peered":"2023-07-20T10:03:01.902707+0000","last_unstale":"2023-07-20T10:03:03.135711+0000","last_undegraded":"2023-07-20T10:03:03.135711+0000","last_fullsized":"2023-07-20T10:03:03.135711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:01:36.705845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738637+0000","last_change":"2023-07-20T10:03:01.909989+0000","last_active":"2023-07-20T10:03:03.738637+0000","last_peered":"2023-07-20T10:03:03.738637+0000","last_clean":"2023-07-20T10:03:03.738637+0000","last_became_active":"2023-07-20T10:03:01.906822+0000","last_became_peered":"2023-07-20T10:03:01.906822+0000","last_unstale":"2023-07-20T10:03:03.738637+0000","last_undegraded":"2023-07-20T10:03:03.738637+0000","last_fullsized":"2023-07-20T10:03:03.738637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:02:02.524110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739278+0000","last_change":"2023-07-20T10:03:01.910914+0000","last_active":"2023-07-20T10:03:03.739278+0000","last_peered":"2023-07-20T10:03:03.739278+0000","last_clean":"2023-07-20T10:03:03.739278+0000","last_became_active":"2023-07-20T10:03:01.910638+0000","last_became_peered":"2023-07-20T10:03:01.910638+0000","last_unstale":"2023-07-20T10:03:03.739278+0000","last_undegraded":"2023-07-20T10:03:03.739278+0000","last_fullsized":"2023-07-20T10:03:03.739278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:46.834429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890263+0000","last_change":"2023-07-20T10:03:01.908136+0000","last_active":"2023-07-20T10:03:02.890263+0000","last_peered":"2023-07-20T10:03:02.890263+0000","last_clean":"2023-07-20T10:03:02.890263+0000","last_became_active":"2023-07-20T10:03:01.907844+0000","last_became_peered":"2023-07-20T10:03:01.907844+0000","last_unstale":"2023-07-20T10:03:02.890263+0000","last_undegraded":"2023-07-20T10:03:02.890263+0000","last_fullsized":"2023-07-20T10:03:02.890263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:10:58.734231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891923+0000","last_change":"2023-07-20T10:03:01.905950+0000","last_active":"2023-07-20T10:03:02.891923+0000","last_peered":"2023-07-20T10:03:02.891923+0000","last_clean":"2023-07-20T10:03:02.891923+0000","last_became_active":"2023-07-20T10:03:01.905572+0000","last_became_peered":"2023-07-20T10:03:01.905572+0000","last_unstale":"2023-07-20T10:03:02.891923+0000","last_undegraded":"2023-07-20T10:03:02.891923+0000","last_fullsized":"2023-07-20T10:03:02.891923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:32:48.717710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894297+0000","last_change":"2023-07-20T10:03:01.894731+0000","last_active":"2023-07-20T10:03:04.894297+0000","last_peered":"2023-07-20T10:03:04.894297+0000","last_clean":"2023-07-20T10:03:04.894297+0000","last_became_active":"2023-07-20T10:03:01.894385+0000","last_became_peered":"2023-07-20T10:03:01.894385+0000","last_unstale":"2023-07-20T10:03:04.894297+0000","last_undegraded":"2023-07-20T10:03:04.894297+0000","last_fullsized":"2023-07-20T10:03:04.894297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:53:57.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738839+0000","last_change":"2023-07-20T10:03:01.907402+0000","last_active":"2023-07-20T10:03:03.738839+0000","last_peered":"2023-07-20T10:03:03.738839+0000","last_clean":"2023-07-20T10:03:03.738839+0000","last_became_active":"2023-07-20T10:03:01.906614+0000","last_became_peered":"2023-07-20T10:03:01.906614+0000","last_unstale":"2023-07-20T10:03:03.738839+0000","last_undegraded":"2023-07-20T10:03:03.738839+0000","last_fullsized":"2023-07-20T10:03:03.738839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:22.852895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578528+0000","last_change":"2023-07-20T10:03:01.911071+0000","last_active":"2023-07-20T10:03:04.578528+0000","last_peered":"2023-07-20T10:03:04.578528+0000","last_clean":"2023-07-20T10:03:04.578528+0000","last_became_active":"2023-07-20T10:03:01.910788+0000","last_became_peered":"2023-07-20T10:03:01.910788+0000","last_unstale":"2023-07-20T10:03:04.578528+0000","last_undegraded":"2023-07-20T10:03:04.578528+0000","last_fullsized":"2023-07-20T10:03:04.578528+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:39.566415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738723+0000","last_change":"2023-07-20T10:03:01.907434+0000","last_active":"2023-07-20T10:03:03.738723+0000","last_peered":"2023-07-20T10:03:03.738723+0000","last_clean":"2023-07-20T10:03:03.738723+0000","last_became_active":"2023-07-20T10:03:01.907133+0000","last_became_peered":"2023-07-20T10:03:01.907133+0000","last_unstale":"2023-07-20T10:03:03.738723+0000","last_undegraded":"2023-07-20T10:03:03.738723+0000","last_fullsized":"2023-07-20T10:03:03.738723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:48:01.996101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892909+0000","last_change":"2023-07-20T10:03:01.914834+0000","last_active":"2023-07-20T10:03:02.892909+0000","last_peered":"2023-07-20T10:03:02.892909+0000","last_clean":"2023-07-20T10:03:02.892909+0000","last_became_active":"2023-07-20T10:03:01.912955+0000","last_became_peered":"2023-07-20T10:03:01.912955+0000","last_unstale":"2023-07-20T10:03:02.892909+0000","last_undegraded":"2023-07-20T10:03:02.892909+0000","last_fullsized":"2023-07-20T10:03:02.892909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:03.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578146+0000","last_change":"2023-07-20T10:03:01.915988+0000","last_active":"2023-07-20T10:03:04.578146+0000","last_peered":"2023-07-20T10:03:04.578146+0000","last_clean":"2023-07-20T10:03:04.578146+0000","last_became_active":"2023-07-20T10:03:01.915713+0000","last_became_peered":"2023-07-20T10:03:01.915713+0000","last_unstale":"2023-07-20T10:03:04.578146+0000","last_undegraded":"2023-07-20T10:03:04.578146+0000","last_fullsized":"2023-07-20T10:03:04.578146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:04:40.033130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"63'4","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894372+0000","last_change":"2023-07-20T10:03:01.099191+0000","last_active":"2023-07-20T10:03:04.894372+0000","last_peered":"2023-07-20T10:03:04.894372+0000","last_clean":"2023-07-20T10:03:04.894372+0000","last_became_active":"2023-07-20T10:03:01.098882+0000","last_became_peered":"2023-07-20T10:03:01.098882+0000","last_unstale":"2023-07-20T10:03:04.894372+0000","last_undegraded":"2023-07-20T10:03:04.894372+0000","last_fullsized":"2023-07-20T10:03:04.894372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:32.845778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892830+0000","last_change":"2023-07-20T10:03:01.912246+0000","last_active":"2023-07-20T10:03:02.892830+0000","last_peered":"2023-07-20T10:03:02.892830+0000","last_clean":"2023-07-20T10:03:02.892830+0000","last_became_active":"2023-07-20T10:03:01.911888+0000","last_became_peered":"2023-07-20T10:03:01.911888+0000","last_unstale":"2023-07-20T10:03:02.892830+0000","last_undegraded":"2023-07-20T10:03:02.892830+0000","last_fullsized":"2023-07-20T10:03:02.892830+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:10.980738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891726+0000","last_change":"2023-07-20T10:03:01.098083+0000","last_active":"2023-07-20T10:03:02.891726+0000","last_peered":"2023-07-20T10:03:02.891726+0000","last_clean":"2023-07-20T10:03:02.891726+0000","last_became_active":"2023-07-20T10:03:01.097809+0000","last_became_peered":"2023-07-20T10:03:01.097809+0000","last_unstale":"2023-07-20T10:03:02.891726+0000","last_undegraded":"2023-07-20T10:03:02.891726+0000","last_fullsized":"2023-07-20T10:03:02.891726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:25.891688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894062+0000","last_change":"2023-07-20T10:03:01.907197+0000","last_active":"2023-07-20T10:03:04.894062+0000","last_peered":"2023-07-20T10:03:04.894062+0000","last_clean":"2023-07-20T10:03:04.894062+0000","last_became_active":"2023-07-20T10:03:01.906856+0000","last_became_peered":"2023-07-20T10:03:01.906856+0000","last_unstale":"2023-07-20T10:03:04.894062+0000","last_undegraded":"2023-07-20T10:03:04.894062+0000","last_fullsized":"2023-07-20T10:03:04.894062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:26.372830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891894+0000","last_change":"2023-07-20T10:03:01.098834+0000","last_active":"2023-07-20T10:03:02.891894+0000","last_peered":"2023-07-20T10:03:02.891894+0000","last_clean":"2023-07-20T10:03:02.891894+0000","last_became_active":"2023-07-20T10:03:01.098508+0000","last_became_peered":"2023-07-20T10:03:01.098508+0000","last_unstale":"2023-07-20T10:03:02.891894+0000","last_undegraded":"2023-07-20T10:03:02.891894+0000","last_fullsized":"2023-07-20T10:03:02.891894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:45.261033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890065+0000","last_change":"2023-07-20T10:03:01.908145+0000","last_active":"2023-07-20T10:03:02.890065+0000","last_peered":"2023-07-20T10:03:02.890065+0000","last_clean":"2023-07-20T10:03:02.890065+0000","last_became_active":"2023-07-20T10:03:01.907825+0000","last_became_peered":"2023-07-20T10:03:01.907825+0000","last_unstale":"2023-07-20T10:03:02.890065+0000","last_undegraded":"2023-07-20T10:03:02.890065+0000","last_fullsized":"2023-07-20T10:03:02.890065+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:58.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893037+0000","last_change":"2023-07-20T10:03:01.099685+0000","last_active":"2023-07-20T10:03:02.893037+0000","last_peered":"2023-07-20T10:03:02.893037+0000","last_clean":"2023-07-20T10:03:02.893037+0000","last_became_active":"2023-07-20T10:03:01.099391+0000","last_became_peered":"2023-07-20T10:03:01.099391+0000","last_unstale":"2023-07-20T10:03:02.893037+0000","last_undegraded":"2023-07-20T10:03:02.893037+0000","last_fullsized":"2023-07-20T10:03:02.893037+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:15.668501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881298+0000","last_change":"2023-07-20T10:03:01.906484+0000","last_active":"2023-07-20T10:03:04.881298+0000","last_peered":"2023-07-20T10:03:04.881298+0000","last_clean":"2023-07-20T10:03:04.881298+0000","last_became_active":"2023-07-20T10:03:01.906205+0000","last_became_peered":"2023-07-20T10:03:01.906205+0000","last_unstale":"2023-07-20T10:03:04.881298+0000","last_undegraded":"2023-07-20T10:03:04.881298+0000","last_fullsized":"2023-07-20T10:03:04.881298+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:47:15.073042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738837+0000","last_change":"2023-07-20T10:03:01.102430+0000","last_active":"2023-07-20T10:03:03.738837+0000","last_peered":"2023-07-20T10:03:03.738837+0000","last_clean":"2023-07-20T10:03:03.738837+0000","last_became_active":"2023-07-20T10:03:01.102170+0000","last_became_peered":"2023-07-20T10:03:01.102170+0000","last_unstale":"2023-07-20T10:03:03.738837+0000","last_undegraded":"2023-07-20T10:03:03.738837+0000","last_fullsized":"2023-07-20T10:03:03.738837+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:52.902925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578456+0000","last_change":"2023-07-20T10:03:01.912608+0000","last_active":"2023-07-20T10:03:04.578456+0000","last_peered":"2023-07-20T10:03:04.578456+0000","last_clean":"2023-07-20T10:03:04.578456+0000","last_became_active":"2023-07-20T10:03:01.911084+0000","last_became_peered":"2023-07-20T10:03:01.911084+0000","last_unstale":"2023-07-20T10:03:04.578456+0000","last_undegraded":"2023-07-20T10:03:04.578456+0000","last_fullsized":"2023-07-20T10:03:04.578456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:08:20.555673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880984+0000","last_change":"2023-07-20T10:03:01.100480+0000","last_active":"2023-07-20T10:03:04.880984+0000","last_peered":"2023-07-20T10:03:04.880984+0000","last_clean":"2023-07-20T10:03:04.880984+0000","last_became_active":"2023-07-20T10:03:01.100031+0000","last_became_peered":"2023-07-20T10:03:01.100031+0000","last_unstale":"2023-07-20T10:03:04.880984+0000","last_undegraded":"2023-07-20T10:03:04.880984+0000","last_fullsized":"2023-07-20T10:03:04.880984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:05.575026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890393+0000","last_change":"2023-07-20T10:03:01.904588+0000","last_active":"2023-07-20T10:03:02.890393+0000","last_peered":"2023-07-20T10:03:02.890393+0000","last_clean":"2023-07-20T10:03:02.890393+0000","last_became_active":"2023-07-20T10:03:01.904307+0000","last_became_peered":"2023-07-20T10:03:01.904307+0000","last_unstale":"2023-07-20T10:03:02.890393+0000","last_undegraded":"2023-07-20T10:03:02.890393+0000","last_fullsized":"2023-07-20T10:03:02.890393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:04.122297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894096+0000","last_change":"2023-07-20T10:03:01.104574+0000","last_active":"2023-07-20T10:03:04.894096+0000","last_peered":"2023-07-20T10:03:04.894096+0000","last_clean":"2023-07-20T10:03:04.894096+0000","last_became_active":"2023-07-20T10:03:01.104272+0000","last_became_peered":"2023-07-20T10:03:01.104272+0000","last_unstale":"2023-07-20T10:03:04.894096+0000","last_undegraded":"2023-07-20T10:03:04.894096+0000","last_fullsized":"2023-07-20T10:03:04.894096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:31:43.418139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578817+0000","last_change":"2023-07-20T10:03:01.918641+0000","last_active":"2023-07-20T10:03:04.578817+0000","last_peered":"2023-07-20T10:03:04.578817+0000","last_clean":"2023-07-20T10:03:04.578817+0000","last_became_active":"2023-07-20T10:03:01.918352+0000","last_became_peered":"2023-07-20T10:03:01.918352+0000","last_unstale":"2023-07-20T10:03:04.578817+0000","last_undegraded":"2023-07-20T10:03:04.578817+0000","last_fullsized":"2023-07-20T10:03:04.578817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:27.628777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738636+0000","last_change":"2023-07-20T10:03:01.099804+0000","last_active":"2023-07-20T10:03:03.738636+0000","last_peered":"2023-07-20T10:03:03.738636+0000","last_clean":"2023-07-20T10:03:03.738636+0000","last_became_active":"2023-07-20T10:03:01.099553+0000","last_became_peered":"2023-07-20T10:03:01.099553+0000","last_unstale":"2023-07-20T10:03:03.738636+0000","last_undegraded":"2023-07-20T10:03:03.738636+0000","last_fullsized":"2023-07-20T10:03:03.738636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:50.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880930+0000","last_change":"2023-07-20T10:03:01.912519+0000","last_active":"2023-07-20T10:03:04.880930+0000","last_peered":"2023-07-20T10:03:04.880930+0000","last_clean":"2023-07-20T10:03:04.880930+0000","last_became_active":"2023-07-20T10:03:01.912185+0000","last_became_peered":"2023-07-20T10:03:01.912185+0000","last_unstale":"2023-07-20T10:03:04.880930+0000","last_undegraded":"2023-07-20T10:03:04.880930+0000","last_fullsized":"2023-07-20T10:03:04.880930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:41.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578694+0000","last_change":"2023-07-20T10:03:01.098913+0000","last_active":"2023-07-20T10:03:04.578694+0000","last_peered":"2023-07-20T10:03:04.578694+0000","last_clean":"2023-07-20T10:03:04.578694+0000","last_became_active":"2023-07-20T10:03:01.098568+0000","last_became_peered":"2023-07-20T10:03:01.098568+0000","last_unstale":"2023-07-20T10:03:04.578694+0000","last_undegraded":"2023-07-20T10:03:04.578694+0000","last_fullsized":"2023-07-20T10:03:04.578694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:00:10.166845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892881+0000","last_change":"2023-07-20T10:03:01.905613+0000","last_active":"2023-07-20T10:03:02.892881+0000","last_peered":"2023-07-20T10:03:02.892881+0000","last_clean":"2023-07-20T10:03:02.892881+0000","last_became_active":"2023-07-20T10:03:01.905325+0000","last_became_peered":"2023-07-20T10:03:01.905325+0000","last_unstale":"2023-07-20T10:03:02.892881+0000","last_undegraded":"2023-07-20T10:03:02.892881+0000","last_fullsized":"2023-07-20T10:03:02.892881+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:00:11.176258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881334+0000","last_change":"2023-07-20T10:03:01.101064+0000","last_active":"2023-07-20T10:03:04.881334+0000","last_peered":"2023-07-20T10:03:04.881334+0000","last_clean":"2023-07-20T10:03:04.881334+0000","last_became_active":"2023-07-20T10:03:01.100750+0000","last_became_peered":"2023-07-20T10:03:01.100750+0000","last_unstale":"2023-07-20T10:03:04.881334+0000","last_undegraded":"2023-07-20T10:03:04.881334+0000","last_fullsized":"2023-07-20T10:03:04.881334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:11.016300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739116+0000","last_change":"2023-07-20T10:03:01.907386+0000","last_active":"2023-07-20T10:03:03.739116+0000","last_peered":"2023-07-20T10:03:03.739116+0000","last_clean":"2023-07-20T10:03:03.739116+0000","last_became_active":"2023-07-20T10:03:01.906832+0000","last_became_peered":"2023-07-20T10:03:01.906832+0000","last_unstale":"2023-07-20T10:03:03.739116+0000","last_undegraded":"2023-07-20T10:03:03.739116+0000","last_fullsized":"2023-07-20T10:03:03.739116+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:41.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"63'3","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578575+0000","last_change":"2023-07-20T10:03:01.102672+0000","last_active":"2023-07-20T10:03:04.578575+0000","last_peered":"2023-07-20T10:03:04.578575+0000","last_clean":"2023-07-20T10:03:04.578575+0000","last_became_active":"2023-07-20T10:03:01.102358+0000","last_became_peered":"2023-07-20T10:03:01.102358+0000","last_unstale":"2023-07-20T10:03:04.578575+0000","last_undegraded":"2023-07-20T10:03:04.578575+0000","last_fullsized":"2023-07-20T10:03:04.578575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:36:36.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881201+0000","last_change":"2023-07-20T10:03:01.908640+0000","last_active":"2023-07-20T10:03:04.881201+0000","last_peered":"2023-07-20T10:03:04.881201+0000","last_clean":"2023-07-20T10:03:04.881201+0000","last_became_active":"2023-07-20T10:03:01.908369+0000","last_became_peered":"2023-07-20T10:03:01.908369+0000","last_unstale":"2023-07-20T10:03:04.881201+0000","last_undegraded":"2023-07-20T10:03:04.881201+0000","last_fullsized":"2023-07-20T10:03:04.881201+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:54:44.773912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"63'6","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890124+0000","last_change":"2023-07-20T10:03:01.095005+0000","last_active":"2023-07-20T10:03:02.890124+0000","last_peered":"2023-07-20T10:03:02.890124+0000","last_clean":"2023-07-20T10:03:02.890124+0000","last_became_active":"2023-07-20T10:03:01.094719+0000","last_became_peered":"2023-07-20T10:03:01.094719+0000","last_unstale":"2023-07-20T10:03:02.890124+0000","last_undegraded":"2023-07-20T10:03:02.890124+0000","last_fullsized":"2023-07-20T10:03:02.890124+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:17:38.695665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892916+0000","last_change":"2023-07-20T10:03:01.908839+0000","last_active":"2023-07-20T10:03:02.892916+0000","last_peered":"2023-07-20T10:03:02.892916+0000","last_clean":"2023-07-20T10:03:02.892916+0000","last_became_active":"2023-07-20T10:03:01.908568+0000","last_became_peered":"2023-07-20T10:03:01.908568+0000","last_unstale":"2023-07-20T10:03:02.892916+0000","last_undegraded":"2023-07-20T10:03:02.892916+0000","last_fullsized":"2023-07-20T10:03:02.892916+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:27.628777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738940+0000","last_change":"2023-07-20T10:03:01.097287+0000","last_active":"2023-07-20T10:03:03.738940+0000","last_peered":"2023-07-20T10:03:03.738940+0000","last_clean":"2023-07-20T10:03:03.738940+0000","last_became_active":"2023-07-20T10:03:01.096821+0000","last_became_peered":"2023-07-20T10:03:01.096821+0000","last_unstale":"2023-07-20T10:03:03.738940+0000","last_undegraded":"2023-07-20T10:03:03.738940+0000","last_fullsized":"2023-07-20T10:03:03.738940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:12.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739395+0000","last_change":"2023-07-20T10:03:01.905097+0000","last_active":"2023-07-20T10:03:03.739395+0000","last_peered":"2023-07-20T10:03:03.739395+0000","last_clean":"2023-07-20T10:03:03.739395+0000","last_became_active":"2023-07-20T10:03:01.904382+0000","last_became_peered":"2023-07-20T10:03:01.904382+0000","last_unstale":"2023-07-20T10:03:03.739395+0000","last_undegraded":"2023-07-20T10:03:03.739395+0000","last_fullsized":"2023-07-20T10:03:03.739395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:39.015147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894240+0000","last_change":"2023-07-20T10:03:01.102086+0000","last_active":"2023-07-20T10:03:04.894240+0000","last_peered":"2023-07-20T10:03:04.894240+0000","last_clean":"2023-07-20T10:03:04.894240+0000","last_became_active":"2023-07-20T10:03:01.101791+0000","last_became_peered":"2023-07-20T10:03:01.101791+0000","last_unstale":"2023-07-20T10:03:04.894240+0000","last_undegraded":"2023-07-20T10:03:04.894240+0000","last_fullsized":"2023-07-20T10:03:04.894240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:30.734356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890282+0000","last_change":"2023-07-20T10:03:01.903777+0000","last_active":"2023-07-20T10:03:02.890282+0000","last_peered":"2023-07-20T10:03:02.890282+0000","last_clean":"2023-07-20T10:03:02.890282+0000","last_became_active":"2023-07-20T10:03:01.903482+0000","last_became_peered":"2023-07-20T10:03:01.903482+0000","last_unstale":"2023-07-20T10:03:02.890282+0000","last_undegraded":"2023-07-20T10:03:02.890282+0000","last_fullsized":"2023-07-20T10:03:02.890282+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:01.818347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578402+0000","last_change":"2023-07-20T10:03:01.099392+0000","last_active":"2023-07-20T10:03:04.578402+0000","last_peered":"2023-07-20T10:03:04.578402+0000","last_clean":"2023-07-20T10:03:04.578402+0000","last_became_active":"2023-07-20T10:03:01.099131+0000","last_became_peered":"2023-07-20T10:03:01.099131+0000","last_unstale":"2023-07-20T10:03:04.578402+0000","last_undegraded":"2023-07-20T10:03:04.578402+0000","last_fullsized":"2023-07-20T10:03:04.578402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:54.973827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739178+0000","last_change":"2023-07-20T10:03:01.910137+0000","last_active":"2023-07-20T10:03:03.739178+0000","last_peered":"2023-07-20T10:03:03.739178+0000","last_clean":"2023-07-20T10:03:03.739178+0000","last_became_active":"2023-07-20T10:03:01.906764+0000","last_became_peered":"2023-07-20T10:03:01.906764+0000","last_unstale":"2023-07-20T10:03:03.739178+0000","last_undegraded":"2023-07-20T10:03:03.739178+0000","last_fullsized":"2023-07-20T10:03:03.739178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:06.584439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"63'8","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889951+0000","last_change":"2023-07-20T10:03:01.094469+0000","last_active":"2023-07-20T10:03:02.889951+0000","last_peered":"2023-07-20T10:03:02.889951+0000","last_clean":"2023-07-20T10:03:02.889951+0000","last_became_active":"2023-07-20T10:03:01.094208+0000","last_became_peered":"2023-07-20T10:03:01.094208+0000","last_unstale":"2023-07-20T10:03:02.889951+0000","last_undegraded":"2023-07-20T10:03:02.889951+0000","last_fullsized":"2023-07-20T10:03:02.889951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:44.937031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889871+0000","last_change":"2023-07-20T10:03:01.908997+0000","last_active":"2023-07-20T10:03:02.889871+0000","last_peered":"2023-07-20T10:03:02.889871+0000","last_clean":"2023-07-20T10:03:02.889871+0000","last_became_active":"2023-07-20T10:03:01.908712+0000","last_became_peered":"2023-07-20T10:03:01.908712+0000","last_unstale":"2023-07-20T10:03:02.889871+0000","last_undegraded":"2023-07-20T10:03:02.889871+0000","last_fullsized":"2023-07-20T10:03:02.889871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:32:48.717710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739347+0000","last_change":"2023-07-20T10:03:01.101695+0000","last_active":"2023-07-20T10:03:03.739347+0000","last_peered":"2023-07-20T10:03:03.739347+0000","last_clean":"2023-07-20T10:03:03.739347+0000","last_became_active":"2023-07-20T10:03:01.101459+0000","last_became_peered":"2023-07-20T10:03:01.101459+0000","last_unstale":"2023-07-20T10:03:03.739347+0000","last_undegraded":"2023-07-20T10:03:03.739347+0000","last_fullsized":"2023-07-20T10:03:03.739347+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:12.531344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891507+0000","last_change":"2023-07-20T10:03:01.905987+0000","last_active":"2023-07-20T10:03:02.891507+0000","last_peered":"2023-07-20T10:03:02.891507+0000","last_clean":"2023-07-20T10:03:02.891507+0000","last_became_active":"2023-07-20T10:03:01.905560+0000","last_became_peered":"2023-07-20T10:03:01.905560+0000","last_unstale":"2023-07-20T10:03:02.891507+0000","last_undegraded":"2023-07-20T10:03:02.891507+0000","last_fullsized":"2023-07-20T10:03:02.891507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:30.717692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135987+0000","last_change":"2023-07-20T10:03:01.094714+0000","last_active":"2023-07-20T10:03:03.135987+0000","last_peered":"2023-07-20T10:03:03.135987+0000","last_clean":"2023-07-20T10:03:03.135987+0000","last_became_active":"2023-07-20T10:03:01.094430+0000","last_became_peered":"2023-07-20T10:03:01.094430+0000","last_unstale":"2023-07-20T10:03:03.135987+0000","last_undegraded":"2023-07-20T10:03:03.135987+0000","last_fullsized":"2023-07-20T10:03:03.135987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:02.183478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880941+0000","last_change":"2023-07-20T10:03:01.916447+0000","last_active":"2023-07-20T10:03:04.880941+0000","last_peered":"2023-07-20T10:03:04.880941+0000","last_clean":"2023-07-20T10:03:04.880941+0000","last_became_active":"2023-07-20T10:03:01.916110+0000","last_became_peered":"2023-07-20T10:03:01.916110+0000","last_unstale":"2023-07-20T10:03:04.880941+0000","last_undegraded":"2023-07-20T10:03:04.880941+0000","last_fullsized":"2023-07-20T10:03:04.880941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:20.253957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894345+0000","last_change":"2023-07-20T10:03:01.104071+0000","last_active":"2023-07-20T10:03:04.894345+0000","last_peered":"2023-07-20T10:03:04.894345+0000","last_clean":"2023-07-20T10:03:04.894345+0000","last_became_active":"2023-07-20T10:03:01.103612+0000","last_became_peered":"2023-07-20T10:03:01.103612+0000","last_unstale":"2023-07-20T10:03:04.894345+0000","last_undegraded":"2023-07-20T10:03:04.894345+0000","last_fullsized":"2023-07-20T10:03:04.894345+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:20.076064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891628+0000","last_change":"2023-07-20T10:03:01.905190+0000","last_active":"2023-07-20T10:03:02.891628+0000","last_peered":"2023-07-20T10:03:02.891628+0000","last_clean":"2023-07-20T10:03:02.891628+0000","last_became_active":"2023-07-20T10:03:01.904746+0000","last_became_peered":"2023-07-20T10:03:01.904746+0000","last_unstale":"2023-07-20T10:03:02.891628+0000","last_undegraded":"2023-07-20T10:03:02.891628+0000","last_fullsized":"2023-07-20T10:03:02.891628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:14.425974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894401+0000","last_change":"2023-07-20T10:03:01.103025+0000","last_active":"2023-07-20T10:03:04.894401+0000","last_peered":"2023-07-20T10:03:04.894401+0000","last_clean":"2023-07-20T10:03:04.894401+0000","last_became_active":"2023-07-20T10:03:01.102726+0000","last_became_peered":"2023-07-20T10:03:01.102726+0000","last_unstale":"2023-07-20T10:03:04.894401+0000","last_undegraded":"2023-07-20T10:03:04.894401+0000","last_fullsized":"2023-07-20T10:03:04.894401+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:49.894274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892993+0000","last_change":"2023-07-20T10:03:01.906481+0000","last_active":"2023-07-20T10:03:02.892993+0000","last_peered":"2023-07-20T10:03:02.892993+0000","last_clean":"2023-07-20T10:03:02.892993+0000","last_became_active":"2023-07-20T10:03:01.906168+0000","last_became_peered":"2023-07-20T10:03:01.906168+0000","last_unstale":"2023-07-20T10:03:02.892993+0000","last_undegraded":"2023-07-20T10:03:02.892993+0000","last_fullsized":"2023-07-20T10:03:02.892993+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:58.461115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891659+0000","last_change":"2023-07-20T10:03:01.098199+0000","last_active":"2023-07-20T10:03:02.891659+0000","last_peered":"2023-07-20T10:03:02.891659+0000","last_clean":"2023-07-20T10:03:02.891659+0000","last_became_active":"2023-07-20T10:03:01.097911+0000","last_became_peered":"2023-07-20T10:03:01.097911+0000","last_unstale":"2023-07-20T10:03:02.891659+0000","last_undegraded":"2023-07-20T10:03:02.891659+0000","last_fullsized":"2023-07-20T10:03:02.891659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:32.003606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894297+0000","last_change":"2023-07-20T10:03:01.906587+0000","last_active":"2023-07-20T10:03:04.894297+0000","last_peered":"2023-07-20T10:03:04.894297+0000","last_clean":"2023-07-20T10:03:04.894297+0000","last_became_active":"2023-07-20T10:03:01.904319+0000","last_became_peered":"2023-07-20T10:03:01.904319+0000","last_unstale":"2023-07-20T10:03:04.894297+0000","last_undegraded":"2023-07-20T10:03:04.894297+0000","last_fullsized":"2023-07-20T10:03:04.894297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:59:16.519151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889850+0000","last_change":"2023-07-20T10:03:01.095889+0000","last_active":"2023-07-20T10:03:02.889850+0000","last_peered":"2023-07-20T10:03:02.889850+0000","last_clean":"2023-07-20T10:03:02.889850+0000","last_became_active":"2023-07-20T10:03:01.095605+0000","last_became_peered":"2023-07-20T10:03:01.095605+0000","last_unstale":"2023-07-20T10:03:02.889850+0000","last_undegraded":"2023-07-20T10:03:02.889850+0000","last_fullsized":"2023-07-20T10:03:02.889850+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:45.261033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739174+0000","last_change":"2023-07-20T10:03:01.910342+0000","last_active":"2023-07-20T10:03:03.739174+0000","last_peered":"2023-07-20T10:03:03.739174+0000","last_clean":"2023-07-20T10:03:03.739174+0000","last_became_active":"2023-07-20T10:03:01.907403+0000","last_became_peered":"2023-07-20T10:03:01.907403+0000","last_unstale":"2023-07-20T10:03:03.739174+0000","last_undegraded":"2023-07-20T10:03:03.739174+0000","last_fullsized":"2023-07-20T10:03:03.739174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:46.685207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738840+0000","last_change":"2023-07-20T10:03:01.102131+0000","last_active":"2023-07-20T10:03:03.738840+0000","last_peered":"2023-07-20T10:03:03.738840+0000","last_clean":"2023-07-20T10:03:03.738840+0000","last_became_active":"2023-07-20T10:03:01.101808+0000","last_became_peered":"2023-07-20T10:03:01.101808+0000","last_unstale":"2023-07-20T10:03:03.738840+0000","last_undegraded":"2023-07-20T10:03:03.738840+0000","last_fullsized":"2023-07-20T10:03:03.738840+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:06.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891812+0000","last_change":"2023-07-20T10:03:01.899910+0000","last_active":"2023-07-20T10:03:02.891812+0000","last_peered":"2023-07-20T10:03:02.891812+0000","last_clean":"2023-07-20T10:03:02.891812+0000","last_became_active":"2023-07-20T10:03:01.899636+0000","last_became_peered":"2023-07-20T10:03:01.899636+0000","last_unstale":"2023-07-20T10:03:02.891812+0000","last_undegraded":"2023-07-20T10:03:02.891812+0000","last_fullsized":"2023-07-20T10:03:02.891812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:05.288591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135564+0000","last_change":"2023-07-20T10:03:01.089742+0000","last_active":"2023-07-20T10:03:03.135564+0000","last_peered":"2023-07-20T10:03:03.135564+0000","last_clean":"2023-07-20T10:03:03.135564+0000","last_became_active":"2023-07-20T10:03:01.089421+0000","last_became_peered":"2023-07-20T10:03:01.089421+0000","last_unstale":"2023-07-20T10:03:03.135564+0000","last_undegraded":"2023-07-20T10:03:03.135564+0000","last_fullsized":"2023-07-20T10:03:03.135564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:11.970883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.893941+0000","last_change":"2023-07-20T10:03:01.905507+0000","last_active":"2023-07-20T10:03:04.893941+0000","last_peered":"2023-07-20T10:03:04.893941+0000","last_clean":"2023-07-20T10:03:04.893941+0000","last_became_active":"2023-07-20T10:03:01.905221+0000","last_became_peered":"2023-07-20T10:03:01.905221+0000","last_unstale":"2023-07-20T10:03:04.893941+0000","last_undegraded":"2023-07-20T10:03:04.893941+0000","last_fullsized":"2023-07-20T10:03:04.893941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:10:21.094356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739272+0000","last_change":"2023-07-20T10:03:01.097964+0000","last_active":"2023-07-20T10:03:03.739272+0000","last_peered":"2023-07-20T10:03:03.739272+0000","last_clean":"2023-07-20T10:03:03.739272+0000","last_became_active":"2023-07-20T10:03:01.097554+0000","last_became_peered":"2023-07-20T10:03:01.097554+0000","last_unstale":"2023-07-20T10:03:03.739272+0000","last_undegraded":"2023-07-20T10:03:03.739272+0000","last_fullsized":"2023-07-20T10:03:03.739272+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:47:14.063629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578534+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:03:04.578534+0000","last_peered":"2023-07-20T10:03:04.578534+0000","last_clean":"2023-07-20T10:03:04.578534+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:03:04.578534+0000","last_undegraded":"2023-07-20T10:03:04.578534+0000","last_fullsized":"2023-07-20T10:03:04.578534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:53.286285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":105,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892859+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:03:02.892859+0000","last_peered":"2023-07-20T10:03:02.892859+0000","last_clean":"2023-07-20T10:03:02.892859+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:03:02.892859+0000","last_undegraded":"2023-07-20T10:03:02.892859+0000","last_fullsized":"2023-07-20T10:03:02.892859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:18.091205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892039+0000","last_change":"2023-07-20T10:03:01.898820+0000","last_active":"2023-07-20T10:03:02.892039+0000","last_peered":"2023-07-20T10:03:02.892039+0000","last_clean":"2023-07-20T10:03:02.892039+0000","last_became_active":"2023-07-20T10:03:01.898538+0000","last_became_peered":"2023-07-20T10:03:01.898538+0000","last_unstale":"2023-07-20T10:03:02.892039+0000","last_undegraded":"2023-07-20T10:03:02.892039+0000","last_fullsized":"2023-07-20T10:03:02.892039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:45.946444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578645+0000","last_change":"2023-07-20T10:03:01.096763+0000","last_active":"2023-07-20T10:03:04.578645+0000","last_peered":"2023-07-20T10:03:04.578645+0000","last_clean":"2023-07-20T10:03:04.578645+0000","last_became_active":"2023-07-20T10:03:01.096409+0000","last_became_peered":"2023-07-20T10:03:01.096409+0000","last_unstale":"2023-07-20T10:03:04.578645+0000","last_undegraded":"2023-07-20T10:03:04.578645+0000","last_fullsized":"2023-07-20T10:03:04.578645+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:09.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578129+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:03:04.578129+0000","last_peered":"2023-07-20T10:03:04.578129+0000","last_clean":"2023-07-20T10:03:04.578129+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:03:04.578129+0000","last_undegraded":"2023-07-20T10:03:04.578129+0000","last_fullsized":"2023-07-20T10:03:04.578129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:39.157293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889745+0000","last_change":"2023-07-20T10:03:01.902251+0000","last_active":"2023-07-20T10:03:02.889745+0000","last_peered":"2023-07-20T10:03:02.889745+0000","last_clean":"2023-07-20T10:03:02.889745+0000","last_became_active":"2023-07-20T10:03:01.901879+0000","last_became_peered":"2023-07-20T10:03:01.901879+0000","last_unstale":"2023-07-20T10:03:02.889745+0000","last_undegraded":"2023-07-20T10:03:02.889745+0000","last_fullsized":"2023-07-20T10:03:02.889745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:05.288591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738990+0000","last_change":"2023-07-20T10:03:01.093664+0000","last_active":"2023-07-20T10:03:03.738990+0000","last_peered":"2023-07-20T10:03:03.738990+0000","last_clean":"2023-07-20T10:03:03.738990+0000","last_became_active":"2023-07-20T10:03:01.093391+0000","last_became_peered":"2023-07-20T10:03:01.093391+0000","last_unstale":"2023-07-20T10:03:03.738990+0000","last_undegraded":"2023-07-20T10:03:03.738990+0000","last_fullsized":"2023-07-20T10:03:03.738990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:53:12.894309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135767+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:03:03.135767+0000","last_peered":"2023-07-20T10:03:03.135767+0000","last_clean":"2023-07-20T10:03:03.135767+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:03:03.135767+0000","last_undegraded":"2023-07-20T10:03:03.135767+0000","last_fullsized":"2023-07-20T10:03:03.135767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:27:26.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893047+0000","last_change":"2023-07-20T10:03:01.914643+0000","last_active":"2023-07-20T10:03:02.893047+0000","last_peered":"2023-07-20T10:03:02.893047+0000","last_clean":"2023-07-20T10:03:02.893047+0000","last_became_active":"2023-07-20T10:03:01.912735+0000","last_became_peered":"2023-07-20T10:03:01.912735+0000","last_unstale":"2023-07-20T10:03:02.893047+0000","last_undegraded":"2023-07-20T10:03:02.893047+0000","last_fullsized":"2023-07-20T10:03:02.893047+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:52:13.028744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894432+0000","last_change":"2023-07-20T10:03:01.102240+0000","last_active":"2023-07-20T10:03:04.894432+0000","last_peered":"2023-07-20T10:03:04.894432+0000","last_clean":"2023-07-20T10:03:04.894432+0000","last_became_active":"2023-07-20T10:03:01.101668+0000","last_became_peered":"2023-07-20T10:03:01.101668+0000","last_unstale":"2023-07-20T10:03:04.894432+0000","last_undegraded":"2023-07-20T10:03:04.894432+0000","last_fullsized":"2023-07-20T10:03:04.894432+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:27:22.310107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892740+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:03:02.892740+0000","last_peered":"2023-07-20T10:03:02.892740+0000","last_clean":"2023-07-20T10:03:02.892740+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:03:02.892740+0000","last_undegraded":"2023-07-20T10:03:02.892740+0000","last_fullsized":"2023-07-20T10:03:02.892740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:57.844795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739491+0000","last_change":"2023-07-20T10:03:01.913500+0000","last_active":"2023-07-20T10:03:03.739491+0000","last_peered":"2023-07-20T10:03:03.739491+0000","last_clean":"2023-07-20T10:03:03.739491+0000","last_became_active":"2023-07-20T10:03:01.910307+0000","last_became_peered":"2023-07-20T10:03:01.910307+0000","last_unstale":"2023-07-20T10:03:03.739491+0000","last_undegraded":"2023-07-20T10:03:03.739491+0000","last_fullsized":"2023-07-20T10:03:03.739491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:33.341222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880927+0000","last_change":"2023-07-20T10:03:01.101656+0000","last_active":"2023-07-20T10:03:04.880927+0000","last_peered":"2023-07-20T10:03:04.880927+0000","last_clean":"2023-07-20T10:03:04.880927+0000","last_became_active":"2023-07-20T10:03:01.101362+0000","last_became_peered":"2023-07-20T10:03:01.101362+0000","last_unstale":"2023-07-20T10:03:04.880927+0000","last_undegraded":"2023-07-20T10:03:04.880927+0000","last_fullsized":"2023-07-20T10:03:04.880927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:45.675794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891567+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:03:02.891567+0000","last_peered":"2023-07-20T10:03:02.891567+0000","last_clean":"2023-07-20T10:03:02.891567+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:03:02.891567+0000","last_undegraded":"2023-07-20T10:03:02.891567+0000","last_fullsized":"2023-07-20T10:03:02.891567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:59:41.311432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890556+0000","last_change":"2023-07-20T10:03:01.902121+0000","last_active":"2023-07-20T10:03:02.890556+0000","last_peered":"2023-07-20T10:03:02.890556+0000","last_clean":"2023-07-20T10:03:02.890556+0000","last_became_active":"2023-07-20T10:03:01.901825+0000","last_became_peered":"2023-07-20T10:03:01.901825+0000","last_unstale":"2023-07-20T10:03:02.890556+0000","last_undegraded":"2023-07-20T10:03:02.890556+0000","last_fullsized":"2023-07-20T10:03:02.890556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:26.920734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893119+0000","last_change":"2023-07-20T10:03:01.102031+0000","last_active":"2023-07-20T10:03:02.893119+0000","last_peered":"2023-07-20T10:03:02.893119+0000","last_clean":"2023-07-20T10:03:02.893119+0000","last_became_active":"2023-07-20T10:03:01.101741+0000","last_became_peered":"2023-07-20T10:03:01.101741+0000","last_unstale":"2023-07-20T10:03:02.893119+0000","last_undegraded":"2023-07-20T10:03:02.893119+0000","last_fullsized":"2023-07-20T10:03:02.893119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:36:21.590537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578765+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:03:04.578765+0000","last_peered":"2023-07-20T10:03:04.578765+0000","last_clean":"2023-07-20T10:03:04.578765+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:03:04.578765+0000","last_undegraded":"2023-07-20T10:03:04.578765+0000","last_fullsized":"2023-07-20T10:03:04.578765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:18.091205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738925+0000","last_change":"2023-07-20T10:03:01.910910+0000","last_active":"2023-07-20T10:03:03.738925+0000","last_peered":"2023-07-20T10:03:03.738925+0000","last_clean":"2023-07-20T10:03:03.738925+0000","last_became_active":"2023-07-20T10:03:01.910419+0000","last_became_peered":"2023-07-20T10:03:01.910419+0000","last_unstale":"2023-07-20T10:03:03.738925+0000","last_undegraded":"2023-07-20T10:03:03.738925+0000","last_fullsized":"2023-07-20T10:03:03.738925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:00:59.749346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889834+0000","last_change":"2023-07-20T10:03:01.095770+0000","last_active":"2023-07-20T10:03:02.889834+0000","last_peered":"2023-07-20T10:03:02.889834+0000","last_clean":"2023-07-20T10:03:02.889834+0000","last_became_active":"2023-07-20T10:03:01.095483+0000","last_became_peered":"2023-07-20T10:03:01.095483+0000","last_unstale":"2023-07-20T10:03:02.889834+0000","last_undegraded":"2023-07-20T10:03:02.889834+0000","last_fullsized":"2023-07-20T10:03:02.889834+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:16.809701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891818+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:03:02.891818+0000","last_peered":"2023-07-20T10:03:02.891818+0000","last_clean":"2023-07-20T10:03:02.891818+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:03:02.891818+0000","last_undegraded":"2023-07-20T10:03:02.891818+0000","last_fullsized":"2023-07-20T10:03:02.891818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:25.844554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893108+0000","last_change":"2023-07-20T10:03:01.914300+0000","last_active":"2023-07-20T10:03:02.893108+0000","last_peered":"2023-07-20T10:03:02.893108+0000","last_clean":"2023-07-20T10:03:02.893108+0000","last_became_active":"2023-07-20T10:03:01.914016+0000","last_became_peered":"2023-07-20T10:03:01.914016+0000","last_unstale":"2023-07-20T10:03:02.893108+0000","last_undegraded":"2023-07-20T10:03:02.893108+0000","last_fullsized":"2023-07-20T10:03:02.893108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:39:04.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889970+0000","last_change":"2023-07-20T10:03:01.099868+0000","last_active":"2023-07-20T10:03:02.889970+0000","last_peered":"2023-07-20T10:03:02.889970+0000","last_clean":"2023-07-20T10:03:02.889970+0000","last_became_active":"2023-07-20T10:03:01.099592+0000","last_became_peered":"2023-07-20T10:03:01.099592+0000","last_unstale":"2023-07-20T10:03:02.889970+0000","last_undegraded":"2023-07-20T10:03:02.889970+0000","last_fullsized":"2023-07-20T10:03:02.889970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:24:15.208917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894501+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:03:04.894501+0000","last_peered":"2023-07-20T10:03:04.894501+0000","last_clean":"2023-07-20T10:03:04.894501+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:03:04.894501+0000","last_undegraded":"2023-07-20T10:03:04.894501+0000","last_fullsized":"2023-07-20T10:03:04.894501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:36:53.242062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54592,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317248,"statfs":{"total":96636764160,"available":96580861952,"internally_reserved":0,"allocated":1363968,"data_stored":963727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.98999999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.87},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.69399999999999995},"min":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.57499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65800000000000003,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":1.0149999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":1.0069999999999999},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.0840000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":770048,"data_stored":373887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0780000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95599999999999996,"5min":0.98499999999999999,"15min":1.2010000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":1.1259999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":1.103},"last":0.66200000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":1.2230000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.745}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.496,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0149999999999999,"15min":1.25},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.93200000000000005,"5min":0.94999999999999996,"15min":1.272},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.88,"15min":0.92000000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.0389999999999999,"15min":1.0649999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94799999999999995,"5min":1.0609999999999999,"15min":1.155},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":761856,"data_stored":373235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.871,"5min":0.96999999999999997,"15min":0.97199999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.94399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76700000000000002,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":0.996},"last":0.97599999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.754}]},{"osd":6,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.94899999999999995,"5min":1.0089999999999999,"15min":1.016},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.3080000000000001},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.145},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.84399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":765952,"data_stored":373817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38400000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.085},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.141},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.433},"max":{"1min":1.22,"5min":1.22,"15min":1.363},"last":0.78800000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.3620000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.747},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.212},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.5},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.93500000000000005,"15min":1.196},"last":0.748}]},{"osd":6,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.90800000000000003,"5min":1.004,"15min":1.4970000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":0.93200000000000005,"5min":1.0209999999999999,"15min":1.538},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.753,"5min":1.0009999999999999,"15min":1.597},"last":0.55700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":778240,"data_stored":374821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.50800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.29299999999999998},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":1.099},"last":0.502}]},{"osd":4,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":1.381,"15min":1.381},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.98299999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0920000000000001,"5min":1.274,"15min":1.274},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.131,"15min":1.1950000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.496},"max":{"1min":0.94299999999999995,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.54200000000000004},"max":{"1min":1.0509999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54024,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317816,"statfs":{"total":96636764160,"available":96581443584,"internally_reserved":0,"allocated":774144,"data_stored":374799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.623,"5min":0.89300000000000002,"15min":0.92700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":1.6599999999999999},"last":0.42399999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.25700000000000001},"max":{"1min":0.83799999999999997,"5min":0.876,"15min":0.876},"last":0.5},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71799999999999997,"5min":0.92600000000000005,"15min":0.93000000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":1.246,"15min":1.25},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.2689999999999999,"15min":1.383},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.1899999999999999,"15min":1.2470000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.871}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0189999999999999,"5min":1.169,"15min":1.51},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0600000000000001,"5min":1.292,"15min":1.5820000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0720000000000001,"5min":1.393,"15min":1.393},"last":0.79400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":770048,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.76700000000000002,"15min":0.89600000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.626,"5min":0.69699999999999995,"15min":1.0800000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.88300000000000001},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":1.052},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.65600000000000003,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.57899999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.1930000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.048,"5min":1.117,"15min":1.117},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.1559999999999999,"15min":1.355},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":1.107,"15min":1.1879999999999999},"last":0.755}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0129999999999999,"5min":1.117,"15min":1.6060000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2529999999999999},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1363968,"data_stored":963659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.49199999999999999,"15min":0.45200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58899999999999997,"15min":0.52600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.68300000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.36799999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.627,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":10.631,"5min":10.631,"15min":10.631},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.60799999999999998,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.501}]},{"osd":4,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.83699999999999997,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.89800000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":7.4340000000000002,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.84899999999999998,"15min":0.81200000000000006},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":3.161,"5min":3.161,"15min":3.161},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.878,"15min":0.82599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.46600000000000003},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.88}]},{"osd":7,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.89400000000000002,"15min":0.84299999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":5.1970000000000001,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.878,"5min":0.82799999999999996,"15min":0.80800000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:03:08.040 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-07-20T10:03:08.055+0000 7f5935637640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:03:10.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:03:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 Processor -- start 2023-07-20T10:03:10.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 -- start start 2023-07-20T10:03:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbf140ca6b0 0x7fbf140b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140b06c0 con 0x7fbf1415a8e0 2023-07-20T10:03:10.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf140b12a0 con 0x7fbf140afda0 2023-07-20T10:03:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf18dd2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140b3160 con 0x7fbf140ca6b0 2023-07-20T10:03:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf11d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbf1415a8e0 0x7fbf140b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52604/0 (socket says 172.21.15.82:52604) 2023-07-20T10:03:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf11d9b640 1 -- 172.21.15.82:0/2572073593 learned_addr learned my addr 172.21.15.82:0/2572073593 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:10.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.878+0000 7fbf12d9d640 1 --2- 172.21.15.82:0/2572073593 >> v2:172.21.15.183:3300/0 conn(0x7fbf140ca6b0 0x7fbf140b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.882+0000 7fbf12d9d640 1 -- 172.21.15.82:0/2572073593 >> v1:172.21.15.183:6789/0 conn(0x7fbf140afda0 legacy=0x7fbf140b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.882+0000 7fbf12d9d640 1 -- 172.21.15.82:0/2572073593 >> v1:172.21.15.82:6789/0 conn(0x7fbf1415a8e0 legacy=0x7fbf140b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:10.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.882+0000 7fbf12d9d640 1 -- 172.21.15.82:0/2572073593 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf140b1580 con 0x7fbf140ca6b0 2023-07-20T10:03:10.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.882+0000 7fbf12d9d640 1 --2- 172.21.15.82:0/2572073593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf140ca6b0 0x7fbf140b0180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009d90 tx=0x7fbf0c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a1bf9139c8bfab0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf1159a640 1 -- 172.21.15.82:0/2572073593 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0a5980 con 0x7fbf140ca6b0 2023-07-20T10:03:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf1159a640 1 -- 172.21.15.82:0/2572073593 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0a5ae0 con 0x7fbf140ca6b0 2023-07-20T10:03:10.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf1159a640 1 -- 172.21.15.82:0/2572073593 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0a5e70 con 0x7fbf140ca6b0 2023-07-20T10:03:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 -- 172.21.15.82:0/2572073593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf140ca6b0 msgr2=0x7fbf140b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/2572073593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf140ca6b0 0x7fbf140b0180 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009d90 tx=0x7fbf0c01c8c0 comp rx=0 tx=0).stop 2023-07-20T10:03:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 -- 172.21.15.82:0/2572073593 shutdown_connections 2023-07-20T10:03:10.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/2572073593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf140ca6b0 0x7fbf140b0180 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 -- 172.21.15.82:0/2572073593 >> 172.21.15.82:0/2572073593 conn(0x7fbf140cada0 msgr2=0x7fbf140cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 -- 172.21.15.82:0/2572073593 shutdown_connections 2023-07-20T10:03:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.886+0000 7fbf18dd2640 1 -- 172.21.15.82:0/2572073593 wait complete. 2023-07-20T10:03:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 Processor -- start 2023-07-20T10:03:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 -- start start 2023-07-20T10:03:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf140ca6b0 0x7fbf140cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf1415a8e0 0x7fbf1414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1414c510 con 0x7fbf140afda0 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1415cdb0 con 0x7fbf1415a8e0 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf14152600 con 0x7fbf140ca6b0 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43758/0 (socket says 172.21.15.82:43758) 2023-07-20T10:03:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 -- 172.21.15.82:0/1318602056 learned_addr learned my addr 172.21.15.82:0/1318602056 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf11d9b640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf140ca6b0 0x7fbf140cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf12d9d640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf1415a8e0 0x7fbf1414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 -- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf140ca6b0 msgr2=0x7fbf140cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf140ca6b0 0x7fbf140cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 -- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf1415a8e0 msgr2=0x7fbf1414fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf1415a8e0 0x7fbf1414fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 -- 172.21.15.82:0/1318602056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009a70 con 0x7fbf140afda0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf1259c640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c3f0 tx=0x7fbf0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf040052d0 con 0x7fbf140afda0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04005430 con 0x7fbf140afda0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04003840 con 0x7fbf140afda0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.890+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1415c510 con 0x7fbf140afda0 2023-07-20T10:03:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1415cad0 con 0x7fbf140afda0 2023-07-20T10:03:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf14073c70 con 0x7fbf140afda0 2023-07-20T10:03:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf040039a0 con 0x7fbf140afda0 2023-07-20T10:03:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf02ffd640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 0x7fbef4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf04083430 con 0x7fbf140afda0 2023-07-20T10:03:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.894+0000 7fbf11d9b640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 0x7fbef4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.898+0000 7fbf11d9b640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 0x7fbef4068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf1415a250 tx=0x7fbf08009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:10.898+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf040507b0 con 0x7fbf140afda0 2023-07-20T10:03:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.046+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf140cb990 con 0x7fbef40663a0 2023-07-20T10:03:11.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.054+0000 7fbf02ffd640 1 -- 172.21.15.82:0/1318602056 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311013 (secure 0 0 0) 0x7fbf140cb990 con 0x7fbef40663a0 2023-07-20T10:03:11.045 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:03:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 msgr2=0x7fbef4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 0x7fbef4068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf1415a250 tx=0x7fbf08009040 comp rx=0 tx=0).stop 2023-07-20T10:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 msgr2=0x7fbf140cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c3f0 tx=0x7fbf0400c8b0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 shutdown_connections 2023-07-20T10:03:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf1415a8e0 0x7fbf1414fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbf140ca6b0 0x7fbf140cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbef40663a0 0x7fbef4068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 --2- 172.21.15.82:0/1318602056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf140afda0 0x7fbf140cbbb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 >> 172.21.15.82:0/1318602056 conn(0x7fbf140cada0 msgr2=0x7fbf1406ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 shutdown_connections 2023-07-20T10:03:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.058+0000 7fbf18dd2640 1 -- 172.21.15.82:0/1318602056 wait complete. 2023-07-20T10:03:11.065 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T10:03:10.955457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300408,"kb_used_data":7176,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754674312,"statfs":{"total":773094113280,"available":772786495488,"internally_reserved":0,"allocated":7348224,"data_stored":4171340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.069813"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891772+0000","last_change":"2023-07-20T10:03:01.904635+0000","last_active":"2023-07-20T10:03:02.891772+0000","last_peered":"2023-07-20T10:03:02.891772+0000","last_clean":"2023-07-20T10:03:02.891772+0000","last_became_active":"2023-07-20T10:03:01.904268+0000","last_became_peered":"2023-07-20T10:03:01.904268+0000","last_unstale":"2023-07-20T10:03:02.891772+0000","last_undegraded":"2023-07-20T10:03:02.891772+0000","last_fullsized":"2023-07-20T10:03:02.891772+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:55.907626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578622+0000","last_change":"2023-07-20T10:03:01.908723+0000","last_active":"2023-07-20T10:03:04.578622+0000","last_peered":"2023-07-20T10:03:04.578622+0000","last_clean":"2023-07-20T10:03:04.578622+0000","last_became_active":"2023-07-20T10:03:01.908098+0000","last_became_peered":"2023-07-20T10:03:01.908098+0000","last_unstale":"2023-07-20T10:03:04.578622+0000","last_undegraded":"2023-07-20T10:03:04.578622+0000","last_fullsized":"2023-07-20T10:03:04.578622+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:18.110300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739174+0000","last_change":"2023-07-20T10:03:01.910101+0000","last_active":"2023-07-20T10:03:03.739174+0000","last_peered":"2023-07-20T10:03:03.739174+0000","last_clean":"2023-07-20T10:03:03.739174+0000","last_became_active":"2023-07-20T10:03:01.907378+0000","last_became_peered":"2023-07-20T10:03:01.907378+0000","last_unstale":"2023-07-20T10:03:03.739174+0000","last_undegraded":"2023-07-20T10:03:03.739174+0000","last_fullsized":"2023-07-20T10:03:03.739174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:20.253957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578683+0000","last_change":"2023-07-20T10:03:01.913635+0000","last_active":"2023-07-20T10:03:04.578683+0000","last_peered":"2023-07-20T10:03:04.578683+0000","last_clean":"2023-07-20T10:03:04.578683+0000","last_became_active":"2023-07-20T10:03:01.913357+0000","last_became_peered":"2023-07-20T10:03:01.913357+0000","last_unstale":"2023-07-20T10:03:04.578683+0000","last_undegraded":"2023-07-20T10:03:04.578683+0000","last_fullsized":"2023-07-20T10:03:04.578683+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:38.586300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881117+0000","last_change":"2023-07-20T10:03:01.904830+0000","last_active":"2023-07-20T10:03:04.881117+0000","last_peered":"2023-07-20T10:03:04.881117+0000","last_clean":"2023-07-20T10:03:04.881117+0000","last_became_active":"2023-07-20T10:03:01.904556+0000","last_became_peered":"2023-07-20T10:03:01.904556+0000","last_unstale":"2023-07-20T10:03:04.881117+0000","last_undegraded":"2023-07-20T10:03:04.881117+0000","last_fullsized":"2023-07-20T10:03:04.881117+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:46.834429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891921+0000","last_change":"2023-07-20T10:03:01.903593+0000","last_active":"2023-07-20T10:03:02.891921+0000","last_peered":"2023-07-20T10:03:02.891921+0000","last_clean":"2023-07-20T10:03:02.891921+0000","last_became_active":"2023-07-20T10:03:01.903272+0000","last_became_peered":"2023-07-20T10:03:01.903272+0000","last_unstale":"2023-07-20T10:03:02.891921+0000","last_undegraded":"2023-07-20T10:03:02.891921+0000","last_fullsized":"2023-07-20T10:03:02.891921+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:17.819114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738790+0000","last_change":"2023-07-20T10:03:01.911003+0000","last_active":"2023-07-20T10:03:03.738790+0000","last_peered":"2023-07-20T10:03:03.738790+0000","last_clean":"2023-07-20T10:03:03.738790+0000","last_became_active":"2023-07-20T10:03:01.910677+0000","last_became_peered":"2023-07-20T10:03:01.910677+0000","last_unstale":"2023-07-20T10:03:03.738790+0000","last_undegraded":"2023-07-20T10:03:03.738790+0000","last_fullsized":"2023-07-20T10:03:03.738790+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:57:04.651371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889746+0000","last_change":"2023-07-20T10:03:01.904858+0000","last_active":"2023-07-20T10:03:02.889746+0000","last_peered":"2023-07-20T10:03:02.889746+0000","last_clean":"2023-07-20T10:03:02.889746+0000","last_became_active":"2023-07-20T10:03:01.904594+0000","last_became_peered":"2023-07-20T10:03:01.904594+0000","last_unstale":"2023-07-20T10:03:02.889746+0000","last_undegraded":"2023-07-20T10:03:02.889746+0000","last_fullsized":"2023-07-20T10:03:02.889746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:55.907626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890427+0000","last_change":"2023-07-20T10:03:01.910579+0000","last_active":"2023-07-20T10:03:02.890427+0000","last_peered":"2023-07-20T10:03:02.890427+0000","last_clean":"2023-07-20T10:03:02.890427+0000","last_became_active":"2023-07-20T10:03:01.910313+0000","last_became_peered":"2023-07-20T10:03:01.910313+0000","last_unstale":"2023-07-20T10:03:02.890427+0000","last_undegraded":"2023-07-20T10:03:02.890427+0000","last_fullsized":"2023-07-20T10:03:02.890427+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:37:09.281104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891633+0000","last_change":"2023-07-20T10:03:01.900712+0000","last_active":"2023-07-20T10:03:02.891633+0000","last_peered":"2023-07-20T10:03:02.891633+0000","last_clean":"2023-07-20T10:03:02.891633+0000","last_became_active":"2023-07-20T10:03:01.900378+0000","last_became_peered":"2023-07-20T10:03:01.900378+0000","last_unstale":"2023-07-20T10:03:02.891633+0000","last_undegraded":"2023-07-20T10:03:02.891633+0000","last_fullsized":"2023-07-20T10:03:02.891633+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:02:17.958109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135934+0000","last_change":"2023-07-20T10:03:01.910137+0000","last_active":"2023-07-20T10:03:03.135934+0000","last_peered":"2023-07-20T10:03:03.135934+0000","last_clean":"2023-07-20T10:03:03.135934+0000","last_became_active":"2023-07-20T10:03:01.909870+0000","last_became_peered":"2023-07-20T10:03:01.909870+0000","last_unstale":"2023-07-20T10:03:03.135934+0000","last_undegraded":"2023-07-20T10:03:03.135934+0000","last_fullsized":"2023-07-20T10:03:03.135934+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:46:06.009954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890034+0000","last_change":"2023-07-20T10:03:01.899792+0000","last_active":"2023-07-20T10:03:02.890034+0000","last_peered":"2023-07-20T10:03:02.890034+0000","last_clean":"2023-07-20T10:03:02.890034+0000","last_became_active":"2023-07-20T10:03:01.899534+0000","last_became_peered":"2023-07-20T10:03:01.899534+0000","last_unstale":"2023-07-20T10:03:02.890034+0000","last_undegraded":"2023-07-20T10:03:02.890034+0000","last_fullsized":"2023-07-20T10:03:02.890034+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:38:51.773098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891593+0000","last_change":"2023-07-20T10:03:01.900806+0000","last_active":"2023-07-20T10:03:02.891593+0000","last_peered":"2023-07-20T10:03:02.891593+0000","last_clean":"2023-07-20T10:03:02.891593+0000","last_became_active":"2023-07-20T10:03:01.900466+0000","last_became_peered":"2023-07-20T10:03:01.900466+0000","last_unstale":"2023-07-20T10:03:02.891593+0000","last_undegraded":"2023-07-20T10:03:02.891593+0000","last_fullsized":"2023-07-20T10:03:02.891593+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:18:03.950677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738843+0000","last_change":"2023-07-20T10:03:01.914246+0000","last_active":"2023-07-20T10:03:03.738843+0000","last_peered":"2023-07-20T10:03:03.738843+0000","last_clean":"2023-07-20T10:03:03.738843+0000","last_became_active":"2023-07-20T10:03:01.913934+0000","last_became_peered":"2023-07-20T10:03:01.913934+0000","last_unstale":"2023-07-20T10:03:03.738843+0000","last_undegraded":"2023-07-20T10:03:03.738843+0000","last_fullsized":"2023-07-20T10:03:03.738843+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:23:54.938805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578253+0000","last_change":"2023-07-20T10:03:01.910515+0000","last_active":"2023-07-20T10:03:04.578253+0000","last_peered":"2023-07-20T10:03:04.578253+0000","last_clean":"2023-07-20T10:03:04.578253+0000","last_became_active":"2023-07-20T10:03:01.910227+0000","last_became_peered":"2023-07-20T10:03:01.910227+0000","last_unstale":"2023-07-20T10:03:04.578253+0000","last_undegraded":"2023-07-20T10:03:04.578253+0000","last_fullsized":"2023-07-20T10:03:04.578253+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:58.241180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891481+0000","last_change":"2023-07-20T10:03:01.901927+0000","last_active":"2023-07-20T10:03:02.891481+0000","last_peered":"2023-07-20T10:03:02.891481+0000","last_clean":"2023-07-20T10:03:02.891481+0000","last_became_active":"2023-07-20T10:03:01.901645+0000","last_became_peered":"2023-07-20T10:03:01.901645+0000","last_unstale":"2023-07-20T10:03:02.891481+0000","last_undegraded":"2023-07-20T10:03:02.891481+0000","last_fullsized":"2023-07-20T10:03:02.891481+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:36.284117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739309+0000","last_change":"2023-07-20T10:03:01.909940+0000","last_active":"2023-07-20T10:03:03.739309+0000","last_peered":"2023-07-20T10:03:03.739309+0000","last_clean":"2023-07-20T10:03:03.739309+0000","last_became_active":"2023-07-20T10:03:01.906461+0000","last_became_peered":"2023-07-20T10:03:01.906461+0000","last_unstale":"2023-07-20T10:03:03.739309+0000","last_undegraded":"2023-07-20T10:03:03.739309+0000","last_fullsized":"2023-07-20T10:03:03.739309+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:54:44.773912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578752+0000","last_change":"2023-07-20T10:03:01.908922+0000","last_active":"2023-07-20T10:03:04.578752+0000","last_peered":"2023-07-20T10:03:04.578752+0000","last_clean":"2023-07-20T10:03:04.578752+0000","last_became_active":"2023-07-20T10:03:01.908429+0000","last_became_peered":"2023-07-20T10:03:01.908429+0000","last_unstale":"2023-07-20T10:03:04.578752+0000","last_undegraded":"2023-07-20T10:03:04.578752+0000","last_fullsized":"2023-07-20T10:03:04.578752+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:03.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739327+0000","last_change":"2023-07-20T10:03:01.905290+0000","last_active":"2023-07-20T10:03:03.739327+0000","last_peered":"2023-07-20T10:03:03.739327+0000","last_clean":"2023-07-20T10:03:03.739327+0000","last_became_active":"2023-07-20T10:03:01.904763+0000","last_became_peered":"2023-07-20T10:03:01.904763+0000","last_unstale":"2023-07-20T10:03:03.739327+0000","last_undegraded":"2023-07-20T10:03:03.739327+0000","last_fullsized":"2023-07-20T10:03:03.739327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:12.025713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894251+0000","last_change":"2023-07-20T10:03:01.906268+0000","last_active":"2023-07-20T10:03:04.894251+0000","last_peered":"2023-07-20T10:03:04.894251+0000","last_clean":"2023-07-20T10:03:04.894251+0000","last_became_active":"2023-07-20T10:03:01.905362+0000","last_became_peered":"2023-07-20T10:03:01.905362+0000","last_unstale":"2023-07-20T10:03:04.894251+0000","last_undegraded":"2023-07-20T10:03:04.894251+0000","last_fullsized":"2023-07-20T10:03:04.894251+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:59.676420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894301+0000","last_change":"2023-07-20T10:03:01.906626+0000","last_active":"2023-07-20T10:03:04.894301+0000","last_peered":"2023-07-20T10:03:04.894301+0000","last_clean":"2023-07-20T10:03:04.894301+0000","last_became_active":"2023-07-20T10:03:01.906317+0000","last_became_peered":"2023-07-20T10:03:01.906317+0000","last_unstale":"2023-07-20T10:03:04.894301+0000","last_undegraded":"2023-07-20T10:03:04.894301+0000","last_fullsized":"2023-07-20T10:03:04.894301+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:22:59.508656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889765+0000","last_change":"2023-07-20T10:03:01.914705+0000","last_active":"2023-07-20T10:03:02.889765+0000","last_peered":"2023-07-20T10:03:02.889765+0000","last_clean":"2023-07-20T10:03:02.889765+0000","last_became_active":"2023-07-20T10:03:01.914398+0000","last_became_peered":"2023-07-20T10:03:01.914398+0000","last_unstale":"2023-07-20T10:03:02.889765+0000","last_undegraded":"2023-07-20T10:03:02.889765+0000","last_fullsized":"2023-07-20T10:03:02.889765+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:06.586058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135711+0000","last_change":"2023-07-20T10:03:01.902998+0000","last_active":"2023-07-20T10:03:03.135711+0000","last_peered":"2023-07-20T10:03:03.135711+0000","last_clean":"2023-07-20T10:03:03.135711+0000","last_became_active":"2023-07-20T10:03:01.902707+0000","last_became_peered":"2023-07-20T10:03:01.902707+0000","last_unstale":"2023-07-20T10:03:03.135711+0000","last_undegraded":"2023-07-20T10:03:03.135711+0000","last_fullsized":"2023-07-20T10:03:03.135711+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:01:36.705845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738637+0000","last_change":"2023-07-20T10:03:01.909989+0000","last_active":"2023-07-20T10:03:03.738637+0000","last_peered":"2023-07-20T10:03:03.738637+0000","last_clean":"2023-07-20T10:03:03.738637+0000","last_became_active":"2023-07-20T10:03:01.906822+0000","last_became_peered":"2023-07-20T10:03:01.906822+0000","last_unstale":"2023-07-20T10:03:03.738637+0000","last_undegraded":"2023-07-20T10:03:03.738637+0000","last_fullsized":"2023-07-20T10:03:03.738637+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:02:02.524110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739278+0000","last_change":"2023-07-20T10:03:01.910914+0000","last_active":"2023-07-20T10:03:03.739278+0000","last_peered":"2023-07-20T10:03:03.739278+0000","last_clean":"2023-07-20T10:03:03.739278+0000","last_became_active":"2023-07-20T10:03:01.910638+0000","last_became_peered":"2023-07-20T10:03:01.910638+0000","last_unstale":"2023-07-20T10:03:03.739278+0000","last_undegraded":"2023-07-20T10:03:03.739278+0000","last_fullsized":"2023-07-20T10:03:03.739278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:35:46.834429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890263+0000","last_change":"2023-07-20T10:03:01.908136+0000","last_active":"2023-07-20T10:03:02.890263+0000","last_peered":"2023-07-20T10:03:02.890263+0000","last_clean":"2023-07-20T10:03:02.890263+0000","last_became_active":"2023-07-20T10:03:01.907844+0000","last_became_peered":"2023-07-20T10:03:01.907844+0000","last_unstale":"2023-07-20T10:03:02.890263+0000","last_undegraded":"2023-07-20T10:03:02.890263+0000","last_fullsized":"2023-07-20T10:03:02.890263+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:10:58.734231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891923+0000","last_change":"2023-07-20T10:03:01.905950+0000","last_active":"2023-07-20T10:03:02.891923+0000","last_peered":"2023-07-20T10:03:02.891923+0000","last_clean":"2023-07-20T10:03:02.891923+0000","last_became_active":"2023-07-20T10:03:01.905572+0000","last_became_peered":"2023-07-20T10:03:01.905572+0000","last_unstale":"2023-07-20T10:03:02.891923+0000","last_undegraded":"2023-07-20T10:03:02.891923+0000","last_fullsized":"2023-07-20T10:03:02.891923+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:32:48.717710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894297+0000","last_change":"2023-07-20T10:03:01.894731+0000","last_active":"2023-07-20T10:03:04.894297+0000","last_peered":"2023-07-20T10:03:04.894297+0000","last_clean":"2023-07-20T10:03:04.894297+0000","last_became_active":"2023-07-20T10:03:01.894385+0000","last_became_peered":"2023-07-20T10:03:01.894385+0000","last_unstale":"2023-07-20T10:03:04.894297+0000","last_undegraded":"2023-07-20T10:03:04.894297+0000","last_fullsized":"2023-07-20T10:03:04.894297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:53:57.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738839+0000","last_change":"2023-07-20T10:03:01.907402+0000","last_active":"2023-07-20T10:03:03.738839+0000","last_peered":"2023-07-20T10:03:03.738839+0000","last_clean":"2023-07-20T10:03:03.738839+0000","last_became_active":"2023-07-20T10:03:01.906614+0000","last_became_peered":"2023-07-20T10:03:01.906614+0000","last_unstale":"2023-07-20T10:03:03.738839+0000","last_undegraded":"2023-07-20T10:03:03.738839+0000","last_fullsized":"2023-07-20T10:03:03.738839+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:22.852895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578528+0000","last_change":"2023-07-20T10:03:01.911071+0000","last_active":"2023-07-20T10:03:04.578528+0000","last_peered":"2023-07-20T10:03:04.578528+0000","last_clean":"2023-07-20T10:03:04.578528+0000","last_became_active":"2023-07-20T10:03:01.910788+0000","last_became_peered":"2023-07-20T10:03:01.910788+0000","last_unstale":"2023-07-20T10:03:04.578528+0000","last_undegraded":"2023-07-20T10:03:04.578528+0000","last_fullsized":"2023-07-20T10:03:04.578528+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:39.566415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738723+0000","last_change":"2023-07-20T10:03:01.907434+0000","last_active":"2023-07-20T10:03:03.738723+0000","last_peered":"2023-07-20T10:03:03.738723+0000","last_clean":"2023-07-20T10:03:03.738723+0000","last_became_active":"2023-07-20T10:03:01.907133+0000","last_became_peered":"2023-07-20T10:03:01.907133+0000","last_unstale":"2023-07-20T10:03:03.738723+0000","last_undegraded":"2023-07-20T10:03:03.738723+0000","last_fullsized":"2023-07-20T10:03:03.738723+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:48:01.996101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892909+0000","last_change":"2023-07-20T10:03:01.914834+0000","last_active":"2023-07-20T10:03:02.892909+0000","last_peered":"2023-07-20T10:03:02.892909+0000","last_clean":"2023-07-20T10:03:02.892909+0000","last_became_active":"2023-07-20T10:03:01.912955+0000","last_became_peered":"2023-07-20T10:03:01.912955+0000","last_unstale":"2023-07-20T10:03:02.892909+0000","last_undegraded":"2023-07-20T10:03:02.892909+0000","last_fullsized":"2023-07-20T10:03:02.892909+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:03.777200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578146+0000","last_change":"2023-07-20T10:03:01.915988+0000","last_active":"2023-07-20T10:03:04.578146+0000","last_peered":"2023-07-20T10:03:04.578146+0000","last_clean":"2023-07-20T10:03:04.578146+0000","last_became_active":"2023-07-20T10:03:01.915713+0000","last_became_peered":"2023-07-20T10:03:01.915713+0000","last_unstale":"2023-07-20T10:03:04.578146+0000","last_undegraded":"2023-07-20T10:03:04.578146+0000","last_fullsized":"2023-07-20T10:03:04.578146+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:04:40.033130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"63'4","reported_seq":17,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894372+0000","last_change":"2023-07-20T10:03:01.099191+0000","last_active":"2023-07-20T10:03:04.894372+0000","last_peered":"2023-07-20T10:03:04.894372+0000","last_clean":"2023-07-20T10:03:04.894372+0000","last_became_active":"2023-07-20T10:03:01.098882+0000","last_became_peered":"2023-07-20T10:03:01.098882+0000","last_unstale":"2023-07-20T10:03:04.894372+0000","last_undegraded":"2023-07-20T10:03:04.894372+0000","last_fullsized":"2023-07-20T10:03:04.894372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:32.845778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892830+0000","last_change":"2023-07-20T10:03:01.912246+0000","last_active":"2023-07-20T10:03:02.892830+0000","last_peered":"2023-07-20T10:03:02.892830+0000","last_clean":"2023-07-20T10:03:02.892830+0000","last_became_active":"2023-07-20T10:03:01.911888+0000","last_became_peered":"2023-07-20T10:03:01.911888+0000","last_unstale":"2023-07-20T10:03:02.892830+0000","last_undegraded":"2023-07-20T10:03:02.892830+0000","last_fullsized":"2023-07-20T10:03:02.892830+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:10.980738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891726+0000","last_change":"2023-07-20T10:03:01.098083+0000","last_active":"2023-07-20T10:03:02.891726+0000","last_peered":"2023-07-20T10:03:02.891726+0000","last_clean":"2023-07-20T10:03:02.891726+0000","last_became_active":"2023-07-20T10:03:01.097809+0000","last_became_peered":"2023-07-20T10:03:01.097809+0000","last_unstale":"2023-07-20T10:03:02.891726+0000","last_undegraded":"2023-07-20T10:03:02.891726+0000","last_fullsized":"2023-07-20T10:03:02.891726+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:25.891688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894062+0000","last_change":"2023-07-20T10:03:01.907197+0000","last_active":"2023-07-20T10:03:04.894062+0000","last_peered":"2023-07-20T10:03:04.894062+0000","last_clean":"2023-07-20T10:03:04.894062+0000","last_became_active":"2023-07-20T10:03:01.906856+0000","last_became_peered":"2023-07-20T10:03:01.906856+0000","last_unstale":"2023-07-20T10:03:04.894062+0000","last_undegraded":"2023-07-20T10:03:04.894062+0000","last_fullsized":"2023-07-20T10:03:04.894062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:26.372830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891894+0000","last_change":"2023-07-20T10:03:01.098834+0000","last_active":"2023-07-20T10:03:02.891894+0000","last_peered":"2023-07-20T10:03:02.891894+0000","last_clean":"2023-07-20T10:03:02.891894+0000","last_became_active":"2023-07-20T10:03:01.098508+0000","last_became_peered":"2023-07-20T10:03:01.098508+0000","last_unstale":"2023-07-20T10:03:02.891894+0000","last_undegraded":"2023-07-20T10:03:02.891894+0000","last_fullsized":"2023-07-20T10:03:02.891894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:45.261033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890065+0000","last_change":"2023-07-20T10:03:01.908145+0000","last_active":"2023-07-20T10:03:02.890065+0000","last_peered":"2023-07-20T10:03:02.890065+0000","last_clean":"2023-07-20T10:03:02.890065+0000","last_became_active":"2023-07-20T10:03:01.907825+0000","last_became_peered":"2023-07-20T10:03:01.907825+0000","last_unstale":"2023-07-20T10:03:02.890065+0000","last_undegraded":"2023-07-20T10:03:02.890065+0000","last_fullsized":"2023-07-20T10:03:02.890065+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:58.503245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893037+0000","last_change":"2023-07-20T10:03:01.099685+0000","last_active":"2023-07-20T10:03:02.893037+0000","last_peered":"2023-07-20T10:03:02.893037+0000","last_clean":"2023-07-20T10:03:02.893037+0000","last_became_active":"2023-07-20T10:03:01.099391+0000","last_became_peered":"2023-07-20T10:03:01.099391+0000","last_unstale":"2023-07-20T10:03:02.893037+0000","last_undegraded":"2023-07-20T10:03:02.893037+0000","last_fullsized":"2023-07-20T10:03:02.893037+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:15.668501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881298+0000","last_change":"2023-07-20T10:03:01.906484+0000","last_active":"2023-07-20T10:03:04.881298+0000","last_peered":"2023-07-20T10:03:04.881298+0000","last_clean":"2023-07-20T10:03:04.881298+0000","last_became_active":"2023-07-20T10:03:01.906205+0000","last_became_peered":"2023-07-20T10:03:01.906205+0000","last_unstale":"2023-07-20T10:03:04.881298+0000","last_undegraded":"2023-07-20T10:03:04.881298+0000","last_fullsized":"2023-07-20T10:03:04.881298+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:47:15.073042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738837+0000","last_change":"2023-07-20T10:03:01.102430+0000","last_active":"2023-07-20T10:03:03.738837+0000","last_peered":"2023-07-20T10:03:03.738837+0000","last_clean":"2023-07-20T10:03:03.738837+0000","last_became_active":"2023-07-20T10:03:01.102170+0000","last_became_peered":"2023-07-20T10:03:01.102170+0000","last_unstale":"2023-07-20T10:03:03.738837+0000","last_undegraded":"2023-07-20T10:03:03.738837+0000","last_fullsized":"2023-07-20T10:03:03.738837+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:52.902925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578456+0000","last_change":"2023-07-20T10:03:01.912608+0000","last_active":"2023-07-20T10:03:04.578456+0000","last_peered":"2023-07-20T10:03:04.578456+0000","last_clean":"2023-07-20T10:03:04.578456+0000","last_became_active":"2023-07-20T10:03:01.911084+0000","last_became_peered":"2023-07-20T10:03:01.911084+0000","last_unstale":"2023-07-20T10:03:04.578456+0000","last_undegraded":"2023-07-20T10:03:04.578456+0000","last_fullsized":"2023-07-20T10:03:04.578456+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:08:20.555673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880984+0000","last_change":"2023-07-20T10:03:01.100480+0000","last_active":"2023-07-20T10:03:04.880984+0000","last_peered":"2023-07-20T10:03:04.880984+0000","last_clean":"2023-07-20T10:03:04.880984+0000","last_became_active":"2023-07-20T10:03:01.100031+0000","last_became_peered":"2023-07-20T10:03:01.100031+0000","last_unstale":"2023-07-20T10:03:04.880984+0000","last_undegraded":"2023-07-20T10:03:04.880984+0000","last_fullsized":"2023-07-20T10:03:04.880984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:05.575026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890393+0000","last_change":"2023-07-20T10:03:01.904588+0000","last_active":"2023-07-20T10:03:02.890393+0000","last_peered":"2023-07-20T10:03:02.890393+0000","last_clean":"2023-07-20T10:03:02.890393+0000","last_became_active":"2023-07-20T10:03:01.904307+0000","last_became_peered":"2023-07-20T10:03:01.904307+0000","last_unstale":"2023-07-20T10:03:02.890393+0000","last_undegraded":"2023-07-20T10:03:02.890393+0000","last_fullsized":"2023-07-20T10:03:02.890393+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:04.122297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894096+0000","last_change":"2023-07-20T10:03:01.104574+0000","last_active":"2023-07-20T10:03:04.894096+0000","last_peered":"2023-07-20T10:03:04.894096+0000","last_clean":"2023-07-20T10:03:04.894096+0000","last_became_active":"2023-07-20T10:03:01.104272+0000","last_became_peered":"2023-07-20T10:03:01.104272+0000","last_unstale":"2023-07-20T10:03:04.894096+0000","last_undegraded":"2023-07-20T10:03:04.894096+0000","last_fullsized":"2023-07-20T10:03:04.894096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:31:43.418139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578817+0000","last_change":"2023-07-20T10:03:01.918641+0000","last_active":"2023-07-20T10:03:04.578817+0000","last_peered":"2023-07-20T10:03:04.578817+0000","last_clean":"2023-07-20T10:03:04.578817+0000","last_became_active":"2023-07-20T10:03:01.918352+0000","last_became_peered":"2023-07-20T10:03:01.918352+0000","last_unstale":"2023-07-20T10:03:04.578817+0000","last_undegraded":"2023-07-20T10:03:04.578817+0000","last_fullsized":"2023-07-20T10:03:04.578817+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:27.628777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738636+0000","last_change":"2023-07-20T10:03:01.099804+0000","last_active":"2023-07-20T10:03:03.738636+0000","last_peered":"2023-07-20T10:03:03.738636+0000","last_clean":"2023-07-20T10:03:03.738636+0000","last_became_active":"2023-07-20T10:03:01.099553+0000","last_became_peered":"2023-07-20T10:03:01.099553+0000","last_unstale":"2023-07-20T10:03:03.738636+0000","last_undegraded":"2023-07-20T10:03:03.738636+0000","last_fullsized":"2023-07-20T10:03:03.738636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:50.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880930+0000","last_change":"2023-07-20T10:03:01.912519+0000","last_active":"2023-07-20T10:03:04.880930+0000","last_peered":"2023-07-20T10:03:04.880930+0000","last_clean":"2023-07-20T10:03:04.880930+0000","last_became_active":"2023-07-20T10:03:01.912185+0000","last_became_peered":"2023-07-20T10:03:01.912185+0000","last_unstale":"2023-07-20T10:03:04.880930+0000","last_undegraded":"2023-07-20T10:03:04.880930+0000","last_fullsized":"2023-07-20T10:03:04.880930+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:41.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578694+0000","last_change":"2023-07-20T10:03:01.098913+0000","last_active":"2023-07-20T10:03:04.578694+0000","last_peered":"2023-07-20T10:03:04.578694+0000","last_clean":"2023-07-20T10:03:04.578694+0000","last_became_active":"2023-07-20T10:03:01.098568+0000","last_became_peered":"2023-07-20T10:03:01.098568+0000","last_unstale":"2023-07-20T10:03:04.578694+0000","last_undegraded":"2023-07-20T10:03:04.578694+0000","last_fullsized":"2023-07-20T10:03:04.578694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:00:10.166845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892881+0000","last_change":"2023-07-20T10:03:01.905613+0000","last_active":"2023-07-20T10:03:02.892881+0000","last_peered":"2023-07-20T10:03:02.892881+0000","last_clean":"2023-07-20T10:03:02.892881+0000","last_became_active":"2023-07-20T10:03:01.905325+0000","last_became_peered":"2023-07-20T10:03:01.905325+0000","last_unstale":"2023-07-20T10:03:02.892881+0000","last_undegraded":"2023-07-20T10:03:02.892881+0000","last_fullsized":"2023-07-20T10:03:02.892881+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:00:11.176258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881334+0000","last_change":"2023-07-20T10:03:01.101064+0000","last_active":"2023-07-20T10:03:04.881334+0000","last_peered":"2023-07-20T10:03:04.881334+0000","last_clean":"2023-07-20T10:03:04.881334+0000","last_became_active":"2023-07-20T10:03:01.100750+0000","last_became_peered":"2023-07-20T10:03:01.100750+0000","last_unstale":"2023-07-20T10:03:04.881334+0000","last_undegraded":"2023-07-20T10:03:04.881334+0000","last_fullsized":"2023-07-20T10:03:04.881334+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:11.016300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739116+0000","last_change":"2023-07-20T10:03:01.907386+0000","last_active":"2023-07-20T10:03:03.739116+0000","last_peered":"2023-07-20T10:03:03.739116+0000","last_clean":"2023-07-20T10:03:03.739116+0000","last_became_active":"2023-07-20T10:03:01.906832+0000","last_became_peered":"2023-07-20T10:03:01.906832+0000","last_unstale":"2023-07-20T10:03:03.739116+0000","last_undegraded":"2023-07-20T10:03:03.739116+0000","last_fullsized":"2023-07-20T10:03:03.739116+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:41.457757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"63'3","reported_seq":16,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578575+0000","last_change":"2023-07-20T10:03:01.102672+0000","last_active":"2023-07-20T10:03:04.578575+0000","last_peered":"2023-07-20T10:03:04.578575+0000","last_clean":"2023-07-20T10:03:04.578575+0000","last_became_active":"2023-07-20T10:03:01.102358+0000","last_became_peered":"2023-07-20T10:03:01.102358+0000","last_unstale":"2023-07-20T10:03:04.578575+0000","last_undegraded":"2023-07-20T10:03:04.578575+0000","last_fullsized":"2023-07-20T10:03:04.578575+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:36:36.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.881201+0000","last_change":"2023-07-20T10:03:01.908640+0000","last_active":"2023-07-20T10:03:04.881201+0000","last_peered":"2023-07-20T10:03:04.881201+0000","last_clean":"2023-07-20T10:03:04.881201+0000","last_became_active":"2023-07-20T10:03:01.908369+0000","last_became_peered":"2023-07-20T10:03:01.908369+0000","last_unstale":"2023-07-20T10:03:04.881201+0000","last_undegraded":"2023-07-20T10:03:04.881201+0000","last_fullsized":"2023-07-20T10:03:04.881201+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:54:44.773912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"63'6","reported_seq":19,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890124+0000","last_change":"2023-07-20T10:03:01.095005+0000","last_active":"2023-07-20T10:03:02.890124+0000","last_peered":"2023-07-20T10:03:02.890124+0000","last_clean":"2023-07-20T10:03:02.890124+0000","last_became_active":"2023-07-20T10:03:01.094719+0000","last_became_peered":"2023-07-20T10:03:01.094719+0000","last_unstale":"2023-07-20T10:03:02.890124+0000","last_undegraded":"2023-07-20T10:03:02.890124+0000","last_fullsized":"2023-07-20T10:03:02.890124+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:17:38.695665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892916+0000","last_change":"2023-07-20T10:03:01.908839+0000","last_active":"2023-07-20T10:03:02.892916+0000","last_peered":"2023-07-20T10:03:02.892916+0000","last_clean":"2023-07-20T10:03:02.892916+0000","last_became_active":"2023-07-20T10:03:01.908568+0000","last_became_peered":"2023-07-20T10:03:01.908568+0000","last_unstale":"2023-07-20T10:03:02.892916+0000","last_undegraded":"2023-07-20T10:03:02.892916+0000","last_fullsized":"2023-07-20T10:03:02.892916+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:27.628777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738940+0000","last_change":"2023-07-20T10:03:01.097287+0000","last_active":"2023-07-20T10:03:03.738940+0000","last_peered":"2023-07-20T10:03:03.738940+0000","last_clean":"2023-07-20T10:03:03.738940+0000","last_became_active":"2023-07-20T10:03:01.096821+0000","last_became_peered":"2023-07-20T10:03:01.096821+0000","last_unstale":"2023-07-20T10:03:03.738940+0000","last_undegraded":"2023-07-20T10:03:03.738940+0000","last_fullsized":"2023-07-20T10:03:03.738940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:12.692777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739395+0000","last_change":"2023-07-20T10:03:01.905097+0000","last_active":"2023-07-20T10:03:03.739395+0000","last_peered":"2023-07-20T10:03:03.739395+0000","last_clean":"2023-07-20T10:03:03.739395+0000","last_became_active":"2023-07-20T10:03:01.904382+0000","last_became_peered":"2023-07-20T10:03:01.904382+0000","last_unstale":"2023-07-20T10:03:03.739395+0000","last_undegraded":"2023-07-20T10:03:03.739395+0000","last_fullsized":"2023-07-20T10:03:03.739395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:39.015147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894240+0000","last_change":"2023-07-20T10:03:01.102086+0000","last_active":"2023-07-20T10:03:04.894240+0000","last_peered":"2023-07-20T10:03:04.894240+0000","last_clean":"2023-07-20T10:03:04.894240+0000","last_became_active":"2023-07-20T10:03:01.101791+0000","last_became_peered":"2023-07-20T10:03:01.101791+0000","last_unstale":"2023-07-20T10:03:04.894240+0000","last_undegraded":"2023-07-20T10:03:04.894240+0000","last_fullsized":"2023-07-20T10:03:04.894240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:30.734356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890282+0000","last_change":"2023-07-20T10:03:01.903777+0000","last_active":"2023-07-20T10:03:02.890282+0000","last_peered":"2023-07-20T10:03:02.890282+0000","last_clean":"2023-07-20T10:03:02.890282+0000","last_became_active":"2023-07-20T10:03:01.903482+0000","last_became_peered":"2023-07-20T10:03:01.903482+0000","last_unstale":"2023-07-20T10:03:02.890282+0000","last_undegraded":"2023-07-20T10:03:02.890282+0000","last_fullsized":"2023-07-20T10:03:02.890282+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:44:01.818347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578402+0000","last_change":"2023-07-20T10:03:01.099392+0000","last_active":"2023-07-20T10:03:04.578402+0000","last_peered":"2023-07-20T10:03:04.578402+0000","last_clean":"2023-07-20T10:03:04.578402+0000","last_became_active":"2023-07-20T10:03:01.099131+0000","last_became_peered":"2023-07-20T10:03:01.099131+0000","last_unstale":"2023-07-20T10:03:04.578402+0000","last_undegraded":"2023-07-20T10:03:04.578402+0000","last_fullsized":"2023-07-20T10:03:04.578402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:54.973827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739178+0000","last_change":"2023-07-20T10:03:01.910137+0000","last_active":"2023-07-20T10:03:03.739178+0000","last_peered":"2023-07-20T10:03:03.739178+0000","last_clean":"2023-07-20T10:03:03.739178+0000","last_became_active":"2023-07-20T10:03:01.906764+0000","last_became_peered":"2023-07-20T10:03:01.906764+0000","last_unstale":"2023-07-20T10:03:03.739178+0000","last_undegraded":"2023-07-20T10:03:03.739178+0000","last_fullsized":"2023-07-20T10:03:03.739178+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:06.584439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"63'8","reported_seq":21,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889951+0000","last_change":"2023-07-20T10:03:01.094469+0000","last_active":"2023-07-20T10:03:02.889951+0000","last_peered":"2023-07-20T10:03:02.889951+0000","last_clean":"2023-07-20T10:03:02.889951+0000","last_became_active":"2023-07-20T10:03:01.094208+0000","last_became_peered":"2023-07-20T10:03:01.094208+0000","last_unstale":"2023-07-20T10:03:02.889951+0000","last_undegraded":"2023-07-20T10:03:02.889951+0000","last_fullsized":"2023-07-20T10:03:02.889951+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:44.937031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889871+0000","last_change":"2023-07-20T10:03:01.908997+0000","last_active":"2023-07-20T10:03:02.889871+0000","last_peered":"2023-07-20T10:03:02.889871+0000","last_clean":"2023-07-20T10:03:02.889871+0000","last_became_active":"2023-07-20T10:03:01.908712+0000","last_became_peered":"2023-07-20T10:03:01.908712+0000","last_unstale":"2023-07-20T10:03:02.889871+0000","last_undegraded":"2023-07-20T10:03:02.889871+0000","last_fullsized":"2023-07-20T10:03:02.889871+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:32:48.717710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739347+0000","last_change":"2023-07-20T10:03:01.101695+0000","last_active":"2023-07-20T10:03:03.739347+0000","last_peered":"2023-07-20T10:03:03.739347+0000","last_clean":"2023-07-20T10:03:03.739347+0000","last_became_active":"2023-07-20T10:03:01.101459+0000","last_became_peered":"2023-07-20T10:03:01.101459+0000","last_unstale":"2023-07-20T10:03:03.739347+0000","last_undegraded":"2023-07-20T10:03:03.739347+0000","last_fullsized":"2023-07-20T10:03:03.739347+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:12.531344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891507+0000","last_change":"2023-07-20T10:03:01.905987+0000","last_active":"2023-07-20T10:03:02.891507+0000","last_peered":"2023-07-20T10:03:02.891507+0000","last_clean":"2023-07-20T10:03:02.891507+0000","last_became_active":"2023-07-20T10:03:01.905560+0000","last_became_peered":"2023-07-20T10:03:01.905560+0000","last_unstale":"2023-07-20T10:03:02.891507+0000","last_undegraded":"2023-07-20T10:03:02.891507+0000","last_fullsized":"2023-07-20T10:03:02.891507+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:30.717692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135987+0000","last_change":"2023-07-20T10:03:01.094714+0000","last_active":"2023-07-20T10:03:03.135987+0000","last_peered":"2023-07-20T10:03:03.135987+0000","last_clean":"2023-07-20T10:03:03.135987+0000","last_became_active":"2023-07-20T10:03:01.094430+0000","last_became_peered":"2023-07-20T10:03:01.094430+0000","last_unstale":"2023-07-20T10:03:03.135987+0000","last_undegraded":"2023-07-20T10:03:03.135987+0000","last_fullsized":"2023-07-20T10:03:03.135987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:02.183478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880941+0000","last_change":"2023-07-20T10:03:01.916447+0000","last_active":"2023-07-20T10:03:04.880941+0000","last_peered":"2023-07-20T10:03:04.880941+0000","last_clean":"2023-07-20T10:03:04.880941+0000","last_became_active":"2023-07-20T10:03:01.916110+0000","last_became_peered":"2023-07-20T10:03:01.916110+0000","last_unstale":"2023-07-20T10:03:04.880941+0000","last_undegraded":"2023-07-20T10:03:04.880941+0000","last_fullsized":"2023-07-20T10:03:04.880941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:20.253957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"63'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894345+0000","last_change":"2023-07-20T10:03:01.104071+0000","last_active":"2023-07-20T10:03:04.894345+0000","last_peered":"2023-07-20T10:03:04.894345+0000","last_clean":"2023-07-20T10:03:04.894345+0000","last_became_active":"2023-07-20T10:03:01.103612+0000","last_became_peered":"2023-07-20T10:03:01.103612+0000","last_unstale":"2023-07-20T10:03:04.894345+0000","last_undegraded":"2023-07-20T10:03:04.894345+0000","last_fullsized":"2023-07-20T10:03:04.894345+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:20.076064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891628+0000","last_change":"2023-07-20T10:03:01.905190+0000","last_active":"2023-07-20T10:03:02.891628+0000","last_peered":"2023-07-20T10:03:02.891628+0000","last_clean":"2023-07-20T10:03:02.891628+0000","last_became_active":"2023-07-20T10:03:01.904746+0000","last_became_peered":"2023-07-20T10:03:01.904746+0000","last_unstale":"2023-07-20T10:03:02.891628+0000","last_undegraded":"2023-07-20T10:03:02.891628+0000","last_fullsized":"2023-07-20T10:03:02.891628+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:14.425974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894401+0000","last_change":"2023-07-20T10:03:01.103025+0000","last_active":"2023-07-20T10:03:04.894401+0000","last_peered":"2023-07-20T10:03:04.894401+0000","last_clean":"2023-07-20T10:03:04.894401+0000","last_became_active":"2023-07-20T10:03:01.102726+0000","last_became_peered":"2023-07-20T10:03:01.102726+0000","last_unstale":"2023-07-20T10:03:04.894401+0000","last_undegraded":"2023-07-20T10:03:04.894401+0000","last_fullsized":"2023-07-20T10:03:04.894401+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:49.894274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892993+0000","last_change":"2023-07-20T10:03:01.906481+0000","last_active":"2023-07-20T10:03:02.892993+0000","last_peered":"2023-07-20T10:03:02.892993+0000","last_clean":"2023-07-20T10:03:02.892993+0000","last_became_active":"2023-07-20T10:03:01.906168+0000","last_became_peered":"2023-07-20T10:03:01.906168+0000","last_unstale":"2023-07-20T10:03:02.892993+0000","last_undegraded":"2023-07-20T10:03:02.892993+0000","last_fullsized":"2023-07-20T10:03:02.892993+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:58.461115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891659+0000","last_change":"2023-07-20T10:03:01.098199+0000","last_active":"2023-07-20T10:03:02.891659+0000","last_peered":"2023-07-20T10:03:02.891659+0000","last_clean":"2023-07-20T10:03:02.891659+0000","last_became_active":"2023-07-20T10:03:01.097911+0000","last_became_peered":"2023-07-20T10:03:01.097911+0000","last_unstale":"2023-07-20T10:03:02.891659+0000","last_undegraded":"2023-07-20T10:03:02.891659+0000","last_fullsized":"2023-07-20T10:03:02.891659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:32.003606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894297+0000","last_change":"2023-07-20T10:03:01.906587+0000","last_active":"2023-07-20T10:03:04.894297+0000","last_peered":"2023-07-20T10:03:04.894297+0000","last_clean":"2023-07-20T10:03:04.894297+0000","last_became_active":"2023-07-20T10:03:01.904319+0000","last_became_peered":"2023-07-20T10:03:01.904319+0000","last_unstale":"2023-07-20T10:03:04.894297+0000","last_undegraded":"2023-07-20T10:03:04.894297+0000","last_fullsized":"2023-07-20T10:03:04.894297+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:59:16.519151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889850+0000","last_change":"2023-07-20T10:03:01.095889+0000","last_active":"2023-07-20T10:03:02.889850+0000","last_peered":"2023-07-20T10:03:02.889850+0000","last_clean":"2023-07-20T10:03:02.889850+0000","last_became_active":"2023-07-20T10:03:01.095605+0000","last_became_peered":"2023-07-20T10:03:01.095605+0000","last_unstale":"2023-07-20T10:03:02.889850+0000","last_undegraded":"2023-07-20T10:03:02.889850+0000","last_fullsized":"2023-07-20T10:03:02.889850+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:45.261033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739174+0000","last_change":"2023-07-20T10:03:01.910342+0000","last_active":"2023-07-20T10:03:03.739174+0000","last_peered":"2023-07-20T10:03:03.739174+0000","last_clean":"2023-07-20T10:03:03.739174+0000","last_became_active":"2023-07-20T10:03:01.907403+0000","last_became_peered":"2023-07-20T10:03:01.907403+0000","last_unstale":"2023-07-20T10:03:03.739174+0000","last_undegraded":"2023-07-20T10:03:03.739174+0000","last_fullsized":"2023-07-20T10:03:03.739174+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:46.685207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738840+0000","last_change":"2023-07-20T10:03:01.102131+0000","last_active":"2023-07-20T10:03:03.738840+0000","last_peered":"2023-07-20T10:03:03.738840+0000","last_clean":"2023-07-20T10:03:03.738840+0000","last_became_active":"2023-07-20T10:03:01.101808+0000","last_became_peered":"2023-07-20T10:03:01.101808+0000","last_unstale":"2023-07-20T10:03:03.738840+0000","last_undegraded":"2023-07-20T10:03:03.738840+0000","last_fullsized":"2023-07-20T10:03:03.738840+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:06.148243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891812+0000","last_change":"2023-07-20T10:03:01.899910+0000","last_active":"2023-07-20T10:03:02.891812+0000","last_peered":"2023-07-20T10:03:02.891812+0000","last_clean":"2023-07-20T10:03:02.891812+0000","last_became_active":"2023-07-20T10:03:01.899636+0000","last_became_peered":"2023-07-20T10:03:01.899636+0000","last_unstale":"2023-07-20T10:03:02.891812+0000","last_undegraded":"2023-07-20T10:03:02.891812+0000","last_fullsized":"2023-07-20T10:03:02.891812+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:05.288591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135564+0000","last_change":"2023-07-20T10:03:01.089742+0000","last_active":"2023-07-20T10:03:03.135564+0000","last_peered":"2023-07-20T10:03:03.135564+0000","last_clean":"2023-07-20T10:03:03.135564+0000","last_became_active":"2023-07-20T10:03:01.089421+0000","last_became_peered":"2023-07-20T10:03:01.089421+0000","last_unstale":"2023-07-20T10:03:03.135564+0000","last_undegraded":"2023-07-20T10:03:03.135564+0000","last_fullsized":"2023-07-20T10:03:03.135564+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:11.970883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.893941+0000","last_change":"2023-07-20T10:03:01.905507+0000","last_active":"2023-07-20T10:03:04.893941+0000","last_peered":"2023-07-20T10:03:04.893941+0000","last_clean":"2023-07-20T10:03:04.893941+0000","last_became_active":"2023-07-20T10:03:01.905221+0000","last_became_peered":"2023-07-20T10:03:01.905221+0000","last_unstale":"2023-07-20T10:03:04.893941+0000","last_undegraded":"2023-07-20T10:03:04.893941+0000","last_fullsized":"2023-07-20T10:03:04.893941+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:10:21.094356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"64'1","reported_seq":14,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739314+0000","last_change":"2023-07-20T10:03:01.097964+0000","last_active":"2023-07-20T10:03:03.739314+0000","last_peered":"2023-07-20T10:03:03.739314+0000","last_clean":"2023-07-20T10:03:03.739314+0000","last_became_active":"2023-07-20T10:03:01.097554+0000","last_became_peered":"2023-07-20T10:03:01.097554+0000","last_unstale":"2023-07-20T10:03:03.739314+0000","last_undegraded":"2023-07-20T10:03:03.739314+0000","last_fullsized":"2023-07-20T10:03:03.739314+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:47:14.063629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":333,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578534+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:03:04.578534+0000","last_peered":"2023-07-20T10:03:04.578534+0000","last_clean":"2023-07-20T10:03:04.578534+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:03:04.578534+0000","last_undegraded":"2023-07-20T10:03:04.578534+0000","last_fullsized":"2023-07-20T10:03:04.578534+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:53.286285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":105,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892859+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:03:02.892859+0000","last_peered":"2023-07-20T10:03:02.892859+0000","last_clean":"2023-07-20T10:03:02.892859+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:03:02.892859+0000","last_undegraded":"2023-07-20T10:03:02.892859+0000","last_fullsized":"2023-07-20T10:03:02.892859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:18.091205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892039+0000","last_change":"2023-07-20T10:03:01.898820+0000","last_active":"2023-07-20T10:03:02.892039+0000","last_peered":"2023-07-20T10:03:02.892039+0000","last_clean":"2023-07-20T10:03:02.892039+0000","last_became_active":"2023-07-20T10:03:01.898538+0000","last_became_peered":"2023-07-20T10:03:01.898538+0000","last_unstale":"2023-07-20T10:03:02.892039+0000","last_undegraded":"2023-07-20T10:03:02.892039+0000","last_fullsized":"2023-07-20T10:03:02.892039+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:18:45.946444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578645+0000","last_change":"2023-07-20T10:03:01.096763+0000","last_active":"2023-07-20T10:03:04.578645+0000","last_peered":"2023-07-20T10:03:04.578645+0000","last_clean":"2023-07-20T10:03:04.578645+0000","last_became_active":"2023-07-20T10:03:01.096409+0000","last_became_peered":"2023-07-20T10:03:01.096409+0000","last_unstale":"2023-07-20T10:03:04.578645+0000","last_undegraded":"2023-07-20T10:03:04.578645+0000","last_fullsized":"2023-07-20T10:03:04.578645+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:09.971325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578129+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:03:04.578129+0000","last_peered":"2023-07-20T10:03:04.578129+0000","last_clean":"2023-07-20T10:03:04.578129+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:03:04.578129+0000","last_undegraded":"2023-07-20T10:03:04.578129+0000","last_fullsized":"2023-07-20T10:03:04.578129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:39.157293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889745+0000","last_change":"2023-07-20T10:03:01.902251+0000","last_active":"2023-07-20T10:03:02.889745+0000","last_peered":"2023-07-20T10:03:02.889745+0000","last_clean":"2023-07-20T10:03:02.889745+0000","last_became_active":"2023-07-20T10:03:01.901879+0000","last_became_peered":"2023-07-20T10:03:01.901879+0000","last_unstale":"2023-07-20T10:03:02.889745+0000","last_undegraded":"2023-07-20T10:03:02.889745+0000","last_fullsized":"2023-07-20T10:03:02.889745+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:05.288591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738990+0000","last_change":"2023-07-20T10:03:01.093664+0000","last_active":"2023-07-20T10:03:03.738990+0000","last_peered":"2023-07-20T10:03:03.738990+0000","last_clean":"2023-07-20T10:03:03.738990+0000","last_became_active":"2023-07-20T10:03:01.093391+0000","last_became_peered":"2023-07-20T10:03:01.093391+0000","last_unstale":"2023-07-20T10:03:03.738990+0000","last_undegraded":"2023-07-20T10:03:03.738990+0000","last_fullsized":"2023-07-20T10:03:03.738990+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:53:12.894309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.135767+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:03:03.135767+0000","last_peered":"2023-07-20T10:03:03.135767+0000","last_clean":"2023-07-20T10:03:03.135767+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:03:03.135767+0000","last_undegraded":"2023-07-20T10:03:03.135767+0000","last_fullsized":"2023-07-20T10:03:03.135767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:27:26.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893047+0000","last_change":"2023-07-20T10:03:01.914643+0000","last_active":"2023-07-20T10:03:02.893047+0000","last_peered":"2023-07-20T10:03:02.893047+0000","last_clean":"2023-07-20T10:03:02.893047+0000","last_became_active":"2023-07-20T10:03:01.912735+0000","last_became_peered":"2023-07-20T10:03:01.912735+0000","last_unstale":"2023-07-20T10:03:02.893047+0000","last_undegraded":"2023-07-20T10:03:02.893047+0000","last_fullsized":"2023-07-20T10:03:02.893047+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:52:13.028744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"63'2","reported_seq":15,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894432+0000","last_change":"2023-07-20T10:03:01.102240+0000","last_active":"2023-07-20T10:03:04.894432+0000","last_peered":"2023-07-20T10:03:04.894432+0000","last_clean":"2023-07-20T10:03:04.894432+0000","last_became_active":"2023-07-20T10:03:01.101668+0000","last_became_peered":"2023-07-20T10:03:01.101668+0000","last_unstale":"2023-07-20T10:03:04.894432+0000","last_undegraded":"2023-07-20T10:03:04.894432+0000","last_fullsized":"2023-07-20T10:03:04.894432+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:27:22.310107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.892740+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:03:02.892740+0000","last_peered":"2023-07-20T10:03:02.892740+0000","last_clean":"2023-07-20T10:03:02.892740+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:03:02.892740+0000","last_undegraded":"2023-07-20T10:03:02.892740+0000","last_fullsized":"2023-07-20T10:03:02.892740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:57.844795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.739491+0000","last_change":"2023-07-20T10:03:01.913500+0000","last_active":"2023-07-20T10:03:03.739491+0000","last_peered":"2023-07-20T10:03:03.739491+0000","last_clean":"2023-07-20T10:03:03.739491+0000","last_became_active":"2023-07-20T10:03:01.910307+0000","last_became_peered":"2023-07-20T10:03:01.910307+0000","last_unstale":"2023-07-20T10:03:03.739491+0000","last_undegraded":"2023-07-20T10:03:03.739491+0000","last_fullsized":"2023-07-20T10:03:03.739491+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:33.341222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.880927+0000","last_change":"2023-07-20T10:03:01.101656+0000","last_active":"2023-07-20T10:03:04.880927+0000","last_peered":"2023-07-20T10:03:04.880927+0000","last_clean":"2023-07-20T10:03:04.880927+0000","last_became_active":"2023-07-20T10:03:01.101362+0000","last_became_peered":"2023-07-20T10:03:01.101362+0000","last_unstale":"2023-07-20T10:03:04.880927+0000","last_undegraded":"2023-07-20T10:03:04.880927+0000","last_fullsized":"2023-07-20T10:03:04.880927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:45.675794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891567+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:03:02.891567+0000","last_peered":"2023-07-20T10:03:02.891567+0000","last_clean":"2023-07-20T10:03:02.891567+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:03:02.891567+0000","last_undegraded":"2023-07-20T10:03:02.891567+0000","last_fullsized":"2023-07-20T10:03:02.891567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:59:41.311432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.890556+0000","last_change":"2023-07-20T10:03:01.902121+0000","last_active":"2023-07-20T10:03:02.890556+0000","last_peered":"2023-07-20T10:03:02.890556+0000","last_clean":"2023-07-20T10:03:02.890556+0000","last_became_active":"2023-07-20T10:03:01.901825+0000","last_became_peered":"2023-07-20T10:03:01.901825+0000","last_unstale":"2023-07-20T10:03:02.890556+0000","last_undegraded":"2023-07-20T10:03:02.890556+0000","last_fullsized":"2023-07-20T10:03:02.890556+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:26.920734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893119+0000","last_change":"2023-07-20T10:03:01.102031+0000","last_active":"2023-07-20T10:03:02.893119+0000","last_peered":"2023-07-20T10:03:02.893119+0000","last_clean":"2023-07-20T10:03:02.893119+0000","last_became_active":"2023-07-20T10:03:01.101741+0000","last_became_peered":"2023-07-20T10:03:01.101741+0000","last_unstale":"2023-07-20T10:03:02.893119+0000","last_undegraded":"2023-07-20T10:03:02.893119+0000","last_fullsized":"2023-07-20T10:03:02.893119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:36:21.590537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.578765+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:03:04.578765+0000","last_peered":"2023-07-20T10:03:04.578765+0000","last_clean":"2023-07-20T10:03:04.578765+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:03:04.578765+0000","last_undegraded":"2023-07-20T10:03:04.578765+0000","last_fullsized":"2023-07-20T10:03:04.578765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:18.091205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:03.738925+0000","last_change":"2023-07-20T10:03:01.910910+0000","last_active":"2023-07-20T10:03:03.738925+0000","last_peered":"2023-07-20T10:03:03.738925+0000","last_clean":"2023-07-20T10:03:03.738925+0000","last_became_active":"2023-07-20T10:03:01.910419+0000","last_became_peered":"2023-07-20T10:03:01.910419+0000","last_unstale":"2023-07-20T10:03:03.738925+0000","last_undegraded":"2023-07-20T10:03:03.738925+0000","last_fullsized":"2023-07-20T10:03:03.738925+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:00:59.749346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889834+0000","last_change":"2023-07-20T10:03:01.095770+0000","last_active":"2023-07-20T10:03:02.889834+0000","last_peered":"2023-07-20T10:03:02.889834+0000","last_clean":"2023-07-20T10:03:02.889834+0000","last_became_active":"2023-07-20T10:03:01.095483+0000","last_became_peered":"2023-07-20T10:03:01.095483+0000","last_unstale":"2023-07-20T10:03:02.889834+0000","last_undegraded":"2023-07-20T10:03:02.889834+0000","last_fullsized":"2023-07-20T10:03:02.889834+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:16.809701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.891818+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:03:02.891818+0000","last_peered":"2023-07-20T10:03:02.891818+0000","last_clean":"2023-07-20T10:03:02.891818+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:03:02.891818+0000","last_undegraded":"2023-07-20T10:03:02.891818+0000","last_fullsized":"2023-07-20T10:03:02.891818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:20:25.844554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.893108+0000","last_change":"2023-07-20T10:03:01.914300+0000","last_active":"2023-07-20T10:03:02.893108+0000","last_peered":"2023-07-20T10:03:02.893108+0000","last_clean":"2023-07-20T10:03:02.893108+0000","last_became_active":"2023-07-20T10:03:01.914016+0000","last_became_peered":"2023-07-20T10:03:01.914016+0000","last_unstale":"2023-07-20T10:03:02.893108+0000","last_undegraded":"2023-07-20T10:03:02.893108+0000","last_fullsized":"2023-07-20T10:03:02.893108+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:01.065630+0000","last_clean_scrub_stamp":"2023-07-20T10:03:01.065630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:39:04.097651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:02.889970+0000","last_change":"2023-07-20T10:03:01.099868+0000","last_active":"2023-07-20T10:03:02.889970+0000","last_peered":"2023-07-20T10:03:02.889970+0000","last_clean":"2023-07-20T10:03:02.889970+0000","last_became_active":"2023-07-20T10:03:01.099592+0000","last_became_peered":"2023-07-20T10:03:01.099592+0000","last_unstale":"2023-07-20T10:03:02.889970+0000","last_undegraded":"2023-07-20T10:03:02.889970+0000","last_fullsized":"2023-07-20T10:03:02.889970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:03:00.056217+0000","last_clean_scrub_stamp":"2023-07-20T10:03:00.056217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:24:15.208917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":102,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-07-20T10:03:04.894501+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:03:04.894501+0000","last_peered":"2023-07-20T10:03:04.894501+0000","last_clean":"2023-07-20T10:03:04.894501+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:03:04.894501+0000","last_undegraded":"2023-07-20T10:03:04.894501+0000","last_fullsized":"2023-07-20T10:03:04.894501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:36:53.242062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54592,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317248,"statfs":{"total":96636764160,"available":96580861952,"internally_reserved":0,"allocated":1363968,"data_stored":963727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.747,"15min":0.73799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":1.0589999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.73699999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99099999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72699999999999998,"15min":0.69399999999999995},"min":{"1min":0.45900000000000002,"5min":0.44800000000000001,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.90900000000000003,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.624},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.47199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.57499999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65800000000000003,"15min":0.69999999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.98499999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60899999999999999,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65600000000000003,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.42399999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93200000000000005,"15min":1.0069999999999999},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67700000000000005,"15min":0.72199999999999998},"min":{"1min":0.497,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96399999999999997,"5min":0.999,"15min":0.999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.67400000000000004},"min":{"1min":0.41999999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":770048,"data_stored":373887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.73099999999999998},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0780000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78300000000000003,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95599999999999996,"5min":0.98499999999999999,"15min":1.2010000000000001},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.72499999999999998,"15min":0.70999999999999996},"min":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.98999999999999999,"15min":1.1259999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.88500000000000001,"5min":0.94599999999999995,"15min":1.103},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.91800000000000004,"5min":0.93999999999999995,"15min":1.2230000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.51500000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90500000000000003,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.746,"15min":0.72399999999999998},"min":{"1min":0.5,"5min":0.496,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.0149999999999999,"15min":1.25},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.93200000000000005,"5min":0.94999999999999996,"15min":1.272},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.77500000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.70099999999999996},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.84099999999999997,"5min":0.95999999999999996,"15min":0.98099999999999998},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":0.88,"15min":0.92000000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.93100000000000005,"5min":1.0389999999999999,"15min":1.0649999999999999},"last":0.629}]},{"osd":7,"last update":"Thu Jul 20 10:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.627,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94799999999999995,"5min":1.0609999999999999,"15min":1.155},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66400000000000003,"15min":0.68300000000000005},"min":{"1min":0.502,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.91200000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":761856,"data_stored":373235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71899999999999997,"15min":0.71199999999999997},"min":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91600000000000004,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.871,"5min":0.96999999999999997,"15min":0.97199999999999998},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72699999999999998,"15min":0.71799999999999997},"min":{"1min":0.40600000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.748,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76700000000000002,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.76000000000000001,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93899999999999995,"5min":0.97199999999999998,"15min":0.996},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.65400000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.499}]},{"osd":6,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.63700000000000001,"15min":0.66100000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.94899999999999995,"5min":1.0089999999999999,"15min":1.016},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.3080000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.145},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91400000000000003,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.52500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31864,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339976,"statfs":{"total":96636764160,"available":96604135424,"internally_reserved":0,"allocated":765952,"data_stored":373817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72999999999999998,"15min":0.71199999999999997},"min":{"1min":0.49099999999999999,"5min":0.39300000000000002,"15min":0.38300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.38400000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.085},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.71799999999999997},"min":{"1min":0.5,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.125,"5min":1.125,"15min":1.141},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.71499999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.433},"max":{"1min":1.22,"5min":1.22,"15min":1.363},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.56100000000000005,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.48299999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.3620000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.747},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.212},"last":0.75800000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63200000000000001,"15min":0.64700000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.82099999999999995,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":0.86399999999999999,"5min":0.93500000000000005,"15min":1.196},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.60799999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.90800000000000003,"5min":1.004,"15min":1.4970000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.71999999999999997,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.41499999999999998},"max":{"1min":0.93200000000000005,"5min":1.0209999999999999,"15min":1.538},"last":0.625}]},{"osd":7,"last update":"Thu Jul 20 10:02:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.65100000000000002},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.40699999999999997},"max":{"1min":0.753,"5min":1.0009999999999999,"15min":1.597},"last":0.51100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":778240,"data_stored":374821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.50800000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.255},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.48999999999999999,"15min":0.53900000000000003},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.47099999999999997},"min":{"1min":0.379,"5min":0.32800000000000001,"15min":0.29299999999999998},"max":{"1min":0.752,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.33300000000000002},"max":{"1min":0.77100000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56200000000000006,"15min":0.55000000000000004},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.75800000000000001,"5min":0.81999999999999995,"15min":1.099},"last":0.502}]},{"osd":4,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79100000000000004,"15min":0.78600000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80700000000000005,"15min":0.78300000000000003},"min":{"1min":0.52500000000000002,"5min":0.505,"15min":0.45900000000000002},"max":{"1min":0.99299999999999999,"5min":1.381,"15min":1.381},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79700000000000004,"15min":0.78900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.98299999999999998,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81399999999999995,"15min":0.79500000000000004},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0920000000000001,"5min":1.274,"15min":1.274},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79000000000000004,"15min":0.78000000000000003},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.502},"max":{"1min":0.96999999999999997,"5min":1.131,"15min":1.1950000000000001},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79500000000000004,"15min":0.79700000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.496},"max":{"1min":0.94299999999999995,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.81899999999999995,"15min":0.81399999999999995},"min":{"1min":0.60099999999999998,"5min":0.58699999999999997,"15min":0.54200000000000004},"max":{"1min":1.0509999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54024,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317816,"statfs":{"total":96636764160,"available":96581443584,"internally_reserved":0,"allocated":774144,"data_stored":374799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.623,"5min":0.89300000000000002,"15min":0.92700000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51200000000000001,"15min":0.51800000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76100000000000001,"5min":0.84499999999999997,"15min":1.6599999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.46800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.25700000000000001},"max":{"1min":0.83799999999999997,"5min":0.876,"15min":0.876},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.628}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71799999999999997,"5min":0.92600000000000005,"15min":0.93000000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.435}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78400000000000003,"15min":0.78000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":1.246,"15min":1.25},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96399999999999997,"5min":1.2689999999999999,"15min":1.383},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.79900000000000004,"15min":0.79700000000000004},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.004,"5min":1.1899999999999999,"15min":1.2470000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0189999999999999,"5min":1.169,"15min":1.51},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.81799999999999995,"15min":0.81100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82299999999999995,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0600000000000001,"5min":1.292,"15min":1.5820000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.83099999999999996,"15min":0.82299999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0720000000000001,"5min":1.393,"15min":1.393},"last":0.748}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":770048,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.28999999999999998,"5min":0.26500000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54000000000000004,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.76700000000000002,"15min":0.89600000000000002},"last":0.502}]},{"osd":2,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47399999999999998,"15min":0.47199999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.626,"5min":0.69699999999999995,"15min":1.0800000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.51200000000000001,"15min":0.51300000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.88300000000000001},"last":0.52300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.40799999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":1.052},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.31900000000000001},"max":{"1min":0.65600000000000003,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.54000000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92900000000000005,"5min":1.0329999999999999,"15min":1.1930000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.46999999999999997},"max":{"1min":1.048,"5min":1.117,"15min":1.117},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.78100000000000003},"min":{"1min":0.53900000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91400000000000003,"5min":1.1559999999999999,"15min":1.355},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.53400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.78800000000000003},"min":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":1.107,"15min":1.1879999999999999},"last":0.81399999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0129999999999999,"5min":1.117,"15min":1.6060000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.78500000000000003,"15min":0.79200000000000004},"min":{"1min":0.55500000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2529999999999999},"last":0.86699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1363968,"data_stored":963659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.49199999999999999,"15min":0.45200000000000001},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.58899999999999997,"15min":0.52600000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":5.1619999999999999,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55800000000000005,"15min":0.52800000000000002},"min":{"1min":0.39900000000000002,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.1459999999999999,"5min":0.68300000000000005,"15min":0.57699999999999996},"min":{"1min":0.40100000000000002,"5min":0.39000000000000001,"15min":0.36799999999999999},"max":{"1min":10.141999999999999,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.433}]},{"osd":3,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":0.627,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":10.631,"5min":10.631,"15min":10.631},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.60799999999999998,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":3.2909999999999999,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.81100000000000005,"15min":0.78600000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.83699999999999997,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.57999999999999996,"15min":0.495},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.89800000000000002,"15min":0.82399999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":7.4340000000000002,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.82699999999999996,"15min":0.79800000000000004},"min":{"1min":0.629,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.84899999999999998,"15min":0.81200000000000006},"min":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.48499999999999999},"max":{"1min":3.161,"5min":3.161,"15min":3.161},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":0.878,"15min":0.82599999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.46600000000000003},"max":{"1min":5.1189999999999998,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:02:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":0.89400000000000002,"15min":0.84299999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":5.1970000000000001,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.878,"5min":0.82799999999999996,"15min":0.80800000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:03:11.072 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:03:11.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:03:11.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 Processor -- start 2023-07-20T10:03:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 -- start start 2023-07-20T10:03:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 0x7f783406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78340c95d0 con 0x7f7834158ce0 2023-07-20T10:03:11.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7834071310 con 0x7f783406b620 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f783a2f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783406bff0 con 0x7f7834070970 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f7838896640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 0x7f783406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f78337fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f7838896640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 0x7f783406bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:59516/0 (socket says 172.21.15.82:59516) 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f7833fff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f7834158ce0 0x7f78340c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:42836/0 (socket says 172.21.15.82:42836) 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f7838896640 1 -- 172.21.15.82:0/984896388 learned_addr learned my addr 172.21.15.82:0/984896388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:11.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f78337fe640 1 -- 172.21.15.82:0/984896388 >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 msgr2=0x7f783406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f78337fe640 1 --2- 172.21.15.82:0/984896388 >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 0x7f783406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f78337fe640 1 -- 172.21.15.82:0/984896388 >> v1:172.21.15.183:6789/0 conn(0x7f7834158ce0 legacy=0x7f78340c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f78337fe640 1 -- 172.21.15.82:0/984896388 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78341590c0 con 0x7f7834070970 2023-07-20T10:03:11.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.266+0000 7f7832ffd640 1 -- 172.21.15.82:0/984896388 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143566476 0 0) 0x7f78340c95d0 con 0x7f7834158ce0 2023-07-20T10:03:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f78337fe640 1 --2- 172.21.15.82:0/984896388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834070dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f78280097c0 tx=0x7f782801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f8c6f5f5b986ee5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f7832ffd640 1 -- 172.21.15.82:0/984896388 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280ac630 con 0x7f7834070970 2023-07-20T10:03:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f7832ffd640 1 -- 172.21.15.82:0/984896388 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78280ac790 con 0x7f7834070970 2023-07-20T10:03:11.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f7832ffd640 1 -- 172.21.15.82:0/984896388 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78280acb20 con 0x7f7834070970 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 -- 172.21.15.82:0/984896388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 msgr2=0x7f7834070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 --2- 172.21.15.82:0/984896388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834070dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f78280097c0 tx=0x7f782801c450 comp rx=0 tx=0).stop 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 -- 172.21.15.82:0/984896388 shutdown_connections 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 --2- 172.21.15.82:0/984896388 >> v2:172.21.15.183:3300/0 conn(0x7f783406b620 0x7f783406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 --2- 172.21.15.82:0/984896388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834070dd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 -- 172.21.15.82:0/984896388 >> 172.21.15.82:0/984896388 conn(0x7f78340cad50 msgr2=0x7f78340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:11.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 -- 172.21.15.82:0/984896388 shutdown_connections 2023-07-20T10:03:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.270+0000 7f783a2f9640 1 -- 172.21.15.82:0/984896388 wait complete. 2023-07-20T10:03:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 Processor -- start 2023-07-20T10:03:11.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- start start 2023-07-20T10:03:11.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7834158ce0 0x7f783414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340ac730 con 0x7f783406b620 2023-07-20T10:03:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78340aca10 con 0x7f7834158ce0 2023-07-20T10:03:11.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78340accf0 con 0x7f7834070970 2023-07-20T10:03:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43772/0 (socket says 172.21.15.82:43772) 2023-07-20T10:03:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 -- 172.21.15.82:0/1681515267 learned_addr learned my addr 172.21.15.82:0/1681515267 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:11.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 -- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 msgr2=0x7f7834159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 -- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7834158ce0 msgr2=0x7f783414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7834158ce0 0x7f783414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 -- 172.21.15.82:0/1681515267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828009420 con 0x7f783406b620 2023-07-20T10:03:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7833fff640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f782400c480 tx=0x7f782400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240074e0 con 0x7f783406b620 2023-07-20T10:03:11.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824007660 con 0x7f783406b620 2023-07-20T10:03:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78340acfd0 con 0x7f783406b620 2023-07-20T10:03:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824004a30 con 0x7f783406b620 2023-07-20T10:03:11.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.273+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7834159c20 con 0x7f783406b620 2023-07-20T10:03:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783404da30 con 0x7f783406b620 2023-07-20T10:03:11.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7824004b90 con 0x7f783406b620 2023-07-20T10:03:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f7830ff9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 0x7f7820068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7824083c20 con 0x7f783406b620 2023-07-20T10:03:11.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f78337fe640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 0x7f7820068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.277+0000 7f78337fe640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 0x7f7820068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78280ae000 tx=0x7f7828008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.281+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7824054a10 con 0x7f783406b620 2023-07-20T10:03:11.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.481+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f78340b4250 con 0x7f783406b620 2023-07-20T10:03:11.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.485+0000 7f7830ff9640 1 -- 172.21.15.82:0/1681515267 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7824058e60 con 0x7f783406b620 2023-07-20T10:03:11.475 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:03:11.476 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:03:11.476 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:03:11.476 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:03:11.476 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:03:11.476 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:03:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 msgr2=0x7f7820068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 0x7f7820068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78280ae000 tx=0x7f7828008040 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 msgr2=0x7f7834159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f782400c480 tx=0x7f782400c940 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 shutdown_connections 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7834158ce0 0x7f783414a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7834070970 0x7f7834159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f78200663d0 0x7f7820068890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 --2- 172.21.15.82:0/1681515267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783406b620 0x7f7834159510 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 >> 172.21.15.82:0/1681515267 conn(0x7f78340cad50 msgr2=0x7f78340cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:11.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 shutdown_connections 2023-07-20T10:03:11.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.489+0000 7f783a2f9640 1 -- 172.21.15.82:0/1681515267 wait complete. 2023-07-20T10:03:11.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:03:11.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.645+0000 7f2d84967640 1 Processor -- start 2023-07-20T10:03:11.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 -- start start 2023-07-20T10:03:11.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 0x7f2d8015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d800cc900 0x7f2d800ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d800b2380 0x7f2d800b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d800b2d50 con 0x7f2d800b2380 2023-07-20T10:03:11.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d800ad600 con 0x7f2d801596b0 2023-07-20T10:03:11.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d84967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800ccd60 con 0x7f2d800cc900 2023-07-20T10:03:11.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d800b2380 0x7f2d800b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d800b2380 0x7f2d800b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43786/0 (socket says 172.21.15.82:43786) 2023-07-20T10:03:11.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 -- 172.21.15.82:0/899113182 learned_addr learned my addr 172.21.15.82:0/899113182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:11.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7e59c640 1 --2- 172.21.15.82:0/899113182 >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 0x7f2d8015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d75d9b640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d800cc900 0x7f2d800ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 -- 172.21.15.82:0/899113182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d800cc900 msgr2=0x7f2d800ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:11.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d800cc900 0x7f2d800ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 -- 172.21.15.82:0/899113182 >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 msgr2=0x7f2d8015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:11.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 --2- 172.21.15.82:0/899113182 >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 0x7f2d8015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7ed9d640 1 -- 172.21.15.82:0/899113182 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800ad810 con 0x7f2d800b2380 2023-07-20T10:03:11.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.649+0000 7f2d7e59c640 1 --2- 172.21.15.82:0/899113182 >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 0x7f2d8015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:11.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d7ed9d640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d800b2810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d80061490 tx=0x7f2d7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e18a45f0f47671 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d7dd9b640 1 -- 172.21.15.82:0/899113182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780aa5f0 con 0x7f2d800b2380 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d7dd9b640 1 -- 172.21.15.82:0/899113182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d780aa750 con 0x7f2d800b2380 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d7dd9b640 1 -- 172.21.15.82:0/899113182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780aaae0 con 0x7f2d800b2380 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 -- 172.21.15.82:0/899113182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 msgr2=0x7f2d800b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d800b2810 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2d80061490 tx=0x7f2d7801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 -- 172.21.15.82:0/899113182 shutdown_connections 2023-07-20T10:03:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d800b2810 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 --2- 172.21.15.82:0/899113182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d800cc900 0x7f2d800ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 --2- 172.21.15.82:0/899113182 >> v2:172.21.15.183:3300/0 conn(0x7f2d801596b0 0x7f2d8015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 -- 172.21.15.82:0/899113182 >> 172.21.15.82:0/899113182 conn(0x7f2d800cada0 msgr2=0x7f2d800cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 -- 172.21.15.82:0/899113182 shutdown_connections 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 -- 172.21.15.82:0/899113182 wait complete. 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.653+0000 7f2d84967640 1 Processor -- start 2023-07-20T10:03:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- start start 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800cc900 0x7f2d80099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d801596b0 0x7f2d8014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800ac440 con 0x7f2d800b2380 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8009a4f0 con 0x7f2d800cc900 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8014ead0 con 0x7f2d801596b0 2023-07-20T10:03:11.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43798/0 (socket says 172.21.15.82:43798) 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 -- 172.21.15.82:0/2187981600 learned_addr learned my addr 172.21.15.82:0/2187981600 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7ed9d640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d801596b0 0x7f2d8014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d75d9b640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800cc900 0x7f2d80099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 -- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d801596b0 msgr2=0x7f2d8014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d801596b0 0x7f2d8014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 -- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800cc900 msgr2=0x7f2d80099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800cc900 0x7f2d80099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 -- 172.21.15.82:0/2187981600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d780094d0 con 0x7f2d800b2380 2023-07-20T10:03:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d7e59c640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000d830 tx=0x7f2d7000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d700096c0 con 0x7f2d800b2380 2023-07-20T10:03:11.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d70009820 con 0x7f2d800b2380 2023-07-20T10:03:11.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d800ab7c0 con 0x7f2d800b2380 2023-07-20T10:03:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70009bd0 con 0x7f2d800b2380 2023-07-20T10:03:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d800abd80 con 0x7f2d800b2380 2023-07-20T10:03:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.657+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d80073c70 con 0x7f2d800b2380 2023-07-20T10:03:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.661+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d70014410 con 0x7f2d800b2380 2023-07-20T10:03:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.661+0000 7f2d777fe640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 0x7f2d60068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.661+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d70084680 con 0x7f2d800b2380 2023-07-20T10:03:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.661+0000 7f2d75d9b640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 0x7f2d60068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.661+0000 7f2d75d9b640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 0x7f2d60068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d800b2c60 tx=0x7f2d68009830 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.665+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d70051a90 con 0x7f2d800b2380 2023-07-20T10:03:11.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.841+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d800acad0 con 0x7f2d800b2380 2023-07-20T10:03:11.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.841+0000 7f2d777fe640 1 -- 172.21.15.82:0/2187981600 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f2d700550b0 con 0x7f2d800b2380 2023-07-20T10:03:11.831 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:11.831 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:03:11.831 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:03:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 msgr2=0x7f2d60068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 0x7f2d60068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d800b2c60 tx=0x7f2d68009830 comp rx=0 tx=0).stop 2023-07-20T10:03:11.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 msgr2=0x7f2d80151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000d830 tx=0x7f2d7000dcf0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 shutdown_connections 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d801596b0 0x7f2d8014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d800cc900 0x7f2d80099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f2d600663a0 0x7f2d60068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 --2- 172.21.15.82:0/2187981600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d800b2380 0x7f2d80151340 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:11.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 >> 172.21.15.82:0/2187981600 conn(0x7f2d800cada0 msgr2=0x7f2d800cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:11.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 shutdown_connections 2023-07-20T10:03:11.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:11.845+0000 7f2d84967640 1 -- 172.21.15.82:0/2187981600 wait complete. 2023-07-20T10:03:12.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:03:01.464190+0000', 'modified': '2023-07-20T10:03:05.103842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5836}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5836': {'gid': 5836, 'name': 'd', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6834/1320222659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 1320222659}, {'type': 'v1', 'addr': '172.21.15.183:6834', 'nonce': 1320222659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:03:12.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:03:12.255 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-20T10:03:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 Processor -- start 2023-07-20T10:03:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 -- start start 2023-07-20T10:03:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc9ec1596b0 0x7fc9ec15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0b2380 0x7fc9ec0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0b2d50 con 0x7fc9ec0cc900 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ad600 con 0x7fc9ec1596b0 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f4703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ccd90 con 0x7fc9ec0b2380 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43808/0 (socket says 172.21.15.82:43808) 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/2417717491 learned_addr learned my addr 172.21.15.82:0/2417717491 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f249f640 1 --2- 172.21.15.82:0/2417717491 >> v2:172.21.15.183:3300/0 conn(0x7fc9ec1596b0 0x7fc9ec15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0b2380 0x7fc9ec0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/2417717491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0b2380 msgr2=0x7fc9ec0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0b2380 0x7fc9ec0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/2417717491 >> v2:172.21.15.183:3300/0 conn(0x7fc9ec1596b0 msgr2=0x7fc9ec15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/2417717491 >> v2:172.21.15.183:3300/0 conn(0x7fc9ec1596b0 0x7fc9ec15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.409+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/2417717491 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0ad810 con 0x7fc9ec0cc900 2023-07-20T10:03:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01147a15ca96d0a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f149d640 1 -- 172.21.15.82:0/2417717491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0aa5f0 con 0x7fc9ec0cc900 2023-07-20T10:03:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f149d640 1 -- 172.21.15.82:0/2417717491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0aa750 con 0x7fc9ec0cc900 2023-07-20T10:03:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f149d640 1 -- 172.21.15.82:0/2417717491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0aaae0 con 0x7fc9ec0cc900 2023-07-20T10:03:12.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 -- 172.21.15.82:0/2417717491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec0cc900 msgr2=0x7fc9ec0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 -- 172.21.15.82:0/2417717491 shutdown_connections 2023-07-20T10:03:12.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0b2380 0x7fc9ec0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 --2- 172.21.15.82:0/2417717491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec0cc900 0x7fc9ec0ad0c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 --2- 172.21.15.82:0/2417717491 >> v2:172.21.15.183:3300/0 conn(0x7fc9ec1596b0 0x7fc9ec15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 -- 172.21.15.82:0/2417717491 >> 172.21.15.82:0/2417717491 conn(0x7fc9ec0cada0 msgr2=0x7fc9ec0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 -- 172.21.15.82:0/2417717491 shutdown_connections 2023-07-20T10:03:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 -- 172.21.15.82:0/2417717491 wait complete. 2023-07-20T10:03:12.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.413+0000 7fc9f4703640 1 Processor -- start 2023-07-20T10:03:12.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- start start 2023-07-20T10:03:12.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9ec0b2380 0x7fc9ec1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0cc900 0x7fc9ec15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ab580 con 0x7fc9ec1596b0 2023-07-20T10:03:12.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c2ef0 con 0x7fc9ec0b2380 2023-07-20T10:03:12.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c31d0 con 0x7fc9ec0cc900 2023-07-20T10:03:12.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f1c9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0cc900 0x7fc9ec15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43816/0 (socket says 172.21.15.82:43816) 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/1018734235 learned_addr learned my addr 172.21.15.82:0/1018734235 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9ec0b2380 0x7fc9ec1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0cc900 msgr2=0x7fc9ec15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0cc900 0x7fc9ec15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9ec0b2380 msgr2=0x7fc9ec1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9ec0b2380 0x7fc9ec1553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/1018734235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0094d0 con 0x7fc9ec1596b0 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007e60 tx=0x7fc9e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9e2ffd640 1 -- 172.21.15.82:0/1018734235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4014620 con 0x7fc9ec1596b0 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9e2ffd640 1 -- 172.21.15.82:0/1018734235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400ee90 con 0x7fc9ec1596b0 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0aaf30 con 0x7fc9ec1596b0 2023-07-20T10:03:12.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9e2ffd640 1 -- 172.21.15.82:0/1018734235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40149e0 con 0x7fc9ec1596b0 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.417+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec1635c0 con 0x7fc9ec1596b0 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9e2ffd640 1 -- 172.21.15.82:0/1018734235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc9e4014b40 con 0x7fc9ec1596b0 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9e2ffd640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 0x7fc9d0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9e2ffd640 1 -- 172.21.15.82:0/1018734235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9e4084710 con 0x7fc9ec1596b0 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 0x7fc9d0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 Processor -- start 2023-07-20T10:03:12.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 -- start start 2023-07-20T10:03:12.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 0x7fc9d0068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80079c0 tx=0x7fc9e8008040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 0x56138a59f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a554950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a41c0a0 con 0x56138a554e90 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a3aae40 con 0x56138a59ed20 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56138a3a8370 con 0x56138a59f640 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43824/0 (socket says 172.21.15.82:43824) 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/663625806 learned_addr learned my addr 172.21.15.82:0/663625806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a554950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f249f640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 0x56138a59f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 msgr2=0x56138a554950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a554950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 msgr2=0x56138a59f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 0x56138a59f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 -- 172.21.15.82:0/663625806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56138a09f890 con 0x56138a554e90 2023-07-20T10:03:12.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f249f640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 0x56138a59f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:12.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.421+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc9e405d4c0 tx=0x7fc9e40551e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dbd5f5c60b81d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9cffff640 1 -- 172.21.15.82:0/663625806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4082ea0 con 0x56138a554e90 2023-07-20T10:03:12.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9cffff640 1 -- 172.21.15.82:0/663625806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4082a30 con 0x56138a554e90 2023-07-20T10:03:12.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9cffff640 1 -- 172.21.15.82:0/663625806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4082be0 con 0x56138a554e90 2023-07-20T10:03:12.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- 172.21.15.82:0/663625806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 msgr2=0x56138a555270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc9e405d4c0 tx=0x7fc9e40551e0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- 172.21.15.82:0/663625806 shutdown_connections 2023-07-20T10:03:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a555270 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a554950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/663625806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59ed20 0x56138a59f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- 172.21.15.82:0/663625806 >> 172.21.15.82:0/663625806 conn(0x56138a54c200 msgr2=0x56138a553230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- 172.21.15.82:0/663625806 shutdown_connections 2023-07-20T10:03:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- 172.21.15.82:0/663625806 wait complete. 2023-07-20T10:03:12.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- start start 2023-07-20T10:03:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 Processor -- start 2023-07-20T10:03:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a55fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a560940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a3a3c60 con 0x56138a59ed20 2023-07-20T10:03:12.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a35fae0 con 0x56138a554e90 2023-07-20T10:03:12.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56138a35f780 con 0x56138a59f640 2023-07-20T10:03:12.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f7a62000 10 client.0 _ll_register_callbacks cb 0x56138a540820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:03:12.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43840/0 (socket says 172.21.15.82:43840) 2023-07-20T10:03:12.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/914692064 learned_addr learned my addr 172.21.15.82:0/914692064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 msgr2=0x56138a560940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a560940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 msgr2=0x56138a55fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f249f640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a55fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a55fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/914692064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec1635c0 con 0x56138a59ed20 2023-07-20T10:03:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.425+0000 7fc9f249f640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a55fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b30653ebfd8bb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0c1070 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9dc0b8070 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56138a363fb0 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9dc0aa560 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 10 client.6264 fetch_fsmap learned FSMap version 25 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56138a367d10 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56138a363fb0 con 0x56138a59ed20 2023-07-20T10:03:12.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc9dc0a9070 con 0x56138a59ed20 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 10 client.6264 fetch_fsmap finished waiting for FSMap version 25 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 10 client.6264 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 20 client.6264 populate_metadata read hostname 'smithi082' 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a5611e0 0x56138a5b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 4 client.6264 mds_command: new command op to 5836 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 --> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56138a3d2410 con 0x56138a5611e0 2023-07-20T10:03:12.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f249f640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a5611e0 0x56138a5b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 10 client.6264 ms_handle_connect on v2:172.21.15.183:6832/1320222659 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f249f640 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a5611e0 0x56138a5b0290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80be47e915cf53f4 server_cookie=fd057daaf2e8688 in_seq=0 out_seq=0 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/914692064 <== mds.0 v2:172.21.15.183:6832/1320222659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56138a3d2410 con 0x56138a5611e0 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 10 client.6264 handle_command_reply: tid=0 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 client.6264 shutdown 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 msgr2=0x56138a560400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009870 tx=0x7fc9dc0046d0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 shutdown_connections 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a5611e0 0x56138a5b0290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a560940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a560400 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/914692064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a55fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 >> 172.21.15.82:0/914692064 conn(0x56138a54c200 msgr2=0x56138a553230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9cd7fa640 0 client.6264 ms_handle_reset on v2:172.21.15.183:6832/1320222659 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 shutdown_connections 2023-07-20T10:03:12.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 1 -- 172.21.15.82:0/914692064 wait complete. 2023-07-20T10:03:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.429+0000 7fc9f7a62000 20 client.6264 trim_cache size 0 max 16384 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 Processor -- start 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 -- start start 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59ed20 0x56138a556280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59f640 0x56138a5567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a060940 con 0x56138a554e90 2023-07-20T10:03:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a44ea20 con 0x56138a59f640 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56138a554bd0 con 0x56138a59ed20 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43850/0 (socket says 172.21.15.82:43850) 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 -- 172.21.15.82:0/2564799907 learned_addr learned my addr 172.21.15.82:0/2564799907 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59f640 0x56138a5567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59ed20 0x56138a556280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 -- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59ed20 msgr2=0x56138a556280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59ed20 0x56138a556280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 -- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59f640 msgr2=0x56138a5567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59f640 0x56138a5567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 -- 172.21.15.82:0/2564799907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56138a34dfa0 con 0x56138a554e90 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.445+0000 7fc9f249f640 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8010b80 tx=0x7fc9e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a31a782bb1582c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9e0ff9640 1 -- 172.21.15.82:0/2564799907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8010d70 con 0x56138a554e90 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9e0ff9640 1 -- 172.21.15.82:0/2564799907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e8010ed0 con 0x56138a554e90 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9e0ff9640 1 -- 172.21.15.82:0/2564799907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8028350 con 0x56138a554e90 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/2564799907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 msgr2=0x56138a59e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8010b80 tx=0x7fc9e8016000 comp rx=0 tx=0).stop 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/2564799907 shutdown_connections 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a59f640 0x56138a5567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59ed20 0x56138a556280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/2564799907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a554e90 0x56138a59e6f0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/2564799907 >> 172.21.15.82:0/2564799907 conn(0x56138a54c200 msgr2=0x56138a59d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/2564799907 shutdown_connections 2023-07-20T10:03:12.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/2564799907 wait complete. 2023-07-20T10:03:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- start start 2023-07-20T10:03:12.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 Processor -- start 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a5f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a5b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a362800 con 0x56138a59ed20 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x56138a4179c0 con 0x56138a554e90 2023-07-20T10:03:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56138a3402b0 con 0x56138a59f640 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 10 client.0 _ll_register_callbacks cb 0x56138a41bff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43860/0 (socket says 172.21.15.82:43860) 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/1633046274 learned_addr learned my addr 172.21.15.82:0/1633046274 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a5f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a5b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 msgr2=0x56138a5b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a5b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 msgr2=0x56138a5f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a5f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 -- 172.21.15.82:0/1633046274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e800e040 con 0x56138a59ed20 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f2ca0640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a5b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f1c9e640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0097c0 tx=0x7fc9dc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed396ba5f4b2d574 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc0d0070 con 0x56138a59ed20 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc9dc0a7070 con 0x56138a59ed20 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.449+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56138a554d20 con 0x56138a59ed20 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9dc0c1070 con 0x56138a59ed20 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 10 client.6270 fetch_fsmap learned FSMap version 25 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x56138a09fcc0 con 0x56138a59ed20 2023-07-20T10:03:12.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0d9020 con 0x56138a59ed20 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc9dc0c4070 con 0x56138a59ed20 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 10 client.6270 fetch_fsmap finished waiting for FSMap version 25 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 10 client.6270 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 20 client.6270 populate_metadata read hostname 'smithi082' 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a603300 0x56138a6056f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 4 client.6270 mds_command: new command op to 5836 tid=0[{"prefix": "status"}] 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 --> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56138a36aa20 con 0x56138a603300 2023-07-20T10:03:12.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a603300 0x56138a6056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 10 client.6270 ms_handle_connect on v2:172.21.15.183:6832/1320222659 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f249f640 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a603300 0x56138a6056f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f32f7b9799a84d server_cookie=bbf1fd4a28932503 in_seq=0 out_seq=0 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 1 -- 172.21.15.82:0/1633046274 <== mds.0 v2:172.21.15.183:6832/1320222659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56138a36aa20 con 0x56138a603300 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 10 client.6270 handle_command_reply: tid=0 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 client.6270 shutdown 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 msgr2=0x56138a5b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0097c0 tx=0x7fc9dc01ad10 comp rx=0 tx=0).stop 2023-07-20T10:03:12.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 shutdown_connections 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:6832/1320222659,v1:172.21.15.183:6834/1320222659] conn(0x56138a603300 0x56138a6056f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56138a59f640 0x56138a5b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56138a59ed20 0x56138a5b09b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9cd7fa640 0 client.6270 ms_handle_reset on v2:172.21.15.183:6832/1320222659 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 --2- 172.21.15.82:0/1633046274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56138a554e90 0x56138a5f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 >> 172.21.15.82:0/1633046274 conn(0x56138a54c200 msgr2=0x56138a559d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 shutdown_connections 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 1 -- 172.21.15.82:0/1633046274 wait complete. 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f7a62000 20 client.6270 trim_cache size 0 max 16384 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:03:12.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5836, 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.377042123000001, 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 25, 2023-07-20T10:03:12.454 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 64, 2023-07-20T10:03:12.455 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 64, 2023-07-20T10:03:12.455 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.364773052 2023-07-20T10:03:12.455 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:03:12.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 msgr2=0x7fc9d0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 0x7fc9d0068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80079c0 tx=0x7fc9e8008040 comp rx=0 tx=0).stop 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 msgr2=0x7fc9ec0c2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007e60 tx=0x7fc9e400e4b0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 shutdown_connections 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc9d00663a0 0x7fc9d0068860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9ec1596b0 0x7fc9ec0c2860 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc9ec0cc900 0x7fc9ec15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 --2- 172.21.15.82:0/1018734235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc9ec0b2380 0x7fc9ec1553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 >> 172.21.15.82:0/1018734235 conn(0x7fc9ec0cada0 msgr2=0x7fc9ec06b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 shutdown_connections 2023-07-20T10:03:12.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.453+0000 7fc9f4703640 1 -- 172.21.15.82:0/1018734235 wait complete. 2023-07-20T10:03:12.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:03:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.609+0000 7f5611807640 1 Processor -- start 2023-07-20T10:03:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.609+0000 7f5611807640 1 -- start start 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f5611807640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f560c0b1f30 0x7f560c0b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f5611807640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0cf4a0 con 0x7f560c06f350 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f5611807640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c06ea80 con 0x7f560c15c120 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f5611807640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0b2900 con 0x7f560c0b1f30 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f56027fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f560c0b1f30 0x7f560c0b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f560affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f560c06f350 0x7f560c06b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52610/0 (socket says 172.21.15.82:52610) 2023-07-20T10:03:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f560affd640 1 -- 172.21.15.82:0/2704242919 learned_addr learned my addr 172.21.15.82:0/2704242919 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f56027fc640 1 -- 172.21.15.82:0/2704242919 >> v1:172.21.15.183:6789/0 conn(0x7f560c15c120 legacy=0x7f560c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f56027fc640 1 -- 172.21.15.82:0/2704242919 >> v1:172.21.15.82:6789/0 conn(0x7f560c06f350 legacy=0x7f560c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f56027fc640 1 -- 172.21.15.82:0/2704242919 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0ce890 con 0x7f560c0b1f30 2023-07-20T10:03:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.613+0000 7f560a7fc640 1 -- 172.21.15.82:0/2704242919 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452024164 0 0) 0x7f560c0cf4a0 con 0x7f560c06f350 2023-07-20T10:03:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f56027fc640 1 --2- 172.21.15.82:0/2704242919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c0b23c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f55f40097c0 tx=0x7f55f401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e653e9050482a8d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f560a7fc640 1 -- 172.21.15.82:0/2704242919 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40ac620 con 0x7f560c0b1f30 2023-07-20T10:03:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f560a7fc640 1 -- 172.21.15.82:0/2704242919 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40ac780 con 0x7f560c0b1f30 2023-07-20T10:03:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f560a7fc640 1 -- 172.21.15.82:0/2704242919 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40acb10 con 0x7f560c0b1f30 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- 172.21.15.82:0/2704242919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 msgr2=0x7f560c0b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 --2- 172.21.15.82:0/2704242919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c0b23c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f55f40097c0 tx=0x7f55f401c3c0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- 172.21.15.82:0/2704242919 shutdown_connections 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 --2- 172.21.15.82:0/2704242919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c0b23c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- 172.21.15.82:0/2704242919 >> 172.21.15.82:0/2704242919 conn(0x7f560c089fa0 msgr2=0x7f560c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- 172.21.15.82:0/2704242919 shutdown_connections 2023-07-20T10:03:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- 172.21.15.82:0/2704242919 wait complete. 2023-07-20T10:03:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 Processor -- start 2023-07-20T10:03:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.617+0000 7f5611807640 1 -- start start 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 0x7f560c145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 0x7f560c149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c8670 con 0x7f560c0b1f30 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c145e60 con 0x7f560c15c120 2023-07-20T10:03:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c148340 con 0x7f560c06f350 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43880/0 (socket says 172.21.15.82:43880) 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 -- 172.21.15.82:0/1751047194 learned_addr learned my addr 172.21.15.82:0/1751047194 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f560affd640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 0x7f560c145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f560b7fe640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 0x7f560c149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 -- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 msgr2=0x7f560c145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 0x7f560c145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 -- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 msgr2=0x7f560c149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 0x7f560c149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 -- 172.21.15.82:0/1751047194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f4009420 con 0x7f560c0b1f30 2023-07-20T10:03:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f560affd640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 0x7f560c145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f560b7fe640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 0x7f560c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:12.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f56027fc640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f55f40af040 tx=0x7f55f4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40b5610 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f40b5790 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40b5b40 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c0cfab0 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c148900 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c073c70 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.621+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f55f40b3040 con 0x7f560c0b1f30 2023-07-20T10:03:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.625+0000 7f5608ff9640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 0x7f55ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:12.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.625+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55f411e1e0 con 0x7f560c0b1f30 2023-07-20T10:03:12.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.625+0000 7f560affd640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 0x7f55ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:12.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.625+0000 7f560affd640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 0x7f55ec068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55fc007fd0 tx=0x7f55fc009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:12.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.629+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55f40eb440 con 0x7f560c0b1f30 2023-07-20T10:03:12.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f560c0ca620 con 0x7f560c0b1f30 2023-07-20T10:03:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5608ff9640 1 -- 172.21.15.82:0/1751047194 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55f40eea60 con 0x7f560c0b1f30 2023-07-20T10:03:12.794 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:03:12.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 msgr2=0x7f55ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 0x7f55ec068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f55fc007fd0 tx=0x7f55fc009040 comp rx=0 tx=0).stop 2023-07-20T10:03:12.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 msgr2=0x7f560c149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:12.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f55f40af040 tx=0x7f55f4019160 comp rx=0 tx=0).stop 2023-07-20T10:03:12.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 shutdown_connections 2023-07-20T10:03:12.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f560c15c120 0x7f560c149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f55ec0663a0 0x7f55ec068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f560c0b1f30 0x7f560c149670 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 --2- 172.21.15.82:0/1751047194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f560c06f350 0x7f560c145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.805+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 >> 172.21.15.82:0/1751047194 conn(0x7f560c089fa0 msgr2=0x7f560c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.809+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 shutdown_connections 2023-07-20T10:03:12.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:12.809+0000 7f5611807640 1 -- 172.21.15.82:0/1751047194 wait complete. 2023-07-20T10:03:12.815 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:03:12.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:03:12.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:03:12.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:03:12.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:03:12.816 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:03:12.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:03:12.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:03:12.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:03:12.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:12.818 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:03:12.828 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:03:12.828 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.829 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.830 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41608sec preferred_lft 41608sec 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:03:12.831 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:03:12.832 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:03:12.833 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:03:12.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:12.834 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:03:12.891 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:03:12.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:12.894 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:03:12.947 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:03:12.947 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:03:12.947 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:03:12.947 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:03:12.947 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:03:12.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:12.949 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:03:12.949 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:03:12.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:03:12.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:03:12.950 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:03:12.951 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:03:13.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:13.044 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:03:13.054 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:03:13.054 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:03:13.055 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:03:13.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:13.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:03:13.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:03:13.120 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:03:13.172 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:03:13.172 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:03:13.173 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:03:13.223 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:03:13.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:13.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:03:13.314 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:03:13.314 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:03:13.315 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:03:13.329 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:03:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:03:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:03:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:03:13.330 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:03:13.339 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:03:13.339 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:03:13.340 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:03:13.344 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:03:13.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:13.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:03:13.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:13.366 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:03:13.426 INFO:teuthology.orchestra.run.smithi082.stdout:client6282 2023-07-20T10:03:13.427 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:03:13.427 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:03:13.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:03:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 Processor -- start 2023-07-20T10:03:13.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 -- start start 2023-07-20T10:03:13.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 0x7fbb680d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb680d16b0 con 0x7fbb680d0d10 2023-07-20T10:03:13.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb680d31c0 con 0x7fbb680ce4c0 2023-07-20T10:03:13.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6f434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680b3520 con 0x7fbb6815cab0 2023-07-20T10:03:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6d1d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6d9d1640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 0x7fbb680d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6d1d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:45528/0 (socket says 172.21.15.82:45528) 2023-07-20T10:03:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6d1d0640 1 -- 172.21.15.82:0/2690108935 learned_addr learned my addr 172.21.15.82:0/2690108935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:13.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.677+0000 7fbb6d1d0640 1 -- 172.21.15.82:0/2690108935 >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 msgr2=0x7fbb680d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6d1d0640 1 --2- 172.21.15.82:0/2690108935 >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 0x7fbb680d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6d1d0640 1 -- 172.21.15.82:0/2690108935 >> v1:172.21.15.183:6789/0 conn(0x7fbb680d0d10 legacy=0x7fbb680cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6d1d0640 1 -- 172.21.15.82:0/2690108935 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680b2910 con 0x7fbb6815cab0 2023-07-20T10:03:13.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6d9d1640 1 --2- 172.21.15.82:0/2690108935 >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 0x7fbb680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:13.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6d1d0640 1 --2- 172.21.15.82:0/2690108935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009e50 tx=0x7fbb6401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0c0e10d2aed66d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:13.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb5ffff640 1 -- 172.21.15.82:0/2690108935 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640a57c0 con 0x7fbb6815cab0 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb5ffff640 1 -- 172.21.15.82:0/2690108935 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb640a5920 con 0x7fbb6815cab0 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb5ffff640 1 -- 172.21.15.82:0/2690108935 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb640a5cb0 con 0x7fbb6815cab0 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 -- 172.21.15.82:0/2690108935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 msgr2=0x7fbb680d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2690108935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009e50 tx=0x7fbb6401c9e0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 -- 172.21.15.82:0/2690108935 shutdown_connections 2023-07-20T10:03:13.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2690108935 >> v2:172.21.15.183:3300/0 conn(0x7fbb680ce4c0 0x7fbb680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2690108935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb6815cab0 0x7fbb680d0300 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.681+0000 7fbb6f434640 1 -- 172.21.15.82:0/2690108935 >> 172.21.15.82:0/2690108935 conn(0x7fbb6808c120 msgr2=0x7fbb6809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:13.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- 172.21.15.82:0/2690108935 shutdown_connections 2023-07-20T10:03:13.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- 172.21.15.82:0/2690108935 wait complete. 2023-07-20T10:03:13.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 Processor -- start 2023-07-20T10:03:13.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- start start 2023-07-20T10:03:13.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb680ce4c0 0x7fbb680c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb6815cab0 0x7fbb6806b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680c84e0 con 0x7fbb680d0d10 2023-07-20T10:03:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6814a700 con 0x7fbb6815cab0 2023-07-20T10:03:13.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6f434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb680cbf10 con 0x7fbb680ce4c0 2023-07-20T10:03:13.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6d1d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb680ce4c0 0x7fbb680c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60222/0 (socket says 172.21.15.82:60222) 2023-07-20T10:03:13.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 -- 172.21.15.82:0/2226469746 learned_addr learned my addr 172.21.15.82:0/2226469746 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6d9d1640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb6815cab0 0x7fbb6806b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 -- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb680ce4c0 msgr2=0x7fbb680c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb680ce4c0 0x7fbb680c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 -- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb6815cab0 msgr2=0x7fbb6806b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb6815cab0 0x7fbb6806b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 -- 172.21.15.82:0/2226469746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb60009420 con 0x7fbb680d0d10 2023-07-20T10:03:13.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.685+0000 7fbb6c9cf640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c3a0 tx=0x7fbb5800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb580052d0 con 0x7fbb680d0d10 2023-07-20T10:03:13.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58005430 con 0x7fbb680d0d10 2023-07-20T10:03:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58007260 con 0x7fbb680d0d10 2023-07-20T10:03:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb64009b30 con 0x7fbb680d0d10 2023-07-20T10:03:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb680cc1d0 con 0x7fbb680d0d10 2023-07-20T10:03:13.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6814a8b0 con 0x7fbb680d0d10 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbb580073c0 con 0x7fbb680d0d10 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 0x7fbb4c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb580830a0 con 0x7fbb680d0d10 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb6d1d0640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 0x7fbb4c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.689+0000 7fbb6d1d0640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 0x7fbb4c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb640ae000 tx=0x7fbb640a7070 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:13.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.693+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb580504b0 con 0x7fbb680d0d10 2023-07-20T10:03:13.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.861+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb680b25c0 con 0x7fbb4c0663a0 2023-07-20T10:03:13.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb5dffb640 1 -- 172.21.15.82:0/2226469746 <== mgr.5838 v2:172.21.15.82:6832/3713806871 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbb640a5a90 con 0x7fbb4c0663a0 2023-07-20T10:03:13.852 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:03:13.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:03:13.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:03:13.853 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:03:13.853 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:03:13.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 msgr2=0x7fbb4c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 0x7fbb4c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb640ae000 tx=0x7fbb640a7070 comp rx=0 tx=0).stop 2023-07-20T10:03:13.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 msgr2=0x7fbb680c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:13.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800c3a0 tx=0x7fbb5800c7a0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 shutdown_connections 2023-07-20T10:03:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb6815cab0 0x7fbb6806b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fbb4c0663a0 0x7fbb4c068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb680d0d10 0x7fbb680c7fa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 --2- 172.21.15.82:0/2226469746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb680ce4c0 0x7fbb680c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:13.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 >> 172.21.15.82:0/2226469746 conn(0x7fbb6808c120 msgr2=0x7fbb68155600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 shutdown_connections 2023-07-20T10:03:13.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:13.865+0000 7fbb6f434640 1 -- 172.21.15.82:0/2226469746 wait complete. 2023-07-20T10:03:13.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:03:14.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.025+0000 7fc3b7827640 1 Processor -- start 2023-07-20T10:03:14.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.025+0000 7fc3b7827640 1 -- start start 2023-07-20T10:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b7827640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3b0159830 0x7fc3b00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b7827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 0x7fc3b00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b7827640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b00cc8d0 con 0x7fc3b0159450 2023-07-20T10:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b7827640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00cce90 con 0x7fc3b0159830 2023-07-20T10:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b7827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00ccbb0 con 0x7fc3b00cc3e0 2023-07-20T10:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b55c3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc3b0159450 0x7fc3b015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38826/0 (socket says 172.21.15.82:38826) 2023-07-20T10:03:14.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b55c3640 1 -- 172.21.15.82:0/1298434821 learned_addr learned my addr 172.21.15.82:0/1298434821 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b5dc4640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 0x7fc3b00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/1298434821 >> v2:172.21.15.183:3300/0 conn(0x7fc3b0159830 0x7fc3b00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3a7fff640 1 -- 172.21.15.82:0/1298434821 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284842588 0 0) 0x7fc3b00cc8d0 con 0x7fc3b0159450 2023-07-20T10:03:14.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3a7fff640 1 -- 172.21.15.82:0/1298434821 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c003530 con 0x7fc3b0159450 2023-07-20T10:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 msgr2=0x7fc3b00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 0x7fc3b00afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/1298434821 >> v1:172.21.15.82:6789/0 conn(0x7fc3b0159450 legacy=0x7fc3b015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/1298434821 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0159cc0 con 0x7fc3b0159830 2023-07-20T10:03:14.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.029+0000 7fc3b5dc4640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 0x7fc3b00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:14.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0159830 0x7fc3b00cbea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097c0 tx=0x7fc3a001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1aba0102e883ea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:14.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3a7fff640 1 -- 172.21.15.82:0/1298434821 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00ad660 con 0x7fc3b0159830 2023-07-20T10:03:14.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3a7fff640 1 -- 172.21.15.82:0/1298434821 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a00ad7c0 con 0x7fc3b0159830 2023-07-20T10:03:14.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3a7fff640 1 -- 172.21.15.82:0/1298434821 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00adb50 con 0x7fc3b0159830 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0159830 msgr2=0x7fc3b00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0159830 0x7fc3b00cbea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00097c0 tx=0x7fc3a001c450 comp rx=0 tx=0).stop 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- 172.21.15.82:0/1298434821 shutdown_connections 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b00cc3e0 0x7fc3b00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 --2- 172.21.15.82:0/1298434821 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b0159830 0x7fc3b00cbea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- 172.21.15.82:0/1298434821 >> 172.21.15.82:0/1298434821 conn(0x7fc3b00cad50 msgr2=0x7fc3b00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:14.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- 172.21.15.82:0/1298434821 shutdown_connections 2023-07-20T10:03:14.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- 172.21.15.82:0/1298434821 wait complete. 2023-07-20T10:03:14.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 Processor -- start 2023-07-20T10:03:14.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.033+0000 7fc3b7827640 1 -- start start 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 0x7fc3b0150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 0x7fc3b014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00c1a20 con 0x7fc3b0159450 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00c80d0 con 0x7fc3b00cc3e0 2023-07-20T10:03:14.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b01509d0 con 0x7fc3b0151060 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60224/0 (socket says 172.21.15.82:60224) 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/2156372790 learned_addr learned my addr 172.21.15.82:0/2156372790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b5dc4640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 0x7fc3b014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 msgr2=0x7fc3b014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b55c3640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 0x7fc3b0150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 0x7fc3b014f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 msgr2=0x7fc3b0150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 0x7fc3b0150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 -- 172.21.15.82:0/2156372790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8009a70 con 0x7fc3b0159450 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b5dc4640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 0x7fc3b014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b55c3640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 0x7fc3b0150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:03:14.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b4dc2640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b0040 tx=0x7fc3a00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:14.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00ba070 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a00b6430 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00b67e0 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a0009420 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b00c7a80 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.037+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b004da30 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.041+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc3a00b4040 con 0x7fc3b0159450 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.041+0000 7fc3a5ffb640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 0x7fc394068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:14.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.041+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3a011da50 con 0x7fc3b0159450 2023-07-20T10:03:14.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.041+0000 7fc3b55c3640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 0x7fc394068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:14.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.041+0000 7fc3b55c3640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 0x7fc394068890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0011f0 tx=0x7fc3ac009040 comp rx=0 tx=0).ready entity=mgr.5838 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:14.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.045+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3a00eaca0 con 0x7fc3b0159450 2023-07-20T10:03:14.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.229+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc3b00cbbf0 con 0x7fc3b0159450 2023-07-20T10:03:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.905+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc3a00eb070 con 0x7fc3b0159450 2023-07-20T10:03:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.909+0000 7fc3a5ffb640 1 -- 172.21.15.82:0/2156372790 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc3a01161a0 con 0x7fc3b0159450 2023-07-20T10:03:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 msgr2=0x7fc394068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 0x7fc394068890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0011f0 tx=0x7fc3ac009040 comp rx=0 tx=0).stop 2023-07-20T10:03:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 msgr2=0x7fc3b00c14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b0040 tx=0x7fc3a00191f0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 shutdown_connections 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3b0151060 0x7fc3b014f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fc3940663d0 0x7fc394068890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3b0159450 0x7fc3b00c14e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 --2- 172.21.15.82:0/2156372790 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3b00cc3e0 0x7fc3b0150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 >> 172.21.15.82:0/2156372790 conn(0x7fc3b00cad50 msgr2=0x7fc3b015ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 shutdown_connections 2023-07-20T10:03:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:14.913+0000 7fc3b7827640 1 -- 172.21.15.82:0/2156372790 wait complete. 2023-07-20T10:03:14.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:03:15.065 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:15.079+0000 7eff27c47180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:03:15.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 Processor -- start 2023-07-20T10:03:15.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 -- start start 2023-07-20T10:03:15.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f477406c120 0x7f47740cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477406b220 0x7f4774160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47740d0970 con 0x7f47741602b0 2023-07-20T10:03:15.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4774160e20 con 0x7f477406c120 2023-07-20T10:03:15.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4779b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47740cd300 con 0x7f477406b220 2023-07-20T10:03:15.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f47737fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f477406c120 0x7f47740cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4772ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47741602b0 0x7f477406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38842/0 (socket says 172.21.15.82:38842) 2023-07-20T10:03:15.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4772ffd640 1 -- 172.21.15.82:0/1113742603 learned_addr learned my addr 172.21.15.82:0/1113742603 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:15.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.097+0000 7f4773fff640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477406b220 0x7f4774160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47727fc640 1 -- 172.21.15.82:0/1113742603 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758116653 0 0) 0x7f47740d0970 con 0x7f47741602b0 2023-07-20T10:03:15.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47727fc640 1 -- 172.21.15.82:0/1113742603 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f475c003530 con 0x7f47741602b0 2023-07-20T10:03:15.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47737fe640 1 -- 172.21.15.82:0/1113742603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477406b220 msgr2=0x7f4774160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:15.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47737fe640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477406b220 0x7f4774160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47737fe640 1 -- 172.21.15.82:0/1113742603 >> v1:172.21.15.82:6789/0 conn(0x7f47741602b0 legacy=0x7f477406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47737fe640 1 -- 172.21.15.82:0/1113742603 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47740cd5e0 con 0x7f477406c120 2023-07-20T10:03:15.095 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:15.101+0000 7ff9efa46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:03:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47737fe640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f47740cdde0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f47640097c0 tx=0x7f476401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a94ccc713d3ed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47727fc640 1 -- 172.21.15.82:0/1113742603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640ac640 con 0x7f477406c120 2023-07-20T10:03:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47727fc640 1 -- 172.21.15.82:0/1113742603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640ac7a0 con 0x7f477406c120 2023-07-20T10:03:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.101+0000 7f47727fc640 1 -- 172.21.15.82:0/1113742603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640acb10 con 0x7f477406c120 2023-07-20T10:03:15.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- 172.21.15.82:0/1113742603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 msgr2=0x7f47740cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f47740cdde0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f47640097c0 tx=0x7f476401c3c0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- 172.21.15.82:0/1113742603 shutdown_connections 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f477406b220 0x7f4774160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- 172.21.15.82:0/1113742603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f47740cdde0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- 172.21.15.82:0/1113742603 >> 172.21.15.82:0/1113742603 conn(0x7f477408c0a0 msgr2=0x7f477409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- 172.21.15.82:0/1113742603 shutdown_connections 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- 172.21.15.82:0/1113742603 wait complete. 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 Processor -- start 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- start start 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 0x7f477414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47741602b0 0x7f47740b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4774155dd0 con 0x7f477406c120 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47741520c0 con 0x7f477406b220 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4779b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4774151ab0 con 0x7f47741602b0 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60252/0 (socket says 172.21.15.82:60252) 2023-07-20T10:03:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 -- 172.21.15.82:0/1774029281 learned_addr learned my addr 172.21.15.82:0/1774029281 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f47737fe640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 0x7f477414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4773fff640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47741602b0 0x7f47740b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 -- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47741602b0 msgr2=0x7f47740b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47741602b0 0x7f47740b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 -- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 msgr2=0x7f477414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 0x7f477414f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f4772ffd640 1 -- 172.21.15.82:0/1774029281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764009420 con 0x7f477406c120 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.105+0000 7f47737fe640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 0x7f477414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f4772ffd640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f476800c3c0 tx=0x7f476800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768005cf0 con 0x7f477406c120 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768005e50 con 0x7f477406c120 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477414f810 con 0x7f477406c120 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47680072f0 con 0x7f477406c120 2023-07-20T10:03:15.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4774151d50 con 0x7f477406c120 2023-07-20T10:03:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477404da30 con 0x7f477406c120 2023-07-20T10:03:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4768007450 con 0x7f477406c120 2023-07-20T10:03:15.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.109+0000 7f475bfff640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 0x7f47600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.113+0000 7f47737fe640 1 -- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 msgr2=0x7f47600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.113+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47680834d0 con 0x7f477406c120 2023-07-20T10:03:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.113+0000 7f47737fe640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 0x7f47600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:03:15.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.117+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4768050850 con 0x7f477406c120 2023-07-20T10:03:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.269+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f4774152200 con 0x7f477406c120 2023-07-20T10:03:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.273+0000 7f475bfff640 1 -- 172.21.15.82:0/1774029281 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4768053e70 con 0x7f477406c120 2023-07-20T10:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 msgr2=0x7f47600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 0x7f47600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 msgr2=0x7f477414b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f476800c3c0 tx=0x7f476800c880 comp rx=0 tx=0).stop 2023-07-20T10:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 shutdown_connections 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47741602b0 0x7f47740b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f4760066420 0x7f47600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f477406c120 0x7f477414b9e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 --2- 172.21.15.82:0/1774029281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f477406b220 0x7f477414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 >> 172.21.15.82:0/1774029281 conn(0x7f477408c0a0 msgr2=0x7f477415f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 shutdown_connections 2023-07-20T10:03:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.277+0000 7f4779b37640 1 -- 172.21.15.82:0/1774029281 wait complete. 2023-07-20T10:03:15.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:03:15.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 Processor -- start 2023-07-20T10:03:15.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 -- start start 2023-07-20T10:03:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f5c06c120 0x7f7f5c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f5c1602b0 0x7f7f5c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5c0d0970 con 0x7f7f5c06ab10 2023-07-20T10:03:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c160e20 con 0x7f7f5c1602b0 2023-07-20T10:03:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6358f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5c0cd300 con 0x7f7f5c06c120 2023-07-20T10:03:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f5c1602b0 0x7f7f5c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f5c1602b0 0x7f7f5c160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60262/0 (socket says 172.21.15.82:60262) 2023-07-20T10:03:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 -- 172.21.15.82:0/2268851980 learned_addr learned my addr 172.21.15.82:0/2268851980 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f61b2c640 1 --1- 172.21.15.82:0/2268851980 >> v1:172.21.15.82:6789/0 conn(0x7f7f5c06ab10 0x7f7f5c06af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38850/0 (socket says 172.21.15.82:38850) 2023-07-20T10:03:15.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f6132b640 1 --2- 172.21.15.82:0/2268851980 >> v2:172.21.15.183:3300/0 conn(0x7f7f5c06c120 0x7f7f5c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 -- 172.21.15.82:0/2268851980 >> v2:172.21.15.183:3300/0 conn(0x7f7f5c06c120 msgr2=0x7f7f5c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:15.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 --2- 172.21.15.82:0/2268851980 >> v2:172.21.15.183:3300/0 conn(0x7f7f5c06c120 0x7f7f5c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 -- 172.21.15.82:0/2268851980 >> v1:172.21.15.82:6789/0 conn(0x7f7f5c06ab10 legacy=0x7f7f5c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f53fff640 1 -- 172.21.15.82:0/2268851980 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672713141 0 0) 0x7f7f5c0d0970 con 0x7f7f5c06ab10 2023-07-20T10:03:15.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.441+0000 7f7f60b2a640 1 -- 172.21.15.82:0/2268851980 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0cd5e0 con 0x7f7f5c1602b0 2023-07-20T10:03:15.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f60b2a640 1 --2- 172.21.15.82:0/2268851980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c1602b0 0x7f7f5c160740 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0d00e0 tx=0x7f7f4c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd4c7750d943dac server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f53fff640 1 -- 172.21.15.82:0/2268851980 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ac630 con 0x7f7f5c1602b0 2023-07-20T10:03:15.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f53fff640 1 -- 172.21.15.82:0/2268851980 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0ac790 con 0x7f7f5c1602b0 2023-07-20T10:03:15.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f53fff640 1 -- 172.21.15.82:0/2268851980 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0acb20 con 0x7f7f5c1602b0 2023-07-20T10:03:15.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 -- 172.21.15.82:0/2268851980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c1602b0 msgr2=0x7f7f5c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 --2- 172.21.15.82:0/2268851980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c1602b0 0x7f7f5c160740 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0d00e0 tx=0x7f7f4c01c3b0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 -- 172.21.15.82:0/2268851980 shutdown_connections 2023-07-20T10:03:15.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 --2- 172.21.15.82:0/2268851980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c1602b0 0x7f7f5c160740 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 --2- 172.21.15.82:0/2268851980 >> v2:172.21.15.183:3300/0 conn(0x7f7f5c06c120 0x7f7f5c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.445+0000 7f7f6358f640 1 -- 172.21.15.82:0/2268851980 >> 172.21.15.82:0/2268851980 conn(0x7f7f5c08c0a0 msgr2=0x7f7f5c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:15.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- 172.21.15.82:0/2268851980 shutdown_connections 2023-07-20T10:03:15.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- 172.21.15.82:0/2268851980 wait complete. 2023-07-20T10:03:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 Processor -- start 2023-07-20T10:03:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- start start 2023-07-20T10:03:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f5c06ab10 0x7f7f5c0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f5c1602b0 0x7f7f5c156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c64f0 con 0x7f7f5c06c120 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c67d0 con 0x7f7f5c06ab10 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6358f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5c0c6ab0 con 0x7f7f5c1602b0 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60268/0 (socket says 172.21.15.82:60268) 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 -- 172.21.15.82:0/3923682731 learned_addr learned my addr 172.21.15.82:0/3923682731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:15.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f6132b640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f5c06ab10 0x7f7f5c0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f61b2c640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f5c1602b0 0x7f7f5c156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 -- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f5c1602b0 msgr2=0x7f7f5c156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f5c1602b0 0x7f7f5c156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 -- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f5c06ab10 msgr2=0x7f7f5c0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f5c06ab10 0x7f7f5c0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.449+0000 7f7f60b2a640 1 -- 172.21.15.82:0/3923682731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4c0094d0 con 0x7f7f5c06c120 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f60b2a640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0af040 tx=0x7f7f4c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b7620 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0b7780 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b7b30 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c0c6d90 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5c0c6180 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5c04da30 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f7f4c0b3040 con 0x7f7f5c06c120 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.453+0000 7f7f51ffb640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 0x7f7f400688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.457+0000 7f7f6132b640 1 -- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 msgr2=0x7f7f400688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.457+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f4c11e410 con 0x7f7f5c06c120 2023-07-20T10:03:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.457+0000 7f7f6132b640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 0x7f7f400688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:03:15.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.461+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f4c0eb720 con 0x7f7f5c06c120 2023-07-20T10:03:15.483 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:15.495+0000 7eff27c47180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:03:15.524 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:15.537+0000 7ff9efa46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:03:15.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.613+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7f5c0cee40 con 0x7f7f5c06c120 2023-07-20T10:03:15.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f51ffb640 1 -- 172.21.15.82:0/3923682731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7f4c0eed40 con 0x7f7f5c06c120 2023-07-20T10:03:15.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 msgr2=0x7f7f400688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 0x7f7f400688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 msgr2=0x7f7f5c0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0af040 tx=0x7f7f4c019150 comp rx=0 tx=0).stop 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 shutdown_connections 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f5c1602b0 0x7f7f5c156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7f7f400663f0 0x7f7f400688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f5c06c120 0x7f7f5c0cb130 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 --2- 172.21.15.82:0/3923682731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f5c06ab10 0x7f7f5c0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 >> 172.21.15.82:0/3923682731 conn(0x7f7f5c08c0a0 msgr2=0x7f7f5c06af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:15.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 shutdown_connections 2023-07-20T10:03:15.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.621+0000 7f7f6358f640 1 -- 172.21.15.82:0/3923682731 wait complete. 2023-07-20T10:03:15.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:15.630 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T10:03:15.634 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:15.647+0000 7eff27c47180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:03:15.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-20T10:03:15.681 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:15.693+0000 7ff9efa46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:03:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.837+0000 7fd62e733640 1 Processor -- start 2023-07-20T10:03:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.837+0000 7fd62e733640 1 -- start start 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd62e733640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815c6e0 0x7fd6280cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd62e733640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280d3200 0x7fd6280cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd62e733640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6280cdb40 con 0x7fd62815cac0 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd62e733640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6280d07a0 con 0x7fd6280d3200 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd62e733640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280cd4f0 con 0x7fd62815c6e0 2023-07-20T10:03:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280d3200 0x7fd6280cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6280d3200 0x7fd6280cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60282/0 (socket says 172.21.15.82:60282) 2023-07-20T10:03:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 -- 172.21.15.82:0/1356118984 learned_addr learned my addr 172.21.15.82:0/1356118984 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd627fff640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815c6e0 0x7fd6280cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 -- 172.21.15.82:0/1356118984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815c6e0 msgr2=0x7fd6280cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815c6e0 0x7fd6280cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 -- 172.21.15.82:0/1356118984 >> v1:172.21.15.183:6789/0 conn(0x7fd62815cac0 legacy=0x7fd6280d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 -- 172.21.15.82:0/1356118984 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280cd7d0 con 0x7fd6280d3200 2023-07-20T10:03:15.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.841+0000 7fd61ffff640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280d3200 0x7fd6280cdfd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd610009870 tx=0x7fd61001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45047d233f94717 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd6277fe640 1 -- 172.21.15.82:0/1356118984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100ab600 con 0x7fd6280d3200 2023-07-20T10:03:15.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd6277fe640 1 -- 172.21.15.82:0/1356118984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6100ab760 con 0x7fd6280d3200 2023-07-20T10:03:15.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd6277fe640 1 -- 172.21.15.82:0/1356118984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100abaf0 con 0x7fd6280d3200 2023-07-20T10:03:15.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- 172.21.15.82:0/1356118984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280d3200 msgr2=0x7fd6280cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280d3200 0x7fd6280cdfd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd610009870 tx=0x7fd61001c420 comp rx=0 tx=0).stop 2023-07-20T10:03:15.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- 172.21.15.82:0/1356118984 shutdown_connections 2023-07-20T10:03:15.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6280d3200 0x7fd6280cdfd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- 172.21.15.82:0/1356118984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815c6e0 0x7fd6280cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- 172.21.15.82:0/1356118984 >> 172.21.15.82:0/1356118984 conn(0x7fd6280d2600 msgr2=0x7fd6280d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:15.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- 172.21.15.82:0/1356118984 shutdown_connections 2023-07-20T10:03:15.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- 172.21.15.82:0/1356118984 wait complete. 2023-07-20T10:03:15.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 Processor -- start 2023-07-20T10:03:15.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- start start 2023-07-20T10:03:15.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6280d3200 0x7fd628157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 0x7fd6280c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815cac0 0x7fd6280c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280b16c0 con 0x7fd62815c6e0 2023-07-20T10:03:15.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280cb3d0 con 0x7fd6280d3200 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd62e733640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6280cb620 con 0x7fd62815cac0 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd61ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 0x7fd6280c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd61ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 0x7fd6280c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60294/0 (socket says 172.21.15.82:60294) 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd61ffff640 1 -- 172.21.15.82:0/816484749 learned_addr learned my addr 172.21.15.82:0/816484749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.845+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6280d3200 0x7fd628157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd62ccd0640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815cac0 0x7fd6280c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:15.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815cac0 msgr2=0x7fd6280c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd62815cac0 0x7fd6280c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6280d3200 msgr2=0x7fd628157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:15.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6280d3200 0x7fd628157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:15.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6100094d0 con 0x7fd62815c6e0 2023-07-20T10:03:15.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd61ffff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 0x7fd6280c65a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd61001aad0 tx=0x7fd61001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100b4800 con 0x7fd62815c6e0 2023-07-20T10:03:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6100b4960 con 0x7fd62815c6e0 2023-07-20T10:03:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6100b4d10 con 0x7fd62815c6e0 2023-07-20T10:03:15.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6280cb900 con 0x7fd62815c6e0 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6280cbec0 con 0x7fd62815c6e0 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62804da30 con 0x7fd62815c6e0 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.849+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd6100c9430 con 0x7fd62815c6e0 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.853+0000 7fd6257fa640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.853+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd61011e840 con 0x7fd62815c6e0 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.853+0000 7fd627fff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 msgr2=0x7fd6080688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:15.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.853+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:03:15.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:15.853+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6100ebba0 con 0x7fd62815c6e0 2023-07-20T10:03:16.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:16.021+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6280d12f0 con 0x7fd6080663f0 2023-07-20T10:03:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:16.057+0000 7fd627fff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 msgr2=0x7fd6080688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:16.057+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:03:16.120 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.135+0000 7eff27c47180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:03:16.174 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.185+0000 7ff9efa46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:03:16.178 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.191+0000 7eff27c47180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:03:16.232 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.245+0000 7ff9efa46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:03:16.233 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.247+0000 7eff27c47180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:03:16.288 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.301+0000 7ff9efa46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:03:16.318 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.331+0000 7eff27c47180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:03:16.375 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.387+0000 7eff27c47180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:03:16.376 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.389+0000 7ff9efa46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:03:16.432 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.445+0000 7ff9efa46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:03:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:16.461+0000 7fd627fff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 msgr2=0x7fd6080688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:16.461+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:03:16.458 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.471+0000 7eff27c47180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:03:16.514 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.527+0000 7eff27c47180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:03:16.516 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.529+0000 7ff9efa46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:03:16.573 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.585+0000 7ff9efa46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:03:16.656 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.671+0000 7eff27c47180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:03:16.714 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.725+0000 7ff9efa46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:03:16.714 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.727+0000 7eff27c47180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:03:16.772 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:16.785+0000 7ff9efa46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:03:16.961 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:03:16.961 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:03:16.962 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:03:16.969 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:16.983+0000 7eff27c47180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:03:17.012 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:03:17.013 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:03:17.013 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:03:17.020 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:17.033+0000 7ff9efa46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:03:17.104 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:17.119+0000 7eff27c47180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:03:17.156 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:17.169+0000 7ff9efa46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:03:17.228 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:17.243+0000 7eff27c47180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:03:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:17.265+0000 7fd627fff640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 msgr2=0x7fd6080688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3713806871 2023-07-20T10:03:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:17.265+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:03:17.281 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:17.293+0000 7ff9efa46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:03:17.298 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:17.311+0000 7eff27c47180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:03:17.351 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:17.361+0000 7ff9efa46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:03:17.432 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:17.447+0000 7eff27c47180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:03:17.486 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:17.497+0000 7ff9efa46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:03:17.969 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:17.983+0000 7eff27c47180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:03:18.024 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.037+0000 7ff9efa46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:03:18.052 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:18.067+0000 7eff27c47180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:03:18.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.121+0000 7ff9efa46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:03:18.199 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:18.211+0000 7eff27c47180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:03:18.254 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.265+0000 7ff9efa46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:03:18.281 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:18.295+0000 7eff27c47180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:03:18.338 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.349+0000 7ff9efa46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:03:18.547 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:18.563+0000 7eff27c47180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:03:18.606 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:03:18.619+0000 7eff27c47180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:03:18.607 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.617+0000 7ff9efa46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:03:18.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:18.677+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 20) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd6100ebf70 con 0x7fd62815c6e0 2023-07-20T10:03:18.670 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.681+0000 7ff9efa46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:03:18.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:18.693+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 21) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fd61011f550 con 0x7fd62815c6e0 2023-07-20T10:03:18.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:18.697+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 msgr2=0x7fd6080688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:03:18.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:18.697+0000 7fd6257fa640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/3713806871,v1:172.21.15.82:6833/3713806871] conn(0x7fd6080663f0 0x7fd6080688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:18.804 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff971fa3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff971fa3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff971fa3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff971fa3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff971fa3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff974fa9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.806 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff974fa9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.806 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff974fa9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.806 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff974fa9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:18.806 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:03:18.817+0000 7ff974fa9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:03:19.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.701+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mon.0 v2:172.21.15.82:3300/0 9 ==== mgrmap(e 22) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fd6100c4d40 con 0x7fd62815c6e0 2023-07-20T10:03:19.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.701+0000 7fd6257fa640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd60806e8c0 0x7fd608070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.701+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 --> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd608034290 con 0x7fd60806e8c0 2023-07-20T10:03:19.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.705+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd60806e8c0 0x7fd608070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.705+0000 7fd627fff640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd60806e8c0 0x7fd608070cb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd618009780 tx=0x7fd618009190 comp rx=0 tx=0).ready entity=mgr.5998 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:19.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.773+0000 7fd6257fa640 1 -- 172.21.15.82:0/816484749 <== mgr.5998 v2:172.21.15.82:6832/4292533700 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd608034290 con 0x7fd60806e8c0 2023-07-20T10:03:19.762 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T10:03:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd60806e8c0 msgr2=0x7fd608070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd60806e8c0 0x7fd608070cb0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd618009780 tx=0x7fd618009190 comp rx=0 tx=0).stop 2023-07-20T10:03:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 msgr2=0x7fd6280c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 --2- 172.21.15.82:0/816484749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd62815c6e0 0x7fd6280c65a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd61001aad0 tx=0x7fd61001ac60 comp rx=0 tx=0).stop 2023-07-20T10:03:19.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62ccd0640 1 -- 172.21.15.82:0/816484749 reap_dead start 2023-07-20T10:03:19.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 shutdown_connections 2023-07-20T10:03:19.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 >> 172.21.15.82:0/816484749 conn(0x7fd6280d2600 msgr2=0x7fd6280af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:19.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 shutdown_connections 2023-07-20T10:03:19.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.777+0000 7fd62e733640 1 -- 172.21.15.82:0/816484749 wait complete. 2023-07-20T10:03:19.784 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T10:03:19.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-07-20T10:03:19.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 Processor -- start 2023-07-20T10:03:19.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 -- start start 2023-07-20T10:03:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9dfc159450 0x7f9dfc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 0x7f9dfc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0b06b0 con 0x7f9dfc159830 2023-07-20T10:03:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0cce90 con 0x7f9dfc159450 2023-07-20T10:03:19.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9e011ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0cc8d0 con 0x7f9dfc0afd50 2023-07-20T10:03:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9dfa59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9dfc159830 0x7f9dfc0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38866/0 (socket says 172.21.15.82:38866) 2023-07-20T10:03:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.941+0000 7f9dfa59c640 1 -- 172.21.15.82:0/122637151 learned_addr learned my addr 172.21.15.82:0/122637151 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:03:19.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/122637151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 0x7f9dfc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfad9d640 1 --2- 172.21.15.82:0/122637151 >> v2:172.21.15.183:3300/0 conn(0x7f9dfc159450 0x7f9dfc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9df9d9b640 1 -- 172.21.15.82:0/122637151 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520189306 0 0) 0x7f9dfc0b06b0 con 0x7f9dfc159830 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9df9d9b640 1 -- 172.21.15.82:0/122637151 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9de4003530 con 0x7f9dfc159830 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 -- 172.21.15.82:0/122637151 >> v2:172.21.15.183:3300/0 conn(0x7f9dfc159450 msgr2=0x7f9dfc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/122637151 >> v2:172.21.15.183:3300/0 conn(0x7f9dfc159450 0x7f9dfc15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 -- 172.21.15.82:0/122637151 >> v1:172.21.15.82:6789/0 conn(0x7f9dfc159830 legacy=0x7f9dfc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 -- 172.21.15.82:0/122637151 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0ccbb0 con 0x7f9dfc0afd50 2023-07-20T10:03:19.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/122637151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 0x7f9dfc0b0170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70e99d962f58e55 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:19.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9df9d9b640 1 -- 172.21.15.82:0/122637151 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40a59e0 con 0x7f9dfc0afd50 2023-07-20T10:03:19.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9df9d9b640 1 -- 172.21.15.82:0/122637151 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40a5b40 con 0x7f9dfc0afd50 2023-07-20T10:03:19.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.945+0000 7f9df9d9b640 1 -- 172.21.15.82:0/122637151 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40ad440 con 0x7f9dfc0afd50 2023-07-20T10:03:19.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- 172.21.15.82:0/122637151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 msgr2=0x7f9dfc0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- 172.21.15.82:0/122637151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 0x7f9dfc0b0170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009d90 tx=0x7f9df401c920 comp rx=0 tx=0).stop 2023-07-20T10:03:19.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- 172.21.15.82:0/122637151 shutdown_connections 2023-07-20T10:03:19.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- 172.21.15.82:0/122637151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc0afd50 0x7f9dfc0b0170 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:19.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- 172.21.15.82:0/122637151 >> v2:172.21.15.183:3300/0 conn(0x7f9dfc159450 0x7f9dfc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:19.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- 172.21.15.82:0/122637151 >> 172.21.15.82:0/122637151 conn(0x7f9dfc0cad50 msgr2=0x7f9dfc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:19.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- 172.21.15.82:0/122637151 shutdown_connections 2023-07-20T10:03:19.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- 172.21.15.82:0/122637151 wait complete. 2023-07-20T10:03:19.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 Processor -- start 2023-07-20T10:03:19.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- start start 2023-07-20T10:03:19.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dfc0afd50 0x7f9dfc1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 0x7f9dfc154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c6e10 con 0x7f9dfc0c6440 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc152330 con 0x7f9dfc0afd50 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.949+0000 7f9e011ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc152610 con 0x7f9dfc159450 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60402/0 (socket says 172.21.15.82:60402) 2023-07-20T10:03:19.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 -- 172.21.15.82:0/893270372 learned_addr learned my addr 172.21.15.82:0/893270372 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:19.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfad9d640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dfc0afd50 0x7f9dfc1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfa59c640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 0x7f9dfc154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 -- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 msgr2=0x7f9dfc154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 0x7f9dfc154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 -- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dfc0afd50 msgr2=0x7f9dfc1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dfc0afd50 0x7f9dfc1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 -- 172.21.15.82:0/893270372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009a70 con 0x7f9dfc0c6440 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfa59c640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 0x7f9dfc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9dfb59e640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9df40b0040 tx=0x7f9df40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:19.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40adce0 con 0x7f9dfc0c6440 2023-07-20T10:03:19.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df40ade40 con 0x7f9dfc0c6440 2023-07-20T10:03:19.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df40b9690 con 0x7f9dfc0c6440 2023-07-20T10:03:19.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc1528f0 con 0x7f9dfc0c6440 2023-07-20T10:03:19.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc152eb0 con 0x7f9dfc0c6440 2023-07-20T10:03:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc1530a0 con 0x7f9dfc0c6440 2023-07-20T10:03:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f9df40b97f0 con 0x7f9dfc0c6440 2023-07-20T10:03:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.953+0000 7f9de37fe640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 0x7f9de80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.957+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9df411f110 con 0x7f9dfc0c6440 2023-07-20T10:03:19.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.957+0000 7f9dfad9d640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 0x7f9de80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:19.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.957+0000 7f9dfad9d640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 0x7f9de80685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009b60 tx=0x7f9dec009190 comp rx=0 tx=0).ready entity=mgr.5998 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:19.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:19.961+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9df40ec770 con 0x7f9dfc0c6440 2023-07-20T10:03:20.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.125+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 --> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9dfc0cc5b0 con 0x7f9de8066120 2023-07-20T10:03:20.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9de37fe640 1 -- 172.21.15.82:0/893270372 <== mgr.5998 v2:172.21.15.82:6832/4292533700 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9dec011ac0 con 0x7f9de8066120 2023-07-20T10:03:20.165 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T10:03:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 msgr2=0x7f9de80685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 0x7f9de80685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009b60 tx=0x7f9dec009190 comp rx=0 tx=0).stop 2023-07-20T10:03:20.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 msgr2=0x7f9dfc0c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f9df40b0040 tx=0x7f9df40196c0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 shutdown_connections 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f9de8066120 0x7f9de80685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9dfc0c6440 0x7f9dfc0c68d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9dfc159450 0x7f9dfc154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 --2- 172.21.15.82:0/893270372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dfc0afd50 0x7f9dfc1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 >> 172.21.15.82:0/893270372 conn(0x7f9dfc0cad50 msgr2=0x7f9dfc0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:20.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 shutdown_connections 2023-07-20T10:03:20.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.177+0000 7f9e011ba640 1 -- 172.21.15.82:0/893270372 wait complete. 2023-07-20T10:03:20.186 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T10:03:20.187 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-20-10_04_00 in ~40s... 2023-07-20T10:03:20.187 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-20-10_05_00 in ~100s... 2023-07-20T10:03:20.187 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-07-20T10:03:20.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-20T10:03:20.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 Processor -- start 2023-07-20T10:03:20.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 -- start start 2023-07-20T10:03:20.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faae4159830 0x7faae40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:20.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae40cc8d0 con 0x7faae40cc3e0 2023-07-20T10:03:20.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae40ccbb0 con 0x7faae4159450 2023-07-20T10:03:20.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.341+0000 7faaebe56640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae40cce90 con 0x7faae4159830 2023-07-20T10:03:20.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faae4159830 0x7faae40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:20.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faae4159830 0x7faae40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60404/0 (socket says 172.21.15.82:60404) 2023-07-20T10:03:20.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 -- 172.21.15.82:0/2544325929 learned_addr learned my addr 172.21.15.82:0/2544325929 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:20.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 -- 172.21.15.82:0/2544325929 >> v1:172.21.15.183:6789/0 conn(0x7faae4159450 legacy=0x7faae415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 -- 172.21.15.82:0/2544325929 >> v1:172.21.15.82:6789/0 conn(0x7faae40cc3e0 legacy=0x7faae40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 -- 172.21.15.82:0/2544325929 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae4159cc0 con 0x7faae4159830 2023-07-20T10:03:20.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae93f1640 1 --2- 172.21.15.82:0/2544325929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159830 0x7faae40cbea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d8569ebcde760c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:20.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae8bf0640 1 -- 172.21.15.82:0/2544325929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40ab620 con 0x7faae4159830 2023-07-20T10:03:20.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae8bf0640 1 -- 172.21.15.82:0/2544325929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40ab780 con 0x7faae4159830 2023-07-20T10:03:20.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.345+0000 7faae8bf0640 1 -- 172.21.15.82:0/2544325929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40abb10 con 0x7faae4159830 2023-07-20T10:03:20.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- 172.21.15.82:0/2544325929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159830 msgr2=0x7faae40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 --2- 172.21.15.82:0/2544325929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159830 0x7faae40cbea0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7faad4009870 tx=0x7faad401c510 comp rx=0 tx=0).stop 2023-07-20T10:03:20.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- 172.21.15.82:0/2544325929 shutdown_connections 2023-07-20T10:03:20.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 --2- 172.21.15.82:0/2544325929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159830 0x7faae40cbea0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- 172.21.15.82:0/2544325929 >> 172.21.15.82:0/2544325929 conn(0x7faae40cad50 msgr2=0x7faae40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:20.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- 172.21.15.82:0/2544325929 shutdown_connections 2023-07-20T10:03:20.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- 172.21.15.82:0/2544325929 wait complete. 2023-07-20T10:03:20.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 Processor -- start 2023-07-20T10:03:20.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- start start 2023-07-20T10:03:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 0x7faae4070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:20.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 0x7faae40c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae4071580 con 0x7faae4159450 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae41f59e0 con 0x7faae40cc3e0 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaebe56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4070ce0 con 0x7faae40c5ad0 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60408/0 (socket says 172.21.15.82:60408) 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 -- 172.21.15.82:0/1755761810 learned_addr learned my addr 172.21.15.82:0/1755761810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:03:20.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae9bf2640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 0x7faae4070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaea3f3640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 0x7faae40c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 -- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 msgr2=0x7faae40c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 0x7faae40c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 -- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 msgr2=0x7faae4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 0x7faae4070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae93f1640 1 -- 172.21.15.82:0/1755761810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40094d0 con 0x7faae4159450 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faae9bf2640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 0x7faae4070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:20.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.349+0000 7faaea3f3640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 0x7faae40c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:03:20.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faae93f1640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faad401a140 tx=0x7faad401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40be3f0 con 0x7faae4159450 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40be570 con 0x7faae4159450 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40be920 con 0x7faae4159450 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae4070fc0 con 0x7faae4159450 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae41626b0 con 0x7faae4159450 2023-07-20T10:03:20.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae404da30 con 0x7faae4159450 2023-07-20T10:03:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) v1 ==== 85513+0+0 (secure 0 0 0) 0x7faad40b43f0 con 0x7faae4159450 2023-07-20T10:03:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 0x7faac80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:03:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6406+0+0 (secure 0 0 0) 0x7faad411daf0 con 0x7faae4159450 2023-07-20T10:03:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.353+0000 7faae9bf2640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 0x7faac80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:03:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.357+0000 7faae9bf2640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 0x7faac80685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faae406fd00 tx=0x7faae0009040 comp rx=0 tx=0).ready entity=mgr.5998 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:03:20.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.357+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faad40eb200 con 0x7faae4159450 2023-07-20T10:03:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.521+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 --> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faae415d8b0 con 0x7faac8066120 2023-07-20T10:03:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faada7fc640 1 -- 172.21.15.82:0/1755761810 <== mgr.5998 v2:172.21.15.82:6832/4292533700 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7faae0001ce0 con 0x7faac8066120 2023-07-20T10:03:20.518 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:03:20.518 INFO:teuthology.orchestra.run.smithi082.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 msgr2=0x7faac80685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 0x7faac80685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faae406fd00 tx=0x7faae0009040 comp rx=0 tx=0).stop 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 msgr2=0x7faae41f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faad401a140 tx=0x7faad401ad50 comp rx=0 tx=0).stop 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 shutdown_connections 2023-07-20T10:03:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7faac8066120 0x7faac80685e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faae40c5ad0 0x7faae40c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faae4159450 0x7faae41f54a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 --2- 172.21.15.82:0/1755761810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faae40cc3e0 0x7faae4070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.529+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 >> 172.21.15.82:0/1755761810 conn(0x7faae40cad50 msgr2=0x7faae40cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.533+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 shutdown_connections 2023-07-20T10:03:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:03:20.533+0000 7faaebe56640 1 -- 172.21.15.82:0/1755761810 wait complete. 2023-07-20T10:03:20.538 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-20T10:03:20.539 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-07-20T10:03:20.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:20.540 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:20.552 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:20.553 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:20.553 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:21.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:21.555 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:21.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:21.567 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:21.567 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:22.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:22.569 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:22.581 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:22.581 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:22.581 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:23.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:23.583 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:23.595 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:23.595 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:23.595 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:24.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:24.597 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:24.609 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:24.609 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:24.609 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:25.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:25.611 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:25.624 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:25.624 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:25.625 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:26.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:26.626 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:26.638 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:26.639 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:26.639 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:26.733 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:03:26.737 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:03:27.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:27.641 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:27.653 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:27.653 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:27.654 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:28.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:28.655 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:28.667 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:28.668 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:28.668 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:29.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:29.670 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:29.682 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:29.682 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:29.682 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:30.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:30.684 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:30.696 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:30.696 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:30.696 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:31.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:31.699 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:31.711 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:31.712 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:31.712 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:32.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:32.714 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:32.726 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:32.726 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:32.727 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:33.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:33.729 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:33.741 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:33.741 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:33.742 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:34.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:34.743 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:34.755 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:34.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:34.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:35.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:35.757 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:35.770 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:35.771 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:35.771 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:36.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:36.773 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:36.786 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:36.786 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:36.786 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:37.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:37.788 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:37.801 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:37.801 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:37.802 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:38.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:38.803 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:38.815 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:38.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:38.816 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:39.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:39.818 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:39.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:39.831 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:39.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:40.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:40.833 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:40.845 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:40.845 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:40.846 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:41.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:41.847 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:41.859 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:41.860 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:41.860 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:42.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:42.861 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:42.874 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:42.874 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:42.874 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:43.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:43.877 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:43.890 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:43.891 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:43.891 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:44.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:44.893 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:44.905 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:44.906 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:44.906 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:45.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:45.908 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:45.921 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:45.921 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:45.922 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:46.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:46.925 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:46.937 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:46.938 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:46.938 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:47.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:47.939 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:47.952 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:47.952 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:47.952 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:48.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:48.954 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:48.967 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:48.967 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:48.967 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:49.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:49.969 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:49.981 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:49.982 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:49.983 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:50.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:50.985 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:50.997 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:50.997 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:50.998 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:51.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:51.999 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:52.011 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:52.011 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:52.012 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:53.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:53.013 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:53.029 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:53.029 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:53.030 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:54.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:54.031 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:54.043 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:54.044 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:54.044 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:55.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:55.046 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:55.058 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:55.059 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:55.059 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:56.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:56.061 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:56.074 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:56.075 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:56.075 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:57.055 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:03:57.059 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:03:57.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:57.076 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:57.113 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:57.114 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:57.114 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:58.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:58.116 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:58.130 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:58.131 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:58.132 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:03:59.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:03:59.135 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:03:59.147 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:03:59.147 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:03:59.147 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:00.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:00.149 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:00.161 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:04:00.162 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:00.162 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:00.176 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:04:00.188+0000 7ff963f87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:04:00.176 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:04:00.188+0000 7ff963f87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:04:00.176 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:04:00.188+0000 7ff963f87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:04:00.176 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:04:00.188+0000 7ff963f87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:04:00.176 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:04:00.188+0000 7ff963f87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:04:01.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:01.164 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:01.175 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:01.176 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:01.176 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:01.177 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:01.177 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-20-10_04_00_UTC'] 2023-07-20T10:04:01.178 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689847400.1870122, now = 1689847441.1781604, timo = 40 2023-07-20T10:04:02.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:02.179 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:02.190 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:02.191 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:02.192 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:02.192 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:03.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:03.193 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:03.204 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:03.205 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:03.205 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:03.206 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:04.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:04.208 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:04.219 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:04.220 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:04.220 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:04.221 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:05.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:05.222 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:05.233 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:05.234 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:05.234 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:05.234 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:06.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:06.236 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:06.248 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:06.249 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:06.249 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:06.249 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:07.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:07.251 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:07.262 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:07.263 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:07.264 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:07.264 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:08.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:08.266 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:08.278 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:08.279 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:08.280 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:08.280 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:09.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:09.281 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:09.292 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:09.293 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:09.293 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:09.294 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:10.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:10.296 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:10.307 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:10.309 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:10.310 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:10.310 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:11.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:11.312 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:11.323 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:11.324 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:11.324 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:11.325 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:12.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:12.326 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:12.337 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:12.338 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:12.338 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:12.338 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:13.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:13.340 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:13.351 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:13.352 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:13.353 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:13.353 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:14.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:14.355 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:14.366 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:14.367 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:14.367 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:14.368 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:15.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:15.369 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:15.380 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:15.381 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:15.382 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:15.382 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:16.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:16.384 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:16.395 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:16.396 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:16.396 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:16.396 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:17.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:17.398 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:17.409 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:17.410 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:17.410 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:17.411 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:18.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:18.413 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:18.424 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:18.425 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:18.425 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:18.425 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:19.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:19.428 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:19.439 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:19.440 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:19.441 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:19.441 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:20.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:20.443 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:20.454 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:20.455 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:20.456 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:20.456 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:21.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:21.458 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:21.469 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:21.470 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:21.470 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:21.471 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:22.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:22.472 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:22.484 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:22.485 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:22.485 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:22.485 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:23.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:23.487 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:23.498 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:23.499 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:23.499 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:23.500 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:24.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:24.501 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:24.513 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:24.514 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:24.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:24.515 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:25.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:25.516 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:25.527 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:25.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:25.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:25.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:26.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:26.530 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:26.540 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:26.541 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:26.541 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:26.542 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:27.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:04:27.128 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:04:27.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:27.543 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:27.554 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:27.555 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:27.555 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:27.555 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:28.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:28.557 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:28.568 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:28.569 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:28.569 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:28.570 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:29.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:29.571 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:29.582 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:29.583 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:29.583 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:29.583 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:30.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:30.585 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:30.596 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:30.597 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:30.597 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:30.598 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:31.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:31.599 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:31.611 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:31.612 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:31.612 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:31.612 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:32.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:32.615 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:32.625 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:32.626 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:32.627 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:32.628 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:33.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:33.630 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:33.641 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:33.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:33.643 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:33.644 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:34.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:34.646 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:34.657 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:34.658 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:34.658 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:34.659 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:35.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:35.660 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:35.671 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:35.671 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:35.672 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:35.672 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:36.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:36.674 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:36.686 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:36.687 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:36.687 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:37.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:37.689 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:37.699 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:37.700 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:37.701 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:37.701 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:38.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:38.702 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:38.713 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:38.714 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:38.714 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:38.715 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:39.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:39.716 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:39.727 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:39.728 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:39.728 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:39.729 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:40.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:40.730 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:40.741 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:40.742 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:40.742 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:40.742 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:41.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:41.744 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:41.755 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:41.756 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:41.756 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:41.757 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:42.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:42.759 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:42.771 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:42.772 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:42.773 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:42.773 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:43.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:43.775 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:43.786 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:43.787 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:43.787 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:43.787 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:44.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:44.789 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:44.800 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:44.801 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:44.802 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:44.802 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:45.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:45.803 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:45.815 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:45.816 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:45.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:45.817 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:46.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:46.818 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:46.829 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:46.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:46.831 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:46.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:47.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:47.832 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:47.843 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:47.844 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:47.844 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:47.845 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:48.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:48.846 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:48.857 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:48.858 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:48.858 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:48.858 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:49.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:49.860 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:49.871 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:49.872 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:49.873 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:49.873 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:50.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:50.875 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:50.887 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:50.888 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:50.888 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:50.889 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:51.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:51.891 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:51.902 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:51.902 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:51.903 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:51.903 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:52.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:52.905 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:52.916 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:52.918 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:52.918 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:52.918 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:53.920 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:53.931 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:53.931 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:53.932 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:53.932 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:54.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:54.934 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:54.945 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:54.946 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:54.946 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:54.946 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:55.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:55.948 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:55.959 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:55.960 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:55.961 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:55.961 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:56.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:56.962 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:56.974 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:56.975 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:56.975 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:56.975 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:57.238 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:04:57.242 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:04:57.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:57.977 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:57.988 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:57.989 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:57.989 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:57.990 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:04:58.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:04:58.991 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:04:59.002 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:04:59.003 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:04:59.003 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:04:59.004 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:05:00.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:00.005 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:05:00.016 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:05:00.017 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC'} 2023-07-20T10:05:00.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:05:00.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:05:01.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:01.018 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:05:01.029 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:05:01.029 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_05_00_UTC 2023-07-20T10:05:01.031 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_04_00_UTC', 'scheduled-2023-07-20-10_05_00_UTC'} 2023-07-20T10:05:01.031 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-20-10_05_00_UTC'} 2023-07-20T10:05:01.032 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:05:01.033 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-20-10_05_00_UTC'] 2023-07-20T10:05:01.033 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689847400.1870122, now = 1689847501.033779, timo = 100 2023-07-20T10:05:02.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-20T10:05:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 Processor -- start 2023-07-20T10:05:02.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 -- start start 2023-07-20T10:05:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd998159450 0x7fd99815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980cc8d0 con 0x7fd9980afd50 2023-07-20T10:05:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9980ccbb0 con 0x7fd998159830 2023-07-20T10:05:02.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd99db8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9980cce90 con 0x7fd998159450 2023-07-20T10:05:02.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd997fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd9980afd50 0x7fd9980b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36678/0 (socket says 172.21.15.82:36678) 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd997fff640 1 -- 172.21.15.82:0/2625225531 learned_addr learned my addr 172.21.15.82:0/2625225531 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9977fe640 1 --2- 172.21.15.82:0/2625225531 >> v2:172.21.15.183:3300/0 conn(0x7fd998159450 0x7fd99815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505631929 0 0) 0x7fd9980cc8d0 con 0x7fd9980afd50 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd980003530 con 0x7fd9980afd50 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9977fe640 1 -- 172.21.15.82:0/2625225531 >> v1:172.21.15.183:6789/0 conn(0x7fd998159830 legacy=0x7fd9980cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 577074039 0 0) 0x7fd980003530 con 0x7fd9980afd50 2023-07-20T10:05:02.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9977fe640 1 -- 172.21.15.82:0/2625225531 >> v1:172.21.15.82:6789/0 conn(0x7fd9980afd50 legacy=0x7fd9980b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.207+0000 7fd9977fe640 1 -- 172.21.15.82:0/2625225531 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998159cc0 con 0x7fd998159450 2023-07-20T10:05:02.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd9977fe640 1 --2- 172.21.15.82:0/2625225531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd99815a4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9880097c0 tx=0x7fd98801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec53911d136d8dee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990001a00 con 0x7fd998159450 2023-07-20T10:05:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9880a7050 con 0x7fd998159450 2023-07-20T10:05:02.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd9967fc640 1 -- 172.21.15.82:0/2625225531 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9880ab620 con 0x7fd998159450 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 -- 172.21.15.82:0/2625225531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 msgr2=0x7fd99815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 --2- 172.21.15.82:0/2625225531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd99815a4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd9880097c0 tx=0x7fd98801c370 comp rx=0 tx=0).stop 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 -- 172.21.15.82:0/2625225531 shutdown_connections 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 --2- 172.21.15.82:0/2625225531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd99815a4c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 -- 172.21.15.82:0/2625225531 >> 172.21.15.82:0/2625225531 conn(0x7fd9980cad50 msgr2=0x7fd9980cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:02.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 -- 172.21.15.82:0/2625225531 shutdown_connections 2023-07-20T10:05:02.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.211+0000 7fd99db8f640 1 -- 172.21.15.82:0/2625225531 wait complete. 2023-07-20T10:05:02.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 Processor -- start 2023-07-20T10:05:02.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- start start 2023-07-20T10:05:02.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9980afd50 0x7fd998155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd998155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980add60 con 0x7fd998150330 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd998155dd0 con 0x7fd998159450 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9980c7b80 con 0x7fd9980afd50 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60540/0 (socket says 172.21.15.82:60540) 2023-07-20T10:05:02.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 -- 172.21.15.82:0/254730910 learned_addr learned my addr 172.21.15.82:0/254730910 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:02.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd9977fe640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9980afd50 0x7fd998155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd996ffd640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd998155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 -- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9980afd50 msgr2=0x7fd998155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9980afd50 0x7fd998155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 -- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 msgr2=0x7fd998155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd998155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 -- 172.21.15.82:0/254730910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd988009420 con 0x7fd998150330 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd996ffd640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd998155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd997fff640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd9900018a0 tx=0x7fd99000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990012400 con 0x7fd998150330 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd990012560 con 0x7fd998150330 2023-07-20T10:05:02.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990012910 con 0x7fd998150330 2023-07-20T10:05:02.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9980c7e60 con 0x7fd998150330 2023-07-20T10:05:02.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.215+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9980c8140 con 0x7fd998150330 2023-07-20T10:05:02.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9980adf10 con 0x7fd998150330 2023-07-20T10:05:02.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fd990012a70 con 0x7fd998150330 2023-07-20T10:05:02.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd97ffff640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 0x7fd9840688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd9900847a0 con 0x7fd998150330 2023-07-20T10:05:02.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd9977fe640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 0x7fd9840688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.219+0000 7fd9977fe640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 0x7fd9840688e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9880ad000 tx=0x7fd988008040 comp rx=0 tx=0).ready entity=mgr.5998 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.223+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9980adf10 con 0x7fd998150330 2023-07-20T10:05:02.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.391+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 --> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9980cc5b0 con 0x7fd984066420 2023-07-20T10:05:02.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.455+0000 7fd97ffff640 1 -- 172.21.15.82:0/254730910 <== mgr.5998 v2:172.21.15.82:6832/4292533700 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd9880bc0c0 con 0x7fd984066420 2023-07-20T10:05:02.438 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path snap_test_dir1 2023-07-20T10:05:02.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 msgr2=0x7fd9840688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 0x7fd9840688e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9880ad000 tx=0x7fd988008040 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 msgr2=0x7fd99815b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd9900018a0 tx=0x7fd99000a430 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 shutdown_connections 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd984066420 0x7fd9840688e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd998150330 0x7fd99815b4b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd998159450 0x7fd998155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 --2- 172.21.15.82:0/254730910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9980afd50 0x7fd998155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 >> 172.21.15.82:0/254730910 conn(0x7fd9980cad50 msgr2=0x7fd998156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:02.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 shutdown_connections 2023-07-20T10:05:02.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.459+0000 7fd99db8f640 1 -- 172.21.15.82:0/254730910 wait complete. 2023-07-20T10:05:02.459 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-20T10:05:02.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:02.460 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:05:02.469 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:05:02.469 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_05_00_UTC 2023-07-20T10:05:02.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_04_00_UTC 2023-07-20T10:05:02.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:02.471 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_04_00_UTC) 2023-07-20T10:05:02.524 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_05_00_UTC 2023-07-20T10:05:02.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:02.525 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_05_00_UTC) 2023-07-20T10:05:02.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:02.580 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T10:05:02.639 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:05:02.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.835+0000 7fa846a61640 1 Processor -- start 2023-07-20T10:05:02.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 -- start start 2023-07-20T10:05:02.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa840070970 0x7fa840070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa84006b620 0x7fa84006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8400c95d0 con 0x7fa840158ce0 2023-07-20T10:05:02.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84006bff0 con 0x7fa840070970 2023-07-20T10:05:02.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa846a61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8401590c0 con 0x7fa84006b620 2023-07-20T10:05:02.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa840070970 0x7fa840070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa840158ce0 0x7fa8400c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36694/0 (socket says 172.21.15.82:36694) 2023-07-20T10:05:02.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83ffff640 1 -- 172.21.15.82:0/1435151963 learned_addr learned my addr 172.21.15.82:0/1435151963 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:02.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa840070970 0x7fa840070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60546/0 (socket says 172.21.15.82:60546) 2023-07-20T10:05:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa844ffe640 1 --2- 172.21.15.82:0/1435151963 >> v2:172.21.15.183:3300/0 conn(0x7fa84006b620 0x7fa84006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 -- 172.21.15.82:0/1435151963 >> v2:172.21.15.183:3300/0 conn(0x7fa84006b620 msgr2=0x7fa84006bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:02.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 --2- 172.21.15.82:0/1435151963 >> v2:172.21.15.183:3300/0 conn(0x7fa84006b620 0x7fa84006bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 -- 172.21.15.82:0/1435151963 >> v1:172.21.15.82:6789/0 conn(0x7fa840158ce0 legacy=0x7fa8400c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83f7fe640 1 -- 172.21.15.82:0/1435151963 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8400c89c0 con 0x7fa840070970 2023-07-20T10:05:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.839+0000 7fa83effd640 1 -- 172.21.15.82:0/1435151963 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150289007 0 0) 0x7fa8400c95d0 con 0x7fa840158ce0 2023-07-20T10:05:02.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa83f7fe640 1 --2- 172.21.15.82:0/1435151963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840070970 0x7fa840070e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa8400b0e20 tx=0x7fa83401e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319989a067cfa012 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa83effd640 1 -- 172.21.15.82:0/1435151963 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a7830 con 0x7fa840070970 2023-07-20T10:05:02.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa83effd640 1 -- 172.21.15.82:0/1435151963 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8340ab070 con 0x7fa840070970 2023-07-20T10:05:02.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa83effd640 1 -- 172.21.15.82:0/1435151963 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a7bb0 con 0x7fa840070970 2023-07-20T10:05:02.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 -- 172.21.15.82:0/1435151963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840070970 msgr2=0x7fa840070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 --2- 172.21.15.82:0/1435151963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840070970 0x7fa840070e00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa8400b0e20 tx=0x7fa83401e8f0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 -- 172.21.15.82:0/1435151963 shutdown_connections 2023-07-20T10:05:02.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 --2- 172.21.15.82:0/1435151963 >> v2:172.21.15.183:3300/0 conn(0x7fa84006b620 0x7fa84006bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 --2- 172.21.15.82:0/1435151963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840070970 0x7fa840070e00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 -- 172.21.15.82:0/1435151963 >> 172.21.15.82:0/1435151963 conn(0x7fa8400cad50 msgr2=0x7fa8400cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:02.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 -- 172.21.15.82:0/1435151963 shutdown_connections 2023-07-20T10:05:02.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 -- 172.21.15.82:0/1435151963 wait complete. 2023-07-20T10:05:02.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.843+0000 7fa846a61640 1 Processor -- start 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- start start 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 0x7fa84014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa840070970 0x7fa8400c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400c4c00 con 0x7fa840158ce0 2023-07-20T10:05:02.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84014a980 con 0x7fa840070970 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8400c22d0 con 0x7fa84006b620 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60560/0 (socket says 172.21.15.82:60560) 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 -- 172.21.15.82:0/1290640914 learned_addr learned my addr 172.21.15.82:0/1290640914 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83f7fe640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa840070970 0x7fa8400c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83ffff640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 0x7fa84014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 -- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 msgr2=0x7fa84014a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 0x7fa84014a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 -- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa840070970 msgr2=0x7fa8400c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa840070970 0x7fa8400c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 -- 172.21.15.82:0/1290640914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83400b6b0 con 0x7fa840158ce0 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83ffff640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 0x7fa84014a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:02.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa844ffe640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa838007e40 tx=0x7fa83800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838014620 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83800ee90 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8380149e0 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8400c25b0 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8400c2b70 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.847+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84004da30 con 0x7fa840158ce0 2023-07-20T10:05:02.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.851+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 26) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fa838014b40 con 0x7fa840158ce0 2023-07-20T10:05:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.851+0000 7fa83cff9640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 0x7fa82c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:02.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.851+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fa838084a20 con 0x7fa840158ce0 2023-07-20T10:05:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.851+0000 7fa83ffff640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 0x7fa82c0688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:02.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.851+0000 7fa83ffff640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 0x7fa82c0688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa830000f70 tx=0x7fa830007cb0 comp rx=0 tx=0).ready entity=mgr.5998 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:02.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:02.855+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa838051b80 con 0x7fa840158ce0 2023-07-20T10:05:03.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:03.039+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fa8400c20b0 con 0x7fa840158ce0 2023-07-20T10:05:03.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.011+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fa838051f50 con 0x7fa840158ce0 2023-07-20T10:05:03.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.011+0000 7fa83cff9640 1 -- 172.21.15.82:0/1290640914 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v27) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa838051b80 con 0x7fa840158ce0 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 msgr2=0x7fa82c0688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 0x7fa82c0688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa830000f70 tx=0x7fa830007cb0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 msgr2=0x7fa840149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa838007e40 tx=0x7fa83800e4b0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 shutdown_connections 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fa82c0663f0 0x7fa82c0688b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa840158ce0 0x7fa840149bf0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa840070970 0x7fa8400c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 --2- 172.21.15.82:0/1290640914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa84006b620 0x7fa84014a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 >> 172.21.15.82:0/1290640914 conn(0x7fa8400cad50 msgr2=0x7fa84014d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 shutdown_connections 2023-07-20T10:05:03.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.015+0000 7fa846a61640 1 -- 172.21.15.82:0/1290640914 wait complete. 2023-07-20T10:05:04.022 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:05:04.022 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:04.087 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:04.149 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:05:04.149 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:04.150 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:04.159 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:04.159 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:04.163 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:04.185+0000 7f2287f65180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:04.172 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:04.191+0000 7fc0ce7fd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:04.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 Processor -- start 2023-07-20T10:05:04.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 -- start start 2023-07-20T10:05:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e940b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e940ceb70 0x7f8e940b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e940b7c20 con 0x7f8e940ccfb0 2023-07-20T10:05:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9415c9d0 con 0x7f8e940ceb70 2023-07-20T10:05:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e98e69640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940ce030 con 0x7f8e9415c5f0 2023-07-20T10:05:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e940ceb70 0x7f8e940b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e940ceb70 0x7f8e940b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60526/0 (socket says 172.21.15.82:60526) 2023-07-20T10:05:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 -- 172.21.15.82:0/220006294 learned_addr learned my addr 172.21.15.82:0/220006294 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e937fe640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e940b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 -- 172.21.15.82:0/220006294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 msgr2=0x7f8e940b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:04.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e940b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 -- 172.21.15.82:0/220006294 >> v1:172.21.15.183:6789/0 conn(0x7f8e940ccfb0 legacy=0x7f8e940ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.383+0000 7f8e93fff640 1 -- 172.21.15.82:0/220006294 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e940cd4b0 con 0x7f8e940ceb70 2023-07-20T10:05:04.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e93fff640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ceb70 0x7f8e940b0f70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009e80 tx=0x7f8e8c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd37a5862bcd8241 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:04.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e927fc640 1 -- 172.21.15.82:0/220006294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0af400 con 0x7f8e940ceb70 2023-07-20T10:05:04.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e927fc640 1 -- 172.21.15.82:0/220006294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0ab050 con 0x7f8e940ceb70 2023-07-20T10:05:04.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e927fc640 1 -- 172.21.15.82:0/220006294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0af780 con 0x7f8e940ceb70 2023-07-20T10:05:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 -- 172.21.15.82:0/220006294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ceb70 msgr2=0x7f8e940b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ceb70 0x7f8e940b0f70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009e80 tx=0x7f8e8c01f1e0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 -- 172.21.15.82:0/220006294 shutdown_connections 2023-07-20T10:05:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ceb70 0x7f8e940b0f70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 --2- 172.21.15.82:0/220006294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e940b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 -- 172.21.15.82:0/220006294 >> 172.21.15.82:0/220006294 conn(0x7f8e94065710 msgr2=0x7f8e94065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 -- 172.21.15.82:0/220006294 shutdown_connections 2023-07-20T10:05:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.387+0000 7f8e98e69640 1 -- 172.21.15.82:0/220006294 wait complete. 2023-07-20T10:05:04.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 Processor -- start 2023-07-20T10:05:04.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- start start 2023-07-20T10:05:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940ceb70 0x7f8e94154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e94153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e940c8940 con 0x7f8e940ccfb0 2023-07-20T10:05:04.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941f1930 con 0x7f8e940ceb70 2023-07-20T10:05:04.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941f5f40 con 0x7f8e9415c5f0 2023-07-20T10:05:04.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60530/0 (socket says 172.21.15.82:60530) 2023-07-20T10:05:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 -- 172.21.15.82:0/2328582445 learned_addr learned my addr 172.21.15.82:0/2328582445 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e92ffd640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940ceb70 0x7f8e94154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e93fff640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e94153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 -- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 msgr2=0x7f8e94153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e94153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 -- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940ceb70 msgr2=0x7f8e94154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940ceb70 0x7f8e94154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 -- 172.21.15.82:0/2328582445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009b30 con 0x7f8e940ccfb0 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e937fe640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400e8a0 tx=0x7f8e8400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84009510 con 0x7f8e940ccfb0 2023-07-20T10:05:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8400c940 con 0x7f8e940ccfb0 2023-07-20T10:05:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8400ccb0 con 0x7f8e940ccfb0 2023-07-20T10:05:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e94155400 con 0x7f8e940ccfb0 2023-07-20T10:05:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e941f5050 con 0x7f8e940ccfb0 2023-07-20T10:05:04.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.391+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9404da30 con 0x7f8e940ccfb0 2023-07-20T10:05:04.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.395+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8e84013470 con 0x7f8e940ccfb0 2023-07-20T10:05:04.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.395+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 0x7f8e80068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.395+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8e84084520 con 0x7f8e940ccfb0 2023-07-20T10:05:04.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.395+0000 7f8e92ffd640 1 -- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 msgr2=0x7f8e80068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:04.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.395+0000 7f8e92ffd640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 0x7f8e80068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:04.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.403+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e84051680 con 0x7f8e940ccfb0 2023-07-20T10:05:04.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.555+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e941f5330 con 0x7f8e940ccfb0 2023-07-20T10:05:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.555+0000 7f8e7bfff640 1 -- 172.21.15.82:0/2328582445 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18866 (secure 0 0 0) 0x7f8e84054ca0 con 0x7f8e940ccfb0 2023-07-20T10:05:04.540 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:04.540 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":67,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:04:20.022610+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.e","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1462509814":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3057720573":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1651242703":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/2140941636":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3208760881":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/4160992300":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6833/3713806871":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6832/3713806871":"2023-07-21T10:03:18.691909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:04.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 msgr2=0x7f8e80068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:04.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 0x7f8e80068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 msgr2=0x7f8e941f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400e8a0 tx=0x7f8e8400eca0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 shutdown_connections 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f8e800663d0 0x7f8e80068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e9415c5f0 0x7f8e94153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e940ceb70 0x7f8e94154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 --2- 172.21.15.82:0/2328582445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e940ccfb0 0x7f8e941f13f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 >> 172.21.15.82:0/2328582445 conn(0x7f8e94065710 msgr2=0x7f8e9415bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:04.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 shutdown_connections 2023-07-20T10:05:04.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.559+0000 7f8e98e69640 1 -- 172.21.15.82:0/2328582445 wait complete. 2023-07-20T10:05:04.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:02:59.146720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:03:00.452578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:04.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:04.578 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:04.601+0000 7f2287f65180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:04.605 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:04.623+0000 7fc0ce7fd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 Processor -- start 2023-07-20T10:05:04.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 -- start start 2023-07-20T10:05:04.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 0x7fd2b8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2b806ab10 0x7fd2b806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b80ce4f0 con 0x7fd2b806c120 2023-07-20T10:05:04.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b806b4c0 con 0x7fd2b806ab10 2023-07-20T10:05:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bf019640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b80d0970 con 0x7fd2b81602b0 2023-07-20T10:05:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2b806ab10 0x7fd2b806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2b806ab10 0x7fd2b806af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60542/0 (socket says 172.21.15.82:60542) 2023-07-20T10:05:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 -- 172.21.15.82:0/3770484933 learned_addr learned my addr 172.21.15.82:0/3770484933 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2b7fff640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 0x7fd2b8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 -- 172.21.15.82:0/3770484933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 msgr2=0x7fd2b8160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 0x7fd2b8160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 -- 172.21.15.82:0/3770484933 >> v1:172.21.15.183:6789/0 conn(0x7fd2b806c120 legacy=0x7fd2b80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2bd5b6640 1 -- 172.21.15.82:0/3770484933 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8160e20 con 0x7fd2b806ab10 2023-07-20T10:05:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.727+0000 7fd2b7fff640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 0x7fd2b8160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bd5b6640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b806af80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009e50 tx=0x7fd2b001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b58fab6d03a871 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2b77fe640 1 -- 172.21.15.82:0/3770484933 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00a5730 con 0x7fd2b806ab10 2023-07-20T10:05:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2b77fe640 1 -- 172.21.15.82:0/3770484933 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b00a5890 con 0x7fd2b806ab10 2023-07-20T10:05:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2b77fe640 1 -- 172.21.15.82:0/3770484933 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b00a5c20 con 0x7fd2b806ab10 2023-07-20T10:05:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 -- 172.21.15.82:0/3770484933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 msgr2=0x7fd2b806af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b806af80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009e50 tx=0x7fd2b001c980 comp rx=0 tx=0).stop 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 -- 172.21.15.82:0/3770484933 shutdown_connections 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b806af80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 --2- 172.21.15.82:0/3770484933 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b81602b0 0x7fd2b8160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 -- 172.21.15.82:0/3770484933 >> 172.21.15.82:0/3770484933 conn(0x7fd2b808c0a0 msgr2=0x7fd2b809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 -- 172.21.15.82:0/3770484933 shutdown_connections 2023-07-20T10:05:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.731+0000 7fd2bf019640 1 -- 172.21.15.82:0/3770484933 wait complete. 2023-07-20T10:05:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 Processor -- start 2023-07-20T10:05:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- start start 2023-07-20T10:05:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b806c120 0x7fd2b814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2b81602b0 0x7fd2b8154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8150080 con 0x7fd2b806ab10 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b814b0a0 con 0x7fd2b81602b0 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b8153e30 con 0x7fd2b806c120 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60556/0 (socket says 172.21.15.82:60556) 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 -- 172.21.15.82:0/1210578215 learned_addr learned my addr 172.21.15.82:0/1210578215 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2b7fff640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b806c120 0x7fd2b814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bd5b6640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2b81602b0 0x7fd2b8154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 -- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b806c120 msgr2=0x7fd2b814ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b806c120 0x7fd2b814ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 -- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2b81602b0 msgr2=0x7fd2b8154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2b81602b0 0x7fd2b8154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 -- 172.21.15.82:0/1210578215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b0009b30 con 0x7fd2b806ab10 2023-07-20T10:05:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bcdb5640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c500 tx=0x7fd2ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac005220 con 0x7fd2b806ab10 2023-07-20T10:05:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac005380 con 0x7fd2b806ab10 2023-07-20T10:05:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b81502d0 con 0x7fd2b806ab10 2023-07-20T10:05:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac007270 con 0x7fd2b806ab10 2023-07-20T10:05:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b8150890 con 0x7fd2b806ab10 2023-07-20T10:05:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.735+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b8150ab0 con 0x7fd2b806ab10 2023-07-20T10:05:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.739+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd2ac0073d0 con 0x7fd2b806ab10 2023-07-20T10:05:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.739+0000 7fd2b57fa640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 0x7fd29c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.739+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd2ac0838f0 con 0x7fd2b806ab10 2023-07-20T10:05:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.739+0000 7fd2b7fff640 1 -- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 msgr2=0x7fd29c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:04.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.739+0000 7fd2b7fff640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 0x7fd29c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:04.728 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:04.749+0000 7f2287f65180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:04.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.747+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2ac050b10 con 0x7fd2b806ab10 2023-07-20T10:05:04.764 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:04.783+0000 7fc0ce7fd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:04.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.895+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2b804da30 con 0x7fd2b806ab10 2023-07-20T10:05:04.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.895+0000 7fd2b57fa640 1 -- 172.21.15.82:0/1210578215 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2ac054130 con 0x7fd2b806ab10 2023-07-20T10:05:04.879 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:04.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 msgr2=0x7fd29c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:04.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 0x7fd29c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 msgr2=0x7fd2b80c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:04.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00c500 tx=0x7fd2ac00c9c0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 shutdown_connections 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fd29c0663a0 0x7fd29c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2b81602b0 0x7fd2b8154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2b806c120 0x7fd2b814ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 --2- 172.21.15.82:0/1210578215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2b806ab10 0x7fd2b80c6180 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 >> 172.21.15.82:0/1210578215 conn(0x7fd2b808c0a0 msgr2=0x7fd2b815f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:04.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 shutdown_connections 2023-07-20T10:05:04.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:04.899+0000 7fd2bf019640 1 -- 172.21.15.82:0/1210578215 wait complete. 2023-07-20T10:05:04.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.103+0000 7f4be1da2640 1 Processor -- start 2023-07-20T10:05:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.103+0000 7f4be1da2640 1 -- start start 2023-07-20T10:05:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be1da2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be1da2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be1da2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc15ff50 con 0x7f4bdc0b44d0 2023-07-20T10:05:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be1da2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc0b4960 con 0x7f4bdc15fb70 2023-07-20T10:05:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be1da2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc0d0f90 con 0x7f4bdc0d0970 2023-07-20T10:05:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60566/0 (socket says 172.21.15.82:60566) 2023-07-20T10:05:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 -- 172.21.15.82:0/3848414173 learned_addr learned my addr 172.21.15.82:0/3848414173 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be15a1640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 -- 172.21.15.82:0/3848414173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 msgr2=0x7f4bdc0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 -- 172.21.15.82:0/3848414173 >> v1:172.21.15.183:6789/0 conn(0x7f4bdc0b44d0 legacy=0x7f4bdc0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.107+0000 7f4be0da0640 1 -- 172.21.15.82:0/3848414173 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0cd190 con 0x7f4bdc15fb70 2023-07-20T10:05:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be0da0640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496bff8bfcfdd461 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4bdb7fe640 1 -- 172.21.15.82:0/3848414173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00ac640 con 0x7f4bdc15fb70 2023-07-20T10:05:05.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4bdb7fe640 1 -- 172.21.15.82:0/3848414173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00ac7a0 con 0x7f4bdc15fb70 2023-07-20T10:05:05.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4bdb7fe640 1 -- 172.21.15.82:0/3848414173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00acb30 con 0x7f4bdc15fb70 2023-07-20T10:05:05.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- 172.21.15.82:0/3848414173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 msgr2=0x7f4bdc0b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009870 tx=0x7f4bd001c420 comp rx=0 tx=0).stop 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- 172.21.15.82:0/3848414173 shutdown_connections 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3848414173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc0b3f90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- 172.21.15.82:0/3848414173 >> 172.21.15.82:0/3848414173 conn(0x7f4bdc065710 msgr2=0x7f4bdc065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- 172.21.15.82:0/3848414173 shutdown_connections 2023-07-20T10:05:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- 172.21.15.82:0/3848414173 wait complete. 2023-07-20T10:05:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 Processor -- start 2023-07-20T10:05:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.111+0000 7f4be1da2640 1 -- start start 2023-07-20T10:05:05.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bdc0b44d0 0x7f4bdc15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc156c80 con 0x7f4bdc15fb70 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc14e890 con 0x7f4bdc0b44d0 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc14eb70 con 0x7f4bdc0d0970 2023-07-20T10:05:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60580/0 (socket says 172.21.15.82:60580) 2023-07-20T10:05:05.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 -- 172.21.15.82:0/3855844496 learned_addr learned my addr 172.21.15.82:0/3855844496 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:05.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4bdbfff640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be0da0640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bdc0b44d0 0x7f4bdc15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 -- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 msgr2=0x7f4bdc15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 -- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bdc0b44d0 msgr2=0x7f4bdc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bdc0b44d0 0x7f4bdc15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 -- 172.21.15.82:0/3855844496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00094d0 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be15a1640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400efc0 tx=0x7f4bd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4014480 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd400f040 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc156ef0 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4014820 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc15de10 con 0x7f4bdc15fb70 2023-07-20T10:05:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc15e090 con 0x7f4bdc15fb70 2023-07-20T10:05:05.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.115+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f4bd4014980 con 0x7f4bdc15fb70 2023-07-20T10:05:05.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.119+0000 7f4bd97fa640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 0x7f4bc0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.119+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f4bd4084c00 con 0x7f4bdc15fb70 2023-07-20T10:05:05.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.119+0000 7f4be0da0640 1 -- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 msgr2=0x7f4bc0068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:05.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.119+0000 7f4be0da0640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 0x7f4bc0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.123+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bd4051d00 con 0x7f4bdc15fb70 2023-07-20T10:05:05.211 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.233+0000 7f2287f65180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:05.261 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.279+0000 7fc0ce7fd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.279+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4bdc04da30 con 0x7f4bdc15fb70 2023-07-20T10:05:05.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.279+0000 7f4bd97fa640 1 -- 172.21.15.82:0/3855844496 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4bd40180a0 con 0x7f4bdc15fb70 2023-07-20T10:05:05.262 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 msgr2=0x7f4bc0068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 0x7f4bc0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 msgr2=0x7f4bdc157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400efc0 tx=0x7f4bd400c490 comp rx=0 tx=0).stop 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 shutdown_connections 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f4bc00663a0 0x7f4bc0068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bdc15fb70 0x7f4bdc157410 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bdc0d0970 0x7f4bdc15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 --2- 172.21.15.82:0/3855844496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bdc0b44d0 0x7f4bdc15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 >> 172.21.15.82:0/3855844496 conn(0x7f4bdc065710 msgr2=0x7f4bdc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 shutdown_connections 2023-07-20T10:05:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.283+0000 7f4be1da2640 1 -- 172.21.15.82:0/3855844496 wait complete. 2023-07-20T10:05:05.269 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.289+0000 7f2287f65180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:05.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:05:05.323 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.339+0000 7fc0ce7fd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:05.325 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.345+0000 7f2287f65180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:05.380 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.399+0000 7fc0ce7fd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:05.410 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.429+0000 7f2287f65180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.443+0000 7f7157ebd640 1 Processor -- start 2023-07-20T10:05:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 -- start start 2023-07-20T10:05:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71501602b0 0x7f7150160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f715006ab10 0x7f715006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500ce4f0 con 0x7f715006c120 2023-07-20T10:05:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71500d0970 con 0x7f71501602b0 2023-07-20T10:05:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7157ebd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7150160e20 con 0x7f715006ab10 2023-07-20T10:05:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71501602b0 0x7f7150160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f71501602b0 0x7f7150160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60592/0 (socket says 172.21.15.82:60592) 2023-07-20T10:05:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 -- 172.21.15.82:0/299301436 learned_addr learned my addr 172.21.15.82:0/299301436 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f715645a640 1 --2- 172.21.15.82:0/299301436 >> v2:172.21.15.183:3300/0 conn(0x7f715006ab10 0x7f715006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 -- 172.21.15.82:0/299301436 >> v2:172.21.15.183:3300/0 conn(0x7f715006ab10 msgr2=0x7f715006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 --2- 172.21.15.82:0/299301436 >> v2:172.21.15.183:3300/0 conn(0x7f715006ab10 0x7f715006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 -- 172.21.15.82:0/299301436 >> v1:172.21.15.183:6789/0 conn(0x7f715006c120 legacy=0x7f71500cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.447+0000 7f7155458640 1 -- 172.21.15.82:0/299301436 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500cd300 con 0x7f71501602b0 2023-07-20T10:05:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7155458640 1 --2- 172.21.15.82:0/299301436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71501602b0 0x7f7150160740 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f715008ceb0 tx=0x7f714001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85ec28dc92e1d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7154c57640 1 -- 172.21.15.82:0/299301436 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab640 con 0x7f71501602b0 2023-07-20T10:05:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7154c57640 1 -- 172.21.15.82:0/299301436 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400a7070 con 0x7f71501602b0 2023-07-20T10:05:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7154c57640 1 -- 172.21.15.82:0/299301436 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab9c0 con 0x7f71501602b0 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 -- 172.21.15.82:0/299301436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71501602b0 msgr2=0x7f7150160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 --2- 172.21.15.82:0/299301436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71501602b0 0x7f7150160740 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f715008ceb0 tx=0x7f714001c440 comp rx=0 tx=0).stop 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 -- 172.21.15.82:0/299301436 shutdown_connections 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 --2- 172.21.15.82:0/299301436 >> v2:172.21.15.183:3300/0 conn(0x7f715006ab10 0x7f715006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 --2- 172.21.15.82:0/299301436 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71501602b0 0x7f7150160740 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 -- 172.21.15.82:0/299301436 >> 172.21.15.82:0/299301436 conn(0x7f715008c0a0 msgr2=0x7f715009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 -- 172.21.15.82:0/299301436 shutdown_connections 2023-07-20T10:05:05.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.451+0000 7f7157ebd640 1 -- 172.21.15.82:0/299301436 wait complete. 2023-07-20T10:05:05.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 Processor -- start 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- start start 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f715006ab10 0x7f715014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71501602b0 0x7f715014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150158380 con 0x7f715006c120 2023-07-20T10:05:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71501591e0 con 0x7f71501602b0 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715014c3d0 con 0x7f715006ab10 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60608/0 (socket says 172.21.15.82:60608) 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 -- 172.21.15.82:0/2489678572 learned_addr learned my addr 172.21.15.82:0/2489678572 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f715645a640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71501602b0 0x7f715014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155c59640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f715006ab10 0x7f715014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 -- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f715006ab10 msgr2=0x7f715014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f715006ab10 0x7f715014eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 -- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71501602b0 msgr2=0x7f715014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71501602b0 0x7f715014be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 -- 172.21.15.82:0/2489678572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400094d0 con 0x7f715006c120 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7155458640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f71400ad040 tx=0x7f71400191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400abe80 con 0x7f715006c120 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400bf410 con 0x7f715006c120 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400bf7c0 con 0x7f715006c120 2023-07-20T10:05:05.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71501585d0 con 0x7f715006c120 2023-07-20T10:05:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7150158b90 con 0x7f715006c120 2023-07-20T10:05:05.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.455+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500d17e0 con 0x7f715006c120 2023-07-20T10:05:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.459+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f71400b5400 con 0x7f715006c120 2023-07-20T10:05:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.459+0000 7f71467fc640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 0x7f7134068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.459+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f714011e7f0 con 0x7f715006c120 2023-07-20T10:05:05.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.459+0000 7f7155c59640 1 -- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 msgr2=0x7f7134068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:05.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.459+0000 7f7155c59640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 0x7f7134068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:05.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.463+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71400eb970 con 0x7f715006c120 2023-07-20T10:05:05.469 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.489+0000 7f2287f65180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:05.472 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.491+0000 7fc0ce7fd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:05.530 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.547+0000 7fc0ce7fd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:05.553 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.573+0000 7f2287f65180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.611+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f715004da30 con 0x7f715006c120 2023-07-20T10:05:05.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.611+0000 7f71467fc640 1 -- 172.21.15.82:0/2489678572 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71400eef90 con 0x7f715006c120 2023-07-20T10:05:05.594 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:05:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 msgr2=0x7f7134068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:05.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 0x7f7134068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 msgr2=0x7f7150156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f71400ad040 tx=0x7f71400191e0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 shutdown_connections 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f71340663a0 0x7f7134068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71501602b0 0x7f715014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f715006c120 0x7f7150156990 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 --2- 172.21.15.82:0/2489678572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f715006ab10 0x7f715014eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 >> 172.21.15.82:0/2489678572 conn(0x7f715008c0a0 msgr2=0x7f715009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 shutdown_connections 2023-07-20T10:05:05.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.615+0000 7f7157ebd640 1 -- 172.21.15.82:0/2489678572 wait complete. 2023-07-20T10:05:05.609 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.629+0000 7f2287f65180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:05.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:05:05.617 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.635+0000 7fc0ce7fd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:05.677 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.695+0000 7fc0ce7fd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:05.751 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.773+0000 7f2287f65180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 Processor -- start 2023-07-20T10:05:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 -- start start 2023-07-20T10:05:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf4c1602b0 0x7fcf4c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcf4c06ab10 0x7fcf4c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c0ce4f0 con 0x7fcf4c06c120 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0d0970 con 0x7fcf4c1602b0 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf53933640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c160e20 con 0x7fcf4c06ab10 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf50ece640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf4c1602b0 0x7fcf4c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf516cf640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf4c06c120 0x7fcf4c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38326/0 (socket says 172.21.15.82:38326) 2023-07-20T10:05:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf516cf640 1 -- 172.21.15.82:0/1838545144 learned_addr learned my addr 172.21.15.82:0/1838545144 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf51ed0640 1 --2- 172.21.15.82:0/1838545144 >> v2:172.21.15.183:3300/0 conn(0x7fcf4c06ab10 0x7fcf4c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf50ece640 1 -- 172.21.15.82:0/1838545144 >> v2:172.21.15.183:3300/0 conn(0x7fcf4c06ab10 msgr2=0x7fcf4c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf50ece640 1 --2- 172.21.15.82:0/1838545144 >> v2:172.21.15.183:3300/0 conn(0x7fcf4c06ab10 0x7fcf4c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.779+0000 7fcf50ece640 1 -- 172.21.15.82:0/1838545144 >> v1:172.21.15.82:6789/0 conn(0x7fcf4c06c120 legacy=0x7fcf4c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf50ece640 1 -- 172.21.15.82:0/1838545144 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0cd300 con 0x7fcf4c1602b0 2023-07-20T10:05:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf50ece640 1 --2- 172.21.15.82:0/1838545144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c160740 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c08ceb0 tx=0x7fcf3c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c430d9b9b58c35da server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf43fff640 1 -- 172.21.15.82:0/1838545144 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0ac600 con 0x7fcf4c1602b0 2023-07-20T10:05:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf43fff640 1 -- 172.21.15.82:0/1838545144 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0a8050 con 0x7fcf4c1602b0 2023-07-20T10:05:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf43fff640 1 -- 172.21.15.82:0/1838545144 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0ac980 con 0x7fcf4c1602b0 2023-07-20T10:05:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf53933640 1 -- 172.21.15.82:0/1838545144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c1602b0 msgr2=0x7fcf4c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.783+0000 7fcf53933640 1 --2- 172.21.15.82:0/1838545144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c160740 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c08ceb0 tx=0x7fcf3c01c3a0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- 172.21.15.82:0/1838545144 shutdown_connections 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 --2- 172.21.15.82:0/1838545144 >> v2:172.21.15.183:3300/0 conn(0x7fcf4c06ab10 0x7fcf4c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 --2- 172.21.15.82:0/1838545144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c160740 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- 172.21.15.82:0/1838545144 >> 172.21.15.82:0/1838545144 conn(0x7fcf4c08c0a0 msgr2=0x7fcf4c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- 172.21.15.82:0/1838545144 shutdown_connections 2023-07-20T10:05:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- 172.21.15.82:0/1838545144 wait complete. 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 Processor -- start 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- start start 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf4c06ab10 0x7fcf4c0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0c9040 con 0x7fcf4c06c120 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c1598e0 con 0x7fcf4c1602b0 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf53933640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c159bc0 con 0x7fcf4c06ab10 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60620/0 (socket says 172.21.15.82:60620) 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 -- 172.21.15.82:0/695267701 learned_addr learned my addr 172.21.15.82:0/695267701 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf516cf640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf4c06ab10 0x7fcf4c0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf51ed0640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 -- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf4c06ab10 msgr2=0x7fcf4c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf4c06ab10 0x7fcf4c0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 -- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf4c1602b0 msgr2=0x7fcf4c1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.787+0000 7fcf50ece640 1 -- 172.21.15.82:0/695267701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c009420 con 0x7fcf4c06c120 2023-07-20T10:05:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf50ece640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c018fb0 tx=0x7fcf3c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0b5400 con 0x7fcf4c06c120 2023-07-20T10:05:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0b5560 con 0x7fcf4c06c120 2023-07-20T10:05:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0b58d0 con 0x7fcf4c06c120 2023-07-20T10:05:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c159ea0 con 0x7fcf4c06c120 2023-07-20T10:05:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c0c7090 con 0x7fcf4c06c120 2023-07-20T10:05:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c15a3c0 con 0x7fcf4c06c120 2023-07-20T10:05:05.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.791+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fcf3c0b3040 con 0x7fcf4c06c120 2023-07-20T10:05:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.795+0000 7fcf41ffb640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 0x7fcf30068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.795+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcf3c11df90 con 0x7fcf4c06c120 2023-07-20T10:05:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.795+0000 7fcf516cf640 1 -- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 msgr2=0x7fcf30068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.795+0000 7fcf516cf640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 0x7fcf30068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:05.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.799+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf3c14e700 con 0x7fcf4c06c120 2023-07-20T10:05:05.811 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:05.833+0000 7f2287f65180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:05.826 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.843+0000 7fc0ce7fd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:05.886 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:05.903+0000 7fc0ce7fd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.947+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf4c0c7310 con 0x7fcf4c06c120 2023-07-20T10:05:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.947+0000 7fcf41ffb640 1 -- 172.21.15.82:0/695267701 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf3c0eb1a0 con 0x7fcf4c06c120 2023-07-20T10:05:05.931 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:05:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 msgr2=0x7fcf30068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 0x7fcf30068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 msgr2=0x7fcf4c1543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:05.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c018fb0 tx=0x7fcf3c019140 comp rx=0 tx=0).stop 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 shutdown_connections 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fcf300663a0 0x7fcf30068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf4c1602b0 0x7fcf4c1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf4c06c120 0x7fcf4c1543b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 --2- 172.21.15.82:0/695267701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf4c06ab10 0x7fcf4c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:05.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 >> 172.21.15.82:0/695267701 conn(0x7fcf4c08c0a0 msgr2=0x7fcf4c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 shutdown_connections 2023-07-20T10:05:05.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:05.951+0000 7fcf53933640 1 -- 172.21.15.82:0/695267701 wait complete. 2023-07-20T10:05:05.953 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:05:06.054 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:06.054 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:06.055 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:06.062 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:06.085+0000 7f2287f65180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.151+0000 7f11557ba640 1 Processor -- start 2023-07-20T10:05:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.151+0000 7f11557ba640 1 -- start start 2023-07-20T10:05:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f11557ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f11557ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f11500cd4b0 0x7f11500cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f11557ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11500d16b0 con 0x7f115015cab0 2023-07-20T10:05:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f11557ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11500d31c0 con 0x7f11500cd4b0 2023-07-20T10:05:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f11557ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500b3520 con 0x7f11500d0d10 2023-07-20T10:05:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f114f7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f11500cd4b0 0x7f11500cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:47172/0 (socket says 172.21.15.82:47172) 2023-07-20T10:05:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 -- 172.21.15.82:0/1290513896 learned_addr learned my addr 172.21.15.82:0/1290513896 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f114effd640 1 --1- 172.21.15.82:0/1290513896 >> v1:172.21.15.183:6789/0 conn(0x7f115015cab0 0x7f11500d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:44384/0 (socket says 172.21.15.82:44384) 2023-07-20T10:05:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 -- 172.21.15.82:0/1290513896 >> v2:172.21.15.183:3300/0 conn(0x7f11500cd4b0 msgr2=0x7f11500cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 --2- 172.21.15.82:0/1290513896 >> v2:172.21.15.183:3300/0 conn(0x7f11500cd4b0 0x7f11500cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 -- 172.21.15.82:0/1290513896 >> v1:172.21.15.183:6789/0 conn(0x7f115015cab0 legacy=0x7f11500d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.155+0000 7f1147fff640 1 -- 172.21.15.82:0/1290513896 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500d0a10 con 0x7f11500d0d10 2023-07-20T10:05:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f1147fff640 1 --2- 172.21.15.82:0/1290513896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1138009870 tx=0x7f113801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3feca0a890d2011 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f114e7fc640 1 -- 172.21.15.82:0/1290513896 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380aa670 con 0x7f11500d0d10 2023-07-20T10:05:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f114e7fc640 1 -- 172.21.15.82:0/1290513896 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380aa7d0 con 0x7f11500d0d10 2023-07-20T10:05:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f114e7fc640 1 -- 172.21.15.82:0/1290513896 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380aab60 con 0x7f11500d0d10 2023-07-20T10:05:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- 172.21.15.82:0/1290513896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 msgr2=0x7f11500d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 --2- 172.21.15.82:0/1290513896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1138009870 tx=0x7f113801c510 comp rx=0 tx=0).stop 2023-07-20T10:05:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- 172.21.15.82:0/1290513896 shutdown_connections 2023-07-20T10:05:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 --2- 172.21.15.82:0/1290513896 >> v2:172.21.15.183:3300/0 conn(0x7f11500cd4b0 0x7f11500cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 --2- 172.21.15.82:0/1290513896 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11500d0d10 0x7f11500d1170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- 172.21.15.82:0/1290513896 >> 172.21.15.82:0/1290513896 conn(0x7f115008c120 msgr2=0x7f115009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- 172.21.15.82:0/1290513896 shutdown_connections 2023-07-20T10:05:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- 172.21.15.82:0/1290513896 wait complete. 2023-07-20T10:05:06.142 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:06.142 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:06.143 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 Processor -- start 2023-07-20T10:05:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.159+0000 7f11557ba640 1 -- start start 2023-07-20T10:05:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11500d0d10 0x7f11500b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f115015cab0 0x7f11500b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150158f60 con 0x7f11500cd4b0 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150159ae0 con 0x7f11500d0d10 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11501591b0 con 0x7f115015cab0 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60632/0 (socket says 172.21.15.82:60632) 2023-07-20T10:05:06.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 -- 172.21.15.82:0/1751589484 learned_addr learned my addr 172.21.15.82:0/1751589484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f1147fff640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11500d0d10 0x7f11500b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114f7fe640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f115015cab0 0x7f11500b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 -- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f115015cab0 msgr2=0x7f11500b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f115015cab0 0x7f11500b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 -- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11500d0d10 msgr2=0x7f11500b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11500d0d10 0x7f11500b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 -- 172.21.15.82:0/1751589484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380094d0 con 0x7f11500cd4b0 2023-07-20T10:05:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f114effd640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f114000c460 tx=0x7f114000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140007480 con 0x7f11500cd4b0 2023-07-20T10:05:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11400075e0 con 0x7f11500cd4b0 2023-07-20T10:05:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1150159490 con 0x7f11500cd4b0 2023-07-20T10:05:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140004a10 con 0x7f11500cd4b0 2023-07-20T10:05:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11501549c0 con 0x7f11500cd4b0 2023-07-20T10:05:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1150073c70 con 0x7f11500cd4b0 2023-07-20T10:05:06.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.163+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f1140004b70 con 0x7f11500cd4b0 2023-07-20T10:05:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.167+0000 7f11477fe640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 0x7f1130068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.167+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f1140083370 con 0x7f11500cd4b0 2023-07-20T10:05:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.167+0000 7f1147fff640 1 -- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 msgr2=0x7f1130068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:06.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.167+0000 7f1147fff640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 0x7f1130068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:06.153 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:06.171+0000 7fc0ce7fd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:06.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.171+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1140050610 con 0x7f11500cd4b0 2023-07-20T10:05:06.199 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:06.221+0000 7f2287f65180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:06.288 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:06.307+0000 7fc0ce7fd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:06.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f115006be00 con 0x7f11500cd4b0 2023-07-20T10:05:06.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11477fe640 1 -- 172.21.15.82:0/1751589484 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v67) v1 ==== 80+0+470 (secure 0 0 0) 0x7f1140053c30 con 0x7f11500cd4b0 2023-07-20T10:05:06.317 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1462509814 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3057720573 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1651242703 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2140941636 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3208760881 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4160992300 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/3713806871 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.318 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/3713806871 2023-07-21T10:03:18.691909+0000 2023-07-20T10:05:06.319 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T10:05:06.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 msgr2=0x7f1130068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 0x7f1130068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 msgr2=0x7f1150152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f114000c460 tx=0x7f114000c920 comp rx=0 tx=0).stop 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 shutdown_connections 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f11300663d0 0x7f1130068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f115015cab0 0x7f11500b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11500d0d10 0x7f11500b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 --2- 172.21.15.82:0/1751589484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11500cd4b0 0x7f1150152f60 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.335+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 >> 172.21.15.82:0/1751589484 conn(0x7f115008c120 msgr2=0x7f11500af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:06.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.339+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 shutdown_connections 2023-07-20T10:05:06.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.339+0000 7f11557ba640 1 -- 172.21.15.82:0/1751589484 wait complete. 2023-07-20T10:05:06.323 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:06.345+0000 7f2287f65180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:06.339 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:05:06.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:06.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:06.394 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:06.417+0000 7f2287f65180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:06.404 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:05:06.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:06.404 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:05:06.414 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:06.415 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:06.419 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:06.439+0000 7fc0ce7fd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:06.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:06.426 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:06.427 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:06.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:06.436 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:06.436 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:06.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:06.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:06.490 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:06.507+0000 7fc0ce7fd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:06.529 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:06.549+0000 7f2287f65180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:06.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.635+0000 7effedb2c640 1 Processor -- start 2023-07-20T10:05:06.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.635+0000 7effedb2c640 1 -- start start 2023-07-20T10:05:06.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effedb2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effe80d0d10 0x7effe80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effedb2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80cd4b0 0x7effe80cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effedb2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe80d16b0 con 0x7effe815cab0 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effedb2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe80d31c0 con 0x7effe80d0d10 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effedb2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe80b3520 con 0x7effe80cd4b0 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7effe80d0d10 0x7effe80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7effe815cab0 0x7effe80d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38340/0 (socket says 172.21.15.82:38340) 2023-07-20T10:05:06.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe77fe640 1 -- 172.21.15.82:0/765465761 learned_addr learned my addr 172.21.15.82:0/765465761 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe7fff640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80cd4b0 0x7effe80cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe6ffd640 1 -- 172.21.15.82:0/765465761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80cd4b0 msgr2=0x7effe80cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe6ffd640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80cd4b0 0x7effe80cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe6ffd640 1 -- 172.21.15.82:0/765465761 >> v1:172.21.15.82:6789/0 conn(0x7effe815cab0 legacy=0x7effe80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.639+0000 7effe6ffd640 1 -- 172.21.15.82:0/765465761 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80d0a10 con 0x7effe80d0d10 2023-07-20T10:05:06.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effe6ffd640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe80d0d10 0x7effe80d1170 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7effdc0097c0 tx=0x7effdc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa85d687e77b6e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:06.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effe67fc640 1 -- 172.21.15.82:0/765465761 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0ab650 con 0x7effe80d0d10 2023-07-20T10:05:06.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effe67fc640 1 -- 172.21.15.82:0/765465761 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc0ab7b0 con 0x7effe80d0d10 2023-07-20T10:05:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effe67fc640 1 -- 172.21.15.82:0/765465761 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0abb40 con 0x7effe80d0d10 2023-07-20T10:05:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- 172.21.15.82:0/765465761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe80d0d10 msgr2=0x7effe80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe80d0d10 0x7effe80d1170 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7effdc0097c0 tx=0x7effdc01c450 comp rx=0 tx=0).stop 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- 172.21.15.82:0/765465761 shutdown_connections 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80cd4b0 0x7effe80cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 --2- 172.21.15.82:0/765465761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe80d0d10 0x7effe80d1170 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- 172.21.15.82:0/765465761 >> 172.21.15.82:0/765465761 conn(0x7effe808c120 msgr2=0x7effe809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- 172.21.15.82:0/765465761 shutdown_connections 2023-07-20T10:05:06.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- 172.21.15.82:0/765465761 wait complete. 2023-07-20T10:05:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 Processor -- start 2023-07-20T10:05:06.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.643+0000 7effedb2c640 1 -- start start 2023-07-20T10:05:06.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effe80cd4b0 0x7effe80c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 0x7effe814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 0x7effe814be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe815a1c0 con 0x7effe815cab0 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe815a4a0 con 0x7effe80cd4b0 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe815a780 con 0x7effe80d0d10 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 0x7effe814be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 0x7effe814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 0x7effe814be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60648/0 (socket says 172.21.15.82:60648) 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe7fff640 1 -- 172.21.15.82:0/840088709 learned_addr learned my addr 172.21.15.82:0/840088709 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe77fe640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effe80cd4b0 0x7effe80c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 -- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effe80cd4b0 msgr2=0x7effe80c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effe80cd4b0 0x7effe80c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 -- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 msgr2=0x7effe814be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 0x7effe814be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 -- 172.21.15.82:0/840088709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009420 con 0x7effe80d0d10 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effe6ffd640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 0x7effe814b940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effdc0ac000 tx=0x7effdc01ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0b5600 con 0x7effe80d0d10 2023-07-20T10:05:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc0b5760 con 0x7effe80d0d10 2023-07-20T10:05:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe815aa60 con 0x7effe80d0d10 2023-07-20T10:05:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0b5af0 con 0x7effe80d0d10 2023-07-20T10:05:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe80c8e70 con 0x7effe80d0d10 2023-07-20T10:05:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.647+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe8073c70 con 0x7effe80d0d10 2023-07-20T10:05:06.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.651+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7effe80ce690 con 0x7effe80d0d10 2023-07-20T10:05:06.633 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:06.651+0000 7fc0ce7fd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.651+0000 7effcffff640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 0x7effd4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:06.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.651+0000 7effe77fe640 1 -- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 msgr2=0x7effd4068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.651+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6464+0+0 (secure 0 0 0) 0x7effdc11e770 con 0x7effe80d0d10 2023-07-20T10:05:06.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.651+0000 7effe77fe640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 0x7effd4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:06.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.655+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effdc0eba00 con 0x7effe80d0d10 2023-07-20T10:05:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effe815af10 con 0x7effe80d0d10 2023-07-20T10:05:06.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effcffff640 1 -- 172.21.15.82:0/840088709 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7effdc0ef020 con 0x7effe80d0d10 2023-07-20T10:05:06.817 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:06.817 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:05:06.817 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:05:06.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 msgr2=0x7effd4068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 0x7effd4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 msgr2=0x7effe814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 0x7effe814b940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7effdc0ac000 tx=0x7effdc01ac90 comp rx=0 tx=0).stop 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 shutdown_connections 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7effd40663a0 0x7effd4068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7effe815cab0 0x7effe814be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7effe80d0d10 0x7effe814b940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 --2- 172.21.15.82:0/840088709 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7effe80cd4b0 0x7effe80c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:06.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 >> 172.21.15.82:0/840088709 conn(0x7effe808c120 msgr2=0x7effe80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:06.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 shutdown_connections 2023-07-20T10:05:06.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:06.835+0000 7effedb2c640 1 -- 172.21.15.82:0/840088709 wait complete. 2023-07-20T10:05:06.838 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 Processor -- start 2023-07-20T10:05:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 -- start start 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f54cc15cab0 0x7f54cc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0d0d10 0x7f54cc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54cc0cf110 0x7f54cc0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0d31c0 con 0x7f54cc0cf110 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc0d16b0 con 0x7f54cc15cab0 2023-07-20T10:05:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d2382640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0b3520 con 0x7f54cc0d0d10 2023-07-20T10:05:07.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54cc0cf110 0x7f54cc0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54cc0cf110 0x7f54cc0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60656/0 (socket says 172.21.15.82:60656) 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 -- 172.21.15.82:0/3479689102 learned_addr learned my addr 172.21.15.82:0/3479689102 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54cbfff640 1 --2- 172.21.15.82:0/3479689102 >> v2:172.21.15.183:3300/0 conn(0x7f54cc15cab0 0x7f54cc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54cb7fe640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0d0d10 0x7f54cc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 -- 172.21.15.82:0/3479689102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0d0d10 msgr2=0x7f54cc0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0d0d10 0x7f54cc0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 -- 172.21.15.82:0/3479689102 >> v2:172.21.15.183:3300/0 conn(0x7f54cc15cab0 msgr2=0x7f54cc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 --2- 172.21.15.82:0/3479689102 >> v2:172.21.15.183:3300/0 conn(0x7f54cc15cab0 0x7f54cc0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.043+0000 7f54d091f640 1 -- 172.21.15.82:0/3479689102 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0b2910 con 0x7f54cc0cf110 2023-07-20T10:05:07.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d091f640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc0cf110 0x7f54cc0cf5a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f54cc06a660 tx=0x7f54c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29161396ac685a72 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54caffd640 1 -- 172.21.15.82:0/3479689102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40a5820 con 0x7f54cc0cf110 2023-07-20T10:05:07.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54caffd640 1 -- 172.21.15.82:0/3479689102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c40a5980 con 0x7f54cc0cf110 2023-07-20T10:05:07.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54caffd640 1 -- 172.21.15.82:0/3479689102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40a5d10 con 0x7f54cc0cf110 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 -- 172.21.15.82:0/3479689102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc0cf110 msgr2=0x7f54cc0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc0cf110 0x7f54cc0cf5a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f54cc06a660 tx=0x7f54c401c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 -- 172.21.15.82:0/3479689102 shutdown_connections 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc0cf110 0x7f54cc0cf5a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 --2- 172.21.15.82:0/3479689102 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0d0d10 0x7f54cc0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 --2- 172.21.15.82:0/3479689102 >> v2:172.21.15.183:3300/0 conn(0x7f54cc15cab0 0x7f54cc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 -- 172.21.15.82:0/3479689102 >> 172.21.15.82:0/3479689102 conn(0x7f54cc08c120 msgr2=0x7f54cc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 -- 172.21.15.82:0/3479689102 shutdown_connections 2023-07-20T10:05:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.047+0000 7f54d2382640 1 -- 172.21.15.82:0/3479689102 wait complete. 2023-07-20T10:05:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 Processor -- start 2023-07-20T10:05:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- start start 2023-07-20T10:05:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54cc0d0d10 0x7f54cc1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 0x7f54cc155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0ca540 con 0x7f54cc15cab0 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc06c510 con 0x7f54cc0d0d10 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc0c9930 con 0x7f54cc0cf110 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d091f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 0x7f54cc155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:47224/0 (socket says 172.21.15.82:47224) 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d091f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 0x7f54cc155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60668/0 (socket says 172.21.15.82:60668) 2023-07-20T10:05:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 -- 172.21.15.82:0/2169845970 learned_addr learned my addr 172.21.15.82:0/2169845970 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:07.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cb7fe640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54cc0d0d10 0x7f54cc1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 -- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54cc0d0d10 msgr2=0x7f54cc1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54cc0d0d10 0x7f54cc1557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 -- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 msgr2=0x7f54cc155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 0x7f54cc155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 -- 172.21.15.82:0/2169845970 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4009b30 con 0x7f54cc0cf110 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54cbfff640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e870 tx=0x7f54bc00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc009510 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54bc00eec0 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc00cb40 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc0c9c10 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.051+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc0ca1d0 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc073c70 con 0x7f54cc0cf110 2023-07-20T10:05:07.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f54bc00cca0 con 0x7f54cc0cf110 2023-07-20T10:05:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54c8ff9640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 0x7f54b8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54cb7fe640 1 -- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 msgr2=0x7f54b8068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6552+0+0 (secure 0 0 0) 0x7f54bc084110 con 0x7f54cc0cf110 2023-07-20T10:05:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.055+0000 7f54cb7fe640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 0x7f54b8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.059+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54bc051330 con 0x7f54cc0cf110 2023-07-20T10:05:07.078 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.101+0000 7f2287f65180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:07.166 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.185+0000 7f2287f65180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:07.222 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.239+0000 7fc0ce7fd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:07.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.247+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54cc06b340 con 0x7f54cc0cf110 2023-07-20T10:05:07.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.247+0000 7f54c8ff9640 1 -- 172.21.15.82:0/2169845970 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+19020 (secure 0 0 0) 0x7f54bc054950 con 0x7f54cc0cf110 2023-07-20T10:05:07.232 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:07.232 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":68,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:07.022065+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":68,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.e","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1462509814":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3057720573":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1651242703":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/2140941636":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3208760881":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/4160992300":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6833/3713806871":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6832/3713806871":"2023-07-21T10:03:18.691909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:07.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 msgr2=0x7f54b8068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:07.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 0x7f54b8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 msgr2=0x7f54cc06bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00e870 tx=0x7f54bc00ec70 comp rx=0 tx=0).stop 2023-07-20T10:05:07.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 shutdown_connections 2023-07-20T10:05:07.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f54b80663a0 0x7f54b8068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54cc15cab0 0x7f54cc155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54cc0d0d10 0x7f54cc1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 --2- 172.21.15.82:0/2169845970 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54cc0cf110 0x7f54cc06bfd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 >> 172.21.15.82:0/2169845970 conn(0x7f54cc08c120 msgr2=0x7f54cc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 shutdown_connections 2023-07-20T10:05:07.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.251+0000 7f54d2382640 1 -- 172.21.15.82:0/2169845970 wait complete. 2023-07-20T10:05:07.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:02:59.146720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:03:00.452578+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 68, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:07.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:07.310 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.327+0000 7fc0ce7fd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:07.313 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.333+0000 7f2287f65180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:07.396 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.417+0000 7f2287f65180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:07.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 Processor -- start 2023-07-20T10:05:07.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 -- start start 2023-07-20T10:05:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f423406c120 0x7f42340cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f4234160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42340d0970 con 0x7f42341602b0 2023-07-20T10:05:07.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4234160e20 con 0x7f423406c120 2023-07-20T10:05:07.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423ba9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340cd300 con 0x7f423406b220 2023-07-20T10:05:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f423406c120 0x7f42340cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423a039640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f4234160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f423406c120 0x7f42340cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:46772/0 (socket says 172.21.15.82:46772) 2023-07-20T10:05:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 -- 172.21.15.82:0/2249960227 learned_addr learned my addr 172.21.15.82:0/2249960227 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239037640 1 --1- 172.21.15.82:0/2249960227 >> v1:172.21.15.183:6789/0 conn(0x7f42341602b0 0x7f423406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:44388/0 (socket says 172.21.15.82:44388) 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 -- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 msgr2=0x7f4234160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f4234160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 -- 172.21.15.82:0/2249960227 >> v1:172.21.15.183:6789/0 conn(0x7f42341602b0 legacy=0x7f423406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f4239838640 1 -- 172.21.15.82:0/2249960227 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340cd5e0 con 0x7f423406c120 2023-07-20T10:05:07.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.419+0000 7f423a039640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f4234160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:07.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f4239838640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340cdde0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4230009870 tx=0x7f423001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6de74f4922aab20 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f4238836640 1 -- 172.21.15.82:0/2249960227 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300a6040 con 0x7f423406c120 2023-07-20T10:05:07.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f4238836640 1 -- 172.21.15.82:0/2249960227 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300aa600 con 0x7f423406c120 2023-07-20T10:05:07.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f4238836640 1 -- 172.21.15.82:0/2249960227 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300aa990 con 0x7f423406c120 2023-07-20T10:05:07.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 -- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 msgr2=0x7f42340cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340cdde0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4230009870 tx=0x7f423001c480 comp rx=0 tx=0).stop 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 -- 172.21.15.82:0/2249960227 shutdown_connections 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f4234160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 --2- 172.21.15.82:0/2249960227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340cdde0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 -- 172.21.15.82:0/2249960227 >> 172.21.15.82:0/2249960227 conn(0x7f423408c0a0 msgr2=0x7f423409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 -- 172.21.15.82:0/2249960227 shutdown_connections 2023-07-20T10:05:07.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.423+0000 7f423ba9c640 1 -- 172.21.15.82:0/2249960227 wait complete. 2023-07-20T10:05:07.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 Processor -- start 2023-07-20T10:05:07.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- start start 2023-07-20T10:05:07.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f423414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c9950 con 0x7f42341602b0 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340c7da0 con 0x7f423406c120 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42340b7d20 con 0x7f423406b220 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60670/0 (socket says 172.21.15.82:60670) 2023-07-20T10:05:07.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 -- 172.21.15.82:0/3362116606 learned_addr learned my addr 172.21.15.82:0/3362116606 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f4239838640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f423414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f4239037640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 -- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 msgr2=0x7f423414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f423414dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 -- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 msgr2=0x7f42340c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 -- 172.21.15.82:0/3362116606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c009a70 con 0x7f42341602b0 2023-07-20T10:05:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423a039640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f422c00efc0 tx=0x7f422c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c009d70 con 0x7f42341602b0 2023-07-20T10:05:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00f040 con 0x7f42341602b0 2023-07-20T10:05:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42300094d0 con 0x7f42341602b0 2023-07-20T10:05:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0039a0 con 0x7f42341602b0 2023-07-20T10:05:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.427+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42340c7500 con 0x7f42341602b0 2023-07-20T10:05:07.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42340c9a90 con 0x7f42341602b0 2023-07-20T10:05:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f422c0144a0 con 0x7f42341602b0 2023-07-20T10:05:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f422a7fc640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 0x7f4218068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6552+0+0 (secure 0 0 0) 0x7f422c084cd0 con 0x7f42341602b0 2023-07-20T10:05:07.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f4239838640 1 -- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 msgr2=0x7f4218068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:07.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.431+0000 7f4239838640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 0x7f4218068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:07.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.435+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42340c9a90 con 0x7f42341602b0 2023-07-20T10:05:07.463 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.479+0000 7fc0ce7fd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:07.552 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.571+0000 7fc0ce7fd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:07.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42340c9a90 con 0x7f42341602b0 2023-07-20T10:05:07.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f422a7fc640 1 -- 172.21.15.82:0/3362116606 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42340c9a90 con 0x7f42341602b0 2023-07-20T10:05:07.573 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:07.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 msgr2=0x7f4218068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 0x7f4218068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 msgr2=0x7f42340b6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f422c00efc0 tx=0x7f422c009f90 comp rx=0 tx=0).stop 2023-07-20T10:05:07.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 shutdown_connections 2023-07-20T10:05:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7f42180663a0 0x7f4218068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42341602b0 0x7f42340b6270 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f423406c120 0x7f42340c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 --2- 172.21.15.82:0/3362116606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f423406b220 0x7f423414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 >> 172.21.15.82:0/3362116606 conn(0x7f423408c0a0 msgr2=0x7f42340b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 shutdown_connections 2023-07-20T10:05:07.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.591+0000 7f423ba9c640 1 -- 172.21.15.82:0/3362116606 wait complete. 2023-07-20T10:05:07.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:07.671 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.693+0000 7f2287f65180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:07.731 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:07.753+0000 7f2287f65180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:07.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.755+0000 7fdfe5626640 1 Processor -- start 2023-07-20T10:05:07.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.755+0000 7fdfe5626640 1 -- start start 2023-07-20T10:05:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 0x7fdfe00b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe5626640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe00b4930 con 0x7fdfe00d0970 2023-07-20T10:05:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe5626640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe015ff50 con 0x7fdfe00b44d0 2023-07-20T10:05:07.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00d0f90 con 0x7fdfe015fb70 2023-07-20T10:05:07.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe4e25640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfe00d0970 0x7fdfe00b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38344/0 (socket says 172.21.15.82:38344) 2023-07-20T10:05:07.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfe4e25640 1 -- 172.21.15.82:0/2106289904 learned_addr learned my addr 172.21.15.82:0/2106289904 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdffff640 1 --2- 172.21.15.82:0/2106289904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 0x7fdfe00b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859516000 0 0) 0x7fdfe00b4930 con 0x7fdfe00d0970 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc8003530 con 0x7fdfe00d0970 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079977374 0 0) 0x7fdfe015ff50 con 0x7fdfe00b44d0 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe00b4930 con 0x7fdfe00b44d0 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2423106780 0 0) 0x7fdfc8003530 con 0x7fdfe00d0970 2023-07-20T10:05:07.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdffff640 1 -- 172.21.15.82:0/2106289904 >> v1:172.21.15.183:6789/0 conn(0x7fdfe00b44d0 legacy=0x7fdfe00d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdffff640 1 -- 172.21.15.82:0/2106289904 >> v1:172.21.15.82:6789/0 conn(0x7fdfe00d0970 legacy=0x7fdfe00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.759+0000 7fdfdffff640 1 -- 172.21.15.82:0/2106289904 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe00cd190 con 0x7fdfe015fb70 2023-07-20T10:05:07.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfdffff640 1 --2- 172.21.15.82:0/2106289904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 0x7fdfe00b3f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097f0 tx=0x7fdfd001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fac98b79a0abfbe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8001a00 con 0x7fdfe015fb70 2023-07-20T10:05:07.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00a7050 con 0x7fdfe015fb70 2023-07-20T10:05:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfdeffd640 1 -- 172.21.15.82:0/2106289904 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00ab600 con 0x7fdfe015fb70 2023-07-20T10:05:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- 172.21.15.82:0/2106289904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 msgr2=0x7fdfe00b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2106289904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 0x7fdfe00b3f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097f0 tx=0x7fdfd001c2c0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- 172.21.15.82:0/2106289904 shutdown_connections 2023-07-20T10:05:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2106289904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe015fb70 0x7fdfe00b3f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- 172.21.15.82:0/2106289904 >> 172.21.15.82:0/2106289904 conn(0x7fdfe0065710 msgr2=0x7fdfe0065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- 172.21.15.82:0/2106289904 shutdown_connections 2023-07-20T10:05:07.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- 172.21.15.82:0/2106289904 wait complete. 2023-07-20T10:05:07.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 Processor -- start 2023-07-20T10:05:07.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.763+0000 7fdfe5626640 1 -- start start 2023-07-20T10:05:07.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 0x7fdfe0153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfe015fb70 0x7fdfe015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe015c140 con 0x7fdfe00d0970 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe015b830 con 0x7fdfe015fb70 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe015e070 con 0x7fdfe00b44d0 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60676/0 (socket says 172.21.15.82:60676) 2023-07-20T10:05:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 -- 172.21.15.82:0/2743815469 learned_addr learned my addr 172.21.15.82:0/2743815469 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe4e25640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfe015fb70 0x7fdfe015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdffff640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 0x7fdfe0153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 -- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 msgr2=0x7fdfe0153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 0x7fdfe0153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 -- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfe015fb70 msgr2=0x7fdfe015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfe015fb70 0x7fdfe015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 -- 172.21.15.82:0/2743815469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009420 con 0x7fdfe00d0970 2023-07-20T10:05:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdffff640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 0x7fdfe0153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdf7fe640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c490 tx=0x7fdfd400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40052d0 con 0x7fdfe00d0970 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4005430 con 0x7fdfe00d0970 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4012870 con 0x7fdfe00d0970 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe015baf0 con 0x7fdfe00d0970 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe0153a90 con 0x7fdfe00d0970 2023-07-20T10:05:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.767+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe004da30 con 0x7fdfe00d0970 2023-07-20T10:05:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.771+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 27) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fdfd40129d0 con 0x7fdfe00d0970 2023-07-20T10:05:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.771+0000 7fdfdcff9640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 0x7fdfcc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.771+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6552+0+0 (secure 0 0 0) 0x7fdfd4083c50 con 0x7fdfe00d0970 2023-07-20T10:05:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.771+0000 7fdfdffff640 1 -- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 msgr2=0x7fdfcc068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4292533700 2023-07-20T10:05:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.771+0000 7fdfdffff640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 0x7fdfcc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.775+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfd4050d30 con 0x7fdfe00d0970 2023-07-20T10:05:07.834 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.851+0000 7fc0ce7fd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:07.895 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.911+0000 7fc0ce7fd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:07.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.923+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdfd4051100 con 0x7fdfe00d0970 2023-07-20T10:05:07.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.923+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 msgr2=0x7fdfcc068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:07.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.923+0000 7fdfdcff9640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 0x7fdfcc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.931+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdfe00c5800 con 0x7fdfe00d0970 2023-07-20T10:05:07.916 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.931+0000 7fdfdcff9640 1 -- 172.21.15.82:0/2743815469 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v69) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfd4070050 con 0x7fdfe00d0970 2023-07-20T10:05:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 msgr2=0x7fdfe0153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c490 tx=0x7fdfd400c950 comp rx=0 tx=0).stop 2023-07-20T10:05:07.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 shutdown_connections 2023-07-20T10:05:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:6832/4292533700,v1:172.21.15.82:6833/4292533700] conn(0x7fdfcc0663a0 0x7fdfcc068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfe015fb70 0x7fdfe015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfe00d0970 0x7fdfe0153db0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 --2- 172.21.15.82:0/2743815469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfe00b44d0 0x7fdfe0153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:07.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 >> 172.21.15.82:0/2743815469 conn(0x7fdfe0065710 msgr2=0x7fdfe00cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:07.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 shutdown_connections 2023-07-20T10:05:07.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:07.939+0000 7fdfe5626640 1 -- 172.21.15.82:0/2743815469 wait complete. 2023-07-20T10:05:07.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:05:07.981 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05703e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.982 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05703e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.982 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05703e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.982 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05703e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.982 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05703e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.983 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05a044640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.983 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05a044640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.983 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05a044640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.983 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05a044640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:07.983 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:07.999+0000 7fc05a044640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:08.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 Processor -- start 2023-07-20T10:05:08.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 -- start start 2023-07-20T10:05:08.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb94415fb70 0x7fb9440b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9440b44d0 0x7fb9440d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9440b4930 con 0x7fb9440d07a0 2023-07-20T10:05:08.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94415ff50 con 0x7fb9440b44d0 2023-07-20T10:05:08.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94b398640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9440d0f90 con 0x7fb94415fb70 2023-07-20T10:05:08.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9440b44d0 0x7fb9440d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb9440b44d0 0x7fb9440d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60780/0 (socket says 172.21.15.82:60780) 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 -- 172.21.15.82:0/1490601638 learned_addr learned my addr 172.21.15.82:0/1490601638 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb94a396640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb94415fb70 0x7fb9440b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 -- 172.21.15.82:0/1490601638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb94415fb70 msgr2=0x7fb9440b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb94415fb70 0x7fb9440b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 -- 172.21.15.82:0/1490601638 >> v1:172.21.15.183:6789/0 conn(0x7fb9440d07a0 legacy=0x7fb94406a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.119+0000 7fb949b95640 1 -- 172.21.15.82:0/1490601638 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9440cd190 con 0x7fb9440b44d0 2023-07-20T10:05:08.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb949b95640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb9440d0260 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb934009870 tx=0x7fb93401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391180e5740570ad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb949394640 1 -- 172.21.15.82:0/1490601638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340ac640 con 0x7fb9440b44d0 2023-07-20T10:05:08.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb949394640 1 -- 172.21.15.82:0/1490601638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9340ac7a0 con 0x7fb9440b44d0 2023-07-20T10:05:08.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb949394640 1 -- 172.21.15.82:0/1490601638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9340acb30 con 0x7fb9440b44d0 2023-07-20T10:05:08.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 -- 172.21.15.82:0/1490601638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 msgr2=0x7fb9440d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb9440d0260 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb934009870 tx=0x7fb93401c3f0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 -- 172.21.15.82:0/1490601638 shutdown_connections 2023-07-20T10:05:08.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb9440d0260 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 --2- 172.21.15.82:0/1490601638 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb94415fb70 0x7fb9440b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 -- 172.21.15.82:0/1490601638 >> 172.21.15.82:0/1490601638 conn(0x7fb944065710 msgr2=0x7fb944065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 -- 172.21.15.82:0/1490601638 shutdown_connections 2023-07-20T10:05:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.123+0000 7fb94b398640 1 -- 172.21.15.82:0/1490601638 wait complete. 2023-07-20T10:05:08.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 Processor -- start 2023-07-20T10:05:08.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- start start 2023-07-20T10:05:08.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9440d07a0 0x7fb9441527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 0x7fb944152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944150190 con 0x7fb9440b44d0 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94415d930 con 0x7fb94415fb70 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94415dc10 con 0x7fb9440d07a0 2023-07-20T10:05:08.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60788/0 (socket says 172.21.15.82:60788) 2023-07-20T10:05:08.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 -- 172.21.15.82:0/1457321749 learned_addr learned my addr 172.21.15.82:0/1457321749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94ab97640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 0x7fb944152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb949b95640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9440d07a0 0x7fb9441527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 -- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9440d07a0 msgr2=0x7fb9441527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9440d07a0 0x7fb9441527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 -- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 msgr2=0x7fb944152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 0x7fb944152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 -- 172.21.15.82:0/1457321749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340094d0 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94ab97640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 0x7fb944152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94a396640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb94000e870 tx=0x7fb94000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940009510 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000eec0 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94415def0 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000cb40 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.127+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94415e4b0 con 0x7fb9440b44d0 2023-07-20T10:05:08.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.131+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94404da30 con 0x7fb9440b44d0 2023-07-20T10:05:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.131+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fb94000cca0 con 0x7fb9440b44d0 2023-07-20T10:05:08.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.131+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fb940083c20 con 0x7fb9440b44d0 2023-07-20T10:05:08.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.135+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9400511a0 con 0x7fb9440b44d0 2023-07-20T10:05:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.283+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9440ce8d0 con 0x7fb9440b44d0 2023-07-20T10:05:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb93affd640 1 -- 172.21.15.82:0/1457321749 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9400547c0 con 0x7fb9440b44d0 2023-07-20T10:05:08.268 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:05:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 msgr2=0x7fb94414fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb94000e870 tx=0x7fb94000ec70 comp rx=0 tx=0).stop 2023-07-20T10:05:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 shutdown_connections 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb94415fb70 0x7fb944152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9440d07a0 0x7fb9441527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 --2- 172.21.15.82:0/1457321749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9440b44d0 0x7fb94414fc50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 >> 172.21.15.82:0/1457321749 conn(0x7fb944065710 msgr2=0x7fb9440b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 shutdown_connections 2023-07-20T10:05:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.287+0000 7fb94b398640 1 -- 172.21.15.82:0/1457321749 wait complete. 2023-07-20T10:05:08.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:05:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.491+0000 7f01c8133640 1 Processor -- start 2023-07-20T10:05:08.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 -- start start 2023-07-20T10:05:08.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01c0159450 0x7f01c015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f01c00afd50 0x7f01c00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00b06b0 con 0x7f01c0159830 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00cce90 con 0x7f01c0159450 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c8133640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00cc8d0 con 0x7f01c00afd50 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01c0159450 0x7f01c015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f01c0159450 0x7f01c015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60800/0 (socket says 172.21.15.82:60800) 2023-07-20T10:05:08.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 -- 172.21.15.82:0/4098343837 learned_addr learned my addr 172.21.15.82:0/4098343837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 -- 172.21.15.82:0/4098343837 >> v2:172.21.15.183:3300/0 conn(0x7f01c00afd50 msgr2=0x7f01c00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:08.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 --2- 172.21.15.82:0/4098343837 >> v2:172.21.15.183:3300/0 conn(0x7f01c00afd50 0x7f01c00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 -- 172.21.15.82:0/4098343837 >> v1:172.21.15.183:6789/0 conn(0x7f01c0159830 legacy=0x7f01c00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:08.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.495+0000 7f01c5ecf640 1 -- 172.21.15.82:0/4098343837 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00ccbb0 con 0x7f01c0159450 2023-07-20T10:05:08.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c5ecf640 1 --2- 172.21.15.82:0/4098343837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c015a4c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f01c00c1da0 tx=0x7f01bc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2630fa0a1a459a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c4ecd640 1 -- 172.21.15.82:0/4098343837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0aa5f0 con 0x7f01c0159450 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c4ecd640 1 -- 172.21.15.82:0/4098343837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc0aa750 con 0x7f01c0159450 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c4ecd640 1 -- 172.21.15.82:0/4098343837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0aaae0 con 0x7f01c0159450 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- 172.21.15.82:0/4098343837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 msgr2=0x7f01c015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 --2- 172.21.15.82:0/4098343837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c015a4c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f01c00c1da0 tx=0x7f01bc01c490 comp rx=0 tx=0).stop 2023-07-20T10:05:08.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- 172.21.15.82:0/4098343837 shutdown_connections 2023-07-20T10:05:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 --2- 172.21.15.82:0/4098343837 >> v2:172.21.15.183:3300/0 conn(0x7f01c00afd50 0x7f01c00b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 --2- 172.21.15.82:0/4098343837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c015a4c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- 172.21.15.82:0/4098343837 >> 172.21.15.82:0/4098343837 conn(0x7f01c00cad50 msgr2=0x7f01c00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- 172.21.15.82:0/4098343837 shutdown_connections 2023-07-20T10:05:08.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- 172.21.15.82:0/4098343837 wait complete. 2023-07-20T10:05:08.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 Processor -- start 2023-07-20T10:05:08.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.499+0000 7f01c8133640 1 -- start start 2023-07-20T10:05:08.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01c00afd50 0x7f01c00c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 0x7f01c0154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c013ee80 con 0x7f01c0159450 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01630b0 con 0x7f01c00afd50 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0163950 con 0x7f01c0154970 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60816/0 (socket says 172.21.15.82:60816) 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 -- 172.21.15.82:0/237844979 learned_addr learned my addr 172.21.15.82:0/237844979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c5ecf640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01c00afd50 0x7f01c00c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c66d0640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 0x7f01c0154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 -- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 msgr2=0x7f01c0154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 0x7f01c0154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 -- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01c00afd50 msgr2=0x7f01c00c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01c00afd50 0x7f01c00c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 -- 172.21.15.82:0/237844979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0094d0 con 0x7f01c0159450 2023-07-20T10:05:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c66d0640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 0x7f01c0154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c56ce640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b410 tx=0x7f01b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011830 con 0x7f01c0159450 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0011990 con 0x7f01c0159450 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011d40 con 0x7f01c0159450 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c0154690 con 0x7f01c0159450 2023-07-20T10:05:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c01635e0 con 0x7f01c0159450 2023-07-20T10:05:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c004da30 con 0x7f01c0159450 2023-07-20T10:05:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.503+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f01b001a400 con 0x7f01c0159450 2023-07-20T10:05:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.507+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f01b0083be0 con 0x7f01c0159450 2023-07-20T10:05:08.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.511+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01b0051180 con 0x7f01c0159450 2023-07-20T10:05:08.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.655+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01c0163a90 con 0x7f01c0159450 2023-07-20T10:05:08.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.655+0000 7f01b67fc640 1 -- 172.21.15.82:0/237844979 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01b0015020 con 0x7f01c0159450 2023-07-20T10:05:08.638 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:05:08.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 msgr2=0x7f01c0163de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f01b000b410 tx=0x7f01b000b8d0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 shutdown_connections 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01c0154970 0x7f01c0154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01c0159450 0x7f01c0163de0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 --2- 172.21.15.82:0/237844979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01c00afd50 0x7f01c00c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 >> 172.21.15.82:0/237844979 conn(0x7f01c00cad50 msgr2=0x7f01c00cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 shutdown_connections 2023-07-20T10:05:08.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.659+0000 7f01c8133640 1 -- 172.21.15.82:0/237844979 wait complete. 2023-07-20T10:05:08.658 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:08.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 Processor -- start 2023-07-20T10:05:08.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 -- start start 2023-07-20T10:05:08.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 0x7f633015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63300b1170 0x7f63300b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63300cde70 con 0x7f63300ca040 2023-07-20T10:05:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300cbef0 con 0x7f63300b1170 2023-07-20T10:05:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6334f33640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300ca420 con 0x7f63300ad060 2023-07-20T10:05:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63300b1170 0x7f63300b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f63300b1170 0x7f63300b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60830/0 (socket says 172.21.15.82:60830) 2023-07-20T10:05:08.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 -- 172.21.15.82:0/3525726024 learned_addr learned my addr 172.21.15.82:0/3525726024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 -- 172.21.15.82:0/3525726024 >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 msgr2=0x7f633015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:08.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f6325d9b640 1 --2- 172.21.15.82:0/3525726024 >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 0x7f633015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 --2- 172.21.15.82:0/3525726024 >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 0x7f633015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.815+0000 7f632ed9d640 1 -- 172.21.15.82:0/3525726024 >> v1:172.21.15.183:6789/0 conn(0x7f63300ca040 legacy=0x7f633015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f632ed9d640 1 -- 172.21.15.82:0/3525726024 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300cdb40 con 0x7f63300b1170 2023-07-20T10:05:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6325d9b640 1 --2- 172.21.15.82:0/3525726024 >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 0x7f633015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:08.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f632ed9d640 1 --2- 172.21.15.82:0/3525726024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300b1170 0x7f63300b1600 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6330068d50 tx=0x7f632801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfe3261ab4314b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f632dd9b640 1 -- 172.21.15.82:0/3525726024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280a5730 con 0x7f63300b1170 2023-07-20T10:05:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f632dd9b640 1 -- 172.21.15.82:0/3525726024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63280a5890 con 0x7f63300b1170 2023-07-20T10:05:08.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f632dd9b640 1 -- 172.21.15.82:0/3525726024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280a5c20 con 0x7f63300b1170 2023-07-20T10:05:08.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 -- 172.21.15.82:0/3525726024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300b1170 msgr2=0x7f63300b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 --2- 172.21.15.82:0/3525726024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300b1170 0x7f63300b1600 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6330068d50 tx=0x7f632801c960 comp rx=0 tx=0).stop 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 -- 172.21.15.82:0/3525726024 shutdown_connections 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 --2- 172.21.15.82:0/3525726024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300b1170 0x7f63300b1600 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 --2- 172.21.15.82:0/3525726024 >> v2:172.21.15.183:3300/0 conn(0x7f63300ad060 0x7f633015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 -- 172.21.15.82:0/3525726024 >> 172.21.15.82:0/3525726024 conn(0x7f63300cada0 msgr2=0x7f63300cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:08.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 -- 172.21.15.82:0/3525726024 shutdown_connections 2023-07-20T10:05:08.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.819+0000 7f6334f33640 1 -- 172.21.15.82:0/3525726024 wait complete. 2023-07-20T10:05:08.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 Processor -- start 2023-07-20T10:05:08.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 -- start start 2023-07-20T10:05:08.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63300b1170 0x7f63301589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63300ca040 0x7f633006f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63301f4dc0 con 0x7f63300ad060 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63300c30b0 con 0x7f63300b1170 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6334f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63300c3390 con 0x7f63300ca040 2023-07-20T10:05:08.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60840/0 (socket says 172.21.15.82:60840) 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 -- 172.21.15.82:0/1316701610 learned_addr learned my addr 172.21.15.82:0/1316701610 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f6325d9b640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63300b1170 0x7f63301589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632ed9d640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63300ca040 0x7f633006f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 -- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63300ca040 msgr2=0x7f633006f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63300ca040 0x7f633006f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 -- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63300b1170 msgr2=0x7f63301589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:08.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63300b1170 0x7f63301589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:08.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 -- 172.21.15.82:0/1316701610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009b30 con 0x7f63300ad060 2023-07-20T10:05:08.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.823+0000 7f632e59c640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f631800b410 tx=0x7f631800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318004020 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6318004180 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6318011630 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63300c3670 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63300c2d70 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63300c3b90 con 0x7f63300ad060 2023-07-20T10:05:08.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 28) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6318011790 con 0x7f63300ad060 2023-07-20T10:05:08.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.827+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f63180837a0 con 0x7f63300ad060 2023-07-20T10:05:08.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.831+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6318050d20 con 0x7f63300ad060 2023-07-20T10:05:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.927+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f63180507d0 con 0x7f63300ad060 2023-07-20T10:05:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.927+0000 7f63277fe640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 0x7f631006e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:08.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.927+0000 7f6325d9b640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 0x7f631006e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:08.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:08.927+0000 7f6325d9b640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 0x7f631006e600 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f633006cbf0 tx=0x7f6320008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.019+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6330073c70 con 0x7f63300ad060 2023-07-20T10:05:09.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.019+0000 7f63277fe640 1 -- 172.21.15.82:0/1316701610 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f631806c4d0 con 0x7f63300ad060 2023-07-20T10:05:09.003 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:09.003 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:05:09.003 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:05:09.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 msgr2=0x7f631006e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 0x7f631006e600 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f633006cbf0 tx=0x7f6320008040 comp rx=0 tx=0).stop 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 msgr2=0x7f63300c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f631800b410 tx=0x7f631800b8d0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 shutdown_connections 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f63300ca040 0x7f633006f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63300b1170 0x7f63301589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f631006c210 0x7f631006e600 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 --2- 172.21.15.82:0/1316701610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f63300ad060 0x7f63300c2830 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 >> 172.21.15.82:0/1316701610 conn(0x7f63300cada0 msgr2=0x7f633006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 shutdown_connections 2023-07-20T10:05:09.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.023+0000 7f6334f33640 1 -- 172.21.15.82:0/1316701610 wait complete. 2023-07-20T10:05:09.024 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:09.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 Processor -- start 2023-07-20T10:05:09.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 -- start start 2023-07-20T10:05:09.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa100ad060 0x7faa1015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100b1170 0x7faa100b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100cde70 con 0x7faa100ca040 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa100cbef0 con 0x7faa100ad060 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa17367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa100ca420 con 0x7faa100b1170 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa14902640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa100ad060 0x7faa1015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa15103640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faa100ca040 0x7faa1015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38352/0 (socket says 172.21.15.82:38352) 2023-07-20T10:05:09.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa15103640 1 -- 172.21.15.82:0/2397626056 learned_addr learned my addr 172.21.15.82:0/2397626056 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa15904640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100b1170 0x7faa100b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa14902640 1 -- 172.21.15.82:0/2397626056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100b1170 msgr2=0x7faa100b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:09.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa14902640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100b1170 0x7faa100b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa14902640 1 -- 172.21.15.82:0/2397626056 >> v1:172.21.15.82:6789/0 conn(0x7faa100ca040 legacy=0x7faa1015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa14902640 1 -- 172.21.15.82:0/2397626056 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100cdb40 con 0x7faa100ad060 2023-07-20T10:05:09.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.183+0000 7faa07fff640 1 -- 172.21.15.82:0/2397626056 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270755858 0 0) 0x7faa100cde70 con 0x7faa100ca040 2023-07-20T10:05:09.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa14902640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100ad060 0x7faa1015d020 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faa000097c0 tx=0x7faa0001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d788bb89c5814177 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa07fff640 1 -- 172.21.15.82:0/2397626056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000ab670 con 0x7faa100ad060 2023-07-20T10:05:09.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa07fff640 1 -- 172.21.15.82:0/2397626056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000ab7d0 con 0x7faa100ad060 2023-07-20T10:05:09.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa07fff640 1 -- 172.21.15.82:0/2397626056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000abb60 con 0x7faa100ad060 2023-07-20T10:05:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 -- 172.21.15.82:0/2397626056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100ad060 msgr2=0x7faa1015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100ad060 0x7faa1015d020 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faa000097c0 tx=0x7faa0001c450 comp rx=0 tx=0).stop 2023-07-20T10:05:09.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 -- 172.21.15.82:0/2397626056 shutdown_connections 2023-07-20T10:05:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100b1170 0x7faa100b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 --2- 172.21.15.82:0/2397626056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100ad060 0x7faa1015d020 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 -- 172.21.15.82:0/2397626056 >> 172.21.15.82:0/2397626056 conn(0x7faa100cada0 msgr2=0x7faa100cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 -- 172.21.15.82:0/2397626056 shutdown_connections 2023-07-20T10:05:09.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.187+0000 7faa17367640 1 -- 172.21.15.82:0/2397626056 wait complete. 2023-07-20T10:05:09.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 Processor -- start 2023-07-20T10:05:09.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 -- start start 2023-07-20T10:05:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100ad060 0x7faa101621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa100ca040 0x7faa10157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101636f0 con 0x7faa100b1170 2023-07-20T10:05:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa10162ae0 con 0x7faa100ca040 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa17367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa10162dc0 con 0x7faa100ad060 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60852/0 (socket says 172.21.15.82:60852) 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 -- 172.21.15.82:0/505578291 learned_addr learned my addr 172.21.15.82:0/505578291 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa15904640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa100ca040 0x7faa10157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa15103640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100ad060 0x7faa101621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 -- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100ad060 msgr2=0x7faa101621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100ad060 0x7faa101621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 -- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa100ca040 msgr2=0x7faa10157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa100ca040 0x7faa10157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 -- 172.21.15.82:0/505578291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009420 con 0x7faa100b1170 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.191+0000 7faa14902640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faa0001ab00 tx=0x7faa0001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00004220 con 0x7faa100b1170 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000b9070 con 0x7faa100b1170 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa101630a0 con 0x7faa100b1170 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00003620 con 0x7faa100b1170 2023-07-20T10:05:09.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa10162720 con 0x7faa100b1170 2023-07-20T10:05:09.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa10073c70 con 0x7faa100b1170 2023-07-20T10:05:09.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7faa100b2350 con 0x7faa100b1170 2023-07-20T10:05:09.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 0x7fa9f4068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7faa000bb070 con 0x7faa100b1170 2023-07-20T10:05:09.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.195+0000 7faa15103640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 0x7fa9f4068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.199+0000 7faa15103640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 0x7fa9f4068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0012f0 tx=0x7faa0c001770 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.199+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa000ebbe0 con 0x7faa100b1170 2023-07-20T10:05:09.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.347+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa100cbbd0 con 0x7faa100b1170 2023-07-20T10:05:09.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa05ffb640 1 -- 172.21.15.82:0/505578291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+19499 (secure 0 0 0) 0x7faa000c4070 con 0x7faa100b1170 2023-07-20T10:05:09.332 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:09.332 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":69,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:07.917839+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.e","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3191662334":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6833/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6832/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/3397616520":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1792465488":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2668626711":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1462509814":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3057720573":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1651242703":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/2715518898":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2140941636":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3208760881":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1188963073":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/4160992300":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6833/3713806871":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6832/3713806871":"2023-07-21T10:03:18.691909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:09.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 msgr2=0x7fa9f4068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 0x7fa9f4068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0012f0 tx=0x7faa0c001770 comp rx=0 tx=0).stop 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 msgr2=0x7faa101586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faa0001ab00 tx=0x7faa0001ac90 comp rx=0 tx=0).stop 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 shutdown_connections 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa100ca040 0x7faa10157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa9f40660d0 0x7fa9f4068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa100b1170 0x7faa101586e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 --2- 172.21.15.82:0/505578291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa100ad060 0x7faa101621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 >> 172.21.15.82:0/505578291 conn(0x7faa100cada0 msgr2=0x7faa1006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 shutdown_connections 2023-07-20T10:05:09.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.351+0000 7faa17367640 1 -- 172.21.15.82:0/505578291 wait complete. 2023-07-20T10:05:09.352 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:05:09.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:09.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.507+0000 7f86fe4ec640 1 Processor -- start 2023-07-20T10:05:09.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.507+0000 7f86fe4ec640 1 -- start start 2023-07-20T10:05:09.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fe4ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f86f81596b0 0x7f86f815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fe4ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80ccd90 con 0x7f86f80b2a90 2023-07-20T10:05:09.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fe4ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f80ad810 con 0x7f86f80cc900 2023-07-20T10:05:09.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fe4ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f815d0d0 con 0x7f86f81596b0 2023-07-20T10:05:09.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fca89640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f86f80b2a90 0x7f86f80c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38358/0 (socket says 172.21.15.82:38358) 2023-07-20T10:05:09.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86fca89640 1 -- 172.21.15.82:0/2198791243 learned_addr learned my addr 172.21.15.82:0/2198791243 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f7fff640 1 --2- 172.21.15.82:0/2198791243 >> v2:172.21.15.183:3300/0 conn(0x7f86f81596b0 0x7f86f815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105986256 0 0) 0x7f86f80ccd90 con 0x7f86f80b2a90 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e0003530 con 0x7f86f80b2a90 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f7fff640 1 -- 172.21.15.82:0/2198791243 >> v1:172.21.15.183:6789/0 conn(0x7f86f80cc900 legacy=0x7f86f80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f7fff640 1 -- 172.21.15.82:0/2198791243 >> v1:172.21.15.82:6789/0 conn(0x7f86f80b2a90 legacy=0x7f86f80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 806388891 0 0) 0x7f86e0003530 con 0x7f86f80b2a90 2023-07-20T10:05:09.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.511+0000 7f86f7fff640 1 -- 172.21.15.82:0/2198791243 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f815d3b0 con 0x7f86f81596b0 2023-07-20T10:05:09.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86f7fff640 1 --2- 172.21.15.82:0/2198791243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f815dbb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097f0 tx=0x7f86e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11fb1913b06a8e3b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80ab5f0 con 0x7f86f81596b0 2023-07-20T10:05:09.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e80ab750 con 0x7f86f81596b0 2023-07-20T10:05:09.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86f6ffd640 1 -- 172.21.15.82:0/2198791243 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e80abac0 con 0x7f86f81596b0 2023-07-20T10:05:09.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 -- 172.21.15.82:0/2198791243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 msgr2=0x7f86f815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/2198791243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f815dbb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f86e80097f0 tx=0x7f86e801c450 comp rx=0 tx=0).stop 2023-07-20T10:05:09.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 -- 172.21.15.82:0/2198791243 shutdown_connections 2023-07-20T10:05:09.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/2198791243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f815dbb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 -- 172.21.15.82:0/2198791243 >> 172.21.15.82:0/2198791243 conn(0x7f86f80cada0 msgr2=0x7f86f80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 -- 172.21.15.82:0/2198791243 shutdown_connections 2023-07-20T10:05:09.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 -- 172.21.15.82:0/2198791243 wait complete. 2023-07-20T10:05:09.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.515+0000 7f86fe4ec640 1 Processor -- start 2023-07-20T10:05:09.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- start start 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86f80b2a90 0x7f86f81f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f8071ab0 con 0x7f86f80cc900 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81f5120 con 0x7f86f81596b0 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f81f53a0 con 0x7f86f80b2a90 2023-07-20T10:05:09.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60862/0 (socket says 172.21.15.82:60862) 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 -- 172.21.15.82:0/60469035 learned_addr learned my addr 172.21.15.82:0/60469035 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fca89640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f7fff640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86f80b2a90 0x7f86f81f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 -- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86f80b2a90 msgr2=0x7f86f81f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86f80b2a90 0x7f86f81f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 -- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 msgr2=0x7f86f814dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f814dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 -- 172.21.15.82:0/60469035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8009420 con 0x7f86f80cc900 2023-07-20T10:05:09.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fca89640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f814dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:09.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f77fe640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c500 tx=0x7f86ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec005220 con 0x7f86f80cc900 2023-07-20T10:05:09.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec005380 con 0x7f86f80cc900 2023-07-20T10:05:09.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec007270 con 0x7f86f80cc900 2023-07-20T10:05:09.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f81f5680 con 0x7f86f80cc900 2023-07-20T10:05:09.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f81f5c40 con 0x7f86f80cc900 2023-07-20T10:05:09.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.519+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f8073c70 con 0x7f86f80cc900 2023-07-20T10:05:09.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.523+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f86ec0073d0 con 0x7f86f80cc900 2023-07-20T10:05:09.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.523+0000 7f86f4ff9640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 0x7f86e40685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.523+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f86ec0835d0 con 0x7f86f80cc900 2023-07-20T10:05:09.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.523+0000 7f86f7fff640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 0x7f86e40685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.523+0000 7f86f7fff640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 0x7f86e40685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86e80af000 tx=0x7f86e80a7000 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.527+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86ec0509c0 con 0x7f86f80cc900 2023-07-20T10:05:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.703+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86f80c86b0 con 0x7f86f80cc900 2023-07-20T10:05:09.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86f4ff9640 1 -- 172.21.15.82:0/60469035 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f86ec053fe0 con 0x7f86f80cc900 2023-07-20T10:05:09.688 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:09.688 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:05:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:05:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 msgr2=0x7f86e40685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 0x7f86e40685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86e80af000 tx=0x7f86e80a7000 comp rx=0 tx=0).stop 2023-07-20T10:05:09.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 msgr2=0x7f86f814d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c500 tx=0x7f86ec00c9c0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 shutdown_connections 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f86f81596b0 0x7f86f814dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f86e4066100 0x7f86e40685c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86f80cc900 0x7f86f814d6b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 --2- 172.21.15.82:0/60469035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86f80b2a90 0x7f86f81f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 >> 172.21.15.82:0/60469035 conn(0x7f86f80cada0 msgr2=0x7f86f806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 shutdown_connections 2023-07-20T10:05:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.707+0000 7f86fe4ec640 1 -- 172.21.15.82:0/60469035 wait complete. 2023-07-20T10:05:09.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:09.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.863+0000 7ff97ea34640 1 Processor -- start 2023-07-20T10:05:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.863+0000 7ff97ea34640 1 -- start start 2023-07-20T10:05:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff97ea34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9781596b0 0x7ff97815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff97ea34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780ccd90 con 0x7ff9780b2a90 2023-07-20T10:05:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff97ea34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9780ad810 con 0x7ff9780cc900 2023-07-20T10:05:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff97ea34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97815d0d0 con 0x7ff9781596b0 2023-07-20T10:05:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9781596b0 0x7ff97815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9781596b0 0x7ff97815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60866/0 (socket says 172.21.15.82:60866) 2023-07-20T10:05:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 -- 172.21.15.82:0/942294068 learned_addr learned my addr 172.21.15.82:0/942294068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:09.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 -- 172.21.15.82:0/942294068 >> v1:172.21.15.183:6789/0 conn(0x7ff9780cc900 legacy=0x7ff9780b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:09.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 -- 172.21.15.82:0/942294068 >> v1:172.21.15.82:6789/0 conn(0x7ff9780b2a90 legacy=0x7ff9780c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.867+0000 7ff977fff640 1 -- 172.21.15.82:0/942294068 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97815d3b0 con 0x7ff9781596b0 2023-07-20T10:05:09.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff977fff640 1 --2- 172.21.15.82:0/942294068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff97815dbb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff96800bb40 tx=0x7ff96801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bf5fd4015b8844 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff976ffd640 1 -- 172.21.15.82:0/942294068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680a7c30 con 0x7ff9781596b0 2023-07-20T10:05:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff976ffd640 1 -- 172.21.15.82:0/942294068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9680a7d90 con 0x7ff9781596b0 2023-07-20T10:05:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff976ffd640 1 -- 172.21.15.82:0/942294068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680af660 con 0x7ff9781596b0 2023-07-20T10:05:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- 172.21.15.82:0/942294068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 msgr2=0x7ff97815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 --2- 172.21.15.82:0/942294068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff97815dbb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7ff96800bb40 tx=0x7ff96801ebc0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- 172.21.15.82:0/942294068 shutdown_connections 2023-07-20T10:05:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 --2- 172.21.15.82:0/942294068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff97815dbb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- 172.21.15.82:0/942294068 >> 172.21.15.82:0/942294068 conn(0x7ff9780cada0 msgr2=0x7ff9780cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- 172.21.15.82:0/942294068 shutdown_connections 2023-07-20T10:05:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- 172.21.15.82:0/942294068 wait complete. 2023-07-20T10:05:09.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 Processor -- start 2023-07-20T10:05:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.871+0000 7ff97ea34640 1 -- start start 2023-07-20T10:05:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9780b2a90 0x7ff97814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 0x7ff9780afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97815a0c0 con 0x7ff9781596b0 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff978159a90 con 0x7ff9780cc900 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9780b0810 con 0x7ff9780b2a90 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60870/0 (socket says 172.21.15.82:60870) 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 -- 172.21.15.82:0/66012279 learned_addr learned my addr 172.21.15.82:0/66012279 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff977fff640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9780b2a90 0x7ff97814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff9777fe640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 0x7ff9780afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 -- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9780b2a90 msgr2=0x7ff97814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9780b2a90 0x7ff97814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 -- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 msgr2=0x7ff9780afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 0x7ff9780afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 -- 172.21.15.82:0/66012279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96800b770 con 0x7ff9781596b0 2023-07-20T10:05:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff9777fe640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 0x7ff9780afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97cfd1640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff97000c700 tx=0x7ff97000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970003b80 con 0x7ff9781596b0 2023-07-20T10:05:09.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970003ce0 con 0x7ff9781596b0 2023-07-20T10:05:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97000aa90 con 0x7ff9781596b0 2023-07-20T10:05:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9780b0af0 con 0x7ff9781596b0 2023-07-20T10:05:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9780ae9b0 con 0x7ff9781596b0 2023-07-20T10:05:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97815a270 con 0x7ff9781596b0 2023-07-20T10:05:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.875+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 29) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff97000abf0 con 0x7ff9781596b0 2023-07-20T10:05:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.879+0000 7ff974ff9640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 0x7ff964068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.879+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7ff970083a80 con 0x7ff9781596b0 2023-07-20T10:05:09.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.879+0000 7ff977fff640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 0x7ff964068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:09.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.879+0000 7ff977fff640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 0x7ff964068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b1000 tx=0x7ff968008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:09.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:09.883+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff97815a270 con 0x7ff9781596b0 2023-07-20T10:05:10.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.043+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 30) v1 ==== 85704+0+0 (secure 0 0 0) 0x7ff9700512c0 con 0x7ff9781596b0 2023-07-20T10:05:10.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.075+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff978073c70 con 0x7ff9781596b0 2023-07-20T10:05:10.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.075+0000 7ff974ff9640 1 -- 172.21.15.82:0/66012279 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4674 (secure 0 0 0) 0x7ff97006fcd0 con 0x7ff9781596b0 2023-07-20T10:05:10.058 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:10.059 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:03:01.464190+0000","modified":"2023-07-20T10:03:05.103842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5836},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5836":{"gid":5836,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1320222659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1320222659},{"type":"v1","addr":"172.21.15.183:6834","nonce":1320222659}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-20T10:05:10.059 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 25 2023-07-20T10:05:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 msgr2=0x7ff964068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 0x7ff964068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b1000 tx=0x7ff968008040 comp rx=0 tx=0).stop 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 msgr2=0x7ff9781503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff97000c700 tx=0x7ff97000cbc0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 shutdown_connections 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7ff9640660d0 0x7ff964068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9781596b0 0x7ff9781503a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9780cc900 0x7ff9780afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 --2- 172.21.15.82:0/66012279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9780b2a90 0x7ff97814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 >> 172.21.15.82:0/66012279 conn(0x7ff9780cada0 msgr2=0x7ff9781542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 shutdown_connections 2023-07-20T10:05:10.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.079+0000 7ff97ea34640 1 -- 172.21.15.82:0/66012279 wait complete. 2023-07-20T10:05:10.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:10.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 Processor -- start 2023-07-20T10:05:10.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 -- start start 2023-07-20T10:05:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 0x7f4ebc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ebc0d16b0 con 0x7f4ebc0cf110 2023-07-20T10:05:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ebc0d31c0 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ec1dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc0b3520 con 0x7f4ebc15cab0 2023-07-20T10:05:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60888/0 (socket says 172.21.15.82:60888) 2023-07-20T10:05:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 -- 172.21.15.82:0/1483209122 learned_addr learned my addr 172.21.15.82:0/1483209122 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebb7fe640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 0x7f4ebc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 -- 172.21.15.82:0/1483209122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 msgr2=0x7f4ebc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 0x7f4ebc0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 -- 172.21.15.82:0/1483209122 >> v1:172.21.15.82:6789/0 conn(0x7f4ebc0cf110 legacy=0x7f4ebc0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebaffd640 1 -- 172.21.15.82:0/1483209122 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0b2910 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.239+0000 7f4ebb7fe640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 0x7f4ebc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:10.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ebaffd640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009870 tx=0x7f4eb001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e917bfb4bf318 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4eba7fc640 1 -- 172.21.15.82:0/1483209122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00aa670 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4eba7fc640 1 -- 172.21.15.82:0/1483209122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb00aa7d0 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4eba7fc640 1 -- 172.21.15.82:0/1483209122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00aab60 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/1483209122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0d0d10 msgr2=0x7f4ebc0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0009870 tx=0x7f4eb001c510 comp rx=0 tx=0).stop 2023-07-20T10:05:10.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/1483209122 shutdown_connections 2023-07-20T10:05:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc0d0d10 0x7f4ebc0d1170 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/1483209122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc15cab0 0x7f4ebc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/1483209122 >> 172.21.15.82:0/1483209122 conn(0x7f4ebc08c120 msgr2=0x7f4ebc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/1483209122 shutdown_connections 2023-07-20T10:05:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/1483209122 wait complete. 2023-07-20T10:05:10.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 Processor -- start 2023-07-20T10:05:10.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.243+0000 7f4ec1dfa640 1 -- start start 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ebc0cf110 0x7f4ebc06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0d0d10 0x7f4ebc151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc0c6020 con 0x7f4ebc15cab0 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc153540 con 0x7f4ebc0cf110 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ebc152120 con 0x7f4ebc0d0d10 2023-07-20T10:05:10.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60890/0 (socket says 172.21.15.82:60890) 2023-07-20T10:05:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 -- 172.21.15.82:0/380840155 learned_addr learned my addr 172.21.15.82:0/380840155 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebaffd640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0d0d10 0x7f4ebc151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebb7fe640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ebc0cf110 0x7f4ebc06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 -- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0d0d10 msgr2=0x7f4ebc151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0d0d10 0x7f4ebc151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 -- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ebc0cf110 msgr2=0x7f4ebc06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ebc0cf110 0x7f4ebc06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 -- 172.21.15.82:0/380840155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb00094d0 con 0x7f4ebc15cab0 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ebbfff640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c730 tx=0x7f4eb400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4003b80 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb4003ce0 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc06bc60 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4005310 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ebc153770 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.247+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ebc06bdf0 con 0x7f4ebc15cab0 2023-07-20T10:05:10.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.251+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f4eb4005680 con 0x7f4ebc15cab0 2023-07-20T10:05:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.251+0000 7f4ea3fff640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 0x7f4ea8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.251+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f4eb40840d0 con 0x7f4ebc15cab0 2023-07-20T10:05:10.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.251+0000 7f4ebb7fe640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 0x7f4ea8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.251+0000 7f4ebb7fe640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 0x7f4ea8068800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00a9a0 tx=0x7f4eac008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.255+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4eb4051150 con 0x7f4ebc15cab0 2023-07-20T10:05:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.403+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ebc0b2590 con 0x7f4ebc15cab0 2023-07-20T10:05:10.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.403+0000 7f4ea3fff640 1 -- 172.21.15.82:0/380840155 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+19499 (secure 0 0 0) 0x7f4eb4054770 con 0x7f4ebc15cab0 2023-07-20T10:05:10.387 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:10.387 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":69,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:07.917839+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:02:59.146720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-20T10:03:00.452578+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":69,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2","mappings":[{"from":0,"to":6}]},{"pgid":"8.e","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3191662334":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6833/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6832/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/3397616520":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1792465488":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2668626711":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1462509814":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3057720573":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1651242703":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/2715518898":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2140941636":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3208760881":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1188963073":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/4160992300":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6833/3713806871":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6832/3713806871":"2023-07-21T10:03:18.691909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 msgr2=0x7f4ea8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 0x7f4ea8068800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00a9a0 tx=0x7f4eac008040 comp rx=0 tx=0).stop 2023-07-20T10:05:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 msgr2=0x7f4ebc15b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400c730 tx=0x7f4eb400cbf0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 shutdown_connections 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f4ea8066340 0x7f4ea8068800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ebc15cab0 0x7f4ebc15b1f0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ebc0d0d10 0x7f4ebc151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 --2- 172.21.15.82:0/380840155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ebc0cf110 0x7f4ebc06c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 >> 172.21.15.82:0/380840155 conn(0x7f4ebc08c120 msgr2=0x7f4ebc0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 shutdown_connections 2023-07-20T10:05:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.407+0000 7f4ec1dfa640 1 -- 172.21.15.82:0/380840155 wait complete. 2023-07-20T10:05:10.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:05:10.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 Processor -- start 2023-07-20T10:05:10.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 -- start start 2023-07-20T10:05:10.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f45580ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f45580ce9a0 0x7f45580b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45580b7c20 con 0x7f455815c5f0 2023-07-20T10:05:10.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45580cee50 con 0x7f45580ce9a0 2023-07-20T10:05:10.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455e09e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b4980 con 0x7f45580ccfb0 2023-07-20T10:05:10.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455d09c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f455815c5f0 0x7f45580b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38388/0 (socket says 172.21.15.82:38388) 2023-07-20T10:05:10.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455d09c640 1 -- 172.21.15.82:0/967016553 learned_addr learned my addr 172.21.15.82:0/967016553 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598040676 0 0) 0x7f45580b7c20 con 0x7f455815c5f0 2023-07-20T10:05:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4544003530 con 0x7f455815c5f0 2023-07-20T10:05:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455c89b640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f45580ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455d89d640 1 --2- 172.21.15.82:0/967016553 >> v2:172.21.15.183:3300/0 conn(0x7f45580ce9a0 0x7f45580b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223361924 0 0) 0x7f4544003530 con 0x7f455815c5f0 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 msgr2=0x7f45580ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f45580ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 >> v2:172.21.15.183:3300/0 conn(0x7f45580ce9a0 msgr2=0x7f45580b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 --2- 172.21.15.82:0/967016553 >> v2:172.21.15.183:3300/0 conn(0x7f45580ce9a0 0x7f45580b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455815c9d0 con 0x7f455815c5f0 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f4554001680 con 0x7f455815c5f0 2023-07-20T10:05:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 >> v1:172.21.15.82:6789/0 conn(0x7f455815c5f0 legacy=0x7f45580b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4544003980 0x7f4544003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45440047d0 0x7f4544004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f4544005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580cee50 con 0x7f45440047d0 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b4980 con 0x7f4544003980 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454400b9c0 con 0x7f45580ccfb0 2023-07-20T10:05:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455c89b640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45440047d0 0x7f4544004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.567+0000 7f455d09c640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4544003980 0x7f4544003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455d89d640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f4544005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 -- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 msgr2=0x7f4544005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f45580ccfb0 0x7f4544005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 -- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4544003980 msgr2=0x7f4544003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4544003980 0x7f4544003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 -- 172.21.15.82:0/967016553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544003530 con 0x7f45440047d0 2023-07-20T10:05:10.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455c89b640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45440047d0 0x7f4544004c50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ae0 tx=0x7f454801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f20afac195f097 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480a5560 con 0x7f45440047d0 2023-07-20T10:05:10.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45480a56c0 con 0x7f45440047d0 2023-07-20T10:05:10.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f454ffff640 1 -- 172.21.15.82:0/967016553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480a5a70 con 0x7f45440047d0 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455e09e640 1 -- 172.21.15.82:0/967016553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45440047d0 msgr2=0x7f4544004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455e09e640 1 --2- 172.21.15.82:0/967016553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45440047d0 0x7f4544004c50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ae0 tx=0x7f454801ca50 comp rx=0 tx=0).stop 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.571+0000 7f455d89d640 1 -- 172.21.15.82:0/967016553 reap_dead start 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- 172.21.15.82:0/967016553 shutdown_connections 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- 172.21.15.82:0/967016553 >> 172.21.15.82:0/967016553 conn(0x7f4558065710 msgr2=0x7f4558065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- 172.21.15.82:0/967016553 shutdown_connections 2023-07-20T10:05:10.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- 172.21.15.82:0/967016553 wait complete. 2023-07-20T10:05:10.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 Processor -- start 2023-07-20T10:05:10.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- start start 2023-07-20T10:05:10.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 0x7f4558156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 0x7f45580ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45581523e0 con 0x7f45581589e0 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4558156850 con 0x7f45440047d0 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455e09e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4558152630 con 0x7f4558154c50 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60912/0 (socket says 172.21.15.82:60912) 2023-07-20T10:05:10.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 -- 172.21.15.82:0/1176121900 learned_addr learned my addr 172.21.15.82:0/1176121900 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455d09c640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 0x7f4558156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455d89d640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 0x7f45580ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 -- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 msgr2=0x7f45580ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 0x7f45580ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 -- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 msgr2=0x7f4558156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 0x7f4558156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 -- 172.21.15.82:0/1176121900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4558152910 con 0x7f45581589e0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455d89d640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 0x7f45580ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455d09c640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 0x7f4558156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f455c89b640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ae0 tx=0x7f4544005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548004220 con 0x7f45581589e0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.575+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548004380 con 0x7f45581589e0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4558152bf0 con 0x7f45581589e0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480ad850 con 0x7f45581589e0 2023-07-20T10:05:10.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45580b3a40 con 0x7f45581589e0 2023-07-20T10:05:10.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455804da30 con 0x7f45581589e0 2023-07-20T10:05:10.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f45480b4040 con 0x7f45581589e0 2023-07-20T10:05:10.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f454dffb640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 0x7f453c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f454811e430 con 0x7f45581589e0 2023-07-20T10:05:10.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f455d09c640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 0x7f453c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.579+0000 7f455d09c640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 0x7f453c068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4554001500 tx=0x7f4554009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.583+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45480eb6f0 con 0x7f45581589e0 2023-07-20T10:05:10.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.763+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f455806ae20 con 0x7f45581589e0 2023-07-20T10:05:10.747 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:05:10.763+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:05:10.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.771+0000 7f454dffb640 1 -- 172.21.15.82:0/1176121900 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f45480eed10 con 0x7f45581589e0 2023-07-20T10:05:10.753 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:05:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 msgr2=0x7f453c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 0x7f453c068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4554001500 tx=0x7f4554009040 comp rx=0 tx=0).stop 2023-07-20T10:05:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 msgr2=0x7f4558153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4548009ae0 tx=0x7f4544005800 comp rx=0 tx=0).stop 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 shutdown_connections 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4558154c50 0x7f45580ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f453c066340 0x7f453c068800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45581589e0 0x7f4558153110 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 --2- 172.21.15.82:0/1176121900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45440047d0 0x7f4558156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 >> 172.21.15.82:0/1176121900 conn(0x7f4558065710 msgr2=0x7f45580b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 shutdown_connections 2023-07-20T10:05:10.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.775+0000 7f455e09e640 1 -- 172.21.15.82:0/1176121900 wait complete. 2023-07-20T10:05:10.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:05:10.819 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:05:10.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 Processor -- start 2023-07-20T10:05:10.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 -- start start 2023-07-20T10:05:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd514159290 0x7fd514070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd5140c9f70 0x7fd51406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd514070990 con 0x7fd5140cd770 2023-07-20T10:05:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd514159670 con 0x7fd5140c9f70 2023-07-20T10:05:10.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.939+0000 7fd51952d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51415d1f0 con 0x7fd514159290 2023-07-20T10:05:10.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd5140c9f70 0x7fd51406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd5140c9f70 0x7fd51406ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60924/0 (socket says 172.21.15.82:60924) 2023-07-20T10:05:10.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 -- 172.21.15.82:0/1260713210 learned_addr learned my addr 172.21.15.82:0/1260713210 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:10.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd513fff640 1 --2- 172.21.15.82:0/1260713210 >> v2:172.21.15.183:3300/0 conn(0x7fd514159290 0x7fd514070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 -- 172.21.15.82:0/1260713210 >> v2:172.21.15.183:3300/0 conn(0x7fd514159290 msgr2=0x7fd514070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 --2- 172.21.15.82:0/1260713210 >> v2:172.21.15.183:3300/0 conn(0x7fd514159290 0x7fd514070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 -- 172.21.15.82:0/1260713210 >> v1:172.21.15.183:6789/0 conn(0x7fd5140cd770 legacy=0x7fd5140c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:10.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 -- 172.21.15.82:0/1260713210 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51415d4d0 con 0x7fd5140c9f70 2023-07-20T10:05:10.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd518d2c640 1 --2- 172.21.15.82:0/1260713210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51406ba50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c01c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38fb2bcd002d4f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd512ffd640 1 -- 172.21.15.82:0/1260713210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a5700 con 0x7fd5140c9f70 2023-07-20T10:05:10.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd512ffd640 1 -- 172.21.15.82:0/1260713210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0a5860 con 0x7fd5140c9f70 2023-07-20T10:05:10.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.943+0000 7fd512ffd640 1 -- 172.21.15.82:0/1260713210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0a5bf0 con 0x7fd5140c9f70 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- 172.21.15.82:0/1260713210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 msgr2=0x7fd51406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- 172.21.15.82:0/1260713210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51406ba50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c01c840 comp rx=0 tx=0).stop 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- 172.21.15.82:0/1260713210 shutdown_connections 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- 172.21.15.82:0/1260713210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51406ba50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- 172.21.15.82:0/1260713210 >> v2:172.21.15.183:3300/0 conn(0x7fd514159290 0x7fd514070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- 172.21.15.82:0/1260713210 >> 172.21.15.82:0/1260713210 conn(0x7fd5140ce080 msgr2=0x7fd5140ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:10.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- 172.21.15.82:0/1260713210 shutdown_connections 2023-07-20T10:05:10.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- 172.21.15.82:0/1260713210 wait complete. 2023-07-20T10:05:10.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 Processor -- start 2023-07-20T10:05:10.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- start start 2023-07-20T10:05:10.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5140cd770 0x7fd51415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 0x7fd514155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514150060 con 0x7fd5140c9f70 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51415ad60 con 0x7fd5140cd770 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd51952d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51415aa80 con 0x7fd514159290 2023-07-20T10:05:10.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd513fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd513fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60936/0 (socket says 172.21.15.82:60936) 2023-07-20T10:05:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd513fff640 1 -- 172.21.15.82:0/2859068021 learned_addr learned my addr 172.21.15.82:0/2859068021 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd5137fe640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5140cd770 0x7fd51415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.947+0000 7fd518d2c640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 0x7fd514155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 -- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 msgr2=0x7fd514155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 0x7fd514155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 -- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5140cd770 msgr2=0x7fd51415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:10.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5140cd770 0x7fd51415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 -- 172.21.15.82:0/2859068021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009b30 con 0x7fd5140c9f70 2023-07-20T10:05:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd518d2c640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 0x7fd514155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd513fff640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d830 tx=0x7fd50400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400b6c0 con 0x7fd5140c9f70 2023-07-20T10:05:10.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50400b820 con 0x7fd5140c9f70 2023-07-20T10:05:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50400bb90 con 0x7fd5140c9f70 2023-07-20T10:05:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51414f9a0 con 0x7fd5140c9f70 2023-07-20T10:05:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51414f610 con 0x7fd5140c9f70 2023-07-20T10:05:10.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5141502d0 con 0x7fd5140c9f70 2023-07-20T10:05:10.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fd50401e460 con 0x7fd5140c9f70 2023-07-20T10:05:10.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 0x7fd500068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:10.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fd504084810 con 0x7fd5140c9f70 2023-07-20T10:05:10.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.951+0000 7fd5137fe640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 0x7fd500068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:10.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.955+0000 7fd5137fe640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 0x7fd500068800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd51415c050 tx=0x7fd508007e40 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:10.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:10.955+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5040518d0 con 0x7fd5140c9f70 2023-07-20T10:05:11.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.143+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd51404da30 con 0x7fd5140c9f70 2023-07-20T10:05:11.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.771+0000 7fd510ff9640 1 -- 172.21.15.82:0/2859068021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd504054ef0 con 0x7fd5140c9f70 2023-07-20T10:05:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 msgr2=0x7fd500068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 0x7fd500068800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd51415c050 tx=0x7fd508007e40 comp rx=0 tx=0).stop 2023-07-20T10:05:11.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 msgr2=0x7fd51414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d830 tx=0x7fd50400dcf0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 shutdown_connections 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd514159290 0x7fd514155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd5140cd770 0x7fd51415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd500066340 0x7fd500068800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 --2- 172.21.15.82:0/2859068021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5140c9f70 0x7fd51414f0d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 >> 172.21.15.82:0/2859068021 conn(0x7fd5140ce080 msgr2=0x7fd5140c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:11.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 shutdown_connections 2023-07-20T10:05:11.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.775+0000 7fd51952d640 1 -- 172.21.15.82:0/2859068021 wait complete. 2023-07-20T10:05:11.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:05:11.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.939+0000 7fa844367640 1 Processor -- start 2023-07-20T10:05:11.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.939+0000 7fa844367640 1 -- start start 2023-07-20T10:05:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa844367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa83c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa844367640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa83c0afd50 0x7fa83c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa844367640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c0cc8d0 con 0x7fa83c159830 2023-07-20T10:05:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa844367640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0cce90 con 0x7fa83c0afd50 2023-07-20T10:05:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa844367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b0700 con 0x7fa83c159450 2023-07-20T10:05:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841902640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa83c159830 0x7fa83c0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38398/0 (socket says 172.21.15.82:38398) 2023-07-20T10:05:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841902640 1 -- 172.21.15.82:0/877529220 learned_addr learned my addr 172.21.15.82:0/877529220 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489820644 0 0) 0x7fa83c0cc8d0 con 0x7fa83c159830 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 --2- 172.21.15.82:0/877529220 >> v2:172.21.15.183:3300/0 conn(0x7fa83c0afd50 0x7fa83c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842103640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa83c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa828003530 con 0x7fa83c159830 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2572946364 0 0) 0x7fa828003530 con 0x7fa83c159830 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 msgr2=0x7fa83c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa83c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 >> v2:172.21.15.183:3300/0 conn(0x7fa83c0afd50 msgr2=0x7fa83c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 --2- 172.21.15.82:0/877529220 >> v2:172.21.15.183:3300/0 conn(0x7fa83c0afd50 0x7fa83c0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0ccbb0 con 0x7fa83c159830 2023-07-20T10:05:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fa82c001680 con 0x7fa83c159830 2023-07-20T10:05:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 >> v1:172.21.15.82:6789/0 conn(0x7fa83c159830 legacy=0x7fa83c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828003a20 0x7fa828003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa8280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa828004d10 0x7fa828005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0cce90 con 0x7fa828004d10 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b0700 con 0x7fa828003a20 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82800b990 con 0x7fa83c159450 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa828004d10 0x7fa828005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842103640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828003a20 0x7fa828003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa841902640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa8280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 -- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 msgr2=0x7fa8280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c159450 0x7fa8280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 -- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828003a20 msgr2=0x7fa828003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828003a20 0x7fa828003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.943+0000 7fa842904640 1 -- 172.21.15.82:0/877529220 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828003530 con 0x7fa828004d10 2023-07-20T10:05:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa842904640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa828004d10 0x7fa828005190 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa834009ae0 tx=0x7fa83401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98daea2135193a85 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a5680 con 0x7fa828004d10 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8340a57e0 con 0x7fa828004d10 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa841101640 1 -- 172.21.15.82:0/877529220 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a5b90 con 0x7fa828004d10 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 -- 172.21.15.82:0/877529220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa828004d10 msgr2=0x7fa828005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 --2- 172.21.15.82:0/877529220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa828004d10 0x7fa828005190 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa834009ae0 tx=0x7fa83401ca90 comp rx=0 tx=0).stop 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa842904640 1 -- 172.21.15.82:0/877529220 reap_dead start 2023-07-20T10:05:11.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 -- 172.21.15.82:0/877529220 shutdown_connections 2023-07-20T10:05:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 -- 172.21.15.82:0/877529220 >> 172.21.15.82:0/877529220 conn(0x7fa83c0cad50 msgr2=0x7fa83c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 -- 172.21.15.82:0/877529220 shutdown_connections 2023-07-20T10:05:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 -- 172.21.15.82:0/877529220 wait complete. 2023-07-20T10:05:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.947+0000 7fa844367640 1 Processor -- start 2023-07-20T10:05:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- start start 2023-07-20T10:05:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 0x7fa83c0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 0x7fa83c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0aeb20 con 0x7fa83c0ae160 2023-07-20T10:05:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0acfd0 con 0x7fa828004d10 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0ac130 con 0x7fa83c0c1e50 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60962/0 (socket says 172.21.15.82:60962) 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 -- 172.21.15.82:0/934545563 learned_addr learned my addr 172.21.15.82:0/934545563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa841902640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 0x7fa83c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842103640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 0x7fa83c0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 -- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 msgr2=0x7fa83c14f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 0x7fa83c14f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 -- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 msgr2=0x7fa83c0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 0x7fa83c0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 -- 172.21.15.82:0/934545563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0ac3e0 con 0x7fa83c0ae160 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842103640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 0x7fa83c0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa841902640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 0x7fa83c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa842904640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa8340b0040 tx=0x7fa828005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340ba070 con 0x7fa83c0ae160 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834004020 con 0x7fa83c0ae160 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340a5680 con 0x7fa83c0ae160 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c0ac6a0 con 0x7fa83c0ae160 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0acc60 con 0x7fa83c0ae160 2023-07-20T10:05:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.951+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c04da30 con 0x7fa83c0ae160 2023-07-20T10:05:11.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.955+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 30) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fa8340b4070 con 0x7fa83c0ae160 2023-07-20T10:05:11.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.955+0000 7fa832ffd640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 0x7fa820068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:11.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.955+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fa83411e060 con 0x7fa83c0ae160 2023-07-20T10:05:11.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.955+0000 7fa842103640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 0x7fa820068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:11.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.955+0000 7fa842103640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 0x7fa820068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa838009430 tx=0x7fa83800d040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:11.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:11.959+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8340eb000 con 0x7fa83c0ae160 2023-07-20T10:05:12.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:12.107+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa83c159f70 con 0x7fa83c0ae160 2023-07-20T10:05:12.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:12.779+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8340eb3d0 con 0x7fa83c0ae160 2023-07-20T10:05:13.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.055+0000 7fa832ffd640 1 -- 172.21.15.82:0/934545563 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa834102950 con 0x7fa83c0ae160 2023-07-20T10:05:13.037 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:05:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 msgr2=0x7fa820068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 0x7fa820068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa838009430 tx=0x7fa83800d040 comp rx=0 tx=0).stop 2023-07-20T10:05:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 msgr2=0x7fa83c0ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa8340b0040 tx=0x7fa828005800 comp rx=0 tx=0).stop 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 shutdown_connections 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa820066340 0x7fa820068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa83c0ae160 0x7fa83c0ae5e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa83c0c1e50 0x7fa83c14f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 --2- 172.21.15.82:0/934545563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa828004d10 0x7fa83c0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 >> 172.21.15.82:0/934545563 conn(0x7fa83c0cad50 msgr2=0x7fa83c158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 shutdown_connections 2023-07-20T10:05:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.063+0000 7fa844367640 1 -- 172.21.15.82:0/934545563 wait complete. 2023-07-20T10:05:13.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:05:13.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.239+0000 7fd69b848640 1 Processor -- start 2023-07-20T10:05:13.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.239+0000 7fd69b848640 1 -- start start 2023-07-20T10:05:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd69b848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd6940c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd69b848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd6940c8e60 0x7fd6940afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd69b848640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940c9370 con 0x7fd694161de0 2023-07-20T10:05:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd69b848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940c9650 con 0x7fd6940c8e60 2023-07-20T10:05:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd69b848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941619c0 con 0x7fd694160ba0 2023-07-20T10:05:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd699de5640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd694161de0 0x7fd6940cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38414/0 (socket says 172.21.15.82:38414) 2023-07-20T10:05:13.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd699de5640 1 -- 172.21.15.82:0/2576732060 learned_addr learned my addr 172.21.15.82:0/2576732060 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd6940c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd698de3640 1 --2- 172.21.15.82:0/2576732060 >> v2:172.21.15.183:3300/0 conn(0x7fd6940c8e60 0x7fd6940afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426027826 0 0) 0x7fd6940c9370 con 0x7fd694161de0 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd680003530 con 0x7fd694161de0 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4052676948 0 0) 0x7fd680003530 con 0x7fd694161de0 2023-07-20T10:05:13.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 msgr2=0x7fd6940c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd6940c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 >> v2:172.21.15.183:3300/0 conn(0x7fd6940c8e60 msgr2=0x7fd6940afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 --2- 172.21.15.82:0/2576732060 >> v2:172.21.15.183:3300/0 conn(0x7fd6940c8e60 0x7fd6940afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694161300 con 0x7fd694161de0 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd68c001a00 con 0x7fd694161de0 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 >> v1:172.21.15.82:6789/0 conn(0x7fd694161de0 legacy=0x7fd6940cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6800039f0 0x7fd680003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800047d0 0x7fd680004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd680005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c9650 con 0x7fd6800039f0 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6941619c0 con 0x7fd6800047d0 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68000b990 con 0x7fd694160ba0 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6800039f0 0x7fd680003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd698de3640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800047d0 0x7fd680004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd699de5640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd680005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 -- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 msgr2=0x7fd680005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:13.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd694160ba0 0x7fd680005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 -- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800047d0 msgr2=0x7fd680004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:13.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800047d0 0x7fd680004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.243+0000 7fd6995e4640 1 -- 172.21.15.82:0/2576732060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680003530 con 0x7fd6800039f0 2023-07-20T10:05:13.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd6995e4640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6800039f0 0x7fd680003e10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd690009b10 tx=0x7fd69001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3447d55a5ef1b496 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:13.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900a6430 con 0x7fd6800039f0 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6900a6590 con 0x7fd6800039f0 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd68bfff640 1 -- 172.21.15.82:0/2576732060 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6900a6940 con 0x7fd6800039f0 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 -- 172.21.15.82:0/2576732060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6800039f0 msgr2=0x7fd680003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 --2- 172.21.15.82:0/2576732060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6800039f0 0x7fd680003e10 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd690009b10 tx=0x7fd69001ca20 comp rx=0 tx=0).stop 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd699de5640 1 -- 172.21.15.82:0/2576732060 reap_dead start 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 -- 172.21.15.82:0/2576732060 shutdown_connections 2023-07-20T10:05:13.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 -- 172.21.15.82:0/2576732060 >> 172.21.15.82:0/2576732060 conn(0x7fd6940cad50 msgr2=0x7fd6940cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 -- 172.21.15.82:0/2576732060 shutdown_connections 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 -- 172.21.15.82:0/2576732060 wait complete. 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.247+0000 7fd69b848640 1 Processor -- start 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- start start 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800039f0 0x7fd6940c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6940c2570 0x7fd6940c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c38f0 con 0x7fd694159880 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c2c70 con 0x7fd6800039f0 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6940c2f50 con 0x7fd6940c2570 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60982/0 (socket says 172.21.15.82:60982) 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 -- 172.21.15.82:0/155675077 learned_addr learned my addr 172.21.15.82:0/155675077 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:13.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd6995e4640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800039f0 0x7fd6940c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd698de3640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6940c2570 0x7fd6940c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 -- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6940c2570 msgr2=0x7fd6940c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6940c2570 0x7fd6940c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 -- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800039f0 msgr2=0x7fd6940c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800039f0 0x7fd6940c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 -- 172.21.15.82:0/155675077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940c3230 con 0x7fd694159880 2023-07-20T10:05:13.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd699de5640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd694071b70 tx=0x7fd68c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00ebc0 con 0x7fd694159880 2023-07-20T10:05:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00ed20 con 0x7fd694159880 2023-07-20T10:05:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c013660 con 0x7fd694159880 2023-07-20T10:05:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6940c3510 con 0x7fd694159880 2023-07-20T10:05:13.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6940c4420 con 0x7fd694159880 2023-07-20T10:05:13.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.251+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940c3a30 con 0x7fd694159880 2023-07-20T10:05:13.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.255+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd68c0137c0 con 0x7fd694159880 2023-07-20T10:05:13.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.255+0000 7fd689ffb640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 0x7fd678068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.255+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fd68c0842d0 con 0x7fd694159880 2023-07-20T10:05:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.255+0000 7fd6995e4640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 0x7fd678068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.255+0000 7fd6995e4640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 0x7fd678068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ad000 tx=0x7fd6900046d0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:13.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.259+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6940c3a30 con 0x7fd694159880 2023-07-20T10:05:13.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:13.407+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6940c3a30 con 0x7fd694159880 2023-07-20T10:05:14.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.071+0000 7fd689ffb640 1 -- 172.21.15.82:0/155675077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd6940c3a30 con 0x7fd694159880 2023-07-20T10:05:14.054 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:05:14.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.075+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 msgr2=0x7fd678068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.075+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 0x7fd678068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd6900ad000 tx=0x7fd6900046d0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.075+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 msgr2=0x7fd6940b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.075+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fd694071b70 tx=0x7fd68c007bc0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 shutdown_connections 2023-07-20T10:05:14.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd6780663a0 0x7fd678068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd694159880 0x7fd6940b30a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6940c2570 0x7fd6940c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 --2- 172.21.15.82:0/155675077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6800039f0 0x7fd6940c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 >> 172.21.15.82:0/155675077 conn(0x7fd6940cad50 msgr2=0x7fd694164b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 shutdown_connections 2023-07-20T10:05:14.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.079+0000 7fd69b848640 1 -- 172.21.15.82:0/155675077 wait complete. 2023-07-20T10:05:14.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:05:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 Processor -- start 2023-07-20T10:05:14.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 -- start start 2023-07-20T10:05:14.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbb4159450 0x7fdbb415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 0x7fdbb40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 0x7fdbb40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb40cce90 con 0x7fdbb4159450 2023-07-20T10:05:14.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb40cc8d0 con 0x7fdbb4159830 2023-07-20T10:05:14.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbbb1fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ccbb0 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbb4159450 0x7fdbb415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbb4159450 0x7fdbb415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48202/0 (socket says 172.21.15.82:48202) 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2884570563 learned_addr learned my addr 172.21.15.82:0/2884570563 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2884570563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 msgr2=0x7fdbb40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb9797640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 0x7fdbb40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2884570563 >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 0x7fdbb40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 0x7fdbb40afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2884570563 >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 msgr2=0x7fdbb40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:14.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2884570563 >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 0x7fdbb40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2884570563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4159cc0 con 0x7fdbb4159450 2023-07-20T10:05:14.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbb9797640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 0x7fdbb40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:14.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.247+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2884570563 >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 0x7fdbb40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:14.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb4159450 0x7fdbb415a4c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdbb415e190 tx=0x7fdbb001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b077d510565633 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbab7fe640 1 -- 172.21.15.82:0/2884570563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00a5730 con 0x7fdbb4159450 2023-07-20T10:05:14.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbab7fe640 1 -- 172.21.15.82:0/2884570563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb00a5890 con 0x7fdbb4159450 2023-07-20T10:05:14.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbab7fe640 1 -- 172.21.15.82:0/2884570563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00a5c20 con 0x7fdbb4159450 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2884570563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb4159450 msgr2=0x7fdbb415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb4159450 0x7fdbb415a4c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdbb415e190 tx=0x7fdbb001c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2884570563 shutdown_connections 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2884570563 >> v2:172.21.15.183:3300/0 conn(0x7fdbb4159830 0x7fdbb40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb40cc3e0 0x7fdbb40afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2884570563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb4159450 0x7fdbb415a4c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2884570563 >> 172.21.15.82:0/2884570563 conn(0x7fdbb40cad50 msgr2=0x7fdbb40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2884570563 shutdown_connections 2023-07-20T10:05:14.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.251+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2884570563 wait complete. 2023-07-20T10:05:14.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 Processor -- start 2023-07-20T10:05:14.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 -- start start 2023-07-20T10:05:14.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 0x7fdbb41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb414edb0 0x7fdbb40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb414e920 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb414dff0 con 0x7fdbb4159450 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbbb1fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb414e2d0 con 0x7fdbb414edb0 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48218/0 (socket says 172.21.15.82:48218) 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2825752531 learned_addr learned my addr 172.21.15.82:0/2825752531 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 0x7fdbb41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb9797640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb414edb0 0x7fdbb40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb414edb0 msgr2=0x7fdbb40c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb414edb0 0x7fdbb40c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 msgr2=0x7fdbb41537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 0x7fdbb41537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 -- 172.21.15.82:0/2825752531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb0009b30 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 0x7fdbb41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.255+0000 7fdbb8f96640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00af040 tx=0x7fdbb0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00b8670 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb00b87d0 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb414e5b0 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00b8b80 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb414dc20 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb404da30 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdbb00b8ce0 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 0x7fdba0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fdbb011ee50 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.259+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 0x7fdba0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.263+0000 7fdbabfff640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 0x7fdba0068890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40c8200 tx=0x7fdba4008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.263+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbb00ec220 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.411+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fdbb40cbbf0 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.415+0000 7fdba97fa640 1 -- 172.21.15.82:0/2825752531 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7fdbb00ef840 con 0x7fdbb40cc3e0 2023-07-20T10:05:14.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 msgr2=0x7fdba0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 0x7fdba0068890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40c8200 tx=0x7fdba4008040 comp rx=0 tx=0).stop 2023-07-20T10:05:14.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 msgr2=0x7fdbb40c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fdbb00af040 tx=0x7fdbb0019740 comp rx=0 tx=0).stop 2023-07-20T10:05:14.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 shutdown_connections 2023-07-20T10:05:14.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbb414edb0 0x7fdbb40c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbb4159450 0x7fdbb41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fdba00663d0 0x7fdba0068890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 --2- 172.21.15.82:0/2825752531 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb40cc3e0 0x7fdbb40c7cc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 >> 172.21.15.82:0/2825752531 conn(0x7fdbb40cad50 msgr2=0x7fdbb415acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 shutdown_connections 2023-07-20T10:05:14.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.419+0000 7fdbbb1fa640 1 -- 172.21.15.82:0/2825752531 wait complete. 2023-07-20T10:05:14.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:05:14.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 Processor -- start 2023-07-20T10:05:14.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 -- start start 2023-07-20T10:05:14.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75a8159450 0x7f75a815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f75a8159830 0x7f75a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80cc8d0 con 0x7f75a80cc3e0 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80cce90 con 0x7f75a8159450 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75aeb2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80ccbb0 con 0x7f75a8159830 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75a8159450 0x7f75a815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f75a8159450 0x7f75a815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48222/0 (socket says 172.21.15.82:48222) 2023-07-20T10:05:14.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 -- 172.21.15.82:0/87756068 learned_addr learned my addr 172.21.15.82:0/87756068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f759ffff640 1 --2- 172.21.15.82:0/87756068 >> v2:172.21.15.183:3300/0 conn(0x7f75a8159830 0x7f75a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 -- 172.21.15.82:0/87756068 >> v2:172.21.15.183:3300/0 conn(0x7f75a8159830 msgr2=0x7f75a80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:14.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 --2- 172.21.15.82:0/87756068 >> v2:172.21.15.183:3300/0 conn(0x7f75a8159830 0x7f75a80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 -- 172.21.15.82:0/87756068 >> v1:172.21.15.82:6789/0 conn(0x7f75a80cc3e0 legacy=0x7f75a80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.579+0000 7f75ac8c8640 1 -- 172.21.15.82:0/87756068 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8159cc0 con 0x7f75a8159450 2023-07-20T10:05:14.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75ac8c8640 1 --2- 172.21.15.82:0/87756068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8159450 0x7f75a815a4c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f75a815e190 tx=0x7f75a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a61b6d8a0d04271 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f759f7fe640 1 -- 172.21.15.82:0/87756068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40aa610 con 0x7f75a8159450 2023-07-20T10:05:14.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f759f7fe640 1 -- 172.21.15.82:0/87756068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a40a6040 con 0x7f75a8159450 2023-07-20T10:05:14.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f759f7fe640 1 -- 172.21.15.82:0/87756068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a40aa990 con 0x7f75a8159450 2023-07-20T10:05:14.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- 172.21.15.82:0/87756068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8159450 msgr2=0x7f75a815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/87756068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8159450 0x7f75a815a4c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f75a815e190 tx=0x7f75a401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- 172.21.15.82:0/87756068 shutdown_connections 2023-07-20T10:05:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/87756068 >> v2:172.21.15.183:3300/0 conn(0x7f75a8159830 0x7f75a80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/87756068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8159450 0x7f75a815a4c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- 172.21.15.82:0/87756068 >> 172.21.15.82:0/87756068 conn(0x7f75a80cad50 msgr2=0x7f75a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- 172.21.15.82:0/87756068 shutdown_connections 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- 172.21.15.82:0/87756068 wait complete. 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 Processor -- start 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.583+0000 7f75aeb2c640 1 -- start start 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a80cc3e0 0x7f75a80c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a8159450 0x7f75a814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8154180 con 0x7f75a8152db0 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a814f630 con 0x7f75a80cc3e0 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8153600 con 0x7f75a8159450 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48230/0 (socket says 172.21.15.82:48230) 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 -- 172.21.15.82:0/3129387778 learned_addr learned my addr 172.21.15.82:0/3129387778 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ac8c8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a80cc3e0 0x7f75a80c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f759ffff640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a8159450 0x7f75a814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 -- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a8159450 msgr2=0x7f75a814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a8159450 0x7f75a814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 -- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a80cc3e0 msgr2=0x7f75a80c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a80cc3e0 0x7f75a80c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 -- 172.21.15.82:0/3129387778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40094d0 con 0x7f75a8152db0 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75ad0c9640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c7a0 tx=0x7f75a000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a0003b80 con 0x7f75a8152db0 2023-07-20T10:05:14.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a0003ce0 con 0x7f75a8152db0 2023-07-20T10:05:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a000aa30 con 0x7f75a8152db0 2023-07-20T10:05:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a81538e0 con 0x7f75a8152db0 2023-07-20T10:05:14.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a8153ea0 con 0x7f75a8152db0 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.587+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a804da30 con 0x7f75a8152db0 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.591+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f75a000ab90 con 0x7f75a8152db0 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.591+0000 7f759d7fa640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 0x7f7594068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.591+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f75a0083be0 con 0x7f75a8152db0 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.591+0000 7f75ac8c8640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 0x7f7594068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.591+0000 7f75ac8c8640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 0x7f7594068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f75a40ae000 tx=0x7f75a40b5040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.595+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75a0051050 con 0x7f75a8152db0 2023-07-20T10:05:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.739+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f75a80cbbf0 con 0x7f75a8152db0 2023-07-20T10:05:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.743+0000 7f759d7fa640 1 -- 172.21.15.82:0/3129387778 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f75a0054670 con 0x7f75a8152db0 2023-07-20T10:05:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 msgr2=0x7f7594068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 0x7f7594068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f75a40ae000 tx=0x7f75a40b5040 comp rx=0 tx=0).stop 2023-07-20T10:05:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 msgr2=0x7f75a80705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c7a0 tx=0x7f75a000cc60 comp rx=0 tx=0).stop 2023-07-20T10:05:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 shutdown_connections 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f75940663a0 0x7f7594068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75a8152db0 0x7f75a80705e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f75a8159450 0x7f75a814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 --2- 172.21.15.82:0/3129387778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f75a80cc3e0 0x7f75a80c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 >> 172.21.15.82:0/3129387778 conn(0x7f75a80cad50 msgr2=0x7f75a80ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 shutdown_connections 2023-07-20T10:05:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.747+0000 7f75aeb2c640 1 -- 172.21.15.82:0/3129387778 wait complete. 2023-07-20T10:05:14.756 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:05:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 Processor -- start 2023-07-20T10:05:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 -- start start 2023-07-20T10:05:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb4c06f710 0x7fcb4c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c070030 con 0x7fcb4c15a6f0 2023-07-20T10:05:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c071950 con 0x7fcb4c0ca5a0 2023-07-20T10:05:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb51b2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c15bad0 con 0x7fcb4c06f710 2023-07-20T10:05:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb4c06f710 0x7fcb4c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcb4c06f710 0x7fcb4c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48240/0 (socket says 172.21.15.82:48240) 2023-07-20T10:05:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/4139708539 learned_addr learned my addr 172.21.15.82:0/4139708539 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/4139708539 >> v1:172.21.15.183:6789/0 conn(0x7fcb4c0ca5a0 legacy=0x7fcb4c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/4139708539 >> v1:172.21.15.82:6789/0 conn(0x7fcb4c15a6f0 legacy=0x7fcb4c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.915+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/4139708539 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c15b230 con 0x7fcb4c06f710 2023-07-20T10:05:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb4b7fe640 1 --2- 172.21.15.82:0/4139708539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c06faf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f153fed7bdb3fc1e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb4a7fc640 1 -- 172.21.15.82:0/4139708539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0aa430 con 0x7fcb4c06f710 2023-07-20T10:05:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb4a7fc640 1 -- 172.21.15.82:0/4139708539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0aa590 con 0x7fcb4c06f710 2023-07-20T10:05:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb4a7fc640 1 -- 172.21.15.82:0/4139708539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0aa920 con 0x7fcb4c06f710 2023-07-20T10:05:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 -- 172.21.15.82:0/4139708539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 msgr2=0x7fcb4c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/4139708539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c06faf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009870 tx=0x7fcb3c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 -- 172.21.15.82:0/4139708539 shutdown_connections 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/4139708539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c06faf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 -- 172.21.15.82:0/4139708539 >> 172.21.15.82:0/4139708539 conn(0x7fcb4c0cad50 msgr2=0x7fcb4c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 -- 172.21.15.82:0/4139708539 shutdown_connections 2023-07-20T10:05:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.919+0000 7fcb51b2c640 1 -- 172.21.15.82:0/4139708539 wait complete. 2023-07-20T10:05:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 Processor -- start 2023-07-20T10:05:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- start start 2023-07-20T10:05:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c0ca5a0 0x7fcb4c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb4c15a6f0 0x7fcb4c0b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c158760 con 0x7fcb4c06f710 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0b1800 con 0x7fcb4c0ca5a0 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0b1ae0 con 0x7fcb4c15a6f0 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48256/0 (socket says 172.21.15.82:48256) 2023-07-20T10:05:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/2823812418 learned_addr learned my addr 172.21.15.82:0/2823812418 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4affd640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c0ca5a0 0x7fcb4c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4bfff640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb4c15a6f0 0x7fcb4c0b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb4c15a6f0 msgr2=0x7fcb4c0b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb4c15a6f0 0x7fcb4c0b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c0ca5a0 msgr2=0x7fcb4c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c0ca5a0 0x7fcb4c0cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:14.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 -- 172.21.15.82:0/2823812418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0094d0 con 0x7fcb4c06f710 2023-07-20T10:05:14.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb4b7fe640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ac040 tx=0x7fcb3c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b38c0 con 0x7fcb4c06f710 2023-07-20T10:05:14.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0b3a40 con 0x7fcb4c06f710 2023-07-20T10:05:14.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b3df0 con 0x7fcb4c06f710 2023-07-20T10:05:14.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0b1dc0 con 0x7fcb4c06f710 2023-07-20T10:05:14.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.923+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0b1490 con 0x7fcb4c06f710 2023-07-20T10:05:14.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c04da30 con 0x7fcb4c06f710 2023-07-20T10:05:14.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcb3c0b2380 con 0x7fcb4c06f710 2023-07-20T10:05:14.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb33fff640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 0x7fcb38068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fcb3c11e5a0 con 0x7fcb4c06f710 2023-07-20T10:05:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb4affd640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 0x7fcb38068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.927+0000 7fcb4affd640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 0x7fcb38068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c1f8300 tx=0x7fcb40009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:14.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:14.931+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb3c0eb910 con 0x7fcb4c06f710 2023-07-20T10:05:15.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.079+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcb4c0cb940 con 0x7fcb4c06f710 2023-07-20T10:05:15.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.083+0000 7fcb33fff640 1 -- 172.21.15.82:0/2823812418 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb3c0eef30 con 0x7fcb4c06f710 2023-07-20T10:05:15.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 msgr2=0x7fcb38068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 0x7fcb38068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c1f8300 tx=0x7fcb40009040 comp rx=0 tx=0).stop 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 msgr2=0x7fcb4c154f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ac040 tx=0x7fcb3c01ad10 comp rx=0 tx=0).stop 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 shutdown_connections 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcb4c15a6f0 0x7fcb4c0b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c0ca5a0 0x7fcb4c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcb380663a0 0x7fcb38068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 --2- 172.21.15.82:0/2823812418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb4c06f710 0x7fcb4c154f30 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 >> 172.21.15.82:0/2823812418 conn(0x7fcb4c0cad50 msgr2=0x7fcb4c0cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:15.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 shutdown_connections 2023-07-20T10:05:15.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.087+0000 7fcb51b2c640 1 -- 172.21.15.82:0/2823812418 wait complete. 2023-07-20T10:05:15.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-20T10:05:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.243+0000 7f8e37b37640 1 Processor -- start 2023-07-20T10:05:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.243+0000 7f8e37b37640 1 -- start start 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e301596b0 0x7f8e3015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 0x7f8e300ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300b2380 0x7f8e300b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300b2d50 con 0x7f8e301596b0 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300ad600 con 0x7f8e300cc900 2023-07-20T10:05:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e37b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300ccd90 con 0x7f8e300b2380 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e301596b0 0x7f8e3015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8e301596b0 0x7f8e3015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48272/0 (socket says 172.21.15.82:48272) 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 -- 172.21.15.82:0/1151670884 learned_addr learned my addr 172.21.15.82:0/1151670884 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e360d4640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300b2380 0x7f8e300b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e350d2640 1 --2- 172.21.15.82:0/1151670884 >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 0x7f8e300ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 -- 172.21.15.82:0/1151670884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300b2380 msgr2=0x7f8e300b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300b2380 0x7f8e300b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 -- 172.21.15.82:0/1151670884 >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 msgr2=0x7f8e300ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 --2- 172.21.15.82:0/1151670884 >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 0x7f8e300ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 -- 172.21.15.82:0/1151670884 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300ad810 con 0x7f8e301596b0 2023-07-20T10:05:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e350d2640 1 --2- 172.21.15.82:0/1151670884 >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 0x7f8e300ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.247+0000 7f8e358d3640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3015dbb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00bb10 tx=0x7f8e2c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff7a6e69800f3d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e348d1640 1 -- 172.21.15.82:0/1151670884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0a7c30 con 0x7f8e301596b0 2023-07-20T10:05:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e348d1640 1 -- 172.21.15.82:0/1151670884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0a7d90 con 0x7f8e301596b0 2023-07-20T10:05:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e348d1640 1 -- 172.21.15.82:0/1151670884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0af660 con 0x7f8e301596b0 2023-07-20T10:05:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- 172.21.15.82:0/1151670884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 msgr2=0x7f8e3015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3015dbb0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00bb10 tx=0x7f8e2c01eba0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- 172.21.15.82:0/1151670884 shutdown_connections 2023-07-20T10:05:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- 172.21.15.82:0/1151670884 >> v2:172.21.15.183:3300/0 conn(0x7f8e300cc900 0x7f8e300ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300b2380 0x7f8e300b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- 172.21.15.82:0/1151670884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3015dbb0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- 172.21.15.82:0/1151670884 >> 172.21.15.82:0/1151670884 conn(0x7f8e300cada0 msgr2=0x7f8e300cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- 172.21.15.82:0/1151670884 shutdown_connections 2023-07-20T10:05:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- 172.21.15.82:0/1151670884 wait complete. 2023-07-20T10:05:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 Processor -- start 2023-07-20T10:05:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- start start 2023-07-20T10:05:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 0x7f8e300b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 0x7f8e30157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30099d50 con 0x7f8e301596b0 2023-07-20T10:05:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30158030 con 0x7f8e300b2380 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.251+0000 7f8e37b37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3009b1d0 con 0x7f8e300cc900 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48282/0 (socket says 172.21.15.82:48282) 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 -- 172.21.15.82:0/71680661 learned_addr learned my addr 172.21.15.82:0/71680661 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e350d2640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 0x7f8e30157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e358d3640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 0x7f8e300b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 -- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 msgr2=0x7f8e30157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 0x7f8e30157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 -- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 msgr2=0x7f8e300b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 0x7f8e300b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 -- 172.21.15.82:0/71680661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c00b770 con 0x7f8e301596b0 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e358d3640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 0x7f8e300b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e350d2640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 0x7f8e30157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e360d4640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8e28007e60 tx=0x7f8e2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28014620 con 0x7f8e301596b0 2023-07-20T10:05:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800ee90 con 0x7f8e301596b0 2023-07-20T10:05:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e280149e0 con 0x7f8e301596b0 2023-07-20T10:05:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3009b4b0 con 0x7f8e301596b0 2023-07-20T10:05:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e301572f0 con 0x7f8e301596b0 2023-07-20T10:05:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e30073c70 con 0x7f8e301596b0 2023-07-20T10:05:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8e28014b40 con 0x7f8e301596b0 2023-07-20T10:05:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.255+0000 7f8e267fc640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 0x7f8e14068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.259+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8e280847d0 con 0x7f8e301596b0 2023-07-20T10:05:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.259+0000 7f8e358d3640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 0x7f8e14068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.259+0000 7f8e358d3640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 0x7f8e14068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0b1000 tx=0x7f8e2c008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.259+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e28051b10 con 0x7f8e301596b0 2023-07-20T10:05:15.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:15.459+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f8e300cbbd0 con 0x7f8e301596b0 2023-07-20T10:05:16.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e267fc640 1 -- 172.21.15.82:0/71680661 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v542) v1 ==== 154+0+0 (secure 0 0 0) 0x7f8e28055130 con 0x7f8e301596b0 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 msgr2=0x7f8e14068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 0x7f8e14068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0b1000 tx=0x7f8e2c008040 comp rx=0 tx=0).stop 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 msgr2=0x7f8e3009a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8e28007e60 tx=0x7f8e2800e4b0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 shutdown_connections 2023-07-20T10:05:16.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8e140663a0 0x7f8e14068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e301596b0 0x7f8e3009a600 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e300cc900 0x7f8e30157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 --2- 172.21.15.82:0/71680661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e300b2380 0x7f8e300b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 >> 172.21.15.82:0/71680661 conn(0x7f8e300cada0 msgr2=0x7f8e300acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 shutdown_connections 2023-07-20T10:05:16.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.075+0000 7f8e37b37640 1 -- 172.21.15.82:0/71680661 wait complete. 2023-07-20T10:05:16.078 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-07-20T10:05:16.079 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-07-20T10:05:16.079 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:05:16.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-20T10:05:16.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 Processor -- start 2023-07-20T10:05:16.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 -- start start 2023-07-20T10:05:16.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 0x7f43f00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f00ce4c0 0x7f43f00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f00d16b0 con 0x7f43f00d0d10 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f00d31c0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f6b52640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f00b3520 con 0x7f43f015cab0 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f00ce4c0 0x7f43f00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f00ce4c0 0x7f43f00d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48298/0 (socket says 172.21.15.82:48298) 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 -- 172.21.15.82:0/2796559482 learned_addr learned my addr 172.21.15.82:0/2796559482 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:16.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f48ee640 1 --2- 172.21.15.82:0/2796559482 >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 0x7f43f00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 -- 172.21.15.82:0/2796559482 >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 msgr2=0x7f43f00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:16.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 --2- 172.21.15.82:0/2796559482 >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 0x7f43f00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 -- 172.21.15.82:0/2796559482 >> v1:172.21.15.183:6789/0 conn(0x7f43f00d0d10 legacy=0x7f43f00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:16.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f50ef640 1 -- 172.21.15.82:0/2796559482 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f00b2910 con 0x7f43f00ce4c0 2023-07-20T10:05:16.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.239+0000 7f43f48ee640 1 --2- 172.21.15.82:0/2796559482 >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 0x7f43f00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:16.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f50ef640 1 --2- 172.21.15.82:0/2796559482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f00d1170 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f43f006a660 tx=0x7f43e801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fffe637b2e2422 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:16.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43e77fe640 1 -- 172.21.15.82:0/2796559482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a5740 con 0x7f43f00ce4c0 2023-07-20T10:05:16.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43e77fe640 1 -- 172.21.15.82:0/2796559482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e80a58a0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43e77fe640 1 -- 172.21.15.82:0/2796559482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80a5c30 con 0x7f43f00ce4c0 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 -- 172.21.15.82:0/2796559482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 msgr2=0x7f43f00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 --2- 172.21.15.82:0/2796559482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f00d1170 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f43f006a660 tx=0x7f43e801c960 comp rx=0 tx=0).stop 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 -- 172.21.15.82:0/2796559482 shutdown_connections 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 --2- 172.21.15.82:0/2796559482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f00d1170 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 --2- 172.21.15.82:0/2796559482 >> v2:172.21.15.183:3300/0 conn(0x7f43f015cab0 0x7f43f00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 -- 172.21.15.82:0/2796559482 >> 172.21.15.82:0/2796559482 conn(0x7f43f008c120 msgr2=0x7f43f009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:16.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 -- 172.21.15.82:0/2796559482 shutdown_connections 2023-07-20T10:05:16.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.243+0000 7f43f6b52640 1 -- 172.21.15.82:0/2796559482 wait complete. 2023-07-20T10:05:16.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 Processor -- start 2023-07-20T10:05:16.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- start start 2023-07-20T10:05:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f00d0d10 0x7f43f00b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f015cab0 0x7f43f00d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00ca8c0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00b5dc0 con 0x7f43f00d0d10 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f00b60a0 con 0x7f43f015cab0 2023-07-20T10:05:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48310/0 (socket says 172.21.15.82:48310) 2023-07-20T10:05:16.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 -- 172.21.15.82:0/214974702 learned_addr learned my addr 172.21.15.82:0/214974702 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:16.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f50ef640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f015cab0 0x7f43f00d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43e7fff640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f00d0d10 0x7f43f00b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 -- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f015cab0 msgr2=0x7f43f00d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:16.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f015cab0 0x7f43f00d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 -- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f00d0d10 msgr2=0x7f43f00b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:16.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f00d0d10 0x7f43f00b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 -- 172.21.15.82:0/214974702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8009b30 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f48ee640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e810 tx=0x7f43ec00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00c8d0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec00ca30 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec00cdc0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f00b6380 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.247+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f00cade0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f0073c70 con 0x7f43f00ce4c0 2023-07-20T10:05:16.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43ec013410 con 0x7f43f00ce4c0 2023-07-20T10:05:16.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43e57fa640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 0x7f43dc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:16.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f43ec083ce0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43e7fff640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 0x7f43dc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:16.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.251+0000 7f43e7fff640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 0x7f43dc068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43f00c8e80 tx=0x7f43e0009060 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:16.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.255+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43ec050fc0 con 0x7f43f00ce4c0 2023-07-20T10:05:16.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:16.459+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f43f00b77a0 con 0x7f43f00ce4c0 2023-07-20T10:05:17.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.075+0000 7f43e57fa640 1 -- 172.21.15.82:0/214974702 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v543) v1 ==== 159+0+0 (secure 0 0 0) 0x7f43ec009480 con 0x7f43f00ce4c0 2023-07-20T10:05:17.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 msgr2=0x7f43dc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 0x7f43dc068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43f00c8e80 tx=0x7f43e0009060 comp rx=0 tx=0).stop 2023-07-20T10:05:17.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 msgr2=0x7f43f0155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00e810 tx=0x7f43ec00ecd0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 shutdown_connections 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f015cab0 0x7f43f00d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f00d0d10 0x7f43f00b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f43dc0663a0 0x7f43dc068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 --2- 172.21.15.82:0/214974702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f00ce4c0 0x7f43f0155d70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 >> 172.21.15.82:0/214974702 conn(0x7f43f008c120 msgr2=0x7f43f006be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 shutdown_connections 2023-07-20T10:05:17.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.079+0000 7f43f6b52640 1 -- 172.21.15.82:0/214974702 wait complete. 2023-07-20T10:05:17.082 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:17.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.239+0000 7f3a8d98f640 1 Processor -- start 2023-07-20T10:05:17.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.239+0000 7f3a8d98f640 1 -- start start 2023-07-20T10:05:17.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a8d98f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a8815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a8d98f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a880cc900 0x7f3a880ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a8d98f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880ccd90 con 0x7f3a881596b0 2023-07-20T10:05:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a8d98f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880ad600 con 0x7f3a880cc900 2023-07-20T10:05:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a8d98f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880ad810 con 0x7f3a880b2a90 2023-07-20T10:05:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a86ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3a881596b0 0x7f3a880b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52068/0 (socket says 172.21.15.82:52068) 2023-07-20T10:05:17.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a86ffd640 1 -- 172.21.15.82:0/252749372 learned_addr learned my addr 172.21.15.82:0/252749372 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a877fe640 1 --2- 172.21.15.82:0/252749372 >> v2:172.21.15.183:3300/0 conn(0x7f3a880cc900 0x7f3a880ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a867fc640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a8815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407584499 0 0) 0x7f3a880ccd90 con 0x7f3a881596b0 2023-07-20T10:05:17.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a70003530 con 0x7f3a881596b0 2023-07-20T10:05:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136970776 0 0) 0x7f3a70003530 con 0x7f3a881596b0 2023-07-20T10:05:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a877fe640 1 -- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 msgr2=0x7f3a8815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a877fe640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a8815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a877fe640 1 -- 172.21.15.82:0/252749372 >> v1:172.21.15.82:6789/0 conn(0x7f3a881596b0 legacy=0x7f3a880b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.243+0000 7f3a877fe640 1 -- 172.21.15.82:0/252749372 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8815d0d0 con 0x7f3a880cc900 2023-07-20T10:05:17.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a877fe640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880ad0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009d90 tx=0x7f3a8001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9e6451272184c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78001680 con 0x7f3a880cc900 2023-07-20T10:05:17.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a800a5640 con 0x7f3a880cc900 2023-07-20T10:05:17.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a85ffb640 1 -- 172.21.15.82:0/252749372 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800a59d0 con 0x7f3a880cc900 2023-07-20T10:05:17.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 msgr2=0x7f3a880ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880ad0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009d90 tx=0x7f3a8001c840 comp rx=0 tx=0).stop 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- 172.21.15.82:0/252749372 shutdown_connections 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880ad0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/252749372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a8815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- 172.21.15.82:0/252749372 >> 172.21.15.82:0/252749372 conn(0x7f3a880cada0 msgr2=0x7f3a880cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- 172.21.15.82:0/252749372 shutdown_connections 2023-07-20T10:05:17.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- 172.21.15.82:0/252749372 wait complete. 2023-07-20T10:05:17.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 Processor -- start 2023-07-20T10:05:17.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- start start 2023-07-20T10:05:17.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a88153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8815a560 con 0x7f3a881596b0 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880c4ad0 con 0x7f3a880cc900 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.247+0000 7f3a8d98f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a88159c30 con 0x7f3a880b2a90 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48314/0 (socket says 172.21.15.82:48314) 2023-07-20T10:05:17.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 -- 172.21.15.82:0/1615179562 learned_addr learned my addr 172.21.15.82:0/1615179562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a867fc640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a86ffd640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a88153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 -- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 msgr2=0x7f3a88153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a88153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 -- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 msgr2=0x7f3a880c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 -- 172.21.15.82:0/1615179562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80009a70 con 0x7f3a881596b0 2023-07-20T10:05:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a867fc640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a86ffd640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a88153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a877fe640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3a800b0040 tx=0x7f3a800195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800ad850 con 0x7f3a881596b0 2023-07-20T10:05:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a800ad9b0 con 0x7f3a881596b0 2023-07-20T10:05:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800adda0 con 0x7f3a881596b0 2023-07-20T10:05:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a88159f10 con 0x7f3a881596b0 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880c3e60 con 0x7f3a881596b0 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8815a6d0 con 0x7f3a881596b0 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3a800b4050 con 0x7f3a881596b0 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.251+0000 7f3a6ffff640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 0x7f3a74068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.255+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3a8011edc0 con 0x7f3a881596b0 2023-07-20T10:05:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.255+0000 7f3a86ffd640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 0x7f3a74068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.255+0000 7f3a86ffd640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 0x7f3a74068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005890 tx=0x7f3a78009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.259+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a800ec220 con 0x7f3a881596b0 2023-07-20T10:05:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.403+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a88073c70 con 0x7f3a881596b0 2023-07-20T10:05:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a6ffff640 1 -- 172.21.15.82:0/1615179562 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+15750 (secure 0 0 0) 0x7f3a800b2070 con 0x7f3a881596b0 2023-07-20T10:05:17.387 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:17.388 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":73,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:14.064314+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6834/1320222659":"2023-07-21T10:05:10.767917+0000","172.21.15.183:6832/1320222659":"2023-07-21T10:05:10.767917+0000","172.21.15.82:0/3191662334":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6833/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:6832/4292533700":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/3397616520":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1792465488":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2668626711":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/1462509814":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3057720573":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1651242703":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/2715518898":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/2140941636":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/3208760881":"2023-07-21T10:03:18.691909+0000","172.21.15.82:0/1188963073":"2023-07-21T10:05:07.917787+0000","172.21.15.82:0/4160992300":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6833/3713806871":"2023-07-21T10:03:18.691909+0000","172.21.15.82:6832/3713806871":"2023-07-21T10:03:18.691909+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 msgr2=0x7f3a74068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 0x7f3a74068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a78005890 tx=0x7f3a78009040 comp rx=0 tx=0).stop 2023-07-20T10:05:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 msgr2=0x7f3a880b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f3a800b0040 tx=0x7f3a800195e0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 shutdown_connections 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3a740663a0 0x7f3a74068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a881596b0 0x7f3a880b1dd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a880cc900 0x7f3a880c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 --2- 172.21.15.82:0/1615179562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a880b2a90 0x7f3a88153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 >> 172.21.15.82:0/1615179562 conn(0x7f3a880cada0 msgr2=0x7f3a88071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 shutdown_connections 2023-07-20T10:05:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.407+0000 7f3a8d98f640 1 -- 172.21.15.82:0/1615179562 wait complete. 2023-07-20T10:05:17.408 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:17.409 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:17.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.567+0000 7f0f003ba640 1 Processor -- start 2023-07-20T10:05:17.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.567+0000 7f0f003ba640 1 -- start start 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0f003ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806c120 0x7f0ef80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0f003ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ef81602b0 0x7f0ef8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0f003ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef80d0970 con 0x7f0ef806ab10 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0f003ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef8160e20 con 0x7f0ef81602b0 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0f003ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80cd300 con 0x7f0ef806c120 2023-07-20T10:05:17.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efe957640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0ef806ab10 0x7f0ef806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52076/0 (socket says 172.21.15.82:52076) 2023-07-20T10:05:17.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efe957640 1 -- 172.21.15.82:0/100326388 learned_addr learned my addr 172.21.15.82:0/100326388 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:17.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd955640 1 --2- 172.21.15.82:0/100326388 >> v2:172.21.15.183:3300/0 conn(0x7f0ef81602b0 0x7f0ef8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efe156640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806c120 0x7f0ef80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd154640 1 -- 172.21.15.82:0/100326388 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693840729 0 0) 0x7f0ef80d0970 con 0x7f0ef806ab10 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd154640 1 -- 172.21.15.82:0/100326388 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ee4003530 con 0x7f0ef806ab10 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd955640 1 -- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806c120 msgr2=0x7f0ef80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd955640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806c120 0x7f0ef80cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd955640 1 -- 172.21.15.82:0/100326388 >> v1:172.21.15.82:6789/0 conn(0x7f0ef806ab10 legacy=0x7f0ef806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.571+0000 7f0efd955640 1 -- 172.21.15.82:0/100326388 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80cd5e0 con 0x7f0ef81602b0 2023-07-20T10:05:17.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0efd955640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef81602b0 0x7f0ef8160710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b4366a93f06823e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0efd154640 1 -- 172.21.15.82:0/100326388 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80ab600 con 0x7f0ef81602b0 2023-07-20T10:05:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0efd154640 1 -- 172.21.15.82:0/100326388 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee80a7050 con 0x7f0ef81602b0 2023-07-20T10:05:17.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0efd154640 1 -- 172.21.15.82:0/100326388 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee80ab980 con 0x7f0ef81602b0 2023-07-20T10:05:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef81602b0 msgr2=0x7f0ef8160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef81602b0 0x7f0ef8160710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0ee80097c0 tx=0x7f0ee801c3f0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- 172.21.15.82:0/100326388 shutdown_connections 2023-07-20T10:05:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef81602b0 0x7f0ef8160710 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 --2- 172.21.15.82:0/100326388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806c120 0x7f0ef80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- 172.21.15.82:0/100326388 >> 172.21.15.82:0/100326388 conn(0x7f0ef808c0a0 msgr2=0x7f0ef809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- 172.21.15.82:0/100326388 shutdown_connections 2023-07-20T10:05:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- 172.21.15.82:0/100326388 wait complete. 2023-07-20T10:05:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 Processor -- start 2023-07-20T10:05:17.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.575+0000 7f0f003ba640 1 -- start start 2023-07-20T10:05:17.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806ab10 0x7f0ef80c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef806c120 0x7f0ef81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8155180 con 0x7f0ef81602b0 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c8030 con 0x7f0ef806c120 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c9e10 con 0x7f0ef806ab10 2023-07-20T10:05:17.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48318/0 (socket says 172.21.15.82:48318) 2023-07-20T10:05:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 -- 172.21.15.82:0/902751897 learned_addr learned my addr 172.21.15.82:0/902751897 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efd955640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef806c120 0x7f0ef81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe156640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806ab10 0x7f0ef80c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 -- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806ab10 msgr2=0x7f0ef80c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806ab10 0x7f0ef80c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 -- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef806c120 msgr2=0x7f0ef81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef806c120 0x7f0ef81546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 -- 172.21.15.82:0/902751897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee8009420 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0efe957640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000cb40 tx=0x7f0ef000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000aca0 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef000ae00 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0012620 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef80c8260 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef80c97c0 con 0x7f0ef81602b0 2023-07-20T10:05:17.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.579+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef80c9f80 con 0x7f0ef81602b0 2023-07-20T10:05:17.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.583+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ef0007070 con 0x7f0ef81602b0 2023-07-20T10:05:17.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.583+0000 7f0eeeffd640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 0x7f0edc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.583+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f0ef0083d50 con 0x7f0ef81602b0 2023-07-20T10:05:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.583+0000 7f0efe156640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 0x7f0edc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.583+0000 7f0efe156640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 0x7f0edc068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8160210 tx=0x7f0ef4009190 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.587+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ef0087030 con 0x7f0ef81602b0 2023-07-20T10:05:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.731+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ef804da30 con 0x7f0ef81602b0 2023-07-20T10:05:17.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.731+0000 7f0eeeffd640 1 -- 172.21.15.82:0/902751897 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ef0017020 con 0x7f0ef81602b0 2023-07-20T10:05:17.715 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 msgr2=0x7f0edc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 0x7f0edc068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8160210 tx=0x7f0ef4009190 comp rx=0 tx=0).stop 2023-07-20T10:05:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 msgr2=0x7f0ef81563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000cb40 tx=0x7f0ef000a060 comp rx=0 tx=0).stop 2023-07-20T10:05:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 shutdown_connections 2023-07-20T10:05:17.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0edc0663a0 0x7f0edc068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ef81602b0 0x7f0ef81563a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ef806c120 0x7f0ef81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 --2- 172.21.15.82:0/902751897 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ef806ab10 0x7f0ef80c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 >> 172.21.15.82:0/902751897 conn(0x7f0ef808c0a0 msgr2=0x7f0ef80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 shutdown_connections 2023-07-20T10:05:17.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.735+0000 7f0f003ba640 1 -- 172.21.15.82:0/902751897 wait complete. 2023-07-20T10:05:17.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:17.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 Processor -- start 2023-07-20T10:05:17.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 -- start start 2023-07-20T10:05:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf0159830 0x7fadf00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadf00cc3e0 0x7fadf00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00cc8d0 con 0x7fadf0159450 2023-07-20T10:05:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00cce90 con 0x7fadf00cc3e0 2023-07-20T10:05:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf852c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ccbb0 con 0x7fadf0159830 2023-07-20T10:05:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadf00cc3e0 0x7fadf00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fadf00cc3e0 0x7fadf00afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48332/0 (socket says 172.21.15.82:48332) 2023-07-20T10:05:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 -- 172.21.15.82:0/216951648 learned_addr learned my addr 172.21.15.82:0/216951648 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf5ac7640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf0159830 0x7fadf00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 -- 172.21.15.82:0/216951648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf0159830 msgr2=0x7fadf00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf0159830 0x7fadf00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 -- 172.21.15.82:0/216951648 >> v1:172.21.15.183:6789/0 conn(0x7fadf0159450 legacy=0x7fadf015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.895+0000 7fadf6ac9640 1 -- 172.21.15.82:0/216951648 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0159cc0 con 0x7fadf00cc3e0 2023-07-20T10:05:17.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf6ac9640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf00cc3e0 0x7fadf00afd50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fade800bb10 tx=0x7fade801ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3058a9555848681b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf52c6640 1 -- 172.21.15.82:0/216951648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80a7bc0 con 0x7fadf00cc3e0 2023-07-20T10:05:17.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf52c6640 1 -- 172.21.15.82:0/216951648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80a7d20 con 0x7fadf00cc3e0 2023-07-20T10:05:17.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf52c6640 1 -- 172.21.15.82:0/216951648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80af660 con 0x7fadf00cc3e0 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 -- 172.21.15.82:0/216951648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf00cc3e0 msgr2=0x7fadf00afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf00cc3e0 0x7fadf00afd50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fade800bb10 tx=0x7fade801ebe0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 -- 172.21.15.82:0/216951648 shutdown_connections 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf00cc3e0 0x7fadf00afd50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 --2- 172.21.15.82:0/216951648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf0159830 0x7fadf00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 -- 172.21.15.82:0/216951648 >> 172.21.15.82:0/216951648 conn(0x7fadf00cad50 msgr2=0x7fadf00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:17.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 -- 172.21.15.82:0/216951648 shutdown_connections 2023-07-20T10:05:17.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.899+0000 7fadf852c640 1 -- 172.21.15.82:0/216951648 wait complete. 2023-07-20T10:05:17.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 Processor -- start 2023-07-20T10:05:17.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- start start 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cc3e0 0x7fadf014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf01f4ca0 0x7fadf00705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c34a0 con 0x7fadf0159450 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf014ff30 con 0x7fadf01f4ca0 2023-07-20T10:05:17.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0150210 con 0x7fadf00cc3e0 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48334/0 (socket says 172.21.15.82:48334) 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 -- 172.21.15.82:0/1059012631 learned_addr learned my addr 172.21.15.82:0/1059012631 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf6ac9640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf01f4ca0 0x7fadf00705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf62c8640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cc3e0 0x7fadf014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 -- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cc3e0 msgr2=0x7fadf014c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cc3e0 0x7fadf014c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 -- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf01f4ca0 msgr2=0x7fadf00705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf01f4ca0 0x7fadf00705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 -- 172.21.15.82:0/1059012631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade800b770 con 0x7fadf0159450 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf5ac7640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fade000e870 tx=0x7fade000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0009510 con 0x7fadf0159450 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade000eec0 con 0x7fadf0159450 2023-07-20T10:05:17.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf01504f0 con 0x7fadf0159450 2023-07-20T10:05:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000cb40 con 0x7fadf0159450 2023-07-20T10:05:17.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.903+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0150ab0 con 0x7fadf0159450 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf004da30 con 0x7fadf0159450 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fade000cca0 con 0x7fadf0159450 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fade6ffd640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 0x7fadd4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fade0083e70 con 0x7fadf0159450 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fadf62c8640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 0x7fadd4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:17.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.907+0000 7fadf62c8640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 0x7fadd4068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadec0012f0 tx=0x7fadec009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:17.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:17.911+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fade00512e0 con 0x7fadf0159450 2023-07-20T10:05:18.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.059+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fadf00c97c0 con 0x7fadf0159450 2023-07-20T10:05:18.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fade6ffd640 1 -- 172.21.15.82:0/1059012631 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7fade00170a0 con 0x7fadf0159450 2023-07-20T10:05:18.043 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:18.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 msgr2=0x7fadd4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 0x7fadd4068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadec0012f0 tx=0x7fadec009040 comp rx=0 tx=0).stop 2023-07-20T10:05:18.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 msgr2=0x7fadf01514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fade000e870 tx=0x7fade000ec70 comp rx=0 tx=0).stop 2023-07-20T10:05:18.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 shutdown_connections 2023-07-20T10:05:18.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fadf01f4ca0 0x7fadf00705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fadd40663a0 0x7fadd4068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fadf0159450 0x7fadf01514a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 --2- 172.21.15.82:0/1059012631 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fadf00cc3e0 0x7fadf014c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 >> 172.21.15.82:0/1059012631 conn(0x7fadf00cad50 msgr2=0x7fadf00ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:18.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 shutdown_connections 2023-07-20T10:05:18.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.063+0000 7fadf852c640 1 -- 172.21.15.82:0/1059012631 wait complete. 2023-07-20T10:05:18.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:05:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 Processor -- start 2023-07-20T10:05:18.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 -- start start 2023-07-20T10:05:18.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710161de0 0x7fa7100afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7100b0290 0x7fa7100cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100b06e0 con 0x7fa710160ba0 2023-07-20T10:05:18.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100c9650 con 0x7fa7100b0290 2023-07-20T10:05:18.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.227+0000 7fa718027640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101619c0 con 0x7fa710161de0 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7100b0290 0x7fa7100cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa7100b0290 0x7fa7100cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:33800/0 (socket says 172.21.15.82:33800) 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 -- 172.21.15.82:0/4131758209 learned_addr learned my addr 172.21.15.82:0/4131758209 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7155c2640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710161de0 0x7fa7100afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 -- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710161de0 msgr2=0x7fa7100afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710161de0 0x7fa7100afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 -- 172.21.15.82:0/4131758209 >> v1:172.21.15.183:6789/0 conn(0x7fa710160ba0 legacy=0x7fa7100c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 -- 172.21.15.82:0/4131758209 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100c9370 con 0x7fa7100b0290 2023-07-20T10:05:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa7165c4640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7100b0290 0x7fa7100cbea0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa708009870 tx=0x7fa70801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb16ae3b2fbaa364 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.231+0000 7fa714dc1640 1 -- 172.21.15.82:0/4131758209 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080aa670 con 0x7fa7100b0290 2023-07-20T10:05:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa714dc1640 1 -- 172.21.15.82:0/4131758209 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080aa7d0 con 0x7fa7100b0290 2023-07-20T10:05:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa714dc1640 1 -- 172.21.15.82:0/4131758209 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7080aab60 con 0x7fa7100b0290 2023-07-20T10:05:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7100b0290 msgr2=0x7fa7100cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7100b0290 0x7fa7100cbea0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa708009870 tx=0x7fa70801c510 comp rx=0 tx=0).stop 2023-07-20T10:05:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- 172.21.15.82:0/4131758209 shutdown_connections 2023-07-20T10:05:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa7100b0290 0x7fa7100cbea0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- 172.21.15.82:0/4131758209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710161de0 0x7fa7100afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- 172.21.15.82:0/4131758209 >> 172.21.15.82:0/4131758209 conn(0x7fa7100cad50 msgr2=0x7fa7100cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:18.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- 172.21.15.82:0/4131758209 shutdown_connections 2023-07-20T10:05:18.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- 172.21.15.82:0/4131758209 wait complete. 2023-07-20T10:05:18.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 Processor -- start 2023-07-20T10:05:18.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- start start 2023-07-20T10:05:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa710161de0 0x7fa710070c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100c14b0 con 0x7fa7100b0290 2023-07-20T10:05:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100c5b40 con 0x7fa710161de0 2023-07-20T10:05:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa718027640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b1c70 con 0x7fa710160ba0 2023-07-20T10:05:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa715dc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa7155c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa7155c2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:47016/0 (socket says 172.21.15.82:47016) 2023-07-20T10:05:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa715dc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48346/0 (socket says 172.21.15.82:48346) 2023-07-20T10:05:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa7155c2640 1 -- 172.21.15.82:0/4154546420 learned_addr learned my addr 172.21.15.82:0/4154546420 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.235+0000 7fa7165c4640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa710161de0 0x7fa710070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 -- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa710161de0 msgr2=0x7fa710070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa710161de0 0x7fa710070c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 -- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 msgr2=0x7fa7100c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 -- 172.21.15.82:0/4154546420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080094d0 con 0x7fa710160ba0 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa715dc3640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7155c2640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e8a0 tx=0x7fa70000eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700009510 con 0x7fa710160ba0 2023-07-20T10:05:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70000c940 con 0x7fa710160ba0 2023-07-20T10:05:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7100c1700 con 0x7fa710160ba0 2023-07-20T10:05:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70000ccb0 con 0x7fa710160ba0 2023-07-20T10:05:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100c1cc0 con 0x7fa710160ba0 2023-07-20T10:05:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71006c480 con 0x7fa710160ba0 2023-07-20T10:05:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa700013470 con 0x7fa710160ba0 2023-07-20T10:05:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 0x7fa6f4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa700083e70 con 0x7fa710160ba0 2023-07-20T10:05:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.239+0000 7fa715dc3640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 0x7fa6f4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.243+0000 7fa715dc3640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 0x7fa6f4068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0012f0 tx=0x7fa70c009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.247+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7000512f0 con 0x7fa710160ba0 2023-07-20T10:05:18.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.391+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa7100c9010 con 0x7fa710160ba0 2023-07-20T10:05:18.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa7067fc640 1 -- 172.21.15.82:0/4154546420 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa7100c9010 con 0x7fa710160ba0 2023-07-20T10:05:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 msgr2=0x7fa6f4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 0x7fa6f4068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0012f0 tx=0x7fa70c009040 comp rx=0 tx=0).stop 2023-07-20T10:05:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 msgr2=0x7fa7100b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa70000e8a0 tx=0x7fa70000eca0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 shutdown_connections 2023-07-20T10:05:18.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa710161de0 0x7fa710070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa710160ba0 0x7fa7100b1730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa6f40663a0 0x7fa6f4068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 --2- 172.21.15.82:0/4154546420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa7100b0290 0x7fa7100c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 >> 172.21.15.82:0/4154546420 conn(0x7fa7100cad50 msgr2=0x7fa71006fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 shutdown_connections 2023-07-20T10:05:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.403+0000 7fa718027640 1 -- 172.21.15.82:0/4154546420 wait complete. 2023-07-20T10:05:18.405 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:05:18.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:18.465 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:18.521 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:05:18.522 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:18.522 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:18.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:18.532 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:18.532 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:18.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:18.542 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:18.543 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:18.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:18.587 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:18.587 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:18.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:18.597 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:05:18.598 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:18.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 Processor -- start 2023-07-20T10:05:18.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 -- start start 2023-07-20T10:05:18.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1a000afda0 0x7f1a000ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0015a8e0 0x7f1a000b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a000b2060 0x7f1a000b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a000b3160 con 0x7f1a000b2060 2023-07-20T10:05:18.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a000b2ee0 con 0x7f1a000afda0 2023-07-20T10:05:18.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a082bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000b06c0 con 0x7f1a0015a8e0 2023-07-20T10:05:18.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a000b2060 0x7f1a000b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a000b2060 0x7f1a000b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48352/0 (socket says 172.21.15.82:48352) 2023-07-20T10:05:18.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 -- 172.21.15.82:0/2584258891 learned_addr learned my addr 172.21.15.82:0/2584258891 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a05858640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0015a8e0 0x7f1a000b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a06059640 1 --2- 172.21.15.82:0/2584258891 >> v2:172.21.15.183:3300/0 conn(0x7f1a000afda0 0x7f1a000ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 -- 172.21.15.82:0/2584258891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0015a8e0 msgr2=0x7f1a000b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0015a8e0 0x7f1a000b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 -- 172.21.15.82:0/2584258891 >> v2:172.21.15.183:3300/0 conn(0x7f1a000afda0 msgr2=0x7f1a000ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 --2- 172.21.15.82:0/2584258891 >> v2:172.21.15.183:3300/0 conn(0x7f1a000afda0 0x7f1a000ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.787+0000 7f1a0685a640 1 -- 172.21.15.82:0/2584258891 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000b12a0 con 0x7f1a000b2060 2023-07-20T10:05:18.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a0685a640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000b0180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1a000b0b40 tx=0x7f19f801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffbd110dac6e6d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a05057640 1 -- 172.21.15.82:0/2584258891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ab600 con 0x7f1a000b2060 2023-07-20T10:05:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a05057640 1 -- 172.21.15.82:0/2584258891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f80a7050 con 0x7f1a000b2060 2023-07-20T10:05:18.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a05057640 1 -- 172.21.15.82:0/2584258891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ab980 con 0x7f1a000b2060 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 -- 172.21.15.82:0/2584258891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 msgr2=0x7f1a000b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000b0180 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1a000b0b40 tx=0x7f19f801c3b0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 -- 172.21.15.82:0/2584258891 shutdown_connections 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000b0180 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 --2- 172.21.15.82:0/2584258891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0015a8e0 0x7f1a000b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 --2- 172.21.15.82:0/2584258891 >> v2:172.21.15.183:3300/0 conn(0x7f1a000afda0 0x7f1a000ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 -- 172.21.15.82:0/2584258891 >> 172.21.15.82:0/2584258891 conn(0x7f1a000cada0 msgr2=0x7f1a000cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 -- 172.21.15.82:0/2584258891 shutdown_connections 2023-07-20T10:05:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.791+0000 7f1a082bd640 1 -- 172.21.15.82:0/2584258891 wait complete. 2023-07-20T10:05:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 Processor -- start 2023-07-20T10:05:18.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- start start 2023-07-20T10:05:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 0x7f1a00157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 0x7f1a000ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0015c600 con 0x7f1a000b2060 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3170 con 0x7f1a0015a8e0 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0015bd60 con 0x7f1a000afda0 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48356/0 (socket says 172.21.15.82:48356) 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 -- 172.21.15.82:0/3083362007 learned_addr learned my addr 172.21.15.82:0/3083362007 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:18.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a06059640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 0x7f1a00157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a0685a640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 0x7f1a000ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 -- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 msgr2=0x7f1a00157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 0x7f1a00157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 -- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 msgr2=0x7f1a000ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 0x7f1a000ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 -- 172.21.15.82:0/3083362007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80094d0 con 0x7f1a000b2060 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a0685a640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 0x7f1a000ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:18.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a06059640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 0x7f1a00157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a05858640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f19f000d5f0 tx=0x7f19f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00125f0 con 0x7f1a000b2060 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0012750 con 0x7f1a000b2060 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0015c040 con 0x7f1a000b2060 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0012ae0 con 0x7f1a000b2060 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.795+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a000c33c0 con 0x7f1a000b2060 2023-07-20T10:05:18.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a00073c70 con 0x7f1a000b2060 2023-07-20T10:05:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f19f0012c40 con 0x7f1a000b2060 2023-07-20T10:05:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f19f6ffd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 0x7f19e4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:18.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f19f00843a0 con 0x7f1a000b2060 2023-07-20T10:05:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f1a06059640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 0x7f19e4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:18.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.799+0000 7f1a06059640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 0x7f19e4068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19fc003fd0 tx=0x7f19fc003a00 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:18.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.803+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19f00516e0 con 0x7f1a000b2060 2023-07-20T10:05:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.983+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a0006ca10 con 0x7f1a000b2060 2023-07-20T10:05:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.983+0000 7f19f6ffd640 1 -- 172.21.15.82:0/3083362007 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f19f0007380 con 0x7f1a000b2060 2023-07-20T10:05:18.967 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:18.967 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1571904443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1571904443},{"type":"v1","addr":"172.21.15.183:6835","nonce":1571904443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5798,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/768269901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":768269901},{"type":"v1","addr":"172.21.15.183:6834","nonce":768269901}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5830,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1071196218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1071196218},{"type":"v1","addr":"172.21.15.82:6836","nonce":1071196218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/943738292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":943738292},{"type":"v1","addr":"172.21.15.82:6837","nonce":943738292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-07-20T10:05:18.967 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 27 2023-07-20T10:05:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 msgr2=0x7f19e4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 0x7f19e4068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f19fc003fd0 tx=0x7f19fc003a00 comp rx=0 tx=0).stop 2023-07-20T10:05:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 msgr2=0x7f1a000aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f19f000d5f0 tx=0x7f19f000dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 shutdown_connections 2023-07-20T10:05:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0015a8e0 0x7f1a000ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f19e40663a0 0x7f19e4068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a000b2060 0x7f1a000aae90 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 --2- 172.21.15.82:0/3083362007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a000afda0 0x7f1a00157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 >> 172.21.15.82:0/3083362007 conn(0x7f1a000cada0 msgr2=0x7f1a0006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 shutdown_connections 2023-07-20T10:05:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:18.987+0000 7f1a082bd640 1 -- 172.21.15.82:0/3083362007 wait complete. 2023-07-20T10:05:18.987 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:05:18.988 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:05:18.988 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:05:18.989 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:18.989 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:05:18.990 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:05:18.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:05:18.990 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:18.991 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:05:18.991 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:05:18.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:05:18.992 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:18.992 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:05:18.993 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:05:18.993 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:05:18.993 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:19.000 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:05:19.001 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:05:19.002 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:05:19.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:05:19.006 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:05:19.007 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:05:19.008 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:05:19.008 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:05:19.050 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:05:19.050 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:19.052 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:05:19.052 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:19.055 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:05:19.056 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:19.058 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:05:19.058 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:19.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:05:19.139 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:05:19.141 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:05:19.153 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:05:19.153 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:05:19.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 Processor -- start 2023-07-20T10:05:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 -- start start 2023-07-20T10:05:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700afda0 0x7f6e700ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e700b2060 0x7f6e700b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700b06c0 con 0x7f6e7015a8e0 2023-07-20T10:05:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e700b3160 con 0x7f6e700b2060 2023-07-20T10:05:19.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e75034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700b12a0 con 0x7f6e700afda0 2023-07-20T10:05:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e700b2060 0x7f6e700b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6659c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f6e7015a8e0 0x7f6e700b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:48856/0 (socket says 172.21.15.82:48856) 2023-07-20T10:05:19.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6659c640 1 -- 172.21.15.82:0/1032448533 learned_addr learned my addr 172.21.15.82:0/1032448533 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e700b2060 0x7f6e700b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:33866/0 (socket says 172.21.15.82:33866) 2023-07-20T10:05:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6ed9d640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700afda0 0x7f6e700ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 -- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700afda0 msgr2=0x7f6e700ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:19.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700afda0 0x7f6e700ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 -- 172.21.15.82:0/1032448533 >> v1:172.21.15.183:6789/0 conn(0x7f6e7015a8e0 legacy=0x7f6e700b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:19.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.227+0000 7f6e6f59e640 1 -- 172.21.15.82:0/1032448533 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700b1580 con 0x7f6e700b2060 2023-07-20T10:05:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e6f59e640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e700b2060 0x7f6e700b0180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e6801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=935d39c34d84a31 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e6e59c640 1 -- 172.21.15.82:0/1032448533 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680ab600 con 0x7f6e700b2060 2023-07-20T10:05:19.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e6e59c640 1 -- 172.21.15.82:0/1032448533 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e680a7050 con 0x7f6e700b2060 2023-07-20T10:05:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e6e59c640 1 -- 172.21.15.82:0/1032448533 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e680ab980 con 0x7f6e700b2060 2023-07-20T10:05:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 -- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e700b2060 msgr2=0x7f6e700b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e700b2060 0x7f6e700b0180 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6e680097c0 tx=0x7f6e6801c330 comp rx=0 tx=0).stop 2023-07-20T10:05:19.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 -- 172.21.15.82:0/1032448533 shutdown_connections 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e700b2060 0x7f6e700b0180 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 --2- 172.21.15.82:0/1032448533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700afda0 0x7f6e700ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 -- 172.21.15.82:0/1032448533 >> 172.21.15.82:0/1032448533 conn(0x7f6e700cada0 msgr2=0x7f6e700cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 -- 172.21.15.82:0/1032448533 shutdown_connections 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.231+0000 7f6e75034640 1 -- 172.21.15.82:0/1032448533 wait complete. 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 Processor -- start 2023-07-20T10:05:19.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- start start 2023-07-20T10:05:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700b2060 0x7f6e701558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7015a8e0 0x7f6e700c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7015d670 con 0x7f6e700afda0 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70155430 con 0x7f6e7015a8e0 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70154820 con 0x7f6e700b2060 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48384/0 (socket says 172.21.15.82:48384) 2023-07-20T10:05:19.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 -- 172.21.15.82:0/1967188982 learned_addr learned my addr 172.21.15.82:0/1967188982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6f59e640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7015a8e0 0x7f6e700c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6659c640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700b2060 0x7f6e701558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 -- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700b2060 msgr2=0x7f6e701558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700b2060 0x7f6e701558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 -- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7015a8e0 msgr2=0x7f6e700c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7015a8e0 0x7f6e700c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:19.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 -- 172.21.15.82:0/1967188982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009420 con 0x7f6e700afda0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e6ed9d640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e930 tx=0x7f6e6000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60009690 con 0x7f6e700afda0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000ca00 con 0x7f6e700afda0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e70154b00 con 0x7f6e700afda0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6000cd70 con 0x7f6e700afda0 2023-07-20T10:05:19.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.235+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e701550c0 con 0x7f6e700afda0 2023-07-20T10:05:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e70073c70 con 0x7f6e700afda0 2023-07-20T10:05:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6e60013470 con 0x7f6e700afda0 2023-07-20T10:05:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e67fff640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 0x7f6e50068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:19.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f6e60083f90 con 0x7f6e700afda0 2023-07-20T10:05:19.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e6659c640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 0x7f6e50068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.239+0000 7f6e6659c640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 0x7f6e50068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e7006d8b0 tx=0x7f6e58009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:19.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.243+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e600514d0 con 0x7f6e700afda0 2023-07-20T10:05:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:19.399+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6e700cb990 con 0x7f6e700afda0 2023-07-20T10:05:20.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e67fff640 1 -- 172.21.15.82:0/1967188982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e60017080 con 0x7f6e700afda0 2023-07-20T10:05:20.085 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:05:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 msgr2=0x7f6e50068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 0x7f6e50068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6e7006d8b0 tx=0x7f6e58009040 comp rx=0 tx=0).stop 2023-07-20T10:05:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 msgr2=0x7f6e7015d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000e930 tx=0x7f6e6000edf0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.103+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 shutdown_connections 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7015a8e0 0x7f6e700c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e700b2060 0x7f6e701558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f6e500663a0 0x7f6e50068860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 --2- 172.21.15.82:0/1967188982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e700afda0 0x7f6e7015d130 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 >> 172.21.15.82:0/1967188982 conn(0x7f6e700cada0 msgr2=0x7f6e70156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 shutdown_connections 2023-07-20T10:05:20.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.107+0000 7f6e75034640 1 -- 172.21.15.82:0/1967188982 wait complete. 2023-07-20T10:05:20.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:05:20.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 Processor -- start 2023-07-20T10:05:20.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 -- start start 2023-07-20T10:05:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fedd406f350 0x7fedd406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd406b970 0x7fedd40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40cf4a0 con 0x7fedd40b2470 2023-07-20T10:05:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd40b28e0 con 0x7fedd406f350 2023-07-20T10:05:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd9a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd406ea80 con 0x7fedd406b970 2023-07-20T10:05:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fedd406f350 0x7fedd406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fedd40b2470 0x7fedd415c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52110/0 (socket says 172.21.15.82:52110) 2023-07-20T10:05:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd37fe640 1 -- 172.21.15.82:0/3375967570 learned_addr learned my addr 172.21.15.82:0/3375967570 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fedd406f350 0x7fedd406b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48386/0 (socket says 172.21.15.82:48386) 2023-07-20T10:05:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedca7fc640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd406b970 0x7fedd40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 -- 172.21.15.82:0/3375967570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd406b970 msgr2=0x7fedd40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd406b970 0x7fedd40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 -- 172.21.15.82:0/3375967570 >> v1:172.21.15.82:6789/0 conn(0x7fedd40b2470 legacy=0x7fedd415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.271+0000 7fedd2ffd640 1 -- 172.21.15.82:0/3375967570 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40ce890 con 0x7fedd406f350 2023-07-20T10:05:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd2ffd640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406f350 0x7fedd406b430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fedc40097c0 tx=0x7fedc401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb832d42f64beb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd27fc640 1 -- 172.21.15.82:0/3375967570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40ab600 con 0x7fedd406f350 2023-07-20T10:05:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd27fc640 1 -- 172.21.15.82:0/3375967570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40a7050 con 0x7fedd406f350 2023-07-20T10:05:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd27fc640 1 -- 172.21.15.82:0/3375967570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40ab980 con 0x7fedd406f350 2023-07-20T10:05:20.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 -- 172.21.15.82:0/3375967570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406f350 msgr2=0x7fedd406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406f350 0x7fedd406b430 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fedc40097c0 tx=0x7fedc401c3c0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 -- 172.21.15.82:0/3375967570 shutdown_connections 2023-07-20T10:05:20.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd406b970 0x7fedd40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 --2- 172.21.15.82:0/3375967570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406f350 0x7fedd406b430 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 -- 172.21.15.82:0/3375967570 >> 172.21.15.82:0/3375967570 conn(0x7fedd4089fa0 msgr2=0x7fedd40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 -- 172.21.15.82:0/3375967570 shutdown_connections 2023-07-20T10:05:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.275+0000 7fedd9a61640 1 -- 172.21.15.82:0/3375967570 wait complete. 2023-07-20T10:05:20.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 Processor -- start 2023-07-20T10:05:20.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- start start 2023-07-20T10:05:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd406f350 0x7fedd40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd40b2470 0x7fedd40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40cafb0 con 0x7fedd406b970 2023-07-20T10:05:20.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40c4490 con 0x7fedd406f350 2023-07-20T10:05:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd40cc000 con 0x7fedd40b2470 2023-07-20T10:05:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48390/0 (socket says 172.21.15.82:48390) 2023-07-20T10:05:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 -- 172.21.15.82:0/773412456 learned_addr learned my addr 172.21.15.82:0/773412456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd37fe640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd40b2470 0x7fedd40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedca7fc640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd406f350 0x7fedd40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 -- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd40b2470 msgr2=0x7fedd40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd40b2470 0x7fedd40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 -- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd406f350 msgr2=0x7fedd40b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd406f350 0x7fedd40b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 -- 172.21.15.82:0/773412456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4009420 con 0x7fedd406b970 2023-07-20T10:05:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd2ffd640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fedc4019ff0 tx=0x7fedc401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40b7650 con 0x7fedd406b970 2023-07-20T10:05:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc40abe90 con 0x7fedd406b970 2023-07-20T10:05:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd40cfab0 con 0x7fedd406b970 2023-07-20T10:05:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc40b7a10 con 0x7fedd406b970 2023-07-20T10:05:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.279+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40cabd0 con 0x7fedd406b970 2023-07-20T10:05:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd4073c70 con 0x7fedd406b970 2023-07-20T10:05:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fedc40b7b70 con 0x7fedd406b970 2023-07-20T10:05:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedd0ff9640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 0x7fedb8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fedc411e5c0 con 0x7fedd406b970 2023-07-20T10:05:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedca7fc640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 0x7fedb8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.283+0000 7fedca7fc640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 0x7fedb8068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b6170 tx=0x7fedbc008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.287+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedc40ebc80 con 0x7fedd406b970 2023-07-20T10:05:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.483+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fedd40b2ad0 con 0x7fedd406b970 2023-07-20T10:05:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.483+0000 7fedd0ff9640 1 -- 172.21.15.82:0/773412456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fedc40ef2a0 con 0x7fedd406b970 2023-07-20T10:05:20.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:20.466 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:05:20.468 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:05:20.470 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:05:20.472 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:05:20.472 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.472 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.474 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:05:20.475 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:05:20.475 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.475 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.476 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:05:20.477 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:05:20.478 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.479 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:05:20.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.483 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:05:20.484 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:05:20.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:05:20.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.488 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.489 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:20.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.491 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:20.492 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:05:20.492 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 msgr2=0x7fedb8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 0x7fedb8068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fedd40b6170 tx=0x7fedbc008040 comp rx=0 tx=0).stop 2023-07-20T10:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 msgr2=0x7fedd40c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fedc4019ff0 tx=0x7fedc401ac00 comp rx=0 tx=0).stop 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 shutdown_connections 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedd40b2470 0x7fedd40cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedd406f350 0x7fedd40b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fedb80663a0 0x7fedb8068860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 --2- 172.21.15.82:0/773412456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedd406b970 0x7fedd40c3f50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 >> 172.21.15.82:0/773412456 conn(0x7fedd4089fa0 msgr2=0x7fedd415c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 shutdown_connections 2023-07-20T10:05:20.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.487+0000 7fedd9a61640 1 -- 172.21.15.82:0/773412456 wait complete. 2023-07-20T10:05:20.495 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.651+0000 7f0d531f3640 1 Processor -- start 2023-07-20T10:05:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.651+0000 7f0d531f3640 1 -- start start 2023-07-20T10:05:20.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d531f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d4c0ad060 0x7f0d4c0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d531f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0b0290 0x7f0d4c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d531f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c0cde70 con 0x7f0d4c0afe10 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d531f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c0ad440 con 0x7f0d4c0ad060 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d531f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0cbef0 con 0x7f0d4c0b0290 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d4c0ad060 0x7f0d4c0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0d4c0ad060 0x7f0d4c0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48404/0 (socket says 172.21.15.82:48404) 2023-07-20T10:05:20.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3242410293 learned_addr learned my addr 172.21.15.82:0/3242410293 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:20.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d51790640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0b0290 0x7f0d4c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3242410293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0b0290 msgr2=0x7f0d4c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:20.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0b0290 0x7f0d4c15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3242410293 >> v1:172.21.15.183:6789/0 conn(0x7f0d4c0afe10 legacy=0x7f0d4c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:20.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.655+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3242410293 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0cdb40 con 0x7f0d4c0ad060 2023-07-20T10:05:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d50f8f640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0ca040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009e50 tx=0x7f0d4801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3d62b2b341965e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d437fe640 1 -- 172.21.15.82:0/3242410293 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480a58d0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d437fe640 1 -- 172.21.15.82:0/3242410293 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480a5a30 con 0x7f0d4c0ad060 2023-07-20T10:05:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d437fe640 1 -- 172.21.15.82:0/3242410293 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480a5dc0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- 172.21.15.82:0/3242410293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 msgr2=0x7f0d4c0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0ca040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009e50 tx=0x7f0d4801c9e0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- 172.21.15.82:0/3242410293 shutdown_connections 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0b0290 0x7f0d4c15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3242410293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0ca040 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- 172.21.15.82:0/3242410293 >> 172.21.15.82:0/3242410293 conn(0x7f0d4c0cada0 msgr2=0x7f0d4c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- 172.21.15.82:0/3242410293 shutdown_connections 2023-07-20T10:05:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- 172.21.15.82:0/3242410293 wait complete. 2023-07-20T10:05:20.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 Processor -- start 2023-07-20T10:05:20.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.659+0000 7f0d531f3640 1 -- start start 2023-07-20T10:05:20.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 0x7f0d4c09a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d4c0b0290 0x7f0d4c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c099930 con 0x7f0d4c0ad060 2023-07-20T10:05:20.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c09b840 con 0x7f0d4c0b0290 2023-07-20T10:05:20.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c099b90 con 0x7f0d4c0afe10 2023-07-20T10:05:20.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48406/0 (socket says 172.21.15.82:48406) 2023-07-20T10:05:20.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3858335042 learned_addr learned my addr 172.21.15.82:0/3858335042 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:20.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d51790640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d4c0b0290 0x7f0d4c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d43fff640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 0x7f0d4c09a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 msgr2=0x7f0d4c09a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 0x7f0d4c09a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d4c0b0290 msgr2=0x7f0d4c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d4c0b0290 0x7f0d4c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 -- 172.21.15.82:0/3858335042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48009b30 con 0x7f0d4c0ad060 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d43fff640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 0x7f0d4c09a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d50f8f640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0d4801a610 tx=0x7f0d48019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480bd070 con 0x7f0d4c0ad060 2023-07-20T10:05:20.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d48009250 con 0x7f0d4c0ad060 2023-07-20T10:05:20.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d480b88c0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c099e70 con 0x7f0d4c0ad060 2023-07-20T10:05:20.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c0b0d50 con 0x7f0d4c0ad060 2023-07-20T10:05:20.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4c0b0bb0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.663+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0d480b8a20 con 0x7f0d4c0ad060 2023-07-20T10:05:20.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.667+0000 7f0d417fa640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 0x7f0d38068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.667+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d4811ea70 con 0x7f0d4c0ad060 2023-07-20T10:05:20.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.667+0000 7f0d43fff640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 0x7f0d38068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.667+0000 7f0d43fff640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 0x7f0d38068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0c9a90 tx=0x7f0d3c009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.671+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d4c0b0bb0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.815+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d4c0b0bb0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d417fa640 1 -- 172.21.15.82:0/3858335042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+14615 (secure 0 0 0) 0x7f0d4c0b0bb0 con 0x7f0d4c0ad060 2023-07-20T10:05:20.800 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:20.800 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":77,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:20.111613+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:20.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 msgr2=0x7f0d38068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 0x7f0d38068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0c9a90 tx=0x7f0d3c009040 comp rx=0 tx=0).stop 2023-07-20T10:05:20.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 msgr2=0x7f0d4c0993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f0d4801a610 tx=0x7f0d48019780 comp rx=0 tx=0).stop 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 shutdown_connections 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0d4c0b0290 0x7f0d4c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0d4c0afe10 0x7f0d4c09a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0d380663a0 0x7f0d38068860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 --2- 172.21.15.82:0/3858335042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d4c0ad060 0x7f0d4c0993f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 >> 172.21.15.82:0/3858335042 conn(0x7f0d4c0cada0 msgr2=0x7f0d4c0c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 shutdown_connections 2023-07-20T10:05:20.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.819+0000 7f0d531f3640 1 -- 172.21.15.82:0/3858335042 wait complete. 2023-07-20T10:05:20.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:20.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:20.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 Processor -- start 2023-07-20T10:05:20.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 -- start start 2023-07-20T10:05:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc60015a6f0 0x7fc60015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc600071950 con 0x7fc60006f710 2023-07-20T10:05:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60015b230 con 0x7fc6000ca5a0 2023-07-20T10:05:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc608027640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60015bad0 con 0x7fc60015a6f0 2023-07-20T10:05:20.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc605dc3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc60006f710 0x7fc60006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52122/0 (socket says 172.21.15.82:52122) 2023-07-20T10:05:20.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc605dc3640 1 -- 172.21.15.82:0/166099796 learned_addr learned my addr 172.21.15.82:0/166099796 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:20.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc6065c4640 1 --2- 172.21.15.82:0/166099796 >> v2:172.21.15.183:3300/0 conn(0x7fc60015a6f0 0x7fc60015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.983+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767033158 0 0) 0x7fc600071950 con 0x7fc60006f710 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ec003530 con 0x7fc60006f710 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344313269 0 0) 0x7fc60015b230 con 0x7fc6000ca5a0 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc600071950 con 0x7fc6000ca5a0 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc6065c4640 1 -- 172.21.15.82:0/166099796 >> v1:172.21.15.183:6789/0 conn(0x7fc6000ca5a0 legacy=0x7fc60015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1341543712 0 0) 0x7fc5ec003530 con 0x7fc60006f710 2023-07-20T10:05:20.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc6065c4640 1 -- 172.21.15.82:0/166099796 >> v1:172.21.15.82:6789/0 conn(0x7fc60006f710 legacy=0x7fc60006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc6065c4640 1 -- 172.21.15.82:0/166099796 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60015b510 con 0x7fc60015a6f0 2023-07-20T10:05:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc6065c4640 1 --2- 172.21.15.82:0/166099796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc60015ab60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009dc0 tx=0x7fc5f801c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af28672ece7da172 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc001680 con 0x7fc60015a6f0 2023-07-20T10:05:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80a56a0 con 0x7fc60015a6f0 2023-07-20T10:05:20.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.987+0000 7fc604dc1640 1 -- 172.21.15.82:0/166099796 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80a5a30 con 0x7fc60015a6f0 2023-07-20T10:05:20.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- 172.21.15.82:0/166099796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 msgr2=0x7fc60015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 --2- 172.21.15.82:0/166099796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc60015ab60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009dc0 tx=0x7fc5f801c820 comp rx=0 tx=0).stop 2023-07-20T10:05:20.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- 172.21.15.82:0/166099796 shutdown_connections 2023-07-20T10:05:20.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 --2- 172.21.15.82:0/166099796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc60015ab60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- 172.21.15.82:0/166099796 >> 172.21.15.82:0/166099796 conn(0x7fc6000cad50 msgr2=0x7fc6000cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:20.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- 172.21.15.82:0/166099796 shutdown_connections 2023-07-20T10:05:20.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- 172.21.15.82:0/166099796 wait complete. 2023-07-20T10:05:20.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 Processor -- start 2023-07-20T10:05:20.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- start start 2023-07-20T10:05:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc60006f710 0x7fc6001522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc600157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600157a40 con 0x7fc6000ca5a0 2023-07-20T10:05:20.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600156dc0 con 0x7fc60015a6f0 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc608027640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001570a0 con 0x7fc60006f710 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48410/0 (socket says 172.21.15.82:48410) 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 -- 172.21.15.82:0/2924655089 learned_addr learned my addr 172.21.15.82:0/2924655089 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6065c4640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc600157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc605dc3640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc60006f710 0x7fc6001522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 -- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc60006f710 msgr2=0x7fc6001522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc60006f710 0x7fc6001522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 -- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 msgr2=0x7fc600157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc600157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.991+0000 7fc6055c2640 1 -- 172.21.15.82:0/2924655089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009a70 con 0x7fc6000ca5a0 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc6055c2640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c500 tx=0x7fc5f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f00052d0 con 0x7fc6000ca5a0 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f0005430 con 0x7fc6000ca5a0 2023-07-20T10:05:20.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0012870 con 0x7fc6000ca5a0 2023-07-20T10:05:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600157380 con 0x7fc6000ca5a0 2023-07-20T10:05:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600152040 con 0x7fc6000ca5a0 2023-07-20T10:05:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc600157b80 con 0x7fc6000ca5a0 2023-07-20T10:05:20.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc5f00129d0 con 0x7fc6000ca5a0 2023-07-20T10:05:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 0x7fc5e4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc5f0083660 con 0x7fc6000ca5a0 2023-07-20T10:05:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.995+0000 7fc605dc3640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 0x7fc5e4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:20.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.999+0000 7fc605dc3640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 0x7fc5e4068890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc001ec0 tx=0x7fc5fc001a60 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:20.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:20.999+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc600157b80 con 0x7fc6000ca5a0 2023-07-20T10:05:21.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc600157b80 con 0x7fc6000ca5a0 2023-07-20T10:05:21.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc5f67fc640 1 -- 172.21.15.82:0/2924655089 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc600157b80 con 0x7fc6000ca5a0 2023-07-20T10:05:21.137 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 msgr2=0x7fc5e4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 0x7fc5e4068890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc001ec0 tx=0x7fc5fc001a60 comp rx=0 tx=0).stop 2023-07-20T10:05:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 msgr2=0x7fc600151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c500 tx=0x7fc5f000c9c0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 shutdown_connections 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc60015a6f0 0x7fc600157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc5e40663d0 0x7fc5e4068890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6000ca5a0 0x7fc600151b00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 --2- 172.21.15.82:0/2924655089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc60006f710 0x7fc6001522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 >> 172.21.15.82:0/2924655089 conn(0x7fc6000cad50 msgr2=0x7fc6000acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 shutdown_connections 2023-07-20T10:05:21.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.155+0000 7fc608027640 1 -- 172.21.15.82:0/2924655089 wait complete. 2023-07-20T10:05:21.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 Processor -- start 2023-07-20T10:05:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 -- start start 2023-07-20T10:05:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a0415c6e0 0x7f9a040cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a040d3200 0x7f9a040cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a040cdb40 con 0x7f9a0415cac0 2023-07-20T10:05:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040d07a0 con 0x7f9a0415c6e0 2023-07-20T10:05:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a09533640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040cd4f0 con 0x7f9a040d3200 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a0415c6e0 0x7f9a040cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a0415c6e0 0x7f9a040cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48420/0 (socket says 172.21.15.82:48420) 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 -- 172.21.15.82:0/2082323946 learned_addr learned my addr 172.21.15.82:0/2082323946 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a037fe640 1 --1- 172.21.15.82:0/2082323946 >> v1:172.21.15.82:6789/0 conn(0x7f9a0415cac0 0x7f9a040d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52128/0 (socket says 172.21.15.82:52128) 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a027fc640 1 --2- 172.21.15.82:0/2082323946 >> v2:172.21.15.183:3300/0 conn(0x7f9a040d3200 0x7f9a040cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 -- 172.21.15.82:0/2082323946 >> v2:172.21.15.183:3300/0 conn(0x7f9a040d3200 msgr2=0x7f9a040cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 --2- 172.21.15.82:0/2082323946 >> v2:172.21.15.183:3300/0 conn(0x7f9a040d3200 0x7f9a040cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 -- 172.21.15.82:0/2082323946 >> v1:172.21.15.82:6789/0 conn(0x7f9a0415cac0 legacy=0x7f9a040d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.319+0000 7f9a02ffd640 1 -- 172.21.15.82:0/2082323946 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040cd7d0 con 0x7f9a0415c6e0 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a02ffd640 1 --2- 172.21.15.82:0/2082323946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0415c6e0 0x7f9a040cf640 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ccf90 tx=0x7f99f401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a85172da5575548 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a01ffb640 1 -- 172.21.15.82:0/2082323946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40ab600 con 0x7f9a0415c6e0 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a01ffb640 1 -- 172.21.15.82:0/2082323946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40ab760 con 0x7f9a0415c6e0 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a01ffb640 1 -- 172.21.15.82:0/2082323946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40abaf0 con 0x7f9a0415c6e0 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 -- 172.21.15.82:0/2082323946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0415c6e0 msgr2=0x7f9a040cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 --2- 172.21.15.82:0/2082323946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0415c6e0 0x7f9a040cf640 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ccf90 tx=0x7f99f401c3e0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 -- 172.21.15.82:0/2082323946 shutdown_connections 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 --2- 172.21.15.82:0/2082323946 >> v2:172.21.15.183:3300/0 conn(0x7f9a040d3200 0x7f9a040cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 --2- 172.21.15.82:0/2082323946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a0415c6e0 0x7f9a040cf640 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 -- 172.21.15.82:0/2082323946 >> 172.21.15.82:0/2082323946 conn(0x7f9a040d2600 msgr2=0x7f9a040d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 -- 172.21.15.82:0/2082323946 shutdown_connections 2023-07-20T10:05:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 -- 172.21.15.82:0/2082323946 wait complete. 2023-07-20T10:05:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.323+0000 7f9a09533640 1 Processor -- start 2023-07-20T10:05:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- start start 2023-07-20T10:05:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 0x7f9a040c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a0415cac0 0x7f9a040cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a041580b0 con 0x7f9a040d3200 2023-07-20T10:05:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040c96d0 con 0x7f9a0415c6e0 2023-07-20T10:05:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040c99b0 con 0x7f9a0415cac0 2023-07-20T10:05:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48434/0 (socket says 172.21.15.82:48434) 2023-07-20T10:05:21.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 -- 172.21.15.82:0/3431960286 learned_addr learned my addr 172.21.15.82:0/3431960286 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a027fc640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 0x7f9a040c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 -- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a0415cac0 msgr2=0x7f9a040cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a0415cac0 0x7f9a040cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 -- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 msgr2=0x7f9a040c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 0x7f9a040c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 -- 172.21.15.82:0/3431960286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40094d0 con 0x7f9a040d3200 2023-07-20T10:05:21.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a027fc640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 0x7f9a040c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:21.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a02ffd640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f99f401a010 tx=0x7f99f401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40ab600 con 0x7f9a040d3200 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40b4800 con 0x7f9a040d3200 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a040c9c90 con 0x7f9a040d3200 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40b4b70 con 0x7f9a040d3200 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a040ca250 con 0x7f9a040d3200 2023-07-20T10:05:21.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.327+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0404da30 con 0x7f9a040d3200 2023-07-20T10:05:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.331+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99f40b4cd0 con 0x7f9a040d3200 2023-07-20T10:05:21.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.331+0000 7f99eb7fe640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 0x7f99f0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.331+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f99f411e6e0 con 0x7f9a040d3200 2023-07-20T10:05:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.331+0000 7f9a027fc640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 0x7f99f0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.331+0000 7f9a027fc640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 0x7f99f0068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a0406bed0 tx=0x7f99f8008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.335+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99f40ebbf0 con 0x7f9a040d3200 2023-07-20T10:05:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.483+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a040b8580 con 0x7f9a040d3200 2023-07-20T10:05:21.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.483+0000 7f99eb7fe640 1 -- 172.21.15.82:0/3431960286 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99f40ef210 con 0x7f9a040d3200 2023-07-20T10:05:21.466 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:21.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 msgr2=0x7f99f0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 0x7f99f0068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9a0406bed0 tx=0x7f99f8008040 comp rx=0 tx=0).stop 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 msgr2=0x7f9a04157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f99f401a010 tx=0x7f99f401ac20 comp rx=0 tx=0).stop 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 shutdown_connections 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a0415cac0 0x7f9a040cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a0415c6e0 0x7f9a040c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f99f00663d0 0x7f99f0068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 --2- 172.21.15.82:0/3431960286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a040d3200 0x7f9a04157b70 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 >> 172.21.15.82:0/3431960286 conn(0x7f9a040d2600 msgr2=0x7f9a040b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 shutdown_connections 2023-07-20T10:05:21.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.487+0000 7f9a09533640 1 -- 172.21.15.82:0/3431960286 wait complete. 2023-07-20T10:05:21.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:05:21.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.643+0000 7f5e8f3fa640 1 Processor -- start 2023-07-20T10:05:21.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.643+0000 7f5e8f3fa640 1 -- start start 2023-07-20T10:05:21.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.643+0000 7f5e8f3fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5e8815dbb0 0x7f5e880cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.643+0000 7f5e8f3fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880ad810 con 0x7f5e880b2a90 2023-07-20T10:05:21.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8f3fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8815d0d0 con 0x7f5e881596b0 2023-07-20T10:05:21.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8f3fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8815e000 con 0x7f5e8815dbb0 2023-07-20T10:05:21.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8c995640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5e880b2a90 0x7f5e880c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52130/0 (socket says 172.21.15.82:52130) 2023-07-20T10:05:21.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8c995640 1 -- 172.21.15.82:0/915706571 learned_addr learned my addr 172.21.15.82:0/915706571 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:21.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8d997640 1 --2- 172.21.15.82:0/915706571 >> v2:172.21.15.183:3300/0 conn(0x7f5e8815dbb0 0x7f5e880cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809117431 0 0) 0x7f5e880ad810 con 0x7f5e880b2a90 2023-07-20T10:05:21.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e74003530 con 0x7f5e880b2a90 2023-07-20T10:05:21.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8d997640 1 -- 172.21.15.82:0/915706571 >> v1:172.21.15.183:6789/0 conn(0x7f5e881596b0 legacy=0x7f5e880b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8d997640 1 -- 172.21.15.82:0/915706571 >> v1:172.21.15.82:6789/0 conn(0x7f5e880b2a90 legacy=0x7f5e880c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976354876 0 0) 0x7f5e74003530 con 0x7f5e880b2a90 2023-07-20T10:05:21.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8d997640 1 -- 172.21.15.82:0/915706571 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8815d3b0 con 0x7f5e8815dbb0 2023-07-20T10:05:21.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.647+0000 7f5e8d997640 1 --2- 172.21.15.82:0/915706571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880cc900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009dc0 tx=0x7f5e8001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65097f6890f2fd97 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800a5960 con 0x7f5e8815dbb0 2023-07-20T10:05:21.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e800a5ac0 con 0x7f5e8815dbb0 2023-07-20T10:05:21.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e7ffff640 1 -- 172.21.15.82:0/915706571 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800a5e50 con 0x7f5e8815dbb0 2023-07-20T10:05:21.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/915706571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 msgr2=0x7f5e880cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/915706571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880cc900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009dc0 tx=0x7f5e8001c900 comp rx=0 tx=0).stop 2023-07-20T10:05:21.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/915706571 shutdown_connections 2023-07-20T10:05:21.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/915706571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880cc900 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/915706571 >> 172.21.15.82:0/915706571 conn(0x7f5e880cada0 msgr2=0x7f5e880cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/915706571 shutdown_connections 2023-07-20T10:05:21.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/915706571 wait complete. 2023-07-20T10:05:21.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 Processor -- start 2023-07-20T10:05:21.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 -- start start 2023-07-20T10:05:21.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 0x7f5e88140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.651+0000 7f5e8f3fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880cce40 con 0x7f5e881596b0 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880c19e0 con 0x7f5e8815dbb0 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88153240 con 0x7f5e880b2a90 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48442/0 (socket says 172.21.15.82:48442) 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 -- 172.21.15.82:0/1848894842 learned_addr learned my addr 172.21.15.82:0/1848894842 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8d997640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8d196640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 0x7f5e88140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 -- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 msgr2=0x7f5e88140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 0x7f5e88140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 -- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 msgr2=0x7f5e880b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 -- 172.21.15.82:0/1848894842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80009a70 con 0x7f5e881596b0 2023-07-20T10:05:21.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8d196640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 0x7f5e88140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:21.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8c995640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c780 tx=0x7f5e7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78005ac0 con 0x7f5e881596b0 2023-07-20T10:05:21.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78005c20 con 0x7f5e881596b0 2023-07-20T10:05:21.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e780072b0 con 0x7f5e881596b0 2023-07-20T10:05:21.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e88140d60 con 0x7f5e881596b0 2023-07-20T10:05:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e88152630 con 0x7f5e881596b0 2023-07-20T10:05:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e88073c70 con 0x7f5e881596b0 2023-07-20T10:05:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.655+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e78007410 con 0x7f5e881596b0 2023-07-20T10:05:21.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.659+0000 7f5e7dffb640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 0x7f5e6c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.659+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5e78083800 con 0x7f5e881596b0 2023-07-20T10:05:21.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.659+0000 7f5e8d196640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 0x7f5e6c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.659+0000 7f5e8d196640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 0x7f5e6c068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e84000f70 tx=0x7f5e84009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.663+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e78050d90 con 0x7f5e881596b0 2023-07-20T10:05:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.811+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e8809bc70 con 0x7f5e881596b0 2023-07-20T10:05:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.811+0000 7f5e7dffb640 1 -- 172.21.15.82:0/1848894842 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5e780543b0 con 0x7f5e881596b0 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:05:21.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:05:21.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:21.795 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:05:21.795 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:05:21.795 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:21.795 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:05:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 msgr2=0x7f5e6c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 0x7f5e6c068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5e84000f70 tx=0x7f5e84009040 comp rx=0 tx=0).stop 2023-07-20T10:05:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 msgr2=0x7f5e880b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c780 tx=0x7f5e7800cc40 comp rx=0 tx=0).stop 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 shutdown_connections 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e8815dbb0 0x7f5e880b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f5e6c0663a0 0x7f5e6c068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e881596b0 0x7f5e880b1ee0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 --2- 172.21.15.82:0/1848894842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e880b2a90 0x7f5e88140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 >> 172.21.15.82:0/1848894842 conn(0x7f5e880cada0 msgr2=0x7f5e880cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 shutdown_connections 2023-07-20T10:05:21.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.815+0000 7f5e8f3fa640 1 -- 172.21.15.82:0/1848894842 wait complete. 2023-07-20T10:05:21.814 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:05:21.815 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:05:21.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.975+0000 7f8363dfa640 1 Processor -- start 2023-07-20T10:05:21.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.975+0000 7f8363dfa640 1 -- start start 2023-07-20T10:05:21.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8363dfa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f835c159830 0x7f835c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8363dfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c0cc8d0 con 0x7f835c0cc3e0 2023-07-20T10:05:21.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8363dfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835c0ccbb0 con 0x7f835c159450 2023-07-20T10:05:21.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8363dfa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835c0cce90 con 0x7f835c159830 2023-07-20T10:05:21.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8362397640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f835c0cc3e0 0x7f835c0afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52144/0 (socket says 172.21.15.82:52144) 2023-07-20T10:05:21.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8362397640 1 -- 172.21.15.82:0/356986115 learned_addr learned my addr 172.21.15.82:0/356986115 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:21.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8361395640 1 --2- 172.21.15.82:0/356986115 >> v2:172.21.15.183:3300/0 conn(0x7f835c159830 0x7f835c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575539953 0 0) 0x7f835c0cc8d0 con 0x7f835c0cc3e0 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8348003530 con 0x7f835c0cc3e0 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202786514 0 0) 0x7f835c0ccbb0 con 0x7f835c159450 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f835c0cc8d0 con 0x7f835c159450 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8361395640 1 -- 172.21.15.82:0/356986115 >> v1:172.21.15.183:6789/0 conn(0x7f835c159450 legacy=0x7f835c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8361395640 1 -- 172.21.15.82:0/356986115 >> v1:172.21.15.82:6789/0 conn(0x7f835c0cc3e0 legacy=0x7f835c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.979+0000 7f8361395640 1 -- 172.21.15.82:0/356986115 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c159cc0 con 0x7f835c159830 2023-07-20T10:05:21.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8361395640 1 --2- 172.21.15.82:0/356986115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159830 0x7f835c0cbea0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f834c0097c0 tx=0x7f834c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4717ed41cbe446 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0ad660 con 0x7f835c159830 2023-07-20T10:05:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0ad7c0 con 0x7f835c159830 2023-07-20T10:05:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8360b94640 1 -- 172.21.15.82:0/356986115 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c0adb50 con 0x7f835c159830 2023-07-20T10:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- 172.21.15.82:0/356986115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159830 msgr2=0x7f835c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 --2- 172.21.15.82:0/356986115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159830 0x7f835c0cbea0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f834c0097c0 tx=0x7f834c01c450 comp rx=0 tx=0).stop 2023-07-20T10:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- 172.21.15.82:0/356986115 shutdown_connections 2023-07-20T10:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 --2- 172.21.15.82:0/356986115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159830 0x7f835c0cbea0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- 172.21.15.82:0/356986115 >> 172.21.15.82:0/356986115 conn(0x7f835c0cad50 msgr2=0x7f835c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- 172.21.15.82:0/356986115 shutdown_connections 2023-07-20T10:05:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- 172.21.15.82:0/356986115 wait complete. 2023-07-20T10:05:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 Processor -- start 2023-07-20T10:05:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.983+0000 7f8363dfa640 1 -- start start 2023-07-20T10:05:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 0x7f835c1625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f835c152330 0x7f835c1f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c0c7390 con 0x7f835c0cc3e0 2023-07-20T10:05:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c162b30 con 0x7f835c159450 2023-07-20T10:05:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c1f83b0 con 0x7f835c152330 2023-07-20T10:05:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48446/0 (socket says 172.21.15.82:48446) 2023-07-20T10:05:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 -- 172.21.15.82:0/4005601764 learned_addr learned my addr 172.21.15.82:0/4005601764 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361395640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 0x7f835c1625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8362397640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f835c152330 0x7f835c1f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 -- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f835c152330 msgr2=0x7f835c1f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f835c152330 0x7f835c1f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 -- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 msgr2=0x7f835c1625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 0x7f835c1625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 -- 172.21.15.82:0/4005601764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009420 con 0x7f835c0cc3e0 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361395640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 0x7f835c1625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8361b96640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f835800c8a0 tx=0x7f835800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8358003b80 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8358003ce0 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835800aa30 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c158170 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c1f8040 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.987+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c04da30 con 0x7f835c0cc3e0 2023-07-20T10:05:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.991+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f835800ab90 con 0x7f835c0cc3e0 2023-07-20T10:05:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.991+0000 7f83527fc640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 0x7f8340068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.991+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8358083aa0 con 0x7f835c0cc3e0 2023-07-20T10:05:21.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.991+0000 7f8361395640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 0x7f8340068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:21.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.991+0000 7f8361395640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 0x7f8340068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f834c0af000 tx=0x7f834c008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:21.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:21.995+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8358051150 con 0x7f835c0cc3e0 2023-07-20T10:05:22.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:22.143+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f835c0cbbf0 con 0x7f835c0cc3e0 2023-07-20T10:05:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.127+0000 7f83527fc640 1 -- 172.21.15.82:0/4005601764 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8358054770 con 0x7f835c0cc3e0 2023-07-20T10:05:23.109 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:05:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 msgr2=0x7f8340068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 0x7f8340068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f834c0af000 tx=0x7f834c008040 comp rx=0 tx=0).stop 2023-07-20T10:05:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 msgr2=0x7f835c0c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f835800c8a0 tx=0x7f835800cd60 comp rx=0 tx=0).stop 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 shutdown_connections 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f835c152330 0x7f835c1f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f835c159450 0x7f835c1625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f83400663a0 0x7f8340068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 --2- 172.21.15.82:0/4005601764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f835c0cc3e0 0x7f835c0c6e50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 >> 172.21.15.82:0/4005601764 conn(0x7f835c0cad50 msgr2=0x7f835c0c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 shutdown_connections 2023-07-20T10:05:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.131+0000 7f8363dfa640 1 -- 172.21.15.82:0/4005601764 wait complete. 2023-07-20T10:05:23.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:05:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 Processor -- start 2023-07-20T10:05:23.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 -- start start 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8bf4159450 0x7f8bf415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bf4159830 0x7f8bf40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf40cc8d0 con 0x7f8bf40cc3e0 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf40cce90 con 0x7f8bf4159830 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bfaf8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf40ccbb0 con 0x7f8bf4159450 2023-07-20T10:05:23.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bf4159830 0x7f8bf40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8bf4159830 0x7f8bf40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48538/0 (socket says 172.21.15.82:48538) 2023-07-20T10:05:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 -- 172.21.15.82:0/542743653 learned_addr learned my addr 172.21.15.82:0/542743653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:23.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf8d2b640 1 --2- 172.21.15.82:0/542743653 >> v2:172.21.15.183:3300/0 conn(0x7f8bf4159450 0x7f8bf415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 -- 172.21.15.82:0/542743653 >> v2:172.21.15.183:3300/0 conn(0x7f8bf4159450 msgr2=0x7f8bf415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 --2- 172.21.15.82:0/542743653 >> v2:172.21.15.183:3300/0 conn(0x7f8bf4159450 0x7f8bf415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 -- 172.21.15.82:0/542743653 >> v1:172.21.15.183:6789/0 conn(0x7f8bf40cc3e0 legacy=0x7f8bf40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.307+0000 7f8bf3fff640 1 -- 172.21.15.82:0/542743653 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4159cc0 con 0x7f8bf4159830 2023-07-20T10:05:23.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bf3fff640 1 --2- 172.21.15.82:0/542743653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4159830 0x7f8bf40cbea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8bf406a6c0 tx=0x7f8be001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc69385cce59f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bf37fe640 1 -- 172.21.15.82:0/542743653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be00aa610 con 0x7f8bf4159830 2023-07-20T10:05:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bf37fe640 1 -- 172.21.15.82:0/542743653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be00a6040 con 0x7f8bf4159830 2023-07-20T10:05:23.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bf37fe640 1 -- 172.21.15.82:0/542743653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be00aa990 con 0x7f8bf4159830 2023-07-20T10:05:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/542743653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4159830 msgr2=0x7f8bf40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/542743653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4159830 0x7f8bf40cbea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8bf406a6c0 tx=0x7f8be001c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/542743653 shutdown_connections 2023-07-20T10:05:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/542743653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4159830 0x7f8bf40cbea0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/542743653 >> v2:172.21.15.183:3300/0 conn(0x7f8bf4159450 0x7f8bf415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/542743653 >> 172.21.15.82:0/542743653 conn(0x7f8bf40cad50 msgr2=0x7f8bf40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/542743653 shutdown_connections 2023-07-20T10:05:23.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.311+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/542743653 wait complete. 2023-07-20T10:05:23.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 Processor -- start 2023-07-20T10:05:23.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- start start 2023-07-20T10:05:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf40cc3e0 0x7f8bf40c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bf4159450 0x7f8bf40c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf40acbb0 con 0x7f8bf4165440 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf40ac2a0 con 0x7f8bf40cc3e0 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf40c1300 con 0x7f8bf4159450 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48554/0 (socket says 172.21.15.82:48554) 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 -- 172.21.15.82:0/2182590082 learned_addr learned my addr 172.21.15.82:0/2182590082 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf8d2b640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf40cc3e0 0x7f8bf40c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf3fff640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bf4159450 0x7f8bf40c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 -- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bf4159450 msgr2=0x7f8bf40c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bf4159450 0x7f8bf40c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 -- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf40cc3e0 msgr2=0x7f8bf40c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf40cc3e0 0x7f8bf40c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 -- 172.21.15.82:0/2182590082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00094d0 con 0x7f8bf4165440 2023-07-20T10:05:23.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf952c640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c7a0 tx=0x7f8bec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec003b80 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec003ce0 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf41659b0 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00aa30 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf40ac7d0 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.315+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf40accf0 con 0x7f8bf4165440 2023-07-20T10:05:23.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.319+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8bec00ab90 con 0x7f8bf4165440 2023-07-20T10:05:23.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.319+0000 7f8bf17fa640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 0x7f8bd8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:23.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.319+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8bec084230 con 0x7f8bf4165440 2023-07-20T10:05:23.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.319+0000 7f8bf8d2b640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 0x7f8bd8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:23.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.319+0000 7f8bf8d2b640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 0x7f8bd8068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006aa0 tx=0x7f8be8008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:23.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.323+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bec051920 con 0x7f8bf4165440 2023-07-20T10:05:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:23.467+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8bf40accf0 con 0x7f8bf4165440 2023-07-20T10:05:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.135+0000 7f8bf17fa640 1 -- 172.21.15.82:0/2182590082 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8bf40accf0 con 0x7f8bf4165440 2023-07-20T10:05:24.117 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:05:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.143+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 msgr2=0x7f8bd8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.143+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 0x7f8bd8068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006aa0 tx=0x7f8be8008040 comp rx=0 tx=0).stop 2023-07-20T10:05:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.143+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 msgr2=0x7f8bf40c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.143+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00c7a0 tx=0x7f8bec00cc60 comp rx=0 tx=0).stop 2023-07-20T10:05:24.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 shutdown_connections 2023-07-20T10:05:24.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f8bd80663a0 0x7f8bd8068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4165440 0x7f8bf40c88e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8bf4159450 0x7f8bf40c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 --2- 172.21.15.82:0/2182590082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf40cc3e0 0x7f8bf40c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 >> 172.21.15.82:0/2182590082 conn(0x7f8bf40cad50 msgr2=0x7f8bf406be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:24.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 shutdown_connections 2023-07-20T10:05:24.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.147+0000 7f8bfaf8f640 1 -- 172.21.15.82:0/2182590082 wait complete. 2023-07-20T10:05:24.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:05:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 Processor -- start 2023-07-20T10:05:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 -- start start 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa32015a4f0 0x7fa32006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa320069750 0x7fa320069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32006a0e0 con 0x7fa3201603e0 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32015a8d0 con 0x7fa320069750 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa324a56640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32006ce00 con 0x7fa32015a4f0 2023-07-20T10:05:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa320069750 0x7fa320069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa320069750 0x7fa320069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48564/0 (socket says 172.21.15.82:48564) 2023-07-20T10:05:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 -- 172.21.15.82:0/3862769361 learned_addr learned my addr 172.21.15.82:0/3862769361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31dd9b640 1 --1- 172.21.15.82:0/3862769361 >> v1:172.21.15.82:6789/0 conn(0x7fa3201603e0 0x7fa320070820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49842/0 (socket says 172.21.15.82:49842) 2023-07-20T10:05:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31e59c640 1 --2- 172.21.15.82:0/3862769361 >> v2:172.21.15.183:3300/0 conn(0x7fa32015a4f0 0x7fa32006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 -- 172.21.15.82:0/3862769361 >> v2:172.21.15.183:3300/0 conn(0x7fa32015a4f0 msgr2=0x7fa32006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 --2- 172.21.15.82:0/3862769361 >> v2:172.21.15.183:3300/0 conn(0x7fa32015a4f0 0x7fa32006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 -- 172.21.15.82:0/3862769361 >> v1:172.21.15.82:6789/0 conn(0x7fa3201603e0 legacy=0x7fa320070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31ed9d640 1 -- 172.21.15.82:0/3862769361 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320070f30 con 0x7fa320069750 2023-07-20T10:05:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.319+0000 7fa31d59a640 1 -- 172.21.15.82:0/3862769361 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615372598 0 0) 0x7fa314001120 con 0x7fa3201603e0 2023-07-20T10:05:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa31ed9d640 1 --2- 172.21.15.82:0/3862769361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa320069750 0x7fa320069ba0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa32006c330 tx=0x7fa31801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1675b488b9a35cd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa31d59a640 1 -- 172.21.15.82:0/3862769361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180ab600 con 0x7fa320069750 2023-07-20T10:05:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa31d59a640 1 -- 172.21.15.82:0/3862769361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3180a7050 con 0x7fa320069750 2023-07-20T10:05:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa31d59a640 1 -- 172.21.15.82:0/3862769361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180ab980 con 0x7fa320069750 2023-07-20T10:05:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 -- 172.21.15.82:0/3862769361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa320069750 msgr2=0x7fa320069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 --2- 172.21.15.82:0/3862769361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa320069750 0x7fa320069ba0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa32006c330 tx=0x7fa31801c500 comp rx=0 tx=0).stop 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 -- 172.21.15.82:0/3862769361 shutdown_connections 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 --2- 172.21.15.82:0/3862769361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa320069750 0x7fa320069ba0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 --2- 172.21.15.82:0/3862769361 >> v2:172.21.15.183:3300/0 conn(0x7fa32015a4f0 0x7fa32006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 -- 172.21.15.82:0/3862769361 >> 172.21.15.82:0/3862769361 conn(0x7fa3200cbe80 msgr2=0x7fa3200cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 -- 172.21.15.82:0/3862769361 shutdown_connections 2023-07-20T10:05:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.323+0000 7fa324a56640 1 -- 172.21.15.82:0/3862769361 wait complete. 2023-07-20T10:05:24.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 Processor -- start 2023-07-20T10:05:24.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- start start 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa320069750 0x7fa3200aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 0x7fa320151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200ad270 con 0x7fa32015a4f0 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c3040 con 0x7fa3201603e0 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3200c3320 con 0x7fa320069750 2023-07-20T10:05:24.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48568/0 (socket says 172.21.15.82:48568) 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 -- 172.21.15.82:0/2779424442 learned_addr learned my addr 172.21.15.82:0/2779424442 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31ed9d640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 0x7fa320151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31e59c640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa320069750 0x7fa3200aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 -- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa320069750 msgr2=0x7fa3200aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa320069750 0x7fa3200aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 -- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 msgr2=0x7fa320151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:24.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 0x7fa320151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:24.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 -- 172.21.15.82:0/2779424442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180094d0 con 0x7fa32015a4f0 2023-07-20T10:05:24.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31ed9d640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 0x7fa320151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa31dd9b640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c480 tx=0x7fa31400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140074e0 con 0x7fa32015a4f0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314007660 con 0x7fa32015a4f0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200c3600 con 0x7fa32015a4f0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314004a30 con 0x7fa32015a4f0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.327+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3200abb20 con 0x7fa32015a4f0 2023-07-20T10:05:24.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32004da30 con 0x7fa32015a4f0 2023-07-20T10:05:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa314004b90 con 0x7fa32015a4f0 2023-07-20T10:05:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa30effd640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 0x7fa300068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:24.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fa314083180 con 0x7fa32015a4f0 2023-07-20T10:05:24.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa31e59c640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 0x7fa300068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:24.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.331+0000 7fa31e59c640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 0x7fa300068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa310003fd0 tx=0x7fa3100039a0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:24.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.335+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa314053fd0 con 0x7fa32015a4f0 2023-07-20T10:05:24.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:24.515+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa32006a0e0 con 0x7fa32015a4f0 2023-07-20T10:05:25.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.135+0000 7fa30effd640 1 -- 172.21.15.82:0/2779424442 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v30) v1 ==== 173+0+0 (secure 0 0 0) 0x7fa32006a0e0 con 0x7fa32015a4f0 2023-07-20T10:05:25.119 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 9 and data pool 10 2023-07-20T10:05:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 msgr2=0x7fa300068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 0x7fa300068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa310003fd0 tx=0x7fa3100039a0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 msgr2=0x7fa3200ac7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c480 tx=0x7fa31400c940 comp rx=0 tx=0).stop 2023-07-20T10:05:25.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 shutdown_connections 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3201603e0 0x7fa320151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fa3000663a0 0x7fa300068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa32015a4f0 0x7fa3200ac7b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 --2- 172.21.15.82:0/2779424442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa320069750 0x7fa3200aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 >> 172.21.15.82:0/2779424442 conn(0x7fa3200cbe80 msgr2=0x7fa3200ae350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 shutdown_connections 2023-07-20T10:05:25.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.143+0000 7fa324a56640 1 -- 172.21.15.82:0/2779424442 wait complete. 2023-07-20T10:05:25.165 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.323+0000 7f3e73703640 1 Processor -- start 2023-07-20T10:05:25.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.323+0000 7f3e73703640 1 -- start start 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e73703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e73703640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e6c0b2060 0x7f3e6c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e73703640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c0b06c0 con 0x7f3e6c15a8e0 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e73703640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b3160 con 0x7f3e6c0b2060 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e73703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b12a0 con 0x7f3e6c0afda0 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e6c0b2060 0x7f3e6c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e6c0b2060 0x7f3e6c0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48574/0 (socket says 172.21.15.82:48574) 2023-07-20T10:05:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 -- 172.21.15.82:0/3224256115 learned_addr learned my addr 172.21.15.82:0/3224256115 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e7149f640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 -- 172.21.15.82:0/3224256115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 msgr2=0x7f3e6c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 -- 172.21.15.82:0/3224256115 >> v1:172.21.15.183:6789/0 conn(0x7f3e6c15a8e0 legacy=0x7f3e6c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 -- 172.21.15.82:0/3224256115 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0b1580 con 0x7f3e6c0b2060 2023-07-20T10:05:25.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e71ca0640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c0b0180 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e6401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7ca594c4c6f132 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.327+0000 7f3e63fff640 1 -- 172.21.15.82:0/3224256115 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640a5700 con 0x7f3e6c0b2060 2023-07-20T10:05:25.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e63fff640 1 -- 172.21.15.82:0/3224256115 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e640a5860 con 0x7f3e6c0b2060 2023-07-20T10:05:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e63fff640 1 -- 172.21.15.82:0/3224256115 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640a5bf0 con 0x7f3e6c0b2060 2023-07-20T10:05:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- 172.21.15.82:0/3224256115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 msgr2=0x7f3e6c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c0b0180 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009e50 tx=0x7f3e6401c880 comp rx=0 tx=0).stop 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- 172.21.15.82:0/3224256115 shutdown_connections 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c0b0180 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- 172.21.15.82:0/3224256115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- 172.21.15.82:0/3224256115 >> 172.21.15.82:0/3224256115 conn(0x7f3e6c0cada0 msgr2=0x7f3e6c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- 172.21.15.82:0/3224256115 shutdown_connections 2023-07-20T10:05:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- 172.21.15.82:0/3224256115 wait complete. 2023-07-20T10:05:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 Processor -- start 2023-07-20T10:05:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- start start 2023-07-20T10:05:25.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 0x7f3e6c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15bed0 con 0x7f3e6c0b2060 2023-07-20T10:05:25.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15c1b0 con 0x7f3e6c15a8e0 2023-07-20T10:05:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e73703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15c490 con 0x7f3e6c0afda0 2023-07-20T10:05:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e70c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e70c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48576/0 (socket says 172.21.15.82:48576) 2023-07-20T10:05:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.331+0000 7f3e70c9e640 1 -- 172.21.15.82:0/2844651013 learned_addr learned my addr 172.21.15.82:0/2844651013 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e7149f640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e71ca0640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 0x7f3e6c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 -- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 msgr2=0x7f3e6c155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 -- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 msgr2=0x7f3e6c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 0x7f3e6c0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 -- 172.21.15.82:0/2844651013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64009b30 con 0x7f3e6c0b2060 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e71ca0640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 0x7f3e6c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e70c9e640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b410 tx=0x7f3e5c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c004020 con 0x7f3e6c0b2060 2023-07-20T10:05:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c004180 con 0x7f3e6c0b2060 2023-07-20T10:05:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c15c770 con 0x7f3e6c0b2060 2023-07-20T10:05:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c011630 con 0x7f3e6c0b2060 2023-07-20T10:05:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c156170 con 0x7f3e6c0b2060 2023-07-20T10:05:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c073c70 con 0x7f3e6c0b2060 2023-07-20T10:05:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3e5c011790 con 0x7f3e6c0b2060 2023-07-20T10:05:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 0x7f3e50068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e5c083c00 con 0x7f3e6c0b2060 2023-07-20T10:05:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.335+0000 7f3e7149f640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 0x7f3e50068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.339+0000 7f3e7149f640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 0x7f3e50068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a970 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.339+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e5c050f50 con 0x7f3e6c0b2060 2023-07-20T10:05:25.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e6c0c8c20 con 0x7f3e6c0b2060 2023-07-20T10:05:25.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e61ffb640 1 -- 172.21.15.82:0/2844651013 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f3e5c054570 con 0x7f3e6c0b2060 2023-07-20T10:05:25.473 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:25.473 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:24.518214+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:25.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 msgr2=0x7f3e50068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 0x7f3e50068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800a970 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 msgr2=0x7f3e6c15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c00b410 tx=0x7f3e5c00b8d0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 shutdown_connections 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e6c15a8e0 0x7f3e6c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f3e500663a0 0x7f3e50068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e6c0b2060 0x7f3e6c15d490 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 --2- 172.21.15.82:0/2844651013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e6c0afda0 0x7f3e6c155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.491+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 >> 172.21.15.82:0/2844651013 conn(0x7f3e6c0cada0 msgr2=0x7f3e6c0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.495+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 shutdown_connections 2023-07-20T10:05:25.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.495+0000 7f3e73703640 1 -- 172.21.15.82:0/2844651013 wait complete. 2023-07-20T10:05:25.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:25.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.651+0000 7f84a21fa640 1 Processor -- start 2023-07-20T10:05:25.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 -- start start 2023-07-20T10:05:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 0x7f849c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 0x7f849c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c0ccd90 con 0x7f849c1596b0 2023-07-20T10:05:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0ad600 con 0x7f849c0cc900 2023-07-20T10:05:25.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f84a21fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0ad810 con 0x7f849c0b2a90 2023-07-20T10:05:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f849c1596b0 0x7f849c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49846/0 (socket says 172.21.15.82:49846) 2023-07-20T10:05:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849b7fe640 1 -- 172.21.15.82:0/1371654690 learned_addr learned my addr 172.21.15.82:0/1371654690 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f8493fff640 1 --2- 172.21.15.82:0/1371654690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 0x7f849c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849bfff640 1 --2- 172.21.15.82:0/1371654690 >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 0x7f849c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849affd640 1 -- 172.21.15.82:0/1371654690 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292473253 0 0) 0x7f849c0ccd90 con 0x7f849c1596b0 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849affd640 1 -- 172.21.15.82:0/1371654690 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8488003530 con 0x7f849c1596b0 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f8493fff640 1 -- 172.21.15.82:0/1371654690 >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 msgr2=0x7f849c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f8493fff640 1 --2- 172.21.15.82:0/1371654690 >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 0x7f849c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f8493fff640 1 -- 172.21.15.82:0/1371654690 >> v1:172.21.15.82:6789/0 conn(0x7f849c1596b0 legacy=0x7f849c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f8493fff640 1 -- 172.21.15.82:0/1371654690 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c15d0d0 con 0x7f849c0b2a90 2023-07-20T10:05:25.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.655+0000 7f849bfff640 1 --2- 172.21.15.82:0/1371654690 >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 0x7f849c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:25.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f8493fff640 1 --2- 172.21.15.82:0/1371654690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 0x7f849c15dbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84840097c0 tx=0x7f848401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7cd9e8cb9d0b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f849affd640 1 -- 172.21.15.82:0/1371654690 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840ab650 con 0x7f849c0b2a90 2023-07-20T10:05:25.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f849affd640 1 -- 172.21.15.82:0/1371654690 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840ab7b0 con 0x7f849c0b2a90 2023-07-20T10:05:25.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f849affd640 1 -- 172.21.15.82:0/1371654690 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840abb40 con 0x7f849c0b2a90 2023-07-20T10:05:25.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 -- 172.21.15.82:0/1371654690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 msgr2=0x7f849c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 --2- 172.21.15.82:0/1371654690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 0x7f849c15dbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f84840097c0 tx=0x7f848401c450 comp rx=0 tx=0).stop 2023-07-20T10:05:25.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 -- 172.21.15.82:0/1371654690 shutdown_connections 2023-07-20T10:05:25.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 --2- 172.21.15.82:0/1371654690 >> v2:172.21.15.183:3300/0 conn(0x7f849c0cc900 0x7f849c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 --2- 172.21.15.82:0/1371654690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c0b2a90 0x7f849c15dbb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 -- 172.21.15.82:0/1371654690 >> 172.21.15.82:0/1371654690 conn(0x7f849c0cada0 msgr2=0x7f849c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 -- 172.21.15.82:0/1371654690 shutdown_connections 2023-07-20T10:05:25.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.659+0000 7f84a21fa640 1 -- 172.21.15.82:0/1371654690 wait complete. 2023-07-20T10:05:25.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 Processor -- start 2023-07-20T10:05:25.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- start start 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f849c0b2a90 0x7f849c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c1596b0 0x7f849c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c155540 con 0x7f849c0cc900 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0c53f0 con 0x7f849c0b2a90 2023-07-20T10:05:25.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0c6250 con 0x7f849c1596b0 2023-07-20T10:05:25.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48592/0 (socket says 172.21.15.82:48592) 2023-07-20T10:05:25.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 -- 172.21.15.82:0/3101280976 learned_addr learned my addr 172.21.15.82:0/3101280976 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:25.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f849b7fe640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f849c0b2a90 0x7f849c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f849bfff640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c1596b0 0x7f849c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 -- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c1596b0 msgr2=0x7f849c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c1596b0 0x7f849c0abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 -- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f849c0b2a90 msgr2=0x7f849c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f849c0b2a90 0x7f849c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 -- 172.21.15.82:0/3101280976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009a70 con 0x7f849c0cc900 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8493fff640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f84840ad040 tx=0x7f848401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840bf610 con 0x7f849c0cc900 2023-07-20T10:05:25.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84840bf7b0 con 0x7f849c0cc900 2023-07-20T10:05:25.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8484009420 con 0x7f849c0cc900 2023-07-20T10:05:25.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840bfb60 con 0x7f849c0cc900 2023-07-20T10:05:25.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0c5920 con 0x7f849c0cc900 2023-07-20T10:05:25.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.663+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c073c70 con 0x7f849c0cc900 2023-07-20T10:05:25.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.667+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84840b5400 con 0x7f849c0cc900 2023-07-20T10:05:25.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.667+0000 7f8498ff9640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 0x7f847c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.667+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f848411e980 con 0x7f849c0cc900 2023-07-20T10:05:25.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.667+0000 7f849b7fe640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 0x7f847c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.667+0000 7f849b7fe640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 0x7f847c068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f848c0011f0 tx=0x7f848c007d40 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.671+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84840ebf50 con 0x7f849c0cc900 2023-07-20T10:05:25.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f849c0c6390 con 0x7f849c0cc900 2023-07-20T10:05:25.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f8498ff9640 1 -- 172.21.15.82:0/3101280976 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f849c0c6390 con 0x7f849c0cc900 2023-07-20T10:05:25.800 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:25.801 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:24.518214+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:25.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 msgr2=0x7f847c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 0x7f847c068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f848c0011f0 tx=0x7f848c007d40 comp rx=0 tx=0).stop 2023-07-20T10:05:25.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 msgr2=0x7f849c0abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f84840ad040 tx=0x7f848401ac90 comp rx=0 tx=0).stop 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 shutdown_connections 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f849c1596b0 0x7f849c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f847c0663a0 0x7f847c068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849c0cc900 0x7f849c0abaa0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 --2- 172.21.15.82:0/3101280976 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f849c0b2a90 0x7f849c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 >> 172.21.15.82:0/3101280976 conn(0x7f849c0cada0 msgr2=0x7f849c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 shutdown_connections 2023-07-20T10:05:25.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.819+0000 7f84a21fa640 1 -- 172.21.15.82:0/3101280976 wait complete. 2023-07-20T10:05:25.822 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:05:25.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.983+0000 7f1b18b67640 1 Processor -- start 2023-07-20T10:05:25.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 -- start start 2023-07-20T10:05:25.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b14159450 0x7f1b1415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b14159830 0x7f1b140cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b140cc8d0 con 0x7f1b140cc3e0 2023-07-20T10:05:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b140cce90 con 0x7f1b14159830 2023-07-20T10:05:25.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b18b67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140ccbb0 con 0x7f1b14159450 2023-07-20T10:05:25.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b12d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1b140cc3e0 0x7f1b140afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49850/0 (socket says 172.21.15.82:49850) 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b12d9d640 1 -- 172.21.15.82:0/881730302 learned_addr learned my addr 172.21.15.82:0/881730302 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b14159450 0x7f1b1415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b09d9b640 1 --2- 172.21.15.82:0/881730302 >> v2:172.21.15.183:3300/0 conn(0x7f1b14159830 0x7f1b140cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003861235 0 0) 0x7f1b140cc8d0 con 0x7f1b140cc3e0 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b00005740 con 0x7f1b140cc3e0 2023-07-20T10:05:25.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259381068 0 0) 0x7f1b00005740 con 0x7f1b140cc3e0 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b14159450 msgr2=0x7f1b1415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b14159450 0x7f1b1415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 >> v2:172.21.15.183:3300/0 conn(0x7f1b14159830 msgr2=0x7f1b140cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 --2- 172.21.15.82:0/881730302 >> v2:172.21.15.183:3300/0 conn(0x7f1b14159830 0x7f1b140cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14159cc0 con 0x7f1b140cc3e0 2023-07-20T10:05:25.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f1b0c001a20 con 0x7f1b140cc3e0 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 >> v1:172.21.15.82:6789/0 conn(0x7f1b140cc3e0 legacy=0x7f1b140afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b00006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b000069e0 0x7f1b00006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b000073a0 0x7f1b0000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140cce90 con 0x7f1b00005c00 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b140ccbb0 con 0x7f1b000069e0 2023-07-20T10:05:25.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0000e0e0 con 0x7f1b000073a0 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b14159450 0x7f1b1415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b00006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b12d9d640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b000073a0 0x7f1b0000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b09d9b640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b000069e0 0x7f1b00006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 -- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b000073a0 msgr2=0x7f1b0000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b000073a0 0x7f1b0000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 -- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b000069e0 msgr2=0x7f1b00006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:25.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b000069e0 0x7f1b00006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.987+0000 7f1b1259c640 1 -- 172.21.15.82:0/881730302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00005740 con 0x7f1b00005c00 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b1259c640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b00006020 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009b20 tx=0x7f1b0401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f20429fe16d809b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04004030 con 0x7f1b00005c00 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04004190 con 0x7f1b00005c00 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b11d9b640 1 -- 172.21.15.82:0/881730302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04004520 con 0x7f1b00005c00 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 -- 172.21.15.82:0/881730302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 msgr2=0x7f1b00006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 --2- 172.21.15.82:0/881730302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b00006020 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009b20 tx=0x7f1b0401ca60 comp rx=0 tx=0).stop 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b12d9d640 1 -- 172.21.15.82:0/881730302 reap_dead start 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 -- 172.21.15.82:0/881730302 shutdown_connections 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 -- 172.21.15.82:0/881730302 >> 172.21.15.82:0/881730302 conn(0x7f1b140cad50 msgr2=0x7f1b140cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 -- 172.21.15.82:0/881730302 shutdown_connections 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.991+0000 7f1b18b67640 1 -- 172.21.15.82:0/881730302 wait complete. 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 Processor -- start 2023-07-20T10:05:25.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- start start 2023-07-20T10:05:25.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1415c740 0x7f1b14153890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b140c3140 0x7f1b14157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415c2b0 con 0x7f1b00005c00 2023-07-20T10:05:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14153dd0 con 0x7f1b1415c740 2023-07-20T10:05:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1415b6a0 con 0x7f1b140c3140 2023-07-20T10:05:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48604/0 (socket says 172.21.15.82:48604) 2023-07-20T10:05:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 -- 172.21.15.82:0/3479300197 learned_addr learned my addr 172.21.15.82:0/3479300197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b12d9d640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b140c3140 0x7f1b14157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b09d9b640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1415c740 0x7f1b14153890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 -- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b140c3140 msgr2=0x7f1b14157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b140c3140 0x7f1b14157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 -- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1415c740 msgr2=0x7f1b14153890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1415c740 0x7f1b14153890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 -- 172.21.15.82:0/3479300197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1415b980 con 0x7f1b00005c00 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b1259c640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1b0401caa0 tx=0x7f1b00007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400f000 con 0x7f1b00005c00 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b04003d00 con 0x7f1b00005c00 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04003e70 con 0x7f1b00005c00 2023-07-20T10:05:25.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1415bc60 con 0x7f1b00005c00 2023-07-20T10:05:25.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.995+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b140c35c0 con 0x7f1b00005c00 2023-07-20T10:05:25.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1404da30 con 0x7f1b00005c00 2023-07-20T10:05:25.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b040a5540 con 0x7f1b00005c00 2023-07-20T10:05:25.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b0b7fe640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 0x7f1af4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:25.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b0411deb0 con 0x7f1b00005c00 2023-07-20T10:05:25.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b09d9b640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 0x7f1af4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:25.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:25.999+0000 7f1b09d9b640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 0x7f1af4068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b1406f750 tx=0x7f1afc008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:25.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:26.003+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b040eb2b0 con 0x7f1b00005c00 2023-07-20T10:05:26.090 INFO:tasks.ceph.mds.b.smithi183.stderr:2023-07-20T10:05:26.113+0000 7ff3fc22d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:05:26.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:26.187+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1b1404da30 con 0x7f1b00005c00 2023-07-20T10:05:27.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.179+0000 7f1b0b7fe640 1 -- 172.21.15.82:0/3479300197 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1b040ee8d0 con 0x7f1b00005c00 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.179+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 msgr2=0x7f1af4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.179+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 0x7f1af4068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1b1406f750 tx=0x7f1afc008040 comp rx=0 tx=0).stop 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 msgr2=0x7f1b1415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1b0401caa0 tx=0x7f1b00007a10 comp rx=0 tx=0).stop 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 shutdown_connections 2023-07-20T10:05:27.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b140c3140 0x7f1b14157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b1415c740 0x7f1b14153890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1af40663a0 0x7f1af4068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 --2- 172.21.15.82:0/3479300197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b00005c00 0x7f1b1415b050 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 >> 172.21.15.82:0/3479300197 conn(0x7f1b140cad50 msgr2=0x7f1b14158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 shutdown_connections 2023-07-20T10:05:27.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.183+0000 7f1b18b67640 1 -- 172.21.15.82:0/3479300197 wait complete. 2023-07-20T10:05:27.185 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:05:27.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:05:27.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:05:27.313 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:05:27.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 Processor -- start 2023-07-20T10:05:27.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 -- start start 2023-07-20T10:05:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c15c8e0 0x7f161c06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f161c0d0320 0x7f161c0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161c0cd5e0 con 0x7f161c0d0ca0 2023-07-20T10:05:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c06b020 con 0x7f161c0d0320 2023-07-20T10:05:27.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f1622027640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0cf800 con 0x7f161c15c8e0 2023-07-20T10:05:27.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f161c0d0320 0x7f161c0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f161c0d0320 0x7f161c0cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48612/0 (socket says 172.21.15.82:48612) 2023-07-20T10:05:27.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 -- 172.21.15.82:0/2989520235 learned_addr learned my addr 172.21.15.82:0/2989520235 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:27.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161b7fe640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c15c8e0 0x7f161c06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 -- 172.21.15.82:0/2989520235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c15c8e0 msgr2=0x7f161c06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c15c8e0 0x7f161c06aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 -- 172.21.15.82:0/2989520235 >> v1:172.21.15.183:6789/0 conn(0x7f161c0d0ca0 legacy=0x7f161c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.351+0000 7f161affd640 1 -- 172.21.15.82:0/2989520235 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0cfae0 con 0x7f161c0d0320 2023-07-20T10:05:27.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f161affd640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0320 0x7f161c0cef00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1610009870 tx=0x7f161001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a819547d8da51d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:27.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f161a7fc640 1 -- 172.21.15.82:0/2989520235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100aa650 con 0x7f161c0d0320 2023-07-20T10:05:27.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f161a7fc640 1 -- 172.21.15.82:0/2989520235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100aa7b0 con 0x7f161c0d0320 2023-07-20T10:05:27.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f161a7fc640 1 -- 172.21.15.82:0/2989520235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100aab40 con 0x7f161c0d0320 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 -- 172.21.15.82:0/2989520235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0320 msgr2=0x7f161c0cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0320 0x7f161c0cef00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1610009870 tx=0x7f161001c510 comp rx=0 tx=0).stop 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 -- 172.21.15.82:0/2989520235 shutdown_connections 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0320 0x7f161c0cef00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 --2- 172.21.15.82:0/2989520235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c15c8e0 0x7f161c06aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 -- 172.21.15.82:0/2989520235 >> 172.21.15.82:0/2989520235 conn(0x7f161c065d40 msgr2=0x7f161c09b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:27.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 -- 172.21.15.82:0/2989520235 shutdown_connections 2023-07-20T10:05:27.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.355+0000 7f1622027640 1 -- 172.21.15.82:0/2989520235 wait complete. 2023-07-20T10:05:27.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 Processor -- start 2023-07-20T10:05:27.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- start start 2023-07-20T10:05:27.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c0d0320 0x7f161c155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 0x7f161c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0b4b70 con 0x7f161c0d0ca0 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0b3c70 con 0x7f161c15c8e0 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0c98e0 con 0x7f161c0d0320 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48628/0 (socket says 172.21.15.82:48628) 2023-07-20T10:05:27.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 -- 172.21.15.82:0/185777084 learned_addr learned my addr 172.21.15.82:0/185777084 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:27.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161b7fe640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c0d0320 0x7f161c155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161bfff640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 0x7f161c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 -- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c0d0320 msgr2=0x7f161c155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c0d0320 0x7f161c155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 -- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 msgr2=0x7f161c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 0x7f161c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 -- 172.21.15.82:0/185777084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100094d0 con 0x7f161c0d0ca0 2023-07-20T10:05:27.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161bfff640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 0x7f161c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f161affd640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f16100ac040 tx=0x7f161001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100b3800 con 0x7f161c0d0ca0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100b3980 con 0x7f161c0d0ca0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100b3d30 con 0x7f161c0d0ca0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c0c9bc0 con 0x7f161c0d0ca0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.359+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c0ca180 con 0x7f161c0d0ca0 2023-07-20T10:05:27.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c04da30 con 0x7f161c0d0ca0 2023-07-20T10:05:27.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f16100b2380 con 0x7f161c0d0ca0 2023-07-20T10:05:27.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f1603fff640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 0x7f1608068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:27.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f161011e780 con 0x7f161c0d0ca0 2023-07-20T10:05:27.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f161b7fe640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 0x7f1608068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:27.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.363+0000 7f161b7fe640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 0x7f1608068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f161c1f8820 tx=0x7f160c009190 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:27.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.367+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16100eba80 con 0x7f161c0d0ca0 2023-07-20T10:05:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:27.547+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f161c0d2c40 con 0x7f161c0d0ca0 2023-07-20T10:05:28.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1603fff640 1 -- 172.21.15.82:0/185777084 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16100aa610 con 0x7f161c0d0ca0 2023-07-20T10:05:28.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 msgr2=0x7f1608068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 0x7f1608068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f161c1f8820 tx=0x7f160c009190 comp rx=0 tx=0).stop 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 msgr2=0x7f161c0b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f16100ac040 tx=0x7f161001ad50 comp rx=0 tx=0).stop 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 shutdown_connections 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f161c15c8e0 0x7f161c0b3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f16080663a0 0x7f1608068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f161c0d0ca0 0x7f161c0b31f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 --2- 172.21.15.82:0/185777084 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f161c0d0320 0x7f161c155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.187+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 >> 172.21.15.82:0/185777084 conn(0x7f161c065d40 msgr2=0x7f161c158f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.191+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 shutdown_connections 2023-07-20T10:05:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.191+0000 7f1622027640 1 -- 172.21.15.82:0/185777084 wait complete. 2023-07-20T10:05:28.193 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:05:28.193 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 Processor -- start 2023-07-20T10:05:28.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 -- start start 2023-07-20T10:05:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b5015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b50159ff0 con 0x7f2b5015d5a0 2023-07-20T10:05:28.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5015da90 con 0x7f2b50159420 2023-07-20T10:05:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b55398640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5015e050 con 0x7f2b50159800 2023-07-20T10:05:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b54b97640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2b5015d5a0 0x7f2b500c98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49860/0 (socket says 172.21.15.82:49860) 2023-07-20T10:05:28.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b54b97640 1 -- 172.21.15.82:0/3962457013 learned_addr learned my addr 172.21.15.82:0/3962457013 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b5015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480830572 0 0) 0x7f2b50159ff0 con 0x7f2b5015d5a0 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b38003530 con 0x7f2b5015d5a0 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126607956 0 0) 0x7f2b38003530 con 0x7f2b5015d5a0 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 msgr2=0x7f2b5015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b5015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 >> v1:172.21.15.183:6789/0 conn(0x7f2b50159420 legacy=0x7f2b5015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5015dd70 con 0x7f2b5015d5a0 2023-07-20T10:05:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2b48001a00 con 0x7f2b5015d5a0 2023-07-20T10:05:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 >> v1:172.21.15.82:6789/0 conn(0x7f2b5015d5a0 legacy=0x7f2b500c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b380039b0 0x7f2b38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b38004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b38005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5015e050 con 0x7f2b380047d0 2023-07-20T10:05:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3800ba70 con 0x7f2b380039b0 2023-07-20T10:05:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3800bc30 con 0x7f2b50159800 2023-07-20T10:05:28.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b38004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b54b97640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b38005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4ffff640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b380039b0 0x7f2b38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 -- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 msgr2=0x7f2b38005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b50159800 0x7f2b38005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 -- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b380039b0 msgr2=0x7f2b38003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b380039b0 0x7f2b38003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.355+0000 7f2b4f7fe640 1 -- 172.21.15.82:0/3962457013 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38003530 con 0x7f2b380047d0 2023-07-20T10:05:28.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b38004c50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009a90 tx=0x7f2b4401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfafbbb996065f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440059a0 con 0x7f2b380047d0 2023-07-20T10:05:28.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b44005b00 con 0x7f2b380047d0 2023-07-20T10:05:28.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b4effd640 1 -- 172.21.15.82:0/3962457013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44006030 con 0x7f2b380047d0 2023-07-20T10:05:28.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 -- 172.21.15.82:0/3962457013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 msgr2=0x7f2b38004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 --2- 172.21.15.82:0/3962457013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b38004c50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009a90 tx=0x7f2b4401c9f0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b54b97640 1 -- 172.21.15.82:0/3962457013 reap_dead start 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 -- 172.21.15.82:0/3962457013 shutdown_connections 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 -- 172.21.15.82:0/3962457013 >> 172.21.15.82:0/3962457013 conn(0x7f2b500afb90 msgr2=0x7f2b500affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 -- 172.21.15.82:0/3962457013 shutdown_connections 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.359+0000 7f2b55398640 1 -- 172.21.15.82:0/3962457013 wait complete. 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 Processor -- start 2023-07-20T10:05:28.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- start start 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b501e3750 0x7f2b50152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 0x7f2b500c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c20f0 con 0x7f2b380047d0 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c47c0 con 0x7f2b500c3dd0 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c2390 con 0x7f2b501e3750 2023-07-20T10:05:28.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48654/0 (socket says 172.21.15.82:48654) 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 -- 172.21.15.82:0/1508814946 learned_addr learned my addr 172.21.15.82:0/1508814946 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b501e3750 0x7f2b50152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b54b97640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 0x7f2b500c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 -- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b501e3750 msgr2=0x7f2b50152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b501e3750 0x7f2b50152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 -- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 msgr2=0x7f2b500c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 0x7f2b500c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 -- 172.21.15.82:0/1508814946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500c2670 con 0x7f2b380047d0 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b54b97640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 0x7f2b500c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4ffff640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000f5f0 tx=0x7f2b4000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400052e0 con 0x7f2b380047d0 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40005440 con 0x7f2b380047d0 2023-07-20T10:05:28.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40003820 con 0x7f2b380047d0 2023-07-20T10:05:28.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b501e4280 con 0x7f2b380047d0 2023-07-20T10:05:28.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.363+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b50152c90 con 0x7f2b380047d0 2023-07-20T10:05:28.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b50152eb0 con 0x7f2b380047d0 2023-07-20T10:05:28.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2b40003980 con 0x7f2b380047d0 2023-07-20T10:05:28.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b4cff9640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 0x7f2b3c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b40083cb0 con 0x7f2b380047d0 2023-07-20T10:05:28.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 0x7f2b3c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.367+0000 7f2b4f7fe640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 0x7f2b3c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ae000 tx=0x7f2b440046d0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.371+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b40051010 con 0x7f2b380047d0 2023-07-20T10:05:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.547+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b5004da30 con 0x7f2b380047d0 2023-07-20T10:05:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.547+0000 7f2b4cff9640 1 -- 172.21.15.82:0/1508814946 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f2b40054630 con 0x7f2b380047d0 2023-07-20T10:05:28.531 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:28.531 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 msgr2=0x7f2b3c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 0x7f2b3c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ae000 tx=0x7f2b440046d0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 msgr2=0x7f2b500c1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000f5f0 tx=0x7f2b4000fab0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 shutdown_connections 2023-07-20T10:05:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b500c3dd0 0x7f2b500c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b501e3750 0x7f2b50152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2b3c0663d0 0x7f2b3c068890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 --2- 172.21.15.82:0/1508814946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b380047d0 0x7f2b500c1bb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 >> 172.21.15.82:0/1508814946 conn(0x7f2b500afb90 msgr2=0x7f2b500c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:28.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 shutdown_connections 2023-07-20T10:05:28.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.551+0000 7f2b55398640 1 -- 172.21.15.82:0/1508814946 wait complete. 2023-07-20T10:05:28.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:28.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.707+0000 7f31e5688640 1 Processor -- start 2023-07-20T10:05:28.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.707+0000 7f31e5688640 1 -- start start 2023-07-20T10:05:28.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31e015cab0 0x7f31e00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31e00d0d10 0x7f31e00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00cf110 0x7f31e00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00d31c0 con 0x7f31e00d0d10 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00d16b0 con 0x7f31e015cab0 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31e5688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00b3520 con 0x7f31e00cf110 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31e00d0d10 0x7f31e00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f31e00d0d10 0x7f31e00d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48666/0 (socket says 172.21.15.82:48666) 2023-07-20T10:05:28.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 -- 172.21.15.82:0/998155199 learned_addr learned my addr 172.21.15.82:0/998155199 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:28.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31df7fe640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00cf110 0x7f31e00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31deffd640 1 --2- 172.21.15.82:0/998155199 >> v2:172.21.15.183:3300/0 conn(0x7f31e015cab0 0x7f31e00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 -- 172.21.15.82:0/998155199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00cf110 msgr2=0x7f31e00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00cf110 0x7f31e00cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 -- 172.21.15.82:0/998155199 >> v2:172.21.15.183:3300/0 conn(0x7f31e015cab0 msgr2=0x7f31e00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 --2- 172.21.15.82:0/998155199 >> v2:172.21.15.183:3300/0 conn(0x7f31e015cab0 0x7f31e00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 -- 172.21.15.82:0/998155199 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00b2910 con 0x7f31e00d0d10 2023-07-20T10:05:28.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31d67fc640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00d0d10 0x7f31e00d1170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f31e006a660 tx=0x7f31c801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab0425da8ec15dc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31de7fc640 1 -- 172.21.15.82:0/998155199 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80a5820 con 0x7f31e00d0d10 2023-07-20T10:05:28.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31de7fc640 1 -- 172.21.15.82:0/998155199 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c80a5980 con 0x7f31e00d0d10 2023-07-20T10:05:28.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.711+0000 7f31de7fc640 1 -- 172.21.15.82:0/998155199 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c80a5d10 con 0x7f31e00d0d10 2023-07-20T10:05:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- 172.21.15.82:0/998155199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00d0d10 msgr2=0x7f31e00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00d0d10 0x7f31e00d1170 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f31e006a660 tx=0x7f31c801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- 172.21.15.82:0/998155199 shutdown_connections 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00cf110 0x7f31e00cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- 172.21.15.82:0/998155199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00d0d10 0x7f31e00d1170 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- 172.21.15.82:0/998155199 >> v2:172.21.15.183:3300/0 conn(0x7f31e015cab0 0x7f31e00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- 172.21.15.82:0/998155199 >> 172.21.15.82:0/998155199 conn(0x7f31e008c120 msgr2=0x7f31e009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- 172.21.15.82:0/998155199 shutdown_connections 2023-07-20T10:05:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- 172.21.15.82:0/998155199 wait complete. 2023-07-20T10:05:28.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 Processor -- start 2023-07-20T10:05:28.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- start start 2023-07-20T10:05:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00d0d10 0x7f31e015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31e015cab0 0x7f31e0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0154960 con 0x7f31e00cf110 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015e660 con 0x7f31e015cab0 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31e5688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015e8b0 con 0x7f31e00d0d10 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31deffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31deffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48682/0 (socket says 172.21.15.82:48682) 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31deffd640 1 -- 172.21.15.82:0/3614688696 learned_addr learned my addr 172.21.15.82:0/3614688696 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:28.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31d67fc640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00d0d10 0x7f31e015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.715+0000 7f31df7fe640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31e015cab0 0x7f31e0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 -- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00d0d10 msgr2=0x7f31e015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00d0d10 0x7f31e015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 -- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31e015cab0 msgr2=0x7f31e0155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31e015cab0 0x7f31e0155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 -- 172.21.15.82:0/3614688696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8009b30 con 0x7f31e00cf110 2023-07-20T10:05:28.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31deffd640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f31d000d5f0 tx=0x7f31d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00125f0 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0012750 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0012ae0 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e015eb90 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e015f150 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0073c70 con 0x7f31e00cf110 2023-07-20T10:05:28.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f31d0012c40 con 0x7f31e00cf110 2023-07-20T10:05:28.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 0x7f31c00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:28.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31d0084270 con 0x7f31e00cf110 2023-07-20T10:05:28.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.719+0000 7f31d67fc640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 0x7f31c00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:28.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.723+0000 7f31d67fc640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 0x7f31c00688b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ae000 tx=0x7f31c80a7070 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.723+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31d0051670 con 0x7f31e00cf110 2023-07-20T10:05:28.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.871+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31e00b1650 con 0x7f31e00cf110 2023-07-20T10:05:28.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.871+0000 7f31d7fff640 1 -- 172.21.15.82:0/3614688696 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f31d0007380 con 0x7f31e00cf110 2023-07-20T10:05:28.854 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:28.855 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:26.135169+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:28.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 msgr2=0x7f31c00688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 0x7f31c00688b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31c80ae000 tx=0x7f31c80a7070 comp rx=0 tx=0).stop 2023-07-20T10:05:28.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 msgr2=0x7f31e00c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:28.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f31d000d5f0 tx=0x7f31d000dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 shutdown_connections 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31e015cab0 0x7f31e0155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31e00d0d10 0x7f31e015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f31c00663f0 0x7f31c00688b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 --2- 172.21.15.82:0/3614688696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31e00cf110 0x7f31e00c7930 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:28.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 >> 172.21.15.82:0/3614688696 conn(0x7f31e008c120 msgr2=0x7f31e00cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:28.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 shutdown_connections 2023-07-20T10:05:28.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:28.875+0000 7f31e5688640 1 -- 172.21.15.82:0/3614688696 wait complete. 2023-07-20T10:05:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:05:28.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:05:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 Processor -- start 2023-07-20T10:05:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 -- start start 2023-07-20T10:05:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1bcc0d0d10 0x7f1bcc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bcc0d16b0 con 0x7f1bcc15cab0 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0d31c0 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bd178f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b3520 con 0x7f1bcc0d0d10 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48690/0 (socket says 172.21.15.82:48690) 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/3408851462 learned_addr learned my addr 172.21.15.82:0/3408851462 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bc27fc640 1 --2- 172.21.15.82:0/3408851462 >> v2:172.21.15.183:3300/0 conn(0x7f1bcc0d0d10 0x7f1bcc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/3408851462 >> v2:172.21.15.183:3300/0 conn(0x7f1bcc0d0d10 msgr2=0x7f1bcc0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 --2- 172.21.15.82:0/3408851462 >> v2:172.21.15.183:3300/0 conn(0x7f1bcc0d0d10 0x7f1bcc0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/3408851462 >> v1:172.21.15.183:6789/0 conn(0x7f1bcc15cab0 legacy=0x7f1bcc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.035+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/3408851462 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0d0a10 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bcb7fe640 1 --2- 172.21.15.82:0/3408851462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0d0190 tx=0x7f1bc401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe815187be41226 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bca7fc640 1 -- 172.21.15.82:0/3408851462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40aa430 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bca7fc640 1 -- 172.21.15.82:0/3408851462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc40aa590 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bca7fc640 1 -- 172.21.15.82:0/3408851462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40aa920 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 -- 172.21.15.82:0/3408851462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc0cd4b0 msgr2=0x7f1bcc0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 --2- 172.21.15.82:0/3408851462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0d0190 tx=0x7f1bc401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 -- 172.21.15.82:0/3408851462 shutdown_connections 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 --2- 172.21.15.82:0/3408851462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc0cd4b0 0x7f1bcc0cd920 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 --2- 172.21.15.82:0/3408851462 >> v2:172.21.15.183:3300/0 conn(0x7f1bcc0d0d10 0x7f1bcc0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 -- 172.21.15.82:0/3408851462 >> 172.21.15.82:0/3408851462 conn(0x7f1bcc08c120 msgr2=0x7f1bcc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 -- 172.21.15.82:0/3408851462 shutdown_connections 2023-07-20T10:05:29.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.039+0000 7f1bd178f640 1 -- 172.21.15.82:0/3408851462 wait complete. 2023-07-20T10:05:29.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 Processor -- start 2023-07-20T10:05:29.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- start start 2023-07-20T10:05:29.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bcc0cd4b0 0x7f1bcc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bcc0d0d10 0x7f1bcc157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc159cb0 con 0x7f1bcc15cab0 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15f350 con 0x7f1bcc0d0d10 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15f630 con 0x7f1bcc0cd4b0 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48694/0 (socket says 172.21.15.82:48694) 2023-07-20T10:05:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/461016397 learned_addr learned my addr 172.21.15.82:0/461016397 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bcc0cd4b0 msgr2=0x7f1bcc14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bcc0cd4b0 0x7f1bcc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bcc0d0d10 msgr2=0x7f1bcc157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bcc0d0d10 0x7f1bcc157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 -- 172.21.15.82:0/461016397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40094d0 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bcb7fe640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40190e0 tx=0x7f1bc401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40aa430 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc40b3800 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40b3b90 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc15f910 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.043+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc14c080 con 0x7f1bcc15cab0 2023-07-20T10:05:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc159e60 con 0x7f1bcc15cab0 2023-07-20T10:05:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1bc40b3cf0 con 0x7f1bcc15cab0 2023-07-20T10:05:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bc3fff640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 0x7f1bac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bc411e980 con 0x7f1bcc15cab0 2023-07-20T10:05:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bcaffd640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 0x7f1bac068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.047+0000 7f1bcaffd640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 0x7f1bac068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000f70 tx=0x7f1bbc0079c0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.051+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bcc159e60 con 0x7f1bcc15cab0 2023-07-20T10:05:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.195+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bcc14c2a0 con 0x7f1bac0663a0 2023-07-20T10:05:29.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bc3fff640 1 -- 172.21.15.82:0/461016397 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299541 (secure 0 0 0) 0x7f1bbc005080 con 0x7f1bac0663a0 2023-07-20T10:05:29.189 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:29.191 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 msgr2=0x7f1bac068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 0x7f1bac068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000f70 tx=0x7f1bbc0079c0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 msgr2=0x7f1bcc157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40190e0 tx=0x7f1bc401ad10 comp rx=0 tx=0).stop 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 shutdown_connections 2023-07-20T10:05:29.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f1bac0663a0 0x7f1bac068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bcc15cab0 0x7f1bcc157cc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1bcc0d0d10 0x7f1bcc157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 --2- 172.21.15.82:0/461016397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1bcc0cd4b0 0x7f1bcc14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.207+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 >> 172.21.15.82:0/461016397 conn(0x7f1bcc08c120 msgr2=0x7f1bcc0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.211+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 shutdown_connections 2023-07-20T10:05:29.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.211+0000 7f1bd178f640 1 -- 172.21.15.82:0/461016397 wait complete. 2023-07-20T10:05:29.209 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:05:27.949348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301716,"kb_used_data":8496,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754673004,"statfs":{"total":773094113280,"available":772785156096,"internally_reserved":0,"allocated":8699904,"data_stored":4898756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.822117"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128397+0000","last_change":"2023-07-20T10:05:23.128397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128397+0000","last_undegraded":"2023-07-20T10:05:23.128397+0000","last_fullsized":"2023-07-20T10:05:23.128397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136974+0000","last_change":"2023-07-20T10:05:23.136974+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136974+0000","last_undegraded":"2023-07-20T10:05:23.136974+0000","last_fullsized":"2023-07-20T10:05:23.136974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137397+0000","last_change":"2023-07-20T10:05:23.137397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137397+0000","last_undegraded":"2023-07-20T10:05:23.137397+0000","last_fullsized":"2023-07-20T10:05:23.137397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136964+0000","last_change":"2023-07-20T10:05:23.136964+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136964+0000","last_undegraded":"2023-07-20T10:05:23.136964+0000","last_fullsized":"2023-07-20T10:05:23.136964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134091+0000","last_change":"2023-07-20T10:05:23.134091+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134091+0000","last_undegraded":"2023-07-20T10:05:23.134091+0000","last_fullsized":"2023-07-20T10:05:23.134091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134814+0000","last_change":"2023-07-20T10:05:23.134814+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134814+0000","last_undegraded":"2023-07-20T10:05:23.134814+0000","last_fullsized":"2023-07-20T10:05:23.134814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134098+0000","last_change":"2023-07-20T10:05:23.134098+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134098+0000","last_undegraded":"2023-07-20T10:05:23.134098+0000","last_fullsized":"2023-07-20T10:05:23.134098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.131466+0000","last_change":"2023-07-20T10:05:23.131466+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.131466+0000","last_undegraded":"2023-07-20T10:05:23.131466+0000","last_fullsized":"2023-07-20T10:05:23.131466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133631+0000","last_change":"2023-07-20T10:05:23.133631+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133631+0000","last_undegraded":"2023-07-20T10:05:23.133631+0000","last_fullsized":"2023-07-20T10:05:23.133631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133821+0000","last_change":"2023-07-20T10:05:23.133821+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133821+0000","last_undegraded":"2023-07-20T10:05:23.133821+0000","last_fullsized":"2023-07-20T10:05:23.133821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134318+0000","last_change":"2023-07-20T10:05:23.134318+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134318+0000","last_undegraded":"2023-07-20T10:05:23.134318+0000","last_fullsized":"2023-07-20T10:05:23.134318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.129041+0000","last_change":"2023-07-20T10:05:23.129041+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.129041+0000","last_undegraded":"2023-07-20T10:05:23.129041+0000","last_fullsized":"2023-07-20T10:05:23.129041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134171+0000","last_change":"2023-07-20T10:05:23.134171+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134171+0000","last_undegraded":"2023-07-20T10:05:23.134171+0000","last_fullsized":"2023-07-20T10:05:23.134171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142872+0000","last_change":"2023-07-20T10:05:23.142872+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142872+0000","last_undegraded":"2023-07-20T10:05:23.142872+0000","last_fullsized":"2023-07-20T10:05:23.142872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133676+0000","last_change":"2023-07-20T10:05:23.133676+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133676+0000","last_undegraded":"2023-07-20T10:05:23.133676+0000","last_fullsized":"2023-07-20T10:05:23.133676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134239+0000","last_change":"2023-07-20T10:05:23.134239+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134239+0000","last_undegraded":"2023-07-20T10:05:23.134239+0000","last_fullsized":"2023-07-20T10:05:23.134239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142397+0000","last_change":"2023-07-20T10:05:23.142397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142397+0000","last_undegraded":"2023-07-20T10:05:23.142397+0000","last_fullsized":"2023-07-20T10:05:23.142397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142382+0000","last_change":"2023-07-20T10:05:23.142382+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142382+0000","last_undegraded":"2023-07-20T10:05:23.142382+0000","last_fullsized":"2023-07-20T10:05:23.142382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137896+0000","last_change":"2023-07-20T10:05:23.137896+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137896+0000","last_undegraded":"2023-07-20T10:05:23.137896+0000","last_fullsized":"2023-07-20T10:05:23.137896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128403+0000","last_change":"2023-07-20T10:05:23.128403+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128403+0000","last_undegraded":"2023-07-20T10:05:23.128403+0000","last_fullsized":"2023-07-20T10:05:23.128403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133590+0000","last_change":"2023-07-20T10:05:23.133590+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133590+0000","last_undegraded":"2023-07-20T10:05:23.133590+0000","last_fullsized":"2023-07-20T10:05:23.133590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134173+0000","last_change":"2023-07-20T10:05:23.134173+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134173+0000","last_undegraded":"2023-07-20T10:05:23.134173+0000","last_fullsized":"2023-07-20T10:05:23.134173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134765+0000","last_change":"2023-07-20T10:05:23.134765+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134765+0000","last_undegraded":"2023-07-20T10:05:23.134765+0000","last_fullsized":"2023-07-20T10:05:23.134765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128407+0000","last_change":"2023-07-20T10:05:23.128407+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128407+0000","last_undegraded":"2023-07-20T10:05:23.128407+0000","last_fullsized":"2023-07-20T10:05:23.128407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134073+0000","last_change":"2023-07-20T10:05:23.134073+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134073+0000","last_undegraded":"2023-07-20T10:05:23.134073+0000","last_fullsized":"2023-07-20T10:05:23.134073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":434,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135531+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:05:23.135531+0000","last_peered":"2023-07-20T10:05:23.135531+0000","last_clean":"2023-07-20T10:05:23.135531+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:05:23.135531+0000","last_undegraded":"2023-07-20T10:05:23.135531+0000","last_fullsized":"2023-07-20T10:05:23.135531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:33.368190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143201+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:05:23.143201+0000","last_peered":"2023-07-20T10:05:23.143201+0000","last_clean":"2023-07-20T10:05:23.143201+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:05:23.143201+0000","last_undegraded":"2023-07-20T10:05:23.143201+0000","last_fullsized":"2023-07-20T10:05:23.143201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:40:01.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137031+0000","last_change":"2023-07-20T10:05:23.137031+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137031+0000","last_undegraded":"2023-07-20T10:05:23.137031+0000","last_fullsized":"2023-07-20T10:05:23.137031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135451+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:05:23.135451+0000","last_peered":"2023-07-20T10:05:23.135451+0000","last_clean":"2023-07-20T10:05:23.135451+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:05:23.135451+0000","last_undegraded":"2023-07-20T10:05:23.135451+0000","last_fullsized":"2023-07-20T10:05:23.135451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:35.999499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142358+0000","last_change":"2023-07-20T10:05:23.142358+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142358+0000","last_undegraded":"2023-07-20T10:05:23.142358+0000","last_fullsized":"2023-07-20T10:05:23.142358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129127+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:05:23.129127+0000","last_peered":"2023-07-20T10:05:23.129127+0000","last_clean":"2023-07-20T10:05:23.129127+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:05:23.129127+0000","last_undegraded":"2023-07-20T10:05:23.129127+0000","last_fullsized":"2023-07-20T10:05:23.129127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:07:48.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136945+0000","last_change":"2023-07-20T10:05:23.136945+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136945+0000","last_undegraded":"2023-07-20T10:05:23.136945+0000","last_fullsized":"2023-07-20T10:05:23.136945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143238+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:05:23.143238+0000","last_peered":"2023-07-20T10:05:23.143238+0000","last_clean":"2023-07-20T10:05:23.143238+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:05:23.143238+0000","last_undegraded":"2023-07-20T10:05:23.143238+0000","last_fullsized":"2023-07-20T10:05:23.143238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.580000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142860+0000","last_change":"2023-07-20T10:05:23.142860+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142860+0000","last_undegraded":"2023-07-20T10:05:23.142860+0000","last_fullsized":"2023-07-20T10:05:23.142860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129607+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:05:23.129607+0000","last_peered":"2023-07-20T10:05:23.129607+0000","last_clean":"2023-07-20T10:05:23.129607+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:05:23.129607+0000","last_undegraded":"2023-07-20T10:05:23.129607+0000","last_fullsized":"2023-07-20T10:05:23.129607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:38.024591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134563+0000","last_change":"2023-07-20T10:05:23.134563+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134563+0000","last_undegraded":"2023-07-20T10:05:23.134563+0000","last_fullsized":"2023-07-20T10:05:23.134563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.136032+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:05:23.136032+0000","last_peered":"2023-07-20T10:05:23.136032+0000","last_clean":"2023-07-20T10:05:23.136032+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:05:23.136032+0000","last_undegraded":"2023-07-20T10:05:23.136032+0000","last_fullsized":"2023-07-20T10:05:23.136032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:20.839459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133811+0000","last_change":"2023-07-20T10:05:23.133811+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133811+0000","last_undegraded":"2023-07-20T10:05:23.133811+0000","last_fullsized":"2023-07-20T10:05:23.133811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129633+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:05:23.129633+0000","last_peered":"2023-07-20T10:05:23.129633+0000","last_clean":"2023-07-20T10:05:23.129633+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:05:23.129633+0000","last_undegraded":"2023-07-20T10:05:23.129633+0000","last_fullsized":"2023-07-20T10:05:23.129633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:08.437767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134085+0000","last_change":"2023-07-20T10:05:23.134085+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134085+0000","last_undegraded":"2023-07-20T10:05:23.134085+0000","last_fullsized":"2023-07-20T10:05:23.134085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.132126+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:05:23.132126+0000","last_peered":"2023-07-20T10:05:23.132126+0000","last_clean":"2023-07-20T10:05:23.132126+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:05:23.132126+0000","last_undegraded":"2023-07-20T10:05:23.132126+0000","last_fullsized":"2023-07-20T10:05:23.132126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:25:30.310598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.64400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":1.008,"15min":1.008},"last":0.435},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":1.075,"15min":1.075},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.716,"15min":1.716},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.056},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":1.758,"15min":1.758},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79100000000000004,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.55100000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":1.8,"15min":1.8},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":0.999,"15min":0.999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.77700000000000002},"min":{"1min":0.59699999999999998,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.018,"15min":1.2010000000000001},"last":0.75}]},{"osd":1,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93799999999999994,"5min":1.04,"15min":1.1259999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.54700000000000004,"5min":0.41799999999999998,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.94599999999999995,"15min":1.103},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90100000000000002,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":0.93200000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.84699999999999998,"5min":0.95299999999999996,"15min":1.272},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.434},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.79700000000000004,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.65500000000000003,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.55200000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.66300000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.69499999999999995,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.46000000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.081},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.753},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.77800000000000002,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.53800000000000003,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.94899999999999995,"15min":1.016},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78100000000000003,"5min":1.024,"15min":1.3080000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0680000000000001,"15min":1.145},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.874,"5min":1.0580000000000001,"15min":1.085},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.141},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.22,"15min":1.363},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":1.177,"15min":1.177},"last":0.629},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.3620000000000001},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.212},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.93500000000000005,"15min":1.196},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.873,"5min":1.004,"15min":1.4970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.0209999999999999,"15min":1.538},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0009999999999999,"15min":1.597},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48799999999999999,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":1.099},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.436,"15min":0.436},"max":{"1min":1.083,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.071,"5min":1.381,"15min":1.381},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.52300000000000002,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.64900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.107,"5min":1.274,"15min":1.274},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.502},"max":{"1min":1.008,"5min":1.131,"15min":1.1950000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76500000000000001,"15min":0.79100000000000004},"min":{"1min":0.63600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.68899999999999995,"5min":0.83799999999999997,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.089,"5min":1.2529999999999999,"15min":1.383},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.61899999999999999,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1579999999999999,"5min":1.169,"15min":1.51},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1020000000000001,"5min":1.2529999999999999,"15min":1.3240000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.66900000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.5820000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.393},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.89600000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.44600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.499}]},{"osd":3,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.47499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":1.052},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67700000000000005,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0589999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.1930000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":1.048,"15min":1.117},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.63900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.355},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.63100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.999,"5min":1,"15min":1.1899999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.034,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.1259999999999999,"15min":1.2529999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.45500000000000002},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.443},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58499999999999996,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.64400000000000002,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.68200000000000005,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.623,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":10.631,"15min":10.631},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.82699999999999996,"15min":0.80000000000000004},"min":{"1min":0.76200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.232,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.626},{"interface":"front","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.81200000000000006},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.495},"max":{"1min":1.1359999999999999,"5min":3.125,"15min":3.125},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91600000000000004,"15min":0.83699999999999997},"min":{"1min":0.70999999999999996,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":1.1479999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.85199999999999998,"15min":0.81000000000000005},"min":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.45700000000000002},"max":{"1min":1.2310000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.81999999999999995},"min":{"1min":0.68999999999999995,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":3.161,"15min":3.161},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89700000000000002,"15min":0.83499999999999996},"min":{"1min":0.70499999999999996,"5min":0.55200000000000005,"15min":0.46600000000000003},"max":{"1min":1.1499999999999999,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91500000000000004,"15min":0.85299999999999998},"min":{"1min":0.73799999999999999,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":1.278,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.3089999999999999,"5min":1.766,"15min":1.766},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:05:29.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:05:29.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 Processor -- start 2023-07-20T10:05:29.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 -- start start 2023-07-20T10:05:29.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2d1815cab0 0x7f2d180d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d180d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d180cf110 0x7f2d180cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180d31c0 con 0x7f2d180cf110 2023-07-20T10:05:29.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180d16b0 con 0x7f2d1815cab0 2023-07-20T10:05:29.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1f696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180b3520 con 0x7f2d180d0d10 2023-07-20T10:05:29.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d180cf110 0x7f2d180cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d180cf110 0x7f2d180cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48704/0 (socket says 172.21.15.82:48704) 2023-07-20T10:05:29.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 -- 172.21.15.82:0/3356025726 learned_addr learned my addr 172.21.15.82:0/3356025726 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1cc31640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d180d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1d432640 1 --2- 172.21.15.82:0/3356025726 >> v2:172.21.15.183:3300/0 conn(0x7f2d1815cab0 0x7f2d180d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 -- 172.21.15.82:0/3356025726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 msgr2=0x7f2d180d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:29.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d180d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 -- 172.21.15.82:0/3356025726 >> v2:172.21.15.183:3300/0 conn(0x7f2d1815cab0 msgr2=0x7f2d180d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:29.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 --2- 172.21.15.82:0/3356025726 >> v2:172.21.15.183:3300/0 conn(0x7f2d1815cab0 0x7f2d180d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.407+0000 7f2d1dc33640 1 -- 172.21.15.82:0/3356025726 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b2910 con 0x7f2d180cf110 2023-07-20T10:05:29.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1dc33640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180cf5a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2d1806a660 tx=0x7f2d1001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494309f2fb798afd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d0ffff640 1 -- 172.21.15.82:0/3356025726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100a5820 con 0x7f2d180cf110 2023-07-20T10:05:29.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d0ffff640 1 -- 172.21.15.82:0/3356025726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d100a5980 con 0x7f2d180cf110 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d0ffff640 1 -- 172.21.15.82:0/3356025726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d100a5d10 con 0x7f2d180cf110 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 -- 172.21.15.82:0/3356025726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 msgr2=0x7f2d180cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180cf5a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2d1806a660 tx=0x7f2d1001c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 -- 172.21.15.82:0/3356025726 shutdown_connections 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180cf5a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 --2- 172.21.15.82:0/3356025726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d180d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 --2- 172.21.15.82:0/3356025726 >> v2:172.21.15.183:3300/0 conn(0x7f2d1815cab0 0x7f2d180d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 -- 172.21.15.82:0/3356025726 >> 172.21.15.82:0/3356025726 conn(0x7f2d1808c120 msgr2=0x7f2d1809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 -- 172.21.15.82:0/3356025726 shutdown_connections 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.411+0000 7f2d1f696640 1 -- 172.21.15.82:0/3356025726 wait complete. 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 Processor -- start 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- start start 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d181425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d1815cab0 0x7f2d180cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18142af0 con 0x7f2d180cf110 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180c84c0 con 0x7f2d1815cab0 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180c87a0 con 0x7f2d180d0d10 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48720/0 (socket says 172.21.15.82:48720) 2023-07-20T10:05:29.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 -- 172.21.15.82:0/2027670645 learned_addr learned my addr 172.21.15.82:0/2027670645 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1cc31640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d181425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1dc33640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d1815cab0 0x7f2d180cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 -- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 msgr2=0x7f2d181425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d181425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 -- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d1815cab0 msgr2=0x7f2d180cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d1815cab0 0x7f2d180cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 -- 172.21.15.82:0/2027670645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009b30 con 0x7f2d180cf110 2023-07-20T10:05:29.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1d432640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400d5f0 tx=0x7f2d1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140125f0 con 0x7f2d180cf110 2023-07-20T10:05:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14012750 con 0x7f2d180cf110 2023-07-20T10:05:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14012ae0 con 0x7f2d180cf110 2023-07-20T10:05:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d180c8a80 con 0x7f2d180cf110 2023-07-20T10:05:29.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.415+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d180c9040 con 0x7f2d180cf110 2023-07-20T10:05:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d18073c70 con 0x7f2d180cf110 2023-07-20T10:05:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d14012c40 con 0x7f2d180cf110 2023-07-20T10:05:29.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d0dffb640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 0x7f2cfc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d140843e0 con 0x7f2d180cf110 2023-07-20T10:05:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d1cc31640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 0x7f2cfc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.419+0000 7f2d1cc31640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 0x7f2cfc068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d18155640 tx=0x7f2d08008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.423+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d140516b0 con 0x7f2d180cf110 2023-07-20T10:05:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.567+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d180b31b0 con 0x7f2cfc0663a0 2023-07-20T10:05:29.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.575+0000 7f2d0dffb640 1 -- 172.21.15.82:0/2027670645 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299541 (secure 0 0 0) 0x7f2d0800b140 con 0x7f2cfc0663a0 2023-07-20T10:05:29.558 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:29.559 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:05:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 msgr2=0x7f2cfc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 0x7f2cfc068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2d18155640 tx=0x7f2d08008040 comp rx=0 tx=0).stop 2023-07-20T10:05:29.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 msgr2=0x7f2d180c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400d5f0 tx=0x7f2d1400dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 shutdown_connections 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d1815cab0 0x7f2d180cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d180d0d10 0x7f2d181425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f2cfc0663a0 0x7f2cfc068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 --2- 172.21.15.82:0/2027670645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d180cf110 0x7f2d180c7e20 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 >> 172.21.15.82:0/2027670645 conn(0x7f2d1808c120 msgr2=0x7f2d180d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 shutdown_connections 2023-07-20T10:05:29.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.579+0000 7f2d1f696640 1 -- 172.21.15.82:0/2027670645 wait complete. 2023-07-20T10:05:29.578 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:05:27.949348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301716,"kb_used_data":8496,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754673004,"statfs":{"total":773094113280,"available":772785156096,"internally_reserved":0,"allocated":8699904,"data_stored":4898756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.822117"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128397+0000","last_change":"2023-07-20T10:05:23.128397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128397+0000","last_undegraded":"2023-07-20T10:05:23.128397+0000","last_fullsized":"2023-07-20T10:05:23.128397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136974+0000","last_change":"2023-07-20T10:05:23.136974+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136974+0000","last_undegraded":"2023-07-20T10:05:23.136974+0000","last_fullsized":"2023-07-20T10:05:23.136974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137397+0000","last_change":"2023-07-20T10:05:23.137397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137397+0000","last_undegraded":"2023-07-20T10:05:23.137397+0000","last_fullsized":"2023-07-20T10:05:23.137397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136964+0000","last_change":"2023-07-20T10:05:23.136964+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136964+0000","last_undegraded":"2023-07-20T10:05:23.136964+0000","last_fullsized":"2023-07-20T10:05:23.136964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134091+0000","last_change":"2023-07-20T10:05:23.134091+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134091+0000","last_undegraded":"2023-07-20T10:05:23.134091+0000","last_fullsized":"2023-07-20T10:05:23.134091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134814+0000","last_change":"2023-07-20T10:05:23.134814+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134814+0000","last_undegraded":"2023-07-20T10:05:23.134814+0000","last_fullsized":"2023-07-20T10:05:23.134814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134098+0000","last_change":"2023-07-20T10:05:23.134098+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134098+0000","last_undegraded":"2023-07-20T10:05:23.134098+0000","last_fullsized":"2023-07-20T10:05:23.134098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.131466+0000","last_change":"2023-07-20T10:05:23.131466+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.131466+0000","last_undegraded":"2023-07-20T10:05:23.131466+0000","last_fullsized":"2023-07-20T10:05:23.131466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133631+0000","last_change":"2023-07-20T10:05:23.133631+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133631+0000","last_undegraded":"2023-07-20T10:05:23.133631+0000","last_fullsized":"2023-07-20T10:05:23.133631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133821+0000","last_change":"2023-07-20T10:05:23.133821+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133821+0000","last_undegraded":"2023-07-20T10:05:23.133821+0000","last_fullsized":"2023-07-20T10:05:23.133821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134318+0000","last_change":"2023-07-20T10:05:23.134318+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134318+0000","last_undegraded":"2023-07-20T10:05:23.134318+0000","last_fullsized":"2023-07-20T10:05:23.134318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.129041+0000","last_change":"2023-07-20T10:05:23.129041+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.129041+0000","last_undegraded":"2023-07-20T10:05:23.129041+0000","last_fullsized":"2023-07-20T10:05:23.129041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134171+0000","last_change":"2023-07-20T10:05:23.134171+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134171+0000","last_undegraded":"2023-07-20T10:05:23.134171+0000","last_fullsized":"2023-07-20T10:05:23.134171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142872+0000","last_change":"2023-07-20T10:05:23.142872+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142872+0000","last_undegraded":"2023-07-20T10:05:23.142872+0000","last_fullsized":"2023-07-20T10:05:23.142872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133676+0000","last_change":"2023-07-20T10:05:23.133676+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133676+0000","last_undegraded":"2023-07-20T10:05:23.133676+0000","last_fullsized":"2023-07-20T10:05:23.133676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134239+0000","last_change":"2023-07-20T10:05:23.134239+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134239+0000","last_undegraded":"2023-07-20T10:05:23.134239+0000","last_fullsized":"2023-07-20T10:05:23.134239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142397+0000","last_change":"2023-07-20T10:05:23.142397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142397+0000","last_undegraded":"2023-07-20T10:05:23.142397+0000","last_fullsized":"2023-07-20T10:05:23.142397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142382+0000","last_change":"2023-07-20T10:05:23.142382+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142382+0000","last_undegraded":"2023-07-20T10:05:23.142382+0000","last_fullsized":"2023-07-20T10:05:23.142382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137896+0000","last_change":"2023-07-20T10:05:23.137896+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137896+0000","last_undegraded":"2023-07-20T10:05:23.137896+0000","last_fullsized":"2023-07-20T10:05:23.137896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128403+0000","last_change":"2023-07-20T10:05:23.128403+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128403+0000","last_undegraded":"2023-07-20T10:05:23.128403+0000","last_fullsized":"2023-07-20T10:05:23.128403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133590+0000","last_change":"2023-07-20T10:05:23.133590+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133590+0000","last_undegraded":"2023-07-20T10:05:23.133590+0000","last_fullsized":"2023-07-20T10:05:23.133590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134173+0000","last_change":"2023-07-20T10:05:23.134173+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134173+0000","last_undegraded":"2023-07-20T10:05:23.134173+0000","last_fullsized":"2023-07-20T10:05:23.134173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134765+0000","last_change":"2023-07-20T10:05:23.134765+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134765+0000","last_undegraded":"2023-07-20T10:05:23.134765+0000","last_fullsized":"2023-07-20T10:05:23.134765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128407+0000","last_change":"2023-07-20T10:05:23.128407+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128407+0000","last_undegraded":"2023-07-20T10:05:23.128407+0000","last_fullsized":"2023-07-20T10:05:23.128407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134073+0000","last_change":"2023-07-20T10:05:23.134073+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134073+0000","last_undegraded":"2023-07-20T10:05:23.134073+0000","last_fullsized":"2023-07-20T10:05:23.134073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":434,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135531+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:05:23.135531+0000","last_peered":"2023-07-20T10:05:23.135531+0000","last_clean":"2023-07-20T10:05:23.135531+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:05:23.135531+0000","last_undegraded":"2023-07-20T10:05:23.135531+0000","last_fullsized":"2023-07-20T10:05:23.135531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:33.368190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143201+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:05:23.143201+0000","last_peered":"2023-07-20T10:05:23.143201+0000","last_clean":"2023-07-20T10:05:23.143201+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:05:23.143201+0000","last_undegraded":"2023-07-20T10:05:23.143201+0000","last_fullsized":"2023-07-20T10:05:23.143201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:40:01.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137031+0000","last_change":"2023-07-20T10:05:23.137031+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137031+0000","last_undegraded":"2023-07-20T10:05:23.137031+0000","last_fullsized":"2023-07-20T10:05:23.137031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135451+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:05:23.135451+0000","last_peered":"2023-07-20T10:05:23.135451+0000","last_clean":"2023-07-20T10:05:23.135451+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:05:23.135451+0000","last_undegraded":"2023-07-20T10:05:23.135451+0000","last_fullsized":"2023-07-20T10:05:23.135451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:35.999499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142358+0000","last_change":"2023-07-20T10:05:23.142358+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142358+0000","last_undegraded":"2023-07-20T10:05:23.142358+0000","last_fullsized":"2023-07-20T10:05:23.142358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129127+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:05:23.129127+0000","last_peered":"2023-07-20T10:05:23.129127+0000","last_clean":"2023-07-20T10:05:23.129127+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:05:23.129127+0000","last_undegraded":"2023-07-20T10:05:23.129127+0000","last_fullsized":"2023-07-20T10:05:23.129127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:07:48.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136945+0000","last_change":"2023-07-20T10:05:23.136945+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136945+0000","last_undegraded":"2023-07-20T10:05:23.136945+0000","last_fullsized":"2023-07-20T10:05:23.136945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143238+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:05:23.143238+0000","last_peered":"2023-07-20T10:05:23.143238+0000","last_clean":"2023-07-20T10:05:23.143238+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:05:23.143238+0000","last_undegraded":"2023-07-20T10:05:23.143238+0000","last_fullsized":"2023-07-20T10:05:23.143238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.580000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142860+0000","last_change":"2023-07-20T10:05:23.142860+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142860+0000","last_undegraded":"2023-07-20T10:05:23.142860+0000","last_fullsized":"2023-07-20T10:05:23.142860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129607+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:05:23.129607+0000","last_peered":"2023-07-20T10:05:23.129607+0000","last_clean":"2023-07-20T10:05:23.129607+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:05:23.129607+0000","last_undegraded":"2023-07-20T10:05:23.129607+0000","last_fullsized":"2023-07-20T10:05:23.129607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:38.024591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134563+0000","last_change":"2023-07-20T10:05:23.134563+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134563+0000","last_undegraded":"2023-07-20T10:05:23.134563+0000","last_fullsized":"2023-07-20T10:05:23.134563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.136032+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:05:23.136032+0000","last_peered":"2023-07-20T10:05:23.136032+0000","last_clean":"2023-07-20T10:05:23.136032+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:05:23.136032+0000","last_undegraded":"2023-07-20T10:05:23.136032+0000","last_fullsized":"2023-07-20T10:05:23.136032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:20.839459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133811+0000","last_change":"2023-07-20T10:05:23.133811+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133811+0000","last_undegraded":"2023-07-20T10:05:23.133811+0000","last_fullsized":"2023-07-20T10:05:23.133811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129633+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:05:23.129633+0000","last_peered":"2023-07-20T10:05:23.129633+0000","last_clean":"2023-07-20T10:05:23.129633+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:05:23.129633+0000","last_undegraded":"2023-07-20T10:05:23.129633+0000","last_fullsized":"2023-07-20T10:05:23.129633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:08.437767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134085+0000","last_change":"2023-07-20T10:05:23.134085+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134085+0000","last_undegraded":"2023-07-20T10:05:23.134085+0000","last_fullsized":"2023-07-20T10:05:23.134085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.132126+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:05:23.132126+0000","last_peered":"2023-07-20T10:05:23.132126+0000","last_clean":"2023-07-20T10:05:23.132126+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:05:23.132126+0000","last_undegraded":"2023-07-20T10:05:23.132126+0000","last_fullsized":"2023-07-20T10:05:23.132126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:25:30.310598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.64400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":1.008,"15min":1.008},"last":0.435},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":1.075,"15min":1.075},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.716,"15min":1.716},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.056},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":1.758,"15min":1.758},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79100000000000004,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.55100000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":1.8,"15min":1.8},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":0.999,"15min":0.999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.77700000000000002},"min":{"1min":0.59699999999999998,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.018,"15min":1.2010000000000001},"last":0.75}]},{"osd":1,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93799999999999994,"5min":1.04,"15min":1.1259999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.54700000000000004,"5min":0.41799999999999998,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.94599999999999995,"15min":1.103},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90100000000000002,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":0.93200000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.84699999999999998,"5min":0.95299999999999996,"15min":1.272},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.434},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.79700000000000004,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.65500000000000003,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.55200000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.66300000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.69499999999999995,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.46000000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.081},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.753},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.77800000000000002,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.53800000000000003,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.94899999999999995,"15min":1.016},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78100000000000003,"5min":1.024,"15min":1.3080000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0680000000000001,"15min":1.145},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.874,"5min":1.0580000000000001,"15min":1.085},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.141},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.22,"15min":1.363},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":1.177,"15min":1.177},"last":0.629},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.3620000000000001},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.212},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.93500000000000005,"15min":1.196},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.873,"5min":1.004,"15min":1.4970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.0209999999999999,"15min":1.538},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0009999999999999,"15min":1.597},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48799999999999999,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":1.099},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.436,"15min":0.436},"max":{"1min":1.083,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.071,"5min":1.381,"15min":1.381},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.52300000000000002,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.64900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.107,"5min":1.274,"15min":1.274},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.502},"max":{"1min":1.008,"5min":1.131,"15min":1.1950000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76500000000000001,"15min":0.79100000000000004},"min":{"1min":0.63600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.68899999999999995,"5min":0.83799999999999997,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.089,"5min":1.2529999999999999,"15min":1.383},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.61899999999999999,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1579999999999999,"5min":1.169,"15min":1.51},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1020000000000001,"5min":1.2529999999999999,"15min":1.3240000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.66900000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.5820000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.393},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.89600000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.44600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.499}]},{"osd":3,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.47499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":1.052},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67700000000000005,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0589999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.1930000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":1.048,"15min":1.117},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.63900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.355},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.63100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.999,"5min":1,"15min":1.1899999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.034,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.1259999999999999,"15min":1.2529999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.45500000000000002},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.443},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58499999999999996,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.64400000000000002,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.68200000000000005,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.623,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":10.631,"15min":10.631},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.82699999999999996,"15min":0.80000000000000004},"min":{"1min":0.76200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.232,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.626},{"interface":"front","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.81200000000000006},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.495},"max":{"1min":1.1359999999999999,"5min":3.125,"15min":3.125},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91600000000000004,"15min":0.83699999999999997},"min":{"1min":0.70999999999999996,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":1.1479999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.85199999999999998,"15min":0.81000000000000005},"min":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.45700000000000002},"max":{"1min":1.2310000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.81999999999999995},"min":{"1min":0.68999999999999995,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":3.161,"15min":3.161},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89700000000000002,"15min":0.83499999999999996},"min":{"1min":0.70499999999999996,"5min":0.55200000000000005,"15min":0.46600000000000003},"max":{"1min":1.1499999999999999,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91500000000000004,"15min":0.85299999999999998},"min":{"1min":0.73799999999999999,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":1.278,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.3089999999999999,"5min":1.766,"15min":1.766},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:05:29.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:05:29.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.779+0000 7fc1cbd00640 1 Processor -- start 2023-07-20T10:05:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.779+0000 7fc1cbd00640 1 -- start start 2023-07-20T10:05:29.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1cbd00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1c4160fa0 0x7fc1c40c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1cbd00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1c40cd830 0x7fc1c40c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1cbd00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40cc560 con 0x7fc1c4160bc0 2023-07-20T10:05:29.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1cbd00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40ad7e0 con 0x7fc1c40cd830 2023-07-20T10:05:29.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1cbd00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40cc790 con 0x7fc1c4160fa0 2023-07-20T10:05:29.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1c40cd830 0x7fc1c40c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1c40cd830 0x7fc1c40c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48728/0 (socket says 172.21.15.82:48728) 2023-07-20T10:05:29.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 -- 172.21.15.82:0/2860854609 learned_addr learned my addr 172.21.15.82:0/2860854609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1c929b640 1 --2- 172.21.15.82:0/2860854609 >> v2:172.21.15.183:3300/0 conn(0x7fc1c4160fa0 0x7fc1c40c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 -- 172.21.15.82:0/2860854609 >> v2:172.21.15.183:3300/0 conn(0x7fc1c4160fa0 msgr2=0x7fc1c40c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 --2- 172.21.15.82:0/2860854609 >> v2:172.21.15.183:3300/0 conn(0x7fc1c4160fa0 0x7fc1c40c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 -- 172.21.15.82:0/2860854609 >> v1:172.21.15.183:6789/0 conn(0x7fc1c4160bc0 legacy=0x7fc1c406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.783+0000 7fc1ca29d640 1 -- 172.21.15.82:0/2860854609 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40cca70 con 0x7fc1c40cd830 2023-07-20T10:05:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1ca29d640 1 --2- 172.21.15.82:0/2860854609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c40c1830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc1c406a740 tx=0x7fc1bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac991983bc5268be server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1c8a9a640 1 -- 172.21.15.82:0/2860854609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0aa430 con 0x7fc1c40cd830 2023-07-20T10:05:29.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1c8a9a640 1 -- 172.21.15.82:0/2860854609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc0aa590 con 0x7fc1c40cd830 2023-07-20T10:05:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1c8a9a640 1 -- 172.21.15.82:0/2860854609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0aa920 con 0x7fc1c40cd830 2023-07-20T10:05:29.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- 172.21.15.82:0/2860854609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 msgr2=0x7fc1c40c1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/2860854609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c40c1830 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc1c406a740 tx=0x7fc1bc01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- 172.21.15.82:0/2860854609 shutdown_connections 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/2860854609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c40c1830 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/2860854609 >> v2:172.21.15.183:3300/0 conn(0x7fc1c4160fa0 0x7fc1c40c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- 172.21.15.82:0/2860854609 >> 172.21.15.82:0/2860854609 conn(0x7fc1c40cada0 msgr2=0x7fc1c40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- 172.21.15.82:0/2860854609 shutdown_connections 2023-07-20T10:05:29.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- 172.21.15.82:0/2860854609 wait complete. 2023-07-20T10:05:29.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 Processor -- start 2023-07-20T10:05:29.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.787+0000 7fc1cbd00640 1 -- start start 2023-07-20T10:05:29.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c4160bc0 0x7fc1c415adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 0x7fc1c415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40af430 con 0x7fc1c40cd830 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40af710 con 0x7fc1c4160fa0 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40af9f0 con 0x7fc1c4160bc0 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48734/0 (socket says 172.21.15.82:48734) 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 -- 172.21.15.82:0/4177781020 learned_addr learned my addr 172.21.15.82:0/4177781020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c929b640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c4160bc0 0x7fc1c415adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ca29d640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 0x7fc1c415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 -- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c4160bc0 msgr2=0x7fc1c415adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c4160bc0 0x7fc1c415adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 -- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 msgr2=0x7fc1c415c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 0x7fc1c415c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 -- 172.21.15.82:0/4177781020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0094d0 con 0x7fc1c40cd830 2023-07-20T10:05:29.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ca29d640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 0x7fc1c415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:29.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1c9a9c640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c7f0 tx=0x7fc1c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0003b80 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0003ce0 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000aa90 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c40afcd0 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c415b2f0 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c4073c70 con 0x7fc1c40cd830 2023-07-20T10:05:29.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.791+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc1c000abf0 con 0x7fc1c40cd830 2023-07-20T10:05:29.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.795+0000 7fc1ba7fc640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 0x7fc1a8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:29.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.795+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1c0083d60 con 0x7fc1c40cd830 2023-07-20T10:05:29.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.795+0000 7fc1c929b640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 0x7fc1a8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:29.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.795+0000 7fc1c929b640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 0x7fc1a8068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1c415ff40 tx=0x7fc1b4008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:29.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.799+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1c0051030 con 0x7fc1c40cd830 2023-07-20T10:05:29.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.943+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1c415b4e0 con 0x7fc1a80663a0 2023-07-20T10:05:29.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.951+0000 7fc1ba7fc640 1 -- 172.21.15.82:0/4177781020 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299541 (secure 0 0 0) 0x7fc1c415b4e0 con 0x7fc1a80663a0 2023-07-20T10:05:29.935 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:29.937 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 msgr2=0x7fc1a8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 0x7fc1a8068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc1c415ff40 tx=0x7fc1b4008040 comp rx=0 tx=0).stop 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 msgr2=0x7fc1c4158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c7f0 tx=0x7fc1c000ccb0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 shutdown_connections 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1c4160fa0 0x7fc1c415c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1c4160bc0 0x7fc1c415adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc1a80663a0 0x7fc1a8068860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 --2- 172.21.15.82:0/4177781020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1c40cd830 0x7fc1c4158a60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 >> 172.21.15.82:0/4177781020 conn(0x7fc1c40cada0 msgr2=0x7fc1c40cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 shutdown_connections 2023-07-20T10:05:29.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:29.955+0000 7fc1cbd00640 1 -- 172.21.15.82:0/4177781020 wait complete. 2023-07-20T10:05:29.955 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:05:27.949348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301716,"kb_used_data":8496,"kb_used_omap":13,"kb_used_meta":293106,"kb_avail":754673004,"statfs":{"total":773094113280,"available":772785156096,"internally_reserved":0,"allocated":8699904,"data_stored":4898756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":300140632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.822117"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128397+0000","last_change":"2023-07-20T10:05:23.128397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128397+0000","last_undegraded":"2023-07-20T10:05:23.128397+0000","last_fullsized":"2023-07-20T10:05:23.128397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136974+0000","last_change":"2023-07-20T10:05:23.136974+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136974+0000","last_undegraded":"2023-07-20T10:05:23.136974+0000","last_fullsized":"2023-07-20T10:05:23.136974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137397+0000","last_change":"2023-07-20T10:05:23.137397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137397+0000","last_undegraded":"2023-07-20T10:05:23.137397+0000","last_fullsized":"2023-07-20T10:05:23.137397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136964+0000","last_change":"2023-07-20T10:05:23.136964+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136964+0000","last_undegraded":"2023-07-20T10:05:23.136964+0000","last_fullsized":"2023-07-20T10:05:23.136964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134091+0000","last_change":"2023-07-20T10:05:23.134091+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134091+0000","last_undegraded":"2023-07-20T10:05:23.134091+0000","last_fullsized":"2023-07-20T10:05:23.134091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134814+0000","last_change":"2023-07-20T10:05:23.134814+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134814+0000","last_undegraded":"2023-07-20T10:05:23.134814+0000","last_fullsized":"2023-07-20T10:05:23.134814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134098+0000","last_change":"2023-07-20T10:05:23.134098+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134098+0000","last_undegraded":"2023-07-20T10:05:23.134098+0000","last_fullsized":"2023-07-20T10:05:23.134098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.131466+0000","last_change":"2023-07-20T10:05:23.131466+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.131466+0000","last_undegraded":"2023-07-20T10:05:23.131466+0000","last_fullsized":"2023-07-20T10:05:23.131466+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133631+0000","last_change":"2023-07-20T10:05:23.133631+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133631+0000","last_undegraded":"2023-07-20T10:05:23.133631+0000","last_fullsized":"2023-07-20T10:05:23.133631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133821+0000","last_change":"2023-07-20T10:05:23.133821+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133821+0000","last_undegraded":"2023-07-20T10:05:23.133821+0000","last_fullsized":"2023-07-20T10:05:23.133821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134318+0000","last_change":"2023-07-20T10:05:23.134318+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134318+0000","last_undegraded":"2023-07-20T10:05:23.134318+0000","last_fullsized":"2023-07-20T10:05:23.134318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.129041+0000","last_change":"2023-07-20T10:05:23.129041+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.129041+0000","last_undegraded":"2023-07-20T10:05:23.129041+0000","last_fullsized":"2023-07-20T10:05:23.129041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134171+0000","last_change":"2023-07-20T10:05:23.134171+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134171+0000","last_undegraded":"2023-07-20T10:05:23.134171+0000","last_fullsized":"2023-07-20T10:05:23.134171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142872+0000","last_change":"2023-07-20T10:05:23.142872+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142872+0000","last_undegraded":"2023-07-20T10:05:23.142872+0000","last_fullsized":"2023-07-20T10:05:23.142872+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133676+0000","last_change":"2023-07-20T10:05:23.133676+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133676+0000","last_undegraded":"2023-07-20T10:05:23.133676+0000","last_fullsized":"2023-07-20T10:05:23.133676+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134239+0000","last_change":"2023-07-20T10:05:23.134239+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134239+0000","last_undegraded":"2023-07-20T10:05:23.134239+0000","last_fullsized":"2023-07-20T10:05:23.134239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142397+0000","last_change":"2023-07-20T10:05:23.142397+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142397+0000","last_undegraded":"2023-07-20T10:05:23.142397+0000","last_fullsized":"2023-07-20T10:05:23.142397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142382+0000","last_change":"2023-07-20T10:05:23.142382+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142382+0000","last_undegraded":"2023-07-20T10:05:23.142382+0000","last_fullsized":"2023-07-20T10:05:23.142382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137896+0000","last_change":"2023-07-20T10:05:23.137896+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137896+0000","last_undegraded":"2023-07-20T10:05:23.137896+0000","last_fullsized":"2023-07-20T10:05:23.137896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128403+0000","last_change":"2023-07-20T10:05:23.128403+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128403+0000","last_undegraded":"2023-07-20T10:05:23.128403+0000","last_fullsized":"2023-07-20T10:05:23.128403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133590+0000","last_change":"2023-07-20T10:05:23.133590+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133590+0000","last_undegraded":"2023-07-20T10:05:23.133590+0000","last_fullsized":"2023-07-20T10:05:23.133590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134173+0000","last_change":"2023-07-20T10:05:23.134173+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134173+0000","last_undegraded":"2023-07-20T10:05:23.134173+0000","last_fullsized":"2023-07-20T10:05:23.134173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134765+0000","last_change":"2023-07-20T10:05:23.134765+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134765+0000","last_undegraded":"2023-07-20T10:05:23.134765+0000","last_fullsized":"2023-07-20T10:05:23.134765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.128407+0000","last_change":"2023-07-20T10:05:23.128407+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.128407+0000","last_undegraded":"2023-07-20T10:05:23.128407+0000","last_fullsized":"2023-07-20T10:05:23.128407+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134073+0000","last_change":"2023-07-20T10:05:23.134073+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134073+0000","last_undegraded":"2023-07-20T10:05:23.134073+0000","last_fullsized":"2023-07-20T10:05:23.134073+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":434,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135531+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:05:23.135531+0000","last_peered":"2023-07-20T10:05:23.135531+0000","last_clean":"2023-07-20T10:05:23.135531+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:05:23.135531+0000","last_undegraded":"2023-07-20T10:05:23.135531+0000","last_fullsized":"2023-07-20T10:05:23.135531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:33.368190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143201+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:05:23.143201+0000","last_peered":"2023-07-20T10:05:23.143201+0000","last_clean":"2023-07-20T10:05:23.143201+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:05:23.143201+0000","last_undegraded":"2023-07-20T10:05:23.143201+0000","last_fullsized":"2023-07-20T10:05:23.143201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:40:01.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.137031+0000","last_change":"2023-07-20T10:05:23.137031+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.137031+0000","last_undegraded":"2023-07-20T10:05:23.137031+0000","last_fullsized":"2023-07-20T10:05:23.137031+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.135451+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:05:23.135451+0000","last_peered":"2023-07-20T10:05:23.135451+0000","last_clean":"2023-07-20T10:05:23.135451+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:05:23.135451+0000","last_undegraded":"2023-07-20T10:05:23.135451+0000","last_fullsized":"2023-07-20T10:05:23.135451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:35.999499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142358+0000","last_change":"2023-07-20T10:05:23.142358+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142358+0000","last_undegraded":"2023-07-20T10:05:23.142358+0000","last_fullsized":"2023-07-20T10:05:23.142358+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129127+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:05:23.129127+0000","last_peered":"2023-07-20T10:05:23.129127+0000","last_clean":"2023-07-20T10:05:23.129127+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:05:23.129127+0000","last_undegraded":"2023-07-20T10:05:23.129127+0000","last_fullsized":"2023-07-20T10:05:23.129127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:07:48.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.136945+0000","last_change":"2023-07-20T10:05:23.136945+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.136945+0000","last_undegraded":"2023-07-20T10:05:23.136945+0000","last_fullsized":"2023-07-20T10:05:23.136945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.143238+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:05:23.143238+0000","last_peered":"2023-07-20T10:05:23.143238+0000","last_clean":"2023-07-20T10:05:23.143238+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:05:23.143238+0000","last_undegraded":"2023-07-20T10:05:23.143238+0000","last_fullsized":"2023-07-20T10:05:23.143238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:58.580000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.142860+0000","last_change":"2023-07-20T10:05:23.142860+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.142860+0000","last_undegraded":"2023-07-20T10:05:23.142860+0000","last_fullsized":"2023-07-20T10:05:23.142860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129607+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:05:23.129607+0000","last_peered":"2023-07-20T10:05:23.129607+0000","last_clean":"2023-07-20T10:05:23.129607+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:05:23.129607+0000","last_undegraded":"2023-07-20T10:05:23.129607+0000","last_fullsized":"2023-07-20T10:05:23.129607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:38.024591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134563+0000","last_change":"2023-07-20T10:05:23.134563+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134563+0000","last_undegraded":"2023-07-20T10:05:23.134563+0000","last_fullsized":"2023-07-20T10:05:23.134563+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.136032+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:05:23.136032+0000","last_peered":"2023-07-20T10:05:23.136032+0000","last_clean":"2023-07-20T10:05:23.136032+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:05:23.136032+0000","last_undegraded":"2023-07-20T10:05:23.136032+0000","last_fullsized":"2023-07-20T10:05:23.136032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:20.839459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.133811+0000","last_change":"2023-07-20T10:05:23.133811+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.133811+0000","last_undegraded":"2023-07-20T10:05:23.133811+0000","last_fullsized":"2023-07-20T10:05:23.133811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.129633+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:05:23.129633+0000","last_peered":"2023-07-20T10:05:23.129633+0000","last_clean":"2023-07-20T10:05:23.129633+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:05:23.129633+0000","last_undegraded":"2023-07-20T10:05:23.129633+0000","last_fullsized":"2023-07-20T10:05:23.129633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:08.437767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:05:24.125211+0000","last_change":"2023-07-20T10:05:24.125211+0000","last_active":"2023-07-20T10:05:24.125211+0000","last_peered":"2023-07-20T10:05:24.125211+0000","last_clean":"2023-07-20T10:05:24.125211+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:24.125211+0000","last_undegraded":"2023-07-20T10:05:24.125211+0000","last_fullsized":"2023-07-20T10:05:24.125211+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2023-07-20T10:05:23.134085+0000","last_change":"2023-07-20T10:05:23.134085+0000","last_active":"2023-07-20T10:05:23.112887+0000","last_peered":"2023-07-20T10:05:23.112887+0000","last_clean":"2023-07-20T10:05:23.112887+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:05:23.134085+0000","last_undegraded":"2023-07-20T10:05:23.134085+0000","last_fullsized":"2023-07-20T10:05:23.134085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-07-20T10:05:23.132126+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:05:23.132126+0000","last_peered":"2023-07-20T10:05:23.132126+0000","last_clean":"2023-07-20T10:05:23.132126+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:05:23.132126+0000","last_undegraded":"2023-07-20T10:05:23.132126+0000","last_fullsized":"2023-07-20T10:05:23.132126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:25:30.310598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.64400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":1.008,"15min":1.008},"last":0.435},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":1.075,"15min":1.075},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.716,"15min":1.716},"last":0.70499999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.056},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":1.758,"15min":1.758},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79100000000000004,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.55100000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":1.8,"15min":1.8},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":0.999,"15min":0.999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.77700000000000002},"min":{"1min":0.59699999999999998,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.018,"15min":1.2010000000000001},"last":0.75}]},{"osd":1,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93799999999999994,"5min":1.04,"15min":1.1259999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.54700000000000004,"5min":0.41799999999999998,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.94599999999999995,"15min":1.103},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90100000000000002,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":0.93200000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.84699999999999998,"5min":0.95299999999999996,"15min":1.272},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.434},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.79700000000000004,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.65500000000000003,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.55200000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.66300000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.69499999999999995,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.46000000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.081},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.753},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.77800000000000002,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.53800000000000003,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.67500000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.94899999999999995,"15min":1.016},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78100000000000003,"5min":1.024,"15min":1.3080000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0680000000000001,"15min":1.145},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.73499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.874,"5min":1.0580000000000001,"15min":1.085},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.141},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.22,"15min":1.363},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":1.177,"15min":1.177},"last":0.629},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.3620000000000001},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.212},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.93500000000000005,"15min":1.196},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.873,"5min":1.004,"15min":1.4970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.0209999999999999,"15min":1.538},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0009999999999999,"15min":1.597},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575029,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48799999999999999,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":1.099},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.436,"15min":0.436},"max":{"1min":1.083,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.071,"5min":1.381,"15min":1.381},"last":0.77600000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.52300000000000002,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.64900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.107,"5min":1.274,"15min":1.274},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.502},"max":{"1min":1.008,"5min":1.131,"15min":1.1950000000000001},"last":0.71799999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76500000000000001,"15min":0.79100000000000004},"min":{"1min":0.63600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575029,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54180,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317660,"statfs":{"total":96636764160,"available":96581283840,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.68899999999999995,"5min":0.83799999999999997,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.089,"5min":1.2529999999999999,"15min":1.383},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.61899999999999999,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1579999999999999,"5min":1.169,"15min":1.51},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1020000000000001,"5min":1.2529999999999999,"15min":1.3240000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.66900000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.5820000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.393},"last":0.65700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":942080,"data_stored":466295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.89600000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.44600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.499}]},{"osd":3,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.47499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":1.052},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67700000000000005,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0589999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.1930000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":1.048,"15min":1.117},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.63900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.355},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.63100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.999,"5min":1,"15min":1.1899999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.034,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.1259999999999999,"15min":1.2529999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1523712,"data_stored":1050493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.45500000000000002},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.443},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58499999999999996,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.64400000000000002,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.68200000000000005,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.623,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":10.631,"15min":10.631},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.82699999999999996,"15min":0.80000000000000004},"min":{"1min":0.76200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.232,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.626},{"interface":"front","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.81200000000000006},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.495},"max":{"1min":1.1359999999999999,"5min":3.125,"15min":3.125},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91600000000000004,"15min":0.83699999999999997},"min":{"1min":0.70999999999999996,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":1.1479999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.85199999999999998,"15min":0.81000000000000005},"min":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.45700000000000002},"max":{"1min":1.2310000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.81999999999999995},"min":{"1min":0.68999999999999995,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":3.161,"15min":3.161},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89700000000000002,"15min":0.83499999999999996},"min":{"1min":0.70499999999999996,"5min":0.55200000000000005,"15min":0.46600000000000003},"max":{"1min":1.1499999999999999,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91500000000000004,"15min":0.85299999999999998},"min":{"1min":0.73799999999999999,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":1.278,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.3089999999999999,"5min":1.766,"15min":1.766},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:05:29.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-07-20T10:05:29.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-07-20T10:05:29.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-07-20T10:05:29.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-07-20T10:05:29.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-07-20T10:05:29.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-07-20T10:05:29.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-07-20T10:05:29.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-07-20T10:05:29.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-07-20T10:05:29.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-07-20T10:05:29.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-07-20T10:05:29.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-07-20T10:05:29.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-07-20T10:05:29.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-07-20T10:05:29.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-07-20T10:05:29.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-07-20T10:05:29.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-07-20T10:05:29.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-07-20T10:05:29.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-07-20T10:05:29.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-07-20T10:05:29.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-07-20T10:05:29.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-07-20T10:05:29.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-07-20T10:05:29.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-07-20T10:05:29.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-07-20T10:05:29.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-07-20T10:05:29.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-07-20T10:05:29.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-07-20T10:05:29.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-07-20T10:05:29.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-07-20T10:05:29.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-07-20T10:05:29.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-07-20T10:05:29.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-07-20T10:05:29.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-07-20T10:05:29.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.128397+0000', 'last_change': '2023-07-20T10:05:23.128397+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.128397+0000', 'last_undegraded': '2023-07-20T10:05:23.128397+0000', 'last_fullsized': '2023-07-20T10:05:23.128397+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:05:29.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-07-20T10:05:29.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-07-20T10:05:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.136974+0000', 'last_change': '2023-07-20T10:05:23.136974+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.136974+0000', 'last_undegraded': '2023-07-20T10:05:23.136974+0000', 'last_fullsized': '2023-07-20T10:05:23.136974+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-07-20T10:05:29.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-07-20T10:05:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.137397+0000', 'last_change': '2023-07-20T10:05:23.137397+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.137397+0000', 'last_undegraded': '2023-07-20T10:05:23.137397+0000', 'last_fullsized': '2023-07-20T10:05:23.137397+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:29.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-07-20T10:05:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-07-20T10:05:29.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.136964+0000', 'last_change': '2023-07-20T10:05:23.136964+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.136964+0000', 'last_undegraded': '2023-07-20T10:05:23.136964+0000', 'last_fullsized': '2023-07-20T10:05:23.136964+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-07-20T10:05:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-07-20T10:05:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134091+0000', 'last_change': '2023-07-20T10:05:23.134091+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134091+0000', 'last_undegraded': '2023-07-20T10:05:23.134091+0000', 'last_fullsized': '2023-07-20T10:05:23.134091+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-07-20T10:05:29.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-07-20T10:05:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134814+0000', 'last_change': '2023-07-20T10:05:23.134814+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134814+0000', 'last_undegraded': '2023-07-20T10:05:23.134814+0000', 'last_fullsized': '2023-07-20T10:05:23.134814+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:29.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-07-20T10:05:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-07-20T10:05:29.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134098+0000', 'last_change': '2023-07-20T10:05:23.134098+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134098+0000', 'last_undegraded': '2023-07-20T10:05:23.134098+0000', 'last_fullsized': '2023-07-20T10:05:23.134098+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-07-20T10:05:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-07-20T10:05:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.131466+0000', 'last_change': '2023-07-20T10:05:23.131466+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.131466+0000', 'last_undegraded': '2023-07-20T10:05:23.131466+0000', 'last_fullsized': '2023-07-20T10:05:23.131466+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:05:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-07-20T10:05:29.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-07-20T10:05:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.133631+0000', 'last_change': '2023-07-20T10:05:23.133631+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.133631+0000', 'last_undegraded': '2023-07-20T10:05:23.133631+0000', 'last_fullsized': '2023-07-20T10:05:23.133631+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-07-20T10:05:29.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-07-20T10:05:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.133821+0000', 'last_change': '2023-07-20T10:05:23.133821+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.133821+0000', 'last_undegraded': '2023-07-20T10:05:23.133821+0000', 'last_fullsized': '2023-07-20T10:05:23.133821+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:05:29.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-07-20T10:05:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-07-20T10:05:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134318+0000', 'last_change': '2023-07-20T10:05:23.134318+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134318+0000', 'last_undegraded': '2023-07-20T10:05:23.134318+0000', 'last_fullsized': '2023-07-20T10:05:23.134318+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-07-20T10:05:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:29.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-07-20T10:05:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.129041+0000', 'last_change': '2023-07-20T10:05:23.129041+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.129041+0000', 'last_undegraded': '2023-07-20T10:05:23.129041+0000', 'last_fullsized': '2023-07-20T10:05:23.129041+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:05:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-07-20T10:05:29.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-07-20T10:05:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134171+0000', 'last_change': '2023-07-20T10:05:23.134171+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134171+0000', 'last_undegraded': '2023-07-20T10:05:23.134171+0000', 'last_fullsized': '2023-07-20T10:05:23.134171+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-07-20T10:05:30.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-07-20T10:05:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.142872+0000', 'last_change': '2023-07-20T10:05:23.142872+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.142872+0000', 'last_undegraded': '2023-07-20T10:05:23.142872+0000', 'last_fullsized': '2023-07-20T10:05:23.142872+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:05:30.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-07-20T10:05:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-07-20T10:05:30.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.133676+0000', 'last_change': '2023-07-20T10:05:23.133676+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.133676+0000', 'last_undegraded': '2023-07-20T10:05:23.133676+0000', 'last_fullsized': '2023-07-20T10:05:23.133676+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-07-20T10:05:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-07-20T10:05:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134239+0000', 'last_change': '2023-07-20T10:05:23.134239+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134239+0000', 'last_undegraded': '2023-07-20T10:05:23.134239+0000', 'last_fullsized': '2023-07-20T10:05:23.134239+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:05:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-07-20T10:05:30.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-07-20T10:05:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.142397+0000', 'last_change': '2023-07-20T10:05:23.142397+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.142397+0000', 'last_undegraded': '2023-07-20T10:05:23.142397+0000', 'last_fullsized': '2023-07-20T10:05:23.142397+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:05:30.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-07-20T10:05:30.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-07-20T10:05:30.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.142382+0000', 'last_change': '2023-07-20T10:05:23.142382+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.142382+0000', 'last_undegraded': '2023-07-20T10:05:23.142382+0000', 'last_fullsized': '2023-07-20T10:05:23.142382+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:05:30.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-07-20T10:05:30.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-07-20T10:05:30.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.137896+0000', 'last_change': '2023-07-20T10:05:23.137896+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.137896+0000', 'last_undegraded': '2023-07-20T10:05:23.137896+0000', 'last_fullsized': '2023-07-20T10:05:23.137896+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:30.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-07-20T10:05:30.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-07-20T10:05:30.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.128403+0000', 'last_change': '2023-07-20T10:05:23.128403+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.128403+0000', 'last_undegraded': '2023-07-20T10:05:23.128403+0000', 'last_fullsized': '2023-07-20T10:05:23.128403+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:05:30.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-07-20T10:05:30.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-07-20T10:05:30.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.133590+0000', 'last_change': '2023-07-20T10:05:23.133590+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.133590+0000', 'last_undegraded': '2023-07-20T10:05:23.133590+0000', 'last_fullsized': '2023-07-20T10:05:23.133590+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:30.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-07-20T10:05:30.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-07-20T10:05:30.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134173+0000', 'last_change': '2023-07-20T10:05:23.134173+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134173+0000', 'last_undegraded': '2023-07-20T10:05:23.134173+0000', 'last_fullsized': '2023-07-20T10:05:23.134173+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:30.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-07-20T10:05:30.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-07-20T10:05:30.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134765+0000', 'last_change': '2023-07-20T10:05:23.134765+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134765+0000', 'last_undegraded': '2023-07-20T10:05:23.134765+0000', 'last_fullsized': '2023-07-20T10:05:23.134765+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:30.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-07-20T10:05:30.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-07-20T10:05:30.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.128407+0000', 'last_change': '2023-07-20T10:05:23.128407+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.128407+0000', 'last_undegraded': '2023-07-20T10:05:23.128407+0000', 'last_fullsized': '2023-07-20T10:05:23.128407+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:05:30.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-07-20T10:05:30.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-07-20T10:05:30.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134073+0000', 'last_change': '2023-07-20T10:05:23.134073+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134073+0000', 'last_undegraded': '2023-07-20T10:05:23.134073+0000', 'last_fullsized': '2023-07-20T10:05:23.134073+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:30.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-07-20T10:05:30.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-07-20T10:05:30.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.137031+0000', 'last_change': '2023-07-20T10:05:23.137031+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.137031+0000', 'last_undegraded': '2023-07-20T10:05:23.137031+0000', 'last_fullsized': '2023-07-20T10:05:23.137031+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:30.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-07-20T10:05:30.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-07-20T10:05:30.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.142358+0000', 'last_change': '2023-07-20T10:05:23.142358+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.142358+0000', 'last_undegraded': '2023-07-20T10:05:23.142358+0000', 'last_fullsized': '2023-07-20T10:05:23.142358+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:05:30.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-07-20T10:05:30.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-07-20T10:05:30.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.136945+0000', 'last_change': '2023-07-20T10:05:23.136945+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.136945+0000', 'last_undegraded': '2023-07-20T10:05:23.136945+0000', 'last_fullsized': '2023-07-20T10:05:23.136945+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:05:30.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-07-20T10:05:30.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-07-20T10:05:30.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.142860+0000', 'last_change': '2023-07-20T10:05:23.142860+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.142860+0000', 'last_undegraded': '2023-07-20T10:05:23.142860+0000', 'last_fullsized': '2023-07-20T10:05:23.142860+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:05:30.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-07-20T10:05:30.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-07-20T10:05:30.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134563+0000', 'last_change': '2023-07-20T10:05:23.134563+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134563+0000', 'last_undegraded': '2023-07-20T10:05:23.134563+0000', 'last_fullsized': '2023-07-20T10:05:23.134563+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:30.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-07-20T10:05:30.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-07-20T10:05:30.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.133811+0000', 'last_change': '2023-07-20T10:05:23.133811+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.133811+0000', 'last_undegraded': '2023-07-20T10:05:23.133811+0000', 'last_fullsized': '2023-07-20T10:05:23.133811+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:05:30.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-07-20T10:05:30.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T10:05:24.125211+0000', 'last_change': '2023-07-20T10:05:24.125211+0000', 'last_active': '2023-07-20T10:05:24.125211+0000', 'last_peered': '2023-07-20T10:05:24.125211+0000', 'last_clean': '2023-07-20T10:05:24.125211+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:24.125211+0000', 'last_undegraded': '2023-07-20T10:05:24.125211+0000', 'last_fullsized': '2023-07-20T10:05:24.125211+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:24.125211+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T10:05:30.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-07-20T10:05:30.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:05:23.134085+0000', 'last_change': '2023-07-20T10:05:23.134085+0000', 'last_active': '2023-07-20T10:05:23.112887+0000', 'last_peered': '2023-07-20T10:05:23.112887+0000', 'last_clean': '2023-07-20T10:05:23.112887+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:05:23.134085+0000', 'last_undegraded': '2023-07-20T10:05:23.134085+0000', 'last_fullsized': '2023-07-20T10:05:23.134085+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'last_clean_scrub_stamp': '2023-07-20T10:05:23.112887+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:05:30.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:05:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 Processor -- start 2023-07-20T10:05:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 -- start start 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0b12a0 con 0x7fd8fc0afda0 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0b1580 con 0x7fd8fc0b2060 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd9021db640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b3160 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd8f2ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd8fb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd8fc0afda0 0x7fd8fc0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49866/0 (socket says 172.21.15.82:49866) 2023-07-20T10:05:30.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd8fb7fe640 1 -- 172.21.15.82:0/2259960892 learned_addr learned my addr 172.21.15.82:0/2259960892 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.183+0000 7fd8f2ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48746/0 (socket says 172.21.15.82:48746) 2023-07-20T10:05:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.187+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/2259960892 >> v1:172.21.15.183:6789/0 conn(0x7fd8fc0b2060 legacy=0x7fd8fc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.187+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/2259960892 >> v1:172.21.15.82:6789/0 conn(0x7fd8fc0afda0 legacy=0x7fd8fc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.187+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/2259960892 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0b1860 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.187+0000 7fd8f2ffd640 1 --2- 172.21.15.82:0/2259960892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009d90 tx=0x7fd8e401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c2e2466e3cdf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd8faffd640 1 -- 172.21.15.82:0/2259960892 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40a5810 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd8faffd640 1 -- 172.21.15.82:0/2259960892 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e40a5970 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd8faffd640 1 -- 172.21.15.82:0/2259960892 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40a5d00 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- 172.21.15.82:0/2259960892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc15a8e0 msgr2=0x7fd8fc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 --2- 172.21.15.82:0/2259960892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009d90 tx=0x7fd8e401c7c0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- 172.21.15.82:0/2259960892 shutdown_connections 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 --2- 172.21.15.82:0/2259960892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc15a8e0 0x7fd8fc0ca6b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- 172.21.15.82:0/2259960892 >> 172.21.15.82:0/2259960892 conn(0x7fd8fc0cada0 msgr2=0x7fd8fc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:30.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- 172.21.15.82:0/2259960892 shutdown_connections 2023-07-20T10:05:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- 172.21.15.82:0/2259960892 wait complete. 2023-07-20T10:05:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 Processor -- start 2023-07-20T10:05:30.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.191+0000 7fd9021db640 1 -- start start 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8fc0afda0 0x7fd8fc0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8fc15a8e0 0x7fd8fc0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0aca10 con 0x7fd8fc0b2060 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0c5520 con 0x7fd8fc0afda0 2023-07-20T10:05:30.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0c57c0 con 0x7fd8fc15a8e0 2023-07-20T10:05:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48754/0 (socket says 172.21.15.82:48754) 2023-07-20T10:05:30.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/3085126656 learned_addr learned my addr 172.21.15.82:0/3085126656 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8fbfff640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8fc15a8e0 0x7fd8fc0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8fb7fe640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8fc0afda0 0x7fd8fc0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8fc15a8e0 msgr2=0x7fd8fc0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8fc15a8e0 0x7fd8fc0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8fc0afda0 msgr2=0x7fd8fc0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8fc0afda0 0x7fd8fc0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 -- 172.21.15.82:0/3085126656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e4009a70 con 0x7fd8fc0b2060 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f2ffd640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40193d0 tx=0x7fd8e4019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40b9860 con 0x7fd8fc0b2060 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e40b99c0 con 0x7fd8fc0b2060 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc0c5aa0 con 0x7fd8fc0b2060 2023-07-20T10:05:30.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40b9d50 con 0x7fd8fc0b2060 2023-07-20T10:05:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc140dc0 con 0x7fd8fc0b2060 2023-07-20T10:05:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc073c70 con 0x7fd8fc0b2060 2023-07-20T10:05:30.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.195+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8e40ad440 con 0x7fd8fc0b2060 2023-07-20T10:05:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.199+0000 7fd8f8ff9640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 0x7fd8dc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.199+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8e411f330 con 0x7fd8fc0b2060 2023-07-20T10:05:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.199+0000 7fd8fb7fe640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 0x7fd8dc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.199+0000 7fd8fb7fe640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 0x7fd8dc068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec005890 tx=0x7fd8ec009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.203+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8e40ec7b0 con 0x7fd8fc0b2060 2023-07-20T10:05:30.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.403+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd8fc0cb990 con 0x7fd8fc0b2060 2023-07-20T10:05:30.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.403+0000 7fd8f8ff9640 1 -- 172.21.15.82:0/3085126656 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7fd8e40efdd0 con 0x7fd8fc0b2060 2023-07-20T10:05:30.386 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:30.386 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":929,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":313581568,"bytes_avail":772780531712,"bytes_total":773094113280,"write_bytes_sec":2387,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":33,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6678}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-20T10:04:20.728788+0000","services":{}},"progress_events":{}} 2023-07-20T10:05:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 msgr2=0x7fd8dc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 0x7fd8dc068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec005890 tx=0x7fd8ec009040 comp rx=0 tx=0).stop 2023-07-20T10:05:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 msgr2=0x7fd8fc0c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40193d0 tx=0x7fd8e4019560 comp rx=0 tx=0).stop 2023-07-20T10:05:30.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 shutdown_connections 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8fc15a8e0 0x7fd8fc0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd8dc0663a0 0x7fd8dc068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0b2060 0x7fd8fc0c62a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 --2- 172.21.15.82:0/3085126656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8fc0afda0 0x7fd8fc0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 >> 172.21.15.82:0/3085126656 conn(0x7fd8fc0cada0 msgr2=0x7fd8fc072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 shutdown_connections 2023-07-20T10:05:30.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.407+0000 7fd9021db640 1 -- 172.21.15.82:0/3085126656 wait complete. 2023-07-20T10:05:30.407 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:05:30.407 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:05:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.563+0000 7f48ef333640 1 Processor -- start 2023-07-20T10:05:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.563+0000 7f48ef333640 1 -- start start 2023-07-20T10:05:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ef333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48e80ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ef333640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e80ab890 con 0x7f48e815c5e0 2023-07-20T10:05:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ef333640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e8069ac0 con 0x7f48e80cd080 2023-07-20T10:05:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ef333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80cd4f0 con 0x7f48e80c91f0 2023-07-20T10:05:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed0cf640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48e815c5e0 0x7f48e80adcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49874/0 (socket says 172.21.15.82:49874) 2023-07-20T10:05:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed0cf640 1 -- 172.21.15.82:0/2674427233 learned_addr learned my addr 172.21.15.82:0/2674427233 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ec8ce640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48e80ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323901392 0 0) 0x7f48e80ab890 con 0x7f48e815c5e0 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48d4003530 con 0x7f48e815c5e0 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2117235918 0 0) 0x7f48d4003530 con 0x7f48e815c5e0 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 msgr2=0x7f48e80ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:30.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48e80ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 >> v1:172.21.15.183:6789/0 conn(0x7f48e80cd080 legacy=0x7f48e8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e80ce2d0 con 0x7f48e815c5e0 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f48e4001680 con 0x7f48e815c5e0 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 >> v1:172.21.15.82:6789/0 conn(0x7f48e815c5e0 legacy=0x7f48e80adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48d40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4003f80 0x7f48d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80cd4f0 con 0x7f48d4004d10 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d400bad0 con 0x7f48d4003f80 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d400bc90 con 0x7f48e80c91f0 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed0cf640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48d40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ec8ce640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4003f80 0x7f48d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 -- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 msgr2=0x7f48d40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:30.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48e80c91f0 0x7f48d40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 -- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4003f80 msgr2=0x7f48d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d4003f80 0x7f48d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.567+0000 7f48ed8d0640 1 -- 172.21.15.82:0/2674427233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4003530 con 0x7f48d4004d10 2023-07-20T10:05:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001e70 tx=0x7f48e001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dda687404c9065 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0003b80 con 0x7f48d4004d10 2023-07-20T10:05:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0003ce0 con 0x7f48d4004d10 2023-07-20T10:05:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48dffff640 1 -- 172.21.15.82:0/2674427233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00052c0 con 0x7f48d4004d10 2023-07-20T10:05:30.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- 172.21.15.82:0/2674427233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d4004d10 msgr2=0x7f48d4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 --2- 172.21.15.82:0/2674427233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d4004d10 0x7f48d4005190 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001e70 tx=0x7f48e001c760 comp rx=0 tx=0).stop 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ed8d0640 1 -- 172.21.15.82:0/2674427233 reap_dead start 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- 172.21.15.82:0/2674427233 shutdown_connections 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- 172.21.15.82:0/2674427233 >> 172.21.15.82:0/2674427233 conn(0x7f48e80cb620 msgr2=0x7f48e80cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- 172.21.15.82:0/2674427233 shutdown_connections 2023-07-20T10:05:30.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- 172.21.15.82:0/2674427233 wait complete. 2023-07-20T10:05:30.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 Processor -- start 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.571+0000 7f48ef333640 1 -- start start 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d4004d10 0x7f48e815f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e81f1d50 0x7f48e815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e815ee60 con 0x7f48e815daf0 2023-07-20T10:05:30.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81f2d60 con 0x7f48e81f1d50 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81f21e0 con 0x7f48d4004d10 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48776/0 (socket says 172.21.15.82:48776) 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 -- 172.21.15.82:0/3364947023 learned_addr learned my addr 172.21.15.82:0/3364947023 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ec8ce640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e81f1d50 0x7f48e815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed0cf640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d4004d10 0x7f48e815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 -- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d4004d10 msgr2=0x7f48e815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d4004d10 0x7f48e815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 -- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e81f1d50 msgr2=0x7f48e815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e81f1d50 0x7f48e815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 -- 172.21.15.82:0/3364947023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e81f24c0 con 0x7f48e815daf0 2023-07-20T10:05:30.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ed8d0640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f48e001cc40 tx=0x7f48d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0006d60 con 0x7f48e815daf0 2023-07-20T10:05:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0005820 con 0x7f48e815daf0 2023-07-20T10:05:30.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0007230 con 0x7f48e815daf0 2023-07-20T10:05:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e81f27a0 con 0x7f48e815daf0 2023-07-20T10:05:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e815dfa0 con 0x7f48e815daf0 2023-07-20T10:05:30.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e81f53f0 con 0x7f48e815daf0 2023-07-20T10:05:30.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.575+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48e0007390 con 0x7f48e815daf0 2023-07-20T10:05:30.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.579+0000 7f48ddffb640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 0x7f48cc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:30.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.579+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48e011dce0 con 0x7f48e815daf0 2023-07-20T10:05:30.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.579+0000 7f48ed0cf640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 0x7f48cc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:30.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.579+0000 7f48ed0cf640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 0x7f48cc068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000c10 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:30.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.583+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48e00eaf30 con 0x7f48e815daf0 2023-07-20T10:05:30.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.727+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48e80ce890 con 0x7f48cc0663a0 2023-07-20T10:05:30.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.735+0000 7f48ddffb640 1 -- 172.21.15.82:0/3364947023 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311518 (secure 0 0 0) 0x7f48e4007750 con 0x7f48cc0663a0 2023-07-20T10:05:30.717 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.735+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 msgr2=0x7f48cc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.735+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 0x7f48cc068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48e4000c10 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.735+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 msgr2=0x7f48e80ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.735+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f48e001cc40 tx=0x7f48d4005800 comp rx=0 tx=0).stop 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 shutdown_connections 2023-07-20T10:05:30.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f48cc0663a0 0x7f48cc068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e815daf0 0x7f48e80ac8e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48e81f1d50 0x7f48e815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 --2- 172.21.15.82:0/3364947023 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d4004d10 0x7f48e815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 >> 172.21.15.82:0/3364947023 conn(0x7f48e80cb620 msgr2=0x7f48e80cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 shutdown_connections 2023-07-20T10:05:30.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:30.739+0000 7f48ef333640 1 -- 172.21.15.82:0/3364947023 wait complete. 2023-07-20T10:05:30.737 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:05:29.953897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306232,"kb_used_data":8872,"kb_used_omap":13,"kb_used_meta":297202,"kb_avail":754668488,"statfs":{"total":773094113280,"available":772780531712,"internally_reserved":0,"allocated":9084928,"data_stored":5079028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":304334936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.005303"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508993+0000","last_change":"2023-07-20T10:05:25.168147+0000","last_active":"2023-07-20T10:05:26.508993+0000","last_peered":"2023-07-20T10:05:26.508993+0000","last_clean":"2023-07-20T10:05:26.508993+0000","last_became_active":"2023-07-20T10:05:25.167891+0000","last_became_peered":"2023-07-20T10:05:25.167891+0000","last_unstale":"2023-07-20T10:05:26.508993+0000","last_undegraded":"2023-07-20T10:05:26.508993+0000","last_fullsized":"2023-07-20T10:05:26.508993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:53.381975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508461+0000","last_change":"2023-07-20T10:05:25.165649+0000","last_active":"2023-07-20T10:05:26.508461+0000","last_peered":"2023-07-20T10:05:26.508461+0000","last_clean":"2023-07-20T10:05:26.508461+0000","last_became_active":"2023-07-20T10:05:25.164081+0000","last_became_peered":"2023-07-20T10:05:25.164081+0000","last_unstale":"2023-07-20T10:05:26.508461+0000","last_undegraded":"2023-07-20T10:05:26.508461+0000","last_fullsized":"2023-07-20T10:05:26.508461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:07:40.337236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511333+0000","last_change":"2023-07-20T10:05:25.174172+0000","last_active":"2023-07-20T10:05:26.511333+0000","last_peered":"2023-07-20T10:05:26.511333+0000","last_clean":"2023-07-20T10:05:26.511333+0000","last_became_active":"2023-07-20T10:05:25.173885+0000","last_became_peered":"2023-07-20T10:05:25.173885+0000","last_unstale":"2023-07-20T10:05:26.511333+0000","last_undegraded":"2023-07-20T10:05:26.511333+0000","last_fullsized":"2023-07-20T10:05:26.511333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:16.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145550+0000","last_change":"2023-07-20T10:05:25.162990+0000","last_active":"2023-07-20T10:05:26.145550+0000","last_peered":"2023-07-20T10:05:26.145550+0000","last_clean":"2023-07-20T10:05:26.145550+0000","last_became_active":"2023-07-20T10:05:25.162627+0000","last_became_peered":"2023-07-20T10:05:25.162627+0000","last_unstale":"2023-07-20T10:05:26.145550+0000","last_undegraded":"2023-07-20T10:05:26.145550+0000","last_fullsized":"2023-07-20T10:05:26.145550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:41.776631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511496+0000","last_change":"2023-07-20T10:05:25.178587+0000","last_active":"2023-07-20T10:05:26.511496+0000","last_peered":"2023-07-20T10:05:26.511496+0000","last_clean":"2023-07-20T10:05:26.511496+0000","last_became_active":"2023-07-20T10:05:25.178251+0000","last_became_peered":"2023-07-20T10:05:25.178251+0000","last_unstale":"2023-07-20T10:05:26.511496+0000","last_undegraded":"2023-07-20T10:05:26.511496+0000","last_fullsized":"2023-07-20T10:05:26.511496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:09.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507775+0000","last_change":"2023-07-20T10:05:25.172210+0000","last_active":"2023-07-20T10:05:26.507775+0000","last_peered":"2023-07-20T10:05:26.507775+0000","last_clean":"2023-07-20T10:05:26.507775+0000","last_became_active":"2023-07-20T10:05:25.171549+0000","last_became_peered":"2023-07-20T10:05:25.171549+0000","last_unstale":"2023-07-20T10:05:26.507775+0000","last_undegraded":"2023-07-20T10:05:26.507775+0000","last_fullsized":"2023-07-20T10:05:26.507775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:34:31.021514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139749+0000","last_change":"2023-07-20T10:05:25.162336+0000","last_active":"2023-07-20T10:05:26.139749+0000","last_peered":"2023-07-20T10:05:26.139749+0000","last_clean":"2023-07-20T10:05:26.139749+0000","last_became_active":"2023-07-20T10:05:25.162049+0000","last_became_peered":"2023-07-20T10:05:25.162049+0000","last_unstale":"2023-07-20T10:05:26.139749+0000","last_undegraded":"2023-07-20T10:05:26.139749+0000","last_fullsized":"2023-07-20T10:05:26.139749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:30.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144204+0000","last_change":"2023-07-20T10:05:25.171100+0000","last_active":"2023-07-20T10:05:26.144204+0000","last_peered":"2023-07-20T10:05:26.144204+0000","last_clean":"2023-07-20T10:05:26.144204+0000","last_became_active":"2023-07-20T10:05:25.170826+0000","last_became_peered":"2023-07-20T10:05:25.170826+0000","last_unstale":"2023-07-20T10:05:26.144204+0000","last_undegraded":"2023-07-20T10:05:26.144204+0000","last_fullsized":"2023-07-20T10:05:26.144204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:35.226838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511890+0000","last_change":"2023-07-20T10:05:25.179893+0000","last_active":"2023-07-20T10:05:26.511890+0000","last_peered":"2023-07-20T10:05:26.511890+0000","last_clean":"2023-07-20T10:05:26.511890+0000","last_became_active":"2023-07-20T10:05:25.178337+0000","last_became_peered":"2023-07-20T10:05:25.178337+0000","last_unstale":"2023-07-20T10:05:26.511890+0000","last_undegraded":"2023-07-20T10:05:26.511890+0000","last_fullsized":"2023-07-20T10:05:26.511890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:41:49.637039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511527+0000","last_change":"2023-07-20T10:05:25.172420+0000","last_active":"2023-07-20T10:05:26.511527+0000","last_peered":"2023-07-20T10:05:26.511527+0000","last_clean":"2023-07-20T10:05:26.511527+0000","last_became_active":"2023-07-20T10:05:25.171594+0000","last_became_peered":"2023-07-20T10:05:25.171594+0000","last_unstale":"2023-07-20T10:05:26.511527+0000","last_undegraded":"2023-07-20T10:05:26.511527+0000","last_fullsized":"2023-07-20T10:05:26.511527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:55:13.395178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145666+0000","last_change":"2023-07-20T10:05:25.165669+0000","last_active":"2023-07-20T10:05:26.145666+0000","last_peered":"2023-07-20T10:05:26.145666+0000","last_clean":"2023-07-20T10:05:26.145666+0000","last_became_active":"2023-07-20T10:05:25.165372+0000","last_became_peered":"2023-07-20T10:05:25.165372+0000","last_unstale":"2023-07-20T10:05:26.145666+0000","last_undegraded":"2023-07-20T10:05:26.145666+0000","last_fullsized":"2023-07-20T10:05:26.145666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:10.383102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144407+0000","last_change":"2023-07-20T10:05:25.175341+0000","last_active":"2023-07-20T10:05:26.144407+0000","last_peered":"2023-07-20T10:05:26.144407+0000","last_clean":"2023-07-20T10:05:26.144407+0000","last_became_active":"2023-07-20T10:05:25.175086+0000","last_became_peered":"2023-07-20T10:05:25.175086+0000","last_unstale":"2023-07-20T10:05:26.144407+0000","last_undegraded":"2023-07-20T10:05:26.144407+0000","last_fullsized":"2023-07-20T10:05:26.144407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:40.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144673+0000","last_change":"2023-07-20T10:05:25.157542+0000","last_active":"2023-07-20T10:05:26.144673+0000","last_peered":"2023-07-20T10:05:26.144673+0000","last_clean":"2023-07-20T10:05:26.144673+0000","last_became_active":"2023-07-20T10:05:25.157205+0000","last_became_peered":"2023-07-20T10:05:25.157205+0000","last_unstale":"2023-07-20T10:05:26.144673+0000","last_undegraded":"2023-07-20T10:05:26.144673+0000","last_fullsized":"2023-07-20T10:05:26.144673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:18.030205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510974+0000","last_change":"2023-07-20T10:05:25.172267+0000","last_active":"2023-07-20T10:05:26.510974+0000","last_peered":"2023-07-20T10:05:26.510974+0000","last_clean":"2023-07-20T10:05:26.510974+0000","last_became_active":"2023-07-20T10:05:25.171924+0000","last_became_peered":"2023-07-20T10:05:25.171924+0000","last_unstale":"2023-07-20T10:05:26.510974+0000","last_undegraded":"2023-07-20T10:05:26.510974+0000","last_fullsized":"2023-07-20T10:05:26.510974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:04.217272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511229+0000","last_change":"2023-07-20T10:05:25.172080+0000","last_active":"2023-07-20T10:05:26.511229+0000","last_peered":"2023-07-20T10:05:26.511229+0000","last_clean":"2023-07-20T10:05:26.511229+0000","last_became_active":"2023-07-20T10:05:25.171735+0000","last_became_peered":"2023-07-20T10:05:25.171735+0000","last_unstale":"2023-07-20T10:05:26.511229+0000","last_undegraded":"2023-07-20T10:05:26.511229+0000","last_fullsized":"2023-07-20T10:05:26.511229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:15.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139919+0000","last_change":"2023-07-20T10:05:25.168087+0000","last_active":"2023-07-20T10:05:26.139919+0000","last_peered":"2023-07-20T10:05:26.139919+0000","last_clean":"2023-07-20T10:05:26.139919+0000","last_became_active":"2023-07-20T10:05:25.167797+0000","last_became_peered":"2023-07-20T10:05:25.167797+0000","last_unstale":"2023-07-20T10:05:26.139919+0000","last_undegraded":"2023-07-20T10:05:26.139919+0000","last_fullsized":"2023-07-20T10:05:26.139919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:14:28.253258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509085+0000","last_change":"2023-07-20T10:05:25.173229+0000","last_active":"2023-07-20T10:05:26.509085+0000","last_peered":"2023-07-20T10:05:26.509085+0000","last_clean":"2023-07-20T10:05:26.509085+0000","last_became_active":"2023-07-20T10:05:25.172964+0000","last_became_peered":"2023-07-20T10:05:25.172964+0000","last_unstale":"2023-07-20T10:05:26.509085+0000","last_undegraded":"2023-07-20T10:05:26.509085+0000","last_fullsized":"2023-07-20T10:05:26.509085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:03.449831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145355+0000","last_change":"2023-07-20T10:05:25.166726+0000","last_active":"2023-07-20T10:05:26.145355+0000","last_peered":"2023-07-20T10:05:26.145355+0000","last_clean":"2023-07-20T10:05:26.145355+0000","last_became_active":"2023-07-20T10:05:25.166452+0000","last_became_peered":"2023-07-20T10:05:25.166452+0000","last_unstale":"2023-07-20T10:05:26.145355+0000","last_undegraded":"2023-07-20T10:05:26.145355+0000","last_fullsized":"2023-07-20T10:05:26.145355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:38.379244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511823+0000","last_change":"2023-07-20T10:05:25.166622+0000","last_active":"2023-07-20T10:05:26.511823+0000","last_peered":"2023-07-20T10:05:26.511823+0000","last_clean":"2023-07-20T10:05:26.511823+0000","last_became_active":"2023-07-20T10:05:25.166209+0000","last_became_peered":"2023-07-20T10:05:25.166209+0000","last_unstale":"2023-07-20T10:05:26.511823+0000","last_undegraded":"2023-07-20T10:05:26.511823+0000","last_fullsized":"2023-07-20T10:05:26.511823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:04.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507817+0000","last_change":"2023-07-20T10:05:25.166585+0000","last_active":"2023-07-20T10:05:26.507817+0000","last_peered":"2023-07-20T10:05:26.507817+0000","last_clean":"2023-07-20T10:05:26.507817+0000","last_became_active":"2023-07-20T10:05:25.166235+0000","last_became_peered":"2023-07-20T10:05:25.166235+0000","last_unstale":"2023-07-20T10:05:26.507817+0000","last_undegraded":"2023-07-20T10:05:26.507817+0000","last_fullsized":"2023-07-20T10:05:26.507817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:13:26.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144833+0000","last_change":"2023-07-20T10:05:25.164915+0000","last_active":"2023-07-20T10:05:26.144833+0000","last_peered":"2023-07-20T10:05:26.144833+0000","last_clean":"2023-07-20T10:05:26.144833+0000","last_became_active":"2023-07-20T10:05:25.164649+0000","last_became_peered":"2023-07-20T10:05:25.164649+0000","last_unstale":"2023-07-20T10:05:26.144833+0000","last_undegraded":"2023-07-20T10:05:26.144833+0000","last_fullsized":"2023-07-20T10:05:26.144833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:07.270012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507644+0000","last_change":"2023-07-20T10:05:25.169795+0000","last_active":"2023-07-20T10:05:26.507644+0000","last_peered":"2023-07-20T10:05:26.507644+0000","last_clean":"2023-07-20T10:05:26.507644+0000","last_became_active":"2023-07-20T10:05:25.169506+0000","last_became_peered":"2023-07-20T10:05:25.169506+0000","last_unstale":"2023-07-20T10:05:26.507644+0000","last_undegraded":"2023-07-20T10:05:26.507644+0000","last_fullsized":"2023-07-20T10:05:26.507644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:41:44.492629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508710+0000","last_change":"2023-07-20T10:05:25.169762+0000","last_active":"2023-07-20T10:05:26.508710+0000","last_peered":"2023-07-20T10:05:26.508710+0000","last_clean":"2023-07-20T10:05:26.508710+0000","last_became_active":"2023-07-20T10:05:25.169454+0000","last_became_peered":"2023-07-20T10:05:25.169454+0000","last_unstale":"2023-07-20T10:05:26.508710+0000","last_undegraded":"2023-07-20T10:05:26.508710+0000","last_fullsized":"2023-07-20T10:05:26.508710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:16.803699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511563+0000","last_change":"2023-07-20T10:05:25.173618+0000","last_active":"2023-07-20T10:05:26.511563+0000","last_peered":"2023-07-20T10:05:26.511563+0000","last_clean":"2023-07-20T10:05:26.511563+0000","last_became_active":"2023-07-20T10:05:25.172676+0000","last_became_peered":"2023-07-20T10:05:25.172676+0000","last_unstale":"2023-07-20T10:05:26.511563+0000","last_undegraded":"2023-07-20T10:05:26.511563+0000","last_fullsized":"2023-07-20T10:05:26.511563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:42.267585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145119+0000","last_change":"2023-07-20T10:05:25.156567+0000","last_active":"2023-07-20T10:05:26.145119+0000","last_peered":"2023-07-20T10:05:26.145119+0000","last_clean":"2023-07-20T10:05:26.145119+0000","last_became_active":"2023-07-20T10:05:25.156252+0000","last_became_peered":"2023-07-20T10:05:25.156252+0000","last_unstale":"2023-07-20T10:05:26.145119+0000","last_undegraded":"2023-07-20T10:05:26.145119+0000","last_fullsized":"2023-07-20T10:05:26.145119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:12:58.173216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144410+0000","last_change":"2023-07-20T10:05:25.150820+0000","last_active":"2023-07-20T10:05:26.144410+0000","last_peered":"2023-07-20T10:05:26.144410+0000","last_clean":"2023-07-20T10:05:26.144410+0000","last_became_active":"2023-07-20T10:05:25.150544+0000","last_became_peered":"2023-07-20T10:05:25.150544+0000","last_unstale":"2023-07-20T10:05:26.144410+0000","last_undegraded":"2023-07-20T10:05:26.144410+0000","last_fullsized":"2023-07-20T10:05:26.144410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:51.129173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145848+0000","last_change":"2023-07-20T10:05:25.155792+0000","last_active":"2023-07-20T10:05:26.145848+0000","last_peered":"2023-07-20T10:05:26.145848+0000","last_clean":"2023-07-20T10:05:26.145848+0000","last_became_active":"2023-07-20T10:05:25.155491+0000","last_became_peered":"2023-07-20T10:05:25.155491+0000","last_unstale":"2023-07-20T10:05:26.145848+0000","last_undegraded":"2023-07-20T10:05:26.145848+0000","last_fullsized":"2023-07-20T10:05:26.145848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:51:49.687628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508585+0000","last_change":"2023-07-20T10:05:25.166665+0000","last_active":"2023-07-20T10:05:26.508585+0000","last_peered":"2023-07-20T10:05:26.508585+0000","last_clean":"2023-07-20T10:05:26.508585+0000","last_became_active":"2023-07-20T10:05:25.165891+0000","last_became_peered":"2023-07-20T10:05:25.165891+0000","last_unstale":"2023-07-20T10:05:26.508585+0000","last_undegraded":"2023-07-20T10:05:26.508585+0000","last_fullsized":"2023-07-20T10:05:26.508585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:57.332335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511218+0000","last_change":"2023-07-20T10:05:25.180250+0000","last_active":"2023-07-20T10:05:26.511218+0000","last_peered":"2023-07-20T10:05:26.511218+0000","last_clean":"2023-07-20T10:05:26.511218+0000","last_became_active":"2023-07-20T10:05:25.179951+0000","last_became_peered":"2023-07-20T10:05:25.179951+0000","last_unstale":"2023-07-20T10:05:26.511218+0000","last_undegraded":"2023-07-20T10:05:26.511218+0000","last_fullsized":"2023-07-20T10:05:26.511218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:36:27.336212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144407+0000","last_change":"2023-07-20T10:05:25.174811+0000","last_active":"2023-07-20T10:05:26.144407+0000","last_peered":"2023-07-20T10:05:26.144407+0000","last_clean":"2023-07-20T10:05:26.144407+0000","last_became_active":"2023-07-20T10:05:25.174541+0000","last_became_peered":"2023-07-20T10:05:25.174541+0000","last_unstale":"2023-07-20T10:05:26.144407+0000","last_undegraded":"2023-07-20T10:05:26.144407+0000","last_fullsized":"2023-07-20T10:05:26.144407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:13.482693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144757+0000","last_change":"2023-07-20T10:05:25.147578+0000","last_active":"2023-07-20T10:05:26.144757+0000","last_peered":"2023-07-20T10:05:26.144757+0000","last_clean":"2023-07-20T10:05:26.144757+0000","last_became_active":"2023-07-20T10:05:25.147273+0000","last_became_peered":"2023-07-20T10:05:25.147273+0000","last_unstale":"2023-07-20T10:05:26.144757+0000","last_undegraded":"2023-07-20T10:05:26.144757+0000","last_fullsized":"2023-07-20T10:05:26.144757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:00:21.528951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507431+0000","last_change":"2023-07-20T10:05:25.162355+0000","last_active":"2023-07-20T10:05:26.507431+0000","last_peered":"2023-07-20T10:05:26.507431+0000","last_clean":"2023-07-20T10:05:26.507431+0000","last_became_active":"2023-07-20T10:05:25.159503+0000","last_became_peered":"2023-07-20T10:05:25.159503+0000","last_unstale":"2023-07-20T10:05:26.507431+0000","last_undegraded":"2023-07-20T10:05:26.507431+0000","last_fullsized":"2023-07-20T10:05:26.507431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:03.248853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511140+0000","last_change":"2023-07-20T10:05:25.172277+0000","last_active":"2023-07-20T10:05:26.511140+0000","last_peered":"2023-07-20T10:05:26.511140+0000","last_clean":"2023-07-20T10:05:26.511140+0000","last_became_active":"2023-07-20T10:05:25.171670+0000","last_became_peered":"2023-07-20T10:05:25.171670+0000","last_unstale":"2023-07-20T10:05:26.511140+0000","last_undegraded":"2023-07-20T10:05:26.511140+0000","last_fullsized":"2023-07-20T10:05:26.511140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:06:19.297371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"80'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509083+0000","last_change":"2023-07-20T10:05:24.162257+0000","last_active":"2023-07-20T10:05:26.509083+0000","last_peered":"2023-07-20T10:05:26.509083+0000","last_clean":"2023-07-20T10:05:26.509083+0000","last_became_active":"2023-07-20T10:05:24.161963+0000","last_became_peered":"2023-07-20T10:05:24.161963+0000","last_unstale":"2023-07-20T10:05:26.509083+0000","last_undegraded":"2023-07-20T10:05:26.509083+0000","last_fullsized":"2023-07-20T10:05:26.509083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:19.047829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145827+0000","last_change":"2023-07-20T10:05:25.169240+0000","last_active":"2023-07-20T10:05:26.145827+0000","last_peered":"2023-07-20T10:05:26.145827+0000","last_clean":"2023-07-20T10:05:26.145827+0000","last_became_active":"2023-07-20T10:05:25.168930+0000","last_became_peered":"2023-07-20T10:05:25.168930+0000","last_unstale":"2023-07-20T10:05:26.145827+0000","last_undegraded":"2023-07-20T10:05:26.145827+0000","last_fullsized":"2023-07-20T10:05:26.145827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:01:38.333914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508764+0000","last_change":"2023-07-20T10:05:24.157108+0000","last_active":"2023-07-20T10:05:26.508764+0000","last_peered":"2023-07-20T10:05:26.508764+0000","last_clean":"2023-07-20T10:05:26.508764+0000","last_became_active":"2023-07-20T10:05:24.156800+0000","last_became_peered":"2023-07-20T10:05:24.156800+0000","last_unstale":"2023-07-20T10:05:26.508764+0000","last_undegraded":"2023-07-20T10:05:26.508764+0000","last_fullsized":"2023-07-20T10:05:26.508764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:43.413164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508666+0000","last_change":"2023-07-20T10:05:25.163496+0000","last_active":"2023-07-20T10:05:26.508666+0000","last_peered":"2023-07-20T10:05:26.508666+0000","last_clean":"2023-07-20T10:05:26.508666+0000","last_became_active":"2023-07-20T10:05:25.163224+0000","last_became_peered":"2023-07-20T10:05:25.163224+0000","last_unstale":"2023-07-20T10:05:26.508666+0000","last_undegraded":"2023-07-20T10:05:26.508666+0000","last_fullsized":"2023-07-20T10:05:26.508666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:33:49.062975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508268+0000","last_change":"2023-07-20T10:05:24.150573+0000","last_active":"2023-07-20T10:05:26.508268+0000","last_peered":"2023-07-20T10:05:26.508268+0000","last_clean":"2023-07-20T10:05:26.508268+0000","last_became_active":"2023-07-20T10:05:24.150220+0000","last_became_peered":"2023-07-20T10:05:24.150220+0000","last_unstale":"2023-07-20T10:05:26.508268+0000","last_undegraded":"2023-07-20T10:05:26.508268+0000","last_fullsized":"2023-07-20T10:05:26.508268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:56.320012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511506+0000","last_change":"2023-07-20T10:05:25.171923+0000","last_active":"2023-07-20T10:05:26.511506+0000","last_peered":"2023-07-20T10:05:26.511506+0000","last_clean":"2023-07-20T10:05:26.511506+0000","last_became_active":"2023-07-20T10:05:25.171618+0000","last_became_peered":"2023-07-20T10:05:25.171618+0000","last_unstale":"2023-07-20T10:05:26.511506+0000","last_undegraded":"2023-07-20T10:05:26.511506+0000","last_fullsized":"2023-07-20T10:05:26.511506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:33.541152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508246+0000","last_change":"2023-07-20T10:05:24.154034+0000","last_active":"2023-07-20T10:05:26.508246+0000","last_peered":"2023-07-20T10:05:26.508246+0000","last_clean":"2023-07-20T10:05:26.508246+0000","last_became_active":"2023-07-20T10:05:24.153743+0000","last_became_peered":"2023-07-20T10:05:24.153743+0000","last_unstale":"2023-07-20T10:05:26.508246+0000","last_undegraded":"2023-07-20T10:05:26.508246+0000","last_fullsized":"2023-07-20T10:05:26.508246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:25.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139800+0000","last_change":"2023-07-20T10:05:25.163136+0000","last_active":"2023-07-20T10:05:26.139800+0000","last_peered":"2023-07-20T10:05:26.139800+0000","last_clean":"2023-07-20T10:05:26.139800+0000","last_became_active":"2023-07-20T10:05:25.162812+0000","last_became_peered":"2023-07-20T10:05:25.162812+0000","last_unstale":"2023-07-20T10:05:26.139800+0000","last_undegraded":"2023-07-20T10:05:26.139800+0000","last_fullsized":"2023-07-20T10:05:26.139800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:14.422676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508221+0000","last_change":"2023-07-20T10:05:24.152571+0000","last_active":"2023-07-20T10:05:26.508221+0000","last_peered":"2023-07-20T10:05:26.508221+0000","last_clean":"2023-07-20T10:05:26.508221+0000","last_became_active":"2023-07-20T10:05:24.152144+0000","last_became_peered":"2023-07-20T10:05:24.152144+0000","last_unstale":"2023-07-20T10:05:26.508221+0000","last_undegraded":"2023-07-20T10:05:26.508221+0000","last_fullsized":"2023-07-20T10:05:26.508221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:08.623044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508612+0000","last_change":"2023-07-20T10:05:25.175432+0000","last_active":"2023-07-20T10:05:26.508612+0000","last_peered":"2023-07-20T10:05:26.508612+0000","last_clean":"2023-07-20T10:05:26.508612+0000","last_became_active":"2023-07-20T10:05:25.175122+0000","last_became_peered":"2023-07-20T10:05:25.175122+0000","last_unstale":"2023-07-20T10:05:26.508612+0000","last_undegraded":"2023-07-20T10:05:26.508612+0000","last_fullsized":"2023-07-20T10:05:26.508612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:44.425488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507745+0000","last_change":"2023-07-20T10:05:24.149442+0000","last_active":"2023-07-20T10:05:26.507745+0000","last_peered":"2023-07-20T10:05:26.507745+0000","last_clean":"2023-07-20T10:05:26.507745+0000","last_became_active":"2023-07-20T10:05:24.149136+0000","last_became_peered":"2023-07-20T10:05:24.149136+0000","last_unstale":"2023-07-20T10:05:26.507745+0000","last_undegraded":"2023-07-20T10:05:26.507745+0000","last_fullsized":"2023-07-20T10:05:26.507745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:48:49.791065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510957+0000","last_change":"2023-07-20T10:05:25.166395+0000","last_active":"2023-07-20T10:05:26.510957+0000","last_peered":"2023-07-20T10:05:26.510957+0000","last_clean":"2023-07-20T10:05:26.510957+0000","last_became_active":"2023-07-20T10:05:25.165907+0000","last_became_peered":"2023-07-20T10:05:25.165907+0000","last_unstale":"2023-07-20T10:05:26.510957+0000","last_undegraded":"2023-07-20T10:05:26.510957+0000","last_fullsized":"2023-07-20T10:05:26.510957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:52:33.976795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508049+0000","last_change":"2023-07-20T10:05:24.158619+0000","last_active":"2023-07-20T10:05:26.508049+0000","last_peered":"2023-07-20T10:05:26.508049+0000","last_clean":"2023-07-20T10:05:26.508049+0000","last_became_active":"2023-07-20T10:05:24.158335+0000","last_became_peered":"2023-07-20T10:05:24.158335+0000","last_unstale":"2023-07-20T10:05:26.508049+0000","last_undegraded":"2023-07-20T10:05:26.508049+0000","last_fullsized":"2023-07-20T10:05:26.508049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:25.006101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508127+0000","last_change":"2023-07-20T10:05:25.164421+0000","last_active":"2023-07-20T10:05:26.508127+0000","last_peered":"2023-07-20T10:05:26.508127+0000","last_clean":"2023-07-20T10:05:26.508127+0000","last_became_active":"2023-07-20T10:05:25.164091+0000","last_became_peered":"2023-07-20T10:05:25.164091+0000","last_unstale":"2023-07-20T10:05:26.508127+0000","last_undegraded":"2023-07-20T10:05:26.508127+0000","last_fullsized":"2023-07-20T10:05:26.508127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:12:09.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511743+0000","last_change":"2023-07-20T10:05:24.167186+0000","last_active":"2023-07-20T10:05:26.511743+0000","last_peered":"2023-07-20T10:05:26.511743+0000","last_clean":"2023-07-20T10:05:26.511743+0000","last_became_active":"2023-07-20T10:05:24.166879+0000","last_became_peered":"2023-07-20T10:05:24.166879+0000","last_unstale":"2023-07-20T10:05:26.511743+0000","last_undegraded":"2023-07-20T10:05:26.511743+0000","last_fullsized":"2023-07-20T10:05:26.511743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:24:25.696899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508707+0000","last_change":"2023-07-20T10:05:25.162187+0000","last_active":"2023-07-20T10:05:26.508707+0000","last_peered":"2023-07-20T10:05:26.508707+0000","last_clean":"2023-07-20T10:05:26.508707+0000","last_became_active":"2023-07-20T10:05:25.161923+0000","last_became_peered":"2023-07-20T10:05:25.161923+0000","last_unstale":"2023-07-20T10:05:26.508707+0000","last_undegraded":"2023-07-20T10:05:26.508707+0000","last_fullsized":"2023-07-20T10:05:26.508707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:45.445957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511801+0000","last_change":"2023-07-20T10:05:24.167285+0000","last_active":"2023-07-20T10:05:26.511801+0000","last_peered":"2023-07-20T10:05:26.511801+0000","last_clean":"2023-07-20T10:05:26.511801+0000","last_became_active":"2023-07-20T10:05:24.167014+0000","last_became_peered":"2023-07-20T10:05:24.167014+0000","last_unstale":"2023-07-20T10:05:26.511801+0000","last_undegraded":"2023-07-20T10:05:26.511801+0000","last_fullsized":"2023-07-20T10:05:26.511801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:08.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507935+0000","last_change":"2023-07-20T10:05:25.158432+0000","last_active":"2023-07-20T10:05:26.507935+0000","last_peered":"2023-07-20T10:05:26.507935+0000","last_clean":"2023-07-20T10:05:26.507935+0000","last_became_active":"2023-07-20T10:05:25.158153+0000","last_became_peered":"2023-07-20T10:05:25.158153+0000","last_unstale":"2023-07-20T10:05:26.507935+0000","last_undegraded":"2023-07-20T10:05:26.507935+0000","last_fullsized":"2023-07-20T10:05:26.507935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:58.930312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145590+0000","last_change":"2023-07-20T10:05:24.156683+0000","last_active":"2023-07-20T10:05:26.145590+0000","last_peered":"2023-07-20T10:05:26.145590+0000","last_clean":"2023-07-20T10:05:26.145590+0000","last_became_active":"2023-07-20T10:05:24.156397+0000","last_became_peered":"2023-07-20T10:05:24.156397+0000","last_unstale":"2023-07-20T10:05:26.145590+0000","last_undegraded":"2023-07-20T10:05:26.145590+0000","last_fullsized":"2023-07-20T10:05:26.145590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:49.086061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510976+0000","last_change":"2023-07-20T10:05:25.177366+0000","last_active":"2023-07-20T10:05:26.510976+0000","last_peered":"2023-07-20T10:05:26.510976+0000","last_clean":"2023-07-20T10:05:26.510976+0000","last_became_active":"2023-07-20T10:05:25.177038+0000","last_became_peered":"2023-07-20T10:05:25.177038+0000","last_unstale":"2023-07-20T10:05:26.510976+0000","last_undegraded":"2023-07-20T10:05:26.510976+0000","last_fullsized":"2023-07-20T10:05:26.510976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:45:09.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"80'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511735+0000","last_change":"2023-07-20T10:05:24.166812+0000","last_active":"2023-07-20T10:05:26.511735+0000","last_peered":"2023-07-20T10:05:26.511735+0000","last_clean":"2023-07-20T10:05:26.511735+0000","last_became_active":"2023-07-20T10:05:24.165303+0000","last_became_peered":"2023-07-20T10:05:24.165303+0000","last_unstale":"2023-07-20T10:05:26.511735+0000","last_undegraded":"2023-07-20T10:05:26.511735+0000","last_fullsized":"2023-07-20T10:05:26.511735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:18:28.280910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145722+0000","last_change":"2023-07-20T10:05:25.154538+0000","last_active":"2023-07-20T10:05:26.145722+0000","last_peered":"2023-07-20T10:05:26.145722+0000","last_clean":"2023-07-20T10:05:26.145722+0000","last_became_active":"2023-07-20T10:05:25.154251+0000","last_became_peered":"2023-07-20T10:05:25.154251+0000","last_unstale":"2023-07-20T10:05:26.145722+0000","last_undegraded":"2023-07-20T10:05:26.145722+0000","last_fullsized":"2023-07-20T10:05:26.145722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:01:08.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"80'6","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508794+0000","last_change":"2023-07-20T10:05:24.159710+0000","last_active":"2023-07-20T10:05:26.508794+0000","last_peered":"2023-07-20T10:05:26.508794+0000","last_clean":"2023-07-20T10:05:26.508794+0000","last_became_active":"2023-07-20T10:05:24.159412+0000","last_became_peered":"2023-07-20T10:05:24.159412+0000","last_unstale":"2023-07-20T10:05:26.508794+0000","last_undegraded":"2023-07-20T10:05:26.508794+0000","last_fullsized":"2023-07-20T10:05:26.508794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:41.428140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144385+0000","last_change":"2023-07-20T10:05:25.168606+0000","last_active":"2023-07-20T10:05:26.144385+0000","last_peered":"2023-07-20T10:05:26.144385+0000","last_clean":"2023-07-20T10:05:26.144385+0000","last_became_active":"2023-07-20T10:05:25.168280+0000","last_became_peered":"2023-07-20T10:05:25.168280+0000","last_unstale":"2023-07-20T10:05:26.144385+0000","last_undegraded":"2023-07-20T10:05:26.144385+0000","last_fullsized":"2023-07-20T10:05:26.144385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:48:37.830201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511333+0000","last_change":"2023-07-20T10:05:24.166452+0000","last_active":"2023-07-20T10:05:26.511333+0000","last_peered":"2023-07-20T10:05:26.511333+0000","last_clean":"2023-07-20T10:05:26.511333+0000","last_became_active":"2023-07-20T10:05:24.165469+0000","last_became_peered":"2023-07-20T10:05:24.165469+0000","last_unstale":"2023-07-20T10:05:26.511333+0000","last_undegraded":"2023-07-20T10:05:26.511333+0000","last_fullsized":"2023-07-20T10:05:26.511333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:21.427201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144223+0000","last_change":"2023-07-20T10:05:25.163826+0000","last_active":"2023-07-20T10:05:26.144223+0000","last_peered":"2023-07-20T10:05:26.144223+0000","last_clean":"2023-07-20T10:05:26.144223+0000","last_became_active":"2023-07-20T10:05:25.163512+0000","last_became_peered":"2023-07-20T10:05:25.163512+0000","last_unstale":"2023-07-20T10:05:26.144223+0000","last_undegraded":"2023-07-20T10:05:26.144223+0000","last_fullsized":"2023-07-20T10:05:26.144223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:00.546059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144516+0000","last_change":"2023-07-20T10:05:24.156935+0000","last_active":"2023-07-20T10:05:26.144516+0000","last_peered":"2023-07-20T10:05:26.144516+0000","last_clean":"2023-07-20T10:05:26.144516+0000","last_became_active":"2023-07-20T10:05:24.156430+0000","last_became_peered":"2023-07-20T10:05:24.156430+0000","last_unstale":"2023-07-20T10:05:26.144516+0000","last_undegraded":"2023-07-20T10:05:26.144516+0000","last_fullsized":"2023-07-20T10:05:26.144516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:59:44.025142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511123+0000","last_change":"2023-07-20T10:05:25.166205+0000","last_active":"2023-07-20T10:05:26.511123+0000","last_peered":"2023-07-20T10:05:26.511123+0000","last_clean":"2023-07-20T10:05:26.511123+0000","last_became_active":"2023-07-20T10:05:25.165629+0000","last_became_peered":"2023-07-20T10:05:25.165629+0000","last_unstale":"2023-07-20T10:05:26.511123+0000","last_undegraded":"2023-07-20T10:05:26.511123+0000","last_fullsized":"2023-07-20T10:05:26.511123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:33.869898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511450+0000","last_change":"2023-07-20T10:05:24.165512+0000","last_active":"2023-07-20T10:05:26.511450+0000","last_peered":"2023-07-20T10:05:26.511450+0000","last_clean":"2023-07-20T10:05:26.511450+0000","last_became_active":"2023-07-20T10:05:24.165208+0000","last_became_peered":"2023-07-20T10:05:24.165208+0000","last_unstale":"2023-07-20T10:05:26.511450+0000","last_undegraded":"2023-07-20T10:05:26.511450+0000","last_fullsized":"2023-07-20T10:05:26.511450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:37.770756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508266+0000","last_change":"2023-07-20T10:05:25.171919+0000","last_active":"2023-07-20T10:05:26.508266+0000","last_peered":"2023-07-20T10:05:26.508266+0000","last_clean":"2023-07-20T10:05:26.508266+0000","last_became_active":"2023-07-20T10:05:25.171647+0000","last_became_peered":"2023-07-20T10:05:25.171647+0000","last_unstale":"2023-07-20T10:05:26.508266+0000","last_undegraded":"2023-07-20T10:05:26.508266+0000","last_fullsized":"2023-07-20T10:05:26.508266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:23:28.272687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144485+0000","last_change":"2023-07-20T10:05:24.162258+0000","last_active":"2023-07-20T10:05:26.144485+0000","last_peered":"2023-07-20T10:05:26.144485+0000","last_clean":"2023-07-20T10:05:26.144485+0000","last_became_active":"2023-07-20T10:05:24.161908+0000","last_became_peered":"2023-07-20T10:05:24.161908+0000","last_unstale":"2023-07-20T10:05:26.144485+0000","last_undegraded":"2023-07-20T10:05:26.144485+0000","last_fullsized":"2023-07-20T10:05:26.144485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:34.774627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508157+0000","last_change":"2023-07-20T10:05:25.175449+0000","last_active":"2023-07-20T10:05:26.508157+0000","last_peered":"2023-07-20T10:05:26.508157+0000","last_clean":"2023-07-20T10:05:26.508157+0000","last_became_active":"2023-07-20T10:05:25.175144+0000","last_became_peered":"2023-07-20T10:05:25.175144+0000","last_unstale":"2023-07-20T10:05:26.508157+0000","last_undegraded":"2023-07-20T10:05:26.508157+0000","last_fullsized":"2023-07-20T10:05:26.508157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:23:28.272687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145289+0000","last_change":"2023-07-20T10:05:24.158981+0000","last_active":"2023-07-20T10:05:26.145289+0000","last_peered":"2023-07-20T10:05:26.145289+0000","last_clean":"2023-07-20T10:05:26.145289+0000","last_became_active":"2023-07-20T10:05:24.158668+0000","last_became_peered":"2023-07-20T10:05:24.158668+0000","last_unstale":"2023-07-20T10:05:26.145289+0000","last_undegraded":"2023-07-20T10:05:26.145289+0000","last_fullsized":"2023-07-20T10:05:26.145289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:41:33.391256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139948+0000","last_change":"2023-07-20T10:05:25.160748+0000","last_active":"2023-07-20T10:05:26.139948+0000","last_peered":"2023-07-20T10:05:26.139948+0000","last_clean":"2023-07-20T10:05:26.139948+0000","last_became_active":"2023-07-20T10:05:25.160504+0000","last_became_peered":"2023-07-20T10:05:25.160504+0000","last_unstale":"2023-07-20T10:05:26.139948+0000","last_undegraded":"2023-07-20T10:05:26.139948+0000","last_fullsized":"2023-07-20T10:05:26.139948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:03:33.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145064+0000","last_change":"2023-07-20T10:05:24.152874+0000","last_active":"2023-07-20T10:05:26.145064+0000","last_peered":"2023-07-20T10:05:26.145064+0000","last_clean":"2023-07-20T10:05:26.145064+0000","last_became_active":"2023-07-20T10:05:24.152597+0000","last_became_peered":"2023-07-20T10:05:24.152597+0000","last_unstale":"2023-07-20T10:05:26.145064+0000","last_undegraded":"2023-07-20T10:05:26.145064+0000","last_fullsized":"2023-07-20T10:05:26.145064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:05.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144489+0000","last_change":"2023-07-20T10:05:25.167702+0000","last_active":"2023-07-20T10:05:26.144489+0000","last_peered":"2023-07-20T10:05:26.144489+0000","last_clean":"2023-07-20T10:05:26.144489+0000","last_became_active":"2023-07-20T10:05:25.167409+0000","last_became_peered":"2023-07-20T10:05:25.167409+0000","last_unstale":"2023-07-20T10:05:26.144489+0000","last_undegraded":"2023-07-20T10:05:26.144489+0000","last_fullsized":"2023-07-20T10:05:26.144489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:52:50.863636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508149+0000","last_change":"2023-07-20T10:05:24.150525+0000","last_active":"2023-07-20T10:05:26.508149+0000","last_peered":"2023-07-20T10:05:26.508149+0000","last_clean":"2023-07-20T10:05:26.508149+0000","last_became_active":"2023-07-20T10:05:24.150231+0000","last_became_peered":"2023-07-20T10:05:24.150231+0000","last_unstale":"2023-07-20T10:05:26.508149+0000","last_undegraded":"2023-07-20T10:05:26.508149+0000","last_fullsized":"2023-07-20T10:05:26.508149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:07:39.324913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511589+0000","last_change":"2023-07-20T10:05:25.166709+0000","last_active":"2023-07-20T10:05:26.511589+0000","last_peered":"2023-07-20T10:05:26.511589+0000","last_clean":"2023-07-20T10:05:26.511589+0000","last_became_active":"2023-07-20T10:05:25.164336+0000","last_became_peered":"2023-07-20T10:05:25.164336+0000","last_unstale":"2023-07-20T10:05:26.511589+0000","last_undegraded":"2023-07-20T10:05:26.511589+0000","last_fullsized":"2023-07-20T10:05:26.511589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:47:54.823464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509018+0000","last_change":"2023-07-20T10:05:24.154244+0000","last_active":"2023-07-20T10:05:26.509018+0000","last_peered":"2023-07-20T10:05:26.509018+0000","last_clean":"2023-07-20T10:05:26.509018+0000","last_became_active":"2023-07-20T10:05:24.153930+0000","last_became_peered":"2023-07-20T10:05:24.153930+0000","last_unstale":"2023-07-20T10:05:26.509018+0000","last_undegraded":"2023-07-20T10:05:26.509018+0000","last_fullsized":"2023-07-20T10:05:26.509018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:09:23.080452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510777+0000","last_change":"2023-07-20T10:05:25.169068+0000","last_active":"2023-07-20T10:05:26.510777+0000","last_peered":"2023-07-20T10:05:26.510777+0000","last_clean":"2023-07-20T10:05:26.510777+0000","last_became_active":"2023-07-20T10:05:25.168798+0000","last_became_peered":"2023-07-20T10:05:25.168798+0000","last_unstale":"2023-07-20T10:05:26.510777+0000","last_undegraded":"2023-07-20T10:05:26.510777+0000","last_fullsized":"2023-07-20T10:05:26.510777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:34:24.040739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511384+0000","last_change":"2023-07-20T10:05:24.164942+0000","last_active":"2023-07-20T10:05:26.511384+0000","last_peered":"2023-07-20T10:05:26.511384+0000","last_clean":"2023-07-20T10:05:26.511384+0000","last_became_active":"2023-07-20T10:05:24.164640+0000","last_became_peered":"2023-07-20T10:05:24.164640+0000","last_unstale":"2023-07-20T10:05:26.511384+0000","last_undegraded":"2023-07-20T10:05:26.511384+0000","last_fullsized":"2023-07-20T10:05:26.511384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:44:35.962027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144880+0000","last_change":"2023-07-20T10:05:25.165672+0000","last_active":"2023-07-20T10:05:26.144880+0000","last_peered":"2023-07-20T10:05:26.144880+0000","last_clean":"2023-07-20T10:05:26.144880+0000","last_became_active":"2023-07-20T10:05:25.165397+0000","last_became_peered":"2023-07-20T10:05:25.165397+0000","last_unstale":"2023-07-20T10:05:26.144880+0000","last_undegraded":"2023-07-20T10:05:26.144880+0000","last_fullsized":"2023-07-20T10:05:26.144880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:38.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507874+0000","last_change":"2023-07-20T10:05:24.151619+0000","last_active":"2023-07-20T10:05:26.507874+0000","last_peered":"2023-07-20T10:05:26.507874+0000","last_clean":"2023-07-20T10:05:26.507874+0000","last_became_active":"2023-07-20T10:05:24.151301+0000","last_became_peered":"2023-07-20T10:05:24.151301+0000","last_unstale":"2023-07-20T10:05:26.507874+0000","last_undegraded":"2023-07-20T10:05:26.507874+0000","last_fullsized":"2023-07-20T10:05:26.507874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:47:14.011256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508481+0000","last_change":"2023-07-20T10:05:25.173195+0000","last_active":"2023-07-20T10:05:26.508481+0000","last_peered":"2023-07-20T10:05:26.508481+0000","last_clean":"2023-07-20T10:05:26.508481+0000","last_became_active":"2023-07-20T10:05:25.172912+0000","last_became_peered":"2023-07-20T10:05:25.172912+0000","last_unstale":"2023-07-20T10:05:26.508481+0000","last_undegraded":"2023-07-20T10:05:26.508481+0000","last_fullsized":"2023-07-20T10:05:26.508481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:26.725043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507935+0000","last_change":"2023-07-20T10:05:24.158698+0000","last_active":"2023-07-20T10:05:26.507935+0000","last_peered":"2023-07-20T10:05:26.507935+0000","last_clean":"2023-07-20T10:05:26.507935+0000","last_became_active":"2023-07-20T10:05:24.158403+0000","last_became_peered":"2023-07-20T10:05:24.158403+0000","last_unstale":"2023-07-20T10:05:26.507935+0000","last_undegraded":"2023-07-20T10:05:26.507935+0000","last_fullsized":"2023-07-20T10:05:26.507935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:26:16.418217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139924+0000","last_change":"2023-07-20T10:05:25.168201+0000","last_active":"2023-07-20T10:05:26.139924+0000","last_peered":"2023-07-20T10:05:26.139924+0000","last_clean":"2023-07-20T10:05:26.139924+0000","last_became_active":"2023-07-20T10:05:25.167793+0000","last_became_peered":"2023-07-20T10:05:25.167793+0000","last_unstale":"2023-07-20T10:05:26.139924+0000","last_undegraded":"2023-07-20T10:05:26.139924+0000","last_fullsized":"2023-07-20T10:05:26.139924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:59:26.385810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508699+0000","last_change":"2023-07-20T10:05:24.160168+0000","last_active":"2023-07-20T10:05:26.508699+0000","last_peered":"2023-07-20T10:05:26.508699+0000","last_clean":"2023-07-20T10:05:26.508699+0000","last_became_active":"2023-07-20T10:05:24.159934+0000","last_became_peered":"2023-07-20T10:05:24.159934+0000","last_unstale":"2023-07-20T10:05:26.508699+0000","last_undegraded":"2023-07-20T10:05:26.508699+0000","last_fullsized":"2023-07-20T10:05:26.508699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:58.603174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511564+0000","last_change":"2023-07-20T10:05:25.173319+0000","last_active":"2023-07-20T10:05:26.511564+0000","last_peered":"2023-07-20T10:05:26.511564+0000","last_clean":"2023-07-20T10:05:26.511564+0000","last_became_active":"2023-07-20T10:05:25.172802+0000","last_became_peered":"2023-07-20T10:05:25.172802+0000","last_unstale":"2023-07-20T10:05:26.511564+0000","last_undegraded":"2023-07-20T10:05:26.511564+0000","last_fullsized":"2023-07-20T10:05:26.511564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:44.582912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507766+0000","last_change":"2023-07-20T10:05:24.152405+0000","last_active":"2023-07-20T10:05:26.507766+0000","last_peered":"2023-07-20T10:05:26.507766+0000","last_clean":"2023-07-20T10:05:26.507766+0000","last_became_active":"2023-07-20T10:05:24.152098+0000","last_became_peered":"2023-07-20T10:05:24.152098+0000","last_unstale":"2023-07-20T10:05:26.507766+0000","last_undegraded":"2023-07-20T10:05:26.507766+0000","last_fullsized":"2023-07-20T10:05:26.507766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:51:51.737021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510901+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:05:26.510901+0000","last_peered":"2023-07-20T10:05:26.510901+0000","last_clean":"2023-07-20T10:05:26.510901+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:05:26.510901+0000","last_undegraded":"2023-07-20T10:05:26.510901+0000","last_fullsized":"2023-07-20T10:05:26.510901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:31:44.625112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144786+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:05:26.144786+0000","last_peered":"2023-07-20T10:05:26.144786+0000","last_clean":"2023-07-20T10:05:26.144786+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:05:26.144786+0000","last_undegraded":"2023-07-20T10:05:26.144786+0000","last_fullsized":"2023-07-20T10:05:26.144786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:22:30.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507488+0000","last_change":"2023-07-20T10:05:25.162532+0000","last_active":"2023-07-20T10:05:26.507488+0000","last_peered":"2023-07-20T10:05:26.507488+0000","last_clean":"2023-07-20T10:05:26.507488+0000","last_became_active":"2023-07-20T10:05:25.162060+0000","last_became_peered":"2023-07-20T10:05:25.162060+0000","last_unstale":"2023-07-20T10:05:26.507488+0000","last_undegraded":"2023-07-20T10:05:26.507488+0000","last_fullsized":"2023-07-20T10:05:26.507488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:40.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507879+0000","last_change":"2023-07-20T10:05:24.158855+0000","last_active":"2023-07-20T10:05:26.507879+0000","last_peered":"2023-07-20T10:05:26.507879+0000","last_clean":"2023-07-20T10:05:26.507879+0000","last_became_active":"2023-07-20T10:05:24.158565+0000","last_became_peered":"2023-07-20T10:05:24.158565+0000","last_unstale":"2023-07-20T10:05:26.507879+0000","last_undegraded":"2023-07-20T10:05:26.507879+0000","last_fullsized":"2023-07-20T10:05:26.507879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:41.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510757+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:05:26.510757+0000","last_peered":"2023-07-20T10:05:26.510757+0000","last_clean":"2023-07-20T10:05:26.510757+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:05:26.510757+0000","last_undegraded":"2023-07-20T10:05:26.510757+0000","last_fullsized":"2023-07-20T10:05:26.510757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:02.012790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144264+0000","last_change":"2023-07-20T10:05:25.156401+0000","last_active":"2023-07-20T10:05:26.144264+0000","last_peered":"2023-07-20T10:05:26.144264+0000","last_clean":"2023-07-20T10:05:26.144264+0000","last_became_active":"2023-07-20T10:05:25.156088+0000","last_became_peered":"2023-07-20T10:05:25.156088+0000","last_unstale":"2023-07-20T10:05:26.144264+0000","last_undegraded":"2023-07-20T10:05:26.144264+0000","last_fullsized":"2023-07-20T10:05:26.144264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:39:27.609716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144633+0000","last_change":"2023-07-20T10:05:24.156721+0000","last_active":"2023-07-20T10:05:26.144633+0000","last_peered":"2023-07-20T10:05:26.144633+0000","last_clean":"2023-07-20T10:05:26.144633+0000","last_became_active":"2023-07-20T10:05:24.155981+0000","last_became_peered":"2023-07-20T10:05:24.155981+0000","last_unstale":"2023-07-20T10:05:26.144633+0000","last_undegraded":"2023-07-20T10:05:26.144633+0000","last_fullsized":"2023-07-20T10:05:26.144633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:01.847548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139832+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:05:26.139832+0000","last_peered":"2023-07-20T10:05:26.139832+0000","last_clean":"2023-07-20T10:05:26.139832+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:05:26.139832+0000","last_undegraded":"2023-07-20T10:05:26.139832+0000","last_fullsized":"2023-07-20T10:05:26.139832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:13.838690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511264+0000","last_change":"2023-07-20T10:05:25.165420+0000","last_active":"2023-07-20T10:05:26.511264+0000","last_peered":"2023-07-20T10:05:26.511264+0000","last_clean":"2023-07-20T10:05:26.511264+0000","last_became_active":"2023-07-20T10:05:25.165117+0000","last_became_peered":"2023-07-20T10:05:25.165117+0000","last_unstale":"2023-07-20T10:05:26.511264+0000","last_undegraded":"2023-07-20T10:05:26.511264+0000","last_fullsized":"2023-07-20T10:05:26.511264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:34:48.857984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507662+0000","last_change":"2023-07-20T10:05:24.156222+0000","last_active":"2023-07-20T10:05:26.507662+0000","last_peered":"2023-07-20T10:05:26.507662+0000","last_clean":"2023-07-20T10:05:26.507662+0000","last_became_active":"2023-07-20T10:05:24.155675+0000","last_became_peered":"2023-07-20T10:05:24.155675+0000","last_unstale":"2023-07-20T10:05:26.507662+0000","last_undegraded":"2023-07-20T10:05:26.507662+0000","last_fullsized":"2023-07-20T10:05:26.507662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:46:52.348225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144916+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:05:26.144916+0000","last_peered":"2023-07-20T10:05:26.144916+0000","last_clean":"2023-07-20T10:05:26.144916+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:05:26.144916+0000","last_undegraded":"2023-07-20T10:05:26.144916+0000","last_fullsized":"2023-07-20T10:05:26.144916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:49:14.927141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511236+0000","last_change":"2023-07-20T10:05:25.179932+0000","last_active":"2023-07-20T10:05:26.511236+0000","last_peered":"2023-07-20T10:05:26.511236+0000","last_clean":"2023-07-20T10:05:26.511236+0000","last_became_active":"2023-07-20T10:05:25.178433+0000","last_became_peered":"2023-07-20T10:05:25.178433+0000","last_unstale":"2023-07-20T10:05:26.511236+0000","last_undegraded":"2023-07-20T10:05:26.511236+0000","last_fullsized":"2023-07-20T10:05:26.511236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:34.793996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145385+0000","last_change":"2023-07-20T10:05:24.155864+0000","last_active":"2023-07-20T10:05:26.145385+0000","last_peered":"2023-07-20T10:05:26.145385+0000","last_clean":"2023-07-20T10:05:26.145385+0000","last_became_active":"2023-07-20T10:05:24.155545+0000","last_became_peered":"2023-07-20T10:05:24.155545+0000","last_unstale":"2023-07-20T10:05:26.145385+0000","last_undegraded":"2023-07-20T10:05:26.145385+0000","last_fullsized":"2023-07-20T10:05:26.145385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:37:24.662288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508915+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:05:26.508915+0000","last_peered":"2023-07-20T10:05:26.508915+0000","last_clean":"2023-07-20T10:05:26.508915+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:05:26.508915+0000","last_undegraded":"2023-07-20T10:05:26.508915+0000","last_fullsized":"2023-07-20T10:05:26.508915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:11:39.281328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511923+0000","last_change":"2023-07-20T10:05:25.168757+0000","last_active":"2023-07-20T10:05:26.511923+0000","last_peered":"2023-07-20T10:05:26.511923+0000","last_clean":"2023-07-20T10:05:26.511923+0000","last_became_active":"2023-07-20T10:05:25.168474+0000","last_became_peered":"2023-07-20T10:05:25.168474+0000","last_unstale":"2023-07-20T10:05:26.511923+0000","last_undegraded":"2023-07-20T10:05:26.511923+0000","last_fullsized":"2023-07-20T10:05:26.511923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:35.786951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511638+0000","last_change":"2023-07-20T10:05:24.166934+0000","last_active":"2023-07-20T10:05:26.511638+0000","last_peered":"2023-07-20T10:05:26.511638+0000","last_clean":"2023-07-20T10:05:26.511638+0000","last_became_active":"2023-07-20T10:05:24.166582+0000","last_became_peered":"2023-07-20T10:05:24.166582+0000","last_unstale":"2023-07-20T10:05:26.511638+0000","last_undegraded":"2023-07-20T10:05:26.511638+0000","last_fullsized":"2023-07-20T10:05:26.511638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:54:21.886310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511982+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:05:26.511982+0000","last_peered":"2023-07-20T10:05:26.511982+0000","last_clean":"2023-07-20T10:05:26.511982+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:05:26.511982+0000","last_undegraded":"2023-07-20T10:05:26.511982+0000","last_fullsized":"2023-07-20T10:05:26.511982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:33:59.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145493+0000","last_change":"2023-07-20T10:05:25.168497+0000","last_active":"2023-07-20T10:05:26.145493+0000","last_peered":"2023-07-20T10:05:26.145493+0000","last_clean":"2023-07-20T10:05:26.145493+0000","last_became_active":"2023-07-20T10:05:25.168216+0000","last_became_peered":"2023-07-20T10:05:25.168216+0000","last_unstale":"2023-07-20T10:05:26.145493+0000","last_undegraded":"2023-07-20T10:05:26.145493+0000","last_fullsized":"2023-07-20T10:05:26.145493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:46:42.376013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511879+0000","last_change":"2023-07-20T10:05:24.166292+0000","last_active":"2023-07-20T10:05:26.511879+0000","last_peered":"2023-07-20T10:05:26.511879+0000","last_clean":"2023-07-20T10:05:26.511879+0000","last_became_active":"2023-07-20T10:05:24.165945+0000","last_became_peered":"2023-07-20T10:05:24.165945+0000","last_unstale":"2023-07-20T10:05:26.511879+0000","last_undegraded":"2023-07-20T10:05:26.511879+0000","last_fullsized":"2023-07-20T10:05:26.511879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:12:49.193144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508606+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:05:26.508606+0000","last_peered":"2023-07-20T10:05:26.508606+0000","last_clean":"2023-07-20T10:05:26.508606+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:05:26.508606+0000","last_undegraded":"2023-07-20T10:05:26.508606+0000","last_fullsized":"2023-07-20T10:05:26.508606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:45.261890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511754+0000","last_change":"2023-07-20T10:05:25.167471+0000","last_active":"2023-07-20T10:05:26.511754+0000","last_peered":"2023-07-20T10:05:26.511754+0000","last_clean":"2023-07-20T10:05:26.511754+0000","last_became_active":"2023-07-20T10:05:25.164630+0000","last_became_peered":"2023-07-20T10:05:25.164630+0000","last_unstale":"2023-07-20T10:05:26.511754+0000","last_undegraded":"2023-07-20T10:05:26.511754+0000","last_fullsized":"2023-07-20T10:05:26.511754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:27.284730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507910+0000","last_change":"2023-07-20T10:05:24.153976+0000","last_active":"2023-07-20T10:05:26.507910+0000","last_peered":"2023-07-20T10:05:26.507910+0000","last_clean":"2023-07-20T10:05:26.507910+0000","last_became_active":"2023-07-20T10:05:24.153669+0000","last_became_peered":"2023-07-20T10:05:24.153669+0000","last_unstale":"2023-07-20T10:05:26.507910+0000","last_undegraded":"2023-07-20T10:05:26.507910+0000","last_fullsized":"2023-07-20T10:05:26.507910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:09:27.688663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511886+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:05:26.511886+0000","last_peered":"2023-07-20T10:05:26.511886+0000","last_clean":"2023-07-20T10:05:26.511886+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:05:26.511886+0000","last_undegraded":"2023-07-20T10:05:26.511886+0000","last_fullsized":"2023-07-20T10:05:26.511886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:34.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575031,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58916,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312924,"statfs":{"total":96636764160,"available":96576434176,"internally_reserved":0,"allocated":1589248,"data_stored":1077840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.64400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":1.008,"15min":1.008},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":1.075,"15min":1.075},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.716,"15min":1.716},"last":0.73399999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.056},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":1.758,"15min":1.758},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79100000000000004,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.55100000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":1.8,"15min":1.8},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":0.999,"15min":0.999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":983040,"data_stored":486730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.77700000000000002},"min":{"1min":0.59699999999999998,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.018,"15min":1.2010000000000001},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93799999999999994,"5min":1.04,"15min":1.1259999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.54700000000000004,"5min":0.41799999999999998,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.94599999999999995,"15min":1.103},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90100000000000002,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.86899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":0.93200000000000005,"5min":1.0489999999999999,"15min":1.25},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.84699999999999998,"5min":0.95299999999999996,"15min":1.272},"last":0.88}]},{"osd":4,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.135}]},{"osd":5,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.79700000000000004,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":1.1160000000000001,"15min":1.155},"last":1.02},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.92100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":983040,"data_stored":486718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.65500000000000003,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.96299999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.55200000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.66300000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.69499999999999995,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.46000000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.081},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.77800000000000002,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.53800000000000003,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.94899999999999995,"15min":1.016},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78100000000000003,"5min":1.024,"15min":1.3080000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0680000000000001,"15min":1.145},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.82699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":991232,"data_stored":488260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.874,"5min":1.0580000000000001,"15min":1.085},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.141},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.22,"15min":1.363},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":1.177,"15min":1.177},"last":0.629},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.3620000000000001},"last":0.79600000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.212},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.93500000000000005,"15min":1.196},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.873,"5min":1.004,"15min":1.4970000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.0209999999999999,"15min":1.538},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0009999999999999,"15min":1.597},"last":0.82099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":978944,"data_stored":486696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.38},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48799999999999999,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.439},{"interface":"front","average":{"1min":0.621,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":1.099},"last":0.501}]},{"osd":4,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.436,"15min":0.436},"max":{"1min":1.083,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.071,"5min":1.381,"15min":1.381},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.52300000000000002,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.64900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.107,"5min":1.274,"15min":1.274},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.502},"max":{"1min":1.008,"5min":1.131,"15min":1.1950000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76500000000000001,"15min":0.79100000000000004},"min":{"1min":0.63600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.77100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54220,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317620,"statfs":{"total":96636764160,"available":96581242880,"internally_reserved":0,"allocated":978944,"data_stored":486696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.436},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.496}]},{"osd":1,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.68899999999999995,"5min":0.83799999999999997,"15min":0.876},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.089,"5min":1.2529999999999999,"15min":1.383},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.61899999999999999,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.877}]},{"osd":6,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1579999999999999,"5min":1.169,"15min":1.51},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1020000000000001,"5min":1.2529999999999999,"15min":1.3240000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.66900000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.5820000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.393},"last":0.93500000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1007616,"data_stored":489024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.89600000000000002},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.44600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.499}]},{"osd":3,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.47499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":1.052},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67700000000000005,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0589999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.1930000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":1.048,"15min":1.117},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.63900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.355},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.63100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.999,"5min":1,"15min":1.1899999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.034,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.1259999999999999,"15min":1.2529999999999999},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1572864,"data_stored":1077064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.45500000000000002},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.432},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58499999999999996,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.64400000000000002,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.495}]},{"osd":2,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.68200000000000005,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.623,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":10.631,"15min":10.631},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.82699999999999996,"15min":0.80000000000000004},"min":{"1min":0.76200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.232,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.81200000000000006},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.495},"max":{"1min":1.1359999999999999,"5min":3.125,"15min":3.125},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91600000000000004,"15min":0.83699999999999997},"min":{"1min":0.70999999999999996,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":1.1479999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.85199999999999998,"15min":0.81000000000000005},"min":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.45700000000000002},"max":{"1min":1.2310000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.81999999999999995},"min":{"1min":0.68999999999999995,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":3.161,"15min":3.161},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89700000000000002,"15min":0.83499999999999996},"min":{"1min":0.70499999999999996,"5min":0.55200000000000005,"15min":0.46600000000000003},"max":{"1min":1.1499999999999999,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.753}]},{"osd":7,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91500000000000004,"15min":0.85299999999999998},"min":{"1min":0.73799999999999999,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":1.278,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.3089999999999999,"5min":1.766,"15min":1.766},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:05:33.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:05:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 Processor -- start 2023-07-20T10:05:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 -- start start 2023-07-20T10:05:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8840d0d10 0x7fc8840d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840d16b0 con 0x7fc88415cab0 2023-07-20T10:05:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8840b3520 con 0x7fc8840cd4b0 2023-07-20T10:05:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc88b567640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8840d31c0 con 0x7fc8840d0d10 2023-07-20T10:05:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889303640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc88415cab0 0x7fc8840d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54078/0 (socket says 172.21.15.82:54078) 2023-07-20T10:05:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889303640 1 -- 172.21.15.82:0/4248174603 learned_addr learned my addr 172.21.15.82:0/4248174603 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109144794 0 0) 0x7fc8840d16b0 con 0x7fc88415cab0 2023-07-20T10:05:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc870003530 con 0x7fc88415cab0 2023-07-20T10:05:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> v2:172.21.15.183:3300/0 conn(0x7fc8840d0d10 0x7fc8840d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480487392 0 0) 0x7fc870003530 con 0x7fc88415cab0 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 >> v2:172.21.15.183:3300/0 conn(0x7fc8840d0d10 msgr2=0x7fc8840d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 --2- 172.21.15.82:0/4248174603 >> v2:172.21.15.183:3300/0 conn(0x7fc8840d0d10 0x7fc8840d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 >> v1:172.21.15.183:6789/0 conn(0x7fc8840cd4b0 legacy=0x7fc8840cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8840d0a10 con 0x7fc88415cab0 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fc880001680 con 0x7fc88415cab0 2023-07-20T10:05:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> v2:172.21.15.183:3300/0 conn(0x7fc8840d0d10 0x7fc8840d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 >> v1:172.21.15.82:6789/0 conn(0x7fc88415cab0 legacy=0x7fc8840d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700039d0 0x7fc870003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 0x7fc870004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8700051e0 0x7fc87000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87000c100 con 0x7fc8700047d0 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87000c270 con 0x7fc8700039d0 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87000c430 con 0x7fc8700051e0 2023-07-20T10:05:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 0x7fc870004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889303640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700039d0 0x7fc870003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889b04640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8700051e0 0x7fc87000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 -- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8700051e0 msgr2=0x7fc87000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8700051e0 0x7fc87000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 -- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700039d0 msgr2=0x7fc870003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700039d0 0x7fc870003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc888b02640 1 -- 172.21.15.82:0/4248174603 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870003530 con 0x7fc8700047d0 2023-07-20T10:05:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889303640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700039d0 0x7fc870003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.915+0000 7fc889b04640 1 -- 172.21.15.82:0/4248174603 reap_dead start 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc888b02640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 0x7fc870004c50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc8740098d0 tx=0x7fc87401c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6dddb5a438b713 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740aa650 con 0x7fc8700047d0 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740aa7b0 con 0x7fc8700047d0 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc87bfff640 1 -- 172.21.15.82:0/4248174603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740aab20 con 0x7fc8700047d0 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 -- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 msgr2=0x7fc870004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 0x7fc870004c50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc8740098d0 tx=0x7fc87401c5b0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 -- 172.21.15.82:0/4248174603 shutdown_connections 2023-07-20T10:05:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 --2- 172.21.15.82:0/4248174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8700047d0 0x7fc870004c50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 -- 172.21.15.82:0/4248174603 >> 172.21.15.82:0/4248174603 conn(0x7fc88408c120 msgr2=0x7fc88409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 -- 172.21.15.82:0/4248174603 shutdown_connections 2023-07-20T10:05:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.919+0000 7fc88b567640 1 -- 172.21.15.82:0/4248174603 wait complete. 2023-07-20T10:05:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 Processor -- start 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- start start 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700047d0 0x7fc8840ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8840c7730 0x7fc8840b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88406c0c0 con 0x7fc88406b700 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840cbc50 con 0x7fc8700047d0 2023-07-20T10:05:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8840b5dd0 con 0x7fc8840c7730 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38304/0 (socket says 172.21.15.82:38304) 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 -- 172.21.15.82:0/1327469345 learned_addr learned my addr 172.21.15.82:0/1327469345 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889303640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700047d0 0x7fc8840ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc888b02640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8840c7730 0x7fc8840b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 -- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8840c7730 msgr2=0x7fc8840b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8840c7730 0x7fc8840b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 -- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700047d0 msgr2=0x7fc8840ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700047d0 0x7fc8840ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 -- 172.21.15.82:0/1327469345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8840b82c0 con 0x7fc88406b700 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc889b04640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc8840d0220 tx=0x7fc87c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00eed0 con 0x7fc88406b700 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c003980 con 0x7fc88406b700 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8840c7cb0 con 0x7fc88406b700 2023-07-20T10:05:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c003d50 con 0x7fc88406b700 2023-07-20T10:05:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.923+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8840c8270 con 0x7fc88406b700 2023-07-20T10:05:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc884073c70 con 0x7fc88406b700 2023-07-20T10:05:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc87c0050d0 con 0x7fc88406b700 2023-07-20T10:05:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc879ffb640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 0x7fc868068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc87c083a90 con 0x7fc88406b700 2023-07-20T10:05:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc889303640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 0x7fc868068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.927+0000 7fc889303640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 0x7fc868068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc880001bd0 tx=0x7fc880004840 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:33.931+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc87c050e10 con 0x7fc88406b700 2023-07-20T10:05:34.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.079+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8840b2bf0 con 0x7fc8680663a0 2023-07-20T10:05:34.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.087+0000 7fc879ffb640 1 -- 172.21.15.82:0/1327469345 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311445 (secure 0 0 0) 0x7fc880014ab0 con 0x7fc8680663a0 2023-07-20T10:05:34.071 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:34.072 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:05:34.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 msgr2=0x7fc868068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 0x7fc868068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc880001bd0 tx=0x7fc880004840 comp rx=0 tx=0).stop 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 msgr2=0x7fc88406bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fc8840d0220 tx=0x7fc87c00eb90 comp rx=0 tx=0).stop 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 shutdown_connections 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fc8680663a0 0x7fc868068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc88406b700 0x7fc88406bb80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8840c7730 0x7fc8840b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 --2- 172.21.15.82:0/1327469345 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8700047d0 0x7fc8840ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 >> 172.21.15.82:0/1327469345 conn(0x7fc88408c120 msgr2=0x7fc8840cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 shutdown_connections 2023-07-20T10:05:34.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.091+0000 7fc88b567640 1 -- 172.21.15.82:0/1327469345 wait complete. 2023-07-20T10:05:34.092 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T10:05:33.954839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":306232,"kb_used_data":8872,"kb_used_omap":13,"kb_used_meta":297202,"kb_avail":754668488,"statfs":{"total":773094113280,"available":772780531712,"internally_reserved":0,"allocated":9084928,"data_stored":5079028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":304334936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.818431"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508993+0000","last_change":"2023-07-20T10:05:25.168147+0000","last_active":"2023-07-20T10:05:26.508993+0000","last_peered":"2023-07-20T10:05:26.508993+0000","last_clean":"2023-07-20T10:05:26.508993+0000","last_became_active":"2023-07-20T10:05:25.167891+0000","last_became_peered":"2023-07-20T10:05:25.167891+0000","last_unstale":"2023-07-20T10:05:26.508993+0000","last_undegraded":"2023-07-20T10:05:26.508993+0000","last_fullsized":"2023-07-20T10:05:26.508993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:53.381975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508461+0000","last_change":"2023-07-20T10:05:25.165649+0000","last_active":"2023-07-20T10:05:26.508461+0000","last_peered":"2023-07-20T10:05:26.508461+0000","last_clean":"2023-07-20T10:05:26.508461+0000","last_became_active":"2023-07-20T10:05:25.164081+0000","last_became_peered":"2023-07-20T10:05:25.164081+0000","last_unstale":"2023-07-20T10:05:26.508461+0000","last_undegraded":"2023-07-20T10:05:26.508461+0000","last_fullsized":"2023-07-20T10:05:26.508461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:07:40.337236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511333+0000","last_change":"2023-07-20T10:05:25.174172+0000","last_active":"2023-07-20T10:05:26.511333+0000","last_peered":"2023-07-20T10:05:26.511333+0000","last_clean":"2023-07-20T10:05:26.511333+0000","last_became_active":"2023-07-20T10:05:25.173885+0000","last_became_peered":"2023-07-20T10:05:25.173885+0000","last_unstale":"2023-07-20T10:05:26.511333+0000","last_undegraded":"2023-07-20T10:05:26.511333+0000","last_fullsized":"2023-07-20T10:05:26.511333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:16.757184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145550+0000","last_change":"2023-07-20T10:05:25.162990+0000","last_active":"2023-07-20T10:05:26.145550+0000","last_peered":"2023-07-20T10:05:26.145550+0000","last_clean":"2023-07-20T10:05:26.145550+0000","last_became_active":"2023-07-20T10:05:25.162627+0000","last_became_peered":"2023-07-20T10:05:25.162627+0000","last_unstale":"2023-07-20T10:05:26.145550+0000","last_undegraded":"2023-07-20T10:05:26.145550+0000","last_fullsized":"2023-07-20T10:05:26.145550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:41.776631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511496+0000","last_change":"2023-07-20T10:05:25.178587+0000","last_active":"2023-07-20T10:05:26.511496+0000","last_peered":"2023-07-20T10:05:26.511496+0000","last_clean":"2023-07-20T10:05:26.511496+0000","last_became_active":"2023-07-20T10:05:25.178251+0000","last_became_peered":"2023-07-20T10:05:25.178251+0000","last_unstale":"2023-07-20T10:05:26.511496+0000","last_undegraded":"2023-07-20T10:05:26.511496+0000","last_fullsized":"2023-07-20T10:05:26.511496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:42:09.269685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507775+0000","last_change":"2023-07-20T10:05:25.172210+0000","last_active":"2023-07-20T10:05:26.507775+0000","last_peered":"2023-07-20T10:05:26.507775+0000","last_clean":"2023-07-20T10:05:26.507775+0000","last_became_active":"2023-07-20T10:05:25.171549+0000","last_became_peered":"2023-07-20T10:05:25.171549+0000","last_unstale":"2023-07-20T10:05:26.507775+0000","last_undegraded":"2023-07-20T10:05:26.507775+0000","last_fullsized":"2023-07-20T10:05:26.507775+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:34:31.021514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139749+0000","last_change":"2023-07-20T10:05:25.162336+0000","last_active":"2023-07-20T10:05:26.139749+0000","last_peered":"2023-07-20T10:05:26.139749+0000","last_clean":"2023-07-20T10:05:26.139749+0000","last_became_active":"2023-07-20T10:05:25.162049+0000","last_became_peered":"2023-07-20T10:05:25.162049+0000","last_unstale":"2023-07-20T10:05:26.139749+0000","last_undegraded":"2023-07-20T10:05:26.139749+0000","last_fullsized":"2023-07-20T10:05:26.139749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:30.857753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144204+0000","last_change":"2023-07-20T10:05:25.171100+0000","last_active":"2023-07-20T10:05:26.144204+0000","last_peered":"2023-07-20T10:05:26.144204+0000","last_clean":"2023-07-20T10:05:26.144204+0000","last_became_active":"2023-07-20T10:05:25.170826+0000","last_became_peered":"2023-07-20T10:05:25.170826+0000","last_unstale":"2023-07-20T10:05:26.144204+0000","last_undegraded":"2023-07-20T10:05:26.144204+0000","last_fullsized":"2023-07-20T10:05:26.144204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:35.226838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511890+0000","last_change":"2023-07-20T10:05:25.179893+0000","last_active":"2023-07-20T10:05:26.511890+0000","last_peered":"2023-07-20T10:05:26.511890+0000","last_clean":"2023-07-20T10:05:26.511890+0000","last_became_active":"2023-07-20T10:05:25.178337+0000","last_became_peered":"2023-07-20T10:05:25.178337+0000","last_unstale":"2023-07-20T10:05:26.511890+0000","last_undegraded":"2023-07-20T10:05:26.511890+0000","last_fullsized":"2023-07-20T10:05:26.511890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:41:49.637039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511527+0000","last_change":"2023-07-20T10:05:25.172420+0000","last_active":"2023-07-20T10:05:26.511527+0000","last_peered":"2023-07-20T10:05:26.511527+0000","last_clean":"2023-07-20T10:05:26.511527+0000","last_became_active":"2023-07-20T10:05:25.171594+0000","last_became_peered":"2023-07-20T10:05:25.171594+0000","last_unstale":"2023-07-20T10:05:26.511527+0000","last_undegraded":"2023-07-20T10:05:26.511527+0000","last_fullsized":"2023-07-20T10:05:26.511527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:55:13.395178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145666+0000","last_change":"2023-07-20T10:05:25.165669+0000","last_active":"2023-07-20T10:05:26.145666+0000","last_peered":"2023-07-20T10:05:26.145666+0000","last_clean":"2023-07-20T10:05:26.145666+0000","last_became_active":"2023-07-20T10:05:25.165372+0000","last_became_peered":"2023-07-20T10:05:25.165372+0000","last_unstale":"2023-07-20T10:05:26.145666+0000","last_undegraded":"2023-07-20T10:05:26.145666+0000","last_fullsized":"2023-07-20T10:05:26.145666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:10.383102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144407+0000","last_change":"2023-07-20T10:05:25.175341+0000","last_active":"2023-07-20T10:05:26.144407+0000","last_peered":"2023-07-20T10:05:26.144407+0000","last_clean":"2023-07-20T10:05:26.144407+0000","last_became_active":"2023-07-20T10:05:25.175086+0000","last_became_peered":"2023-07-20T10:05:25.175086+0000","last_unstale":"2023-07-20T10:05:26.144407+0000","last_undegraded":"2023-07-20T10:05:26.144407+0000","last_fullsized":"2023-07-20T10:05:26.144407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:40.023266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144673+0000","last_change":"2023-07-20T10:05:25.157542+0000","last_active":"2023-07-20T10:05:26.144673+0000","last_peered":"2023-07-20T10:05:26.144673+0000","last_clean":"2023-07-20T10:05:26.144673+0000","last_became_active":"2023-07-20T10:05:25.157205+0000","last_became_peered":"2023-07-20T10:05:25.157205+0000","last_unstale":"2023-07-20T10:05:26.144673+0000","last_undegraded":"2023-07-20T10:05:26.144673+0000","last_fullsized":"2023-07-20T10:05:26.144673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:18.030205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510974+0000","last_change":"2023-07-20T10:05:25.172267+0000","last_active":"2023-07-20T10:05:26.510974+0000","last_peered":"2023-07-20T10:05:26.510974+0000","last_clean":"2023-07-20T10:05:26.510974+0000","last_became_active":"2023-07-20T10:05:25.171924+0000","last_became_peered":"2023-07-20T10:05:25.171924+0000","last_unstale":"2023-07-20T10:05:26.510974+0000","last_undegraded":"2023-07-20T10:05:26.510974+0000","last_fullsized":"2023-07-20T10:05:26.510974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:04.217272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511229+0000","last_change":"2023-07-20T10:05:25.172080+0000","last_active":"2023-07-20T10:05:26.511229+0000","last_peered":"2023-07-20T10:05:26.511229+0000","last_clean":"2023-07-20T10:05:26.511229+0000","last_became_active":"2023-07-20T10:05:25.171735+0000","last_became_peered":"2023-07-20T10:05:25.171735+0000","last_unstale":"2023-07-20T10:05:26.511229+0000","last_undegraded":"2023-07-20T10:05:26.511229+0000","last_fullsized":"2023-07-20T10:05:26.511229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:15.406469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139919+0000","last_change":"2023-07-20T10:05:25.168087+0000","last_active":"2023-07-20T10:05:26.139919+0000","last_peered":"2023-07-20T10:05:26.139919+0000","last_clean":"2023-07-20T10:05:26.139919+0000","last_became_active":"2023-07-20T10:05:25.167797+0000","last_became_peered":"2023-07-20T10:05:25.167797+0000","last_unstale":"2023-07-20T10:05:26.139919+0000","last_undegraded":"2023-07-20T10:05:26.139919+0000","last_fullsized":"2023-07-20T10:05:26.139919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:14:28.253258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509085+0000","last_change":"2023-07-20T10:05:25.173229+0000","last_active":"2023-07-20T10:05:26.509085+0000","last_peered":"2023-07-20T10:05:26.509085+0000","last_clean":"2023-07-20T10:05:26.509085+0000","last_became_active":"2023-07-20T10:05:25.172964+0000","last_became_peered":"2023-07-20T10:05:25.172964+0000","last_unstale":"2023-07-20T10:05:26.509085+0000","last_undegraded":"2023-07-20T10:05:26.509085+0000","last_fullsized":"2023-07-20T10:05:26.509085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:03.449831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145355+0000","last_change":"2023-07-20T10:05:25.166726+0000","last_active":"2023-07-20T10:05:26.145355+0000","last_peered":"2023-07-20T10:05:26.145355+0000","last_clean":"2023-07-20T10:05:26.145355+0000","last_became_active":"2023-07-20T10:05:25.166452+0000","last_became_peered":"2023-07-20T10:05:25.166452+0000","last_unstale":"2023-07-20T10:05:26.145355+0000","last_undegraded":"2023-07-20T10:05:26.145355+0000","last_fullsized":"2023-07-20T10:05:26.145355+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:38.379244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511823+0000","last_change":"2023-07-20T10:05:25.166622+0000","last_active":"2023-07-20T10:05:26.511823+0000","last_peered":"2023-07-20T10:05:26.511823+0000","last_clean":"2023-07-20T10:05:26.511823+0000","last_became_active":"2023-07-20T10:05:25.166209+0000","last_became_peered":"2023-07-20T10:05:25.166209+0000","last_unstale":"2023-07-20T10:05:26.511823+0000","last_undegraded":"2023-07-20T10:05:26.511823+0000","last_fullsized":"2023-07-20T10:05:26.511823+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:04.809937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507817+0000","last_change":"2023-07-20T10:05:25.166585+0000","last_active":"2023-07-20T10:05:26.507817+0000","last_peered":"2023-07-20T10:05:26.507817+0000","last_clean":"2023-07-20T10:05:26.507817+0000","last_became_active":"2023-07-20T10:05:25.166235+0000","last_became_peered":"2023-07-20T10:05:25.166235+0000","last_unstale":"2023-07-20T10:05:26.507817+0000","last_undegraded":"2023-07-20T10:05:26.507817+0000","last_fullsized":"2023-07-20T10:05:26.507817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:13:26.736260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144833+0000","last_change":"2023-07-20T10:05:25.164915+0000","last_active":"2023-07-20T10:05:26.144833+0000","last_peered":"2023-07-20T10:05:26.144833+0000","last_clean":"2023-07-20T10:05:26.144833+0000","last_became_active":"2023-07-20T10:05:25.164649+0000","last_became_peered":"2023-07-20T10:05:25.164649+0000","last_unstale":"2023-07-20T10:05:26.144833+0000","last_undegraded":"2023-07-20T10:05:26.144833+0000","last_fullsized":"2023-07-20T10:05:26.144833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:07.270012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507644+0000","last_change":"2023-07-20T10:05:25.169795+0000","last_active":"2023-07-20T10:05:26.507644+0000","last_peered":"2023-07-20T10:05:26.507644+0000","last_clean":"2023-07-20T10:05:26.507644+0000","last_became_active":"2023-07-20T10:05:25.169506+0000","last_became_peered":"2023-07-20T10:05:25.169506+0000","last_unstale":"2023-07-20T10:05:26.507644+0000","last_undegraded":"2023-07-20T10:05:26.507644+0000","last_fullsized":"2023-07-20T10:05:26.507644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:41:44.492629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508710+0000","last_change":"2023-07-20T10:05:25.169762+0000","last_active":"2023-07-20T10:05:26.508710+0000","last_peered":"2023-07-20T10:05:26.508710+0000","last_clean":"2023-07-20T10:05:26.508710+0000","last_became_active":"2023-07-20T10:05:25.169454+0000","last_became_peered":"2023-07-20T10:05:25.169454+0000","last_unstale":"2023-07-20T10:05:26.508710+0000","last_undegraded":"2023-07-20T10:05:26.508710+0000","last_fullsized":"2023-07-20T10:05:26.508710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:16.803699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511563+0000","last_change":"2023-07-20T10:05:25.173618+0000","last_active":"2023-07-20T10:05:26.511563+0000","last_peered":"2023-07-20T10:05:26.511563+0000","last_clean":"2023-07-20T10:05:26.511563+0000","last_became_active":"2023-07-20T10:05:25.172676+0000","last_became_peered":"2023-07-20T10:05:25.172676+0000","last_unstale":"2023-07-20T10:05:26.511563+0000","last_undegraded":"2023-07-20T10:05:26.511563+0000","last_fullsized":"2023-07-20T10:05:26.511563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:42.267585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145119+0000","last_change":"2023-07-20T10:05:25.156567+0000","last_active":"2023-07-20T10:05:26.145119+0000","last_peered":"2023-07-20T10:05:26.145119+0000","last_clean":"2023-07-20T10:05:26.145119+0000","last_became_active":"2023-07-20T10:05:25.156252+0000","last_became_peered":"2023-07-20T10:05:25.156252+0000","last_unstale":"2023-07-20T10:05:26.145119+0000","last_undegraded":"2023-07-20T10:05:26.145119+0000","last_fullsized":"2023-07-20T10:05:26.145119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:12:58.173216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144410+0000","last_change":"2023-07-20T10:05:25.150820+0000","last_active":"2023-07-20T10:05:26.144410+0000","last_peered":"2023-07-20T10:05:26.144410+0000","last_clean":"2023-07-20T10:05:26.144410+0000","last_became_active":"2023-07-20T10:05:25.150544+0000","last_became_peered":"2023-07-20T10:05:25.150544+0000","last_unstale":"2023-07-20T10:05:26.144410+0000","last_undegraded":"2023-07-20T10:05:26.144410+0000","last_fullsized":"2023-07-20T10:05:26.144410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:33:51.129173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145848+0000","last_change":"2023-07-20T10:05:25.155792+0000","last_active":"2023-07-20T10:05:26.145848+0000","last_peered":"2023-07-20T10:05:26.145848+0000","last_clean":"2023-07-20T10:05:26.145848+0000","last_became_active":"2023-07-20T10:05:25.155491+0000","last_became_peered":"2023-07-20T10:05:25.155491+0000","last_unstale":"2023-07-20T10:05:26.145848+0000","last_undegraded":"2023-07-20T10:05:26.145848+0000","last_fullsized":"2023-07-20T10:05:26.145848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:51:49.687628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508585+0000","last_change":"2023-07-20T10:05:25.166665+0000","last_active":"2023-07-20T10:05:26.508585+0000","last_peered":"2023-07-20T10:05:26.508585+0000","last_clean":"2023-07-20T10:05:26.508585+0000","last_became_active":"2023-07-20T10:05:25.165891+0000","last_became_peered":"2023-07-20T10:05:25.165891+0000","last_unstale":"2023-07-20T10:05:26.508585+0000","last_undegraded":"2023-07-20T10:05:26.508585+0000","last_fullsized":"2023-07-20T10:05:26.508585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:57.332335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511218+0000","last_change":"2023-07-20T10:05:25.180250+0000","last_active":"2023-07-20T10:05:26.511218+0000","last_peered":"2023-07-20T10:05:26.511218+0000","last_clean":"2023-07-20T10:05:26.511218+0000","last_became_active":"2023-07-20T10:05:25.179951+0000","last_became_peered":"2023-07-20T10:05:25.179951+0000","last_unstale":"2023-07-20T10:05:26.511218+0000","last_undegraded":"2023-07-20T10:05:26.511218+0000","last_fullsized":"2023-07-20T10:05:26.511218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:36:27.336212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144407+0000","last_change":"2023-07-20T10:05:25.174811+0000","last_active":"2023-07-20T10:05:26.144407+0000","last_peered":"2023-07-20T10:05:26.144407+0000","last_clean":"2023-07-20T10:05:26.144407+0000","last_became_active":"2023-07-20T10:05:25.174541+0000","last_became_peered":"2023-07-20T10:05:25.174541+0000","last_unstale":"2023-07-20T10:05:26.144407+0000","last_undegraded":"2023-07-20T10:05:26.144407+0000","last_fullsized":"2023-07-20T10:05:26.144407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:13.482693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144757+0000","last_change":"2023-07-20T10:05:25.147578+0000","last_active":"2023-07-20T10:05:26.144757+0000","last_peered":"2023-07-20T10:05:26.144757+0000","last_clean":"2023-07-20T10:05:26.144757+0000","last_became_active":"2023-07-20T10:05:25.147273+0000","last_became_peered":"2023-07-20T10:05:25.147273+0000","last_unstale":"2023-07-20T10:05:26.144757+0000","last_undegraded":"2023-07-20T10:05:26.144757+0000","last_fullsized":"2023-07-20T10:05:26.144757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:00:21.528951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507431+0000","last_change":"2023-07-20T10:05:25.162355+0000","last_active":"2023-07-20T10:05:26.507431+0000","last_peered":"2023-07-20T10:05:26.507431+0000","last_clean":"2023-07-20T10:05:26.507431+0000","last_became_active":"2023-07-20T10:05:25.159503+0000","last_became_peered":"2023-07-20T10:05:25.159503+0000","last_unstale":"2023-07-20T10:05:26.507431+0000","last_undegraded":"2023-07-20T10:05:26.507431+0000","last_fullsized":"2023-07-20T10:05:26.507431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:03.248853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511140+0000","last_change":"2023-07-20T10:05:25.172277+0000","last_active":"2023-07-20T10:05:26.511140+0000","last_peered":"2023-07-20T10:05:26.511140+0000","last_clean":"2023-07-20T10:05:26.511140+0000","last_became_active":"2023-07-20T10:05:25.171670+0000","last_became_peered":"2023-07-20T10:05:25.171670+0000","last_unstale":"2023-07-20T10:05:26.511140+0000","last_undegraded":"2023-07-20T10:05:26.511140+0000","last_fullsized":"2023-07-20T10:05:26.511140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:06:19.297371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"80'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509083+0000","last_change":"2023-07-20T10:05:24.162257+0000","last_active":"2023-07-20T10:05:26.509083+0000","last_peered":"2023-07-20T10:05:26.509083+0000","last_clean":"2023-07-20T10:05:26.509083+0000","last_became_active":"2023-07-20T10:05:24.161963+0000","last_became_peered":"2023-07-20T10:05:24.161963+0000","last_unstale":"2023-07-20T10:05:26.509083+0000","last_undegraded":"2023-07-20T10:05:26.509083+0000","last_fullsized":"2023-07-20T10:05:26.509083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:19.047829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145827+0000","last_change":"2023-07-20T10:05:25.169240+0000","last_active":"2023-07-20T10:05:26.145827+0000","last_peered":"2023-07-20T10:05:26.145827+0000","last_clean":"2023-07-20T10:05:26.145827+0000","last_became_active":"2023-07-20T10:05:25.168930+0000","last_became_peered":"2023-07-20T10:05:25.168930+0000","last_unstale":"2023-07-20T10:05:26.145827+0000","last_undegraded":"2023-07-20T10:05:26.145827+0000","last_fullsized":"2023-07-20T10:05:26.145827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:01:38.333914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508764+0000","last_change":"2023-07-20T10:05:24.157108+0000","last_active":"2023-07-20T10:05:26.508764+0000","last_peered":"2023-07-20T10:05:26.508764+0000","last_clean":"2023-07-20T10:05:26.508764+0000","last_became_active":"2023-07-20T10:05:24.156800+0000","last_became_peered":"2023-07-20T10:05:24.156800+0000","last_unstale":"2023-07-20T10:05:26.508764+0000","last_undegraded":"2023-07-20T10:05:26.508764+0000","last_fullsized":"2023-07-20T10:05:26.508764+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:43.413164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508666+0000","last_change":"2023-07-20T10:05:25.163496+0000","last_active":"2023-07-20T10:05:26.508666+0000","last_peered":"2023-07-20T10:05:26.508666+0000","last_clean":"2023-07-20T10:05:26.508666+0000","last_became_active":"2023-07-20T10:05:25.163224+0000","last_became_peered":"2023-07-20T10:05:25.163224+0000","last_unstale":"2023-07-20T10:05:26.508666+0000","last_undegraded":"2023-07-20T10:05:26.508666+0000","last_fullsized":"2023-07-20T10:05:26.508666+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:33:49.062975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508268+0000","last_change":"2023-07-20T10:05:24.150573+0000","last_active":"2023-07-20T10:05:26.508268+0000","last_peered":"2023-07-20T10:05:26.508268+0000","last_clean":"2023-07-20T10:05:26.508268+0000","last_became_active":"2023-07-20T10:05:24.150220+0000","last_became_peered":"2023-07-20T10:05:24.150220+0000","last_unstale":"2023-07-20T10:05:26.508268+0000","last_undegraded":"2023-07-20T10:05:26.508268+0000","last_fullsized":"2023-07-20T10:05:26.508268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:56.320012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511506+0000","last_change":"2023-07-20T10:05:25.171923+0000","last_active":"2023-07-20T10:05:26.511506+0000","last_peered":"2023-07-20T10:05:26.511506+0000","last_clean":"2023-07-20T10:05:26.511506+0000","last_became_active":"2023-07-20T10:05:25.171618+0000","last_became_peered":"2023-07-20T10:05:25.171618+0000","last_unstale":"2023-07-20T10:05:26.511506+0000","last_undegraded":"2023-07-20T10:05:26.511506+0000","last_fullsized":"2023-07-20T10:05:26.511506+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:33.541152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508246+0000","last_change":"2023-07-20T10:05:24.154034+0000","last_active":"2023-07-20T10:05:26.508246+0000","last_peered":"2023-07-20T10:05:26.508246+0000","last_clean":"2023-07-20T10:05:26.508246+0000","last_became_active":"2023-07-20T10:05:24.153743+0000","last_became_peered":"2023-07-20T10:05:24.153743+0000","last_unstale":"2023-07-20T10:05:26.508246+0000","last_undegraded":"2023-07-20T10:05:26.508246+0000","last_fullsized":"2023-07-20T10:05:26.508246+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:25.712719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139800+0000","last_change":"2023-07-20T10:05:25.163136+0000","last_active":"2023-07-20T10:05:26.139800+0000","last_peered":"2023-07-20T10:05:26.139800+0000","last_clean":"2023-07-20T10:05:26.139800+0000","last_became_active":"2023-07-20T10:05:25.162812+0000","last_became_peered":"2023-07-20T10:05:25.162812+0000","last_unstale":"2023-07-20T10:05:26.139800+0000","last_undegraded":"2023-07-20T10:05:26.139800+0000","last_fullsized":"2023-07-20T10:05:26.139800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:14.422676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508221+0000","last_change":"2023-07-20T10:05:24.152571+0000","last_active":"2023-07-20T10:05:26.508221+0000","last_peered":"2023-07-20T10:05:26.508221+0000","last_clean":"2023-07-20T10:05:26.508221+0000","last_became_active":"2023-07-20T10:05:24.152144+0000","last_became_peered":"2023-07-20T10:05:24.152144+0000","last_unstale":"2023-07-20T10:05:26.508221+0000","last_undegraded":"2023-07-20T10:05:26.508221+0000","last_fullsized":"2023-07-20T10:05:26.508221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:08.623044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508612+0000","last_change":"2023-07-20T10:05:25.175432+0000","last_active":"2023-07-20T10:05:26.508612+0000","last_peered":"2023-07-20T10:05:26.508612+0000","last_clean":"2023-07-20T10:05:26.508612+0000","last_became_active":"2023-07-20T10:05:25.175122+0000","last_became_peered":"2023-07-20T10:05:25.175122+0000","last_unstale":"2023-07-20T10:05:26.508612+0000","last_undegraded":"2023-07-20T10:05:26.508612+0000","last_fullsized":"2023-07-20T10:05:26.508612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:44.425488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507745+0000","last_change":"2023-07-20T10:05:24.149442+0000","last_active":"2023-07-20T10:05:26.507745+0000","last_peered":"2023-07-20T10:05:26.507745+0000","last_clean":"2023-07-20T10:05:26.507745+0000","last_became_active":"2023-07-20T10:05:24.149136+0000","last_became_peered":"2023-07-20T10:05:24.149136+0000","last_unstale":"2023-07-20T10:05:26.507745+0000","last_undegraded":"2023-07-20T10:05:26.507745+0000","last_fullsized":"2023-07-20T10:05:26.507745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:48:49.791065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510957+0000","last_change":"2023-07-20T10:05:25.166395+0000","last_active":"2023-07-20T10:05:26.510957+0000","last_peered":"2023-07-20T10:05:26.510957+0000","last_clean":"2023-07-20T10:05:26.510957+0000","last_became_active":"2023-07-20T10:05:25.165907+0000","last_became_peered":"2023-07-20T10:05:25.165907+0000","last_unstale":"2023-07-20T10:05:26.510957+0000","last_undegraded":"2023-07-20T10:05:26.510957+0000","last_fullsized":"2023-07-20T10:05:26.510957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:52:33.976795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508049+0000","last_change":"2023-07-20T10:05:24.158619+0000","last_active":"2023-07-20T10:05:26.508049+0000","last_peered":"2023-07-20T10:05:26.508049+0000","last_clean":"2023-07-20T10:05:26.508049+0000","last_became_active":"2023-07-20T10:05:24.158335+0000","last_became_peered":"2023-07-20T10:05:24.158335+0000","last_unstale":"2023-07-20T10:05:26.508049+0000","last_undegraded":"2023-07-20T10:05:26.508049+0000","last_fullsized":"2023-07-20T10:05:26.508049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:25.006101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508127+0000","last_change":"2023-07-20T10:05:25.164421+0000","last_active":"2023-07-20T10:05:26.508127+0000","last_peered":"2023-07-20T10:05:26.508127+0000","last_clean":"2023-07-20T10:05:26.508127+0000","last_became_active":"2023-07-20T10:05:25.164091+0000","last_became_peered":"2023-07-20T10:05:25.164091+0000","last_unstale":"2023-07-20T10:05:26.508127+0000","last_undegraded":"2023-07-20T10:05:26.508127+0000","last_fullsized":"2023-07-20T10:05:26.508127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:12:09.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511743+0000","last_change":"2023-07-20T10:05:24.167186+0000","last_active":"2023-07-20T10:05:26.511743+0000","last_peered":"2023-07-20T10:05:26.511743+0000","last_clean":"2023-07-20T10:05:26.511743+0000","last_became_active":"2023-07-20T10:05:24.166879+0000","last_became_peered":"2023-07-20T10:05:24.166879+0000","last_unstale":"2023-07-20T10:05:26.511743+0000","last_undegraded":"2023-07-20T10:05:26.511743+0000","last_fullsized":"2023-07-20T10:05:26.511743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:24:25.696899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508707+0000","last_change":"2023-07-20T10:05:25.162187+0000","last_active":"2023-07-20T10:05:26.508707+0000","last_peered":"2023-07-20T10:05:26.508707+0000","last_clean":"2023-07-20T10:05:26.508707+0000","last_became_active":"2023-07-20T10:05:25.161923+0000","last_became_peered":"2023-07-20T10:05:25.161923+0000","last_unstale":"2023-07-20T10:05:26.508707+0000","last_undegraded":"2023-07-20T10:05:26.508707+0000","last_fullsized":"2023-07-20T10:05:26.508707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:45.445957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511801+0000","last_change":"2023-07-20T10:05:24.167285+0000","last_active":"2023-07-20T10:05:26.511801+0000","last_peered":"2023-07-20T10:05:26.511801+0000","last_clean":"2023-07-20T10:05:26.511801+0000","last_became_active":"2023-07-20T10:05:24.167014+0000","last_became_peered":"2023-07-20T10:05:24.167014+0000","last_unstale":"2023-07-20T10:05:26.511801+0000","last_undegraded":"2023-07-20T10:05:26.511801+0000","last_fullsized":"2023-07-20T10:05:26.511801+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:08.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507935+0000","last_change":"2023-07-20T10:05:25.158432+0000","last_active":"2023-07-20T10:05:26.507935+0000","last_peered":"2023-07-20T10:05:26.507935+0000","last_clean":"2023-07-20T10:05:26.507935+0000","last_became_active":"2023-07-20T10:05:25.158153+0000","last_became_peered":"2023-07-20T10:05:25.158153+0000","last_unstale":"2023-07-20T10:05:26.507935+0000","last_undegraded":"2023-07-20T10:05:26.507935+0000","last_fullsized":"2023-07-20T10:05:26.507935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:58.930312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145590+0000","last_change":"2023-07-20T10:05:24.156683+0000","last_active":"2023-07-20T10:05:26.145590+0000","last_peered":"2023-07-20T10:05:26.145590+0000","last_clean":"2023-07-20T10:05:26.145590+0000","last_became_active":"2023-07-20T10:05:24.156397+0000","last_became_peered":"2023-07-20T10:05:24.156397+0000","last_unstale":"2023-07-20T10:05:26.145590+0000","last_undegraded":"2023-07-20T10:05:26.145590+0000","last_fullsized":"2023-07-20T10:05:26.145590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:49.086061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510976+0000","last_change":"2023-07-20T10:05:25.177366+0000","last_active":"2023-07-20T10:05:26.510976+0000","last_peered":"2023-07-20T10:05:26.510976+0000","last_clean":"2023-07-20T10:05:26.510976+0000","last_became_active":"2023-07-20T10:05:25.177038+0000","last_became_peered":"2023-07-20T10:05:25.177038+0000","last_unstale":"2023-07-20T10:05:26.510976+0000","last_undegraded":"2023-07-20T10:05:26.510976+0000","last_fullsized":"2023-07-20T10:05:26.510976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:45:09.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"80'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511735+0000","last_change":"2023-07-20T10:05:24.166812+0000","last_active":"2023-07-20T10:05:26.511735+0000","last_peered":"2023-07-20T10:05:26.511735+0000","last_clean":"2023-07-20T10:05:26.511735+0000","last_became_active":"2023-07-20T10:05:24.165303+0000","last_became_peered":"2023-07-20T10:05:24.165303+0000","last_unstale":"2023-07-20T10:05:26.511735+0000","last_undegraded":"2023-07-20T10:05:26.511735+0000","last_fullsized":"2023-07-20T10:05:26.511735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:18:28.280910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145722+0000","last_change":"2023-07-20T10:05:25.154538+0000","last_active":"2023-07-20T10:05:26.145722+0000","last_peered":"2023-07-20T10:05:26.145722+0000","last_clean":"2023-07-20T10:05:26.145722+0000","last_became_active":"2023-07-20T10:05:25.154251+0000","last_became_peered":"2023-07-20T10:05:25.154251+0000","last_unstale":"2023-07-20T10:05:26.145722+0000","last_undegraded":"2023-07-20T10:05:26.145722+0000","last_fullsized":"2023-07-20T10:05:26.145722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:01:08.675044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"80'6","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508794+0000","last_change":"2023-07-20T10:05:24.159710+0000","last_active":"2023-07-20T10:05:26.508794+0000","last_peered":"2023-07-20T10:05:26.508794+0000","last_clean":"2023-07-20T10:05:26.508794+0000","last_became_active":"2023-07-20T10:05:24.159412+0000","last_became_peered":"2023-07-20T10:05:24.159412+0000","last_unstale":"2023-07-20T10:05:26.508794+0000","last_undegraded":"2023-07-20T10:05:26.508794+0000","last_fullsized":"2023-07-20T10:05:26.508794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:41.428140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144385+0000","last_change":"2023-07-20T10:05:25.168606+0000","last_active":"2023-07-20T10:05:26.144385+0000","last_peered":"2023-07-20T10:05:26.144385+0000","last_clean":"2023-07-20T10:05:26.144385+0000","last_became_active":"2023-07-20T10:05:25.168280+0000","last_became_peered":"2023-07-20T10:05:25.168280+0000","last_unstale":"2023-07-20T10:05:26.144385+0000","last_undegraded":"2023-07-20T10:05:26.144385+0000","last_fullsized":"2023-07-20T10:05:26.144385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:48:37.830201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511333+0000","last_change":"2023-07-20T10:05:24.166452+0000","last_active":"2023-07-20T10:05:26.511333+0000","last_peered":"2023-07-20T10:05:26.511333+0000","last_clean":"2023-07-20T10:05:26.511333+0000","last_became_active":"2023-07-20T10:05:24.165469+0000","last_became_peered":"2023-07-20T10:05:24.165469+0000","last_unstale":"2023-07-20T10:05:26.511333+0000","last_undegraded":"2023-07-20T10:05:26.511333+0000","last_fullsized":"2023-07-20T10:05:26.511333+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:21.427201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144223+0000","last_change":"2023-07-20T10:05:25.163826+0000","last_active":"2023-07-20T10:05:26.144223+0000","last_peered":"2023-07-20T10:05:26.144223+0000","last_clean":"2023-07-20T10:05:26.144223+0000","last_became_active":"2023-07-20T10:05:25.163512+0000","last_became_peered":"2023-07-20T10:05:25.163512+0000","last_unstale":"2023-07-20T10:05:26.144223+0000","last_undegraded":"2023-07-20T10:05:26.144223+0000","last_fullsized":"2023-07-20T10:05:26.144223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:00.546059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144516+0000","last_change":"2023-07-20T10:05:24.156935+0000","last_active":"2023-07-20T10:05:26.144516+0000","last_peered":"2023-07-20T10:05:26.144516+0000","last_clean":"2023-07-20T10:05:26.144516+0000","last_became_active":"2023-07-20T10:05:24.156430+0000","last_became_peered":"2023-07-20T10:05:24.156430+0000","last_unstale":"2023-07-20T10:05:26.144516+0000","last_undegraded":"2023-07-20T10:05:26.144516+0000","last_fullsized":"2023-07-20T10:05:26.144516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:59:44.025142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511123+0000","last_change":"2023-07-20T10:05:25.166205+0000","last_active":"2023-07-20T10:05:26.511123+0000","last_peered":"2023-07-20T10:05:26.511123+0000","last_clean":"2023-07-20T10:05:26.511123+0000","last_became_active":"2023-07-20T10:05:25.165629+0000","last_became_peered":"2023-07-20T10:05:25.165629+0000","last_unstale":"2023-07-20T10:05:26.511123+0000","last_undegraded":"2023-07-20T10:05:26.511123+0000","last_fullsized":"2023-07-20T10:05:26.511123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:33.869898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511450+0000","last_change":"2023-07-20T10:05:24.165512+0000","last_active":"2023-07-20T10:05:26.511450+0000","last_peered":"2023-07-20T10:05:26.511450+0000","last_clean":"2023-07-20T10:05:26.511450+0000","last_became_active":"2023-07-20T10:05:24.165208+0000","last_became_peered":"2023-07-20T10:05:24.165208+0000","last_unstale":"2023-07-20T10:05:26.511450+0000","last_undegraded":"2023-07-20T10:05:26.511450+0000","last_fullsized":"2023-07-20T10:05:26.511450+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:37.770756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508266+0000","last_change":"2023-07-20T10:05:25.171919+0000","last_active":"2023-07-20T10:05:26.508266+0000","last_peered":"2023-07-20T10:05:26.508266+0000","last_clean":"2023-07-20T10:05:26.508266+0000","last_became_active":"2023-07-20T10:05:25.171647+0000","last_became_peered":"2023-07-20T10:05:25.171647+0000","last_unstale":"2023-07-20T10:05:26.508266+0000","last_undegraded":"2023-07-20T10:05:26.508266+0000","last_fullsized":"2023-07-20T10:05:26.508266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:23:28.272687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"80'8","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144485+0000","last_change":"2023-07-20T10:05:24.162258+0000","last_active":"2023-07-20T10:05:26.144485+0000","last_peered":"2023-07-20T10:05:26.144485+0000","last_clean":"2023-07-20T10:05:26.144485+0000","last_became_active":"2023-07-20T10:05:24.161908+0000","last_became_peered":"2023-07-20T10:05:24.161908+0000","last_unstale":"2023-07-20T10:05:26.144485+0000","last_undegraded":"2023-07-20T10:05:26.144485+0000","last_fullsized":"2023-07-20T10:05:26.144485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:34.774627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508157+0000","last_change":"2023-07-20T10:05:25.175449+0000","last_active":"2023-07-20T10:05:26.508157+0000","last_peered":"2023-07-20T10:05:26.508157+0000","last_clean":"2023-07-20T10:05:26.508157+0000","last_became_active":"2023-07-20T10:05:25.175144+0000","last_became_peered":"2023-07-20T10:05:25.175144+0000","last_unstale":"2023-07-20T10:05:26.508157+0000","last_undegraded":"2023-07-20T10:05:26.508157+0000","last_fullsized":"2023-07-20T10:05:26.508157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:23:28.272687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145289+0000","last_change":"2023-07-20T10:05:24.158981+0000","last_active":"2023-07-20T10:05:26.145289+0000","last_peered":"2023-07-20T10:05:26.145289+0000","last_clean":"2023-07-20T10:05:26.145289+0000","last_became_active":"2023-07-20T10:05:24.158668+0000","last_became_peered":"2023-07-20T10:05:24.158668+0000","last_unstale":"2023-07-20T10:05:26.145289+0000","last_undegraded":"2023-07-20T10:05:26.145289+0000","last_fullsized":"2023-07-20T10:05:26.145289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:41:33.391256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139948+0000","last_change":"2023-07-20T10:05:25.160748+0000","last_active":"2023-07-20T10:05:26.139948+0000","last_peered":"2023-07-20T10:05:26.139948+0000","last_clean":"2023-07-20T10:05:26.139948+0000","last_became_active":"2023-07-20T10:05:25.160504+0000","last_became_peered":"2023-07-20T10:05:25.160504+0000","last_unstale":"2023-07-20T10:05:26.139948+0000","last_undegraded":"2023-07-20T10:05:26.139948+0000","last_fullsized":"2023-07-20T10:05:26.139948+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:03:33.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145098+0000","last_change":"2023-07-20T10:05:24.152874+0000","last_active":"2023-07-20T10:05:26.145098+0000","last_peered":"2023-07-20T10:05:26.145098+0000","last_clean":"2023-07-20T10:05:26.145098+0000","last_became_active":"2023-07-20T10:05:24.152597+0000","last_became_peered":"2023-07-20T10:05:24.152597+0000","last_unstale":"2023-07-20T10:05:26.145098+0000","last_undegraded":"2023-07-20T10:05:26.145098+0000","last_fullsized":"2023-07-20T10:05:26.145098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:05.577736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144489+0000","last_change":"2023-07-20T10:05:25.167702+0000","last_active":"2023-07-20T10:05:26.144489+0000","last_peered":"2023-07-20T10:05:26.144489+0000","last_clean":"2023-07-20T10:05:26.144489+0000","last_became_active":"2023-07-20T10:05:25.167409+0000","last_became_peered":"2023-07-20T10:05:25.167409+0000","last_unstale":"2023-07-20T10:05:26.144489+0000","last_undegraded":"2023-07-20T10:05:26.144489+0000","last_fullsized":"2023-07-20T10:05:26.144489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:52:50.863636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508149+0000","last_change":"2023-07-20T10:05:24.150525+0000","last_active":"2023-07-20T10:05:26.508149+0000","last_peered":"2023-07-20T10:05:26.508149+0000","last_clean":"2023-07-20T10:05:26.508149+0000","last_became_active":"2023-07-20T10:05:24.150231+0000","last_became_peered":"2023-07-20T10:05:24.150231+0000","last_unstale":"2023-07-20T10:05:26.508149+0000","last_undegraded":"2023-07-20T10:05:26.508149+0000","last_fullsized":"2023-07-20T10:05:26.508149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:07:39.324913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511589+0000","last_change":"2023-07-20T10:05:25.166709+0000","last_active":"2023-07-20T10:05:26.511589+0000","last_peered":"2023-07-20T10:05:26.511589+0000","last_clean":"2023-07-20T10:05:26.511589+0000","last_became_active":"2023-07-20T10:05:25.164336+0000","last_became_peered":"2023-07-20T10:05:25.164336+0000","last_unstale":"2023-07-20T10:05:26.511589+0000","last_undegraded":"2023-07-20T10:05:26.511589+0000","last_fullsized":"2023-07-20T10:05:26.511589+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:47:54.823464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.509018+0000","last_change":"2023-07-20T10:05:24.154244+0000","last_active":"2023-07-20T10:05:26.509018+0000","last_peered":"2023-07-20T10:05:26.509018+0000","last_clean":"2023-07-20T10:05:26.509018+0000","last_became_active":"2023-07-20T10:05:24.153930+0000","last_became_peered":"2023-07-20T10:05:24.153930+0000","last_unstale":"2023-07-20T10:05:26.509018+0000","last_undegraded":"2023-07-20T10:05:26.509018+0000","last_fullsized":"2023-07-20T10:05:26.509018+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:09:23.080452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510777+0000","last_change":"2023-07-20T10:05:25.169068+0000","last_active":"2023-07-20T10:05:26.510777+0000","last_peered":"2023-07-20T10:05:26.510777+0000","last_clean":"2023-07-20T10:05:26.510777+0000","last_became_active":"2023-07-20T10:05:25.168798+0000","last_became_peered":"2023-07-20T10:05:25.168798+0000","last_unstale":"2023-07-20T10:05:26.510777+0000","last_undegraded":"2023-07-20T10:05:26.510777+0000","last_fullsized":"2023-07-20T10:05:26.510777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:34:24.040739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511384+0000","last_change":"2023-07-20T10:05:24.164942+0000","last_active":"2023-07-20T10:05:26.511384+0000","last_peered":"2023-07-20T10:05:26.511384+0000","last_clean":"2023-07-20T10:05:26.511384+0000","last_became_active":"2023-07-20T10:05:24.164640+0000","last_became_peered":"2023-07-20T10:05:24.164640+0000","last_unstale":"2023-07-20T10:05:26.511384+0000","last_undegraded":"2023-07-20T10:05:26.511384+0000","last_fullsized":"2023-07-20T10:05:26.511384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:44:35.962027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144880+0000","last_change":"2023-07-20T10:05:25.165672+0000","last_active":"2023-07-20T10:05:26.144880+0000","last_peered":"2023-07-20T10:05:26.144880+0000","last_clean":"2023-07-20T10:05:26.144880+0000","last_became_active":"2023-07-20T10:05:25.165397+0000","last_became_peered":"2023-07-20T10:05:25.165397+0000","last_unstale":"2023-07-20T10:05:26.144880+0000","last_undegraded":"2023-07-20T10:05:26.144880+0000","last_fullsized":"2023-07-20T10:05:26.144880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:38.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507874+0000","last_change":"2023-07-20T10:05:24.151619+0000","last_active":"2023-07-20T10:05:26.507874+0000","last_peered":"2023-07-20T10:05:26.507874+0000","last_clean":"2023-07-20T10:05:26.507874+0000","last_became_active":"2023-07-20T10:05:24.151301+0000","last_became_peered":"2023-07-20T10:05:24.151301+0000","last_unstale":"2023-07-20T10:05:26.507874+0000","last_undegraded":"2023-07-20T10:05:26.507874+0000","last_fullsized":"2023-07-20T10:05:26.507874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:47:14.011256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508481+0000","last_change":"2023-07-20T10:05:25.173195+0000","last_active":"2023-07-20T10:05:26.508481+0000","last_peered":"2023-07-20T10:05:26.508481+0000","last_clean":"2023-07-20T10:05:26.508481+0000","last_became_active":"2023-07-20T10:05:25.172912+0000","last_became_peered":"2023-07-20T10:05:25.172912+0000","last_unstale":"2023-07-20T10:05:26.508481+0000","last_undegraded":"2023-07-20T10:05:26.508481+0000","last_fullsized":"2023-07-20T10:05:26.508481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:26.725043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507935+0000","last_change":"2023-07-20T10:05:24.158698+0000","last_active":"2023-07-20T10:05:26.507935+0000","last_peered":"2023-07-20T10:05:26.507935+0000","last_clean":"2023-07-20T10:05:26.507935+0000","last_became_active":"2023-07-20T10:05:24.158403+0000","last_became_peered":"2023-07-20T10:05:24.158403+0000","last_unstale":"2023-07-20T10:05:26.507935+0000","last_undegraded":"2023-07-20T10:05:26.507935+0000","last_fullsized":"2023-07-20T10:05:26.507935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:26:16.418217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139924+0000","last_change":"2023-07-20T10:05:25.168201+0000","last_active":"2023-07-20T10:05:26.139924+0000","last_peered":"2023-07-20T10:05:26.139924+0000","last_clean":"2023-07-20T10:05:26.139924+0000","last_became_active":"2023-07-20T10:05:25.167793+0000","last_became_peered":"2023-07-20T10:05:25.167793+0000","last_unstale":"2023-07-20T10:05:26.139924+0000","last_undegraded":"2023-07-20T10:05:26.139924+0000","last_fullsized":"2023-07-20T10:05:26.139924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:59:26.385810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508699+0000","last_change":"2023-07-20T10:05:24.160168+0000","last_active":"2023-07-20T10:05:26.508699+0000","last_peered":"2023-07-20T10:05:26.508699+0000","last_clean":"2023-07-20T10:05:26.508699+0000","last_became_active":"2023-07-20T10:05:24.159934+0000","last_became_peered":"2023-07-20T10:05:24.159934+0000","last_unstale":"2023-07-20T10:05:26.508699+0000","last_undegraded":"2023-07-20T10:05:26.508699+0000","last_fullsized":"2023-07-20T10:05:26.508699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:58.603174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511564+0000","last_change":"2023-07-20T10:05:25.173319+0000","last_active":"2023-07-20T10:05:26.511564+0000","last_peered":"2023-07-20T10:05:26.511564+0000","last_clean":"2023-07-20T10:05:26.511564+0000","last_became_active":"2023-07-20T10:05:25.172802+0000","last_became_peered":"2023-07-20T10:05:25.172802+0000","last_unstale":"2023-07-20T10:05:26.511564+0000","last_undegraded":"2023-07-20T10:05:26.511564+0000","last_fullsized":"2023-07-20T10:05:26.511564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:44.582912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507766+0000","last_change":"2023-07-20T10:05:24.152405+0000","last_active":"2023-07-20T10:05:26.507766+0000","last_peered":"2023-07-20T10:05:26.507766+0000","last_clean":"2023-07-20T10:05:26.507766+0000","last_became_active":"2023-07-20T10:05:24.152098+0000","last_became_peered":"2023-07-20T10:05:24.152098+0000","last_unstale":"2023-07-20T10:05:26.507766+0000","last_undegraded":"2023-07-20T10:05:26.507766+0000","last_fullsized":"2023-07-20T10:05:26.507766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:51:51.737021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"69'161","reported_seq":440,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510901+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:05:26.510901+0000","last_peered":"2023-07-20T10:05:26.510901+0000","last_clean":"2023-07-20T10:05:26.510901+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:05:26.510901+0000","last_undegraded":"2023-07-20T10:05:26.510901+0000","last_fullsized":"2023-07-20T10:05:26.510901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:31:44.625112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144786+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:05:26.144786+0000","last_peered":"2023-07-20T10:05:26.144786+0000","last_clean":"2023-07-20T10:05:26.144786+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:05:26.144786+0000","last_undegraded":"2023-07-20T10:05:26.144786+0000","last_fullsized":"2023-07-20T10:05:26.144786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:22:30.102783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507488+0000","last_change":"2023-07-20T10:05:25.162532+0000","last_active":"2023-07-20T10:05:26.507488+0000","last_peered":"2023-07-20T10:05:26.507488+0000","last_clean":"2023-07-20T10:05:26.507488+0000","last_became_active":"2023-07-20T10:05:25.162060+0000","last_became_peered":"2023-07-20T10:05:25.162060+0000","last_unstale":"2023-07-20T10:05:26.507488+0000","last_undegraded":"2023-07-20T10:05:26.507488+0000","last_fullsized":"2023-07-20T10:05:26.507488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:43:40.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507879+0000","last_change":"2023-07-20T10:05:24.158855+0000","last_active":"2023-07-20T10:05:26.507879+0000","last_peered":"2023-07-20T10:05:26.507879+0000","last_clean":"2023-07-20T10:05:26.507879+0000","last_became_active":"2023-07-20T10:05:24.158565+0000","last_became_peered":"2023-07-20T10:05:24.158565+0000","last_unstale":"2023-07-20T10:05:26.507879+0000","last_undegraded":"2023-07-20T10:05:26.507879+0000","last_fullsized":"2023-07-20T10:05:26.507879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:41.846112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.510757+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:05:26.510757+0000","last_peered":"2023-07-20T10:05:26.510757+0000","last_clean":"2023-07-20T10:05:26.510757+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:05:26.510757+0000","last_undegraded":"2023-07-20T10:05:26.510757+0000","last_fullsized":"2023-07-20T10:05:26.510757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:02.012790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144264+0000","last_change":"2023-07-20T10:05:25.156401+0000","last_active":"2023-07-20T10:05:26.144264+0000","last_peered":"2023-07-20T10:05:26.144264+0000","last_clean":"2023-07-20T10:05:26.144264+0000","last_became_active":"2023-07-20T10:05:25.156088+0000","last_became_peered":"2023-07-20T10:05:25.156088+0000","last_unstale":"2023-07-20T10:05:26.144264+0000","last_undegraded":"2023-07-20T10:05:26.144264+0000","last_fullsized":"2023-07-20T10:05:26.144264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:39:27.609716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144633+0000","last_change":"2023-07-20T10:05:24.156721+0000","last_active":"2023-07-20T10:05:26.144633+0000","last_peered":"2023-07-20T10:05:26.144633+0000","last_clean":"2023-07-20T10:05:26.144633+0000","last_became_active":"2023-07-20T10:05:24.155981+0000","last_became_peered":"2023-07-20T10:05:24.155981+0000","last_unstale":"2023-07-20T10:05:26.144633+0000","last_undegraded":"2023-07-20T10:05:26.144633+0000","last_fullsized":"2023-07-20T10:05:26.144633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:01.847548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.139832+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:05:26.139832+0000","last_peered":"2023-07-20T10:05:26.139832+0000","last_clean":"2023-07-20T10:05:26.139832+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:05:26.139832+0000","last_undegraded":"2023-07-20T10:05:26.139832+0000","last_fullsized":"2023-07-20T10:05:26.139832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:13.838690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511264+0000","last_change":"2023-07-20T10:05:25.165420+0000","last_active":"2023-07-20T10:05:26.511264+0000","last_peered":"2023-07-20T10:05:26.511264+0000","last_clean":"2023-07-20T10:05:26.511264+0000","last_became_active":"2023-07-20T10:05:25.165117+0000","last_became_peered":"2023-07-20T10:05:25.165117+0000","last_unstale":"2023-07-20T10:05:26.511264+0000","last_undegraded":"2023-07-20T10:05:26.511264+0000","last_fullsized":"2023-07-20T10:05:26.511264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:34:48.857984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507662+0000","last_change":"2023-07-20T10:05:24.156222+0000","last_active":"2023-07-20T10:05:26.507662+0000","last_peered":"2023-07-20T10:05:26.507662+0000","last_clean":"2023-07-20T10:05:26.507662+0000","last_became_active":"2023-07-20T10:05:24.155675+0000","last_became_peered":"2023-07-20T10:05:24.155675+0000","last_unstale":"2023-07-20T10:05:26.507662+0000","last_undegraded":"2023-07-20T10:05:26.507662+0000","last_fullsized":"2023-07-20T10:05:26.507662+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:46:52.348225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.144916+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:05:26.144916+0000","last_peered":"2023-07-20T10:05:26.144916+0000","last_clean":"2023-07-20T10:05:26.144916+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:05:26.144916+0000","last_undegraded":"2023-07-20T10:05:26.144916+0000","last_fullsized":"2023-07-20T10:05:26.144916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:49:14.927141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511236+0000","last_change":"2023-07-20T10:05:25.179932+0000","last_active":"2023-07-20T10:05:26.511236+0000","last_peered":"2023-07-20T10:05:26.511236+0000","last_clean":"2023-07-20T10:05:26.511236+0000","last_became_active":"2023-07-20T10:05:25.178433+0000","last_became_peered":"2023-07-20T10:05:25.178433+0000","last_unstale":"2023-07-20T10:05:26.511236+0000","last_undegraded":"2023-07-20T10:05:26.511236+0000","last_fullsized":"2023-07-20T10:05:26.511236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:34.793996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145385+0000","last_change":"2023-07-20T10:05:24.155864+0000","last_active":"2023-07-20T10:05:26.145385+0000","last_peered":"2023-07-20T10:05:26.145385+0000","last_clean":"2023-07-20T10:05:26.145385+0000","last_became_active":"2023-07-20T10:05:24.155545+0000","last_became_peered":"2023-07-20T10:05:24.155545+0000","last_unstale":"2023-07-20T10:05:26.145385+0000","last_undegraded":"2023-07-20T10:05:26.145385+0000","last_fullsized":"2023-07-20T10:05:26.145385+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:37:24.662288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508915+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:05:26.508915+0000","last_peered":"2023-07-20T10:05:26.508915+0000","last_clean":"2023-07-20T10:05:26.508915+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:05:26.508915+0000","last_undegraded":"2023-07-20T10:05:26.508915+0000","last_fullsized":"2023-07-20T10:05:26.508915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:11:39.281328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511923+0000","last_change":"2023-07-20T10:05:25.168757+0000","last_active":"2023-07-20T10:05:26.511923+0000","last_peered":"2023-07-20T10:05:26.511923+0000","last_clean":"2023-07-20T10:05:26.511923+0000","last_became_active":"2023-07-20T10:05:25.168474+0000","last_became_peered":"2023-07-20T10:05:25.168474+0000","last_unstale":"2023-07-20T10:05:26.511923+0000","last_undegraded":"2023-07-20T10:05:26.511923+0000","last_fullsized":"2023-07-20T10:05:26.511923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:35.786951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"80'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511638+0000","last_change":"2023-07-20T10:05:24.166934+0000","last_active":"2023-07-20T10:05:26.511638+0000","last_peered":"2023-07-20T10:05:26.511638+0000","last_clean":"2023-07-20T10:05:26.511638+0000","last_became_active":"2023-07-20T10:05:24.166582+0000","last_became_peered":"2023-07-20T10:05:24.166582+0000","last_unstale":"2023-07-20T10:05:26.511638+0000","last_undegraded":"2023-07-20T10:05:26.511638+0000","last_fullsized":"2023-07-20T10:05:26.511638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:54:21.886310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511982+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:05:26.511982+0000","last_peered":"2023-07-20T10:05:26.511982+0000","last_clean":"2023-07-20T10:05:26.511982+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:05:26.511982+0000","last_undegraded":"2023-07-20T10:05:26.511982+0000","last_fullsized":"2023-07-20T10:05:26.511982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:33:59.375414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.145493+0000","last_change":"2023-07-20T10:05:25.168497+0000","last_active":"2023-07-20T10:05:26.145493+0000","last_peered":"2023-07-20T10:05:26.145493+0000","last_clean":"2023-07-20T10:05:26.145493+0000","last_became_active":"2023-07-20T10:05:25.168216+0000","last_became_peered":"2023-07-20T10:05:25.168216+0000","last_unstale":"2023-07-20T10:05:26.145493+0000","last_undegraded":"2023-07-20T10:05:26.145493+0000","last_fullsized":"2023-07-20T10:05:26.145493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:46:42.376013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"80'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511879+0000","last_change":"2023-07-20T10:05:24.166292+0000","last_active":"2023-07-20T10:05:26.511879+0000","last_peered":"2023-07-20T10:05:26.511879+0000","last_clean":"2023-07-20T10:05:26.511879+0000","last_became_active":"2023-07-20T10:05:24.165945+0000","last_became_peered":"2023-07-20T10:05:24.165945+0000","last_unstale":"2023-07-20T10:05:26.511879+0000","last_undegraded":"2023-07-20T10:05:26.511879+0000","last_fullsized":"2023-07-20T10:05:26.511879+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:12:49.193144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":128,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.508606+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:05:26.508606+0000","last_peered":"2023-07-20T10:05:26.508606+0000","last_clean":"2023-07-20T10:05:26.508606+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:05:26.508606+0000","last_undegraded":"2023-07-20T10:05:26.508606+0000","last_fullsized":"2023-07-20T10:05:26.508606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:18:45.261890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511754+0000","last_change":"2023-07-20T10:05:25.167471+0000","last_active":"2023-07-20T10:05:26.511754+0000","last_peered":"2023-07-20T10:05:26.511754+0000","last_clean":"2023-07-20T10:05:26.511754+0000","last_became_active":"2023-07-20T10:05:25.164630+0000","last_became_peered":"2023-07-20T10:05:25.164630+0000","last_unstale":"2023-07-20T10:05:26.511754+0000","last_undegraded":"2023-07-20T10:05:26.511754+0000","last_fullsized":"2023-07-20T10:05:26.511754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:24.125211+0000","last_clean_scrub_stamp":"2023-07-20T10:05:24.125211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:27.284730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.507910+0000","last_change":"2023-07-20T10:05:24.153976+0000","last_active":"2023-07-20T10:05:26.507910+0000","last_peered":"2023-07-20T10:05:26.507910+0000","last_clean":"2023-07-20T10:05:26.507910+0000","last_became_active":"2023-07-20T10:05:24.153669+0000","last_became_peered":"2023-07-20T10:05:24.153669+0000","last_unstale":"2023-07-20T10:05:26.507910+0000","last_undegraded":"2023-07-20T10:05:26.507910+0000","last_fullsized":"2023-07-20T10:05:26.507910+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:05:23.112887+0000","last_clean_scrub_stamp":"2023-07-20T10:05:23.112887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:09:27.688663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-07-20T10:05:26.511886+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:05:26.511886+0000","last_peered":"2023-07-20T10:05:26.511886+0000","last_clean":"2023-07-20T10:05:26.511886+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:05:26.511886+0000","last_undegraded":"2023-07-20T10:05:26.511886+0000","last_fullsized":"2023-07-20T10:05:26.511886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:34.029116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58916,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312924,"statfs":{"total":96636764160,"available":96576434176,"internally_reserved":0,"allocated":1589248,"data_stored":1077840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.74099999999999999},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.752,"15min":0.74399999999999999},"min":{"1min":0.64400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93500000000000005,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.54800000000000004,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":1.008,"15min":1.008},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.97599999999999998,"5min":1.075,"15min":1.075},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.51800000000000002,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.92200000000000004,"5min":1.716,"15min":1.716},"last":0.80100000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.72099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.433},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.056},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.747,"15min":0.745},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.443},"max":{"1min":0.95099999999999996,"5min":1.758,"15min":1.758},"last":0.75800000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79100000000000004,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.55100000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90500000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.625},"min":{"1min":0.42199999999999999,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":1.8,"15min":1.8},"last":0.623},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.68100000000000005,"15min":0.68700000000000006},"min":{"1min":0.54800000000000004,"5min":0.46000000000000002,"15min":0.42199999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69399999999999995,"15min":0.70699999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81299999999999994,"5min":0.999,"15min":0.999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64300000000000002,"15min":0.65900000000000003},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575034,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":983040,"data_stored":486730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.73899999999999999},"min":{"1min":0.52400000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.77800000000000002,"15min":0.77700000000000002},"min":{"1min":0.59699999999999998,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.006,"5min":1.018,"15min":1.2010000000000001},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.72199999999999998,"15min":0.71899999999999997},"min":{"1min":0.50900000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.93799999999999994,"5min":1.04,"15min":1.1259999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.54700000000000004,"5min":0.41799999999999998,"15min":0.33200000000000002},"max":{"1min":0.91100000000000003,"5min":0.94599999999999995,"15min":1.103},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.48599999999999999,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.59899999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.90100000000000002,"5min":0.98799999999999999,"15min":1.0129999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.63900000000000001,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":0.93200000000000005,"5min":1.0489999999999999,"15min":1.25},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.52000000000000002,"15min":0.498},"max":{"1min":0.84699999999999998,"5min":0.95299999999999996,"15min":1.272},"last":0.878}]},{"osd":4,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.90200000000000002,"5min":1.0169999999999999,"15min":1.173},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69699999999999995,"15min":0.69399999999999995},"min":{"1min":0.495,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88600000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.42799999999999999,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":0.71999999999999997,"5min":0.996,"15min":0.996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63800000000000001,"15min":0.63200000000000001},"min":{"1min":0.52300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.79700000000000004,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:04:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.373},"max":{"1min":0.82499999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.44500000000000001,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.79400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":983040,"data_stored":486718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.65500000000000003,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.72499999999999998},"min":{"1min":0.55200000000000005,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.97099999999999997,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.66300000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.98699999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.751,"15min":0.74099999999999999},"min":{"1min":0.69499999999999995,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.747},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.751,"15min":0.74299999999999999},"min":{"1min":0.55800000000000005,"5min":0.51400000000000001,"15min":0.46000000000000002},"max":{"1min":0.93100000000000005,"5min":1.0269999999999999,"15min":1.081},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.59199999999999997,"5min":0.52200000000000002,"15min":0.501},"max":{"1min":0.94699999999999995,"5min":1.034,"15min":1.034},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.77800000000000002,"15min":0.75900000000000001},"min":{"1min":0.65100000000000002,"5min":0.53800000000000003,"15min":0.42899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89700000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.622,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73499999999999999,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.45100000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.94899999999999995,"15min":1.016},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.65500000000000003,"15min":0.66800000000000004},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78100000000000003,"5min":1.024,"15min":1.3080000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.53200000000000003,"5min":0.49399999999999999,"15min":0.41999999999999998},"max":{"1min":0.95099999999999996,"5min":1.0680000000000001,"15min":1.145},"last":0.629},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.68700000000000006,"15min":0.71699999999999997},"min":{"1min":0.50900000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":0.96799999999999997,"15min":1.0329999999999999},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":991232,"data_stored":488260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.38300000000000001},"max":{"1min":0.88600000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.874,"5min":1.0580000000000001,"15min":1.085},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.141},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70499999999999996,"15min":0.70999999999999996},"min":{"1min":0.53200000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.93500000000000005,"5min":1.22,"15min":1.363},"last":0.78600000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":0.89100000000000001,"5min":1.177,"15min":1.177},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77700000000000002},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.3620000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.71799999999999997,"15min":0.72399999999999998},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.91200000000000003,"5min":0.97799999999999998,"15min":1.212},"last":0.751}]},{"osd":5,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.437,"5min":0.377,"15min":0.377},"max":{"1min":0.84499999999999997,"5min":0.98899999999999999,"15min":1.4770000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.44600000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90300000000000002,"5min":0.93500000000000005,"15min":1.196},"last":0.877}]},{"osd":6,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.442,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.873,"5min":1.004,"15min":1.4970000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.71899999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89200000000000002,"5min":1.0209999999999999,"15min":1.538},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61899999999999999,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.85599999999999998,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64900000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91200000000000003,"5min":1.0009999999999999,"15min":1.597},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":978944,"data_stored":486696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30199999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48799999999999999,"15min":0.51500000000000001},"min":{"1min":0.38,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.68700000000000006,"5min":0.70299999999999996,"15min":4.8239999999999998},"last":0.498}]},{"osd":1,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47299999999999998,"15min":0.47199999999999998},"min":{"1min":0.35799999999999998,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.33300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42799999999999999,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.83499999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.47099999999999997,"5min":0.379,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.84499999999999997,"15min":1.099},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.436,"15min":0.436},"max":{"1min":1.083,"5min":1.1890000000000001,"15min":1.9830000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.071,"5min":1.381,"15min":1.381},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.52300000000000002,"15min":0.48299999999999998},"max":{"1min":1.0649999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.052,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78600000000000003,"15min":0.79700000000000004},"min":{"1min":0.64900000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.107,"5min":1.274,"15min":1.274},"last":1.01},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.502},"max":{"1min":1.008,"5min":1.131,"15min":1.1950000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:04:33 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76500000000000001,"15min":0.79100000000000004},"min":{"1min":0.63600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.64700000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.155,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.96799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54220,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317620,"statfs":{"total":96636764160,"available":96581242880,"internally_reserved":0,"allocated":978944,"data_stored":486696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48099999999999998,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.35699999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48099999999999998,"15min":0.47299999999999998},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.68899999999999995,"5min":0.83799999999999997,"15min":0.876},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.54800000000000004},"min":{"1min":0.44,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70699999999999996,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.502}]},{"osd":3,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.54100000000000004},"min":{"1min":0.40899999999999997,"5min":0.35899999999999999,"15min":0.32700000000000001},"max":{"1min":0.67400000000000004,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.59399999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.089,"5min":1.2529999999999999,"15min":1.383},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.79800000000000004,"15min":0.79000000000000004},"min":{"1min":0.61899999999999999,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.1040000000000001,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.751}]},{"osd":6,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81999999999999995,"15min":0.81100000000000005},"min":{"1min":0.61699999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1579999999999999,"5min":1.169,"15min":1.51},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.81699999999999995,"15min":0.81299999999999994},"min":{"1min":0.52500000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1020000000000001,"5min":1.2529999999999999,"15min":1.3240000000000001},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:04:42 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.82899999999999996,"15min":0.81999999999999995},"min":{"1min":0.66900000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.143,"5min":1.143,"15min":1.5820000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.83199999999999996,"15min":0.82699999999999996},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.393},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":1007616,"data_stored":489024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.35099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.53300000000000003},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.72699999999999998,"15min":0.89600000000000002},"last":0.502}]},{"osd":2,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.35899999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.44600000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.47499999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76000000000000001,"5min":0.81200000000000006,"15min":1.052},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52300000000000002},"min":{"1min":0.40400000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67700000000000005,"5min":0.86799999999999999,"15min":0.97899999999999998},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.746,"15min":0.75800000000000001},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0589999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.1930000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.56299999999999994,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":0.94599999999999995,"5min":1.048,"15min":1.117},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.63900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98599999999999999,"5min":1.1080000000000001,"15min":1.355},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75700000000000001,"15min":0.77500000000000002},"min":{"1min":0.63100000000000001,"5min":0.505,"15min":0.505},"max":{"1min":0.999,"5min":1,"15min":1.1899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.034,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:04:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.621,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.624},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.79100000000000004},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53000000000000003},"max":{"1min":0.96799999999999997,"5min":1.1259999999999999,"15min":1.2529999999999999},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1572864,"data_stored":1077064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48899999999999999,"15min":0.45500000000000002},"min":{"1min":0.374,"5min":0.26800000000000002,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58499999999999996,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.64400000000000002,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.503}]},{"osd":2,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.53300000000000003},"min":{"1min":0.40400000000000003,"5min":0.34999999999999998,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.68200000000000005,"15min":0.58799999999999997},"min":{"1min":0.40999999999999998,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71099999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.623,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.314},"max":{"1min":0.74299999999999999,"5min":10.631,"15min":10.631},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38200000000000001,"15min":0.35499999999999998},"max":{"1min":0.76800000000000002,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.622}]},{"osd":4,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.82699999999999996,"15min":0.80000000000000004},"min":{"1min":0.76200000000000001,"5min":0.51200000000000001,"15min":0.505},"max":{"1min":1.232,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.84399999999999997,"15min":0.81200000000000006},"min":{"1min":0.623,"5min":0.56499999999999995,"15min":0.495},"max":{"1min":1.1359999999999999,"5min":3.125,"15min":3.125},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.91600000000000004,"15min":0.83699999999999997},"min":{"1min":0.70999999999999996,"5min":0.52200000000000002,"15min":0.38500000000000001},"max":{"1min":1.1479999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.85199999999999998,"15min":0.81000000000000005},"min":{"1min":0.70099999999999996,"5min":0.59999999999999998,"15min":0.45700000000000002},"max":{"1min":1.2310000000000001,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.85399999999999998,"15min":0.81999999999999995},"min":{"1min":0.68999999999999995,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.1950000000000001,"5min":3.161,"15min":3.161},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89700000000000002,"15min":0.83499999999999996},"min":{"1min":0.70499999999999996,"5min":0.55200000000000005,"15min":0.46600000000000003},"max":{"1min":1.1499999999999999,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:04:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91500000000000004,"15min":0.85299999999999998},"min":{"1min":0.73799999999999999,"5min":0.56299999999999994,"15min":0.51200000000000001},"max":{"1min":1.278,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64400000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":1.3089999999999999,"5min":1.766,"15min":1.766},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:05:34.101 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:05:34.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:05:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 Processor -- start 2023-07-20T10:05:34.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 -- start start 2023-07-20T10:05:34.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b84159830 0x7f0b840cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b840cc8d0 con 0x7f0b84159450 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b840cce90 con 0x7f0b84159830 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8af8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840ccbb0 con 0x7f0b840cc3e0 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b84159830 0x7f0b840cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b84159830 0x7f0b840cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38316/0 (socket says 172.21.15.82:38316) 2023-07-20T10:05:34.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2727008409 learned_addr learned my addr 172.21.15.82:0/2727008409 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2727008409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 msgr2=0x7f0b840afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8952c640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2727008409 >> v1:172.21.15.183:6789/0 conn(0x7f0b84159450 legacy=0x7f0b8415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2727008409 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84159cc0 con 0x7f0b84159830 2023-07-20T10:05:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.302+0000 7f0b8952c640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:34.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b7bfff640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159830 0x7f0b840cbea0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009870 tx=0x7f0b7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448a1897fa8230d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b7b7fe640 1 -- 172.21.15.82:0/2727008409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740ac600 con 0x7f0b84159830 2023-07-20T10:05:34.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b7b7fe640 1 -- 172.21.15.82:0/2727008409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740a8050 con 0x7f0b84159830 2023-07-20T10:05:34.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b7b7fe640 1 -- 172.21.15.82:0/2727008409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740ac980 con 0x7f0b84159830 2023-07-20T10:05:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2727008409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159830 msgr2=0x7f0b840cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159830 0x7f0b840cbea0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009870 tx=0x7f0b7401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2727008409 shutdown_connections 2023-07-20T10:05:34.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2727008409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159830 0x7f0b840cbea0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2727008409 >> 172.21.15.82:0/2727008409 conn(0x7f0b840cad50 msgr2=0x7f0b840cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2727008409 shutdown_connections 2023-07-20T10:05:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.306+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2727008409 wait complete. 2023-07-20T10:05:34.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 Processor -- start 2023-07-20T10:05:34.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- start start 2023-07-20T10:05:34.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 0x7f0b84158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840c63f0 con 0x7f0b84159450 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840c6970 con 0x7f0b841634d0 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84163a30 con 0x7f0b840cc3e0 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38332/0 (socket says 172.21.15.82:38332) 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2002604609 learned_addr learned my addr 172.21.15.82:0/2002604609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b88d2b640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8952c640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 0x7f0b84158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 msgr2=0x7f0b840c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 msgr2=0x7f0b84158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 0x7f0b84158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 -- 172.21.15.82:0/2002604609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740094d0 con 0x7f0b84159450 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8952c640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 0x7f0b84158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b7bfff640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0b7401cd70 tx=0x7f0b7401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740b7650 con 0x7f0b84159450 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740b77d0 con 0x7f0b84159450 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740b7b80 con 0x7f0b84159450 2023-07-20T10:05:34.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b84163d10 con 0x7f0b84159450 2023-07-20T10:05:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b840c2e20 con 0x7f0b84159450 2023-07-20T10:05:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.310+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b840c6ae0 con 0x7f0b84159450 2023-07-20T10:05:34.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.314+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b740b3070 con 0x7f0b84159450 2023-07-20T10:05:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.314+0000 7f0b797fa640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 0x7f0b70068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.314+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b7411e650 con 0x7f0b84159450 2023-07-20T10:05:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.314+0000 7f0b88d2b640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 0x7f0b70068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.314+0000 7f0b88d2b640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 0x7f0b70068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b80005680 tx=0x7f0b80003dd0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.318+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b740eb810 con 0x7f0b84159450 2023-07-20T10:05:34.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.518+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0b8404da30 con 0x7f0b84159450 2023-07-20T10:05:34.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.522+0000 7f0b797fa640 1 -- 172.21.15.82:0/2002604609 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0b740eee30 con 0x7f0b84159450 2023-07-20T10:05:34.504 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:05:34.505 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:05:34.505 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:05:34.505 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:05:34.505 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:05:34.505 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:05:34.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 msgr2=0x7f0b70068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 0x7f0b70068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b80005680 tx=0x7f0b80003dd0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 msgr2=0x7f0b84162f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0b7401cd70 tx=0x7f0b7401ad10 comp rx=0 tx=0).stop 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 shutdown_connections 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b841634d0 0x7f0b84158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f0b700663d0 0x7f0b70068890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b84159450 0x7f0b84162f90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 --2- 172.21.15.82:0/2002604609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b840cc3e0 0x7f0b840c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 >> 172.21.15.82:0/2002604609 conn(0x7f0b840cad50 msgr2=0x7f0b84070ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 shutdown_connections 2023-07-20T10:05:34.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.526+0000 7f0b8af8f640 1 -- 172.21.15.82:0/2002604609 wait complete. 2023-07-20T10:05:34.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 Processor -- start 2023-07-20T10:05:34.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 -- start start 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000afda0 0x7f86000ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f860015a8e0 0x7f86000b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86000b2060 0x7f86000b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000b3160 con 0x7f86000b2060 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86000b2ee0 con 0x7f860015a8e0 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f8606f59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000b06c0 con 0x7f86000afda0 2023-07-20T10:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f86054f6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86000b2060 0x7f86000b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f86054f6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f86000b2060 0x7f86000b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38336/0 (socket says 172.21.15.82:38336) 2023-07-20T10:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.682+0000 7f86054f6640 1 -- 172.21.15.82:0/1939921450 learned_addr learned my addr 172.21.15.82:0/1939921450 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f8604cf5640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000afda0 0x7f86000ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f85fffff640 1 --2- 172.21.15.82:0/1939921450 >> v2:172.21.15.183:3300/0 conn(0x7f860015a8e0 0x7f86000b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 -- 172.21.15.82:0/1939921450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000afda0 msgr2=0x7f86000ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000afda0 0x7f86000ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 -- 172.21.15.82:0/1939921450 >> v2:172.21.15.183:3300/0 conn(0x7f860015a8e0 msgr2=0x7f86000b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 --2- 172.21.15.82:0/1939921450 >> v2:172.21.15.183:3300/0 conn(0x7f860015a8e0 0x7f86000b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 -- 172.21.15.82:0/1939921450 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000b12a0 con 0x7f86000b2060 2023-07-20T10:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f86054f6640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000b2060 0x7f86000b0180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f86000cf380 tx=0x7f85f801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f031a78ed72e99f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f85ff7fe640 1 -- 172.21.15.82:0/1939921450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80ab600 con 0x7f86000b2060 2023-07-20T10:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f85ff7fe640 1 -- 172.21.15.82:0/1939921450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f80a7050 con 0x7f86000b2060 2023-07-20T10:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f85ff7fe640 1 -- 172.21.15.82:0/1939921450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80ab980 con 0x7f86000b2060 2023-07-20T10:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f8606f59640 1 -- 172.21.15.82:0/1939921450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000b2060 msgr2=0x7f86000b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.686+0000 7f8606f59640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000b2060 0x7f86000b0180 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f86000cf380 tx=0x7f85f801c3b0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- 172.21.15.82:0/1939921450 shutdown_connections 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- 172.21.15.82:0/1939921450 >> v2:172.21.15.183:3300/0 conn(0x7f860015a8e0 0x7f86000b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000b2060 0x7f86000b0180 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- 172.21.15.82:0/1939921450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000afda0 0x7f86000ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- 172.21.15.82:0/1939921450 >> 172.21.15.82:0/1939921450 conn(0x7f86000cada0 msgr2=0x7f86000cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- 172.21.15.82:0/1939921450 shutdown_connections 2023-07-20T10:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- 172.21.15.82:0/1939921450 wait complete. 2023-07-20T10:05:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 Processor -- start 2023-07-20T10:05:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- start start 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000b2060 0x7f86001579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f860015a8e0 0x7f860006fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c2510 con 0x7f86000afda0 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c2740 con 0x7f860015a8e0 2023-07-20T10:05:34.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8606f59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000c2a20 con 0x7f86000b2060 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38350/0 (socket says 172.21.15.82:38350) 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 -- 172.21.15.82:0/4184688644 learned_addr learned my addr 172.21.15.82:0/4184688644 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f85fffff640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000b2060 0x7f86001579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f86054f6640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f860015a8e0 0x7f860006fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 -- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000b2060 msgr2=0x7f86001579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000b2060 0x7f86001579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 -- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f860015a8e0 msgr2=0x7f860006fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f860015a8e0 0x7f860006fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 -- 172.21.15.82:0/4184688644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80094d0 con 0x7f86000afda0 2023-07-20T10:05:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.690+0000 7f8604cf5640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d800 tx=0x7f85f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00096a0 con 0x7f86000afda0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f0009800 con 0x7f86000afda0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000c2d00 con 0x7f86000afda0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0009b70 con 0x7f86000afda0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86000c32c0 con 0x7f86000afda0 2023-07-20T10:05:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8600073c70 con 0x7f86000afda0 2023-07-20T10:05:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85f0009cd0 con 0x7f86000afda0 2023-07-20T10:05:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 0x7f85ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85f00845c0 con 0x7f86000afda0 2023-07-20T10:05:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.694+0000 7f85fffff640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 0x7f85ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.698+0000 7f85fffff640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 0x7f85ec068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85f4003fd0 tx=0x7f85f40039a0 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.698+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85f0051920 con 0x7f86000afda0 2023-07-20T10:05:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86000ccb10 con 0x7f86000afda0 2023-07-20T10:05:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f85fd7fa640 1 -- 172.21.15.82:0/4184688644 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f85f0054f40 con 0x7f86000afda0 2023-07-20T10:05:34.860 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:34.860 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 msgr2=0x7f85ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 0x7f85ec068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85f4003fd0 tx=0x7f85f40039a0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 msgr2=0x7f86000c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f85f000d800 tx=0x7f85f000dcc0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 shutdown_connections 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f860015a8e0 0x7f860006fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f86000b2060 0x7f86001579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f85ec0663a0 0x7f85ec068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 --2- 172.21.15.82:0/4184688644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86000afda0 0x7f86000c1fd0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 >> 172.21.15.82:0/4184688644 conn(0x7f86000cada0 msgr2=0x7f86000abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 shutdown_connections 2023-07-20T10:05:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:34.878+0000 7f8606f59640 1 -- 172.21.15.82:0/4184688644 wait complete. 2023-07-20T10:05:35.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:05:24.518575+0000', 'modified': '2023-07-20T10:05:28.180096+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6678': {'gid': 6678, 'name': 'b', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6834/1873066176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 1873066176}, {'type': 'v1', 'addr': '172.21.15.183:6834', 'nonce': 1873066176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:05:35.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:05:35.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-20T10:05:35.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.442+0000 7fcbcaf96640 1 Processor -- start 2023-07-20T10:05:35.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.442+0000 7fcbcaf96640 1 -- start start 2023-07-20T10:05:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbcaf96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbcaf96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbc40cc900 0x7fcbc40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbcaf96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc40ccd60 con 0x7fcbc40b2380 2023-07-20T10:05:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbcaf96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc40ad600 con 0x7fcbc40cc900 2023-07-20T10:05:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbcaf96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40ad810 con 0x7fcbc41596b0 2023-07-20T10:05:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbc40cc900 0x7fcbc40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcbc40cc900 0x7fcbc40ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38356/0 (socket says 172.21.15.82:38356) 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbc9533640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcbc40b2380 0x7fcbc40c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54082/0 (socket says 172.21.15.82:54082) 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2505657320 learned_addr learned my addr 172.21.15.82:0/2505657320 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2505657320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 msgr2=0x7fcbc415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2505657320 >> v1:172.21.15.82:6789/0 conn(0x7fcbc40b2380 legacy=0x7fcbc40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2505657320 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc415d0d0 con 0x7fcbc40cc900 2023-07-20T10:05:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/2505657320 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172151590 0 0) 0x7fcbc40ccd60 con 0x7fcbc40b2380 2023-07-20T10:05:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.446+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40cc900 0x7fcbc40ad0c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009870 tx=0x7fcbb401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869a221347ffe81a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/2505657320 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40aa670 con 0x7fcbc40cc900 2023-07-20T10:05:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/2505657320 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40aa7d0 con 0x7fcbc40cc900 2023-07-20T10:05:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/2505657320 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40aab60 con 0x7fcbc40cc900 2023-07-20T10:05:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2505657320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40cc900 msgr2=0x7fcbc40ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40cc900 0x7fcbc40ad0c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009870 tx=0x7fcbb401c510 comp rx=0 tx=0).stop 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2505657320 shutdown_connections 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40cc900 0x7fcbc40ad0c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2505657320 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2505657320 >> 172.21.15.82:0/2505657320 conn(0x7fcbc40cada0 msgr2=0x7fcbc40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2505657320 shutdown_connections 2023-07-20T10:05:35.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2505657320 wait complete. 2023-07-20T10:05:35.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 Processor -- start 2023-07-20T10:05:35.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- start start 2023-07-20T10:05:35.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc40cc900 0x7fcbc4154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc41f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c4980 con 0x7fcbc40b2380 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc4153ef0 con 0x7fcbc40cc900 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbcaf96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40c4050 con 0x7fcbc41596b0 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbc8d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbc8d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38366/0 (socket says 172.21.15.82:38366) 2023-07-20T10:05:35.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.450+0000 7fcbc8d32640 1 -- 172.21.15.82:0/2694799154 learned_addr learned my addr 172.21.15.82:0/2694799154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc9533640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc41f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc40cc900 0x7fcbc4154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 -- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 msgr2=0x7fcbc41f8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc41f8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 -- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc40cc900 msgr2=0x7fcbc4154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc40cc900 0x7fcbc4154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 -- 172.21.15.82:0/2694799154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40094d0 con 0x7fcbc40b2380 2023-07-20T10:05:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000d5f0 tx=0x7fcbc000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbb97fa640 1 -- 172.21.15.82:0/2694799154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00125f0 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbb97fa640 1 -- 172.21.15.82:0/2694799154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0012750 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc40c4330 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbb97fa640 1 -- 172.21.15.82:0/2694799154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0012ae0 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40c1a40 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbb97fa640 1 -- 172.21.15.82:0/2694799154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbc0012c40 con 0x7fcbc40b2380 2023-07-20T10:05:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.454+0000 7fcbb97fa640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 0x7fcbb0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbb97fa640 1 -- 172.21.15.82:0/2694799154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbc0084410 con 0x7fcbc40b2380 2023-07-20T10:05:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 0x7fcbb0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 Processor -- start 2023-07-20T10:05:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- start start 2023-07-20T10:05:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 0x7fcbb0068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ae000 tx=0x7fcbb40a7000 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x564894986100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648948030a0 con 0x56489493be90 2023-07-20T10:05:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564894791e40 con 0x564894985d20 2023-07-20T10:05:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56489478f370 con 0x564894986640 2023-07-20T10:05:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38370/0 (socket says 172.21.15.82:38370) 2023-07-20T10:05:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc8d32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x564894986100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 -- 172.21.15.82:0/2863884733 learned_addr learned my addr 172.21.15.82:0/2863884733 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 -- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 msgr2=0x56489493b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 -- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 msgr2=0x564894986100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x564894986100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 -- 172.21.15.82:0/2863884733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564894486890 con 0x56489493be90 2023-07-20T10:05:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbc9533640 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0072e0 tx=0x7fcbbc0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd19671ea91f7b1f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbaa7fc640 1 -- 172.21.15.82:0/2863884733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc004d80 con 0x56489493be90 2023-07-20T10:05:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbaa7fc640 1 -- 172.21.15.82:0/2863884733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc001c20 con 0x56489493be90 2023-07-20T10:05:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbaa7fc640 1 -- 172.21.15.82:0/2863884733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc001f90 con 0x56489493be90 2023-07-20T10:05:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2863884733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 msgr2=0x56489493c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0072e0 tx=0x7fcbbc0077a0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2863884733 shutdown_connections 2023-07-20T10:05:35.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x56489493c270 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2863884733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x564894986100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2863884733 >> 172.21.15.82:0/2863884733 conn(0x564894933200 msgr2=0x56489493a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2863884733 shutdown_connections 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.458+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2863884733 wait complete. 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- start start 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 Processor -- start 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56489493be90 0x564894946ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x564894947940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489478ac60 con 0x564894985d20 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564894746ae0 con 0x56489493be90 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x564894746780 con 0x564894986640 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 10 client.0 _ll_register_callbacks cb 0x564894927820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38380/0 (socket says 172.21.15.82:38380) 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 -- 172.21.15.82:0/206680633 learned_addr learned my addr 172.21.15.82:0/206680633 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbc9533640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x564894947940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56489493be90 0x564894946ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 -- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 msgr2=0x564894947940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x564894947940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 -- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56489493be90 msgr2=0x564894946ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56489493be90 0x564894946ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 -- 172.21.15.82:0/206680633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc00f040 con 0x564894985d20 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcbb401cdb0 tx=0x7fcbb401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c63d696abad668d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40c5070 con 0x564894985d20 2023-07-20T10:05:35.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56489474afb0 con 0x564894985d20 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbb4003620 con 0x564894985d20 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb40037e0 con 0x564894985d20 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 10 client.6843 fetch_fsmap learned FSMap version 33 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56489474ed10 con 0x564894985d20 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56489474afb0 con 0x564894985d20 2023-07-20T10:05:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcbb40a8050 con 0x564894985d20 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 10 client.6843 fetch_fsmap finished waiting for FSMap version 33 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 10 client.6843 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 20 client.6843 populate_metadata read hostname 'smithi082' 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894948210 0x564894997290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 4 client.6843 mds_command: new command op to 6678 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.462+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 --> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648947b9410 con 0x564894948210 2023-07-20T10:05:35.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894948210 0x564894997290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcba37fe640 10 client.6843 ms_handle_connect on v2:172.21.15.183:6832/1873066176 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894948210 0x564894997290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92b157a0a71cd7e8 server_cookie=fb2cf9131e78cdeb in_seq=0 out_seq=0 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcba37fe640 1 -- 172.21.15.82:0/206680633 <== mds.0 v2:172.21.15.183:6832/1873066176 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5648947b9410 con 0x564894948210 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcba37fe640 10 client.6843 handle_command_reply: tid=0 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 client.6843 shutdown 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 msgr2=0x564894947400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fcbb401cdb0 tx=0x7fcbb401ad50 comp rx=0 tx=0).stop 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 shutdown_connections 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894948210 0x564894997290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x564894947940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x564894947400 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcba37fe640 0 client.6843 ms_handle_reset on v2:172.21.15.183:6832/1873066176 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/206680633 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56489493be90 0x564894946ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 >> 172.21.15.82:0/206680633 conn(0x564894933200 msgr2=0x56489493a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 shutdown_connections 2023-07-20T10:05:35.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 1 -- 172.21.15.82:0/206680633 wait complete. 2023-07-20T10:05:35.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.466+0000 7fcbce2ff000 20 client.6843 trim_cache size 0 max 16384 2023-07-20T10:05:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 Processor -- start 2023-07-20T10:05:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- start start 2023-07-20T10:05:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x56489493d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564894447940 con 0x56489493be90 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x56489478ec60 con 0x564894985d20 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56489493e7a0 con 0x564894986640 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38396/0 (socket says 172.21.15.82:38396) 2023-07-20T10:05:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 -- 172.21.15.82:0/3149433438 learned_addr learned my addr 172.21.15.82:0/3149433438 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc9533640 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x56489493d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 -- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 msgr2=0x56489493d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 -- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 msgr2=0x56489493d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x56489493d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 -- 172.21.15.82:0/3149433438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564894734fa0 con 0x56489493be90 2023-07-20T10:05:35.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000dfb0 tx=0x7fcbc0058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd24c64ffe2018ec server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbaaffd640 1 -- 172.21.15.82:0/3149433438 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0053740 con 0x56489493be90 2023-07-20T10:05:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbaaffd640 1 -- 172.21.15.82:0/3149433438 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc005b0b0 con 0x56489493be90 2023-07-20T10:05:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbaaffd640 1 -- 172.21.15.82:0/3149433438 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc005b220 con 0x56489493be90 2023-07-20T10:05:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- 172.21.15.82:0/3149433438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 msgr2=0x564894985720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000dfb0 tx=0x7fcbc0058040 comp rx=0 tx=0).stop 2023-07-20T10:05:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- 172.21.15.82:0/3149433438 shutdown_connections 2023-07-20T10:05:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x564894986640 0x56489493d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894985d20 0x56489493d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/3149433438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56489493be90 0x564894985720 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- 172.21.15.82:0/3149433438 >> 172.21.15.82:0/3149433438 conn(0x564894933200 msgr2=0x5648949847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- 172.21.15.82:0/3149433438 shutdown_connections 2023-07-20T10:05:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.482+0000 7fcbce2ff000 1 -- 172.21.15.82:0/3149433438 wait complete. 2023-07-20T10:05:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- start start 2023-07-20T10:05:35.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 Processor -- start 2023-07-20T10:05:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56489493be90 0x5648949df850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894986640 0x564894997ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x564894745cc0 con 0x564894985d20 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x564894788470 con 0x564894986640 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x56489478a470 con 0x56489493be90 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 10 client.0 _ll_register_callbacks cb 0x564894802ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:05:35.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38408/0 (socket says 172.21.15.82:38408) 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2974233154 learned_addr learned my addr 172.21.15.82:0/2974233154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56489493be90 0x5648949df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbc9533640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894986640 0x564894997ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56489493be90 msgr2=0x5648949df850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56489493be90 0x5648949df850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894986640 msgr2=0x564894997ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894986640 0x564894997ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 -- 172.21.15.82:0/2974233154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40c1a40 con 0x564894985d20 2023-07-20T10:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbbbfff640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4004610 tx=0x7fcbb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11827de0d65e99c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40aa570 con 0x564894985d20 2023-07-20T10:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbb40043e0 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56489493bd20 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb40c0420 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 10 client.6849 fetch_fsmap learned FSMap version 33 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x564894486cc0 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56489493bd20 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcbb40d1070 con 0x564894985d20 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 10 client.6849 fetch_fsmap finished waiting for FSMap version 33 2023-07-20T10:05:35.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 10 client.6849 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 20 client.6849 populate_metadata read hostname 'smithi082' 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894998430 0x564894998810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 4 client.6849 mds_command: new command op to 6678 tid=0[{"prefix": "status"}] 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 --> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564894751a20 con 0x564894998430 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.486+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894998430 0x564894998810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcba37fe640 10 client.6849 ms_handle_connect on v2:172.21.15.183:6832/1873066176 2023-07-20T10:05:35.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbc8d32640 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894998430 0x564894998810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e5b961f048a67 server_cookie=4f251a7cdd48f6ea in_seq=0 out_seq=0 2023-07-20T10:05:35.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcba37fe640 1 -- 172.21.15.82:0/2974233154 <== mds.0 v2:172.21.15.183:6832/1873066176 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564894751a20 con 0x564894998430 2023-07-20T10:05:35.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcba37fe640 10 client.6849 handle_command_reply: tid=0 2023-07-20T10:05:35.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 client.6849 shutdown 2023-07-20T10:05:35.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 msgr2=0x5648949979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4004610 tx=0x7fcbb4008040 comp rx=0 tx=0).stop 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 shutdown_connections 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:6832/1873066176,v1:172.21.15.183:6834/1873066176] conn(0x564894998430 0x564894998810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564894986640 0x564894997ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564894985d20 0x5648949979b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcba37fe640 0 client.6849 ms_handle_reset on v2:172.21.15.183:6832/1873066176 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 --2- 172.21.15.82:0/2974233154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x56489493be90 0x5648949df850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 >> 172.21.15.82:0/2974233154 conn(0x564894933200 msgr2=0x564894940d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 shutdown_connections 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 1 -- 172.21.15.82:0/2974233154 wait complete. 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbce2ff000 20 client.6849 trim_cache size 0 max 16384 2023-07-20T10:05:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6678, 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:05:35.484 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.356570080999999, 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 33, 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 81, 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 81, 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.315645631999999 2023-07-20T10:05:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 msgr2=0x7fcbb0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 0x7fcbb0068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40ae000 tx=0x7fcbb40a7000 comp rx=0 tx=0).stop 2023-07-20T10:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 msgr2=0x7fcbc4159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000d5f0 tx=0x7fcbc000dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 shutdown_connections 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc41596b0 0x7fcbc41f8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc40cc900 0x7fcbc4154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fcbb00663d0 0x7fcbb0068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 --2- 172.21.15.82:0/2694799154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc40b2380 0x7fcbc4159a90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 >> 172.21.15.82:0/2694799154 conn(0x7fcbc40cada0 msgr2=0x7fcbc406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 shutdown_connections 2023-07-20T10:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.490+0000 7fcbcaf96640 1 -- 172.21.15.82:0/2694799154 wait complete. 2023-07-20T10:05:35.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:05:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.646+0000 7f65e6618640 1 Processor -- start 2023-07-20T10:05:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.646+0000 7f65e6618640 1 -- start start 2023-07-20T10:05:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e6618640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00ad060 0x7f65e015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e6618640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65e00b1170 0x7f65e00b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e6618640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e00cde70 con 0x7f65e00ca040 2023-07-20T10:05:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e6618640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e00cbef0 con 0x7f65e00b1170 2023-07-20T10:05:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e6618640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00ca420 con 0x7f65e00ad060 2023-07-20T10:05:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65e00b1170 0x7f65e00b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65e00b1170 0x7f65e00b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38424/0 (socket says 172.21.15.82:38424) 2023-07-20T10:05:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 -- 172.21.15.82:0/448899068 learned_addr learned my addr 172.21.15.82:0/448899068 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65dffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f65e00ca040 0x7f65e015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54084/0 (socket says 172.21.15.82:54084) 2023-07-20T10:05:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65df7fe640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00ad060 0x7f65e015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 -- 172.21.15.82:0/448899068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00ad060 msgr2=0x7f65e015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00ad060 0x7f65e015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 -- 172.21.15.82:0/448899068 >> v1:172.21.15.82:6789/0 conn(0x7f65e00ca040 legacy=0x7f65e015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.650+0000 7f65e4bb5640 1 -- 172.21.15.82:0/448899068 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00cdb40 con 0x7f65e00b1170 2023-07-20T10:05:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e4bb5640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00b1170 0x7f65e00b1600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009e50 tx=0x7f65d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a581709d14447d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65deffd640 1 -- 172.21.15.82:0/448899068 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80a57c0 con 0x7f65e00b1170 2023-07-20T10:05:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65deffd640 1 -- 172.21.15.82:0/448899068 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d80a5920 con 0x7f65e00b1170 2023-07-20T10:05:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65deffd640 1 -- 172.21.15.82:0/448899068 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80a5cb0 con 0x7f65e00b1170 2023-07-20T10:05:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- 172.21.15.82:0/448899068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00b1170 msgr2=0x7f65e00b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00b1170 0x7f65e00b1600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009e50 tx=0x7f65d801c9e0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- 172.21.15.82:0/448899068 shutdown_connections 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00b1170 0x7f65e00b1600 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 --2- 172.21.15.82:0/448899068 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00ad060 0x7f65e015d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- 172.21.15.82:0/448899068 >> 172.21.15.82:0/448899068 conn(0x7f65e00cada0 msgr2=0x7f65e00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- 172.21.15.82:0/448899068 shutdown_connections 2023-07-20T10:05:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- 172.21.15.82:0/448899068 wait complete. 2023-07-20T10:05:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 Processor -- start 2023-07-20T10:05:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.654+0000 7f65e6618640 1 -- start start 2023-07-20T10:05:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00b1170 0x7f65e0156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e00ca040 0x7f65e0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0162ad0 con 0x7f65e00ad060 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0162db0 con 0x7f65e00ca040 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00ab7b0 con 0x7f65e00b1170 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38430/0 (socket says 172.21.15.82:38430) 2023-07-20T10:05:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 -- 172.21.15.82:0/2953988735 learned_addr learned my addr 172.21.15.82:0/2953988735 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65df7fe640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00b1170 0x7f65e0156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e4bb5640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e00ca040 0x7f65e0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 -- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00b1170 msgr2=0x7f65e0156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00b1170 0x7f65e0156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 -- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e00ca040 msgr2=0x7f65e0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e00ca040 0x7f65e0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 -- 172.21.15.82:0/2953988735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8009b30 con 0x7f65e00ad060 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dffff640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c430 tx=0x7f65d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d00074e0 con 0x7f65e00ad060 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d0007640 con 0x7f65e00ad060 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0004a10 con 0x7f65e00ad060 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e00aba90 con 0x7f65e00ad060 2023-07-20T10:05:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e015d210 con 0x7f65e00ad060 2023-07-20T10:05:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e00ab610 con 0x7f65e00ad060 2023-07-20T10:05:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.658+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65d0004b70 con 0x7f65e00ad060 2023-07-20T10:05:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.662+0000 7f65dcff9640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 0x7f65cc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.662+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65d0083750 con 0x7f65e00ad060 2023-07-20T10:05:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.662+0000 7f65df7fe640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 0x7f65cc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:35.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.662+0000 7f65df7fe640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 0x7f65cc068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65e00c4700 tx=0x7f65d4008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:35.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.666+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65e00ab610 con 0x7f65e00ad060 2023-07-20T10:05:35.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f65e00ab610 con 0x7f65e00ad060 2023-07-20T10:05:35.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65dcff9640 1 -- 172.21.15.82:0/2953988735 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f65e00ab610 con 0x7f65e00ad060 2023-07-20T10:05:35.828 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:05:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 msgr2=0x7f65cc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 0x7f65cc068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f65e00c4700 tx=0x7f65d4008040 comp rx=0 tx=0).stop 2023-07-20T10:05:35.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 msgr2=0x7f65e015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f65d000c430 tx=0x7f65d000c8f0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 shutdown_connections 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65e00ca040 0x7f65e0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65e00b1170 0x7f65e0156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f65cc0663a0 0x7f65cc068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 --2- 172.21.15.82:0/2953988735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65e00ad060 0x7f65e015cb00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 >> 172.21.15.82:0/2953988735 conn(0x7f65e00cada0 msgr2=0x7f65e00703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 shutdown_connections 2023-07-20T10:05:35.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:35.846+0000 7f65e6618640 1 -- 172.21.15.82:0/2953988735 wait complete. 2023-07-20T10:05:35.848 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:05:35.849 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:05:35.849 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:05:35.849 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:05:35.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:35.850 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:05:35.850 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:05:35.851 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:05:35.851 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:05:35.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:35.852 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:05:35.861 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:05:35.861 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:05:35.861 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:05:35.861 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:05:35.863 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:05:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.863 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:05:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41465sec preferred_lft 41465sec 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.864 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.865 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:05:35.866 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:05:35.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:35.868 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:05:35.929 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:05:35.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:35.932 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:05:35.984 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:05:35.984 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:05:35.984 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:05:35.985 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:05:35.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:35.986 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:05:35.986 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:05:35.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:05:35.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:05:35.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:05:35.988 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:05:36.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:36.079 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:05:36.088 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:05:36.088 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:05:36.089 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:05:36.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:36.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:05:36.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:05:36.156 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:36.206 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:05:36.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:05:36.207 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:36.259 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:05:36.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:36.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:05:36.352 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:05:36.352 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:05:36.352 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:05:36.367 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:05:36.367 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:05:36.368 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:05:36.368 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:05:36.368 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:05:36.377 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:05:36.377 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:05:36.377 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:05:36.377 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:05:36.377 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:05:36.378 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:05:36.378 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:05:36.378 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:05:36.380 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:05:36.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:36.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:36.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:36.403 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:05:36.467 INFO:teuthology.orchestra.run.smithi082.stdout:client6484 2023-07-20T10:05:36.468 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:36.468 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:36.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:05:36.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 Processor -- start 2023-07-20T10:05:36.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 -- start start 2023-07-20T10:05:36.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f969415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f96940cc900 0x7f96940ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96940ccd60 con 0x7f96940b2380 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96940ad600 con 0x7f96940cc900 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9699688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96940ad810 con 0x7f96941596b0 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f96937fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f96940b2380 0x7f96940c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54094/0 (socket says 172.21.15.82:54094) 2023-07-20T10:05:36.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f96937fe640 1 -- 172.21.15.82:0/991712789 learned_addr learned my addr 172.21.15.82:0/991712789 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f969415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.722+0000 7f96927fc640 1 --2- 172.21.15.82:0/991712789 >> v2:172.21.15.183:3300/0 conn(0x7f96940cc900 0x7f96940ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758735734 0 0) 0x7f96940ccd60 con 0x7f96940b2380 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f967c005740 con 0x7f96940b2380 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411984040 0 0) 0x7f967c005740 con 0x7f96940b2380 2023-07-20T10:05:36.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 msgr2=0x7f969415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f969415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 >> v2:172.21.15.183:3300/0 conn(0x7f96940cc900 msgr2=0x7f96940ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 --2- 172.21.15.82:0/991712789 >> v2:172.21.15.183:3300/0 conn(0x7f96940cc900 0x7f96940ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969415d0d0 con 0x7f96940b2380 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f968c001680 con 0x7f96940b2380 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f969415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:36.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f96927fc640 1 --2- 172.21.15.82:0/991712789 >> v2:172.21.15.183:3300/0 conn(0x7f96940cc900 0x7f96940ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 >> v1:172.21.15.82:6789/0 conn(0x7f96940b2380 legacy=0x7f96940c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f967c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f967c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f967c006f20 0x7f967c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940ad600 con 0x7f967c005b90 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940ad810 con 0x7f967c006f20 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c00dba0 con 0x7f96941596b0 2023-07-20T10:05:36.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f967c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f96927fc640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f967c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f96937fe640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f967c006f20 0x7f967c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 -- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 msgr2=0x7f967c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96941596b0 0x7f967c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 -- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f967c006f20 msgr2=0x7f967c0073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f967c006f20 0x7f967c0073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f9692ffd640 1 -- 172.21.15.82:0/991712789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009a70 con 0x7f967c005b90 2023-07-20T10:05:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.726+0000 7f96937fe640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f967c006f20 0x7f967c0073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9692ffd640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f967c005fb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f968400e350 tx=0x7f968401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c51cb44aac052d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a5cb0 con 0x7f967c005b90 2023-07-20T10:05:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400f040 con 0x7f967c005b90 2023-07-20T10:05:36.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9691ffb640 1 -- 172.21.15.82:0/991712789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840ad640 con 0x7f967c005b90 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- 172.21.15.82:0/991712789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 msgr2=0x7f967c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 --2- 172.21.15.82:0/991712789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f967c005fb0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f968400e350 tx=0x7f968401cdb0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f96937fe640 1 -- 172.21.15.82:0/991712789 reap_dead start 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- 172.21.15.82:0/991712789 shutdown_connections 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- 172.21.15.82:0/991712789 >> 172.21.15.82:0/991712789 conn(0x7f96940cada0 msgr2=0x7f96940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- 172.21.15.82:0/991712789 shutdown_connections 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- 172.21.15.82:0/991712789 wait complete. 2023-07-20T10:05:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 Processor -- start 2023-07-20T10:05:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- start start 2023-07-20T10:05:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96940c24b0 0x7f969409ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 0x7f96940c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940c36a0 con 0x7f967c005b90 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96940c5db0 con 0x7f96940c53f0 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.730+0000 7f9699688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9694151140 con 0x7f96940c24b0 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38448/0 (socket says 172.21.15.82:38448) 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 -- 172.21.15.82:0/4131002777 learned_addr learned my addr 172.21.15.82:0/4131002777 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:36.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f96927fc640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96940c24b0 0x7f969409ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f96937fe640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 0x7f96940c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 -- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96940c24b0 msgr2=0x7f969409ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96940c24b0 0x7f969409ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 -- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 msgr2=0x7f96940c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 0x7f96940c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 -- 172.21.15.82:0/4131002777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940b2d20 con 0x7f967c005b90 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f96937fe640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 0x7f96940c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:36.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9692ffd640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f968401cbe0 tx=0x7f9684009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840ad980 con 0x7f967c005b90 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840adb20 con 0x7f967c005b90 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96940c2a20 con 0x7f967c005b90 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b6430 con 0x7f967c005b90 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96940c2fe0 con 0x7f967c005b90 2023-07-20T10:05:36.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96940c3910 con 0x7f967c005b90 2023-07-20T10:05:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f96840b4040 con 0x7f967c005b90 2023-07-20T10:05:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 0x7f9680068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.734+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f968411dd00 con 0x7f967c005b90 2023-07-20T10:05:36.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.738+0000 7f96927fc640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 0x7f9680068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:36.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.738+0000 7f96927fc640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 0x7f9680068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96940b0af0 tx=0x7f9688008040 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:36.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.742+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96840eafd0 con 0x7f967c005b90 2023-07-20T10:05:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.906+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f96940b2ba0 con 0x7f96800663a0 2023-07-20T10:05:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.906+0000 7f967b7fe640 1 -- 172.21.15.82:0/4131002777 <== mgr.6417 v2:172.21.15.82:6832/4139035279 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f96880098c0 con 0x7f96800663a0 2023-07-20T10:05:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:05:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:05:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:05:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:05:36.890 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 msgr2=0x7f9680068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 0x7f9680068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f96940b0af0 tx=0x7f9688008040 comp rx=0 tx=0).stop 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 msgr2=0x7f9694150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f968401cbe0 tx=0x7f9684009750 comp rx=0 tx=0).stop 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 shutdown_connections 2023-07-20T10:05:36.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96940c53f0 0x7f96940c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f96940c24b0 0x7f969409ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f96800663a0 0x7f9680068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 --2- 172.21.15.82:0/4131002777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967c005b90 0x7f9694150c00 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 >> 172.21.15.82:0/4131002777 conn(0x7f96940cada0 msgr2=0x7f96940abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 shutdown_connections 2023-07-20T10:05:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:36.910+0000 7f9699688640 1 -- 172.21.15.82:0/4131002777 wait complete. 2023-07-20T10:05:36.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:05:37.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 Processor -- start 2023-07-20T10:05:37.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 -- start start 2023-07-20T10:05:37.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e8159450 0x7fd2e815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2e80afd50 0x7fd2e80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80cc8d0 con 0x7fd2e8159830 2023-07-20T10:05:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e80cce90 con 0x7fd2e80afd50 2023-07-20T10:05:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.070+0000 7fd2ecb00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b0700 con 0x7fd2e8159450 2023-07-20T10:05:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2e80afd50 0x7fd2e80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2e80afd50 0x7fd2e80b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38450/0 (socket says 172.21.15.82:38450) 2023-07-20T10:05:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e8159450 0x7fd2e815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 -- 172.21.15.82:0/3938646088 learned_addr learned my addr 172.21.15.82:0/3938646088 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 -- 172.21.15.82:0/3938646088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e8159450 msgr2=0x7fd2e815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 --2- 172.21.15.82:0/3938646088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e8159450 0x7fd2e815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 -- 172.21.15.82:0/3938646088 >> v1:172.21.15.183:6789/0 conn(0x7fd2e8159830 legacy=0x7fd2e80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 -- 172.21.15.82:0/3938646088 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80ccbb0 con 0x7fd2e80afd50 2023-07-20T10:05:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e6d9d640 1 --2- 172.21.15.82:0/3938646088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e80afd50 0x7fd2e80b01c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00098a0 tx=0x7fd2e001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26f4a676741f12c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e5d9b640 1 -- 172.21.15.82:0/3938646088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00aa650 con 0x7fd2e80afd50 2023-07-20T10:05:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e5d9b640 1 -- 172.21.15.82:0/3938646088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00aa7b0 con 0x7fd2e80afd50 2023-07-20T10:05:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.074+0000 7fd2e5d9b640 1 -- 172.21.15.82:0/3938646088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00aab40 con 0x7fd2e80afd50 2023-07-20T10:05:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- 172.21.15.82:0/3938646088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e80afd50 msgr2=0x7fd2e80b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/3938646088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e80afd50 0x7fd2e80b01c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00098a0 tx=0x7fd2e001c4f0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- 172.21.15.82:0/3938646088 shutdown_connections 2023-07-20T10:05:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/3938646088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e80afd50 0x7fd2e80b01c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/3938646088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e8159450 0x7fd2e815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- 172.21.15.82:0/3938646088 >> 172.21.15.82:0/3938646088 conn(0x7fd2e80cad50 msgr2=0x7fd2e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- 172.21.15.82:0/3938646088 shutdown_connections 2023-07-20T10:05:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- 172.21.15.82:0/3938646088 wait complete. 2023-07-20T10:05:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 Processor -- start 2023-07-20T10:05:37.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- start start 2023-07-20T10:05:37.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e80afd50 0x7fd2e8154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e80c0c80 0x7fd2e80aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80c62b0 con 0x7fd2e8159450 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80c6570 con 0x7fd2e80c0c80 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ecb00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80c6850 con 0x7fd2e80afd50 2023-07-20T10:05:37.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38454/0 (socket says 172.21.15.82:38454) 2023-07-20T10:05:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.078+0000 7fd2ddd9b640 1 -- 172.21.15.82:0/624068673 learned_addr learned my addr 172.21.15.82:0/624068673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 -- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e80afd50 msgr2=0x7fd2e8154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e80afd50 0x7fd2e8154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 -- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e80c0c80 msgr2=0x7fd2e80aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e80c0c80 0x7fd2e80aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 -- 172.21.15.82:0/624068673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00094d0 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ddd9b640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c7a0 tx=0x7fd2d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0003b80 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0003ce0 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000aa90 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80c6b30 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e80c70f0 con 0x7fd2e8159450 2023-07-20T10:05:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e804da30 con 0x7fd2e8159450 2023-07-20T10:05:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 31) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2d000abf0 con 0x7fd2e8159450 2023-07-20T10:05:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 0x7fd2c8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2d0083d40 con 0x7fd2e8159450 2023-07-20T10:05:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.082+0000 7fd2e659c640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 0x7fd2c8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.086+0000 7fd2e659c640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 0x7fd2c8068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006aa0 tx=0x7fd2d8006a30 comp rx=0 tx=0).ready entity=mgr.6417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:37.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.086+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2d0051010 con 0x7fd2e8159450 2023-07-20T10:05:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:37.270+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd2e8167430 con 0x7fd2e8159450 2023-07-20T10:05:38.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.022+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 32) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd2d00b4700 con 0x7fd2e8159450 2023-07-20T10:05:38.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.026+0000 7fd2df7fe640 1 -- 172.21.15.82:0/624068673 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd2d006f530 con 0x7fd2e8159450 2023-07-20T10:05:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 msgr2=0x7fd2c8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 0x7fd2c8068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006aa0 tx=0x7fd2d8006a30 comp rx=0 tx=0).stop 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 msgr2=0x7fd2e80c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c7a0 tx=0x7fd2d000cc60 comp rx=0 tx=0).stop 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 shutdown_connections 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2e80c0c80 0x7fd2e80aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fd2c80663a0 0x7fd2c8068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2e8159450 0x7fd2e80c5d70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 --2- 172.21.15.82:0/624068673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2e80afd50 0x7fd2e8154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 >> 172.21.15.82:0/624068673 conn(0x7fd2e80cad50 msgr2=0x7fd2e80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 shutdown_connections 2023-07-20T10:05:38.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.030+0000 7fd2ecb00640 1 -- 172.21.15.82:0/624068673 wait complete. 2023-07-20T10:05:38.033 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:05:38.176 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:38.196+0000 7f432def7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.198+0000 7fb91bb03640 1 Processor -- start 2023-07-20T10:05:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 -- start start 2023-07-20T10:05:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb91406c120 0x7fb9140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9141602b0 0x7fb914160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9140d0970 con 0x7fb91406ab10 2023-07-20T10:05:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb914160e20 con 0x7fb91406c120 2023-07-20T10:05:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91bb03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9140cd300 con 0x7fb9141602b0 2023-07-20T10:05:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91a0a0640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb91406ab10 0x7fb91406af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54100/0 (socket says 172.21.15.82:54100) 2023-07-20T10:05:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91a0a0640 1 -- 172.21.15.82:0/1532366715 learned_addr learned my addr 172.21.15.82:0/1532366715 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91989f640 1 --2- 172.21.15.82:0/1532366715 >> v2:172.21.15.183:3300/0 conn(0x7fb91406c120 0x7fb9140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91909e640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9141602b0 0x7fb914160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91889d640 1 -- 172.21.15.82:0/1532366715 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983113882 0 0) 0x7fb9140d0970 con 0x7fb91406ab10 2023-07-20T10:05:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91889d640 1 -- 172.21.15.82:0/1532366715 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb900003530 con 0x7fb91406ab10 2023-07-20T10:05:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91989f640 1 -- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9141602b0 msgr2=0x7fb914160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91989f640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9141602b0 0x7fb914160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91989f640 1 -- 172.21.15.82:0/1532366715 >> v1:172.21.15.82:6789/0 conn(0x7fb91406ab10 legacy=0x7fb91406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.202+0000 7fb91989f640 1 -- 172.21.15.82:0/1532366715 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140cd5e0 con 0x7fb91406c120 2023-07-20T10:05:38.188 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fe19f377180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91989f640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb91406c120 0x7fb9140cdde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9100097c0 tx=0x7fb91001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d04b6a64cd66c3c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91889d640 1 -- 172.21.15.82:0/1532366715 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100ab600 con 0x7fb91406c120 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91889d640 1 -- 172.21.15.82:0/1532366715 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9100a7050 con 0x7fb91406c120 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91889d640 1 -- 172.21.15.82:0/1532366715 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100ab960 con 0x7fb91406c120 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 -- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb91406c120 msgr2=0x7fb9140cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb91406c120 0x7fb9140cdde0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9100097c0 tx=0x7fb91001c3f0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 -- 172.21.15.82:0/1532366715 shutdown_connections 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb9141602b0 0x7fb914160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1532366715 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb91406c120 0x7fb9140cdde0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 -- 172.21.15.82:0/1532366715 >> 172.21.15.82:0/1532366715 conn(0x7fb91408c0a0 msgr2=0x7fb91409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 -- 172.21.15.82:0/1532366715 shutdown_connections 2023-07-20T10:05:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.206+0000 7fb91bb03640 1 -- 172.21.15.82:0/1532366715 wait complete. 2023-07-20T10:05:38.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 Processor -- start 2023-07-20T10:05:38.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- start start 2023-07-20T10:05:38.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 0x7fb91415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9141602b0 0x7fb9140c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91415a5e0 con 0x7fb91406c120 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409f550 con 0x7fb9141602b0 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91409e940 con 0x7fb91406ab10 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91909e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91909e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38484/0 (socket says 172.21.15.82:38484) 2023-07-20T10:05:38.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91909e640 1 -- 172.21.15.82:0/1830657732 learned_addr learned my addr 172.21.15.82:0/1830657732 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 0x7fb91415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91a0a0640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9141602b0 0x7fb9140c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 -- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9141602b0 msgr2=0x7fb9140c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9141602b0 0x7fb9140c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 -- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 msgr2=0x7fb9140c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 -- 172.21.15.82:0/1830657732 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb910009420 con 0x7fb91406ab10 2023-07-20T10:05:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91909e640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91989f640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 0x7fb91415a0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb91408cc00 tx=0x7fb910019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910003ab0 con 0x7fb91406ab10 2023-07-20T10:05:38.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910003c10 con 0x7fb91406ab10 2023-07-20T10:05:38.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9100b5410 con 0x7fb91406ab10 2023-07-20T10:05:38.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91409ec20 con 0x7fb91406ab10 2023-07-20T10:05:38.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.210+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91409f1e0 con 0x7fb91406ab10 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91404da30 con 0x7fb91406ab10 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 32) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb9100b2050 con 0x7fb91406ab10 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb90a7fc640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 0x7fb8f80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb91011e6b0 con 0x7fb91406ab10 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb91909e640 1 -- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 msgr2=0x7fb8f80688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:38.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.214+0000 7fb91909e640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 0x7fb8f80688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:38.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.218+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9100ebb50 con 0x7fb91406ab10 2023-07-20T10:05:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.370+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb91409f690 con 0x7fb91406ab10 2023-07-20T10:05:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.378+0000 7fb90a7fc640 1 -- 172.21.15.82:0/1830657732 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb9100ef170 con 0x7fb91406ab10 2023-07-20T10:05:38.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 msgr2=0x7fb8f80688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 0x7fb8f80688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 msgr2=0x7fb91415a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 0x7fb91415a0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb91408cc00 tx=0x7fb910019190 comp rx=0 tx=0).stop 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 shutdown_connections 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9141602b0 0x7fb9140c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fb8f80663f0 0x7fb8f80688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91406c120 0x7fb9140c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 --2- 172.21.15.82:0/1830657732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb91406ab10 0x7fb91415a0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 >> 172.21.15.82:0/1830657732 conn(0x7fb91408c0a0 msgr2=0x7fb9140b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 shutdown_connections 2023-07-20T10:05:38.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.382+0000 7fb91bb03640 1 -- 172.21.15.82:0/1830657732 wait complete. 2023-07-20T10:05:38.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:05:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 Processor -- start 2023-07-20T10:05:38.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 -- start start 2023-07-20T10:05:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fca1406c120 0x7fca140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fca141602b0 0x7fca14160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca140d0970 con 0x7fca1406ab10 2023-07-20T10:05:38.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca14160e20 con 0x7fca1406c120 2023-07-20T10:05:38.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca19e6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca140cd300 con 0x7fca141602b0 2023-07-20T10:05:38.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca137fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fca1406c120 0x7fca140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca13fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca1406ab10 0x7fca1406af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54116/0 (socket says 172.21.15.82:54116) 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca13fff640 1 -- 172.21.15.82:0/1341843298 learned_addr learned my addr 172.21.15.82:0/1341843298 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca12ffd640 1 --2- 172.21.15.82:0/1341843298 >> v2:172.21.15.183:3300/0 conn(0x7fca141602b0 0x7fca14160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca137fe640 1 -- 172.21.15.82:0/1341843298 >> v2:172.21.15.183:3300/0 conn(0x7fca141602b0 msgr2=0x7fca14160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca137fe640 1 --2- 172.21.15.82:0/1341843298 >> v2:172.21.15.183:3300/0 conn(0x7fca141602b0 0x7fca14160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca137fe640 1 -- 172.21.15.82:0/1341843298 >> v1:172.21.15.82:6789/0 conn(0x7fca1406ab10 legacy=0x7fca1406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.546+0000 7fca137fe640 1 -- 172.21.15.82:0/1341843298 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca140cd5e0 con 0x7fca1406c120 2023-07-20T10:05:38.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca137fe640 1 --2- 172.21.15.82:0/1341843298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cdde0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fca1408ca40 tx=0x7fca0401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef7a3d5cc6d97ee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca127fc640 1 -- 172.21.15.82:0/1341843298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040ab600 con 0x7fca1406c120 2023-07-20T10:05:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca127fc640 1 -- 172.21.15.82:0/1341843298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca040a7050 con 0x7fca1406c120 2023-07-20T10:05:38.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca127fc640 1 -- 172.21.15.82:0/1341843298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040ab980 con 0x7fca1406c120 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 -- 172.21.15.82:0/1341843298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 msgr2=0x7fca140cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 --2- 172.21.15.82:0/1341843298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cdde0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fca1408ca40 tx=0x7fca0401c310 comp rx=0 tx=0).stop 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 -- 172.21.15.82:0/1341843298 shutdown_connections 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 --2- 172.21.15.82:0/1341843298 >> v2:172.21.15.183:3300/0 conn(0x7fca141602b0 0x7fca14160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 --2- 172.21.15.82:0/1341843298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cdde0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 -- 172.21.15.82:0/1341843298 >> 172.21.15.82:0/1341843298 conn(0x7fca1408c0a0 msgr2=0x7fca1409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 -- 172.21.15.82:0/1341843298 shutdown_connections 2023-07-20T10:05:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.550+0000 7fca19e6d640 1 -- 172.21.15.82:0/1341843298 wait complete. 2023-07-20T10:05:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 Processor -- start 2023-07-20T10:05:38.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- start start 2023-07-20T10:05:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca1414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca1406c120 0x7fca1414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1414b930 con 0x7fca141602b0 2023-07-20T10:05:38.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1414dde0 con 0x7fca1406ab10 2023-07-20T10:05:38.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1414c800 con 0x7fca1406c120 2023-07-20T10:05:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca137fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca1414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38502/0 (socket says 172.21.15.82:38502) 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 -- 172.21.15.82:0/4218694619 learned_addr learned my addr 172.21.15.82:0/4218694619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca12ffd640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca1406c120 0x7fca1414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 -- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca1406c120 msgr2=0x7fca1414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca1406c120 0x7fca1414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 -- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 msgr2=0x7fca1414b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca1414b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 -- 172.21.15.82:0/4218694619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04009420 con 0x7fca141602b0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca137fe640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca1414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca13fff640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00cbc0 tx=0x7fca0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00ad40 con 0x7fca141602b0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c012400 con 0x7fca141602b0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c00aea0 con 0x7fca141602b0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1414cae0 con 0x7fca141602b0 2023-07-20T10:05:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.554+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1414d0a0 con 0x7fca141602b0 2023-07-20T10:05:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1404da30 con 0x7fca141602b0 2023-07-20T10:05:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fca0c007070 con 0x7fca141602b0 2023-07-20T10:05:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fc9fbfff640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 0x7fca000688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca0c083e80 con 0x7fca141602b0 2023-07-20T10:05:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fca137fe640 1 -- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 msgr2=0x7fca000688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.558+0000 7fca137fe640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 0x7fca000688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.562+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca0c051180 con 0x7fca141602b0 2023-07-20T10:05:38.599 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:38.620+0000 7f432def7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:38.620 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:38.638+0000 7fe19f377180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.714+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fca1406b400 con 0x7fca141602b0 2023-07-20T10:05:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.718+0000 7fc9fbfff640 1 -- 172.21.15.82:0/4218694619 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7fca0c0547a0 con 0x7fca141602b0 2023-07-20T10:05:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 msgr2=0x7fca000688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 0x7fca000688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 msgr2=0x7fca140b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00cbc0 tx=0x7fca0c00a430 comp rx=0 tx=0).stop 2023-07-20T10:05:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 shutdown_connections 2023-07-20T10:05:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7fca000663f0 0x7fca000688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca141602b0 0x7fca140b0640 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca1406c120 0x7fca1414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 --2- 172.21.15.82:0/4218694619 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca1414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 >> 172.21.15.82:0/4218694619 conn(0x7fca1408c0a0 msgr2=0x7fca140d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 shutdown_connections 2023-07-20T10:05:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.722+0000 7fca19e6d640 1 -- 172.21.15.82:0/4218694619 wait complete. 2023-07-20T10:05:38.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:38.724 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T10:05:38.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-20T10:05:38.755 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:38.776+0000 7f432def7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:38.776 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:38.794+0000 7fe19f377180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:38.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.938+0000 7f94c4cca640 1 Processor -- start 2023-07-20T10:05:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.938+0000 7f94c4cca640 1 -- start start 2023-07-20T10:05:38.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94c4cca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c00ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94c4cca640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94c00ad580 0x7f94c00b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94c4cca640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c0160390 con 0x7f94c0160820 2023-07-20T10:05:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94c4cca640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c00b0670 con 0x7f94c00ad580 2023-07-20T10:05:38.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94c4cca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00cc1d0 con 0x7f94c00afd50 2023-07-20T10:05:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94c00ad580 0x7f94c00b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94c00ad580 0x7f94c00b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38512/0 (socket says 172.21.15.82:38512) 2023-07-20T10:05:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 -- 172.21.15.82:0/2017980480 learned_addr learned my addr 172.21.15.82:0/2017980480 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:38.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94be59c640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c00ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 -- 172.21.15.82:0/2017980480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 msgr2=0x7f94c00ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c00ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 -- 172.21.15.82:0/2017980480 >> v1:172.21.15.82:6789/0 conn(0x7f94c0160820 legacy=0x7f94c0160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.942+0000 7f94b7fff640 1 -- 172.21.15.82:0/2017980480 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00cc4b0 con 0x7f94c00ad580 2023-07-20T10:05:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94b7fff640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c00b0130 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009870 tx=0x7f94a801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf80be457cd3432 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94bdd9b640 1 -- 172.21.15.82:0/2017980480 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80aa610 con 0x7f94c00ad580 2023-07-20T10:05:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94bdd9b640 1 -- 172.21.15.82:0/2017980480 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a80a6040 con 0x7f94c00ad580 2023-07-20T10:05:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94bdd9b640 1 -- 172.21.15.82:0/2017980480 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80aa990 con 0x7f94c00ad580 2023-07-20T10:05:38.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- 172.21.15.82:0/2017980480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 msgr2=0x7f94c00b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c00b0130 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009870 tx=0x7f94a801c510 comp rx=0 tx=0).stop 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- 172.21.15.82:0/2017980480 shutdown_connections 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c00b0130 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 --2- 172.21.15.82:0/2017980480 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c00ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- 172.21.15.82:0/2017980480 >> 172.21.15.82:0/2017980480 conn(0x7f94c00cad50 msgr2=0x7f94c00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:38.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- 172.21.15.82:0/2017980480 shutdown_connections 2023-07-20T10:05:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- 172.21.15.82:0/2017980480 wait complete. 2023-07-20T10:05:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 Processor -- start 2023-07-20T10:05:38.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.946+0000 7f94c4cca640 1 -- start start 2023-07-20T10:05:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c0157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c0156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c0160820 0x7f94c01446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0156660 con 0x7f94c00ad580 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0144c00 con 0x7f94c0160820 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c0156890 con 0x7f94c00afd50 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c0157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c0157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38526/0 (socket says 172.21.15.82:38526) 2023-07-20T10:05:38.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 -- 172.21.15.82:0/515516066 learned_addr learned my addr 172.21.15.82:0/515516066 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c0156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94bed9d640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c0160820 0x7f94c01446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 msgr2=0x7f94c0156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94c00afd50 0x7f94c0156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c0160820 msgr2=0x7f94c01446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94c0160820 0x7f94c01446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80094d0 con 0x7f94c00ad580 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94be59c640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94c00ad580 0x7f94c0157ef0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f94b000e930 tx=0x7f94b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:38.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0009690 con 0x7f94c00ad580 2023-07-20T10:05:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000ca00 con 0x7f94c00ad580 2023-07-20T10:05:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c0156b70 con 0x7f94c00ad580 2023-07-20T10:05:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000cd70 con 0x7f94c00ad580 2023-07-20T10:05:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c0157130 con 0x7f94c00ad580 2023-07-20T10:05:38.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94c4cca640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c004da30 con 0x7f94c00ad580 2023-07-20T10:05:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.950+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 32) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f94b0013470 con 0x7f94c00ad580 2023-07-20T10:05:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.954+0000 7f94b6ffd640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.954+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f94b0084150 con 0x7f94c00ad580 2023-07-20T10:05:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.954+0000 7f94b7fff640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 msgr2=0x7f94a00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.954+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:38.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:38.958+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94b0051590 con 0x7f94c00ad580 2023-07-20T10:05:39.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:39.130+0000 7f94c4cca640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f94c015d1e0 con 0x7f94a00663f0 2023-07-20T10:05:39.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:39.158+0000 7f94b7fff640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 msgr2=0x7f94a00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:39.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:39.158+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:05:39.244 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.264+0000 7f432def7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:39.268 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.286+0000 7fe19f377180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:39.303 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.324+0000 7f432def7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:39.326 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.346+0000 7fe19f377180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:39.359 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.380+0000 7f432def7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:39.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.398+0000 7fe19f377180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:39.445 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.468+0000 7f432def7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:39.467 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.486+0000 7fe19f377180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:39.502 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.524+0000 7f432def7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:39.525 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.542+0000 7fe19f377180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:39.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:39.562+0000 7f94b7fff640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 msgr2=0x7f94a00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:39.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:39.562+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:05:39.586 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.608+0000 7f432def7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:39.609 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.626+0000 7fe19f377180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:39.642 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.664+0000 7f432def7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:39.665 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.682+0000 7fe19f377180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:39.785 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.808+0000 7f432def7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:39.805 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.822+0000 7fe19f377180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:39.844 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:39.864+0000 7f432def7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:39.863 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:39.882+0000 7fe19f377180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:40.085 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:40.085 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:40.085 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:40.093 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:40.116+0000 7f432def7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:40.103 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:40.104 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:40.104 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:40.112 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:40.130+0000 7fe19f377180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:40.230 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:40.252+0000 7f432def7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:40.248 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:40.266+0000 7fe19f377180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:40.366+0000 7f94b7fff640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 msgr2=0x7f94a00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4139035279 2023-07-20T10:05:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:40.366+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:05:40.356 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:40.380+0000 7f432def7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:40.373 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:40.390+0000 7fe19f377180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:40.427 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:40.448+0000 7f432def7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:40.443 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:40.462+0000 7fe19f377180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:40.562 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:40.584+0000 7f432def7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:40.576 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:40.594+0000 7fe19f377180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:41.109 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.132+0000 7f432def7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:41.110 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.130+0000 7fe19f377180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:41.198 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.218+0000 7fe19f377180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:41.199 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.220+0000 7f432def7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:41.344 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.362+0000 7fe19f377180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:41.348 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.368+0000 7f432def7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:41.427 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.446+0000 7fe19f377180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:41.432 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.452+0000 7f432def7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:41.694 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.714+0000 7fe19f377180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:41.704 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.728+0000 7f432def7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:41.754 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.774+0000 7fe19f377180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:41.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:41.782+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 33) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f94b0051960 con 0x7f94c00ad580 2023-07-20T10:05:41.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:41.782+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 msgr2=0x7f94a00688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:41.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:41.782+0000 7f94b6ffd640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/4139035279,v1:172.21.15.82:6833/4139035279] conn(0x7f94a00663f0 0x7f94a00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:41.768 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:41.792+0000 7f432def7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:41.879 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1253a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.879 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1253a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.879 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1253a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.879 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1253a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.880 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1253a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.880 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1223a3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.880 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1223a3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.880 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1223a3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.880 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1223a3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:41.881 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:41.898+0000 7fe1223a3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:42.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.790+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 34) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f94b00059a0 con 0x7f94c00ad580 2023-07-20T10:05:42.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.790+0000 7f94b6ffd640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f94a0033e90 0x7f94a00708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:42.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.790+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 --> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f94a0034270 con 0x7f94a0033e90 2023-07-20T10:05:42.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.794+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f94a0033e90 0x7f94a00708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:42.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.794+0000 7f94b7fff640 1 --2- 172.21.15.82:0/515516066 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f94a0033e90 0x7f94a00708d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f94a80ae000 tx=0x7f94a80a7000 comp rx=0 tx=0).ready entity=mgr.6888 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:42.786 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:42.806+0000 7fe12c3b7640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-20T10:05:42.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:42.806+0000 7f94b6ffd640 1 -- 172.21.15.82:0/515516066 <== mgr.6888 v2:172.21.15.82:6832/3872476705 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f94a0034270 con 0x7f94a0033e90 2023-07-20T10:05:42.787 INFO:teuthology.orchestra.run.smithi082.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-20T10:05:42.795 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-20T10:05:42.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:42.797 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T10:05:42.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:05:42.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 Processor -- start 2023-07-20T10:05:42.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 -- start start 2023-07-20T10:05:42.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff05c160f30 0x7ff05c0ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c160390 con 0x7ff05c0ad580 2023-07-20T10:05:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0cc1d0 con 0x7ff05c0afd50 2023-07-20T10:05:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff060f82640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0cc4b0 con 0x7ff05c160f30 2023-07-20T10:05:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff051d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff05c0ad580 0x7ff05c160820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54130/0 (socket says 172.21.15.82:54130) 2023-07-20T10:05:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff051d9b640 1 -- 172.21.15.82:0/957769987 learned_addr learned my addr 172.21.15.82:0/957769987 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff05ad9d640 1 --2- 172.21.15.82:0/957769987 >> v2:172.21.15.183:3300/0 conn(0x7ff05c160f30 0x7ff05c0ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:42.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff059d9b640 1 -- 172.21.15.82:0/957769987 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212081244 0 0) 0x7ff05c160390 con 0x7ff05c0ad580 2023-07-20T10:05:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff059d9b640 1 -- 172.21.15.82:0/957769987 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff048003530 con 0x7ff05c0ad580 2023-07-20T10:05:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff05ad9d640 1 -- 172.21.15.82:0/957769987 >> v1:172.21.15.183:6789/0 conn(0x7ff05c0afd50 legacy=0x7ff05c0b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff05ad9d640 1 -- 172.21.15.82:0/957769987 >> v1:172.21.15.82:6789/0 conn(0x7ff05c0ad580 legacy=0x7ff05c160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.014+0000 7ff05ad9d640 1 -- 172.21.15.82:0/957769987 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0cc790 con 0x7ff05c160f30 2023-07-20T10:05:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff05ad9d640 1 --2- 172.21.15.82:0/957769987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c160f30 0x7ff05c0ac770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff054009d90 tx=0x7ff05401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b1663520971176 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff059d9b640 1 -- 172.21.15.82:0/957769987 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a59b0 con 0x7ff05c160f30 2023-07-20T10:05:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff059d9b640 1 -- 172.21.15.82:0/957769987 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0540a5b10 con 0x7ff05c160f30 2023-07-20T10:05:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff059d9b640 1 -- 172.21.15.82:0/957769987 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a5ea0 con 0x7ff05c160f30 2023-07-20T10:05:43.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 -- 172.21.15.82:0/957769987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c160f30 msgr2=0x7ff05c0ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 --2- 172.21.15.82:0/957769987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c160f30 0x7ff05c0ac770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff054009d90 tx=0x7ff05401c950 comp rx=0 tx=0).stop 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 -- 172.21.15.82:0/957769987 shutdown_connections 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 --2- 172.21.15.82:0/957769987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c160f30 0x7ff05c0ac770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 -- 172.21.15.82:0/957769987 >> 172.21.15.82:0/957769987 conn(0x7ff05c0cad50 msgr2=0x7ff05c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 -- 172.21.15.82:0/957769987 shutdown_connections 2023-07-20T10:05:43.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.018+0000 7ff060f82640 1 -- 172.21.15.82:0/957769987 wait complete. 2023-07-20T10:05:43.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 Processor -- start 2023-07-20T10:05:43.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 -- start start 2023-07-20T10:05:43.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c0ad580 0x7ff05c1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff05c160f30 0x7ff05c1f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0c5780 con 0x7ff05c0afd50 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0c5a60 con 0x7ff05c0ad580 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c155450 con 0x7ff05c160f30 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:43.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38654/0 (socket says 172.21.15.82:38654) 2023-07-20T10:05:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 -- 172.21.15.82:0/2977363769 learned_addr learned my addr 172.21.15.82:0/2977363769 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff05ad9d640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff05c160f30 0x7ff05c1f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:43.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff05a59c640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c0ad580 0x7ff05c1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:43.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 -- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff05c160f30 msgr2=0x7ff05c1f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:43.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff05c160f30 0x7ff05c1f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 -- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c0ad580 msgr2=0x7ff05c1f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:43.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c0ad580 0x7ff05c1f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 -- 172.21.15.82:0/2977363769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff054009a70 con 0x7ff05c0afd50 2023-07-20T10:05:43.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff051d9b640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c4d0 tx=0x7ff04400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:43.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044005cf0 con 0x7ff05c0afd50 2023-07-20T10:05:43.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044005e50 con 0x7ff05c0afd50 2023-07-20T10:05:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044007270 con 0x7ff05c0afd50 2023-07-20T10:05:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.022+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c155730 con 0x7ff05c0afd50 2023-07-20T10:05:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1f7ff0 con 0x7ff05c0afd50 2023-07-20T10:05:43.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c04da30 con 0x7ff05c0afd50 2023-07-20T10:05:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 34) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff0440073d0 con 0x7ff05c0afd50 2023-07-20T10:05:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff0537fe640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff044083030 con 0x7ff05c0afd50 2023-07-20T10:05:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff05a59c640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:43.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.026+0000 7ff05a59c640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 0x7ff03c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff05c160ec0 tx=0x7ff04c009040 comp rx=0 tx=0).ready entity=mgr.6888 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:43.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.030+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff044050740 con 0x7ff05c0afd50 2023-07-20T10:05:43.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.214+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff05c0cbaf0 con 0x7ff05c0afd50 2023-07-20T10:05:43.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.802+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7ff044050b10 con 0x7ff05c0afd50 2023-07-20T10:05:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.802+0000 7ff0537fe640 1 -- 172.21.15.82:0/2977363769 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff044070740 con 0x7ff05c0afd50 2023-07-20T10:05:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 msgr2=0x7ff03c0685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 0x7ff03c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff05c160ec0 tx=0x7ff04c009040 comp rx=0 tx=0).stop 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 msgr2=0x7ff05c1f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c4d0 tx=0x7ff04400c990 comp rx=0 tx=0).stop 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 shutdown_connections 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff05c160f30 0x7ff05c1f82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff05c0afd50 0x7ff05c1f57c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 --2- 172.21.15.82:0/2977363769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05c0ad580 0x7ff05c1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 >> 172.21.15.82:0/2977363769 conn(0x7ff05c0cad50 msgr2=0x7ff05c157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 shutdown_connections 2023-07-20T10:05:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:43.806+0000 7ff060f82640 1 -- 172.21.15.82:0/2977363769 wait complete. 2023-07-20T10:05:43.809 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:05:43.809 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:43.865 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:43.923 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:05:43.988 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:43.989 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:43.990 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:43.974+0000 7ff3895e6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:43.990 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:43.972+0000 7f9f4e123180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:05:43.998 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:43.999 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:44.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:44.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 Processor -- start 2023-07-20T10:05:44.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 -- start start 2023-07-20T10:05:44.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97380cd480 0x7f973815c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f973806da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973815d460 con 0x7f973806df50 2023-07-20T10:05:44.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973806e400 con 0x7f97380cd480 2023-07-20T10:05:44.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973da0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973815d740 con 0x7f973815cf30 2023-07-20T10:05:44.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97380cd480 0x7f973815c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f97380cd480 0x7f973815c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55866/0 (socket says 172.21.15.82:55866) 2023-07-20T10:05:44.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 -- 172.21.15.82:0/490363732 learned_addr learned my addr 172.21.15.82:0/490363732 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:44.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f9737fff640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f973806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 -- 172.21.15.82:0/490363732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 msgr2=0x7f973806da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:44.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f973806da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 -- 172.21.15.82:0/490363732 >> v1:172.21.15.82:6789/0 conn(0x7f973806df50 legacy=0x7f9738160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f973ca09640 1 -- 172.21.15.82:0/490363732 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973806a9e0 con 0x7f97380cd480 2023-07-20T10:05:44.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.254+0000 7f97377fe640 1 -- 172.21.15.82:0/490363732 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424485861 0 0) 0x7f973815d460 con 0x7f973806df50 2023-07-20T10:05:44.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973ca09640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97380cd480 0x7f973815c9f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f972c009870 tx=0x7f972c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02853c04e871d27 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f97377fe640 1 -- 172.21.15.82:0/490363732 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab650 con 0x7f97380cd480 2023-07-20T10:05:44.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f97377fe640 1 -- 172.21.15.82:0/490363732 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0ab7b0 con 0x7f97380cd480 2023-07-20T10:05:44.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f97377fe640 1 -- 172.21.15.82:0/490363732 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0abb40 con 0x7f97380cd480 2023-07-20T10:05:44.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 -- 172.21.15.82:0/490363732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97380cd480 msgr2=0x7f973815c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97380cd480 0x7f973815c9f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f972c009870 tx=0x7f972c01c540 comp rx=0 tx=0).stop 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 -- 172.21.15.82:0/490363732 shutdown_connections 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f973806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 --2- 172.21.15.82:0/490363732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97380cd480 0x7f973815c9f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 -- 172.21.15.82:0/490363732 >> 172.21.15.82:0/490363732 conn(0x7f97380b1e50 msgr2=0x7f97380b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 -- 172.21.15.82:0/490363732 shutdown_connections 2023-07-20T10:05:44.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.258+0000 7f973da0b640 1 -- 172.21.15.82:0/490363732 wait complete. 2023-07-20T10:05:44.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 Processor -- start 2023-07-20T10:05:44.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- start start 2023-07-20T10:05:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97380cd480 0x7f97380b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f97381577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b3e50 con 0x7f973806df50 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b4060 con 0x7f97380cd480 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b4340 con 0x7f973815cf30 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55876/0 (socket says 172.21.15.82:55876) 2023-07-20T10:05:44.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 -- 172.21.15.82:0/380076684 learned_addr learned my addr 172.21.15.82:0/380076684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f9737fff640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97380cd480 0x7f97380b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973d20a640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f97381577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 -- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 msgr2=0x7f97381577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f97381577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 -- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97380cd480 msgr2=0x7f97380b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97380cd480 0x7f97380b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 -- 172.21.15.82:0/380076684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0094d0 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973ca09640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f972c0ad040 tx=0x7f972c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0abd30 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0b8070 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c004220 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380b4620 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380b4be0 con 0x7f973806df50 2023-07-20T10:05:44.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.262+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973804da30 con 0x7f973806df50 2023-07-20T10:05:44.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.266+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f972c004380 con 0x7f973806df50 2023-07-20T10:05:44.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.266+0000 7f97357fa640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 0x7f971c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.266+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f972c11df90 con 0x7f973806df50 2023-07-20T10:05:44.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.266+0000 7f9737fff640 1 -- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 msgr2=0x7f971c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:44.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.266+0000 7f9737fff640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 0x7f971c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:44.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.270+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f972c0eb2d0 con 0x7f973806df50 2023-07-20T10:05:44.369 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:44.392+0000 7f9f4e123180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:44.388 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:44.406+0000 7ff3895e6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:05:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.422+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f973806fb20 con 0x7f973806df50 2023-07-20T10:05:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.422+0000 7f97357fa640 1 -- 172.21.15.82:0/380076684 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18767 (secure 0 0 0) 0x7f972c0ba020 con 0x7f973806df50 2023-07-20T10:05:44.405 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:44.405 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:41.778070+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/329177331":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3805426120":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/997612192":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6833/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6832/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/1637149210":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/115575575":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3471734032":"2023-07-21T10:05:41.778040+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 msgr2=0x7f971c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 0x7f971c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 msgr2=0x7f97380cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f972c0ad040 tx=0x7f972c01ad80 comp rx=0 tx=0).stop 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 shutdown_connections 2023-07-20T10:05:44.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f971c0663a0 0x7f971c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f973815cf30 0x7f97381577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f97380cd480 0x7f97380b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 --2- 172.21.15.82:0/380076684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f973806df50 0x7f97380cc800 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 >> 172.21.15.82:0/380076684 conn(0x7f97380b1e50 msgr2=0x7f97380ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:44.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 shutdown_connections 2023-07-20T10:05:44.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.426+0000 7f973da0b640 1 -- 172.21.15.82:0/380076684 wait complete. 2023-07-20T10:05:44.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:05:22.193275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:05:23.515835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:44.427 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:44.519 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:44.540+0000 7f9f4e123180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:44.544 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:44.562+0000 7ff3895e6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:05:44.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.590+0000 7f46c5e48640 1 Processor -- start 2023-07-20T10:05:44.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.590+0000 7f46c5e48640 1 -- start start 2023-07-20T10:05:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46c5e48640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c006c120 0x7f46c00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46c5e48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00d0970 con 0x7f46c01602b0 2023-07-20T10:05:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46c5e48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c0160e20 con 0x7f46c006b220 2023-07-20T10:05:44.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46c5e48640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00cd300 con 0x7f46c006c120 2023-07-20T10:05:44.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46bf7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f46c006c120 0x7f46c00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46beffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46c01602b0 0x7f46c006ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47850/0 (socket says 172.21.15.82:47850) 2023-07-20T10:05:44.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46beffd640 1 -- 172.21.15.82:0/780587871 learned_addr learned my addr 172.21.15.82:0/780587871 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:44.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46bf7fe640 1 -- 172.21.15.82:0/780587871 >> v1:172.21.15.183:6789/0 conn(0x7f46c006b220 legacy=0x7f46c00d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46bf7fe640 1 -- 172.21.15.82:0/780587871 >> v1:172.21.15.82:6789/0 conn(0x7f46c01602b0 legacy=0x7f46c006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46bf7fe640 1 -- 172.21.15.82:0/780587871 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00cd5e0 con 0x7f46c006c120 2023-07-20T10:05:44.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.594+0000 7f46be7fc640 1 -- 172.21.15.82:0/780587871 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821850514 0 0) 0x7f46c00d0970 con 0x7f46c01602b0 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46bf7fe640 1 --2- 172.21.15.82:0/780587871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00cdde0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f46b00097c0 tx=0x7f46b001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9776a0a57cb2408 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46be7fc640 1 -- 172.21.15.82:0/780587871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0004230 con 0x7f46c006c120 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46be7fc640 1 -- 172.21.15.82:0/780587871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b00a7050 con 0x7f46c006c120 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46be7fc640 1 -- 172.21.15.82:0/780587871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0003620 con 0x7f46c006c120 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- 172.21.15.82:0/780587871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 msgr2=0x7f46c00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 --2- 172.21.15.82:0/780587871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00cdde0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f46b00097c0 tx=0x7f46b001c330 comp rx=0 tx=0).stop 2023-07-20T10:05:44.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- 172.21.15.82:0/780587871 shutdown_connections 2023-07-20T10:05:44.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 --2- 172.21.15.82:0/780587871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00cdde0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- 172.21.15.82:0/780587871 >> 172.21.15.82:0/780587871 conn(0x7f46c008c0a0 msgr2=0x7f46c009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:44.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- 172.21.15.82:0/780587871 shutdown_connections 2023-07-20T10:05:44.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- 172.21.15.82:0/780587871 wait complete. 2023-07-20T10:05:44.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 Processor -- start 2023-07-20T10:05:44.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.598+0000 7f46c5e48640 1 -- start start 2023-07-20T10:05:44.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c006b220 0x7f46c01519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c01602b0 0x7f46c00b7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c014e350 con 0x7f46c006c120 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00b84c0 con 0x7f46c01602b0 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0153f10 con 0x7f46c006b220 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55892/0 (socket says 172.21.15.82:55892) 2023-07-20T10:05:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 -- 172.21.15.82:0/3224820508 learned_addr learned my addr 172.21.15.82:0/3224820508 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46bffff640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c01602b0 0x7f46c00b7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46bf7fe640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c006b220 0x7f46c01519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 -- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c006b220 msgr2=0x7f46c01519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c006b220 0x7f46c01519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 -- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c01602b0 msgr2=0x7f46c00b7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c01602b0 0x7f46c00b7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 -- 172.21.15.82:0/3224820508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0009420 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46beffd640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c410 tx=0x7f46b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40074e0 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4007640 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01541b0 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4004a30 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0154770 con 0x7f46c006c120 2023-07-20T10:05:44.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.602+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0155730 con 0x7f46c006c120 2023-07-20T10:05:44.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.606+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f46b4004b90 con 0x7f46c006c120 2023-07-20T10:05:44.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.606+0000 7f46a7fff640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 0x7f46ac068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.606+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f46b4083cb0 con 0x7f46c006c120 2023-07-20T10:05:44.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.606+0000 7f46bf7fe640 1 -- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 msgr2=0x7f46ac068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:44.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.606+0000 7f46bf7fe640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 0x7f46ac068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:44.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.614+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46b4050f70 con 0x7f46c006c120 2023-07-20T10:05:44.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.762+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46c004da30 con 0x7f46c006c120 2023-07-20T10:05:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46a7fff640 1 -- 172.21.15.82:0/3224820508 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46b4054590 con 0x7f46c006c120 2023-07-20T10:05:44.746 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 msgr2=0x7f46ac068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 0x7f46ac068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 msgr2=0x7f46c00b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c410 tx=0x7f46b400c8d0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 shutdown_connections 2023-07-20T10:05:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f46ac0663d0 0x7f46ac068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46c01602b0 0x7f46c00b7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46c006c120 0x7f46c00b0730 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 --2- 172.21.15.82:0/3224820508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46c006b220 0x7f46c01519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 >> 172.21.15.82:0/3224820508 conn(0x7f46c008c0a0 msgr2=0x7f46c00b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 shutdown_connections 2023-07-20T10:05:44.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.766+0000 7f46c5e48640 1 -- 172.21.15.82:0/3224820508 wait complete. 2023-07-20T10:05:44.768 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:44.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 Processor -- start 2023-07-20T10:05:44.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 -- start start 2023-07-20T10:05:44.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 0x7f08f80cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08f815dfd0 0x7f08f80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f815af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f815aae0 con 0x7f08f815dfd0 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f815e4d0 con 0x7f08f80cce60 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08fdbdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f815e7b0 con 0x7f08f80cfaa0 2023-07-20T10:05:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08f6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08f815dfd0 0x7f08f80ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08f6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08f815dfd0 0x7f08f80ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55898/0 (socket says 172.21.15.82:55898) 2023-07-20T10:05:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.930+0000 7f08f6ffd640 1 -- 172.21.15.82:0/1192512086 learned_addr learned my addr 172.21.15.82:0/1192512086 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f7fff640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f77fe640 1 --2- 172.21.15.82:0/1192512086 >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 0x7f08f80cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 -- 172.21.15.82:0/1192512086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 msgr2=0x7f08f815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f815af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 -- 172.21.15.82:0/1192512086 >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 msgr2=0x7f08f80cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 --2- 172.21.15.82:0/1192512086 >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 0x7f08f80cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 -- 172.21.15.82:0/1192512086 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f815ea90 con 0x7f08f815dfd0 2023-07-20T10:05:44.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f77fe640 1 --2- 172.21.15.82:0/1192512086 >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 0x7f08f80cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f6ffd640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f80ce1b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f08f80b22a0 tx=0x7f08ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c1a6cc02564b97 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f67fc640 1 -- 172.21.15.82:0/1192512086 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0ab670 con 0x7f08f815dfd0 2023-07-20T10:05:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f67fc640 1 -- 172.21.15.82:0/1192512086 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec0ab7d0 con 0x7f08f815dfd0 2023-07-20T10:05:44.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.934+0000 7f08f67fc640 1 -- 172.21.15.82:0/1192512086 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0abb60 con 0x7f08f815dfd0 2023-07-20T10:05:44.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- 172.21.15.82:0/1192512086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 msgr2=0x7f08f80ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f80ce1b0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f08f80b22a0 tx=0x7f08ec01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- 172.21.15.82:0/1192512086 shutdown_connections 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/1192512086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f80ce1b0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/1192512086 >> v2:172.21.15.183:3300/0 conn(0x7f08f80cce60 0x7f08f80cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- 172.21.15.82:0/1192512086 >> 172.21.15.82:0/1192512086 conn(0x7f08f8065310 msgr2=0x7f08f8065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- 172.21.15.82:0/1192512086 shutdown_connections 2023-07-20T10:05:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- 172.21.15.82:0/1192512086 wait complete. 2023-07-20T10:05:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 Processor -- start 2023-07-20T10:05:44.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- start start 2023-07-20T10:05:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 0x7f08f8153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f80c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f806aa70 con 0x7f08f815dfd0 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80ca0b0 con 0x7f08f80cce60 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08fdbdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80ca390 con 0x7f08f80cfaa0 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55904/0 (socket says 172.21.15.82:55904) 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 -- 172.21.15.82:0/3499155684 learned_addr learned my addr 172.21.15.82:0/3499155684 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f6ffd640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f80c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f77fe640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 0x7f08f8153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 -- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 msgr2=0x7f08f80c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f80c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 -- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 msgr2=0x7f08f8153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 0x7f08f8153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f7fff640 1 -- 172.21.15.82:0/3499155684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0094d0 con 0x7f08f815dfd0 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f6ffd640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f80c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:44.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.938+0000 7f08f77fe640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 0x7f08f8153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08f7fff640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f08f000efc0 tx=0x7f08f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0014480 con 0x7f08f815dfd0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000f040 con 0x7f08f815dfd0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0014820 con 0x7f08f815dfd0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f80ca670 con 0x7f08f815dfd0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f80c9b40 con 0x7f08f815dfd0 2023-07-20T10:05:44.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f806a860 con 0x7f08f815dfd0 2023-07-20T10:05:44.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f08f0014980 con 0x7f08f815dfd0 2023-07-20T10:05:44.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 0x7f08e4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:44.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f08f0084cc0 con 0x7f08f815dfd0 2023-07-20T10:05:44.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08f77fe640 1 -- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 msgr2=0x7f08e4068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:44.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.942+0000 7f08f77fe640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 0x7f08e4068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:44.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:44.946+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08f0051dc0 con 0x7f08f815dfd0 2023-07-20T10:05:44.997 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.020+0000 7f9f4e123180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:45.056 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.076+0000 7f9f4e123180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:45.060 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.078+0000 7ff3895e6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:45.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.106+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08f80ca860 con 0x7f08f815dfd0 2023-07-20T10:05:45.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.106+0000 7f08dffff640 1 -- 172.21.15.82:0/3499155684 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v82) v1 ==== 92+0+10 (secure 0 0 0) 0x7f08f0018020 con 0x7f08f815dfd0 2023-07-20T10:05:45.089 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:45.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 msgr2=0x7f08e4068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:45.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 0x7f08e4068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 msgr2=0x7f08f81f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f08f000efc0 tx=0x7f08f000c490 comp rx=0 tx=0).stop 2023-07-20T10:05:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 shutdown_connections 2023-07-20T10:05:45.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f08e40663d0 0x7f08e4068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08f815dfd0 0x7f08f81f8cc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08f80cfaa0 0x7f08f80c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 --2- 172.21.15.82:0/3499155684 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08f80cce60 0x7f08f8153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 >> 172.21.15.82:0/3499155684 conn(0x7f08f8065310 msgr2=0x7f08f80d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 shutdown_connections 2023-07-20T10:05:45.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.110+0000 7f08fdbdf640 1 -- 172.21.15.82:0/3499155684 wait complete. 2023-07-20T10:05:45.111 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.132+0000 7f9f4e123180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:45.112 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:05:45.122 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.142+0000 7ff3895e6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:05:45.181 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.198+0000 7ff3895e6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:05:45.196 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.220+0000 7f9f4e123180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:45.254 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.276+0000 7f9f4e123180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 Processor -- start 2023-07-20T10:05:45.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 -- start start 2023-07-20T10:05:45.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671406c120 0x7f67140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140d0970 con 0x7f671406b220 2023-07-20T10:05:45.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6714160e20 con 0x7f67141602b0 2023-07-20T10:05:45.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671ad8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140cd300 con 0x7f671406c120 2023-07-20T10:05:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671406c120 0x7f67140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f671406c120 0x7f67140cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55920/0 (socket says 172.21.15.82:55920) 2023-07-20T10:05:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 -- 172.21.15.82:0/3770316894 learned_addr learned my addr 172.21.15.82:0/3770316894 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f671932c640 1 --1- 172.21.15.82:0/3770316894 >> v1:172.21.15.82:6789/0 conn(0x7f671406b220 0x7f67140d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47856/0 (socket says 172.21.15.82:47856) 2023-07-20T10:05:45.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 -- 172.21.15.82:0/3770316894 >> v1:172.21.15.183:6789/0 conn(0x7f67141602b0 legacy=0x7f671406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 -- 172.21.15.82:0/3770316894 >> v1:172.21.15.82:6789/0 conn(0x7f671406b220 legacy=0x7f67140d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.278+0000 7f6718b2b640 1 -- 172.21.15.82:0/3770316894 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140cd5e0 con 0x7f671406c120 2023-07-20T10:05:45.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f6718b2b640 1 --2- 172.21.15.82:0/3770316894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f67140cdde0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6708009870 tx=0x7f670801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc8a1b0a6be6b7f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:45.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f67137fe640 1 -- 172.21.15.82:0/3770316894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080ab610 con 0x7f671406c120 2023-07-20T10:05:45.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f67137fe640 1 -- 172.21.15.82:0/3770316894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080ab770 con 0x7f671406c120 2023-07-20T10:05:45.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f67137fe640 1 -- 172.21.15.82:0/3770316894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080abb00 con 0x7f671406c120 2023-07-20T10:05:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 -- 172.21.15.82:0/3770316894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 msgr2=0x7f67140cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 --2- 172.21.15.82:0/3770316894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f67140cdde0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6708009870 tx=0x7f670801c3f0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 -- 172.21.15.82:0/3770316894 shutdown_connections 2023-07-20T10:05:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 --2- 172.21.15.82:0/3770316894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f67140cdde0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 -- 172.21.15.82:0/3770316894 >> 172.21.15.82:0/3770316894 conn(0x7f671408c0a0 msgr2=0x7f671409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 -- 172.21.15.82:0/3770316894 shutdown_connections 2023-07-20T10:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.282+0000 7f671ad8f640 1 -- 172.21.15.82:0/3770316894 wait complete. 2023-07-20T10:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 Processor -- start 2023-07-20T10:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- start start 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f671406b220 0x7f671414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67141602b0 0x7f6714157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671414e960 con 0x7f671406c120 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671415cc70 con 0x7f671406b220 2023-07-20T10:05:45.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671415c660 con 0x7f67141602b0 2023-07-20T10:05:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55922/0 (socket says 172.21.15.82:55922) 2023-07-20T10:05:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 -- 172.21.15.82:0/2483754673 learned_addr learned my addr 172.21.15.82:0/2483754673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6718b2b640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f671406b220 0x7f671414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671932c640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67141602b0 0x7f6714157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 -- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67141602b0 msgr2=0x7f6714157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67141602b0 0x7f6714157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 -- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f671406b220 msgr2=0x7f671414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f671406b220 0x7f671414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 -- 172.21.15.82:0/2483754673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080094d0 con 0x7f671406c120 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f6713fff640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f670000c3f0 tx=0x7f670000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000052d0 con 0x7f671406c120 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700005430 con 0x7f671406c120 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700003840 con 0x7f671406c120 2023-07-20T10:05:45.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67140b74c0 con 0x7f671406c120 2023-07-20T10:05:45.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.286+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671415c900 con 0x7f671406c120 2023-07-20T10:05:45.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671415ce00 con 0x7f671406c120 2023-07-20T10:05:45.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f67000039a0 con 0x7f671406c120 2023-07-20T10:05:45.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f67117fa640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 0x7f66f8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f6718b2b640 1 -- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 msgr2=0x7f66f8068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:45.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f67000834c0 con 0x7f671406c120 2023-07-20T10:05:45.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.290+0000 7f6718b2b640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 0x7f66f8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:45.275 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.290+0000 7ff3895e6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:05:45.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.294+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6700050780 con 0x7f671406c120 2023-07-20T10:05:45.332 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.350+0000 7ff3895e6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:05:45.339 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.360+0000 7f9f4e123180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:45.395 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.416+0000 7f9f4e123180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:45.418 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.434+0000 7ff3895e6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:05:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f671404da30 con 0x7f671406c120 2023-07-20T10:05:45.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f67117fa640 1 -- 172.21.15.82:0/2483754673 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6700053da0 con 0x7f671406c120 2023-07-20T10:05:45.427 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:05:45.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 msgr2=0x7f66f8068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 0x7f66f8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 msgr2=0x7f6714157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f670000c3f0 tx=0x7f670000c8b0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 shutdown_connections 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f66f80663a0 0x7f66f8068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67141602b0 0x7f6714157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f671406c120 0x7f6714157340 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 --2- 172.21.15.82:0/2483754673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f671406b220 0x7f671414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 >> 172.21.15.82:0/2483754673 conn(0x7f671408c0a0 msgr2=0x7f67140af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 shutdown_connections 2023-07-20T10:05:45.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.446+0000 7f671ad8f640 1 -- 172.21.15.82:0/2483754673 wait complete. 2023-07-20T10:05:45.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:05:45.477 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.494+0000 7ff3895e6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:05:45.537 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.560+0000 7f9f4e123180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:45.595 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.616+0000 7f9f4e123180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 Processor -- start 2023-07-20T10:05:45.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 -- start start 2023-07-20T10:05:45.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f487c1602b0 0x7f487c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0ce4f0 con 0x7f487c06c120 2023-07-20T10:05:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c06b4a0 con 0x7f487c1602b0 2023-07-20T10:05:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.638+0000 7f4880e48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0d0970 con 0x7f487c06ab10 2023-07-20T10:05:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f487a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f487c06c120 0x7f487c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47858/0 (socket says 172.21.15.82:47858) 2023-07-20T10:05:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f487a59c640 1 -- 172.21.15.82:0/1970324420 learned_addr learned my addr 172.21.15.82:0/1970324420 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 --2- 172.21.15.82:0/1970324420 >> v2:172.21.15.183:3300/0 conn(0x7f487c1602b0 0x7f487c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f487ad9d640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4879d9b640 1 -- 172.21.15.82:0/1970324420 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719287643 0 0) 0x7f487c0ce4f0 con 0x7f487c06c120 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4879d9b640 1 -- 172.21.15.82:0/1970324420 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4868003530 con 0x7f487c06c120 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 -- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 msgr2=0x7f487c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 -- 172.21.15.82:0/1970324420 >> v1:172.21.15.82:6789/0 conn(0x7f487c06c120 legacy=0x7f487c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 -- 172.21.15.82:0/1970324420 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c160e20 con 0x7f487c1602b0 2023-07-20T10:05:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f487ad9d640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:45.625 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.642+0000 7ff3895e6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:05:45.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.642+0000 7f4873fff640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c1602b0 0x7f487c160740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48640097c0 tx=0x7f486401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca7850d51827bcbe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4879d9b640 1 -- 172.21.15.82:0/1970324420 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640ac620 con 0x7f487c1602b0 2023-07-20T10:05:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4879d9b640 1 -- 172.21.15.82:0/1970324420 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48640ac780 con 0x7f487c1602b0 2023-07-20T10:05:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4879d9b640 1 -- 172.21.15.82:0/1970324420 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640acb10 con 0x7f487c1602b0 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c1602b0 msgr2=0x7f487c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c1602b0 0x7f487c160740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48640097c0 tx=0x7f486401c3c0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- 172.21.15.82:0/1970324420 shutdown_connections 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- 172.21.15.82:0/1970324420 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c1602b0 0x7f487c160740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- 172.21.15.82:0/1970324420 >> 172.21.15.82:0/1970324420 conn(0x7f487c08c0a0 msgr2=0x7f487c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- 172.21.15.82:0/1970324420 shutdown_connections 2023-07-20T10:05:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- 172.21.15.82:0/1970324420 wait complete. 2023-07-20T10:05:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 Processor -- start 2023-07-20T10:05:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- start start 2023-07-20T10:05:45.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 0x7f487c14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 0x7f487c1f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b03c0 con 0x7f487c1602b0 2023-07-20T10:05:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b0e90 con 0x7f487c06c120 2023-07-20T10:05:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.646+0000 7f4880e48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b05f0 con 0x7f487c06ab10 2023-07-20T10:05:45.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4873fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 0x7f487c14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 0x7f487c1f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4873fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 0x7f487c14a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:50722/0 (socket says 172.21.15.82:50722) 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4873fff640 1 -- 172.21.15.82:0/686687878 learned_addr learned my addr 172.21.15.82:0/686687878 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:60952/0 (socket says 172.21.15.82:60952) 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 -- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 msgr2=0x7f487c14a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 0x7f487c14a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 -- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 msgr2=0x7f487c1f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 0x7f487c1f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 -- 172.21.15.82:0/686687878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009a70 con 0x7f487c06ab10 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487ad9d640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 0x7f487c1f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f487a59c640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c400 tx=0x7f486c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c005cf0 con 0x7f487c06ab10 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c005e50 con 0x7f487c06ab10 2023-07-20T10:05:45.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4864009420 con 0x7f487c06ab10 2023-07-20T10:05:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0072d0 con 0x7f487c06ab10 2023-07-20T10:05:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c0b0bb0 con 0x7f487c06ab10 2023-07-20T10:05:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.650+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c04da30 con 0x7f487c06ab10 2023-07-20T10:05:45.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.654+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f486c007430 con 0x7f487c06ab10 2023-07-20T10:05:45.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.654+0000 7f4872ffd640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 0x7f485c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.654+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f486c083480 con 0x7f487c06ab10 2023-07-20T10:05:45.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.654+0000 7f4873fff640 1 -- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 msgr2=0x7f485c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:45.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.654+0000 7f4873fff640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 0x7f485c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:45.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.658+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f486c050740 con 0x7f487c06ab10 2023-07-20T10:05:45.687 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.706+0000 7ff3895e6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:05:45.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.806+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f487c0cee40 con 0x7f487c06ab10 2023-07-20T10:05:45.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.806+0000 7f4872ffd640 1 -- 172.21.15.82:0/686687878 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f486c053d60 con 0x7f487c06ab10 2023-07-20T10:05:45.790 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:05:45.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 msgr2=0x7f485c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:45.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 0x7f485c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 msgr2=0x7f487c0afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f486c00c400 tx=0x7f486c00c800 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 shutdown_connections 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f485c0663a0 0x7f485c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f487c1602b0 0x7f487c1f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f487c06c120 0x7f487c14a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 --2- 172.21.15.82:0/686687878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f487c06ab10 0x7f487c0afe80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 >> 172.21.15.82:0/686687878 conn(0x7f487c08c0a0 msgr2=0x7f487c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:45.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 shutdown_connections 2023-07-20T10:05:45.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:45.810+0000 7f4880e48640 1 -- 172.21.15.82:0/686687878 wait complete. 2023-07-20T10:05:45.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:05:45.838 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:45.838 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:45.839 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:45.846 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:45.868+0000 7f9f4e123180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:45.940 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:05:45.940 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:05:45.941 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:05:45.949 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:45.966+0000 7ff3895e6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:05:45.981 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.004+0000 7f9f4e123180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:45.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.006+0000 7f6bb4ecb640 1 Processor -- start 2023-07-20T10:05:45.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.006+0000 7f6bb4ecb640 1 -- start start 2023-07-20T10:05:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bb4ecb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6bb015cab0 0x7f6bb00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bb4ecb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bb00ce4c0 0x7f6bb00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bb4ecb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb00d16b0 con 0x7f6bb00d0d10 2023-07-20T10:05:45.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bb4ecb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb00d31c0 con 0x7f6bb00ce4c0 2023-07-20T10:05:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bb4ecb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb00b3520 con 0x7f6bb015cab0 2023-07-20T10:05:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bb00ce4c0 0x7f6bb00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6bb00ce4c0 0x7f6bb00d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55940/0 (socket says 172.21.15.82:55940) 2023-07-20T10:05:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 -- 172.21.15.82:0/338533361 learned_addr learned my addr 172.21.15.82:0/338533361 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:45.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6ba7fff640 1 --1- 172.21.15.82:0/338533361 >> v1:172.21.15.82:6789/0 conn(0x7f6bb00d0d10 0x7f6bb00cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47862/0 (socket says 172.21.15.82:47862) 2023-07-20T10:05:45.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6bae59c640 1 --2- 172.21.15.82:0/338533361 >> v2:172.21.15.183:3300/0 conn(0x7f6bb015cab0 0x7f6bb00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:45.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 -- 172.21.15.82:0/338533361 >> v2:172.21.15.183:3300/0 conn(0x7f6bb015cab0 msgr2=0x7f6bb00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 --2- 172.21.15.82:0/338533361 >> v2:172.21.15.183:3300/0 conn(0x7f6bb015cab0 0x7f6bb00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 -- 172.21.15.82:0/338533361 >> v1:172.21.15.82:6789/0 conn(0x7f6bb00d0d10 legacy=0x7f6bb00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6baed9d640 1 -- 172.21.15.82:0/338533361 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00b2910 con 0x7f6bb00ce4c0 2023-07-20T10:05:45.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.010+0000 7f6badd9b640 1 -- 172.21.15.82:0/338533361 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650711379 0 0) 0x7f6bb00d16b0 con 0x7f6bb00d0d10 2023-07-20T10:05:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6baed9d640 1 --2- 172.21.15.82:0/338533361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00d1170 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6bb006a660 tx=0x7f6ba801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18be749a9cedf2d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6badd9b640 1 -- 172.21.15.82:0/338533361 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a5780 con 0x7f6bb00ce4c0 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6badd9b640 1 -- 172.21.15.82:0/338533361 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba80a58e0 con 0x7f6bb00ce4c0 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6badd9b640 1 -- 172.21.15.82:0/338533361 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80a5c70 con 0x7f6bb00ce4c0 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/338533361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 msgr2=0x7f6bb00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/338533361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00d1170 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6bb006a660 tx=0x7f6ba801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/338533361 shutdown_connections 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/338533361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00d1170 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/338533361 >> v2:172.21.15.183:3300/0 conn(0x7f6bb015cab0 0x7f6bb00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/338533361 >> 172.21.15.82:0/338533361 conn(0x7f6bb008c120 msgr2=0x7f6bb009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/338533361 shutdown_connections 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/338533361 wait complete. 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 Processor -- start 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.014+0000 7f6bb4ecb640 1 -- start start 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bb00d0d10 0x7f6bb0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bb015cab0 0x7f6bb015f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015fcb0 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015f9d0 con 0x7f6bb00d0d10 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b5450 con 0x7f6bb015cab0 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55946/0 (socket says 172.21.15.82:55946) 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 -- 172.21.15.82:0/1671903130 learned_addr learned my addr 172.21.15.82:0/1671903130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6ba7fff640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bb00d0d10 0x7f6bb0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6baed9d640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bb015cab0 0x7f6bb015f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 -- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bb015cab0 msgr2=0x7f6bb015f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bb015cab0 0x7f6bb015f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 -- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bb00d0d10 msgr2=0x7f6bb0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bb00d0d10 0x7f6bb0157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 -- 172.21.15.82:0/1671903130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8009b30 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bae59c640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e870 tx=0x7f6ba000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0009510 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000eec0 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb00b5730 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000cb40 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb00b6470 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb0073c70 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.018+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f6ba000cca0 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.022+0000 7f6ba6ffd640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 0x7f6b90068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.022+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6ba0084110 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.022+0000 7f6ba7fff640 1 -- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 msgr2=0x7f6b90068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:46.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.022+0000 7f6ba7fff640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 0x7f6b90068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:46.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.026+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ba0051330 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.090 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:46.110+0000 7ff3895e6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:46.108 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.128+0000 7f9f4e123180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6bb00d05e0 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6ba6ffd640 1 -- 172.21.15.82:0/1671903130 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v82) v1 ==== 80+0+467 (secure 0 0 0) 0x7f6ba0054950 con 0x7f6bb00ce4c0 2023-07-20T10:05:46.171 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/329177331 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.171 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3805426120 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/997612192 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/4139035279 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/4139035279 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1637149210 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/115575575 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.172 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3471734032 2023-07-21T10:05:41.778040+0000 2023-07-20T10:05:46.173 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 msgr2=0x7f6b90068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 0x7f6b90068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 msgr2=0x7f6bb00b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000e870 tx=0x7f6ba000ec70 comp rx=0 tx=0).stop 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 shutdown_connections 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f6b900663a0 0x7f6b90068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bb015cab0 0x7f6bb015f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bb00d0d10 0x7f6bb0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 --2- 172.21.15.82:0/1671903130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bb00ce4c0 0x7f6bb00b5f30 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 >> 172.21.15.82:0/1671903130 conn(0x7f6bb008c120 msgr2=0x7f6bb006b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 shutdown_connections 2023-07-20T10:05:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.190+0000 7f6bb4ecb640 1 -- 172.21.15.82:0/1671903130 wait complete. 2023-07-20T10:05:46.178 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.200+0000 7f9f4e123180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:46.191 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:05:46.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:46.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:05:46.224 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:46.242+0000 7ff3895e6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:05:46.270 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:05:46.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:05:46.271 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:05:46.296 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:46.314+0000 7ff3895e6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:05:46.305 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:46.305 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:46.314 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.336+0000 7f9f4e123180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:46.315 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:46.315 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:46.315 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:46.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:46.354 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:46.355 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:46.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:46.365 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:46.434 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:46.450+0000 7ff3895e6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:05:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.554+0000 7f79c8abd640 1 Processor -- start 2023-07-20T10:05:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.554+0000 7f79c8abd640 1 -- start start 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c8abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c8abd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 0x7f79c40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c8abd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c40d16b0 con 0x7f79c415cab0 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c8abd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c40d31c0 con 0x7f79c40cd4b0 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c8abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c40b3520 con 0x7f79c40d0d10 2023-07-20T10:05:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f79c415cab0 0x7f79c40d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47878/0 (socket says 172.21.15.82:47878) 2023-07-20T10:05:46.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c259c640 1 -- 172.21.15.82:0/3476413886 learned_addr learned my addr 172.21.15.82:0/3476413886 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:46.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c2d9d640 1 --2- 172.21.15.82:0/3476413886 >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 0x7f79c40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/3476413886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c159a640 1 -- 172.21.15.82:0/3476413886 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024029084 0 0) 0x7f79c40d16b0 con 0x7f79c415cab0 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c159a640 1 -- 172.21.15.82:0/3476413886 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac003530 con 0x7f79c415cab0 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c1d9b640 1 -- 172.21.15.82:0/3476413886 >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 msgr2=0x7f79c40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/3476413886 >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 0x7f79c40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c1d9b640 1 -- 172.21.15.82:0/3476413886 >> v1:172.21.15.82:6789/0 conn(0x7f79c415cab0 legacy=0x7f79c40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c1d9b640 1 -- 172.21.15.82:0/3476413886 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40d0a10 con 0x7f79c40d0d10 2023-07-20T10:05:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.558+0000 7f79c2d9d640 1 --2- 172.21.15.82:0/3476413886 >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 0x7f79c40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:46.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/3476413886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40d1170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097c0 tx=0x7f79b801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a15597f970d4fc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:46.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c159a640 1 -- 172.21.15.82:0/3476413886 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80ab650 con 0x7f79c40d0d10 2023-07-20T10:05:46.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c159a640 1 -- 172.21.15.82:0/3476413886 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b80ab7b0 con 0x7f79c40d0d10 2023-07-20T10:05:46.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c159a640 1 -- 172.21.15.82:0/3476413886 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b80abb40 con 0x7f79c40d0d10 2023-07-20T10:05:46.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 -- 172.21.15.82:0/3476413886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 msgr2=0x7f79c40d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 --2- 172.21.15.82:0/3476413886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40d1170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79b80097c0 tx=0x7f79b801c450 comp rx=0 tx=0).stop 2023-07-20T10:05:46.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 -- 172.21.15.82:0/3476413886 shutdown_connections 2023-07-20T10:05:46.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 --2- 172.21.15.82:0/3476413886 >> v2:172.21.15.82:3300/0 conn(0x7f79c40cd4b0 0x7f79c40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 --2- 172.21.15.82:0/3476413886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40d1170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 -- 172.21.15.82:0/3476413886 >> 172.21.15.82:0/3476413886 conn(0x7f79c408c120 msgr2=0x7f79c409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:46.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 -- 172.21.15.82:0/3476413886 shutdown_connections 2023-07-20T10:05:46.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.562+0000 7f79c8abd640 1 -- 172.21.15.82:0/3476413886 wait complete. 2023-07-20T10:05:46.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 Processor -- start 2023-07-20T10:05:46.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- start start 2023-07-20T10:05:46.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40cd4b0 0x7f79c4153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41f49d0 con 0x7f79c415cab0 2023-07-20T10:05:46.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c4154030 con 0x7f79c40cd4b0 2023-07-20T10:05:46.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c41f4c00 con 0x7f79c40d0d10 2023-07-20T10:05:46.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55968/0 (socket says 172.21.15.82:55968) 2023-07-20T10:05:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 -- 172.21.15.82:0/2464240808 learned_addr learned my addr 172.21.15.82:0/2464240808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c259c640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40cd4b0 0x7f79c4153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c1d9b640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 -- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 msgr2=0x7f79c40b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 -- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40cd4b0 msgr2=0x7f79c4153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40cd4b0 0x7f79c4153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 -- 172.21.15.82:0/2464240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79bc009a70 con 0x7f79c415cab0 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c2d9d640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e60 tx=0x7f79bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc009cd0 con 0x7f79c415cab0 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79bc00f040 con 0x7f79c415cab0 2023-07-20T10:05:46.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b8009420 con 0x7f79c415cab0 2023-07-20T10:05:46.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc0039a0 con 0x7f79c415cab0 2023-07-20T10:05:46.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.566+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c41f51c0 con 0x7f79c415cab0 2023-07-20T10:05:46.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c4073c70 con 0x7f79c415cab0 2023-07-20T10:05:46.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f79bc014480 con 0x7f79c415cab0 2023-07-20T10:05:46.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79b2ffd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 0x7f79a4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f79bc084c90 con 0x7f79c415cab0 2023-07-20T10:05:46.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79c259c640 1 -- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 msgr2=0x7f79a4068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:46.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.570+0000 7f79c259c640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 0x7f79a4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:46.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.574+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79bc051dc0 con 0x7f79c415cab0 2023-07-20T10:05:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79c40b2ea0 con 0x7f79c415cab0 2023-07-20T10:05:46.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79b2ffd640 1 -- 172.21.15.82:0/2464240808 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f79bc0553e0 con 0x7f79c415cab0 2023-07-20T10:05:46.736 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:46.736 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:46.736 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 msgr2=0x7f79a4068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 0x7f79a4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 msgr2=0x7f79c40b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f79bc009e60 tx=0x7f79bc00c490 comp rx=0 tx=0).stop 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 shutdown_connections 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f79a40663a0 0x7f79a4068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79c415cab0 0x7f79c40b0600 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79c40d0d10 0x7f79c40b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 --2- 172.21.15.82:0/2464240808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79c40cd4b0 0x7f79c4153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 >> 172.21.15.82:0/2464240808 conn(0x7f79c408c120 msgr2=0x7f79c406b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 shutdown_connections 2023-07-20T10:05:46.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.754+0000 7f79c8abd640 1 -- 172.21.15.82:0/2464240808 wait complete. 2023-07-20T10:05:46.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:46.854 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.876+0000 7f9f4e123180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:46.938 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:46.960+0000 7f9f4e123180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:46.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 Processor -- start 2023-07-20T10:05:46.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 -- start start 2023-07-20T10:05:46.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f523815c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380cf4a0 con 0x7f523806f350 2023-07-20T10:05:46.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523806ea80 con 0x7f52380b1f30 2023-07-20T10:05:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f523d827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380ce890 con 0x7f52380b23c0 2023-07-20T10:05:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f523806f350 0x7f523806b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47890/0 (socket says 172.21.15.82:47890) 2023-07-20T10:05:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 -- 172.21.15.82:0/230814863 learned_addr learned my addr 172.21.15.82:0/230814863 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f52377fe640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f523815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237966541 0 0) 0x7f52380cf4a0 con 0x7f523806f350 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5220003530 con 0x7f523806f350 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302244635 0 0) 0x7f523806ea80 con 0x7f52380b1f30 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52380cf4a0 con 0x7f52380b1f30 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2341415209 0 0) 0x7f5220003530 con 0x7f523806f350 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 msgr2=0x7f523815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f523815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 >> v1:172.21.15.183:6789/0 conn(0x7f52380b1f30 legacy=0x7f523815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380ceb70 con 0x7f523806f350 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f5228001680 con 0x7f523806f350 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 >> v1:172.21.15.82:6789/0 conn(0x7f523806f350 legacy=0x7f523806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5220003b70 0x7f5220003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f52200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5220004d10 0x7f5220005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c001240 con 0x7f5220003b70 2023-07-20T10:05:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380ce890 con 0x7f5220004d10 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522000bb20 con 0x7f52380b23c0 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5220003b70 0x7f5220003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f52367fc640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f52200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f52377fe640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5220004d10 0x7f5220005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 -- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 msgr2=0x7f52200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f52200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 -- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5220004d10 msgr2=0x7f5220005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5220004d10 0x7f5220005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f5236ffd640 1 -- 172.21.15.82:0/230814863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220003530 con 0x7f5220003b70 2023-07-20T10:05:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.962+0000 7f52367fc640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52380b23c0 0x7f52200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f5236ffd640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5220003b70 0x7f5220003f50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5228007fa0 tx=0x7f522801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aac8b8ea14bf85b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228005ae0 con 0x7f5220003b70 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228005c40 con 0x7f5220003b70 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f5235ffb640 1 -- 172.21.15.82:0/230814863 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280a57d0 con 0x7f5220003b70 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 -- 172.21.15.82:0/230814863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5220003b70 msgr2=0x7f5220003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 --2- 172.21.15.82:0/230814863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5220003b70 0x7f5220003f50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f5228007fa0 tx=0x7f522801caf0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f52377fe640 1 -- 172.21.15.82:0/230814863 reap_dead start 2023-07-20T10:05:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 -- 172.21.15.82:0/230814863 shutdown_connections 2023-07-20T10:05:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 -- 172.21.15.82:0/230814863 >> 172.21.15.82:0/230814863 conn(0x7f5238089fa0 msgr2=0x7f52380d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 -- 172.21.15.82:0/230814863 shutdown_connections 2023-07-20T10:05:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.966+0000 7f523d827640 1 -- 172.21.15.82:0/230814863 wait complete. 2023-07-20T10:05:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 Processor -- start 2023-07-20T10:05:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- start start 2023-07-20T10:05:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 0x7f523814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52380c3f50 0x7f52380b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 0x7f52380d0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c5120 con 0x7f52380d04b0 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52381501d0 con 0x7f52380c3f50 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380d0e70 con 0x7f5220003b70 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f52377fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 0x7f52380d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 0x7f523814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f52377fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 0x7f52380d0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55986/0 (socket says 172.21.15.82:55986) 2023-07-20T10:05:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f52377fe640 1 -- 172.21.15.82:0/2938754567 learned_addr learned my addr 172.21.15.82:0/2938754567 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f52367fc640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52380c3f50 0x7f52380b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 -- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52380c3f50 msgr2=0x7f52380b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52380c3f50 0x7f52380b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 -- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 msgr2=0x7f52380d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 0x7f52380d0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 -- 172.21.15.82:0/2938754567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380c44a0 con 0x7f5220003b70 2023-07-20T10:05:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f5236ffd640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 0x7f523814e2a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5228009000 tx=0x7f5220005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280b4070 con 0x7f5220003b70 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5228005db0 con 0x7f5220003b70 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52280a57d0 con 0x7f5220003b70 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52380c4780 con 0x7f5220003b70 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.970+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380c4d40 con 0x7f5220003b70 2023-07-20T10:05:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380c4f00 con 0x7f5220003b70 2023-07-20T10:05:46.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f52280a5930 con 0x7f5220003b70 2023-07-20T10:05:46.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f521ffff640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 0x7f5224068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:46.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f522811d770 con 0x7f5220003b70 2023-07-20T10:05:46.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f52367fc640 1 -- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 msgr2=0x7f5224068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:46.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.974+0000 7f52367fc640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 0x7f5224068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:46.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:46.978+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52280ea990 con 0x7f5220003b70 2023-07-20T10:05:46.999 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.018+0000 7ff3895e6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:05:47.085 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.102+0000 7ff3895e6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:05:47.087 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:47.108+0000 7f9f4e123180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:47.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.130+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f523814e9e0 con 0x7f5220003b70 2023-07-20T10:05:47.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f521ffff640 1 -- 172.21.15.82:0/2938754567 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18767 (secure 0 0 0) 0x7f52280edfb0 con 0x7f5220003b70 2023-07-20T10:05:47.114 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:47.115 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:41.778070+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/329177331":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3805426120":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/997612192":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6833/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6832/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/1637149210":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/115575575":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3471734032":"2023-07-21T10:05:41.778040+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 msgr2=0x7f5224068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:47.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 0x7f5224068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 msgr2=0x7f523814e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 0x7f523814e2a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5228009000 tx=0x7f5220005800 comp rx=0 tx=0).stop 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 shutdown_connections 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f52240663a0 0x7f5224068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52380d04b0 0x7f52380d0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52380c3f50 0x7f52380b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 --2- 172.21.15.82:0/2938754567 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5220003b70 0x7f523814e2a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 >> 172.21.15.82:0/2938754567 conn(0x7f5238089fa0 msgr2=0x7f523815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 shutdown_connections 2023-07-20T10:05:47.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.134+0000 7f523d827640 1 -- 172.21.15.82:0/2938754567 wait complete. 2023-07-20T10:05:47.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:05:22.193275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:05:23.515835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:47.137 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:47.174 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:47.196+0000 7f9f4e123180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:47.242 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.258+0000 7ff3895e6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:05:47.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 Processor -- start 2023-07-20T10:05:47.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 -- start start 2023-07-20T10:05:47.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f59980cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f599806b220 0x7f5998160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980d0970 con 0x7f59981602b0 2023-07-20T10:05:47.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998160e20 con 0x7f599806b220 2023-07-20T10:05:47.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f59a0288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cd300 con 0x7f599806c120 2023-07-20T10:05:47.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f599806b220 0x7f5998160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f599806b220 0x7f5998160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56000/0 (socket says 172.21.15.82:56000) 2023-07-20T10:05:47.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 -- 172.21.15.82:0/3901325589 learned_addr learned my addr 172.21.15.82:0/3901325589 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:47.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e024640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f59980cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 -- 172.21.15.82:0/3901325589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 msgr2=0x7f59980cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:47.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f59980cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 -- 172.21.15.82:0/3901325589 >> v1:172.21.15.183:6789/0 conn(0x7f59981602b0 legacy=0x7f599806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e825640 1 -- 172.21.15.82:0/3901325589 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980cd5e0 con 0x7f599806b220 2023-07-20T10:05:47.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.302+0000 7f599e024640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f59980cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:47.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f599e825640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f5998160710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5990009e50 tx=0x7f599001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0254a995ff79347 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f599d022640 1 -- 172.21.15.82:0/3901325589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900a5750 con 0x7f599806b220 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f599d022640 1 -- 172.21.15.82:0/3901325589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59900a58b0 con 0x7f599806b220 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f599d022640 1 -- 172.21.15.82:0/3901325589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59900a5c40 con 0x7f599806b220 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 -- 172.21.15.82:0/3901325589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 msgr2=0x7f5998160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f5998160710 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f5990009e50 tx=0x7f599001c980 comp rx=0 tx=0).stop 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 -- 172.21.15.82:0/3901325589 shutdown_connections 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f5998160710 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 --2- 172.21.15.82:0/3901325589 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f59980cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 -- 172.21.15.82:0/3901325589 >> 172.21.15.82:0/3901325589 conn(0x7f599808c0a0 msgr2=0x7f599809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 -- 172.21.15.82:0/3901325589 shutdown_connections 2023-07-20T10:05:47.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.306+0000 7f59a0288640 1 -- 172.21.15.82:0/3901325589 wait complete. 2023-07-20T10:05:47.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 Processor -- start 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- start start 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f5998153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59981602b0 0x7f5998153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cbac0 con 0x7f599806b220 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cbda0 con 0x7f59981602b0 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cc080 con 0x7f599806c120 2023-07-20T10:05:47.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56012/0 (socket says 172.21.15.82:56012) 2023-07-20T10:05:47.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 -- 172.21.15.82:0/804953165 learned_addr learned my addr 172.21.15.82:0/804953165 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:47.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e825640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59981602b0 0x7f5998153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599d823640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f5998153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 -- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 msgr2=0x7f5998153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f5998153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 -- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59981602b0 msgr2=0x7f5998153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59981602b0 0x7f5998153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 -- 172.21.15.82:0/804953165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990009b30 con 0x7f599806b220 2023-07-20T10:05:47.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f599e024640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f599400e810 tx=0x7f599400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400c8d0 con 0x7f599806b220 2023-07-20T10:05:47.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400ca30 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980cc360 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400cdc0 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.310+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59980cad40 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599815f290 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f5994013410 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f598effd640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 0x7f597c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f5994083e70 con 0x7f599806b220 2023-07-20T10:05:47.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f599d823640 1 -- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 msgr2=0x7f597c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:47.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.314+0000 7f599d823640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 0x7f597c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:47.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.318+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5994051010 con 0x7f599806b220 2023-07-20T10:05:47.331 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.350+0000 7ff3895e6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:05:47.444 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:47.464+0000 7f9f4e123180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:47.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.466+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f599804da30 con 0x7f599806b220 2023-07-20T10:05:47.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f598effd640 1 -- 172.21.15.82:0/804953165 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5994009480 con 0x7f599806b220 2023-07-20T10:05:47.450 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 msgr2=0x7f597c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 0x7f597c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 msgr2=0x7f59980c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f599400e810 tx=0x7f599400ecd0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 shutdown_connections 2023-07-20T10:05:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7f597c0663a0 0x7f597c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59981602b0 0x7f5998153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f599806c120 0x7f5998153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 --2- 172.21.15.82:0/804953165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f599806b220 0x7f59980c8140 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 >> 172.21.15.82:0/804953165 conn(0x7f599808c0a0 msgr2=0x7f59980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 shutdown_connections 2023-07-20T10:05:47.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.470+0000 7f59a0288640 1 -- 172.21.15.82:0/804953165 wait complete. 2023-07-20T10:05:47.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:47.503 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:05:47.524+0000 7f9f4e123180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:47.610 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.630+0000 7ff3895e6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 Processor -- start 2023-07-20T10:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 -- start start 2023-07-20T10:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc33c159830 0x7fc33c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0cc8d0 con 0x7fc33c159450 2023-07-20T10:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0ccbb0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc341582640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c0cce90 con 0x7fc33c159830 2023-07-20T10:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc33c159450 0x7fc33c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47902/0 (socket says 172.21.15.82:47902) 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33affd640 1 -- 172.21.15.82:0/3568731106 learned_addr learned my addr 172.21.15.82:0/3568731106 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33a7fc640 1 --2- 172.21.15.82:0/3568731106 >> v2:172.21.15.183:3300/0 conn(0x7fc33c159830 0x7fc33c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411440299 0 0) 0x7fc33c0cc8d0 con 0x7fc33c159450 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc324003530 con 0x7fc33c159450 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679425467 0 0) 0x7fc33c0ccbb0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33c0cc8d0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33a7fc640 1 -- 172.21.15.82:0/3568731106 >> v1:172.21.15.183:6789/0 conn(0x7fc33c0cc3e0 legacy=0x7fc33c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33a7fc640 1 -- 172.21.15.82:0/3568731106 >> v1:172.21.15.82:6789/0 conn(0x7fc33c159450 legacy=0x7fc33c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.634+0000 7fc33a7fc640 1 -- 172.21.15.82:0/3568731106 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c159cc0 con 0x7fc33c159830 2023-07-20T10:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc33a7fc640 1 --2- 172.21.15.82:0/3568731106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c159830 0x7fc33c0cbea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc33000ba60 tx=0x7fc33001eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f819036d83ffd6c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3300a7b00 con 0x7fc33c159830 2023-07-20T10:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3300a7c60 con 0x7fc33c159830 2023-07-20T10:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc339ffb640 1 -- 172.21.15.82:0/3568731106 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3300af440 con 0x7fc33c159830 2023-07-20T10:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 -- 172.21.15.82:0/3568731106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c159830 msgr2=0x7fc33c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 --2- 172.21.15.82:0/3568731106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c159830 0x7fc33c0cbea0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc33000ba60 tx=0x7fc33001eb20 comp rx=0 tx=0).stop 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 -- 172.21.15.82:0/3568731106 shutdown_connections 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 --2- 172.21.15.82:0/3568731106 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c159830 0x7fc33c0cbea0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 -- 172.21.15.82:0/3568731106 >> 172.21.15.82:0/3568731106 conn(0x7fc33c0cad50 msgr2=0x7fc33c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 -- 172.21.15.82:0/3568731106 shutdown_connections 2023-07-20T10:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.638+0000 7fc341582640 1 -- 172.21.15.82:0/3568731106 wait complete. 2023-07-20T10:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 Processor -- start 2023-07-20T10:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- start start 2023-07-20T10:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc33c159450 0x7fc33c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 0x7fc33c0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c150ad0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c154320 con 0x7fc33c0c4430 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0c20b0 con 0x7fc33c159450 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56022/0 (socket says 172.21.15.82:56022) 2023-07-20T10:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 -- 172.21.15.82:0/1284394449 learned_addr learned my addr 172.21.15.82:0/1284394449 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33b7fe640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 0x7fc33c0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33a7fc640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc33c159450 0x7fc33c0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 -- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc33c159450 msgr2=0x7fc33c0af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc33c159450 0x7fc33c0af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 -- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 msgr2=0x7fc33c0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 0x7fc33c0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 -- 172.21.15.82:0/1284394449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33000b6c0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33b7fe640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 0x7fc33c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc33affd640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c4d0 tx=0x7fc32c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c005cf0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c005e50 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0072b0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c0c2300 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.642+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c153cd0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c04da30 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 35) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fc32c007410 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc3237fe640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 0x7fc328068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc32c083710 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc33a7fc640 1 -- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 msgr2=0x7fc328068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3872476705 2023-07-20T10:05:47.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.646+0000 7fc33a7fc640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 0x7fc328068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:05:47.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.650+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc32c050800 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.674 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.694+0000 7ff3895e6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:05:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.706+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fc32c050bd0 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.706+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 msgr2=0x7fc328068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:05:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.706+0000 7fc3237fe640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 0x7fc328068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.752 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff311f25640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.752 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff311f25640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.752 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff311f25640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.752 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff311f25640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.753 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff311f25640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.753 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff31472a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.753 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff31472a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.753 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff31472a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.753 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff31472a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.754 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:05:47.770+0000 7ff31472a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:05:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc33c0c2820 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc3237fe640 1 -- 172.21.15.82:0/1284394449 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc32c07c040 con 0x7fc33c0cc3e0 2023-07-20T10:05:47.803 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:47.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 msgr2=0x7fc33c1510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00c4d0 tx=0x7fc32c00c990 comp rx=0 tx=0).stop 2023-07-20T10:05:47.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 shutdown_connections 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:6832/3872476705,v1:172.21.15.82:6833/3872476705] conn(0x7fc3280663a0 0x7fc328068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc33c0c4430 0x7fc33c0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc33c159450 0x7fc33c0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 --2- 172.21.15.82:0/1284394449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc33c0cc3e0 0x7fc33c1510e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 >> 172.21.15.82:0/1284394449 conn(0x7fc33c0cad50 msgr2=0x7fc33c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 shutdown_connections 2023-07-20T10:05:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.822+0000 7fc341582640 1 -- 172.21.15.82:0/1284394449 wait complete. 2023-07-20T10:05:47.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:05:47.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.982+0000 7f446c834640 1 Processor -- start 2023-07-20T10:05:47.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 -- start start 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4468158ce0 0x7f44680c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f446806bd30 0x7f4468070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680c95d0 con 0x7f4468070970 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4468071310 con 0x7f446806bd30 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446c834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680c9fa0 con 0x7f4468158ce0 2023-07-20T10:05:47.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4468070970 0x7f446806b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47912/0 (socket says 172.21.15.82:47912) 2023-07-20T10:05:47.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 -- 172.21.15.82:0/3580998916 learned_addr learned my addr 172.21.15.82:0/3580998916 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:47.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446659c640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4468158ce0 0x7f44680c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4466d9d640 1 --2- 172.21.15.82:0/3580998916 >> v2:172.21.15.183:3300/0 conn(0x7f446806bd30 0x7f4468070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855093798 0 0) 0x7f44680c95d0 con 0x7f4468070970 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4454003530 con 0x7f4468070970 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688317030 0 0) 0x7f4454003530 con 0x7f4468070970 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4468158ce0 msgr2=0x7f44680c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4468158ce0 0x7f44680c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 >> v2:172.21.15.183:3300/0 conn(0x7f446806bd30 msgr2=0x7f4468070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 --2- 172.21.15.82:0/3580998916 >> v2:172.21.15.183:3300/0 conn(0x7f446806bd30 0x7f4468070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44681590c0 con 0x7f4468070970 2023-07-20T10:05:47.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f4450001680 con 0x7f4468070970 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 >> v1:172.21.15.82:6789/0 conn(0x7f4468070970 legacy=0x7f446806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44540039f0 0x7f4454003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44540047d0 0x7f4454004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4454005190 0x7f445400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4468071310 con 0x7f44540047d0 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680c9fa0 con 0x7f4454005190 2023-07-20T10:05:47.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445400e0e0 con 0x7f44540039f0 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446659c640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4468158ce0 0x7f44680c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44540047d0 0x7f4454004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4466d9d640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4454005190 0x7f445400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f446659c640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44540039f0 0x7f4454003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 -- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44540039f0 msgr2=0x7f4454003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f44540039f0 0x7f4454003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 -- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4454005190 msgr2=0x7f445400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:47.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4454005190 0x7f445400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f445dd9b640 1 -- 172.21.15.82:0/3580998916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454003530 con 0x7f44540047d0 2023-07-20T10:05:47.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.986+0000 7f4466d9d640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4454005190 0x7f445400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f445dd9b640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44540047d0 0x7f4454004c50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f445000c270 tx=0x7f445001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9133d4117eb66f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450005ae0 con 0x7f44540047d0 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44500ab070 con 0x7f44540047d0 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f4465d9b640 1 -- 172.21.15.82:0/3580998916 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4450007070 con 0x7f44540047d0 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 -- 172.21.15.82:0/3580998916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44540047d0 msgr2=0x7f4454004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 --2- 172.21.15.82:0/3580998916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44540047d0 0x7f4454004c50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f445000c270 tx=0x7f445001f350 comp rx=0 tx=0).stop 2023-07-20T10:05:47.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f4466d9d640 1 -- 172.21.15.82:0/3580998916 reap_dead start 2023-07-20T10:05:47.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 -- 172.21.15.82:0/3580998916 shutdown_connections 2023-07-20T10:05:47.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 -- 172.21.15.82:0/3580998916 >> 172.21.15.82:0/3580998916 conn(0x7f44680cad50 msgr2=0x7f44680cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:47.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 -- 172.21.15.82:0/3580998916 shutdown_connections 2023-07-20T10:05:47.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.990+0000 7f446c834640 1 -- 172.21.15.82:0/3580998916 wait complete. 2023-07-20T10:05:47.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 Processor -- start 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- start start 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 0x7f4468155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f446815be20 0x7f4468152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446815b7c0 con 0x7f44680c2c80 2023-07-20T10:05:47.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680c38e0 con 0x7f44540047d0 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4468159350 con 0x7f446815be20 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56156/0 (socket says 172.21.15.82:56156) 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 -- 172.21.15.82:0/1319756636 learned_addr learned my addr 172.21.15.82:0/1319756636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f445dd9b640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f446815be20 0x7f4468152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446659c640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 0x7f4468155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 -- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f446815be20 msgr2=0x7f4468152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f446815be20 0x7f4468152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 -- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 msgr2=0x7f4468155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 0x7f4468155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 -- 172.21.15.82:0/1319756636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468153230 con 0x7f44680c2c80 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446659c640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 0x7f4468155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f4466d9d640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0ac0 tx=0x7f4460007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460003ba0 con 0x7f44680c2c80 2023-07-20T10:05:47.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4460010040 con 0x7f44680c2c80 2023-07-20T10:05:47.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4460004020 con 0x7f44680c2c80 2023-07-20T10:05:47.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44681595c0 con 0x7f44680c2c80 2023-07-20T10:05:47.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.994+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44680c3570 con 0x7f44680c2c80 2023-07-20T10:05:47.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.998+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446804da30 con 0x7f44680c2c80 2023-07-20T10:05:47.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.998+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f4460004180 con 0x7f44680c2c80 2023-07-20T10:05:47.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:47.998+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4460083cd0 con 0x7f44680c2c80 2023-07-20T10:05:47.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.002+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44600512b0 con 0x7f44680c2c80 2023-07-20T10:05:48.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.146+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44680c3a20 con 0x7f44680c2c80 2023-07-20T10:05:48.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.146+0000 7f445f7fe640 1 -- 172.21.15.82:0/1319756636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44600830a0 con 0x7f44680c2c80 2023-07-20T10:05:48.130 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:05:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 msgr2=0x7f44680cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f44680b0ac0 tx=0x7f4460007680 comp rx=0 tx=0).stop 2023-07-20T10:05:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 shutdown_connections 2023-07-20T10:05:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44680c2c80 0x7f44680cce20 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f446815be20 0x7f4468152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 --2- 172.21.15.82:0/1319756636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44540047d0 0x7f4468155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 >> 172.21.15.82:0/1319756636 conn(0x7f44680cad50 msgr2=0x7f44680adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 shutdown_connections 2023-07-20T10:05:48.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.150+0000 7f446c834640 1 -- 172.21.15.82:0/1319756636 wait complete. 2023-07-20T10:05:48.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:05:48.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.310+0000 7f6a95ce5640 1 Processor -- start 2023-07-20T10:05:48.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 -- start start 2023-07-20T10:05:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6a90159450 0x7f6a9015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6a900afd50 0x7f6a900b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900b06b0 con 0x7f6a90159830 2023-07-20T10:05:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cce90 con 0x7f6a900afd50 2023-07-20T10:05:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a95ce5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900cc8d0 con 0x7f6a90159450 2023-07-20T10:05:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6a900afd50 0x7f6a900b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6a900afd50 0x7f6a900b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56172/0 (socket says 172.21.15.82:56172) 2023-07-20T10:05:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1253849586 learned_addr learned my addr 172.21.15.82:0/1253849586 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1253849586 >> v2:172.21.15.183:3300/0 conn(0x7f6a90159450 msgr2=0x7f6a9015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 --2- 172.21.15.82:0/1253849586 >> v2:172.21.15.183:3300/0 conn(0x7f6a90159450 0x7f6a9015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1253849586 >> v1:172.21.15.183:6789/0 conn(0x7f6a90159830 legacy=0x7f6a900cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.314+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1253849586 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900ccbb0 con 0x7f6a900afd50 2023-07-20T10:05:48.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a8ffff640 1 --2- 172.21.15.82:0/1253849586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a900afd50 0x7f6a900b0170 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006a6c0 tx=0x7f6a8801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b6bcc38ba9928 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a8effd640 1 -- 172.21.15.82:0/1253849586 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5820 con 0x7f6a900afd50 2023-07-20T10:05:48.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a8effd640 1 -- 172.21.15.82:0/1253849586 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880a5980 con 0x7f6a900afd50 2023-07-20T10:05:48.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a8effd640 1 -- 172.21.15.82:0/1253849586 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5d10 con 0x7f6a900afd50 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1253849586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a900afd50 msgr2=0x7f6a900b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1253849586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a900afd50 0x7f6a900b0170 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6a9006a6c0 tx=0x7f6a8801c960 comp rx=0 tx=0).stop 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1253849586 shutdown_connections 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1253849586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a900afd50 0x7f6a900b0170 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1253849586 >> v2:172.21.15.183:3300/0 conn(0x7f6a90159450 0x7f6a9015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1253849586 >> 172.21.15.82:0/1253849586 conn(0x7f6a900cad50 msgr2=0x7f6a900cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1253849586 shutdown_connections 2023-07-20T10:05:48.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1253849586 wait complete. 2023-07-20T10:05:48.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 Processor -- start 2023-07-20T10:05:48.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.318+0000 7f6a95ce5640 1 -- start start 2023-07-20T10:05:48.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a900afd50 0x7f6a90157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a90159450 0x7f6a90163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901561e0 con 0x7f6a90150940 2023-07-20T10:05:48.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90156480 con 0x7f6a900afd50 2023-07-20T10:05:48.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90156760 con 0x7f6a90159450 2023-07-20T10:05:48.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56174/0 (socket says 172.21.15.82:56174) 2023-07-20T10:05:48.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1937950197 learned_addr learned my addr 172.21.15.82:0/1937950197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:48.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a90159450 msgr2=0x7f6a90163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a90159450 0x7f6a90163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a900afd50 msgr2=0x7f6a90157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a900afd50 0x7f6a90157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 -- 172.21.15.82:0/1937950197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009b30 con 0x7f6a90150940 2023-07-20T10:05:48.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8ffff640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6a8801a590 tx=0x7f6a88019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880b8880 con 0x7f6a90150940 2023-07-20T10:05:48.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880b8a20 con 0x7f6a90150940 2023-07-20T10:05:48.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880b8dd0 con 0x7f6a90150940 2023-07-20T10:05:48.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a90156a40 con 0x7f6a90150940 2023-07-20T10:05:48.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a90164160 con 0x7f6a90150940 2023-07-20T10:05:48.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9004da30 con 0x7f6a90150940 2023-07-20T10:05:48.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.322+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6a880c1410 con 0x7f6a90150940 2023-07-20T10:05:48.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.326+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f6a8811ec20 con 0x7f6a90150940 2023-07-20T10:05:48.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.330+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a880ec150 con 0x7f6a90150940 2023-07-20T10:05:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.474+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a90156ef0 con 0x7f6a90150940 2023-07-20T10:05:48.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.474+0000 7f6a8cff9640 1 -- 172.21.15.82:0/1937950197 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a880ef770 con 0x7f6a90150940 2023-07-20T10:05:48.457 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:05:48.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 msgr2=0x7f6a90157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f6a8801a590 tx=0x7f6a88019700 comp rx=0 tx=0).stop 2023-07-20T10:05:48.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 shutdown_connections 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a90150940 0x7f6a90157a40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6a90159450 0x7f6a90163c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 --2- 172.21.15.82:0/1937950197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a900afd50 0x7f6a90157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 >> 172.21.15.82:0/1937950197 conn(0x7f6a900cad50 msgr2=0x7f6a9006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 shutdown_connections 2023-07-20T10:05:48.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.478+0000 7f6a95ce5640 1 -- 172.21.15.82:0/1937950197 wait complete. 2023-07-20T10:05:48.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:48.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 Processor -- start 2023-07-20T10:05:48.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 -- start start 2023-07-20T10:05:48.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8254160bc0 0x7f825406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8254160fa0 0x7f82540c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f82540c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82540cc560 con 0x7f8254160bc0 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82540ad7e0 con 0x7f8254160fa0 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.634+0000 7f825b967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540cc790 con 0x7f825406c700 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8254160bc0 0x7f825406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8254160bc0 0x7f825406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56190/0 (socket says 172.21.15.82:56190) 2023-07-20T10:05:48.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 -- 172.21.15.82:0/1971461780 learned_addr learned my addr 172.21.15.82:0/1971461780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:48.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8258f02640 1 --2- 172.21.15.82:0/1971461780 >> v2:172.21.15.183:3300/0 conn(0x7f8254160fa0 0x7f82540c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259f04640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f82540c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 -- 172.21.15.82:0/1971461780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 msgr2=0x7f82540c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:48.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f82540c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 -- 172.21.15.82:0/1971461780 >> v2:172.21.15.183:3300/0 conn(0x7f8254160fa0 msgr2=0x7f82540c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:48.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 --2- 172.21.15.82:0/1971461780 >> v2:172.21.15.183:3300/0 conn(0x7f8254160fa0 0x7f82540c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 -- 172.21.15.82:0/1971461780 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540cca70 con 0x7f8254160bc0 2023-07-20T10:05:48.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f8259703640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f825406c1c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f825406a740 tx=0x7f825001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3cc6465908b7a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f824bfff640 1 -- 172.21.15.82:0/1971461780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500a5820 con 0x7f8254160bc0 2023-07-20T10:05:48.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f824bfff640 1 -- 172.21.15.82:0/1971461780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500a5980 con 0x7f8254160bc0 2023-07-20T10:05:48.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.638+0000 7f824bfff640 1 -- 172.21.15.82:0/1971461780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500a5d10 con 0x7f8254160bc0 2023-07-20T10:05:48.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- 172.21.15.82:0/1971461780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 msgr2=0x7f825406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f825406c1c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f825406a740 tx=0x7f825001c9a0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- 172.21.15.82:0/1971461780 shutdown_connections 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- 172.21.15.82:0/1971461780 >> v2:172.21.15.183:3300/0 conn(0x7f8254160fa0 0x7f82540c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f82540c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- 172.21.15.82:0/1971461780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f825406c1c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- 172.21.15.82:0/1971461780 >> 172.21.15.82:0/1971461780 conn(0x7f82540cada0 msgr2=0x7f82540cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- 172.21.15.82:0/1971461780 shutdown_connections 2023-07-20T10:05:48.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- 172.21.15.82:0/1971461780 wait complete. 2023-07-20T10:05:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 Processor -- start 2023-07-20T10:05:48.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- start start 2023-07-20T10:05:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f825415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8254160fa0 0x7f82540af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825415a620 con 0x7f8254160bc0 2023-07-20T10:05:48.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8254099960 con 0x7f8254160fa0 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f825b967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8254160390 con 0x7f825406c700 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56204/0 (socket says 172.21.15.82:56204) 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 -- 172.21.15.82:0/3427332391 learned_addr learned my addr 172.21.15.82:0/3427332391 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8259703640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f825415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8259f04640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8254160fa0 0x7f82540af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 -- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 msgr2=0x7f825415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f825415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 -- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8254160fa0 msgr2=0x7f82540af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8254160fa0 0x7f82540af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.642+0000 7f8258f02640 1 -- 172.21.15.82:0/3427332391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009b30 con 0x7f8254160bc0 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f8258f02640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f824400d5f0 tx=0x7f824400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82440125f0 con 0x7f8254160bc0 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244012750 con 0x7f8254160bc0 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244012ae0 con 0x7f8254160bc0 2023-07-20T10:05:48.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82540ae300 con 0x7f8254160bc0 2023-07-20T10:05:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82540ae8c0 con 0x7f8254160bc0 2023-07-20T10:05:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254073c70 con 0x7f8254160bc0 2023-07-20T10:05:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.646+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 36) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8244012c40 con 0x7f8254160bc0 2023-07-20T10:05:48.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.650+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8244083e20 con 0x7f8254160bc0 2023-07-20T10:05:48.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.650+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8244051400 con 0x7f8254160bc0 2023-07-20T10:05:48.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.710+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8244089020 con 0x7f8254160bc0 2023-07-20T10:05:48.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.710+0000 7f8249ffb640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 0x7f823806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.714+0000 7f8259703640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 0x7f823806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.718+0000 7f8259703640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 0x7f823806e430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82500ae000 tx=0x7f82500a7070 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f825409bff0 con 0x7f8254160bc0 2023-07-20T10:05:48.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f8249ffb640 1 -- 172.21.15.82:0/3427332391 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f824407f320 con 0x7f8254160bc0 2023-07-20T10:05:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:48.824 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:48.824 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:48.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 msgr2=0x7f823806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 0x7f823806e430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82500ae000 tx=0x7f82500a7070 comp rx=0 tx=0).stop 2023-07-20T10:05:48.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 msgr2=0x7f8254099420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f824400d5f0 tx=0x7f824400dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 shutdown_connections 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f823806c040 0x7f823806e430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8254160fa0 0x7f82540af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8254160bc0 0x7f8254099420 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 --2- 172.21.15.82:0/3427332391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f825406c700 0x7f825415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 >> 172.21.15.82:0/3427332391 conn(0x7f82540cada0 msgr2=0x7f8254070580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 shutdown_connections 2023-07-20T10:05:48.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:48.842+0000 7f825b967640 1 -- 172.21.15.82:0/3427332391 wait complete. 2023-07-20T10:05:48.844 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 Processor -- start 2023-07-20T10:05:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 -- start start 2023-07-20T10:05:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 0x7f07300d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f07300ce4c0 0x7f07300d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300d16b0 con 0x7f07300d0d10 2023-07-20T10:05:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300d31c0 con 0x7f07300ce4c0 2023-07-20T10:05:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f0736b40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300b3520 con 0x7f073015cab0 2023-07-20T10:05:48.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f072ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f07300d0d10 0x7f07300cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47928/0 (socket says 172.21.15.82:47928) 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f072ffff640 1 -- 172.21.15.82:0/2126652327 learned_addr learned my addr 172.21.15.82:0/2126652327 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07350dd640 1 --2- 172.21.15.82:0/2126652327 >> v2:172.21.15.82:3300/0 conn(0x7f07300ce4c0 0x7f07300d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07348dc640 1 --2- 172.21.15.82:0/2126652327 >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 0x7f07300d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07350dd640 1 -- 172.21.15.82:0/2126652327 >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 msgr2=0x7f07300d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07350dd640 1 --2- 172.21.15.82:0/2126652327 >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 0x7f07300d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07350dd640 1 -- 172.21.15.82:0/2126652327 >> v1:172.21.15.82:6789/0 conn(0x7f07300d0d10 legacy=0x7f07300cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07350dd640 1 -- 172.21.15.82:0/2126652327 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300b2910 con 0x7f07300ce4c0 2023-07-20T10:05:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.002+0000 7f07348dc640 1 --2- 172.21.15.82:0/2126652327 >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 0x7f07300d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:48.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f07350dd640 1 --2- 172.21.15.82:0/2126652327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f07300d1170 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f073006a660 tx=0x7f072801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ed66e9aa4ca3e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f072f7fe640 1 -- 172.21.15.82:0/2126652327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280a58c0 con 0x7f07300ce4c0 2023-07-20T10:05:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f072f7fe640 1 -- 172.21.15.82:0/2126652327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07280a5a20 con 0x7f07300ce4c0 2023-07-20T10:05:48.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f072f7fe640 1 -- 172.21.15.82:0/2126652327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07280a5db0 con 0x7f07300ce4c0 2023-07-20T10:05:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 -- 172.21.15.82:0/2126652327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 msgr2=0x7f07300d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 --2- 172.21.15.82:0/2126652327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f07300d1170 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f073006a660 tx=0x7f072801c8e0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 -- 172.21.15.82:0/2126652327 shutdown_connections 2023-07-20T10:05:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 --2- 172.21.15.82:0/2126652327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f07300d1170 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 --2- 172.21.15.82:0/2126652327 >> v2:172.21.15.183:3300/0 conn(0x7f073015cab0 0x7f07300d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 -- 172.21.15.82:0/2126652327 >> 172.21.15.82:0/2126652327 conn(0x7f073008c120 msgr2=0x7f073009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:48.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 -- 172.21.15.82:0/2126652327 shutdown_connections 2023-07-20T10:05:48.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.006+0000 7f0736b40640 1 -- 172.21.15.82:0/2126652327 wait complete. 2023-07-20T10:05:48.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 Processor -- start 2023-07-20T10:05:48.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- start start 2023-07-20T10:05:48.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07300d0d10 0x7f073006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f073015cab0 0x7f07300b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b7fb0 con 0x7f07300ce4c0 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b7330 con 0x7f07300d0d10 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b7610 con 0x7f073015cab0 2023-07-20T10:05:48.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56220/0 (socket says 172.21.15.82:56220) 2023-07-20T10:05:48.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 -- 172.21.15.82:0/2638058069 learned_addr learned my addr 172.21.15.82:0/2638058069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 -- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f073015cab0 msgr2=0x7f07300b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f073015cab0 0x7f07300b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 -- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07300d0d10 msgr2=0x7f073006ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07300d0d10 0x7f073006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 -- 172.21.15.82:0/2638058069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728009a70 con 0x7f07300ce4c0 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f07348dc640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f071800c7f0 tx=0x7f071800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718007820 con 0x7f07300ce4c0 2023-07-20T10:05:48.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718007980 con 0x7f07300ce4c0 2023-07-20T10:05:48.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718007d30 con 0x7f07300ce4c0 2023-07-20T10:05:48.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07300b78f0 con 0x7f07300ce4c0 2023-07-20T10:05:48.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.010+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07300b6d70 con 0x7f07300ce4c0 2023-07-20T10:05:48.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0730073c70 con 0x7f07300ce4c0 2023-07-20T10:05:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f07180113f0 con 0x7f07300ce4c0 2023-07-20T10:05:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f072d7fa640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 0x7f0710068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f07180840b0 con 0x7f07300ce4c0 2023-07-20T10:05:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f072ffff640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 0x7f0710068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:48.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.014+0000 7f072ffff640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 0x7f0710068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07300cbce0 tx=0x7f0720007a50 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:48.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.018+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07180514f0 con 0x7f07300ce4c0 2023-07-20T10:05:49.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.170+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0730158f40 con 0x7f07300ce4c0 2023-07-20T10:05:49.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.170+0000 7f072d7fa640 1 -- 172.21.15.82:0/2638058069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+19269 (secure 0 0 0) 0x7f071801f090 con 0x7f07300ce4c0 2023-07-20T10:05:49.153 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:49.153 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":83,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:47.698469+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3117016263":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720967325":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720817754":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2027423293":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6832/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/329177331":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3805426120":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/997612192":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/1287935297":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6833/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6832/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6833/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/1637149210":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/2748750086":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/115575575":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3471734032":"2023-07-21T10:05:41.778040+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:49.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 msgr2=0x7f0710068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 0x7f0710068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07300cbce0 tx=0x7f0720007a50 comp rx=0 tx=0).stop 2023-07-20T10:05:49.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 msgr2=0x7f073006b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f071800c7f0 tx=0x7f071800ccb0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 shutdown_connections 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f07100660d0 0x7f0710068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f073015cab0 0x7f07300b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07300d0d10 0x7f073006ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 --2- 172.21.15.82:0/2638058069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07300ce4c0 0x7f073006b4e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 >> 172.21.15.82:0/2638058069 conn(0x7f073008c120 msgr2=0x7f0730158750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:49.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 shutdown_connections 2023-07-20T10:05:49.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.174+0000 7f0736b40640 1 -- 172.21.15.82:0/2638058069 wait complete. 2023-07-20T10:05:49.175 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:05:49.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:49.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 Processor -- start 2023-07-20T10:05:49.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 -- start start 2023-07-20T10:05:49.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c7015cab0 0x7f2c700d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700d0d10 0x7f2c700d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c700d16b0 con 0x7f2c700cf110 2023-07-20T10:05:49.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c700d31c0 con 0x7f2c7015cab0 2023-07-20T10:05:49.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c764bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700b3520 con 0x7f2c700d0d10 2023-07-20T10:05:49.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c7015cab0 0x7f2c700d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2c7015cab0 0x7f2c700d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56232/0 (socket says 172.21.15.82:56232) 2023-07-20T10:05:49.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 -- 172.21.15.82:0/3912044519 learned_addr learned my addr 172.21.15.82:0/3912044519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:49.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6f7fe640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700d0d10 0x7f2c700d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 -- 172.21.15.82:0/3912044519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700d0d10 msgr2=0x7f2c700d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:49.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700d0d10 0x7f2c700d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 -- 172.21.15.82:0/3912044519 >> v1:172.21.15.82:6789/0 conn(0x7f2c700cf110 legacy=0x7f2c700cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.334+0000 7f2c6ffff640 1 -- 172.21.15.82:0/3912044519 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c700b2910 con 0x7f2c7015cab0 2023-07-20T10:05:49.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c6ffff640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700d0300 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c6001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d14c08d468eb95 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c6effd640 1 -- 172.21.15.82:0/3912044519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600aa670 con 0x7f2c7015cab0 2023-07-20T10:05:49.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c6effd640 1 -- 172.21.15.82:0/3912044519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c600aa7d0 con 0x7f2c7015cab0 2023-07-20T10:05:49.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c6effd640 1 -- 172.21.15.82:0/3912044519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600aab60 con 0x7f2c7015cab0 2023-07-20T10:05:49.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 -- 172.21.15.82:0/3912044519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 msgr2=0x7f2c700d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700d0300 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f2c60009870 tx=0x7f2c6001c510 comp rx=0 tx=0).stop 2023-07-20T10:05:49.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 -- 172.21.15.82:0/3912044519 shutdown_connections 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700d0d10 0x7f2c700d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 --2- 172.21.15.82:0/3912044519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700d0300 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 -- 172.21.15.82:0/3912044519 >> 172.21.15.82:0/3912044519 conn(0x7f2c7008c120 msgr2=0x7f2c7009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 -- 172.21.15.82:0/3912044519 shutdown_connections 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.338+0000 7f2c764bd640 1 -- 172.21.15.82:0/3912044519 wait complete. 2023-07-20T10:05:49.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 Processor -- start 2023-07-20T10:05:49.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- start start 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700cf110 0x7f2c700cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 0x7f2c70157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700cc660 con 0x7f2c7015cab0 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700c6c70 con 0x7f2c700d0d10 2023-07-20T10:05:49.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700c8e90 con 0x7f2c700cf110 2023-07-20T10:05:49.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56244/0 (socket says 172.21.15.82:56244) 2023-07-20T10:05:49.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 -- 172.21.15.82:0/2047610251 learned_addr learned my addr 172.21.15.82:0/2047610251 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:49.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6ffff640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700cf110 0x7f2c700cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6f7fe640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 0x7f2c70157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 -- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700cf110 msgr2=0x7f2c700cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700cf110 0x7f2c700cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 -- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 msgr2=0x7f2c70157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 0x7f2c70157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 -- 172.21.15.82:0/2047610251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c600094d0 con 0x7f2c7015cab0 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6f7fe640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 0x7f2c70157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c74a5a640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7a0 tx=0x7f2c6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68003b80 con 0x7f2c7015cab0 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68003ce0 con 0x7f2c7015cab0 2023-07-20T10:05:49.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c700c6ec0 con 0x7f2c7015cab0 2023-07-20T10:05:49.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800aa90 con 0x7f2c7015cab0 2023-07-20T10:05:49.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.342+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c700c7480 con 0x7f2c7015cab0 2023-07-20T10:05:49.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c70073c70 con 0x7f2c7015cab0 2023-07-20T10:05:49.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f2c6800abf0 con 0x7f2c7015cab0 2023-07-20T10:05:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c6cff9640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 0x7f2c5c068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2c68083b00 con 0x7f2c7015cab0 2023-07-20T10:05:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c6ffff640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 0x7f2c5c068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.346+0000 7f2c6ffff640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 0x7f2c5c068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ae000 tx=0x7f2c600a7000 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.350+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c68085e60 con 0x7f2c7015cab0 2023-07-20T10:05:49.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.530+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c700b2310 con 0x7f2c7015cab0 2023-07-20T10:05:49.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.530+0000 7f2c6cff9640 1 -- 172.21.15.82:0/2047610251 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7f2c68050f40 con 0x7f2c7015cab0 2023-07-20T10:05:49.512 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:49.513 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:49.513 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 msgr2=0x7f2c5c068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 0x7f2c5c068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2c600ae000 tx=0x7f2c600a7000 comp rx=0 tx=0).stop 2023-07-20T10:05:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 msgr2=0x7f2c700c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7a0 tx=0x7f2c6800cc60 comp rx=0 tx=0).stop 2023-07-20T10:05:49.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 shutdown_connections 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2c5c0660d0 0x7f2c5c068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c7015cab0 0x7f2c700c7fe0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2c700d0d10 0x7f2c70157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 --2- 172.21.15.82:0/2047610251 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2c700cf110 0x7f2c700cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 >> 172.21.15.82:0/2047610251 conn(0x7f2c7008c120 msgr2=0x7f2c700af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 shutdown_connections 2023-07-20T10:05:49.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.534+0000 7f2c764bd640 1 -- 172.21.15.82:0/2047610251 wait complete. 2023-07-20T10:05:49.533 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 Processor -- start 2023-07-20T10:05:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 -- start start 2023-07-20T10:05:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 0x7fc5d00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5d006c8b0 0x7fc5d006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d015e130 con 0x7fc5d006bc60 2023-07-20T10:05:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d006c110 con 0x7fc5d006c8b0 2023-07-20T10:05:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d6831640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d015e410 con 0x7fc5d00b3860 2023-07-20T10:05:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d502e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5d006c8b0 0x7fc5d006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d502e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5d006c8b0 0x7fc5d006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56252/0 (socket says 172.21.15.82:56252) 2023-07-20T10:05:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.690+0000 7fc5d502e640 1 -- 172.21.15.82:0/3359506994 learned_addr learned my addr 172.21.15.82:0/3359506994 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d582f640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 0x7fc5d00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d502e640 1 -- 172.21.15.82:0/3359506994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 msgr2=0x7fc5d00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d502e640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 0x7fc5d00715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d502e640 1 -- 172.21.15.82:0/3359506994 >> v1:172.21.15.183:6789/0 conn(0x7fc5d006bc60 legacy=0x7fc5d00cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d502e640 1 -- 172.21.15.82:0/3359506994 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d015e6f0 con 0x7fc5d006c8b0 2023-07-20T10:05:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d582f640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 0x7fc5d00715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d502e640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d006c8b0 0x7fc5d006b720 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3ec3047bf26cb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d482d640 1 -- 172.21.15.82:0/3359506994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00ab600 con 0x7fc5d006c8b0 2023-07-20T10:05:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d482d640 1 -- 172.21.15.82:0/3359506994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c00ab760 con 0x7fc5d006c8b0 2023-07-20T10:05:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.694+0000 7fc5d482d640 1 -- 172.21.15.82:0/3359506994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00abaf0 con 0x7fc5d006c8b0 2023-07-20T10:05:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- 172.21.15.82:0/3359506994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d006c8b0 msgr2=0x7fc5d006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d006c8b0 0x7fc5d006b720 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c001c440 comp rx=0 tx=0).stop 2023-07-20T10:05:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- 172.21.15.82:0/3359506994 shutdown_connections 2023-07-20T10:05:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d006c8b0 0x7fc5d006b720 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- 172.21.15.82:0/3359506994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d00b3860 0x7fc5d00715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- 172.21.15.82:0/3359506994 >> 172.21.15.82:0/3359506994 conn(0x7fc5d00ce080 msgr2=0x7fc5d00ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- 172.21.15.82:0/3359506994 shutdown_connections 2023-07-20T10:05:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- 172.21.15.82:0/3359506994 wait complete. 2023-07-20T10:05:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 Processor -- start 2023-07-20T10:05:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- start start 2023-07-20T10:05:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d006bc60 0x7fc5d00c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d006c8b0 0x7fc5d014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0159d50 con 0x7fc5d00b3860 2023-07-20T10:05:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d015a030 con 0x7fc5d006bc60 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6831640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d015a310 con 0x7fc5d006c8b0 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56256/0 (socket says 172.21.15.82:56256) 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 -- 172.21.15.82:0/705663792 learned_addr learned my addr 172.21.15.82:0/705663792 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d502e640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d006c8b0 0x7fc5d014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d582f640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d006bc60 0x7fc5d00c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 -- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d006c8b0 msgr2=0x7fc5d014dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d006c8b0 0x7fc5d014dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 -- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d006bc60 msgr2=0x7fc5d00c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d006bc60 0x7fc5d00c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.698+0000 7fc5d6030640 1 -- 172.21.15.82:0/705663792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00094d0 con 0x7fc5d00b3860 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5d6030640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800c780 tx=0x7fc5c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004b70 con 0x7fc5d00b3860 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c800ce90 con 0x7fc5d00b3860 2023-07-20T10:05:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800a850 con 0x7fc5d00b3860 2023-07-20T10:05:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d015a5f0 con 0x7fc5d00b3860 2023-07-20T10:05:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d0156320 con 0x7fc5d00b3860 2023-07-20T10:05:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d004da30 con 0x7fc5d00b3860 2023-07-20T10:05:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 37) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc5c800a9b0 con 0x7fc5d00b3860 2023-07-20T10:05:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 0x7fc5b4068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc5c8083ce0 con 0x7fc5d00b3860 2023-07-20T10:05:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.702+0000 7fc5d582f640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 0x7fc5b4068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.706+0000 7fc5d582f640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 0x7fc5b4068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0045f0 tx=0x7fc5cc008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:49.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.706+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5c8054c60 con 0x7fc5d00b3860 2023-07-20T10:05:49.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.814+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 38) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fc5c80515a0 con 0x7fc5d00b3860 2023-07-20T10:05:49.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5d015aaa0 con 0x7fc5d00b3860 2023-07-20T10:05:49.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5c67fc640 1 -- 172.21.15.82:0/705663792 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4672 (secure 0 0 0) 0x7fc5c806ec80 con 0x7fc5d00b3860 2023-07-20T10:05:49.879 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:49.879 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:05:24.518575+0000","modified":"2023-07-20T10:05:28.180096+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"b","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6834/1873066176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1873066176},{"type":"v1","addr":"172.21.15.183:6834","nonce":1873066176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-20T10:05:49.880 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 33 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 msgr2=0x7fc5b4068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 0x7fc5b4068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0045f0 tx=0x7fc5cc008040 comp rx=0 tx=0).stop 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 msgr2=0x7fc5d00c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800c780 tx=0x7fc5c800cc40 comp rx=0 tx=0).stop 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 shutdown_connections 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc5b40660d0 0x7fc5b4068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5d00b3860 0x7fc5d00c40e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5d006c8b0 0x7fc5d014dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 --2- 172.21.15.82:0/705663792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5d006bc60 0x7fc5d00c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:49.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 >> 172.21.15.82:0/705663792 conn(0x7fc5d00ce080 msgr2=0x7fc5d00af3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:49.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 shutdown_connections 2023-07-20T10:05:49.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:49.898+0000 7fc5d6831640 1 -- 172.21.15.82:0/705663792 wait complete. 2023-07-20T10:05:49.899 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:50.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 Processor -- start 2023-07-20T10:05:50.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 -- start start 2023-07-20T10:05:50.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 0x7fa3cc0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 0x7fa3cc0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0b0c80 con 0x7fa3cc1603a0 2023-07-20T10:05:50.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0aed60 con 0x7fa3cc0ce600 2023-07-20T10:05:50.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3d1367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0af040 con 0x7fa3cc0b0360 2023-07-20T10:05:50.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3c3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 0x7fa3cc0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 0x7fa3cc0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3c3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 0x7fa3cc0cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:50986/0 (socket says 172.21.15.82:50986) 2023-07-20T10:05:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3c3fff640 1 -- 172.21.15.82:0/1344286688 learned_addr learned my addr 172.21.15.82:0/1344286688 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3caffd640 1 -- 172.21.15.82:0/1344286688 >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 msgr2=0x7fa3cc0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3caffd640 1 --2- 172.21.15.82:0/1344286688 >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 0x7fa3cc0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3caffd640 1 -- 172.21.15.82:0/1344286688 >> v1:172.21.15.183:6789/0 conn(0x7fa3cc1603a0 legacy=0x7fa3cc160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.058+0000 7fa3caffd640 1 -- 172.21.15.82:0/1344286688 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0af320 con 0x7fa3cc0b0360 2023-07-20T10:05:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3caffd640 1 --2- 172.21.15.82:0/1344286688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 0x7fa3cc0b0740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097f0 tx=0x7fa3bc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de62a14fc11205ba server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3ca7fc640 1 -- 172.21.15.82:0/1344286688 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0ab650 con 0x7fa3cc0b0360 2023-07-20T10:05:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3ca7fc640 1 -- 172.21.15.82:0/1344286688 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0ab7b0 con 0x7fa3cc0b0360 2023-07-20T10:05:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3ca7fc640 1 -- 172.21.15.82:0/1344286688 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0abb40 con 0x7fa3cc0b0360 2023-07-20T10:05:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 -- 172.21.15.82:0/1344286688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 msgr2=0x7fa3cc0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 --2- 172.21.15.82:0/1344286688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 0x7fa3cc0b0740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097f0 tx=0x7fa3bc01c450 comp rx=0 tx=0).stop 2023-07-20T10:05:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 -- 172.21.15.82:0/1344286688 shutdown_connections 2023-07-20T10:05:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 --2- 172.21.15.82:0/1344286688 >> v2:172.21.15.183:3300/0 conn(0x7fa3cc0ce600 0x7fa3cc0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 --2- 172.21.15.82:0/1344286688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc0b0360 0x7fa3cc0b0740 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 -- 172.21.15.82:0/1344286688 >> 172.21.15.82:0/1344286688 conn(0x7fa3cc098a10 msgr2=0x7fa3cc0cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 -- 172.21.15.82:0/1344286688 shutdown_connections 2023-07-20T10:05:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.062+0000 7fa3d1367640 1 -- 172.21.15.82:0/1344286688 wait complete. 2023-07-20T10:05:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 Processor -- start 2023-07-20T10:05:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- start start 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc0ce600 0x7fa3cc156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 0x7fa3cc158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15dff0 con 0x7fa3cc0b0360 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc1573c0 con 0x7fa3cc0ce600 2023-07-20T10:05:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc156e00 con 0x7fa3cc1603a0 2023-07-20T10:05:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56278/0 (socket says 172.21.15.82:56278) 2023-07-20T10:05:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 -- 172.21.15.82:0/3429474119 learned_addr learned my addr 172.21.15.82:0/3429474119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3c3fff640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc0ce600 0x7fa3cc156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3cb7fe640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 0x7fa3cc158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 -- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 msgr2=0x7fa3cc158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 0x7fa3cc158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 -- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc0ce600 msgr2=0x7fa3cc156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc0ce600 0x7fa3cc156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 -- 172.21.15.82:0/3429474119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009420 con 0x7fa3cc0b0360 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3cb7fe640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 0x7fa3cc158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3caffd640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ad040 tx=0x7fa3bc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0bf610 con 0x7fa3cc0b0360 2023-07-20T10:05:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0bf790 con 0x7fa3cc0b0360 2023-07-20T10:05:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0bfb40 con 0x7fa3cc0b0360 2023-07-20T10:05:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc1570e0 con 0x7fa3cc0b0360 2023-07-20T10:05:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.066+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc14d2a0 con 0x7fa3cc0b0360 2023-07-20T10:05:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.070+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc15da70 con 0x7fa3cc0b0360 2023-07-20T10:05:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.070+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fa3bc0b5400 con 0x7fa3cc0b0360 2023-07-20T10:05:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.070+0000 7fa3c37fe640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 0x7fa3ac0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.070+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa3bc11ec40 con 0x7fa3cc0b0360 2023-07-20T10:05:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.070+0000 7fa3c3fff640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 0x7fa3ac0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.074+0000 7fa3c3fff640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 0x7fa3ac0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0ae0e0 tx=0x7fa3b4009240 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.074+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3cc15da70 con 0x7fa3cc0b0360 2023-07-20T10:05:50.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.222+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3cc15da70 con 0x7fa3cc0b0360 2023-07-20T10:05:50.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3c37fe640 1 -- 172.21.15.82:0/3429474119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+19269 (secure 0 0 0) 0x7fa3cc15da70 con 0x7fa3cc0b0360 2023-07-20T10:05:50.206 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:50.206 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":83,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:47.698469+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:05:22.193275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-20T10:05:23.515835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3117016263":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720967325":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720817754":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2027423293":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6832/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/329177331":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3805426120":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/997612192":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/1287935297":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6833/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6832/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6833/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/1637149210":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/2748750086":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/115575575":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3471734032":"2023-07-21T10:05:41.778040+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 msgr2=0x7fa3ac0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 0x7fa3ac0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0ae0e0 tx=0x7fa3b4009240 comp rx=0 tx=0).stop 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 msgr2=0x7fa3cc14cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ad040 tx=0x7fa3bc01ac90 comp rx=0 tx=0).stop 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 shutdown_connections 2023-07-20T10:05:50.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa3ac066310 0x7fa3ac0687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3cc1603a0 0x7fa3cc158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3cc0ce600 0x7fa3cc156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 --2- 172.21.15.82:0/3429474119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3cc0b0360 0x7fa3cc14cd60 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 >> 172.21.15.82:0/3429474119 conn(0x7fa3cc098a10 msgr2=0x7fa3cc06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 shutdown_connections 2023-07-20T10:05:50.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.226+0000 7fa3d1367640 1 -- 172.21.15.82:0/3429474119 wait complete. 2023-07-20T10:05:50.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:05:50.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 Processor -- start 2023-07-20T10:05:50.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 -- start start 2023-07-20T10:05:50.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb71c0ccfb0 0x7fb71c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c0b7c20 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c15c9d0 con 0x7fb71c15c5f0 2023-07-20T10:05:50.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb721763640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c0b4980 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb71c0ccfb0 0x7fb71c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb71c0ccfb0 0x7fb71c0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56290/0 (socket says 172.21.15.82:56290) 2023-07-20T10:05:50.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb720f62640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb71c0ce9a0 0x7fb71c0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47946/0 (socket says 172.21.15.82:47946) 2023-07-20T10:05:50.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 -- 172.21.15.82:0/4074618318 learned_addr learned my addr 172.21.15.82:0/4074618318 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 -- 172.21.15.82:0/4074618318 >> v1:172.21.15.183:6789/0 conn(0x7fb71c15c5f0 legacy=0x7fb71c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 -- 172.21.15.82:0/4074618318 >> v1:172.21.15.82:6789/0 conn(0x7fb71c0ce9a0 legacy=0x7fb71c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71b7fe640 1 -- 172.21.15.82:0/4074618318 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0ce030 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.386+0000 7fb71affd640 1 -- 172.21.15.82:0/4074618318 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777208504 0 0) 0x7fb71c0b7c20 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb71b7fe640 1 --2- 172.21.15.82:0/4074618318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c0ce460 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc482ddf5cb1e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb71affd640 1 -- 172.21.15.82:0/4074618318 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a8a30 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb71affd640 1 -- 172.21.15.82:0/4074618318 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100a8b90 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb71affd640 1 -- 172.21.15.82:0/4074618318 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100b0440 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 -- 172.21.15.82:0/4074618318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ccfb0 msgr2=0x7fb71c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 --2- 172.21.15.82:0/4074618318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c0ce460 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71001ed30 comp rx=0 tx=0).stop 2023-07-20T10:05:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 -- 172.21.15.82:0/4074618318 shutdown_connections 2023-07-20T10:05:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 --2- 172.21.15.82:0/4074618318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c0ce460 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 -- 172.21.15.82:0/4074618318 >> 172.21.15.82:0/4074618318 conn(0x7fb71c065710 msgr2=0x7fb71c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 -- 172.21.15.82:0/4074618318 shutdown_connections 2023-07-20T10:05:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.390+0000 7fb721763640 1 -- 172.21.15.82:0/4074618318 wait complete. 2023-07-20T10:05:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 Processor -- start 2023-07-20T10:05:50.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- start start 2023-07-20T10:05:50.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 0x7fb71c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1f1770 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0cab70 con 0x7fb71c0ccfb0 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0cae10 con 0x7fb71c15c5f0 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56304/0 (socket says 172.21.15.82:56304) 2023-07-20T10:05:50.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 -- 172.21.15.82:0/1990525129 learned_addr learned my addr 172.21.15.82:0/1990525129 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71bfff640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb720f62640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 0x7fb71c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 -- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 msgr2=0x7fb71c06a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 0x7fb71c06a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 -- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c0ccfb0 msgr2=0x7fb71c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 -- 172.21.15.82:0/1990525129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100094d0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb720f62640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 0x7fb71c06a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:50.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb71b7fe640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b3040 tx=0x7fb71001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100a8a30 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100bb480 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100bb850 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c0cb0f0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.394+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c1528b0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c152aa0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fb7100bb9b0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb718ff9640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 0x7fb7080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fb710122610 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb71bfff640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 0x7fb7080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.398+0000 7fb71bfff640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 0x7fb7080687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb70c007fd0 tx=0x7fb70c009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.402+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7100ef7f0 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.582+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb71c04da30 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.563 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:05:50.582+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:05:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.586+0000 7fb718ff9640 1 -- 172.21.15.82:0/1990525129 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb7100f2e10 con 0x7fb71c0ce9a0 2023-07-20T10:05:50.569 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:05:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 msgr2=0x7fb7080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 0x7fb7080687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb70c007fd0 tx=0x7fb70c009040 comp rx=0 tx=0).stop 2023-07-20T10:05:50.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 msgr2=0x7fb71c0ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b3040 tx=0x7fb71001bad0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 shutdown_connections 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb708066310 0x7fb7080687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb71c15c5f0 0x7fb71c06a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb71c0ce9a0 0x7fb71c0ca630 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 --2- 172.21.15.82:0/1990525129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb71c0ccfb0 0x7fb71c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 >> 172.21.15.82:0/1990525129 conn(0x7fb71c065710 msgr2=0x7fb71c0b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 shutdown_connections 2023-07-20T10:05:50.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.590+0000 7fb721763640 1 -- 172.21.15.82:0/1990525129 wait complete. 2023-07-20T10:05:50.577 INFO:tasks.ceph.mds.b.smithi183.stderr: -4037> 2023-07-20T10:05:26.113+0000 7ff3fc22d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:05:50.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:05:50.626 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:05:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 Processor -- start 2023-07-20T10:05:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 -- start start 2023-07-20T10:05:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe5f0159830 0x7fe5f00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00cc8d0 con 0x7fe5f0159450 2023-07-20T10:05:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f00ccbb0 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5f5903640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00cce90 con 0x7fe5f0159830 2023-07-20T10:05:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5eeffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5f0159450 0x7fe5f015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47958/0 (socket says 172.21.15.82:47958) 2023-07-20T10:05:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5eeffd640 1 -- 172.21.15.82:0/1970800554 learned_addr learned my addr 172.21.15.82:0/1970800554 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.750+0000 7fe5e67fc640 1 --2- 172.21.15.82:0/1970800554 >> v2:172.21.15.183:3300/0 conn(0x7fe5f0159830 0x7fe5f00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5ee7fc640 1 -- 172.21.15.82:0/1970800554 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964342275 0 0) 0x7fe5f00cc8d0 con 0x7fe5f0159450 2023-07-20T10:05:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5ee7fc640 1 -- 172.21.15.82:0/1970800554 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d0005740 con 0x7fe5f0159450 2023-07-20T10:05:50.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5e67fc640 1 -- 172.21.15.82:0/1970800554 >> v1:172.21.15.183:6789/0 conn(0x7fe5f00cc3e0 legacy=0x7fe5f00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5e67fc640 1 -- 172.21.15.82:0/1970800554 >> v1:172.21.15.82:6789/0 conn(0x7fe5f0159450 legacy=0x7fe5f015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5e67fc640 1 -- 172.21.15.82:0/1970800554 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0159cc0 con 0x7fe5f0159830 2023-07-20T10:05:50.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5e67fc640 1 --2- 172.21.15.82:0/1970800554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f0159830 0x7fe5f00cbea0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097c0 tx=0x7fe5d801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60d671bdba597f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5ee7fc640 1 -- 172.21.15.82:0/1970800554 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80ad660 con 0x7fe5f0159830 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5ee7fc640 1 -- 172.21.15.82:0/1970800554 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80ad7c0 con 0x7fe5f0159830 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5ee7fc640 1 -- 172.21.15.82:0/1970800554 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80adb50 con 0x7fe5f0159830 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5f5903640 1 -- 172.21.15.82:0/1970800554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f0159830 msgr2=0x7fe5f00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.754+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1970800554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f0159830 0x7fe5f00cbea0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097c0 tx=0x7fe5d801c450 comp rx=0 tx=0).stop 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- 172.21.15.82:0/1970800554 shutdown_connections 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1970800554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f0159830 0x7fe5f00cbea0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- 172.21.15.82:0/1970800554 >> 172.21.15.82:0/1970800554 conn(0x7fe5f00cad50 msgr2=0x7fe5f00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- 172.21.15.82:0/1970800554 shutdown_connections 2023-07-20T10:05:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- 172.21.15.82:0/1970800554 wait complete. 2023-07-20T10:05:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 Processor -- start 2023-07-20T10:05:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- start start 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f0159450 0x7fe5f0164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f00c0fc0 0x7fe5f00c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00c19b0 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0162600 con 0x7fe5f00c0fc0 2023-07-20T10:05:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5f5903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f01f5ee0 con 0x7fe5f0159450 2023-07-20T10:05:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56306/0 (socket says 172.21.15.82:56306) 2023-07-20T10:05:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 -- 172.21.15.82:0/1966197303 learned_addr learned my addr 172.21.15.82:0/1966197303 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5e67fc640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f0159450 0x7fe5f0164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5ef7fe640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f00c0fc0 0x7fe5f00c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 -- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f0159450 msgr2=0x7fe5f0164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f0159450 0x7fe5f0164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 -- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f00c0fc0 msgr2=0x7fe5f00c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f00c0fc0 0x7fe5f00c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.758+0000 7fe5eeffd640 1 -- 172.21.15.82:0/1966197303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8009420 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5eeffd640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c500 tx=0x7fe5e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005cf0 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0005e50 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0165200 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e00072f0 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f0162850 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f004da30 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fe5e0007450 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 0x7fe5d40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fe5e0083670 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.762+0000 7fe5e67fc640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 0x7fe5d40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.766+0000 7fe5e67fc640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 0x7fe5d40687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80af000 tx=0x7fe5d8008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.766+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5e0050830 con 0x7fe5f00cc3e0 2023-07-20T10:05:50.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:50.950+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe5f00cbbf0 con 0x7fe5f00cc3e0 2023-07-20T10:05:51.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5ecff9640 1 -- 172.21.15.82:0/1966197303 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5e0053e50 con 0x7fe5f00cc3e0 2023-07-20T10:05:51.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 msgr2=0x7fe5d40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 0x7fe5d40687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80af000 tx=0x7fe5d8008040 comp rx=0 tx=0).stop 2023-07-20T10:05:51.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 msgr2=0x7fe5f01f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c500 tx=0x7fe5e000c9c0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 shutdown_connections 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fe5d4066310 0x7fe5d40687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5f00c0fc0 0x7fe5f00c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5f0159450 0x7fe5f0164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 --2- 172.21.15.82:0/1966197303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5f00cc3e0 0x7fe5f01f59a0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 >> 172.21.15.82:0/1966197303 conn(0x7fe5f00cad50 msgr2=0x7fe5f00c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:51.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 shutdown_connections 2023-07-20T10:05:51.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.590+0000 7fe5f5903640 1 -- 172.21.15.82:0/1966197303 wait complete. 2023-07-20T10:05:51.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:05:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 Processor -- start 2023-07-20T10:05:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 -- start start 2023-07-20T10:05:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 0x7f858006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85800ce4f0 con 0x7f858006c120 2023-07-20T10:05:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858006b4a0 con 0x7f85801602b0 2023-07-20T10:05:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8587796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85800d0970 con 0x7f858006ab10 2023-07-20T10:05:51.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8584d31640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8585d33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 0x7f858006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8584d31640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:51032/0 (socket says 172.21.15.82:51032) 2023-07-20T10:05:51.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8584d31640 1 -- 172.21.15.82:0/2685045590 learned_addr learned my addr 172.21.15.82:0/2685045590 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.758+0000 7f8585532640 1 --1- 172.21.15.82:0/2685045590 >> v1:172.21.15.183:6789/0 conn(0x7f858006c120 0x7f85800cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:50666/0 (socket says 172.21.15.82:50666) 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8585d33640 1 -- 172.21.15.82:0/2685045590 >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 msgr2=0x7f8580160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8585d33640 1 --2- 172.21.15.82:0/2685045590 >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8585d33640 1 -- 172.21.15.82:0/2685045590 >> v1:172.21.15.183:6789/0 conn(0x7f858006c120 legacy=0x7f85800cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8585d33640 1 -- 172.21.15.82:0/2685045590 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580160e20 con 0x7f858006ab10 2023-07-20T10:05:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8584d31640 1 --2- 172.21.15.82:0/2685045590 >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:51.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8577fff640 1 -- 172.21.15.82:0/2685045590 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412952411 0 0) 0x7f85800ce4f0 con 0x7f858006c120 2023-07-20T10:05:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8585d33640 1 --2- 172.21.15.82:0/2685045590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 0x7f858006af60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8578009d90 tx=0x7f857801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dd024e5010e3634 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8577fff640 1 -- 172.21.15.82:0/2685045590 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780a5950 con 0x7f858006ab10 2023-07-20T10:05:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8577fff640 1 -- 172.21.15.82:0/2685045590 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85780a5ab0 con 0x7f858006ab10 2023-07-20T10:05:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.762+0000 7f8577fff640 1 -- 172.21.15.82:0/2685045590 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780a5e40 con 0x7f858006ab10 2023-07-20T10:05:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- 172.21.15.82:0/2685045590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 msgr2=0x7f858006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- 172.21.15.82:0/2685045590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 0x7f858006af60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8578009d90 tx=0x7f857801c890 comp rx=0 tx=0).stop 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- 172.21.15.82:0/2685045590 shutdown_connections 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- 172.21.15.82:0/2685045590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006ab10 0x7f858006af60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- 172.21.15.82:0/2685045590 >> v2:172.21.15.183:3300/0 conn(0x7f85801602b0 0x7f8580160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- 172.21.15.82:0/2685045590 >> 172.21.15.82:0/2685045590 conn(0x7f858008c0a0 msgr2=0x7f858009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- 172.21.15.82:0/2685045590 shutdown_connections 2023-07-20T10:05:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- 172.21.15.82:0/2685045590 wait complete. 2023-07-20T10:05:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 Processor -- start 2023-07-20T10:05:51.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- start start 2023-07-20T10:05:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858006ab10 0x7f858015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006c120 0x7f858014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858014f590 con 0x7f85801602b0 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858014f870 con 0x7f858006ab10 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8587796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858014fb50 con 0x7f858006c120 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8585d33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8585d33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56308/0 (socket says 172.21.15.82:56308) 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8585d33640 1 -- 172.21.15.82:0/2400632886 learned_addr learned my addr 172.21.15.82:0/2400632886 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8585532640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858006ab10 0x7f858015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.766+0000 7f8584d31640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006c120 0x7f858014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 -- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006c120 msgr2=0x7f858014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006c120 0x7f858014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 -- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858006ab10 msgr2=0x7f858015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858006ab10 0x7f858015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 -- 172.21.15.82:0/2400632886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700094d0 con 0x7f85801602b0 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8585d33640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f857801af40 tx=0x7f8578019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780add90 con 0x7f85801602b0 2023-07-20T10:05:51.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8578009450 con 0x7f85801602b0 2023-07-20T10:05:51.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85780b9670 con 0x7f85801602b0 2023-07-20T10:05:51.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8578009a70 con 0x7f85801602b0 2023-07-20T10:05:51.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8580150110 con 0x7f85801602b0 2023-07-20T10:05:51.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858004da30 con 0x7f85801602b0 2023-07-20T10:05:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 38) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f85780039a0 con 0x7f85801602b0 2023-07-20T10:05:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 0x7f8564068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.770+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f857811f720 con 0x7f85801602b0 2023-07-20T10:05:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.774+0000 7f8585532640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 0x7f8564068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.774+0000 7f8585532640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 0x7f8564068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f857c007fd0 tx=0x7f857c007d60 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:51.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.778+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85780ec970 con 0x7f85801602b0 2023-07-20T10:05:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:51.926+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f85800cee40 con 0x7f85801602b0 2023-07-20T10:05:52.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.602+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85780ecd40 con 0x7f85801602b0 2023-07-20T10:05:52.919 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:05:52.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.938+0000 7f8575ffb640 1 -- 172.21.15.82:0/2400632886 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85781047d0 con 0x7f85801602b0 2023-07-20T10:05:52.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 msgr2=0x7f8564068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:52.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 0x7f8564068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f857c007fd0 tx=0x7f857c007d60 comp rx=0 tx=0).stop 2023-07-20T10:05:52.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 msgr2=0x7f85800af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:52.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f857801af40 tx=0x7f8578019630 comp rx=0 tx=0).stop 2023-07-20T10:05:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 shutdown_connections 2023-07-20T10:05:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8564066340 0x7f8564068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85801602b0 0x7f85800af220 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f858006c120 0x7f858014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:52.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 --2- 172.21.15.82:0/2400632886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f858006ab10 0x7f858015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 >> 172.21.15.82:0/2400632886 conn(0x7f858008c0a0 msgr2=0x7f85800b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 shutdown_connections 2023-07-20T10:05:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:52.942+0000 7f8587796640 1 -- 172.21.15.82:0/2400632886 wait complete. 2023-07-20T10:05:52.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:05:53.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 Processor -- start 2023-07-20T10:05:53.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 -- start start 2023-07-20T10:05:53.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f73080afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f73080b0290 0x7f73080cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73080b06e0 con 0x7f7308160ba0 2023-07-20T10:05:53.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c9650 con 0x7f73080b0290 2023-07-20T10:05:53.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730f5a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73081619c0 con 0x7f7308161de0 2023-07-20T10:05:53.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730d33f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7308160ba0 0x7f73080c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47972/0 (socket says 172.21.15.82:47972) 2023-07-20T10:05:53.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730d33f640 1 -- 172.21.15.82:0/769754806 learned_addr learned my addr 172.21.15.82:0/769754806 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730cb3e640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f73080afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 --2- 172.21.15.82:0/769754806 >> v2:172.21.15.183:3300/0 conn(0x7f73080b0290 0x7f73080cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056758232 0 0) 0x7f7304001120 con 0x7f7308160ba0 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003530 con 0x7f7308160ba0 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789580767 0 0) 0x7f72f4003530 con 0x7f7308160ba0 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 msgr2=0x7f73080afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f73080afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 >> v2:172.21.15.183:3300/0 conn(0x7f73080b0290 msgr2=0x7f73080cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 --2- 172.21.15.82:0/769754806 >> v2:172.21.15.183:3300/0 conn(0x7f73080b0290 0x7f73080cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080c9370 con 0x7f7308160ba0 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7304001810 con 0x7f7308160ba0 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 >> v1:172.21.15.82:6789/0 conn(0x7f7308160ba0 legacy=0x7f73080c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f72f40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72f4003f70 0x7f72f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f72f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c9650 con 0x7f72f4004d10 2023-07-20T10:05:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081619c0 con 0x7f72f4003f70 2023-07-20T10:05:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400b9c0 con 0x7f7308161de0 2023-07-20T10:05:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f72f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730d33f640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f72f40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730cb3e640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72f4003f70 0x7f72f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 -- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 msgr2=0x7f72f40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7308161de0 0x7f72f40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 -- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72f4003f70 msgr2=0x7f72f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72f4003f70 0x7f72f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730db40640 1 -- 172.21.15.82:0/769754806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003530 con 0x7f72f4004d10 2023-07-20T10:05:53.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.114+0000 7f730cb3e640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72f4003f70 0x7f72f40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730db40640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f72f4005190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fc0 tx=0x7f730001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e19243a10d0d620 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000a5cb0 con 0x7f72f4004d10 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000f040 con 0x7f72f4004d10 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f72fffff640 1 -- 172.21.15.82:0/769754806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000ad680 con 0x7f72f4004d10 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 -- 172.21.15.82:0/769754806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 msgr2=0x7f72f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 --2- 172.21.15.82:0/769754806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f72f4005190 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7300009fc0 tx=0x7f730001cca0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730db40640 1 -- 172.21.15.82:0/769754806 reap_dead start 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 -- 172.21.15.82:0/769754806 shutdown_connections 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 -- 172.21.15.82:0/769754806 >> 172.21.15.82:0/769754806 conn(0x7f73080cad50 msgr2=0x7f73080cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 -- 172.21.15.82:0/769754806 shutdown_connections 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.118+0000 7f730f5a3640 1 -- 172.21.15.82:0/769754806 wait complete. 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 Processor -- start 2023-07-20T10:05:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- start start 2023-07-20T10:05:53.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73080c69e0 0x7f73080c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080b1bb0 0x7f730814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c46a0 con 0x7f72f4004d10 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c8780 con 0x7f73080b1bb0 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c5680 con 0x7f73080c69e0 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56322/0 (socket says 172.21.15.82:56322) 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 -- 172.21.15.82:0/602920716 learned_addr learned my addr 172.21.15.82:0/602920716 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730cb3e640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73080c69e0 0x7f73080c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730db40640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080b1bb0 0x7f730814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 -- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73080c69e0 msgr2=0x7f73080c8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73080c69e0 0x7f73080c8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 -- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080b1bb0 msgr2=0x7f730814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080b1bb0 0x7f730814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 -- 172.21.15.82:0/602920716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080c30c0 con 0x7f72f4004d10 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730d33f640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7304007300 tx=0x7f73040077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304007e90 con 0x7f72f4004d10 2023-07-20T10:05:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730400e950 con 0x7f72f4004d10 2023-07-20T10:05:53.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730400ed00 con 0x7f72f4004d10 2023-07-20T10:05:53.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080c33a0 con 0x7f72f4004d10 2023-07-20T10:05:53.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.122+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73080c3960 con 0x7f72f4004d10 2023-07-20T10:05:53.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730804da30 con 0x7f72f4004d10 2023-07-20T10:05:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f730401d460 con 0x7f72f4004d10 2023-07-20T10:05:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f72fdffb640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 0x7f72ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f7304083e80 con 0x7f72f4004d10 2023-07-20T10:05:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f730cb3e640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 0x7f72ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.126+0000 7f730cb3e640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 0x7f72ec068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73080b26d0 tx=0x7f72f8008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:53.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.130+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7304051140 con 0x7f72f4004d10 2023-07-20T10:05:53.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.278+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73080b4250 con 0x7f72f4004d10 2023-07-20T10:05:53.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.946+0000 7f72fdffb640 1 -- 172.21.15.82:0/602920716 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7304054760 con 0x7f72f4004d10 2023-07-20T10:05:53.927 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:05:53.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 msgr2=0x7f72ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 0x7f72ec068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f73080b26d0 tx=0x7f72f8008040 comp rx=0 tx=0).stop 2023-07-20T10:05:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 msgr2=0x7f73080c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7304007300 tx=0x7f73040077c0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 shutdown_connections 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f72ec0663a0 0x7f72ec068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080b1bb0 0x7f730814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73080c69e0 0x7f73080c8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 --2- 172.21.15.82:0/602920716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72f4004d10 0x7f73080c4160 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 >> 172.21.15.82:0/602920716 conn(0x7f73080cad50 msgr2=0x7f73080b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:53.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 shutdown_connections 2023-07-20T10:05:53.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:53.950+0000 7f730f5a3640 1 -- 172.21.15.82:0/602920716 wait complete. 2023-07-20T10:05:53.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:05:54.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.110+0000 7fc7717fa640 1 Processor -- start 2023-07-20T10:05:54.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.110+0000 7fc7717fa640 1 -- start start 2023-07-20T10:05:54.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 0x7fc76c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc76c159830 0x7fc76c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 0x7fc76c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cce90 con 0x7fc76c159830 2023-07-20T10:05:54.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cc8d0 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7717fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0ccbb0 con 0x7fc76c159450 2023-07-20T10:05:54.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc76c159830 0x7fc76c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc76c159830 0x7fc76c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60490/0 (socket says 172.21.15.82:60490) 2023-07-20T10:05:54.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 -- 172.21.15.82:0/299275862 learned_addr learned my addr 172.21.15.82:0/299275862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc76affd640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 0x7fc76c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc76b7fe640 1 --2- 172.21.15.82:0/299275862 >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 0x7fc76c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 -- 172.21.15.82:0/299275862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 msgr2=0x7fc76c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:54.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 0x7fc76c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 -- 172.21.15.82:0/299275862 >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 msgr2=0x7fc76c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:54.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 --2- 172.21.15.82:0/299275862 >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 0x7fc76c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc7627fc640 1 -- 172.21.15.82:0/299275862 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c159cc0 con 0x7fc76c159830 2023-07-20T10:05:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc76affd640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 0x7fc76c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.114+0000 7fc76b7fe640 1 --2- 172.21.15.82:0/299275862 >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 0x7fc76c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:54.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7627fc640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c159830 0x7fc76c0cbea0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0ce1b0 tx=0x7fc75401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33ca1e076614d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc76a7fc640 1 -- 172.21.15.82:0/299275862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540a7b40 con 0x7fc76c159830 2023-07-20T10:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc76a7fc640 1 -- 172.21.15.82:0/299275862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7540a7ca0 con 0x7fc76c159830 2023-07-20T10:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc76a7fc640 1 -- 172.21.15.82:0/299275862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540af660 con 0x7fc76c159830 2023-07-20T10:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- 172.21.15.82:0/299275862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c159830 msgr2=0x7fc76c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c159830 0x7fc76c0cbea0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0ce1b0 tx=0x7fc75401eba0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- 172.21.15.82:0/299275862 shutdown_connections 2023-07-20T10:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 --2- 172.21.15.82:0/299275862 >> v2:172.21.15.183:3300/0 conn(0x7fc76c0cc3e0 0x7fc76c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c159830 0x7fc76c0cbea0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 --2- 172.21.15.82:0/299275862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c159450 0x7fc76c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- 172.21.15.82:0/299275862 >> 172.21.15.82:0/299275862 conn(0x7fc76c0cad50 msgr2=0x7fc76c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- 172.21.15.82:0/299275862 shutdown_connections 2023-07-20T10:05:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- 172.21.15.82:0/299275862 wait complete. 2023-07-20T10:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 Processor -- start 2023-07-20T10:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.118+0000 7fc7717fa640 1 -- start start 2023-07-20T10:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc76c159450 0x7fc76c158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 0x7fc76c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c154690 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c155060 con 0x7fc76c159450 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c158d90 con 0x7fc76c153580 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60504/0 (socket says 172.21.15.82:60504) 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 -- 172.21.15.82:0/1284354931 learned_addr learned my addr 172.21.15.82:0/1284354931 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7627fc640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc76c159450 0x7fc76c158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76b7fe640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 0x7fc76c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 -- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 msgr2=0x7fc76c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 0x7fc76c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 -- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc76c159450 msgr2=0x7fc76c158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc76c159450 0x7fc76c158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 -- 172.21.15.82:0/1284354931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75400b770 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76b7fe640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 0x7fc76c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc76affd640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c7c0 tx=0x7fc75c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c007a30 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c007b90 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00ce70 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c153a80 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c154040 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.122+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c04da30 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.126+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc75c0113f0 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.126+0000 7fc763fff640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 0x7fc750068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.126+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc75c084330 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.126+0000 7fc7627fc640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 0x7fc750068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.126+0000 7fc7627fc640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 0x7fc750068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7540b1000 tx=0x7fc7540a9070 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.130+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc75c051690 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.286+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fc76c0cbbf0 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc763fff640 1 -- 172.21.15.82:0/1284354931 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7fc75c054cb0 con 0x7fc76c0cc3e0 2023-07-20T10:05:54.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 msgr2=0x7fc750068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 0x7fc750068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc7540b1000 tx=0x7fc7540a9070 comp rx=0 tx=0).stop 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 msgr2=0x7fc76c154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c7c0 tx=0x7fc75c00cc80 comp rx=0 tx=0).stop 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 shutdown_connections 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc7500663a0 0x7fc750068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc76c153580 0x7fc76c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc76c159450 0x7fc76c158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 --2- 172.21.15.82:0/1284354931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc76c0cc3e0 0x7fc76c154b20 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 >> 172.21.15.82:0/1284354931 conn(0x7fc76c0cad50 msgr2=0x7fc76c070900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 shutdown_connections 2023-07-20T10:05:54.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.294+0000 7fc7717fa640 1 -- 172.21.15.82:0/1284354931 wait complete. 2023-07-20T10:05:54.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:05:54.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.454+0000 7fd45fba3640 1 Processor -- start 2023-07-20T10:05:54.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.454+0000 7fd45fba3640 1 -- start start 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45fba3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4581589a0 0x7fd4580cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45fba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd45815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45fba3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4580cb6e0 con 0x7fd4580cb280 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45fba3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580cabd0 con 0x7fd4581589a0 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45fba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458070a70 con 0x7fd4580ca5b0 2023-07-20T10:05:54.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4581589a0 0x7fd4580cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd4581589a0 0x7fd4580cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60516/0 (socket says 172.21.15.82:60516) 2023-07-20T10:05:54.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 -- 172.21.15.82:0/3897824685 learned_addr learned my addr 172.21.15.82:0/3897824685 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45e140640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd45815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 -- 172.21.15.82:0/3897824685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 msgr2=0x7fd45815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:54.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd45815c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 -- 172.21.15.82:0/3897824685 >> v1:172.21.15.183:6789/0 conn(0x7fd4580cb280 legacy=0x7fd4580c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 -- 172.21.15.82:0/3897824685 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45806fcb0 con 0x7fd4581589a0 2023-07-20T10:05:54.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.458+0000 7fd45d93f640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd4580cad40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd454009870 tx=0x7fd45401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af567869ee9fcdaf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45c93d640 1 -- 172.21.15.82:0/3897824685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540ab600 con 0x7fd4581589a0 2023-07-20T10:05:54.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45c93d640 1 -- 172.21.15.82:0/3897824685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4540a7050 con 0x7fd4581589a0 2023-07-20T10:05:54.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45c93d640 1 -- 172.21.15.82:0/3897824685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540ab980 con 0x7fd4581589a0 2023-07-20T10:05:54.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- 172.21.15.82:0/3897824685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 msgr2=0x7fd4580cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd4580cad40 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fd454009870 tx=0x7fd45401c540 comp rx=0 tx=0).stop 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- 172.21.15.82:0/3897824685 shutdown_connections 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd45815c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- 172.21.15.82:0/3897824685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd4580cad40 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- 172.21.15.82:0/3897824685 >> 172.21.15.82:0/3897824685 conn(0x7fd458065710 msgr2=0x7fd458069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- 172.21.15.82:0/3897824685 shutdown_connections 2023-07-20T10:05:54.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- 172.21.15.82:0/3897824685 wait complete. 2023-07-20T10:05:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 Processor -- start 2023-07-20T10:05:54.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- start start 2023-07-20T10:05:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd4580c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 0x7fd4581510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458152480 con 0x7fd4581589a0 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458151630 con 0x7fd4580cb280 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45fba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd458151900 con 0x7fd4580ca5b0 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45e140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45e140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60528/0 (socket says 172.21.15.82:60528) 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45e140640 1 -- 172.21.15.82:0/4036182083 learned_addr learned my addr 172.21.15.82:0/4036182083 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45d13e640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 0x7fd4581510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.462+0000 7fd45d93f640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd4580c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 -- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 msgr2=0x7fd4580c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd4580c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 -- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 msgr2=0x7fd4581510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 0x7fd4581510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 -- 172.21.15.82:0/4036182083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540094d0 con 0x7fd4581589a0 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45d13e640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 0x7fd4581510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45e140640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd450007e40 tx=0x7fd45000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450014620 con 0x7fd4581589a0 2023-07-20T10:05:54.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45000ee90 con 0x7fd4581589a0 2023-07-20T10:05:54.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4500149e0 con 0x7fd4581589a0 2023-07-20T10:05:54.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd458151be0 con 0x7fd4581589a0 2023-07-20T10:05:54.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4581521a0 con 0x7fd4581589a0 2023-07-20T10:05:54.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580c5ea0 con 0x7fd4581589a0 2023-07-20T10:05:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.466+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd450014b40 con 0x7fd4581589a0 2023-07-20T10:05:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.470+0000 7fd44e7fc640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 0x7fd43c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.470+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd4500846c0 con 0x7fd4581589a0 2023-07-20T10:05:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.470+0000 7fd45d93f640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 0x7fd43c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.470+0000 7fd45d93f640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 0x7fd43c068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4580cf6c0 tx=0x7fd4540a6000 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.474+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4580c5ea0 con 0x7fd4581589a0 2023-07-20T10:05:54.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.618+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fd4580c5ea0 con 0x7fd4581589a0 2023-07-20T10:05:54.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.626+0000 7fd44e7fc640 1 -- 172.21.15.82:0/4036182083 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd4580c5ea0 con 0x7fd4581589a0 2023-07-20T10:05:54.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.626+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 msgr2=0x7fd43c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.626+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 0x7fd43c068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd4580cf6c0 tx=0x7fd4540a6000 comp rx=0 tx=0).stop 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.626+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 msgr2=0x7fd458150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.626+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fd450007e40 tx=0x7fd45000e4b0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 shutdown_connections 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd43c0663d0 0x7fd43c068890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581589a0 0x7fd458150920 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd4580cb280 0x7fd4581510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 --2- 172.21.15.82:0/4036182083 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd4580ca5b0 0x7fd4580c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 >> 172.21.15.82:0/4036182083 conn(0x7fd458065710 msgr2=0x7fd4580ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 shutdown_connections 2023-07-20T10:05:54.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.630+0000 7fd45fba3640 1 -- 172.21.15.82:0/4036182083 wait complete. 2023-07-20T10:05:54.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:05:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 Processor -- start 2023-07-20T10:05:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 -- start start 2023-07-20T10:05:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5edc1602b0 0x7f5edc160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5edc06ab10 0x7f5edc06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc0ce4f0 con 0x7f5edc06c120 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc0d0970 con 0x7f5edc06ab10 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ee0a6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5edc160e20 con 0x7f5edc1602b0 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5edc06ab10 0x7f5edc06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5edc06ab10 0x7f5edc06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60532/0 (socket says 172.21.15.82:60532) 2023-07-20T10:05:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 -- 172.21.15.82:0/2714172038 learned_addr learned my addr 172.21.15.82:0/2714172038 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5ed9d9b640 1 --2- 172.21.15.82:0/2714172038 >> v2:172.21.15.183:3300/0 conn(0x7f5edc1602b0 0x7f5edc160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 -- 172.21.15.82:0/2714172038 >> v2:172.21.15.183:3300/0 conn(0x7f5edc1602b0 msgr2=0x7f5edc160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 --2- 172.21.15.82:0/2714172038 >> v2:172.21.15.183:3300/0 conn(0x7f5edc1602b0 0x7f5edc160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 -- 172.21.15.82:0/2714172038 >> v1:172.21.15.183:6789/0 conn(0x7f5edc06c120 legacy=0x7f5edc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.790+0000 7f5edad9d640 1 -- 172.21.15.82:0/2714172038 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc0cd300 con 0x7f5edc06ab10 2023-07-20T10:05:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5edad9d640 1 --2- 172.21.15.82:0/2714172038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06ab10 0x7f5edc06af10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f5edc08ca40 tx=0x7f5ed401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d953653a7ef72c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ed959a640 1 -- 172.21.15.82:0/2714172038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40a5790 con 0x7f5edc06ab10 2023-07-20T10:05:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ed959a640 1 -- 172.21.15.82:0/2714172038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40a58f0 con 0x7f5edc06ab10 2023-07-20T10:05:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ed959a640 1 -- 172.21.15.82:0/2714172038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40a5c80 con 0x7f5edc06ab10 2023-07-20T10:05:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/2714172038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06ab10 msgr2=0x7f5edc06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/2714172038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06ab10 0x7f5edc06af10 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f5edc08ca40 tx=0x7f5ed401c8d0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/2714172038 shutdown_connections 2023-07-20T10:05:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/2714172038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06ab10 0x7f5edc06af10 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/2714172038 >> v2:172.21.15.183:3300/0 conn(0x7f5edc1602b0 0x7f5edc160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/2714172038 >> 172.21.15.82:0/2714172038 conn(0x7f5edc08c0a0 msgr2=0x7f5edc09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/2714172038 shutdown_connections 2023-07-20T10:05:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.794+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/2714172038 wait complete. 2023-07-20T10:05:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 Processor -- start 2023-07-20T10:05:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 -- start start 2023-07-20T10:05:54.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5edc06ab10 0x7f5edc153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 0x7f5edc154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c8910 con 0x7f5edc06c120 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c8bb0 con 0x7f5edc1602b0 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ee0a6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0c8e90 con 0x7f5edc06ab10 2023-07-20T10:05:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60534/0 (socket says 172.21.15.82:60534) 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 -- 172.21.15.82:0/378074836 learned_addr learned my addr 172.21.15.82:0/378074836 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5eda59c640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5edc06ab10 0x7f5edc153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5edad9d640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 0x7f5edc154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 -- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5edc06ab10 msgr2=0x7f5edc153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5edc06ab10 0x7f5edc153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 -- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 msgr2=0x7f5edc154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 0x7f5edc154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 -- 172.21.15.82:0/378074836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009b30 con 0x7f5edc06c120 2023-07-20T10:05:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5edad9d640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 0x7f5edc154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ed9d9b640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d5f0 tx=0x7f5ed000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00125f0 con 0x7f5edc06c120 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.798+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0012750 con 0x7f5edc06c120 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0012ae0 con 0x7f5edc06c120 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc0c9d80 con 0x7f5edc06c120 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc153fa0 con 0x7f5edc06c120 2023-07-20T10:05:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc04da30 con 0x7f5edc06c120 2023-07-20T10:05:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ed0012c40 con 0x7f5edc06c120 2023-07-20T10:05:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ecaffd640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 0x7f5ebc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5ed00843a0 con 0x7f5edc06c120 2023-07-20T10:05:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.802+0000 7f5eda59c640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 0x7f5ebc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.806+0000 7f5eda59c640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 0x7f5ebc068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc004e30 tx=0x7f5ecc009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.806+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ed00516e0 con 0x7f5edc06c120 2023-07-20T10:05:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.958+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5edc0cee40 con 0x7f5edc06c120 2023-07-20T10:05:54.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.962+0000 7f5ecaffd640 1 -- 172.21.15.82:0/378074836 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ed0007380 con 0x7f5edc06c120 2023-07-20T10:05:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 msgr2=0x7f5ebc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 0x7f5ebc068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc004e30 tx=0x7f5ecc009040 comp rx=0 tx=0).stop 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 msgr2=0x7f5edc0c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d5f0 tx=0x7f5ed000dab0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 shutdown_connections 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5ebc0663a0 0x7f5ebc068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5edc1602b0 0x7f5edc154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5edc06c120 0x7f5edc0c74d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 --2- 172.21.15.82:0/378074836 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5edc06ab10 0x7f5edc153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:54.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 >> 172.21.15.82:0/378074836 conn(0x7f5edc08c0a0 msgr2=0x7f5edc0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:54.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 shutdown_connections 2023-07-20T10:05:54.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:54.966+0000 7f5ee0a6a640 1 -- 172.21.15.82:0/378074836 wait complete. 2023-07-20T10:05:54.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-20T10:05:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.122+0000 7fb3eb396640 1 Processor -- start 2023-07-20T10:05:55.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.122+0000 7fb3eb396640 1 -- start start 2023-07-20T10:05:55.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3eb396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3eb396640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb3e415a8e0 0x7fb3e40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3eb396640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e40b2ee0 con 0x7fb3e40b2060 2023-07-20T10:05:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3eb396640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e40b3160 con 0x7fb3e415a8e0 2023-07-20T10:05:55.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3eb396640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b12a0 con 0x7fb3e40afda0 2023-07-20T10:05:55.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e9132640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e8931640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb3e415a8e0 0x7fb3e40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e9933640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb3e40b2060 0x7fb3e40b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59148/0 (socket says 172.21.15.82:59148) 2023-07-20T10:05:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e9933640 1 -- 172.21.15.82:0/2464864099 learned_addr learned my addr 172.21.15.82:0/2464864099 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e8931640 1 -- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 msgr2=0x7fb3e40ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e8931640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e40ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e8931640 1 -- 172.21.15.82:0/2464864099 >> v1:172.21.15.183:6789/0 conn(0x7fb3e40b2060 legacy=0x7fb3e40b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e8931640 1 -- 172.21.15.82:0/2464864099 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40b1580 con 0x7fb3e415a8e0 2023-07-20T10:05:55.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.126+0000 7fb3e9132640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:55.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3e8931640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40b29a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40097f0 tx=0x7fb3d401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e5e1e0170a9b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:55.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3dbfff640 1 -- 172.21.15.82:0/2464864099 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40ab600 con 0x7fb3e415a8e0 2023-07-20T10:05:55.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3dbfff640 1 -- 172.21.15.82:0/2464864099 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d40a7050 con 0x7fb3e415a8e0 2023-07-20T10:05:55.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3dbfff640 1 -- 172.21.15.82:0/2464864099 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40ab980 con 0x7fb3e415a8e0 2023-07-20T10:05:55.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 msgr2=0x7fb3e40b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40b29a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40097f0 tx=0x7fb3d401c330 comp rx=0 tx=0).stop 2023-07-20T10:05:55.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- 172.21.15.82:0/2464864099 shutdown_connections 2023-07-20T10:05:55.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40b29a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 --2- 172.21.15.82:0/2464864099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e40ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- 172.21.15.82:0/2464864099 >> 172.21.15.82:0/2464864099 conn(0x7fb3e40cada0 msgr2=0x7fb3e40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- 172.21.15.82:0/2464864099 shutdown_connections 2023-07-20T10:05:55.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- 172.21.15.82:0/2464864099 wait complete. 2023-07-20T10:05:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 Processor -- start 2023-07-20T10:05:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.130+0000 7fb3eb396640 1 -- start start 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e415c2f0 con 0x7fb3e40b2060 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e415d6b0 con 0x7fb3e415a8e0 2023-07-20T10:05:55.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e415d950 con 0x7fb3e40afda0 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60536/0 (socket says 172.21.15.82:60536) 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 -- 172.21.15.82:0/3012120752 learned_addr learned my addr 172.21.15.82:0/3012120752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e9933640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e9132640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 -- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 msgr2=0x7fb3e415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 -- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 msgr2=0x7fb3e40ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 -- 172.21.15.82:0/3012120752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e0009420 con 0x7fb3e40b2060 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3e8931640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb3d401a9e0 tx=0x7fb3d40190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40b4400 con 0x7fb3e40b2060 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d40b4560 con 0x7fb3e40b2060 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40b4910 con 0x7fb3e40b2060 2023-07-20T10:05:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d4009420 con 0x7fb3e40b2060 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e415b180 con 0x7fb3e40b2060 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.134+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e4073c70 con 0x7fb3e40b2060 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.138+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb3d40b2040 con 0x7fb3e40b2060 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.138+0000 7fb3d9ffb640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 0x7fb3c8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.138+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb3d411dd40 con 0x7fb3e40b2060 2023-07-20T10:05:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.138+0000 7fb3e9132640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 0x7fb3c8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.138+0000 7fb3e9132640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 0x7fb3c8068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cbcd0 tx=0x7fb3e0009190 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.142+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3d40eb0b0 con 0x7fb3e40b2060 2023-07-20T10:05:55.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.346+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fb3e40cb990 con 0x7fb3e40b2060 2023-07-20T10:05:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3d9ffb640 1 -- 172.21.15.82:0/3012120752 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v577) v1 ==== 156+0+0 (secure 0 0 0) 0x7fb3d40ee6d0 con 0x7fb3e40b2060 2023-07-20T10:05:55.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 msgr2=0x7fb3c8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 0x7fb3c8068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cbcd0 tx=0x7fb3e0009190 comp rx=0 tx=0).stop 2023-07-20T10:05:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 msgr2=0x7fb3e40adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb3d401a9e0 tx=0x7fb3d40190d0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 shutdown_connections 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb3c80663a0 0x7fb3c8068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb3e415a8e0 0x7fb3e40ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e40b2060 0x7fb3e40adb50 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 --2- 172.21.15.82:0/3012120752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb3e40afda0 0x7fb3e415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 >> 172.21.15.82:0/3012120752 conn(0x7fb3e40cada0 msgr2=0x7fb3e4071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 shutdown_connections 2023-07-20T10:05:55.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:55.950+0000 7fb3eb396640 1 -- 172.21.15.82:0/3012120752 wait complete. 2023-07-20T10:05:55.954 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-07-20T10:05:55.956 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-07-20T10:05:55.956 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:05:55.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-20T10:05:56.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 Processor -- start 2023-07-20T10:05:56.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 -- start start 2023-07-20T10:05:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d440ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2d440b2060 0x7f2d440b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440b06c0 con 0x7f2d440afda0 2023-07-20T10:05:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440b3160 con 0x7f2d440b2060 2023-07-20T10:05:56.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4c40b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440b12a0 con 0x7f2d4415a8e0 2023-07-20T10:05:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4a1a7640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2d440afda0 0x7f2d440b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39922/0 (socket says 172.21.15.82:39922) 2023-07-20T10:05:56.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.118+0000 7f2d4a1a7640 1 -- 172.21.15.82:0/3120715064 learned_addr learned my addr 172.21.15.82:0/3120715064 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 --2- 172.21.15.82:0/3120715064 >> v2:172.21.15.183:3300/0 conn(0x7f2d440b2060 0x7f2d440b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d499a6640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d440ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946593855 0 0) 0x7f2d440b06c0 con 0x7f2d440afda0 2023-07-20T10:05:56.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d30003530 con 0x7f2d440afda0 2023-07-20T10:05:56.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3327371960 0 0) 0x7f2d30003530 con 0x7f2d440afda0 2023-07-20T10:05:56.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 -- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 msgr2=0x7f2d440ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:56.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d440ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 -- 172.21.15.82:0/3120715064 >> v1:172.21.15.82:6789/0 conn(0x7f2d440afda0 legacy=0x7f2d440b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 -- 172.21.15.82:0/3120715064 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440b1580 con 0x7f2d440b2060 2023-07-20T10:05:56.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d499a6640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d440ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:56.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.122+0000 7f2d4a9a8640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d440b0180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009d90 tx=0x7f2d3c01c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bea08623bf0e0322 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:56.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38001680 con 0x7f2d440b2060 2023-07-20T10:05:56.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0a5520 con 0x7f2d440b2060 2023-07-20T10:05:56.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d491a5640 1 -- 172.21.15.82:0/3120715064 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0a58b0 con 0x7f2d440b2060 2023-07-20T10:05:56.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 msgr2=0x7f2d440b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d440b0180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009d90 tx=0x7f2d3c01c720 comp rx=0 tx=0).stop 2023-07-20T10:05:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- 172.21.15.82:0/3120715064 shutdown_connections 2023-07-20T10:05:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d440b0180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/3120715064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d440ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- 172.21.15.82:0/3120715064 >> 172.21.15.82:0/3120715064 conn(0x7f2d440cada0 msgr2=0x7f2d440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:56.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- 172.21.15.82:0/3120715064 shutdown_connections 2023-07-20T10:05:56.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- 172.21.15.82:0/3120715064 wait complete. 2023-07-20T10:05:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 Processor -- start 2023-07-20T10:05:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- start start 2023-07-20T10:05:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d4415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d44154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44157990 con 0x7f2d440afda0 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441554b0 con 0x7f2d440b2060 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4c40b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415c680 con 0x7f2d4415a8e0 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4a1a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4a1a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60548/0 (socket says 172.21.15.82:60548) 2023-07-20T10:05:56.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4a1a7640 1 -- 172.21.15.82:0/789782566 learned_addr learned my addr 172.21.15.82:0/789782566 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d4a9a8640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d44154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.126+0000 7f2d499a6640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d4415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 -- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 msgr2=0x7f2d44154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d44154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 -- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 msgr2=0x7f2d4415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d4415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 -- 172.21.15.82:0/789782566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009420 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4a1a7640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c780 tx=0x7f2d3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38005cf0 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005e50 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380072b0 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c009a70 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4415cc00 con 0x7f2d440afda0 2023-07-20T10:05:56.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d44073c70 con 0x7f2d440afda0 2023-07-20T10:05:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d38007410 con 0x7f2d440afda0 2023-07-20T10:05:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 0x7f2d28068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.130+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2d38083b10 con 0x7f2d440afda0 2023-07-20T10:05:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.134+0000 7f2d499a6640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 0x7f2d28068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:56.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.134+0000 7f2d499a6640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 0x7f2d28068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406faf0 tx=0x7f2d40009190 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:56.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.138+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d38050f40 con 0x7f2d440afda0 2023-07-20T10:05:56.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.334+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f2d440cb990 con 0x7f2d440afda0 2023-07-20T10:05:56.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.950+0000 7f2d36ffd640 1 -- 172.21.15.82:0/789782566 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v578) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d38054560 con 0x7f2d440afda0 2023-07-20T10:05:56.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 msgr2=0x7f2d28068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 0x7f2d28068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406faf0 tx=0x7f2d40009190 comp rx=0 tx=0).stop 2023-07-20T10:05:56.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 msgr2=0x7f2d440cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c780 tx=0x7f2d3800cc40 comp rx=0 tx=0).stop 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 shutdown_connections 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2d280663a0 0x7f2d28068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d4415a8e0 0x7f2d44154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d440b2060 0x7f2d4415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 --2- 172.21.15.82:0/789782566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d440afda0 0x7f2d440cc7c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:56.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 >> 172.21.15.82:0/789782566 conn(0x7f2d440cada0 msgr2=0x7f2d44157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:56.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 shutdown_connections 2023-07-20T10:05:56.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:56.954+0000 7f2d4c40b640 1 -- 172.21.15.82:0/789782566 wait complete. 2023-07-20T10:05:56.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:05:57.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.118+0000 7f92c5607640 1 Processor -- start 2023-07-20T10:05:57.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.118+0000 7f92c5607640 1 -- start start 2023-07-20T10:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92c5607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92c015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92c5607640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00cde70 con 0x7f92c00b1170 2023-07-20T10:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92c5607640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00cbef0 con 0x7f92c00ca040 2023-07-20T10:05:57.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92c5607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00ca420 con 0x7f92c00ad060 2023-07-20T10:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f92c00b1170 0x7f92c00b1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39926/0 (socket says 172.21.15.82:39926) 2023-07-20T10:05:57.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 -- 172.21.15.82:0/2241417425 learned_addr learned my addr 172.21.15.82:0/2241417425 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545616727 0 0) 0x7f92c00cde70 con 0x7f92c00b1170 2023-07-20T10:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a8003530 con 0x7f92c00b1170 2023-07-20T10:05:57.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92be7fc640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92c015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120021392 0 0) 0x7f92a8003530 con 0x7f92c00b1170 2023-07-20T10:05:57.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 msgr2=0x7f92c015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92c015d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 >> v1:172.21.15.183:6789/0 conn(0x7f92c00ca040 legacy=0x7f92c015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00cdb40 con 0x7f92c00b1170 2023-07-20T10:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f92b8001680 con 0x7f92c00b1170 2023-07-20T10:05:57.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 >> v1:172.21.15.82:6789/0 conn(0x7f92c00b1170 legacy=0x7f92c00b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a80039b0 0x7f92a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a8004d10 0x7f92a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00ca420 con 0x7f92a8004d10 2023-07-20T10:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a800ba70 con 0x7f92a80039b0 2023-07-20T10:05:57.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a800bc30 con 0x7f92c00ad060 2023-07-20T10:05:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a8004d10 0x7f92a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92beffd640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a80039b0 0x7f92a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92be7fc640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 -- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 msgr2=0x7f92a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92c00ad060 0x7f92a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 -- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a80039b0 msgr2=0x7f92a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92a80039b0 0x7f92a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.122+0000 7f92bf7fe640 1 -- 172.21.15.82:0/2241417425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a8003530 con 0x7f92a8004d10 2023-07-20T10:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a8004d10 0x7f92a8005190 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f92b8001ec0 tx=0x7f92b801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ffe49cf5f5cf4c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80a7c50 con 0x7f92a8004d10 2023-07-20T10:05:57.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b80a7db0 con 0x7f92a8004d10 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92bdffb640 1 -- 172.21.15.82:0/2241417425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8005b20 con 0x7f92a8004d10 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 -- 172.21.15.82:0/2241417425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a8004d10 msgr2=0x7f92a8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 --2- 172.21.15.82:0/2241417425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92a8004d10 0x7f92a8005190 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f92b8001ec0 tx=0x7f92b801ed50 comp rx=0 tx=0).stop 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92bf7fe640 1 -- 172.21.15.82:0/2241417425 reap_dead start 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 -- 172.21.15.82:0/2241417425 shutdown_connections 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 -- 172.21.15.82:0/2241417425 >> 172.21.15.82:0/2241417425 conn(0x7f92c00cada0 msgr2=0x7f92c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:57.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 -- 172.21.15.82:0/2241417425 shutdown_connections 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.126+0000 7f92c5607640 1 -- 172.21.15.82:0/2241417425 wait complete. 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 Processor -- start 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- start start 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a8004d10 0x7f92c01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c01553b0 0x7f92c00ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01f2460 con 0x7f92c00ab870 2023-07-20T10:05:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0155da0 con 0x7f92c01553b0 2023-07-20T10:05:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0157eb0 con 0x7f92a8004d10 2023-07-20T10:05:57.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60564/0 (socket says 172.21.15.82:60564) 2023-07-20T10:05:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 -- 172.21.15.82:0/647357814 learned_addr learned my addr 172.21.15.82:0/647357814 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92be7fc640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c01553b0 0x7f92c00ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92beffd640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a8004d10 0x7f92c01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 -- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a8004d10 msgr2=0x7f92c01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a8004d10 0x7f92c01578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 -- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c01553b0 msgr2=0x7f92c00ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c01553b0 0x7f92c00ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 -- 172.21.15.82:0/647357814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c01594c0 con 0x7f92c00ab870 2023-07-20T10:05:57.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92bf7fe640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f92b801f5f0 tx=0x7f92a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80049f0 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8004b50 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800f1d0 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c01597a0 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c0155830 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.130+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c0159320 con 0x7f92c00ab870 2023-07-20T10:05:57.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.134+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92b8007090 con 0x7f92c00ab870 2023-07-20T10:05:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.134+0000 7f92a77fe640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 0x7f92ac068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.134+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f92b811dda0 con 0x7f92c00ab870 2023-07-20T10:05:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.134+0000 7f92beffd640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 0x7f92ac068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.134+0000 7f92beffd640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 0x7f92ac068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c10 tx=0x7f92b0009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.138+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92c0159320 con 0x7f92c00ab870 2023-07-20T10:05:57.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.286+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c0159320 con 0x7f92c00ab870 2023-07-20T10:05:57.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.286+0000 7f92a77fe640 1 -- 172.21.15.82:0/647357814 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+15748 (secure 0 0 0) 0x7f92b811ada0 con 0x7f92c00ab870 2023-07-20T10:05:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:57.268 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:53.938523+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6834/1873066176":"2023-07-21T10:05:50.586042+0000","172.21.15.82:0/3117016263":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720967325":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2720817754":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/2027423293":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6832/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/329177331":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3805426120":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/997612192":"2023-07-21T10:05:41.778040+0000","172.21.15.183:6832/1873066176":"2023-07-21T10:05:50.586042+0000","172.21.15.82:0/1287935297":"2023-07-21T10:05:47.698421+0000","172.21.15.82:6833/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6832/4139035279":"2023-07-21T10:05:41.778040+0000","172.21.15.82:6833/3872476705":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/1637149210":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/2748750086":"2023-07-21T10:05:47.698421+0000","172.21.15.82:0/115575575":"2023-07-21T10:05:41.778040+0000","172.21.15.82:0/3471734032":"2023-07-21T10:05:41.778040+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:05:57.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 msgr2=0x7f92ac068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 0x7f92ac068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c10 tx=0x7f92b0009040 comp rx=0 tx=0).stop 2023-07-20T10:05:57.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 msgr2=0x7f92c00abcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f92b801f5f0 tx=0x7f92a8005800 comp rx=0 tx=0).stop 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 shutdown_connections 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f92ac0663d0 0x7f92ac068890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92c00ab870 0x7f92c00abcf0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f92c01553b0 0x7f92c00ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 --2- 172.21.15.82:0/647357814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92a8004d10 0x7f92c01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 >> 172.21.15.82:0/647357814 conn(0x7f92c00cada0 msgr2=0x7f92c006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:57.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 shutdown_connections 2023-07-20T10:05:57.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.290+0000 7f92c5607640 1 -- 172.21.15.82:0/647357814 wait complete. 2023-07-20T10:05:57.289 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:05:57.290 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:05:57.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:05:57.392 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:05:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.450+0000 7fc04a48a640 1 Processor -- start 2023-07-20T10:05:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.450+0000 7fc04a48a640 1 -- start start 2023-07-20T10:05:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc04a48a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc04415fb70 0x7fc0440b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc04a48a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440d0970 0x7fc0440b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc04a48a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04415ff50 con 0x7fc0440b44d0 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc04a48a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440b4960 con 0x7fc04415fb70 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc04a48a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440d0f90 con 0x7fc0440d0970 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc04415fb70 0x7fc0440b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc04415fb70 0x7fc0440b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60568/0 (socket says 172.21.15.82:60568) 2023-07-20T10:05:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 -- 172.21.15.82:0/1854242290 learned_addr learned my addr 172.21.15.82:0/1854242290 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049c89640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440d0970 0x7fc0440b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 -- 172.21.15.82:0/1854242290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440d0970 msgr2=0x7fc0440b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440d0970 0x7fc0440b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 -- 172.21.15.82:0/1854242290 >> v1:172.21.15.183:6789/0 conn(0x7fc0440b44d0 legacy=0x7fc0440d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.454+0000 7fc049488640 1 -- 172.21.15.82:0/1854242290 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0440cd190 con 0x7fc04415fb70 2023-07-20T10:05:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc049488640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04415fb70 0x7fc0440b3f90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc040009870 tx=0x7fc04001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166be057aefc3a17 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc03bfff640 1 -- 172.21.15.82:0/1854242290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400ac640 con 0x7fc04415fb70 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc03bfff640 1 -- 172.21.15.82:0/1854242290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0400ac7a0 con 0x7fc04415fb70 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc03bfff640 1 -- 172.21.15.82:0/1854242290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400acb30 con 0x7fc04415fb70 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- 172.21.15.82:0/1854242290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04415fb70 msgr2=0x7fc0440b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04415fb70 0x7fc0440b3f90 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc040009870 tx=0x7fc04001c420 comp rx=0 tx=0).stop 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- 172.21.15.82:0/1854242290 shutdown_connections 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0440d0970 0x7fc0440b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1854242290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc04415fb70 0x7fc0440b3f90 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- 172.21.15.82:0/1854242290 >> 172.21.15.82:0/1854242290 conn(0x7fc044065710 msgr2=0x7fc044065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- 172.21.15.82:0/1854242290 shutdown_connections 2023-07-20T10:05:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- 172.21.15.82:0/1854242290 wait complete. 2023-07-20T10:05:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 Processor -- start 2023-07-20T10:05:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.458+0000 7fc04a48a640 1 -- start start 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 0x7fc04415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc04415fb70 0x7fc044157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc044156c80 con 0x7fc0440b44d0 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04414e890 con 0x7fc0440d0970 2023-07-20T10:05:57.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04414eb70 con 0x7fc04415fb70 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60576/0 (socket says 172.21.15.82:60576) 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 -- 172.21.15.82:0/1447122623 learned_addr learned my addr 172.21.15.82:0/1447122623 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc048c87640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 0x7fc04415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049c89640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc04415fb70 0x7fc044157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 -- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc04415fb70 msgr2=0x7fc044157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc04415fb70 0x7fc044157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 -- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 msgr2=0x7fc04415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 0x7fc04415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 -- 172.21.15.82:0/1447122623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400094d0 con 0x7fc0440b44d0 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc048c87640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 0x7fc04415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc049488640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc0400af040 tx=0x7fc0400191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400b5850 con 0x7fc0440b44d0 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0400b59b0 con 0x7fc0440b44d0 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc044156ef0 con 0x7fc0440b44d0 2023-07-20T10:05:57.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400b5d40 con 0x7fc0440b44d0 2023-07-20T10:05:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04415de10 con 0x7fc0440b44d0 2023-07-20T10:05:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04415e0c0 con 0x7fc0440b44d0 2023-07-20T10:05:57.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.462+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc0400b3070 con 0x7fc0440b44d0 2023-07-20T10:05:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.466+0000 7fc039ffb640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 0x7fc028068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.466+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc04011e040 con 0x7fc0440b44d0 2023-07-20T10:05:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.466+0000 7fc048c87640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 0x7fc028068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.466+0000 7fc048c87640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 0x7fc028068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc0440cc480 tx=0x7fc034009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.470+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc04014e700 con 0x7fc0440b44d0 2023-07-20T10:05:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.618+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc04404da30 con 0x7fc0440b44d0 2023-07-20T10:05:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.618+0000 7fc039ffb640 1 -- 172.21.15.82:0/1447122623 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0400b10a0 con 0x7fc0440b44d0 2023-07-20T10:05:57.600 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:05:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 msgr2=0x7fc028068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 0x7fc028068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc0440cc480 tx=0x7fc034009040 comp rx=0 tx=0).stop 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 msgr2=0x7fc04415d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc0400af040 tx=0x7fc0400191c0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 shutdown_connections 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0280663a0 0x7fc028068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc04415fb70 0x7fc044157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0440d0970 0x7fc04415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 --2- 172.21.15.82:0/1447122623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0440b44d0 0x7fc04415d8d0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 >> 172.21.15.82:0/1447122623 conn(0x7fc044065710 msgr2=0x7fc0440b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 shutdown_connections 2023-07-20T10:05:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.622+0000 7fc04a48a640 1 -- 172.21.15.82:0/1447122623 wait complete. 2023-07-20T10:05:57.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:05:57.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.858+0000 7fd798703640 1 Processor -- start 2023-07-20T10:05:57.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.858+0000 7fd798703640 1 -- start start 2023-07-20T10:05:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd798703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 0x7fd7900c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd798703640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd79006bd30 0x7fd790070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd798703640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7900c95d0 con 0x7fd790070970 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd798703640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd790071310 con 0x7fd79006bd30 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd798703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900c9fa0 con 0x7fd790158ce0 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd795c9e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd790070970 0x7fd79006b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39940/0 (socket says 172.21.15.82:39940) 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd795c9e640 1 -- 172.21.15.82:0/1536039766 learned_addr learned my addr 172.21.15.82:0/1536039766 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd796ca0640 1 --2- 172.21.15.82:0/1536039766 >> v2:172.21.15.183:3300/0 conn(0x7fd79006bd30 0x7fd790070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd79649f640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 0x7fd7900c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd79549d640 1 -- 172.21.15.82:0/1536039766 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566514191 0 0) 0x7fd7900c95d0 con 0x7fd790070970 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd79549d640 1 -- 172.21.15.82:0/1536039766 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c003530 con 0x7fd790070970 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd796ca0640 1 -- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 msgr2=0x7fd7900c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd796ca0640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 0x7fd7900c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd796ca0640 1 -- 172.21.15.82:0/1536039766 >> v1:172.21.15.82:6789/0 conn(0x7fd790070970 legacy=0x7fd79006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd796ca0640 1 -- 172.21.15.82:0/1536039766 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7901590c0 con 0x7fd79006bd30 2023-07-20T10:05:57.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.862+0000 7fd79649f640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 0x7fd7900c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:05:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd796ca0640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd79006bd30 0x7fd790070dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd788009d90 tx=0x7fd78801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24d8e253a2b0b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd79549d640 1 -- 172.21.15.82:0/1536039766 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7880a59e0 con 0x7fd79006bd30 2023-07-20T10:05:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd79549d640 1 -- 172.21.15.82:0/1536039766 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7880a5b40 con 0x7fd79006bd30 2023-07-20T10:05:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd79549d640 1 -- 172.21.15.82:0/1536039766 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7880ad440 con 0x7fd79006bd30 2023-07-20T10:05:57.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd79006bd30 msgr2=0x7fd790070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd79006bd30 0x7fd790070dd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd788009d90 tx=0x7fd78801c920 comp rx=0 tx=0).stop 2023-07-20T10:05:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- 172.21.15.82:0/1536039766 shutdown_connections 2023-07-20T10:05:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd79006bd30 0x7fd790070dd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 --2- 172.21.15.82:0/1536039766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd790158ce0 0x7fd7900c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- 172.21.15.82:0/1536039766 >> 172.21.15.82:0/1536039766 conn(0x7fd7900cad50 msgr2=0x7fd7900cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:57.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- 172.21.15.82:0/1536039766 shutdown_connections 2023-07-20T10:05:57.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- 172.21.15.82:0/1536039766 wait complete. 2023-07-20T10:05:57.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 Processor -- start 2023-07-20T10:05:57.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.866+0000 7fd798703640 1 -- start start 2023-07-20T10:05:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd79006bd30 0x7fd7901533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 0x7fd7900c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79014db50 con 0x7fd790158ce0 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901538f0 con 0x7fd790070970 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd790151f30 con 0x7fd79006bd30 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60582/0 (socket says 172.21.15.82:60582) 2023-07-20T10:05:57.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 -- 172.21.15.82:0/2203312808 learned_addr learned my addr 172.21.15.82:0/2203312808 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 -- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd79006bd30 msgr2=0x7fd7901533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd795c9e640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 0x7fd7900c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd79006bd30 0x7fd7901533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 -- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 msgr2=0x7fd7900c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 0x7fd7900c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 -- 172.21.15.82:0/2203312808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c009420 con 0x7fd790158ce0 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd795c9e640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 0x7fd7900c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:05:57.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd796ca0640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd7880b0040 tx=0x7fd7880196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7880adce0 con 0x7fd790158ce0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7880ade40 con 0x7fd790158ce0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7880b7650 con 0x7fd790158ce0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788009a70 con 0x7fd790158ce0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79013d3d0 con 0x7fd790158ce0 2023-07-20T10:05:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79004da30 con 0x7fd790158ce0 2023-07-20T10:05:57.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.870+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7880b4050 con 0x7fd790158ce0 2023-07-20T10:05:57.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.874+0000 7fd786ffd640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 0x7fd774068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:57.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.874+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd78811f450 con 0x7fd790158ce0 2023-07-20T10:05:57.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.874+0000 7fd79649f640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 0x7fd774068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:57.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.874+0000 7fd79649f640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 0x7fd774068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006e90 tx=0x7fd78c006de0 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:57.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:57.878+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7880ec820 con 0x7fd790158ce0 2023-07-20T10:05:58.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.026+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd790163920 con 0x7fd790158ce0 2023-07-20T10:05:58.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.026+0000 7fd786ffd640 1 -- 172.21.15.82:0/2203312808 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd788009450 con 0x7fd790158ce0 2023-07-20T10:05:58.009 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:05:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 msgr2=0x7fd774068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 0x7fd774068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006e90 tx=0x7fd78c006de0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 msgr2=0x7fd79015bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd7880b0040 tx=0x7fd7880196c0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 shutdown_connections 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7740663a0 0x7fd774068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd790158ce0 0x7fd79015bf40 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd790070970 0x7fd7900c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 --2- 172.21.15.82:0/2203312808 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd79006bd30 0x7fd7901533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 >> 172.21.15.82:0/2203312808 conn(0x7fd7900cad50 msgr2=0x7fd7900cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 shutdown_connections 2023-07-20T10:05:58.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.030+0000 7fd798703640 1 -- 172.21.15.82:0/2203312808 wait complete. 2023-07-20T10:05:58.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:05:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 Processor -- start 2023-07-20T10:05:58.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 -- start start 2023-07-20T10:05:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5838159450 0x7f583815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f58380afd50 0x7f58380b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380b06b0 con 0x7f5838159830 2023-07-20T10:05:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380cce90 con 0x7f5838159450 2023-07-20T10:05:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f5840018640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380cc8d0 con 0x7f58380afd50 2023-07-20T10:05:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f583d5b3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5838159830 0x7f58380cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39944/0 (socket says 172.21.15.82:39944) 2023-07-20T10:05:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f583d5b3640 1 -- 172.21.15.82:0/664533326 learned_addr learned my addr 172.21.15.82:0/664533326 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:58.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f583ddb4640 1 --2- 172.21.15.82:0/664533326 >> v2:172.21.15.82:3300/0 conn(0x7f5838159450 0x7f583815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.190+0000 7f583e5b5640 1 --2- 172.21.15.82:0/664533326 >> v2:172.21.15.183:3300/0 conn(0x7f58380afd50 0x7f58380b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583ddb4640 1 -- 172.21.15.82:0/664533326 >> v2:172.21.15.183:3300/0 conn(0x7f58380afd50 msgr2=0x7f58380b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583ddb4640 1 --2- 172.21.15.82:0/664533326 >> v2:172.21.15.183:3300/0 conn(0x7f58380afd50 0x7f58380b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583ddb4640 1 -- 172.21.15.82:0/664533326 >> v1:172.21.15.82:6789/0 conn(0x7f5838159830 legacy=0x7f58380cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583ddb4640 1 -- 172.21.15.82:0/664533326 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380ccbb0 con 0x7f5838159450 2023-07-20T10:05:58.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583cdb2640 1 -- 172.21.15.82:0/664533326 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280125394 0 0) 0x7f58380b06b0 con 0x7f5838159830 2023-07-20T10:05:58.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583ddb4640 1 --2- 172.21.15.82:0/664533326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5838159450 0x7f583815a4c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f58380c1da0 tx=0x7f583401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957a894369ab9ce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583cdb2640 1 -- 172.21.15.82:0/664533326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340a7070 con 0x7f5838159450 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583cdb2640 1 -- 172.21.15.82:0/664533326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58340ab430 con 0x7f5838159450 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f583cdb2640 1 -- 172.21.15.82:0/664533326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58340ab7c0 con 0x7f5838159450 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f5840018640 1 -- 172.21.15.82:0/664533326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5838159450 msgr2=0x7f583815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.194+0000 7f5840018640 1 --2- 172.21.15.82:0/664533326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5838159450 0x7f583815a4c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f58380c1da0 tx=0x7f583401c430 comp rx=0 tx=0).stop 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- 172.21.15.82:0/664533326 shutdown_connections 2023-07-20T10:05:58.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 --2- 172.21.15.82:0/664533326 >> v2:172.21.15.183:3300/0 conn(0x7f58380afd50 0x7f58380b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 --2- 172.21.15.82:0/664533326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5838159450 0x7f583815a4c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- 172.21.15.82:0/664533326 >> 172.21.15.82:0/664533326 conn(0x7f58380cad50 msgr2=0x7f58380cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:58.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- 172.21.15.82:0/664533326 shutdown_connections 2023-07-20T10:05:58.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- 172.21.15.82:0/664533326 wait complete. 2023-07-20T10:05:58.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 Processor -- start 2023-07-20T10:05:58.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- start start 2023-07-20T10:05:58.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5838159450 0x7f58381f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 0x7f5838156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5838156a40 con 0x7f58380afd50 2023-07-20T10:05:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380c6de0 con 0x7f5838159450 2023-07-20T10:05:58.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f5840018640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380c7050 con 0x7f5838156070 2023-07-20T10:05:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60600/0 (socket says 172.21.15.82:60600) 2023-07-20T10:05:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 -- 172.21.15.82:0/2937618310 learned_addr learned my addr 172.21.15.82:0/2937618310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583d5b3640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5838159450 0x7f58381f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583e5b5640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 0x7f5838156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 -- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 msgr2=0x7f5838156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 0x7f5838156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 -- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5838159450 msgr2=0x7f58381f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5838159450 0x7f58381f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583ddb4640 1 -- 172.21.15.82:0/2937618310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009420 con 0x7f58380afd50 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.198+0000 7f583e5b5640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 0x7f5838156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f583ddb4640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5834019040 tx=0x7f583401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834004230 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58340b9070 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834006e20 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380c7330 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58380c78f0 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58380c7ae0 con 0x7f58380afd50 2023-07-20T10:05:58.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5834003620 con 0x7f58380afd50 2023-07-20T10:05:58.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 0x7f581c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f58340bb070 con 0x7f58380afd50 2023-07-20T10:05:58.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.202+0000 7f583d5b3640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 0x7f581c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.206+0000 7f583d5b3640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 0x7f581c068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58381f9360 tx=0x7f5828007df0 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.206+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58340ebd60 con 0x7f58380afd50 2023-07-20T10:05:58.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.354+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f583804da30 con 0x7f58380afd50 2023-07-20T10:05:58.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f582e7fc640 1 -- 172.21.15.82:0/2937618310 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58340c40c0 con 0x7f58380afd50 2023-07-20T10:05:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 msgr2=0x7f581c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 0x7f581c068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f58381f9360 tx=0x7f5828007df0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 msgr2=0x7f58380c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f5834019040 tx=0x7f583401ac70 comp rx=0 tx=0).stop 2023-07-20T10:05:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 shutdown_connections 2023-07-20T10:05:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f581c0663a0 0x7f581c068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5838156070 0x7f5838156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5838159450 0x7f58381f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 --2- 172.21.15.82:0/2937618310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58380afd50 0x7f58380c7e10 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 >> 172.21.15.82:0/2937618310 conn(0x7f58380cad50 msgr2=0x7f58381556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 shutdown_connections 2023-07-20T10:05:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.362+0000 7f5840018640 1 -- 172.21.15.82:0/2937618310 wait complete. 2023-07-20T10:05:58.362 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:05:58.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:58.436 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:05:58.494 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:05:58.495 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:58.495 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:58.504 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:58.505 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:58.505 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:58.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:58.515 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:05:58.516 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:58.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:05:58.557 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:05:58.558 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:05:58.567 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:05:58.568 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:05:58.568 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:05:58.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.762+0000 7f3f5bc27640 1 Processor -- start 2023-07-20T10:05:58.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 -- start start 2023-07-20T10:05:58.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f540c91f0 0x7f3f540ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f540cd080 0x7f3f54069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540ab890 con 0x7f3f5415c5e0 2023-07-20T10:05:58.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540cd4f0 con 0x7f3f540cd080 2023-07-20T10:05:58.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5bc27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54069ac0 con 0x7f3f540c91f0 2023-07-20T10:05:58.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f540cd080 0x7f3f54069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3f540cd080 0x7f3f54069f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60612/0 (socket says 172.21.15.82:60612) 2023-07-20T10:05:58.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 -- 172.21.15.82:0/149520876 learned_addr learned my addr 172.21.15.82:0/149520876 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:58.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f591c2640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f540c91f0 0x7f3f540ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 -- 172.21.15.82:0/149520876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f540c91f0 msgr2=0x7f3f540ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:58.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f540c91f0 0x7f3f540ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 -- 172.21.15.82:0/149520876 >> v1:172.21.15.183:6789/0 conn(0x7f3f5415c5e0 legacy=0x7f3f540adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.766+0000 7f3f5a1c4640 1 -- 172.21.15.82:0/149520876 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540ce2d0 con 0x7f3f540cd080 2023-07-20T10:05:58.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5a1c4640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f54069f50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009e50 tx=0x7f3f4c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a712c7276759807c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f589c1640 1 -- 172.21.15.82:0/149520876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0a58a0 con 0x7f3f540cd080 2023-07-20T10:05:58.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f589c1640 1 -- 172.21.15.82:0/149520876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c0a5a00 con 0x7f3f540cd080 2023-07-20T10:05:58.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f589c1640 1 -- 172.21.15.82:0/149520876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0a5d90 con 0x7f3f540cd080 2023-07-20T10:05:58.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- 172.21.15.82:0/149520876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 msgr2=0x7f3f54069f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f54069f50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009e50 tx=0x7f3f4c01c9e0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- 172.21.15.82:0/149520876 shutdown_connections 2023-07-20T10:05:58.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f54069f50 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/149520876 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f540c91f0 0x7f3f540ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- 172.21.15.82:0/149520876 >> 172.21.15.82:0/149520876 conn(0x7f3f540cb620 msgr2=0x7f3f540cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:58.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- 172.21.15.82:0/149520876 shutdown_connections 2023-07-20T10:05:58.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- 172.21.15.82:0/149520876 wait complete. 2023-07-20T10:05:58.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 Processor -- start 2023-07-20T10:05:58.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.770+0000 7f3f5bc27640 1 -- start start 2023-07-20T10:05:58.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f540c91f0 0x7f3f540c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5415c5e0 0x7f3f540abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540ac690 con 0x7f3f540cd080 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540ac970 con 0x7f3f540c91f0 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540acc50 con 0x7f3f5415c5e0 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60624/0 (socket says 172.21.15.82:60624) 2023-07-20T10:05:58.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 -- 172.21.15.82:0/263272653 learned_addr learned my addr 172.21.15.82:0/263272653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:58.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f599c3640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f540c91f0 0x7f3f540c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5a1c4640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5415c5e0 0x7f3f540abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 -- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5415c5e0 msgr2=0x7f3f540abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5415c5e0 0x7f3f540abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 -- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f540c91f0 msgr2=0x7f3f540c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f540c91f0 0x7f3f540c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 -- 172.21.15.82:0/263272653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009b30 con 0x7f3f540cd080 2023-07-20T10:05:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f591c2640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e870 tx=0x7f3f4400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44009510 con 0x7f3f540cd080 2023-07-20T10:05:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400eec0 con 0x7f3f540cd080 2023-07-20T10:05:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400cb40 con 0x7f3f540cd080 2023-07-20T10:05:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5415cb40 con 0x7f3f540cd080 2023-07-20T10:05:58.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5414c470 con 0x7f3f540cd080 2023-07-20T10:05:58.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.774+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f54073c70 con 0x7f3f540cd080 2023-07-20T10:05:58.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.778+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f4400cca0 con 0x7f3f540cd080 2023-07-20T10:05:58.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.778+0000 7f3f4a7fc640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 0x7f3f38068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:58.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.778+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3f44084320 con 0x7f3f540cd080 2023-07-20T10:05:58.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.778+0000 7f3f599c3640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 0x7f3f38068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:58.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.778+0000 7f3f599c3640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 0x7f3f38068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f50007fd0 tx=0x7f3f50009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:58.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.782+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f44051680 con 0x7f3f540cd080 2023-07-20T10:05:58.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.958+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f540cc920 con 0x7f3f540cd080 2023-07-20T10:05:58.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f4a7fc640 1 -- 172.21.15.82:0/263272653 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f3f44017de0 con 0x7f3f540cd080 2023-07-20T10:05:58.941 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:05:58.942 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/353165795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":353165795},{"type":"v1","addr":"172.21.15.183:6835","nonce":353165795}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6666,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/620162105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":620162105},{"type":"v1","addr":"172.21.15.82:6836","nonce":620162105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2746081680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2746081680},{"type":"v1","addr":"172.21.15.82:6837","nonce":2746081680}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6697,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/761433805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":761433805},{"type":"v1","addr":"172.21.15.183:6834","nonce":761433805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-07-20T10:05:58.942 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 35 2023-07-20T10:05:58.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 msgr2=0x7f3f38068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 0x7f3f38068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3f50007fd0 tx=0x7f3f50009040 comp rx=0 tx=0).stop 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 msgr2=0x7f3f540c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400e870 tx=0x7f3f4400ec70 comp rx=0 tx=0).stop 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 shutdown_connections 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f3f380663a0 0x7f3f38068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f5415c5e0 0x7f3f540abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f540cd080 0x7f3f540c79b0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 --2- 172.21.15.82:0/263272653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f540c91f0 0x7f3f540c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:58.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 >> 172.21.15.82:0/263272653 conn(0x7f3f540cb620 msgr2=0x7f3f540ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:58.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 shutdown_connections 2023-07-20T10:05:58.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:58.962+0000 7f3f5bc27640 1 -- 172.21.15.82:0/263272653 wait complete. 2023-07-20T10:05:58.963 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:05:58.963 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:05:58.964 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:05:58.964 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:58.964 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:05:58.964 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:05:58.965 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:05:58.965 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:58.965 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:05:58.965 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:05:58.965 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:05:58.966 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:58.966 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:05:58.966 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:05:58.966 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:05:58.966 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:05:58.977 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:05:58.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:05:58.979 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:05:58.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:05:58.985 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:05:58.985 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:05:58.986 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:05:58.987 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:05:59.031 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:05:59.031 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:59.033 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:05:59.033 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:59.034 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:05:59.034 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:59.035 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:05:59.035 DEBUG:teuthology.parallel:result is None 2023-07-20T10:05:59.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:05:59.119 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:05:59.123 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:05:59.128 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:05:59.129 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:05:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 Processor -- start 2023-07-20T10:05:59.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 -- start start 2023-07-20T10:05:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f42940b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f429415c120 0x7f429415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42940b28d0 con 0x7f429406f350 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42940cf4a0 con 0x7f429415c120 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4298c88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429406ea80 con 0x7f42940b1f30 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4292d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f429415c120 0x7f429415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f429259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f429406f350 0x7f429406b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39950/0 (socket says 172.21.15.82:39950) 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f4292d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f429415c120 0x7f429415c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60650/0 (socket says 172.21.15.82:60650) 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.202+0000 7f429259c640 1 -- 172.21.15.82:0/1374465134 learned_addr learned my addr 172.21.15.82:0/1374465134 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:05:59.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4289d9b640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f42940b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4292d9d640 1 -- 172.21.15.82:0/1374465134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 msgr2=0x7f42940b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:05:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4292d9d640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f42940b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4292d9d640 1 -- 172.21.15.82:0/1374465134 >> v1:172.21.15.82:6789/0 conn(0x7f429406f350 legacy=0x7f429406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4292d9d640 1 -- 172.21.15.82:0/1374465134 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42940ce890 con 0x7f429415c120 2023-07-20T10:05:59.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4291d9b640 1 -- 172.21.15.82:0/1374465134 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126445209 0 0) 0x7f42940b28d0 con 0x7f429406f350 2023-07-20T10:05:59.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4292d9d640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429415c120 0x7f429415c590 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f428c009d90 tx=0x7f428c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518f17b7cc815d72 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4291d9b640 1 -- 172.21.15.82:0/1374465134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0a5970 con 0x7f429415c120 2023-07-20T10:05:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4291d9b640 1 -- 172.21.15.82:0/1374465134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c0a5ad0 con 0x7f429415c120 2023-07-20T10:05:59.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4291d9b640 1 -- 172.21.15.82:0/1374465134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0a5e60 con 0x7f429415c120 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4298c88640 1 -- 172.21.15.82:0/1374465134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429415c120 msgr2=0x7f429415c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.206+0000 7f4298c88640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429415c120 0x7f429415c590 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f428c009d90 tx=0x7f428c01c890 comp rx=0 tx=0).stop 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- 172.21.15.82:0/1374465134 shutdown_connections 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429415c120 0x7f429415c590 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 --2- 172.21.15.82:0/1374465134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f42940b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- 172.21.15.82:0/1374465134 >> 172.21.15.82:0/1374465134 conn(0x7f4294089fa0 msgr2=0x7f42940d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:59.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- 172.21.15.82:0/1374465134 shutdown_connections 2023-07-20T10:05:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- 172.21.15.82:0/1374465134 wait complete. 2023-07-20T10:05:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 Processor -- start 2023-07-20T10:05:59.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- start start 2023-07-20T10:05:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f4294156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f429415c120 0x7f42940c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429415d630 con 0x7f429406f350 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294152e70 con 0x7f429415c120 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4298c88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4294153150 con 0x7f42940b1f30 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60652/0 (socket says 172.21.15.82:60652) 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 -- 172.21.15.82:0/4055045240 learned_addr learned my addr 172.21.15.82:0/4055045240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:05:59.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4289d9b640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f4294156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f4292d9d640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f429415c120 0x7f42940c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 -- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 msgr2=0x7f4294156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f4294156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 -- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f429415c120 msgr2=0x7f42940c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f429415c120 0x7f42940c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.210+0000 7f429259c640 1 -- 172.21.15.82:0/4055045240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009a70 con 0x7f429406f350 2023-07-20T10:05:59.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f429259c640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f42840011f0 tx=0x7f428400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:59.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840074e0 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4284007640 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42940cfab0 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284004a10 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4294153710 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42940cf910 con 0x7f429406f350 2023-07-20T10:05:59.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4284004b70 con 0x7f429406f350 2023-07-20T10:05:59.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 0x7f4274068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:05:59.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f42840833a0 con 0x7f429406f350 2023-07-20T10:05:59.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.214+0000 7f4289d9b640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 0x7f4274068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:05:59.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.218+0000 7f4289d9b640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 0x7f4274068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42941f8260 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:05:59.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.218+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42940cf910 con 0x7f429406f350 2023-07-20T10:05:59.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.378+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f42940cf910 con 0x7f429406f350 2023-07-20T10:05:59.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.974+0000 7f428b7fe640 1 -- 172.21.15.82:0/4055045240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v88) v1 ==== 97+0+0 (secure 0 0 0) 0x7f42940cf910 con 0x7f429406f350 2023-07-20T10:05:59.957 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:05:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 msgr2=0x7f4274068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 0x7f4274068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42941f8260 tx=0x7f427c008040 comp rx=0 tx=0).stop 2023-07-20T10:05:59.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 msgr2=0x7f4294146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:05:59.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f42840011f0 tx=0x7f428400c9b0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 shutdown_connections 2023-07-20T10:05:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f42740663d0 0x7f4274068890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f429415c120 0x7f42940c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f42940b1f30 0x7f4294156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 --2- 172.21.15.82:0/4055045240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f429406f350 0x7f4294146fd0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:05:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 >> 172.21.15.82:0/4055045240 conn(0x7f4294089fa0 msgr2=0x7f42940adab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:05:59.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 shutdown_connections 2023-07-20T10:05:59.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:05:59.978+0000 7f4298c88640 1 -- 172.21.15.82:0/4055045240 wait complete. 2023-07-20T10:05:59.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:06:00.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 Processor -- start 2023-07-20T10:06:00.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 -- start start 2023-07-20T10:06:00.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb0415c5f0 0x7feb040b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb040b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b7c20 con 0x7feb040ccfb0 2023-07-20T10:06:00.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0415c9d0 con 0x7feb0415c5f0 2023-07-20T10:06:00.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb088a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb040ce030 con 0x7feb040ceb70 2023-07-20T10:06:00.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb037fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb0415c5f0 0x7feb040b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feafaffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feb040ccfb0 0x7feb040ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39966/0 (socket says 172.21.15.82:39966) 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feafaffd640 1 -- 172.21.15.82:0/2440772011 learned_addr learned my addr 172.21.15.82:0/2440772011 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb03fff640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb040b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb037fe640 1 -- 172.21.15.82:0/2440772011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 msgr2=0x7feb040b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb037fe640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb040b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb037fe640 1 -- 172.21.15.82:0/2440772011 >> v1:172.21.15.82:6789/0 conn(0x7feb040ccfb0 legacy=0x7feb040ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.146+0000 7feb037fe640 1 -- 172.21.15.82:0/2440772011 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040cd4b0 con 0x7feb0415c5f0 2023-07-20T10:06:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb037fe640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb040b4270 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097c0 tx=0x7feaec01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513422d5a6e6ac1b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb02ffd640 1 -- 172.21.15.82:0/2440772011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a8970 con 0x7feb0415c5f0 2023-07-20T10:06:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb02ffd640 1 -- 172.21.15.82:0/2440772011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec0a8ad0 con 0x7feb0415c5f0 2023-07-20T10:06:00.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb02ffd640 1 -- 172.21.15.82:0/2440772011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a8e60 con 0x7feb0415c5f0 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 -- 172.21.15.82:0/2440772011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 msgr2=0x7feb040b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb040b4270 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7feaec0097c0 tx=0x7feaec01ec70 comp rx=0 tx=0).stop 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 -- 172.21.15.82:0/2440772011 shutdown_connections 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb040b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 --2- 172.21.15.82:0/2440772011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb040b4270 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 -- 172.21.15.82:0/2440772011 >> 172.21.15.82:0/2440772011 conn(0x7feb04065710 msgr2=0x7feb04065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:00.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 -- 172.21.15.82:0/2440772011 shutdown_connections 2023-07-20T10:06:00.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 -- 172.21.15.82:0/2440772011 wait complete. 2023-07-20T10:06:00.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.150+0000 7feb088a1640 1 Processor -- start 2023-07-20T10:06:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- start start 2023-07-20T10:06:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb040ccfb0 0x7feb0414be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb041571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04157c60 con 0x7feb0415c5f0 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04157f40 con 0x7feb040ccfb0 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb04158220 con 0x7feb040ceb70 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60662/0 (socket says 172.21.15.82:60662) 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 -- 172.21.15.82:0/2668553915 learned_addr learned my addr 172.21.15.82:0/2668553915 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feafaffd640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb041571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb037fe640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb040ccfb0 0x7feb0414be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 -- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 msgr2=0x7feb041571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb041571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 -- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb040ccfb0 msgr2=0x7feb0414be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb040ccfb0 0x7feb0414be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 -- 172.21.15.82:0/2668553915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec009420 con 0x7feb0415c5f0 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feafaffd640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb041571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:00.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb03fff640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7feafc00efc0 tx=0x7feafc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc014480 con 0x7feb0415c5f0 2023-07-20T10:06:00.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc00f040 con 0x7feb0415c5f0 2023-07-20T10:06:00.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc014820 con 0x7feb0415c5f0 2023-07-20T10:06:00.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb04158500 con 0x7feb0415c5f0 2023-07-20T10:06:00.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04159100 con 0x7feb0415c5f0 2023-07-20T10:06:00.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.154+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0404da30 con 0x7feb0415c5f0 2023-07-20T10:06:00.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.158+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feafc014980 con 0x7feb0415c5f0 2023-07-20T10:06:00.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.158+0000 7feb00ff9640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 0x7feae4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.158+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7feafc084870 con 0x7feb0415c5f0 2023-07-20T10:06:00.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.158+0000 7feb037fe640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 0x7feae4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.158+0000 7feb037fe640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 0x7feae4068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b2000 tx=0x7feaec008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.162+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feafc051d80 con 0x7feb0415c5f0 2023-07-20T10:06:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.358+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feb041589b0 con 0x7feb0415c5f0 2023-07-20T10:06:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb00ff9640 1 -- 172.21.15.82:0/2668553915 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7feafc0553a0 con 0x7feb0415c5f0 2023-07-20T10:06:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:00.342 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:06:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:06:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.342 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:06:00.344 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:06:00.344 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.344 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.344 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:00.344 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:06:00.345 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.347 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.348 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:06:00.349 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.352 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.353 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.354 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:06:00.355 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.356 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:06:00.359 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.360 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:06:00.361 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:00.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:00.364 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:06:00.365 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:06:00.366 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:06:00.367 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 msgr2=0x7feae4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 0x7feae4068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b2000 tx=0x7feaec008040 comp rx=0 tx=0).stop 2023-07-20T10:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 msgr2=0x7feb0406a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7feafc00efc0 tx=0x7feafc00c490 comp rx=0 tx=0).stop 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 shutdown_connections 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7feae40663a0 0x7feae4068860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0415c5f0 0x7feb0406a730 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb040ceb70 0x7feb041571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 --2- 172.21.15.82:0/2668553915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb040ccfb0 0x7feb0414be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 >> 172.21.15.82:0/2668553915 conn(0x7feb04065710 msgr2=0x7feb0415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:00.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 shutdown_connections 2023-07-20T10:06:00.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.362+0000 7feb088a1640 1 -- 172.21.15.82:0/2668553915 wait complete. 2023-07-20T10:06:00.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:00.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 Processor -- start 2023-07-20T10:06:00.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 -- start start 2023-07-20T10:06:00.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d4c15cab0 0x7f1d4c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 0x7f1d4c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0d16b0 con 0x7f1d4c0cf110 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0d31c0 con 0x7f1d4c15cab0 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d51c34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4c0b3520 con 0x7f1d4c0d0d10 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d4c15cab0 0x7f1d4c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d4c15cab0 0x7f1d4c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60672/0 (socket says 172.21.15.82:60672) 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 -- 172.21.15.82:0/3971024501 learned_addr learned my addr 172.21.15.82:0/3971024501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1d4c0cf110 0x7f1d4c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39970/0 (socket says 172.21.15.82:39970) 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d42ffd640 1 --2- 172.21.15.82:0/3971024501 >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 0x7f1d4c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 -- 172.21.15.82:0/3971024501 >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 msgr2=0x7f1d4c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 --2- 172.21.15.82:0/3971024501 >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 0x7f1d4c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 -- 172.21.15.82:0/3971024501 >> v1:172.21.15.82:6789/0 conn(0x7f1d4c0cf110 legacy=0x7f1d4c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d4b7fe640 1 -- 172.21.15.82:0/3971024501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0b2910 con 0x7f1d4c15cab0 2023-07-20T10:06:00.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.530+0000 7f1d42ffd640 1 --2- 172.21.15.82:0/3971024501 >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 0x7f1d4c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:00.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d4b7fe640 1 --2- 172.21.15.82:0/3971024501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0d0300 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0d0190 tx=0x7f1d3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d48a438031cb1c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d4affd640 1 -- 172.21.15.82:0/3971024501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340aa430 con 0x7f1d4c15cab0 2023-07-20T10:06:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d4affd640 1 -- 172.21.15.82:0/3971024501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340aa590 con 0x7f1d4c15cab0 2023-07-20T10:06:00.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d4affd640 1 -- 172.21.15.82:0/3971024501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340aa920 con 0x7f1d4c15cab0 2023-07-20T10:06:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 -- 172.21.15.82:0/3971024501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 msgr2=0x7f1d4c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 --2- 172.21.15.82:0/3971024501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0d0300 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0d0190 tx=0x7f1d3401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 -- 172.21.15.82:0/3971024501 shutdown_connections 2023-07-20T10:06:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 --2- 172.21.15.82:0/3971024501 >> v2:172.21.15.183:3300/0 conn(0x7f1d4c0d0d10 0x7f1d4c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 --2- 172.21.15.82:0/3971024501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0d0300 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 -- 172.21.15.82:0/3971024501 >> 172.21.15.82:0/3971024501 conn(0x7f1d4c08c120 msgr2=0x7f1d4c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 -- 172.21.15.82:0/3971024501 shutdown_connections 2023-07-20T10:06:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.534+0000 7f1d51c34640 1 -- 172.21.15.82:0/3971024501 wait complete. 2023-07-20T10:06:00.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 Processor -- start 2023-07-20T10:06:00.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- start start 2023-07-20T10:06:00.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d4c0cf110 0x7f1d4c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d4c0d0d10 0x7f1d4c0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0caf30 con 0x7f1d4c15cab0 2023-07-20T10:06:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ca2b0 con 0x7f1d4c0cf110 2023-07-20T10:06:00.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c0ca590 con 0x7f1d4c0d0d10 2023-07-20T10:06:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60684/0 (socket says 172.21.15.82:60684) 2023-07-20T10:06:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 -- 172.21.15.82:0/1025710069 learned_addr learned my addr 172.21.15.82:0/1025710069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4b7fe640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d4c0cf110 0x7f1d4c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d42ffd640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d4c0d0d10 0x7f1d4c0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 -- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d4c0d0d10 msgr2=0x7f1d4c0cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d4c0d0d10 0x7f1d4c0cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 -- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d4c0cf110 msgr2=0x7f1d4c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d4c0cf110 0x7f1d4c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 -- 172.21.15.82:0/1025710069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340094d0 con 0x7f1d4c15cab0 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d4bfff640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c700 tx=0x7f1d4400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400ce10 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4400a640 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0ca870 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400a9b0 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.538+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c1563b0 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0cb070 con 0x7f1d4c15cab0 2023-07-20T10:06:00.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d4400ab10 con 0x7f1d4c15cab0 2023-07-20T10:06:00.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d48ff9640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 0x7f1d2c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1d44083240 con 0x7f1d4c15cab0 2023-07-20T10:06:00.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d4b7fe640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 0x7f1d2c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.542+0000 7f1d4b7fe640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 0x7f1d2c068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ae000 tx=0x7f1d340b5040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.546+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d4c0cb070 con 0x7f1d4c15cab0 2023-07-20T10:06:00.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.694+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d4c0cb070 con 0x7f1d4c15cab0 2023-07-20T10:06:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d48ff9640 1 -- 172.21.15.82:0/1025710069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14616 (secure 0 0 0) 0x7f1d4c0cb070 con 0x7f1d4c15cab0 2023-07-20T10:06:00.678 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:00.678 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:05:59.984792+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 msgr2=0x7f1d2c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 0x7f1d2c068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d340ae000 tx=0x7f1d340b5040 comp rx=0 tx=0).stop 2023-07-20T10:06:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 msgr2=0x7f1d4c0cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c700 tx=0x7f1d4400cbc0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 shutdown_connections 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f1d2c0663d0 0x7f1d2c068890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d4c15cab0 0x7f1d4c0cbee0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d4c0d0d10 0x7f1d4c0cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 --2- 172.21.15.82:0/1025710069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d4c0cf110 0x7f1d4c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 >> 172.21.15.82:0/1025710069 conn(0x7f1d4c08c120 msgr2=0x7f1d4c0b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 shutdown_connections 2023-07-20T10:06:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.698+0000 7f1d51c34640 1 -- 172.21.15.82:0/1025710069 wait complete. 2023-07-20T10:06:00.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:06:00.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:06:00.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 Processor -- start 2023-07-20T10:06:00.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 -- start start 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f28200ca5a0 0x7f282015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f282015ec90 0x7f282015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2820071950 con 0x7f282006f710 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282015bad0 con 0x7f282015ec90 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f2825d8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f282015b230 con 0x7f28200ca5a0 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f282015ec90 0x7f282015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f282006f710 0x7f282006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39978/0 (socket says 172.21.15.82:39978) 2023-07-20T10:06:00.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281f7fe640 1 -- 172.21.15.82:0/175249916 learned_addr learned my addr 172.21.15.82:0/175249916 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:00.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281effd640 1 --2- 172.21.15.82:0/175249916 >> v2:172.21.15.183:3300/0 conn(0x7f28200ca5a0 0x7f282015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281ffff640 1 -- 172.21.15.82:0/175249916 >> v2:172.21.15.183:3300/0 conn(0x7f28200ca5a0 msgr2=0x7f282015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281ffff640 1 --2- 172.21.15.82:0/175249916 >> v2:172.21.15.183:3300/0 conn(0x7f28200ca5a0 0x7f282015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281ffff640 1 -- 172.21.15.82:0/175249916 >> v1:172.21.15.82:6789/0 conn(0x7f282006f710 legacy=0x7f282006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.862+0000 7f281ffff640 1 -- 172.21.15.82:0/175249916 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282015b510 con 0x7f282015ec90 2023-07-20T10:06:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f281ffff640 1 --2- 172.21.15.82:0/175249916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282015ec90 0x7f282015a6f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2818009d90 tx=0x7f281801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62bb5b9c6a421f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f281e7fc640 1 -- 172.21.15.82:0/175249916 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180a58b0 con 0x7f282015ec90 2023-07-20T10:06:00.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f281e7fc640 1 -- 172.21.15.82:0/175249916 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28180a5a10 con 0x7f282015ec90 2023-07-20T10:06:00.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f281e7fc640 1 -- 172.21.15.82:0/175249916 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28180a5da0 con 0x7f282015ec90 2023-07-20T10:06:00.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- 172.21.15.82:0/175249916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282015ec90 msgr2=0x7f282015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 --2- 172.21.15.82:0/175249916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282015ec90 0x7f282015a6f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2818009d90 tx=0x7f281801c8e0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- 172.21.15.82:0/175249916 shutdown_connections 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 --2- 172.21.15.82:0/175249916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282015ec90 0x7f282015a6f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 --2- 172.21.15.82:0/175249916 >> v2:172.21.15.183:3300/0 conn(0x7f28200ca5a0 0x7f282015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- 172.21.15.82:0/175249916 >> 172.21.15.82:0/175249916 conn(0x7f28200cad50 msgr2=0x7f28200cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- 172.21.15.82:0/175249916 shutdown_connections 2023-07-20T10:06:00.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- 172.21.15.82:0/175249916 wait complete. 2023-07-20T10:06:00.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 Processor -- start 2023-07-20T10:06:00.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.866+0000 7f2825d8f640 1 -- start start 2023-07-20T10:06:00.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 0x7f282015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 0x7f2820150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2820153ea0 con 0x7f282006f710 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28200c73e0 con 0x7f28200ca5a0 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28200c76c0 con 0x7f282015ec90 2023-07-20T10:06:00.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60702/0 (socket says 172.21.15.82:60702) 2023-07-20T10:06:00.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 -- 172.21.15.82:0/2098127061 learned_addr learned my addr 172.21.15.82:0/2098127061 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:00.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281ffff640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 0x7f2820150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281effd640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 0x7f282015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 -- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 msgr2=0x7f2820150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 0x7f2820150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 -- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 msgr2=0x7f282015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 0x7f282015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 -- 172.21.15.82:0/2098127061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818009a70 con 0x7f282006f710 2023-07-20T10:06:00.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281ffff640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 0x7f2820150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281effd640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 0x7f282015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f281f7fe640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f281000c400 tx=0x7f281000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2810005cf0 con 0x7f282006f710 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2820153b30 con 0x7f282006f710 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810005e50 con 0x7f282006f710 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2820153750 con 0x7f282006f710 2023-07-20T10:06:00.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100072d0 con 0x7f282006f710 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.870+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282004da30 con 0x7f282006f710 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.874+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2810007430 con 0x7f282006f710 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.874+0000 7f2807fff640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 0x7f280c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.874+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2810083090 con 0x7f282006f710 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.874+0000 7f281effd640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 0x7f280c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.874+0000 7f281effd640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 0x7f280c068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28201653f0 tx=0x7f2814008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:00.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:00.878+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28100506e0 con 0x7f282006f710 2023-07-20T10:06:01.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28200cb940 con 0x7f282006f710 2023-07-20T10:06:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2807fff640 1 -- 172.21.15.82:0/2098127061 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2810053d00 con 0x7f282006f710 2023-07-20T10:06:01.011 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:06:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 msgr2=0x7f280c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 0x7f280c068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28201653f0 tx=0x7f2814008040 comp rx=0 tx=0).stop 2023-07-20T10:06:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 msgr2=0x7f28200c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f281000c400 tx=0x7f281000c8c0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 shutdown_connections 2023-07-20T10:06:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f280c0663a0 0x7f280c068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f282015ec90 0x7f2820150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28200ca5a0 0x7f282015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 --2- 172.21.15.82:0/2098127061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f282006f710 0x7f28200c6bb0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 >> 172.21.15.82:0/2098127061 conn(0x7f28200cad50 msgr2=0x7f28200af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 shutdown_connections 2023-07-20T10:06:01.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.030+0000 7f2825d8f640 1 -- 172.21.15.82:0/2098127061 wait complete. 2023-07-20T10:06:01.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:06:01.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.194+0000 7fc691b03640 1 Processor -- start 2023-07-20T10:06:01.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.194+0000 7fc691b03640 1 -- start start 2023-07-20T10:06:01.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc691b03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc68c06c120 0x7fc68c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc691b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 0x7fc68c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc691b03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0d0970 con 0x7fc68c06ab10 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc691b03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c160e20 con 0x7fc68c06c120 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc691b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0cd300 con 0x7fc68c1602b0 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc68c06c120 0x7fc68c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc682ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 0x7fc68c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc682ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 0x7fc68c160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:34208/0 (socket says 172.21.15.82:34208) 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68bfff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc68c06ab10 0x7fc68c06af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:59192/0 (socket says 172.21.15.82:59192) 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc682ffd640 1 -- 172.21.15.82:0/2917046105 learned_addr learned my addr 172.21.15.82:0/2917046105 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc68c06c120 0x7fc68c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:59790/0 (socket says 172.21.15.82:59790) 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 -- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 msgr2=0x7fc68c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 --2- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 0x7fc68c160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 -- 172.21.15.82:0/2917046105 >> v1:172.21.15.183:6789/0 conn(0x7fc68c06ab10 legacy=0x7fc68c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68b7fe640 1 -- 172.21.15.82:0/2917046105 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0cd5e0 con 0x7fc68c06c120 2023-07-20T10:06:01.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.198+0000 7fc68affd640 1 -- 172.21.15.82:0/2917046105 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169813892 0 0) 0x7fc68c0d0970 con 0x7fc68c06ab10 2023-07-20T10:06:01.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc68b7fe640 1 --2- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c06c120 0x7fc68c0cdde0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0097c0 tx=0x7fc67c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3984dcac9d550f4f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc68affd640 1 -- 172.21.15.82:0/2917046105 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0ab600 con 0x7fc68c06c120 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc68affd640 1 -- 172.21.15.82:0/2917046105 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c0a7050 con 0x7fc68c06c120 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc68affd640 1 -- 172.21.15.82:0/2917046105 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c0ab980 con 0x7fc68c06c120 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c06c120 msgr2=0x7fc68c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 --2- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c06c120 0x7fc68c0cdde0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0097c0 tx=0x7fc67c01c3f0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- 172.21.15.82:0/2917046105 shutdown_connections 2023-07-20T10:06:01.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 --2- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c1602b0 0x7fc68c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 --2- 172.21.15.82:0/2917046105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c06c120 0x7fc68c0cdde0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- 172.21.15.82:0/2917046105 >> 172.21.15.82:0/2917046105 conn(0x7fc68c08c0a0 msgr2=0x7fc68c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- 172.21.15.82:0/2917046105 shutdown_connections 2023-07-20T10:06:01.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- 172.21.15.82:0/2917046105 wait complete. 2023-07-20T10:06:01.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 Processor -- start 2023-07-20T10:06:01.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.202+0000 7fc691b03640 1 -- start start 2023-07-20T10:06:01.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c06ab10 0x7fc68c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c1602b0 0x7fc68c0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0afa70 con 0x7fc68c06c120 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0afd50 con 0x7fc68c1602b0 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0b0030 con 0x7fc68c06ab10 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60708/0 (socket says 172.21.15.82:60708) 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 -- 172.21.15.82:0/1009829503 learned_addr learned my addr 172.21.15.82:0/1009829503 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc68bfff640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c1602b0 0x7fc68c0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc68b7fe640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c06ab10 0x7fc68c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 -- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c06ab10 msgr2=0x7fc68c0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c06ab10 0x7fc68c0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 -- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c1602b0 msgr2=0x7fc68c0c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c1602b0 0x7fc68c0c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 -- 172.21.15.82:0/1009829503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009420 con 0x7fc68c06c120 2023-07-20T10:06:01.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc682ffd640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc67400efc0 tx=0x7fc67400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674009b60 con 0x7fc68c06c120 2023-07-20T10:06:01.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400f040 con 0x7fc68c06c120 2023-07-20T10:06:01.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0b0310 con 0x7fc68c06c120 2023-07-20T10:06:01.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6740092e0 con 0x7fc68c06c120 2023-07-20T10:06:01.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c0af760 con 0x7fc68c06c120 2023-07-20T10:06:01.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c04da30 con 0x7fc68c06c120 2023-07-20T10:06:01.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.206+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc674014480 con 0x7fc68c06c120 2023-07-20T10:06:01.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.210+0000 7fc688ff9640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 0x7fc66c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.210+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc674084150 con 0x7fc68c06c120 2023-07-20T10:06:01.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.210+0000 7fc68b7fe640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 0x7fc66c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.210+0000 7fc68b7fe640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 0x7fc66c068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0ad000 tx=0x7fc67c0a4f90 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.214+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6740552d0 con 0x7fc68c06c120 2023-07-20T10:06:01.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc68c0cca80 con 0x7fc68c06c120 2023-07-20T10:06:01.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc688ff9640 1 -- 172.21.15.82:0/1009829503 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc674054e60 con 0x7fc68c06c120 2023-07-20T10:06:01.349 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 msgr2=0x7fc66c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 0x7fc66c068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0ad000 tx=0x7fc67c0a4f90 comp rx=0 tx=0).stop 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 msgr2=0x7fc68c14d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc67400efc0 tx=0x7fc67400c490 comp rx=0 tx=0).stop 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 shutdown_connections 2023-07-20T10:06:01.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc66c0663a0 0x7fc66c068860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc68c1602b0 0x7fc68c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc68c06c120 0x7fc68c14d680 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 --2- 172.21.15.82:0/1009829503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc68c06ab10 0x7fc68c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 >> 172.21.15.82:0/1009829503 conn(0x7fc68c08c0a0 msgr2=0x7fc68c15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 shutdown_connections 2023-07-20T10:06:01.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.366+0000 7fc691b03640 1 -- 172.21.15.82:0/1009829503 wait complete. 2023-07-20T10:06:01.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:06:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.522+0000 7f1a10888640 1 Processor -- start 2023-07-20T10:06:01.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.522+0000 7f1a10888640 1 -- start start 2023-07-20T10:06:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a10888640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a0c0b0360 0x7f1a0c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a10888640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0cf170 con 0x7f1a0c0ce600 2023-07-20T10:06:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a10888640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0b0c80 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a10888640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0aed60 con 0x7f1a0c0b0360 2023-07-20T10:06:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a0c0b0360 0x7f1a0c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1a0c0b0360 0x7f1a0c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60716/0 (socket says 172.21.15.82:60716) 2023-07-20T10:06:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 -- 172.21.15.82:0/3308683548 learned_addr learned my addr 172.21.15.82:0/3308683548 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a01d9b640 1 --1- 172.21.15.82:0/3308683548 >> v1:172.21.15.82:6789/0 conn(0x7f1a0c0ce600 0x7f1a0c0cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39984/0 (socket says 172.21.15.82:39984) 2023-07-20T10:06:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 -- 172.21.15.82:0/3308683548 >> v1:172.21.15.183:6789/0 conn(0x7f1a0c0c9a70 legacy=0x7f1a0c0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 -- 172.21.15.82:0/3308683548 >> v1:172.21.15.82:6789/0 conn(0x7f1a0c0ce600 legacy=0x7f1a0c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a09d9b640 1 -- 172.21.15.82:0/3308683548 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920157590 0 0) 0x7f1a0c0cf170 con 0x7f1a0c0ce600 2023-07-20T10:06:01.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.526+0000 7f1a0a59c640 1 -- 172.21.15.82:0/3308683548 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c0af040 con 0x7f1a0c0b0360 2023-07-20T10:06:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a0a59c640 1 --2- 172.21.15.82:0/3308683548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b0740 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc13441c397f3bc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a09d9b640 1 -- 172.21.15.82:0/3308683548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aa670 con 0x7f1a0c0b0360 2023-07-20T10:06:01.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a09d9b640 1 -- 172.21.15.82:0/3308683548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0aa7d0 con 0x7f1a0c0b0360 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a09d9b640 1 -- 172.21.15.82:0/3308683548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0aab60 con 0x7f1a0c0b0360 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- 172.21.15.82:0/3308683548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0b0360 msgr2=0x7f1a0c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 --2- 172.21.15.82:0/3308683548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b0740 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc01c510 comp rx=0 tx=0).stop 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- 172.21.15.82:0/3308683548 shutdown_connections 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 --2- 172.21.15.82:0/3308683548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b0740 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- 172.21.15.82:0/3308683548 >> 172.21.15.82:0/3308683548 conn(0x7f1a0c098a10 msgr2=0x7f1a0c0cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- 172.21.15.82:0/3308683548 shutdown_connections 2023-07-20T10:06:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- 172.21.15.82:0/3308683548 wait complete. 2023-07-20T10:06:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 Processor -- start 2023-07-20T10:06:01.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.530+0000 7f1a10888640 1 -- start start 2023-07-20T10:06:01.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0c0ce600 0x7f1a0c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ac9a0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ac0b0 con 0x7f1a0c0b0360 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0ac350 con 0x7f1a0c0ce600 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60720/0 (socket says 172.21.15.82:60720) 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 -- 172.21.15.82:0/3756960742 learned_addr learned my addr 172.21.15.82:0/3756960742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a0ad9d640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0c0ce600 0x7f1a0c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a0a59c640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 -- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0c0ce600 msgr2=0x7f1a0c1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0c0ce600 0x7f1a0c1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 -- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0c0b0360 msgr2=0x7f1a0c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 -- 172.21.15.82:0/3756960742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094d0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a01d9b640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c780 tx=0x7f19f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400ce90 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f400a640 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400aa70 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0ac630 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c0b2910 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.534+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c0acb10 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.538+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f19f400abd0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.538+0000 7f1a037fe640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 0x7f19ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.538+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f19f40830b0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.538+0000 7f1a0a59c640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 0x7f19ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.538+0000 7f1a0a59c640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 0x7f19ec068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0a7000 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.542+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19f40506d0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1a0c073c70 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a037fe640 1 -- 172.21.15.82:0/3756960742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+126 (secure 0 0 0) 0x7f19f4053cf0 con 0x7f1a0c0c9a70 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:06:01.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:06:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:06:01.673 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:01.673 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:06:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 msgr2=0x7f19ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 0x7f19ec068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0ae000 tx=0x7f19fc0a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 msgr2=0x7f1a0c14f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c780 tx=0x7f19f400cc40 comp rx=0 tx=0).stop 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 shutdown_connections 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f19ec0663a0 0x7f19ec068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1a0c0ce600 0x7f1a0c1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a0c0c9a70 0x7f1a0c14f460 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 --2- 172.21.15.82:0/3756960742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a0c0b0360 0x7f1a0c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 >> 172.21.15.82:0/3756960742 conn(0x7f1a0c098a10 msgr2=0x7f1a0c06d120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.690+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 shutdown_connections 2023-07-20T10:06:01.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.694+0000 7f1a10888640 1 -- 172.21.15.82:0/3756960742 wait complete. 2023-07-20T10:06:01.692 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:06:01.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:06:01.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 Processor -- start 2023-07-20T10:06:01.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 -- start start 2023-07-20T10:06:01.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd7241602b0 0x7fd724160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd72406ab10 0x7fd72406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240ce4f0 con 0x7fd72406c120 2023-07-20T10:06:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7240d0970 con 0x7fd7241602b0 2023-07-20T10:06:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd72aacb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd724160e20 con 0x7fd72406ab10 2023-07-20T10:06:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd728867640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd72406c120 0x7fd7240cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39998/0 (socket says 172.21.15.82:39998) 2023-07-20T10:06:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd728867640 1 -- 172.21.15.82:0/3154142763 learned_addr learned my addr 172.21.15.82:0/3154142763 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71bfff640 1 --2- 172.21.15.82:0/3154142763 >> v2:172.21.15.82:3300/0 conn(0x7fd7241602b0 0x7fd724160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71b7fe640 1 -- 172.21.15.82:0/3154142763 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533334763 0 0) 0x7fd7240ce4f0 con 0x7fd72406c120 2023-07-20T10:06:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd729068640 1 --2- 172.21.15.82:0/3154142763 >> v2:172.21.15.183:3300/0 conn(0x7fd72406ab10 0x7fd72406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71b7fe640 1 -- 172.21.15.82:0/3154142763 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd70c003530 con 0x7fd72406c120 2023-07-20T10:06:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71bfff640 1 -- 172.21.15.82:0/3154142763 >> v2:172.21.15.183:3300/0 conn(0x7fd72406ab10 msgr2=0x7fd72406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71bfff640 1 --2- 172.21.15.82:0/3154142763 >> v2:172.21.15.183:3300/0 conn(0x7fd72406ab10 0x7fd72406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71bfff640 1 -- 172.21.15.82:0/3154142763 >> v1:172.21.15.82:6789/0 conn(0x7fd72406c120 legacy=0x7fd7240cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.854+0000 7fd71bfff640 1 -- 172.21.15.82:0/3154142763 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240cd300 con 0x7fd7241602b0 2023-07-20T10:06:01.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd71bfff640 1 --2- 172.21.15.82:0/3154142763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7241602b0 0x7fd724160740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd72408ceb0 tx=0x7fd71401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f4f46fffe5b47c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd71b7fe640 1 -- 172.21.15.82:0/3154142763 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140ac600 con 0x7fd7241602b0 2023-07-20T10:06:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd71b7fe640 1 -- 172.21.15.82:0/3154142763 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7140a8050 con 0x7fd7241602b0 2023-07-20T10:06:01.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd71b7fe640 1 -- 172.21.15.82:0/3154142763 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140ac980 con 0x7fd7241602b0 2023-07-20T10:06:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 -- 172.21.15.82:0/3154142763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7241602b0 msgr2=0x7fd724160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 --2- 172.21.15.82:0/3154142763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7241602b0 0x7fd724160740 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd72408ceb0 tx=0x7fd71401c3a0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 -- 172.21.15.82:0/3154142763 shutdown_connections 2023-07-20T10:06:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 --2- 172.21.15.82:0/3154142763 >> v2:172.21.15.183:3300/0 conn(0x7fd72406ab10 0x7fd72406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 --2- 172.21.15.82:0/3154142763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7241602b0 0x7fd724160740 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 -- 172.21.15.82:0/3154142763 >> 172.21.15.82:0/3154142763 conn(0x7fd72408c0a0 msgr2=0x7fd72409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 -- 172.21.15.82:0/3154142763 shutdown_connections 2023-07-20T10:06:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.858+0000 7fd72aacb640 1 -- 172.21.15.82:0/3154142763 wait complete. 2023-07-20T10:06:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 Processor -- start 2023-07-20T10:06:01.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- start start 2023-07-20T10:06:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 0x7fd7241552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7241602b0 0x7fd724154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c6b90 con 0x7fd72406ab10 2023-07-20T10:06:01.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c73f0 con 0x7fd72406c120 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240cbb40 con 0x7fd7241602b0 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60740/0 (socket says 172.21.15.82:60740) 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 -- 172.21.15.82:0/1424481823 learned_addr learned my addr 172.21.15.82:0/1424481823 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd71bfff640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 0x7fd7241552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd729068640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7241602b0 0x7fd724154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 -- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7241602b0 msgr2=0x7fd724154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7241602b0 0x7fd724154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 -- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 msgr2=0x7fd7241552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 0x7fd7241552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 -- 172.21.15.82:0/1424481823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714009420 con 0x7fd72406ab10 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd71bfff640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 0x7fd7241552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd728867640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c4d0 tx=0x7fd72000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720005cf0 con 0x7fd72406ab10 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd720005e50 con 0x7fd72406ab10 2023-07-20T10:06:01.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7240c6da0 con 0x7fd72406ab10 2023-07-20T10:06:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720007270 con 0x7fd72406ab10 2023-07-20T10:06:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.862+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7241557e0 con 0x7fd72406ab10 2023-07-20T10:06:01.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72404da30 con 0x7fd72406ab10 2023-07-20T10:06:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7200073d0 con 0x7fd72406ab10 2023-07-20T10:06:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd7197fa640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 0x7fd710068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd720083090 con 0x7fd72406ab10 2023-07-20T10:06:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd71bfff640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 0x7fd710068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:01.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.866+0000 7fd71bfff640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 0x7fd710068890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7140ae000 tx=0x7fd7140a7000 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:01.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:01.870+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd720050760 con 0x7fd72406ab10 2023-07-20T10:06:02.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:02.022+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd7240cee40 con 0x7fd72406ab10 2023-07-20T10:06:02.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:02.998+0000 7fd7197fa640 1 -- 172.21.15.82:0/1424481823 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd720053d80 con 0x7fd72406ab10 2023-07-20T10:06:02.978 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:06:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 msgr2=0x7fd710068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 0x7fd710068890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7140ae000 tx=0x7fd7140a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 msgr2=0x7fd7240cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:02.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c4d0 tx=0x7fd72000c990 comp rx=0 tx=0).stop 2023-07-20T10:06:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 shutdown_connections 2023-07-20T10:06:02.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd7100663d0 0x7fd710068890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd7241602b0 0x7fd724154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd72406c120 0x7fd7241552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 --2- 172.21.15.82:0/1424481823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd72406ab10 0x7fd7240cc100 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 >> 172.21.15.82:0/1424481823 conn(0x7fd72408c0a0 msgr2=0x7fd72415f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 shutdown_connections 2023-07-20T10:06:02.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.002+0000 7fd72aacb640 1 -- 172.21.15.82:0/1424481823 wait complete. 2023-07-20T10:06:03.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:06:03.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 Processor -- start 2023-07-20T10:06:03.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 -- start start 2023-07-20T10:06:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 0x7f890006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f89000ca5a0 0x7f890015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8900070030 con 0x7f890015ec90 2023-07-20T10:06:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890015bad0 con 0x7f89000ca5a0 2023-07-20T10:06:03.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f8905a93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8900071950 con 0x7f890006f710 2023-07-20T10:06:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f88fffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f890015ec90 0x7f890015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40000/0 (socket says 172.21.15.82:40000) 2023-07-20T10:06:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f88fffff640 1 -- 172.21.15.82:0/2788975063 learned_addr learned my addr 172.21.15.82:0/2788975063 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:03.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 0x7f890006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.174+0000 7f88f7fff640 1 --2- 172.21.15.82:0/2788975063 >> v2:172.21.15.183:3300/0 conn(0x7f89000ca5a0 0x7f890015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88feffd640 1 -- 172.21.15.82:0/2788975063 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023163994 0 0) 0x7f8900070030 con 0x7f890015ec90 2023-07-20T10:06:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88feffd640 1 -- 172.21.15.82:0/2788975063 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ec003530 con 0x7f890015ec90 2023-07-20T10:06:03.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88f7fff640 1 -- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 msgr2=0x7f890006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88f7fff640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 0x7f890006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88f7fff640 1 -- 172.21.15.82:0/2788975063 >> v1:172.21.15.82:6789/0 conn(0x7f890015ec90 legacy=0x7f890015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88f7fff640 1 -- 172.21.15.82:0/2788975063 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890015b230 con 0x7f89000ca5a0 2023-07-20T10:06:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 0x7f890006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:03.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88f7fff640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000ca5a0 0x7f890015e750 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097c0 tx=0x7f88e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fa666366c93bbb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88feffd640 1 -- 172.21.15.82:0/2788975063 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80ad660 con 0x7f89000ca5a0 2023-07-20T10:06:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88feffd640 1 -- 172.21.15.82:0/2788975063 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e80ad7c0 con 0x7f89000ca5a0 2023-07-20T10:06:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.178+0000 7f88feffd640 1 -- 172.21.15.82:0/2788975063 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e80adb30 con 0x7f89000ca5a0 2023-07-20T10:06:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000ca5a0 msgr2=0x7f890015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000ca5a0 0x7f890015e750 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f88e80097c0 tx=0x7f88e801c450 comp rx=0 tx=0).stop 2023-07-20T10:06:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- 172.21.15.82:0/2788975063 shutdown_connections 2023-07-20T10:06:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f89000ca5a0 0x7f890015e750 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- 172.21.15.82:0/2788975063 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f890006f710 0x7f890006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- 172.21.15.82:0/2788975063 >> 172.21.15.82:0/2788975063 conn(0x7f89000cad50 msgr2=0x7f89000cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- 172.21.15.82:0/2788975063 shutdown_connections 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- 172.21.15.82:0/2788975063 wait complete. 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 Processor -- start 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- start start 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 0x7f89000ce510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89000ca5a0 0x7f89000b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89001537b0 con 0x7f890015ec90 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89000b1900 con 0x7f890006f710 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f8905a93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89000b1be0 con 0x7f89000ca5a0 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f88fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f88fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60742/0 (socket says 172.21.15.82:60742) 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f88fffff640 1 -- 172.21.15.82:0/3732215471 learned_addr learned my addr 172.21.15.82:0/3732215471 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 0x7f89000ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.182+0000 7f88f7fff640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89000ca5a0 0x7f89000b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 -- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89000ca5a0 msgr2=0x7f89000b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89000ca5a0 0x7f89000b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 -- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 msgr2=0x7f89000ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 0x7f89000ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 -- 172.21.15.82:0/3732215471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0009420 con 0x7f890015ec90 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 0x7f89000ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fffff640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f88f800caa0 tx=0x7f88f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f800ac00 con 0x7f890015ec90 2023-07-20T10:06:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f800ad60 con 0x7f890015ec90 2023-07-20T10:06:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f8012620 con 0x7f890015ec90 2023-07-20T10:06:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8009420 con 0x7f890015ec90 2023-07-20T10:06:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89000b2900 con 0x7f890015ec90 2023-07-20T10:06:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890004da30 con 0x7f890015ec90 2023-07-20T10:06:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.186+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f88f8007070 con 0x7f890015ec90 2023-07-20T10:06:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.190+0000 7f88fcff9640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 0x7f88e0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.190+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f88f8083f30 con 0x7f890015ec90 2023-07-20T10:06:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.190+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 0x7f88e0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.190+0000 7f88ff7fe640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 0x7f88e0068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89000ce0d0 tx=0x7f88f0009190 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:03.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.190+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88f8051620 con 0x7f890015ec90 2023-07-20T10:06:03.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:03.338+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f89000ad9e0 con 0x7f890015ec90 2023-07-20T10:06:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.010+0000 7f88fcff9640 1 -- 172.21.15.82:0/3732215471 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7f88f8054c40 con 0x7f890015ec90 2023-07-20T10:06:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:06:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 msgr2=0x7f88e0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 0x7f88e0068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f89000ce0d0 tx=0x7f88f0009190 comp rx=0 tx=0).stop 2023-07-20T10:06:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 msgr2=0x7f89001528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f88f800caa0 tx=0x7f88f800cf60 comp rx=0 tx=0).stop 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 shutdown_connections 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f88e00663a0 0x7f88e0068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f890015ec90 0x7f89001528b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f89000ca5a0 0x7f89000b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 --2- 172.21.15.82:0/3732215471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f890006f710 0x7f89000ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 >> 172.21.15.82:0/3732215471 conn(0x7f89000cad50 msgr2=0x7f89000cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:04.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 shutdown_connections 2023-07-20T10:06:04.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.018+0000 7f8905a93640 1 -- 172.21.15.82:0/3732215471 wait complete. 2023-07-20T10:06:04.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:06:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.190+0000 7efcb9bd2640 1 Processor -- start 2023-07-20T10:06:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.190+0000 7efcb9bd2640 1 -- start start 2023-07-20T10:06:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb9bd2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcb415fb70 0x7efcb40b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb9bd2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efcb40b44d0 0x7efcb40d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb9bd2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb415ff50 con 0x7efcb40d07a0 2023-07-20T10:06:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb9bd2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40b4960 con 0x7efcb415fb70 2023-07-20T10:06:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb9bd2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40d0f90 con 0x7efcb40b44d0 2023-07-20T10:06:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcb415fb70 0x7efcb40b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efcb415fb70 0x7efcb40b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48684/0 (socket says 172.21.15.82:48684) 2023-07-20T10:06:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 -- 172.21.15.82:0/203476099 learned_addr learned my addr 172.21.15.82:0/203476099 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb3fff640 1 --2- 172.21.15.82:0/203476099 >> v2:172.21.15.183:3300/0 conn(0x7efcb40b44d0 0x7efcb40d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 -- 172.21.15.82:0/203476099 >> v2:172.21.15.183:3300/0 conn(0x7efcb40b44d0 msgr2=0x7efcb40d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/203476099 >> v2:172.21.15.183:3300/0 conn(0x7efcb40b44d0 0x7efcb40d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 -- 172.21.15.82:0/203476099 >> v1:172.21.15.183:6789/0 conn(0x7efcb40d07a0 legacy=0x7efcb406a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.194+0000 7efcb8bd0640 1 -- 172.21.15.82:0/203476099 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40cd190 con 0x7efcb415fb70 2023-07-20T10:06:04.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/203476099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb415fb70 0x7efcb40b3f90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7efcb40b1f20 tx=0x7efca801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ff217bcbe4e6a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb37fe640 1 -- 172.21.15.82:0/203476099 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab600 con 0x7efcb415fb70 2023-07-20T10:06:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb37fe640 1 -- 172.21.15.82:0/203476099 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca80a7050 con 0x7efcb415fb70 2023-07-20T10:06:04.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb37fe640 1 -- 172.21.15.82:0/203476099 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca80ab980 con 0x7efcb415fb70 2023-07-20T10:06:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- 172.21.15.82:0/203476099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb415fb70 msgr2=0x7efcb40b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/203476099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb415fb70 0x7efcb40b3f90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7efcb40b1f20 tx=0x7efca801c3b0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- 172.21.15.82:0/203476099 shutdown_connections 2023-07-20T10:06:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/203476099 >> v2:172.21.15.183:3300/0 conn(0x7efcb40b44d0 0x7efcb40d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/203476099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb415fb70 0x7efcb40b3f90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- 172.21.15.82:0/203476099 >> 172.21.15.82:0/203476099 conn(0x7efcb4065710 msgr2=0x7efcb4065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- 172.21.15.82:0/203476099 shutdown_connections 2023-07-20T10:06:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- 172.21.15.82:0/203476099 wait complete. 2023-07-20T10:06:04.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 Processor -- start 2023-07-20T10:06:04.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.198+0000 7efcb9bd2640 1 -- start start 2023-07-20T10:06:04.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 0x7efcb415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efcb415fb70 0x7efcb40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4155b00 con 0x7efcb40d07a0 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40cb4a0 con 0x7efcb40b44d0 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40cb780 con 0x7efcb415fb70 2023-07-20T10:06:04.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48696/0 (socket says 172.21.15.82:48696) 2023-07-20T10:06:04.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 -- 172.21.15.82:0/1167019019 learned_addr learned my addr 172.21.15.82:0/1167019019 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:04.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 0x7efcb415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb93d1640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efcb415fb70 0x7efcb40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 -- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efcb415fb70 msgr2=0x7efcb40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efcb415fb70 0x7efcb40b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 -- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 msgr2=0x7efcb415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:04.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 0x7efcb415d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 -- 172.21.15.82:0/1167019019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80094d0 con 0x7efcb40d07a0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 0x7efcb415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb3fff640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7efca000d5f0 tx=0x7efca000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00125f0 con 0x7efcb40d07a0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0012750 con 0x7efcb40d07a0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb40cba60 con 0x7efcb40d07a0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0012ae0 con 0x7efcb40d07a0 2023-07-20T10:06:04.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40cc020 con 0x7efcb40d07a0 2023-07-20T10:06:04.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40cc1b0 con 0x7efcb40d07a0 2023-07-20T10:06:04.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.202+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efca0012c40 con 0x7efcb40d07a0 2023-07-20T10:06:04.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.206+0000 7efcb17fa640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 0x7efc98068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:04.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.206+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5962+0+0 (secure 0 0 0) 0x7efca0084210 con 0x7efcb40d07a0 2023-07-20T10:06:04.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.206+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 0x7efc98068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:04.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.206+0000 7efcb8bd0640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 0x7efc98068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efca80ad000 tx=0x7efca8008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:04.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.210+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efca0051680 con 0x7efcb40d07a0 2023-07-20T10:06:04.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:04.386+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efcb404da30 con 0x7efcb40d07a0 2023-07-20T10:06:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.010+0000 7efcb17fa640 1 -- 172.21.15.82:0/1167019019 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7efca0007380 con 0x7efcb40d07a0 2023-07-20T10:06:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 11 and data pool 12 2023-07-20T10:06:05.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 msgr2=0x7efc98068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 0x7efc98068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efca80ad000 tx=0x7efca8008040 comp rx=0 tx=0).stop 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 msgr2=0x7efcb40b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7efca000d5f0 tx=0x7efca000dab0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 shutdown_connections 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc980663a0 0x7efc98068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efcb415fb70 0x7efcb40b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcb40d07a0 0x7efcb40b60b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 --2- 172.21.15.82:0/1167019019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efcb40b44d0 0x7efcb415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.022+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 >> 172.21.15.82:0/1167019019 conn(0x7efcb4065710 msgr2=0x7efcb4065af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.026+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 shutdown_connections 2023-07-20T10:06:05.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.026+0000 7efcb9bd2640 1 -- 172.21.15.82:0/1167019019 wait complete. 2023-07-20T10:06:05.046 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 Processor -- start 2023-07-20T10:06:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 -- start start 2023-07-20T10:06:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc94160fa0 0x7efc940c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940cc560 con 0x7efc940cd830 2023-07-20T10:06:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940ad7e0 con 0x7efc94160bc0 2023-07-20T10:06:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.206+0000 7efc9bd67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940cc790 con 0x7efc94160fa0 2023-07-20T10:06:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc9a304640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efc940cd830 0x7efc940aae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50394/0 (socket says 172.21.15.82:50394) 2023-07-20T10:06:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc9a304640 1 -- 172.21.15.82:0/806352833 learned_addr learned my addr 172.21.15.82:0/806352833 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc99302640 1 --2- 172.21.15.82:0/806352833 >> v2:172.21.15.183:3300/0 conn(0x7efc94160fa0 0x7efc940c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc98b01640 1 -- 172.21.15.82:0/806352833 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409000292 0 0) 0x7efc940cc560 con 0x7efc940cd830 2023-07-20T10:06:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc99302640 1 -- 172.21.15.82:0/806352833 >> v1:172.21.15.183:6789/0 conn(0x7efc94160bc0 legacy=0x7efc9406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc99302640 1 -- 172.21.15.82:0/806352833 >> v1:172.21.15.82:6789/0 conn(0x7efc940cd830 legacy=0x7efc940aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc99302640 1 -- 172.21.15.82:0/806352833 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940cca70 con 0x7efc94160fa0 2023-07-20T10:06:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc99302640 1 --2- 172.21.15.82:0/806352833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c12f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efc840097c0 tx=0x7efc940abdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2923069e5083712a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc98b01640 1 -- 172.21.15.82:0/806352833 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840ad660 con 0x7efc94160fa0 2023-07-20T10:06:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc98b01640 1 -- 172.21.15.82:0/806352833 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840ad7c0 con 0x7efc94160fa0 2023-07-20T10:06:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.210+0000 7efc98b01640 1 -- 172.21.15.82:0/806352833 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840adb50 con 0x7efc94160fa0 2023-07-20T10:06:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- 172.21.15.82:0/806352833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 msgr2=0x7efc940c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 --2- 172.21.15.82:0/806352833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c12f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efc840097c0 tx=0x7efc940abdb0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- 172.21.15.82:0/806352833 shutdown_connections 2023-07-20T10:06:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 --2- 172.21.15.82:0/806352833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c12f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- 172.21.15.82:0/806352833 >> 172.21.15.82:0/806352833 conn(0x7efc940cada0 msgr2=0x7efc940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- 172.21.15.82:0/806352833 shutdown_connections 2023-07-20T10:06:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- 172.21.15.82:0/806352833 wait complete. 2023-07-20T10:06:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 Processor -- start 2023-07-20T10:06:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- start start 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940cd830 0x7efc94157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94099ac0 con 0x7efc94160bc0 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94099420 con 0x7efc94160fa0 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9bd67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941573c0 con 0x7efc940cd830 2023-07-20T10:06:05.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48706/0 (socket says 172.21.15.82:48706) 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 -- 172.21.15.82:0/4112488866 learned_addr learned my addr 172.21.15.82:0/4112488866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc9a304640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99b03640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940cd830 0x7efc94157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 -- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940cd830 msgr2=0x7efc94157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940cd830 0x7efc94157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 -- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 msgr2=0x7efc940c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.214+0000 7efc99302640 1 -- 172.21.15.82:0/4112488866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009420 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc99302640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efc8401a080 tx=0x7efc840191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004230 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84004390 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84003820 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc941576a0 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940c4c90 con 0x7efc94160bc0 2023-07-20T10:06:05.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94099c00 con 0x7efc94160bc0 2023-07-20T10:06:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc840b4040 con 0x7efc94160bc0 2023-07-20T10:06:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc8411d620 con 0x7efc94160bc0 2023-07-20T10:06:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.218+0000 7efc99b03640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.222+0000 7efc99b03640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 0x7efc78068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc90000f70 tx=0x7efc90009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.222+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc94099c00 con 0x7efc94160bc0 2023-07-20T10:06:05.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.370+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc94099c00 con 0x7efc94160bc0 2023-07-20T10:06:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.370+0000 7efc8a7fc640 1 -- 172.21.15.82:0/4112488866 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18343 (secure 0 0 0) 0x7efc94099c00 con 0x7efc94160bc0 2023-07-20T10:06:05.352 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:05.352 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":93,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:04.392390+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:05.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 msgr2=0x7efc78068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 0x7efc78068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc90000f70 tx=0x7efc90009040 comp rx=0 tx=0).stop 2023-07-20T10:06:05.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 msgr2=0x7efc94158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efc8401a080 tx=0x7efc840191f0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 shutdown_connections 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc94160fa0 0x7efc940c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc94160bc0 0x7efc94158190 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 --2- 172.21.15.82:0/4112488866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc940cd830 0x7efc94157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 >> 172.21.15.82:0/4112488866 conn(0x7efc940cada0 msgr2=0x7efc940cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 shutdown_connections 2023-07-20T10:06:05.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.374+0000 7efc9bd67640 1 -- 172.21.15.82:0/4112488866 wait complete. 2023-07-20T10:06:05.373 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 Processor -- start 2023-07-20T10:06:05.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 -- start start 2023-07-20T10:06:05.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6af415a5e0 0x7f6af415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6af4160970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af415cf10 con 0x7f6af4160500 2023-07-20T10:06:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af4160f50 con 0x7f6af415a5e0 2023-07-20T10:06:05.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6afa20b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4161230 con 0x7f6af4069e60 2023-07-20T10:06:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6aebfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6af4160500 0x7f6af4069750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50398/0 (socket says 172.21.15.82:50398) 2023-07-20T10:06:05.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6aebfff640 1 -- 172.21.15.82:0/1804075544 learned_addr learned my addr 172.21.15.82:0/1804075544 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af37fe640 1 --2- 172.21.15.82:0/1804075544 >> v2:172.21.15.183:3300/0 conn(0x7f6af415a5e0 0x7f6af415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af3fff640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6af4160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660973511 0 0) 0x7f6af415cf10 con 0x7f6af4160500 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae0003530 con 0x7f6af4160500 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442214676 0 0) 0x7f6ae0003530 con 0x7f6af4160500 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 msgr2=0x7f6af4160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6af4160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 >> v2:172.21.15.183:3300/0 conn(0x7f6af415a5e0 msgr2=0x7f6af415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 --2- 172.21.15.82:0/1804075544 >> v2:172.21.15.183:3300/0 conn(0x7f6af415a5e0 0x7f6af415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af415d1d0 con 0x7f6af4160500 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f6adc001680 con 0x7f6af4160500 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 >> v1:172.21.15.82:6789/0 conn(0x7f6af4160500 legacy=0x7f6af4069750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ae0003980 0x7f6ae0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6ae00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d10 0x7f6ae0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4160f50 con 0x7f6ae0003980 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4161230 con 0x7f6ae0004d10 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae000b9c0 con 0x7f6af4069e60 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af37fe640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ae0003980 0x7f6ae0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.534+0000 7f6af3fff640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d10 0x7f6ae0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6aebfff640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6ae00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 -- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 msgr2=0x7f6ae00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6af4069e60 0x7f6ae00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 -- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d10 msgr2=0x7f6ae0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ae0004d10 0x7f6ae0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 -- 172.21.15.82:0/1804075544 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae0003530 con 0x7f6ae0003980 2023-07-20T10:06:05.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af37fe640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ae0003980 0x7f6ae0003da0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ae0 tx=0x7f6ae401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256a2c8f257eb803 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40a5540 con 0x7f6ae0003980 2023-07-20T10:06:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40a56a0 con 0x7f6ae0003980 2023-07-20T10:06:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af2ffd640 1 -- 172.21.15.82:0/1804075544 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40a5a50 con 0x7f6ae0003980 2023-07-20T10:06:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6afa20b640 1 -- 172.21.15.82:0/1804075544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ae0003980 msgr2=0x7f6ae0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6afa20b640 1 --2- 172.21.15.82:0/1804075544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ae0003980 0x7f6ae0003da0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009ae0 tx=0x7f6ae401ca60 comp rx=0 tx=0).stop 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.538+0000 7f6af3fff640 1 -- 172.21.15.82:0/1804075544 reap_dead start 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- 172.21.15.82:0/1804075544 shutdown_connections 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- 172.21.15.82:0/1804075544 >> 172.21.15.82:0/1804075544 conn(0x7f6af40ce710 msgr2=0x7f6af40ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- 172.21.15.82:0/1804075544 shutdown_connections 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- 172.21.15.82:0/1804075544 wait complete. 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 Processor -- start 2023-07-20T10:06:05.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- start start 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae0003980 0x7f6af40c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af40b3c70 0x7f6af41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af4154ca0 con 0x7f6af4154400 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c3fd0 con 0x7f6af40b3c70 2023-07-20T10:06:05.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c42b0 con 0x7f6ae0003980 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48710/0 (socket says 172.21.15.82:48710) 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 -- 172.21.15.82:0/905129743 learned_addr learned my addr 172.21.15.82:0/905129743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6af3fff640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af40b3c70 0x7f6af41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6af37fe640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae0003980 0x7f6af40c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 -- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae0003980 msgr2=0x7f6af40c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae0003980 0x7f6af40c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 -- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af40b3c70 msgr2=0x7f6af41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af40b3c70 0x7f6af41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 -- 172.21.15.82:0/905129743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40c4590 con 0x7f6af4154400 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6aebfff640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6adc007340 tx=0x7f6adc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00f9c0 con 0x7f6af4154400 2023-07-20T10:06:05.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00fb20 con 0x7f6af4154400 2023-07-20T10:06:05.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00feb0 con 0x7f6af4154400 2023-07-20T10:06:05.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.542+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40c4870 con 0x7f6af4154400 2023-07-20T10:06:05.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af40c52d0 con 0x7f6af4154400 2023-07-20T10:06:05.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af40735d0 con 0x7f6af4154400 2023-07-20T10:06:05.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6adc01d460 con 0x7f6af4154400 2023-07-20T10:06:05.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6af0ff9640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 0x7f6ad4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6adc083f30 con 0x7f6af4154400 2023-07-20T10:06:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.546+0000 7f6af37fe640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 0x7f6ad4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.550+0000 7f6af37fe640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 0x7f6ad4068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40af000 tx=0x7f6ae40046d0 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.550+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6adc051370 con 0x7f6af4154400 2023-07-20T10:06:05.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6af4073c70 con 0x7f6af4154400 2023-07-20T10:06:05.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6af0ff9640 1 -- 172.21.15.82:0/905129743 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18343 (secure 0 0 0) 0x7f6adc054990 con 0x7f6af4154400 2023-07-20T10:06:05.687 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:05.687 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":93,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:04.392390+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:05.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 msgr2=0x7f6ad4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 0x7f6ad4068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40af000 tx=0x7f6ae40046d0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 msgr2=0x7f6af40c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6adc007340 tx=0x7f6adc007800 comp rx=0 tx=0).stop 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 shutdown_connections 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6ad40663d0 0x7f6ad4068890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6af40b3c70 0x7f6af41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6af4154400 0x7f6af40c4d90 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 --2- 172.21.15.82:0/905129743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ae0003980 0x7f6af40c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 >> 172.21.15.82:0/905129743 conn(0x7f6af40ce710 msgr2=0x7f6af406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 shutdown_connections 2023-07-20T10:06:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.706+0000 7f6afa20b640 1 -- 172.21.15.82:0/905129743 wait complete. 2023-07-20T10:06:05.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:06:05.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 Processor -- start 2023-07-20T10:06:05.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 -- start start 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f6c0ca5a0 0x7f7f6c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c071950 con 0x7f7f6c06f710 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c15b230 con 0x7f7f6c15ec90 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f709ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c15bad0 con 0x7f7f6c0ca5a0 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f6a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7f6c06f710 0x7f7f6c06faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50400/0 (socket says 172.21.15.82:50400) 2023-07-20T10:06:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.870+0000 7f7f6a59c640 1 -- 172.21.15.82:0/1775564132 learned_addr learned my addr 172.21.15.82:0/1775564132 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997760433 0 0) 0x7f7f6c071950 con 0x7f7f6c06f710 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f58003530 con 0x7f7f6c06f710 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/1775564132 >> v2:172.21.15.183:3300/0 conn(0x7f7f6c0ca5a0 0x7f7f6c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252355743 0 0) 0x7f7f58003530 con 0x7f7f6c06f710 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 >> v2:172.21.15.183:3300/0 conn(0x7f7f6c0ca5a0 msgr2=0x7f7f6c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 --2- 172.21.15.82:0/1775564132 >> v2:172.21.15.183:3300/0 conn(0x7f7f6c0ca5a0 0x7f7f6c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 >> v1:172.21.15.183:6789/0 conn(0x7f7f6c15ec90 legacy=0x7f7f6c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c15b510 con 0x7f7f6c06f710 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7f5c001680 con 0x7f7f6c06f710 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 >> v1:172.21.15.82:6789/0 conn(0x7f7f6c06f710 legacy=0x7f7f6c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f58003a70 0x7f7f58003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 0x7f7f58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580051e0 0x7f7f5800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c15bad0 con 0x7f7f580047d0 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58010540 con 0x7f7f580051e0 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58010700 con 0x7f7f58003a70 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 0x7f7f58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f6a59c640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f58003a70 0x7f7f58003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f6ad9d640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580051e0 0x7f7f5800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 -- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f58003a70 msgr2=0x7f7f58003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f58003a70 0x7f7f58003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 -- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580051e0 msgr2=0x7f7f5800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f580051e0 0x7f7f5800fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f61d9b640 1 -- 172.21.15.82:0/1775564132 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58003530 con 0x7f7f580047d0 2023-07-20T10:06:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.874+0000 7f7f6ad9d640 1 -- 172.21.15.82:0/1775564132 reap_dead start 2023-07-20T10:06:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 0x7f7f58004c50 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0caa50 tx=0x7f7f5401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e588ccb75a508f7a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540a5580 con 0x7f7f580047d0 2023-07-20T10:06:05.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540a56e0 con 0x7f7f580047d0 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f69d9b640 1 -- 172.21.15.82:0/1775564132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540a5a90 con 0x7f7f580047d0 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 msgr2=0x7f7f58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 0x7f7f58004c50 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0caa50 tx=0x7f7f5401c990 comp rx=0 tx=0).stop 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- 172.21.15.82:0/1775564132 shutdown_connections 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 --2- 172.21.15.82:0/1775564132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f580047d0 0x7f7f58004c50 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- 172.21.15.82:0/1775564132 >> 172.21.15.82:0/1775564132 conn(0x7f7f6c0cad50 msgr2=0x7f7f6c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- 172.21.15.82:0/1775564132 shutdown_connections 2023-07-20T10:06:05.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- 172.21.15.82:0/1775564132 wait complete. 2023-07-20T10:06:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 Processor -- start 2023-07-20T10:06:05.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.878+0000 7f7f709ba640 1 -- start start 2023-07-20T10:06:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580047d0 0x7f7f6c0c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c157a90 0x7f7f6c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c158480 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c154d00 con 0x7f7f6c157a90 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0c4750 con 0x7f7f580047d0 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48722/0 (socket says 172.21.15.82:48722) 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 -- 172.21.15.82:0/4019830591 learned_addr learned my addr 172.21.15.82:0/4019830591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f6a59c640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580047d0 0x7f7f6c0c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f6ad9d640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c157a90 0x7f7f6c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 -- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580047d0 msgr2=0x7f7f6c0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580047d0 0x7f7f6c0c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 -- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c157a90 msgr2=0x7f7f6c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c157a90 0x7f7f6c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:05.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 -- 172.21.15.82:0/4019830591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c156b30 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f61d9b640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401c7c0 tx=0x7f7f54019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540a5580 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540b6660 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f540b69d0 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c0c2490 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0c2a50 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c04da30 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.882+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f540b4070 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.886+0000 7f7f637fe640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 0x7f7f4c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.886+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7f5411d8b0 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.886+0000 7f7f6a59c640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 0x7f7f4c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:05.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.886+0000 7f7f6a59c640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 0x7f7f4c068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0c8840 tx=0x7f7f5c000ff0 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:05.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:05.890+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f540eacc0 con 0x7f7f6c0c42d0 2023-07-20T10:06:05.960 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T10:06:05.978+0000 7f4e20506640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:06:06.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:06.074+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7f6c156b30 con 0x7f7f6c0c42d0 2023-07-20T10:06:07.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.046+0000 7f7f637fe640 1 -- 172.21.15.82:0/4019830591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7f6c156b30 con 0x7f7f6c0c42d0 2023-07-20T10:06:07.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.046+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 msgr2=0x7f7f4c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.046+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 0x7f7f4c068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0c8840 tx=0x7f7f5c000ff0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.046+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 msgr2=0x7f7f6c1547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.046+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7f5401c7c0 tx=0x7f7f54019790 comp rx=0 tx=0).stop 2023-07-20T10:06:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 shutdown_connections 2023-07-20T10:06:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f7f4c0663a0 0x7f7f4c068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f6c157a90 0x7f7f6c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6c0c42d0 0x7f7f6c1547c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 --2- 172.21.15.82:0/4019830591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f580047d0 0x7f7f6c0c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 >> 172.21.15.82:0/4019830591 conn(0x7f7f6c0cad50 msgr2=0x7f7f6c15d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:07.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 shutdown_connections 2023-07-20T10:06:07.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.050+0000 7f7f709ba640 1 -- 172.21.15.82:0/4019830591 wait complete. 2023-07-20T10:06:07.052 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:06:07.053 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:06:07.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 Processor -- start 2023-07-20T10:06:07.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 -- start start 2023-07-20T10:06:07.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf8c159450 0x7fdf8c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdf8c0afd50 0x7fdf8c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0b06b0 con 0x7fdf8c159830 2023-07-20T10:06:07.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cce90 con 0x7fdf8c159450 2023-07-20T10:06:07.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf91827640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0cc8d0 con 0x7fdf8c0afd50 2023-07-20T10:06:07.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf8c159450 0x7fdf8c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdf8c159450 0x7fdf8c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48724/0 (socket says 172.21.15.82:48724) 2023-07-20T10:06:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 -- 172.21.15.82:0/2998048605 learned_addr learned my addr 172.21.15.82:0/2998048605 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8b7fe640 1 --2- 172.21.15.82:0/2998048605 >> v2:172.21.15.183:3300/0 conn(0x7fdf8c0afd50 0x7fdf8c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 -- 172.21.15.82:0/2998048605 >> v2:172.21.15.183:3300/0 conn(0x7fdf8c0afd50 msgr2=0x7fdf8c0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:07.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 --2- 172.21.15.82:0/2998048605 >> v2:172.21.15.183:3300/0 conn(0x7fdf8c0afd50 0x7fdf8c0b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 -- 172.21.15.82:0/2998048605 >> v1:172.21.15.82:6789/0 conn(0x7fdf8c159830 legacy=0x7fdf8c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf8affd640 1 -- 172.21.15.82:0/2998048605 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0ccbb0 con 0x7fdf8c159450 2023-07-20T10:06:07.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.218+0000 7fdf89ffb640 1 -- 172.21.15.82:0/2998048605 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227259725 0 0) 0x7fdf8c0b06b0 con 0x7fdf8c159830 2023-07-20T10:06:07.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf8affd640 1 --2- 172.21.15.82:0/2998048605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c159450 0x7fdf8c15a4c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0c1da0 tx=0x7fdf7c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2705ae773012f95 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf89ffb640 1 -- 172.21.15.82:0/2998048605 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0aa430 con 0x7fdf8c159450 2023-07-20T10:06:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf89ffb640 1 -- 172.21.15.82:0/2998048605 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0aa590 con 0x7fdf8c159450 2023-07-20T10:06:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf89ffb640 1 -- 172.21.15.82:0/2998048605 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0aa920 con 0x7fdf8c159450 2023-07-20T10:06:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 -- 172.21.15.82:0/2998048605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c159450 msgr2=0x7fdf8c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 --2- 172.21.15.82:0/2998048605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c159450 0x7fdf8c15a4c0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0c1da0 tx=0x7fdf7c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 -- 172.21.15.82:0/2998048605 shutdown_connections 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 --2- 172.21.15.82:0/2998048605 >> v2:172.21.15.183:3300/0 conn(0x7fdf8c0afd50 0x7fdf8c0b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 --2- 172.21.15.82:0/2998048605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c159450 0x7fdf8c15a4c0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 -- 172.21.15.82:0/2998048605 >> 172.21.15.82:0/2998048605 conn(0x7fdf8c0cad50 msgr2=0x7fdf8c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 -- 172.21.15.82:0/2998048605 shutdown_connections 2023-07-20T10:06:07.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.222+0000 7fdf91827640 1 -- 172.21.15.82:0/2998048605 wait complete. 2023-07-20T10:06:07.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 Processor -- start 2023-07-20T10:06:07.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- start start 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf8c0afd50 0x7fdf8c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 0x7fdf8c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b1700 con 0x7fdf8c0c6930 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b0e10 con 0x7fdf8c0afd50 2023-07-20T10:06:07.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0c4a10 con 0x7fdf8c159450 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48732/0 (socket says 172.21.15.82:48732) 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 -- 172.21.15.82:0/1200272416 learned_addr learned my addr 172.21.15.82:0/1200272416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8affd640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf8c0afd50 0x7fdf8c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8a7fc640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 0x7fdf8c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 -- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 msgr2=0x7fdf8c0c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 0x7fdf8c0c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 -- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf8c0afd50 msgr2=0x7fdf8c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf8c0afd50 0x7fdf8c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 -- 172.21.15.82:0/1200272416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0094d0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8a7fc640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 0x7fdf8c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf8b7fe640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400d800 tx=0x7fdf8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400b6c0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400b820 con 0x7fdf8c0c6930 2023-07-20T10:06:07.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400bbd0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c0b10b0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.226+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c154bc0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c04da30 con 0x7fdf8c0c6930 2023-07-20T10:06:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf8400bd30 con 0x7fdf8c0c6930 2023-07-20T10:06:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf73fff640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 0x7fdf78068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf840843a0 con 0x7fdf8c0c6930 2023-07-20T10:06:07.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf8affd640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 0x7fdf78068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:07.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.230+0000 7fdf8affd640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 0x7fdf78068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0ae000 tx=0x7fdf7c0b5040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:07.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.234+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf84051670 con 0x7fdf8c0c6930 2023-07-20T10:06:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:07.418+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdf8c0b1840 con 0x7fdf8c0c6930 2023-07-20T10:06:08.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf73fff640 1 -- 172.21.15.82:0/1200272416 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v41) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf84054c90 con 0x7fdf8c0c6930 2023-07-20T10:06:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 msgr2=0x7fdf78068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 0x7fdf78068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0ae000 tx=0x7fdf7c0b5040 comp rx=0 tx=0).stop 2023-07-20T10:06:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 msgr2=0x7fdf8c0c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400d800 tx=0x7fdf8400dcc0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 shutdown_connections 2023-07-20T10:06:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fdf780663a0 0x7fdf78068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdf8c0c6930 0x7fdf8c0c6dc0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdf8c159450 0x7fdf8c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 --2- 172.21.15.82:0/1200272416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdf8c0afd50 0x7fdf8c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.054+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 >> 172.21.15.82:0/1200272416 conn(0x7fdf8c0cad50 msgr2=0x7fdf8c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.058+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 shutdown_connections 2023-07-20T10:06:08.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.058+0000 7fdf91827640 1 -- 172.21.15.82:0/1200272416 wait complete. 2023-07-20T10:06:08.059 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:06:08.059 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 Processor -- start 2023-07-20T10:06:08.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 -- start start 2023-07-20T10:06:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa24415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2440cc900 0x7fa2440ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2440ccd60 con 0x7fa2440b2380 2023-07-20T10:06:08.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440ad600 con 0x7fa2440cc900 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa24af2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440ad810 con 0x7fa2441596b0 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa23bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2440cc900 0x7fa2440ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa23bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa2440cc900 0x7fa2440ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48740/0 (socket says 172.21.15.82:48740) 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.222+0000 7fa23bfff640 1 -- 172.21.15.82:0/528102585 learned_addr learned my addr 172.21.15.82:0/528102585 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa248cc8640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa24415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23bfff640 1 -- 172.21.15.82:0/528102585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 msgr2=0x7fa24415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23bfff640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa24415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23bfff640 1 -- 172.21.15.82:0/528102585 >> v1:172.21.15.82:6789/0 conn(0x7fa2440b2380 legacy=0x7fa2440c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23bfff640 1 -- 172.21.15.82:0/528102585 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24415d0d0 con 0x7fa2440cc900 2023-07-20T10:06:08.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23b7fe640 1 -- 172.21.15.82:0/528102585 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675916680 0 0) 0x7fa2440ccd60 con 0x7fa2440b2380 2023-07-20T10:06:08.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23bfff640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2440ad0c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a8ead36aff23f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23b7fe640 1 -- 172.21.15.82:0/528102585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340aa670 con 0x7fa2440cc900 2023-07-20T10:06:08.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23b7fe640 1 -- 172.21.15.82:0/528102585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340aa7d0 con 0x7fa2440cc900 2023-07-20T10:06:08.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa23b7fe640 1 -- 172.21.15.82:0/528102585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340aab60 con 0x7fa2440cc900 2023-07-20T10:06:08.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa24af2c640 1 -- 172.21.15.82:0/528102585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 msgr2=0x7fa2440ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.226+0000 7fa24af2c640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2440ad0c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa234009870 tx=0x7fa23401c510 comp rx=0 tx=0).stop 2023-07-20T10:06:08.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- 172.21.15.82:0/528102585 shutdown_connections 2023-07-20T10:06:08.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2440ad0c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 --2- 172.21.15.82:0/528102585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa24415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- 172.21.15.82:0/528102585 >> 172.21.15.82:0/528102585 conn(0x7fa2440cada0 msgr2=0x7fa2440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- 172.21.15.82:0/528102585 shutdown_connections 2023-07-20T10:06:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- 172.21.15.82:0/528102585 wait complete. 2023-07-20T10:06:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 Processor -- start 2023-07-20T10:06:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- start start 2023-07-20T10:06:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2440b2380 0x7fa2440af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa244098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440c4cb0 con 0x7fa2440cc900 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440afa30 con 0x7fa2440b2380 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa24af2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440afd10 con 0x7fa2441596b0 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48750/0 (socket says 172.21.15.82:48750) 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 -- 172.21.15.82:0/1606120285 learned_addr learned my addr 172.21.15.82:0/1606120285 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 -- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 msgr2=0x7fa244098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa244098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 -- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2440b2380 msgr2=0x7fa2440af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2440b2380 0x7fa2440af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 -- 172.21.15.82:0/1606120285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340094d0 con 0x7fa2440cc900 2023-07-20T10:06:08.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.230+0000 7fa23bfff640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa23401a140 tx=0x7fa23401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340aae10 con 0x7fa2440cc900 2023-07-20T10:06:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2340b7070 con 0x7fa2440cc900 2023-07-20T10:06:08.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2440afff0 con 0x7fa2440cc900 2023-07-20T10:06:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234004220 con 0x7fa2440cc900 2023-07-20T10:06:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2440b05b0 con 0x7fa2440cc900 2023-07-20T10:06:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440b07a0 con 0x7fa2440cc900 2023-07-20T10:06:08.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa234004380 con 0x7fa2440cc900 2023-07-20T10:06:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 0x7fa230068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa23411e380 con 0x7fa2440cc900 2023-07-20T10:06:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa248cc8640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 0x7fa230068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.234+0000 7fa248cc8640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 0x7fa230068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa244158960 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.238+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2340eb6e0 con 0x7fa2440cc900 2023-07-20T10:06:08.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa244073c70 con 0x7fa2440cc900 2023-07-20T10:06:08.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa2397fa640 1 -- 172.21.15.82:0/1606120285 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fa2340eed00 con 0x7fa2440cc900 2023-07-20T10:06:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:08.399 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:08.399 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:08.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 msgr2=0x7fa230068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 0x7fa230068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa244158960 tx=0x7fa240008040 comp rx=0 tx=0).stop 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 msgr2=0x7fa2441511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa23401a140 tx=0x7fa23401ad50 comp rx=0 tx=0).stop 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 shutdown_connections 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa2300663a0 0x7fa230068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2441596b0 0x7fa244098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2440cc900 0x7fa2441511c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 --2- 172.21.15.82:0/1606120285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2440b2380 0x7fa2440af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 >> 172.21.15.82:0/1606120285 conn(0x7fa2440cada0 msgr2=0x7fa2440b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 shutdown_connections 2023-07-20T10:06:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.418+0000 7fa24af2c640 1 -- 172.21.15.82:0/1606120285 wait complete. 2023-07-20T10:06:08.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:08.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 Processor -- start 2023-07-20T10:06:08.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 -- start start 2023-07-20T10:06:08.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a6c0ca6b0 0x7f5a6c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0b06c0 con 0x7f5a6c0afda0 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c0b12a0 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a71133640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b3160 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a6b59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5a6c0ca6b0 0x7f5a6c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a6ad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5a6c0afda0 0x7f5a6c0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50422/0 (socket says 172.21.15.82:50422) 2023-07-20T10:06:08.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.578+0000 7f5a6ad9d640 1 -- 172.21.15.82:0/4150460744 learned_addr learned my addr 172.21.15.82:0/4150460744 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:08.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6b59e640 1 -- 172.21.15.82:0/4150460744 >> v1:172.21.15.183:6789/0 conn(0x7f5a6c15a8e0 legacy=0x7f5a6c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:08.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6b59e640 1 -- 172.21.15.82:0/4150460744 >> v1:172.21.15.82:6789/0 conn(0x7f5a6c0afda0 legacy=0x7f5a6c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6b59e640 1 -- 172.21.15.82:0/4150460744 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0b1580 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6a59c640 1 -- 172.21.15.82:0/4150460744 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625566529 0 0) 0x7f5a6c0b06c0 con 0x7f5a6c0afda0 2023-07-20T10:06:08.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6b59e640 1 --2- 172.21.15.82:0/4150460744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c0b0180 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5a640097c0 tx=0x7f5a6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ac5a1997ed6cad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6a59c640 1 -- 172.21.15.82:0/4150460744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ac410 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6a59c640 1 -- 172.21.15.82:0/4150460744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a640ac570 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a6a59c640 1 -- 172.21.15.82:0/4150460744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ac900 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a71133640 1 -- 172.21.15.82:0/4150460744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c0ca6b0 msgr2=0x7f5a6c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a71133640 1 --2- 172.21.15.82:0/4150460744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c0b0180 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5a640097c0 tx=0x7f5a6401c3b0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a71133640 1 -- 172.21.15.82:0/4150460744 shutdown_connections 2023-07-20T10:06:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a71133640 1 --2- 172.21.15.82:0/4150460744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c0b0180 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.582+0000 7f5a71133640 1 -- 172.21.15.82:0/4150460744 >> 172.21.15.82:0/4150460744 conn(0x7f5a6c0cada0 msgr2=0x7f5a6c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- 172.21.15.82:0/4150460744 shutdown_connections 2023-07-20T10:06:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- 172.21.15.82:0/4150460744 wait complete. 2023-07-20T10:06:08.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 Processor -- start 2023-07-20T10:06:08.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- start start 2023-07-20T10:06:08.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a6c0afda0 0x7f5a6c0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c165860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0cc8b0 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c2d90 con 0x7f5a6c0ca6b0 2023-07-20T10:06:08.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a71133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0ccb50 con 0x7f5a6c0afda0 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48772/0 (socket says 172.21.15.82:48772) 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 -- 172.21.15.82:0/2383266995 learned_addr learned my addr 172.21.15.82:0/2383266995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6ad9d640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a6c0afda0 0x7f5a6c0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6259c640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 -- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a6c0afda0 msgr2=0x7f5a6c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a6c0afda0 0x7f5a6c0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 -- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 msgr2=0x7f5a6c165860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c165860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 -- 172.21.15.82:0/2383266995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a64009420 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6259c640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c165860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.586+0000 7f5a6b59e640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5a64018fc0 tx=0x7f5a6401abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a640ac410 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64006e20 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004230 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0cce30 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c072d80 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c0c2f50 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5a64004390 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 0x7f5a4c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a6411e280 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a6ad9d640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 0x7f5a4c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.590+0000 7f5a6ad9d640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 0x7f5a4c068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0012f0 tx=0x7f5a5c005ec0 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.594+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a640eb4d0 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.742+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a6c073c70 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a63fff640 1 -- 172.21.15.82:0/2383266995 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f5a640eeaf0 con 0x7f5a6c15a8e0 2023-07-20T10:06:08.726 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:08.726 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":94,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:06.009631+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:08.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 msgr2=0x7f5a4c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 0x7f5a4c068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0012f0 tx=0x7f5a5c005ec0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 msgr2=0x7f5a6c15d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5a64018fc0 tx=0x7f5a6401abf0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 shutdown_connections 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f5a4c0663d0 0x7f5a4c068890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a6c15a8e0 0x7f5a6c15d090 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a6c0ca6b0 0x7f5a6c165860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 --2- 172.21.15.82:0/2383266995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5a6c0afda0 0x7f5a6c0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 >> 172.21.15.82:0/2383266995 conn(0x7f5a6c0cada0 msgr2=0x7f5a6c06cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 shutdown_connections 2023-07-20T10:06:08.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.746+0000 7f5a71133640 1 -- 172.21.15.82:0/2383266995 wait complete. 2023-07-20T10:06:08.747 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:06:08.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:08.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 Processor -- start 2023-07-20T10:06:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 -- start start 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5dc15cab0 0x7fa5dc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc0ce4c0 0x7fa5dc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc0d16b0 con 0x7fa5dc0d0d10 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc0d31c0 con 0x7fa5dc15cab0 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5e1f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0b3520 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5dc15cab0 0x7fa5dc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5dc15cab0 0x7fa5dc0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48778/0 (socket says 172.21.15.82:48778) 2023-07-20T10:06:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 -- 172.21.15.82:0/494960295 learned_addr learned my addr 172.21.15.82:0/494960295 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5dbfff640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc0ce4c0 0x7fa5dc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 -- 172.21.15.82:0/494960295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc0ce4c0 msgr2=0x7fa5dc0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc0ce4c0 0x7fa5dc0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 -- 172.21.15.82:0/494960295 >> v1:172.21.15.82:6789/0 conn(0x7fa5dc0d0d10 legacy=0x7fa5dc0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.906+0000 7fa5db7fe640 1 -- 172.21.15.82:0/494960295 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0b2910 con 0x7fa5dc15cab0 2023-07-20T10:06:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5db7fe640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc15cab0 0x7fa5dc0d0300 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009870 tx=0x7fa5cc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239c956aebb9581c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5da7fc640 1 -- 172.21.15.82:0/494960295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0a7070 con 0x7fa5dc15cab0 2023-07-20T10:06:08.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5da7fc640 1 -- 172.21.15.82:0/494960295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc0ab430 con 0x7fa5dc15cab0 2023-07-20T10:06:08.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5da7fc640 1 -- 172.21.15.82:0/494960295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0ab7c0 con 0x7fa5dc15cab0 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 -- 172.21.15.82:0/494960295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc15cab0 msgr2=0x7fa5dc0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc15cab0 0x7fa5dc0d0300 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc009870 tx=0x7fa5cc01c510 comp rx=0 tx=0).stop 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 -- 172.21.15.82:0/494960295 shutdown_connections 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc0ce4c0 0x7fa5dc0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/494960295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc15cab0 0x7fa5dc0d0300 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 -- 172.21.15.82:0/494960295 >> 172.21.15.82:0/494960295 conn(0x7fa5dc08c120 msgr2=0x7fa5dc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 -- 172.21.15.82:0/494960295 shutdown_connections 2023-07-20T10:06:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.910+0000 7fa5e1f67640 1 -- 172.21.15.82:0/494960295 wait complete. 2023-07-20T10:06:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 Processor -- start 2023-07-20T10:06:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- start start 2023-07-20T10:06:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 0x7fa5dc15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc15cab0 0x7fa5dc159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc14ec40 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc14edb0 con 0x7fa5dc0d0d10 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc14f000 con 0x7fa5dc15cab0 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48782/0 (socket says 172.21.15.82:48782) 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 -- 172.21.15.82:0/2908454159 learned_addr learned my addr 172.21.15.82:0/2908454159 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5dbfff640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc15cab0 0x7fa5dc159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5daffd640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 0x7fa5dc15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 -- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc15cab0 msgr2=0x7fa5dc159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc15cab0 0x7fa5dc159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 -- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 msgr2=0x7fa5dc15bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 0x7fa5dc15bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 -- 172.21.15.82:0/2908454159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0094d0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5daffd640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 0x7fa5dc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:08.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5db7fe640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc01a140 tx=0x7fa5cc0192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0ba070 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc0abe10 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc0b4870 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5dc14f2e0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.914+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc14f8a0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc073c70 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa5cc0b49d0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5c3fff640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 0x7fa5c8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:08.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5cc11daa0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5daffd640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 0x7fa5c8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:08.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.918+0000 7fa5daffd640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 0x7fa5c8068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc1f88e0 tx=0x7fa5d0009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:08.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:08.922+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5cc0eacf0 con 0x7fa5dc0ce4c0 2023-07-20T10:06:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.070+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5dc0b25c0 con 0x7fa5c80663a0 2023-07-20T10:06:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.078+0000 7fa5c3fff640 1 -- 172.21.15.82:0/2908454159 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299624 (secure 0 0 0) 0x7fa5d000d4f0 con 0x7fa5c80663a0 2023-07-20T10:06:09.062 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 msgr2=0x7fa5c8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 0x7fa5c8068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc1f88e0 tx=0x7fa5d0009040 comp rx=0 tx=0).stop 2023-07-20T10:06:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 msgr2=0x7fa5dc14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc01a140 tx=0x7fa5cc0192b0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 shutdown_connections 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fa5c80663a0 0x7fa5c8068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5dc15cab0 0x7fa5dc159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5dc0d0d10 0x7fa5dc15bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 --2- 172.21.15.82:0/2908454159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5dc0ce4c0 0x7fa5dc14e700 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 >> 172.21.15.82:0/2908454159 conn(0x7fa5dc08c120 msgr2=0x7fa5dc0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 shutdown_connections 2023-07-20T10:06:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.082+0000 7fa5e1f67640 1 -- 172.21.15.82:0/2908454159 wait complete. 2023-07-20T10:06:09.083 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:06:07.725602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311248,"kb_used_data":9832,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754663472,"statfs":{"total":773094113280,"available":772775395328,"internally_reserved":0,"allocated":10067968,"data_stored":5588144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.726937"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.003033+0000","last_change":"2023-07-20T10:06:03.003033+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.003033+0000","last_undegraded":"2023-07-20T10:06:03.003033+0000","last_fullsized":"2023-07-20T10:06:03.003033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008425+0000","last_change":"2023-07-20T10:06:03.008425+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008425+0000","last_undegraded":"2023-07-20T10:06:03.008425+0000","last_fullsized":"2023-07-20T10:06:03.008425+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009018+0000","last_change":"2023-07-20T10:06:03.009018+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009018+0000","last_undegraded":"2023-07-20T10:06:03.009018+0000","last_fullsized":"2023-07-20T10:06:03.009018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.006567+0000","last_change":"2023-07-20T10:06:03.006567+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.006567+0000","last_undegraded":"2023-07-20T10:06:03.006567+0000","last_fullsized":"2023-07-20T10:06:03.006567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008671+0000","last_change":"2023-07-20T10:06:03.008671+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008671+0000","last_undegraded":"2023-07-20T10:06:03.008671+0000","last_fullsized":"2023-07-20T10:06:03.008671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012476+0000","last_change":"2023-07-20T10:06:03.012476+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012476+0000","last_undegraded":"2023-07-20T10:06:03.012476+0000","last_fullsized":"2023-07-20T10:06:03.012476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005018+0000","last_change":"2023-07-20T10:06:03.005018+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005018+0000","last_undegraded":"2023-07-20T10:06:03.005018+0000","last_fullsized":"2023-07-20T10:06:03.005018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.002979+0000","last_change":"2023-07-20T10:06:03.002979+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.002979+0000","last_undegraded":"2023-07-20T10:06:03.002979+0000","last_fullsized":"2023-07-20T10:06:03.002979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009024+0000","last_change":"2023-07-20T10:06:03.009024+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009024+0000","last_undegraded":"2023-07-20T10:06:03.009024+0000","last_fullsized":"2023-07-20T10:06:03.009024+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012476+0000","last_change":"2023-07-20T10:06:03.012476+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012476+0000","last_undegraded":"2023-07-20T10:06:03.012476+0000","last_fullsized":"2023-07-20T10:06:03.012476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.002240+0000","last_change":"2023-07-20T10:06:03.002240+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.002240+0000","last_undegraded":"2023-07-20T10:06:03.002240+0000","last_fullsized":"2023-07-20T10:06:03.002240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005910+0000","last_change":"2023-07-20T10:06:03.005910+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005910+0000","last_undegraded":"2023-07-20T10:06:03.005910+0000","last_fullsized":"2023-07-20T10:06:03.005910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012410+0000","last_change":"2023-07-20T10:06:03.012410+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012410+0000","last_undegraded":"2023-07-20T10:06:03.012410+0000","last_fullsized":"2023-07-20T10:06:03.012410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008338+0000","last_change":"2023-07-20T10:06:03.008338+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008338+0000","last_undegraded":"2023-07-20T10:06:03.008338+0000","last_fullsized":"2023-07-20T10:06:03.008338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001756+0000","last_change":"2023-07-20T10:06:03.001756+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001756+0000","last_undegraded":"2023-07-20T10:06:03.001756+0000","last_fullsized":"2023-07-20T10:06:03.001756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005619+0000","last_change":"2023-07-20T10:06:03.005619+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005619+0000","last_undegraded":"2023-07-20T10:06:03.005619+0000","last_fullsized":"2023-07-20T10:06:03.005619+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012498+0000","last_change":"2023-07-20T10:06:03.012498+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012498+0000","last_undegraded":"2023-07-20T10:06:03.012498+0000","last_fullsized":"2023-07-20T10:06:03.012498+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005929+0000","last_change":"2023-07-20T10:06:03.005929+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005929+0000","last_undegraded":"2023-07-20T10:06:03.005929+0000","last_fullsized":"2023-07-20T10:06:03.005929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008407+0000","last_change":"2023-07-20T10:06:03.008407+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008407+0000","last_undegraded":"2023-07-20T10:06:03.008407+0000","last_fullsized":"2023-07-20T10:06:03.008407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008613+0000","last_change":"2023-07-20T10:06:03.008613+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008613+0000","last_undegraded":"2023-07-20T10:06:03.008613+0000","last_fullsized":"2023-07-20T10:06:03.008613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005929+0000","last_change":"2023-07-20T10:06:03.005929+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005929+0000","last_undegraded":"2023-07-20T10:06:03.005929+0000","last_fullsized":"2023-07-20T10:06:03.005929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001732+0000","last_change":"2023-07-20T10:06:03.001732+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001732+0000","last_undegraded":"2023-07-20T10:06:03.001732+0000","last_fullsized":"2023-07-20T10:06:03.001732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005910+0000","last_change":"2023-07-20T10:06:03.005910+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005910+0000","last_undegraded":"2023-07-20T10:06:03.005910+0000","last_fullsized":"2023-07-20T10:06:03.005910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005195+0000","last_change":"2023-07-20T10:06:03.005195+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005195+0000","last_undegraded":"2023-07-20T10:06:03.005195+0000","last_fullsized":"2023-07-20T10:06:03.005195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004524+0000","last_change":"2023-07-20T10:06:03.004524+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004524+0000","last_undegraded":"2023-07-20T10:06:03.004524+0000","last_fullsized":"2023-07-20T10:06:03.004524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"83'172","reported_seq":495,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.009955+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:03.009955+0000","last_peered":"2023-07-20T10:06:03.009955+0000","last_clean":"2023-07-20T10:06:03.009955+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:03.009955+0000","last_undegraded":"2023-07-20T10:06:03.009955+0000","last_fullsized":"2023-07-20T10:06:03.009955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T09:59:36.315774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.013146+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:03.013146+0000","last_peered":"2023-07-20T10:06:03.013146+0000","last_clean":"2023-07-20T10:06:03.013146+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:03.013146+0000","last_undegraded":"2023-07-20T10:06:03.013146+0000","last_fullsized":"2023-07-20T10:06:03.013146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:07.323177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004330+0000","last_change":"2023-07-20T10:06:03.004330+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004330+0000","last_undegraded":"2023-07-20T10:06:03.004330+0000","last_fullsized":"2023-07-20T10:06:03.004330+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.009880+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:03.009880+0000","last_peered":"2023-07-20T10:06:03.009880+0000","last_clean":"2023-07-20T10:06:03.009880+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:03.009880+0000","last_undegraded":"2023-07-20T10:06:03.009880+0000","last_fullsized":"2023-07-20T10:06:03.009880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:23.444428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004313+0000","last_change":"2023-07-20T10:06:03.004313+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004313+0000","last_undegraded":"2023-07-20T10:06:03.004313+0000","last_fullsized":"2023-07-20T10:06:03.004313+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.000485+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:03.000485+0000","last_peered":"2023-07-20T10:06:03.000485+0000","last_clean":"2023-07-20T10:06:03.000485+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:03.000485+0000","last_undegraded":"2023-07-20T10:06:03.000485+0000","last_fullsized":"2023-07-20T10:06:03.000485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:52:07.202447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004302+0000","last_change":"2023-07-20T10:06:03.004302+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004302+0000","last_undegraded":"2023-07-20T10:06:03.004302+0000","last_fullsized":"2023-07-20T10:06:03.004302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.012952+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:03.012952+0000","last_peered":"2023-07-20T10:06:03.012952+0000","last_clean":"2023-07-20T10:06:03.012952+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:03.012952+0000","last_undegraded":"2023-07-20T10:06:03.012952+0000","last_fullsized":"2023-07-20T10:06:03.012952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:22:29.258714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001672+0000","last_change":"2023-07-20T10:06:03.001672+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001672+0000","last_undegraded":"2023-07-20T10:06:03.001672+0000","last_fullsized":"2023-07-20T10:06:03.001672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.005422+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:03.005422+0000","last_peered":"2023-07-20T10:06:03.005422+0000","last_clean":"2023-07-20T10:06:03.005422+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:03.005422+0000","last_undegraded":"2023-07-20T10:06:03.005422+0000","last_fullsized":"2023-07-20T10:06:03.005422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:30.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005105+0000","last_change":"2023-07-20T10:06:03.005105+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005105+0000","last_undegraded":"2023-07-20T10:06:03.005105+0000","last_fullsized":"2023-07-20T10:06:03.005105+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.010185+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:03.010185+0000","last_peered":"2023-07-20T10:06:03.010185+0000","last_clean":"2023-07-20T10:06:03.010185+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:03.010185+0000","last_undegraded":"2023-07-20T10:06:03.010185+0000","last_fullsized":"2023-07-20T10:06:03.010185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:09.084894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008474+0000","last_change":"2023-07-20T10:06:03.008474+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008474+0000","last_undegraded":"2023-07-20T10:06:03.008474+0000","last_fullsized":"2023-07-20T10:06:03.008474+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.004746+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:03.004746+0000","last_peered":"2023-07-20T10:06:03.004746+0000","last_clean":"2023-07-20T10:06:03.004746+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:03.004746+0000","last_undegraded":"2023-07-20T10:06:03.004746+0000","last_fullsized":"2023-07-20T10:06:03.004746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:11.605383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009274+0000","last_change":"2023-07-20T10:06:03.009274+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009274+0000","last_undegraded":"2023-07-20T10:06:03.009274+0000","last_fullsized":"2023-07-20T10:06:03.009274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.005730+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:03.005730+0000","last_peered":"2023-07-20T10:06:03.005730+0000","last_clean":"2023-07-20T10:06:03.005730+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:03.005730+0000","last_undegraded":"2023-07-20T10:06:03.005730+0000","last_fullsized":"2023-07-20T10:06:03.005730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:22.935174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59024,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312816,"statfs":{"total":96636764160,"available":96576323584,"internally_reserved":0,"allocated":1703936,"data_stored":1141294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.874},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.63}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.496},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.84499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.47799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0580000000000001,"15min":1.085},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.141},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70799999999999996},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.363},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.177},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.0049999999999999,"5min":1.204,"15min":1.3620000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.61799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":1.212},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":1.4770000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.877,"5min":0.90500000000000003,"15min":1.196},"last":0.90300000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60499999999999998,"15min":0.58799999999999997},"min":{"1min":0.48899999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.4970000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.57499999999999996,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89500000000000002,"5min":0.96299999999999997,"15min":1.538},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"max":{"1min":0.85899999999999999,"5min":0.93400000000000005,"15min":1.597},"last":0.88200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.68700000000000006,"15min":4.8239999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.54600000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.51200000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66900000000000004,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.44}]},{"osd":2,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":1.099},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.9830000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.071,"15min":1.381},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"max":{"1min":0.97499999999999998,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.872},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.052,"15min":1.3260000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.01,"5min":1.1160000000000001,"15min":1.274},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.502},"max":{"1min":1.04,"5min":1.04,"15min":1.1950000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.4399999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0549999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54344,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317496,"statfs":{"total":96636764160,"available":96581115904,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.441}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.378}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.621}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.5},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1703936,"data_stored":1141294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.434},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.377}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.627}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:09.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 Processor -- start 2023-07-20T10:06:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 -- start start 2023-07-20T10:06:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe3015d020 0x7efe30164c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe300cde70 con 0x7efe300ca040 2023-07-20T10:06:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe300cbef0 con 0x7efe300ad060 2023-07-20T10:06:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe34e9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300ca4c0 con 0x7efe3015d020 2023-07-20T10:06:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe25d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efe300ca040 0x7efe3015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50440/0 (socket says 172.21.15.82:50440) 2023-07-20T10:06:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe25d9b640 1 -- 172.21.15.82:0/2485956947 learned_addr learned my addr 172.21.15.82:0/2485956947 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe2ed9d640 1 --2- 172.21.15.82:0/2485956947 >> v2:172.21.15.82:3300/0 conn(0x7efe3015d020 0x7efe30164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe2ed9d640 1 -- 172.21.15.82:0/2485956947 >> v1:172.21.15.183:6789/0 conn(0x7efe300ad060 legacy=0x7efe300afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe2ed9d640 1 -- 172.21.15.82:0/2485956947 >> v1:172.21.15.82:6789/0 conn(0x7efe300ca040 legacy=0x7efe3015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe2ed9d640 1 -- 172.21.15.82:0/2485956947 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe300cdb40 con 0x7efe3015d020 2023-07-20T10:06:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.282+0000 7efe2dd9b640 1 -- 172.21.15.82:0/2485956947 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188364152 0 0) 0x7efe300cde70 con 0x7efe300ca040 2023-07-20T10:06:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe2ed9d640 1 --2- 172.21.15.82:0/2485956947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe30164c50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efe28009d90 tx=0x7efe2801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7303db53b85b2081 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe2dd9b640 1 -- 172.21.15.82:0/2485956947 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a5810 con 0x7efe3015d020 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe2dd9b640 1 -- 172.21.15.82:0/2485956947 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280a5970 con 0x7efe3015d020 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe2dd9b640 1 -- 172.21.15.82:0/2485956947 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280a5d00 con 0x7efe3015d020 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 -- 172.21.15.82:0/2485956947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 msgr2=0x7efe30164c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 --2- 172.21.15.82:0/2485956947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe30164c50 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7efe28009d90 tx=0x7efe2801c950 comp rx=0 tx=0).stop 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 -- 172.21.15.82:0/2485956947 shutdown_connections 2023-07-20T10:06:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 --2- 172.21.15.82:0/2485956947 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe30164c50 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 -- 172.21.15.82:0/2485956947 >> 172.21.15.82:0/2485956947 conn(0x7efe300cada0 msgr2=0x7efe300cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 -- 172.21.15.82:0/2485956947 shutdown_connections 2023-07-20T10:06:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.286+0000 7efe34e9c640 1 -- 172.21.15.82:0/2485956947 wait complete. 2023-07-20T10:06:09.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 Processor -- start 2023-07-20T10:06:09.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 -- start start 2023-07-20T10:06:09.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe300ad060 0x7efe300c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe300ca040 0x7efe300c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe300c8130 con 0x7efe3015d020 2023-07-20T10:06:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe30099390 con 0x7efe300ca040 2023-07-20T10:06:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe34e9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe300c74b0 con 0x7efe300ad060 2023-07-20T10:06:09.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48800/0 (socket says 172.21.15.82:48800) 2023-07-20T10:06:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 -- 172.21.15.82:0/3412904702 learned_addr learned my addr 172.21.15.82:0/3412904702 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe25d9b640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe300ca040 0x7efe300c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2e59c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe300ad060 0x7efe300c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 -- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe300ad060 msgr2=0x7efe300c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe300ad060 0x7efe300c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 -- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe300ca040 msgr2=0x7efe300c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe300ca040 0x7efe300c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 -- 172.21.15.82:0/3412904702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009a70 con 0x7efe3015d020 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.290+0000 7efe2ed9d640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efe28019560 tx=0x7efe280196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280ad650 con 0x7efe3015d020 2023-07-20T10:06:09.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280ad7b0 con 0x7efe3015d020 2023-07-20T10:06:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280adb20 con 0x7efe3015d020 2023-07-20T10:06:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe300c7790 con 0x7efe3015d020 2023-07-20T10:06:09.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe300c7d50 con 0x7efe3015d020 2023-07-20T10:06:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe300c8270 con 0x7efe3015d020 2023-07-20T10:06:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe280adc80 con 0x7efe3015d020 2023-07-20T10:06:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 0x7efe10068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe2811ef70 con 0x7efe3015d020 2023-07-20T10:06:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe2e59c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 0x7efe10068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.294+0000 7efe2e59c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 0x7efe10068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe20007fd0 tx=0x7efe20009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.298+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe280ec380 con 0x7efe3015d020 2023-07-20T10:06:09.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.442+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe300b1170 con 0x7efe100663d0 2023-07-20T10:06:09.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.450+0000 7efe277fe640 1 -- 172.21.15.82:0/3412904702 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299624 (secure 0 0 0) 0x7efe200014f0 con 0x7efe100663d0 2023-07-20T10:06:09.434 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:09.435 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 msgr2=0x7efe10068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 0x7efe10068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe20007fd0 tx=0x7efe20009040 comp rx=0 tx=0).stop 2023-07-20T10:06:09.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 msgr2=0x7efe300c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7efe28019560 tx=0x7efe280196f0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 shutdown_connections 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7efe100663d0 0x7efe10068890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe3015d020 0x7efe300c68d0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe300ca040 0x7efe300c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 --2- 172.21.15.82:0/3412904702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe300ad060 0x7efe300c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 >> 172.21.15.82:0/3412904702 conn(0x7efe300cada0 msgr2=0x7efe300c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:09.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 shutdown_connections 2023-07-20T10:06:09.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.454+0000 7efe34e9c640 1 -- 172.21.15.82:0/3412904702 wait complete. 2023-07-20T10:06:09.454 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:06:07.725602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311248,"kb_used_data":9832,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754663472,"statfs":{"total":773094113280,"available":772775395328,"internally_reserved":0,"allocated":10067968,"data_stored":5588144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.726937"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.003033+0000","last_change":"2023-07-20T10:06:03.003033+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.003033+0000","last_undegraded":"2023-07-20T10:06:03.003033+0000","last_fullsized":"2023-07-20T10:06:03.003033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008425+0000","last_change":"2023-07-20T10:06:03.008425+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008425+0000","last_undegraded":"2023-07-20T10:06:03.008425+0000","last_fullsized":"2023-07-20T10:06:03.008425+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009018+0000","last_change":"2023-07-20T10:06:03.009018+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009018+0000","last_undegraded":"2023-07-20T10:06:03.009018+0000","last_fullsized":"2023-07-20T10:06:03.009018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.006567+0000","last_change":"2023-07-20T10:06:03.006567+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.006567+0000","last_undegraded":"2023-07-20T10:06:03.006567+0000","last_fullsized":"2023-07-20T10:06:03.006567+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008671+0000","last_change":"2023-07-20T10:06:03.008671+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008671+0000","last_undegraded":"2023-07-20T10:06:03.008671+0000","last_fullsized":"2023-07-20T10:06:03.008671+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012476+0000","last_change":"2023-07-20T10:06:03.012476+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012476+0000","last_undegraded":"2023-07-20T10:06:03.012476+0000","last_fullsized":"2023-07-20T10:06:03.012476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005018+0000","last_change":"2023-07-20T10:06:03.005018+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005018+0000","last_undegraded":"2023-07-20T10:06:03.005018+0000","last_fullsized":"2023-07-20T10:06:03.005018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.002979+0000","last_change":"2023-07-20T10:06:03.002979+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.002979+0000","last_undegraded":"2023-07-20T10:06:03.002979+0000","last_fullsized":"2023-07-20T10:06:03.002979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009024+0000","last_change":"2023-07-20T10:06:03.009024+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009024+0000","last_undegraded":"2023-07-20T10:06:03.009024+0000","last_fullsized":"2023-07-20T10:06:03.009024+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012476+0000","last_change":"2023-07-20T10:06:03.012476+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012476+0000","last_undegraded":"2023-07-20T10:06:03.012476+0000","last_fullsized":"2023-07-20T10:06:03.012476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.002240+0000","last_change":"2023-07-20T10:06:03.002240+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.002240+0000","last_undegraded":"2023-07-20T10:06:03.002240+0000","last_fullsized":"2023-07-20T10:06:03.002240+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005910+0000","last_change":"2023-07-20T10:06:03.005910+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005910+0000","last_undegraded":"2023-07-20T10:06:03.005910+0000","last_fullsized":"2023-07-20T10:06:03.005910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012410+0000","last_change":"2023-07-20T10:06:03.012410+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012410+0000","last_undegraded":"2023-07-20T10:06:03.012410+0000","last_fullsized":"2023-07-20T10:06:03.012410+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008338+0000","last_change":"2023-07-20T10:06:03.008338+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008338+0000","last_undegraded":"2023-07-20T10:06:03.008338+0000","last_fullsized":"2023-07-20T10:06:03.008338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001756+0000","last_change":"2023-07-20T10:06:03.001756+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001756+0000","last_undegraded":"2023-07-20T10:06:03.001756+0000","last_fullsized":"2023-07-20T10:06:03.001756+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005619+0000","last_change":"2023-07-20T10:06:03.005619+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005619+0000","last_undegraded":"2023-07-20T10:06:03.005619+0000","last_fullsized":"2023-07-20T10:06:03.005619+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.012498+0000","last_change":"2023-07-20T10:06:03.012498+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.012498+0000","last_undegraded":"2023-07-20T10:06:03.012498+0000","last_fullsized":"2023-07-20T10:06:03.012498+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005929+0000","last_change":"2023-07-20T10:06:03.005929+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005929+0000","last_undegraded":"2023-07-20T10:06:03.005929+0000","last_fullsized":"2023-07-20T10:06:03.005929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008407+0000","last_change":"2023-07-20T10:06:03.008407+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008407+0000","last_undegraded":"2023-07-20T10:06:03.008407+0000","last_fullsized":"2023-07-20T10:06:03.008407+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008613+0000","last_change":"2023-07-20T10:06:03.008613+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008613+0000","last_undegraded":"2023-07-20T10:06:03.008613+0000","last_fullsized":"2023-07-20T10:06:03.008613+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005929+0000","last_change":"2023-07-20T10:06:03.005929+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005929+0000","last_undegraded":"2023-07-20T10:06:03.005929+0000","last_fullsized":"2023-07-20T10:06:03.005929+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001732+0000","last_change":"2023-07-20T10:06:03.001732+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001732+0000","last_undegraded":"2023-07-20T10:06:03.001732+0000","last_fullsized":"2023-07-20T10:06:03.001732+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005910+0000","last_change":"2023-07-20T10:06:03.005910+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005910+0000","last_undegraded":"2023-07-20T10:06:03.005910+0000","last_fullsized":"2023-07-20T10:06:03.005910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005195+0000","last_change":"2023-07-20T10:06:03.005195+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005195+0000","last_undegraded":"2023-07-20T10:06:03.005195+0000","last_fullsized":"2023-07-20T10:06:03.005195+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004524+0000","last_change":"2023-07-20T10:06:03.004524+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004524+0000","last_undegraded":"2023-07-20T10:06:03.004524+0000","last_fullsized":"2023-07-20T10:06:03.004524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"83'172","reported_seq":495,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.009955+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:03.009955+0000","last_peered":"2023-07-20T10:06:03.009955+0000","last_clean":"2023-07-20T10:06:03.009955+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:03.009955+0000","last_undegraded":"2023-07-20T10:06:03.009955+0000","last_fullsized":"2023-07-20T10:06:03.009955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T09:59:36.315774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.013146+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:03.013146+0000","last_peered":"2023-07-20T10:06:03.013146+0000","last_clean":"2023-07-20T10:06:03.013146+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:03.013146+0000","last_undegraded":"2023-07-20T10:06:03.013146+0000","last_fullsized":"2023-07-20T10:06:03.013146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:07.323177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004330+0000","last_change":"2023-07-20T10:06:03.004330+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004330+0000","last_undegraded":"2023-07-20T10:06:03.004330+0000","last_fullsized":"2023-07-20T10:06:03.004330+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.009880+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:03.009880+0000","last_peered":"2023-07-20T10:06:03.009880+0000","last_clean":"2023-07-20T10:06:03.009880+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:03.009880+0000","last_undegraded":"2023-07-20T10:06:03.009880+0000","last_fullsized":"2023-07-20T10:06:03.009880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:23.444428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004313+0000","last_change":"2023-07-20T10:06:03.004313+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004313+0000","last_undegraded":"2023-07-20T10:06:03.004313+0000","last_fullsized":"2023-07-20T10:06:03.004313+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":158,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.000485+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:03.000485+0000","last_peered":"2023-07-20T10:06:03.000485+0000","last_clean":"2023-07-20T10:06:03.000485+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:03.000485+0000","last_undegraded":"2023-07-20T10:06:03.000485+0000","last_fullsized":"2023-07-20T10:06:03.000485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:52:07.202447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.004302+0000","last_change":"2023-07-20T10:06:03.004302+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.004302+0000","last_undegraded":"2023-07-20T10:06:03.004302+0000","last_fullsized":"2023-07-20T10:06:03.004302+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":156,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.012952+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:03.012952+0000","last_peered":"2023-07-20T10:06:03.012952+0000","last_clean":"2023-07-20T10:06:03.012952+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:03.012952+0000","last_undegraded":"2023-07-20T10:06:03.012952+0000","last_fullsized":"2023-07-20T10:06:03.012952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:22:29.258714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.001672+0000","last_change":"2023-07-20T10:06:03.001672+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.001672+0000","last_undegraded":"2023-07-20T10:06:03.001672+0000","last_fullsized":"2023-07-20T10:06:03.001672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.005422+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:03.005422+0000","last_peered":"2023-07-20T10:06:03.005422+0000","last_clean":"2023-07-20T10:06:03.005422+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:03.005422+0000","last_undegraded":"2023-07-20T10:06:03.005422+0000","last_fullsized":"2023-07-20T10:06:03.005422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:30.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.005105+0000","last_change":"2023-07-20T10:06:03.005105+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.005105+0000","last_undegraded":"2023-07-20T10:06:03.005105+0000","last_fullsized":"2023-07-20T10:06:03.005105+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.010185+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:03.010185+0000","last_peered":"2023-07-20T10:06:03.010185+0000","last_clean":"2023-07-20T10:06:03.010185+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:03.010185+0000","last_undegraded":"2023-07-20T10:06:03.010185+0000","last_fullsized":"2023-07-20T10:06:03.010185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:09.084894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.008474+0000","last_change":"2023-07-20T10:06:03.008474+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.008474+0000","last_undegraded":"2023-07-20T10:06:03.008474+0000","last_fullsized":"2023-07-20T10:06:03.008474+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":142,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.004746+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:03.004746+0000","last_peered":"2023-07-20T10:06:03.004746+0000","last_clean":"2023-07-20T10:06:03.004746+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:03.004746+0000","last_undegraded":"2023-07-20T10:06:03.004746+0000","last_fullsized":"2023-07-20T10:06:03.004746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:11.605383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:06:03.996620+0000","last_change":"2023-07-20T10:06:03.996620+0000","last_active":"2023-07-20T10:06:03.996620+0000","last_peered":"2023-07-20T10:06:03.996620+0000","last_clean":"2023-07-20T10:06:03.996620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.996620+0000","last_undegraded":"2023-07-20T10:06:03.996620+0000","last_fullsized":"2023-07-20T10:06:03.996620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2023-07-20T10:06:03.009274+0000","last_change":"2023-07-20T10:06:03.009274+0000","last_active":"2023-07-20T10:06:02.984206+0000","last_peered":"2023-07-20T10:06:02.984206+0000","last_clean":"2023-07-20T10:06:02.984206+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:03.009274+0000","last_undegraded":"2023-07-20T10:06:03.009274+0000","last_fullsized":"2023-07-20T10:06:03.009274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-07-20T10:06:03.005730+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:03.005730+0000","last_peered":"2023-07-20T10:06:03.005730+0000","last_clean":"2023-07-20T10:06:03.005730+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:03.005730+0000","last_undegraded":"2023-07-20T10:06:03.005730+0000","last_fullsized":"2023-07-20T10:06:03.005730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:22.935174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59024,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312816,"statfs":{"total":96636764160,"available":96576323584,"internally_reserved":0,"allocated":1703936,"data_stored":1141294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.874},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.77200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.60299999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.63}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.496},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.84499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.47799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0580000000000001,"15min":1.085},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.141},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70799999999999996},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.363},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.177},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.0049999999999999,"5min":1.204,"15min":1.3620000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.61799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":1.212},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":1.4770000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.877,"5min":0.90500000000000003,"15min":1.196},"last":0.90300000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60499999999999998,"15min":0.58799999999999997},"min":{"1min":0.48899999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.4970000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.57499999999999996,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89500000000000002,"5min":0.96299999999999997,"15min":1.538},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"max":{"1min":0.85899999999999999,"5min":0.93400000000000005,"15min":1.597},"last":0.88200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.68700000000000006,"15min":4.8239999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.54600000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.51200000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66900000000000004,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.44}]},{"osd":2,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":1.099},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.9830000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.071,"15min":1.381},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"max":{"1min":0.97499999999999998,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.872},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.052,"15min":1.3260000000000001},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.01,"5min":1.1160000000000001,"15min":1.274},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.502},"max":{"1min":1.04,"5min":1.04,"15min":1.1950000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.4399999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0549999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.98499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54344,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317496,"statfs":{"total":96636764160,"available":96581115904,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.441}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.378}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.621}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1110016,"data_stored":550926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.5},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.53100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1703936,"data_stored":1141294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.434},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.377}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.627}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:09.461 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:09.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 Processor -- start 2023-07-20T10:06:09.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 -- start start 2023-07-20T10:06:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8e7c0b2a90 0x7f8e7c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c0ccd60 con 0x7f8e7c0cc900 2023-07-20T10:06:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c0ad600 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e828e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0ad810 con 0x7f8e7c1596b0 2023-07-20T10:06:09.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8e7c0cc900 0x7f8e7c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50444/0 (socket says 172.21.15.82:50444) 2023-07-20T10:06:09.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7b7fe640 1 -- 172.21.15.82:0/1250532229 learned_addr learned my addr 172.21.15.82:0/1250532229 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/1250532229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e80e82640 1 --2- 172.21.15.82:0/1250532229 >> v2:172.21.15.183:3300/0 conn(0x7f8e7c0b2a90 0x7f8e7c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7affd640 1 -- 172.21.15.82:0/1250532229 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206551926 0 0) 0x7f8e7c0ccd60 con 0x7f8e7c0cc900 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7affd640 1 -- 172.21.15.82:0/1250532229 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e64003530 con 0x7f8e7c0cc900 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7bfff640 1 -- 172.21.15.82:0/1250532229 >> v2:172.21.15.183:3300/0 conn(0x7f8e7c0b2a90 msgr2=0x7f8e7c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/1250532229 >> v2:172.21.15.183:3300/0 conn(0x7f8e7c0b2a90 0x7f8e7c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7bfff640 1 -- 172.21.15.82:0/1250532229 >> v1:172.21.15.82:6789/0 conn(0x7f8e7c0cc900 legacy=0x7f8e7c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.654+0000 7f8e7bfff640 1 -- 172.21.15.82:0/1250532229 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c15d0d0 con 0x7f8e7c1596b0 2023-07-20T10:06:09.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/1250532229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c15dbb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0097c0 tx=0x7f8e6c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8726d93572638024 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e7affd640 1 -- 172.21.15.82:0/1250532229 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0ab650 con 0x7f8e7c1596b0 2023-07-20T10:06:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e7affd640 1 -- 172.21.15.82:0/1250532229 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c0ab7b0 con 0x7f8e7c1596b0 2023-07-20T10:06:09.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e7affd640 1 -- 172.21.15.82:0/1250532229 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0abb40 con 0x7f8e7c1596b0 2023-07-20T10:06:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 -- 172.21.15.82:0/1250532229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 msgr2=0x7f8e7c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 --2- 172.21.15.82:0/1250532229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c15dbb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0097c0 tx=0x7f8e6c01c450 comp rx=0 tx=0).stop 2023-07-20T10:06:09.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 -- 172.21.15.82:0/1250532229 shutdown_connections 2023-07-20T10:06:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 --2- 172.21.15.82:0/1250532229 >> v2:172.21.15.183:3300/0 conn(0x7f8e7c0b2a90 0x7f8e7c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 --2- 172.21.15.82:0/1250532229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c15dbb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 -- 172.21.15.82:0/1250532229 >> 172.21.15.82:0/1250532229 conn(0x7f8e7c0cada0 msgr2=0x7f8e7c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:09.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 -- 172.21.15.82:0/1250532229 shutdown_connections 2023-07-20T10:06:09.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.658+0000 7f8e828e5640 1 -- 172.21.15.82:0/1250532229 wait complete. 2023-07-20T10:06:09.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 Processor -- start 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- start start 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c0cc900 0x7f8e7c154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c1555a0 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0b0490 con 0x7f8e7c0cc900 2023-07-20T10:06:09.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0b0770 con 0x7f8e7c1596b0 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48808/0 (socket says 172.21.15.82:48808) 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 -- 172.21.15.82:0/542808388 learned_addr learned my addr 172.21.15.82:0/542808388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7b7fe640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c0cc900 0x7f8e7c154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e80e82640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 -- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 msgr2=0x7f8e7c0b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c0b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 -- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c0cc900 msgr2=0x7f8e7c154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c0cc900 0x7f8e7c154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 -- 172.21.15.82:0/542808388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c009420 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e7bfff640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c01ab00 tx=0x7f8e6c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0abdf0 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6c0bf450 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0bf800 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c0b0a50 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c0ae260 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.662+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c0ae450 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.666+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8e6c0c93f0 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.666+0000 7f8e78ff9640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 0x7f8e68068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:09.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.666+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e6c11e930 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.666+0000 7f8e7b7fe640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 0x7f8e68068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:09.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.666+0000 7f8e7b7fe640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 0x7f8e68068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0b2190 tx=0x7f8e70009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:09.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.670+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e6c0ebd30 con 0x7f8e7c0b2a90 2023-07-20T10:06:09.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.814+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e7c0adaf0 con 0x7f8e680663d0 2023-07-20T10:06:09.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.822+0000 7f8e78ff9640 1 -- 172.21.15.82:0/542808388 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311515 (secure 0 0 0) 0x7f8e70001400 con 0x7f8e680663d0 2023-07-20T10:06:09.806 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:09.809 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:09.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 msgr2=0x7f8e68068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 0x7f8e68068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0b2190 tx=0x7f8e70009040 comp rx=0 tx=0).stop 2023-07-20T10:06:09.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 msgr2=0x7f8e7c0ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:09.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c01ab00 tx=0x7f8e6c0191f0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 shutdown_connections 2023-07-20T10:06:09.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f8e680663d0 0x7f8e68068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8e7c1596b0 0x7f8e7c0b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c0cc900 0x7f8e7c154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 --2- 172.21.15.82:0/542808388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e7c0b2a90 0x7f8e7c0ae680 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 >> 172.21.15.82:0/542808388 conn(0x7f8e7c0cada0 msgr2=0x7f8e7c1586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 shutdown_connections 2023-07-20T10:06:09.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:09.826+0000 7f8e828e5640 1 -- 172.21.15.82:0/542808388 wait complete. 2023-07-20T10:06:09.825 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:06:09.726160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":303,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311616,"kb_used_data":10184,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754663104,"statfs":{"total":773094113280,"available":772775018496,"internally_reserved":0,"allocated":10428416,"data_stored":5756140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001353"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565323+0000","last_change":"2023-07-20T10:06:05.050840+0000","last_active":"2023-07-20T10:06:06.565323+0000","last_peered":"2023-07-20T10:06:06.565323+0000","last_clean":"2023-07-20T10:06:06.565323+0000","last_became_active":"2023-07-20T10:06:05.050552+0000","last_became_peered":"2023-07-20T10:06:05.050552+0000","last_unstale":"2023-07-20T10:06:06.565323+0000","last_undegraded":"2023-07-20T10:06:06.565323+0000","last_fullsized":"2023-07-20T10:06:06.565323+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:45.478167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561250+0000","last_change":"2023-07-20T10:06:05.038869+0000","last_active":"2023-07-20T10:06:06.561250+0000","last_peered":"2023-07-20T10:06:06.561250+0000","last_clean":"2023-07-20T10:06:06.561250+0000","last_became_active":"2023-07-20T10:06:05.038535+0000","last_became_peered":"2023-07-20T10:06:05.038535+0000","last_unstale":"2023-07-20T10:06:06.561250+0000","last_undegraded":"2023-07-20T10:06:06.561250+0000","last_fullsized":"2023-07-20T10:06:06.561250+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:09.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016747+0000","last_change":"2023-07-20T10:06:05.042401+0000","last_active":"2023-07-20T10:06:06.016747+0000","last_peered":"2023-07-20T10:06:06.016747+0000","last_clean":"2023-07-20T10:06:06.016747+0000","last_became_active":"2023-07-20T10:06:05.042096+0000","last_became_peered":"2023-07-20T10:06:05.042096+0000","last_unstale":"2023-07-20T10:06:06.016747+0000","last_undegraded":"2023-07-20T10:06:06.016747+0000","last_fullsized":"2023-07-20T10:06:06.016747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:32.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019337+0000","last_change":"2023-07-20T10:06:05.028079+0000","last_active":"2023-07-20T10:06:06.019337+0000","last_peered":"2023-07-20T10:06:06.019337+0000","last_clean":"2023-07-20T10:06:06.019337+0000","last_became_active":"2023-07-20T10:06:05.027783+0000","last_became_peered":"2023-07-20T10:06:05.027783+0000","last_unstale":"2023-07-20T10:06:06.019337+0000","last_undegraded":"2023-07-20T10:06:06.019337+0000","last_fullsized":"2023-07-20T10:06:06.019337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:03.379893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014415+0000","last_change":"2023-07-20T10:06:05.039614+0000","last_active":"2023-07-20T10:06:06.014415+0000","last_peered":"2023-07-20T10:06:06.014415+0000","last_clean":"2023-07-20T10:06:06.014415+0000","last_became_active":"2023-07-20T10:06:05.039138+0000","last_became_peered":"2023-07-20T10:06:05.039138+0000","last_unstale":"2023-07-20T10:06:06.014415+0000","last_undegraded":"2023-07-20T10:06:06.014415+0000","last_fullsized":"2023-07-20T10:06:06.014415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:27.693800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561567+0000","last_change":"2023-07-20T10:06:05.029835+0000","last_active":"2023-07-20T10:06:06.561567+0000","last_peered":"2023-07-20T10:06:06.561567+0000","last_clean":"2023-07-20T10:06:06.561567+0000","last_became_active":"2023-07-20T10:06:05.029580+0000","last_became_peered":"2023-07-20T10:06:05.029580+0000","last_unstale":"2023-07-20T10:06:06.561567+0000","last_undegraded":"2023-07-20T10:06:06.561567+0000","last_fullsized":"2023-07-20T10:06:06.561567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:05.546020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565139+0000","last_change":"2023-07-20T10:06:05.039362+0000","last_active":"2023-07-20T10:06:06.565139+0000","last_peered":"2023-07-20T10:06:06.565139+0000","last_clean":"2023-07-20T10:06:06.565139+0000","last_became_active":"2023-07-20T10:06:05.038969+0000","last_became_peered":"2023-07-20T10:06:05.038969+0000","last_unstale":"2023-07-20T10:06:06.565139+0000","last_undegraded":"2023-07-20T10:06:06.565139+0000","last_fullsized":"2023-07-20T10:06:06.565139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:39.486906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014017+0000","last_change":"2023-07-20T10:06:05.037765+0000","last_active":"2023-07-20T10:06:06.014017+0000","last_peered":"2023-07-20T10:06:06.014017+0000","last_clean":"2023-07-20T10:06:06.014017+0000","last_became_active":"2023-07-20T10:06:05.037471+0000","last_became_peered":"2023-07-20T10:06:05.037471+0000","last_unstale":"2023-07-20T10:06:06.014017+0000","last_undegraded":"2023-07-20T10:06:06.014017+0000","last_fullsized":"2023-07-20T10:06:06.014017+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:49.522374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408278+0000","last_change":"2023-07-20T10:06:05.028251+0000","last_active":"2023-07-20T10:06:06.408278+0000","last_peered":"2023-07-20T10:06:06.408278+0000","last_clean":"2023-07-20T10:06:06.408278+0000","last_became_active":"2023-07-20T10:06:05.027934+0000","last_became_peered":"2023-07-20T10:06:05.027934+0000","last_unstale":"2023-07-20T10:06:06.408278+0000","last_undegraded":"2023-07-20T10:06:06.408278+0000","last_fullsized":"2023-07-20T10:06:06.408278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019469+0000","last_change":"2023-07-20T10:06:05.046590+0000","last_active":"2023-07-20T10:06:06.019469+0000","last_peered":"2023-07-20T10:06:06.019469+0000","last_clean":"2023-07-20T10:06:06.019469+0000","last_became_active":"2023-07-20T10:06:05.045939+0000","last_became_peered":"2023-07-20T10:06:05.045939+0000","last_unstale":"2023-07-20T10:06:06.019469+0000","last_undegraded":"2023-07-20T10:06:06.019469+0000","last_fullsized":"2023-07-20T10:06:06.019469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:13.160757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561204+0000","last_change":"2023-07-20T10:06:05.039079+0000","last_active":"2023-07-20T10:06:06.561204+0000","last_peered":"2023-07-20T10:06:06.561204+0000","last_clean":"2023-07-20T10:06:06.561204+0000","last_became_active":"2023-07-20T10:06:05.038601+0000","last_became_peered":"2023-07-20T10:06:05.038601+0000","last_unstale":"2023-07-20T10:06:06.561204+0000","last_undegraded":"2023-07-20T10:06:06.561204+0000","last_fullsized":"2023-07-20T10:06:06.561204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:55:02.770042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019245+0000","last_change":"2023-07-20T10:06:05.047873+0000","last_active":"2023-07-20T10:06:06.019245+0000","last_peered":"2023-07-20T10:06:06.019245+0000","last_clean":"2023-07-20T10:06:06.019245+0000","last_became_active":"2023-07-20T10:06:05.047385+0000","last_became_peered":"2023-07-20T10:06:05.047385+0000","last_unstale":"2023-07-20T10:06:06.019245+0000","last_undegraded":"2023-07-20T10:06:06.019245+0000","last_fullsized":"2023-07-20T10:06:06.019245+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:26.161706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014282+0000","last_change":"2023-07-20T10:06:05.027326+0000","last_active":"2023-07-20T10:06:06.014282+0000","last_peered":"2023-07-20T10:06:06.014282+0000","last_clean":"2023-07-20T10:06:06.014282+0000","last_became_active":"2023-07-20T10:06:05.027030+0000","last_became_peered":"2023-07-20T10:06:05.027030+0000","last_unstale":"2023-07-20T10:06:06.014282+0000","last_undegraded":"2023-07-20T10:06:06.014282+0000","last_fullsized":"2023-07-20T10:06:06.014282+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:53.794465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561636+0000","last_change":"2023-07-20T10:06:05.029697+0000","last_active":"2023-07-20T10:06:06.561636+0000","last_peered":"2023-07-20T10:06:06.561636+0000","last_clean":"2023-07-20T10:06:06.561636+0000","last_became_active":"2023-07-20T10:06:05.029158+0000","last_became_peered":"2023-07-20T10:06:05.029158+0000","last_unstale":"2023-07-20T10:06:06.561636+0000","last_undegraded":"2023-07-20T10:06:06.561636+0000","last_fullsized":"2023-07-20T10:06:06.561636+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:38.559958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560699+0000","last_change":"2023-07-20T10:06:05.046303+0000","last_active":"2023-07-20T10:06:06.560699+0000","last_peered":"2023-07-20T10:06:06.560699+0000","last_clean":"2023-07-20T10:06:06.560699+0000","last_became_active":"2023-07-20T10:06:05.046007+0000","last_became_peered":"2023-07-20T10:06:05.046007+0000","last_unstale":"2023-07-20T10:06:06.560699+0000","last_undegraded":"2023-07-20T10:06:06.560699+0000","last_fullsized":"2023-07-20T10:06:06.560699+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:37:07.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564446+0000","last_change":"2023-07-20T10:06:05.038830+0000","last_active":"2023-07-20T10:06:06.564446+0000","last_peered":"2023-07-20T10:06:06.564446+0000","last_clean":"2023-07-20T10:06:06.564446+0000","last_became_active":"2023-07-20T10:06:05.038483+0000","last_became_peered":"2023-07-20T10:06:05.038483+0000","last_unstale":"2023-07-20T10:06:06.564446+0000","last_undegraded":"2023-07-20T10:06:06.564446+0000","last_fullsized":"2023-07-20T10:06:06.564446+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:25.755337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014529+0000","last_change":"2023-07-20T10:06:05.040785+0000","last_active":"2023-07-20T10:06:06.014529+0000","last_peered":"2023-07-20T10:06:06.014529+0000","last_clean":"2023-07-20T10:06:06.014529+0000","last_became_active":"2023-07-20T10:06:05.040316+0000","last_became_peered":"2023-07-20T10:06:05.040316+0000","last_unstale":"2023-07-20T10:06:06.014529+0000","last_undegraded":"2023-07-20T10:06:06.014529+0000","last_fullsized":"2023-07-20T10:06:06.014529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:31:36.103791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016779+0000","last_change":"2023-07-20T10:06:05.049684+0000","last_active":"2023-07-20T10:06:06.016779+0000","last_peered":"2023-07-20T10:06:06.016779+0000","last_clean":"2023-07-20T10:06:06.016779+0000","last_became_active":"2023-07-20T10:06:05.049414+0000","last_became_peered":"2023-07-20T10:06:05.049414+0000","last_unstale":"2023-07-20T10:06:06.016779+0000","last_undegraded":"2023-07-20T10:06:06.016779+0000","last_fullsized":"2023-07-20T10:06:06.016779+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:07.407187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561515+0000","last_change":"2023-07-20T10:06:05.036606+0000","last_active":"2023-07-20T10:06:06.561515+0000","last_peered":"2023-07-20T10:06:06.561515+0000","last_clean":"2023-07-20T10:06:06.561515+0000","last_became_active":"2023-07-20T10:06:05.036300+0000","last_became_peered":"2023-07-20T10:06:05.036300+0000","last_unstale":"2023-07-20T10:06:06.561515+0000","last_undegraded":"2023-07-20T10:06:06.561515+0000","last_fullsized":"2023-07-20T10:06:06.561515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:42:14.274988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014561+0000","last_change":"2023-07-20T10:06:05.044137+0000","last_active":"2023-07-20T10:06:06.014561+0000","last_peered":"2023-07-20T10:06:06.014561+0000","last_clean":"2023-07-20T10:06:06.014561+0000","last_became_active":"2023-07-20T10:06:05.043875+0000","last_became_peered":"2023-07-20T10:06:05.043875+0000","last_unstale":"2023-07-20T10:06:06.014561+0000","last_undegraded":"2023-07-20T10:06:06.014561+0000","last_fullsized":"2023-07-20T10:06:06.014561+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:06:07.214972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407977+0000","last_change":"2023-07-20T10:06:05.048839+0000","last_active":"2023-07-20T10:06:06.407977+0000","last_peered":"2023-07-20T10:06:06.407977+0000","last_clean":"2023-07-20T10:06:06.407977+0000","last_became_active":"2023-07-20T10:06:05.048555+0000","last_became_peered":"2023-07-20T10:06:05.048555+0000","last_unstale":"2023-07-20T10:06:06.407977+0000","last_undegraded":"2023-07-20T10:06:06.407977+0000","last_fullsized":"2023-07-20T10:06:06.407977+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:20.208645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014160+0000","last_change":"2023-07-20T10:06:05.025025+0000","last_active":"2023-07-20T10:06:06.014160+0000","last_peered":"2023-07-20T10:06:06.014160+0000","last_clean":"2023-07-20T10:06:06.014160+0000","last_became_active":"2023-07-20T10:06:05.024737+0000","last_became_peered":"2023-07-20T10:06:05.024737+0000","last_unstale":"2023-07-20T10:06:06.014160+0000","last_undegraded":"2023-07-20T10:06:06.014160+0000","last_fullsized":"2023-07-20T10:06:06.014160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:46:42.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407710+0000","last_change":"2023-07-20T10:06:05.027158+0000","last_active":"2023-07-20T10:06:06.407710+0000","last_peered":"2023-07-20T10:06:06.407710+0000","last_clean":"2023-07-20T10:06:06.407710+0000","last_became_active":"2023-07-20T10:06:05.026861+0000","last_became_peered":"2023-07-20T10:06:05.026861+0000","last_unstale":"2023-07-20T10:06:06.407710+0000","last_undegraded":"2023-07-20T10:06:06.407710+0000","last_fullsized":"2023-07-20T10:06:06.407710+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:33.231957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560864+0000","last_change":"2023-07-20T10:06:05.041105+0000","last_active":"2023-07-20T10:06:06.560864+0000","last_peered":"2023-07-20T10:06:06.560864+0000","last_clean":"2023-07-20T10:06:06.560864+0000","last_became_active":"2023-07-20T10:06:05.040798+0000","last_became_peered":"2023-07-20T10:06:05.040798+0000","last_unstale":"2023-07-20T10:06:06.560864+0000","last_undegraded":"2023-07-20T10:06:06.560864+0000","last_fullsized":"2023-07-20T10:06:06.560864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:56.628592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561189+0000","last_change":"2023-07-20T10:06:05.046810+0000","last_active":"2023-07-20T10:06:06.561189+0000","last_peered":"2023-07-20T10:06:06.561189+0000","last_clean":"2023-07-20T10:06:06.561189+0000","last_became_active":"2023-07-20T10:06:05.046504+0000","last_became_peered":"2023-07-20T10:06:05.046504+0000","last_unstale":"2023-07-20T10:06:06.561189+0000","last_undegraded":"2023-07-20T10:06:06.561189+0000","last_fullsized":"2023-07-20T10:06:06.561189+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:29:22.138993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019498+0000","last_change":"2023-07-20T10:06:05.046795+0000","last_active":"2023-07-20T10:06:06.019498+0000","last_peered":"2023-07-20T10:06:06.019498+0000","last_clean":"2023-07-20T10:06:06.019498+0000","last_became_active":"2023-07-20T10:06:05.046436+0000","last_became_peered":"2023-07-20T10:06:05.046436+0000","last_unstale":"2023-07-20T10:06:06.019498+0000","last_undegraded":"2023-07-20T10:06:06.019498+0000","last_fullsized":"2023-07-20T10:06:06.019498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:15:26.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564951+0000","last_change":"2023-07-20T10:06:05.038974+0000","last_active":"2023-07-20T10:06:06.564951+0000","last_peered":"2023-07-20T10:06:06.564951+0000","last_clean":"2023-07-20T10:06:06.564951+0000","last_became_active":"2023-07-20T10:06:05.038669+0000","last_became_peered":"2023-07-20T10:06:05.038669+0000","last_unstale":"2023-07-20T10:06:06.564951+0000","last_undegraded":"2023-07-20T10:06:06.564951+0000","last_fullsized":"2023-07-20T10:06:06.564951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:47:12.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014482+0000","last_change":"2023-07-20T10:06:05.025634+0000","last_active":"2023-07-20T10:06:06.014482+0000","last_peered":"2023-07-20T10:06:06.014482+0000","last_clean":"2023-07-20T10:06:06.014482+0000","last_became_active":"2023-07-20T10:06:05.025360+0000","last_became_peered":"2023-07-20T10:06:05.025360+0000","last_unstale":"2023-07-20T10:06:06.014482+0000","last_undegraded":"2023-07-20T10:06:06.014482+0000","last_fullsized":"2023-07-20T10:06:06.014482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:06.831949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560984+0000","last_change":"2023-07-20T10:06:05.043579+0000","last_active":"2023-07-20T10:06:06.560984+0000","last_peered":"2023-07-20T10:06:06.560984+0000","last_clean":"2023-07-20T10:06:06.560984+0000","last_became_active":"2023-07-20T10:06:05.043284+0000","last_became_peered":"2023-07-20T10:06:05.043284+0000","last_unstale":"2023-07-20T10:06:06.560984+0000","last_undegraded":"2023-07-20T10:06:06.560984+0000","last_fullsized":"2023-07-20T10:06:06.560984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:18.654488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564547+0000","last_change":"2023-07-20T10:06:05.048784+0000","last_active":"2023-07-20T10:06:06.564547+0000","last_peered":"2023-07-20T10:06:06.564547+0000","last_clean":"2023-07-20T10:06:06.564547+0000","last_became_active":"2023-07-20T10:06:05.048470+0000","last_became_peered":"2023-07-20T10:06:05.048470+0000","last_unstale":"2023-07-20T10:06:06.564547+0000","last_undegraded":"2023-07-20T10:06:06.564547+0000","last_fullsized":"2023-07-20T10:06:06.564547+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:08.110549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016330+0000","last_change":"2023-07-20T10:06:05.041872+0000","last_active":"2023-07-20T10:06:06.016330+0000","last_peered":"2023-07-20T10:06:06.016330+0000","last_clean":"2023-07-20T10:06:06.016330+0000","last_became_active":"2023-07-20T10:06:05.041469+0000","last_became_peered":"2023-07-20T10:06:05.041469+0000","last_unstale":"2023-07-20T10:06:06.016330+0000","last_undegraded":"2023-07-20T10:06:06.016330+0000","last_fullsized":"2023-07-20T10:06:06.016330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:38:23.869762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564602+0000","last_change":"2023-07-20T10:06:05.050905+0000","last_active":"2023-07-20T10:06:06.564602+0000","last_peered":"2023-07-20T10:06:06.564602+0000","last_clean":"2023-07-20T10:06:06.564602+0000","last_became_active":"2023-07-20T10:06:05.050614+0000","last_became_peered":"2023-07-20T10:06:05.050614+0000","last_unstale":"2023-07-20T10:06:06.564602+0000","last_undegraded":"2023-07-20T10:06:06.564602+0000","last_fullsized":"2023-07-20T10:06:06.564602+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:16.267204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016242+0000","last_change":"2023-07-20T10:06:05.049444+0000","last_active":"2023-07-20T10:06:06.016242+0000","last_peered":"2023-07-20T10:06:06.016242+0000","last_clean":"2023-07-20T10:06:06.016242+0000","last_became_active":"2023-07-20T10:06:05.049152+0000","last_became_peered":"2023-07-20T10:06:05.049152+0000","last_unstale":"2023-07-20T10:06:06.016242+0000","last_undegraded":"2023-07-20T10:06:06.016242+0000","last_fullsized":"2023-07-20T10:06:06.016242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:59:13.124492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014616+0000","last_change":"2023-07-20T10:06:04.029257+0000","last_active":"2023-07-20T10:06:06.014616+0000","last_peered":"2023-07-20T10:06:06.014616+0000","last_clean":"2023-07-20T10:06:06.014616+0000","last_became_active":"2023-07-20T10:06:04.028782+0000","last_became_peered":"2023-07-20T10:06:04.028782+0000","last_unstale":"2023-07-20T10:06:06.014616+0000","last_undegraded":"2023-07-20T10:06:06.014616+0000","last_fullsized":"2023-07-20T10:06:06.014616+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:58.085410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561439+0000","last_change":"2023-07-20T10:06:05.040671+0000","last_active":"2023-07-20T10:06:06.561439+0000","last_peered":"2023-07-20T10:06:06.561439+0000","last_clean":"2023-07-20T10:06:06.561439+0000","last_became_active":"2023-07-20T10:06:05.040267+0000","last_became_peered":"2023-07-20T10:06:05.040267+0000","last_unstale":"2023-07-20T10:06:06.561439+0000","last_undegraded":"2023-07-20T10:06:06.561439+0000","last_fullsized":"2023-07-20T10:06:06.561439+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:30.076876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564919+0000","last_change":"2023-07-20T10:06:04.029372+0000","last_active":"2023-07-20T10:06:06.564919+0000","last_peered":"2023-07-20T10:06:06.564919+0000","last_clean":"2023-07-20T10:06:06.564919+0000","last_became_active":"2023-07-20T10:06:04.029056+0000","last_became_peered":"2023-07-20T10:06:04.029056+0000","last_unstale":"2023-07-20T10:06:06.564919+0000","last_undegraded":"2023-07-20T10:06:06.564919+0000","last_fullsized":"2023-07-20T10:06:06.564919+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:57.170782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407909+0000","last_change":"2023-07-20T10:06:05.029656+0000","last_active":"2023-07-20T10:06:06.407909+0000","last_peered":"2023-07-20T10:06:06.407909+0000","last_clean":"2023-07-20T10:06:06.407909+0000","last_became_active":"2023-07-20T10:06:05.029021+0000","last_became_peered":"2023-07-20T10:06:05.029021+0000","last_unstale":"2023-07-20T10:06:06.407909+0000","last_undegraded":"2023-07-20T10:06:06.407909+0000","last_fullsized":"2023-07-20T10:06:06.407909+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:10.892922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565056+0000","last_change":"2023-07-20T10:06:04.027229+0000","last_active":"2023-07-20T10:06:06.565056+0000","last_peered":"2023-07-20T10:06:06.565056+0000","last_clean":"2023-07-20T10:06:06.565056+0000","last_became_active":"2023-07-20T10:06:04.026857+0000","last_became_peered":"2023-07-20T10:06:04.026857+0000","last_unstale":"2023-07-20T10:06:06.565056+0000","last_undegraded":"2023-07-20T10:06:06.565056+0000","last_fullsized":"2023-07-20T10:06:06.565056+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:54.035369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408013+0000","last_change":"2023-07-20T10:06:05.052785+0000","last_active":"2023-07-20T10:06:06.408013+0000","last_peered":"2023-07-20T10:06:06.408013+0000","last_clean":"2023-07-20T10:06:06.408013+0000","last_became_active":"2023-07-20T10:06:05.052453+0000","last_became_peered":"2023-07-20T10:06:05.052453+0000","last_unstale":"2023-07-20T10:06:06.408013+0000","last_undegraded":"2023-07-20T10:06:06.408013+0000","last_fullsized":"2023-07-20T10:06:06.408013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:06.596451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565457+0000","last_change":"2023-07-20T10:06:04.036046+0000","last_active":"2023-07-20T10:06:06.565457+0000","last_peered":"2023-07-20T10:06:06.565457+0000","last_clean":"2023-07-20T10:06:06.565457+0000","last_became_active":"2023-07-20T10:06:04.035744+0000","last_became_peered":"2023-07-20T10:06:04.035744+0000","last_unstale":"2023-07-20T10:06:06.565457+0000","last_undegraded":"2023-07-20T10:06:06.565457+0000","last_fullsized":"2023-07-20T10:06:06.565457+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:10:02.951770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560877+0000","last_change":"2023-07-20T10:06:05.039994+0000","last_active":"2023-07-20T10:06:06.560877+0000","last_peered":"2023-07-20T10:06:06.560877+0000","last_clean":"2023-07-20T10:06:06.560877+0000","last_became_active":"2023-07-20T10:06:05.039489+0000","last_became_peered":"2023-07-20T10:06:05.039489+0000","last_unstale":"2023-07-20T10:06:06.560877+0000","last_undegraded":"2023-07-20T10:06:06.560877+0000","last_fullsized":"2023-07-20T10:06:06.560877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:02.310933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408074+0000","last_change":"2023-07-20T10:06:04.022787+0000","last_active":"2023-07-20T10:06:06.408074+0000","last_peered":"2023-07-20T10:06:06.408074+0000","last_clean":"2023-07-20T10:06:06.408074+0000","last_became_active":"2023-07-20T10:06:04.022483+0000","last_became_peered":"2023-07-20T10:06:04.022483+0000","last_unstale":"2023-07-20T10:06:06.408074+0000","last_undegraded":"2023-07-20T10:06:06.408074+0000","last_fullsized":"2023-07-20T10:06:06.408074+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:36.191330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561333+0000","last_change":"2023-07-20T10:06:05.038913+0000","last_active":"2023-07-20T10:06:06.561333+0000","last_peered":"2023-07-20T10:06:06.561333+0000","last_clean":"2023-07-20T10:06:06.561333+0000","last_became_active":"2023-07-20T10:06:05.038296+0000","last_became_peered":"2023-07-20T10:06:05.038296+0000","last_unstale":"2023-07-20T10:06:06.561333+0000","last_undegraded":"2023-07-20T10:06:06.561333+0000","last_fullsized":"2023-07-20T10:06:06.561333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:49.142935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018895+0000","last_change":"2023-07-20T10:06:04.034968+0000","last_active":"2023-07-20T10:06:06.018895+0000","last_peered":"2023-07-20T10:06:06.018895+0000","last_clean":"2023-07-20T10:06:06.018895+0000","last_became_active":"2023-07-20T10:06:04.034639+0000","last_became_peered":"2023-07-20T10:06:04.034639+0000","last_unstale":"2023-07-20T10:06:06.018895+0000","last_undegraded":"2023-07-20T10:06:06.018895+0000","last_fullsized":"2023-07-20T10:06:06.018895+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:36:43.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408216+0000","last_change":"2023-07-20T10:06:05.030536+0000","last_active":"2023-07-20T10:06:06.408216+0000","last_peered":"2023-07-20T10:06:06.408216+0000","last_clean":"2023-07-20T10:06:06.408216+0000","last_became_active":"2023-07-20T10:06:05.030242+0000","last_became_peered":"2023-07-20T10:06:05.030242+0000","last_unstale":"2023-07-20T10:06:06.408216+0000","last_undegraded":"2023-07-20T10:06:06.408216+0000","last_fullsized":"2023-07-20T10:06:06.408216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:34:28.934384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560986+0000","last_change":"2023-07-20T10:06:04.025599+0000","last_active":"2023-07-20T10:06:06.560986+0000","last_peered":"2023-07-20T10:06:06.560986+0000","last_clean":"2023-07-20T10:06:06.560986+0000","last_became_active":"2023-07-20T10:06:04.025282+0000","last_became_peered":"2023-07-20T10:06:04.025282+0000","last_unstale":"2023-07-20T10:06:06.560986+0000","last_undegraded":"2023-07-20T10:06:06.560986+0000","last_fullsized":"2023-07-20T10:06:06.560986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:12.400147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565884+0000","last_change":"2023-07-20T10:06:05.039334+0000","last_active":"2023-07-20T10:06:06.565884+0000","last_peered":"2023-07-20T10:06:06.565884+0000","last_clean":"2023-07-20T10:06:06.565884+0000","last_became_active":"2023-07-20T10:06:05.038983+0000","last_became_peered":"2023-07-20T10:06:05.038983+0000","last_unstale":"2023-07-20T10:06:06.565884+0000","last_undegraded":"2023-07-20T10:06:06.565884+0000","last_fullsized":"2023-07-20T10:06:06.565884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:44:50.829929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014071+0000","last_change":"2023-07-20T10:06:04.028955+0000","last_active":"2023-07-20T10:06:06.014071+0000","last_peered":"2023-07-20T10:06:06.014071+0000","last_clean":"2023-07-20T10:06:06.014071+0000","last_became_active":"2023-07-20T10:06:04.028617+0000","last_became_peered":"2023-07-20T10:06:04.028617+0000","last_unstale":"2023-07-20T10:06:06.014071+0000","last_undegraded":"2023-07-20T10:06:06.014071+0000","last_fullsized":"2023-07-20T10:06:06.014071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:30.679152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560711+0000","last_change":"2023-07-20T10:06:05.041064+0000","last_active":"2023-07-20T10:06:06.560711+0000","last_peered":"2023-07-20T10:06:06.560711+0000","last_clean":"2023-07-20T10:06:06.560711+0000","last_became_active":"2023-07-20T10:06:05.040487+0000","last_became_peered":"2023-07-20T10:06:05.040487+0000","last_unstale":"2023-07-20T10:06:06.560711+0000","last_undegraded":"2023-07-20T10:06:06.560711+0000","last_fullsized":"2023-07-20T10:06:06.560711+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:55.277877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564999+0000","last_change":"2023-07-20T10:06:04.036680+0000","last_active":"2023-07-20T10:06:06.564999+0000","last_peered":"2023-07-20T10:06:06.564999+0000","last_clean":"2023-07-20T10:06:06.564999+0000","last_became_active":"2023-07-20T10:06:04.036407+0000","last_became_peered":"2023-07-20T10:06:04.036407+0000","last_unstale":"2023-07-20T10:06:06.564999+0000","last_undegraded":"2023-07-20T10:06:06.564999+0000","last_fullsized":"2023-07-20T10:06:06.564999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:39:53.048154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018930+0000","last_change":"2023-07-20T10:06:05.028186+0000","last_active":"2023-07-20T10:06:06.018930+0000","last_peered":"2023-07-20T10:06:06.018930+0000","last_clean":"2023-07-20T10:06:06.018930+0000","last_became_active":"2023-07-20T10:06:05.027688+0000","last_became_peered":"2023-07-20T10:06:05.027688+0000","last_unstale":"2023-07-20T10:06:06.018930+0000","last_undegraded":"2023-07-20T10:06:06.018930+0000","last_fullsized":"2023-07-20T10:06:06.018930+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:53.221466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019563+0000","last_change":"2023-07-20T10:06:04.028333+0000","last_active":"2023-07-20T10:06:06.019563+0000","last_peered":"2023-07-20T10:06:06.019563+0000","last_clean":"2023-07-20T10:06:06.019563+0000","last_became_active":"2023-07-20T10:06:04.028042+0000","last_became_peered":"2023-07-20T10:06:04.028042+0000","last_unstale":"2023-07-20T10:06:06.019563+0000","last_undegraded":"2023-07-20T10:06:06.019563+0000","last_fullsized":"2023-07-20T10:06:06.019563+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:48:51.744974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561723+0000","last_change":"2023-07-20T10:06:05.043803+0000","last_active":"2023-07-20T10:06:06.561723+0000","last_peered":"2023-07-20T10:06:06.561723+0000","last_clean":"2023-07-20T10:06:06.561723+0000","last_became_active":"2023-07-20T10:06:05.043533+0000","last_became_peered":"2023-07-20T10:06:05.043533+0000","last_unstale":"2023-07-20T10:06:06.561723+0000","last_undegraded":"2023-07-20T10:06:06.561723+0000","last_fullsized":"2023-07-20T10:06:06.561723+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:16.590671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014651+0000","last_change":"2023-07-20T10:06:04.029830+0000","last_active":"2023-07-20T10:06:06.014651+0000","last_peered":"2023-07-20T10:06:06.014651+0000","last_clean":"2023-07-20T10:06:06.014651+0000","last_became_active":"2023-07-20T10:06:04.029557+0000","last_became_peered":"2023-07-20T10:06:04.029557+0000","last_unstale":"2023-07-20T10:06:06.014651+0000","last_undegraded":"2023-07-20T10:06:06.014651+0000","last_fullsized":"2023-07-20T10:06:06.014651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:01:44.311713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016379+0000","last_change":"2023-07-20T10:06:05.044465+0000","last_active":"2023-07-20T10:06:06.016379+0000","last_peered":"2023-07-20T10:06:06.016379+0000","last_clean":"2023-07-20T10:06:06.016379+0000","last_became_active":"2023-07-20T10:06:05.044082+0000","last_became_peered":"2023-07-20T10:06:05.044082+0000","last_unstale":"2023-07-20T10:06:06.016379+0000","last_undegraded":"2023-07-20T10:06:06.016379+0000","last_fullsized":"2023-07-20T10:06:06.016379+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:34.804032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'6","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565485+0000","last_change":"2023-07-20T10:06:04.029387+0000","last_active":"2023-07-20T10:06:06.565485+0000","last_peered":"2023-07-20T10:06:06.565485+0000","last_clean":"2023-07-20T10:06:06.565485+0000","last_became_active":"2023-07-20T10:06:04.029081+0000","last_became_peered":"2023-07-20T10:06:04.029081+0000","last_unstale":"2023-07-20T10:06:06.565485+0000","last_undegraded":"2023-07-20T10:06:06.565485+0000","last_fullsized":"2023-07-20T10:06:06.565485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:42.308825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019495+0000","last_change":"2023-07-20T10:06:05.029675+0000","last_active":"2023-07-20T10:06:06.019495+0000","last_peered":"2023-07-20T10:06:06.019495+0000","last_clean":"2023-07-20T10:06:06.019495+0000","last_became_active":"2023-07-20T10:06:05.029358+0000","last_became_peered":"2023-07-20T10:06:05.029358+0000","last_unstale":"2023-07-20T10:06:06.019495+0000","last_undegraded":"2023-07-20T10:06:06.019495+0000","last_fullsized":"2023-07-20T10:06:06.019495+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:07.116921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018904+0000","last_change":"2023-07-20T10:06:04.034283+0000","last_active":"2023-07-20T10:06:06.018904+0000","last_peered":"2023-07-20T10:06:06.018904+0000","last_clean":"2023-07-20T10:06:06.018904+0000","last_became_active":"2023-07-20T10:06:04.033976+0000","last_became_peered":"2023-07-20T10:06:04.033976+0000","last_unstale":"2023-07-20T10:06:06.018904+0000","last_undegraded":"2023-07-20T10:06:06.018904+0000","last_fullsized":"2023-07-20T10:06:06.018904+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:20.596671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565600+0000","last_change":"2023-07-20T10:06:05.047144+0000","last_active":"2023-07-20T10:06:06.565600+0000","last_peered":"2023-07-20T10:06:06.565600+0000","last_clean":"2023-07-20T10:06:06.565600+0000","last_became_active":"2023-07-20T10:06:05.046854+0000","last_became_peered":"2023-07-20T10:06:05.046854+0000","last_unstale":"2023-07-20T10:06:06.565600+0000","last_undegraded":"2023-07-20T10:06:06.565600+0000","last_fullsized":"2023-07-20T10:06:06.565600+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:59.931561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564666+0000","last_change":"2023-07-20T10:06:04.033232+0000","last_active":"2023-07-20T10:06:06.564666+0000","last_peered":"2023-07-20T10:06:06.564666+0000","last_clean":"2023-07-20T10:06:06.564666+0000","last_became_active":"2023-07-20T10:06:04.032917+0000","last_became_peered":"2023-07-20T10:06:04.032917+0000","last_unstale":"2023-07-20T10:06:06.564666+0000","last_undegraded":"2023-07-20T10:06:06.564666+0000","last_fullsized":"2023-07-20T10:06:06.564666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:10:42.954009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565630+0000","last_change":"2023-07-20T10:06:05.048583+0000","last_active":"2023-07-20T10:06:06.565630+0000","last_peered":"2023-07-20T10:06:06.565630+0000","last_clean":"2023-07-20T10:06:06.565630+0000","last_became_active":"2023-07-20T10:06:05.048299+0000","last_became_peered":"2023-07-20T10:06:05.048299+0000","last_unstale":"2023-07-20T10:06:06.565630+0000","last_undegraded":"2023-07-20T10:06:06.565630+0000","last_fullsized":"2023-07-20T10:06:06.565630+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:18:06.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014058+0000","last_change":"2023-07-20T10:06:04.028928+0000","last_active":"2023-07-20T10:06:06.014058+0000","last_peered":"2023-07-20T10:06:06.014058+0000","last_clean":"2023-07-20T10:06:06.014058+0000","last_became_active":"2023-07-20T10:06:04.028633+0000","last_became_peered":"2023-07-20T10:06:04.028633+0000","last_unstale":"2023-07-20T10:06:06.014058+0000","last_undegraded":"2023-07-20T10:06:06.014058+0000","last_fullsized":"2023-07-20T10:06:06.014058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:31:14.219542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565903+0000","last_change":"2023-07-20T10:06:05.050299+0000","last_active":"2023-07-20T10:06:06.565903+0000","last_peered":"2023-07-20T10:06:06.565903+0000","last_clean":"2023-07-20T10:06:06.565903+0000","last_became_active":"2023-07-20T10:06:05.050018+0000","last_became_peered":"2023-07-20T10:06:05.050018+0000","last_unstale":"2023-07-20T10:06:06.565903+0000","last_undegraded":"2023-07-20T10:06:06.565903+0000","last_fullsized":"2023-07-20T10:06:06.565903+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:43:41.380293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560815+0000","last_change":"2023-07-20T10:06:04.026332+0000","last_active":"2023-07-20T10:06:06.560815+0000","last_peered":"2023-07-20T10:06:06.560815+0000","last_clean":"2023-07-20T10:06:06.560815+0000","last_became_active":"2023-07-20T10:06:04.026047+0000","last_became_peered":"2023-07-20T10:06:04.026047+0000","last_unstale":"2023-07-20T10:06:06.560815+0000","last_undegraded":"2023-07-20T10:06:06.560815+0000","last_fullsized":"2023-07-20T10:06:06.560815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:04:13.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407980+0000","last_change":"2023-07-20T10:06:05.044485+0000","last_active":"2023-07-20T10:06:06.407980+0000","last_peered":"2023-07-20T10:06:06.407980+0000","last_clean":"2023-07-20T10:06:06.407980+0000","last_became_active":"2023-07-20T10:06:05.044206+0000","last_became_peered":"2023-07-20T10:06:05.044206+0000","last_unstale":"2023-07-20T10:06:06.407980+0000","last_undegraded":"2023-07-20T10:06:06.407980+0000","last_fullsized":"2023-07-20T10:06:06.407980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:08.144096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019257+0000","last_change":"2023-07-20T10:06:04.033740+0000","last_active":"2023-07-20T10:06:06.019257+0000","last_peered":"2023-07-20T10:06:06.019257+0000","last_clean":"2023-07-20T10:06:06.019257+0000","last_became_active":"2023-07-20T10:06:04.033441+0000","last_became_peered":"2023-07-20T10:06:04.033441+0000","last_unstale":"2023-07-20T10:06:06.019257+0000","last_undegraded":"2023-07-20T10:06:06.019257+0000","last_fullsized":"2023-07-20T10:06:06.019257+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:51.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565159+0000","last_change":"2023-07-20T10:06:05.049657+0000","last_active":"2023-07-20T10:06:06.565159+0000","last_peered":"2023-07-20T10:06:06.565159+0000","last_clean":"2023-07-20T10:06:06.565159+0000","last_became_active":"2023-07-20T10:06:05.049370+0000","last_became_peered":"2023-07-20T10:06:05.049370+0000","last_unstale":"2023-07-20T10:06:06.565159+0000","last_undegraded":"2023-07-20T10:06:06.565159+0000","last_fullsized":"2023-07-20T10:06:06.565159+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:22.311872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561456+0000","last_change":"2023-07-20T10:06:04.030423+0000","last_active":"2023-07-20T10:06:06.561456+0000","last_peered":"2023-07-20T10:06:06.561456+0000","last_clean":"2023-07-20T10:06:06.561456+0000","last_became_active":"2023-07-20T10:06:04.030140+0000","last_became_peered":"2023-07-20T10:06:04.030140+0000","last_unstale":"2023-07-20T10:06:06.561456+0000","last_undegraded":"2023-07-20T10:06:06.561456+0000","last_fullsized":"2023-07-20T10:06:06.561456+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:42.035494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407937+0000","last_change":"2023-07-20T10:06:05.029942+0000","last_active":"2023-07-20T10:06:06.407937+0000","last_peered":"2023-07-20T10:06:06.407937+0000","last_clean":"2023-07-20T10:06:06.407937+0000","last_became_active":"2023-07-20T10:06:05.029382+0000","last_became_peered":"2023-07-20T10:06:05.029382+0000","last_unstale":"2023-07-20T10:06:06.407937+0000","last_undegraded":"2023-07-20T10:06:06.407937+0000","last_fullsized":"2023-07-20T10:06:06.407937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:41:22.729844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565334+0000","last_change":"2023-07-20T10:06:04.031020+0000","last_active":"2023-07-20T10:06:06.565334+0000","last_peered":"2023-07-20T10:06:06.565334+0000","last_clean":"2023-07-20T10:06:06.565334+0000","last_became_active":"2023-07-20T10:06:04.030738+0000","last_became_peered":"2023-07-20T10:06:04.030738+0000","last_unstale":"2023-07-20T10:06:06.565334+0000","last_undegraded":"2023-07-20T10:06:06.565334+0000","last_fullsized":"2023-07-20T10:06:06.565334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:02.434817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561154+0000","last_change":"2023-07-20T10:06:05.041399+0000","last_active":"2023-07-20T10:06:06.561154+0000","last_peered":"2023-07-20T10:06:06.561154+0000","last_clean":"2023-07-20T10:06:06.561154+0000","last_became_active":"2023-07-20T10:06:05.041105+0000","last_became_peered":"2023-07-20T10:06:05.041105+0000","last_unstale":"2023-07-20T10:06:06.561154+0000","last_undegraded":"2023-07-20T10:06:06.561154+0000","last_fullsized":"2023-07-20T10:06:06.561154+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:55:53.266587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565363+0000","last_change":"2023-07-20T10:06:04.031439+0000","last_active":"2023-07-20T10:06:06.565363+0000","last_peered":"2023-07-20T10:06:06.565363+0000","last_clean":"2023-07-20T10:06:06.565363+0000","last_became_active":"2023-07-20T10:06:04.031137+0000","last_became_peered":"2023-07-20T10:06:04.031137+0000","last_unstale":"2023-07-20T10:06:06.565363+0000","last_undegraded":"2023-07-20T10:06:06.565363+0000","last_fullsized":"2023-07-20T10:06:06.565363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:01.084126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565051+0000","last_change":"2023-07-20T10:06:05.049777+0000","last_active":"2023-07-20T10:06:06.565051+0000","last_peered":"2023-07-20T10:06:06.565051+0000","last_clean":"2023-07-20T10:06:06.565051+0000","last_became_active":"2023-07-20T10:06:05.049495+0000","last_became_peered":"2023-07-20T10:06:05.049495+0000","last_unstale":"2023-07-20T10:06:06.565051+0000","last_undegraded":"2023-07-20T10:06:06.565051+0000","last_fullsized":"2023-07-20T10:06:06.565051+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565219+0000","last_change":"2023-07-20T10:06:04.035200+0000","last_active":"2023-07-20T10:06:06.565219+0000","last_peered":"2023-07-20T10:06:06.565219+0000","last_clean":"2023-07-20T10:06:06.565219+0000","last_became_active":"2023-07-20T10:06:04.034920+0000","last_became_peered":"2023-07-20T10:06:04.034920+0000","last_unstale":"2023-07-20T10:06:06.565219+0000","last_undegraded":"2023-07-20T10:06:06.565219+0000","last_fullsized":"2023-07-20T10:06:06.565219+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:21.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565666+0000","last_change":"2023-07-20T10:06:05.040875+0000","last_active":"2023-07-20T10:06:06.565666+0000","last_peered":"2023-07-20T10:06:06.565666+0000","last_clean":"2023-07-20T10:06:06.565666+0000","last_became_active":"2023-07-20T10:06:05.040586+0000","last_became_peered":"2023-07-20T10:06:05.040586+0000","last_unstale":"2023-07-20T10:06:06.565666+0000","last_undegraded":"2023-07-20T10:06:06.565666+0000","last_fullsized":"2023-07-20T10:06:06.565666+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:11.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014510+0000","last_change":"2023-07-20T10:06:04.031467+0000","last_active":"2023-07-20T10:06:06.014510+0000","last_peered":"2023-07-20T10:06:06.014510+0000","last_clean":"2023-07-20T10:06:06.014510+0000","last_became_active":"2023-07-20T10:06:04.031193+0000","last_became_peered":"2023-07-20T10:06:04.031193+0000","last_unstale":"2023-07-20T10:06:06.014510+0000","last_undegraded":"2023-07-20T10:06:06.014510+0000","last_fullsized":"2023-07-20T10:06:06.014510+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:12:58.644065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016808+0000","last_change":"2023-07-20T10:06:05.042402+0000","last_active":"2023-07-20T10:06:06.016808+0000","last_peered":"2023-07-20T10:06:06.016808+0000","last_clean":"2023-07-20T10:06:06.016808+0000","last_became_active":"2023-07-20T10:06:05.042153+0000","last_became_peered":"2023-07-20T10:06:05.042153+0000","last_unstale":"2023-07-20T10:06:06.016808+0000","last_undegraded":"2023-07-20T10:06:06.016808+0000","last_fullsized":"2023-07-20T10:06:06.016808+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:03:38.627202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565285+0000","last_change":"2023-07-20T10:06:04.036252+0000","last_active":"2023-07-20T10:06:06.565285+0000","last_peered":"2023-07-20T10:06:06.565285+0000","last_clean":"2023-07-20T10:06:06.565285+0000","last_became_active":"2023-07-20T10:06:04.035895+0000","last_became_peered":"2023-07-20T10:06:04.035895+0000","last_unstale":"2023-07-20T10:06:06.565285+0000","last_undegraded":"2023-07-20T10:06:06.565285+0000","last_fullsized":"2023-07-20T10:06:06.565285+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:32.240970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016866+0000","last_change":"2023-07-20T10:06:05.041915+0000","last_active":"2023-07-20T10:06:06.016866+0000","last_peered":"2023-07-20T10:06:06.016866+0000","last_clean":"2023-07-20T10:06:06.016866+0000","last_became_active":"2023-07-20T10:06:05.041588+0000","last_became_peered":"2023-07-20T10:06:05.041588+0000","last_unstale":"2023-07-20T10:06:06.016866+0000","last_undegraded":"2023-07-20T10:06:06.016866+0000","last_fullsized":"2023-07-20T10:06:06.016866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:06:12.111341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016194+0000","last_change":"2023-07-20T10:06:04.030099+0000","last_active":"2023-07-20T10:06:06.016194+0000","last_peered":"2023-07-20T10:06:06.016194+0000","last_clean":"2023-07-20T10:06:06.016194+0000","last_became_active":"2023-07-20T10:06:04.029635+0000","last_became_peered":"2023-07-20T10:06:04.029635+0000","last_unstale":"2023-07-20T10:06:06.016194+0000","last_undegraded":"2023-07-20T10:06:06.016194+0000","last_fullsized":"2023-07-20T10:06:06.016194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:02:59.228281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565239+0000","last_change":"2023-07-20T10:06:05.047083+0000","last_active":"2023-07-20T10:06:06.565239+0000","last_peered":"2023-07-20T10:06:06.565239+0000","last_clean":"2023-07-20T10:06:06.565239+0000","last_became_active":"2023-07-20T10:06:05.046549+0000","last_became_peered":"2023-07-20T10:06:05.046549+0000","last_unstale":"2023-07-20T10:06:06.565239+0000","last_undegraded":"2023-07-20T10:06:06.565239+0000","last_fullsized":"2023-07-20T10:06:06.565239+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:45.278322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561829+0000","last_change":"2023-07-20T10:06:04.029970+0000","last_active":"2023-07-20T10:06:06.561829+0000","last_peered":"2023-07-20T10:06:06.561829+0000","last_clean":"2023-07-20T10:06:06.561829+0000","last_became_active":"2023-07-20T10:06:04.029676+0000","last_became_peered":"2023-07-20T10:06:04.029676+0000","last_unstale":"2023-07-20T10:06:06.561829+0000","last_undegraded":"2023-07-20T10:06:06.561829+0000","last_fullsized":"2023-07-20T10:06:06.561829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:49:47.400172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"83'172","reported_seq":501,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565380+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:06.565380+0000","last_peered":"2023-07-20T10:06:06.565380+0000","last_clean":"2023-07-20T10:06:06.565380+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:06.565380+0000","last_undegraded":"2023-07-20T10:06:06.565380+0000","last_fullsized":"2023-07-20T10:06:06.565380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:37.385277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018976+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:06.018976+0000","last_peered":"2023-07-20T10:06:06.018976+0000","last_clean":"2023-07-20T10:06:06.018976+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:06.018976+0000","last_undegraded":"2023-07-20T10:06:06.018976+0000","last_fullsized":"2023-07-20T10:06:06.018976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:32:59.549783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561374+0000","last_change":"2023-07-20T10:06:05.046142+0000","last_active":"2023-07-20T10:06:06.561374+0000","last_peered":"2023-07-20T10:06:06.561374+0000","last_clean":"2023-07-20T10:06:06.561374+0000","last_became_active":"2023-07-20T10:06:05.045819+0000","last_became_peered":"2023-07-20T10:06:05.045819+0000","last_unstale":"2023-07-20T10:06:06.561374+0000","last_undegraded":"2023-07-20T10:06:06.561374+0000","last_fullsized":"2023-07-20T10:06:06.561374+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:29.508447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561245+0000","last_change":"2023-07-20T10:06:04.026867+0000","last_active":"2023-07-20T10:06:06.561245+0000","last_peered":"2023-07-20T10:06:06.561245+0000","last_clean":"2023-07-20T10:06:06.561245+0000","last_became_active":"2023-07-20T10:06:04.026540+0000","last_became_peered":"2023-07-20T10:06:04.026540+0000","last_unstale":"2023-07-20T10:06:06.561245+0000","last_undegraded":"2023-07-20T10:06:06.561245+0000","last_fullsized":"2023-07-20T10:06:06.561245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:57.587221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564657+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:06.564657+0000","last_peered":"2023-07-20T10:06:06.564657+0000","last_clean":"2023-07-20T10:06:06.564657+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:06.564657+0000","last_undegraded":"2023-07-20T10:06:06.564657+0000","last_fullsized":"2023-07-20T10:06:06.564657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:42.929117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566050+0000","last_change":"2023-07-20T10:06:05.039311+0000","last_active":"2023-07-20T10:06:06.566050+0000","last_peered":"2023-07-20T10:06:06.566050+0000","last_clean":"2023-07-20T10:06:06.566050+0000","last_became_active":"2023-07-20T10:06:05.038935+0000","last_became_peered":"2023-07-20T10:06:05.038935+0000","last_unstale":"2023-07-20T10:06:06.566050+0000","last_undegraded":"2023-07-20T10:06:06.566050+0000","last_fullsized":"2023-07-20T10:06:06.566050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:05:44.135239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561216+0000","last_change":"2023-07-20T10:06:04.026770+0000","last_active":"2023-07-20T10:06:06.561216+0000","last_peered":"2023-07-20T10:06:06.561216+0000","last_clean":"2023-07-20T10:06:06.561216+0000","last_became_active":"2023-07-20T10:06:04.026487+0000","last_became_peered":"2023-07-20T10:06:04.026487+0000","last_unstale":"2023-07-20T10:06:06.561216+0000","last_undegraded":"2023-07-20T10:06:06.561216+0000","last_fullsized":"2023-07-20T10:06:06.561216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:46.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014166+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:06.014166+0000","last_peered":"2023-07-20T10:06:06.014166+0000","last_clean":"2023-07-20T10:06:06.014166+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:06.014166+0000","last_undegraded":"2023-07-20T10:06:06.014166+0000","last_fullsized":"2023-07-20T10:06:06.014166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:15.218167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560934+0000","last_change":"2023-07-20T10:06:05.039783+0000","last_active":"2023-07-20T10:06:06.560934+0000","last_peered":"2023-07-20T10:06:06.560934+0000","last_clean":"2023-07-20T10:06:06.560934+0000","last_became_active":"2023-07-20T10:06:05.039168+0000","last_became_peered":"2023-07-20T10:06:05.039168+0000","last_unstale":"2023-07-20T10:06:06.560934+0000","last_undegraded":"2023-07-20T10:06:06.560934+0000","last_fullsized":"2023-07-20T10:06:06.560934+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:16.845759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561463+0000","last_change":"2023-07-20T10:06:04.029986+0000","last_active":"2023-07-20T10:06:06.561463+0000","last_peered":"2023-07-20T10:06:06.561463+0000","last_clean":"2023-07-20T10:06:06.561463+0000","last_became_active":"2023-07-20T10:06:04.029712+0000","last_became_peered":"2023-07-20T10:06:04.029712+0000","last_unstale":"2023-07-20T10:06:06.561463+0000","last_undegraded":"2023-07-20T10:06:06.561463+0000","last_fullsized":"2023-07-20T10:06:06.561463+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:37.032211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019147+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:06.019147+0000","last_peered":"2023-07-20T10:06:06.019147+0000","last_clean":"2023-07-20T10:06:06.019147+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:06.019147+0000","last_undegraded":"2023-07-20T10:06:06.019147+0000","last_fullsized":"2023-07-20T10:06:06.019147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:10.772811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014259+0000","last_change":"2023-07-20T10:06:05.043001+0000","last_active":"2023-07-20T10:06:06.014259+0000","last_peered":"2023-07-20T10:06:06.014259+0000","last_clean":"2023-07-20T10:06:06.014259+0000","last_became_active":"2023-07-20T10:06:05.042682+0000","last_became_peered":"2023-07-20T10:06:05.042682+0000","last_unstale":"2023-07-20T10:06:06.014259+0000","last_undegraded":"2023-07-20T10:06:06.014259+0000","last_fullsized":"2023-07-20T10:06:06.014259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:09.032897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014774+0000","last_change":"2023-07-20T10:06:04.028773+0000","last_active":"2023-07-20T10:06:06.014774+0000","last_peered":"2023-07-20T10:06:06.014774+0000","last_clean":"2023-07-20T10:06:06.014774+0000","last_became_active":"2023-07-20T10:06:04.028476+0000","last_became_peered":"2023-07-20T10:06:04.028476+0000","last_unstale":"2023-07-20T10:06:06.014774+0000","last_undegraded":"2023-07-20T10:06:06.014774+0000","last_fullsized":"2023-07-20T10:06:06.014774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:17:18.247321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016593+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:06.016593+0000","last_peered":"2023-07-20T10:06:06.016593+0000","last_clean":"2023-07-20T10:06:06.016593+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:06.016593+0000","last_undegraded":"2023-07-20T10:06:06.016593+0000","last_fullsized":"2023-07-20T10:06:06.016593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:06:24.613255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561362+0000","last_change":"2023-07-20T10:06:05.037745+0000","last_active":"2023-07-20T10:06:06.561362+0000","last_peered":"2023-07-20T10:06:06.561362+0000","last_clean":"2023-07-20T10:06:06.561362+0000","last_became_active":"2023-07-20T10:06:05.037480+0000","last_became_peered":"2023-07-20T10:06:05.037480+0000","last_unstale":"2023-07-20T10:06:06.561362+0000","last_undegraded":"2023-07-20T10:06:06.561362+0000","last_fullsized":"2023-07-20T10:06:06.561362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:46.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016525+0000","last_change":"2023-07-20T10:06:04.033788+0000","last_active":"2023-07-20T10:06:06.016525+0000","last_peered":"2023-07-20T10:06:06.016525+0000","last_clean":"2023-07-20T10:06:06.016525+0000","last_became_active":"2023-07-20T10:06:04.033519+0000","last_became_peered":"2023-07-20T10:06:04.033519+0000","last_unstale":"2023-07-20T10:06:06.016525+0000","last_undegraded":"2023-07-20T10:06:06.016525+0000","last_fullsized":"2023-07-20T10:06:06.016525+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:24.706130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565402+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:06.565402+0000","last_peered":"2023-07-20T10:06:06.565402+0000","last_clean":"2023-07-20T10:06:06.565402+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:06.565402+0000","last_undegraded":"2023-07-20T10:06:06.565402+0000","last_fullsized":"2023-07-20T10:06:06.565402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:07.031856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561155+0000","last_change":"2023-07-20T10:06:05.037168+0000","last_active":"2023-07-20T10:06:06.561155+0000","last_peered":"2023-07-20T10:06:06.561155+0000","last_clean":"2023-07-20T10:06:06.561155+0000","last_became_active":"2023-07-20T10:06:05.036894+0000","last_became_peered":"2023-07-20T10:06:05.036894+0000","last_unstale":"2023-07-20T10:06:06.561155+0000","last_undegraded":"2023-07-20T10:06:06.561155+0000","last_fullsized":"2023-07-20T10:06:06.561155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:13.775277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565140+0000","last_change":"2023-07-20T10:06:04.033251+0000","last_active":"2023-07-20T10:06:06.565140+0000","last_peered":"2023-07-20T10:06:06.565140+0000","last_clean":"2023-07-20T10:06:06.565140+0000","last_became_active":"2023-07-20T10:06:04.032902+0000","last_became_peered":"2023-07-20T10:06:04.032902+0000","last_unstale":"2023-07-20T10:06:06.565140+0000","last_undegraded":"2023-07-20T10:06:06.565140+0000","last_fullsized":"2023-07-20T10:06:06.565140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:25.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016891+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:06.016891+0000","last_peered":"2023-07-20T10:06:06.016891+0000","last_clean":"2023-07-20T10:06:06.016891+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:06.016891+0000","last_undegraded":"2023-07-20T10:06:06.016891+0000","last_fullsized":"2023-07-20T10:06:06.016891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:13:26.945694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014077+0000","last_change":"2023-07-20T10:06:05.038534+0000","last_active":"2023-07-20T10:06:06.014077+0000","last_peered":"2023-07-20T10:06:06.014077+0000","last_clean":"2023-07-20T10:06:06.014077+0000","last_became_active":"2023-07-20T10:06:05.038136+0000","last_became_peered":"2023-07-20T10:06:05.038136+0000","last_unstale":"2023-07-20T10:06:06.014077+0000","last_undegraded":"2023-07-20T10:06:06.014077+0000","last_fullsized":"2023-07-20T10:06:06.014077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:55.305110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408214+0000","last_change":"2023-07-20T10:06:04.032699+0000","last_active":"2023-07-20T10:06:06.408214+0000","last_peered":"2023-07-20T10:06:06.408214+0000","last_clean":"2023-07-20T10:06:06.408214+0000","last_became_active":"2023-07-20T10:06:04.032218+0000","last_became_peered":"2023-07-20T10:06:04.032218+0000","last_unstale":"2023-07-20T10:06:06.408214+0000","last_undegraded":"2023-07-20T10:06:06.408214+0000","last_fullsized":"2023-07-20T10:06:06.408214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:41:23.284483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566003+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:06.566003+0000","last_peered":"2023-07-20T10:06:06.566003+0000","last_clean":"2023-07-20T10:06:06.566003+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:06.566003+0000","last_undegraded":"2023-07-20T10:06:06.566003+0000","last_fullsized":"2023-07-20T10:06:06.566003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:38:32.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312780,"statfs":{"total":96636764160,"available":96576286720,"internally_reserved":0,"allocated":1744896,"data_stored":1161725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.372},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1159168,"data_stored":572899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.621}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.67300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1150976,"data_stored":571369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.37},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.501}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1167360,"data_stored":573003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.84499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.47799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0580000000000001,"15min":1.085},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.141},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70799999999999996},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.363},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.177},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.0049999999999999,"5min":1.204,"15min":1.3620000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.61799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":1.212},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":1.4770000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.877,"5min":0.90500000000000003,"15min":1.196},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60499999999999998,"15min":0.58799999999999997},"min":{"1min":0.48899999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.4970000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.57499999999999996,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89500000000000002,"5min":0.96299999999999997,"15min":1.538},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"max":{"1min":0.85899999999999999,"5min":0.93400000000000005,"15min":1.597},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":571917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.68700000000000006,"15min":4.8239999999999998},"last":0.375}]},{"osd":1,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.54600000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.51200000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66900000000000004,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":1.099},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.9830000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.071,"15min":1.381},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"max":{"1min":0.97499999999999998,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.052,"15min":1.3260000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.01,"5min":1.1160000000000001,"15min":1.274},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.502},"max":{"1min":1.04,"5min":1.04,"15min":1.1950000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.4399999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0549999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54396,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317444,"statfs":{"total":96636764160,"available":96581062656,"internally_reserved":0,"allocated":1159168,"data_stored":572077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.318}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.442}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1155072,"data_stored":571447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.435}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.376},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.496},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1740800,"data_stored":1161703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.626}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:09.833 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:06:10.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 Processor -- start 2023-07-20T10:06:10.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 -- start start 2023-07-20T10:06:10.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2940d1170 0x7fd2940cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940b3520 con 0x7fd2940d0d10 2023-07-20T10:06:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940d0a10 con 0x7fd29415cab0 2023-07-20T10:06:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd29b8cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940d31c0 con 0x7fd2940d1170 2023-07-20T10:06:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd299e68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2940d1170 0x7fd2940cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd298e66640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd2940d0d10 0x7fd2940cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50458/0 (socket says 172.21.15.82:50458) 2023-07-20T10:06:10.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd299e68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2940d1170 0x7fd2940cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48818/0 (socket says 172.21.15.82:48818) 2023-07-20T10:06:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd298e66640 1 -- 172.21.15.82:0/2171196537 learned_addr learned my addr 172.21.15.82:0/2171196537 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd299e68640 1 -- 172.21.15.82:0/2171196537 >> v1:172.21.15.183:6789/0 conn(0x7fd29415cab0 legacy=0x7fd2940d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd299e68640 1 -- 172.21.15.82:0/2171196537 >> v1:172.21.15.82:6789/0 conn(0x7fd2940d0d10 legacy=0x7fd2940cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd299e68640 1 -- 172.21.15.82:0/2171196537 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2940b2910 con 0x7fd2940d1170 2023-07-20T10:06:10.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.026+0000 7fd28bfff640 1 -- 172.21.15.82:0/2171196537 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173884888 0 0) 0x7fd2940b3520 con 0x7fd2940d0d10 2023-07-20T10:06:10.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd299e68640 1 --2- 172.21.15.82:0/2171196537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d1170 0x7fd2940cdbc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009d90 tx=0x7fd28c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adc5f91089c36b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd28bfff640 1 -- 172.21.15.82:0/2171196537 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0a58e0 con 0x7fd2940d1170 2023-07-20T10:06:10.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd28bfff640 1 -- 172.21.15.82:0/2171196537 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c0a5a40 con 0x7fd2940d1170 2023-07-20T10:06:10.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd28bfff640 1 -- 172.21.15.82:0/2171196537 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0a5dd0 con 0x7fd2940d1170 2023-07-20T10:06:10.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2171196537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d1170 msgr2=0x7fd2940cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2171196537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d1170 0x7fd2940cdbc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009d90 tx=0x7fd28c01c8b0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2171196537 shutdown_connections 2023-07-20T10:06:10.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2171196537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d1170 0x7fd2940cdbc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2171196537 >> 172.21.15.82:0/2171196537 conn(0x7fd29408c120 msgr2=0x7fd29409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:10.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2171196537 shutdown_connections 2023-07-20T10:06:10.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.030+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2171196537 wait complete. 2023-07-20T10:06:10.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 Processor -- start 2023-07-20T10:06:10.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- start start 2023-07-20T10:06:10.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2940d1170 0x7fd2940c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd29415cab0 0x7fd2940cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940c8d90 con 0x7fd2940d0d10 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294154420 con 0x7fd2940d1170 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940c87d0 con 0x7fd29415cab0 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48830/0 (socket says 172.21.15.82:48830) 2023-07-20T10:06:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 -- 172.21.15.82:0/2909826283 learned_addr learned my addr 172.21.15.82:0/2909826283 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299e68640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd29415cab0 0x7fd2940cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd298e66640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2940d1170 0x7fd2940c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 -- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd29415cab0 msgr2=0x7fd2940cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd29415cab0 0x7fd2940cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 -- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2940d1170 msgr2=0x7fd2940c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2940d1170 0x7fd2940c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 -- 172.21.15.82:0/2909826283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c009a70 con 0x7fd2940d0d10 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd299667640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd29000c450 tx=0x7fd29000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290011790 con 0x7fd2940d0d10 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290011910 con 0x7fd2940d0d10 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290011cc0 con 0x7fd2940d0d10 2023-07-20T10:06:10.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2940c8ab0 con 0x7fd2940d0d10 2023-07-20T10:06:10.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.034+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2940cb3f0 con 0x7fd2940d0d10 2023-07-20T10:06:10.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2940caf70 con 0x7fd2940d0d10 2023-07-20T10:06:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd29001c460 con 0x7fd2940d0d10 2023-07-20T10:06:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd289ffb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 0x7fd278068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd290083e40 con 0x7fd2940d0d10 2023-07-20T10:06:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd298e66640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 0x7fd278068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.038+0000 7fd298e66640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 0x7fd278068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2940b3b70 tx=0x7fd284007c10 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.042+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2940caf70 con 0x7fd2940d0d10 2023-07-20T10:06:10.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2940caf70 con 0x7fd2940d0d10 2023-07-20T10:06:10.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd289ffb640 1 -- 172.21.15.82:0/2909826283 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7fd2940caf70 con 0x7fd2940d0d10 2023-07-20T10:06:10.223 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:10.223 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":969,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":94,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":319094784,"bytes_avail":772775018496,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":41,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":7224}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-20T10:04:20.728788+0000","services":{}},"progress_events":{}} 2023-07-20T10:06:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 msgr2=0x7fd278068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 0x7fd278068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd2940b3b70 tx=0x7fd284007c10 comp rx=0 tx=0).stop 2023-07-20T10:06:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 msgr2=0x7fd294153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd29000c450 tx=0x7fd29000c910 comp rx=0 tx=0).stop 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 shutdown_connections 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fd2780663a0 0x7fd278068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd29415cab0 0x7fd2940cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2940d1170 0x7fd2940c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 --2- 172.21.15.82:0/2909826283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2940d0d10 0x7fd294153ee0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 >> 172.21.15.82:0/2909826283 conn(0x7fd29408c120 msgr2=0x7fd29406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.242+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 shutdown_connections 2023-07-20T10:06:10.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.246+0000 7fd29b8cb640 1 -- 172.21.15.82:0/2909826283 wait complete. 2023-07-20T10:06:10.243 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:06:10.244 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 Processor -- start 2023-07-20T10:06:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 -- start start 2023-07-20T10:06:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f296406f350 0x7f296406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29640b2640 0x7f296415c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29640cf4a0 con 0x7f296406b970 2023-07-20T10:06:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296406ea80 con 0x7f29640b2640 2023-07-20T10:06:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296bcec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29640ce890 con 0x7f296406f350 2023-07-20T10:06:10.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29640b2640 0x7f296415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29640b2640 0x7f296415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48844/0 (socket says 172.21.15.82:48844) 2023-07-20T10:06:10.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 -- 172.21.15.82:0/311424752 learned_addr learned my addr 172.21.15.82:0/311424752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f2969a88640 1 --2- 172.21.15.82:0/311424752 >> v2:172.21.15.183:3300/0 conn(0x7f296406f350 0x7f296406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 -- 172.21.15.82:0/311424752 >> v2:172.21.15.183:3300/0 conn(0x7f296406f350 msgr2=0x7f296406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 --2- 172.21.15.82:0/311424752 >> v2:172.21.15.183:3300/0 conn(0x7f296406f350 0x7f296406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 -- 172.21.15.82:0/311424752 >> v1:172.21.15.82:6789/0 conn(0x7f296406b970 legacy=0x7f29640b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.402+0000 7f296a289640 1 -- 172.21.15.82:0/311424752 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640ceb70 con 0x7f29640b2640 2023-07-20T10:06:10.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296a289640 1 --2- 172.21.15.82:0/311424752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640b2640 0x7f296415c120 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f296408a560 tx=0x7f295c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5103665f285f8e28 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f2968a86640 1 -- 172.21.15.82:0/311424752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0a56e0 con 0x7f29640b2640 2023-07-20T10:06:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f2968a86640 1 -- 172.21.15.82:0/311424752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0a5840 con 0x7f29640b2640 2023-07-20T10:06:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f2968a86640 1 -- 172.21.15.82:0/311424752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0a5bd0 con 0x7f29640b2640 2023-07-20T10:06:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 -- 172.21.15.82:0/311424752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640b2640 msgr2=0x7f296415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 --2- 172.21.15.82:0/311424752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640b2640 0x7f296415c120 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f296408a560 tx=0x7f295c01c910 comp rx=0 tx=0).stop 2023-07-20T10:06:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 -- 172.21.15.82:0/311424752 shutdown_connections 2023-07-20T10:06:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 --2- 172.21.15.82:0/311424752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29640b2640 0x7f296415c120 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 --2- 172.21.15.82:0/311424752 >> v2:172.21.15.183:3300/0 conn(0x7f296406f350 0x7f296406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 -- 172.21.15.82:0/311424752 >> 172.21.15.82:0/311424752 conn(0x7f2964089fa0 msgr2=0x7f29640d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 -- 172.21.15.82:0/311424752 shutdown_connections 2023-07-20T10:06:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.406+0000 7f296bcec640 1 -- 172.21.15.82:0/311424752 wait complete. 2023-07-20T10:06:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 Processor -- start 2023-07-20T10:06:10.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- start start 2023-07-20T10:06:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 0x7f296414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29640b2640 0x7f29640cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29640ca440 con 0x7f296406b970 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641552c0 con 0x7f29640b2640 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29640c9170 con 0x7f296406f350 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48860/0 (socket says 172.21.15.82:48860) 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 -- 172.21.15.82:0/2735938022 learned_addr learned my addr 172.21.15.82:0/2735938022 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296a289640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29640b2640 0x7f29640cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969287640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 0x7f296414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 -- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 msgr2=0x7f296414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 0x7f296414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 -- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29640b2640 msgr2=0x7f29640cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29640b2640 0x7f29640cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 -- 172.21.15.82:0/2735938022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009b30 con 0x7f296406b970 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969287640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 0x7f296414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:10.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f2969a88640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f296000d830 tx=0x7f296000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000b6c0 con 0x7f296406b970 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000b820 con 0x7f296406b970 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000bb90 con 0x7f296406b970 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29640c9450 con 0x7f296406b970 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296415c3a0 con 0x7f296406b970 2023-07-20T10:06:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.410+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2964073c70 con 0x7f296406b970 2023-07-20T10:06:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.414+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f296001e460 con 0x7f296406b970 2023-07-20T10:06:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.414+0000 7f295a7fc640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 0x7f2948068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.414+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2960084600 con 0x7f296406b970 2023-07-20T10:06:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.414+0000 7f2969287640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 0x7f2948068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.414+0000 7f2969287640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 0x7f2948068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29640caae0 tx=0x7f2954009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.418+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2960051950 con 0x7f296406b970 2023-07-20T10:06:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.558+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f296406f730 con 0x7f29480663d0 2023-07-20T10:06:10.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.566+0000 7f295a7fc640 1 -- 172.21.15.82:0/2735938022 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311515 (secure 0 0 0) 0x7f29540013f0 con 0x7f29480663d0 2023-07-20T10:06:10.551 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:10.552 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:10.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 msgr2=0x7f2948068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 0x7f2948068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f29640caae0 tx=0x7f2954009040 comp rx=0 tx=0).stop 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 msgr2=0x7f29640c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f296000d830 tx=0x7f296000dcf0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 shutdown_connections 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f29480663d0 0x7f2948068890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29640b2640 0x7f29640cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f296406f350 0x7f296414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 --2- 172.21.15.82:0/2735938022 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f296406b970 0x7f29640c9e60 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 >> 172.21.15.82:0/2735938022 conn(0x7f2964089fa0 msgr2=0x7f2964154970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 shutdown_connections 2023-07-20T10:06:10.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:10.570+0000 7f296bcec640 1 -- 172.21.15.82:0/2735938022 wait complete. 2023-07-20T10:06:10.572 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:06:09.726160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":303,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311616,"kb_used_data":10184,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754663104,"statfs":{"total":773094113280,"available":772775018496,"internally_reserved":0,"allocated":10428416,"data_stored":5756140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001353"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565323+0000","last_change":"2023-07-20T10:06:05.050840+0000","last_active":"2023-07-20T10:06:06.565323+0000","last_peered":"2023-07-20T10:06:06.565323+0000","last_clean":"2023-07-20T10:06:06.565323+0000","last_became_active":"2023-07-20T10:06:05.050552+0000","last_became_peered":"2023-07-20T10:06:05.050552+0000","last_unstale":"2023-07-20T10:06:06.565323+0000","last_undegraded":"2023-07-20T10:06:06.565323+0000","last_fullsized":"2023-07-20T10:06:06.565323+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:45.478167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561250+0000","last_change":"2023-07-20T10:06:05.038869+0000","last_active":"2023-07-20T10:06:06.561250+0000","last_peered":"2023-07-20T10:06:06.561250+0000","last_clean":"2023-07-20T10:06:06.561250+0000","last_became_active":"2023-07-20T10:06:05.038535+0000","last_became_peered":"2023-07-20T10:06:05.038535+0000","last_unstale":"2023-07-20T10:06:06.561250+0000","last_undegraded":"2023-07-20T10:06:06.561250+0000","last_fullsized":"2023-07-20T10:06:06.561250+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:09.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016747+0000","last_change":"2023-07-20T10:06:05.042401+0000","last_active":"2023-07-20T10:06:06.016747+0000","last_peered":"2023-07-20T10:06:06.016747+0000","last_clean":"2023-07-20T10:06:06.016747+0000","last_became_active":"2023-07-20T10:06:05.042096+0000","last_became_peered":"2023-07-20T10:06:05.042096+0000","last_unstale":"2023-07-20T10:06:06.016747+0000","last_undegraded":"2023-07-20T10:06:06.016747+0000","last_fullsized":"2023-07-20T10:06:06.016747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:32.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019337+0000","last_change":"2023-07-20T10:06:05.028079+0000","last_active":"2023-07-20T10:06:06.019337+0000","last_peered":"2023-07-20T10:06:06.019337+0000","last_clean":"2023-07-20T10:06:06.019337+0000","last_became_active":"2023-07-20T10:06:05.027783+0000","last_became_peered":"2023-07-20T10:06:05.027783+0000","last_unstale":"2023-07-20T10:06:06.019337+0000","last_undegraded":"2023-07-20T10:06:06.019337+0000","last_fullsized":"2023-07-20T10:06:06.019337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:03.379893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014415+0000","last_change":"2023-07-20T10:06:05.039614+0000","last_active":"2023-07-20T10:06:06.014415+0000","last_peered":"2023-07-20T10:06:06.014415+0000","last_clean":"2023-07-20T10:06:06.014415+0000","last_became_active":"2023-07-20T10:06:05.039138+0000","last_became_peered":"2023-07-20T10:06:05.039138+0000","last_unstale":"2023-07-20T10:06:06.014415+0000","last_undegraded":"2023-07-20T10:06:06.014415+0000","last_fullsized":"2023-07-20T10:06:06.014415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:27.693800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561567+0000","last_change":"2023-07-20T10:06:05.029835+0000","last_active":"2023-07-20T10:06:06.561567+0000","last_peered":"2023-07-20T10:06:06.561567+0000","last_clean":"2023-07-20T10:06:06.561567+0000","last_became_active":"2023-07-20T10:06:05.029580+0000","last_became_peered":"2023-07-20T10:06:05.029580+0000","last_unstale":"2023-07-20T10:06:06.561567+0000","last_undegraded":"2023-07-20T10:06:06.561567+0000","last_fullsized":"2023-07-20T10:06:06.561567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:05.546020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565139+0000","last_change":"2023-07-20T10:06:05.039362+0000","last_active":"2023-07-20T10:06:06.565139+0000","last_peered":"2023-07-20T10:06:06.565139+0000","last_clean":"2023-07-20T10:06:06.565139+0000","last_became_active":"2023-07-20T10:06:05.038969+0000","last_became_peered":"2023-07-20T10:06:05.038969+0000","last_unstale":"2023-07-20T10:06:06.565139+0000","last_undegraded":"2023-07-20T10:06:06.565139+0000","last_fullsized":"2023-07-20T10:06:06.565139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:39.486906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014017+0000","last_change":"2023-07-20T10:06:05.037765+0000","last_active":"2023-07-20T10:06:06.014017+0000","last_peered":"2023-07-20T10:06:06.014017+0000","last_clean":"2023-07-20T10:06:06.014017+0000","last_became_active":"2023-07-20T10:06:05.037471+0000","last_became_peered":"2023-07-20T10:06:05.037471+0000","last_unstale":"2023-07-20T10:06:06.014017+0000","last_undegraded":"2023-07-20T10:06:06.014017+0000","last_fullsized":"2023-07-20T10:06:06.014017+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:49.522374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408278+0000","last_change":"2023-07-20T10:06:05.028251+0000","last_active":"2023-07-20T10:06:06.408278+0000","last_peered":"2023-07-20T10:06:06.408278+0000","last_clean":"2023-07-20T10:06:06.408278+0000","last_became_active":"2023-07-20T10:06:05.027934+0000","last_became_peered":"2023-07-20T10:06:05.027934+0000","last_unstale":"2023-07-20T10:06:06.408278+0000","last_undegraded":"2023-07-20T10:06:06.408278+0000","last_fullsized":"2023-07-20T10:06:06.408278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019469+0000","last_change":"2023-07-20T10:06:05.046590+0000","last_active":"2023-07-20T10:06:06.019469+0000","last_peered":"2023-07-20T10:06:06.019469+0000","last_clean":"2023-07-20T10:06:06.019469+0000","last_became_active":"2023-07-20T10:06:05.045939+0000","last_became_peered":"2023-07-20T10:06:05.045939+0000","last_unstale":"2023-07-20T10:06:06.019469+0000","last_undegraded":"2023-07-20T10:06:06.019469+0000","last_fullsized":"2023-07-20T10:06:06.019469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:13.160757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561204+0000","last_change":"2023-07-20T10:06:05.039079+0000","last_active":"2023-07-20T10:06:06.561204+0000","last_peered":"2023-07-20T10:06:06.561204+0000","last_clean":"2023-07-20T10:06:06.561204+0000","last_became_active":"2023-07-20T10:06:05.038601+0000","last_became_peered":"2023-07-20T10:06:05.038601+0000","last_unstale":"2023-07-20T10:06:06.561204+0000","last_undegraded":"2023-07-20T10:06:06.561204+0000","last_fullsized":"2023-07-20T10:06:06.561204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:55:02.770042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019245+0000","last_change":"2023-07-20T10:06:05.047873+0000","last_active":"2023-07-20T10:06:06.019245+0000","last_peered":"2023-07-20T10:06:06.019245+0000","last_clean":"2023-07-20T10:06:06.019245+0000","last_became_active":"2023-07-20T10:06:05.047385+0000","last_became_peered":"2023-07-20T10:06:05.047385+0000","last_unstale":"2023-07-20T10:06:06.019245+0000","last_undegraded":"2023-07-20T10:06:06.019245+0000","last_fullsized":"2023-07-20T10:06:06.019245+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:26.161706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014282+0000","last_change":"2023-07-20T10:06:05.027326+0000","last_active":"2023-07-20T10:06:06.014282+0000","last_peered":"2023-07-20T10:06:06.014282+0000","last_clean":"2023-07-20T10:06:06.014282+0000","last_became_active":"2023-07-20T10:06:05.027030+0000","last_became_peered":"2023-07-20T10:06:05.027030+0000","last_unstale":"2023-07-20T10:06:06.014282+0000","last_undegraded":"2023-07-20T10:06:06.014282+0000","last_fullsized":"2023-07-20T10:06:06.014282+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:53.794465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561636+0000","last_change":"2023-07-20T10:06:05.029697+0000","last_active":"2023-07-20T10:06:06.561636+0000","last_peered":"2023-07-20T10:06:06.561636+0000","last_clean":"2023-07-20T10:06:06.561636+0000","last_became_active":"2023-07-20T10:06:05.029158+0000","last_became_peered":"2023-07-20T10:06:05.029158+0000","last_unstale":"2023-07-20T10:06:06.561636+0000","last_undegraded":"2023-07-20T10:06:06.561636+0000","last_fullsized":"2023-07-20T10:06:06.561636+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:38.559958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560699+0000","last_change":"2023-07-20T10:06:05.046303+0000","last_active":"2023-07-20T10:06:06.560699+0000","last_peered":"2023-07-20T10:06:06.560699+0000","last_clean":"2023-07-20T10:06:06.560699+0000","last_became_active":"2023-07-20T10:06:05.046007+0000","last_became_peered":"2023-07-20T10:06:05.046007+0000","last_unstale":"2023-07-20T10:06:06.560699+0000","last_undegraded":"2023-07-20T10:06:06.560699+0000","last_fullsized":"2023-07-20T10:06:06.560699+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:37:07.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564446+0000","last_change":"2023-07-20T10:06:05.038830+0000","last_active":"2023-07-20T10:06:06.564446+0000","last_peered":"2023-07-20T10:06:06.564446+0000","last_clean":"2023-07-20T10:06:06.564446+0000","last_became_active":"2023-07-20T10:06:05.038483+0000","last_became_peered":"2023-07-20T10:06:05.038483+0000","last_unstale":"2023-07-20T10:06:06.564446+0000","last_undegraded":"2023-07-20T10:06:06.564446+0000","last_fullsized":"2023-07-20T10:06:06.564446+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:25.755337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014529+0000","last_change":"2023-07-20T10:06:05.040785+0000","last_active":"2023-07-20T10:06:06.014529+0000","last_peered":"2023-07-20T10:06:06.014529+0000","last_clean":"2023-07-20T10:06:06.014529+0000","last_became_active":"2023-07-20T10:06:05.040316+0000","last_became_peered":"2023-07-20T10:06:05.040316+0000","last_unstale":"2023-07-20T10:06:06.014529+0000","last_undegraded":"2023-07-20T10:06:06.014529+0000","last_fullsized":"2023-07-20T10:06:06.014529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:31:36.103791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016779+0000","last_change":"2023-07-20T10:06:05.049684+0000","last_active":"2023-07-20T10:06:06.016779+0000","last_peered":"2023-07-20T10:06:06.016779+0000","last_clean":"2023-07-20T10:06:06.016779+0000","last_became_active":"2023-07-20T10:06:05.049414+0000","last_became_peered":"2023-07-20T10:06:05.049414+0000","last_unstale":"2023-07-20T10:06:06.016779+0000","last_undegraded":"2023-07-20T10:06:06.016779+0000","last_fullsized":"2023-07-20T10:06:06.016779+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:07.407187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561515+0000","last_change":"2023-07-20T10:06:05.036606+0000","last_active":"2023-07-20T10:06:06.561515+0000","last_peered":"2023-07-20T10:06:06.561515+0000","last_clean":"2023-07-20T10:06:06.561515+0000","last_became_active":"2023-07-20T10:06:05.036300+0000","last_became_peered":"2023-07-20T10:06:05.036300+0000","last_unstale":"2023-07-20T10:06:06.561515+0000","last_undegraded":"2023-07-20T10:06:06.561515+0000","last_fullsized":"2023-07-20T10:06:06.561515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:42:14.274988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014561+0000","last_change":"2023-07-20T10:06:05.044137+0000","last_active":"2023-07-20T10:06:06.014561+0000","last_peered":"2023-07-20T10:06:06.014561+0000","last_clean":"2023-07-20T10:06:06.014561+0000","last_became_active":"2023-07-20T10:06:05.043875+0000","last_became_peered":"2023-07-20T10:06:05.043875+0000","last_unstale":"2023-07-20T10:06:06.014561+0000","last_undegraded":"2023-07-20T10:06:06.014561+0000","last_fullsized":"2023-07-20T10:06:06.014561+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:06:07.214972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407977+0000","last_change":"2023-07-20T10:06:05.048839+0000","last_active":"2023-07-20T10:06:06.407977+0000","last_peered":"2023-07-20T10:06:06.407977+0000","last_clean":"2023-07-20T10:06:06.407977+0000","last_became_active":"2023-07-20T10:06:05.048555+0000","last_became_peered":"2023-07-20T10:06:05.048555+0000","last_unstale":"2023-07-20T10:06:06.407977+0000","last_undegraded":"2023-07-20T10:06:06.407977+0000","last_fullsized":"2023-07-20T10:06:06.407977+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:20.208645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014160+0000","last_change":"2023-07-20T10:06:05.025025+0000","last_active":"2023-07-20T10:06:06.014160+0000","last_peered":"2023-07-20T10:06:06.014160+0000","last_clean":"2023-07-20T10:06:06.014160+0000","last_became_active":"2023-07-20T10:06:05.024737+0000","last_became_peered":"2023-07-20T10:06:05.024737+0000","last_unstale":"2023-07-20T10:06:06.014160+0000","last_undegraded":"2023-07-20T10:06:06.014160+0000","last_fullsized":"2023-07-20T10:06:06.014160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:46:42.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407710+0000","last_change":"2023-07-20T10:06:05.027158+0000","last_active":"2023-07-20T10:06:06.407710+0000","last_peered":"2023-07-20T10:06:06.407710+0000","last_clean":"2023-07-20T10:06:06.407710+0000","last_became_active":"2023-07-20T10:06:05.026861+0000","last_became_peered":"2023-07-20T10:06:05.026861+0000","last_unstale":"2023-07-20T10:06:06.407710+0000","last_undegraded":"2023-07-20T10:06:06.407710+0000","last_fullsized":"2023-07-20T10:06:06.407710+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:33.231957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560864+0000","last_change":"2023-07-20T10:06:05.041105+0000","last_active":"2023-07-20T10:06:06.560864+0000","last_peered":"2023-07-20T10:06:06.560864+0000","last_clean":"2023-07-20T10:06:06.560864+0000","last_became_active":"2023-07-20T10:06:05.040798+0000","last_became_peered":"2023-07-20T10:06:05.040798+0000","last_unstale":"2023-07-20T10:06:06.560864+0000","last_undegraded":"2023-07-20T10:06:06.560864+0000","last_fullsized":"2023-07-20T10:06:06.560864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:56.628592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561189+0000","last_change":"2023-07-20T10:06:05.046810+0000","last_active":"2023-07-20T10:06:06.561189+0000","last_peered":"2023-07-20T10:06:06.561189+0000","last_clean":"2023-07-20T10:06:06.561189+0000","last_became_active":"2023-07-20T10:06:05.046504+0000","last_became_peered":"2023-07-20T10:06:05.046504+0000","last_unstale":"2023-07-20T10:06:06.561189+0000","last_undegraded":"2023-07-20T10:06:06.561189+0000","last_fullsized":"2023-07-20T10:06:06.561189+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:29:22.138993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019498+0000","last_change":"2023-07-20T10:06:05.046795+0000","last_active":"2023-07-20T10:06:06.019498+0000","last_peered":"2023-07-20T10:06:06.019498+0000","last_clean":"2023-07-20T10:06:06.019498+0000","last_became_active":"2023-07-20T10:06:05.046436+0000","last_became_peered":"2023-07-20T10:06:05.046436+0000","last_unstale":"2023-07-20T10:06:06.019498+0000","last_undegraded":"2023-07-20T10:06:06.019498+0000","last_fullsized":"2023-07-20T10:06:06.019498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:15:26.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564951+0000","last_change":"2023-07-20T10:06:05.038974+0000","last_active":"2023-07-20T10:06:06.564951+0000","last_peered":"2023-07-20T10:06:06.564951+0000","last_clean":"2023-07-20T10:06:06.564951+0000","last_became_active":"2023-07-20T10:06:05.038669+0000","last_became_peered":"2023-07-20T10:06:05.038669+0000","last_unstale":"2023-07-20T10:06:06.564951+0000","last_undegraded":"2023-07-20T10:06:06.564951+0000","last_fullsized":"2023-07-20T10:06:06.564951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:47:12.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014482+0000","last_change":"2023-07-20T10:06:05.025634+0000","last_active":"2023-07-20T10:06:06.014482+0000","last_peered":"2023-07-20T10:06:06.014482+0000","last_clean":"2023-07-20T10:06:06.014482+0000","last_became_active":"2023-07-20T10:06:05.025360+0000","last_became_peered":"2023-07-20T10:06:05.025360+0000","last_unstale":"2023-07-20T10:06:06.014482+0000","last_undegraded":"2023-07-20T10:06:06.014482+0000","last_fullsized":"2023-07-20T10:06:06.014482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:06.831949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560984+0000","last_change":"2023-07-20T10:06:05.043579+0000","last_active":"2023-07-20T10:06:06.560984+0000","last_peered":"2023-07-20T10:06:06.560984+0000","last_clean":"2023-07-20T10:06:06.560984+0000","last_became_active":"2023-07-20T10:06:05.043284+0000","last_became_peered":"2023-07-20T10:06:05.043284+0000","last_unstale":"2023-07-20T10:06:06.560984+0000","last_undegraded":"2023-07-20T10:06:06.560984+0000","last_fullsized":"2023-07-20T10:06:06.560984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:18.654488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564547+0000","last_change":"2023-07-20T10:06:05.048784+0000","last_active":"2023-07-20T10:06:06.564547+0000","last_peered":"2023-07-20T10:06:06.564547+0000","last_clean":"2023-07-20T10:06:06.564547+0000","last_became_active":"2023-07-20T10:06:05.048470+0000","last_became_peered":"2023-07-20T10:06:05.048470+0000","last_unstale":"2023-07-20T10:06:06.564547+0000","last_undegraded":"2023-07-20T10:06:06.564547+0000","last_fullsized":"2023-07-20T10:06:06.564547+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:08.110549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016330+0000","last_change":"2023-07-20T10:06:05.041872+0000","last_active":"2023-07-20T10:06:06.016330+0000","last_peered":"2023-07-20T10:06:06.016330+0000","last_clean":"2023-07-20T10:06:06.016330+0000","last_became_active":"2023-07-20T10:06:05.041469+0000","last_became_peered":"2023-07-20T10:06:05.041469+0000","last_unstale":"2023-07-20T10:06:06.016330+0000","last_undegraded":"2023-07-20T10:06:06.016330+0000","last_fullsized":"2023-07-20T10:06:06.016330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:38:23.869762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564602+0000","last_change":"2023-07-20T10:06:05.050905+0000","last_active":"2023-07-20T10:06:06.564602+0000","last_peered":"2023-07-20T10:06:06.564602+0000","last_clean":"2023-07-20T10:06:06.564602+0000","last_became_active":"2023-07-20T10:06:05.050614+0000","last_became_peered":"2023-07-20T10:06:05.050614+0000","last_unstale":"2023-07-20T10:06:06.564602+0000","last_undegraded":"2023-07-20T10:06:06.564602+0000","last_fullsized":"2023-07-20T10:06:06.564602+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:16.267204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016242+0000","last_change":"2023-07-20T10:06:05.049444+0000","last_active":"2023-07-20T10:06:06.016242+0000","last_peered":"2023-07-20T10:06:06.016242+0000","last_clean":"2023-07-20T10:06:06.016242+0000","last_became_active":"2023-07-20T10:06:05.049152+0000","last_became_peered":"2023-07-20T10:06:05.049152+0000","last_unstale":"2023-07-20T10:06:06.016242+0000","last_undegraded":"2023-07-20T10:06:06.016242+0000","last_fullsized":"2023-07-20T10:06:06.016242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:59:13.124492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014616+0000","last_change":"2023-07-20T10:06:04.029257+0000","last_active":"2023-07-20T10:06:06.014616+0000","last_peered":"2023-07-20T10:06:06.014616+0000","last_clean":"2023-07-20T10:06:06.014616+0000","last_became_active":"2023-07-20T10:06:04.028782+0000","last_became_peered":"2023-07-20T10:06:04.028782+0000","last_unstale":"2023-07-20T10:06:06.014616+0000","last_undegraded":"2023-07-20T10:06:06.014616+0000","last_fullsized":"2023-07-20T10:06:06.014616+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:58.085410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561439+0000","last_change":"2023-07-20T10:06:05.040671+0000","last_active":"2023-07-20T10:06:06.561439+0000","last_peered":"2023-07-20T10:06:06.561439+0000","last_clean":"2023-07-20T10:06:06.561439+0000","last_became_active":"2023-07-20T10:06:05.040267+0000","last_became_peered":"2023-07-20T10:06:05.040267+0000","last_unstale":"2023-07-20T10:06:06.561439+0000","last_undegraded":"2023-07-20T10:06:06.561439+0000","last_fullsized":"2023-07-20T10:06:06.561439+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:30.076876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564919+0000","last_change":"2023-07-20T10:06:04.029372+0000","last_active":"2023-07-20T10:06:06.564919+0000","last_peered":"2023-07-20T10:06:06.564919+0000","last_clean":"2023-07-20T10:06:06.564919+0000","last_became_active":"2023-07-20T10:06:04.029056+0000","last_became_peered":"2023-07-20T10:06:04.029056+0000","last_unstale":"2023-07-20T10:06:06.564919+0000","last_undegraded":"2023-07-20T10:06:06.564919+0000","last_fullsized":"2023-07-20T10:06:06.564919+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:57.170782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407909+0000","last_change":"2023-07-20T10:06:05.029656+0000","last_active":"2023-07-20T10:06:06.407909+0000","last_peered":"2023-07-20T10:06:06.407909+0000","last_clean":"2023-07-20T10:06:06.407909+0000","last_became_active":"2023-07-20T10:06:05.029021+0000","last_became_peered":"2023-07-20T10:06:05.029021+0000","last_unstale":"2023-07-20T10:06:06.407909+0000","last_undegraded":"2023-07-20T10:06:06.407909+0000","last_fullsized":"2023-07-20T10:06:06.407909+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:10.892922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565056+0000","last_change":"2023-07-20T10:06:04.027229+0000","last_active":"2023-07-20T10:06:06.565056+0000","last_peered":"2023-07-20T10:06:06.565056+0000","last_clean":"2023-07-20T10:06:06.565056+0000","last_became_active":"2023-07-20T10:06:04.026857+0000","last_became_peered":"2023-07-20T10:06:04.026857+0000","last_unstale":"2023-07-20T10:06:06.565056+0000","last_undegraded":"2023-07-20T10:06:06.565056+0000","last_fullsized":"2023-07-20T10:06:06.565056+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:54.035369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408013+0000","last_change":"2023-07-20T10:06:05.052785+0000","last_active":"2023-07-20T10:06:06.408013+0000","last_peered":"2023-07-20T10:06:06.408013+0000","last_clean":"2023-07-20T10:06:06.408013+0000","last_became_active":"2023-07-20T10:06:05.052453+0000","last_became_peered":"2023-07-20T10:06:05.052453+0000","last_unstale":"2023-07-20T10:06:06.408013+0000","last_undegraded":"2023-07-20T10:06:06.408013+0000","last_fullsized":"2023-07-20T10:06:06.408013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:06.596451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565457+0000","last_change":"2023-07-20T10:06:04.036046+0000","last_active":"2023-07-20T10:06:06.565457+0000","last_peered":"2023-07-20T10:06:06.565457+0000","last_clean":"2023-07-20T10:06:06.565457+0000","last_became_active":"2023-07-20T10:06:04.035744+0000","last_became_peered":"2023-07-20T10:06:04.035744+0000","last_unstale":"2023-07-20T10:06:06.565457+0000","last_undegraded":"2023-07-20T10:06:06.565457+0000","last_fullsized":"2023-07-20T10:06:06.565457+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:10:02.951770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560877+0000","last_change":"2023-07-20T10:06:05.039994+0000","last_active":"2023-07-20T10:06:06.560877+0000","last_peered":"2023-07-20T10:06:06.560877+0000","last_clean":"2023-07-20T10:06:06.560877+0000","last_became_active":"2023-07-20T10:06:05.039489+0000","last_became_peered":"2023-07-20T10:06:05.039489+0000","last_unstale":"2023-07-20T10:06:06.560877+0000","last_undegraded":"2023-07-20T10:06:06.560877+0000","last_fullsized":"2023-07-20T10:06:06.560877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:02.310933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408074+0000","last_change":"2023-07-20T10:06:04.022787+0000","last_active":"2023-07-20T10:06:06.408074+0000","last_peered":"2023-07-20T10:06:06.408074+0000","last_clean":"2023-07-20T10:06:06.408074+0000","last_became_active":"2023-07-20T10:06:04.022483+0000","last_became_peered":"2023-07-20T10:06:04.022483+0000","last_unstale":"2023-07-20T10:06:06.408074+0000","last_undegraded":"2023-07-20T10:06:06.408074+0000","last_fullsized":"2023-07-20T10:06:06.408074+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:36.191330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561333+0000","last_change":"2023-07-20T10:06:05.038913+0000","last_active":"2023-07-20T10:06:06.561333+0000","last_peered":"2023-07-20T10:06:06.561333+0000","last_clean":"2023-07-20T10:06:06.561333+0000","last_became_active":"2023-07-20T10:06:05.038296+0000","last_became_peered":"2023-07-20T10:06:05.038296+0000","last_unstale":"2023-07-20T10:06:06.561333+0000","last_undegraded":"2023-07-20T10:06:06.561333+0000","last_fullsized":"2023-07-20T10:06:06.561333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:49.142935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018895+0000","last_change":"2023-07-20T10:06:04.034968+0000","last_active":"2023-07-20T10:06:06.018895+0000","last_peered":"2023-07-20T10:06:06.018895+0000","last_clean":"2023-07-20T10:06:06.018895+0000","last_became_active":"2023-07-20T10:06:04.034639+0000","last_became_peered":"2023-07-20T10:06:04.034639+0000","last_unstale":"2023-07-20T10:06:06.018895+0000","last_undegraded":"2023-07-20T10:06:06.018895+0000","last_fullsized":"2023-07-20T10:06:06.018895+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:36:43.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408216+0000","last_change":"2023-07-20T10:06:05.030536+0000","last_active":"2023-07-20T10:06:06.408216+0000","last_peered":"2023-07-20T10:06:06.408216+0000","last_clean":"2023-07-20T10:06:06.408216+0000","last_became_active":"2023-07-20T10:06:05.030242+0000","last_became_peered":"2023-07-20T10:06:05.030242+0000","last_unstale":"2023-07-20T10:06:06.408216+0000","last_undegraded":"2023-07-20T10:06:06.408216+0000","last_fullsized":"2023-07-20T10:06:06.408216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:34:28.934384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560986+0000","last_change":"2023-07-20T10:06:04.025599+0000","last_active":"2023-07-20T10:06:06.560986+0000","last_peered":"2023-07-20T10:06:06.560986+0000","last_clean":"2023-07-20T10:06:06.560986+0000","last_became_active":"2023-07-20T10:06:04.025282+0000","last_became_peered":"2023-07-20T10:06:04.025282+0000","last_unstale":"2023-07-20T10:06:06.560986+0000","last_undegraded":"2023-07-20T10:06:06.560986+0000","last_fullsized":"2023-07-20T10:06:06.560986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:12.400147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565884+0000","last_change":"2023-07-20T10:06:05.039334+0000","last_active":"2023-07-20T10:06:06.565884+0000","last_peered":"2023-07-20T10:06:06.565884+0000","last_clean":"2023-07-20T10:06:06.565884+0000","last_became_active":"2023-07-20T10:06:05.038983+0000","last_became_peered":"2023-07-20T10:06:05.038983+0000","last_unstale":"2023-07-20T10:06:06.565884+0000","last_undegraded":"2023-07-20T10:06:06.565884+0000","last_fullsized":"2023-07-20T10:06:06.565884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:44:50.829929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014071+0000","last_change":"2023-07-20T10:06:04.028955+0000","last_active":"2023-07-20T10:06:06.014071+0000","last_peered":"2023-07-20T10:06:06.014071+0000","last_clean":"2023-07-20T10:06:06.014071+0000","last_became_active":"2023-07-20T10:06:04.028617+0000","last_became_peered":"2023-07-20T10:06:04.028617+0000","last_unstale":"2023-07-20T10:06:06.014071+0000","last_undegraded":"2023-07-20T10:06:06.014071+0000","last_fullsized":"2023-07-20T10:06:06.014071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:30.679152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560711+0000","last_change":"2023-07-20T10:06:05.041064+0000","last_active":"2023-07-20T10:06:06.560711+0000","last_peered":"2023-07-20T10:06:06.560711+0000","last_clean":"2023-07-20T10:06:06.560711+0000","last_became_active":"2023-07-20T10:06:05.040487+0000","last_became_peered":"2023-07-20T10:06:05.040487+0000","last_unstale":"2023-07-20T10:06:06.560711+0000","last_undegraded":"2023-07-20T10:06:06.560711+0000","last_fullsized":"2023-07-20T10:06:06.560711+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:55.277877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564999+0000","last_change":"2023-07-20T10:06:04.036680+0000","last_active":"2023-07-20T10:06:06.564999+0000","last_peered":"2023-07-20T10:06:06.564999+0000","last_clean":"2023-07-20T10:06:06.564999+0000","last_became_active":"2023-07-20T10:06:04.036407+0000","last_became_peered":"2023-07-20T10:06:04.036407+0000","last_unstale":"2023-07-20T10:06:06.564999+0000","last_undegraded":"2023-07-20T10:06:06.564999+0000","last_fullsized":"2023-07-20T10:06:06.564999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:39:53.048154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018930+0000","last_change":"2023-07-20T10:06:05.028186+0000","last_active":"2023-07-20T10:06:06.018930+0000","last_peered":"2023-07-20T10:06:06.018930+0000","last_clean":"2023-07-20T10:06:06.018930+0000","last_became_active":"2023-07-20T10:06:05.027688+0000","last_became_peered":"2023-07-20T10:06:05.027688+0000","last_unstale":"2023-07-20T10:06:06.018930+0000","last_undegraded":"2023-07-20T10:06:06.018930+0000","last_fullsized":"2023-07-20T10:06:06.018930+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:53.221466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019563+0000","last_change":"2023-07-20T10:06:04.028333+0000","last_active":"2023-07-20T10:06:06.019563+0000","last_peered":"2023-07-20T10:06:06.019563+0000","last_clean":"2023-07-20T10:06:06.019563+0000","last_became_active":"2023-07-20T10:06:04.028042+0000","last_became_peered":"2023-07-20T10:06:04.028042+0000","last_unstale":"2023-07-20T10:06:06.019563+0000","last_undegraded":"2023-07-20T10:06:06.019563+0000","last_fullsized":"2023-07-20T10:06:06.019563+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:48:51.744974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561723+0000","last_change":"2023-07-20T10:06:05.043803+0000","last_active":"2023-07-20T10:06:06.561723+0000","last_peered":"2023-07-20T10:06:06.561723+0000","last_clean":"2023-07-20T10:06:06.561723+0000","last_became_active":"2023-07-20T10:06:05.043533+0000","last_became_peered":"2023-07-20T10:06:05.043533+0000","last_unstale":"2023-07-20T10:06:06.561723+0000","last_undegraded":"2023-07-20T10:06:06.561723+0000","last_fullsized":"2023-07-20T10:06:06.561723+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:16.590671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014651+0000","last_change":"2023-07-20T10:06:04.029830+0000","last_active":"2023-07-20T10:06:06.014651+0000","last_peered":"2023-07-20T10:06:06.014651+0000","last_clean":"2023-07-20T10:06:06.014651+0000","last_became_active":"2023-07-20T10:06:04.029557+0000","last_became_peered":"2023-07-20T10:06:04.029557+0000","last_unstale":"2023-07-20T10:06:06.014651+0000","last_undegraded":"2023-07-20T10:06:06.014651+0000","last_fullsized":"2023-07-20T10:06:06.014651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:01:44.311713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016379+0000","last_change":"2023-07-20T10:06:05.044465+0000","last_active":"2023-07-20T10:06:06.016379+0000","last_peered":"2023-07-20T10:06:06.016379+0000","last_clean":"2023-07-20T10:06:06.016379+0000","last_became_active":"2023-07-20T10:06:05.044082+0000","last_became_peered":"2023-07-20T10:06:05.044082+0000","last_unstale":"2023-07-20T10:06:06.016379+0000","last_undegraded":"2023-07-20T10:06:06.016379+0000","last_fullsized":"2023-07-20T10:06:06.016379+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:34.804032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'6","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565485+0000","last_change":"2023-07-20T10:06:04.029387+0000","last_active":"2023-07-20T10:06:06.565485+0000","last_peered":"2023-07-20T10:06:06.565485+0000","last_clean":"2023-07-20T10:06:06.565485+0000","last_became_active":"2023-07-20T10:06:04.029081+0000","last_became_peered":"2023-07-20T10:06:04.029081+0000","last_unstale":"2023-07-20T10:06:06.565485+0000","last_undegraded":"2023-07-20T10:06:06.565485+0000","last_fullsized":"2023-07-20T10:06:06.565485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:42.308825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019495+0000","last_change":"2023-07-20T10:06:05.029675+0000","last_active":"2023-07-20T10:06:06.019495+0000","last_peered":"2023-07-20T10:06:06.019495+0000","last_clean":"2023-07-20T10:06:06.019495+0000","last_became_active":"2023-07-20T10:06:05.029358+0000","last_became_peered":"2023-07-20T10:06:05.029358+0000","last_unstale":"2023-07-20T10:06:06.019495+0000","last_undegraded":"2023-07-20T10:06:06.019495+0000","last_fullsized":"2023-07-20T10:06:06.019495+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:07.116921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018904+0000","last_change":"2023-07-20T10:06:04.034283+0000","last_active":"2023-07-20T10:06:06.018904+0000","last_peered":"2023-07-20T10:06:06.018904+0000","last_clean":"2023-07-20T10:06:06.018904+0000","last_became_active":"2023-07-20T10:06:04.033976+0000","last_became_peered":"2023-07-20T10:06:04.033976+0000","last_unstale":"2023-07-20T10:06:06.018904+0000","last_undegraded":"2023-07-20T10:06:06.018904+0000","last_fullsized":"2023-07-20T10:06:06.018904+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:20.596671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565600+0000","last_change":"2023-07-20T10:06:05.047144+0000","last_active":"2023-07-20T10:06:06.565600+0000","last_peered":"2023-07-20T10:06:06.565600+0000","last_clean":"2023-07-20T10:06:06.565600+0000","last_became_active":"2023-07-20T10:06:05.046854+0000","last_became_peered":"2023-07-20T10:06:05.046854+0000","last_unstale":"2023-07-20T10:06:06.565600+0000","last_undegraded":"2023-07-20T10:06:06.565600+0000","last_fullsized":"2023-07-20T10:06:06.565600+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:59.931561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564666+0000","last_change":"2023-07-20T10:06:04.033232+0000","last_active":"2023-07-20T10:06:06.564666+0000","last_peered":"2023-07-20T10:06:06.564666+0000","last_clean":"2023-07-20T10:06:06.564666+0000","last_became_active":"2023-07-20T10:06:04.032917+0000","last_became_peered":"2023-07-20T10:06:04.032917+0000","last_unstale":"2023-07-20T10:06:06.564666+0000","last_undegraded":"2023-07-20T10:06:06.564666+0000","last_fullsized":"2023-07-20T10:06:06.564666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:10:42.954009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565630+0000","last_change":"2023-07-20T10:06:05.048583+0000","last_active":"2023-07-20T10:06:06.565630+0000","last_peered":"2023-07-20T10:06:06.565630+0000","last_clean":"2023-07-20T10:06:06.565630+0000","last_became_active":"2023-07-20T10:06:05.048299+0000","last_became_peered":"2023-07-20T10:06:05.048299+0000","last_unstale":"2023-07-20T10:06:06.565630+0000","last_undegraded":"2023-07-20T10:06:06.565630+0000","last_fullsized":"2023-07-20T10:06:06.565630+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:18:06.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014058+0000","last_change":"2023-07-20T10:06:04.028928+0000","last_active":"2023-07-20T10:06:06.014058+0000","last_peered":"2023-07-20T10:06:06.014058+0000","last_clean":"2023-07-20T10:06:06.014058+0000","last_became_active":"2023-07-20T10:06:04.028633+0000","last_became_peered":"2023-07-20T10:06:04.028633+0000","last_unstale":"2023-07-20T10:06:06.014058+0000","last_undegraded":"2023-07-20T10:06:06.014058+0000","last_fullsized":"2023-07-20T10:06:06.014058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:31:14.219542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565903+0000","last_change":"2023-07-20T10:06:05.050299+0000","last_active":"2023-07-20T10:06:06.565903+0000","last_peered":"2023-07-20T10:06:06.565903+0000","last_clean":"2023-07-20T10:06:06.565903+0000","last_became_active":"2023-07-20T10:06:05.050018+0000","last_became_peered":"2023-07-20T10:06:05.050018+0000","last_unstale":"2023-07-20T10:06:06.565903+0000","last_undegraded":"2023-07-20T10:06:06.565903+0000","last_fullsized":"2023-07-20T10:06:06.565903+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:43:41.380293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560815+0000","last_change":"2023-07-20T10:06:04.026332+0000","last_active":"2023-07-20T10:06:06.560815+0000","last_peered":"2023-07-20T10:06:06.560815+0000","last_clean":"2023-07-20T10:06:06.560815+0000","last_became_active":"2023-07-20T10:06:04.026047+0000","last_became_peered":"2023-07-20T10:06:04.026047+0000","last_unstale":"2023-07-20T10:06:06.560815+0000","last_undegraded":"2023-07-20T10:06:06.560815+0000","last_fullsized":"2023-07-20T10:06:06.560815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:04:13.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407980+0000","last_change":"2023-07-20T10:06:05.044485+0000","last_active":"2023-07-20T10:06:06.407980+0000","last_peered":"2023-07-20T10:06:06.407980+0000","last_clean":"2023-07-20T10:06:06.407980+0000","last_became_active":"2023-07-20T10:06:05.044206+0000","last_became_peered":"2023-07-20T10:06:05.044206+0000","last_unstale":"2023-07-20T10:06:06.407980+0000","last_undegraded":"2023-07-20T10:06:06.407980+0000","last_fullsized":"2023-07-20T10:06:06.407980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:08.144096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019257+0000","last_change":"2023-07-20T10:06:04.033740+0000","last_active":"2023-07-20T10:06:06.019257+0000","last_peered":"2023-07-20T10:06:06.019257+0000","last_clean":"2023-07-20T10:06:06.019257+0000","last_became_active":"2023-07-20T10:06:04.033441+0000","last_became_peered":"2023-07-20T10:06:04.033441+0000","last_unstale":"2023-07-20T10:06:06.019257+0000","last_undegraded":"2023-07-20T10:06:06.019257+0000","last_fullsized":"2023-07-20T10:06:06.019257+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:51.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565159+0000","last_change":"2023-07-20T10:06:05.049657+0000","last_active":"2023-07-20T10:06:06.565159+0000","last_peered":"2023-07-20T10:06:06.565159+0000","last_clean":"2023-07-20T10:06:06.565159+0000","last_became_active":"2023-07-20T10:06:05.049370+0000","last_became_peered":"2023-07-20T10:06:05.049370+0000","last_unstale":"2023-07-20T10:06:06.565159+0000","last_undegraded":"2023-07-20T10:06:06.565159+0000","last_fullsized":"2023-07-20T10:06:06.565159+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:22.311872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561456+0000","last_change":"2023-07-20T10:06:04.030423+0000","last_active":"2023-07-20T10:06:06.561456+0000","last_peered":"2023-07-20T10:06:06.561456+0000","last_clean":"2023-07-20T10:06:06.561456+0000","last_became_active":"2023-07-20T10:06:04.030140+0000","last_became_peered":"2023-07-20T10:06:04.030140+0000","last_unstale":"2023-07-20T10:06:06.561456+0000","last_undegraded":"2023-07-20T10:06:06.561456+0000","last_fullsized":"2023-07-20T10:06:06.561456+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:42.035494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407937+0000","last_change":"2023-07-20T10:06:05.029942+0000","last_active":"2023-07-20T10:06:06.407937+0000","last_peered":"2023-07-20T10:06:06.407937+0000","last_clean":"2023-07-20T10:06:06.407937+0000","last_became_active":"2023-07-20T10:06:05.029382+0000","last_became_peered":"2023-07-20T10:06:05.029382+0000","last_unstale":"2023-07-20T10:06:06.407937+0000","last_undegraded":"2023-07-20T10:06:06.407937+0000","last_fullsized":"2023-07-20T10:06:06.407937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:41:22.729844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565334+0000","last_change":"2023-07-20T10:06:04.031020+0000","last_active":"2023-07-20T10:06:06.565334+0000","last_peered":"2023-07-20T10:06:06.565334+0000","last_clean":"2023-07-20T10:06:06.565334+0000","last_became_active":"2023-07-20T10:06:04.030738+0000","last_became_peered":"2023-07-20T10:06:04.030738+0000","last_unstale":"2023-07-20T10:06:06.565334+0000","last_undegraded":"2023-07-20T10:06:06.565334+0000","last_fullsized":"2023-07-20T10:06:06.565334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:02.434817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561154+0000","last_change":"2023-07-20T10:06:05.041399+0000","last_active":"2023-07-20T10:06:06.561154+0000","last_peered":"2023-07-20T10:06:06.561154+0000","last_clean":"2023-07-20T10:06:06.561154+0000","last_became_active":"2023-07-20T10:06:05.041105+0000","last_became_peered":"2023-07-20T10:06:05.041105+0000","last_unstale":"2023-07-20T10:06:06.561154+0000","last_undegraded":"2023-07-20T10:06:06.561154+0000","last_fullsized":"2023-07-20T10:06:06.561154+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:55:53.266587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565363+0000","last_change":"2023-07-20T10:06:04.031439+0000","last_active":"2023-07-20T10:06:06.565363+0000","last_peered":"2023-07-20T10:06:06.565363+0000","last_clean":"2023-07-20T10:06:06.565363+0000","last_became_active":"2023-07-20T10:06:04.031137+0000","last_became_peered":"2023-07-20T10:06:04.031137+0000","last_unstale":"2023-07-20T10:06:06.565363+0000","last_undegraded":"2023-07-20T10:06:06.565363+0000","last_fullsized":"2023-07-20T10:06:06.565363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:01.084126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565051+0000","last_change":"2023-07-20T10:06:05.049777+0000","last_active":"2023-07-20T10:06:06.565051+0000","last_peered":"2023-07-20T10:06:06.565051+0000","last_clean":"2023-07-20T10:06:06.565051+0000","last_became_active":"2023-07-20T10:06:05.049495+0000","last_became_peered":"2023-07-20T10:06:05.049495+0000","last_unstale":"2023-07-20T10:06:06.565051+0000","last_undegraded":"2023-07-20T10:06:06.565051+0000","last_fullsized":"2023-07-20T10:06:06.565051+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565219+0000","last_change":"2023-07-20T10:06:04.035200+0000","last_active":"2023-07-20T10:06:06.565219+0000","last_peered":"2023-07-20T10:06:06.565219+0000","last_clean":"2023-07-20T10:06:06.565219+0000","last_became_active":"2023-07-20T10:06:04.034920+0000","last_became_peered":"2023-07-20T10:06:04.034920+0000","last_unstale":"2023-07-20T10:06:06.565219+0000","last_undegraded":"2023-07-20T10:06:06.565219+0000","last_fullsized":"2023-07-20T10:06:06.565219+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:21.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565666+0000","last_change":"2023-07-20T10:06:05.040875+0000","last_active":"2023-07-20T10:06:06.565666+0000","last_peered":"2023-07-20T10:06:06.565666+0000","last_clean":"2023-07-20T10:06:06.565666+0000","last_became_active":"2023-07-20T10:06:05.040586+0000","last_became_peered":"2023-07-20T10:06:05.040586+0000","last_unstale":"2023-07-20T10:06:06.565666+0000","last_undegraded":"2023-07-20T10:06:06.565666+0000","last_fullsized":"2023-07-20T10:06:06.565666+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:11.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014510+0000","last_change":"2023-07-20T10:06:04.031467+0000","last_active":"2023-07-20T10:06:06.014510+0000","last_peered":"2023-07-20T10:06:06.014510+0000","last_clean":"2023-07-20T10:06:06.014510+0000","last_became_active":"2023-07-20T10:06:04.031193+0000","last_became_peered":"2023-07-20T10:06:04.031193+0000","last_unstale":"2023-07-20T10:06:06.014510+0000","last_undegraded":"2023-07-20T10:06:06.014510+0000","last_fullsized":"2023-07-20T10:06:06.014510+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:12:58.644065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016808+0000","last_change":"2023-07-20T10:06:05.042402+0000","last_active":"2023-07-20T10:06:06.016808+0000","last_peered":"2023-07-20T10:06:06.016808+0000","last_clean":"2023-07-20T10:06:06.016808+0000","last_became_active":"2023-07-20T10:06:05.042153+0000","last_became_peered":"2023-07-20T10:06:05.042153+0000","last_unstale":"2023-07-20T10:06:06.016808+0000","last_undegraded":"2023-07-20T10:06:06.016808+0000","last_fullsized":"2023-07-20T10:06:06.016808+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:03:38.627202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565285+0000","last_change":"2023-07-20T10:06:04.036252+0000","last_active":"2023-07-20T10:06:06.565285+0000","last_peered":"2023-07-20T10:06:06.565285+0000","last_clean":"2023-07-20T10:06:06.565285+0000","last_became_active":"2023-07-20T10:06:04.035895+0000","last_became_peered":"2023-07-20T10:06:04.035895+0000","last_unstale":"2023-07-20T10:06:06.565285+0000","last_undegraded":"2023-07-20T10:06:06.565285+0000","last_fullsized":"2023-07-20T10:06:06.565285+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:32.240970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016866+0000","last_change":"2023-07-20T10:06:05.041915+0000","last_active":"2023-07-20T10:06:06.016866+0000","last_peered":"2023-07-20T10:06:06.016866+0000","last_clean":"2023-07-20T10:06:06.016866+0000","last_became_active":"2023-07-20T10:06:05.041588+0000","last_became_peered":"2023-07-20T10:06:05.041588+0000","last_unstale":"2023-07-20T10:06:06.016866+0000","last_undegraded":"2023-07-20T10:06:06.016866+0000","last_fullsized":"2023-07-20T10:06:06.016866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:06:12.111341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016194+0000","last_change":"2023-07-20T10:06:04.030099+0000","last_active":"2023-07-20T10:06:06.016194+0000","last_peered":"2023-07-20T10:06:06.016194+0000","last_clean":"2023-07-20T10:06:06.016194+0000","last_became_active":"2023-07-20T10:06:04.029635+0000","last_became_peered":"2023-07-20T10:06:04.029635+0000","last_unstale":"2023-07-20T10:06:06.016194+0000","last_undegraded":"2023-07-20T10:06:06.016194+0000","last_fullsized":"2023-07-20T10:06:06.016194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:02:59.228281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565239+0000","last_change":"2023-07-20T10:06:05.047083+0000","last_active":"2023-07-20T10:06:06.565239+0000","last_peered":"2023-07-20T10:06:06.565239+0000","last_clean":"2023-07-20T10:06:06.565239+0000","last_became_active":"2023-07-20T10:06:05.046549+0000","last_became_peered":"2023-07-20T10:06:05.046549+0000","last_unstale":"2023-07-20T10:06:06.565239+0000","last_undegraded":"2023-07-20T10:06:06.565239+0000","last_fullsized":"2023-07-20T10:06:06.565239+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:45.278322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561829+0000","last_change":"2023-07-20T10:06:04.029970+0000","last_active":"2023-07-20T10:06:06.561829+0000","last_peered":"2023-07-20T10:06:06.561829+0000","last_clean":"2023-07-20T10:06:06.561829+0000","last_became_active":"2023-07-20T10:06:04.029676+0000","last_became_peered":"2023-07-20T10:06:04.029676+0000","last_unstale":"2023-07-20T10:06:06.561829+0000","last_undegraded":"2023-07-20T10:06:06.561829+0000","last_fullsized":"2023-07-20T10:06:06.561829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:49:47.400172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"83'172","reported_seq":501,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565380+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:06.565380+0000","last_peered":"2023-07-20T10:06:06.565380+0000","last_clean":"2023-07-20T10:06:06.565380+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:06.565380+0000","last_undegraded":"2023-07-20T10:06:06.565380+0000","last_fullsized":"2023-07-20T10:06:06.565380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:37.385277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018976+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:06.018976+0000","last_peered":"2023-07-20T10:06:06.018976+0000","last_clean":"2023-07-20T10:06:06.018976+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:06.018976+0000","last_undegraded":"2023-07-20T10:06:06.018976+0000","last_fullsized":"2023-07-20T10:06:06.018976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:32:59.549783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561374+0000","last_change":"2023-07-20T10:06:05.046142+0000","last_active":"2023-07-20T10:06:06.561374+0000","last_peered":"2023-07-20T10:06:06.561374+0000","last_clean":"2023-07-20T10:06:06.561374+0000","last_became_active":"2023-07-20T10:06:05.045819+0000","last_became_peered":"2023-07-20T10:06:05.045819+0000","last_unstale":"2023-07-20T10:06:06.561374+0000","last_undegraded":"2023-07-20T10:06:06.561374+0000","last_fullsized":"2023-07-20T10:06:06.561374+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:29.508447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561245+0000","last_change":"2023-07-20T10:06:04.026867+0000","last_active":"2023-07-20T10:06:06.561245+0000","last_peered":"2023-07-20T10:06:06.561245+0000","last_clean":"2023-07-20T10:06:06.561245+0000","last_became_active":"2023-07-20T10:06:04.026540+0000","last_became_peered":"2023-07-20T10:06:04.026540+0000","last_unstale":"2023-07-20T10:06:06.561245+0000","last_undegraded":"2023-07-20T10:06:06.561245+0000","last_fullsized":"2023-07-20T10:06:06.561245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:57.587221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564657+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:06.564657+0000","last_peered":"2023-07-20T10:06:06.564657+0000","last_clean":"2023-07-20T10:06:06.564657+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:06.564657+0000","last_undegraded":"2023-07-20T10:06:06.564657+0000","last_fullsized":"2023-07-20T10:06:06.564657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:42.929117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566050+0000","last_change":"2023-07-20T10:06:05.039311+0000","last_active":"2023-07-20T10:06:06.566050+0000","last_peered":"2023-07-20T10:06:06.566050+0000","last_clean":"2023-07-20T10:06:06.566050+0000","last_became_active":"2023-07-20T10:06:05.038935+0000","last_became_peered":"2023-07-20T10:06:05.038935+0000","last_unstale":"2023-07-20T10:06:06.566050+0000","last_undegraded":"2023-07-20T10:06:06.566050+0000","last_fullsized":"2023-07-20T10:06:06.566050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:05:44.135239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561216+0000","last_change":"2023-07-20T10:06:04.026770+0000","last_active":"2023-07-20T10:06:06.561216+0000","last_peered":"2023-07-20T10:06:06.561216+0000","last_clean":"2023-07-20T10:06:06.561216+0000","last_became_active":"2023-07-20T10:06:04.026487+0000","last_became_peered":"2023-07-20T10:06:04.026487+0000","last_unstale":"2023-07-20T10:06:06.561216+0000","last_undegraded":"2023-07-20T10:06:06.561216+0000","last_fullsized":"2023-07-20T10:06:06.561216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:46.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014166+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:06.014166+0000","last_peered":"2023-07-20T10:06:06.014166+0000","last_clean":"2023-07-20T10:06:06.014166+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:06.014166+0000","last_undegraded":"2023-07-20T10:06:06.014166+0000","last_fullsized":"2023-07-20T10:06:06.014166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:15.218167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560934+0000","last_change":"2023-07-20T10:06:05.039783+0000","last_active":"2023-07-20T10:06:06.560934+0000","last_peered":"2023-07-20T10:06:06.560934+0000","last_clean":"2023-07-20T10:06:06.560934+0000","last_became_active":"2023-07-20T10:06:05.039168+0000","last_became_peered":"2023-07-20T10:06:05.039168+0000","last_unstale":"2023-07-20T10:06:06.560934+0000","last_undegraded":"2023-07-20T10:06:06.560934+0000","last_fullsized":"2023-07-20T10:06:06.560934+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:16.845759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561463+0000","last_change":"2023-07-20T10:06:04.029986+0000","last_active":"2023-07-20T10:06:06.561463+0000","last_peered":"2023-07-20T10:06:06.561463+0000","last_clean":"2023-07-20T10:06:06.561463+0000","last_became_active":"2023-07-20T10:06:04.029712+0000","last_became_peered":"2023-07-20T10:06:04.029712+0000","last_unstale":"2023-07-20T10:06:06.561463+0000","last_undegraded":"2023-07-20T10:06:06.561463+0000","last_fullsized":"2023-07-20T10:06:06.561463+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:37.032211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019147+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:06.019147+0000","last_peered":"2023-07-20T10:06:06.019147+0000","last_clean":"2023-07-20T10:06:06.019147+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:06.019147+0000","last_undegraded":"2023-07-20T10:06:06.019147+0000","last_fullsized":"2023-07-20T10:06:06.019147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:10.772811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014259+0000","last_change":"2023-07-20T10:06:05.043001+0000","last_active":"2023-07-20T10:06:06.014259+0000","last_peered":"2023-07-20T10:06:06.014259+0000","last_clean":"2023-07-20T10:06:06.014259+0000","last_became_active":"2023-07-20T10:06:05.042682+0000","last_became_peered":"2023-07-20T10:06:05.042682+0000","last_unstale":"2023-07-20T10:06:06.014259+0000","last_undegraded":"2023-07-20T10:06:06.014259+0000","last_fullsized":"2023-07-20T10:06:06.014259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:09.032897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014774+0000","last_change":"2023-07-20T10:06:04.028773+0000","last_active":"2023-07-20T10:06:06.014774+0000","last_peered":"2023-07-20T10:06:06.014774+0000","last_clean":"2023-07-20T10:06:06.014774+0000","last_became_active":"2023-07-20T10:06:04.028476+0000","last_became_peered":"2023-07-20T10:06:04.028476+0000","last_unstale":"2023-07-20T10:06:06.014774+0000","last_undegraded":"2023-07-20T10:06:06.014774+0000","last_fullsized":"2023-07-20T10:06:06.014774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:17:18.247321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016593+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:06.016593+0000","last_peered":"2023-07-20T10:06:06.016593+0000","last_clean":"2023-07-20T10:06:06.016593+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:06.016593+0000","last_undegraded":"2023-07-20T10:06:06.016593+0000","last_fullsized":"2023-07-20T10:06:06.016593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:06:24.613255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561362+0000","last_change":"2023-07-20T10:06:05.037745+0000","last_active":"2023-07-20T10:06:06.561362+0000","last_peered":"2023-07-20T10:06:06.561362+0000","last_clean":"2023-07-20T10:06:06.561362+0000","last_became_active":"2023-07-20T10:06:05.037480+0000","last_became_peered":"2023-07-20T10:06:05.037480+0000","last_unstale":"2023-07-20T10:06:06.561362+0000","last_undegraded":"2023-07-20T10:06:06.561362+0000","last_fullsized":"2023-07-20T10:06:06.561362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:46.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016525+0000","last_change":"2023-07-20T10:06:04.033788+0000","last_active":"2023-07-20T10:06:06.016525+0000","last_peered":"2023-07-20T10:06:06.016525+0000","last_clean":"2023-07-20T10:06:06.016525+0000","last_became_active":"2023-07-20T10:06:04.033519+0000","last_became_peered":"2023-07-20T10:06:04.033519+0000","last_unstale":"2023-07-20T10:06:06.016525+0000","last_undegraded":"2023-07-20T10:06:06.016525+0000","last_fullsized":"2023-07-20T10:06:06.016525+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:24.706130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565402+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:06.565402+0000","last_peered":"2023-07-20T10:06:06.565402+0000","last_clean":"2023-07-20T10:06:06.565402+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:06.565402+0000","last_undegraded":"2023-07-20T10:06:06.565402+0000","last_fullsized":"2023-07-20T10:06:06.565402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:07.031856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561155+0000","last_change":"2023-07-20T10:06:05.037168+0000","last_active":"2023-07-20T10:06:06.561155+0000","last_peered":"2023-07-20T10:06:06.561155+0000","last_clean":"2023-07-20T10:06:06.561155+0000","last_became_active":"2023-07-20T10:06:05.036894+0000","last_became_peered":"2023-07-20T10:06:05.036894+0000","last_unstale":"2023-07-20T10:06:06.561155+0000","last_undegraded":"2023-07-20T10:06:06.561155+0000","last_fullsized":"2023-07-20T10:06:06.561155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:13.775277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565140+0000","last_change":"2023-07-20T10:06:04.033251+0000","last_active":"2023-07-20T10:06:06.565140+0000","last_peered":"2023-07-20T10:06:06.565140+0000","last_clean":"2023-07-20T10:06:06.565140+0000","last_became_active":"2023-07-20T10:06:04.032902+0000","last_became_peered":"2023-07-20T10:06:04.032902+0000","last_unstale":"2023-07-20T10:06:06.565140+0000","last_undegraded":"2023-07-20T10:06:06.565140+0000","last_fullsized":"2023-07-20T10:06:06.565140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:25.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016891+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:06.016891+0000","last_peered":"2023-07-20T10:06:06.016891+0000","last_clean":"2023-07-20T10:06:06.016891+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:06.016891+0000","last_undegraded":"2023-07-20T10:06:06.016891+0000","last_fullsized":"2023-07-20T10:06:06.016891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:13:26.945694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014077+0000","last_change":"2023-07-20T10:06:05.038534+0000","last_active":"2023-07-20T10:06:06.014077+0000","last_peered":"2023-07-20T10:06:06.014077+0000","last_clean":"2023-07-20T10:06:06.014077+0000","last_became_active":"2023-07-20T10:06:05.038136+0000","last_became_peered":"2023-07-20T10:06:05.038136+0000","last_unstale":"2023-07-20T10:06:06.014077+0000","last_undegraded":"2023-07-20T10:06:06.014077+0000","last_fullsized":"2023-07-20T10:06:06.014077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:55.305110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408214+0000","last_change":"2023-07-20T10:06:04.032699+0000","last_active":"2023-07-20T10:06:06.408214+0000","last_peered":"2023-07-20T10:06:06.408214+0000","last_clean":"2023-07-20T10:06:06.408214+0000","last_became_active":"2023-07-20T10:06:04.032218+0000","last_became_peered":"2023-07-20T10:06:04.032218+0000","last_unstale":"2023-07-20T10:06:06.408214+0000","last_undegraded":"2023-07-20T10:06:06.408214+0000","last_fullsized":"2023-07-20T10:06:06.408214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:41:23.284483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566003+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:06.566003+0000","last_peered":"2023-07-20T10:06:06.566003+0000","last_clean":"2023-07-20T10:06:06.566003+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:06.566003+0000","last_undegraded":"2023-07-20T10:06:06.566003+0000","last_fullsized":"2023-07-20T10:06:06.566003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:38:32.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312780,"statfs":{"total":96636764160,"available":96576286720,"internally_reserved":0,"allocated":1744896,"data_stored":1161725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.372},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1159168,"data_stored":572899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.621}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.67300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1150976,"data_stored":571369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.37},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.501}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1167360,"data_stored":573003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.84499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.47799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0580000000000001,"15min":1.085},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.141},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70799999999999996},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.363},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.177},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.0049999999999999,"5min":1.204,"15min":1.3620000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.61799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":1.212},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":1.4770000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.877,"5min":0.90500000000000003,"15min":1.196},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60499999999999998,"15min":0.58799999999999997},"min":{"1min":0.48899999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.4970000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.57499999999999996,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89500000000000002,"5min":0.96299999999999997,"15min":1.538},"last":0.50800000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"max":{"1min":0.85899999999999999,"5min":0.93400000000000005,"15min":1.597},"last":0.55000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":571917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.68700000000000006,"15min":4.8239999999999998},"last":0.375}]},{"osd":1,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.54600000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.51200000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66900000000000004,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":1.099},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.9830000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.071,"15min":1.381},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"max":{"1min":0.97499999999999998,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.052,"15min":1.3260000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.01,"5min":1.1160000000000001,"15min":1.274},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.502},"max":{"1min":1.04,"5min":1.04,"15min":1.1950000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.4399999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0549999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54396,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317444,"statfs":{"total":96636764160,"available":96581062656,"internally_reserved":0,"allocated":1159168,"data_stored":572077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.318}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.442}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.79600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.75800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1155072,"data_stored":571447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.435}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.376},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.496},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.67000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.59799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1740800,"data_stored":1161703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.626}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.871}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:13.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:13.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 Processor -- start 2023-07-20T10:06:13.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 -- start start 2023-07-20T10:06:13.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6f815cab0 0x7fb6f80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6f80ce4c0 0x7fb6f80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80d16b0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80d31c0 con 0x7fb6f815cab0 2023-07-20T10:06:13.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6fd9a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f80b3520 con 0x7fb6f80ce4c0 2023-07-20T10:06:13.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb6f815cab0 0x7fb6f80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:13.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f67fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb6f80d0d10 0x7fb6f80cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43286/0 (socket says 172.21.15.82:43286) 2023-07-20T10:06:13.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f67fc640 1 -- 172.21.15.82:0/1014177337 learned_addr learned my addr 172.21.15.82:0/1014177337 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:13.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f6ffd640 1 -- 172.21.15.82:0/1014177337 >> v2:172.21.15.183:3300/0 conn(0x7fb6f80ce4c0 msgr2=0x7fb6f80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:13.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/1014177337 >> v2:172.21.15.183:3300/0 conn(0x7fb6f80ce4c0 0x7fb6f80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f6ffd640 1 -- 172.21.15.82:0/1014177337 >> v1:172.21.15.82:6789/0 conn(0x7fb6f80d0d10 legacy=0x7fb6f80cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f6ffd640 1 -- 172.21.15.82:0/1014177337 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80b2910 con 0x7fb6f815cab0 2023-07-20T10:06:13.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.750+0000 7fb6f5ffb640 1 -- 172.21.15.82:0/1014177337 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055629895 0 0) 0x7fb6f80d16b0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/1014177337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f815cab0 0x7fb6f80d0300 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8071cd0 tx=0x7fb6e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6db25ca5fc372e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:13.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6f5ffb640 1 -- 172.21.15.82:0/1014177337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8004230 con 0x7fb6f815cab0 2023-07-20T10:06:13.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6f5ffb640 1 -- 172.21.15.82:0/1014177337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80a7050 con 0x7fb6f815cab0 2023-07-20T10:06:13.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6f5ffb640 1 -- 172.21.15.82:0/1014177337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e8003620 con 0x7fb6f815cab0 2023-07-20T10:06:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/1014177337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f815cab0 msgr2=0x7fb6f80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/1014177337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f815cab0 0x7fb6f80d0300 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8071cd0 tx=0x7fb6e801c430 comp rx=0 tx=0).stop 2023-07-20T10:06:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/1014177337 shutdown_connections 2023-07-20T10:06:13.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/1014177337 >> v2:172.21.15.183:3300/0 conn(0x7fb6f80ce4c0 0x7fb6f80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/1014177337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f815cab0 0x7fb6f80d0300 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/1014177337 >> 172.21.15.82:0/1014177337 conn(0x7fb6f808c120 msgr2=0x7fb6f809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:13.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/1014177337 shutdown_connections 2023-07-20T10:06:13.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.754+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/1014177337 wait complete. 2023-07-20T10:06:13.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 Processor -- start 2023-07-20T10:06:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- start start 2023-07-20T10:06:13.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 0x7fb6f8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 0x7fb6f80d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80c7bb0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80b5350 con 0x7fb6f80ce4c0 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80c6c50 con 0x7fb6f815cab0 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:13.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39694/0 (socket says 172.21.15.82:39694) 2023-07-20T10:06:13.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 -- 172.21.15.82:0/329738533 learned_addr learned my addr 172.21.15.82:0/329738533 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 0x7fb6f8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f77fe640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 0x7fb6f80d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 -- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 msgr2=0x7fb6f80d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 0x7fb6f80d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 -- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 msgr2=0x7fb6f8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 0x7fb6f8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 -- 172.21.15.82:0/329738533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009420 con 0x7fb6f80d0d10 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f77fe640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 0x7fb6f80d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 0x7fb6f8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6f67fc640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec001570 tx=0x7fb6ec00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00a640 con 0x7fb6f80d0d10 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec00a7c0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00ab70 con 0x7fb6f80d0d10 2023-07-20T10:06:13.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f80c6f30 con 0x7fb6f80d0d10 2023-07-20T10:06:13.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.758+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f80c74f0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f80c7cf0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6ec00acd0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6dffff640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 0x7fb6e4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:13.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6ec083300 con 0x7fb6f80d0d10 2023-07-20T10:06:13.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 0x7fb6e4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:13.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.762+0000 7fb6f6ffd640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 0x7fb6e4068890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ad000 tx=0x7fb6e8008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:13.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.766+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6f80c7cf0 con 0x7fb6f80d0d10 2023-07-20T10:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.910+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6f80b25c0 con 0x7fb6e40663d0 2023-07-20T10:06:13.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.918+0000 7fb6dffff640 1 -- 172.21.15.82:0/329738533 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311460 (secure 0 0 0) 0x7fb6e80044f0 con 0x7fb6e40663d0 2023-07-20T10:06:13.902 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:13.903 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 msgr2=0x7fb6e4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 0x7fb6e4068890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ad000 tx=0x7fb6e8008040 comp rx=0 tx=0).stop 2023-07-20T10:06:13.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 msgr2=0x7fb6f80d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec001570 tx=0x7fb6ec00cd20 comp rx=0 tx=0).stop 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 shutdown_connections 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb6e40663d0 0x7fb6e4068890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6f815cab0 0x7fb6f80d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6f80d0d10 0x7fb6f80d2520 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 --2- 172.21.15.82:0/329738533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6f80ce4c0 0x7fb6f8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 >> 172.21.15.82:0/329738533 conn(0x7fb6f808c120 msgr2=0x7fb6f80b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:13.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 shutdown_connections 2023-07-20T10:06:13.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:13.922+0000 7fb6fd9a3640 1 -- 172.21.15.82:0/329738533 wait complete. 2023-07-20T10:06:13.922 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T10:06:13.727007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":304,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311616,"kb_used_data":10184,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754663104,"statfs":{"total":773094113280,"available":772775018496,"internally_reserved":0,"allocated":10428416,"data_stored":5756140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.716105"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565323+0000","last_change":"2023-07-20T10:06:05.050840+0000","last_active":"2023-07-20T10:06:06.565323+0000","last_peered":"2023-07-20T10:06:06.565323+0000","last_clean":"2023-07-20T10:06:06.565323+0000","last_became_active":"2023-07-20T10:06:05.050552+0000","last_became_peered":"2023-07-20T10:06:05.050552+0000","last_unstale":"2023-07-20T10:06:06.565323+0000","last_undegraded":"2023-07-20T10:06:06.565323+0000","last_fullsized":"2023-07-20T10:06:06.565323+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:45.478167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561250+0000","last_change":"2023-07-20T10:06:05.038869+0000","last_active":"2023-07-20T10:06:06.561250+0000","last_peered":"2023-07-20T10:06:06.561250+0000","last_clean":"2023-07-20T10:06:06.561250+0000","last_became_active":"2023-07-20T10:06:05.038535+0000","last_became_peered":"2023-07-20T10:06:05.038535+0000","last_unstale":"2023-07-20T10:06:06.561250+0000","last_undegraded":"2023-07-20T10:06:06.561250+0000","last_fullsized":"2023-07-20T10:06:06.561250+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:09.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016747+0000","last_change":"2023-07-20T10:06:05.042401+0000","last_active":"2023-07-20T10:06:06.016747+0000","last_peered":"2023-07-20T10:06:06.016747+0000","last_clean":"2023-07-20T10:06:06.016747+0000","last_became_active":"2023-07-20T10:06:05.042096+0000","last_became_peered":"2023-07-20T10:06:05.042096+0000","last_unstale":"2023-07-20T10:06:06.016747+0000","last_undegraded":"2023-07-20T10:06:06.016747+0000","last_fullsized":"2023-07-20T10:06:06.016747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:32.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019337+0000","last_change":"2023-07-20T10:06:05.028079+0000","last_active":"2023-07-20T10:06:06.019337+0000","last_peered":"2023-07-20T10:06:06.019337+0000","last_clean":"2023-07-20T10:06:06.019337+0000","last_became_active":"2023-07-20T10:06:05.027783+0000","last_became_peered":"2023-07-20T10:06:05.027783+0000","last_unstale":"2023-07-20T10:06:06.019337+0000","last_undegraded":"2023-07-20T10:06:06.019337+0000","last_fullsized":"2023-07-20T10:06:06.019337+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:03.379893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014415+0000","last_change":"2023-07-20T10:06:05.039614+0000","last_active":"2023-07-20T10:06:06.014415+0000","last_peered":"2023-07-20T10:06:06.014415+0000","last_clean":"2023-07-20T10:06:06.014415+0000","last_became_active":"2023-07-20T10:06:05.039138+0000","last_became_peered":"2023-07-20T10:06:05.039138+0000","last_unstale":"2023-07-20T10:06:06.014415+0000","last_undegraded":"2023-07-20T10:06:06.014415+0000","last_fullsized":"2023-07-20T10:06:06.014415+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:27.693800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561567+0000","last_change":"2023-07-20T10:06:05.029835+0000","last_active":"2023-07-20T10:06:06.561567+0000","last_peered":"2023-07-20T10:06:06.561567+0000","last_clean":"2023-07-20T10:06:06.561567+0000","last_became_active":"2023-07-20T10:06:05.029580+0000","last_became_peered":"2023-07-20T10:06:05.029580+0000","last_unstale":"2023-07-20T10:06:06.561567+0000","last_undegraded":"2023-07-20T10:06:06.561567+0000","last_fullsized":"2023-07-20T10:06:06.561567+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:38:05.546020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565139+0000","last_change":"2023-07-20T10:06:05.039362+0000","last_active":"2023-07-20T10:06:06.565139+0000","last_peered":"2023-07-20T10:06:06.565139+0000","last_clean":"2023-07-20T10:06:06.565139+0000","last_became_active":"2023-07-20T10:06:05.038969+0000","last_became_peered":"2023-07-20T10:06:05.038969+0000","last_unstale":"2023-07-20T10:06:06.565139+0000","last_undegraded":"2023-07-20T10:06:06.565139+0000","last_fullsized":"2023-07-20T10:06:06.565139+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:55:39.486906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014017+0000","last_change":"2023-07-20T10:06:05.037765+0000","last_active":"2023-07-20T10:06:06.014017+0000","last_peered":"2023-07-20T10:06:06.014017+0000","last_clean":"2023-07-20T10:06:06.014017+0000","last_became_active":"2023-07-20T10:06:05.037471+0000","last_became_peered":"2023-07-20T10:06:05.037471+0000","last_unstale":"2023-07-20T10:06:06.014017+0000","last_undegraded":"2023-07-20T10:06:06.014017+0000","last_fullsized":"2023-07-20T10:06:06.014017+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:49.522374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408278+0000","last_change":"2023-07-20T10:06:05.028251+0000","last_active":"2023-07-20T10:06:06.408278+0000","last_peered":"2023-07-20T10:06:06.408278+0000","last_clean":"2023-07-20T10:06:06.408278+0000","last_became_active":"2023-07-20T10:06:05.027934+0000","last_became_peered":"2023-07-20T10:06:05.027934+0000","last_unstale":"2023-07-20T10:06:06.408278+0000","last_undegraded":"2023-07-20T10:06:06.408278+0000","last_fullsized":"2023-07-20T10:06:06.408278+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019469+0000","last_change":"2023-07-20T10:06:05.046590+0000","last_active":"2023-07-20T10:06:06.019469+0000","last_peered":"2023-07-20T10:06:06.019469+0000","last_clean":"2023-07-20T10:06:06.019469+0000","last_became_active":"2023-07-20T10:06:05.045939+0000","last_became_peered":"2023-07-20T10:06:05.045939+0000","last_unstale":"2023-07-20T10:06:06.019469+0000","last_undegraded":"2023-07-20T10:06:06.019469+0000","last_fullsized":"2023-07-20T10:06:06.019469+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:13.160757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561204+0000","last_change":"2023-07-20T10:06:05.039079+0000","last_active":"2023-07-20T10:06:06.561204+0000","last_peered":"2023-07-20T10:06:06.561204+0000","last_clean":"2023-07-20T10:06:06.561204+0000","last_became_active":"2023-07-20T10:06:05.038601+0000","last_became_peered":"2023-07-20T10:06:05.038601+0000","last_unstale":"2023-07-20T10:06:06.561204+0000","last_undegraded":"2023-07-20T10:06:06.561204+0000","last_fullsized":"2023-07-20T10:06:06.561204+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:55:02.770042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019245+0000","last_change":"2023-07-20T10:06:05.047873+0000","last_active":"2023-07-20T10:06:06.019245+0000","last_peered":"2023-07-20T10:06:06.019245+0000","last_clean":"2023-07-20T10:06:06.019245+0000","last_became_active":"2023-07-20T10:06:05.047385+0000","last_became_peered":"2023-07-20T10:06:05.047385+0000","last_unstale":"2023-07-20T10:06:06.019245+0000","last_undegraded":"2023-07-20T10:06:06.019245+0000","last_fullsized":"2023-07-20T10:06:06.019245+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:26.161706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014282+0000","last_change":"2023-07-20T10:06:05.027326+0000","last_active":"2023-07-20T10:06:06.014282+0000","last_peered":"2023-07-20T10:06:06.014282+0000","last_clean":"2023-07-20T10:06:06.014282+0000","last_became_active":"2023-07-20T10:06:05.027030+0000","last_became_peered":"2023-07-20T10:06:05.027030+0000","last_unstale":"2023-07-20T10:06:06.014282+0000","last_undegraded":"2023-07-20T10:06:06.014282+0000","last_fullsized":"2023-07-20T10:06:06.014282+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:53.794465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561636+0000","last_change":"2023-07-20T10:06:05.029697+0000","last_active":"2023-07-20T10:06:06.561636+0000","last_peered":"2023-07-20T10:06:06.561636+0000","last_clean":"2023-07-20T10:06:06.561636+0000","last_became_active":"2023-07-20T10:06:05.029158+0000","last_became_peered":"2023-07-20T10:06:05.029158+0000","last_unstale":"2023-07-20T10:06:06.561636+0000","last_undegraded":"2023-07-20T10:06:06.561636+0000","last_fullsized":"2023-07-20T10:06:06.561636+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:38.559958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560699+0000","last_change":"2023-07-20T10:06:05.046303+0000","last_active":"2023-07-20T10:06:06.560699+0000","last_peered":"2023-07-20T10:06:06.560699+0000","last_clean":"2023-07-20T10:06:06.560699+0000","last_became_active":"2023-07-20T10:06:05.046007+0000","last_became_peered":"2023-07-20T10:06:05.046007+0000","last_unstale":"2023-07-20T10:06:06.560699+0000","last_undegraded":"2023-07-20T10:06:06.560699+0000","last_fullsized":"2023-07-20T10:06:06.560699+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:37:07.207620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564446+0000","last_change":"2023-07-20T10:06:05.038830+0000","last_active":"2023-07-20T10:06:06.564446+0000","last_peered":"2023-07-20T10:06:06.564446+0000","last_clean":"2023-07-20T10:06:06.564446+0000","last_became_active":"2023-07-20T10:06:05.038483+0000","last_became_peered":"2023-07-20T10:06:05.038483+0000","last_unstale":"2023-07-20T10:06:06.564446+0000","last_undegraded":"2023-07-20T10:06:06.564446+0000","last_fullsized":"2023-07-20T10:06:06.564446+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:25.755337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014529+0000","last_change":"2023-07-20T10:06:05.040785+0000","last_active":"2023-07-20T10:06:06.014529+0000","last_peered":"2023-07-20T10:06:06.014529+0000","last_clean":"2023-07-20T10:06:06.014529+0000","last_became_active":"2023-07-20T10:06:05.040316+0000","last_became_peered":"2023-07-20T10:06:05.040316+0000","last_unstale":"2023-07-20T10:06:06.014529+0000","last_undegraded":"2023-07-20T10:06:06.014529+0000","last_fullsized":"2023-07-20T10:06:06.014529+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:31:36.103791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016779+0000","last_change":"2023-07-20T10:06:05.049684+0000","last_active":"2023-07-20T10:06:06.016779+0000","last_peered":"2023-07-20T10:06:06.016779+0000","last_clean":"2023-07-20T10:06:06.016779+0000","last_became_active":"2023-07-20T10:06:05.049414+0000","last_became_peered":"2023-07-20T10:06:05.049414+0000","last_unstale":"2023-07-20T10:06:06.016779+0000","last_undegraded":"2023-07-20T10:06:06.016779+0000","last_fullsized":"2023-07-20T10:06:06.016779+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:07.407187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561515+0000","last_change":"2023-07-20T10:06:05.036606+0000","last_active":"2023-07-20T10:06:06.561515+0000","last_peered":"2023-07-20T10:06:06.561515+0000","last_clean":"2023-07-20T10:06:06.561515+0000","last_became_active":"2023-07-20T10:06:05.036300+0000","last_became_peered":"2023-07-20T10:06:05.036300+0000","last_unstale":"2023-07-20T10:06:06.561515+0000","last_undegraded":"2023-07-20T10:06:06.561515+0000","last_fullsized":"2023-07-20T10:06:06.561515+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:42:14.274988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014561+0000","last_change":"2023-07-20T10:06:05.044137+0000","last_active":"2023-07-20T10:06:06.014561+0000","last_peered":"2023-07-20T10:06:06.014561+0000","last_clean":"2023-07-20T10:06:06.014561+0000","last_became_active":"2023-07-20T10:06:05.043875+0000","last_became_peered":"2023-07-20T10:06:05.043875+0000","last_unstale":"2023-07-20T10:06:06.014561+0000","last_undegraded":"2023-07-20T10:06:06.014561+0000","last_fullsized":"2023-07-20T10:06:06.014561+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:06:07.214972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407977+0000","last_change":"2023-07-20T10:06:05.048839+0000","last_active":"2023-07-20T10:06:06.407977+0000","last_peered":"2023-07-20T10:06:06.407977+0000","last_clean":"2023-07-20T10:06:06.407977+0000","last_became_active":"2023-07-20T10:06:05.048555+0000","last_became_peered":"2023-07-20T10:06:05.048555+0000","last_unstale":"2023-07-20T10:06:06.407977+0000","last_undegraded":"2023-07-20T10:06:06.407977+0000","last_fullsized":"2023-07-20T10:06:06.407977+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:20.208645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014160+0000","last_change":"2023-07-20T10:06:05.025025+0000","last_active":"2023-07-20T10:06:06.014160+0000","last_peered":"2023-07-20T10:06:06.014160+0000","last_clean":"2023-07-20T10:06:06.014160+0000","last_became_active":"2023-07-20T10:06:05.024737+0000","last_became_peered":"2023-07-20T10:06:05.024737+0000","last_unstale":"2023-07-20T10:06:06.014160+0000","last_undegraded":"2023-07-20T10:06:06.014160+0000","last_fullsized":"2023-07-20T10:06:06.014160+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:46:42.183411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407710+0000","last_change":"2023-07-20T10:06:05.027158+0000","last_active":"2023-07-20T10:06:06.407710+0000","last_peered":"2023-07-20T10:06:06.407710+0000","last_clean":"2023-07-20T10:06:06.407710+0000","last_became_active":"2023-07-20T10:06:05.026861+0000","last_became_peered":"2023-07-20T10:06:05.026861+0000","last_unstale":"2023-07-20T10:06:06.407710+0000","last_undegraded":"2023-07-20T10:06:06.407710+0000","last_fullsized":"2023-07-20T10:06:06.407710+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:33.231957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560864+0000","last_change":"2023-07-20T10:06:05.041105+0000","last_active":"2023-07-20T10:06:06.560864+0000","last_peered":"2023-07-20T10:06:06.560864+0000","last_clean":"2023-07-20T10:06:06.560864+0000","last_became_active":"2023-07-20T10:06:05.040798+0000","last_became_peered":"2023-07-20T10:06:05.040798+0000","last_unstale":"2023-07-20T10:06:06.560864+0000","last_undegraded":"2023-07-20T10:06:06.560864+0000","last_fullsized":"2023-07-20T10:06:06.560864+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:56.628592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561189+0000","last_change":"2023-07-20T10:06:05.046810+0000","last_active":"2023-07-20T10:06:06.561189+0000","last_peered":"2023-07-20T10:06:06.561189+0000","last_clean":"2023-07-20T10:06:06.561189+0000","last_became_active":"2023-07-20T10:06:05.046504+0000","last_became_peered":"2023-07-20T10:06:05.046504+0000","last_unstale":"2023-07-20T10:06:06.561189+0000","last_undegraded":"2023-07-20T10:06:06.561189+0000","last_fullsized":"2023-07-20T10:06:06.561189+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:29:22.138993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019498+0000","last_change":"2023-07-20T10:06:05.046795+0000","last_active":"2023-07-20T10:06:06.019498+0000","last_peered":"2023-07-20T10:06:06.019498+0000","last_clean":"2023-07-20T10:06:06.019498+0000","last_became_active":"2023-07-20T10:06:05.046436+0000","last_became_peered":"2023-07-20T10:06:05.046436+0000","last_unstale":"2023-07-20T10:06:06.019498+0000","last_undegraded":"2023-07-20T10:06:06.019498+0000","last_fullsized":"2023-07-20T10:06:06.019498+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:15:26.028755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564951+0000","last_change":"2023-07-20T10:06:05.038974+0000","last_active":"2023-07-20T10:06:06.564951+0000","last_peered":"2023-07-20T10:06:06.564951+0000","last_clean":"2023-07-20T10:06:06.564951+0000","last_became_active":"2023-07-20T10:06:05.038669+0000","last_became_peered":"2023-07-20T10:06:05.038669+0000","last_unstale":"2023-07-20T10:06:06.564951+0000","last_undegraded":"2023-07-20T10:06:06.564951+0000","last_fullsized":"2023-07-20T10:06:06.564951+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:47:12.916893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014482+0000","last_change":"2023-07-20T10:06:05.025634+0000","last_active":"2023-07-20T10:06:06.014482+0000","last_peered":"2023-07-20T10:06:06.014482+0000","last_clean":"2023-07-20T10:06:06.014482+0000","last_became_active":"2023-07-20T10:06:05.025360+0000","last_became_peered":"2023-07-20T10:06:05.025360+0000","last_unstale":"2023-07-20T10:06:06.014482+0000","last_undegraded":"2023-07-20T10:06:06.014482+0000","last_fullsized":"2023-07-20T10:06:06.014482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:06.831949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560984+0000","last_change":"2023-07-20T10:06:05.043579+0000","last_active":"2023-07-20T10:06:06.560984+0000","last_peered":"2023-07-20T10:06:06.560984+0000","last_clean":"2023-07-20T10:06:06.560984+0000","last_became_active":"2023-07-20T10:06:05.043284+0000","last_became_peered":"2023-07-20T10:06:05.043284+0000","last_unstale":"2023-07-20T10:06:06.560984+0000","last_undegraded":"2023-07-20T10:06:06.560984+0000","last_fullsized":"2023-07-20T10:06:06.560984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:18.654488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564547+0000","last_change":"2023-07-20T10:06:05.048784+0000","last_active":"2023-07-20T10:06:06.564547+0000","last_peered":"2023-07-20T10:06:06.564547+0000","last_clean":"2023-07-20T10:06:06.564547+0000","last_became_active":"2023-07-20T10:06:05.048470+0000","last_became_peered":"2023-07-20T10:06:05.048470+0000","last_unstale":"2023-07-20T10:06:06.564547+0000","last_undegraded":"2023-07-20T10:06:06.564547+0000","last_fullsized":"2023-07-20T10:06:06.564547+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:08.110549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016330+0000","last_change":"2023-07-20T10:06:05.041872+0000","last_active":"2023-07-20T10:06:06.016330+0000","last_peered":"2023-07-20T10:06:06.016330+0000","last_clean":"2023-07-20T10:06:06.016330+0000","last_became_active":"2023-07-20T10:06:05.041469+0000","last_became_peered":"2023-07-20T10:06:05.041469+0000","last_unstale":"2023-07-20T10:06:06.016330+0000","last_undegraded":"2023-07-20T10:06:06.016330+0000","last_fullsized":"2023-07-20T10:06:06.016330+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:38:23.869762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564602+0000","last_change":"2023-07-20T10:06:05.050905+0000","last_active":"2023-07-20T10:06:06.564602+0000","last_peered":"2023-07-20T10:06:06.564602+0000","last_clean":"2023-07-20T10:06:06.564602+0000","last_became_active":"2023-07-20T10:06:05.050614+0000","last_became_peered":"2023-07-20T10:06:05.050614+0000","last_unstale":"2023-07-20T10:06:06.564602+0000","last_undegraded":"2023-07-20T10:06:06.564602+0000","last_fullsized":"2023-07-20T10:06:06.564602+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:16.267204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016242+0000","last_change":"2023-07-20T10:06:05.049444+0000","last_active":"2023-07-20T10:06:06.016242+0000","last_peered":"2023-07-20T10:06:06.016242+0000","last_clean":"2023-07-20T10:06:06.016242+0000","last_became_active":"2023-07-20T10:06:05.049152+0000","last_became_peered":"2023-07-20T10:06:05.049152+0000","last_unstale":"2023-07-20T10:06:06.016242+0000","last_undegraded":"2023-07-20T10:06:06.016242+0000","last_fullsized":"2023-07-20T10:06:06.016242+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:59:13.124492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'4","reported_seq":17,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014616+0000","last_change":"2023-07-20T10:06:04.029257+0000","last_active":"2023-07-20T10:06:06.014616+0000","last_peered":"2023-07-20T10:06:06.014616+0000","last_clean":"2023-07-20T10:06:06.014616+0000","last_became_active":"2023-07-20T10:06:04.028782+0000","last_became_peered":"2023-07-20T10:06:04.028782+0000","last_unstale":"2023-07-20T10:06:06.014616+0000","last_undegraded":"2023-07-20T10:06:06.014616+0000","last_fullsized":"2023-07-20T10:06:06.014616+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:58.085410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561439+0000","last_change":"2023-07-20T10:06:05.040671+0000","last_active":"2023-07-20T10:06:06.561439+0000","last_peered":"2023-07-20T10:06:06.561439+0000","last_clean":"2023-07-20T10:06:06.561439+0000","last_became_active":"2023-07-20T10:06:05.040267+0000","last_became_peered":"2023-07-20T10:06:05.040267+0000","last_unstale":"2023-07-20T10:06:06.561439+0000","last_undegraded":"2023-07-20T10:06:06.561439+0000","last_fullsized":"2023-07-20T10:06:06.561439+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:30.076876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564919+0000","last_change":"2023-07-20T10:06:04.029372+0000","last_active":"2023-07-20T10:06:06.564919+0000","last_peered":"2023-07-20T10:06:06.564919+0000","last_clean":"2023-07-20T10:06:06.564919+0000","last_became_active":"2023-07-20T10:06:04.029056+0000","last_became_peered":"2023-07-20T10:06:04.029056+0000","last_unstale":"2023-07-20T10:06:06.564919+0000","last_undegraded":"2023-07-20T10:06:06.564919+0000","last_fullsized":"2023-07-20T10:06:06.564919+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:57.170782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407909+0000","last_change":"2023-07-20T10:06:05.029656+0000","last_active":"2023-07-20T10:06:06.407909+0000","last_peered":"2023-07-20T10:06:06.407909+0000","last_clean":"2023-07-20T10:06:06.407909+0000","last_became_active":"2023-07-20T10:06:05.029021+0000","last_became_peered":"2023-07-20T10:06:05.029021+0000","last_unstale":"2023-07-20T10:06:06.407909+0000","last_undegraded":"2023-07-20T10:06:06.407909+0000","last_fullsized":"2023-07-20T10:06:06.407909+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:10.892922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565056+0000","last_change":"2023-07-20T10:06:04.027229+0000","last_active":"2023-07-20T10:06:06.565056+0000","last_peered":"2023-07-20T10:06:06.565056+0000","last_clean":"2023-07-20T10:06:06.565056+0000","last_became_active":"2023-07-20T10:06:04.026857+0000","last_became_peered":"2023-07-20T10:06:04.026857+0000","last_unstale":"2023-07-20T10:06:06.565056+0000","last_undegraded":"2023-07-20T10:06:06.565056+0000","last_fullsized":"2023-07-20T10:06:06.565056+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:54.035369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408013+0000","last_change":"2023-07-20T10:06:05.052785+0000","last_active":"2023-07-20T10:06:06.408013+0000","last_peered":"2023-07-20T10:06:06.408013+0000","last_clean":"2023-07-20T10:06:06.408013+0000","last_became_active":"2023-07-20T10:06:05.052453+0000","last_became_peered":"2023-07-20T10:06:05.052453+0000","last_unstale":"2023-07-20T10:06:06.408013+0000","last_undegraded":"2023-07-20T10:06:06.408013+0000","last_fullsized":"2023-07-20T10:06:06.408013+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:06.596451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565457+0000","last_change":"2023-07-20T10:06:04.036046+0000","last_active":"2023-07-20T10:06:06.565457+0000","last_peered":"2023-07-20T10:06:06.565457+0000","last_clean":"2023-07-20T10:06:06.565457+0000","last_became_active":"2023-07-20T10:06:04.035744+0000","last_became_peered":"2023-07-20T10:06:04.035744+0000","last_unstale":"2023-07-20T10:06:06.565457+0000","last_undegraded":"2023-07-20T10:06:06.565457+0000","last_fullsized":"2023-07-20T10:06:06.565457+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:10:02.951770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560877+0000","last_change":"2023-07-20T10:06:05.039994+0000","last_active":"2023-07-20T10:06:06.560877+0000","last_peered":"2023-07-20T10:06:06.560877+0000","last_clean":"2023-07-20T10:06:06.560877+0000","last_became_active":"2023-07-20T10:06:05.039489+0000","last_became_peered":"2023-07-20T10:06:05.039489+0000","last_unstale":"2023-07-20T10:06:06.560877+0000","last_undegraded":"2023-07-20T10:06:06.560877+0000","last_fullsized":"2023-07-20T10:06:06.560877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:02.310933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408074+0000","last_change":"2023-07-20T10:06:04.022787+0000","last_active":"2023-07-20T10:06:06.408074+0000","last_peered":"2023-07-20T10:06:06.408074+0000","last_clean":"2023-07-20T10:06:06.408074+0000","last_became_active":"2023-07-20T10:06:04.022483+0000","last_became_peered":"2023-07-20T10:06:04.022483+0000","last_unstale":"2023-07-20T10:06:06.408074+0000","last_undegraded":"2023-07-20T10:06:06.408074+0000","last_fullsized":"2023-07-20T10:06:06.408074+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:36.191330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561333+0000","last_change":"2023-07-20T10:06:05.038913+0000","last_active":"2023-07-20T10:06:06.561333+0000","last_peered":"2023-07-20T10:06:06.561333+0000","last_clean":"2023-07-20T10:06:06.561333+0000","last_became_active":"2023-07-20T10:06:05.038296+0000","last_became_peered":"2023-07-20T10:06:05.038296+0000","last_unstale":"2023-07-20T10:06:06.561333+0000","last_undegraded":"2023-07-20T10:06:06.561333+0000","last_fullsized":"2023-07-20T10:06:06.561333+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:57:49.142935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018895+0000","last_change":"2023-07-20T10:06:04.034968+0000","last_active":"2023-07-20T10:06:06.018895+0000","last_peered":"2023-07-20T10:06:06.018895+0000","last_clean":"2023-07-20T10:06:06.018895+0000","last_became_active":"2023-07-20T10:06:04.034639+0000","last_became_peered":"2023-07-20T10:06:04.034639+0000","last_unstale":"2023-07-20T10:06:06.018895+0000","last_undegraded":"2023-07-20T10:06:06.018895+0000","last_fullsized":"2023-07-20T10:06:06.018895+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:36:43.521087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408216+0000","last_change":"2023-07-20T10:06:05.030536+0000","last_active":"2023-07-20T10:06:06.408216+0000","last_peered":"2023-07-20T10:06:06.408216+0000","last_clean":"2023-07-20T10:06:06.408216+0000","last_became_active":"2023-07-20T10:06:05.030242+0000","last_became_peered":"2023-07-20T10:06:05.030242+0000","last_unstale":"2023-07-20T10:06:06.408216+0000","last_undegraded":"2023-07-20T10:06:06.408216+0000","last_fullsized":"2023-07-20T10:06:06.408216+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:34:28.934384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560986+0000","last_change":"2023-07-20T10:06:04.025599+0000","last_active":"2023-07-20T10:06:06.560986+0000","last_peered":"2023-07-20T10:06:06.560986+0000","last_clean":"2023-07-20T10:06:06.560986+0000","last_became_active":"2023-07-20T10:06:04.025282+0000","last_became_peered":"2023-07-20T10:06:04.025282+0000","last_unstale":"2023-07-20T10:06:06.560986+0000","last_undegraded":"2023-07-20T10:06:06.560986+0000","last_fullsized":"2023-07-20T10:06:06.560986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:12.400147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565884+0000","last_change":"2023-07-20T10:06:05.039334+0000","last_active":"2023-07-20T10:06:06.565884+0000","last_peered":"2023-07-20T10:06:06.565884+0000","last_clean":"2023-07-20T10:06:06.565884+0000","last_became_active":"2023-07-20T10:06:05.038983+0000","last_became_peered":"2023-07-20T10:06:05.038983+0000","last_unstale":"2023-07-20T10:06:06.565884+0000","last_undegraded":"2023-07-20T10:06:06.565884+0000","last_fullsized":"2023-07-20T10:06:06.565884+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:44:50.829929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014071+0000","last_change":"2023-07-20T10:06:04.028955+0000","last_active":"2023-07-20T10:06:06.014071+0000","last_peered":"2023-07-20T10:06:06.014071+0000","last_clean":"2023-07-20T10:06:06.014071+0000","last_became_active":"2023-07-20T10:06:04.028617+0000","last_became_peered":"2023-07-20T10:06:04.028617+0000","last_unstale":"2023-07-20T10:06:06.014071+0000","last_undegraded":"2023-07-20T10:06:06.014071+0000","last_fullsized":"2023-07-20T10:06:06.014071+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:30.679152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560711+0000","last_change":"2023-07-20T10:06:05.041064+0000","last_active":"2023-07-20T10:06:06.560711+0000","last_peered":"2023-07-20T10:06:06.560711+0000","last_clean":"2023-07-20T10:06:06.560711+0000","last_became_active":"2023-07-20T10:06:05.040487+0000","last_became_peered":"2023-07-20T10:06:05.040487+0000","last_unstale":"2023-07-20T10:06:06.560711+0000","last_undegraded":"2023-07-20T10:06:06.560711+0000","last_fullsized":"2023-07-20T10:06:06.560711+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:08:55.277877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564999+0000","last_change":"2023-07-20T10:06:04.036680+0000","last_active":"2023-07-20T10:06:06.564999+0000","last_peered":"2023-07-20T10:06:06.564999+0000","last_clean":"2023-07-20T10:06:06.564999+0000","last_became_active":"2023-07-20T10:06:04.036407+0000","last_became_peered":"2023-07-20T10:06:04.036407+0000","last_unstale":"2023-07-20T10:06:06.564999+0000","last_undegraded":"2023-07-20T10:06:06.564999+0000","last_fullsized":"2023-07-20T10:06:06.564999+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:39:53.048154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018930+0000","last_change":"2023-07-20T10:06:05.028186+0000","last_active":"2023-07-20T10:06:06.018930+0000","last_peered":"2023-07-20T10:06:06.018930+0000","last_clean":"2023-07-20T10:06:06.018930+0000","last_became_active":"2023-07-20T10:06:05.027688+0000","last_became_peered":"2023-07-20T10:06:05.027688+0000","last_unstale":"2023-07-20T10:06:06.018930+0000","last_undegraded":"2023-07-20T10:06:06.018930+0000","last_fullsized":"2023-07-20T10:06:06.018930+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:53.221466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019563+0000","last_change":"2023-07-20T10:06:04.028333+0000","last_active":"2023-07-20T10:06:06.019563+0000","last_peered":"2023-07-20T10:06:06.019563+0000","last_clean":"2023-07-20T10:06:06.019563+0000","last_became_active":"2023-07-20T10:06:04.028042+0000","last_became_peered":"2023-07-20T10:06:04.028042+0000","last_unstale":"2023-07-20T10:06:06.019563+0000","last_undegraded":"2023-07-20T10:06:06.019563+0000","last_fullsized":"2023-07-20T10:06:06.019563+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:48:51.744974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561723+0000","last_change":"2023-07-20T10:06:05.043803+0000","last_active":"2023-07-20T10:06:06.561723+0000","last_peered":"2023-07-20T10:06:06.561723+0000","last_clean":"2023-07-20T10:06:06.561723+0000","last_became_active":"2023-07-20T10:06:05.043533+0000","last_became_peered":"2023-07-20T10:06:05.043533+0000","last_unstale":"2023-07-20T10:06:06.561723+0000","last_undegraded":"2023-07-20T10:06:06.561723+0000","last_fullsized":"2023-07-20T10:06:06.561723+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:18:16.590671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014651+0000","last_change":"2023-07-20T10:06:04.029830+0000","last_active":"2023-07-20T10:06:06.014651+0000","last_peered":"2023-07-20T10:06:06.014651+0000","last_clean":"2023-07-20T10:06:06.014651+0000","last_became_active":"2023-07-20T10:06:04.029557+0000","last_became_peered":"2023-07-20T10:06:04.029557+0000","last_unstale":"2023-07-20T10:06:06.014651+0000","last_undegraded":"2023-07-20T10:06:06.014651+0000","last_fullsized":"2023-07-20T10:06:06.014651+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:01:44.311713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016379+0000","last_change":"2023-07-20T10:06:05.044465+0000","last_active":"2023-07-20T10:06:06.016379+0000","last_peered":"2023-07-20T10:06:06.016379+0000","last_clean":"2023-07-20T10:06:06.016379+0000","last_became_active":"2023-07-20T10:06:05.044082+0000","last_became_peered":"2023-07-20T10:06:05.044082+0000","last_unstale":"2023-07-20T10:06:06.016379+0000","last_undegraded":"2023-07-20T10:06:06.016379+0000","last_fullsized":"2023-07-20T10:06:06.016379+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:34.804032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'6","reported_seq":19,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565485+0000","last_change":"2023-07-20T10:06:04.029387+0000","last_active":"2023-07-20T10:06:06.565485+0000","last_peered":"2023-07-20T10:06:06.565485+0000","last_clean":"2023-07-20T10:06:06.565485+0000","last_became_active":"2023-07-20T10:06:04.029081+0000","last_became_peered":"2023-07-20T10:06:04.029081+0000","last_unstale":"2023-07-20T10:06:06.565485+0000","last_undegraded":"2023-07-20T10:06:06.565485+0000","last_fullsized":"2023-07-20T10:06:06.565485+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:42.308825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019495+0000","last_change":"2023-07-20T10:06:05.029675+0000","last_active":"2023-07-20T10:06:06.019495+0000","last_peered":"2023-07-20T10:06:06.019495+0000","last_clean":"2023-07-20T10:06:06.019495+0000","last_became_active":"2023-07-20T10:06:05.029358+0000","last_became_peered":"2023-07-20T10:06:05.029358+0000","last_unstale":"2023-07-20T10:06:06.019495+0000","last_undegraded":"2023-07-20T10:06:06.019495+0000","last_fullsized":"2023-07-20T10:06:06.019495+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:07.116921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018904+0000","last_change":"2023-07-20T10:06:04.034283+0000","last_active":"2023-07-20T10:06:06.018904+0000","last_peered":"2023-07-20T10:06:06.018904+0000","last_clean":"2023-07-20T10:06:06.018904+0000","last_became_active":"2023-07-20T10:06:04.033976+0000","last_became_peered":"2023-07-20T10:06:04.033976+0000","last_unstale":"2023-07-20T10:06:06.018904+0000","last_undegraded":"2023-07-20T10:06:06.018904+0000","last_fullsized":"2023-07-20T10:06:06.018904+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:20.596671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565600+0000","last_change":"2023-07-20T10:06:05.047144+0000","last_active":"2023-07-20T10:06:06.565600+0000","last_peered":"2023-07-20T10:06:06.565600+0000","last_clean":"2023-07-20T10:06:06.565600+0000","last_became_active":"2023-07-20T10:06:05.046854+0000","last_became_peered":"2023-07-20T10:06:05.046854+0000","last_unstale":"2023-07-20T10:06:06.565600+0000","last_undegraded":"2023-07-20T10:06:06.565600+0000","last_fullsized":"2023-07-20T10:06:06.565600+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:59.931561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564666+0000","last_change":"2023-07-20T10:06:04.033232+0000","last_active":"2023-07-20T10:06:06.564666+0000","last_peered":"2023-07-20T10:06:06.564666+0000","last_clean":"2023-07-20T10:06:06.564666+0000","last_became_active":"2023-07-20T10:06:04.032917+0000","last_became_peered":"2023-07-20T10:06:04.032917+0000","last_unstale":"2023-07-20T10:06:06.564666+0000","last_undegraded":"2023-07-20T10:06:06.564666+0000","last_fullsized":"2023-07-20T10:06:06.564666+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:10:42.954009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565630+0000","last_change":"2023-07-20T10:06:05.048583+0000","last_active":"2023-07-20T10:06:06.565630+0000","last_peered":"2023-07-20T10:06:06.565630+0000","last_clean":"2023-07-20T10:06:06.565630+0000","last_became_active":"2023-07-20T10:06:05.048299+0000","last_became_peered":"2023-07-20T10:06:05.048299+0000","last_unstale":"2023-07-20T10:06:06.565630+0000","last_undegraded":"2023-07-20T10:06:06.565630+0000","last_fullsized":"2023-07-20T10:06:06.565630+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:18:06.575212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014058+0000","last_change":"2023-07-20T10:06:04.028928+0000","last_active":"2023-07-20T10:06:06.014058+0000","last_peered":"2023-07-20T10:06:06.014058+0000","last_clean":"2023-07-20T10:06:06.014058+0000","last_became_active":"2023-07-20T10:06:04.028633+0000","last_became_peered":"2023-07-20T10:06:04.028633+0000","last_unstale":"2023-07-20T10:06:06.014058+0000","last_undegraded":"2023-07-20T10:06:06.014058+0000","last_fullsized":"2023-07-20T10:06:06.014058+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:31:14.219542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565903+0000","last_change":"2023-07-20T10:06:05.050299+0000","last_active":"2023-07-20T10:06:06.565903+0000","last_peered":"2023-07-20T10:06:06.565903+0000","last_clean":"2023-07-20T10:06:06.565903+0000","last_became_active":"2023-07-20T10:06:05.050018+0000","last_became_peered":"2023-07-20T10:06:05.050018+0000","last_unstale":"2023-07-20T10:06:06.565903+0000","last_undegraded":"2023-07-20T10:06:06.565903+0000","last_fullsized":"2023-07-20T10:06:06.565903+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:43:41.380293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560815+0000","last_change":"2023-07-20T10:06:04.026332+0000","last_active":"2023-07-20T10:06:06.560815+0000","last_peered":"2023-07-20T10:06:06.560815+0000","last_clean":"2023-07-20T10:06:06.560815+0000","last_became_active":"2023-07-20T10:06:04.026047+0000","last_became_peered":"2023-07-20T10:06:04.026047+0000","last_unstale":"2023-07-20T10:06:06.560815+0000","last_undegraded":"2023-07-20T10:06:06.560815+0000","last_fullsized":"2023-07-20T10:06:06.560815+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:04:13.652991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407980+0000","last_change":"2023-07-20T10:06:05.044485+0000","last_active":"2023-07-20T10:06:06.407980+0000","last_peered":"2023-07-20T10:06:06.407980+0000","last_clean":"2023-07-20T10:06:06.407980+0000","last_became_active":"2023-07-20T10:06:05.044206+0000","last_became_peered":"2023-07-20T10:06:05.044206+0000","last_unstale":"2023-07-20T10:06:06.407980+0000","last_undegraded":"2023-07-20T10:06:06.407980+0000","last_fullsized":"2023-07-20T10:06:06.407980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:08.144096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019257+0000","last_change":"2023-07-20T10:06:04.033740+0000","last_active":"2023-07-20T10:06:06.019257+0000","last_peered":"2023-07-20T10:06:06.019257+0000","last_clean":"2023-07-20T10:06:06.019257+0000","last_became_active":"2023-07-20T10:06:04.033441+0000","last_became_peered":"2023-07-20T10:06:04.033441+0000","last_unstale":"2023-07-20T10:06:06.019257+0000","last_undegraded":"2023-07-20T10:06:06.019257+0000","last_fullsized":"2023-07-20T10:06:06.019257+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:51.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565159+0000","last_change":"2023-07-20T10:06:05.049657+0000","last_active":"2023-07-20T10:06:06.565159+0000","last_peered":"2023-07-20T10:06:06.565159+0000","last_clean":"2023-07-20T10:06:06.565159+0000","last_became_active":"2023-07-20T10:06:05.049370+0000","last_became_peered":"2023-07-20T10:06:05.049370+0000","last_unstale":"2023-07-20T10:06:06.565159+0000","last_undegraded":"2023-07-20T10:06:06.565159+0000","last_fullsized":"2023-07-20T10:06:06.565159+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:22.311872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561484+0000","last_change":"2023-07-20T10:06:04.030423+0000","last_active":"2023-07-20T10:06:06.561484+0000","last_peered":"2023-07-20T10:06:06.561484+0000","last_clean":"2023-07-20T10:06:06.561484+0000","last_became_active":"2023-07-20T10:06:04.030140+0000","last_became_peered":"2023-07-20T10:06:04.030140+0000","last_unstale":"2023-07-20T10:06:06.561484+0000","last_undegraded":"2023-07-20T10:06:06.561484+0000","last_fullsized":"2023-07-20T10:06:06.561484+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:42.035494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.407937+0000","last_change":"2023-07-20T10:06:05.029942+0000","last_active":"2023-07-20T10:06:06.407937+0000","last_peered":"2023-07-20T10:06:06.407937+0000","last_clean":"2023-07-20T10:06:06.407937+0000","last_became_active":"2023-07-20T10:06:05.029382+0000","last_became_peered":"2023-07-20T10:06:05.029382+0000","last_unstale":"2023-07-20T10:06:06.407937+0000","last_undegraded":"2023-07-20T10:06:06.407937+0000","last_fullsized":"2023-07-20T10:06:06.407937+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:41:22.729844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565334+0000","last_change":"2023-07-20T10:06:04.031020+0000","last_active":"2023-07-20T10:06:06.565334+0000","last_peered":"2023-07-20T10:06:06.565334+0000","last_clean":"2023-07-20T10:06:06.565334+0000","last_became_active":"2023-07-20T10:06:04.030738+0000","last_became_peered":"2023-07-20T10:06:04.030738+0000","last_unstale":"2023-07-20T10:06:06.565334+0000","last_undegraded":"2023-07-20T10:06:06.565334+0000","last_fullsized":"2023-07-20T10:06:06.565334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:02.434817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561154+0000","last_change":"2023-07-20T10:06:05.041399+0000","last_active":"2023-07-20T10:06:06.561154+0000","last_peered":"2023-07-20T10:06:06.561154+0000","last_clean":"2023-07-20T10:06:06.561154+0000","last_became_active":"2023-07-20T10:06:05.041105+0000","last_became_peered":"2023-07-20T10:06:05.041105+0000","last_unstale":"2023-07-20T10:06:06.561154+0000","last_undegraded":"2023-07-20T10:06:06.561154+0000","last_fullsized":"2023-07-20T10:06:06.561154+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:55:53.266587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565363+0000","last_change":"2023-07-20T10:06:04.031439+0000","last_active":"2023-07-20T10:06:06.565363+0000","last_peered":"2023-07-20T10:06:06.565363+0000","last_clean":"2023-07-20T10:06:06.565363+0000","last_became_active":"2023-07-20T10:06:04.031137+0000","last_became_peered":"2023-07-20T10:06:04.031137+0000","last_unstale":"2023-07-20T10:06:06.565363+0000","last_undegraded":"2023-07-20T10:06:06.565363+0000","last_fullsized":"2023-07-20T10:06:06.565363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:01.084126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565051+0000","last_change":"2023-07-20T10:06:05.049777+0000","last_active":"2023-07-20T10:06:06.565051+0000","last_peered":"2023-07-20T10:06:06.565051+0000","last_clean":"2023-07-20T10:06:06.565051+0000","last_became_active":"2023-07-20T10:06:05.049495+0000","last_became_peered":"2023-07-20T10:06:05.049495+0000","last_unstale":"2023-07-20T10:06:06.565051+0000","last_undegraded":"2023-07-20T10:06:06.565051+0000","last_fullsized":"2023-07-20T10:06:06.565051+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:25.317365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565219+0000","last_change":"2023-07-20T10:06:04.035200+0000","last_active":"2023-07-20T10:06:06.565219+0000","last_peered":"2023-07-20T10:06:06.565219+0000","last_clean":"2023-07-20T10:06:06.565219+0000","last_became_active":"2023-07-20T10:06:04.034920+0000","last_became_peered":"2023-07-20T10:06:04.034920+0000","last_unstale":"2023-07-20T10:06:06.565219+0000","last_undegraded":"2023-07-20T10:06:06.565219+0000","last_fullsized":"2023-07-20T10:06:06.565219+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:21.941408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565666+0000","last_change":"2023-07-20T10:06:05.040875+0000","last_active":"2023-07-20T10:06:06.565666+0000","last_peered":"2023-07-20T10:06:06.565666+0000","last_clean":"2023-07-20T10:06:06.565666+0000","last_became_active":"2023-07-20T10:06:05.040586+0000","last_became_peered":"2023-07-20T10:06:05.040586+0000","last_unstale":"2023-07-20T10:06:06.565666+0000","last_undegraded":"2023-07-20T10:06:06.565666+0000","last_fullsized":"2023-07-20T10:06:06.565666+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:11.945352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014510+0000","last_change":"2023-07-20T10:06:04.031467+0000","last_active":"2023-07-20T10:06:06.014510+0000","last_peered":"2023-07-20T10:06:06.014510+0000","last_clean":"2023-07-20T10:06:06.014510+0000","last_became_active":"2023-07-20T10:06:04.031193+0000","last_became_peered":"2023-07-20T10:06:04.031193+0000","last_unstale":"2023-07-20T10:06:06.014510+0000","last_undegraded":"2023-07-20T10:06:06.014510+0000","last_fullsized":"2023-07-20T10:06:06.014510+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:12:58.644065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016808+0000","last_change":"2023-07-20T10:06:05.042402+0000","last_active":"2023-07-20T10:06:06.016808+0000","last_peered":"2023-07-20T10:06:06.016808+0000","last_clean":"2023-07-20T10:06:06.016808+0000","last_became_active":"2023-07-20T10:06:05.042153+0000","last_became_peered":"2023-07-20T10:06:05.042153+0000","last_unstale":"2023-07-20T10:06:06.016808+0000","last_undegraded":"2023-07-20T10:06:06.016808+0000","last_fullsized":"2023-07-20T10:06:06.016808+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:03:38.627202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565285+0000","last_change":"2023-07-20T10:06:04.036252+0000","last_active":"2023-07-20T10:06:06.565285+0000","last_peered":"2023-07-20T10:06:06.565285+0000","last_clean":"2023-07-20T10:06:06.565285+0000","last_became_active":"2023-07-20T10:06:04.035895+0000","last_became_peered":"2023-07-20T10:06:04.035895+0000","last_unstale":"2023-07-20T10:06:06.565285+0000","last_undegraded":"2023-07-20T10:06:06.565285+0000","last_fullsized":"2023-07-20T10:06:06.565285+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:32.240970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016866+0000","last_change":"2023-07-20T10:06:05.041915+0000","last_active":"2023-07-20T10:06:06.016866+0000","last_peered":"2023-07-20T10:06:06.016866+0000","last_clean":"2023-07-20T10:06:06.016866+0000","last_became_active":"2023-07-20T10:06:05.041588+0000","last_became_peered":"2023-07-20T10:06:05.041588+0000","last_unstale":"2023-07-20T10:06:06.016866+0000","last_undegraded":"2023-07-20T10:06:06.016866+0000","last_fullsized":"2023-07-20T10:06:06.016866+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:06:12.111341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016194+0000","last_change":"2023-07-20T10:06:04.030099+0000","last_active":"2023-07-20T10:06:06.016194+0000","last_peered":"2023-07-20T10:06:06.016194+0000","last_clean":"2023-07-20T10:06:06.016194+0000","last_became_active":"2023-07-20T10:06:04.029635+0000","last_became_peered":"2023-07-20T10:06:04.029635+0000","last_unstale":"2023-07-20T10:06:06.016194+0000","last_undegraded":"2023-07-20T10:06:06.016194+0000","last_fullsized":"2023-07-20T10:06:06.016194+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:02:59.228281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565239+0000","last_change":"2023-07-20T10:06:05.047083+0000","last_active":"2023-07-20T10:06:06.565239+0000","last_peered":"2023-07-20T10:06:06.565239+0000","last_clean":"2023-07-20T10:06:06.565239+0000","last_became_active":"2023-07-20T10:06:05.046549+0000","last_became_peered":"2023-07-20T10:06:05.046549+0000","last_unstale":"2023-07-20T10:06:06.565239+0000","last_undegraded":"2023-07-20T10:06:06.565239+0000","last_fullsized":"2023-07-20T10:06:06.565239+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:45.278322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561829+0000","last_change":"2023-07-20T10:06:04.029970+0000","last_active":"2023-07-20T10:06:06.561829+0000","last_peered":"2023-07-20T10:06:06.561829+0000","last_clean":"2023-07-20T10:06:06.561829+0000","last_became_active":"2023-07-20T10:06:04.029676+0000","last_became_peered":"2023-07-20T10:06:04.029676+0000","last_unstale":"2023-07-20T10:06:06.561829+0000","last_undegraded":"2023-07-20T10:06:06.561829+0000","last_fullsized":"2023-07-20T10:06:06.561829+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:49:47.400172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"83'172","reported_seq":501,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565380+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:06.565380+0000","last_peered":"2023-07-20T10:06:06.565380+0000","last_clean":"2023-07-20T10:06:06.565380+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:06.565380+0000","last_undegraded":"2023-07-20T10:06:06.565380+0000","last_fullsized":"2023-07-20T10:06:06.565380+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:37.385277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.018976+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:06.018976+0000","last_peered":"2023-07-20T10:06:06.018976+0000","last_clean":"2023-07-20T10:06:06.018976+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:06.018976+0000","last_undegraded":"2023-07-20T10:06:06.018976+0000","last_fullsized":"2023-07-20T10:06:06.018976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:32:59.549783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561374+0000","last_change":"2023-07-20T10:06:05.046142+0000","last_active":"2023-07-20T10:06:06.561374+0000","last_peered":"2023-07-20T10:06:06.561374+0000","last_clean":"2023-07-20T10:06:06.561374+0000","last_became_active":"2023-07-20T10:06:05.045819+0000","last_became_peered":"2023-07-20T10:06:05.045819+0000","last_unstale":"2023-07-20T10:06:06.561374+0000","last_undegraded":"2023-07-20T10:06:06.561374+0000","last_fullsized":"2023-07-20T10:06:06.561374+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:29.508447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561245+0000","last_change":"2023-07-20T10:06:04.026867+0000","last_active":"2023-07-20T10:06:06.561245+0000","last_peered":"2023-07-20T10:06:06.561245+0000","last_clean":"2023-07-20T10:06:06.561245+0000","last_became_active":"2023-07-20T10:06:04.026540+0000","last_became_peered":"2023-07-20T10:06:04.026540+0000","last_unstale":"2023-07-20T10:06:06.561245+0000","last_undegraded":"2023-07-20T10:06:06.561245+0000","last_fullsized":"2023-07-20T10:06:06.561245+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:57.587221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.564657+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:06.564657+0000","last_peered":"2023-07-20T10:06:06.564657+0000","last_clean":"2023-07-20T10:06:06.564657+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:06.564657+0000","last_undegraded":"2023-07-20T10:06:06.564657+0000","last_fullsized":"2023-07-20T10:06:06.564657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:20:42.929117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566050+0000","last_change":"2023-07-20T10:06:05.039311+0000","last_active":"2023-07-20T10:06:06.566050+0000","last_peered":"2023-07-20T10:06:06.566050+0000","last_clean":"2023-07-20T10:06:06.566050+0000","last_became_active":"2023-07-20T10:06:05.038935+0000","last_became_peered":"2023-07-20T10:06:05.038935+0000","last_unstale":"2023-07-20T10:06:06.566050+0000","last_undegraded":"2023-07-20T10:06:06.566050+0000","last_fullsized":"2023-07-20T10:06:06.566050+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:05:44.135239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561216+0000","last_change":"2023-07-20T10:06:04.026770+0000","last_active":"2023-07-20T10:06:06.561216+0000","last_peered":"2023-07-20T10:06:06.561216+0000","last_clean":"2023-07-20T10:06:06.561216+0000","last_became_active":"2023-07-20T10:06:04.026487+0000","last_became_peered":"2023-07-20T10:06:04.026487+0000","last_unstale":"2023-07-20T10:06:06.561216+0000","last_undegraded":"2023-07-20T10:06:06.561216+0000","last_fullsized":"2023-07-20T10:06:06.561216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:46.129007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014166+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:06.014166+0000","last_peered":"2023-07-20T10:06:06.014166+0000","last_clean":"2023-07-20T10:06:06.014166+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:06.014166+0000","last_undegraded":"2023-07-20T10:06:06.014166+0000","last_fullsized":"2023-07-20T10:06:06.014166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:15.218167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.560934+0000","last_change":"2023-07-20T10:06:05.039783+0000","last_active":"2023-07-20T10:06:06.560934+0000","last_peered":"2023-07-20T10:06:06.560934+0000","last_clean":"2023-07-20T10:06:06.560934+0000","last_became_active":"2023-07-20T10:06:05.039168+0000","last_became_peered":"2023-07-20T10:06:05.039168+0000","last_unstale":"2023-07-20T10:06:06.560934+0000","last_undegraded":"2023-07-20T10:06:06.560934+0000","last_fullsized":"2023-07-20T10:06:06.560934+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:16.845759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561463+0000","last_change":"2023-07-20T10:06:04.029986+0000","last_active":"2023-07-20T10:06:06.561463+0000","last_peered":"2023-07-20T10:06:06.561463+0000","last_clean":"2023-07-20T10:06:06.561463+0000","last_became_active":"2023-07-20T10:06:04.029712+0000","last_became_peered":"2023-07-20T10:06:04.029712+0000","last_unstale":"2023-07-20T10:06:06.561463+0000","last_undegraded":"2023-07-20T10:06:06.561463+0000","last_fullsized":"2023-07-20T10:06:06.561463+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:37.032211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.019147+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:06.019147+0000","last_peered":"2023-07-20T10:06:06.019147+0000","last_clean":"2023-07-20T10:06:06.019147+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:06.019147+0000","last_undegraded":"2023-07-20T10:06:06.019147+0000","last_fullsized":"2023-07-20T10:06:06.019147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:10.772811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014259+0000","last_change":"2023-07-20T10:06:05.043001+0000","last_active":"2023-07-20T10:06:06.014259+0000","last_peered":"2023-07-20T10:06:06.014259+0000","last_clean":"2023-07-20T10:06:06.014259+0000","last_became_active":"2023-07-20T10:06:05.042682+0000","last_became_peered":"2023-07-20T10:06:05.042682+0000","last_unstale":"2023-07-20T10:06:06.014259+0000","last_undegraded":"2023-07-20T10:06:06.014259+0000","last_fullsized":"2023-07-20T10:06:06.014259+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:09.032897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014774+0000","last_change":"2023-07-20T10:06:04.028773+0000","last_active":"2023-07-20T10:06:06.014774+0000","last_peered":"2023-07-20T10:06:06.014774+0000","last_clean":"2023-07-20T10:06:06.014774+0000","last_became_active":"2023-07-20T10:06:04.028476+0000","last_became_peered":"2023-07-20T10:06:04.028476+0000","last_unstale":"2023-07-20T10:06:06.014774+0000","last_undegraded":"2023-07-20T10:06:06.014774+0000","last_fullsized":"2023-07-20T10:06:06.014774+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:17:18.247321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016593+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:06.016593+0000","last_peered":"2023-07-20T10:06:06.016593+0000","last_clean":"2023-07-20T10:06:06.016593+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:06.016593+0000","last_undegraded":"2023-07-20T10:06:06.016593+0000","last_fullsized":"2023-07-20T10:06:06.016593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:06:24.613255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561362+0000","last_change":"2023-07-20T10:06:05.037745+0000","last_active":"2023-07-20T10:06:06.561362+0000","last_peered":"2023-07-20T10:06:06.561362+0000","last_clean":"2023-07-20T10:06:06.561362+0000","last_became_active":"2023-07-20T10:06:05.037480+0000","last_became_peered":"2023-07-20T10:06:05.037480+0000","last_unstale":"2023-07-20T10:06:06.561362+0000","last_undegraded":"2023-07-20T10:06:06.561362+0000","last_fullsized":"2023-07-20T10:06:06.561362+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:46.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016525+0000","last_change":"2023-07-20T10:06:04.033788+0000","last_active":"2023-07-20T10:06:06.016525+0000","last_peered":"2023-07-20T10:06:06.016525+0000","last_clean":"2023-07-20T10:06:06.016525+0000","last_became_active":"2023-07-20T10:06:04.033519+0000","last_became_peered":"2023-07-20T10:06:04.033519+0000","last_unstale":"2023-07-20T10:06:06.016525+0000","last_undegraded":"2023-07-20T10:06:06.016525+0000","last_fullsized":"2023-07-20T10:06:06.016525+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:24.706130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565402+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:06.565402+0000","last_peered":"2023-07-20T10:06:06.565402+0000","last_clean":"2023-07-20T10:06:06.565402+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:06.565402+0000","last_undegraded":"2023-07-20T10:06:06.565402+0000","last_fullsized":"2023-07-20T10:06:06.565402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:54:07.031856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.561155+0000","last_change":"2023-07-20T10:06:05.037168+0000","last_active":"2023-07-20T10:06:06.561155+0000","last_peered":"2023-07-20T10:06:06.561155+0000","last_clean":"2023-07-20T10:06:06.561155+0000","last_became_active":"2023-07-20T10:06:05.036894+0000","last_became_peered":"2023-07-20T10:06:05.036894+0000","last_unstale":"2023-07-20T10:06:06.561155+0000","last_undegraded":"2023-07-20T10:06:06.561155+0000","last_fullsized":"2023-07-20T10:06:06.561155+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:13.775277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.565140+0000","last_change":"2023-07-20T10:06:04.033251+0000","last_active":"2023-07-20T10:06:06.565140+0000","last_peered":"2023-07-20T10:06:06.565140+0000","last_clean":"2023-07-20T10:06:06.565140+0000","last_became_active":"2023-07-20T10:06:04.032902+0000","last_became_peered":"2023-07-20T10:06:04.032902+0000","last_unstale":"2023-07-20T10:06:06.565140+0000","last_undegraded":"2023-07-20T10:06:06.565140+0000","last_fullsized":"2023-07-20T10:06:06.565140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:25.780484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.016891+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:06.016891+0000","last_peered":"2023-07-20T10:06:06.016891+0000","last_clean":"2023-07-20T10:06:06.016891+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:06.016891+0000","last_undegraded":"2023-07-20T10:06:06.016891+0000","last_fullsized":"2023-07-20T10:06:06.016891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:13:26.945694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.014077+0000","last_change":"2023-07-20T10:06:05.038534+0000","last_active":"2023-07-20T10:06:06.014077+0000","last_peered":"2023-07-20T10:06:06.014077+0000","last_clean":"2023-07-20T10:06:06.014077+0000","last_became_active":"2023-07-20T10:06:05.038136+0000","last_became_peered":"2023-07-20T10:06:05.038136+0000","last_unstale":"2023-07-20T10:06:06.014077+0000","last_undegraded":"2023-07-20T10:06:06.014077+0000","last_fullsized":"2023-07-20T10:06:06.014077+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:03.996620+0000","last_clean_scrub_stamp":"2023-07-20T10:06:03.996620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:55.305110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.408214+0000","last_change":"2023-07-20T10:06:04.032699+0000","last_active":"2023-07-20T10:06:06.408214+0000","last_peered":"2023-07-20T10:06:06.408214+0000","last_clean":"2023-07-20T10:06:06.408214+0000","last_became_active":"2023-07-20T10:06:04.032218+0000","last_became_peered":"2023-07-20T10:06:04.032218+0000","last_unstale":"2023-07-20T10:06:06.408214+0000","last_undegraded":"2023-07-20T10:06:06.408214+0000","last_fullsized":"2023-07-20T10:06:06.408214+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:02.984206+0000","last_clean_scrub_stamp":"2023-07-20T10:06:02.984206+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:41:23.284483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2023-07-20T10:06:06.566003+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:06.566003+0000","last_peered":"2023-07-20T10:06:06.566003+0000","last_clean":"2023-07-20T10:06:06.566003+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:06.566003+0000","last_undegraded":"2023-07-20T10:06:06.566003+0000","last_fullsized":"2023-07-20T10:06:06.566003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:38:32.848634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":596,"num_read_kb":1130,"num_write":259,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312780,"statfs":{"total":96636764160,"available":96576286720,"internally_reserved":0,"allocated":1744896,"data_stored":1161725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.434},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834575041,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1159168,"data_stored":572899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.628},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575039,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1150976,"data_stored":571369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.628},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1167360,"data_stored":573003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.70699999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":0.84499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.47799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96899999999999997,"5min":1.0580000000000001,"15min":1.085},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.70399999999999996,"15min":0.71899999999999997},"min":{"1min":0.54900000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.141},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.69099999999999995,"15min":0.70799999999999996},"min":{"1min":0.40799999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98599999999999999,"5min":1.22,"15min":1.363},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.442,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.177},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.0049999999999999,"5min":1.204,"15min":1.3620000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.61799999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91300000000000003,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.59299999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.95299999999999996,"5min":0.97799999999999998,"15min":1.212},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.42099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":1.4770000000000001},"last":0.745},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.64600000000000002},"min":{"1min":0.48699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.877,"5min":0.90500000000000003,"15min":1.196},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60499999999999998,"15min":0.58799999999999997},"min":{"1min":0.48899999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.4970000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69499999999999995,"15min":0.71199999999999997},"min":{"1min":0.57499999999999996,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89500000000000002,"5min":0.96299999999999997,"15min":1.538},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.33300000000000002},"max":{"1min":0.82899999999999996,"5min":0.91400000000000003,"15min":1.3859999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.40699999999999997},"max":{"1min":0.85899999999999999,"5min":0.93400000000000005,"15min":1.597},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1150976,"data_stored":571917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46600000000000003},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.56399999999999995,"5min":0.79600000000000004,"15min":4.7699999999999996},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.29999999999999999,"15min":0.28299999999999997},"max":{"1min":0.61699999999999999,"5min":0.68700000000000006,"15min":4.8239999999999998},"last":0.375}]},{"osd":1,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46899999999999997,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.54600000000000004,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.51200000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.66900000000000004,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.70099999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56399999999999995,"15min":0.57699999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.84499999999999997,"15min":1.099},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.747,"15min":0.77200000000000002},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.9830000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":1.016,"5min":1.071,"15min":1.381},"last":0.81499999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48299999999999998},"max":{"1min":0.97499999999999998,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":1.052,"15min":1.3260000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77800000000000002,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.01,"5min":1.1160000000000001,"15min":1.274},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75600000000000001,"15min":0.77300000000000002},"min":{"1min":0.54400000000000004,"5min":0.504,"15min":0.502},"max":{"1min":1.04,"5min":1.04,"15min":1.1950000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:37 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.755,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.96199999999999997,"5min":1.0189999999999999,"15min":1.4399999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.58199999999999996,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0549999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54396,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317444,"statfs":{"total":96636764160,"available":96581062656,"internally_reserved":0,"allocated":1159168,"data_stored":572077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.441}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.38},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.879}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1155072,"data_stored":571447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36916,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334924,"statfs":{"total":96636764160,"available":96598962176,"internally_reserved":0,"allocated":1740800,"data_stored":1161703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.876},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.81299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:13.929 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:06:13.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:06:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 Processor -- start 2023-07-20T10:06:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 -- start start 2023-07-20T10:06:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2a8161de0 0x7fc2a80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80b06e0 con 0x7fc2a80b0290 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80c9370 con 0x7fc2a8160ba0 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2b0256640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80c9650 con 0x7fc2a8161de0 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2a8161de0 0x7fc2a80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2a8161de0 0x7fc2a80afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39710/0 (socket says 172.21.15.82:39710) 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/1172280132 learned_addr learned my addr 172.21.15.82:0/1172280132 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ae7f3640 1 --1- 172.21.15.82:0/1172280132 >> v1:172.21.15.82:6789/0 conn(0x7fc2a80b0290 0x7fc2a80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43294/0 (socket says 172.21.15.82:43294) 2023-07-20T10:06:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/1172280132 >> v1:172.21.15.183:6789/0 conn(0x7fc2a8160ba0 legacy=0x7fc2a80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/1172280132 >> v1:172.21.15.82:6789/0 conn(0x7fc2a80b0290 legacy=0x7fc2a80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2acff0640 1 -- 172.21.15.82:0/1172280132 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706904686 0 0) 0x7fc2a00014a0 con 0x7fc2a80b0290 2023-07-20T10:06:14.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.130+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/1172280132 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a8161300 con 0x7fc2a8161de0 2023-07-20T10:06:14.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2ad7f1640 1 --2- 172.21.15.82:0/1172280132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8161de0 0x7fc2a80afd50 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc298009870 tx=0x7fc29801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9a95a80b470729 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2acff0640 1 -- 172.21.15.82:0/1172280132 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980a6040 con 0x7fc2a8161de0 2023-07-20T10:06:14.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2acff0640 1 -- 172.21.15.82:0/1172280132 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980aa600 con 0x7fc2a8161de0 2023-07-20T10:06:14.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2acff0640 1 -- 172.21.15.82:0/1172280132 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980aa990 con 0x7fc2a8161de0 2023-07-20T10:06:14.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 -- 172.21.15.82:0/1172280132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8161de0 msgr2=0x7fc2a80afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 --2- 172.21.15.82:0/1172280132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8161de0 0x7fc2a80afd50 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc298009870 tx=0x7fc29801c510 comp rx=0 tx=0).stop 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 -- 172.21.15.82:0/1172280132 shutdown_connections 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 --2- 172.21.15.82:0/1172280132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8161de0 0x7fc2a80afd50 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 -- 172.21.15.82:0/1172280132 >> 172.21.15.82:0/1172280132 conn(0x7fc2a80cad50 msgr2=0x7fc2a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 -- 172.21.15.82:0/1172280132 shutdown_connections 2023-07-20T10:06:14.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.134+0000 7fc2b0256640 1 -- 172.21.15.82:0/1172280132 wait complete. 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 Processor -- start 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- start start 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2a80b0290 0x7fc2a80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2a8161de0 0x7fc2a80b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81619c0 con 0x7fc2a8160ba0 2023-07-20T10:06:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80b3c20 con 0x7fc2a80b0290 2023-07-20T10:06:14.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8157740 con 0x7fc2a8161de0 2023-07-20T10:06:14.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39712/0 (socket says 172.21.15.82:39712) 2023-07-20T10:06:14.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/567411515 learned_addr learned my addr 172.21.15.82:0/567411515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:14.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ae7f3640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2a8161de0 0x7fc2a80b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2adff2640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2a80b0290 0x7fc2a80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2a8161de0 msgr2=0x7fc2a80b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2a8161de0 0x7fc2a80b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2a80b0290 msgr2=0x7fc2a80c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2a80b0290 0x7fc2a80c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 -- 172.21.15.82:0/567411515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980094d0 con 0x7fc2a8160ba0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2ad7f1640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc298019120 tx=0x7fc29801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980aad70 con 0x7fc2a8160ba0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980b7070 con 0x7fc2a8160ba0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298004270 con 0x7fc2a8160ba0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a8156e10 con 0x7fc2a8160ba0 2023-07-20T10:06:14.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.138+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a81573d0 con 0x7fc2a8160ba0 2023-07-20T10:06:14.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a8157560 con 0x7fc2a8160ba0 2023-07-20T10:06:14.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc2980043d0 con 0x7fc2a8160ba0 2023-07-20T10:06:14.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc29e7fc640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 0x7fc28c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc29811e380 con 0x7fc2a8160ba0 2023-07-20T10:06:14.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc2adff2640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 0x7fc28c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.142+0000 7fc2adff2640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 0x7fc28c068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000f70 tx=0x7fc2a4009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.146+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2980eb6e0 con 0x7fc2a8160ba0 2023-07-20T10:06:14.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.346+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc2a804da30 con 0x7fc2a8160ba0 2023-07-20T10:06:14.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc29e7fc640 1 -- 172.21.15.82:0/567411515 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fc2980eed00 con 0x7fc2a8160ba0 2023-07-20T10:06:14.333 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:06:14.333 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:06:14.334 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:06:14.334 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:06:14.334 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:06:14.334 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:06:14.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 msgr2=0x7fc28c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 0x7fc28c068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4000f70 tx=0x7fc2a4009040 comp rx=0 tx=0).stop 2023-07-20T10:06:14.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 msgr2=0x7fc2a80b0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc298019120 tx=0x7fc29801ad50 comp rx=0 tx=0).stop 2023-07-20T10:06:14.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 shutdown_connections 2023-07-20T10:06:14.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc28c0663a0 0x7fc28c068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2a8161de0 0x7fc2a80b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2a8160ba0 0x7fc2a80b0d60 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 --2- 172.21.15.82:0/567411515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2a80b0290 0x7fc2a80c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 >> 172.21.15.82:0/567411515 conn(0x7fc2a80cad50 msgr2=0x7fc2a8070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:14.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 shutdown_connections 2023-07-20T10:06:14.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.354+0000 7fc2b0256640 1 -- 172.21.15.82:0/567411515 wait complete. 2023-07-20T10:06:14.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.510+0000 7f5490967640 1 Processor -- start 2023-07-20T10:06:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.510+0000 7f5490967640 1 -- start start 2023-07-20T10:06:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5490967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f548c15dbb0 0x7f548c0cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5490967640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c0ad810 con 0x7f548c0b2a90 2023-07-20T10:06:14.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5490967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c15d0d0 con 0x7f548c1596b0 2023-07-20T10:06:14.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5490967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c15e000 con 0x7f548c15dbb0 2023-07-20T10:06:14.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5489d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f548c0b2a90 0x7f548c0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43296/0 (socket says 172.21.15.82:43296) 2023-07-20T10:06:14.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5489d9b640 1 -- 172.21.15.82:0/2721176240 learned_addr learned my addr 172.21.15.82:0/2721176240 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 --2- 172.21.15.82:0/2721176240 >> v2:172.21.15.183:3300/0 conn(0x7f548c15dbb0 0x7f548c0cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427714846 0 0) 0x7f548c0ad810 con 0x7f548c0b2a90 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5474003530 con 0x7f548c0b2a90 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2049678185 0 0) 0x7f5474003530 con 0x7f548c0b2a90 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 >> v2:172.21.15.183:3300/0 conn(0x7f548c15dbb0 msgr2=0x7f548c0cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 --2- 172.21.15.82:0/2721176240 >> v2:172.21.15.183:3300/0 conn(0x7f548c15dbb0 0x7f548c0cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 >> v1:172.21.15.183:6789/0 conn(0x7f548c1596b0 legacy=0x7f548c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c15d3b0 con 0x7f548c0b2a90 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f5480001680 con 0x7f548c0b2a90 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 >> v1:172.21.15.82:6789/0 conn(0x7f548c0b2a90 legacy=0x7f548c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5474003980 0x7f5474003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54740047d0 0x7f5474004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 0x7f547400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15e000 con 0x7f5474005190 2023-07-20T10:06:14.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547400c030 con 0x7f54740047d0 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547400c1f0 con 0x7f5474003980 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 0x7f547400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f5489d9b640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54740047d0 0x7f5474004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548a59c640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5474003980 0x7f5474003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 -- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5474003980 msgr2=0x7f5474003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5474003980 0x7f5474003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 -- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54740047d0 msgr2=0x7f5474004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:14.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54740047d0 0x7f5474004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.514+0000 7f548ad9d640 1 -- 172.21.15.82:0/2721176240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474003530 con 0x7f5474005190 2023-07-20T10:06:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f548ad9d640 1 -- 172.21.15.82:0/2721176240 reap_dead start 2023-07-20T10:06:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f548ad9d640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 0x7f547400b990 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5484009fc0 tx=0x7f548401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ebbb3144f02ce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840a5cb0 con 0x7f5474005190 2023-07-20T10:06:14.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548400f040 con 0x7f5474005190 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f548959a640 1 -- 172.21.15.82:0/2721176240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484003be0 con 0x7f5474005190 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 -- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 msgr2=0x7f547400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 0x7f547400b990 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f5484009fc0 tx=0x7f548401cca0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 -- 172.21.15.82:0/2721176240 shutdown_connections 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 --2- 172.21.15.82:0/2721176240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5474005190 0x7f547400b990 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 -- 172.21.15.82:0/2721176240 >> 172.21.15.82:0/2721176240 conn(0x7f548c0cada0 msgr2=0x7f548c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 -- 172.21.15.82:0/2721176240 shutdown_connections 2023-07-20T10:06:14.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.518+0000 7f5490967640 1 -- 172.21.15.82:0/2721176240 wait complete. 2023-07-20T10:06:14.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 Processor -- start 2023-07-20T10:06:14.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- start start 2023-07-20T10:06:14.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5474005190 0x7f548c140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548c154210 0x7f548c0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0cce40 con 0x7f548c156490 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c140900 con 0x7f5474005190 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c140640 con 0x7f548c154210 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39734/0 (socket says 172.21.15.82:39734) 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 -- 172.21.15.82:0/3096880062 learned_addr learned my addr 172.21.15.82:0/3096880062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:14.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548a59c640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5474005190 0x7f548c140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5489d9b640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548c154210 0x7f548c0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 -- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548c154210 msgr2=0x7f548c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548c154210 0x7f548c0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 -- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5474005190 msgr2=0x7f548c140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5474005190 0x7f548c140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 -- 172.21.15.82:0/3096880062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c15c300 con 0x7f548c156490 2023-07-20T10:06:14.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f548ad9d640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f548401c710 tx=0x7f5484009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484003db0 con 0x7f548c156490 2023-07-20T10:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5484004030 con 0x7f548c156490 2023-07-20T10:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c15c5e0 con 0x7f548c156490 2023-07-20T10:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5484004420 con 0x7f548c156490 2023-07-20T10:06:14.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.522+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c155c90 con 0x7f548c156490 2023-07-20T10:06:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c073c70 con 0x7f548c156490 2023-07-20T10:06:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5484004580 con 0x7f548c156490 2023-07-20T10:06:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f547affd640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 0x7f546c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:14.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f548411f8c0 con 0x7f548c156490 2023-07-20T10:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f548a59c640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 0x7f546c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:14.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.526+0000 7f548a59c640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 0x7f546c068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f547c001660 tx=0x7f547c009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:14.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.530+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54840ecbb0 con 0x7f548c156490 2023-07-20T10:06:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f548c0c1b60 con 0x7f548c156490 2023-07-20T10:06:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f547affd640 1 -- 172.21.15.82:0/3096880062 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f54840f01d0 con 0x7f548c156490 2023-07-20T10:06:14.690 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:14.690 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 msgr2=0x7f546c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 0x7f546c068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f547c001660 tx=0x7f547c009040 comp rx=0 tx=0).stop 2023-07-20T10:06:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 msgr2=0x7f548c156910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f548401c710 tx=0x7f5484009750 comp rx=0 tx=0).stop 2023-07-20T10:06:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 shutdown_connections 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f546c0663c0 0x7f546c068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548c156490 0x7f548c156910 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548c154210 0x7f548c0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 --2- 172.21.15.82:0/3096880062 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5474005190 0x7f548c140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 >> 172.21.15.82:0/3096880062 conn(0x7f548c0cada0 msgr2=0x7f548c158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 shutdown_connections 2023-07-20T10:06:14.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:14.710+0000 7f5490967640 1 -- 172.21.15.82:0/3096880062 wait complete. 2023-07-20T10:06:15.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:06:04.392869+0000', 'modified': '2023-07-20T10:06:08.048002+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7224}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7224': {'gid': 7224, 'name': 'c', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/1048696572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 1048696572}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1048696572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:06:15.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:06:15.113 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T10:06:15.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 Processor -- start 2023-07-20T10:06:15.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 -- start start 2023-07-20T10:06:15.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a415cab0 0x7fc0a40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a40ce4c0 0x7fc0a40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40d16b0 con 0x7fc0a40d0d10 2023-07-20T10:06:15.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40d31c0 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a989c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40b3520 con 0x7fc0a415cab0 2023-07-20T10:06:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a40ce4c0 0x7fc0a40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0a40ce4c0 0x7fc0a40d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39736/0 (socket says 172.21.15.82:39736) 2023-07-20T10:06:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2003394504 learned_addr learned my addr 172.21.15.82:0/2003394504 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a415cab0 0x7fc0a40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2003394504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a415cab0 msgr2=0x7fc0a40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a415cab0 0x7fc0a40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2003394504 >> v1:172.21.15.183:6789/0 conn(0x7fc0a40d0d10 legacy=0x7fc0a40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.274+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2003394504 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40b2910 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a40ce4c0 0x7fc0a40d1170 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009e50 tx=0x7fc09c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b1aeaa67c020da server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a27fc640 1 -- 172.21.15.82:0/2003394504 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a57c0 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a27fc640 1 -- 172.21.15.82:0/2003394504 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0a5920 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a27fc640 1 -- 172.21.15.82:0/2003394504 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5cb0 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 -- 172.21.15.82:0/2003394504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a40ce4c0 msgr2=0x7fc0a40d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a40ce4c0 0x7fc0a40d1170 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009e50 tx=0x7fc09c01c9e0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 -- 172.21.15.82:0/2003394504 shutdown_connections 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a40ce4c0 0x7fc0a40d1170 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2003394504 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a415cab0 0x7fc0a40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 -- 172.21.15.82:0/2003394504 >> 172.21.15.82:0/2003394504 conn(0x7fc0a408c120 msgr2=0x7fc0a409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 -- 172.21.15.82:0/2003394504 shutdown_connections 2023-07-20T10:06:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.278+0000 7fc0a989c640 1 -- 172.21.15.82:0/2003394504 wait complete. 2023-07-20T10:06:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 Processor -- start 2023-07-20T10:06:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- start start 2023-07-20T10:06:15.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a40ce4c0 0x7fc0a4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0a40d0d10 0x7fc0a415df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4148730 con 0x7fc0a415cab0 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4156250 con 0x7fc0a40d0d10 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c8fe0 con 0x7fc0a40ce4c0 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39738/0 (socket says 172.21.15.82:39738) 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a2ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a40ce4c0 0x7fc0a4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2935653612 learned_addr learned my addr 172.21.15.82:0/2935653612 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0a40d0d10 0x7fc0a415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a40ce4c0 msgr2=0x7fc0a4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a40ce4c0 0x7fc0a4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0a40d0d10 msgr2=0x7fc0a415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0a40d0d10 0x7fc0a415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 -- 172.21.15.82:0/2935653612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009b30 con 0x7fc0a415cab0 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01a610 tx=0x7fc09c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a0ff9640 1 -- 172.21.15.82:0/2935653612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b8670 con 0x7fc0a415cab0 2023-07-20T10:06:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a0ff9640 1 -- 172.21.15.82:0/2935653612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0b87d0 con 0x7fc0a415cab0 2023-07-20T10:06:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a0ff9640 1 -- 172.21.15.82:0/2935653612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b8b60 con 0x7fc0a415cab0 2023-07-20T10:06:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a41564a0 con 0x7fc0a415cab0 2023-07-20T10:06:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.282+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4156a60 con 0x7fc0a415cab0 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0a0ff9640 1 -- 172.21.15.82:0/2935653612 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc09c0b8cc0 con 0x7fc0a415cab0 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0a0ff9640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 0x7fc084068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0a0ff9640 1 -- 172.21.15.82:0/2935653612 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc09c11f2b0 con 0x7fc0a415cab0 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 0x7fc084068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0acc0c000 1 Processor -- start 2023-07-20T10:06:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0acc0c000 1 -- start start 2023-07-20T10:06:15.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.286+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 0x7fc084068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc094006aa0 tx=0x7fc094008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5bb6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5bb7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a5a7e0a0 con 0x5646a5c00d20 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a5a0ce40 con 0x5646a5bb6e90 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646a5a0a370 con 0x5646a5c01640 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39742/0 (socket says 172.21.15.82:39742) 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 -- 172.21.15.82:0/3764266987 learned_addr learned my addr 172.21.15.82:0/3764266987 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5bb6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5bb7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 -- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 msgr2=0x5646a5bb6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5bb6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 -- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 msgr2=0x5646a5bb7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5bb7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 -- 172.21.15.82:0/3764266987 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646a5701890 con 0x5646a5c00d20 2023-07-20T10:06:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc0940041f0 tx=0x7fc094013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a485959a018e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0997fa640 1 -- 172.21.15.82:0/3764266987 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940038f0 con 0x5646a5c00d20 2023-07-20T10:06:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0997fa640 1 -- 172.21.15.82:0/3764266987 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094003a50 con 0x5646a5c00d20 2023-07-20T10:06:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0997fa640 1 -- 172.21.15.82:0/3764266987 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094003dc0 con 0x5646a5c00d20 2023-07-20T10:06:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3764266987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 msgr2=0x5646a5c01100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc0940041f0 tx=0x7fc094013000 comp rx=0 tx=0).stop 2023-07-20T10:06:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3764266987 shutdown_connections 2023-07-20T10:06:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5bb7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5bb6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3764266987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c01100 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3764266987 >> 172.21.15.82:0/3764266987 conn(0x5646a5bae200 msgr2=0x5646a5bb5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3764266987 shutdown_connections 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3764266987 wait complete. 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 -- start start 2023-07-20T10:06:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.290+0000 7fc0acc0c000 1 Processor -- start 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5bc1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 0x5646a5bc2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a5a05c60 con 0x5646a5c00d20 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a59c1ae0 con 0x5646a5c01640 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646a59c1780 con 0x5646a5bb6e90 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 10 client.0 _ll_register_callbacks cb 0x5646a5ba2820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:06:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39746/0 (socket says 172.21.15.82:39746) 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 -- 172.21.15.82:0/3115089966 learned_addr learned my addr 172.21.15.82:0/3115089966 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5bc1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 0x5646a5bc2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 -- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 msgr2=0x5646a5bc1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5bc1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 -- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 msgr2=0x5646a5bc2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 0x5646a5bc2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 -- 172.21.15.82:0/3115089966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09400e040 con 0x5646a5c00d20 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5bc1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 0x5646a5bc2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000f70 tx=0x7fc08c012750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff3feb6d7e217fc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:06:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01a030 con 0x5646a5c00d20 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc08c01b070 con 0x5646a5c00d20 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646a59c5fb0 con 0x5646a5c00d20 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08c005320 con 0x5646a5c00d20 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 10 client.7422 fetch_fsmap learned FSMap version 41 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5646a59c9d10 con 0x5646a5c00d20 2023-07-20T10:06:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c025020 con 0x5646a5c00d20 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc08c007030 con 0x5646a5c00d20 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 10 client.7422 fetch_fsmap finished waiting for FSMap version 41 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 10 client.7422 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 20 client.7422 populate_metadata read hostname 'smithi082' 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5bc31e0 0x5646a5c12290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 4 client.7422 mds_command: new command op to 7224 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 --> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646a5a34410 con 0x5646a5bc31e0 2023-07-20T10:06:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5bc31e0 0x5646a5c12290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5bc31e0 0x5646a5c12290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6981996450f6375f server_cookie=ab79d4ad690effbc in_seq=0 out_seq=0 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 10 client.7422 ms_handle_connect on v2:172.21.15.82:6836/1048696572 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 1 -- 172.21.15.82:0/3115089966 <== mds.0 v2:172.21.15.82:6836/1048696572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5646a5a34410 con 0x5646a5bc31e0 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 10 client.7422 handle_command_reply: tid=0 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 client.7422 shutdown 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 msgr2=0x5646a5bc2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000f70 tx=0x7fc08c012750 comp rx=0 tx=0).stop 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 shutdown_connections 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5bc31e0 0x5646a5c12290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c01640 0x5646a5bc2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5bc2400 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/3115089966 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5bc1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0827fc640 0 client.7422 ms_handle_reset on v2:172.21.15.82:6836/1048696572 2023-07-20T10:06:15.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.294+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 >> 172.21.15.82:0/3115089966 conn(0x5646a5bae200 msgr2=0x5646a5bb5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.298+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 shutdown_connections 2023-07-20T10:06:15.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.298+0000 7fc0acc0c000 1 -- 172.21.15.82:0/3115089966 wait complete. 2023-07-20T10:06:15.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.298+0000 7fc0acc0c000 20 client.7422 trim_cache size 0 max 16384 2023-07-20T10:06:15.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 Processor -- start 2023-07-20T10:06:15.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 -- start start 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5c006f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 0x5646a5bb8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a56c2940 con 0x5646a5c01640 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a5bb6bd0 con 0x5646a5c00d20 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.310+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646a59a22b0 con 0x5646a5bb6e90 2023-07-20T10:06:15.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39760/0 (socket says 172.21.15.82:39760) 2023-07-20T10:06:15.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 -- 172.21.15.82:0/197279162 learned_addr learned my addr 172.21.15.82:0/197279162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 -- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 msgr2=0x5646a5c006f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5c006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 0x5646a5bb8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5c006f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 -- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 msgr2=0x5646a5bb8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 0x5646a5bb8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 -- 172.21.15.82:0/197279162 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646a59affa0 con 0x5646a5c01640 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 0x5646a5bb8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5c006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01cec0 tx=0x7fc09c11f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7126a0a98491d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc099ffb640 1 -- 172.21.15.82:0/197279162 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0f4150 con 0x5646a5c01640 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc099ffb640 1 -- 172.21.15.82:0/197279162 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0f4320 con 0x5646a5c01640 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc099ffb640 1 -- 172.21.15.82:0/197279162 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0f86b0 con 0x5646a5c01640 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- 172.21.15.82:0/197279162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 msgr2=0x5646a5bb87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01cec0 tx=0x7fc09c11f040 comp rx=0 tx=0).stop 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- 172.21.15.82:0/197279162 shutdown_connections 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c01640 0x5646a5bb87c0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5c00d20 0x5646a5bb8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/197279162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5bb6e90 0x5646a5c006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- 172.21.15.82:0/197279162 >> 172.21.15.82:0/197279162 conn(0x5646a5bae200 msgr2=0x5646a5bff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- 172.21.15.82:0/197279162 shutdown_connections 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- 172.21.15.82:0/197279162 wait complete. 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- start start 2023-07-20T10:06:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 Processor -- start 2023-07-20T10:06:15.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5c5dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5c12ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a5a799c0 con 0x5646a5c00d20 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646a59fe1d0 con 0x5646a5bb6e90 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646a59c6730 con 0x5646a5c01640 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc0acc0c000 10 client.0 _ll_register_callbacks cb 0x5646a5a7dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc09a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc09a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39768/0 (socket says 172.21.15.82:39768) 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.314+0000 7fc09a7fc640 1 -- 172.21.15.82:0/2168466358 learned_addr learned my addr 172.21.15.82:0/2168466358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5c5dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a37fe640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5c12ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 -- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 msgr2=0x5646a5c12ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5c12ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 -- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 msgr2=0x5646a5c5dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5c5dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 -- 172.21.15.82:0/2168466358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4156a60 con 0x5646a5c00d20 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc09a7fc640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc08c005630 tx=0x7fc08c001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc95581caf45c223 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c01a040 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc08c026080 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646a5bb6d20 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc08c012c50 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 10 client.7428 fetch_fsmap learned FSMap version 41 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x5646a5701cc0 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646a5bb6d20 con 0x5646a5c00d20 2023-07-20T10:06:15.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 41) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc08c0067e0 con 0x5646a5c00d20 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 10 client.7428 fetch_fsmap finished waiting for FSMap version 41 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 10 client.7428 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 20 client.7428 populate_metadata read hostname 'smithi082' 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5c13430 0x5646a5c13810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 4 client.7428 mds_command: new command op to 7224 tid=0[{"prefix": "status"}] 2023-07-20T10:06:15.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 --> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5646a59cca20 con 0x5646a5c13430 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5c13430 0x5646a5c13810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 10 client.7428 ms_handle_connect on v2:172.21.15.82:6836/1048696572 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a2ffd640 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5c13430 0x5646a5c13810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f622109e9465ecb server_cookie=11a07bb7b7b2fd46 in_seq=0 out_seq=0 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 1 -- 172.21.15.82:0/2168466358 <== mds.0 v2:172.21.15.82:6836/1048696572 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5646a59cca20 con 0x5646a5c13430 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 10 client.7428 handle_command_reply: tid=0 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 client.7428 shutdown 2023-07-20T10:06:15.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 msgr2=0x5646a5c129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fc08c005630 tx=0x7fc08c001090 comp rx=0 tx=0).stop 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 shutdown_connections 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:6836/1048696572,v1:172.21.15.82:6837/1048696572] conn(0x5646a5c13430 0x5646a5c13810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5646a5c01640 0x5646a5c12ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646a5c00d20 0x5646a5c129b0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0827fc640 0 client.7428 ms_handle_reset on v2:172.21.15.82:6836/1048696572 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 --2- 172.21.15.82:0/2168466358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646a5bb6e90 0x5646a5c5dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 >> 172.21.15.82:0/2168466358 conn(0x5646a5bae200 msgr2=0x5646a5bbbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 shutdown_connections 2023-07-20T10:06:15.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 1 -- 172.21.15.82:0/2168466358 wait complete. 2023-07-20T10:06:15.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0acc0c000 20 client.7428 trim_cache size 0 max 16384 2023-07-20T10:06:15.308 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:06:15.308 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 7224, 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.312120066, 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 41, 2023-07-20T10:06:15.309 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 94, 2023-07-20T10:06:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 94, 2023-07-20T10:06:15.310 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.172334986999999 2023-07-20T10:06:15.310 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 msgr2=0x7fc084068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 0x7fc084068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc094006aa0 tx=0x7fc094008040 comp rx=0 tx=0).stop 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 msgr2=0x7fc0a415e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc09c01a610 tx=0x7fc09c019780 comp rx=0 tx=0).stop 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 shutdown_connections 2023-07-20T10:06:15.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fc0840663a0 0x7fc084068860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a415cab0 0x7fc0a415e4c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0a40d0d10 0x7fc0a415df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 --2- 172.21.15.82:0/2935653612 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0a40ce4c0 0x7fc0a4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 >> 172.21.15.82:0/2935653612 conn(0x7fc0a408c120 msgr2=0x7fc0a406bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 shutdown_connections 2023-07-20T10:06:15.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.318+0000 7fc0a989c640 1 -- 172.21.15.82:0/2935653612 wait complete. 2023-07-20T10:06:15.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:06:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 Processor -- start 2023-07-20T10:06:15.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 -- start start 2023-07-20T10:06:15.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 0x7f22600b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600b7c20 con 0x7f226015c5f0 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226015c9d0 con 0x7f22600ccfb0 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f22672a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b4980 con 0x7f22600ceb70 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226629f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f226015c5f0 0x7f22600b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43302/0 (socket says 172.21.15.82:43302) 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226629f640 1 -- 172.21.15.82:0/1751305848 learned_addr learned my addr 172.21.15.82:0/1751305848 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:15.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f2266aa0640 1 --2- 172.21.15.82:0/1751305848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 0x7f22600b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532158902 0 0) 0x7f22600b7c20 con 0x7f226015c5f0 2023-07-20T10:06:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224c003530 con 0x7f226015c5f0 2023-07-20T10:06:15.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219322433 0 0) 0x7f2250001120 con 0x7f22600ccfb0 2023-07-20T10:06:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22600b7c20 con 0x7f22600ccfb0 2023-07-20T10:06:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f2266aa0640 1 -- 172.21.15.82:0/1751305848 >> v1:172.21.15.183:6789/0 conn(0x7f22600ccfb0 legacy=0x7f22600ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f2266aa0640 1 -- 172.21.15.82:0/1751305848 >> v1:172.21.15.82:6789/0 conn(0x7f226015c5f0 legacy=0x7f22600b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.478+0000 7f2266aa0640 1 -- 172.21.15.82:0/1751305848 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22600ce030 con 0x7f22600ceb70 2023-07-20T10:06:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f2266aa0640 1 --2- 172.21.15.82:0/1751305848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 0x7f22600b0f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2258009dc0 tx=0x7f225801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da9c56c531bb22 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580af600 con 0x7f22600ceb70 2023-07-20T10:06:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22580ab050 con 0x7f22600ceb70 2023-07-20T10:06:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f226529d640 1 -- 172.21.15.82:0/1751305848 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580af980 con 0x7f22600ceb70 2023-07-20T10:06:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 -- 172.21.15.82:0/1751305848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 msgr2=0x7f22600b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 --2- 172.21.15.82:0/1751305848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 0x7f22600b0f70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2258009dc0 tx=0x7f225801f150 comp rx=0 tx=0).stop 2023-07-20T10:06:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 -- 172.21.15.82:0/1751305848 shutdown_connections 2023-07-20T10:06:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 --2- 172.21.15.82:0/1751305848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ceb70 0x7f22600b0f70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 -- 172.21.15.82:0/1751305848 >> 172.21.15.82:0/1751305848 conn(0x7f2260065710 msgr2=0x7f2260065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 -- 172.21.15.82:0/1751305848 shutdown_connections 2023-07-20T10:06:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.482+0000 7f22672a1640 1 -- 172.21.15.82:0/1751305848 wait complete. 2023-07-20T10:06:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 Processor -- start 2023-07-20T10:06:15.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- start start 2023-07-20T10:06:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ccfb0 0x7f22601f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226015c5f0 0x7f2260154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22601539e0 con 0x7f22600ceb70 2023-07-20T10:06:15.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22601f2c20 con 0x7f226015c5f0 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2260152940 con 0x7f22600ccfb0 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39772/0 (socket says 172.21.15.82:39772) 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 -- 172.21.15.82:0/2734326348 learned_addr learned my addr 172.21.15.82:0/2734326348 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f226629f640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ccfb0 0x7f22601f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2266aa0640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226015c5f0 0x7f2260154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 -- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ccfb0 msgr2=0x7f22601f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ccfb0 0x7f22601f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 -- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226015c5f0 msgr2=0x7f2260154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226015c5f0 0x7f2260154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 -- 172.21.15.82:0/2734326348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2258009a70 con 0x7f22600ceb70 2023-07-20T10:06:15.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2265a9e640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f225000c730 tx=0x7f225000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500052d0 con 0x7f22600ceb70 2023-07-20T10:06:15.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2260152c20 con 0x7f22600ceb70 2023-07-20T10:06:15.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250005430 con 0x7f22600ceb70 2023-07-20T10:06:15.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225000a860 con 0x7f22600ceb70 2023-07-20T10:06:15.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22601531e0 con 0x7f22600ceb70 2023-07-20T10:06:15.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.486+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226004da30 con 0x7f22600ceb70 2023-07-20T10:06:15.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.490+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f225000a9c0 con 0x7f22600ceb70 2023-07-20T10:06:15.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.490+0000 7f2256ffd640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 0x7f2244068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.490+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22500837c0 con 0x7f22600ceb70 2023-07-20T10:06:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.490+0000 7f226629f640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 0x7f2244068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:15.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.490+0000 7f226629f640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 0x7f2244068890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f225c0011f0 tx=0x7f225c007d40 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.494+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2250050b60 con 0x7f22600ceb70 2023-07-20T10:06:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.670+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f226015c9d0 con 0x7f22600ceb70 2023-07-20T10:06:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.670+0000 7f2256ffd640 1 -- 172.21.15.82:0/2734326348 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v41) v1 ==== 53+0+73 (secure 0 0 0) 0x7f226015c9d0 con 0x7f22600ceb70 2023-07-20T10:06:15.653 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:06:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 msgr2=0x7f2244068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 0x7f2244068890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f225c0011f0 tx=0x7f225c007d40 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 msgr2=0x7f2260151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f225000c730 tx=0x7f225000cbf0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 shutdown_connections 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f22440663d0 0x7f2244068890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226015c5f0 0x7f2260154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22600ceb70 0x7f2260151b20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 --2- 172.21.15.82:0/2734326348 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22600ccfb0 0x7f22601f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 >> 172.21.15.82:0/2734326348 conn(0x7f2260065710 msgr2=0x7f226015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 shutdown_connections 2023-07-20T10:06:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:15.674+0000 7f22672a1640 1 -- 172.21.15.82:0/2734326348 wait complete. 2023-07-20T10:06:15.673 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:06:15.673 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:06:15.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:06:15.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:06:15.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:15.675 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:06:15.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:06:15.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:06:15.675 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:15.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.676 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:06:15.686 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:15.687 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41425sec preferred_lft 41425sec 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:06:15.689 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:06:15.690 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:06:15.691 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:06:15.691 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:15.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.692 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:06:15.751 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:06:15.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.754 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:06:15.807 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:06:15.807 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:06:15.807 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:06:15.807 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:06:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:06:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:06:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:15.808 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:15.809 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:06:15.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.810 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:06:15.810 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:06:15.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:06:15.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:06:15.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:06:15.811 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:06:15.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.905 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:06:15.915 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:06:15.916 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:06:15.916 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:15.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:15.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:06:15.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:06:15.986 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:16.037 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:16.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:06:16.039 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:16.088 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:06:16.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:16.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:16.182 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:16.183 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:16.183 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:16.198 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:16.199 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:16.199 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:16.199 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:06:16.200 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:06:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:06:16.209 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:06:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:06:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:06:16.210 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:06:16.212 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:06:16.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:16.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:16.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:16.236 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:06:16.295 INFO:teuthology.orchestra.run.smithi082.stdout:client6934 2023-07-20T10:06:16.296 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:16.297 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:16.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:06:16.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 Processor -- start 2023-07-20T10:06:16.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 -- start start 2023-07-20T10:06:16.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 0x7f76f40ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f76f415c910 0x7f76f415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76f415d2d0 0x7f76f40c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f40cde70 con 0x7f76f415d2d0 2023-07-20T10:06:16.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f415d760 con 0x7f76f415c910 2023-07-20T10:06:16.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fc4bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40cbef0 con 0x7f76f40ca040 2023-07-20T10:06:16.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76faa5a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76f415d2d0 0x7f76f40c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76faa5a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f76f415d2d0 0x7f76f40c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39782/0 (socket says 172.21.15.82:39782) 2023-07-20T10:06:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76faa5a640 1 -- 172.21.15.82:0/3514544141 learned_addr learned my addr 172.21.15.82:0/3514544141 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76fa259640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 0x7f76f40ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.546+0000 7f76f9a58640 1 --2- 172.21.15.82:0/3514544141 >> v2:172.21.15.183:3300/0 conn(0x7f76f415c910 0x7f76f415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 -- 172.21.15.82:0/3514544141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 msgr2=0x7f76f40ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:16.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 0x7f76f40ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 -- 172.21.15.82:0/3514544141 >> v2:172.21.15.183:3300/0 conn(0x7f76f415c910 msgr2=0x7f76f415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 --2- 172.21.15.82:0/3514544141 >> v2:172.21.15.183:3300/0 conn(0x7f76f415c910 0x7f76f415cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 -- 172.21.15.82:0/3514544141 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40ca420 con 0x7f76f415d2d0 2023-07-20T10:06:16.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76fa259640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 0x7f76f40ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76faa5a640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f415d2d0 0x7f76f40c8970 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f76f40b3340 tx=0x7f76ec01c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376d3dddec3d3853 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76f9257640 1 -- 172.21.15.82:0/3514544141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec004230 con 0x7f76f415d2d0 2023-07-20T10:06:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76f9257640 1 -- 172.21.15.82:0/3514544141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec004390 con 0x7f76f415d2d0 2023-07-20T10:06:16.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76f9257640 1 -- 172.21.15.82:0/3514544141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec003820 con 0x7f76f415d2d0 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76fc4bd640 1 -- 172.21.15.82:0/3514544141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f415d2d0 msgr2=0x7f76f40c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.550+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f415d2d0 0x7f76f40c8970 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f76f40b3340 tx=0x7f76ec01c7b0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- 172.21.15.82:0/3514544141 shutdown_connections 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/3514544141 >> v2:172.21.15.183:3300/0 conn(0x7f76f415c910 0x7f76f415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f415d2d0 0x7f76f40c8970 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/3514544141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f40ca040 0x7f76f40ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- 172.21.15.82:0/3514544141 >> 172.21.15.82:0/3514544141 conn(0x7f76f40cada0 msgr2=0x7f76f40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- 172.21.15.82:0/3514544141 shutdown_connections 2023-07-20T10:06:16.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- 172.21.15.82:0/3514544141 wait complete. 2023-07-20T10:06:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 Processor -- start 2023-07-20T10:06:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- start start 2023-07-20T10:06:16.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 0x7f76f40af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76f415d2d0 0x7f76f414e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4150500 con 0x7f76f40ca040 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f414f8f0 con 0x7f76f415d2d0 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fc4bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f414fbd0 con 0x7f76f415c910 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39786/0 (socket says 172.21.15.82:39786) 2023-07-20T10:06:16.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 -- 172.21.15.82:0/1588566741 learned_addr learned my addr 172.21.15.82:0/1588566741 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76f9a58640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 0x7f76f40af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76faa5a640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76f415d2d0 0x7f76f414e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 -- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 msgr2=0x7f76f40af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 0x7f76f40af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 -- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76f415d2d0 msgr2=0x7f76f414e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76f415d2d0 0x7f76f414e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 -- 172.21.15.82:0/1588566741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec00b780 con 0x7f76f40ca040 2023-07-20T10:06:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76f9a58640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 0x7f76f40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:16.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76fa259640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f76f0011400 tx=0x7f76f00118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.554+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0003ba0 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f0013040 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000d5d0 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f414feb0 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41537f0 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f4073c70 con 0x7f76f40ca040 2023-07-20T10:06:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f76f0004030 con 0x7f76f40ca040 2023-07-20T10:06:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76eaffd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 0x7f76d8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76f0088350 con 0x7f76f40ca040 2023-07-20T10:06:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76f9a58640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 0x7f76d8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.558+0000 7f76f9a58640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 0x7f76d8068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76f4071810 tx=0x7f76e4008040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.562+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76f0055680 con 0x7f76f40ca040 2023-07-20T10:06:16.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f40c8eb0 con 0x7f76d80663a0 2023-07-20T10:06:16.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76eaffd640 1 -- 172.21.15.82:0/1588566741 <== mgr.6963 v2:172.21.15.82:6832/3956036202 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f76e4009900 con 0x7f76d80663a0 2023-07-20T10:06:16.711 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:06:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:06:16.711 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:16.711 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:06:16.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 msgr2=0x7f76d8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 0x7f76d8068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76f4071810 tx=0x7f76e4008040 comp rx=0 tx=0).stop 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 msgr2=0x7f76f414f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f76f0011400 tx=0x7f76f00118c0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 shutdown_connections 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f76d80663a0 0x7f76d8068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76f415d2d0 0x7f76f414e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f76f415c910 0x7f76f40af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 --2- 172.21.15.82:0/1588566741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76f40ca040 0x7f76f414f210 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.730+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 >> 172.21.15.82:0/1588566741 conn(0x7f76f40cada0 msgr2=0x7f76f406cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:16.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.734+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 shutdown_connections 2023-07-20T10:06:16.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.734+0000 7f76fc4bd640 1 -- 172.21.15.82:0/1588566741 wait complete. 2023-07-20T10:06:16.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:06:16.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 Processor -- start 2023-07-20T10:06:16.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 -- start start 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb7780afd50 0x7fb7780b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780b06b0 con 0x7fb778159830 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780cc8d0 con 0x7fb778159450 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb780703640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780cce90 con 0x7fb7780afd50 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77dc9e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb778159830 0x7fb7780cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43308/0 (socket says 172.21.15.82:43308) 2023-07-20T10:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77dc9e640 1 -- 172.21.15.82:0/3460258041 learned_addr learned my addr 172.21.15.82:0/3460258041 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77eca0640 1 --2- 172.21.15.82:0/3460258041 >> v2:172.21.15.82:3300/0 conn(0x7fb7780afd50 0x7fb7780b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77d49d640 1 -- 172.21.15.82:0/3460258041 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018003561 0 0) 0x7fb7780b06b0 con 0x7fb778159830 2023-07-20T10:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77d49d640 1 -- 172.21.15.82:0/3460258041 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb764005740 con 0x7fb778159830 2023-07-20T10:06:16.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77eca0640 1 -- 172.21.15.82:0/3460258041 >> v1:172.21.15.183:6789/0 conn(0x7fb778159450 legacy=0x7fb77815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77eca0640 1 -- 172.21.15.82:0/3460258041 >> v1:172.21.15.82:6789/0 conn(0x7fb778159830 legacy=0x7fb7780cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.894+0000 7fb77eca0640 1 -- 172.21.15.82:0/3460258041 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780ccbb0 con 0x7fb7780afd50 2023-07-20T10:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb77eca0640 1 --2- 172.21.15.82:0/3460258041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7780afd50 0x7fb7780b0170 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb770009d90 tx=0x7fb77001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856f878f249db0c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb77d49d640 1 -- 172.21.15.82:0/3460258041 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700a59e0 con 0x7fb7780afd50 2023-07-20T10:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb77d49d640 1 -- 172.21.15.82:0/3460258041 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7700a5b40 con 0x7fb7780afd50 2023-07-20T10:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb77d49d640 1 -- 172.21.15.82:0/3460258041 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700ad440 con 0x7fb7780afd50 2023-07-20T10:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 -- 172.21.15.82:0/3460258041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7780afd50 msgr2=0x7fb7780b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 --2- 172.21.15.82:0/3460258041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7780afd50 0x7fb7780b0170 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fb770009d90 tx=0x7fb77001c920 comp rx=0 tx=0).stop 2023-07-20T10:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 -- 172.21.15.82:0/3460258041 shutdown_connections 2023-07-20T10:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 --2- 172.21.15.82:0/3460258041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7780afd50 0x7fb7780b0170 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 -- 172.21.15.82:0/3460258041 >> 172.21.15.82:0/3460258041 conn(0x7fb7780cad50 msgr2=0x7fb7780cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 -- 172.21.15.82:0/3460258041 shutdown_connections 2023-07-20T10:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.898+0000 7fb780703640 1 -- 172.21.15.82:0/3460258041 wait complete. 2023-07-20T10:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 Processor -- start 2023-07-20T10:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- start start 2023-07-20T10:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7780afd50 0x7fb7780c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 0x7fb7780b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780c58f0 con 0x7fb778159450 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780c86a0 con 0x7fb7781554b0 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780c80e0 con 0x7fb7780afd50 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39808/0 (socket says 172.21.15.82:39808) 2023-07-20T10:06:16.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 -- 172.21.15.82:0/1414165742 learned_addr learned my addr 172.21.15.82:0/1414165742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77e49f640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7780afd50 0x7fb7780c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77eca0640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 0x7fb7780b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 -- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7780afd50 msgr2=0x7fb7780c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7780afd50 0x7fb7780c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 -- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 msgr2=0x7fb7780b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 0x7fb7780b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:16.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 -- 172.21.15.82:0/1414165742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770009a70 con 0x7fb778159450 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77eca0640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 0x7fb7780b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb77dc9e640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb76800c420 tx=0x7fb76800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768005cf0 con 0x7fb778159450 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768005e50 con 0x7fb778159450 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680072d0 con 0x7fb778159450 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7780c83c0 con 0x7fb778159450 2023-07-20T10:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778153450 con 0x7fb778159450 2023-07-20T10:06:16.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.902+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7780c5a60 con 0x7fb778159450 2023-07-20T10:06:16.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.906+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 39) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb768007430 con 0x7fb778159450 2023-07-20T10:06:16.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.906+0000 7fb76effd640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 0x7fb75c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:16.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.906+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb768083300 con 0x7fb778159450 2023-07-20T10:06:16.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.906+0000 7fb77e49f640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 0x7fb75c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:16.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.906+0000 7fb77e49f640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 0x7fb75c068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb774000f70 tx=0x7fb774009040 comp rx=0 tx=0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:16.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:16.910+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7680507b0 con 0x7fb778159450 2023-07-20T10:06:17.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.094+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb77804da30 con 0x7fb778159450 2023-07-20T10:06:17.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.802+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 40) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb768050b80 con 0x7fb778159450 2023-07-20T10:06:17.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb76effd640 1 -- 172.21.15.82:0/1414165742 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v40) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb7680507b0 con 0x7fb778159450 2023-07-20T10:06:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 msgr2=0x7fb75c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 0x7fb75c068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb774000f70 tx=0x7fb774009040 comp rx=0 tx=0).stop 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 msgr2=0x7fb7780ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fb76800c420 tx=0x7fb76800c8e0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 shutdown_connections 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7fb75c0663a0 0x7fb75c068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7781554b0 0x7fb7780b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb778159450 0x7fb7780ce440 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 --2- 172.21.15.82:0/1414165742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7780afd50 0x7fb7780c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 >> 172.21.15.82:0/1414165742 conn(0x7fb7780cad50 msgr2=0x7fb7780c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 shutdown_connections 2023-07-20T10:06:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.806+0000 7fb780703640 1 -- 172.21.15.82:0/1414165742 wait complete. 2023-07-20T10:06:17.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:06:17.953 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:17.976+0000 7fd191448180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:17.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 Processor -- start 2023-07-20T10:06:17.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 -- start start 2023-07-20T10:06:17.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6bd406c120 0x7f6bd40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:17.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd40d0970 con 0x7f6bd406b220 2023-07-20T10:06:17.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd4160e20 con 0x7f6bd41602b0 2023-07-20T10:06:17.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bdaa07640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd40cd300 con 0x7f6bd406c120 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd8fa4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6bd406b220 0x7f6bd40d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43316/0 (socket says 172.21.15.82:43316) 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd8fa4640 1 -- 172.21.15.82:0/595590563 learned_addr learned my addr 172.21.15.82:0/595590563 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd3fff640 1 --2- 172.21.15.82:0/595590563 >> v2:172.21.15.183:3300/0 conn(0x7f6bd406c120 0x7f6bd40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd2ffd640 1 -- 172.21.15.82:0/595590563 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145363047 0 0) 0x7f6bd40d0970 con 0x7f6bd406b220 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd2ffd640 1 -- 172.21.15.82:0/595590563 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bbc003530 con 0x7f6bd406b220 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd3fff640 1 -- 172.21.15.82:0/595590563 >> v1:172.21.15.183:6789/0 conn(0x7f6bd41602b0 legacy=0x7f6bd406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd3fff640 1 -- 172.21.15.82:0/595590563 >> v1:172.21.15.82:6789/0 conn(0x7f6bd406b220 legacy=0x7f6bd40d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.978+0000 7f6bd3fff640 1 -- 172.21.15.82:0/595590563 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40cd5e0 con 0x7f6bd406c120 2023-07-20T10:06:17.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bd3fff640 1 --2- 172.21.15.82:0/595590563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406c120 0x7f6bd40cdde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e03532220998d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:17.963 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:17.982+0000 7fc818fd2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:17.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bd2ffd640 1 -- 172.21.15.82:0/595590563 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4004230 con 0x7f6bd406c120 2023-07-20T10:06:17.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bd2ffd640 1 -- 172.21.15.82:0/595590563 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc40a7050 con 0x7f6bd406c120 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bd2ffd640 1 -- 172.21.15.82:0/595590563 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4003620 con 0x7f6bd406c120 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 -- 172.21.15.82:0/595590563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406c120 msgr2=0x7f6bd40cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/595590563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406c120 0x7f6bd40cdde0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40097c0 tx=0x7f6bc401c330 comp rx=0 tx=0).stop 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 -- 172.21.15.82:0/595590563 shutdown_connections 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/595590563 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406c120 0x7f6bd40cdde0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 -- 172.21.15.82:0/595590563 >> 172.21.15.82:0/595590563 conn(0x7f6bd408c0a0 msgr2=0x7f6bd409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:17.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 -- 172.21.15.82:0/595590563 shutdown_connections 2023-07-20T10:06:17.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.982+0000 7f6bdaa07640 1 -- 172.21.15.82:0/595590563 wait complete. 2023-07-20T10:06:17.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 Processor -- start 2023-07-20T10:06:17.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 -- start start 2023-07-20T10:06:17.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 0x7f6bd40c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:17.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd406c120 0x7f6bd40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c78c0 con 0x7f6bd41602b0 2023-07-20T10:06:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c6cb0 con 0x7f6bd406b220 2023-07-20T10:06:17.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bdaa07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd40c6f90 con 0x7f6bd406c120 2023-07-20T10:06:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:17.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 0x7f6bd40c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39840/0 (socket says 172.21.15.82:39840) 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 -- 172.21.15.82:0/3165196820 learned_addr learned my addr 172.21.15.82:0/3165196820 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd37fe640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd406c120 0x7f6bd40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 -- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd406c120 msgr2=0x7f6bd40c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd406c120 0x7f6bd40c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 -- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 msgr2=0x7f6bd40c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:17.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 0x7f6bd40c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd8fa4640 1 -- 172.21.15.82:0/3165196820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc4009420 con 0x7f6bd41602b0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.986+0000 7f6bd3fff640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 0x7f6bd40c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bd8fa4640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00cb40 tx=0x7f6bcc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc00aca0 con 0x7f6bd41602b0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bcc00ae00 con 0x7f6bd41602b0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc012620 con 0x7f6bd41602b0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd40c7270 con 0x7f6bd41602b0 2023-07-20T10:06:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd40ca5a0 con 0x7f6bd41602b0 2023-07-20T10:06:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bd40c7a70 con 0x7f6bd41602b0 2023-07-20T10:06:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.990+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 40) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f6bcc007070 con 0x7f6bd41602b0 2023-07-20T10:06:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.994+0000 7f6bd0ff9640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 0x7f6bc00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.994+0000 7f6bd3fff640 1 -- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 msgr2=0x7f6bc00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.994+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bcc083ee0 con 0x7f6bd41602b0 2023-07-20T10:06:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.994+0000 7f6bd3fff640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 0x7f6bc00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:17.994+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bd40c7a70 con 0x7f6bd41602b0 2023-07-20T10:06:18.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.150+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f6bd40c7a70 con 0x7f6bd41602b0 2023-07-20T10:06:18.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bd0ff9640 1 -- 172.21.15.82:0/3165196820 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6bd40c7a70 con 0x7f6bd41602b0 2023-07-20T10:06:18.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 msgr2=0x7f6bc00688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:18.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 0x7f6bc00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 msgr2=0x7f6bd40c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00cb40 tx=0x7f6bcc00a060 comp rx=0 tx=0).stop 2023-07-20T10:06:18.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 shutdown_connections 2023-07-20T10:06:18.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f6bc00663f0 0x7f6bc00688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bd41602b0 0x7f6bd40c66c0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6bd406c120 0x7f6bd40c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 --2- 172.21.15.82:0/3165196820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6bd406b220 0x7f6bd40c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.154+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 >> 172.21.15.82:0/3165196820 conn(0x7f6bd408c0a0 msgr2=0x7f6bd4072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:18.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.158+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 shutdown_connections 2023-07-20T10:06:18.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.158+0000 7f6bdaa07640 1 -- 172.21.15.82:0/3165196820 wait complete. 2023-07-20T10:06:18.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:06:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 Processor -- start 2023-07-20T10:06:18.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 -- start start 2023-07-20T10:06:18.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d0806c120 0x7f2d080cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d081602b0 0x7f2d08160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d080d0970 con 0x7f2d0806ab10 2023-07-20T10:06:18.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d08160e20 con 0x7f2d0806c120 2023-07-20T10:06:18.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d0de88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080cd300 con 0x7f2d081602b0 2023-07-20T10:06:18.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d0806c120 0x7f2d080cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2d0806c120 0x7f2d080cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39850/0 (socket says 172.21.15.82:39850) 2023-07-20T10:06:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 -- 172.21.15.82:0/784111942 learned_addr learned my addr 172.21.15.82:0/784111942 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d06ffd640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d081602b0 0x7f2d08160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 -- 172.21.15.82:0/784111942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d081602b0 msgr2=0x7f2d08160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d081602b0 0x7f2d08160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 -- 172.21.15.82:0/784111942 >> v1:172.21.15.183:6789/0 conn(0x7f2d0806ab10 legacy=0x7f2d0806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.322+0000 7f2d077fe640 1 -- 172.21.15.82:0/784111942 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d080cd5e0 con 0x7f2d0806c120 2023-07-20T10:06:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d077fe640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0806c120 0x7f2d080cdde0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009870 tx=0x7f2cf801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e2b2566acbe2b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d067fc640 1 -- 172.21.15.82:0/784111942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80ac620 con 0x7f2d0806c120 2023-07-20T10:06:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d067fc640 1 -- 172.21.15.82:0/784111942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80ac780 con 0x7f2d0806c120 2023-07-20T10:06:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d067fc640 1 -- 172.21.15.82:0/784111942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80acb10 con 0x7f2d0806c120 2023-07-20T10:06:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 -- 172.21.15.82:0/784111942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0806c120 msgr2=0x7f2d080cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0806c120 0x7f2d080cdde0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009870 tx=0x7f2cf801c4b0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 -- 172.21.15.82:0/784111942 shutdown_connections 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d081602b0 0x7f2d08160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 --2- 172.21.15.82:0/784111942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d0806c120 0x7f2d080cdde0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 -- 172.21.15.82:0/784111942 >> 172.21.15.82:0/784111942 conn(0x7f2d0808c0a0 msgr2=0x7f2d0809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 -- 172.21.15.82:0/784111942 shutdown_connections 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.326+0000 7f2d0de88640 1 -- 172.21.15.82:0/784111942 wait complete. 2023-07-20T10:06:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 Processor -- start 2023-07-20T10:06:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- start start 2023-07-20T10:06:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0806ab10 0x7f2d0814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 0x7f2d0814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 0x7f2d080af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d080b0b50 con 0x7f2d081602b0 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d08155a40 con 0x7f2d0806c120 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0814dfc0 con 0x7f2d0806ab10 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 0x7f2d080af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 0x7f2d0814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d07fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 0x7f2d080af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39854/0 (socket says 172.21.15.82:39854) 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d07fff640 1 -- 172.21.15.82:0/4280812580 learned_addr learned my addr 172.21.15.82:0/4280812580 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d077fe640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0806ab10 0x7f2d0814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 -- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0806ab10 msgr2=0x7f2d0814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0806ab10 0x7f2d0814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 -- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 msgr2=0x7f2d080af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 0x7f2d080af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 -- 172.21.15.82:0/4280812580 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80094d0 con 0x7f2d0806c120 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d06ffd640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 0x7f2d0814d630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00d5d0 tx=0x7f2cfc00da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0125f0 con 0x7f2d0806c120 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc012750 con 0x7f2d0806c120 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d08155d00 con 0x7f2d0806c120 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc012ae0 con 0x7f2d0806c120 2023-07-20T10:06:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.330+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0814db70 con 0x7f2d0806c120 2023-07-20T10:06:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0814dd90 con 0x7f2d0806c120 2023-07-20T10:06:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 40) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f2cfc012c40 con 0x7f2d0806c120 2023-07-20T10:06:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2ceffff640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 0x7f2cf40688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2cfc0841f0 con 0x7f2d0806c120 2023-07-20T10:06:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2d077fe640 1 -- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 msgr2=0x7f2cf40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.334+0000 7f2d077fe640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 0x7f2cf40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.338+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cfc051620 con 0x7f2d0806c120 2023-07-20T10:06:18.373 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:18.396+0000 7fd191448180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:18.399 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:18.418+0000 7fc818fd2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:18.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.490+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f2d0804da30 con 0x7f2d0806c120 2023-07-20T10:06:18.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.498+0000 7f2ceffff640 1 -- 172.21.15.82:0/4280812580 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2cfc054c40 con 0x7f2d0806c120 2023-07-20T10:06:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 msgr2=0x7f2cf40688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:18.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 0x7f2cf40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 msgr2=0x7f2d0814d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 0x7f2d0814d630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00d5d0 tx=0x7f2cfc00da90 comp rx=0 tx=0).stop 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 shutdown_connections 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f2cf40663f0 0x7f2cf40688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d081602b0 0x7f2d080af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d0806c120 0x7f2d0814d630 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 --2- 172.21.15.82:0/4280812580 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2d0806ab10 0x7f2d0814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 >> 172.21.15.82:0/4280812580 conn(0x7f2d0808c0a0 msgr2=0x7f2d080b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:18.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 shutdown_connections 2023-07-20T10:06:18.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.502+0000 7f2d0de88640 1 -- 172.21.15.82:0/4280812580 wait complete. 2023-07-20T10:06:18.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-20T10:06:18.523 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:18.548+0000 7fd191448180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:18.555 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:18.574+0000 7fc818fd2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:18.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 Processor -- start 2023-07-20T10:06:18.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 -- start start 2023-07-20T10:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f905c06c120 0x7f905c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f905c06b220 0x7f905c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905c0d0970 con 0x7f905c1602b0 2023-07-20T10:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c160e20 con 0x7f905c06c120 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f9061648640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905c0cd300 con 0x7f905c06b220 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f905c06c120 0x7f905c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f905c06c120 0x7f905c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39858/0 (socket says 172.21.15.82:39858) 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 -- 172.21.15.82:0/3473600544 learned_addr learned my addr 172.21.15.82:0/3473600544 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905b7fe640 1 --2- 172.21.15.82:0/3473600544 >> v2:172.21.15.183:3300/0 conn(0x7f905c06b220 0x7f905c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 -- 172.21.15.82:0/3473600544 >> v2:172.21.15.183:3300/0 conn(0x7f905c06b220 msgr2=0x7f905c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 --2- 172.21.15.82:0/3473600544 >> v2:172.21.15.183:3300/0 conn(0x7f905c06b220 0x7f905c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 -- 172.21.15.82:0/3473600544 >> v1:172.21.15.183:6789/0 conn(0x7f905c1602b0 legacy=0x7f905c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.666+0000 7f905affd640 1 -- 172.21.15.82:0/3473600544 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0cd5e0 con 0x7f905c06c120 2023-07-20T10:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f905affd640 1 --2- 172.21.15.82:0/3473600544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06c120 0x7f905c0cdde0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f905c08ceb0 tx=0x7f904c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af9db5027a9096 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f905a7fc640 1 -- 172.21.15.82:0/3473600544 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0ac630 con 0x7f905c06c120 2023-07-20T10:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f905a7fc640 1 -- 172.21.15.82:0/3473600544 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c0ac790 con 0x7f905c06c120 2023-07-20T10:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f905a7fc640 1 -- 172.21.15.82:0/3473600544 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0acb20 con 0x7f905c06c120 2023-07-20T10:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 -- 172.21.15.82:0/3473600544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06c120 msgr2=0x7f905c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 --2- 172.21.15.82:0/3473600544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06c120 0x7f905c0cdde0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f905c08ceb0 tx=0x7f904c01c3b0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 -- 172.21.15.82:0/3473600544 shutdown_connections 2023-07-20T10:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 --2- 172.21.15.82:0/3473600544 >> v2:172.21.15.183:3300/0 conn(0x7f905c06b220 0x7f905c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 --2- 172.21.15.82:0/3473600544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06c120 0x7f905c0cdde0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 -- 172.21.15.82:0/3473600544 >> 172.21.15.82:0/3473600544 conn(0x7f905c08c0a0 msgr2=0x7f905c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 -- 172.21.15.82:0/3473600544 shutdown_connections 2023-07-20T10:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.670+0000 7f9061648640 1 -- 172.21.15.82:0/3473600544 wait complete. 2023-07-20T10:06:18.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 Processor -- start 2023-07-20T10:06:18.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- start start 2023-07-20T10:06:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06b220 0x7f905c14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f905c06c120 0x7f905c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f905c1602b0 0x7f905c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0b1400 con 0x7f905c06b220 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0b1120 con 0x7f905c06c120 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905c0c6220 con 0x7f905c1602b0 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06b220 0x7f905c14aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06b220 0x7f905c14aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39866/0 (socket says 172.21.15.82:39866) 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 -- 172.21.15.82:0/2085029458 learned_addr learned my addr 172.21.15.82:0/2085029458 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f905c06c120 0x7f905c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905b7fe640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f905c1602b0 0x7f905c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:18.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f905c1602b0 msgr2=0x7f905c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f905c1602b0 0x7f905c154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f905c06c120 msgr2=0x7f905c14afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f905c06c120 0x7f905c14afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0094d0 con 0x7f905c06b220 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f905affd640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f905c06b220 0x7f905c14aa90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f904c018fc0 tx=0x7f904c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0b5640 con 0x7f905c06b220 2023-07-20T10:06:18.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c0b57a0 con 0x7f905c06b220 2023-07-20T10:06:18.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0b5b30 con 0x7f905c06b220 2023-07-20T10:06:18.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905c0c6500 con 0x7f905c06b220 2023-07-20T10:06:18.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.674+0000 7f9061648640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905c14dca0 con 0x7f905c06b220 2023-07-20T10:06:18.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f9061648640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905c04da30 con 0x7f905c06b220 2023-07-20T10:06:18.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 40) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f904c0b3070 con 0x7f905c06b220 2023-07-20T10:06:18.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f90537fe640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:18.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f904c11deb0 con 0x7f905c06b220 2023-07-20T10:06:18.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f9053fff640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 msgr2=0x7f903c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:18.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.678+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:18.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.682+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f904c0eb1b0 con 0x7f905c06b220 2023-07-20T10:06:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.850+0000 7f9061648640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f905c15f2d0 con 0x7f903c0663f0 2023-07-20T10:06:18.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.882+0000 7f9053fff640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 msgr2=0x7f903c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:18.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:18.882+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:06:19.003 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.024+0000 7fd191448180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:19.046 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.066+0000 7fc818fd2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:19.061 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.084+0000 7fd191448180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:19.104 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.126+0000 7fc818fd2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:19.116 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.140+0000 7fd191448180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:19.161 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.182+0000 7fc818fd2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:19.204 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.228+0000 7fd191448180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:19.248 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.266+0000 7fc818fd2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:19.263 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.284+0000 7fd191448180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:19.286+0000 7f9053fff640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 msgr2=0x7f903c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:19.286+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:06:19.305 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.326+0000 7fc818fd2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:19.346 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.368+0000 7fd191448180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:19.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.410+0000 7fc818fd2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:19.402 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.424+0000 7fd191448180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:19.445 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.466+0000 7fc818fd2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:19.543 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.568+0000 7fd191448180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:19.588 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.606+0000 7fc818fd2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:19.601 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.624+0000 7fd191448180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:19.647 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.666+0000 7fc818fd2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:19.842 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:19.941 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:19.941 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:19.942 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:19.872+0000 7fd191448180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:19.942 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:19.942 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:19.942 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:19.943 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:19.914+0000 7fc818fd2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:19.982 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.004+0000 7fd191448180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:20.031 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:20.050+0000 7fc818fd2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:20.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:20.090+0000 7f9053fff640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 msgr2=0x7f903c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3956036202 2023-07-20T10:06:20.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:20.090+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:06:20.110 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.132+0000 7fd191448180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:20.157 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:20.178+0000 7fc818fd2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:20.180 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.204+0000 7fd191448180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:06:20.227 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:20.246+0000 7fc818fd2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:06:20.314 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.336+0000 7fd191448180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:20.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:20.382+0000 7fc818fd2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:20.848 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.872+0000 7fd191448180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:06:20.900 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:20.918+0000 7fc818fd2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:06:20.935 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:20.960+0000 7fd191448180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:06:20.986 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.006+0000 7fc818fd2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:06:21.087 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:21.112+0000 7fd191448180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:06:21.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.158+0000 7fc818fd2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:06:21.171 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:21.196+0000 7fd191448180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:06:21.221 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.242+0000 7fc818fd2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:06:21.439 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:21.464+0000 7fd191448180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:06:21.492 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.510+0000 7fc818fd2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:06:21.499 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:21.524+0000 7fd191448180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:06:21.552 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.570+0000 7fc818fd2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:06:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:21.582+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 41) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f904c0eb580 con 0x7f905c06b220 2023-07-20T10:06:21.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:21.582+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 msgr2=0x7f903c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:21.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:21.582+0000 7f90537fe640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3956036202,v1:172.21.15.82:6833/3956036202] conn(0x7f903c0663f0 0x7f903c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:21.679 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79bff7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.679 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79bff7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.679 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79bff7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.680 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79bff7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.680 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79bff7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.680 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.698+0000 7fc79effd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.680 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.702+0000 7fc79effd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.681 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.702+0000 7fc79effd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.681 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.702+0000 7fc79effd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:21.681 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:21.702+0000 7fc79effd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.586+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 42) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f904c11c1d0 con 0x7f905c06b220 2023-07-20T10:06:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.586+0000 7f90537fe640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f903c034090 0x7f903c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.586+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 --> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f903c070e10 con 0x7f903c034090 2023-07-20T10:06:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.590+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f903c034090 0x7f903c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.594+0000 7f9053fff640 1 --2- 172.21.15.82:0/2085029458 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f903c034090 0x7f903c0708d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f905c0a0490 tx=0x7f9044007e40 comp rx=0 tx=0).ready entity=mgr.7461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:22.584 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:22.606+0000 7fc7a600b640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-20T10:06:22.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.606+0000 7f90537fe640 1 -- 172.21.15.82:0/2085029458 <== mgr.7461 v2:172.21.15.82:6832/3984926744 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f903c070e10 con 0x7f903c034090 2023-07-20T10:06:22.585 INFO:teuthology.orchestra.run.smithi082.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-20T10:06:22.594 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-20T10:06:22.595 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:06:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.758+0000 7f30f9f03640 1 Processor -- start 2023-07-20T10:06:22.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.758+0000 7f30f9f03640 1 -- start start 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f9f03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30f4159450 0x7f30f415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f9f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 0x7f30f40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f9f03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f40cc8d0 con 0x7f30f40cc3e0 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f9f03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f40cce90 con 0x7f30f4159450 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f9f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40ccbb0 con 0x7f30f4159830 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30f4159450 0x7f30f415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30f4159450 0x7f30f415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40012/0 (socket says 172.21.15.82:40012) 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 -- 172.21.15.82:0/2001894685 learned_addr learned my addr 172.21.15.82:0/2001894685 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30ebfff640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 0x7f30f40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 -- 172.21.15.82:0/2001894685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 msgr2=0x7f30f40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 0x7f30f40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 -- 172.21.15.82:0/2001894685 >> v1:172.21.15.82:6789/0 conn(0x7f30f40cc3e0 legacy=0x7f30f40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30f37fe640 1 -- 172.21.15.82:0/2001894685 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4159cc0 con 0x7f30f4159450 2023-07-20T10:06:22.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.762+0000 7f30ebfff640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 0x7f30f40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:22.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f37fe640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f4159450 0x7f30f415a4c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009870 tx=0x7f30e401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d7637e3243db2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f2ffd640 1 -- 172.21.15.82:0/2001894685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40aa650 con 0x7f30f4159450 2023-07-20T10:06:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f2ffd640 1 -- 172.21.15.82:0/2001894685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e40aa7b0 con 0x7f30f4159450 2023-07-20T10:06:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f2ffd640 1 -- 172.21.15.82:0/2001894685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40aab40 con 0x7f30f4159450 2023-07-20T10:06:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- 172.21.15.82:0/2001894685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f4159450 msgr2=0x7f30f415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f4159450 0x7f30f415a4c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f30e4009870 tx=0x7f30e401c510 comp rx=0 tx=0).stop 2023-07-20T10:06:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- 172.21.15.82:0/2001894685 shutdown_connections 2023-07-20T10:06:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159830 0x7f30f40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- 172.21.15.82:0/2001894685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f4159450 0x7f30f415a4c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- 172.21.15.82:0/2001894685 >> 172.21.15.82:0/2001894685 conn(0x7f30f40cad50 msgr2=0x7f30f40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- 172.21.15.82:0/2001894685 shutdown_connections 2023-07-20T10:06:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- 172.21.15.82:0/2001894685 wait complete. 2023-07-20T10:06:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 Processor -- start 2023-07-20T10:06:22.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 -- start start 2023-07-20T10:06:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30f40cc3e0 0x7f30f4148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159450 0x7f30f40b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.766+0000 7f30f9f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40b2c00 con 0x7f30f40b2130 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c69f0 con 0x7f30f40cc3e0 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40c63e0 con 0x7f30f4159450 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40024/0 (socket says 172.21.15.82:40024) 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 -- 172.21.15.82:0/4136735599 learned_addr learned my addr 172.21.15.82:0/4136735599 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f37fe640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30f40cc3e0 0x7f30f4148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30ebfff640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159450 0x7f30f40b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 -- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159450 msgr2=0x7f30f40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159450 0x7f30f40b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 -- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30f40cc3e0 msgr2=0x7f30f4148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30f40cc3e0 0x7f30f4148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:22.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 -- 172.21.15.82:0/4136735599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e40094d0 con 0x7f30f40b2130 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f3fff640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c740 tx=0x7f30ec00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec003ba0 con 0x7f30f40b2130 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec003d00 con 0x7f30f40b2130 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f40b2640 con 0x7f30f40b2130 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00aa90 con 0x7f30f40b2130 2023-07-20T10:06:22.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f40c6680 con 0x7f30f40b2130 2023-07-20T10:06:22.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f40c6b80 con 0x7f30f40b2130 2023-07-20T10:06:22.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.770+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 42) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f30ec00abf0 con 0x7f30f40b2130 2023-07-20T10:06:22.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.774+0000 7f30f0ff9640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 0x7f30d40685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:22.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.774+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f30ec0839b0 con 0x7f30f40b2130 2023-07-20T10:06:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.774+0000 7f30f37fe640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 0x7f30d40685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:22.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.774+0000 7f30f37fe640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 0x7f30d40685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ae000 tx=0x7f30e40a7000 comp rx=0 tx=0).ready entity=mgr.7461 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:22.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.778+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30ec050f40 con 0x7f30f40b2130 2023-07-20T10:06:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:22.962+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f30f404da30 con 0x7f30f40b2130 2023-07-20T10:06:23.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.598+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f30ec051310 con 0x7f30f40b2130 2023-07-20T10:06:23.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f0ff9640 1 -- 172.21.15.82:0/4136735599 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v43) v1 ==== 93+0+0 (secure 0 0 0) 0x7f30ec0706d0 con 0x7f30f40b2130 2023-07-20T10:06:23.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 msgr2=0x7f30d40685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 0x7f30d40685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30e40ae000 tx=0x7f30e40a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:23.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 msgr2=0x7f30f406b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c740 tx=0x7f30ec00cc00 comp rx=0 tx=0).stop 2023-07-20T10:06:23.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 shutdown_connections 2023-07-20T10:06:23.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f30d4066120 0x7f30d40685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30f40b2130 0x7f30f406b520 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30f4159450 0x7f30f40b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 --2- 172.21.15.82:0/4136735599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30f40cc3e0 0x7f30f4148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.602+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 >> 172.21.15.82:0/4136735599 conn(0x7f30f40cad50 msgr2=0x7f30f4070a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.606+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 shutdown_connections 2023-07-20T10:06:23.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.606+0000 7f30f9f03640 1 -- 172.21.15.82:0/4136735599 wait complete. 2023-07-20T10:06:23.606 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:06:23.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:06:23.655 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:06:23.718 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:06:23.719 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:23.719 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:23.731 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:23.731 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:23.749 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:23.772+0000 7facd402d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:23.758 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:23.778+0000 7fd0b3801180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:23.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:23.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 Processor -- start 2023-07-20T10:06:23.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 -- start start 2023-07-20T10:06:23.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa8bc0d0d10 0x7fa8bc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc0d16b0 con 0x7fa8bc0cf110 2023-07-20T10:06:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc0d31c0 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8c10cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0b3520 con 0x7fa8bc15cab0 2023-07-20T10:06:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8bb59e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa8bc0cf110 0x7fa8bc0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48920/0 (socket says 172.21.15.82:48920) 2023-07-20T10:06:23.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8bb59e640 1 -- 172.21.15.82:0/4243308027 learned_addr learned my addr 172.21.15.82:0/4243308027 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8bad9d640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/4243308027 >> v2:172.21.15.183:3300/0 conn(0x7fa8bc0d0d10 0x7fa8bc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8ba59c640 1 -- 172.21.15.82:0/4243308027 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815315165 0 0) 0x7fa8bc0d16b0 con 0x7fa8bc0cf110 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8ba59c640 1 -- 172.21.15.82:0/4243308027 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a8003530 con 0x7fa8bc0cf110 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8b3fff640 1 -- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 msgr2=0x7fa8bc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:23.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8b3fff640 1 -- 172.21.15.82:0/4243308027 >> v1:172.21.15.82:6789/0 conn(0x7fa8bc0cf110 legacy=0x7fa8bc0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8b3fff640 1 -- 172.21.15.82:0/4243308027 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0b2910 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.974+0000 7fa8bad9d640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0d1170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40097c0 tx=0x7fa8a401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ba05acc0afa4a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8ba59c640 1 -- 172.21.15.82:0/4243308027 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40ab650 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8ba59c640 1 -- 172.21.15.82:0/4243308027 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a40ab7b0 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8ba59c640 1 -- 172.21.15.82:0/4243308027 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40abb20 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 -- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 msgr2=0x7fa8bc0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0d1170 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40097c0 tx=0x7fa8a401c450 comp rx=0 tx=0).stop 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 -- 172.21.15.82:0/4243308027 shutdown_connections 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0d1170 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/4243308027 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 -- 172.21.15.82:0/4243308027 >> 172.21.15.82:0/4243308027 conn(0x7fa8bc08c120 msgr2=0x7fa8bc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 -- 172.21.15.82:0/4243308027 shutdown_connections 2023-07-20T10:06:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.978+0000 7fa8c10cb640 1 -- 172.21.15.82:0/4243308027 wait complete. 2023-07-20T10:06:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 Processor -- start 2023-07-20T10:06:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 -- start start 2023-07-20T10:06:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0cbfa0 con 0x7fa8bc0cf110 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc155aa0 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8c10cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc155e30 con 0x7fa8bc15cab0 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8bad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8bad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42032/0 (socket says 172.21.15.82:42032) 2023-07-20T10:06:23.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:23.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8bad9d640 1 -- 172.21.15.82:0/2800966577 learned_addr learned my addr 172.21.15.82:0/2800966577 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:23.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8bb59e640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 -- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 msgr2=0x7fa8bc06ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc06ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 -- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 msgr2=0x7fa8bc155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8b3fff640 1 -- 172.21.15.82:0/2800966577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009420 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.982+0000 7fa8bad9d640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b3fff640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0cb630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40ac000 tx=0x7fa8a40191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4004510 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a40ab920 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40abcb0 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a4009420 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc1563f0 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc155f70 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fa8a4003620 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 0x7fa89c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:23.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa8a411e140 con 0x7fa8bc0d0d10 2023-07-20T10:06:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8bad9d640 1 -- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 msgr2=0x7fa89c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:23.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.986+0000 7fa8bad9d640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 0x7fa89c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:23.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:23.990+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8bc155f70 con 0x7fa8bc0d0d10 2023-07-20T10:06:24.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.142+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8bc155f70 con 0x7fa8bc0d0d10 2023-07-20T10:06:24.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.142+0000 7fa8b37fe640 1 -- 172.21.15.82:0/2800966577 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18830 (secure 0 0 0) 0x7fa8bc155f70 con 0x7fa8bc0d0d10 2023-07-20T10:06:24.124 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:24.124 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":95,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:21.577470+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/957540597":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/4054446550":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/2903119807":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/3702343324":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6833/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1345031035":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6832/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1526530333":"2023-07-21T10:06:21.577437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:24.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 msgr2=0x7fa89c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:24.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 0x7fa89c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 msgr2=0x7fa8bc0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0cb630 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40ac000 tx=0x7fa8a40191f0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 shutdown_connections 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa89c0663a0 0x7fa89c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa8bc15cab0 0x7fa8bc06ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa8bc0d0d10 0x7fa8bc0cb630 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 --2- 172.21.15.82:0/2800966577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8bc0cf110 0x7fa8bc155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 >> 172.21.15.82:0/2800966577 conn(0x7fa8bc08c120 msgr2=0x7fa8bc15bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:24.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 shutdown_connections 2023-07-20T10:06:24.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.146+0000 7fa8c10cb640 1 -- 172.21.15.82:0/2800966577 wait complete. 2023-07-20T10:06:24.145 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:06:02.070880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:06:03.385311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:06:24.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:06:24.165 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:24.188+0000 7facd402d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:24.192 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:24.210+0000 7fd0b3801180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 Processor -- start 2023-07-20T10:06:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 -- start start 2023-07-20T10:06:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 0x7fb30c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb30c0cc3e0 0x7fb30c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c0cc8d0 con 0x7fb30c159450 2023-07-20T10:06:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0cce90 con 0x7fb30c159830 2023-07-20T10:06:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.310+0000 7fb312ce5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30c0ccbb0 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 0x7fb30c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb30c0cc3e0 0x7fb30c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb30c0cc3e0 0x7fb30c0afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:34730/0 (socket says 172.21.15.82:34730) 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 -- 172.21.15.82:0/450995060 learned_addr learned my addr 172.21.15.82:0/450995060 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 -- 172.21.15.82:0/450995060 >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 msgr2=0x7fb30c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 --2- 172.21.15.82:0/450995060 >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 0x7fb30c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 -- 172.21.15.82:0/450995060 >> v1:172.21.15.183:6789/0 conn(0x7fb30c159450 legacy=0x7fb30c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 -- 172.21.15.82:0/450995060 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c159cc0 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30bfff640 1 --2- 172.21.15.82:0/450995060 >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 0x7fb30c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:24.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30b7fe640 1 -- 172.21.15.82:0/450995060 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754316462 0 0) 0x7fb30c0cc8d0 con 0x7fb30c159450 2023-07-20T10:06:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb311282640 1 --2- 172.21.15.82:0/450995060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c0cc3e0 0x7fb30c0afd50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0c1da0 tx=0x7fb30401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4200f220902de932 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30b7fe640 1 -- 172.21.15.82:0/450995060 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a5770 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30b7fe640 1 -- 172.21.15.82:0/450995060 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040a58d0 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.314+0000 7fb30b7fe640 1 -- 172.21.15.82:0/450995060 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3040a5c60 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- 172.21.15.82:0/450995060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c0cc3e0 msgr2=0x7fb30c0afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- 172.21.15.82:0/450995060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c0cc3e0 0x7fb30c0afd50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0c1da0 tx=0x7fb30401c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- 172.21.15.82:0/450995060 shutdown_connections 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- 172.21.15.82:0/450995060 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c0cc3e0 0x7fb30c0afd50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- 172.21.15.82:0/450995060 >> v2:172.21.15.82:3300/0 conn(0x7fb30c159830 0x7fb30c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- 172.21.15.82:0/450995060 >> 172.21.15.82:0/450995060 conn(0x7fb30c0cad50 msgr2=0x7fb30c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- 172.21.15.82:0/450995060 shutdown_connections 2023-07-20T10:06:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- 172.21.15.82:0/450995060 wait complete. 2023-07-20T10:06:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 Processor -- start 2023-07-20T10:06:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- start start 2023-07-20T10:06:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb30c0cc3e0 0x7fb30c0c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c158590 0x7fb30c1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0c6c00 con 0x7fb30c159450 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0b1fe0 con 0x7fb30c158590 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.318+0000 7fb312ce5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c162700 con 0x7fb30c0cc3e0 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb310a81640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb30c0cc3e0 0x7fb30c0c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42050/0 (socket says 172.21.15.82:42050) 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 -- 172.21.15.82:0/3745198982 learned_addr learned my addr 172.21.15.82:0/3745198982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb311282640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c158590 0x7fb30c1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 -- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb30c0cc3e0 msgr2=0x7fb30c0c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb30c0cc3e0 0x7fb30c0c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 -- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c158590 msgr2=0x7fb30c1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c158590 0x7fb30c1f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 -- 172.21.15.82:0/3745198982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f8009420 con 0x7fb30c159450 2023-07-20T10:06:24.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb30bfff640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800ebe0 tx=0x7fb2f800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800eee0 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800cc30 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb304009b30 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8013470 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c162cc0 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c162e80 con 0x7fb30c159450 2023-07-20T10:06:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.322+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fb2f80135d0 con 0x7fb30c159450 2023-07-20T10:06:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.326+0000 7fb3097fa640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 0x7fb2f0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.326+0000 7fb310a81640 1 -- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 msgr2=0x7fb2f0068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:24.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.326+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fb2f8084200 con 0x7fb30c159450 2023-07-20T10:06:24.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.326+0000 7fb310a81640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 0x7fb2f0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:24.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.326+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2f80514b0 con 0x7fb30c159450 2023-07-20T10:06:24.315 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:24.340+0000 7facd402d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:24.348 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:24.370+0000 7fd0b3801180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:24.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.478+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb30c04da30 con 0x7fb30c159450 2023-07-20T10:06:24.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.478+0000 7fb3097fa640 1 -- 172.21.15.82:0/3745198982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2f8054ad0 con 0x7fb30c159450 2023-07-20T10:06:24.459 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:06:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 msgr2=0x7fb2f0068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 0x7fb2f0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 msgr2=0x7fb30c0b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800ebe0 tx=0x7fb2f800c520 comp rx=0 tx=0).stop 2023-07-20T10:06:24.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 shutdown_connections 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fb2f00663a0 0x7fb2f0068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb30c158590 0x7fb30c1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb30c159450 0x7fb30c0b1790 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 --2- 172.21.15.82:0/3745198982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb30c0cc3e0 0x7fb30c0c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 >> 172.21.15.82:0/3745198982 conn(0x7fb30c0cad50 msgr2=0x7fb30c15a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 shutdown_connections 2023-07-20T10:06:24.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.482+0000 7fb312ce5640 1 -- 172.21.15.82:0/3745198982 wait complete. 2023-07-20T10:06:24.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:06:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.690+0000 7fde6058f640 1 Processor -- start 2023-07-20T10:06:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.690+0000 7fde6058f640 1 -- start start 2023-07-20T10:06:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde6058f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde5815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde6058f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde580afd50 0x7fde580b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde6058f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580cc8d0 con 0x7fde58159830 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde6058f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580cce90 con 0x7fde580afd50 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde6058f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b0700 con 0x7fde58159450 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde580afd50 0x7fde580b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fde580afd50 0x7fde580b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42062/0 (socket says 172.21.15.82:42062) 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 -- 172.21.15.82:0/1381925581 learned_addr learned my addr 172.21.15.82:0/1381925581 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:24.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5e32b640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde5815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 -- 172.21.15.82:0/1381925581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 msgr2=0x7fde5815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde5815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 -- 172.21.15.82:0/1381925581 >> v1:172.21.15.183:6789/0 conn(0x7fde58159830 legacy=0x7fde580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.694+0000 7fde5eb2c640 1 -- 172.21.15.82:0/1381925581 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580ccbb0 con 0x7fde580afd50 2023-07-20T10:06:24.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde5eb2c640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580afd50 0x7fde580b01c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fde50009e80 tx=0x7fde5001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95e709b68eff160 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:24.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde5d329640 1 -- 172.21.15.82:0/1381925581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500a5880 con 0x7fde580afd50 2023-07-20T10:06:24.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde5d329640 1 -- 172.21.15.82:0/1381925581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500a59e0 con 0x7fde580afd50 2023-07-20T10:06:24.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde5d329640 1 -- 172.21.15.82:0/1381925581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500a5d70 con 0x7fde580afd50 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 -- 172.21.15.82:0/1381925581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580afd50 msgr2=0x7fde580b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580afd50 0x7fde580b01c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fde50009e80 tx=0x7fde5001c9c0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 -- 172.21.15.82:0/1381925581 shutdown_connections 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580afd50 0x7fde580b01c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 --2- 172.21.15.82:0/1381925581 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde5815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 -- 172.21.15.82:0/1381925581 >> 172.21.15.82:0/1381925581 conn(0x7fde580cad50 msgr2=0x7fde580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:24.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 -- 172.21.15.82:0/1381925581 shutdown_connections 2023-07-20T10:06:24.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.698+0000 7fde6058f640 1 -- 172.21.15.82:0/1381925581 wait complete. 2023-07-20T10:06:24.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 Processor -- start 2023-07-20T10:06:24.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- start start 2023-07-20T10:06:24.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde580afd50 0x7fde58151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde580ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580af840 con 0x7fde580acf10 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde58152190 con 0x7fde580afd50 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580ae970 con 0x7fde58159450 2023-07-20T10:06:24.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42072/0 (socket says 172.21.15.82:42072) 2023-07-20T10:06:24.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 -- 172.21.15.82:0/511395905 learned_addr learned my addr 172.21.15.82:0/511395905 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:24.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5e32b640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde580afd50 0x7fde58151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5db2a640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde580ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:24.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 -- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 msgr2=0x7fde580ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde580ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 -- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde580afd50 msgr2=0x7fde58151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde580afd50 0x7fde58151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 -- 172.21.15.82:0/511395905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009b30 con 0x7fde580acf10 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde5eb2c640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fde500af040 tx=0x7fde50019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b8670 con 0x7fde580acf10 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500b87f0 con 0x7fde580acf10 2023-07-20T10:06:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b8ba0 con 0x7fde580acf10 2023-07-20T10:06:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde580aebc0 con 0x7fde580acf10 2023-07-20T10:06:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.702+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580af180 con 0x7fde580acf10 2023-07-20T10:06:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580af980 con 0x7fde580acf10 2023-07-20T10:06:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fde500b8d00 con 0x7fde580acf10 2023-07-20T10:06:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde4effd640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 0x7fde3c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde5e32b640 1 -- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 msgr2=0x7fde3c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fde5011f690 con 0x7fde580acf10 2023-07-20T10:06:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.706+0000 7fde5e32b640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 0x7fde3c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:24.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.710+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde580af980 con 0x7fde580acf10 2023-07-20T10:06:24.798 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:24.820+0000 7facd402d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:24.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.858+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde580af980 con 0x7fde580acf10 2023-07-20T10:06:24.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde4effd640 1 -- 172.21.15.82:0/511395905 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde580af980 con 0x7fde580acf10 2023-07-20T10:06:24.841 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:06:24.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 msgr2=0x7fde3c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 0x7fde3c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 msgr2=0x7fde5806b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fde500af040 tx=0x7fde50019760 comp rx=0 tx=0).stop 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 shutdown_connections 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fde3c0663a0 0x7fde3c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde580acf10 0x7fde5806b620 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde58159450 0x7fde580ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 --2- 172.21.15.82:0/511395905 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde580afd50 0x7fde58151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:24.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 >> 172.21.15.82:0/511395905 conn(0x7fde580cad50 msgr2=0x7fde580c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:24.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 shutdown_connections 2023-07-20T10:06:24.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fde6058f640 1 -- 172.21.15.82:0/511395905 wait complete. 2023-07-20T10:06:24.844 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:24.862+0000 7fd0b3801180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:24.855 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:24.880+0000 7facd402d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:24.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:06:24.905 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:24.926+0000 7fd0b3801180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:24.911 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:24.936+0000 7facd402d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:24.963 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:24.982+0000 7fd0b3801180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:24.996 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.020+0000 7facd402d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:25.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.026+0000 7f6106167640 1 Processor -- start 2023-07-20T10:06:25.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.026+0000 7f6106167640 1 -- start start 2023-07-20T10:06:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f6106167640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 0x7f61000cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f6106167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 0x7f6100160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f6106167640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61000d0970 con 0x7f610006ab10 2023-07-20T10:06:25.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f6106167640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6100160e20 con 0x7f610006c120 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f6106167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000cd300 con 0x7f61001602b0 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60fffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f610006ab10 0x7f610006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48926/0 (socket says 172.21.15.82:48926) 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60fffff640 1 -- 172.21.15.82:0/1296173280 learned_addr learned my addr 172.21.15.82:0/1296173280 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60f7fff640 1 --2- 172.21.15.82:0/1296173280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 0x7f6100160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60ff7fe640 1 --2- 172.21.15.82:0/1296173280 >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 0x7f61000cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60feffd640 1 -- 172.21.15.82:0/1296173280 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909710544 0 0) 0x7f61000d0970 con 0x7f610006ab10 2023-07-20T10:06:25.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60feffd640 1 -- 172.21.15.82:0/1296173280 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ec003530 con 0x7f610006ab10 2023-07-20T10:06:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60f7fff640 1 -- 172.21.15.82:0/1296173280 >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 msgr2=0x7f61000cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60f7fff640 1 --2- 172.21.15.82:0/1296173280 >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 0x7f61000cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60f7fff640 1 -- 172.21.15.82:0/1296173280 >> v1:172.21.15.82:6789/0 conn(0x7f610006ab10 legacy=0x7f610006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60f7fff640 1 -- 172.21.15.82:0/1296173280 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000cd5e0 con 0x7f61001602b0 2023-07-20T10:06:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.030+0000 7f60ff7fe640 1 --2- 172.21.15.82:0/1296173280 >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 0x7f61000cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f60f7fff640 1 --2- 172.21.15.82:0/1296173280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 0x7f6100160710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097c0 tx=0x7f60e801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15bed096ede62a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f60feffd640 1 -- 172.21.15.82:0/1296173280 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80ab600 con 0x7f61001602b0 2023-07-20T10:06:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f60feffd640 1 -- 172.21.15.82:0/1296173280 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e80a7050 con 0x7f61001602b0 2023-07-20T10:06:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f60feffd640 1 -- 172.21.15.82:0/1296173280 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e80ab980 con 0x7f61001602b0 2023-07-20T10:06:25.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- 172.21.15.82:0/1296173280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 msgr2=0x7f6100160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 --2- 172.21.15.82:0/1296173280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 0x7f6100160710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f60e80097c0 tx=0x7f60e801c3f0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- 172.21.15.82:0/1296173280 shutdown_connections 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 --2- 172.21.15.82:0/1296173280 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61001602b0 0x7f6100160710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 --2- 172.21.15.82:0/1296173280 >> v2:172.21.15.183:3300/0 conn(0x7f610006c120 0x7f61000cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- 172.21.15.82:0/1296173280 >> 172.21.15.82:0/1296173280 conn(0x7f610008c0a0 msgr2=0x7f610009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- 172.21.15.82:0/1296173280 shutdown_connections 2023-07-20T10:06:25.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- 172.21.15.82:0/1296173280 wait complete. 2023-07-20T10:06:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 Processor -- start 2023-07-20T10:06:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.034+0000 7f6106167640 1 -- start start 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610006c120 0x7f61001565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 0x7f61000b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000b5fd0 con 0x7f610006ab10 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61000b62b0 con 0x7f61001602b0 2023-07-20T10:06:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61000b6590 con 0x7f610006c120 2023-07-20T10:06:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42082/0 (socket says 172.21.15.82:42082) 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60f7fff640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610006c120 0x7f61001565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 -- 172.21.15.82:0/68985408 learned_addr learned my addr 172.21.15.82:0/68985408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fffff640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 0x7f61000b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 -- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610006c120 msgr2=0x7f61001565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610006c120 0x7f61001565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 -- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 msgr2=0x7f61000b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 0x7f61000b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 -- 172.21.15.82:0/68985408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009420 con 0x7f610006ab10 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fffff640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 0x7f61000b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60ff7fe640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ebe0 tx=0x7f60f000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f000eee0 con 0x7f610006ab10 2023-07-20T10:06:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f000cc30 con 0x7f610006ab10 2023-07-20T10:06:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0013470 con 0x7f610006ab10 2023-07-20T10:06:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8009420 con 0x7f610006ab10 2023-07-20T10:06:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61000b6b50 con 0x7f610006ab10 2023-07-20T10:06:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610004da30 con 0x7f610006ab10 2023-07-20T10:06:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.038+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f60f00135d0 con 0x7f610006ab10 2023-07-20T10:06:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.042+0000 7f60fcff9640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 0x7f60e0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.042+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f60f00841c0 con 0x7f610006ab10 2023-07-20T10:06:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.042+0000 7f60f7fff640 1 -- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 msgr2=0x7f60e0068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.042+0000 7f60f7fff640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 0x7f60e0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.046+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60f0054fa0 con 0x7f610006ab10 2023-07-20T10:06:25.055 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.080+0000 7facd402d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:25.056 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.074+0000 7fd0b3801180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:25.113 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.134+0000 7fd0b3801180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:25.139 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.164+0000 7facd402d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.198+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6100157130 con 0x7f610006ab10 2023-07-20T10:06:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.198+0000 7f60fcff9640 1 -- 172.21.15.82:0/68985408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60f0054b30 con 0x7f610006ab10 2023-07-20T10:06:25.179 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:06:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 msgr2=0x7f60e0068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 0x7f60e0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 msgr2=0x7f6100156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f60f000ebe0 tx=0x7f60f000c520 comp rx=0 tx=0).stop 2023-07-20T10:06:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 shutdown_connections 2023-07-20T10:06:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f60e00663a0 0x7f60e0068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61001602b0 0x7f61000b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f610006c120 0x7f61001565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 --2- 172.21.15.82:0/68985408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f610006ab10 0x7f6100156060 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 >> 172.21.15.82:0/68985408 conn(0x7f610008c0a0 msgr2=0x7f6100157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 shutdown_connections 2023-07-20T10:06:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.202+0000 7f6106167640 1 -- 172.21.15.82:0/68985408 wait complete. 2023-07-20T10:06:25.195 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.220+0000 7facd402d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:25.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:06:25.201 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.222+0000 7fd0b3801180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:25.257 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.278+0000 7fd0b3801180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:25.336 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.360+0000 7facd402d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:25.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.406+0000 7fe953b03640 1 Processor -- start 2023-07-20T10:06:25.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 -- start start 2023-07-20T10:06:25.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 0x7fe94c06af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c0ce4f0 con 0x7fe94c06c120 2023-07-20T10:06:25.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06b4c0 con 0x7fe94c06ab10 2023-07-20T10:06:25.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe953b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0d0970 con 0x7fe94c1602b0 2023-07-20T10:06:25.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe9520a0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 0x7fe94c06af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:52232/0 (socket says 172.21.15.82:52232) 2023-07-20T10:06:25.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 -- 172.21.15.82:0/3850208310 learned_addr learned my addr 172.21.15.82:0/3850208310 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:25.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95189f640 1 --1- 172.21.15.82:0/3850208310 >> v1:172.21.15.183:6789/0 conn(0x7fe94c06c120 0x7fe94c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:36150/0 (socket says 172.21.15.82:36150) 2023-07-20T10:06:25.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 -- 172.21.15.82:0/3850208310 >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 msgr2=0x7fe94c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:25.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 --2- 172.21.15.82:0/3850208310 >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 0x7fe94c06af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 -- 172.21.15.82:0/3850208310 >> v1:172.21.15.183:6789/0 conn(0x7fe94c06c120 legacy=0x7fe94c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe95109e640 1 -- 172.21.15.82:0/3850208310 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c160e20 con 0x7fe94c1602b0 2023-07-20T10:06:25.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.410+0000 7fe9520a0640 1 --2- 172.21.15.82:0/3850208310 >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 0x7fe94c06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe95109e640 1 --2- 172.21.15.82:0/3850208310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009870 tx=0x7fe93c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3a7a65eb8b49b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe95089d640 1 -- 172.21.15.82:0/3850208310 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0ac600 con 0x7fe94c1602b0 2023-07-20T10:06:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe95089d640 1 -- 172.21.15.82:0/3850208310 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0a8050 con 0x7fe94c1602b0 2023-07-20T10:06:25.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe95089d640 1 -- 172.21.15.82:0/3850208310 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0ac980 con 0x7fe94c1602b0 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- 172.21.15.82:0/3850208310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 msgr2=0x7fe94c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 --2- 172.21.15.82:0/3850208310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009870 tx=0x7fe93c01c4b0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- 172.21.15.82:0/3850208310 shutdown_connections 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 --2- 172.21.15.82:0/3850208310 >> v2:172.21.15.183:3300/0 conn(0x7fe94c06ab10 0x7fe94c06af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 --2- 172.21.15.82:0/3850208310 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c1602b0 0x7fe94c160710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- 172.21.15.82:0/3850208310 >> 172.21.15.82:0/3850208310 conn(0x7fe94c08c0a0 msgr2=0x7fe94c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- 172.21.15.82:0/3850208310 shutdown_connections 2023-07-20T10:06:25.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- 172.21.15.82:0/3850208310 wait complete. 2023-07-20T10:06:25.396 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.420+0000 7facd402d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:25.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 Processor -- start 2023-07-20T10:06:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.414+0000 7fe953b03640 1 -- start start 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c06ab10 0x7fe94c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94c1602b0 0x7fe94c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0cb710 con 0x7fe94c06c120 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0c6180 con 0x7fe94c1602b0 2023-07-20T10:06:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c154bf0 con 0x7fe94c06ab10 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42086/0 (socket says 172.21.15.82:42086) 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 -- 172.21.15.82:0/561490828 learned_addr learned my addr 172.21.15.82:0/561490828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95189f640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c06ab10 0x7fe94c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe9520a0640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94c1602b0 0x7fe94c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 -- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c06ab10 msgr2=0x7fe94c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c06ab10 0x7fe94c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 -- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94c1602b0 msgr2=0x7fe94c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94c1602b0 0x7fe94c1546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 -- 172.21.15.82:0/561490828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009a70 con 0x7fe94c06c120 2023-07-20T10:06:25.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe95109e640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe93c01ab60 tx=0x7fe93c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0b5460 con 0x7fe94c06c120 2023-07-20T10:06:25.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c0b55c0 con 0x7fe94c06c120 2023-07-20T10:06:25.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c0094d0 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0b5970 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c0cbc00 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.418+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c04da30 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.422+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fe93c0b3070 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.422+0000 7fe9427fc640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 0x7fe930068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.422+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fe93c11e250 con 0x7fe94c06c120 2023-07-20T10:06:25.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.422+0000 7fe95189f640 1 -- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 msgr2=0x7fe930068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:25.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.422+0000 7fe95189f640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 0x7fe930068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:25.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.426+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe93c0eb360 con 0x7fe94c06c120 2023-07-20T10:06:25.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.426+0000 7fd0b3801180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:25.466 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.486+0000 7fd0b3801180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.574+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe94c0cee40 con 0x7fe94c06c120 2023-07-20T10:06:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.574+0000 7fe9427fc640 1 -- 172.21.15.82:0/561490828 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe93c0ee980 con 0x7fe94c06c120 2023-07-20T10:06:25.555 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:06:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 msgr2=0x7fe930068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 0x7fe930068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 msgr2=0x7fe94c0cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe93c01ab60 tx=0x7fe93c019250 comp rx=0 tx=0).stop 2023-07-20T10:06:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 shutdown_connections 2023-07-20T10:06:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fe9300663a0 0x7fe930068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe94c1602b0 0x7fe94c1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe94c06c120 0x7fe94c0cb1d0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 --2- 172.21.15.82:0/561490828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe94c06ab10 0x7fe94c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 >> 172.21.15.82:0/561490828 conn(0x7fe94c08c0a0 msgr2=0x7fe94c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 shutdown_connections 2023-07-20T10:06:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.578+0000 7fe953b03640 1 -- 172.21.15.82:0/561490828 wait complete. 2023-07-20T10:06:25.577 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:06:25.635 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:25.636 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:25.636 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:25.644 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.668+0000 7facd402d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:25.711 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:25.711 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:25.711 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:25.720 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.738+0000 7fd0b3801180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:25.777 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.800+0000 7facd402d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 Processor -- start 2023-07-20T10:06:25.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 -- start start 2023-07-20T10:06:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7401596b0 0x7fc74015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400cc900 0x7fc7400ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc7400b2380 0x7fc7400b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400b2d50 con 0x7fc7401596b0 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400ad600 con 0x7fc7400b2380 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.826+0000 7fc745933640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400ccd60 con 0x7fc7400cc900 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7401596b0 0x7fc74015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7401596b0 0x7fc74015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42098/0 (socket says 172.21.15.82:42098) 2023-07-20T10:06:25.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 -- 172.21.15.82:0/480914936 learned_addr learned my addr 172.21.15.82:0/480914936 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73f7fe640 1 --2- 172.21.15.82:0/480914936 >> v2:172.21.15.183:3300/0 conn(0x7fc7400b2380 0x7fc7400b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc737fff640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400cc900 0x7fc7400ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 -- 172.21.15.82:0/480914936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400cc900 msgr2=0x7fc7400ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:25.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400cc900 0x7fc7400ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 -- 172.21.15.82:0/480914936 >> v2:172.21.15.183:3300/0 conn(0x7fc7400b2380 msgr2=0x7fc7400b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:25.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 --2- 172.21.15.82:0/480914936 >> v2:172.21.15.183:3300/0 conn(0x7fc7400b2380 0x7fc7400b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 -- 172.21.15.82:0/480914936 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400ad810 con 0x7fc7401596b0 2023-07-20T10:06:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73effd640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc74015dbb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b0e20 tx=0x7fc73001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5909c935bef3282 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73e7fc640 1 -- 172.21.15.82:0/480914936 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300aa5f0 con 0x7fc7401596b0 2023-07-20T10:06:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73e7fc640 1 -- 172.21.15.82:0/480914936 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300aa750 con 0x7fc7401596b0 2023-07-20T10:06:25.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.830+0000 7fc73e7fc640 1 -- 172.21.15.82:0/480914936 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300aaae0 con 0x7fc7401596b0 2023-07-20T10:06:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- 172.21.15.82:0/480914936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 msgr2=0x7fc74015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc74015dbb0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc7400b0e20 tx=0x7fc73001c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- 172.21.15.82:0/480914936 shutdown_connections 2023-07-20T10:06:25.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- 172.21.15.82:0/480914936 >> v2:172.21.15.183:3300/0 conn(0x7fc7400b2380 0x7fc7400b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400cc900 0x7fc7400ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- 172.21.15.82:0/480914936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc74015dbb0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- 172.21.15.82:0/480914936 >> 172.21.15.82:0/480914936 conn(0x7fc7400cada0 msgr2=0x7fc7400cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- 172.21.15.82:0/480914936 shutdown_connections 2023-07-20T10:06:25.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- 172.21.15.82:0/480914936 wait complete. 2023-07-20T10:06:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 Processor -- start 2023-07-20T10:06:25.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- start start 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7400cc900 0x7fc7400c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc7400c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400ac4b0 con 0x7fc7401596b0 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400ac790 con 0x7fc7400cc900 2023-07-20T10:06:25.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc745933640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7400aca70 con 0x7fc7400b2380 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc73effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc73f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc7400c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc73effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:52266/0 (socket says 172.21.15.82:52266) 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc73effd640 1 -- 172.21.15.82:0/611320860 learned_addr learned my addr 172.21.15.82:0/611320860 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.834+0000 7fc737fff640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7400cc900 0x7fc7400c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 -- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7400cc900 msgr2=0x7fc7400c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7400cc900 0x7fc7400c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 -- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 msgr2=0x7fc7400c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc7400c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 -- 172.21.15.82:0/611320860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300094d0 con 0x7fc7400b2380 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73effd640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc73001ab80 tx=0x7fc73001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300bd5f0 con 0x7fc7400b2380 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300bd750 con 0x7fc7400b2380 2023-07-20T10:06:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300bdb00 con 0x7fc7400b2380 2023-07-20T10:06:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc740159f80 con 0x7fc7400b2380 2023-07-20T10:06:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7400ab9e0 con 0x7fc7400b2380 2023-07-20T10:06:25.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400ac8d0 con 0x7fc7400b2380 2023-07-20T10:06:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.838+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fc7300b33f0 con 0x7fc7400b2380 2023-07-20T10:06:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.842+0000 7fc73cff9640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 0x7fc720068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.842+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc7300a7070 con 0x7fc7400b2380 2023-07-20T10:06:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.842+0000 7fc737fff640 1 -- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 msgr2=0x7fc720068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:25.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.842+0000 7fc737fff640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 0x7fc720068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:25.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:25.846+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7400ac8d0 con 0x7fc7400b2380 2023-07-20T10:06:25.860 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:25.878+0000 7fd0b3801180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:25.902 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.924+0000 7facd402d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:25.973 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:25.996+0000 7facd402d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:06:25.987 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:26.006+0000 7fd0b3801180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:25.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.006+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc7400ac8d0 con 0x7fc7400b2380 2023-07-20T10:06:25.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc73cff9640 1 -- 172.21.15.82:0/611320860 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v95) v1 ==== 80+0+469 (secure 0 0 0) 0x7fc7400ac8d0 con 0x7fc7400b2380 2023-07-20T10:06:25.989 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/957540597 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.989 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4054446550 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.989 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2903119807 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.989 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3702343324 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.989 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/3956036202 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.990 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1345031035 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.990 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/3956036202 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.990 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1526530333 2023-07-21T10:06:21.577437+0000 2023-07-20T10:06:25.990 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T10:06:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 msgr2=0x7fc720068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 0x7fc720068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 msgr2=0x7fc740151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:25.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc73001ab80 tx=0x7fc73001ad10 comp rx=0 tx=0).stop 2023-07-20T10:06:25.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 shutdown_connections 2023-07-20T10:06:25.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fc7200663a0 0x7fc720068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7401596b0 0x7fc7400c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7400cc900 0x7fc7400c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 --2- 172.21.15.82:0/611320860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7400b2380 0x7fc740151d10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 >> 172.21.15.82:0/611320860 conn(0x7fc7400cada0 msgr2=0x7fc740155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 shutdown_connections 2023-07-20T10:06:25.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.010+0000 7fc745933640 1 -- 172.21.15.82:0/611320860 wait complete. 2023-07-20T10:06:26.010 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:06:26.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:26.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:26.062 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:26.082+0000 7fd0b3801180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:06:26.065 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:06:26.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:26.066 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:06:26.076 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:06:26.077 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:26.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:06:26.087 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:26.088 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:26.109 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:26.132+0000 7facd402d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:26.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:06:26.129 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:06:26.130 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:26.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:06:26.139 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:26.200 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:26.217+0000 7fd0b3801180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 Processor -- start 2023-07-20T10:06:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 -- start start 2023-07-20T10:06:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0b3415a8e0 0x7f0b340ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b340b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340b06c0 con 0x7f0b340afda0 2023-07-20T10:06:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b340b3160 con 0x7f0b3415a8e0 2023-07-20T10:06:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3b26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b12a0 con 0x7f0b340b2060 2023-07-20T10:06:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b39009640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0b340afda0 0x7f0b340b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48940/0 (socket says 172.21.15.82:48940) 2023-07-20T10:06:26.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b39009640 1 -- 172.21.15.82:0/695146710 learned_addr learned my addr 172.21.15.82:0/695146710 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:26.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b3980a640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b340b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b38808640 1 --2- 172.21.15.82:0/695146710 >> v2:172.21.15.183:3300/0 conn(0x7f0b3415a8e0 0x7f0b340ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b2bfff640 1 -- 172.21.15.82:0/695146710 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830554331 0 0) 0x7f0b340b06c0 con 0x7f0b340afda0 2023-07-20T10:06:26.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b2bfff640 1 -- 172.21.15.82:0/695146710 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b20003530 con 0x7f0b340afda0 2023-07-20T10:06:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b38808640 1 -- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 msgr2=0x7f0b340b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b38808640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b340b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b38808640 1 -- 172.21.15.82:0/695146710 >> v1:172.21.15.82:6789/0 conn(0x7f0b340afda0 legacy=0x7f0b340b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.333+0000 7f0b38808640 1 -- 172.21.15.82:0/695146710 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340b1580 con 0x7f0b3415a8e0 2023-07-20T10:06:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b38808640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b340ca6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0b240097c0 tx=0x7f0b2401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1af0a81a6f968472 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b2bfff640 1 -- 172.21.15.82:0/695146710 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ab600 con 0x7f0b3415a8e0 2023-07-20T10:06:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b2bfff640 1 -- 172.21.15.82:0/695146710 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240a7050 con 0x7f0b3415a8e0 2023-07-20T10:06:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b2bfff640 1 -- 172.21.15.82:0/695146710 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ab980 con 0x7f0b3415a8e0 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 -- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 msgr2=0x7f0b340ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b340ca6b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0b240097c0 tx=0x7f0b2401c330 comp rx=0 tx=0).stop 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 -- 172.21.15.82:0/695146710 shutdown_connections 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b340b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/695146710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b340ca6b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 -- 172.21.15.82:0/695146710 >> 172.21.15.82:0/695146710 conn(0x7f0b340cada0 msgr2=0x7f0b340cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:26.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 -- 172.21.15.82:0/695146710 shutdown_connections 2023-07-20T10:06:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.337+0000 7f0b3b26d640 1 -- 172.21.15.82:0/695146710 wait complete. 2023-07-20T10:06:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 Processor -- start 2023-07-20T10:06:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- start start 2023-07-20T10:06:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b3415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b34070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3415cb50 con 0x7f0b340afda0 2023-07-20T10:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3415ce30 con 0x7f0b3415a8e0 2023-07-20T10:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3415d110 con 0x7f0b340b2060 2023-07-20T10:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42108/0 (socket says 172.21.15.82:42108) 2023-07-20T10:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 -- 172.21.15.82:0/2585340145 learned_addr learned my addr 172.21.15.82:0/2585340145 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3980a640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b34070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b38808640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b3415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 -- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 msgr2=0x7f0b3415c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b3415c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 -- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 msgr2=0x7f0b34070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b34070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 -- 172.21.15.82:0/2585340145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24009420 con 0x7f0b340afda0 2023-07-20T10:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b39009640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c4d0 tx=0x7f0b3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30005cf0 con 0x7f0b340afda0 2023-07-20T10:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30005e50 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30007270 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3415d3f0 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.341+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b34163ed0 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b34073c70 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f0b300073d0 con 0x7f0b340afda0 2023-07-20T10:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b29ffb640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 0x7f0b18068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0b300835d0 con 0x7f0b340afda0 2023-07-20T10:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b38808640 1 -- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 msgr2=0x7f0b18068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.345+0000 7f0b38808640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 0x7f0b18068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.349+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b300507f0 con 0x7f0b340afda0 2023-07-20T10:06:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b340cb990 con 0x7f0b340afda0 2023-07-20T10:06:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b29ffb640 1 -- 172.21.15.82:0/2585340145 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f0b30053e10 con 0x7f0b340afda0 2023-07-20T10:06:26.522 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:26.522 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 msgr2=0x7f0b18068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 0x7f0b18068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 msgr2=0x7f0b34164bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c4d0 tx=0x7f0b3000c990 comp rx=0 tx=0).stop 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 shutdown_connections 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f0b180663a0 0x7f0b18068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b3415a8e0 0x7f0b34070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b340b2060 0x7f0b3415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 --2- 172.21.15.82:0/2585340145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b340afda0 0x7f0b34164bb0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 >> 172.21.15.82:0/2585340145 conn(0x7f0b340cada0 msgr2=0x7f0b3406faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 shutdown_connections 2023-07-20T10:06:26.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.541+0000 7f0b3b26d640 1 -- 172.21.15.82:0/2585340145 wait complete. 2023-07-20T10:06:26.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:26.648 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:26.672+0000 7facd402d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:06:26.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.749+0000 7f7acb26d640 1 Processor -- start 2023-07-20T10:06:26.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.749+0000 7f7acb26d640 1 -- start start 2023-07-20T10:06:26.732 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:26.756+0000 7facd402d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:06:26.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7acb26d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ac415cab0 0x7f7ac40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7acb26d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7ac40d0d10 0x7f7ac40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7acb26d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac40d16b0 con 0x7f7ac40cf110 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7acb26d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40d31c0 con 0x7f7ac415cab0 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7acb26d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40b3520 con 0x7f7ac40d0d10 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac980a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ac40cf110 0x7f7ac40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48954/0 (socket says 172.21.15.82:48954) 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac980a640 1 -- 172.21.15.82:0/3962315414 learned_addr learned my addr 172.21.15.82:0/3962315414 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac9009640 1 --2- 172.21.15.82:0/3962315414 >> v2:172.21.15.82:3300/0 conn(0x7f7ac415cab0 0x7f7ac40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac8808640 1 --2- 172.21.15.82:0/3962315414 >> v2:172.21.15.183:3300/0 conn(0x7f7ac40d0d10 0x7f7ac40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac9009640 1 -- 172.21.15.82:0/3962315414 >> v2:172.21.15.183:3300/0 conn(0x7f7ac40d0d10 msgr2=0x7f7ac40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:26.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac9009640 1 --2- 172.21.15.82:0/3962315414 >> v2:172.21.15.183:3300/0 conn(0x7f7ac40d0d10 0x7f7ac40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac9009640 1 -- 172.21.15.82:0/3962315414 >> v1:172.21.15.82:6789/0 conn(0x7f7ac40cf110 legacy=0x7f7ac40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.753+0000 7f7ac9009640 1 -- 172.21.15.82:0/3962315414 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40b2910 con 0x7f7ac415cab0 2023-07-20T10:06:26.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7ac9009640 1 --2- 172.21.15.82:0/3962315414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40d0300 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40d0190 tx=0x7f7ac001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d41d75c266b1ea server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:26.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7abbfff640 1 -- 172.21.15.82:0/3962315414 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00a7070 con 0x7f7ac415cab0 2023-07-20T10:06:26.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7abbfff640 1 -- 172.21.15.82:0/3962315414 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00ab430 con 0x7f7ac415cab0 2023-07-20T10:06:26.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7abbfff640 1 -- 172.21.15.82:0/3962315414 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00ab7c0 con 0x7f7ac415cab0 2023-07-20T10:06:26.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- 172.21.15.82:0/3962315414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 msgr2=0x7f7ac40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3962315414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40d0300 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40d0190 tx=0x7f7ac001c430 comp rx=0 tx=0).stop 2023-07-20T10:06:26.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- 172.21.15.82:0/3962315414 shutdown_connections 2023-07-20T10:06:26.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3962315414 >> v2:172.21.15.183:3300/0 conn(0x7f7ac40d0d10 0x7f7ac40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3962315414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40d0300 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- 172.21.15.82:0/3962315414 >> 172.21.15.82:0/3962315414 conn(0x7f7ac408c120 msgr2=0x7f7ac409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:26.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- 172.21.15.82:0/3962315414 shutdown_connections 2023-07-20T10:06:26.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- 172.21.15.82:0/3962315414 wait complete. 2023-07-20T10:06:26.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 Processor -- start 2023-07-20T10:06:26.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.757+0000 7f7acb26d640 1 -- start start 2023-07-20T10:06:26.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ac40cf110 0x7f7ac4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 0x7f7ac40cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40caf30 con 0x7f7ac415cab0 2023-07-20T10:06:26.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40ca2b0 con 0x7f7ac40d0d10 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40ca590 con 0x7f7ac40cf110 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42120/0 (socket says 172.21.15.82:42120) 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 -- 172.21.15.82:0/3269771122 learned_addr learned my addr 172.21.15.82:0/3269771122 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac8808640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 0x7f7ac40cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac9009640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ac40cf110 0x7f7ac4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:26.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 -- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ac40cf110 msgr2=0x7f7ac4155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ac40cf110 0x7f7ac4155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 -- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 msgr2=0x7f7ac40cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 0x7f7ac40cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 -- 172.21.15.82:0/3269771122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009420 con 0x7f7ac415cab0 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac8808640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 0x7f7ac40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ac980a640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00ca80 tx=0x7f7abc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00ac30 con 0x7f7ac415cab0 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc00ad90 con 0x7f7ac415cab0 2023-07-20T10:06:26.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac40ca870 con 0x7f7ac415cab0 2023-07-20T10:06:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc012600 con 0x7f7ac415cab0 2023-07-20T10:06:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41563b0 con 0x7f7ac415cab0 2023-07-20T10:06:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac40cb070 con 0x7f7ac415cab0 2023-07-20T10:06:26.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.761+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f7abc007070 con 0x7f7ac415cab0 2023-07-20T10:06:26.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.765+0000 7f7ab9ffb640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 0x7f7aa8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:26.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.765+0000 7f7ac9009640 1 -- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 msgr2=0x7f7aa8068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:26.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.765+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f7abc083e20 con 0x7f7ac415cab0 2023-07-20T10:06:26.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.765+0000 7f7ac9009640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 0x7f7aa8068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:26.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.769+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ac40cb070 con 0x7f7ac415cab0 2023-07-20T10:06:26.758 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:26.777+0000 7fd0b3801180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:06:26.844 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:26.861+0000 7fd0b3801180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:06:26.879 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:26.904+0000 7facd402d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:06:26.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.917+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac40cb070 con 0x7f7ac415cab0 2023-07-20T10:06:26.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7ab9ffb640 1 -- 172.21.15.82:0/3269771122 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18830 (secure 0 0 0) 0x7f7ac40cb070 con 0x7f7ac415cab0 2023-07-20T10:06:26.901 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:26.901 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":95,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:21.577470+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/957540597":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/4054446550":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/2903119807":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/3702343324":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6833/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1345031035":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6832/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1526530333":"2023-07-21T10:06:21.577437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 msgr2=0x7f7aa8068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 0x7f7aa8068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 msgr2=0x7f7ac40cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00ca80 tx=0x7f7abc00cf40 comp rx=0 tx=0).stop 2023-07-20T10:06:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 shutdown_connections 2023-07-20T10:06:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f7aa80663d0 0x7f7aa8068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ac415cab0 0x7f7ac40cbee0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ac40d0d10 0x7f7ac40cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 --2- 172.21.15.82:0/3269771122 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ac40cf110 0x7f7ac4155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 >> 172.21.15.82:0/3269771122 conn(0x7f7ac408c120 msgr2=0x7f7ac40b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 shutdown_connections 2023-07-20T10:06:26.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:26.921+0000 7f7acb26d640 1 -- 172.21.15.82:0/3269771122 wait complete. 2023-07-20T10:06:26.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:06:02.070880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:06:03.385311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:06:26.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:06:26.964 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:26.988+0000 7facd402d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:06:26.997 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.017+0000 7fd0b3801180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:06:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.085+0000 7fa2b1767640 1 Processor -- start 2023-07-20T10:06:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.085+0000 7fa2b1767640 1 -- start start 2023-07-20T10:06:27.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2b1767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa2ac0ca5a0 0x7fa2ac15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2b1767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2b1767640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac071950 con 0x7fa2ac06f710 2023-07-20T10:06:27.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2b1767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac15bad0 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2b1767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac15b230 con 0x7fa2ac15ec90 2023-07-20T10:06:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2aaffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa2ac06f710 0x7fa2ac06faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48958/0 (socket says 172.21.15.82:48958) 2023-07-20T10:06:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2aaffd640 1 -- 172.21.15.82:0/506765747 learned_addr learned my addr 172.21.15.82:0/506765747 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2a27fc640 1 --2- 172.21.15.82:0/506765747 >> v2:172.21.15.183:3300/0 conn(0x7fa2ac0ca5a0 0x7fa2ac15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2ab7fe640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2aa7fc640 1 -- 172.21.15.82:0/506765747 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382483154 0 0) 0x7fa2ac071950 con 0x7fa2ac06f710 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2aa7fc640 1 -- 172.21.15.82:0/506765747 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa298003530 con 0x7fa2ac06f710 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2a27fc640 1 -- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 msgr2=0x7fa2ac15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2a27fc640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2a27fc640 1 -- 172.21.15.82:0/506765747 >> v1:172.21.15.82:6789/0 conn(0x7fa2ac06f710 legacy=0x7fa2ac06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.089+0000 7fa2a27fc640 1 -- 172.21.15.82:0/506765747 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac15b510 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2a27fc640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac15e750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2940097f0 tx=0x7fa29401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8062fe83c74731 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2aa7fc640 1 -- 172.21.15.82:0/506765747 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940ad660 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2aa7fc640 1 -- 172.21.15.82:0/506765747 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2940ad7c0 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2aa7fc640 1 -- 172.21.15.82:0/506765747 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2940adb50 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 -- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 msgr2=0x7fa2ac15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac15e750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2940097f0 tx=0x7fa29401c450 comp rx=0 tx=0).stop 2023-07-20T10:06:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 -- 172.21.15.82:0/506765747 shutdown_connections 2023-07-20T10:06:27.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 --2- 172.21.15.82:0/506765747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac15e750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 -- 172.21.15.82:0/506765747 >> 172.21.15.82:0/506765747 conn(0x7fa2ac0cad50 msgr2=0x7fa2ac0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 -- 172.21.15.82:0/506765747 shutdown_connections 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 -- 172.21.15.82:0/506765747 wait complete. 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.093+0000 7fa2b1767640 1 Processor -- start 2023-07-20T10:06:27.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- start start 2023-07-20T10:06:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0b1310 con 0x7fa2ac06f710 2023-07-20T10:06:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c7f50 con 0x7fa2ac0ca5a0 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac0c8230 con 0x7fa2ac15ec90 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42130/0 (socket says 172.21.15.82:42130) 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 -- 172.21.15.82:0/2207894629 learned_addr learned my addr 172.21.15.82:0/2207894629 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2a27fc640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2ab7fe640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 -- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 msgr2=0x7fa2ac0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 -- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 msgr2=0x7fa2ac0c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac0c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 -- 172.21.15.82:0/2207894629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009420 con 0x7fa2ac06f710 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2aaffd640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c420 tx=0x7fa29c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c005cf0 con 0x7fa2ac06f710 2023-07-20T10:06:27.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c005e50 con 0x7fa2ac06f710 2023-07-20T10:06:27.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c0072d0 con 0x7fa2ac06f710 2023-07-20T10:06:27.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ac0c8510 con 0x7fa2ac06f710 2023-07-20T10:06:27.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac153430 con 0x7fa2ac06f710 2023-07-20T10:06:27.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.097+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac0c86a0 con 0x7fa2ac06f710 2023-07-20T10:06:27.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.101+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fa29c007430 con 0x7fa2ac06f710 2023-07-20T10:06:27.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.101+0000 7fa2a3fff640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 0x7fa28c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.101+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa29c083580 con 0x7fa2ac06f710 2023-07-20T10:06:27.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.101+0000 7fa2a27fc640 1 -- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 msgr2=0x7fa28c068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:27.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.101+0000 7fa2a27fc640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 0x7fa28c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:27.087 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.105+0000 7fd0b3801180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:06:27.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.105+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa29c0507a0 con 0x7fa2ac06f710 2023-07-20T10:06:27.234 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:27.255+0000 7facd402d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:06:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.253+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2ac04da30 con 0x7fa2ac06f710 2023-07-20T10:06:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.253+0000 7fa2a3fff640 1 -- 172.21.15.82:0/2207894629 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa29c053dc0 con 0x7fa2ac06f710 2023-07-20T10:06:27.236 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:06:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 msgr2=0x7fa28c068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 0x7fa28c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 msgr2=0x7fa2ac0c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa29c00c420 tx=0x7fa29c00c8e0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 shutdown_connections 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7fa28c0663d0 0x7fa28c068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa2ac15ec90 0x7fa2ac0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa2ac0ca5a0 0x7fa2ac0c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 --2- 172.21.15.82:0/2207894629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa2ac06f710 0x7fa2ac0c3b80 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 >> 172.21.15.82:0/2207894629 conn(0x7fa2ac0cad50 msgr2=0x7fa2ac0adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 shutdown_connections 2023-07-20T10:06:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.257+0000 7fa2b1767640 1 -- 172.21.15.82:0/2207894629 wait complete. 2023-07-20T10:06:27.258 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:06:27.294 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:27.315+0000 7facd402d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:06:27.364 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.381+0000 7fd0b3801180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:06:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 Processor -- start 2023-07-20T10:06:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 -- start start 2023-07-20T10:06:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f70441602b0 0x7f7044160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f704406ab10 0x7f704406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70440ce4f0 con 0x7f704406c120 2023-07-20T10:06:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440d0970 con 0x7f704406ab10 2023-07-20T10:06:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f704aaf9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7044160e20 con 0x7f70441602b0 2023-07-20T10:06:27.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f704406ab10 0x7f704406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f704406ab10 0x7f704406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42142/0 (socket says 172.21.15.82:42142) 2023-07-20T10:06:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 -- 172.21.15.82:0/2802554041 learned_addr learned my addr 172.21.15.82:0/2802554041 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7043fff640 1 --2- 172.21.15.82:0/2802554041 >> v2:172.21.15.183:3300/0 conn(0x7f70441602b0 0x7f7044160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 -- 172.21.15.82:0/2802554041 >> v2:172.21.15.183:3300/0 conn(0x7f70441602b0 msgr2=0x7f7044160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:27.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 --2- 172.21.15.82:0/2802554041 >> v2:172.21.15.183:3300/0 conn(0x7f70441602b0 0x7f7044160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 -- 172.21.15.82:0/2802554041 >> v1:172.21.15.183:6789/0 conn(0x7f704406c120 legacy=0x7f70440cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.421+0000 7f7049096640 1 -- 172.21.15.82:0/2802554041 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440cd300 con 0x7f704406ab10 2023-07-20T10:06:27.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.425+0000 7f7049096640 1 --2- 172.21.15.82:0/2802554041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406ab10 0x7f704406af10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f704408ca40 tx=0x7f703c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fe85efe41ff465 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.425+0000 7f70437fe640 1 -- 172.21.15.82:0/2802554041 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a57d0 con 0x7f704406ab10 2023-07-20T10:06:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.425+0000 7f70437fe640 1 -- 172.21.15.82:0/2802554041 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0a5930 con 0x7f704406ab10 2023-07-20T10:06:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.425+0000 7f70437fe640 1 -- 172.21.15.82:0/2802554041 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a5cc0 con 0x7f704406ab10 2023-07-20T10:06:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- 172.21.15.82:0/2802554041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406ab10 msgr2=0x7f704406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- 172.21.15.82:0/2802554041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406ab10 0x7f704406af10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f704408ca40 tx=0x7f703c01c910 comp rx=0 tx=0).stop 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- 172.21.15.82:0/2802554041 shutdown_connections 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- 172.21.15.82:0/2802554041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406ab10 0x7f704406af10 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- 172.21.15.82:0/2802554041 >> v2:172.21.15.183:3300/0 conn(0x7f70441602b0 0x7f7044160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- 172.21.15.82:0/2802554041 >> 172.21.15.82:0/2802554041 conn(0x7f704408c0a0 msgr2=0x7f704409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- 172.21.15.82:0/2802554041 shutdown_connections 2023-07-20T10:06:27.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- 172.21.15.82:0/2802554041 wait complete. 2023-07-20T10:06:27.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 Processor -- start 2023-07-20T10:06:27.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- start start 2023-07-20T10:06:27.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f704406ab10 0x7f7044157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70441602b0 0x7f70440caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440ca680 con 0x7f704406c120 2023-07-20T10:06:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044157b70 con 0x7f70441602b0 2023-07-20T10:06:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f704aaf9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044154bf0 con 0x7f704406ab10 2023-07-20T10:06:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f7043fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f7048895640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f704406ab10 0x7f7044157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f7043fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42144/0 (socket says 172.21.15.82:42144) 2023-07-20T10:06:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f7043fff640 1 -- 172.21.15.82:0/3884274053 learned_addr learned my addr 172.21.15.82:0/3884274053 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.429+0000 7f7049096640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70441602b0 0x7f70440caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 -- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f704406ab10 msgr2=0x7f7044157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f704406ab10 0x7f7044157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 -- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70441602b0 msgr2=0x7f70440caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70441602b0 0x7f70440caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 -- 172.21.15.82:0/3884274053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009b30 con 0x7f704406c120 2023-07-20T10:06:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7043fff640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f703000d5f0 tx=0x7f703000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300125f0 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030012750 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030012ae0 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440c9720 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70440c9ce0 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704404da30 con 0x7f704406c120 2023-07-20T10:06:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 43) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f7030012c40 con 0x7f704406c120 2023-07-20T10:06:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 0x7f7028068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f7030084450 con 0x7f704406c120 2023-07-20T10:06:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7048895640 1 -- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 msgr2=0x7f7028068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3984926744 2023-07-20T10:06:27.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.433+0000 7f7048895640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 0x7f7028068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:27.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.437+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7030051680 con 0x7f704406c120 2023-07-20T10:06:27.429 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.449+0000 7fd0b3801180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:06:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.457+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 44) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7030051a50 con 0x7f704406c120 2023-07-20T10:06:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.457+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 msgr2=0x7f7028068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:27.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.457+0000 7f70417fa640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 0x7f7028068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd040046640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd040046640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd040046640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd040046640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd040046640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd03c03e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd03c03e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd03c03e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.507 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd03c03e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.507 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:27.521+0000 7fd03c03e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:06:27.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70440cee40 con 0x7f704406c120 2023-07-20T10:06:27.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f70417fa640 1 -- 172.21.15.82:0/3884274053 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7030071a60 con 0x7f704406c120 2023-07-20T10:06:27.586 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:06:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 msgr2=0x7f70441546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f703000d5f0 tx=0x7f703000dab0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 shutdown_connections 2023-07-20T10:06:27.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:6832/3984926744,v1:172.21.15.82:6833/3984926744] conn(0x7f70280663a0 0x7f7028068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70441602b0 0x7f70440caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f704406c120 0x7f70441546b0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 --2- 172.21.15.82:0/3884274053 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f704406ab10 0x7f7044157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 >> 172.21.15.82:0/3884274053 conn(0x7f704408c0a0 msgr2=0x7f704409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 shutdown_connections 2023-07-20T10:06:27.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.605+0000 7f704aaf9640 1 -- 172.21.15.82:0/3884274053 wait complete. 2023-07-20T10:06:27.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:06:27.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:06:27.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:06:27.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.769+0000 7fbbed767640 1 Processor -- start 2023-07-20T10:06:27.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.769+0000 7fbbed767640 1 -- start start 2023-07-20T10:06:27.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbed767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 0x7fbbe806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbed767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbbe815a6f0 0x7fbbe815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbed767640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe8070030 con 0x7fbbe80ca5a0 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbed767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe815bad0 con 0x7fbbe815a6f0 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbed767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8071950 con 0x7fbbe806f710 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbde7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbbe80ca5a0 0x7fbbe815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48960/0 (socket says 172.21.15.82:48960) 2023-07-20T10:06:27.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbde7fc640 1 -- 172.21.15.82:0/3348256929 learned_addr learned my addr 172.21.15.82:0/3348256929 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:27.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe6ffd640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 0x7fbbe806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3348256929 >> v2:172.21.15.183:3300/0 conn(0x7fbbe815a6f0 0x7fbbe815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225387140 0 0) 0x7fbbe8070030 con 0x7fbbe80ca5a0 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd4003530 con 0x7fbbe80ca5a0 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 msgr2=0x7fbbe806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353754892 0 0) 0x7fbbd4003530 con 0x7fbbe80ca5a0 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 0x7fbbe806faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3348256929 >> v1:172.21.15.82:6789/0 conn(0x7fbbe80ca5a0 legacy=0x7fbbe815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3348256929 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe815b230 con 0x7fbbe815a6f0 2023-07-20T10:06:27.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.773+0000 7fbbe6ffd640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 0x7fbbe806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:27.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe815a6f0 0x7fbbe815ab60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9eabb10dba8854 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0001680 con 0x7fbbe815a6f0 2023-07-20T10:06:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00a7050 con 0x7fbbe815a6f0 2023-07-20T10:06:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbe67fc640 1 -- 172.21.15.82:0/3348256929 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00ab620 con 0x7fbbe815a6f0 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe815a6f0 msgr2=0x7fbbe815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe815a6f0 0x7fbbe815ab60 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c370 comp rx=0 tx=0).stop 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- 172.21.15.82:0/3348256929 shutdown_connections 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe815a6f0 0x7fbbe815ab60 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 --2- 172.21.15.82:0/3348256929 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe806f710 0x7fbbe806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- 172.21.15.82:0/3348256929 >> 172.21.15.82:0/3348256929 conn(0x7fbbe80cad50 msgr2=0x7fbbe80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- 172.21.15.82:0/3348256929 shutdown_connections 2023-07-20T10:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- 172.21.15.82:0/3348256929 wait complete. 2023-07-20T10:06:27.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 Processor -- start 2023-07-20T10:06:27.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 -- start start 2023-07-20T10:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe806f710 0x7fbbe814ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.777+0000 7fbbed767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe80ca5a0 0x7fbbe8163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80cd020 con 0x7fbbe815a6f0 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80cc810 con 0x7fbbe806f710 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80c6900 con 0x7fbbe80ca5a0 2023-07-20T10:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42238/0 (socket says 172.21.15.82:42238) 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3305218591 learned_addr learned my addr 172.21.15.82:0/3305218591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbde7fc640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe80ca5a0 0x7fbbe8163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe6ffd640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe806f710 0x7fbbe814ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe80ca5a0 msgr2=0x7fbbe8163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe80ca5a0 0x7fbbe8163fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe806f710 msgr2=0x7fbbe814ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe806f710 0x7fbbe814ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 -- 172.21.15.82:0/3305218591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009a70 con 0x7fbbe815a6f0 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbe77fe640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ae040 tx=0x7fbbe0019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00abe90 con 0x7fbbe815a6f0 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00b4410 con 0x7fbbe815a6f0 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe0009420 con 0x7fbbe815a6f0 2023-07-20T10:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b4780 con 0x7fbbe815a6f0 2023-07-20T10:06:27.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe80cca60 con 0x7fbbe815a6f0 2023-07-20T10:06:27.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80c6a70 con 0x7fbbe815a6f0 2023-07-20T10:06:27.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.781+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 44) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fbbe00b2040 con 0x7fbbe815a6f0 2023-07-20T10:06:27.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.785+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fbbe011d780 con 0x7fbbe815a6f0 2023-07-20T10:06:27.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.785+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbe00ead60 con 0x7fbbe815a6f0 2023-07-20T10:06:27.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.933+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbe804da30 con 0x7fbbe815a6f0 2023-07-20T10:06:27.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbdffff640 1 -- 172.21.15.82:0/3305218591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbe00ee380 con 0x7fbbe815a6f0 2023-07-20T10:06:27.916 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 msgr2=0x7fbbe80ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ae040 tx=0x7fbbe0019110 comp rx=0 tx=0).stop 2023-07-20T10:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 shutdown_connections 2023-07-20T10:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbe815a6f0 0x7fbbe80ce2b0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbbe80ca5a0 0x7fbbe8163fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 --2- 172.21.15.82:0/3305218591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbbe806f710 0x7fbbe814ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 >> 172.21.15.82:0/3305218591 conn(0x7fbbe80cad50 msgr2=0x7fbbe8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 shutdown_connections 2023-07-20T10:06:27.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:27.937+0000 7fbbed767640 1 -- 172.21.15.82:0/3305218591 wait complete. 2023-07-20T10:06:27.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:06:28.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.101+0000 7f9089696640 1 Processor -- start 2023-07-20T10:06:28.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.101+0000 7f9089696640 1 -- start start 2023-07-20T10:06:28.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9089696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9084159450 0x7f908415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9089696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 0x7f90840cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9089696640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840cc8d0 con 0x7f90840cc3e0 2023-07-20T10:06:28.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9089696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840cce90 con 0x7f9084159450 2023-07-20T10:06:28.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9089696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840ccbb0 con 0x7f9084159830 2023-07-20T10:06:28.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f90837fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f90840cc3e0 0x7f90840afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48974/0 (socket says 172.21.15.82:48974) 2023-07-20T10:06:28.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f90837fe640 1 -- 172.21.15.82:0/1027024454 learned_addr learned my addr 172.21.15.82:0/1027024454 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9082ffd640 1 --2- 172.21.15.82:0/1027024454 >> v2:172.21.15.183:3300/0 conn(0x7f9084159450 0x7f908415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f907a7fc640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 0x7f90840cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f90827fc640 1 -- 172.21.15.82:0/1027024454 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414685091 0 0) 0x7f90840cc8d0 con 0x7f90840cc3e0 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f90827fc640 1 -- 172.21.15.82:0/1027024454 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9064003530 con 0x7f90840cc3e0 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9082ffd640 1 -- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 msgr2=0x7f90840cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9082ffd640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 0x7f90840cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9082ffd640 1 -- 172.21.15.82:0/1027024454 >> v1:172.21.15.82:6789/0 conn(0x7f90840cc3e0 legacy=0x7f90840afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f9082ffd640 1 -- 172.21.15.82:0/1027024454 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9084159cc0 con 0x7f9084159450 2023-07-20T10:06:28.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.105+0000 7f907a7fc640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 0x7f90840cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:28.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9082ffd640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9084159450 0x7f908415a4c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f90740097c0 tx=0x7f907401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca7df6827d91696b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f90827fc640 1 -- 172.21.15.82:0/1027024454 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90740a7070 con 0x7f9084159450 2023-07-20T10:06:28.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f90827fc640 1 -- 172.21.15.82:0/1027024454 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90740ab430 con 0x7f9084159450 2023-07-20T10:06:28.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f90827fc640 1 -- 172.21.15.82:0/1027024454 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90740ab7c0 con 0x7f9084159450 2023-07-20T10:06:28.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9084159450 msgr2=0x7f908415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9084159450 0x7f908415a4c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f90740097c0 tx=0x7f907401c450 comp rx=0 tx=0).stop 2023-07-20T10:06:28.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- 172.21.15.82:0/1027024454 shutdown_connections 2023-07-20T10:06:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159830 0x7f90840cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 --2- 172.21.15.82:0/1027024454 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9084159450 0x7f908415a4c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- 172.21.15.82:0/1027024454 >> 172.21.15.82:0/1027024454 conn(0x7f90840cad50 msgr2=0x7f90840cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- 172.21.15.82:0/1027024454 shutdown_connections 2023-07-20T10:06:28.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- 172.21.15.82:0/1027024454 wait complete. 2023-07-20T10:06:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 Processor -- start 2023-07-20T10:06:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.109+0000 7f9089696640 1 -- start start 2023-07-20T10:06:28.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 0x7f90840c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159450 0x7f90840c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084151850 con 0x7f908414ff00 2023-07-20T10:06:28.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084152020 con 0x7f90840cc3e0 2023-07-20T10:06:28.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840c6e20 con 0x7f9084159450 2023-07-20T10:06:28.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42250/0 (socket says 172.21.15.82:42250) 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 -- 172.21.15.82:0/4055251379 learned_addr learned my addr 172.21.15.82:0/4055251379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9082ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 0x7f90840c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f907a7fc640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159450 0x7f90840c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 -- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159450 msgr2=0x7f90840c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159450 0x7f90840c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 -- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 msgr2=0x7f90840c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 0x7f90840c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 -- 172.21.15.82:0/4055251379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009420 con 0x7f908414ff00 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9082ffd640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 0x7f90840c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f90837fe640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f907c00cbc0 tx=0x7f907c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00aca0 con 0x7f908414ff00 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00ae00 con 0x7f908414ff00 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9074009420 con 0x7f908414ff00 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c012620 con 0x7f908414ff00 2023-07-20T10:06:28.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9084151d40 con 0x7f908414ff00 2023-07-20T10:06:28.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908404da30 con 0x7f908414ff00 2023-07-20T10:06:28.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.113+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 44) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f907c007070 con 0x7f908414ff00 2023-07-20T10:06:28.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.117+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f907c083ad0 con 0x7f908414ff00 2023-07-20T10:06:28.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.121+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f907c0510b0 con 0x7f908414ff00 2023-07-20T10:06:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90840c5160 con 0x7f908414ff00 2023-07-20T10:06:28.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f907bfff640 1 -- 172.21.15.82:0/4055251379 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f907c017020 con 0x7f908414ff00 2023-07-20T10:06:28.250 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:06:28.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 msgr2=0x7f90840ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f907c00cbc0 tx=0x7f907c00a060 comp rx=0 tx=0).stop 2023-07-20T10:06:28.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 shutdown_connections 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f908414ff00 0x7f90840ce440 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9084159450 0x7f90840c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 --2- 172.21.15.82:0/4055251379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f90840cc3e0 0x7f90840c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 >> 172.21.15.82:0/4055251379 conn(0x7f90840cad50 msgr2=0x7f908415ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 shutdown_connections 2023-07-20T10:06:28.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.269+0000 7f9089696640 1 -- 172.21.15.82:0/4055251379 wait complete. 2023-07-20T10:06:28.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:28.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.425+0000 7f99005db640 1 Processor -- start 2023-07-20T10:06:28.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f99005db640 1 -- start start 2023-07-20T10:06:28.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f99005db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f98f80d1170 0x7f98f80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f99005db640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f80b3520 con 0x7f98f80d0d10 2023-07-20T10:06:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f99005db640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f80d0a10 con 0x7f98f815cab0 2023-07-20T10:06:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f99005db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f80d31c0 con 0x7f98f80d1170 2023-07-20T10:06:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98fdb76640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f98f80d0d10 0x7f98f80cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48978/0 (socket says 172.21.15.82:48978) 2023-07-20T10:06:28.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98fdb76640 1 -- 172.21.15.82:0/2617501435 learned_addr learned my addr 172.21.15.82:0/2617501435 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98feb78640 1 --2- 172.21.15.82:0/2617501435 >> v2:172.21.15.183:3300/0 conn(0x7f98f80d1170 0x7f98f80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693992936 0 0) 0x7f98f80b3520 con 0x7f98f80d0d10 2023-07-20T10:06:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e4003530 con 0x7f98f80d0d10 2023-07-20T10:06:28.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98feb78640 1 -- 172.21.15.82:0/2617501435 >> v1:172.21.15.183:6789/0 conn(0x7f98f815cab0 legacy=0x7f98f80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446639064 0 0) 0x7f98f80d0a10 con 0x7f98f815cab0 2023-07-20T10:06:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98feb78640 1 -- 172.21.15.82:0/2617501435 >> v1:172.21.15.82:6789/0 conn(0x7f98f80d0d10 legacy=0x7f98f80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.429+0000 7f98feb78640 1 -- 172.21.15.82:0/2617501435 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80b2910 con 0x7f98f80d1170 2023-07-20T10:06:28.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f98feb78640 1 --2- 172.21.15.82:0/2617501435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f80d1170 0x7f98f80cdbc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ce4f4342332b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00a5940 con 0x7f98f80d1170 2023-07-20T10:06:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f00a5aa0 con 0x7f98f80d1170 2023-07-20T10:06:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f98fd375640 1 -- 172.21.15.82:0/2617501435 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f00a5e30 con 0x7f98f80d1170 2023-07-20T10:06:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- 172.21.15.82:0/2617501435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f80d1170 msgr2=0x7f98f80cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 --2- 172.21.15.82:0/2617501435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f80d1170 0x7f98f80cdbc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009d90 tx=0x7f98f001c8f0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- 172.21.15.82:0/2617501435 shutdown_connections 2023-07-20T10:06:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 --2- 172.21.15.82:0/2617501435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f80d1170 0x7f98f80cdbc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- 172.21.15.82:0/2617501435 >> 172.21.15.82:0/2617501435 conn(0x7f98f808c120 msgr2=0x7f98f809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- 172.21.15.82:0/2617501435 shutdown_connections 2023-07-20T10:06:28.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- 172.21.15.82:0/2617501435 wait complete. 2023-07-20T10:06:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 Processor -- start 2023-07-20T10:06:28.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.433+0000 7f99005db640 1 -- start start 2023-07-20T10:06:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 0x7f98f80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f815cab0 0x7f98f80c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b8240 con 0x7f98f80d1170 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80c6da0 con 0x7f98f815cab0 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80b7fe0 con 0x7f98f80d0d10 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42262/0 (socket says 172.21.15.82:42262) 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 -- 172.21.15.82:0/1204013147 learned_addr learned my addr 172.21.15.82:0/1204013147 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:28.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98feb78640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f815cab0 0x7f98f80c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fe377640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 0x7f98f80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 -- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 msgr2=0x7f98f80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 0x7f98f80cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 -- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f815cab0 msgr2=0x7f98f80c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f815cab0 0x7f98f80c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 -- 172.21.15.82:0/1204013147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f0009a70 con 0x7f98f80d1170 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fe377640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 0x7f98f80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98fdb76640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c3f0 tx=0x7f98e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8005cf0 con 0x7f98f80d1170 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8005e50 con 0x7f98f80d1170 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e80072f0 con 0x7f98f80d1170 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f80c6400 con 0x7f98f80d1170 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80c69c0 con 0x7f98f80d1170 2023-07-20T10:06:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.437+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f80c6ee0 con 0x7f98f80d1170 2023-07-20T10:06:28.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.441+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 44) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f98e8007450 con 0x7f98f80d1170 2023-07-20T10:06:28.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.441+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f98e80830e0 con 0x7f98f80d1170 2023-07-20T10:06:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.445+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98f80c6ee0 con 0x7f98f80d1170 2023-07-20T10:06:28.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.465+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 45) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f98e8050170 con 0x7f98f80d1170 2023-07-20T10:06:28.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.465+0000 7f98eeffd640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 0x7f98dc06e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.465+0000 7f98fe377640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 0x7f98dc06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.465+0000 7f98fe377640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 0x7f98dc06e430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000f70 tx=0x7f98f4009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.629+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98f80c6ee0 con 0x7f98f80d1170 2023-07-20T10:06:28.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f98eeffd640 1 -- 172.21.15.82:0/1204013147 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f98f80c6ee0 con 0x7f98f80d1170 2023-07-20T10:06:28.613 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:28.613 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:28.613 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:28.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 msgr2=0x7f98dc06e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 0x7f98dc06e430 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f98f4000f70 tx=0x7f98f4009040 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 msgr2=0x7f98f80b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c3f0 tx=0x7f98e800c8b0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 shutdown_connections 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f98f815cab0 0x7f98f80c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98f80d1170 0x7f98f80b7aa0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f98dc06c040 0x7f98dc06e430 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 --2- 172.21.15.82:0/1204013147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98f80d0d10 0x7f98f80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 >> 172.21.15.82:0/1204013147 conn(0x7f98f808c120 msgr2=0x7f98f80d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 shutdown_connections 2023-07-20T10:06:28.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.633+0000 7f99005db640 1 -- 172.21.15.82:0/1204013147 wait complete. 2023-07-20T10:06:28.633 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:28.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.789+0000 7fe3ed567640 1 Processor -- start 2023-07-20T10:06:28.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.789+0000 7fe3ed567640 1 -- start start 2023-07-20T10:06:28.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3ed567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe3e80d0d10 0x7fe3e80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3ed567640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 0x7fe3e80cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3ed567640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e80d16b0 con 0x7fe3e815cab0 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3ed567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80d31c0 con 0x7fe3e80d0d10 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3ed567640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80b3520 con 0x7fe3e80cd4b0 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe3e80d0d10 0x7fe3e80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe3e80d0d10 0x7fe3e80d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42272/0 (socket says 172.21.15.82:42272) 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 -- 172.21.15.82:0/493643857 learned_addr learned my addr 172.21.15.82:0/493643857 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:28.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3e77fe640 1 --2- 172.21.15.82:0/493643857 >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 0x7fe3e80cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 -- 172.21.15.82:0/493643857 >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 msgr2=0x7fe3e80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:28.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 --2- 172.21.15.82:0/493643857 >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 0x7fe3e80cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 -- 172.21.15.82:0/493643857 >> v1:172.21.15.183:6789/0 conn(0x7fe3e815cab0 legacy=0x7fe3e80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3de7fc640 1 -- 172.21.15.82:0/493643857 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80d0a10 con 0x7fe3e80d0d10 2023-07-20T10:06:28.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.793+0000 7fe3e77fe640 1 --2- 172.21.15.82:0/493643857 >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 0x7fe3e80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:28.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3de7fc640 1 --2- 172.21.15.82:0/493643857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e80d0d10 0x7fe3e80d1170 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8071cd0 tx=0x7fe3d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae62554cba158dad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3e67fc640 1 -- 172.21.15.82:0/493643857 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00a5860 con 0x7fe3e80d0d10 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3e67fc640 1 -- 172.21.15.82:0/493643857 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d00a59c0 con 0x7fe3e80d0d10 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3e67fc640 1 -- 172.21.15.82:0/493643857 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00a5d50 con 0x7fe3e80d0d10 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- 172.21.15.82:0/493643857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e80d0d10 msgr2=0x7fe3e80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 --2- 172.21.15.82:0/493643857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e80d0d10 0x7fe3e80d1170 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8071cd0 tx=0x7fe3d001c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- 172.21.15.82:0/493643857 shutdown_connections 2023-07-20T10:06:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 --2- 172.21.15.82:0/493643857 >> v2:172.21.15.183:3300/0 conn(0x7fe3e80cd4b0 0x7fe3e80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 --2- 172.21.15.82:0/493643857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e80d0d10 0x7fe3e80d1170 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- 172.21.15.82:0/493643857 >> 172.21.15.82:0/493643857 conn(0x7fe3e808c120 msgr2=0x7fe3e809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- 172.21.15.82:0/493643857 shutdown_connections 2023-07-20T10:06:28.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- 172.21.15.82:0/493643857 wait complete. 2023-07-20T10:06:28.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 Processor -- start 2023-07-20T10:06:28.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 -- start start 2023-07-20T10:06:28.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.797+0000 7fe3ed567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e80cd4b0 0x7fe3e80ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e80d0d10 0x7fe3e814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80c98a0 con 0x7fe3e815cab0 2023-07-20T10:06:28.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80c9b80 con 0x7fe3e80d0d10 2023-07-20T10:06:28.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80c9e60 con 0x7fe3e80cd4b0 2023-07-20T10:06:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42286/0 (socket says 172.21.15.82:42286) 2023-07-20T10:06:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 -- 172.21.15.82:0/1804009324 learned_addr learned my addr 172.21.15.82:0/1804009324 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3de7fc640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e80d0d10 0x7fe3e814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e6ffd640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e80cd4b0 0x7fe3e80ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 -- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e80cd4b0 msgr2=0x7fe3e80ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e80cd4b0 0x7fe3e80ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 -- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e80d0d10 msgr2=0x7fe3e814bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e80d0d10 0x7fe3e814bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 -- 172.21.15.82:0/1804009324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d0009b30 con 0x7fe3e815cab0 2023-07-20T10:06:28.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3e77fe640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000d800 tx=0x7fe3e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00096a0 con 0x7fe3e815cab0 2023-07-20T10:06:28.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0009800 con 0x7fe3e815cab0 2023-07-20T10:06:28.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e80ca140 con 0x7fe3e815cab0 2023-07-20T10:06:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009bb0 con 0x7fe3e815cab0 2023-07-20T10:06:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e80c7920 con 0x7fe3e815cab0 2023-07-20T10:06:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e80ca660 con 0x7fe3e815cab0 2023-07-20T10:06:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.801+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe3e0009d10 con 0x7fe3e815cab0 2023-07-20T10:06:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.805+0000 7fe3dffff640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 0x7fe3c8068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.805+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fe3e0084080 con 0x7fe3e815cab0 2023-07-20T10:06:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.805+0000 7fe3e6ffd640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 0x7fe3c8068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.805+0000 7fe3e6ffd640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 0x7fe3c8068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8156540 tx=0x7fe3d8009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.809+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3e00b4700 con 0x7fe3e815cab0 2023-07-20T10:06:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.957+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3e8073c70 con 0x7fe3e815cab0 2023-07-20T10:06:28.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.957+0000 7fe3dffff640 1 -- 172.21.15.82:0/1804009324 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+19331 (secure 0 0 0) 0x7fe3e80ca660 con 0x7fe3e815cab0 2023-07-20T10:06:28.939 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:28.939 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":96,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:27.455080+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2691334868":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/2112844461":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/819859352":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6833/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6832/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/2954805626":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/3099261972":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/957540597":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/4054446550":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/2903119807":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/3702343324":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6833/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1345031035":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6832/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1791093112":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/1526530333":"2023-07-21T10:06:21.577437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 msgr2=0x7fe3c8068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 0x7fe3c8068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8156540 tx=0x7fe3d8009040 comp rx=0 tx=0).stop 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 msgr2=0x7fe3e80c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000d800 tx=0x7fe3e000dcc0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 shutdown_connections 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3e815cab0 0x7fe3e80c8850 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3e80d0d10 0x7fe3e814bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fe3c80660d0 0x7fe3c8068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 --2- 172.21.15.82:0/1804009324 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe3e80cd4b0 0x7fe3e80ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 >> 172.21.15.82:0/1804009324 conn(0x7fe3e808c120 msgr2=0x7fe3e80af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 shutdown_connections 2023-07-20T10:06:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:28.961+0000 7fe3ed567640 1 -- 172.21.15.82:0/1804009324 wait complete. 2023-07-20T10:06:28.959 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:06:28.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 Processor -- start 2023-07-20T10:06:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 -- start start 2023-07-20T10:06:29.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91d40b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f91d415c120 0x7f91d415c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d40b28d0 con 0x7f91d406f350 2023-07-20T10:06:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40cf4a0 con 0x7f91d415c120 2023-07-20T10:06:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d918f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d406ea80 con 0x7f91d40b1f30 2023-07-20T10:06:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d2d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f91d406f350 0x7f91d406b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48982/0 (socket says 172.21.15.82:48982) 2023-07-20T10:06:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d2d9d640 1 -- 172.21.15.82:0/3974172400 learned_addr learned my addr 172.21.15.82:0/3974172400 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:29.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d259c640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91d40b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d359e640 1 --2- 172.21.15.82:0/3974172400 >> v2:172.21.15.183:3300/0 conn(0x7f91d415c120 0x7f91d415c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182272585 0 0) 0x7f91d40b28d0 con 0x7f91d406f350 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91bc003530 con 0x7f91d406f350 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211093388 0 0) 0x7f91bc003530 con 0x7f91d406f350 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 msgr2=0x7f91d40b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91d40b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 >> v2:172.21.15.183:3300/0 conn(0x7f91d415c120 msgr2=0x7f91d415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 --2- 172.21.15.82:0/3974172400 >> v2:172.21.15.183:3300/0 conn(0x7f91d415c120 0x7f91d415c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40ce890 con 0x7f91d406f350 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f91c4001a00 con 0x7f91d406f350 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.121+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 >> v1:172.21.15.82:6789/0 conn(0x7f91d406f350 legacy=0x7f91d406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91bc003980 0x7f91bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc0047d0 0x7f91bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40cf4a0 con 0x7f91bc0047d0 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d406ea80 con 0x7f91bc003980 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc00b9c0 con 0x7f91d40b1f30 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc0047d0 0x7f91bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d2d9d640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91bc003980 0x7f91bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d359e640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 -- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 msgr2=0x7f91bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 -- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91bc003980 msgr2=0x7f91bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91bc003980 0x7f91bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 -- 172.21.15.82:0/3974172400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc003530 con 0x7f91bc0047d0 2023-07-20T10:06:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d359e640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91d40b1f30 0x7f91bc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d2d9d640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91bc003980 0x7f91bc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:29.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d259c640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc0047d0 0x7f91bc004c50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009ae0 tx=0x7f91c801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1cd5a56bad481b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80a5530 con 0x7f91bc0047d0 2023-07-20T10:06:29.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c80a5690 con 0x7f91bc0047d0 2023-07-20T10:06:29.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.125+0000 7f91d1d9b640 1 -- 172.21.15.82:0/3974172400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80a5a40 con 0x7f91bc0047d0 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- 172.21.15.82:0/3974172400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc0047d0 msgr2=0x7f91bc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 --2- 172.21.15.82:0/3974172400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91bc0047d0 0x7f91bc004c50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009ae0 tx=0x7f91c801c9c0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d359e640 1 -- 172.21.15.82:0/3974172400 reap_dead start 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- 172.21.15.82:0/3974172400 shutdown_connections 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- 172.21.15.82:0/3974172400 >> 172.21.15.82:0/3974172400 conn(0x7f91d4089fa0 msgr2=0x7f91d40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- 172.21.15.82:0/3974172400 shutdown_connections 2023-07-20T10:06:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- 172.21.15.82:0/3974172400 wait complete. 2023-07-20T10:06:29.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 Processor -- start 2023-07-20T10:06:29.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- start start 2023-07-20T10:06:29.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91bc0047d0 0x7f91d4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 0x7f91d4155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4155870 con 0x7f91d40c5300 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40cd840 con 0x7f91d40ccdf0 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d918f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40cd280 con 0x7f91bc0047d0 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42302/0 (socket says 172.21.15.82:42302) 2023-07-20T10:06:29.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.129+0000 7f91d359e640 1 -- 172.21.15.82:0/964112626 learned_addr learned my addr 172.21.15.82:0/964112626 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d2d9d640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91bc0047d0 0x7f91d4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d259c640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 0x7f91d4155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 -- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91bc0047d0 msgr2=0x7f91d4152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91bc0047d0 0x7f91d4152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 -- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 msgr2=0x7f91d4155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 0x7f91d4155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 -- 172.21.15.82:0/964112626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40cd560 con 0x7f91d40c5300 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d259c640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 0x7f91d4155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d359e640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f91d40afea0 tx=0x7f91cc011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc004230 con 0x7f91d40c5300 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc0043b0 con 0x7f91d40c5300 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40cab80 con 0x7f91d40c5300 2023-07-20T10:06:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc015970 con 0x7f91d40c5300 2023-07-20T10:06:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d4152c40 con 0x7f91d40c5300 2023-07-20T10:06:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d4073c70 con 0x7f91d40c5300 2023-07-20T10:06:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f91cc015ad0 con 0x7f91d40c5300 2023-07-20T10:06:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 0x7f91c0068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f91cc083d40 con 0x7f91d40c5300 2023-07-20T10:06:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.133+0000 7f91d2d9d640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 0x7f91c0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.137+0000 7f91d2d9d640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 0x7f91c0068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91c40012f0 tx=0x7f91c40017c0 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.137+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91cc051230 con 0x7f91d40c5300 2023-07-20T10:06:29.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d40cb030 con 0x7f91d40c5300 2023-07-20T10:06:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91bb7fe640 1 -- 172.21.15.82:0/964112626 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f91cc054850 con 0x7f91d40c5300 2023-07-20T10:06:29.298 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:29.298 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 msgr2=0x7f91c0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 0x7f91c0068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f91c40012f0 tx=0x7f91c40017c0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 msgr2=0x7f91d40c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f91d40afea0 tx=0x7f91cc011920 comp rx=0 tx=0).stop 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 shutdown_connections 2023-07-20T10:06:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91d40c5300 0x7f91d40c5790 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f91d40ccdf0 0x7f91d4155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f91c00660d0 0x7f91c0068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 --2- 172.21.15.82:0/964112626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f91bc0047d0 0x7f91d4152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 >> 172.21.15.82:0/964112626 conn(0x7f91d4089fa0 msgr2=0x7f91d4072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 shutdown_connections 2023-07-20T10:06:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.317+0000 7f91d918f640 1 -- 172.21.15.82:0/964112626 wait complete. 2023-07-20T10:06:29.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:29.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 Processor -- start 2023-07-20T10:06:29.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 -- start start 2023-07-20T10:06:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 0x7f9b9c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c0cde70 con 0x7f9b9c15c910 2023-07-20T10:06:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c0cbef0 con 0x7f9b9c15d4a0 2023-07-20T10:06:29.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9ba0a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0ca420 con 0x7f9b9c0ca040 2023-07-20T10:06:29.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9b99d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b9c15c910 0x7f9b9c15cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48996/0 (socket says 172.21.15.82:48996) 2023-07-20T10:06:29.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9b99d9b640 1 -- 172.21.15.82:0/522186363 learned_addr learned my addr 172.21.15.82:0/522186363 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:29.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9b9ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 0x7f9b9c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.477+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/522186363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9959a640 1 -- 172.21.15.82:0/522186363 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30293241 0 0) 0x7f9b9c0cde70 con 0x7f9b9c15c910 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9959a640 1 -- 172.21.15.82:0/522186363 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b84003530 con 0x7f9b9c15c910 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9a59c640 1 -- 172.21.15.82:0/522186363 >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 msgr2=0x7f9b9c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/522186363 >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 0x7f9b9c0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9a59c640 1 -- 172.21.15.82:0/522186363 >> v1:172.21.15.82:6789/0 conn(0x7f9b9c15c910 legacy=0x7f9b9c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9a59c640 1 -- 172.21.15.82:0/522186363 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c0cdb40 con 0x7f9b9c0ca040 2023-07-20T10:06:29.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9ad9d640 1 --2- 172.21.15.82:0/522186363 >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 0x7f9b9c0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:29.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/522186363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c0ad060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009d90 tx=0x7f9b8c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2493134ad5635bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9959a640 1 -- 172.21.15.82:0/522186363 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0a5980 con 0x7f9b9c0ca040 2023-07-20T10:06:29.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9959a640 1 -- 172.21.15.82:0/522186363 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0a5ae0 con 0x7f9b9c0ca040 2023-07-20T10:06:29.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.481+0000 7f9b9959a640 1 -- 172.21.15.82:0/522186363 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0a5e70 con 0x7f9b9c0ca040 2023-07-20T10:06:29.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- 172.21.15.82:0/522186363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 msgr2=0x7f9b9c0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/522186363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c0ad060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c009d90 tx=0x7f9b8c01c920 comp rx=0 tx=0).stop 2023-07-20T10:06:29.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- 172.21.15.82:0/522186363 shutdown_connections 2023-07-20T10:06:29.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/522186363 >> v2:172.21.15.82:3300/0 conn(0x7f9b9c15d4a0 0x7f9b9c0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/522186363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c0ad060 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- 172.21.15.82:0/522186363 >> 172.21.15.82:0/522186363 conn(0x7f9b9c0cada0 msgr2=0x7f9b9c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- 172.21.15.82:0/522186363 shutdown_connections 2023-07-20T10:06:29.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- 172.21.15.82:0/522186363 wait complete. 2023-07-20T10:06:29.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 Processor -- start 2023-07-20T10:06:29.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- start start 2023-07-20T10:06:29.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b9c15d4a0 0x7f9b9c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1590a0 con 0x7f9b9c15c910 2023-07-20T10:06:29.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1f5c80 con 0x7f9b9c15d4a0 2023-07-20T10:06:29.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9ba0a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c1f5070 con 0x7f9b9c0ca040 2023-07-20T10:06:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9b99d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9b9a59c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9b99d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42320/0 (socket says 172.21.15.82:42320) 2023-07-20T10:06:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9b99d9b640 1 -- 172.21.15.82:0/1035072231 learned_addr learned my addr 172.21.15.82:0/1035072231 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.485+0000 7f9b9ad9d640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b9c15d4a0 0x7f9b9c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 -- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 msgr2=0x7f9b9c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 -- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b9c15d4a0 msgr2=0x7f9b9c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b9c15d4a0 0x7f9b9c06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 -- 172.21.15.82:0/1035072231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009420 con 0x7f9b9c15c910 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b99d9b640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c4d0 tx=0x7f9b9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90005cf0 con 0x7f9b9c15c910 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90005e50 con 0x7f9b9c15c910 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900072d0 con 0x7f9b9c15c910 2023-07-20T10:06:29.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c009a70 con 0x7f9b9c15c910 2023-07-20T10:06:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1f5630 con 0x7f9b9c15c910 2023-07-20T10:06:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c073c70 con 0x7f9b9c15c910 2023-07-20T10:06:29.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 45) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9b90007430 con 0x7f9b9c15c910 2023-07-20T10:06:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 0x7f9b7c068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.489+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9b900831e0 con 0x7f9b9c15c910 2023-07-20T10:06:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.493+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 0x7f9b7c068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.493+0000 7f9b9a59c640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 0x7f9b7c068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0af000 tx=0x7f9b8c0a7070 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.493+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b900506d0 con 0x7f9b9c15c910 2023-07-20T10:06:29.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b9c0cbbd0 con 0x7f9b9c15c910 2023-07-20T10:06:29.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9b8affd640 1 -- 172.21.15.82:0/1035072231 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f9b90053cf0 con 0x7f9b9c15c910 2023-07-20T10:06:29.658 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:29.658 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:04.392869+0000","modified":"2023-07-20T10:06:08.048002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7224},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7224":{"gid":7224,"name":"c","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1048696572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1048696572},{"type":"v1","addr":"172.21.15.82:6837","nonce":1048696572}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-20T10:06:29.658 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 41 2023-07-20T10:06:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 msgr2=0x7f9b7c068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 0x7f9b7c068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0af000 tx=0x7f9b8c0a7070 comp rx=0 tx=0).stop 2023-07-20T10:06:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 msgr2=0x7f9b9c0b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c4d0 tx=0x7f9b9000c8d0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 shutdown_connections 2023-07-20T10:06:29.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b9c15d4a0 0x7f9b9c06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9c15c910 0x7f9b9c0b2640 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9b7c0660d0 0x7f9b7c068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 --2- 172.21.15.82:0/1035072231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9c0ca040 0x7f9b9c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 >> 172.21.15.82:0/1035072231 conn(0x7f9b9c0cada0 msgr2=0x7f9b9c0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 shutdown_connections 2023-07-20T10:06:29.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.677+0000 7f9ba0a48640 1 -- 172.21.15.82:0/1035072231 wait complete. 2023-07-20T10:06:29.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:29.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 Processor -- start 2023-07-20T10:06:29.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 -- start start 2023-07-20T10:06:29.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd940d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd940d0d10 0x7fdd940d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd940d16b0 con 0x7fdd940cf110 2023-07-20T10:06:29.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940d31c0 con 0x7fdd940d0d10 2023-07-20T10:06:29.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd9b937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940b3520 con 0x7fdd9415cab0 2023-07-20T10:06:29.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd940d0d10 0x7fdd940d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd940d0d10 0x7fdd940d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42340/0 (socket says 172.21.15.82:42340) 2023-07-20T10:06:29.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 -- 172.21.15.82:0/3103781168 learned_addr learned my addr 172.21.15.82:0/3103781168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:29.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd996d3640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd940d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 -- 172.21.15.82:0/3103781168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 msgr2=0x7fdd940d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:29.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd940d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 -- 172.21.15.82:0/3103781168 >> v1:172.21.15.183:6789/0 conn(0x7fdd940cf110 legacy=0x7fdd940cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.837+0000 7fdd98ed2640 1 -- 172.21.15.82:0/3103781168 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940b2910 con 0x7fdd940d0d10 2023-07-20T10:06:29.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd98ed2640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd940d1170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009870 tx=0x7fdd8401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e632d3928d0f6f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd8bfff640 1 -- 172.21.15.82:0/3103781168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840aa670 con 0x7fdd940d0d10 2023-07-20T10:06:29.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd8bfff640 1 -- 172.21.15.82:0/3103781168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd840aa7d0 con 0x7fdd940d0d10 2023-07-20T10:06:29.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd8bfff640 1 -- 172.21.15.82:0/3103781168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd840aab60 con 0x7fdd940d0d10 2023-07-20T10:06:29.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 -- 172.21.15.82:0/3103781168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 msgr2=0x7fdd940d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd940d1170 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009870 tx=0x7fdd8401c510 comp rx=0 tx=0).stop 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 -- 172.21.15.82:0/3103781168 shutdown_connections 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd940d1170 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 --2- 172.21.15.82:0/3103781168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd940d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 -- 172.21.15.82:0/3103781168 >> 172.21.15.82:0/3103781168 conn(0x7fdd9408c120 msgr2=0x7fdd9409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 -- 172.21.15.82:0/3103781168 shutdown_connections 2023-07-20T10:06:29.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.841+0000 7fdd9b937640 1 -- 172.21.15.82:0/3103781168 wait complete. 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 Processor -- start 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- start start 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd94151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9414c630 con 0x7fdd940d0d10 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd94153e10 con 0x7fdd940cf110 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9414c8c0 con 0x7fdd9415cab0 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd98ed2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd98ed2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42348/0 (socket says 172.21.15.82:42348) 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd98ed2640 1 -- 172.21.15.82:0/2534630498 learned_addr learned my addr 172.21.15.82:0/2534630498 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:29.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:35116/0 (socket says 172.21.15.82:35116) 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd99ed4640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd94151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 -- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 msgr2=0x7fdd94151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd94151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 -- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 msgr2=0x7fdd9414c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 -- 172.21.15.82:0/2534630498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840094d0 con 0x7fdd940cf110 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd98ed2640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd996d3640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000e870 tx=0x7fdd9000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900095d0 con 0x7fdd940cf110 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9000c940 con 0x7fdd940cf110 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9000ccb0 con 0x7fdd940cf110 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9414cb60 con 0x7fdd940cf110 2023-07-20T10:06:29.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9414d120 con 0x7fdd940cf110 2023-07-20T10:06:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.845+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd940ccb40 con 0x7fdd940cf110 2023-07-20T10:06:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.849+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 45) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fdd900059a0 con 0x7fdd940cf110 2023-07-20T10:06:29.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.849+0000 7fdd89ffb640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 0x7fdd780685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.849+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fdd9003a020 con 0x7fdd940cf110 2023-07-20T10:06:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.849+0000 7fdd98ed2640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 0x7fdd780685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.849+0000 7fdd98ed2640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 0x7fdd780685c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd8401c550 tx=0x7fdd840b5040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:29.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.853+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd900516f0 con 0x7fdd940cf110 2023-07-20T10:06:29.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:29.953+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mgrmap(e 46) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fdd90051ac0 con 0x7fdd940cf110 2023-07-20T10:06:29.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.001+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd940b2590 con 0x7fdd940cf110 2023-07-20T10:06:29.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd89ffb640 1 -- 172.21.15.82:0/2534630498 <== mon.1 v2:172.21.15.183:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+19331 (secure 0 0 0) 0x7fdd90072520 con 0x7fdd940cf110 2023-07-20T10:06:29.985 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:29.986 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":96,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:27.455080+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:02.070880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:03.385311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2691334868":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/2112844461":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/819859352":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6833/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6832/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/2954805626":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/3099261972":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/957540597":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/4054446550":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/2903119807":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/3702343324":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6833/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1345031035":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6832/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1791093112":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/1526530333":"2023-07-21T10:06:21.577437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 msgr2=0x7fdd780685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 0x7fdd780685c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdd8401c550 tx=0x7fdd840b5040 comp rx=0 tx=0).stop 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 msgr2=0x7fdd94155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000e870 tx=0x7fdd9000ed30 comp rx=0 tx=0).stop 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 shutdown_connections 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdd78066100 0x7fdd780685c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd9415cab0 0x7fdd94151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd940d0d10 0x7fdd9414c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 --2- 172.21.15.82:0/2534630498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd940cf110 0x7fdd94155e00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 >> 172.21.15.82:0/2534630498 conn(0x7fdd9408c120 msgr2=0x7fdd9406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 shutdown_connections 2023-07-20T10:06:29.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.005+0000 7fdd9b937640 1 -- 172.21.15.82:0/2534630498 wait complete. 2023-07-20T10:06:30.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:06:30.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 Processor -- start 2023-07-20T10:06:30.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 -- start start 2023-07-20T10:06:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 0x7f4d2815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d280b1170 0x7f4d280b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d280cde70 con 0x7f4d280ca040 2023-07-20T10:06:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280cbef0 con 0x7f4d280b1170 2023-07-20T10:06:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d2cb37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280ca420 con 0x7f4d280ad060 2023-07-20T10:06:30.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d26d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d280b1170 0x7f4d280b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d26d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4d280b1170 0x7f4d280b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42354/0 (socket says 172.21.15.82:42354) 2023-07-20T10:06:30.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d26d9d640 1 -- 172.21.15.82:0/1282345739 learned_addr learned my addr 172.21.15.82:0/1282345739 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.165+0000 7f4d1dd9b640 1 --2- 172.21.15.82:0/1282345739 >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 0x7f4d2815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d26d9d640 1 -- 172.21.15.82:0/1282345739 >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 msgr2=0x7f4d2815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d26d9d640 1 --2- 172.21.15.82:0/1282345739 >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 0x7f4d2815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d26d9d640 1 -- 172.21.15.82:0/1282345739 >> v1:172.21.15.183:6789/0 conn(0x7f4d280ca040 legacy=0x7f4d2815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d26d9d640 1 -- 172.21.15.82:0/1282345739 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d280cdb40 con 0x7f4d280b1170 2023-07-20T10:06:30.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d1dd9b640 1 --2- 172.21.15.82:0/1282345739 >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 0x7f4d2815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:30.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d26d9d640 1 --2- 172.21.15.82:0/1282345739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280b1170 0x7f4d280b1600 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4d28068d50 tx=0x7f4d2001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceeeafcdf52331f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d25d9b640 1 -- 172.21.15.82:0/1282345739 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200a5770 con 0x7f4d280b1170 2023-07-20T10:06:30.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d25d9b640 1 -- 172.21.15.82:0/1282345739 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d200a58d0 con 0x7f4d280b1170 2023-07-20T10:06:30.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d25d9b640 1 -- 172.21.15.82:0/1282345739 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200a5c60 con 0x7f4d280b1170 2023-07-20T10:06:30.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 -- 172.21.15.82:0/1282345739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280b1170 msgr2=0x7f4d280b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/1282345739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280b1170 0x7f4d280b1600 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4d28068d50 tx=0x7f4d2001c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 -- 172.21.15.82:0/1282345739 shutdown_connections 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/1282345739 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280b1170 0x7f4d280b1600 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/1282345739 >> v2:172.21.15.183:3300/0 conn(0x7f4d280ad060 0x7f4d2815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 -- 172.21.15.82:0/1282345739 >> 172.21.15.82:0/1282345739 conn(0x7f4d280cada0 msgr2=0x7f4d280cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 -- 172.21.15.82:0/1282345739 shutdown_connections 2023-07-20T10:06:30.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.169+0000 7f4d2cb37640 1 -- 172.21.15.82:0/1282345739 wait complete. 2023-07-20T10:06:30.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 Processor -- start 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 -- start start 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 0x7f4d280996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d280ca040 0x7f4d280c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28070900 con 0x7f4d280ad060 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2806fcf0 con 0x7f4d280b1170 2023-07-20T10:06:30.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2cb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2806ffd0 con 0x7f4d280ca040 2023-07-20T10:06:30.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42364/0 (socket says 172.21.15.82:42364) 2023-07-20T10:06:30.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d1dd9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 0x7f4d280996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 -- 172.21.15.82:0/3279030725 learned_addr learned my addr 172.21.15.82:0/3279030725 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:30.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d26d9d640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d280ca040 0x7f4d280c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 -- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d280ca040 msgr2=0x7f4d280c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d280ca040 0x7f4d280c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 -- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 msgr2=0x7f4d280996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 0x7f4d280996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d2659c640 1 -- 172.21.15.82:0/3279030725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009b30 con 0x7f4d280ad060 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.173+0000 7f4d1dd9b640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 0x7f4d280996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d2659c640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c3c0 tx=0x7f4d1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180052d0 con 0x7f4d280ad060 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18005430 con 0x7f4d280ad060 2023-07-20T10:06:30.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18003840 con 0x7f4d280ad060 2023-07-20T10:06:30.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d280702b0 con 0x7f4d280ad060 2023-07-20T10:06:30.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d281527a0 con 0x7f4d280ad060 2023-07-20T10:06:30.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d28073c70 con 0x7f4d280ad060 2023-07-20T10:06:30.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 46) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f4d180039a0 con 0x7f4d280ad060 2023-07-20T10:06:30.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 0x7f4d080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f4d18083470 con 0x7f4d280ad060 2023-07-20T10:06:30.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.177+0000 7f4d1dd9b640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 0x7f4d080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.181+0000 7f4d1dd9b640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 0x7f4d080687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d2809b270 tx=0x7f4d10008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.181+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d18050710 con 0x7f4d280ad060 2023-07-20T10:06:30.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.361+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4d280cbbd0 con 0x7f4d280ad060 2023-07-20T10:06:30.343 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:06:30.361+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:06:30.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d1f7fe640 1 -- 172.21.15.82:0/3279030725 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4d18053d30 con 0x7f4d280ad060 2023-07-20T10:06:30.349 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:06:30.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 msgr2=0x7f4d080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 0x7f4d080687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4d2809b270 tx=0x7f4d10008040 comp rx=0 tx=0).stop 2023-07-20T10:06:30.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 msgr2=0x7f4d28070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800c3c0 tx=0x7f4d1800c880 comp rx=0 tx=0).stop 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 shutdown_connections 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4d08066310 0x7f4d080687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4d280ca040 0x7f4d280c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4d280b1170 0x7f4d280996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 --2- 172.21.15.82:0/3279030725 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d280ad060 0x7f4d28070d90 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 >> 172.21.15.82:0/3279030725 conn(0x7f4d280cada0 msgr2=0x7f4d280c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:30.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 shutdown_connections 2023-07-20T10:06:30.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.369+0000 7f4d2cb37640 1 -- 172.21.15.82:0/3279030725 wait complete. 2023-07-20T10:06:30.355 INFO:tasks.ceph.mds.c.smithi082.stderr: -2749> 2023-07-20T10:06:05.978+0000 7f4e20506640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:06:30.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:06:30.403 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:06:30.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 Processor -- start 2023-07-20T10:06:30.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 -- start start 2023-07-20T10:06:30.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7370159450 0x7f737015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73700afd50 0x7f73700b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73700b06b0 con 0x7f7370159830 2023-07-20T10:06:30.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700cce90 con 0x7f73700afd50 2023-07-20T10:06:30.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f7374fdb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700cc8d0 con 0x7f7370159450 2023-07-20T10:06:30.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f736ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73700afd50 0x7f73700b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f736ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f73700afd50 0x7f73700b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42404/0 (socket says 172.21.15.82:42404) 2023-07-20T10:06:30.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f736ed9d640 1 -- 172.21.15.82:0/243964105 learned_addr learned my addr 172.21.15.82:0/243964105 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:30.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.537+0000 7f736e59c640 1 --2- 172.21.15.82:0/243964105 >> v2:172.21.15.183:3300/0 conn(0x7f7370159450 0x7f737015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736ed9d640 1 -- 172.21.15.82:0/243964105 >> v2:172.21.15.183:3300/0 conn(0x7f7370159450 msgr2=0x7f737015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:30.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736ed9d640 1 --2- 172.21.15.82:0/243964105 >> v2:172.21.15.183:3300/0 conn(0x7f7370159450 0x7f737015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736ed9d640 1 -- 172.21.15.82:0/243964105 >> v1:172.21.15.183:6789/0 conn(0x7f7370159830 legacy=0x7f73700cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736ed9d640 1 -- 172.21.15.82:0/243964105 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700ccbb0 con 0x7f73700afd50 2023-07-20T10:06:30.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736ed9d640 1 --2- 172.21.15.82:0/243964105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73700afd50 0x7f73700b0170 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f737006a6c0 tx=0x7f736801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae4a342c5a3de33 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736dd9b640 1 -- 172.21.15.82:0/243964105 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73680a5860 con 0x7f73700afd50 2023-07-20T10:06:30.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736dd9b640 1 -- 172.21.15.82:0/243964105 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73680a59c0 con 0x7f73700afd50 2023-07-20T10:06:30.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f736dd9b640 1 -- 172.21.15.82:0/243964105 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73680a5d50 con 0x7f73700afd50 2023-07-20T10:06:30.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f7374fdb640 1 -- 172.21.15.82:0/243964105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73700afd50 msgr2=0x7f73700b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.541+0000 7f7374fdb640 1 --2- 172.21.15.82:0/243964105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73700afd50 0x7f73700b0170 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f737006a6c0 tx=0x7f736801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- 172.21.15.82:0/243964105 shutdown_connections 2023-07-20T10:06:30.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 --2- 172.21.15.82:0/243964105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73700afd50 0x7f73700b0170 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 --2- 172.21.15.82:0/243964105 >> v2:172.21.15.183:3300/0 conn(0x7f7370159450 0x7f737015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- 172.21.15.82:0/243964105 >> 172.21.15.82:0/243964105 conn(0x7f73700cad50 msgr2=0x7f73700cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- 172.21.15.82:0/243964105 shutdown_connections 2023-07-20T10:06:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- 172.21.15.82:0/243964105 wait complete. 2023-07-20T10:06:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 Processor -- start 2023-07-20T10:06:30.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- start start 2023-07-20T10:06:30.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 0x7f73701589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7370159450 0x7f73701553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370153cf0 con 0x7f7370152680 2023-07-20T10:06:30.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370153f90 con 0x7f73700afd50 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7374fdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73700c1c30 con 0x7f7370159450 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42410/0 (socket says 172.21.15.82:42410) 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 -- 172.21.15.82:0/1350586804 learned_addr learned my addr 172.21.15.82:0/1350586804 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736e59c640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 0x7f73701589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f7365d9b640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7370159450 0x7f73701553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 -- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7370159450 msgr2=0x7f73701553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7370159450 0x7f73701553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 -- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 msgr2=0x7f73701589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 0x7f73701589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736ed9d640 1 -- 172.21.15.82:0/1350586804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7368009b30 con 0x7f7370152680 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.545+0000 7f736e59c640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 0x7f73701589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f736ed9d640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73680195b0 tx=0x7f7368019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73680b8670 con 0x7f7370152680 2023-07-20T10:06:30.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73680b87d0 con 0x7f7370152680 2023-07-20T10:06:30.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73680b8b80 con 0x7f7370152680 2023-07-20T10:06:30.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73700c1f10 con 0x7f7370152680 2023-07-20T10:06:30.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73700c24d0 con 0x7f7370152680 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73700c26c0 con 0x7f7370152680 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 46) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f73680b8ce0 con 0x7f7370152680 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 0x7f73500687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f736811f6c0 con 0x7f7370152680 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.549+0000 7f736e59c640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 0x7f73500687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:30.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.553+0000 7f736e59c640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 0x7f73500687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7360009f50 tx=0x7f7360009190 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:30.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.553+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73680ec9d0 con 0x7f7370152680 2023-07-20T10:06:30.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:30.737+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f737004da30 con 0x7f7370152680 2023-07-20T10:06:31.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.369+0000 7f73677fe640 1 -- 172.21.15.82:0/1350586804 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73680efff0 con 0x7f7370152680 2023-07-20T10:06:31.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 msgr2=0x7f73500687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 0x7f73500687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7360009f50 tx=0x7f7360009190 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 msgr2=0x7f73701537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73680195b0 tx=0x7f7368019740 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 shutdown_connections 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7370152680 0x7f73701537b0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7350066310 0x7f73500687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7370159450 0x7f73701553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 --2- 172.21.15.82:0/1350586804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73700afd50 0x7f73701589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 >> 172.21.15.82:0/1350586804 conn(0x7f73700cad50 msgr2=0x7f737015c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 shutdown_connections 2023-07-20T10:06:31.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.373+0000 7f7374fdb640 1 -- 172.21.15.82:0/1350586804 wait complete. 2023-07-20T10:06:31.377 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:06:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 Processor -- start 2023-07-20T10:06:31.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 -- start start 2023-07-20T10:06:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 0x7f94d4160870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94d4160db0 0x7f94d40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40ae440 con 0x7f94d40ae060 2023-07-20T10:06:31.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d406ce50 con 0x7f94d4160db0 2023-07-20T10:06:31.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.589+0000 7f94dbaec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d415cac0 con 0x7f94d406bf20 2023-07-20T10:06:31.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f94d4160db0 0x7f94d40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d9888640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94d40ae060 0x7f94d4070ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49006/0 (socket says 172.21.15.82:49006) 2023-07-20T10:06:31.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d9888640 1 -- 172.21.15.82:0/3168080144 learned_addr learned my addr 172.21.15.82:0/3168080144 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d9087640 1 --2- 172.21.15.82:0/3168080144 >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 0x7f94d4160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 -- 172.21.15.82:0/3168080144 >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 msgr2=0x7f94d4160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 --2- 172.21.15.82:0/3168080144 >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 0x7f94d4160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 -- 172.21.15.82:0/3168080144 >> v1:172.21.15.82:6789/0 conn(0x7f94d40ae060 legacy=0x7f94d4070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 -- 172.21.15.82:0/3168080144 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d406c380 con 0x7f94d4160db0 2023-07-20T10:06:31.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d8886640 1 -- 172.21.15.82:0/3168080144 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994888615 0 0) 0x7f94d40ae440 con 0x7f94d40ae060 2023-07-20T10:06:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d9087640 1 --2- 172.21.15.82:0/3168080144 >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 0x7f94d4160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:31.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94da089640 1 --2- 172.21.15.82:0/3168080144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d4160db0 0x7f94d40c90c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f94d406ea00 tx=0x7f94cc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea89d372d30e794f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d8886640 1 -- 172.21.15.82:0/3168080144 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0a5820 con 0x7f94d4160db0 2023-07-20T10:06:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d8886640 1 -- 172.21.15.82:0/3168080144 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc0a5980 con 0x7f94d4160db0 2023-07-20T10:06:31.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.593+0000 7f94d8886640 1 -- 172.21.15.82:0/3168080144 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0a5d10 con 0x7f94d4160db0 2023-07-20T10:06:31.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- 172.21.15.82:0/3168080144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d4160db0 msgr2=0x7f94d40c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- 172.21.15.82:0/3168080144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d4160db0 0x7f94d40c90c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f94d406ea00 tx=0x7f94cc01c850 comp rx=0 tx=0).stop 2023-07-20T10:06:31.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- 172.21.15.82:0/3168080144 shutdown_connections 2023-07-20T10:06:31.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- 172.21.15.82:0/3168080144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d4160db0 0x7f94d40c90c0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- 172.21.15.82:0/3168080144 >> v2:172.21.15.183:3300/0 conn(0x7f94d406bf20 0x7f94d4160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- 172.21.15.82:0/3168080144 >> 172.21.15.82:0/3168080144 conn(0x7f94d40cf070 msgr2=0x7f94d40cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:31.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- 172.21.15.82:0/3168080144 shutdown_connections 2023-07-20T10:06:31.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- 172.21.15.82:0/3168080144 wait complete. 2023-07-20T10:06:31.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 Processor -- start 2023-07-20T10:06:31.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- start start 2023-07-20T10:06:31.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 0x7f94d40c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94d4160db0 0x7f94d406a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d41514b0 con 0x7f94d40ae060 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d41522d0 con 0x7f94d4160db0 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94dbaec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4152760 con 0x7f94d406bf20 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42440/0 (socket says 172.21.15.82:42440) 2023-07-20T10:06:31.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 -- 172.21.15.82:0/1315822141 learned_addr learned my addr 172.21.15.82:0/1315822141 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:31.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94da089640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94d4160db0 0x7f94d406a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9888640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 0x7f94d40c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 -- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 msgr2=0x7f94d40c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 0x7f94d40c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 -- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94d4160db0 msgr2=0x7f94d406a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94d4160db0 0x7f94d406a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:31.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9087640 1 -- 172.21.15.82:0/1315822141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009a70 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.597+0000 7f94d9888640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 0x7f94d40c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94d9087640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f94c400c7f0 tx=0x7f94c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4007820 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4007980 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d41516c0 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4007d30 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d4151c80 con 0x7f94d40ae060 2023-07-20T10:06:31.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d4152460 con 0x7f94d40ae060 2023-07-20T10:06:31.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 46) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f94c40113f0 con 0x7f94d40ae060 2023-07-20T10:06:31.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 0x7f94b8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:31.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f94c4084440 con 0x7f94d40ae060 2023-07-20T10:06:31.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.601+0000 7f94d9888640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 0x7f94b8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:31.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.605+0000 7f94d9888640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 0x7f94b8068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000f70 tx=0x7f94d0009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:31.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.605+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94c4051540 con 0x7f94d40ae060 2023-07-20T10:06:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:31.753+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f94d404da30 con 0x7f94d40ae060 2023-07-20T10:06:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.381+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f94c4084120 con 0x7f94d40ae060 2023-07-20T10:06:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.381+0000 7f94ca7fc640 1 -- 172.21.15.82:0/1315822141 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7f94c406f010 con 0x7f94d40ae060 2023-07-20T10:06:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:06:32.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 msgr2=0x7f94b8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:32.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 0x7f94b8068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f94d0000f70 tx=0x7f94d0009040 comp rx=0 tx=0).stop 2023-07-20T10:06:32.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 msgr2=0x7f94d406a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f94c400c7f0 tx=0x7f94c400ccb0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 shutdown_connections 2023-07-20T10:06:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94d4160db0 0x7f94d406a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94d40ae060 0x7f94d406a160 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f94b8066340 0x7f94b8068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 --2- 172.21.15.82:0/1315822141 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94d406bf20 0x7f94d40c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 >> 172.21.15.82:0/1315822141 conn(0x7f94d40cf070 msgr2=0x7f94d40afe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 shutdown_connections 2023-07-20T10:06:32.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.385+0000 7f94dbaec640 1 -- 172.21.15.82:0/1315822141 wait complete. 2023-07-20T10:06:32.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:06:32.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 Processor -- start 2023-07-20T10:06:32.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 -- start start 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c4c15c720 0x7f5c4c160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 0x7f5c4c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c0ce580 0x7f5c4c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c161190 con 0x7f5c4c15c720 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ce9d0 con 0x7f5c4c06a860 2023-07-20T10:06:32.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c51103640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c15cb00 con 0x7f5c4c0ce580 2023-07-20T10:06:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c4c15c720 0x7f5c4c160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5c4c15c720 0x7f5c4c160c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42442/0 (socket says 172.21.15.82:42442) 2023-07-20T10:06:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 -- 172.21.15.82:0/4155989098 learned_addr learned my addr 172.21.15.82:0/4155989098 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:32.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4b59e640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c0ce580 0x7f5c4c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4259c640 1 --2- 172.21.15.82:0/4155989098 >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 0x7f5c4c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 -- 172.21.15.82:0/4155989098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c0ce580 msgr2=0x7f5c4c06f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:32.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c0ce580 0x7f5c4c06f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 -- 172.21.15.82:0/4155989098 >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 msgr2=0x7f5c4c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:32.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 --2- 172.21.15.82:0/4155989098 >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 0x7f5c4c0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4ad9d640 1 -- 172.21.15.82:0/4155989098 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c06ad40 con 0x7f5c4c15c720 2023-07-20T10:06:32.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.553+0000 7f5c4259c640 1 --2- 172.21.15.82:0/4155989098 >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 0x7f5c4c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:32.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c4ad9d640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c15c720 0x7f5c4c160c50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0d1570 tx=0x7f5c3c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b03ba02b745fa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c4a59c640 1 -- 172.21.15.82:0/4155989098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0ab600 con 0x7f5c4c15c720 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c4a59c640 1 -- 172.21.15.82:0/4155989098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c0a7050 con 0x7f5c4c15c720 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c4a59c640 1 -- 172.21.15.82:0/4155989098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0ab980 con 0x7f5c4c15c720 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 -- 172.21.15.82:0/4155989098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c15c720 msgr2=0x7f5c4c160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c15c720 0x7f5c4c160c50 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c0d1570 tx=0x7f5c3c01c210 comp rx=0 tx=0).stop 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 -- 172.21.15.82:0/4155989098 shutdown_connections 2023-07-20T10:06:32.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 --2- 172.21.15.82:0/4155989098 >> v2:172.21.15.183:3300/0 conn(0x7f5c4c06a860 0x7f5c4c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c0ce580 0x7f5c4c06f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 --2- 172.21.15.82:0/4155989098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c15c720 0x7f5c4c160c50 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 -- 172.21.15.82:0/4155989098 >> 172.21.15.82:0/4155989098 conn(0x7f5c4c06da00 msgr2=0x7f5c4c06de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:32.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 -- 172.21.15.82:0/4155989098 shutdown_connections 2023-07-20T10:06:32.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.557+0000 7f5c51103640 1 -- 172.21.15.82:0/4155989098 wait complete. 2023-07-20T10:06:32.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 Processor -- start 2023-07-20T10:06:32.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- start start 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c06a860 0x7f5c4c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 0x7f5c4c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ca3d0 con 0x7f5c4c0ce580 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0ca0f0 con 0x7f5c4c15c720 2023-07-20T10:06:32.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0b3b40 con 0x7f5c4c06a860 2023-07-20T10:06:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42450/0 (socket says 172.21.15.82:42450) 2023-07-20T10:06:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c06a860 0x7f5c4c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 0x7f5c4c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4259c640 1 -- 172.21.15.82:0/3292462927 learned_addr learned my addr 172.21.15.82:0/3292462927 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:32.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 -- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c06a860 msgr2=0x7f5c4c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:32.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c06a860 0x7f5c4c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 -- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 msgr2=0x7f5c4c153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 -- 172.21.15.82:0/3292462927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0094d0 con 0x7f5c4c15c720 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4259c640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c4b59e640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 0x7f5c4c153b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d530 tx=0x7f5c4400d9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440125f0 con 0x7f5c4c15c720 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44012750 con 0x7f5c4c15c720 2023-07-20T10:06:32.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44012b00 con 0x7f5c4c15c720 2023-07-20T10:06:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c0b3e20 con 0x7f5c4c15c720 2023-07-20T10:06:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.561+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c0ccca0 con 0x7f5c4c15c720 2023-07-20T10:06:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c04da30 con 0x7f5c4c15c720 2023-07-20T10:06:32.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c44012c60 con 0x7f5c4c15c720 2023-07-20T10:06:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c43fff640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 0x7f5c2c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f5c44084e00 con 0x7f5c4c15c720 2023-07-20T10:06:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c4ad9d640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 0x7f5c2c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:32.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.565+0000 7f5c4ad9d640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 0x7f5c2c068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ad000 tx=0x7f5c3c008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:32.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.569+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c44052140 con 0x7f5c4c15c720 2023-07-20T10:06:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:32.713+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5c4c0b42d0 con 0x7f5c4c15c720 2023-07-20T10:06:33.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.389+0000 7f5c43fff640 1 -- 172.21.15.82:0/3292462927 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5c44055760 con 0x7f5c4c15c720 2023-07-20T10:06:33.371 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:06:33.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.393+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 msgr2=0x7f5c2c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.393+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 0x7f5c2c068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ad000 tx=0x7f5c3c008040 comp rx=0 tx=0).stop 2023-07-20T10:06:33.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.393+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 msgr2=0x7f5c4c153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.393+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 0x7f5c4c153b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d530 tx=0x7f5c4400d9f0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 shutdown_connections 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c4c15c720 0x7f5c4c153b80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c4c0ce580 0x7f5c4c153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f5c2c0663a0 0x7f5c2c068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 --2- 172.21.15.82:0/3292462927 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c4c06a860 0x7f5c4c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 >> 172.21.15.82:0/3292462927 conn(0x7f5c4c06da00 msgr2=0x7f5c4c159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:33.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 shutdown_connections 2023-07-20T10:06:33.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.397+0000 7f5c51103640 1 -- 172.21.15.82:0/3292462927 wait complete. 2023-07-20T10:06:33.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:06:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.565+0000 7f299affa640 1 Processor -- start 2023-07-20T10:06:33.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.565+0000 7f299affa640 1 -- start start 2023-07-20T10:06:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f299affa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994159450 0x7f299415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f299affa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 0x7f29940cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f299affa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940cc8d0 con 0x7f29940cc3e0 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f299affa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940cce90 con 0x7f2994159450 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f299affa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940ccbb0 con 0x7f2994159830 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994159450 0x7f299415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2994159450 0x7f299415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54790/0 (socket says 172.21.15.82:54790) 2023-07-20T10:06:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 -- 172.21.15.82:0/2413860409 learned_addr learned my addr 172.21.15.82:0/2413860409 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 -- 172.21.15.82:0/2413860409 >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 msgr2=0x7f29940cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2993fff640 1 --2- 172.21.15.82:0/2413860409 >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 0x7f29940cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 --2- 172.21.15.82:0/2413860409 >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 0x7f29940cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 -- 172.21.15.82:0/2413860409 >> v1:172.21.15.82:6789/0 conn(0x7f29940cc3e0 legacy=0x7f29940afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2998d96640 1 -- 172.21.15.82:0/2413860409 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994159cc0 con 0x7f2994159450 2023-07-20T10:06:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f29937fe640 1 -- 172.21.15.82:0/2413860409 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129847847 0 0) 0x7f29940cc8d0 con 0x7f29940cc3e0 2023-07-20T10:06:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.569+0000 7f2993fff640 1 --2- 172.21.15.82:0/2413860409 >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 0x7f29940cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:33.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f2998d96640 1 --2- 172.21.15.82:0/2413860409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994159450 0x7f299415a4c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f299415e190 tx=0x7f298801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d787d8d8d16100f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f29937fe640 1 -- 172.21.15.82:0/2413860409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880aa610 con 0x7f2994159450 2023-07-20T10:06:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f29937fe640 1 -- 172.21.15.82:0/2413860409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880a6040 con 0x7f2994159450 2023-07-20T10:06:33.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f29937fe640 1 -- 172.21.15.82:0/2413860409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880aa990 con 0x7f2994159450 2023-07-20T10:06:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- 172.21.15.82:0/2413860409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994159450 msgr2=0x7f299415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 --2- 172.21.15.82:0/2413860409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994159450 0x7f299415a4c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f299415e190 tx=0x7f298801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- 172.21.15.82:0/2413860409 shutdown_connections 2023-07-20T10:06:33.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 --2- 172.21.15.82:0/2413860409 >> v2:172.21.15.183:3300/0 conn(0x7f2994159830 0x7f29940cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 --2- 172.21.15.82:0/2413860409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2994159450 0x7f299415a4c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- 172.21.15.82:0/2413860409 >> 172.21.15.82:0/2413860409 conn(0x7f29940cad50 msgr2=0x7f29940cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- 172.21.15.82:0/2413860409 shutdown_connections 2023-07-20T10:06:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- 172.21.15.82:0/2413860409 wait complete. 2023-07-20T10:06:33.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 Processor -- start 2023-07-20T10:06:33.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.573+0000 7f299affa640 1 -- start start 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29940cc3e0 0x7f299415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2994159450 0x7f29940af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941f5da0 con 0x7f29941f79b0 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940c6fe0 con 0x7f2994159450 2023-07-20T10:06:33.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29941f5a70 con 0x7f29940cc3e0 2023-07-20T10:06:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54794/0 (socket says 172.21.15.82:54794) 2023-07-20T10:06:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 -- 172.21.15.82:0/3837644406 learned_addr learned my addr 172.21.15.82:0/3837644406 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2998d96640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29940cc3e0 0x7f299415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2993fff640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2994159450 0x7f29940af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 -- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29940cc3e0 msgr2=0x7f299415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29940cc3e0 0x7f299415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 -- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2994159450 msgr2=0x7f29940af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2994159450 0x7f29940af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 -- 172.21.15.82:0/3837644406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880094d0 con 0x7f29941f79b0 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f2999597640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c750 tx=0x7f298c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c003db0 con 0x7f29941f79b0 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00ce60 con 0x7f29941f79b0 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0052b0 con 0x7f29941f79b0 2023-07-20T10:06:33.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29941f4ef0 con 0x7f29941f79b0 2023-07-20T10:06:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941f54b0 con 0x7f29941f79b0 2023-07-20T10:06:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940c53a0 con 0x7f29941f79b0 2023-07-20T10:06:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.577+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f298c005410 con 0x7f29941f79b0 2023-07-20T10:06:33.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.581+0000 7f29917fa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 0x7f2978068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.581+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f298c083d50 con 0x7f29941f79b0 2023-07-20T10:06:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.581+0000 7f2998d96640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 0x7f2978068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.581+0000 7f2998d96640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 0x7f2978068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae000 tx=0x7f29880b5040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.585+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29940c53a0 con 0x7f29941f79b0 2023-07-20T10:06:33.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.733+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f29940c53a0 con 0x7f29941f79b0 2023-07-20T10:06:33.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.737+0000 7f29917fa640 1 -- 172.21.15.82:0/3837644406 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7f29940c53a0 con 0x7f29941f79b0 2023-07-20T10:06:33.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 msgr2=0x7f2978068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 0x7f2978068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29880ae000 tx=0x7f29880b5040 comp rx=0 tx=0).stop 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 msgr2=0x7f29940afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f298c00c750 tx=0x7f298c00cc10 comp rx=0 tx=0).stop 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 shutdown_connections 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29941f79b0 0x7f29940afc60 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2994159450 0x7f29940af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f29780663a0 0x7f2978068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 --2- 172.21.15.82:0/3837644406 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29940cc3e0 0x7f299415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 >> 172.21.15.82:0/3837644406 conn(0x7f29940cad50 msgr2=0x7f29941628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:33.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 shutdown_connections 2023-07-20T10:06:33.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.741+0000 7f299affa640 1 -- 172.21.15.82:0/3837644406 wait complete. 2023-07-20T10:06:33.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:06:33.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.905+0000 7f2924500640 1 Processor -- start 2023-07-20T10:06:33.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.905+0000 7f2924500640 1 -- start start 2023-07-20T10:06:33.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.905+0000 7f2924500640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f291c0b08e0 0x7f291c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2924500640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 0x7f291c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2924500640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f291c158870 0x7f291c06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2924500640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c06e150 con 0x7f291c0b08e0 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2924500640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0700b0 con 0x7f291c158870 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2924500640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c06a540 con 0x7f291c0714c0 2023-07-20T10:06:33.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f291c158870 0x7f291c06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f292229c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f291c0b08e0 0x7f291c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f291c158870 0x7f291c06ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:53370/0 (socket says 172.21.15.82:53370) 2023-07-20T10:06:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 -- 172.21.15.82:0/2332962163 learned_addr learned my addr 172.21.15.82:0/2332962163 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:33.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2921a9b640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 0x7f291c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 -- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 msgr2=0x7f291c0c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:33.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 0x7f291c0c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 -- 172.21.15.82:0/2332962163 >> v2:172.21.15.82:3300/0 conn(0x7f291c0b08e0 msgr2=0x7f291c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:33.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 --2- 172.21.15.82:0/2332962163 >> v2:172.21.15.82:3300/0 conn(0x7f291c0b08e0 0x7f291c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2922a9d640 1 -- 172.21.15.82:0/2332962163 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c06faa0 con 0x7f291c158870 2023-07-20T10:06:33.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.909+0000 7f2921a9b640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 0x7f291c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:33.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.913+0000 7f2922a9d640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c158870 0x7f291c06ce10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f291c0c1d50 tx=0x7f291401c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa87be3a419766e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.913+0000 7f292129a640 1 -- 172.21.15.82:0/2332962163 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140a5730 con 0x7f291c158870 2023-07-20T10:06:33.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.913+0000 7f292129a640 1 -- 172.21.15.82:0/2332962163 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29140a5890 con 0x7f291c158870 2023-07-20T10:06:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.913+0000 7f292129a640 1 -- 172.21.15.82:0/2332962163 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29140a5730 con 0x7f291c158870 2023-07-20T10:06:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c158870 msgr2=0x7f291c06ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c158870 0x7f291c06ce10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f291c0c1d50 tx=0x7f291401c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- 172.21.15.82:0/2332962163 shutdown_connections 2023-07-20T10:06:33.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c158870 0x7f291c06ce10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 --2- 172.21.15.82:0/2332962163 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c0714c0 0x7f291c0c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 --2- 172.21.15.82:0/2332962163 >> v2:172.21.15.82:3300/0 conn(0x7f291c0b08e0 0x7f291c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- 172.21.15.82:0/2332962163 >> 172.21.15.82:0/2332962163 conn(0x7f291c0afdc0 msgr2=0x7f291c0b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- 172.21.15.82:0/2332962163 shutdown_connections 2023-07-20T10:06:33.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- 172.21.15.82:0/2332962163 wait complete. 2023-07-20T10:06:33.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 Processor -- start 2023-07-20T10:06:33.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.917+0000 7f2924500640 1 -- start start 2023-07-20T10:06:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 0x7f291c0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 0x7f291c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0c6b90 con 0x7f291c0b08e0 2023-07-20T10:06:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c1f4d40 con 0x7f291c0714c0 2023-07-20T10:06:33.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0c6010 con 0x7f291c158870 2023-07-20T10:06:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54808/0 (socket says 172.21.15.82:54808) 2023-07-20T10:06:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 -- 172.21.15.82:0/1139837257 learned_addr learned my addr 172.21.15.82:0/1139837257 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:33.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f292229c640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 0x7f291c0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2922a9d640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 0x7f291c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 -- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 msgr2=0x7f291c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 0x7f291c0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 -- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 msgr2=0x7f291c0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 0x7f291c0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 -- 172.21.15.82:0/1139837257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914009b30 con 0x7f291c0b08e0 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f292229c640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 0x7f291c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:33.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2922a9d640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 0x7f291c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2921a9b640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f290400c7f0 tx=0x7f290400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007820 con 0x7f291c0b08e0 2023-07-20T10:06:33.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904007980 con 0x7f291c0b08e0 2023-07-20T10:06:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c0c62f0 con 0x7f291c0b08e0 2023-07-20T10:06:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.921+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007d30 con 0x7f291c0b08e0 2023-07-20T10:06:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.925+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c0c68b0 con 0x7f291c0b08e0 2023-07-20T10:06:33.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.925+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c04da30 con 0x7f291c0b08e0 2023-07-20T10:06:33.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.925+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f29040113f0 con 0x7f291c0b08e0 2023-07-20T10:06:33.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.929+0000 7f291affd640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 0x7f28fc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.929+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f29040842a0 con 0x7f291c0b08e0 2023-07-20T10:06:33.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.929+0000 7f292229c640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 0x7f28fc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:33.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.929+0000 7f292229c640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 0x7f28fc068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f290c009eb0 tx=0x7f290c009190 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:33.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:33.933+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29040514e0 con 0x7f291c0b08e0 2023-07-20T10:06:34.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.081+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f291c0b4250 con 0x7f291c0b08e0 2023-07-20T10:06:34.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f291affd640 1 -- 172.21.15.82:0/1139837257 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2904053410 con 0x7f291c0b08e0 2023-07-20T10:06:34.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 msgr2=0x7f28fc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 0x7f28fc068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f290c009eb0 tx=0x7f290c009190 comp rx=0 tx=0).stop 2023-07-20T10:06:34.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 msgr2=0x7f291c14fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f290400c7f0 tx=0x7f290400ccb0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 shutdown_connections 2023-07-20T10:06:34.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f28fc0663a0 0x7f28fc068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f291c158870 0x7f291c0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c0b08e0 0x7f291c14fbc0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 --2- 172.21.15.82:0/1139837257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f291c0714c0 0x7f291c0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.085+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 >> 172.21.15.82:0/1139837257 conn(0x7f291c0afdc0 msgr2=0x7f291c15ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:34.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.089+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 shutdown_connections 2023-07-20T10:06:34.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.089+0000 7f2924500640 1 -- 172.21.15.82:0/1139837257 wait complete. 2023-07-20T10:06:34.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:06:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.245+0000 7fc13a98f640 1 Processor -- start 2023-07-20T10:06:34.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.245+0000 7fc13a98f640 1 -- start start 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc13a98f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc134159830 0x7fc1340cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc13a98f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc1340afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc13a98f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340cc8d0 con 0x7fc134159450 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc13a98f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1340cce90 con 0x7fc134159830 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc13a98f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340ccbb0 con 0x7fc1340cc3e0 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc133fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc134159450 0x7fc13415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55266/0 (socket says 172.21.15.82:55266) 2023-07-20T10:06:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc133fff640 1 -- 172.21.15.82:0/50283633 learned_addr learned my addr 172.21.15.82:0/50283633 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:34.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc138f2c640 1 --2- 172.21.15.82:0/50283633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc1340afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc1337fe640 1 --2- 172.21.15.82:0/50283633 >> v2:172.21.15.183:3300/0 conn(0x7fc134159830 0x7fc1340cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc132ffd640 1 -- 172.21.15.82:0/50283633 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654690504 0 0) 0x7fc1340cc8d0 con 0x7fc134159450 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc132ffd640 1 -- 172.21.15.82:0/50283633 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc11c003530 con 0x7fc134159450 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc138f2c640 1 -- 172.21.15.82:0/50283633 >> v2:172.21.15.183:3300/0 conn(0x7fc134159830 msgr2=0x7fc1340cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc138f2c640 1 --2- 172.21.15.82:0/50283633 >> v2:172.21.15.183:3300/0 conn(0x7fc134159830 0x7fc1340cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc138f2c640 1 -- 172.21.15.82:0/50283633 >> v1:172.21.15.82:6789/0 conn(0x7fc134159450 legacy=0x7fc13415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.249+0000 7fc138f2c640 1 -- 172.21.15.82:0/50283633 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134159cc0 con 0x7fc1340cc3e0 2023-07-20T10:06:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc138f2c640 1 --2- 172.21.15.82:0/50283633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc1340afd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009d90 tx=0x7fc12c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc34609074914da2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc132ffd640 1 -- 172.21.15.82:0/50283633 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0a58f0 con 0x7fc1340cc3e0 2023-07-20T10:06:34.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc132ffd640 1 -- 172.21.15.82:0/50283633 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c0a5a50 con 0x7fc1340cc3e0 2023-07-20T10:06:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc132ffd640 1 -- 172.21.15.82:0/50283633 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0a5de0 con 0x7fc1340cc3e0 2023-07-20T10:06:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- 172.21.15.82:0/50283633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 msgr2=0x7fc1340afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 --2- 172.21.15.82:0/50283633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc1340afd50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009d90 tx=0x7fc12c01c920 comp rx=0 tx=0).stop 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- 172.21.15.82:0/50283633 shutdown_connections 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 --2- 172.21.15.82:0/50283633 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc1340afd50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 --2- 172.21.15.82:0/50283633 >> v2:172.21.15.183:3300/0 conn(0x7fc134159830 0x7fc1340cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- 172.21.15.82:0/50283633 >> 172.21.15.82:0/50283633 conn(0x7fc1340cad50 msgr2=0x7fc1340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- 172.21.15.82:0/50283633 shutdown_connections 2023-07-20T10:06:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- 172.21.15.82:0/50283633 wait complete. 2023-07-20T10:06:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 Processor -- start 2023-07-20T10:06:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.253+0000 7fc13a98f640 1 -- start start 2023-07-20T10:06:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc134158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 0x7fc1340c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340c4800 con 0x7fc1340c4350 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b27d0 con 0x7fc134159450 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340b1730 con 0x7fc1340cc3e0 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54824/0 (socket says 172.21.15.82:54824) 2023-07-20T10:06:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 -- 172.21.15.82:0/2583189108 learned_addr learned my addr 172.21.15.82:0/2583189108 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc133fff640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc134158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc1337fe640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 0x7fc1340c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 -- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 msgr2=0x7fc134158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc134158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 -- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 msgr2=0x7fc1340c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 0x7fc1340c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 -- 172.21.15.82:0/2583189108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c009a70 con 0x7fc1340c4350 2023-07-20T10:06:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc133fff640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc134158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:34.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc1337fe640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 0x7fc1340c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:34.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc138f2c640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc12c01afd0 tx=0x7fc12c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0b9650 con 0x7fc1340c4350 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c0b97b0 con 0x7fc1340c4350 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1340b1a10 con 0x7fc1340c4350 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0b9b20 con 0x7fc1340c4350 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1340b1fd0 con 0x7fc1340c4350 2023-07-20T10:06:34.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.257+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13404da30 con 0x7fc1340c4350 2023-07-20T10:06:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.261+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc12c0b9c80 con 0x7fc1340c4350 2023-07-20T10:06:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.261+0000 7fc130ff9640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 0x7fc120068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.261+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc12c11eb50 con 0x7fc1340c4350 2023-07-20T10:06:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.261+0000 7fc133fff640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 0x7fc120068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.261+0000 7fc133fff640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 0x7fc120068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1240011f0 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.265+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc12c0ebe90 con 0x7fc1340c4350 2023-07-20T10:06:34.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.413+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1340c8690 con 0x7fc1340c4350 2023-07-20T10:06:34.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.417+0000 7fc130ff9640 1 -- 172.21.15.82:0/2583189108 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc12c0ef4b0 con 0x7fc1340c4350 2023-07-20T10:06:34.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 msgr2=0x7fc120068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 0x7fc120068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1240011f0 tx=0x7fc124009040 comp rx=0 tx=0).stop 2023-07-20T10:06:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 msgr2=0x7fc1340b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc12c01afd0 tx=0x7fc12c0196c0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 shutdown_connections 2023-07-20T10:06:34.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1340c4350 0x7fc1340b0990 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc134159450 0x7fc1340c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1200663d0 0x7fc120068890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 --2- 172.21.15.82:0/2583189108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1340cc3e0 0x7fc134158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 >> 172.21.15.82:0/2583189108 conn(0x7fc1340cad50 msgr2=0x7fc134162580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 shutdown_connections 2023-07-20T10:06:34.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.421+0000 7fc13a98f640 1 -- 172.21.15.82:0/2583189108 wait complete. 2023-07-20T10:06:34.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-20T10:06:34.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.577+0000 7f56f51fa640 1 Processor -- start 2023-07-20T10:06:34.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.577+0000 7f56f51fa640 1 -- start start 2023-07-20T10:06:34.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56f51fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f56f01596b0 0x7f56f015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56f51fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56f00b2a90 0x7f56f00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56f51fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f00ccd90 con 0x7f56f00cc900 2023-07-20T10:06:34.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56f51fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00ad600 con 0x7f56f00b2a90 2023-07-20T10:06:34.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56f51fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00ad810 con 0x7f56f01596b0 2023-07-20T10:06:34.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56f00b2a90 0x7f56f00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f56f00b2a90 0x7f56f00ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54826/0 (socket says 172.21.15.82:54826) 2023-07-20T10:06:34.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 -- 172.21.15.82:0/1701587898 learned_addr learned my addr 172.21.15.82:0/1701587898 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:34.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56eed9d640 1 --2- 172.21.15.82:0/1701587898 >> v2:172.21.15.183:3300/0 conn(0x7f56f01596b0 0x7f56f015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 -- 172.21.15.82:0/1701587898 >> v2:172.21.15.183:3300/0 conn(0x7f56f01596b0 msgr2=0x7f56f015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:34.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 --2- 172.21.15.82:0/1701587898 >> v2:172.21.15.183:3300/0 conn(0x7f56f01596b0 0x7f56f015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 -- 172.21.15.82:0/1701587898 >> v1:172.21.15.183:6789/0 conn(0x7f56f00cc900 legacy=0x7f56f00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:34.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.581+0000 7f56ef59e640 1 -- 172.21.15.82:0/1701587898 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f015d0d0 con 0x7f56f00b2a90 2023-07-20T10:06:34.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56ef59e640 1 --2- 172.21.15.82:0/1701587898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f00b2a90 0x7f56f00ad0c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009870 tx=0x7f56e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a05d213c0365f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56edd9b640 1 -- 172.21.15.82:0/1701587898 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80aa5f0 con 0x7f56f00b2a90 2023-07-20T10:06:34.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56edd9b640 1 -- 172.21.15.82:0/1701587898 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e80aa750 con 0x7f56f00b2a90 2023-07-20T10:06:34.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56edd9b640 1 -- 172.21.15.82:0/1701587898 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80aaae0 con 0x7f56f00b2a90 2023-07-20T10:06:34.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- 172.21.15.82:0/1701587898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f00b2a90 msgr2=0x7f56f00ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 --2- 172.21.15.82:0/1701587898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f00b2a90 0x7f56f00ad0c0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009870 tx=0x7f56e801c490 comp rx=0 tx=0).stop 2023-07-20T10:06:34.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- 172.21.15.82:0/1701587898 shutdown_connections 2023-07-20T10:06:34.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 --2- 172.21.15.82:0/1701587898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f00b2a90 0x7f56f00ad0c0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 --2- 172.21.15.82:0/1701587898 >> v2:172.21.15.183:3300/0 conn(0x7f56f01596b0 0x7f56f015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- 172.21.15.82:0/1701587898 >> 172.21.15.82:0/1701587898 conn(0x7f56f00cada0 msgr2=0x7f56f00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- 172.21.15.82:0/1701587898 shutdown_connections 2023-07-20T10:06:34.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- 172.21.15.82:0/1701587898 wait complete. 2023-07-20T10:06:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 Processor -- start 2023-07-20T10:06:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.585+0000 7f56f51fa640 1 -- start start 2023-07-20T10:06:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56f00b2a90 0x7f56f0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56f00cc900 0x7f56f006f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f006fef0 con 0x7f56f01596b0 2023-07-20T10:06:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f006fcc0 con 0x7f56f00b2a90 2023-07-20T10:06:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0070330 con 0x7f56f00cc900 2023-07-20T10:06:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54834/0 (socket says 172.21.15.82:54834) 2023-07-20T10:06:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 -- 172.21.15.82:0/811378180 learned_addr learned my addr 172.21.15.82:0/811378180 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56eed9d640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56f00b2a90 0x7f56f0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ee59c640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56f00cc900 0x7f56f006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 -- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56f00cc900 msgr2=0x7f56f006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56f00cc900 0x7f56f006f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 -- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56f00b2a90 msgr2=0x7f56f0154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56f00b2a90 0x7f56f0154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 -- 172.21.15.82:0/811378180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e80094d0 con 0x7f56f01596b0 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56ef59e640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ac040 tx=0x7f56e801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80b3800 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e80b3980 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80b3d30 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0070610 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f00c59d0 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f0070080 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.589+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56e80b2380 con 0x7f56f01596b0 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.593+0000 7f56d77fe640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 0x7f56dc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:34.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.593+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f56e80a7070 con 0x7f56f01596b0 2023-07-20T10:06:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.593+0000 7f56eed9d640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 0x7f56dc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:34.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.593+0000 7f56eed9d640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 0x7f56dc068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56e0003ab0 tx=0x7f56e0009830 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:34.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.597+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56e80eb730 con 0x7f56f01596b0 2023-07-20T10:06:34.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:34.793+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f56f0073c70 con 0x7f56f01596b0 2023-07-20T10:06:35.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56d77fe640 1 -- 172.21.15.82:0/811378180 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v611) v1 ==== 166+0+0 (secure 0 0 0) 0x7f56e80eed50 con 0x7f56f01596b0 2023-07-20T10:06:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 msgr2=0x7f56dc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 0x7f56dc068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56e0003ab0 tx=0x7f56e0009830 comp rx=0 tx=0).stop 2023-07-20T10:06:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 msgr2=0x7f56f00aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f56e80ac040 tx=0x7f56e801acd0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 shutdown_connections 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56f01596b0 0x7f56f00aae90 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f56dc0663a0 0x7f56dc068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f56f00cc900 0x7f56f006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 --2- 172.21.15.82:0/811378180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f56f00b2a90 0x7f56f0154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 >> 172.21.15.82:0/811378180 conn(0x7f56f00cada0 msgr2=0x7f56f00cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 shutdown_connections 2023-07-20T10:06:35.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.397+0000 7f56f51fa640 1 -- 172.21.15.82:0/811378180 wait complete. 2023-07-20T10:06:35.401 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-07-20T10:06:35.402 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:06:35.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-20T10:06:35.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.561+0000 7f3bf0227640 1 Processor -- start 2023-07-20T10:06:35.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 -- start start 2023-07-20T10:06:35.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3be815cab0 0x7f3be80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3be80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be80d16b0 con 0x7f3be80cf110 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80d31c0 con 0x7f3be815cab0 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bf0227640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b3520 con 0x7f3be80d0d10 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3be80cf110 0x7f3be80cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55282/0 (socket says 172.21.15.82:55282) 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 -- 172.21.15.82:0/4096492471 learned_addr learned my addr 172.21.15.82:0/4096492471 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:35.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bedfc3640 1 --2- 172.21.15.82:0/4096492471 >> v2:172.21.15.183:3300/0 conn(0x7f3be815cab0 0x7f3be80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bed7c2640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3be80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853194486 0 0) 0x7f3be80d16b0 con 0x7f3be80cf110 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd4003530 con 0x7f3be80cf110 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3235311283 0 0) 0x7f3bd4003530 con 0x7f3be80cf110 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 msgr2=0x7f3be80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:35.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3be80d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 >> v2:172.21.15.183:3300/0 conn(0x7f3be815cab0 msgr2=0x7f3be80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 --2- 172.21.15.82:0/4096492471 >> v2:172.21.15.183:3300/0 conn(0x7f3be815cab0 0x7f3be80d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80b2910 con 0x7f3be80cf110 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f3be0001a00 con 0x7f3be80cf110 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 >> v1:172.21.15.82:6789/0 conn(0x7f3be80cf110 legacy=0x7f3be80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3bd4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bd4003f00 0x7f3bd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b3520 con 0x7f3bd4004d10 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd400b990 con 0x7f3bd4003f00 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd400bad0 con 0x7f3be80d0d10 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bedfc3640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3bd4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bed7c2640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bd4003f00 0x7f3bd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 -- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 msgr2=0x7f3bd4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:35.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80d0d10 0x7f3bd4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 -- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bd4003f00 msgr2=0x7f3bd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:35.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bd4003f00 0x7f3bd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.565+0000 7f3bee7c4640 1 -- 172.21.15.82:0/4096492471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4003530 con 0x7f3bd4004d10 2023-07-20T10:06:35.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bee7c4640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3be000a8d0 tx=0x7f3be001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7adef4739bbdcd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00ad630 con 0x7f3bd4004d10 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00a8070 con 0x7f3bd4004d10 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3becfc1640 1 -- 172.21.15.82:0/4096492471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be00ad9d0 con 0x7f3bd4004d10 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 -- 172.21.15.82:0/4096492471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 msgr2=0x7f3bd4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 --2- 172.21.15.82:0/4096492471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3bd4005190 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f3be000a8d0 tx=0x7f3be001d380 comp rx=0 tx=0).stop 2023-07-20T10:06:35.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bee7c4640 1 -- 172.21.15.82:0/4096492471 reap_dead start 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 -- 172.21.15.82:0/4096492471 shutdown_connections 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 -- 172.21.15.82:0/4096492471 >> 172.21.15.82:0/4096492471 conn(0x7f3be808c120 msgr2=0x7f3be809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 -- 172.21.15.82:0/4096492471 shutdown_connections 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.569+0000 7f3bf0227640 1 -- 172.21.15.82:0/4096492471 wait complete. 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 Processor -- start 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- start start 2023-07-20T10:06:35.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3be80b7c00 0x7f3be814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80c6260 0x7f3be80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80caa60 con 0x7f3bd4004d10 2023-07-20T10:06:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80cad40 con 0x7f3be80b7c00 2023-07-20T10:06:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80cb020 con 0x7f3be80c6260 2023-07-20T10:06:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54860/0 (socket says 172.21.15.82:54860) 2023-07-20T10:06:35.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 -- 172.21.15.82:0/708235071 learned_addr learned my addr 172.21.15.82:0/708235071 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bee7c4640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80c6260 0x7f3be80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bed7c2640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3be80b7c00 0x7f3be814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 -- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80c6260 msgr2=0x7f3be80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80c6260 0x7f3be80b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 -- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3be80b7c00 msgr2=0x7f3be814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3be80b7c00 0x7f3be814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:35.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 -- 172.21.15.82:0/708235071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be80cb300 con 0x7f3bd4004d10 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bedfc3640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3be4011aa0 tx=0x7f3be4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400fb80 con 0x7f3bd4004d10 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400fce0 con 0x7f3bd4004d10 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4014680 con 0x7f3bd4004d10 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be80cb5e0 con 0x7f3bd4004d10 2023-07-20T10:06:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.573+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be814f1a0 con 0x7f3bd4004d10 2023-07-20T10:06:35.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8073c70 con 0x7f3bd4004d10 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3be40147e0 con 0x7f3bd4004d10 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bde7fc640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 0x7f3bcc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3be4084750 con 0x7f3bd4004d10 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bed7c2640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 0x7f3bcc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.577+0000 7f3bed7c2640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 0x7f3bcc068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3be80b0f90 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.581+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3be4051b10 con 0x7f3bd4004d10 2023-07-20T10:06:35.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:35.785+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f3be80b1da0 con 0x7f3bd4004d10 2023-07-20T10:06:36.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.401+0000 7f3bde7fc640 1 -- 172.21.15.82:0/708235071 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v612) v1 ==== 186+0+0 (secure 0 0 0) 0x7f3be4055130 con 0x7f3bd4004d10 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 msgr2=0x7f3bcc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 0x7f3bcc068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3be80b0f90 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 msgr2=0x7f3be815c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3be4011aa0 tx=0x7f3be4011f60 comp rx=0 tx=0).stop 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 shutdown_connections 2023-07-20T10:06:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3bcc0663a0 0x7f3bcc068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3be80c6260 0x7f3be80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3be80b7c00 0x7f3be814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 --2- 172.21.15.82:0/708235071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bd4004d10 0x7f3be815c220 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 >> 172.21.15.82:0/708235071 conn(0x7f3be808c120 msgr2=0x7f3be806b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 shutdown_connections 2023-07-20T10:06:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.405+0000 7f3bf0227640 1 -- 172.21.15.82:0/708235071 wait complete. 2023-07-20T10:06:36.406 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:36.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 Processor -- start 2023-07-20T10:06:36.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 -- start start 2023-07-20T10:06:36.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0afda0 0x7f255c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f255c0b2060 0x7f255c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255c0b06c0 con 0x7f255c15a8e0 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255c0b3160 con 0x7f255c0b2060 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f2560dba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c0b12a0 con 0x7f255c0afda0 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f255c0b2060 0x7f255c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f255c0b2060 0x7f255c0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54868/0 (socket says 172.21.15.82:54868) 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 -- 172.21.15.82:0/2017615185 learned_addr learned my addr 172.21.15.82:0/2017615185 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:36.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255a59c640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0afda0 0x7f255c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 -- 172.21.15.82:0/2017615185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0afda0 msgr2=0x7f255c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:36.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0afda0 0x7f255c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 -- 172.21.15.82:0/2017615185 >> v1:172.21.15.183:6789/0 conn(0x7f255c15a8e0 legacy=0x7f255c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.565+0000 7f255ad9d640 1 -- 172.21.15.82:0/2017615185 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0b1580 con 0x7f255c0b2060 2023-07-20T10:06:36.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f255ad9d640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0b0180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2554009870 tx=0x7f255401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0294a196cf6094 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2559d9b640 1 -- 172.21.15.82:0/2017615185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540ab5f0 con 0x7f255c0b2060 2023-07-20T10:06:36.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2559d9b640 1 -- 172.21.15.82:0/2017615185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540ab750 con 0x7f255c0b2060 2023-07-20T10:06:36.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2559d9b640 1 -- 172.21.15.82:0/2017615185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540abae0 con 0x7f255c0b2060 2023-07-20T10:06:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 -- 172.21.15.82:0/2017615185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 msgr2=0x7f255c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0b0180 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f2554009870 tx=0x7f255401c3f0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 -- 172.21.15.82:0/2017615185 shutdown_connections 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0b0180 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 --2- 172.21.15.82:0/2017615185 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c0afda0 0x7f255c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 -- 172.21.15.82:0/2017615185 >> 172.21.15.82:0/2017615185 conn(0x7f255c0cada0 msgr2=0x7f255c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 -- 172.21.15.82:0/2017615185 shutdown_connections 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.569+0000 7f2560dba640 1 -- 172.21.15.82:0/2017615185 wait complete. 2023-07-20T10:06:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 Processor -- start 2023-07-20T10:06:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 -- start start 2023-07-20T10:06:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c0afda0 0x7f255c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15a8e0 0x7f255c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c163b30 con 0x7f255c0b2060 2023-07-20T10:06:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c162f20 con 0x7f255c0afda0 2023-07-20T10:06:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2560dba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255c163200 con 0x7f255c15a8e0 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f255ad9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15a8e0 0x7f255c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54874/0 (socket says 172.21.15.82:54874) 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 -- 172.21.15.82:0/749562119 learned_addr learned my addr 172.21.15.82:0/749562119 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f255a59c640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c0afda0 0x7f255c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 -- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15a8e0 msgr2=0x7f255c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15a8e0 0x7f255c1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 -- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c0afda0 msgr2=0x7f255c0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c0afda0 0x7f255c0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 -- 172.21.15.82:0/749562119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540094d0 con 0x7f255c0b2060 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f2551d9b640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f254400c7a0 tx=0x7f254400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.573+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544003b80 con 0x7f255c0b2060 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544003ce0 con 0x7f255c0b2060 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400aa90 con 0x7f255c0b2060 2023-07-20T10:06:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c1634e0 con 0x7f255c0b2060 2023-07-20T10:06:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c0ace70 con 0x7f255c0b2060 2023-07-20T10:06:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c163ce0 con 0x7f255c0b2060 2023-07-20T10:06:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f254400abf0 con 0x7f255c0b2060 2023-07-20T10:06:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f25537fe640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 0x7f253c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2544083b30 con 0x7f255c0b2060 2023-07-20T10:06:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.577+0000 7f255a59c640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 0x7f253c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.581+0000 7f255a59c640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 0x7f253c068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f254c006aa0 tx=0x7f254c008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.581+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f255c163ce0 con 0x7f255c0b2060 2023-07-20T10:06:36.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.729+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f255c163ce0 con 0x7f255c0b2060 2023-07-20T10:06:36.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f25537fe640 1 -- 172.21.15.82:0/749562119 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+15747 (secure 0 0 0) 0x7f255c163ce0 con 0x7f255c0b2060 2023-07-20T10:06:36.713 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:33.379888+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6836/1048696572":"2023-07-21T10:06:30.367247+0000","172.21.15.82:0/2691334868":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6837/1048696572":"2023-07-21T10:06:30.367247+0000","172.21.15.82:0/2112844461":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/819859352":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6833/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:6832/3984926744":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/2954805626":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/3099261972":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/957540597":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/4054446550":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/2903119807":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/3702343324":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6833/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1345031035":"2023-07-21T10:06:21.577437+0000","172.21.15.82:6832/3956036202":"2023-07-21T10:06:21.577437+0000","172.21.15.82:0/1791093112":"2023-07-21T10:06:27.455034+0000","172.21.15.82:0/1526530333":"2023-07-21T10:06:21.577437+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 msgr2=0x7f253c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 0x7f253c068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f254c006aa0 tx=0x7f254c008040 comp rx=0 tx=0).stop 2023-07-20T10:06:36.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 msgr2=0x7f255c0cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f254400c7a0 tx=0x7f254400cc60 comp rx=0 tx=0).stop 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 shutdown_connections 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f253c0663a0 0x7f253c068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f255c15a8e0 0x7f255c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f255c0b2060 0x7f255c0cd740 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 --2- 172.21.15.82:0/749562119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f255c0afda0 0x7f255c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 >> 172.21.15.82:0/749562119 conn(0x7f255c0cada0 msgr2=0x7f255c06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 shutdown_connections 2023-07-20T10:06:36.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.733+0000 7f2560dba640 1 -- 172.21.15.82:0/749562119 wait complete. 2023-07-20T10:06:36.733 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:06:36.734 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:06:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 Processor -- start 2023-07-20T10:06:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 -- start start 2023-07-20T10:06:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4f5c158ce0 0x7f4f5c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f5c070970 0x7f4f5c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5c0c95d0 con 0x7f4f5c06b620 2023-07-20T10:06:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c0c9fa0 con 0x7f4f5c070970 2023-07-20T10:06:36.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f6166a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5c1590c0 con 0x7f4f5c158ce0 2023-07-20T10:06:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f5c070970 0x7f4f5c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4f5c070970 0x7f4f5c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54878/0 (socket says 172.21.15.82:54878) 2023-07-20T10:06:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 -- 172.21.15.82:0/3559471951 learned_addr learned my addr 172.21.15.82:0/3559471951 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:36.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f5affd640 1 --2- 172.21.15.82:0/3559471951 >> v2:172.21.15.183:3300/0 conn(0x7f4f5c158ce0 0x7f4f5c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 -- 172.21.15.82:0/3559471951 >> v2:172.21.15.183:3300/0 conn(0x7f4f5c158ce0 msgr2=0x7f4f5c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 --2- 172.21.15.82:0/3559471951 >> v2:172.21.15.183:3300/0 conn(0x7f4f5c158ce0 0x7f4f5c0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 -- 172.21.15.82:0/3559471951 >> v1:172.21.15.183:6789/0 conn(0x7f4f5c06b620 legacy=0x7f4f5c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.897+0000 7f4f53fff640 1 -- 172.21.15.82:0/3559471951 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0c89c0 con 0x7f4f5c070970 2023-07-20T10:06:36.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f53fff640 1 --2- 172.21.15.82:0/3559471951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c070970 0x7f4f5c070e00 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06a6c0 tx=0x7f4f4401d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62a5d4fd602b7c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f5a7fc640 1 -- 172.21.15.82:0/3559471951 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440a6870 con 0x7f4f5c070970 2023-07-20T10:06:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f5a7fc640 1 -- 172.21.15.82:0/3559471951 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f440a69d0 con 0x7f4f5c070970 2023-07-20T10:06:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f5a7fc640 1 -- 172.21.15.82:0/3559471951 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f440a6d60 con 0x7f4f5c070970 2023-07-20T10:06:36.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 -- 172.21.15.82:0/3559471951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c070970 msgr2=0x7f4f5c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 --2- 172.21.15.82:0/3559471951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c070970 0x7f4f5c070e00 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06a6c0 tx=0x7f4f4401d8d0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 -- 172.21.15.82:0/3559471951 shutdown_connections 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 --2- 172.21.15.82:0/3559471951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c070970 0x7f4f5c070e00 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 --2- 172.21.15.82:0/3559471951 >> v2:172.21.15.183:3300/0 conn(0x7f4f5c158ce0 0x7f4f5c0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 -- 172.21.15.82:0/3559471951 >> 172.21.15.82:0/3559471951 conn(0x7f4f5c0cad50 msgr2=0x7f4f5c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:36.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 -- 172.21.15.82:0/3559471951 shutdown_connections 2023-07-20T10:06:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.901+0000 7f4f6166a640 1 -- 172.21.15.82:0/3559471951 wait complete. 2023-07-20T10:06:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 Processor -- start 2023-07-20T10:06:36.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- start start 2023-07-20T10:06:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 0x7f4f5c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f5c158ce0 0x7f4f5c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1f85c0 con 0x7f4f5c06b620 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0ce3e0 con 0x7f4f5c070970 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c0ce6c0 con 0x7f4f5c158ce0 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54892/0 (socket says 172.21.15.82:54892) 2023-07-20T10:06:36.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 -- 172.21.15.82:0/193920506 learned_addr learned my addr 172.21.15.82:0/193920506 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f53fff640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 0x7f4f5c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5b7fe640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f5c158ce0 0x7f4f5c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 -- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f5c158ce0 msgr2=0x7f4f5c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f5c158ce0 0x7f4f5c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 -- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 msgr2=0x7f4f5c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 0x7f4f5c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 -- 172.21.15.82:0/193920506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4400a670 con 0x7f4f5c06b620 2023-07-20T10:06:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f53fff640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 0x7f4f5c0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f5affd640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e870 tx=0x7f4f4c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c009510 con 0x7f4f5c06b620 2023-07-20T10:06:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c00eec0 con 0x7f4f5c06b620 2023-07-20T10:06:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00cb40 con 0x7f4f5c06b620 2023-07-20T10:06:36.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c0ce9a0 con 0x7f4f5c06b620 2023-07-20T10:06:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c0cef60 con 0x7f4f5c06b620 2023-07-20T10:06:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.905+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c04da30 con 0x7f4f5c06b620 2023-07-20T10:06:36.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.909+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4f4c00cca0 con 0x7f4f5c06b620 2023-07-20T10:06:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.909+0000 7f4f537fe640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 0x7f4f3c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.909+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f4f4c083f80 con 0x7f4f5c06b620 2023-07-20T10:06:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.909+0000 7f4f53fff640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 0x7f4f3c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:36.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.909+0000 7f4f53fff640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 0x7f4f3c068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f440b0000 tx=0x7f4f44008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:36.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:36.913+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f4c0b4700 con 0x7f4f5c06b620 2023-07-20T10:06:37.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.061+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f5c15d330 con 0x7f4f5c06b620 2023-07-20T10:06:37.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.061+0000 7f4f537fe640 1 -- 172.21.15.82:0/193920506 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f4c0170a0 con 0x7f4f5c06b620 2023-07-20T10:06:37.044 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:06:37.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 msgr2=0x7f4f3c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 0x7f4f3c068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f440b0000 tx=0x7f4f44008040 comp rx=0 tx=0).stop 2023-07-20T10:06:37.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 msgr2=0x7f4f5c1f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e870 tx=0x7f4f4c00ec70 comp rx=0 tx=0).stop 2023-07-20T10:06:37.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 shutdown_connections 2023-07-20T10:06:37.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f4f3c0663a0 0x7f4f3c068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f5c158ce0 0x7f4f5c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f5c070970 0x7f4f5c0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 --2- 172.21.15.82:0/193920506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f5c06b620 0x7f4f5c1f8080 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 >> 172.21.15.82:0/193920506 conn(0x7f4f5c0cad50 msgr2=0x7f4f5c15a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 shutdown_connections 2023-07-20T10:06:37.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.065+0000 7f4f6166a640 1 -- 172.21.15.82:0/193920506 wait complete. 2023-07-20T10:06:37.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:06:37.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 Processor -- start 2023-07-20T10:06:37.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 -- start start 2023-07-20T10:06:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 0x7f3e24070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3e2406b620 0x7f3e2406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240c95d0 con 0x7f3e24158ce0 2023-07-20T10:06:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e24071310 con 0x7f3e2406b620 2023-07-20T10:06:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e2a4ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2406bff0 con 0x7f3e24070970 2023-07-20T10:06:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e23fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3e24158ce0 0x7f3e240c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55286/0 (socket says 172.21.15.82:55286) 2023-07-20T10:06:37.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e23fff640 1 -- 172.21.15.82:0/2471623000 learned_addr learned my addr 172.21.15.82:0/2471623000 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e28a89640 1 --2- 172.21.15.82:0/2471623000 >> v2:172.21.15.183:3300/0 conn(0x7f3e2406b620 0x7f3e2406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e237fe640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 0x7f3e24070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76129086 0 0) 0x7f3e240c95d0 con 0x7f3e24158ce0 2023-07-20T10:06:37.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e0c003530 con 0x7f3e24158ce0 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e28a89640 1 -- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 msgr2=0x7f3e24070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e28a89640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 0x7f3e24070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e28a89640 1 -- 172.21.15.82:0/2471623000 >> v1:172.21.15.82:6789/0 conn(0x7f3e24158ce0 legacy=0x7f3e240c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 583901608 0 0) 0x7f3e0c003530 con 0x7f3e24158ce0 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e28a89640 1 -- 172.21.15.82:0/2471623000 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e241590c0 con 0x7f3e2406b620 2023-07-20T10:06:37.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.225+0000 7f3e237fe640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 0x7f3e24070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:37.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e28a89640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2406b620 0x7f3e2406bab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009d90 tx=0x7f3e1c01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8506b83ae470e88 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14001680 con 0x7f3e2406b620 2023-07-20T10:06:37.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0a55c0 con 0x7f3e2406b620 2023-07-20T10:06:37.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e22ffd640 1 -- 172.21.15.82:0/2471623000 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0a5950 con 0x7f3e2406b620 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2406b620 msgr2=0x7f3e2406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2406b620 0x7f3e2406bab0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009d90 tx=0x7f3e1c01c840 comp rx=0 tx=0).stop 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/2471623000 shutdown_connections 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e2406b620 0x7f3e2406bab0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/2471623000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e24070970 0x7f3e24070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/2471623000 >> 172.21.15.82:0/2471623000 conn(0x7f3e240cad50 msgr2=0x7f3e240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:37.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/2471623000 shutdown_connections 2023-07-20T10:06:37.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.229+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/2471623000 wait complete. 2023-07-20T10:06:37.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 Processor -- start 2023-07-20T10:06:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 -- start start 2023-07-20T10:06:37.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2406b620 0x7f3e240c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e24070970 0x7f3e241f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24153a10 con 0x7f3e24158ce0 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240c2c70 con 0x7f3e24070970 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e24154f00 con 0x7f3e2406b620 2023-07-20T10:06:37.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54904/0 (socket says 172.21.15.82:54904) 2023-07-20T10:06:37.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 -- 172.21.15.82:0/1559121828 learned_addr learned my addr 172.21.15.82:0/1559121828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e23fff640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2406b620 0x7f3e240c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e237fe640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e24070970 0x7f3e241f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 -- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2406b620 msgr2=0x7f3e240c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2406b620 0x7f3e240c2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 -- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e24070970 msgr2=0x7f3e241f5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e24070970 0x7f3e241f5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 -- 172.21.15.82:0/1559121828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18009420 con 0x7f3e24158ce0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e28a89640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c01d0e0 tx=0x7f3e1c0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0ad640 con 0x7f3e24158ce0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0ad7a0 con 0x7f3e24158ce0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0adb10 con 0x7f3e24158ce0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.233+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c009a70 con 0x7f3e24158ce0 2023-07-20T10:06:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e241554c0 con 0x7f3e24158ce0 2023-07-20T10:06:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e240c9240 con 0x7f3e24158ce0 2023-07-20T10:06:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3e1c0b4050 con 0x7f3e24158ce0 2023-07-20T10:06:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e20ff9640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 0x7f3e10068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3e1c11ef50 con 0x7f3e24158ce0 2023-07-20T10:06:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e23fff640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 0x7f3e10068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.237+0000 7f3e23fff640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 0x7f3e10068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e14001b00 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.241+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e240c9240 con 0x7f3e24158ce0 2023-07-20T10:06:37.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e240c9210 con 0x7f3e24158ce0 2023-07-20T10:06:37.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e20ff9640 1 -- 172.21.15.82:0/1559121828 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e1c0ec320 con 0x7f3e24158ce0 2023-07-20T10:06:37.370 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:06:37.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 msgr2=0x7f3e10068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 0x7f3e10068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e14001b00 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2023-07-20T10:06:37.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 msgr2=0x7f3e241518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c01d0e0 tx=0x7f3e1c0195e0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 shutdown_connections 2023-07-20T10:06:37.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e24158ce0 0x7f3e241518e0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e24070970 0x7f3e241f5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3e100663a0 0x7f3e10068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 --2- 172.21.15.82:0/1559121828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e2406b620 0x7f3e240c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 >> 172.21.15.82:0/1559121828 conn(0x7f3e240cad50 msgr2=0x7f3e240ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 shutdown_connections 2023-07-20T10:06:37.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.389+0000 7f3e2a4ec640 1 -- 172.21.15.82:0/1559121828 wait complete. 2023-07-20T10:06:37.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:06:37.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.553+0000 7f52c506d640 1 Processor -- start 2023-07-20T10:06:37.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.553+0000 7f52c506d640 1 -- start start 2023-07-20T10:06:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f52c00ca5a0 0x7f52c015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f52c015ec90 0x7f52c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c015bad0 con 0x7f52c00ca5a0 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c0070030 con 0x7f52c015ec90 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52c506d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0071950 con 0x7f52c006f710 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f52c00ca5a0 0x7f52c015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f52c00ca5a0 0x7f52c015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54916/0 (socket says 172.21.15.82:54916) 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 -- 172.21.15.82:0/1252572705 learned_addr learned my addr 172.21.15.82:0/1252572705 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52bf59e640 1 --2- 172.21.15.82:0/1252572705 >> v2:172.21.15.183:3300/0 conn(0x7f52c015ec90 0x7f52c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52bed9d640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 -- 172.21.15.82:0/1252572705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 msgr2=0x7f52c006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 -- 172.21.15.82:0/1252572705 >> v2:172.21.15.183:3300/0 conn(0x7f52c015ec90 msgr2=0x7f52c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 --2- 172.21.15.82:0/1252572705 >> v2:172.21.15.183:3300/0 conn(0x7f52c015ec90 0x7f52c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.557+0000 7f52b659c640 1 -- 172.21.15.82:0/1252572705 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c015b230 con 0x7f52c00ca5a0 2023-07-20T10:06:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52b659c640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015e750 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f52c00702d0 tx=0x7f52a801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b02d232208592d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52be59c640 1 -- 172.21.15.82:0/1252572705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ac600 con 0x7f52c00ca5a0 2023-07-20T10:06:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52be59c640 1 -- 172.21.15.82:0/1252572705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80a8050 con 0x7f52c00ca5a0 2023-07-20T10:06:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52be59c640 1 -- 172.21.15.82:0/1252572705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ac980 con 0x7f52c00ca5a0 2023-07-20T10:06:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- 172.21.15.82:0/1252572705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 msgr2=0x7f52c015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015e750 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f52c00702d0 tx=0x7f52a801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- 172.21.15.82:0/1252572705 shutdown_connections 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 --2- 172.21.15.82:0/1252572705 >> v2:172.21.15.183:3300/0 conn(0x7f52c015ec90 0x7f52c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015e750 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 --2- 172.21.15.82:0/1252572705 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- 172.21.15.82:0/1252572705 >> 172.21.15.82:0/1252572705 conn(0x7f52c00cad50 msgr2=0x7f52c00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- 172.21.15.82:0/1252572705 shutdown_connections 2023-07-20T10:06:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- 172.21.15.82:0/1252572705 wait complete. 2023-07-20T10:06:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 Processor -- start 2023-07-20T10:06:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.561+0000 7f52c506d640 1 -- start start 2023-07-20T10:06:37.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 0x7f52c0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b0030 con 0x7f52c00ca5a0 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00afa70 con 0x7f52c015ec90 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00afd50 con 0x7f52c006f710 2023-07-20T10:06:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54920/0 (socket says 172.21.15.82:54920) 2023-07-20T10:06:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 -- 172.21.15.82:0/1767419125 learned_addr learned my addr 172.21.15.82:0/1767419125 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52bed9d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52bf59e640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 0x7f52c0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 -- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 msgr2=0x7f52c00c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c00c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 -- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 msgr2=0x7f52c0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 0x7f52c0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 -- 172.21.15.82:0/1767419125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80094d0 con 0x7f52c00ca5a0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52bf59e640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 0x7f52c0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b659c640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f52a801cd70 tx=0x7f52a801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80bc070 con 0x7f52c00ca5a0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80ace90 con 0x7f52c00ca5a0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c00c7610 con 0x7f52c00ca5a0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80b7670 con 0x7f52c00ca5a0 2023-07-20T10:06:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00c5550 con 0x7f52c00ca5a0 2023-07-20T10:06:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c004da30 con 0x7f52c00ca5a0 2023-07-20T10:06:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.565+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f52a80b3070 con 0x7f52c00ca5a0 2023-07-20T10:06:37.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.569+0000 7f52b7fff640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 0x7f52a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.569+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f52a811da40 con 0x7f52c00ca5a0 2023-07-20T10:06:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.569+0000 7f52bed9d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 0x7f52a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:37.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.569+0000 7f52bed9d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 0x7f52a0068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f52c00c6850 tx=0x7f52b0008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:37.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.573+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52a80ead00 con 0x7f52c00ca5a0 2023-07-20T10:06:37.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.717+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f52c00cb940 con 0x7f52c00ca5a0 2023-07-20T10:06:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52b7fff640 1 -- 172.21.15.82:0/1767419125 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f52a80ee320 con 0x7f52c00ca5a0 2023-07-20T10:06:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 msgr2=0x7f52a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 0x7f52a0068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f52c00c6850 tx=0x7f52b0008040 comp rx=0 tx=0).stop 2023-07-20T10:06:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 msgr2=0x7f52c015c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:37.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f52a801cd70 tx=0x7f52a801ad10 comp rx=0 tx=0).stop 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 shutdown_connections 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f52c015ec90 0x7f52c0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52c00ca5a0 0x7f52c015c150 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f52a00663a0 0x7f52a0068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 --2- 172.21.15.82:0/1767419125 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f52c006f710 0x7f52c00c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 >> 172.21.15.82:0/1767419125 conn(0x7f52c00cad50 msgr2=0x7f52c015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:37.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 shutdown_connections 2023-07-20T10:06:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:37.725+0000 7f52c506d640 1 -- 172.21.15.82:0/1767419125 wait complete. 2023-07-20T10:06:37.726 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:06:37.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:06:37.786 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:06:37.845 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:06:37.845 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:37.846 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:37.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:06:37.855 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:06:37.856 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:37.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:06:37.867 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:37.868 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:37.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:06:37.910 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:06:37.910 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:37.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:06:37.923 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:06:37.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 Processor -- start 2023-07-20T10:06:38.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 -- start start 2023-07-20T10:06:38.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 0x7f22a406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22a415d440 0x7f22a415a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a4070660 con 0x7f22a40c86d0 2023-07-20T10:06:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a40ca6f0 con 0x7f22a415d440 2023-07-20T10:06:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22aa20b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40cd490 con 0x7f22a415d060 2023-07-20T10:06:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22a415d440 0x7f22a415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22a415d440 0x7f22a415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54934/0 (socket says 172.21.15.82:54934) 2023-07-20T10:06:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 -- 172.21.15.82:0/1551392150 learned_addr learned my addr 172.21.15.82:0/1551392150 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a8a08640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f22a40c86d0 0x7f22a4070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55298/0 (socket says 172.21.15.82:55298) 2023-07-20T10:06:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 -- 172.21.15.82:0/1551392150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 msgr2=0x7f22a406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9209640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 0x7f22a406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f229bfff640 1 -- 172.21.15.82:0/1551392150 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148604187 0 0) 0x7f22a4070660 con 0x7f22a40c86d0 2023-07-20T10:06:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 0x7f22a406c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 -- 172.21.15.82:0/1551392150 >> v1:172.21.15.82:6789/0 conn(0x7f22a40c86d0 legacy=0x7f22a4070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9a0a640 1 -- 172.21.15.82:0/1551392150 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40cd770 con 0x7f22a415d440 2023-07-20T10:06:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.113+0000 7f22a9209640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 0x7f22a406c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22a9a0a640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d440 0x7f22a415a240 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f229c009e50 tx=0x7f229c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5684935ad9e40d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f229bfff640 1 -- 172.21.15.82:0/1551392150 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0a57d0 con 0x7f22a415d440 2023-07-20T10:06:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f229bfff640 1 -- 172.21.15.82:0/1551392150 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0a5930 con 0x7f22a415d440 2023-07-20T10:06:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f229bfff640 1 -- 172.21.15.82:0/1551392150 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c0a5cc0 con 0x7f22a415d440 2023-07-20T10:06:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 -- 172.21.15.82:0/1551392150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d440 msgr2=0x7f22a415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d440 0x7f22a415a240 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f229c009e50 tx=0x7f229c01ca10 comp rx=0 tx=0).stop 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 -- 172.21.15.82:0/1551392150 shutdown_connections 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d440 0x7f22a415a240 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 --2- 172.21.15.82:0/1551392150 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d060 0x7f22a406c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 -- 172.21.15.82:0/1551392150 >> 172.21.15.82:0/1551392150 conn(0x7f22a40ce080 msgr2=0x7f22a40ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 -- 172.21.15.82:0/1551392150 shutdown_connections 2023-07-20T10:06:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.117+0000 7f22aa20b640 1 -- 172.21.15.82:0/1551392150 wait complete. 2023-07-20T10:06:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 Processor -- start 2023-07-20T10:06:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- start start 2023-07-20T10:06:38.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22a40c86d0 0x7f22a414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d440 0x7f22a414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a414a7c0 con 0x7f22a415d060 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a414c580 con 0x7f22a40c86d0 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40c7a70 con 0x7f22a415d440 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54946/0 (socket says 172.21.15.82:54946) 2023-07-20T10:06:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 -- 172.21.15.82:0/3331063729 learned_addr learned my addr 172.21.15.82:0/3331063729 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a9209640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22a40c86d0 0x7f22a414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a9a0a640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d440 0x7f22a414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 -- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d440 msgr2=0x7f22a414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d440 0x7f22a414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 -- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22a40c86d0 msgr2=0x7f22a414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22a40c86d0 0x7f22a414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 -- 172.21.15.82:0/3331063729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009b30 con 0x7f22a415d060 2023-07-20T10:06:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22a8a08640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f229400c4e0 tx=0x7f229400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940074e0 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294007660 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294004a30 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40c7d50 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.121+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a40c8030 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a414a970 con 0x7f22a415d060 2023-07-20T10:06:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2294004b90 con 0x7f22a415d060 2023-07-20T10:06:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f2299ffb640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 0x7f2288068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2294083070 con 0x7f22a415d060 2023-07-20T10:06:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f22a9209640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 0x7f2288068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.125+0000 7f22a9209640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 0x7f2288068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22a000a9a0 tx=0x7f22a0008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.129+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22a414a970 con 0x7f22a415d060 2023-07-20T10:06:38.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.309+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22a404da30 con 0x7f22a415d060 2023-07-20T10:06:38.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.309+0000 7f2299ffb640 1 -- 172.21.15.82:0/3331063729 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2294018090 con 0x7f22a415d060 2023-07-20T10:06:38.291 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:38.291 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1579289704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1579289704},{"type":"v1","addr":"172.21.15.82:6835","nonce":1579289704}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":6796,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/4029742533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":4029742533},{"type":"v1","addr":"172.21.15.183:6834","nonce":4029742533}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3296937022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3296937022},{"type":"v1","addr":"172.21.15.183:6835","nonce":3296937022}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":7686,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2677931926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2677931926},{"type":"v1","addr":"172.21.15.82:6837","nonce":2677931926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-07-20T10:06:38.292 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 43 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 msgr2=0x7f2288068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 0x7f2288068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22a000a9a0 tx=0x7f22a0008040 comp rx=0 tx=0).stop 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 msgr2=0x7f22a415bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f229400c4e0 tx=0x7f229400c9a0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 shutdown_connections 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f22880663a0 0x7f2288068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22a415d440 0x7f22a414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a415d060 0x7f22a415bf40 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 --2- 172.21.15.82:0/3331063729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22a40c86d0 0x7f22a414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 >> 172.21.15.82:0/3331063729 conn(0x7f22a40ce080 msgr2=0x7f22a40ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 shutdown_connections 2023-07-20T10:06:38.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.313+0000 7f22aa20b640 1 -- 172.21.15.82:0/3331063729 wait complete. 2023-07-20T10:06:38.312 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:06:38.313 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:06:38.313 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:06:38.313 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:06:38.314 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:06:38.314 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:06:38.314 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:06:38.314 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:06:38.314 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:06:38.315 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:06:38.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:06:38.315 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:06:38.315 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:06:38.316 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:06:38.316 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:06:38.316 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:06:38.326 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:06:38.326 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:06:38.328 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:06:38.328 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:06:38.331 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:06:38.331 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:06:38.332 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:06:38.332 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:06:38.375 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:06:38.375 DEBUG:teuthology.parallel:result is None 2023-07-20T10:06:38.376 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:06:38.377 DEBUG:teuthology.parallel:result is None 2023-07-20T10:06:38.381 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:06:38.381 DEBUG:teuthology.parallel:result is None 2023-07-20T10:06:38.383 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:06:38.384 DEBUG:teuthology.parallel:result is None 2023-07-20T10:06:38.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:06:38.466 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:06:38.467 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:06:38.479 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:06:38.480 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:06:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.553+0000 7ff038567640 1 Processor -- start 2023-07-20T10:06:38.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.553+0000 7ff038567640 1 -- start start 2023-07-20T10:06:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff038567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff03015cab0 0x7ff0300d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff038567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0300d0d10 0x7ff0300d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff038567640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300d16b0 con 0x7ff0300cf110 2023-07-20T10:06:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff038567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0300d31c0 con 0x7ff03015cab0 2023-07-20T10:06:38.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff038567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b3520 con 0x7ff0300d0d10 2023-07-20T10:06:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff03015cab0 0x7ff0300d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff03015cab0 0x7ff0300d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54980/0 (socket says 172.21.15.82:54980) 2023-07-20T10:06:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 -- 172.21.15.82:0/4120677388 learned_addr learned my addr 172.21.15.82:0/4120677388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:38.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff035b02640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0300d0d10 0x7ff0300d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 -- 172.21.15.82:0/4120677388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0300d0d10 msgr2=0x7ff0300d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0300d0d10 0x7ff0300d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 -- 172.21.15.82:0/4120677388 >> v1:172.21.15.183:6789/0 conn(0x7ff0300cf110 legacy=0x7ff0300cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.557+0000 7ff036303640 1 -- 172.21.15.82:0/4120677388 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300b2910 con 0x7ff03015cab0 2023-07-20T10:06:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff036303640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03015cab0 0x7ff0300d0300 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009e50 tx=0x7ff02c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74576798db48fccf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff035301640 1 -- 172.21.15.82:0/4120677388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0a58a0 con 0x7ff03015cab0 2023-07-20T10:06:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff035301640 1 -- 172.21.15.82:0/4120677388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02c0a5a00 con 0x7ff03015cab0 2023-07-20T10:06:38.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff035301640 1 -- 172.21.15.82:0/4120677388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02c0a5d90 con 0x7ff03015cab0 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- 172.21.15.82:0/4120677388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03015cab0 msgr2=0x7ff0300d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03015cab0 0x7ff0300d0300 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009e50 tx=0x7ff02c01c9e0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- 172.21.15.82:0/4120677388 shutdown_connections 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0300d0d10 0x7ff0300d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 --2- 172.21.15.82:0/4120677388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff03015cab0 0x7ff0300d0300 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- 172.21.15.82:0/4120677388 >> 172.21.15.82:0/4120677388 conn(0x7ff03008c120 msgr2=0x7ff03009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- 172.21.15.82:0/4120677388 shutdown_connections 2023-07-20T10:06:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- 172.21.15.82:0/4120677388 wait complete. 2023-07-20T10:06:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 Processor -- start 2023-07-20T10:06:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.561+0000 7ff038567640 1 -- start start 2023-07-20T10:06:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0300cf110 0x7ff0300b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03015cab0 0x7ff0300cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c84d0 con 0x7ff0300d0d10 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c87b0 con 0x7ff0300cf110 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300c8a90 con 0x7ff03015cab0 2023-07-20T10:06:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54988/0 (socket says 172.21.15.82:54988) 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 -- 172.21.15.82:0/2383426403 learned_addr learned my addr 172.21.15.82:0/2383426403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff036303640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0300cf110 0x7ff0300b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff036b04640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03015cab0 0x7ff0300cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 -- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03015cab0 msgr2=0x7ff0300cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03015cab0 0x7ff0300cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 -- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0300cf110 msgr2=0x7ff0300b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:38.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0300cf110 0x7ff0300b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:38.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 -- 172.21.15.82:0/2383426403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c009b30 con 0x7ff0300d0d10 2023-07-20T10:06:38.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff035b02640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e870 tx=0x7ff02000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020009510 con 0x7ff0300d0d10 2023-07-20T10:06:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000eec0 con 0x7ff0300d0d10 2023-07-20T10:06:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000cb40 con 0x7ff0300d0d10 2023-07-20T10:06:38.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0300c8d70 con 0x7ff0300d0d10 2023-07-20T10:06:38.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0301600c0 con 0x7ff0300d0d10 2023-07-20T10:06:38.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff030073c70 con 0x7ff0300d0d10 2023-07-20T10:06:38.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.565+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff02000ccc0 con 0x7ff0300d0d10 2023-07-20T10:06:38.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.569+0000 7ff026ffd640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 0x7ff014068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.569+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff020083e60 con 0x7ff0300d0d10 2023-07-20T10:06:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.569+0000 7ff036303640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 0x7ff014068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:38.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.569+0000 7ff036303640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 0x7ff014068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ae000 tx=0x7ff02c0a7070 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:38.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.573+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0200512e0 con 0x7ff0300d0d10 2023-07-20T10:06:38.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:38.729+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff0300cae80 con 0x7ff0300d0d10 2023-07-20T10:06:39.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.425+0000 7ff026ffd640 1 -- 172.21.15.82:0/2383426403 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff020017080 con 0x7ff0300d0d10 2023-07-20T10:06:39.408 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:06:39.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 msgr2=0x7ff014068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 0x7ff014068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0ae000 tx=0x7ff02c0a7070 comp rx=0 tx=0).stop 2023-07-20T10:06:39.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 msgr2=0x7ff0300cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff02000e870 tx=0x7ff02000ec70 comp rx=0 tx=0).stop 2023-07-20T10:06:39.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 shutdown_connections 2023-07-20T10:06:39.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff0140663a0 0x7ff014068860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff03015cab0 0x7ff0300cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0300d0d10 0x7ff0300cb220 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 --2- 172.21.15.82:0/2383426403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0300cf110 0x7ff0300b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 >> 172.21.15.82:0/2383426403 conn(0x7ff03008c120 msgr2=0x7ff03006be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:39.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 shutdown_connections 2023-07-20T10:06:39.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.429+0000 7ff038567640 1 -- 172.21.15.82:0/2383426403 wait complete. 2023-07-20T10:06:39.435 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:06:39.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 Processor -- start 2023-07-20T10:06:39.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 -- start start 2023-07-20T10:06:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3da80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80b3520 con 0x7f3da80d0d10 2023-07-20T10:06:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80d0a10 con 0x7f3da815cab0 2023-07-20T10:06:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3db032c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80d31c0 con 0x7f3da80d1170 2023-07-20T10:06:39.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad8c7640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3da80d0d10 0x7f3da80cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55312/0 (socket says 172.21.15.82:55312) 2023-07-20T10:06:39.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad8c7640 1 -- 172.21.15.82:0/3102922984 learned_addr learned my addr 172.21.15.82:0/3102922984 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae8c9640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3da80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984716168 0 0) 0x7f3da80b3520 con 0x7f3da80d0d10 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d94003530 con 0x7f3da80d0d10 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993090883 0 0) 0x7f3d94003530 con 0x7f3da80d0d10 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 msgr2=0x7f3da80cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3da80cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 >> v1:172.21.15.183:6789/0 conn(0x7f3da815cab0 legacy=0x7f3da80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80b2910 con 0x7f3da80d0d10 2023-07-20T10:06:39.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f3d98001680 con 0x7f3da80d0d10 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 >> v1:172.21.15.82:6789/0 conn(0x7f3da80d0d10 legacy=0x7f3da80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3d94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3d940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d94004d10 0x7f3d94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9400ba40 con 0x7f3d940039b0 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9400bb80 con 0x7f3d94004d10 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9400bd40 con 0x7f3da80d1170 2023-07-20T10:06:39.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3d94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad8c7640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3d940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae8c9640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d94004d10 0x7f3d94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 msgr2=0x7f3d940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3d940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d94004d10 msgr2=0x7f3d94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d94004d10 0x7f3d94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3102922984 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94003530 con 0x7f3d940039b0 2023-07-20T10:06:39.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dad8c7640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da80d1170 0x7f3d940047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:39.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.597+0000 7f3dae8c9640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d94004d10 0x7f3d94005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3d94003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3da4001750 tx=0x7f3da401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467d0d845e11c30e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da40052d0 con 0x7f3d940039b0 2023-07-20T10:06:39.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da40a7050 con 0x7f3d940039b0 2023-07-20T10:06:39.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3dad0c6640 1 -- 172.21.15.82:0/3102922984 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4003600 con 0x7f3d940039b0 2023-07-20T10:06:39.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 -- 172.21.15.82:0/3102922984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 msgr2=0x7f3d94003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 --2- 172.21.15.82:0/3102922984 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3d94003dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f3da4001750 tx=0x7f3da401c390 comp rx=0 tx=0).stop 2023-07-20T10:06:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3dae8c9640 1 -- 172.21.15.82:0/3102922984 reap_dead start 2023-07-20T10:06:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 -- 172.21.15.82:0/3102922984 shutdown_connections 2023-07-20T10:06:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 -- 172.21.15.82:0/3102922984 >> 172.21.15.82:0/3102922984 conn(0x7f3da808c120 msgr2=0x7f3da809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 -- 172.21.15.82:0/3102922984 shutdown_connections 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.601+0000 7f3db032c640 1 -- 172.21.15.82:0/3102922984 wait complete. 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 Processor -- start 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- start start 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da8157a20 0x7f3da81583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8143da0 0x7f3da815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815eed0 con 0x7f3d940039b0 2023-07-20T10:06:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815eba0 con 0x7f3da8143da0 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da815d1e0 con 0x7f3da8157a20 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55014/0 (socket says 172.21.15.82:55014) 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3730629230 learned_addr learned my addr 172.21.15.82:0/3730629230 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da8157a20 msgr2=0x7f3da81583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da8157a20 0x7f3da81583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8143da0 msgr2=0x7f3da815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8143da0 0x7f3da815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 -- 172.21.15.82:0/3730629230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8158a20 con 0x7f3d940039b0 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3dae0c8640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005040 tx=0x7f3d94005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4007040 con 0x7f3d940039b0 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da40071a0 con 0x7f3d940039b0 2023-07-20T10:06:39.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da8158d00 con 0x7f3d940039b0 2023-07-20T10:06:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4007590 con 0x7f3d940039b0 2023-07-20T10:06:39.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.605+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da815bf50 con 0x7f3d940039b0 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da81591b0 con 0x7f3d940039b0 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3da40067e0 con 0x7f3d940039b0 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3d9effd640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 0x7f3d8c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3da411deb0 con 0x7f3d940039b0 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3dad8c7640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 0x7f3d8c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.609+0000 7f3dad8c7640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 0x7f3d8c068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d98001000 tx=0x7f3d98001dd0 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:39.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.613+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3da40eb570 con 0x7f3d940039b0 2023-07-20T10:06:39.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.809+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3da8073c70 con 0x7f3d940039b0 2023-07-20T10:06:39.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.809+0000 7f3d9effd640 1 -- 172.21.15.82:0/3730629230 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3da40eeb90 con 0x7f3d940039b0 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:06:39.791 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:06:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:39.792 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:06:39.793 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.794 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:06:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:06:39.795 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:06:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:06:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.797 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:06:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:06:39.799 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.800 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:06:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:06:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.802 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:06:39.804 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:06:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.805 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:06:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:06:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:06:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:06:39.809 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.810 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:06:39.811 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:06:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.812 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.813 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:06:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:06:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.814 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:06:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:06:39.816 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:06:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:06:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:06:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:06:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.819 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.819 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:06:39.819 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:06:39.819 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.820 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:06:39.821 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:06:39.821 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.821 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.821 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:39.822 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:39.822 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:39.822 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.823 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:06:39.823 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:06:39.824 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.824 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.824 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:39.824 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:39.825 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:39.825 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.826 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:06:39.826 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:06:39.826 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.827 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:06:39.827 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:06:39.827 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:06:39.828 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:06:39.828 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.829 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:06:39.829 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:06:39.829 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.829 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:39.830 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:06:39.830 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:06:39.830 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.830 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:06:39.831 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:06:39.832 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:06:39.833 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:06:39.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:39.833 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:06:39.834 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:06:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 msgr2=0x7f3d8c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 0x7f3d8c068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3d98001000 tx=0x7f3d98001dd0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 msgr2=0x7f3da8157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005040 tx=0x7f3d94005800 comp rx=0 tx=0).stop 2023-07-20T10:06:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 shutdown_connections 2023-07-20T10:06:39.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3da8143da0 0x7f3da815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d8c0663d0 0x7f3d8c068890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3da8157a20 0x7f3da81583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 --2- 172.21.15.82:0/3730629230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d940039b0 0x7f3da8157eb0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 >> 172.21.15.82:0/3730629230 conn(0x7f3da808c120 msgr2=0x7f3da815a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 shutdown_connections 2023-07-20T10:06:39.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.813+0000 7f3db032c640 1 -- 172.21.15.82:0/3730629230 wait complete. 2023-07-20T10:06:39.840 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.997+0000 7f7cb7ffa640 1 Processor -- start 2023-07-20T10:06:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:39.997+0000 7f7cb7ffa640 1 -- start start 2023-07-20T10:06:39.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb7ffa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7cb00d1170 0x7f7cb00cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb7ffa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00b3520 con 0x7f7cb00d0d10 2023-07-20T10:06:39.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb7ffa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00d0a10 con 0x7f7cb015cab0 2023-07-20T10:06:39.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb7ffa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb00d31c0 con 0x7f7cb00d1170 2023-07-20T10:06:39.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7cb00d0d10 0x7f7cb00cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55326/0 (socket says 172.21.15.82:55326) 2023-07-20T10:06:39.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 -- 172.21.15.82:0/1977271269 learned_addr learned my addr 172.21.15.82:0/1977271269 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb6597640 1 --2- 172.21.15.82:0/1977271269 >> v2:172.21.15.183:3300/0 conn(0x7f7cb00d1170 0x7f7cb00cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953082869 0 0) 0x7f7cb00b3520 con 0x7f7cb00d0d10 2023-07-20T10:06:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c9c003530 con 0x7f7cb00d0d10 2023-07-20T10:06:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709302877 0 0) 0x7f7c9c003530 con 0x7f7cb00d0d10 2023-07-20T10:06:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 >> v2:172.21.15.183:3300/0 conn(0x7f7cb00d1170 msgr2=0x7f7cb00cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 --2- 172.21.15.82:0/1977271269 >> v2:172.21.15.183:3300/0 conn(0x7f7cb00d1170 0x7f7cb00cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 >> v1:172.21.15.183:6789/0 conn(0x7f7cb015cab0 legacy=0x7f7cb00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00b2910 con 0x7f7cb00d0d10 2023-07-20T10:06:39.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7ca0001680 con 0x7f7cb00d0d10 2023-07-20T10:06:39.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 >> v1:172.21.15.82:6789/0 conn(0x7f7cb00d0d10 legacy=0x7f7cb00cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c003980 0x7f7c9c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 0x7f7c9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c005050 0x7f7c9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00bf80 con 0x7f7c9c004380 2023-07-20T10:06:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00c0f0 con 0x7f7c9c003980 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c00c2b0 con 0x7f7c9c005050 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 0x7f7c9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5d96640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c003980 0x7f7c9c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb6597640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c005050 0x7f7c9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 -- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c005050 msgr2=0x7f7c9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c005050 0x7f7c9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 -- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c003980 msgr2=0x7f7c9c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:39.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c9c003980 0x7f7c9c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb5595640 1 -- 172.21.15.82:0/1977271269 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c003530 con 0x7f7c9c004380 2023-07-20T10:06:39.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.001+0000 7f7cb6597640 1 -- 172.21.15.82:0/1977271269 reap_dead start 2023-07-20T10:06:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb5595640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 0x7f7c9c004850 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c190 tx=0x7f7ca001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdfb96c0a8e3b76 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0005ae0 con 0x7f7c9c004380 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0005c60 con 0x7f7c9c004380 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb4d94640 1 -- 172.21.15.82:0/1977271269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00a5a80 con 0x7f7c9c004380 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 msgr2=0x7f7c9c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 0x7f7c9c004850 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000c190 tx=0x7f7ca001cb40 comp rx=0 tx=0).stop 2023-07-20T10:06:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/1977271269 shutdown_connections 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/1977271269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c9c004380 0x7f7c9c004850 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/1977271269 >> 172.21.15.82:0/1977271269 conn(0x7f7cb008c120 msgr2=0x7f7cb009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/1977271269 shutdown_connections 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.005+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/1977271269 wait complete. 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 Processor -- start 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- start start 2023-07-20T10:06:39.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c004380 0x7f7cb00ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cb00c9870 0x7f7cb0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00cbe40 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00cb230 con 0x7f7cb00c9870 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00cb510 con 0x7f7c9c004380 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55036/0 (socket says 172.21.15.82:55036) 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 -- 172.21.15.82:0/2078911641 learned_addr learned my addr 172.21.15.82:0/2078911641 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb5d96640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c004380 0x7f7cb00ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb5595640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cb00c9870 0x7f7cb0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 -- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c004380 msgr2=0x7f7cb00ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c004380 0x7f7cb00ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 -- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cb00c9870 msgr2=0x7f7cb0151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:39.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cb00c9870 0x7f7cb0151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:39.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 -- 172.21.15.82:0/2078911641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00cb7f0 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb6597640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7cb008cc70 tx=0x7f7ca80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:39.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800e070 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8011e10 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb00cbad0 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca80039a0 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb0152060 con 0x7f7cb00cc2d0 2023-07-20T10:06:39.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.009+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0073c70 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.013+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ca8003b00 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.013+0000 7f7ca67fc640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 0x7f7c94068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.013+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7ca80843a0 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.013+0000 7f7cb5d96640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 0x7f7c94068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.013+0000 7f7cb5d96640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 0x7f7c94068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cb01f4fa0 tx=0x7f7cac007cd0 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.017+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ca8051940 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb00cbf80 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7ca67fc640 1 -- 172.21.15.82:0/2078911641 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+14617 (secure 0 0 0) 0x7f7ca8054f60 con 0x7f7cb00cc2d0 2023-07-20T10:06:40.146 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:40.146 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":103,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:39.437517+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:40.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 msgr2=0x7f7c94068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 0x7f7c94068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7cb01f4fa0 tx=0x7f7cac007cd0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 msgr2=0x7f7cb006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7cb008cc70 tx=0x7f7ca80115a0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 shutdown_connections 2023-07-20T10:06:40.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cb00cc2d0 0x7f7cb006a7b0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7cb00c9870 0x7f7cb0151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f7c940663a0 0x7f7c94068860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 --2- 172.21.15.82:0/2078911641 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c9c004380 0x7f7cb00ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 >> 172.21.15.82:0/2078911641 conn(0x7f7cb008c120 msgr2=0x7f7cb00cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 shutdown_connections 2023-07-20T10:06:40.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.165+0000 7f7cb7ffa640 1 -- 172.21.15.82:0/2078911641 wait complete. 2023-07-20T10:06:40.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:06:40.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:06:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 Processor -- start 2023-07-20T10:06:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 -- start start 2023-07-20T10:06:40.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd11c15a6f0 0x7fd11c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c071950 con 0x7fd11c0ca5a0 2023-07-20T10:06:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11c15b230 con 0x7fd11c06f710 2023-07-20T10:06:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd123ccb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11c15bad0 con 0x7fd11c15a6f0 2023-07-20T10:06:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd11c15a6f0 0x7fd11c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd11c15a6f0 0x7fd11c15ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55042/0 (socket says 172.21.15.82:55042) 2023-07-20T10:06:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd121266640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd11c0ca5a0 0x7fd11c15e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55330/0 (socket says 172.21.15.82:55330) 2023-07-20T10:06:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 -- 172.21.15.82:0/4145326866 learned_addr learned my addr 172.21.15.82:0/4145326866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 -- 172.21.15.82:0/4145326866 >> v1:172.21.15.183:6789/0 conn(0x7fd11c06f710 legacy=0x7fd11c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 -- 172.21.15.82:0/4145326866 >> v1:172.21.15.82:6789/0 conn(0x7fd11c0ca5a0 legacy=0x7fd11c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.329+0000 7fd122268640 1 -- 172.21.15.82:0/4145326866 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c15b510 con 0x7fd11c15a6f0 2023-07-20T10:06:40.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd122268640 1 --2- 172.21.15.82:0/4145326866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15ab60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd114009e80 tx=0x7fd11401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e559bc79378cdc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd120a65640 1 -- 172.21.15.82:0/4145326866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140a5880 con 0x7fd11c15a6f0 2023-07-20T10:06:40.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd120a65640 1 -- 172.21.15.82:0/4145326866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140a59e0 con 0x7fd11c15a6f0 2023-07-20T10:06:40.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd120a65640 1 -- 172.21.15.82:0/4145326866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140a5d70 con 0x7fd11c15a6f0 2023-07-20T10:06:40.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 -- 172.21.15.82:0/4145326866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 msgr2=0x7fd11c15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 --2- 172.21.15.82:0/4145326866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15ab60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd114009e80 tx=0x7fd11401c9c0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 -- 172.21.15.82:0/4145326866 shutdown_connections 2023-07-20T10:06:40.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 --2- 172.21.15.82:0/4145326866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15ab60 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 -- 172.21.15.82:0/4145326866 >> 172.21.15.82:0/4145326866 conn(0x7fd11c0cad50 msgr2=0x7fd11c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 -- 172.21.15.82:0/4145326866 shutdown_connections 2023-07-20T10:06:40.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.333+0000 7fd123ccb640 1 -- 172.21.15.82:0/4145326866 wait complete. 2023-07-20T10:06:40.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 Processor -- start 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- start start 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c06f710 0x7fd11c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c0ca5a0 0x7fd11c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c155830 con 0x7fd11c15a6f0 2023-07-20T10:06:40.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c155b10 con 0x7fd11c0ca5a0 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11c14cfa0 con 0x7fd11c06f710 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55058/0 (socket says 172.21.15.82:55058) 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 -- 172.21.15.82:0/1929342425 learned_addr learned my addr 172.21.15.82:0/1929342425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd121266640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c0ca5a0 0x7fd11c15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd121a67640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c06f710 0x7fd11c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 -- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c06f710 msgr2=0x7fd11c14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c06f710 0x7fd11c14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 -- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c0ca5a0 msgr2=0x7fd11c15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c0ca5a0 0x7fd11c15bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 -- 172.21.15.82:0/1929342425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114009b30 con 0x7fd11c15a6f0 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd122268640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af040 tx=0x7fd114019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140b8670 con 0x7fd11c15a6f0 2023-07-20T10:06:40.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140b87d0 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11c152240 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140b8b80 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.337+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11c152800 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11c155c80 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd1140b8ce0 con 0x7fd11c15a6f0 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd1127fc640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 0x7fd100068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd11411f390 con 0x7fd11c15a6f0 2023-07-20T10:06:40.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd121a67640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 0x7fd100068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.341+0000 7fd121a67640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 0x7fd100068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd118000f70 tx=0x7fd118009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.345+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1140ecb80 con 0x7fd11c15a6f0 2023-07-20T10:06:40.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd11c04da30 con 0x7fd11c15a6f0 2023-07-20T10:06:40.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd1127fc640 1 -- 172.21.15.82:0/1929342425 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd1140f01a0 con 0x7fd11c15a6f0 2023-07-20T10:06:40.482 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 msgr2=0x7fd100068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 0x7fd100068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd118000f70 tx=0x7fd118009040 comp rx=0 tx=0).stop 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 msgr2=0x7fd11c15c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af040 tx=0x7fd114019760 comp rx=0 tx=0).stop 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 shutdown_connections 2023-07-20T10:06:40.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c15a6f0 0x7fd11c15c460 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd11c0ca5a0 0x7fd11c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fd1000663a0 0x7fd100068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 --2- 172.21.15.82:0/1929342425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd11c06f710 0x7fd11c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 >> 172.21.15.82:0/1929342425 conn(0x7fd11c0cad50 msgr2=0x7fd11c15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 shutdown_connections 2023-07-20T10:06:40.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.501+0000 7fd123ccb640 1 -- 172.21.15.82:0/1929342425 wait complete. 2023-07-20T10:06:40.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:06:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 Processor -- start 2023-07-20T10:06:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 -- start start 2023-07-20T10:06:40.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc158159450 0x7fc15815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc1580b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580b06b0 con 0x7fc158159830 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1580cce90 con 0x7fc158159450 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc15e034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580cc8d0 con 0x7fc1580afd50 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1577fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc158159450 0x7fc15815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc156ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc158159830 0x7fc1580cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55338/0 (socket says 172.21.15.82:55338) 2023-07-20T10:06:40.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc156ffd640 1 -- 172.21.15.82:0/3389112013 learned_addr learned my addr 172.21.15.82:0/3389112013 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc157fff640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc1580b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1577fe640 1 -- 172.21.15.82:0/3389112013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 msgr2=0x7fc1580b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:40.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1577fe640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc1580b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1567fc640 1 -- 172.21.15.82:0/3389112013 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508883094 0 0) 0x7fc1580b06b0 con 0x7fc158159830 2023-07-20T10:06:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1577fe640 1 -- 172.21.15.82:0/3389112013 >> v1:172.21.15.82:6789/0 conn(0x7fc158159830 legacy=0x7fc1580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc1577fe640 1 -- 172.21.15.82:0/3389112013 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580ccbb0 con 0x7fc158159450 2023-07-20T10:06:40.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.665+0000 7fc157fff640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc1580b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc1577fe640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc15815a4c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc1480097f0 tx=0x7fc14801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1194f5accec6deb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc1567fc640 1 -- 172.21.15.82:0/3389112013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480ab650 con 0x7fc158159450 2023-07-20T10:06:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc1567fc640 1 -- 172.21.15.82:0/3389112013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480ab7b0 con 0x7fc158159450 2023-07-20T10:06:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc1567fc640 1 -- 172.21.15.82:0/3389112013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480abb40 con 0x7fc158159450 2023-07-20T10:06:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 -- 172.21.15.82:0/3389112013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 msgr2=0x7fc15815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc15815a4c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc1480097f0 tx=0x7fc14801c450 comp rx=0 tx=0).stop 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 -- 172.21.15.82:0/3389112013 shutdown_connections 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc1580b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 --2- 172.21.15.82:0/3389112013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc15815a4c0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 -- 172.21.15.82:0/3389112013 >> 172.21.15.82:0/3389112013 conn(0x7fc1580cad50 msgr2=0x7fc1580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 -- 172.21.15.82:0/3389112013 shutdown_connections 2023-07-20T10:06:40.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.669+0000 7fc15e034640 1 -- 172.21.15.82:0/3389112013 wait complete. 2023-07-20T10:06:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 Processor -- start 2023-07-20T10:06:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- start start 2023-07-20T10:06:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc15814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 0x7fc158152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158152d70 con 0x7fc158159450 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15814d140 con 0x7fc158152380 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc158153f30 con 0x7fc1580afd50 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55072/0 (socket says 172.21.15.82:55072) 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 -- 172.21.15.82:0/582197159 learned_addr learned my addr 172.21.15.82:0/582197159 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:40.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc1577fe640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc15814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc157fff640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 0x7fc158152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 -- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 msgr2=0x7fc15814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc15814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 -- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 msgr2=0x7fc158152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 0x7fc158152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 -- 172.21.15.82:0/582197159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148009420 con 0x7fc158159450 2023-07-20T10:06:40.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc157fff640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 0x7fc158152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:40.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc156ffd640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c480 tx=0x7fc14c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c0074e0 con 0x7fc158159450 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc14c007660 con 0x7fc158159450 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc14c004a30 con 0x7fc158159450 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc158154210 con 0x7fc158159450 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.673+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1581547d0 con 0x7fc158159450 2023-07-20T10:06:40.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15804da30 con 0x7fc158159450 2023-07-20T10:06:40.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc14c004b90 con 0x7fc158159450 2023-07-20T10:06:40.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc13ffff640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 0x7fc144068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc14c082c40 con 0x7fc158159450 2023-07-20T10:06:40.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc1577fe640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 0x7fc144068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.677+0000 7fc1577fe640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 0x7fc144068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1480af000 tx=0x7fc1480a7000 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.681+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc14c053e20 con 0x7fc158159450 2023-07-20T10:06:40.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1580cbbf0 con 0x7fc158159450 2023-07-20T10:06:40.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc13ffff640 1 -- 172.21.15.82:0/582197159 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v103) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc14c018020 con 0x7fc158159450 2023-07-20T10:06:40.810 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:06:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 msgr2=0x7fc144068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 0x7fc144068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc1480af000 tx=0x7fc1480a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 msgr2=0x7fc1580c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc14c00c480 tx=0x7fc14c00c940 comp rx=0 tx=0).stop 2023-07-20T10:06:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 shutdown_connections 2023-07-20T10:06:40.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc158152380 0x7fc158152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc158159450 0x7fc1580c1dc0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc1440663a0 0x7fc144068860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 --2- 172.21.15.82:0/582197159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1580afd50 0x7fc15814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 >> 172.21.15.82:0/582197159 conn(0x7fc1580cad50 msgr2=0x7fc158070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 shutdown_connections 2023-07-20T10:06:40.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.829+0000 7fc15e034640 1 -- 172.21.15.82:0/582197159 wait complete. 2023-07-20T10:06:40.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:06:40.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 Processor -- start 2023-07-20T10:06:40.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 -- start start 2023-07-20T10:06:40.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2344160bc0 0x7f234406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440cc560 con 0x7f234406c700 2023-07-20T10:06:40.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440ad7e0 con 0x7f2344160bc0 2023-07-20T10:06:40.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f234bc0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440cc790 con 0x7f2344160fa0 2023-07-20T10:06:40.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f23499a7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2344160bc0 0x7f234406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f23499a7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2344160bc0 0x7f234406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55086/0 (socket says 172.21.15.82:55086) 2023-07-20T10:06:40.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.989+0000 7f23499a7640 1 -- 172.21.15.82:0/557153530 learned_addr learned my addr 172.21.15.82:0/557153530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:40.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23499a7640 1 -- 172.21.15.82:0/557153530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 msgr2=0x7f23440c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:40.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23491a6640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23499a7640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23499a7640 1 -- 172.21.15.82:0/557153530 >> v1:172.21.15.183:6789/0 conn(0x7f234406c700 legacy=0x7f23440aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:40.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23499a7640 1 -- 172.21.15.82:0/557153530 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440cca70 con 0x7f2344160bc0 2023-07-20T10:06:40.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23491a6640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:40.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23499a7640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344160bc0 0x7f234406c1c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2340009870 tx=0x7f234001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc367b2a4901511 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23489a5640 1 -- 172.21.15.82:0/557153530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400ab600 con 0x7f2344160bc0 2023-07-20T10:06:40.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23489a5640 1 -- 172.21.15.82:0/557153530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400ab760 con 0x7f2344160bc0 2023-07-20T10:06:40.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f23489a5640 1 -- 172.21.15.82:0/557153530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400abaf0 con 0x7f2344160bc0 2023-07-20T10:06:40.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f234bc0b640 1 -- 172.21.15.82:0/557153530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344160bc0 msgr2=0x7f234406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f234bc0b640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344160bc0 0x7f234406c1c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2340009870 tx=0x7f234001c440 comp rx=0 tx=0).stop 2023-07-20T10:06:40.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f234bc0b640 1 -- 172.21.15.82:0/557153530 shutdown_connections 2023-07-20T10:06:40.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f234bc0b640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.993+0000 7f234bc0b640 1 --2- 172.21.15.82:0/557153530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2344160bc0 0x7f234406c1c0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- 172.21.15.82:0/557153530 >> 172.21.15.82:0/557153530 conn(0x7f23440cada0 msgr2=0x7f23440cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:40.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- 172.21.15.82:0/557153530 shutdown_connections 2023-07-20T10:06:40.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- 172.21.15.82:0/557153530 wait complete. 2023-07-20T10:06:40.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 Processor -- start 2023-07-20T10:06:40.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- start start 2023-07-20T10:06:40.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2344160bc0 0x7f23440add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234415e630 con 0x7f234406c700 2023-07-20T10:06:40.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234415aa40 con 0x7f2344160bc0 2023-07-20T10:06:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234bc0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23440af8a0 con 0x7f2344160fa0 2023-07-20T10:06:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55092/0 (socket says 172.21.15.82:55092) 2023-07-20T10:06:40.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 -- 172.21.15.82:0/3800452282 learned_addr learned my addr 172.21.15.82:0/3800452282 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23491a6640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2344160bc0 0x7f23440add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f234a1a8640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 -- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 msgr2=0x7f23440ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 -- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2344160bc0 msgr2=0x7f23440add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2344160bc0 0x7f23440add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 -- 172.21.15.82:0/3800452282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400094d0 con 0x7f234406c700 2023-07-20T10:06:40.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f23499a7640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f23400ad040 tx=0x7f234001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:40.997+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400b4800 con 0x7f234406c700 2023-07-20T10:06:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400b4960 con 0x7f234406c700 2023-07-20T10:06:40.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400b4d10 con 0x7f234406c700 2023-07-20T10:06:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440afb80 con 0x7f234406c700 2023-07-20T10:06:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2344159200 con 0x7f234406c700 2023-07-20T10:06:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344073c70 con 0x7f234406c700 2023-07-20T10:06:40.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23400b3380 con 0x7f234406c700 2023-07-20T10:06:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f233a7fc640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 0x7f2328068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f234011e3d0 con 0x7f234406c700 2023-07-20T10:06:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f23491a6640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 0x7f2328068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:40.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.001+0000 7f23491a6640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 0x7f2328068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f234415deb0 tx=0x7f2334008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:40.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.005+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23400eb990 con 0x7f234406c700 2023-07-20T10:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f234409bff0 con 0x7f234406c700 2023-07-20T10:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f233a7fc640 1 -- 172.21.15.82:0/3800452282 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+126 (secure 0 0 0) 0x7f23400eefb0 con 0x7f234406c700 2023-07-20T10:06:41.137 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:06:41.138 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:06:41.139 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:41.139 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 msgr2=0x7f2328068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 0x7f2328068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f234415deb0 tx=0x7f2334008040 comp rx=0 tx=0).stop 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 msgr2=0x7f234415e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f23400ad040 tx=0x7f234001ac80 comp rx=0 tx=0).stop 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 shutdown_connections 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f23280663a0 0x7f2328068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2344160fa0 0x7f23440ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2344160bc0 0x7f23440add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 --2- 172.21.15.82:0/3800452282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f234406c700 0x7f234415e0f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 >> 172.21.15.82:0/3800452282 conn(0x7f23440cada0 msgr2=0x7f234415f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 shutdown_connections 2023-07-20T10:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.157+0000 7f234bc0b640 1 -- 172.21.15.82:0/3800452282 wait complete. 2023-07-20T10:06:41.158 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:06:41.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:06:41.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 Processor -- start 2023-07-20T10:06:41.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 -- start start 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc0c815c8e0 0x7fc0c806aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0c80d0320 0x7fc0c80cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c80cd5e0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c806b020 con 0x7fc0c80d0320 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0d03ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c80cf800 con 0x7fc0c815c8e0 2023-07-20T10:06:41.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0c80d0320 0x7fc0c80cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc0c80d0320 0x7fc0c80cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55100/0 (socket says 172.21.15.82:55100) 2023-07-20T10:06:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 -- 172.21.15.82:0/3177344338 learned_addr learned my addr 172.21.15.82:0/3177344338 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0ce957640 1 --1- 172.21.15.82:0/3177344338 >> v1:172.21.15.82:6789/0 conn(0x7fc0c80d0ca0 0x7fc0c80cda70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55354/0 (socket says 172.21.15.82:55354) 2023-07-20T10:06:41.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0ce156640 1 --2- 172.21.15.82:0/3177344338 >> v2:172.21.15.183:3300/0 conn(0x7fc0c815c8e0 0x7fc0c806aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 -- 172.21.15.82:0/3177344338 >> v2:172.21.15.183:3300/0 conn(0x7fc0c815c8e0 msgr2=0x7fc0c806aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:41.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 --2- 172.21.15.82:0/3177344338 >> v2:172.21.15.183:3300/0 conn(0x7fc0c815c8e0 0x7fc0c806aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 -- 172.21.15.82:0/3177344338 >> v1:172.21.15.82:6789/0 conn(0x7fc0c80d0ca0 legacy=0x7fc0c80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.321+0000 7fc0cd955640 1 -- 172.21.15.82:0/3177344338 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c80cfae0 con 0x7fc0c80d0320 2023-07-20T10:06:41.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0cd955640 1 --2- 172.21.15.82:0/3177344338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0320 0x7fc0c80cef00 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80d37e0 tx=0x7fc0b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e7d6000b88435c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0cd154640 1 -- 172.21.15.82:0/3177344338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80aa610 con 0x7fc0c80d0320 2023-07-20T10:06:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0cd154640 1 -- 172.21.15.82:0/3177344338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80a6040 con 0x7fc0c80d0320 2023-07-20T10:06:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0cd154640 1 -- 172.21.15.82:0/3177344338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80aa990 con 0x7fc0c80d0320 2023-07-20T10:06:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 -- 172.21.15.82:0/3177344338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0320 msgr2=0x7fc0c80cef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/3177344338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0320 0x7fc0c80cef00 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0c80d37e0 tx=0x7fc0b801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 -- 172.21.15.82:0/3177344338 shutdown_connections 2023-07-20T10:06:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/3177344338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0320 0x7fc0c80cef00 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/3177344338 >> v2:172.21.15.183:3300/0 conn(0x7fc0c815c8e0 0x7fc0c806aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 -- 172.21.15.82:0/3177344338 >> 172.21.15.82:0/3177344338 conn(0x7fc0c8065d40 msgr2=0x7fc0c809b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 -- 172.21.15.82:0/3177344338 shutdown_connections 2023-07-20T10:06:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.325+0000 7fc0d03ba640 1 -- 172.21.15.82:0/3177344338 wait complete. 2023-07-20T10:06:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 Processor -- start 2023-07-20T10:06:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- start start 2023-07-20T10:06:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c80d0320 0x7fc0c80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 0x7fc0c814b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80b7490 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80b7770 con 0x7fc0c815c8e0 2023-07-20T10:06:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80b7a50 con 0x7fc0c80d0320 2023-07-20T10:06:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55102/0 (socket says 172.21.15.82:55102) 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 -- 172.21.15.82:0/2834139 learned_addr learned my addr 172.21.15.82:0/2834139 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0ce156640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c80d0320 0x7fc0c80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0ce957640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 0x7fc0c814b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 -- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c80d0320 msgr2=0x7fc0c80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c80d0320 0x7fc0c80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 -- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 msgr2=0x7fc0c814b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 0x7fc0c814b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:41.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 -- 172.21.15.82:0/2834139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80094d0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0ce957640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 0x7fc0c814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0cd955640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80190e0 tx=0x7fc0b801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80bd5f0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80bd750 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80bdb00 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c80d1640 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.329+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c814bcd0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c80b7f70 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc0b80b33f0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0beffd640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 0x7fc0ac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc0b811e8d0 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0ce156640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 0x7fc0ac068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:41.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.333+0000 7fc0ce156640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 0x7fc0ac068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400b930 tx=0x7fc0c4008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:41.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.337+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0c80b7f70 con 0x7fc0c80d0ca0 2023-07-20T10:06:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:41.489+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0c80b7f70 con 0x7fc0c80d0ca0 2023-07-20T10:06:42.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.437+0000 7fc0beffd640 1 -- 172.21.15.82:0/2834139 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc0c80b7f70 con 0x7fc0c80d0ca0 2023-07-20T10:06:42.419 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:06:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 msgr2=0x7fc0ac068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 0x7fc0ac068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400b930 tx=0x7fc0c4008040 comp rx=0 tx=0).stop 2023-07-20T10:06:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 msgr2=0x7fc0c814afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80190e0 tx=0x7fc0b801ad10 comp rx=0 tx=0).stop 2023-07-20T10:06:42.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 shutdown_connections 2023-07-20T10:06:42.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c815c8e0 0x7fc0c814b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c80d0ca0 0x7fc0c814afd0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc0ac0663a0 0x7fc0ac068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 --2- 172.21.15.82:0/2834139 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c80d0320 0x7fc0c80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 >> 172.21.15.82:0/2834139 conn(0x7fc0c8065d40 msgr2=0x7fc0c80b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:42.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 shutdown_connections 2023-07-20T10:06:42.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.441+0000 7fc0d03ba640 1 -- 172.21.15.82:0/2834139 wait complete. 2023-07-20T10:06:42.447 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:06:42.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 Processor -- start 2023-07-20T10:06:42.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 -- start start 2023-07-20T10:06:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efeac0cd5b0 0x7efeac06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac0ce060 con 0x7efeac0d0b10 2023-07-20T10:06:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac06c6a0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeb1796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0ce340 con 0x7efeac15c720 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efeac0cd5b0 0x7efeac06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efeac0cd5b0 0x7efeac06ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55104/0 (socket says 172.21.15.82:55104) 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 -- 172.21.15.82:0/457828301 learned_addr learned my addr 172.21.15.82:0/457828301 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeaaffd640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 -- 172.21.15.82:0/457828301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 msgr2=0x7efeac0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:42.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 -- 172.21.15.82:0/457828301 >> v1:172.21.15.183:6789/0 conn(0x7efeac0d0b10 legacy=0x7efeac0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.617+0000 7efeab7fe640 1 -- 172.21.15.82:0/457828301 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0ce620 con 0x7efeac0cd5b0 2023-07-20T10:06:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeab7fe640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac06ae90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693c9d116fe70fc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efea9ffb640 1 -- 172.21.15.82:0/457828301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40a57f0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efea9ffb640 1 -- 172.21.15.82:0/457828301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40a5950 con 0x7efeac0cd5b0 2023-07-20T10:06:42.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efea9ffb640 1 -- 172.21.15.82:0/457828301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea40a5ce0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 -- 172.21.15.82:0/457828301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 msgr2=0x7efeac06ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac06ae90 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea401ca10 comp rx=0 tx=0).stop 2023-07-20T10:06:42.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 -- 172.21.15.82:0/457828301 shutdown_connections 2023-07-20T10:06:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac06ae90 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 --2- 172.21.15.82:0/457828301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 -- 172.21.15.82:0/457828301 >> 172.21.15.82:0/457828301 conn(0x7efeac065310 msgr2=0x7efeac065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 -- 172.21.15.82:0/457828301 shutdown_connections 2023-07-20T10:06:42.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.621+0000 7efeb1796640 1 -- 172.21.15.82:0/457828301 wait complete. 2023-07-20T10:06:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 Processor -- start 2023-07-20T10:06:42.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- start start 2023-07-20T10:06:42.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeac0d0b10 0x7efeac153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0c50d0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0c4450 con 0x7efeac0d0b10 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0c4730 con 0x7efeac15c720 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55120/0 (socket says 172.21.15.82:55120) 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 -- 172.21.15.82:0/2810272571 learned_addr learned my addr 172.21.15.82:0/2810272571 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaa7fc640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeac0d0b10 0x7efeac153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeab7fe640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 -- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 msgr2=0x7efeac154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 -- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeac0d0b10 msgr2=0x7efeac153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeac0d0b10 0x7efeac153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 -- 172.21.15.82:0/2810272571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009b30 con 0x7efeac0cd5b0 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeaaffd640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d7d0 tx=0x7efe9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00b6c0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c00b860 con 0x7efeac0cd5b0 2023-07-20T10:06:42.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac0c4a10 con 0x7efeac0cd5b0 2023-07-20T10:06:42.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00bc10 con 0x7efeac0cd5b0 2023-07-20T10:06:42.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.625+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac154a40 con 0x7efeac0cd5b0 2023-07-20T10:06:42.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac0c5210 con 0x7efeac0cd5b0 2023-07-20T10:06:42.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe9c01e460 con 0x7efeac0cd5b0 2023-07-20T10:06:42.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efe937fe640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 0x7efe98068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:42.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5580+0+0 (secure 0 0 0) 0x7efe9c0840c0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efeaa7fc640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 0x7efe98068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:42.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.629+0000 7efeaa7fc640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 0x7efe98068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efeac1f8f20 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:42.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.633+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe9c0551e0 con 0x7efeac0cd5b0 2023-07-20T10:06:42.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:42.785+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efeac04da30 con 0x7efeac0cd5b0 2023-07-20T10:06:43.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.445+0000 7efe937fe640 1 -- 172.21.15.82:0/2810272571 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe9c054d70 con 0x7efeac0cd5b0 2023-07-20T10:06:43.427 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:06:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 msgr2=0x7efe98068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:43.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 0x7efe98068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efeac1f8f20 tx=0x7efea0009040 comp rx=0 tx=0).stop 2023-07-20T10:06:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 msgr2=0x7efeac0b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d7d0 tx=0x7efe9c00dc90 comp rx=0 tx=0).stop 2023-07-20T10:06:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 shutdown_connections 2023-07-20T10:06:43.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7efe980663a0 0x7efe98068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efeac15c720 0x7efeac154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efeac0d0b10 0x7efeac153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 --2- 172.21.15.82:0/2810272571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efeac0cd5b0 0x7efeac0b18c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.457+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 >> 172.21.15.82:0/2810272571 conn(0x7efeac065310 msgr2=0x7efeac159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.461+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 shutdown_connections 2023-07-20T10:06:43.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.461+0000 7efeb1796640 1 -- 172.21.15.82:0/2810272571 wait complete. 2023-07-20T10:06:43.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:06:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 Processor -- start 2023-07-20T10:06:43.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 -- start start 2023-07-20T10:06:43.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f1c159450 0x7f2f1c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c159830 0x7f2f1c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2f1c0cc3e0 0x7f2f1c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c0cce90 con 0x7f2f1c159450 2023-07-20T10:06:43.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c0cc8d0 con 0x7f2f1c0cc3e0 2023-07-20T10:06:43.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f24596640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0ccbb0 con 0x7f2f1c159830 2023-07-20T10:06:43.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f1c159450 0x7f2f1c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f1c159450 0x7f2f1c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40948/0 (socket says 172.21.15.82:40948) 2023-07-20T10:06:43.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 -- 172.21.15.82:0/2148969103 learned_addr learned my addr 172.21.15.82:0/2148969103 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:43.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22b33640 1 --2- 172.21.15.82:0/2148969103 >> v2:172.21.15.183:3300/0 conn(0x7f2f1c0cc3e0 0x7f2f1c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f21b31640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c159830 0x7f2f1c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 -- 172.21.15.82:0/2148969103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c159830 msgr2=0x7f2f1c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:43.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c159830 0x7f2f1c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 -- 172.21.15.82:0/2148969103 >> v2:172.21.15.183:3300/0 conn(0x7f2f1c0cc3e0 msgr2=0x7f2f1c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:43.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 --2- 172.21.15.82:0/2148969103 >> v2:172.21.15.183:3300/0 conn(0x7f2f1c0cc3e0 0x7f2f1c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.633+0000 7f2f22332640 1 -- 172.21.15.82:0/2148969103 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c159cc0 con 0x7f2f1c159450 2023-07-20T10:06:43.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f22332640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c159450 0x7f2f1c15a4c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0ce1b0 tx=0x7f2f1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b760b6f27f95c2e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:43.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f21330640 1 -- 172.21.15.82:0/2148969103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ac600 con 0x7f2f1c159450 2023-07-20T10:06:43.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f21330640 1 -- 172.21.15.82:0/2148969103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f180a8050 con 0x7f2f1c159450 2023-07-20T10:06:43.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f21330640 1 -- 172.21.15.82:0/2148969103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180ac980 con 0x7f2f1c159450 2023-07-20T10:06:43.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 -- 172.21.15.82:0/2148969103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c159450 msgr2=0x7f2f1c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:43.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c159450 0x7f2f1c15a4c0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0ce1b0 tx=0x7f2f1801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 -- 172.21.15.82:0/2148969103 shutdown_connections 2023-07-20T10:06:43.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 --2- 172.21.15.82:0/2148969103 >> v2:172.21.15.183:3300/0 conn(0x7f2f1c0cc3e0 0x7f2f1c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c159830 0x7f2f1c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 --2- 172.21.15.82:0/2148969103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c159450 0x7f2f1c15a4c0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 -- 172.21.15.82:0/2148969103 >> 172.21.15.82:0/2148969103 conn(0x7f2f1c0cad50 msgr2=0x7f2f1c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:43.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 -- 172.21.15.82:0/2148969103 shutdown_connections 2023-07-20T10:06:43.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.637+0000 7f2f24596640 1 -- 172.21.15.82:0/2148969103 wait complete. 2023-07-20T10:06:43.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 Processor -- start 2023-07-20T10:06:43.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- start start 2023-07-20T10:06:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c0cc3e0 0x7f2f1c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1c159450 0x7f2f1c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c152aa0 con 0x7f2f1c1520b0 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c1504a0 con 0x7f2f1c159450 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0aef70 con 0x7f2f1c0cc3e0 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40958/0 (socket says 172.21.15.82:40958) 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 -- 172.21.15.82:0/2036407000 learned_addr learned my addr 172.21.15.82:0/2036407000 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f21b31640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1c159450 0x7f2f1c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22332640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c0cc3e0 0x7f2f1c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 -- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c0cc3e0 msgr2=0x7f2f1c0b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c0cc3e0 0x7f2f1c0b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 -- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1c159450 msgr2=0x7f2f1c157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1c159450 0x7f2f1c157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 -- 172.21.15.82:0/2036407000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180094d0 con 0x7f2f1c1520b0 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f22b33640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007e30 tx=0x7f2f1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14014420 con 0x7f2f1c1520b0 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f14014580 con 0x7f2f1c1520b0 2023-07-20T10:06:43.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14014930 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1c0ae9b0 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.641+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c150130 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c150650 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f14014a90 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f12ffd640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 0x7f2f00068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2f14084f70 con 0x7f2f1c1520b0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f22332640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 0x7f2f00068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.645+0000 7f2f22332640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 0x7f2f00068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f180ae000 tx=0x7f2f180a7000 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:43.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.649+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f14055e60 con 0x7f2f1c1520b0 2023-07-20T10:06:43.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:43.825+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2f1c150610 con 0x7f2f1c1520b0 2023-07-20T10:06:44.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.477+0000 7f2f12ffd640 1 -- 172.21.15.82:0/2036407000 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2f14009960 con 0x7f2f1c1520b0 2023-07-20T10:06:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 13 and data pool 14 2023-07-20T10:06:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 msgr2=0x7f2f00068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 0x7f2f00068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f180ae000 tx=0x7f2f180a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 msgr2=0x7f2f1c152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2f14007e30 tx=0x7f2f1400e4b0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 shutdown_connections 2023-07-20T10:06:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f1c1520b0 0x7f2f1c152560 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f1c159450 0x7f2f1c157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f2f000663d0 0x7f2f00068890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 --2- 172.21.15.82:0/2036407000 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f1c0cc3e0 0x7f2f1c0b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 >> 172.21.15.82:0/2036407000 conn(0x7f2f1c0cad50 msgr2=0x7f2f1c15ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 shutdown_connections 2023-07-20T10:06:44.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.485+0000 7f2f24596640 1 -- 172.21.15.82:0/2036407000 wait complete. 2023-07-20T10:06:44.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 Processor -- start 2023-07-20T10:06:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 -- start start 2023-07-20T10:06:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f33b415dbb0 0x7f33b40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b40ad810 con 0x7f33b41596b0 2023-07-20T10:06:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b415d0d0 con 0x7f33b40b2a90 2023-07-20T10:06:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33bafd2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b415e000 con 0x7f33b415dbb0 2023-07-20T10:06:44.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33b8d6e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f33b41596b0 0x7f33b40b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49520/0 (socket says 172.21.15.82:49520) 2023-07-20T10:06:44.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33b8d6e640 1 -- 172.21.15.82:0/3264347598 learned_addr learned my addr 172.21.15.82:0/3264347598 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:44.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.649+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583852170 0 0) 0x7f33b40ad810 con 0x7f33b41596b0 2023-07-20T10:06:44.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 --2- 172.21.15.82:0/3264347598 >> v2:172.21.15.183:3300/0 conn(0x7f33b415dbb0 0x7f33b40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f339c003530 con 0x7f33b41596b0 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1272541064 0 0) 0x7f339c003530 con 0x7f33b41596b0 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 >> v2:172.21.15.183:3300/0 conn(0x7f33b415dbb0 msgr2=0x7f33b40cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 --2- 172.21.15.82:0/3264347598 >> v2:172.21.15.183:3300/0 conn(0x7f33b415dbb0 0x7f33b40cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 >> v1:172.21.15.183:6789/0 conn(0x7f33b40b2a90 legacy=0x7f33b40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b415d3b0 con 0x7f33b41596b0 2023-07-20T10:06:44.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f33b0001680 con 0x7f33b41596b0 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 >> v1:172.21.15.82:6789/0 conn(0x7f33b41596b0 legacy=0x7f33b40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f339c003980 0x7f339c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c004380 0x7f339c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 0x7f339c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b415e000 con 0x7f339c005050 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00e1c0 con 0x7f339c003980 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c00e380 con 0x7f339c004380 2023-07-20T10:06:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 0x7f339c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b8d6e640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f339c003980 0x7f339c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33abfff640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c004380 0x7f339c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 -- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c004380 msgr2=0x7f339c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c004380 0x7f339c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 -- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f339c003980 msgr2=0x7f339c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f339c003980 0x7f339c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 -- 172.21.15.82:0/3264347598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c003530 con 0x7f339c005050 2023-07-20T10:06:44.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33abfff640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c004380 0x7f339c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.653+0000 7f33b956f640 1 -- 172.21.15.82:0/3264347598 reap_dead start 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33b956f640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 0x7f339c00dba0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009fc0 tx=0x7f33ac01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a1adc648abe664 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac003ba0 con 0x7f339c005050 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00f040 con 0x7f339c005050 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33ab7fe640 1 -- 172.21.15.82:0/3264347598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0a59a0 con 0x7f339c005050 2023-07-20T10:06:44.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 msgr2=0x7f339c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 0x7f339c00dba0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009fc0 tx=0x7f33ac01cca0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- 172.21.15.82:0/3264347598 shutdown_connections 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 --2- 172.21.15.82:0/3264347598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f339c005050 0x7f339c00dba0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- 172.21.15.82:0/3264347598 >> 172.21.15.82:0/3264347598 conn(0x7f33b40cada0 msgr2=0x7f33b40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- 172.21.15.82:0/3264347598 shutdown_connections 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- 172.21.15.82:0/3264347598 wait complete. 2023-07-20T10:06:44.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 Processor -- start 2023-07-20T10:06:44.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- start start 2023-07-20T10:06:44.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c005050 0x7f33b4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 0x7f33b40c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b40cce40 con 0x7f33b4070890 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4155ce0 con 0x7f33b4155860 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.657+0000 7f33bafd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b4071ba0 con 0x7f339c005050 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40990/0 (socket says 172.21.15.82:40990) 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 -- 172.21.15.82:0/602946861 learned_addr learned my addr 172.21.15.82:0/602946861 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:44.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33b8d6e640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c005050 0x7f33b4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33b956f640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 0x7f33b40c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 -- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c005050 msgr2=0x7f33b4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c005050 0x7f33b4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 -- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 msgr2=0x7f33b40c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 0x7f33b40c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 -- 172.21.15.82:0/602946861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b406f880 con 0x7f33b4070890 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33b956f640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 0x7f33b40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:44.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33abfff640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e5d0 tx=0x7f33a400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40052e0 con 0x7f33b4070890 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4005440 con 0x7f33b4070890 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4003820 con 0x7f33b4070890 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b41540e0 con 0x7f33b4070890 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b406fdb0 con 0x7f33b4070890 2023-07-20T10:06:44.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b4073c70 con 0x7f33b4070890 2023-07-20T10:06:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.661+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f33a4003980 con 0x7f33b4070890 2023-07-20T10:06:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.665+0000 7f33a97fa640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 0x7f33a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.665+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33a4083d80 con 0x7f33b4070890 2023-07-20T10:06:44.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.665+0000 7f33b8d6e640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 0x7f33a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.665+0000 7f33b8d6e640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 0x7f33a0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001060 tx=0x7f33b0009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.669+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33a4051060 con 0x7f33b4070890 2023-07-20T10:06:44.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.817+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33b40cbbd0 con 0x7f33b4070890 2023-07-20T10:06:44.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.817+0000 7f33a97fa640 1 -- 172.21.15.82:0/602946861 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f33a4081790 con 0x7f33b4070890 2023-07-20T10:06:44.799 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:44.799 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":106,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:43.832408+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:44.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 msgr2=0x7f33a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 0x7f33a0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001060 tx=0x7f33b0009040 comp rx=0 tx=0).stop 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 msgr2=0x7f33b4155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e5d0 tx=0x7f33a400ea90 comp rx=0 tx=0).stop 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 shutdown_connections 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f33b4155860 0x7f33b40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33b4070890 0x7f33b4155320 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f33a00663a0 0x7f33a0068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 --2- 172.21.15.82:0/602946861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f339c005050 0x7f33b4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 >> 172.21.15.82:0/602946861 conn(0x7f33b40cada0 msgr2=0x7f33b406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:44.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 shutdown_connections 2023-07-20T10:06:44.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.821+0000 7f33bafd2640 1 -- 172.21.15.82:0/602946861 wait complete. 2023-07-20T10:06:44.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:44.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.977+0000 7f9f09e6d640 1 Processor -- start 2023-07-20T10:06:44.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.977+0000 7f9f09e6d640 1 -- start start 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f09e6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f041596b0 0x7f9f0415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f09e6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f040b2a90 0x7f9f040ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f09e6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040ccd60 con 0x7f9f040cc900 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f09e6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f040ad600 con 0x7f9f040b2a90 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f09e6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040ad810 con 0x7f9f041596b0 2023-07-20T10:06:44.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f040b2a90 0x7f9f040ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9f040b2a90 0x7f9f040ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40996/0 (socket says 172.21.15.82:40996) 2023-07-20T10:06:44.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 -- 172.21.15.82:0/2895835481 learned_addr learned my addr 172.21.15.82:0/2895835481 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:44.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f037fe640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f041596b0 0x7f9f0415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 -- 172.21.15.82:0/2895835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f041596b0 msgr2=0x7f9f0415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:44.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f041596b0 0x7f9f0415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 -- 172.21.15.82:0/2895835481 >> v1:172.21.15.183:6789/0 conn(0x7f9f040cc900 legacy=0x7f9f040b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.981+0000 7f9f03fff640 1 -- 172.21.15.82:0/2895835481 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0415d0d0 con 0x7f9f040b2a90 2023-07-20T10:06:44.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f03fff640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040b2a90 0x7f9f040ad0c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00d150 tx=0x7f9efc01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b01dbcba203fedc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f02ffd640 1 -- 172.21.15.82:0/2895835481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00b2d0 con 0x7f9f040b2a90 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f02ffd640 1 -- 172.21.15.82:0/2895835481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00b430 con 0x7f9f040b2a90 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f02ffd640 1 -- 172.21.15.82:0/2895835481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0a7cd0 con 0x7f9f040b2a90 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2895835481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040b2a90 msgr2=0x7f9f040ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040b2a90 0x7f9f040ad0c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00d150 tx=0x7f9efc01ebe0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2895835481 shutdown_connections 2023-07-20T10:06:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040b2a90 0x7f9f040ad0c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2895835481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f041596b0 0x7f9f0415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2895835481 >> 172.21.15.82:0/2895835481 conn(0x7f9f040cada0 msgr2=0x7f9f040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2895835481 shutdown_connections 2023-07-20T10:06:44.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2895835481 wait complete. 2023-07-20T10:06:44.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 Processor -- start 2023-07-20T10:06:44.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.985+0000 7f9f09e6d640 1 -- start start 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f040b2a90 0x7f9f040c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f041596b0 0x7f9f040c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040c2540 con 0x7f9f040cc900 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040c4d50 con 0x7f9f041596b0 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040c27b0 con 0x7f9f040b2a90 2023-07-20T10:06:44.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41008/0 (socket says 172.21.15.82:41008) 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 -- 172.21.15.82:0/2434394721 learned_addr learned my addr 172.21.15.82:0/2434394721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f037fe640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f040b2a90 0x7f9f040c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f03fff640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f041596b0 0x7f9f040c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 -- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f040b2a90 msgr2=0x7f9f040c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f040b2a90 0x7f9f040c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 -- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f041596b0 msgr2=0x7f9f040c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f041596b0 0x7f9f040c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 -- 172.21.15.82:0/2434394721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc00bd40 con 0x7f9f040cc900 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9efaffd640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c500 tx=0x7f9ef400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4005220 con 0x7f9f040cc900 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4005380 con 0x7f9f040cc900 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4007270 con 0x7f9f040cc900 2023-07-20T10:06:44.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040c7a80 con 0x7f9f040cc900 2023-07-20T10:06:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040c8040 con 0x7f9f040cc900 2023-07-20T10:06:44.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f040c2920 con 0x7f9f040cc900 2023-07-20T10:06:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.989+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ef40073d0 con 0x7f9f040cc900 2023-07-20T10:06:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.993+0000 7f9f00ff9640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 0x7f9ee4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.993+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ef4083740 con 0x7f9f040cc900 2023-07-20T10:06:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.993+0000 7f9f037fe640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 0x7f9ee4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.993+0000 7f9f037fe640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 0x7f9ee4068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009a50 tx=0x7f9eec008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:44.993+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ef4050ac0 con 0x7f9f040cc900 2023-07-20T10:06:45.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f040c8230 con 0x7f9f040cc900 2023-07-20T10:06:45.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f00ff9640 1 -- 172.21.15.82:0/2434394721 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18294 (secure 0 0 0) 0x7f9ef40540e0 con 0x7f9f040cc900 2023-07-20T10:06:45.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:45.127 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":106,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:43.832408+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 msgr2=0x7f9ee4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 0x7f9ee4068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009a50 tx=0x7f9eec008040 comp rx=0 tx=0).stop 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 msgr2=0x7f9f04157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f9ef400c500 tx=0x7f9ef400c9c0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 shutdown_connections 2023-07-20T10:06:45.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.145+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f041596b0 0x7f9f040c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f040cc900 0x7f9f04157220 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ee40663a0 0x7f9ee4068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 --2- 172.21.15.82:0/2434394721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9f040b2a90 0x7f9f040c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 >> 172.21.15.82:0/2434394721 conn(0x7f9f040cada0 msgr2=0x7f9f04163b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 shutdown_connections 2023-07-20T10:06:45.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.149+0000 7f9f09e6d640 1 -- 172.21.15.82:0/2434394721 wait complete. 2023-07-20T10:06:45.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:06:45.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 Processor -- start 2023-07-20T10:06:45.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 -- start start 2023-07-20T10:06:45.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc160ba0 0x7fdfcc0c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0c9370 con 0x7fdfcc0c8e60 2023-07-20T10:06:45.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c9650 con 0x7fdfcc0b0460 2023-07-20T10:06:45.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd3c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1619c0 con 0x7fdfcc160ba0 2023-07-20T10:06:45.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd11cf640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfcc0c8e60 0x7fdfcc0afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49528/0 (socket says 172.21.15.82:49528) 2023-07-20T10:06:45.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41014/0 (socket says 172.21.15.82:41014) 2023-07-20T10:06:45.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd11cf640 1 -- 172.21.15.82:0/1618080043 learned_addr learned my addr 172.21.15.82:0/1618080043 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd19d0640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc160ba0 0x7fdfcc0c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 -- 172.21.15.82:0/1618080043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc160ba0 msgr2=0x7fdfcc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc160ba0 0x7fdfcc0c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 -- 172.21.15.82:0/1618080043 >> v1:172.21.15.82:6789/0 conn(0x7fdfcc0c8e60 legacy=0x7fdfcc0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd21d1640 1 -- 172.21.15.82:0/1618080043 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc161300 con 0x7fdfcc0b0460 2023-07-20T10:06:45.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.309+0000 7fdfd09ce640 1 -- 172.21.15.82:0/1618080043 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020528644 0 0) 0x7fdfcc0c9370 con 0x7fdfcc0c8e60 2023-07-20T10:06:45.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd21d1640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009d90 tx=0x7fdfc401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bc61c8427e3775 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:45.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd09ce640 1 -- 172.21.15.82:0/1618080043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40a5a00 con 0x7fdfcc0b0460 2023-07-20T10:06:45.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd09ce640 1 -- 172.21.15.82:0/1618080043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40a5b60 con 0x7fdfcc0b0460 2023-07-20T10:06:45.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd09ce640 1 -- 172.21.15.82:0/1618080043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40ad440 con 0x7fdfcc0b0460 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1618080043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 msgr2=0x7fdfcc0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009d90 tx=0x7fdfc401c920 comp rx=0 tx=0).stop 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1618080043 shutdown_connections 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc0cbea0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1618080043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc160ba0 0x7fdfcc0c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1618080043 >> 172.21.15.82:0/1618080043 conn(0x7fdfcc0cad50 msgr2=0x7fdfcc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1618080043 shutdown_connections 2023-07-20T10:06:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.313+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1618080043 wait complete. 2023-07-20T10:06:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 Processor -- start 2023-07-20T10:06:45.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- start start 2023-07-20T10:06:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 0x7fdfcc152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc160ba0 0x7fdfcc1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1649b0 con 0x7fdfcc0b0460 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc153f30 con 0x7fdfcc160ba0 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1646d0 con 0x7fdfcc0c8e60 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41030/0 (socket says 172.21.15.82:41030) 2023-07-20T10:06:45.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 -- 172.21.15.82:0/1144963077 learned_addr learned my addr 172.21.15.82:0/1144963077 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:45.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd11cf640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 0x7fdfcc152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd21d1640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc160ba0 0x7fdfcc1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 -- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 msgr2=0x7fdfcc152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 0x7fdfcc152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 -- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc160ba0 msgr2=0x7fdfcc1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc160ba0 0x7fdfcc1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:45.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 -- 172.21.15.82:0/1144963077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009a70 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd11cf640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 0x7fdfcc152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd19d0640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800d5f0 tx=0x7fdfc800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80125f0 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8012750 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8012b00 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc1538e0 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc1533c0 con 0x7fdfcc0b0460 2023-07-20T10:06:45.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.317+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc153740 con 0x7fdfcc0b0460 2023-07-20T10:06:45.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.321+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfc8012c60 con 0x7fdfcc0b0460 2023-07-20T10:06:45.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.321+0000 7fdfc27fc640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 0x7fdfb0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:45.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.321+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfc8084360 con 0x7fdfcc0b0460 2023-07-20T10:06:45.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.321+0000 7fdfd11cf640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 0x7fdfb0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:45.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.321+0000 7fdfd11cf640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 0x7fdfb0068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc158800 tx=0x7fdfbc009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:45.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.325+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfcc153740 con 0x7fdfcc0b0460 2023-07-20T10:06:45.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:45.509+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdfcc153740 con 0x7fdfcc0b0460 2023-07-20T10:06:46.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfc27fc640 1 -- 172.21.15.82:0/1144963077 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdfcc153740 con 0x7fdfcc0b0460 2023-07-20T10:06:46.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 msgr2=0x7fdfb0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 0x7fdfb0068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc158800 tx=0x7fdfbc009040 comp rx=0 tx=0).stop 2023-07-20T10:06:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 msgr2=0x7fdfcc164040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fdfc800d5f0 tx=0x7fdfc800dab0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.477+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 shutdown_connections 2023-07-20T10:06:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfcc160ba0 0x7fdfcc1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdfb00663a0 0x7fdfb0068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfcc0c8e60 0x7fdfcc152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 --2- 172.21.15.82:0/1144963077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfcc0b0460 0x7fdfcc164040 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 >> 172.21.15.82:0/1144963077 conn(0x7fdfcc0cad50 msgr2=0x7fdfcc06ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 shutdown_connections 2023-07-20T10:06:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.481+0000 7fdfd3c34640 1 -- 172.21.15.82:0/1144963077 wait complete. 2023-07-20T10:06:46.483 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:06:46.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:06:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 Processor -- start 2023-07-20T10:06:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 -- start start 2023-07-20T10:06:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f172415c7e0 0x7f172406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f17240b2230 0x7f1724160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17240caf00 0x7f17240cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240b2670 con 0x7f17240caf00 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240c9190 con 0x7f17240b2230 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1729848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240cb8d0 con 0x7f172415c7e0 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17240caf00 0x7f17240cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17240caf00 0x7f17240cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41036/0 (socket says 172.21.15.82:41036) 2023-07-20T10:06:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 -- 172.21.15.82:0/1790465227 learned_addr learned my addr 172.21.15.82:0/1790465227 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f1722ffd640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f172415c7e0 0x7f172406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f171a7fc640 1 --2- 172.21.15.82:0/1790465227 >> v2:172.21.15.183:3300/0 conn(0x7f17240b2230 0x7f1724160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 -- 172.21.15.82:0/1790465227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f172415c7e0 msgr2=0x7f172406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f172415c7e0 0x7f172406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 -- 172.21.15.82:0/1790465227 >> v2:172.21.15.183:3300/0 conn(0x7f17240b2230 msgr2=0x7f1724160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 --2- 172.21.15.82:0/1790465227 >> v2:172.21.15.183:3300/0 conn(0x7f17240b2230 0x7f1724160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.649+0000 7f17237fe640 1 -- 172.21.15.82:0/1790465227 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172415cbc0 con 0x7f17240caf00 2023-07-20T10:06:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f17237fe640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17240caf00 0x7f17240cb390 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1724065da0 tx=0x7f171c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efac70ae858ddab server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f17227fc640 1 -- 172.21.15.82:0/1790465227 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0aa5f0 con 0x7f17240caf00 2023-07-20T10:06:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f17227fc640 1 -- 172.21.15.82:0/1790465227 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0aa750 con 0x7f17240caf00 2023-07-20T10:06:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f17227fc640 1 -- 172.21.15.82:0/1790465227 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0aaae0 con 0x7f17240caf00 2023-07-20T10:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 -- 172.21.15.82:0/1790465227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17240caf00 msgr2=0x7f17240cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17240caf00 0x7f17240cb390 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1724065da0 tx=0x7f171c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 -- 172.21.15.82:0/1790465227 shutdown_connections 2023-07-20T10:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 --2- 172.21.15.82:0/1790465227 >> v2:172.21.15.183:3300/0 conn(0x7f17240b2230 0x7f1724160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17240caf00 0x7f17240cb390 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 --2- 172.21.15.82:0/1790465227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f172415c7e0 0x7f172406cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 -- 172.21.15.82:0/1790465227 >> 172.21.15.82:0/1790465227 conn(0x7f1724065710 msgr2=0x7f1724069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 -- 172.21.15.82:0/1790465227 shutdown_connections 2023-07-20T10:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.653+0000 7f1729848640 1 -- 172.21.15.82:0/1790465227 wait complete. 2023-07-20T10:06:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 Processor -- start 2023-07-20T10:06:46.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- start start 2023-07-20T10:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17240b2230 0x7f172415af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17240caf00 0x7f172415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724155520 con 0x7f172415c7e0 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1724155800 con 0x7f17240caf00 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c2200 con 0x7f17240b2230 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41046/0 (socket says 172.21.15.82:41046) 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 -- 172.21.15.82:0/986816722 learned_addr learned my addr 172.21.15.82:0/986816722 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f171a7fc640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17240caf00 0x7f172415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1722ffd640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17240b2230 0x7f172415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 -- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17240b2230 msgr2=0x7f172415af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17240b2230 0x7f172415af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 -- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17240caf00 msgr2=0x7f172415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17240caf00 0x7f172415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:46.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 -- 172.21.15.82:0/986816722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c0094d0 con 0x7f172415c7e0 2023-07-20T10:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f17237fe640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ac040 tx=0x7f171c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0bd5f0 con 0x7f172415c7e0 2023-07-20T10:06:46.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0bd750 con 0x7f172415c7e0 2023-07-20T10:06:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17240c24e0 con 0x7f172415c7e0 2023-07-20T10:06:46.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0bdb00 con 0x7f172415c7e0 2023-07-20T10:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.657+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17241551f0 con 0x7f172415c7e0 2023-07-20T10:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172404da30 con 0x7f172415c7e0 2023-07-20T10:06:46.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f171c0b33f0 con 0x7f172415c7e0 2023-07-20T10:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1720ff9640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 0x7f1704068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f171c0a7070 con 0x7f172415c7e0 2023-07-20T10:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1722ffd640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 0x7f1704068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:46.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.661+0000 7f1722ffd640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 0x7f1704068890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17240cd550 tx=0x7f1714008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:46.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.665+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f171c0ebc60 con 0x7f172415c7e0 2023-07-20T10:06:46.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:46.841+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f17240b1590 con 0x7f172415c7e0 2023-07-20T10:06:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.477+0000 7f1720ff9640 1 -- 172.21.15.82:0/986816722 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v50) v1 ==== 122+0+0 (secure 0 0 0) 0x7f171c0ef280 con 0x7f172415c7e0 2023-07-20T10:06:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 msgr2=0x7f1704068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 0x7f1704068890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17240cd550 tx=0x7f1714008040 comp rx=0 tx=0).stop 2023-07-20T10:06:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 msgr2=0x7f1724153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ac040 tx=0x7f171c01ad10 comp rx=0 tx=0).stop 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 shutdown_connections 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f172415c7e0 0x7f1724153c40 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17240caf00 0x7f172415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f17040663d0 0x7f1704068890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 --2- 172.21.15.82:0/986816722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17240b2230 0x7f172415af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 >> 172.21.15.82:0/986816722 conn(0x7f1724065710 msgr2=0x7f17240cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:47.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 shutdown_connections 2023-07-20T10:06:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.481+0000 7f1729848640 1 -- 172.21.15.82:0/986816722 wait complete. 2023-07-20T10:06:47.485 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:06:47.486 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:47.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 Processor -- start 2023-07-20T10:06:47.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 -- start start 2023-07-20T10:06:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3edc0afda0 0x7f3edc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 0x7f3edc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3edc0b06c0 con 0x7f3edc15a8e0 2023-07-20T10:06:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3edc0b3160 con 0x7f3edc0afda0 2023-07-20T10:06:47.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee27ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc0b12a0 con 0x7f3edc0b2060 2023-07-20T10:06:47.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3edc15a8e0 0x7f3edc0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49534/0 (socket says 172.21.15.82:49534) 2023-07-20T10:06:47.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edb7fe640 1 -- 172.21.15.82:0/3409924482 learned_addr learned my addr 172.21.15.82:0/3409924482 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:47.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee0d57640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 0x7f3edc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3409924482 >> v2:172.21.15.183:3300/0 conn(0x7f3edc0afda0 0x7f3edc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edaffd640 1 -- 172.21.15.82:0/3409924482 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197911993 0 0) 0x7f3edc0b06c0 con 0x7f3edc15a8e0 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edaffd640 1 -- 172.21.15.82:0/3409924482 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec4003530 con 0x7f3edc15a8e0 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edbfff640 1 -- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 msgr2=0x7f3edc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 0x7f3edc0b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edbfff640 1 -- 172.21.15.82:0/3409924482 >> v1:172.21.15.82:6789/0 conn(0x7f3edc15a8e0 legacy=0x7f3edc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3edbfff640 1 -- 172.21.15.82:0/3409924482 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0b1580 con 0x7f3edc0afda0 2023-07-20T10:06:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.649+0000 7f3ee0d57640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 0x7f3edc0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc0ca6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097c0 tx=0x7f3ecc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec36c5624f16bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3edaffd640 1 -- 172.21.15.82:0/3409924482 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0ab600 con 0x7f3edc0afda0 2023-07-20T10:06:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3edaffd640 1 -- 172.21.15.82:0/3409924482 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0a7050 con 0x7f3edc0afda0 2023-07-20T10:06:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3edaffd640 1 -- 172.21.15.82:0/3409924482 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc0ab980 con 0x7f3edc0afda0 2023-07-20T10:06:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 msgr2=0x7f3edc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc0ca6b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0097c0 tx=0x7f3ecc01c330 comp rx=0 tx=0).stop 2023-07-20T10:06:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3409924482 shutdown_connections 2023-07-20T10:06:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc0b2060 0x7f3edc0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3409924482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc0ca6b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3409924482 >> 172.21.15.82:0/3409924482 conn(0x7f3edc0cada0 msgr2=0x7f3edc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3409924482 shutdown_connections 2023-07-20T10:06:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.653+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3409924482 wait complete. 2023-07-20T10:06:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 Processor -- start 2023-07-20T10:06:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- start start 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 0x7f3edc0cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc155bd0 con 0x7f3edc0b2060 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc15b7f0 con 0x7f3edc0afda0 2023-07-20T10:06:47.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc15d1f0 con 0x7f3edc15a8e0 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41056/0 (socket says 172.21.15.82:41056) 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 -- 172.21.15.82:0/3994148855 learned_addr learned my addr 172.21.15.82:0/3994148855 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee0d57640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 0x7f3edc0cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 -- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 msgr2=0x7f3edc0cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 0x7f3edc0cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 -- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 msgr2=0x7f3edc15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 -- 172.21.15.82:0/3994148855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed4009a70 con 0x7f3edc0b2060 2023-07-20T10:06:47.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee0d57640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 0x7f3edc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:47.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3edb7fe640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c390 tx=0x7f3ed000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:47.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0005cf0 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed0005e70 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ecc009420 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00072f0 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc15d7b0 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.657+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3edc155d80 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.661+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3ed0007450 con 0x7f3edc0b2060 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.661+0000 7f3ed8ff9640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 0x7f3ec8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.661+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ed00834f0 con 0x7f3edc0b2060 2023-07-20T10:06:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.661+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 0x7f3ec8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.661+0000 7f3edbfff640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 0x7f3ec8068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0ad000 tx=0x7f3ecc0a6000 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.665+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3edc155d80 con 0x7f3edc0b2060 2023-07-20T10:06:47.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.841+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3edc073c70 con 0x7f3edc0b2060 2023-07-20T10:06:47.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ed8ff9640 1 -- 172.21.15.82:0/3994148855 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f3ed0054310 con 0x7f3edc0b2060 2023-07-20T10:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:06:47.825 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:06:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 msgr2=0x7f3ec8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 0x7f3ec8068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0ad000 tx=0x7f3ecc0a6000 comp rx=0 tx=0).stop 2023-07-20T10:06:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 msgr2=0x7f3edc164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c390 tx=0x7f3ed000c850 comp rx=0 tx=0).stop 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 shutdown_connections 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3ec80663a0 0x7f3ec8068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3edc15a8e0 0x7f3edc0cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3edc0b2060 0x7f3edc164ca0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 --2- 172.21.15.82:0/3994148855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3edc0afda0 0x7f3edc15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 >> 172.21.15.82:0/3994148855 conn(0x7f3edc0cada0 msgr2=0x7f3edc0c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:47.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 shutdown_connections 2023-07-20T10:06:47.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:47.845+0000 7f3ee27ba640 1 -- 172.21.15.82:0/3994148855 wait complete. 2023-07-20T10:06:47.845 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:06:47.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 Processor -- start 2023-07-20T10:06:47.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 -- start start 2023-07-20T10:06:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc7080cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7080cd730 0x7fc7080cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7080cf880 con 0x7fc70815c590 2023-07-20T10:06:47.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080cd2a0 con 0x7fc7080cd730 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc70d303640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080b4f50 con 0x7fc7080d0d00 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc706ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc70815c590 0x7fc7080b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49544/0 (socket says 172.21.15.82:49544) 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc706ffd640 1 -- 172.21.15.82:0/2709786394 learned_addr learned my addr 172.21.15.82:0/2709786394 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2709786394 >> v2:172.21.15.82:3300/0 conn(0x7fc7080cd730 0x7fc7080cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7067fc640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc7080cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc705ffb640 1 -- 172.21.15.82:0/2709786394 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466597079 0 0) 0x7fc7080cf880 con 0x7fc70815c590 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc705ffb640 1 -- 172.21.15.82:0/2709786394 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f0003530 con 0x7fc70815c590 2023-07-20T10:06:47.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7077fe640 1 -- 172.21.15.82:0/2709786394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 msgr2=0x7fc7080cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc7080cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7077fe640 1 -- 172.21.15.82:0/2709786394 >> v1:172.21.15.82:6789/0 conn(0x7fc70815c590 legacy=0x7fc7080b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.005+0000 7fc7077fe640 1 -- 172.21.15.82:0/2709786394 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080cfab0 con 0x7fc7080cd730 2023-07-20T10:06:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7080cd730 0x7fc7080cdba0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c01183687dcf0c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc705ffb640 1 -- 172.21.15.82:0/2709786394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000a5950 con 0x7fc7080cd730 2023-07-20T10:06:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc705ffb640 1 -- 172.21.15.82:0/2709786394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000a5ab0 con 0x7fc7080cd730 2023-07-20T10:06:47.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc705ffb640 1 -- 172.21.15.82:0/2709786394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000a5e40 con 0x7fc7080cd730 2023-07-20T10:06:47.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 -- 172.21.15.82:0/2709786394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7080cd730 msgr2=0x7fc7080cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7080cd730 0x7fc7080cdba0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70001c890 comp rx=0 tx=0).stop 2023-07-20T10:06:47.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 -- 172.21.15.82:0/2709786394 shutdown_connections 2023-07-20T10:06:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7080cd730 0x7fc7080cdba0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 --2- 172.21.15.82:0/2709786394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc7080cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 -- 172.21.15.82:0/2709786394 >> 172.21.15.82:0/2709786394 conn(0x7fc7080654e0 msgr2=0x7fc7080658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 -- 172.21.15.82:0/2709786394 shutdown_connections 2023-07-20T10:06:47.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 -- 172.21.15.82:0/2709786394 wait complete. 2023-07-20T10:06:47.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.009+0000 7fc70d303640 1 Processor -- start 2023-07-20T10:06:47.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- start start 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7080cd730 0x7fc7080c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc708155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080c9190 con 0x7fc70815c590 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708155b50 con 0x7fc7080cd730 2023-07-20T10:06:47.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815ddf0 con 0x7fc7080d0d00 2023-07-20T10:06:47.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41070/0 (socket says 172.21.15.82:41070) 2023-07-20T10:06:47.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 -- 172.21.15.82:0/2209438561 learned_addr learned my addr 172.21.15.82:0/2209438561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7067fc640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc708155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc706ffd640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7080cd730 0x7fc7080c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 -- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 msgr2=0x7fc708155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc708155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 -- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7080cd730 msgr2=0x7fc7080c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7080cd730 0x7fc7080c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 -- 172.21.15.82:0/2209438561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009a70 con 0x7fc70815c590 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc7077fe640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b0040 tx=0x7fc700019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000adce0 con 0x7fc70815c590 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000ade40 con 0x7fc70815c590 2023-07-20T10:06:47.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70815e040 con 0x7fc70815c590 2023-07-20T10:06:47.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000b9690 con 0x7fc70815c590 2023-07-20T10:06:47.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70815e600 con 0x7fc70815c590 2023-07-20T10:06:47.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.013+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70815e1d0 con 0x7fc70815c590 2023-07-20T10:06:47.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.017+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc7000b97f0 con 0x7fc70815c590 2023-07-20T10:06:47.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.017+0000 7fc6ef7fe640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 0x7fc6f4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:47.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.017+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc70011f660 con 0x7fc70815c590 2023-07-20T10:06:47.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.017+0000 7fc706ffd640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 0x7fc6f4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:47.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.017+0000 7fc706ffd640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 0x7fc6f4068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8005890 tx=0x7fc6f8009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.021+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7000ecb60 con 0x7fc70815c590 2023-07-20T10:06:48.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.173+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc70804da30 con 0x7fc70815c590 2023-07-20T10:06:48.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc6ef7fe640 1 -- 172.21.15.82:0/2209438561 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fc700009450 con 0x7fc70815c590 2023-07-20T10:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":107,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:06:45.450560+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:06:48.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 msgr2=0x7fc6f4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 0x7fc6f4068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8005890 tx=0x7fc6f8009040 comp rx=0 tx=0).stop 2023-07-20T10:06:48.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 msgr2=0x7fc7080b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b0040 tx=0x7fc700019630 comp rx=0 tx=0).stop 2023-07-20T10:06:48.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 shutdown_connections 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc70815c590 0x7fc7080b1fc0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fc6f40663a0 0x7fc6f4068860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7080d0d00 0x7fc708155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 --2- 172.21.15.82:0/2209438561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7080cd730 0x7fc7080c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 >> 172.21.15.82:0/2209438561 conn(0x7fc7080654e0 msgr2=0x7fc7080b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 shutdown_connections 2023-07-20T10:06:48.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.177+0000 7fc70d303640 1 -- 172.21.15.82:0/2209438561 wait complete. 2023-07-20T10:06:48.177 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:06:48.178 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:48.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 Processor -- start 2023-07-20T10:06:48.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 -- start start 2023-07-20T10:06:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55815c5f0 0x7ff5580b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5580ccfb0 0x7ff5580ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5580b7c20 con 0x7ff5580ce9a0 2023-07-20T10:06:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5580cee50 con 0x7ff5580ccfb0 2023-07-20T10:06:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55e5d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55815c9d0 con 0x7ff55815c5f0 2023-07-20T10:06:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5580ccfb0 0x7ff5580ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5580ccfb0 0x7ff5580ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41086/0 (socket says 172.21.15.82:41086) 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 -- 172.21.15.82:0/659761212 learned_addr learned my addr 172.21.15.82:0/659761212 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55d5d0640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55815c5f0 0x7ff5580b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 -- 172.21.15.82:0/659761212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55815c5f0 msgr2=0x7ff5580b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55815c5f0 0x7ff5580b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 -- 172.21.15.82:0/659761212 >> v1:172.21.15.183:6789/0 conn(0x7ff5580ce9a0 legacy=0x7ff5580b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.337+0000 7ff55cdcf640 1 -- 172.21.15.82:0/659761212 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5580ce030 con 0x7ff5580ccfb0 2023-07-20T10:06:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55cdcf640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5580ccfb0 0x7ff5580ce460 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff548009870 tx=0x7ff54801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b353e03fc22537e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff54ffff640 1 -- 172.21.15.82:0/659761212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480a8a30 con 0x7ff5580ccfb0 2023-07-20T10:06:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff54ffff640 1 -- 172.21.15.82:0/659761212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5480a8b90 con 0x7ff5580ccfb0 2023-07-20T10:06:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff54ffff640 1 -- 172.21.15.82:0/659761212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5480b0440 con 0x7ff5580ccfb0 2023-07-20T10:06:48.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 -- 172.21.15.82:0/659761212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5580ccfb0 msgr2=0x7ff5580ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5580ccfb0 0x7ff5580ce460 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff548009870 tx=0x7ff54801ed30 comp rx=0 tx=0).stop 2023-07-20T10:06:48.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 -- 172.21.15.82:0/659761212 shutdown_connections 2023-07-20T10:06:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5580ccfb0 0x7ff5580ce460 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/659761212 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff55815c5f0 0x7ff5580b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 -- 172.21.15.82:0/659761212 >> 172.21.15.82:0/659761212 conn(0x7ff558065710 msgr2=0x7ff558065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 -- 172.21.15.82:0/659761212 shutdown_connections 2023-07-20T10:06:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 -- 172.21.15.82:0/659761212 wait complete. 2023-07-20T10:06:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.341+0000 7ff55e5d2640 1 Processor -- start 2023-07-20T10:06:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- start start 2023-07-20T10:06:48.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 0x7ff55806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 0x7ff5580c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580c9460 con 0x7ff55815c5f0 2023-07-20T10:06:48.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55815b510 con 0x7ff5580ce9a0 2023-07-20T10:06:48.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5580ac220 con 0x7ff5580ccfb0 2023-07-20T10:06:48.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41092/0 (socket says 172.21.15.82:41092) 2023-07-20T10:06:48.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 -- 172.21.15.82:0/3551583585 learned_addr learned my addr 172.21.15.82:0/3551583585 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:48.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55cdcf640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 0x7ff5580c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55d5d0640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 0x7ff55806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 -- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 msgr2=0x7ff55806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 0x7ff55806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 -- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 msgr2=0x7ff5580c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 0x7ff5580c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 -- 172.21.15.82:0/3551583585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480094d0 con 0x7ff55815c5f0 2023-07-20T10:06:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55cdcf640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 0x7ff5580c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:48.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55d5d0640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 0x7ff55806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:48.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55ddd1640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c770 tx=0x7ff55000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550003b80 con 0x7ff55815c5f0 2023-07-20T10:06:48.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550003ce0 con 0x7ff55815c5f0 2023-07-20T10:06:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5580abf40 con 0x7ff55815c5f0 2023-07-20T10:06:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000aa90 con 0x7ff55815c5f0 2023-07-20T10:06:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5581f3100 con 0x7ff55815c5f0 2023-07-20T10:06:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.345+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5581f2c50 con 0x7ff55815c5f0 2023-07-20T10:06:48.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.349+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff55000abf0 con 0x7ff55815c5f0 2023-07-20T10:06:48.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.349+0000 7ff54dffb640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 0x7ff53c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.349+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff550083d10 con 0x7ff55815c5f0 2023-07-20T10:06:48.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.349+0000 7ff55d5d0640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 0x7ff53c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.349+0000 7ff55d5d0640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 0x7ff53c068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff5540097a0 tx=0x7ff554008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.353+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff550051080 con 0x7ff55815c5f0 2023-07-20T10:06:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.497+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5580cd790 con 0x7ff53c0663a0 2023-07-20T10:06:48.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.509+0000 7ff54dffb640 1 -- 172.21.15.82:0/3551583585 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306586 (secure 0 0 0) 0x7ff554009d80 con 0x7ff53c0663a0 2023-07-20T10:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:48.493 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:48.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 msgr2=0x7ff53c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 0x7ff53c068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff5540097a0 tx=0x7ff554008040 comp rx=0 tx=0).stop 2023-07-20T10:06:48.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 msgr2=0x7ff5580c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c770 tx=0x7ff55000cc30 comp rx=0 tx=0).stop 2023-07-20T10:06:48.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 shutdown_connections 2023-07-20T10:06:48.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff55815c5f0 0x7ff5580c8f20 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5580ce9a0 0x7ff5580c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7ff53c0663a0 0x7ff53c068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 --2- 172.21.15.82:0/3551583585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5580ccfb0 0x7ff55806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 >> 172.21.15.82:0/3551583585 conn(0x7ff558065710 msgr2=0x7ff5580d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:48.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 shutdown_connections 2023-07-20T10:06:48.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.513+0000 7ff55e5d2640 1 -- 172.21.15.82:0/3551583585 wait complete. 2023-07-20T10:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:06:47.479121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312552,"kb_used_data":11144,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754662168,"statfs":{"total":773094113280,"available":772774060032,"internally_reserved":0,"allocated":11411456,"data_stored":6265256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040307"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453138+0000","last_change":"2023-07-20T10:06:43.453138+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453138+0000","last_undegraded":"2023-07-20T10:06:43.453138+0000","last_fullsized":"2023-07-20T10:06:43.453138+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462647+0000","last_change":"2023-07-20T10:06:43.462647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462647+0000","last_undegraded":"2023-07-20T10:06:43.462647+0000","last_fullsized":"2023-07-20T10:06:43.462647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454149+0000","last_change":"2023-07-20T10:06:43.454149+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454149+0000","last_undegraded":"2023-07-20T10:06:43.454149+0000","last_fullsized":"2023-07-20T10:06:43.454149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464505+0000","last_change":"2023-07-20T10:06:43.464505+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464505+0000","last_undegraded":"2023-07-20T10:06:43.464505+0000","last_fullsized":"2023-07-20T10:06:43.464505+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460690+0000","last_change":"2023-07-20T10:06:43.460690+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460690+0000","last_undegraded":"2023-07-20T10:06:43.460690+0000","last_fullsized":"2023-07-20T10:06:43.460690+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456826+0000","last_change":"2023-07-20T10:06:43.456826+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456826+0000","last_undegraded":"2023-07-20T10:06:43.456826+0000","last_fullsized":"2023-07-20T10:06:43.456826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466945+0000","last_change":"2023-07-20T10:06:43.466945+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466945+0000","last_undegraded":"2023-07-20T10:06:43.466945+0000","last_fullsized":"2023-07-20T10:06:43.466945+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457109+0000","last_change":"2023-07-20T10:06:43.457109+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457109+0000","last_undegraded":"2023-07-20T10:06:43.457109+0000","last_fullsized":"2023-07-20T10:06:43.457109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459312+0000","last_change":"2023-07-20T10:06:43.459312+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459312+0000","last_undegraded":"2023-07-20T10:06:43.459312+0000","last_fullsized":"2023-07-20T10:06:43.459312+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452720+0000","last_change":"2023-07-20T10:06:43.452720+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452720+0000","last_undegraded":"2023-07-20T10:06:43.452720+0000","last_fullsized":"2023-07-20T10:06:43.452720+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463736+0000","last_change":"2023-07-20T10:06:43.463736+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463736+0000","last_undegraded":"2023-07-20T10:06:43.463736+0000","last_fullsized":"2023-07-20T10:06:43.463736+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452403+0000","last_change":"2023-07-20T10:06:43.452403+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452403+0000","last_undegraded":"2023-07-20T10:06:43.452403+0000","last_fullsized":"2023-07-20T10:06:43.452403+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456648+0000","last_change":"2023-07-20T10:06:43.456648+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456648+0000","last_undegraded":"2023-07-20T10:06:43.456648+0000","last_fullsized":"2023-07-20T10:06:43.456648+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459909+0000","last_change":"2023-07-20T10:06:43.459909+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459909+0000","last_undegraded":"2023-07-20T10:06:43.459909+0000","last_fullsized":"2023-07-20T10:06:43.459909+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458578+0000","last_change":"2023-07-20T10:06:43.458578+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458578+0000","last_undegraded":"2023-07-20T10:06:43.458578+0000","last_fullsized":"2023-07-20T10:06:43.458578+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457467+0000","last_change":"2023-07-20T10:06:43.457467+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457467+0000","last_undegraded":"2023-07-20T10:06:43.457467+0000","last_fullsized":"2023-07-20T10:06:43.457467+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457437+0000","last_change":"2023-07-20T10:06:43.457437+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457437+0000","last_undegraded":"2023-07-20T10:06:43.457437+0000","last_fullsized":"2023-07-20T10:06:43.457437+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455558+0000","last_change":"2023-07-20T10:06:43.455558+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455558+0000","last_undegraded":"2023-07-20T10:06:43.455558+0000","last_fullsized":"2023-07-20T10:06:43.455558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459495+0000","last_change":"2023-07-20T10:06:43.459495+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459495+0000","last_undegraded":"2023-07-20T10:06:43.459495+0000","last_fullsized":"2023-07-20T10:06:43.459495+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464042+0000","last_change":"2023-07-20T10:06:43.464042+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464042+0000","last_undegraded":"2023-07-20T10:06:43.464042+0000","last_fullsized":"2023-07-20T10:06:43.464042+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460226+0000","last_change":"2023-07-20T10:06:43.460226+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460226+0000","last_undegraded":"2023-07-20T10:06:43.460226+0000","last_fullsized":"2023-07-20T10:06:43.460226+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459288+0000","last_change":"2023-07-20T10:06:43.459288+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459288+0000","last_undegraded":"2023-07-20T10:06:43.459288+0000","last_fullsized":"2023-07-20T10:06:43.459288+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463249+0000","last_change":"2023-07-20T10:06:43.463249+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463249+0000","last_undegraded":"2023-07-20T10:06:43.463249+0000","last_fullsized":"2023-07-20T10:06:43.463249+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453695+0000","last_change":"2023-07-20T10:06:43.453695+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453695+0000","last_undegraded":"2023-07-20T10:06:43.453695+0000","last_fullsized":"2023-07-20T10:06:43.453695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463647+0000","last_change":"2023-07-20T10:06:43.463647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463647+0000","last_undegraded":"2023-07-20T10:06:43.463647+0000","last_fullsized":"2023-07-20T10:06:43.463647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461058+0000","last_change":"2023-07-20T10:06:43.461058+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461058+0000","last_undegraded":"2023-07-20T10:06:43.461058+0000","last_fullsized":"2023-07-20T10:06:43.461058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452358+0000","last_change":"2023-07-20T10:06:43.452358+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452358+0000","last_undegraded":"2023-07-20T10:06:43.452358+0000","last_fullsized":"2023-07-20T10:06:43.452358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460758+0000","last_change":"2023-07-20T10:06:43.460758+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460758+0000","last_undegraded":"2023-07-20T10:06:43.460758+0000","last_fullsized":"2023-07-20T10:06:43.460758+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466460+0000","last_change":"2023-07-20T10:06:43.466460+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466460+0000","last_undegraded":"2023-07-20T10:06:43.466460+0000","last_fullsized":"2023-07-20T10:06:43.466460+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458212+0000","last_change":"2023-07-20T10:06:43.458212+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458212+0000","last_undegraded":"2023-07-20T10:06:43.458212+0000","last_fullsized":"2023-07-20T10:06:43.458212+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459059+0000","last_change":"2023-07-20T10:06:43.459059+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459059+0000","last_undegraded":"2023-07-20T10:06:43.459059+0000","last_fullsized":"2023-07-20T10:06:43.459059+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456980+0000","last_change":"2023-07-20T10:06:43.456980+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456980+0000","last_undegraded":"2023-07-20T10:06:43.456980+0000","last_fullsized":"2023-07-20T10:06:43.456980+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458676+0000","last_change":"2023-07-20T10:06:43.458676+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458676+0000","last_undegraded":"2023-07-20T10:06:43.458676+0000","last_fullsized":"2023-07-20T10:06:43.458676+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476636+0000","last_change":"2023-07-20T10:06:43.474094+0000","last_active":"2023-07-20T10:06:43.476636+0000","last_peered":"2023-07-20T10:06:43.476636+0000","last_clean":"2023-07-20T10:06:43.476636+0000","last_became_active":"2023-07-20T10:06:43.473779+0000","last_became_peered":"2023-07-20T10:06:43.473779+0000","last_unstale":"2023-07-20T10:06:43.476636+0000","last_undegraded":"2023-07-20T10:06:43.476636+0000","last_fullsized":"2023-07-20T10:06:43.476636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:27.575598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456453+0000","last_change":"2023-07-20T10:06:43.456453+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456453+0000","last_undegraded":"2023-07-20T10:06:43.456453+0000","last_fullsized":"2023-07-20T10:06:43.456453+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472820+0000","last_change":"2023-07-20T10:06:43.469840+0000","last_active":"2023-07-20T10:06:43.472820+0000","last_peered":"2023-07-20T10:06:43.472820+0000","last_clean":"2023-07-20T10:06:43.472820+0000","last_became_active":"2023-07-20T10:06:43.469543+0000","last_became_peered":"2023-07-20T10:06:43.469543+0000","last_unstale":"2023-07-20T10:06:43.472820+0000","last_undegraded":"2023-07-20T10:06:43.472820+0000","last_fullsized":"2023-07-20T10:06:43.472820+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:09.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466180+0000","last_change":"2023-07-20T10:06:43.466180+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466180+0000","last_undegraded":"2023-07-20T10:06:43.466180+0000","last_fullsized":"2023-07-20T10:06:43.466180+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481437+0000","last_change":"2023-07-20T10:06:43.480281+0000","last_active":"2023-07-20T10:06:43.481437+0000","last_peered":"2023-07-20T10:06:43.481437+0000","last_clean":"2023-07-20T10:06:43.481437+0000","last_became_active":"2023-07-20T10:06:43.479965+0000","last_became_peered":"2023-07-20T10:06:43.479965+0000","last_unstale":"2023-07-20T10:06:43.481437+0000","last_undegraded":"2023-07-20T10:06:43.481437+0000","last_fullsized":"2023-07-20T10:06:43.481437+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:45:41.292704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456920+0000","last_change":"2023-07-20T10:06:43.456920+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456920+0000","last_undegraded":"2023-07-20T10:06:43.456920+0000","last_fullsized":"2023-07-20T10:06:43.456920+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476971+0000","last_change":"2023-07-20T10:06:43.475691+0000","last_active":"2023-07-20T10:06:43.476971+0000","last_peered":"2023-07-20T10:06:43.476971+0000","last_clean":"2023-07-20T10:06:43.476971+0000","last_became_active":"2023-07-20T10:06:43.475393+0000","last_became_peered":"2023-07-20T10:06:43.475393+0000","last_unstale":"2023-07-20T10:06:43.476971+0000","last_undegraded":"2023-07-20T10:06:43.476971+0000","last_fullsized":"2023-07-20T10:06:43.476971+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:07.941110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458341+0000","last_change":"2023-07-20T10:06:43.458341+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458341+0000","last_undegraded":"2023-07-20T10:06:43.458341+0000","last_fullsized":"2023-07-20T10:06:43.458341+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471687+0000","last_change":"2023-07-20T10:06:43.469775+0000","last_active":"2023-07-20T10:06:43.471687+0000","last_peered":"2023-07-20T10:06:43.471687+0000","last_clean":"2023-07-20T10:06:43.471687+0000","last_became_active":"2023-07-20T10:06:43.469463+0000","last_became_peered":"2023-07-20T10:06:43.469463+0000","last_unstale":"2023-07-20T10:06:43.471687+0000","last_undegraded":"2023-07-20T10:06:43.471687+0000","last_fullsized":"2023-07-20T10:06:43.471687+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:09.433244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461122+0000","last_change":"2023-07-20T10:06:43.461122+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461122+0000","last_undegraded":"2023-07-20T10:06:43.461122+0000","last_fullsized":"2023-07-20T10:06:43.461122+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471279+0000","last_change":"2023-07-20T10:06:43.467547+0000","last_active":"2023-07-20T10:06:43.471279+0000","last_peered":"2023-07-20T10:06:43.471279+0000","last_clean":"2023-07-20T10:06:43.471279+0000","last_became_active":"2023-07-20T10:06:43.467241+0000","last_became_peered":"2023-07-20T10:06:43.467241+0000","last_unstale":"2023-07-20T10:06:43.471279+0000","last_undegraded":"2023-07-20T10:06:43.471279+0000","last_fullsized":"2023-07-20T10:06:43.471279+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:38.434969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456298+0000","last_change":"2023-07-20T10:06:43.456298+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456298+0000","last_undegraded":"2023-07-20T10:06:43.456298+0000","last_fullsized":"2023-07-20T10:06:43.456298+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.454618+0000","last_change":"2023-07-20T10:06:43.454618+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454618+0000","last_undegraded":"2023-07-20T10:06:43.454618+0000","last_fullsized":"2023-07-20T10:06:43.454618+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:01:01.615753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455996+0000","last_change":"2023-07-20T10:06:43.455996+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455996+0000","last_undegraded":"2023-07-20T10:06:43.455996+0000","last_fullsized":"2023-07-20T10:06:43.455996+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479596+0000","last_change":"2023-07-20T10:06:43.477958+0000","last_active":"2023-07-20T10:06:43.479596+0000","last_peered":"2023-07-20T10:06:43.479596+0000","last_clean":"2023-07-20T10:06:43.479596+0000","last_became_active":"2023-07-20T10:06:43.476867+0000","last_became_peered":"2023-07-20T10:06:43.476867+0000","last_unstale":"2023-07-20T10:06:43.479596+0000","last_undegraded":"2023-07-20T10:06:43.479596+0000","last_fullsized":"2023-07-20T10:06:43.479596+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:55:17.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458231+0000","last_change":"2023-07-20T10:06:43.458231+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458231+0000","last_undegraded":"2023-07-20T10:06:43.458231+0000","last_fullsized":"2023-07-20T10:06:43.458231+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472211+0000","last_change":"2023-07-20T10:06:43.465731+0000","last_active":"2023-07-20T10:06:43.472211+0000","last_peered":"2023-07-20T10:06:43.472211+0000","last_clean":"2023-07-20T10:06:43.472211+0000","last_became_active":"2023-07-20T10:06:43.465435+0000","last_became_peered":"2023-07-20T10:06:43.465435+0000","last_unstale":"2023-07-20T10:06:43.472211+0000","last_undegraded":"2023-07-20T10:06:43.472211+0000","last_fullsized":"2023-07-20T10:06:43.472211+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:33.995162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466408+0000","last_change":"2023-07-20T10:06:43.466408+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466408+0000","last_undegraded":"2023-07-20T10:06:43.466408+0000","last_fullsized":"2023-07-20T10:06:43.466408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472162+0000","last_change":"2023-07-20T10:06:43.472162+0000","last_active":"2023-07-20T10:06:43.472162+0000","last_peered":"2023-07-20T10:06:43.472162+0000","last_clean":"2023-07-20T10:06:43.472162+0000","last_became_active":"2023-07-20T10:06:43.471820+0000","last_became_peered":"2023-07-20T10:06:43.471820+0000","last_unstale":"2023-07-20T10:06:43.472162+0000","last_undegraded":"2023-07-20T10:06:43.472162+0000","last_fullsized":"2023-07-20T10:06:43.472162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:41.452066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455082+0000","last_change":"2023-07-20T10:06:43.455082+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455082+0000","last_undegraded":"2023-07-20T10:06:43.455082+0000","last_fullsized":"2023-07-20T10:06:43.455082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476905+0000","last_change":"2023-07-20T10:06:43.474965+0000","last_active":"2023-07-20T10:06:43.476905+0000","last_peered":"2023-07-20T10:06:43.476905+0000","last_clean":"2023-07-20T10:06:43.476905+0000","last_became_active":"2023-07-20T10:06:43.474482+0000","last_became_peered":"2023-07-20T10:06:43.474482+0000","last_unstale":"2023-07-20T10:06:43.476905+0000","last_undegraded":"2023-07-20T10:06:43.476905+0000","last_fullsized":"2023-07-20T10:06:43.476905+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:31.786764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460286+0000","last_change":"2023-07-20T10:06:43.460286+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460286+0000","last_undegraded":"2023-07-20T10:06:43.460286+0000","last_fullsized":"2023-07-20T10:06:43.460286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474142+0000","last_change":"2023-07-20T10:06:43.470986+0000","last_active":"2023-07-20T10:06:43.474142+0000","last_peered":"2023-07-20T10:06:43.474142+0000","last_clean":"2023-07-20T10:06:43.474142+0000","last_became_active":"2023-07-20T10:06:43.470639+0000","last_became_peered":"2023-07-20T10:06:43.470639+0000","last_unstale":"2023-07-20T10:06:43.474142+0000","last_undegraded":"2023-07-20T10:06:43.474142+0000","last_fullsized":"2023-07-20T10:06:43.474142+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:06:29.428334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457933+0000","last_change":"2023-07-20T10:06:43.457933+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457933+0000","last_undegraded":"2023-07-20T10:06:43.457933+0000","last_fullsized":"2023-07-20T10:06:43.457933+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479539+0000","last_change":"2023-07-20T10:06:43.477620+0000","last_active":"2023-07-20T10:06:43.479539+0000","last_peered":"2023-07-20T10:06:43.479539+0000","last_clean":"2023-07-20T10:06:43.479539+0000","last_became_active":"2023-07-20T10:06:43.477161+0000","last_became_peered":"2023-07-20T10:06:43.477161+0000","last_unstale":"2023-07-20T10:06:43.479539+0000","last_undegraded":"2023-07-20T10:06:43.479539+0000","last_fullsized":"2023-07-20T10:06:43.479539+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:53:56.539245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458575+0000","last_change":"2023-07-20T10:06:43.458575+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458575+0000","last_undegraded":"2023-07-20T10:06:43.458575+0000","last_fullsized":"2023-07-20T10:06:43.458575+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474241+0000","last_change":"2023-07-20T10:06:43.470913+0000","last_active":"2023-07-20T10:06:43.474241+0000","last_peered":"2023-07-20T10:06:43.474241+0000","last_clean":"2023-07-20T10:06:43.474241+0000","last_became_active":"2023-07-20T10:06:43.470632+0000","last_became_peered":"2023-07-20T10:06:43.470632+0000","last_unstale":"2023-07-20T10:06:43.474241+0000","last_undegraded":"2023-07-20T10:06:43.474241+0000","last_fullsized":"2023-07-20T10:06:43.474241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:53:57.136625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452279+0000","last_change":"2023-07-20T10:06:43.452279+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452279+0000","last_undegraded":"2023-07-20T10:06:43.452279+0000","last_fullsized":"2023-07-20T10:06:43.452279+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472030+0000","last_change":"2023-07-20T10:06:43.469587+0000","last_active":"2023-07-20T10:06:43.472030+0000","last_peered":"2023-07-20T10:06:43.472030+0000","last_clean":"2023-07-20T10:06:43.472030+0000","last_became_active":"2023-07-20T10:06:43.469322+0000","last_became_peered":"2023-07-20T10:06:43.469322+0000","last_unstale":"2023-07-20T10:06:43.472030+0000","last_undegraded":"2023-07-20T10:06:43.472030+0000","last_fullsized":"2023-07-20T10:06:43.472030+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:27.910463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452322+0000","last_change":"2023-07-20T10:06:43.452322+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452322+0000","last_undegraded":"2023-07-20T10:06:43.452322+0000","last_fullsized":"2023-07-20T10:06:43.452322+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471307+0000","last_change":"2023-07-20T10:06:43.467283+0000","last_active":"2023-07-20T10:06:43.471307+0000","last_peered":"2023-07-20T10:06:43.471307+0000","last_clean":"2023-07-20T10:06:43.471307+0000","last_became_active":"2023-07-20T10:06:43.467005+0000","last_became_peered":"2023-07-20T10:06:43.467005+0000","last_unstale":"2023-07-20T10:06:43.471307+0000","last_undegraded":"2023-07-20T10:06:43.471307+0000","last_fullsized":"2023-07-20T10:06:43.471307+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:46.250920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463086+0000","last_change":"2023-07-20T10:06:43.463086+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463086+0000","last_undegraded":"2023-07-20T10:06:43.463086+0000","last_fullsized":"2023-07-20T10:06:43.463086+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481072+0000","last_change":"2023-07-20T10:06:43.478374+0000","last_active":"2023-07-20T10:06:43.481072+0000","last_peered":"2023-07-20T10:06:43.481072+0000","last_clean":"2023-07-20T10:06:43.481072+0000","last_became_active":"2023-07-20T10:06:43.478050+0000","last_became_peered":"2023-07-20T10:06:43.478050+0000","last_unstale":"2023-07-20T10:06:43.481072+0000","last_undegraded":"2023-07-20T10:06:43.481072+0000","last_fullsized":"2023-07-20T10:06:43.481072+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:54.399950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455916+0000","last_change":"2023-07-20T10:06:43.455916+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455916+0000","last_undegraded":"2023-07-20T10:06:43.455916+0000","last_fullsized":"2023-07-20T10:06:43.455916+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472841+0000","last_change":"2023-07-20T10:06:43.471424+0000","last_active":"2023-07-20T10:06:43.472841+0000","last_peered":"2023-07-20T10:06:43.472841+0000","last_clean":"2023-07-20T10:06:43.472841+0000","last_became_active":"2023-07-20T10:06:43.471115+0000","last_became_peered":"2023-07-20T10:06:43.471115+0000","last_unstale":"2023-07-20T10:06:43.472841+0000","last_undegraded":"2023-07-20T10:06:43.472841+0000","last_fullsized":"2023-07-20T10:06:43.472841+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:58.327337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456383+0000","last_change":"2023-07-20T10:06:43.456383+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456383+0000","last_undegraded":"2023-07-20T10:06:43.456383+0000","last_fullsized":"2023-07-20T10:06:43.456383+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476033+0000","last_change":"2023-07-20T10:06:43.474819+0000","last_active":"2023-07-20T10:06:43.476033+0000","last_peered":"2023-07-20T10:06:43.476033+0000","last_clean":"2023-07-20T10:06:43.476033+0000","last_became_active":"2023-07-20T10:06:43.474441+0000","last_became_peered":"2023-07-20T10:06:43.474441+0000","last_unstale":"2023-07-20T10:06:43.476033+0000","last_undegraded":"2023-07-20T10:06:43.476033+0000","last_fullsized":"2023-07-20T10:06:43.476033+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:18.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463112+0000","last_change":"2023-07-20T10:06:43.463112+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463112+0000","last_undegraded":"2023-07-20T10:06:43.463112+0000","last_fullsized":"2023-07-20T10:06:43.463112+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475262+0000","last_change":"2023-07-20T10:06:43.471746+0000","last_active":"2023-07-20T10:06:43.475262+0000","last_peered":"2023-07-20T10:06:43.475262+0000","last_clean":"2023-07-20T10:06:43.475262+0000","last_became_active":"2023-07-20T10:06:43.471193+0000","last_became_peered":"2023-07-20T10:06:43.471193+0000","last_unstale":"2023-07-20T10:06:43.475262+0000","last_undegraded":"2023-07-20T10:06:43.475262+0000","last_fullsized":"2023-07-20T10:06:43.475262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:21.480571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452439+0000","last_change":"2023-07-20T10:06:43.452439+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452439+0000","last_undegraded":"2023-07-20T10:06:43.452439+0000","last_fullsized":"2023-07-20T10:06:43.452439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474292+0000","last_change":"2023-07-20T10:06:43.471548+0000","last_active":"2023-07-20T10:06:43.474292+0000","last_peered":"2023-07-20T10:06:43.474292+0000","last_clean":"2023-07-20T10:06:43.474292+0000","last_became_active":"2023-07-20T10:06:43.471209+0000","last_became_peered":"2023-07-20T10:06:43.471209+0000","last_unstale":"2023-07-20T10:06:43.474292+0000","last_undegraded":"2023-07-20T10:06:43.474292+0000","last_fullsized":"2023-07-20T10:06:43.474292+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:09:05.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454635+0000","last_change":"2023-07-20T10:06:43.454635+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454635+0000","last_undegraded":"2023-07-20T10:06:43.454635+0000","last_fullsized":"2023-07-20T10:06:43.454635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476018+0000","last_change":"2023-07-20T10:06:43.472376+0000","last_active":"2023-07-20T10:06:43.476018+0000","last_peered":"2023-07-20T10:06:43.476018+0000","last_clean":"2023-07-20T10:06:43.476018+0000","last_became_active":"2023-07-20T10:06:43.470495+0000","last_became_peered":"2023-07-20T10:06:43.470495+0000","last_unstale":"2023-07-20T10:06:43.476018+0000","last_undegraded":"2023-07-20T10:06:43.476018+0000","last_fullsized":"2023-07-20T10:06:43.476018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:19.495788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460712+0000","last_change":"2023-07-20T10:06:43.460712+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460712+0000","last_undegraded":"2023-07-20T10:06:43.460712+0000","last_fullsized":"2023-07-20T10:06:43.460712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472633+0000","last_change":"2023-07-20T10:06:43.469684+0000","last_active":"2023-07-20T10:06:43.472633+0000","last_peered":"2023-07-20T10:06:43.472633+0000","last_clean":"2023-07-20T10:06:43.472633+0000","last_became_active":"2023-07-20T10:06:43.469320+0000","last_became_peered":"2023-07-20T10:06:43.469320+0000","last_unstale":"2023-07-20T10:06:43.472633+0000","last_undegraded":"2023-07-20T10:06:43.472633+0000","last_fullsized":"2023-07-20T10:06:43.472633+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:47.597305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456774+0000","last_change":"2023-07-20T10:06:43.456774+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456774+0000","last_undegraded":"2023-07-20T10:06:43.456774+0000","last_fullsized":"2023-07-20T10:06:43.456774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479575+0000","last_change":"2023-07-20T10:06:43.477319+0000","last_active":"2023-07-20T10:06:43.479575+0000","last_peered":"2023-07-20T10:06:43.479575+0000","last_clean":"2023-07-20T10:06:43.479575+0000","last_became_active":"2023-07-20T10:06:43.477040+0000","last_became_peered":"2023-07-20T10:06:43.477040+0000","last_unstale":"2023-07-20T10:06:43.479575+0000","last_undegraded":"2023-07-20T10:06:43.479575+0000","last_fullsized":"2023-07-20T10:06:43.479575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:02.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.467015+0000","last_change":"2023-07-20T10:06:43.467015+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.467015+0000","last_undegraded":"2023-07-20T10:06:43.467015+0000","last_fullsized":"2023-07-20T10:06:43.467015+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472135+0000","last_change":"2023-07-20T10:06:43.469770+0000","last_active":"2023-07-20T10:06:43.472135+0000","last_peered":"2023-07-20T10:06:43.472135+0000","last_clean":"2023-07-20T10:06:43.472135+0000","last_became_active":"2023-07-20T10:06:43.469494+0000","last_became_peered":"2023-07-20T10:06:43.469494+0000","last_unstale":"2023-07-20T10:06:43.472135+0000","last_undegraded":"2023-07-20T10:06:43.472135+0000","last_fullsized":"2023-07-20T10:06:43.472135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:27:51.397197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"96'183","reported_seq":557,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468930+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:43.468930+0000","last_peered":"2023-07-20T10:06:43.468930+0000","last_clean":"2023-07-20T10:06:43.468930+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:43.468930+0000","last_undegraded":"2023-07-20T10:06:43.468930+0000","last_fullsized":"2023-07-20T10:06:43.468930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:35:40.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.460064+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:43.460064+0000","last_peered":"2023-07-20T10:06:43.460064+0000","last_clean":"2023-07-20T10:06:43.460064+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:43.460064+0000","last_undegraded":"2023-07-20T10:06:43.460064+0000","last_fullsized":"2023-07-20T10:06:43.460064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:19.864356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458273+0000","last_change":"2023-07-20T10:06:43.458273+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458273+0000","last_undegraded":"2023-07-20T10:06:43.458273+0000","last_fullsized":"2023-07-20T10:06:43.458273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.461612+0000","last_change":"2023-07-20T10:06:43.461612+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461612+0000","last_undegraded":"2023-07-20T10:06:43.461612+0000","last_fullsized":"2023-07-20T10:06:43.461612+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:08.509539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468810+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:43.468810+0000","last_peered":"2023-07-20T10:06:43.468810+0000","last_clean":"2023-07-20T10:06:43.468810+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:43.468810+0000","last_undegraded":"2023-07-20T10:06:43.468810+0000","last_fullsized":"2023-07-20T10:06:43.468810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:45:56.836205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460811+0000","last_change":"2023-07-20T10:06:43.460811+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460811+0000","last_undegraded":"2023-07-20T10:06:43.460811+0000","last_fullsized":"2023-07-20T10:06:43.460811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481063+0000","last_change":"2023-07-20T10:06:43.478316+0000","last_active":"2023-07-20T10:06:43.481063+0000","last_peered":"2023-07-20T10:06:43.481063+0000","last_clean":"2023-07-20T10:06:43.481063+0000","last_became_active":"2023-07-20T10:06:43.477958+0000","last_became_peered":"2023-07-20T10:06:43.477958+0000","last_unstale":"2023-07-20T10:06:43.481063+0000","last_undegraded":"2023-07-20T10:06:43.481063+0000","last_fullsized":"2023-07-20T10:06:43.481063+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:02.877329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.450090+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:43.450090+0000","last_peered":"2023-07-20T10:06:43.450090+0000","last_clean":"2023-07-20T10:06:43.450090+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:43.450090+0000","last_undegraded":"2023-07-20T10:06:43.450090+0000","last_fullsized":"2023-07-20T10:06:43.450090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:42.662902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460547+0000","last_change":"2023-07-20T10:06:43.460547+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460547+0000","last_undegraded":"2023-07-20T10:06:43.460547+0000","last_fullsized":"2023-07-20T10:06:43.460547+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476014+0000","last_change":"2023-07-20T10:06:43.474746+0000","last_active":"2023-07-20T10:06:43.476014+0000","last_peered":"2023-07-20T10:06:43.476014+0000","last_clean":"2023-07-20T10:06:43.476014+0000","last_became_active":"2023-07-20T10:06:43.473956+0000","last_became_peered":"2023-07-20T10:06:43.473956+0000","last_unstale":"2023-07-20T10:06:43.476014+0000","last_undegraded":"2023-07-20T10:06:43.476014+0000","last_fullsized":"2023-07-20T10:06:43.476014+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:40:45.913787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.462393+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:43.462393+0000","last_peered":"2023-07-20T10:06:43.462393+0000","last_clean":"2023-07-20T10:06:43.462393+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:43.462393+0000","last_undegraded":"2023-07-20T10:06:43.462393+0000","last_fullsized":"2023-07-20T10:06:43.462393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:54.575030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456458+0000","last_change":"2023-07-20T10:06:43.456458+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456458+0000","last_undegraded":"2023-07-20T10:06:43.456458+0000","last_fullsized":"2023-07-20T10:06:43.456458+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474224+0000","last_change":"2023-07-20T10:06:43.469866+0000","last_active":"2023-07-20T10:06:43.474224+0000","last_peered":"2023-07-20T10:06:43.474224+0000","last_clean":"2023-07-20T10:06:43.474224+0000","last_became_active":"2023-07-20T10:06:43.469563+0000","last_became_peered":"2023-07-20T10:06:43.469563+0000","last_unstale":"2023-07-20T10:06:43.474224+0000","last_undegraded":"2023-07-20T10:06:43.474224+0000","last_fullsized":"2023-07-20T10:06:43.474224+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:23.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464871+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:43.464871+0000","last_peered":"2023-07-20T10:06:43.464871+0000","last_clean":"2023-07-20T10:06:43.464871+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:43.464871+0000","last_undegraded":"2023-07-20T10:06:43.464871+0000","last_fullsized":"2023-07-20T10:06:43.464871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:06:44.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458397+0000","last_change":"2023-07-20T10:06:43.458397+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458397+0000","last_undegraded":"2023-07-20T10:06:43.458397+0000","last_fullsized":"2023-07-20T10:06:43.458397+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475911+0000","last_change":"2023-07-20T10:06:43.472464+0000","last_active":"2023-07-20T10:06:43.475911+0000","last_peered":"2023-07-20T10:06:43.475911+0000","last_clean":"2023-07-20T10:06:43.475911+0000","last_became_active":"2023-07-20T10:06:43.472186+0000","last_became_peered":"2023-07-20T10:06:43.472186+0000","last_unstale":"2023-07-20T10:06:43.475911+0000","last_undegraded":"2023-07-20T10:06:43.475911+0000","last_fullsized":"2023-07-20T10:06:43.475911+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:29:46.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.470891+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:43.470891+0000","last_peered":"2023-07-20T10:06:43.470891+0000","last_clean":"2023-07-20T10:06:43.470891+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:43.470891+0000","last_undegraded":"2023-07-20T10:06:43.470891+0000","last_fullsized":"2023-07-20T10:06:43.470891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:25:33.896767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462072+0000","last_change":"2023-07-20T10:06:43.462072+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462072+0000","last_undegraded":"2023-07-20T10:06:43.462072+0000","last_fullsized":"2023-07-20T10:06:43.462072+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475981+0000","last_change":"2023-07-20T10:06:43.471785+0000","last_active":"2023-07-20T10:06:43.475981+0000","last_peered":"2023-07-20T10:06:43.475981+0000","last_clean":"2023-07-20T10:06:43.475981+0000","last_became_active":"2023-07-20T10:06:43.471478+0000","last_became_peered":"2023-07-20T10:06:43.471478+0000","last_unstale":"2023-07-20T10:06:43.475981+0000","last_undegraded":"2023-07-20T10:06:43.475981+0000","last_fullsized":"2023-07-20T10:06:43.475981+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:19.770806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.463053+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:43.463053+0000","last_peered":"2023-07-20T10:06:43.463053+0000","last_clean":"2023-07-20T10:06:43.463053+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:43.463053+0000","last_undegraded":"2023-07-20T10:06:43.463053+0000","last_fullsized":"2023-07-20T10:06:43.463053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:36:34.717075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457248+0000","last_change":"2023-07-20T10:06:43.457248+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457248+0000","last_undegraded":"2023-07-20T10:06:43.457248+0000","last_fullsized":"2023-07-20T10:06:43.457248+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.466189+0000","last_change":"2023-07-20T10:06:43.462009+0000","last_active":"2023-07-20T10:06:43.466189+0000","last_peered":"2023-07-20T10:06:43.466189+0000","last_clean":"2023-07-20T10:06:43.466189+0000","last_became_active":"2023-07-20T10:06:43.461708+0000","last_became_peered":"2023-07-20T10:06:43.461708+0000","last_unstale":"2023-07-20T10:06:43.466189+0000","last_undegraded":"2023-07-20T10:06:43.466189+0000","last_fullsized":"2023-07-20T10:06:43.466189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:26.249050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464129+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:43.464129+0000","last_peered":"2023-07-20T10:06:43.464129+0000","last_clean":"2023-07-20T10:06:43.464129+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:43.464129+0000","last_undegraded":"2023-07-20T10:06:43.464129+0000","last_fullsized":"2023-07-20T10:06:43.464129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:08:24.570614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59184,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312656,"statfs":{"total":96636764160,"available":96576159744,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.871}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.872},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":1.0069999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.085},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68200000000000005,"15min":0.71599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":1.22,"15min":1.363},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70799999999999996,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.177,"15min":1.177},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.55100000000000005,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.204,"15min":1.23},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.874}]},{"osd":5,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.98899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.196},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.84999999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.749},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":1.034},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.876,"15min":1.2649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.57299999999999995,"5min":0.69299999999999995,"15min":0.81899999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46800000000000003,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.68700000000000006,"15min":0.70299999999999996},"last":0.317}]},{"osd":1,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.495}]},{"osd":4,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1890000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.381},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.504,"15min":0.502},"max":{"1min":0.83099999999999996,"5min":1.04,"15min":1.131},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86299999999999999,"5min":0.97699999999999998,"15min":1.4399999999999999},"last":0.749},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.86199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54508,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317332,"statfs":{"total":96636764160,"available":96580947968,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.312},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.377}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.626}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":4.0190000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":3.9750000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":3.3919999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.034}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":3.5139999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":4.1470000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:48.523 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 Processor -- start 2023-07-20T10:06:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 -- start start 2023-07-20T10:06:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f386c0c1a00 0x7f386c0aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0cc560 con 0x7f386c160fa0 2023-07-20T10:06:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0ad7e0 con 0x7f386c160bc0 2023-07-20T10:06:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f3874133640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0cc790 con 0x7f386c0c1a00 2023-07-20T10:06:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.717+0000 7f38726d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f386c0c1a00 0x7f386c0aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f386c0c1a00 0x7f386c0aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41100/0 (socket says 172.21.15.82:41100) 2023-07-20T10:06:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 -- 172.21.15.82:0/3282995535 learned_addr learned my addr 172.21.15.82:0/3282995535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38716ce640 1 --1- 172.21.15.82:0/3282995535 >> v1:172.21.15.82:6789/0 conn(0x7f386c160fa0 0x7f386c0c12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49554/0 (socket says 172.21.15.82:49554) 2023-07-20T10:06:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 -- 172.21.15.82:0/3282995535 >> v1:172.21.15.183:6789/0 conn(0x7f386c160bc0 legacy=0x7f386c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 -- 172.21.15.82:0/3282995535 >> v1:172.21.15.82:6789/0 conn(0x7f386c160fa0 legacy=0x7f386c0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 -- 172.21.15.82:0/3282995535 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c0cca70 con 0x7f386c0c1a00 2023-07-20T10:06:48.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f38726d0640 1 --2- 172.21.15.82:0/3282995535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c0c1a00 0x7f386c0aae90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f3864009e50 tx=0x7f386401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e5ecb6d29b8d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f3870ecd640 1 -- 172.21.15.82:0/3282995535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640a58a0 con 0x7f386c0c1a00 2023-07-20T10:06:48.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f3870ecd640 1 -- 172.21.15.82:0/3282995535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640a5a00 con 0x7f386c0c1a00 2023-07-20T10:06:48.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f3870ecd640 1 -- 172.21.15.82:0/3282995535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640a5d90 con 0x7f386c0c1a00 2023-07-20T10:06:48.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f3874133640 1 -- 172.21.15.82:0/3282995535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c0c1a00 msgr2=0x7f386c0aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.721+0000 7f3874133640 1 --2- 172.21.15.82:0/3282995535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c0c1a00 0x7f386c0aae90 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f3864009e50 tx=0x7f386401c9e0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- 172.21.15.82:0/3282995535 shutdown_connections 2023-07-20T10:06:48.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 --2- 172.21.15.82:0/3282995535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c0c1a00 0x7f386c0aae90 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- 172.21.15.82:0/3282995535 >> 172.21.15.82:0/3282995535 conn(0x7f386c0cada0 msgr2=0x7f386c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:48.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- 172.21.15.82:0/3282995535 shutdown_connections 2023-07-20T10:06:48.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- 172.21.15.82:0/3282995535 wait complete. 2023-07-20T10:06:48.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 Processor -- start 2023-07-20T10:06:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- start start 2023-07-20T10:06:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0c1a00 0x7f386c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 0x7f386c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1588f0 con 0x7f386c160fa0 2023-07-20T10:06:48.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c156ea0 con 0x7f386c160bc0 2023-07-20T10:06:48.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3874133640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c158610 con 0x7f386c0c1a00 2023-07-20T10:06:48.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41114/0 (socket says 172.21.15.82:41114) 2023-07-20T10:06:48.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 -- 172.21.15.82:0/3124370849 learned_addr learned my addr 172.21.15.82:0/3124370849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:48.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38716ce640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 0x7f386c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f3871ecf640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0c1a00 0x7f386c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 -- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0c1a00 msgr2=0x7f386c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0c1a00 0x7f386c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 -- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 msgr2=0x7f386c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 0x7f386c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 -- 172.21.15.82:0/3124370849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864009b30 con 0x7f386c160fa0 2023-07-20T10:06:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38716ce640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 0x7f386c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:48.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.725+0000 7f38726d0640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f38640af040 tx=0x7f3864019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b8880 con 0x7f386c160fa0 2023-07-20T10:06:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640b8a00 con 0x7f386c160fa0 2023-07-20T10:06:48.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b8db0 con 0x7f386c160fa0 2023-07-20T10:06:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c156850 con 0x7f386c160fa0 2023-07-20T10:06:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c158300 con 0x7f386c160fa0 2023-07-20T10:06:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c1566b0 con 0x7f386c160fa0 2023-07-20T10:06:48.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38640c3460 con 0x7f386c160fa0 2023-07-20T10:06:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 0x7f3850068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f386411f590 con 0x7f386c160fa0 2023-07-20T10:06:48.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f3871ecf640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 0x7f3850068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.729+0000 7f3871ecf640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 0x7f3850068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3868000f70 tx=0x7f3868009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:48.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.733+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f386c1566b0 con 0x7f386c160fa0 2023-07-20T10:06:48.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.877+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f386c156d00 con 0x7f38500663a0 2023-07-20T10:06:48.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.885+0000 7f38627fc640 1 -- 172.21.15.82:0/3124370849 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306586 (secure 0 0 0) 0x7f3868001370 con 0x7f38500663a0 2023-07-20T10:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:48.869 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 msgr2=0x7f3850068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 0x7f3850068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3868000f70 tx=0x7f3868009040 comp rx=0 tx=0).stop 2023-07-20T10:06:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 msgr2=0x7f386c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f38640af040 tx=0x7f3864019780 comp rx=0 tx=0).stop 2023-07-20T10:06:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 shutdown_connections 2023-07-20T10:06:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f386c160fa0 0x7f386c151fb0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f386c160bc0 0x7f386c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f38500663a0 0x7f3850068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 --2- 172.21.15.82:0/3124370849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f386c0c1a00 0x7f386c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 >> 172.21.15.82:0/3124370849 conn(0x7f386c0cada0 msgr2=0x7f386c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 shutdown_connections 2023-07-20T10:06:48.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:48.889+0000 7f3874133640 1 -- 172.21.15.82:0/3124370849 wait complete. 2023-07-20T10:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:06:47.479121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312552,"kb_used_data":11144,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754662168,"statfs":{"total":773094113280,"available":772774060032,"internally_reserved":0,"allocated":11411456,"data_stored":6265256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040307"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453138+0000","last_change":"2023-07-20T10:06:43.453138+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453138+0000","last_undegraded":"2023-07-20T10:06:43.453138+0000","last_fullsized":"2023-07-20T10:06:43.453138+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462647+0000","last_change":"2023-07-20T10:06:43.462647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462647+0000","last_undegraded":"2023-07-20T10:06:43.462647+0000","last_fullsized":"2023-07-20T10:06:43.462647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454149+0000","last_change":"2023-07-20T10:06:43.454149+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454149+0000","last_undegraded":"2023-07-20T10:06:43.454149+0000","last_fullsized":"2023-07-20T10:06:43.454149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464505+0000","last_change":"2023-07-20T10:06:43.464505+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464505+0000","last_undegraded":"2023-07-20T10:06:43.464505+0000","last_fullsized":"2023-07-20T10:06:43.464505+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460690+0000","last_change":"2023-07-20T10:06:43.460690+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460690+0000","last_undegraded":"2023-07-20T10:06:43.460690+0000","last_fullsized":"2023-07-20T10:06:43.460690+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456826+0000","last_change":"2023-07-20T10:06:43.456826+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456826+0000","last_undegraded":"2023-07-20T10:06:43.456826+0000","last_fullsized":"2023-07-20T10:06:43.456826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466945+0000","last_change":"2023-07-20T10:06:43.466945+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466945+0000","last_undegraded":"2023-07-20T10:06:43.466945+0000","last_fullsized":"2023-07-20T10:06:43.466945+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457109+0000","last_change":"2023-07-20T10:06:43.457109+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457109+0000","last_undegraded":"2023-07-20T10:06:43.457109+0000","last_fullsized":"2023-07-20T10:06:43.457109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459312+0000","last_change":"2023-07-20T10:06:43.459312+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459312+0000","last_undegraded":"2023-07-20T10:06:43.459312+0000","last_fullsized":"2023-07-20T10:06:43.459312+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452720+0000","last_change":"2023-07-20T10:06:43.452720+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452720+0000","last_undegraded":"2023-07-20T10:06:43.452720+0000","last_fullsized":"2023-07-20T10:06:43.452720+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463736+0000","last_change":"2023-07-20T10:06:43.463736+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463736+0000","last_undegraded":"2023-07-20T10:06:43.463736+0000","last_fullsized":"2023-07-20T10:06:43.463736+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452403+0000","last_change":"2023-07-20T10:06:43.452403+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452403+0000","last_undegraded":"2023-07-20T10:06:43.452403+0000","last_fullsized":"2023-07-20T10:06:43.452403+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456648+0000","last_change":"2023-07-20T10:06:43.456648+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456648+0000","last_undegraded":"2023-07-20T10:06:43.456648+0000","last_fullsized":"2023-07-20T10:06:43.456648+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459909+0000","last_change":"2023-07-20T10:06:43.459909+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459909+0000","last_undegraded":"2023-07-20T10:06:43.459909+0000","last_fullsized":"2023-07-20T10:06:43.459909+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458578+0000","last_change":"2023-07-20T10:06:43.458578+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458578+0000","last_undegraded":"2023-07-20T10:06:43.458578+0000","last_fullsized":"2023-07-20T10:06:43.458578+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457467+0000","last_change":"2023-07-20T10:06:43.457467+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457467+0000","last_undegraded":"2023-07-20T10:06:43.457467+0000","last_fullsized":"2023-07-20T10:06:43.457467+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457437+0000","last_change":"2023-07-20T10:06:43.457437+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457437+0000","last_undegraded":"2023-07-20T10:06:43.457437+0000","last_fullsized":"2023-07-20T10:06:43.457437+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455558+0000","last_change":"2023-07-20T10:06:43.455558+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455558+0000","last_undegraded":"2023-07-20T10:06:43.455558+0000","last_fullsized":"2023-07-20T10:06:43.455558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459495+0000","last_change":"2023-07-20T10:06:43.459495+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459495+0000","last_undegraded":"2023-07-20T10:06:43.459495+0000","last_fullsized":"2023-07-20T10:06:43.459495+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464042+0000","last_change":"2023-07-20T10:06:43.464042+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464042+0000","last_undegraded":"2023-07-20T10:06:43.464042+0000","last_fullsized":"2023-07-20T10:06:43.464042+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460226+0000","last_change":"2023-07-20T10:06:43.460226+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460226+0000","last_undegraded":"2023-07-20T10:06:43.460226+0000","last_fullsized":"2023-07-20T10:06:43.460226+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459288+0000","last_change":"2023-07-20T10:06:43.459288+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459288+0000","last_undegraded":"2023-07-20T10:06:43.459288+0000","last_fullsized":"2023-07-20T10:06:43.459288+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463249+0000","last_change":"2023-07-20T10:06:43.463249+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463249+0000","last_undegraded":"2023-07-20T10:06:43.463249+0000","last_fullsized":"2023-07-20T10:06:43.463249+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453695+0000","last_change":"2023-07-20T10:06:43.453695+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453695+0000","last_undegraded":"2023-07-20T10:06:43.453695+0000","last_fullsized":"2023-07-20T10:06:43.453695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463647+0000","last_change":"2023-07-20T10:06:43.463647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463647+0000","last_undegraded":"2023-07-20T10:06:43.463647+0000","last_fullsized":"2023-07-20T10:06:43.463647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461058+0000","last_change":"2023-07-20T10:06:43.461058+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461058+0000","last_undegraded":"2023-07-20T10:06:43.461058+0000","last_fullsized":"2023-07-20T10:06:43.461058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452358+0000","last_change":"2023-07-20T10:06:43.452358+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452358+0000","last_undegraded":"2023-07-20T10:06:43.452358+0000","last_fullsized":"2023-07-20T10:06:43.452358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460758+0000","last_change":"2023-07-20T10:06:43.460758+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460758+0000","last_undegraded":"2023-07-20T10:06:43.460758+0000","last_fullsized":"2023-07-20T10:06:43.460758+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466460+0000","last_change":"2023-07-20T10:06:43.466460+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466460+0000","last_undegraded":"2023-07-20T10:06:43.466460+0000","last_fullsized":"2023-07-20T10:06:43.466460+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458212+0000","last_change":"2023-07-20T10:06:43.458212+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458212+0000","last_undegraded":"2023-07-20T10:06:43.458212+0000","last_fullsized":"2023-07-20T10:06:43.458212+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459059+0000","last_change":"2023-07-20T10:06:43.459059+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459059+0000","last_undegraded":"2023-07-20T10:06:43.459059+0000","last_fullsized":"2023-07-20T10:06:43.459059+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456980+0000","last_change":"2023-07-20T10:06:43.456980+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456980+0000","last_undegraded":"2023-07-20T10:06:43.456980+0000","last_fullsized":"2023-07-20T10:06:43.456980+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458676+0000","last_change":"2023-07-20T10:06:43.458676+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458676+0000","last_undegraded":"2023-07-20T10:06:43.458676+0000","last_fullsized":"2023-07-20T10:06:43.458676+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476636+0000","last_change":"2023-07-20T10:06:43.474094+0000","last_active":"2023-07-20T10:06:43.476636+0000","last_peered":"2023-07-20T10:06:43.476636+0000","last_clean":"2023-07-20T10:06:43.476636+0000","last_became_active":"2023-07-20T10:06:43.473779+0000","last_became_peered":"2023-07-20T10:06:43.473779+0000","last_unstale":"2023-07-20T10:06:43.476636+0000","last_undegraded":"2023-07-20T10:06:43.476636+0000","last_fullsized":"2023-07-20T10:06:43.476636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:27.575598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456453+0000","last_change":"2023-07-20T10:06:43.456453+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456453+0000","last_undegraded":"2023-07-20T10:06:43.456453+0000","last_fullsized":"2023-07-20T10:06:43.456453+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472820+0000","last_change":"2023-07-20T10:06:43.469840+0000","last_active":"2023-07-20T10:06:43.472820+0000","last_peered":"2023-07-20T10:06:43.472820+0000","last_clean":"2023-07-20T10:06:43.472820+0000","last_became_active":"2023-07-20T10:06:43.469543+0000","last_became_peered":"2023-07-20T10:06:43.469543+0000","last_unstale":"2023-07-20T10:06:43.472820+0000","last_undegraded":"2023-07-20T10:06:43.472820+0000","last_fullsized":"2023-07-20T10:06:43.472820+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:09.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466180+0000","last_change":"2023-07-20T10:06:43.466180+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466180+0000","last_undegraded":"2023-07-20T10:06:43.466180+0000","last_fullsized":"2023-07-20T10:06:43.466180+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481437+0000","last_change":"2023-07-20T10:06:43.480281+0000","last_active":"2023-07-20T10:06:43.481437+0000","last_peered":"2023-07-20T10:06:43.481437+0000","last_clean":"2023-07-20T10:06:43.481437+0000","last_became_active":"2023-07-20T10:06:43.479965+0000","last_became_peered":"2023-07-20T10:06:43.479965+0000","last_unstale":"2023-07-20T10:06:43.481437+0000","last_undegraded":"2023-07-20T10:06:43.481437+0000","last_fullsized":"2023-07-20T10:06:43.481437+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:45:41.292704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456920+0000","last_change":"2023-07-20T10:06:43.456920+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456920+0000","last_undegraded":"2023-07-20T10:06:43.456920+0000","last_fullsized":"2023-07-20T10:06:43.456920+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476971+0000","last_change":"2023-07-20T10:06:43.475691+0000","last_active":"2023-07-20T10:06:43.476971+0000","last_peered":"2023-07-20T10:06:43.476971+0000","last_clean":"2023-07-20T10:06:43.476971+0000","last_became_active":"2023-07-20T10:06:43.475393+0000","last_became_peered":"2023-07-20T10:06:43.475393+0000","last_unstale":"2023-07-20T10:06:43.476971+0000","last_undegraded":"2023-07-20T10:06:43.476971+0000","last_fullsized":"2023-07-20T10:06:43.476971+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:07.941110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458341+0000","last_change":"2023-07-20T10:06:43.458341+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458341+0000","last_undegraded":"2023-07-20T10:06:43.458341+0000","last_fullsized":"2023-07-20T10:06:43.458341+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471687+0000","last_change":"2023-07-20T10:06:43.469775+0000","last_active":"2023-07-20T10:06:43.471687+0000","last_peered":"2023-07-20T10:06:43.471687+0000","last_clean":"2023-07-20T10:06:43.471687+0000","last_became_active":"2023-07-20T10:06:43.469463+0000","last_became_peered":"2023-07-20T10:06:43.469463+0000","last_unstale":"2023-07-20T10:06:43.471687+0000","last_undegraded":"2023-07-20T10:06:43.471687+0000","last_fullsized":"2023-07-20T10:06:43.471687+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:09.433244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461122+0000","last_change":"2023-07-20T10:06:43.461122+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461122+0000","last_undegraded":"2023-07-20T10:06:43.461122+0000","last_fullsized":"2023-07-20T10:06:43.461122+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471279+0000","last_change":"2023-07-20T10:06:43.467547+0000","last_active":"2023-07-20T10:06:43.471279+0000","last_peered":"2023-07-20T10:06:43.471279+0000","last_clean":"2023-07-20T10:06:43.471279+0000","last_became_active":"2023-07-20T10:06:43.467241+0000","last_became_peered":"2023-07-20T10:06:43.467241+0000","last_unstale":"2023-07-20T10:06:43.471279+0000","last_undegraded":"2023-07-20T10:06:43.471279+0000","last_fullsized":"2023-07-20T10:06:43.471279+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:38.434969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456298+0000","last_change":"2023-07-20T10:06:43.456298+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456298+0000","last_undegraded":"2023-07-20T10:06:43.456298+0000","last_fullsized":"2023-07-20T10:06:43.456298+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.454618+0000","last_change":"2023-07-20T10:06:43.454618+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454618+0000","last_undegraded":"2023-07-20T10:06:43.454618+0000","last_fullsized":"2023-07-20T10:06:43.454618+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:01:01.615753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455996+0000","last_change":"2023-07-20T10:06:43.455996+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455996+0000","last_undegraded":"2023-07-20T10:06:43.455996+0000","last_fullsized":"2023-07-20T10:06:43.455996+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479596+0000","last_change":"2023-07-20T10:06:43.477958+0000","last_active":"2023-07-20T10:06:43.479596+0000","last_peered":"2023-07-20T10:06:43.479596+0000","last_clean":"2023-07-20T10:06:43.479596+0000","last_became_active":"2023-07-20T10:06:43.476867+0000","last_became_peered":"2023-07-20T10:06:43.476867+0000","last_unstale":"2023-07-20T10:06:43.479596+0000","last_undegraded":"2023-07-20T10:06:43.479596+0000","last_fullsized":"2023-07-20T10:06:43.479596+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:55:17.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458231+0000","last_change":"2023-07-20T10:06:43.458231+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458231+0000","last_undegraded":"2023-07-20T10:06:43.458231+0000","last_fullsized":"2023-07-20T10:06:43.458231+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472211+0000","last_change":"2023-07-20T10:06:43.465731+0000","last_active":"2023-07-20T10:06:43.472211+0000","last_peered":"2023-07-20T10:06:43.472211+0000","last_clean":"2023-07-20T10:06:43.472211+0000","last_became_active":"2023-07-20T10:06:43.465435+0000","last_became_peered":"2023-07-20T10:06:43.465435+0000","last_unstale":"2023-07-20T10:06:43.472211+0000","last_undegraded":"2023-07-20T10:06:43.472211+0000","last_fullsized":"2023-07-20T10:06:43.472211+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:33.995162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466408+0000","last_change":"2023-07-20T10:06:43.466408+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466408+0000","last_undegraded":"2023-07-20T10:06:43.466408+0000","last_fullsized":"2023-07-20T10:06:43.466408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472162+0000","last_change":"2023-07-20T10:06:43.472162+0000","last_active":"2023-07-20T10:06:43.472162+0000","last_peered":"2023-07-20T10:06:43.472162+0000","last_clean":"2023-07-20T10:06:43.472162+0000","last_became_active":"2023-07-20T10:06:43.471820+0000","last_became_peered":"2023-07-20T10:06:43.471820+0000","last_unstale":"2023-07-20T10:06:43.472162+0000","last_undegraded":"2023-07-20T10:06:43.472162+0000","last_fullsized":"2023-07-20T10:06:43.472162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:41.452066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455082+0000","last_change":"2023-07-20T10:06:43.455082+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455082+0000","last_undegraded":"2023-07-20T10:06:43.455082+0000","last_fullsized":"2023-07-20T10:06:43.455082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476905+0000","last_change":"2023-07-20T10:06:43.474965+0000","last_active":"2023-07-20T10:06:43.476905+0000","last_peered":"2023-07-20T10:06:43.476905+0000","last_clean":"2023-07-20T10:06:43.476905+0000","last_became_active":"2023-07-20T10:06:43.474482+0000","last_became_peered":"2023-07-20T10:06:43.474482+0000","last_unstale":"2023-07-20T10:06:43.476905+0000","last_undegraded":"2023-07-20T10:06:43.476905+0000","last_fullsized":"2023-07-20T10:06:43.476905+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:31.786764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460286+0000","last_change":"2023-07-20T10:06:43.460286+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460286+0000","last_undegraded":"2023-07-20T10:06:43.460286+0000","last_fullsized":"2023-07-20T10:06:43.460286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474142+0000","last_change":"2023-07-20T10:06:43.470986+0000","last_active":"2023-07-20T10:06:43.474142+0000","last_peered":"2023-07-20T10:06:43.474142+0000","last_clean":"2023-07-20T10:06:43.474142+0000","last_became_active":"2023-07-20T10:06:43.470639+0000","last_became_peered":"2023-07-20T10:06:43.470639+0000","last_unstale":"2023-07-20T10:06:43.474142+0000","last_undegraded":"2023-07-20T10:06:43.474142+0000","last_fullsized":"2023-07-20T10:06:43.474142+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:06:29.428334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457933+0000","last_change":"2023-07-20T10:06:43.457933+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457933+0000","last_undegraded":"2023-07-20T10:06:43.457933+0000","last_fullsized":"2023-07-20T10:06:43.457933+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479539+0000","last_change":"2023-07-20T10:06:43.477620+0000","last_active":"2023-07-20T10:06:43.479539+0000","last_peered":"2023-07-20T10:06:43.479539+0000","last_clean":"2023-07-20T10:06:43.479539+0000","last_became_active":"2023-07-20T10:06:43.477161+0000","last_became_peered":"2023-07-20T10:06:43.477161+0000","last_unstale":"2023-07-20T10:06:43.479539+0000","last_undegraded":"2023-07-20T10:06:43.479539+0000","last_fullsized":"2023-07-20T10:06:43.479539+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:53:56.539245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458575+0000","last_change":"2023-07-20T10:06:43.458575+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458575+0000","last_undegraded":"2023-07-20T10:06:43.458575+0000","last_fullsized":"2023-07-20T10:06:43.458575+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474241+0000","last_change":"2023-07-20T10:06:43.470913+0000","last_active":"2023-07-20T10:06:43.474241+0000","last_peered":"2023-07-20T10:06:43.474241+0000","last_clean":"2023-07-20T10:06:43.474241+0000","last_became_active":"2023-07-20T10:06:43.470632+0000","last_became_peered":"2023-07-20T10:06:43.470632+0000","last_unstale":"2023-07-20T10:06:43.474241+0000","last_undegraded":"2023-07-20T10:06:43.474241+0000","last_fullsized":"2023-07-20T10:06:43.474241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:53:57.136625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452279+0000","last_change":"2023-07-20T10:06:43.452279+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452279+0000","last_undegraded":"2023-07-20T10:06:43.452279+0000","last_fullsized":"2023-07-20T10:06:43.452279+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472030+0000","last_change":"2023-07-20T10:06:43.469587+0000","last_active":"2023-07-20T10:06:43.472030+0000","last_peered":"2023-07-20T10:06:43.472030+0000","last_clean":"2023-07-20T10:06:43.472030+0000","last_became_active":"2023-07-20T10:06:43.469322+0000","last_became_peered":"2023-07-20T10:06:43.469322+0000","last_unstale":"2023-07-20T10:06:43.472030+0000","last_undegraded":"2023-07-20T10:06:43.472030+0000","last_fullsized":"2023-07-20T10:06:43.472030+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:27.910463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452322+0000","last_change":"2023-07-20T10:06:43.452322+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452322+0000","last_undegraded":"2023-07-20T10:06:43.452322+0000","last_fullsized":"2023-07-20T10:06:43.452322+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471307+0000","last_change":"2023-07-20T10:06:43.467283+0000","last_active":"2023-07-20T10:06:43.471307+0000","last_peered":"2023-07-20T10:06:43.471307+0000","last_clean":"2023-07-20T10:06:43.471307+0000","last_became_active":"2023-07-20T10:06:43.467005+0000","last_became_peered":"2023-07-20T10:06:43.467005+0000","last_unstale":"2023-07-20T10:06:43.471307+0000","last_undegraded":"2023-07-20T10:06:43.471307+0000","last_fullsized":"2023-07-20T10:06:43.471307+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:46.250920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463086+0000","last_change":"2023-07-20T10:06:43.463086+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463086+0000","last_undegraded":"2023-07-20T10:06:43.463086+0000","last_fullsized":"2023-07-20T10:06:43.463086+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481072+0000","last_change":"2023-07-20T10:06:43.478374+0000","last_active":"2023-07-20T10:06:43.481072+0000","last_peered":"2023-07-20T10:06:43.481072+0000","last_clean":"2023-07-20T10:06:43.481072+0000","last_became_active":"2023-07-20T10:06:43.478050+0000","last_became_peered":"2023-07-20T10:06:43.478050+0000","last_unstale":"2023-07-20T10:06:43.481072+0000","last_undegraded":"2023-07-20T10:06:43.481072+0000","last_fullsized":"2023-07-20T10:06:43.481072+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:54.399950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455916+0000","last_change":"2023-07-20T10:06:43.455916+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455916+0000","last_undegraded":"2023-07-20T10:06:43.455916+0000","last_fullsized":"2023-07-20T10:06:43.455916+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472841+0000","last_change":"2023-07-20T10:06:43.471424+0000","last_active":"2023-07-20T10:06:43.472841+0000","last_peered":"2023-07-20T10:06:43.472841+0000","last_clean":"2023-07-20T10:06:43.472841+0000","last_became_active":"2023-07-20T10:06:43.471115+0000","last_became_peered":"2023-07-20T10:06:43.471115+0000","last_unstale":"2023-07-20T10:06:43.472841+0000","last_undegraded":"2023-07-20T10:06:43.472841+0000","last_fullsized":"2023-07-20T10:06:43.472841+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:58.327337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456383+0000","last_change":"2023-07-20T10:06:43.456383+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456383+0000","last_undegraded":"2023-07-20T10:06:43.456383+0000","last_fullsized":"2023-07-20T10:06:43.456383+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476033+0000","last_change":"2023-07-20T10:06:43.474819+0000","last_active":"2023-07-20T10:06:43.476033+0000","last_peered":"2023-07-20T10:06:43.476033+0000","last_clean":"2023-07-20T10:06:43.476033+0000","last_became_active":"2023-07-20T10:06:43.474441+0000","last_became_peered":"2023-07-20T10:06:43.474441+0000","last_unstale":"2023-07-20T10:06:43.476033+0000","last_undegraded":"2023-07-20T10:06:43.476033+0000","last_fullsized":"2023-07-20T10:06:43.476033+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:18.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463112+0000","last_change":"2023-07-20T10:06:43.463112+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463112+0000","last_undegraded":"2023-07-20T10:06:43.463112+0000","last_fullsized":"2023-07-20T10:06:43.463112+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475262+0000","last_change":"2023-07-20T10:06:43.471746+0000","last_active":"2023-07-20T10:06:43.475262+0000","last_peered":"2023-07-20T10:06:43.475262+0000","last_clean":"2023-07-20T10:06:43.475262+0000","last_became_active":"2023-07-20T10:06:43.471193+0000","last_became_peered":"2023-07-20T10:06:43.471193+0000","last_unstale":"2023-07-20T10:06:43.475262+0000","last_undegraded":"2023-07-20T10:06:43.475262+0000","last_fullsized":"2023-07-20T10:06:43.475262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:21.480571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452439+0000","last_change":"2023-07-20T10:06:43.452439+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452439+0000","last_undegraded":"2023-07-20T10:06:43.452439+0000","last_fullsized":"2023-07-20T10:06:43.452439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474292+0000","last_change":"2023-07-20T10:06:43.471548+0000","last_active":"2023-07-20T10:06:43.474292+0000","last_peered":"2023-07-20T10:06:43.474292+0000","last_clean":"2023-07-20T10:06:43.474292+0000","last_became_active":"2023-07-20T10:06:43.471209+0000","last_became_peered":"2023-07-20T10:06:43.471209+0000","last_unstale":"2023-07-20T10:06:43.474292+0000","last_undegraded":"2023-07-20T10:06:43.474292+0000","last_fullsized":"2023-07-20T10:06:43.474292+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:09:05.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454635+0000","last_change":"2023-07-20T10:06:43.454635+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454635+0000","last_undegraded":"2023-07-20T10:06:43.454635+0000","last_fullsized":"2023-07-20T10:06:43.454635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476018+0000","last_change":"2023-07-20T10:06:43.472376+0000","last_active":"2023-07-20T10:06:43.476018+0000","last_peered":"2023-07-20T10:06:43.476018+0000","last_clean":"2023-07-20T10:06:43.476018+0000","last_became_active":"2023-07-20T10:06:43.470495+0000","last_became_peered":"2023-07-20T10:06:43.470495+0000","last_unstale":"2023-07-20T10:06:43.476018+0000","last_undegraded":"2023-07-20T10:06:43.476018+0000","last_fullsized":"2023-07-20T10:06:43.476018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:19.495788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460712+0000","last_change":"2023-07-20T10:06:43.460712+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460712+0000","last_undegraded":"2023-07-20T10:06:43.460712+0000","last_fullsized":"2023-07-20T10:06:43.460712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472633+0000","last_change":"2023-07-20T10:06:43.469684+0000","last_active":"2023-07-20T10:06:43.472633+0000","last_peered":"2023-07-20T10:06:43.472633+0000","last_clean":"2023-07-20T10:06:43.472633+0000","last_became_active":"2023-07-20T10:06:43.469320+0000","last_became_peered":"2023-07-20T10:06:43.469320+0000","last_unstale":"2023-07-20T10:06:43.472633+0000","last_undegraded":"2023-07-20T10:06:43.472633+0000","last_fullsized":"2023-07-20T10:06:43.472633+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:47.597305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456774+0000","last_change":"2023-07-20T10:06:43.456774+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456774+0000","last_undegraded":"2023-07-20T10:06:43.456774+0000","last_fullsized":"2023-07-20T10:06:43.456774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479575+0000","last_change":"2023-07-20T10:06:43.477319+0000","last_active":"2023-07-20T10:06:43.479575+0000","last_peered":"2023-07-20T10:06:43.479575+0000","last_clean":"2023-07-20T10:06:43.479575+0000","last_became_active":"2023-07-20T10:06:43.477040+0000","last_became_peered":"2023-07-20T10:06:43.477040+0000","last_unstale":"2023-07-20T10:06:43.479575+0000","last_undegraded":"2023-07-20T10:06:43.479575+0000","last_fullsized":"2023-07-20T10:06:43.479575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:02.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.467015+0000","last_change":"2023-07-20T10:06:43.467015+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.467015+0000","last_undegraded":"2023-07-20T10:06:43.467015+0000","last_fullsized":"2023-07-20T10:06:43.467015+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472135+0000","last_change":"2023-07-20T10:06:43.469770+0000","last_active":"2023-07-20T10:06:43.472135+0000","last_peered":"2023-07-20T10:06:43.472135+0000","last_clean":"2023-07-20T10:06:43.472135+0000","last_became_active":"2023-07-20T10:06:43.469494+0000","last_became_peered":"2023-07-20T10:06:43.469494+0000","last_unstale":"2023-07-20T10:06:43.472135+0000","last_undegraded":"2023-07-20T10:06:43.472135+0000","last_fullsized":"2023-07-20T10:06:43.472135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:27:51.397197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"96'183","reported_seq":557,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468930+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:43.468930+0000","last_peered":"2023-07-20T10:06:43.468930+0000","last_clean":"2023-07-20T10:06:43.468930+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:43.468930+0000","last_undegraded":"2023-07-20T10:06:43.468930+0000","last_fullsized":"2023-07-20T10:06:43.468930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:35:40.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.460064+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:43.460064+0000","last_peered":"2023-07-20T10:06:43.460064+0000","last_clean":"2023-07-20T10:06:43.460064+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:43.460064+0000","last_undegraded":"2023-07-20T10:06:43.460064+0000","last_fullsized":"2023-07-20T10:06:43.460064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:19.864356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458273+0000","last_change":"2023-07-20T10:06:43.458273+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458273+0000","last_undegraded":"2023-07-20T10:06:43.458273+0000","last_fullsized":"2023-07-20T10:06:43.458273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.461612+0000","last_change":"2023-07-20T10:06:43.461612+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461612+0000","last_undegraded":"2023-07-20T10:06:43.461612+0000","last_fullsized":"2023-07-20T10:06:43.461612+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:08.509539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468810+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:43.468810+0000","last_peered":"2023-07-20T10:06:43.468810+0000","last_clean":"2023-07-20T10:06:43.468810+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:43.468810+0000","last_undegraded":"2023-07-20T10:06:43.468810+0000","last_fullsized":"2023-07-20T10:06:43.468810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:45:56.836205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460811+0000","last_change":"2023-07-20T10:06:43.460811+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460811+0000","last_undegraded":"2023-07-20T10:06:43.460811+0000","last_fullsized":"2023-07-20T10:06:43.460811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481063+0000","last_change":"2023-07-20T10:06:43.478316+0000","last_active":"2023-07-20T10:06:43.481063+0000","last_peered":"2023-07-20T10:06:43.481063+0000","last_clean":"2023-07-20T10:06:43.481063+0000","last_became_active":"2023-07-20T10:06:43.477958+0000","last_became_peered":"2023-07-20T10:06:43.477958+0000","last_unstale":"2023-07-20T10:06:43.481063+0000","last_undegraded":"2023-07-20T10:06:43.481063+0000","last_fullsized":"2023-07-20T10:06:43.481063+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:02.877329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.450090+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:43.450090+0000","last_peered":"2023-07-20T10:06:43.450090+0000","last_clean":"2023-07-20T10:06:43.450090+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:43.450090+0000","last_undegraded":"2023-07-20T10:06:43.450090+0000","last_fullsized":"2023-07-20T10:06:43.450090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:42.662902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460547+0000","last_change":"2023-07-20T10:06:43.460547+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460547+0000","last_undegraded":"2023-07-20T10:06:43.460547+0000","last_fullsized":"2023-07-20T10:06:43.460547+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476014+0000","last_change":"2023-07-20T10:06:43.474746+0000","last_active":"2023-07-20T10:06:43.476014+0000","last_peered":"2023-07-20T10:06:43.476014+0000","last_clean":"2023-07-20T10:06:43.476014+0000","last_became_active":"2023-07-20T10:06:43.473956+0000","last_became_peered":"2023-07-20T10:06:43.473956+0000","last_unstale":"2023-07-20T10:06:43.476014+0000","last_undegraded":"2023-07-20T10:06:43.476014+0000","last_fullsized":"2023-07-20T10:06:43.476014+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:40:45.913787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.462393+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:43.462393+0000","last_peered":"2023-07-20T10:06:43.462393+0000","last_clean":"2023-07-20T10:06:43.462393+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:43.462393+0000","last_undegraded":"2023-07-20T10:06:43.462393+0000","last_fullsized":"2023-07-20T10:06:43.462393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:54.575030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456458+0000","last_change":"2023-07-20T10:06:43.456458+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456458+0000","last_undegraded":"2023-07-20T10:06:43.456458+0000","last_fullsized":"2023-07-20T10:06:43.456458+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474224+0000","last_change":"2023-07-20T10:06:43.469866+0000","last_active":"2023-07-20T10:06:43.474224+0000","last_peered":"2023-07-20T10:06:43.474224+0000","last_clean":"2023-07-20T10:06:43.474224+0000","last_became_active":"2023-07-20T10:06:43.469563+0000","last_became_peered":"2023-07-20T10:06:43.469563+0000","last_unstale":"2023-07-20T10:06:43.474224+0000","last_undegraded":"2023-07-20T10:06:43.474224+0000","last_fullsized":"2023-07-20T10:06:43.474224+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:23.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464871+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:43.464871+0000","last_peered":"2023-07-20T10:06:43.464871+0000","last_clean":"2023-07-20T10:06:43.464871+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:43.464871+0000","last_undegraded":"2023-07-20T10:06:43.464871+0000","last_fullsized":"2023-07-20T10:06:43.464871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:06:44.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458397+0000","last_change":"2023-07-20T10:06:43.458397+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458397+0000","last_undegraded":"2023-07-20T10:06:43.458397+0000","last_fullsized":"2023-07-20T10:06:43.458397+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475911+0000","last_change":"2023-07-20T10:06:43.472464+0000","last_active":"2023-07-20T10:06:43.475911+0000","last_peered":"2023-07-20T10:06:43.475911+0000","last_clean":"2023-07-20T10:06:43.475911+0000","last_became_active":"2023-07-20T10:06:43.472186+0000","last_became_peered":"2023-07-20T10:06:43.472186+0000","last_unstale":"2023-07-20T10:06:43.475911+0000","last_undegraded":"2023-07-20T10:06:43.475911+0000","last_fullsized":"2023-07-20T10:06:43.475911+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:29:46.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.470891+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:43.470891+0000","last_peered":"2023-07-20T10:06:43.470891+0000","last_clean":"2023-07-20T10:06:43.470891+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:43.470891+0000","last_undegraded":"2023-07-20T10:06:43.470891+0000","last_fullsized":"2023-07-20T10:06:43.470891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:25:33.896767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462072+0000","last_change":"2023-07-20T10:06:43.462072+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462072+0000","last_undegraded":"2023-07-20T10:06:43.462072+0000","last_fullsized":"2023-07-20T10:06:43.462072+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475981+0000","last_change":"2023-07-20T10:06:43.471785+0000","last_active":"2023-07-20T10:06:43.475981+0000","last_peered":"2023-07-20T10:06:43.475981+0000","last_clean":"2023-07-20T10:06:43.475981+0000","last_became_active":"2023-07-20T10:06:43.471478+0000","last_became_peered":"2023-07-20T10:06:43.471478+0000","last_unstale":"2023-07-20T10:06:43.475981+0000","last_undegraded":"2023-07-20T10:06:43.475981+0000","last_fullsized":"2023-07-20T10:06:43.475981+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:19.770806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.463053+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:43.463053+0000","last_peered":"2023-07-20T10:06:43.463053+0000","last_clean":"2023-07-20T10:06:43.463053+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:43.463053+0000","last_undegraded":"2023-07-20T10:06:43.463053+0000","last_fullsized":"2023-07-20T10:06:43.463053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:36:34.717075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457248+0000","last_change":"2023-07-20T10:06:43.457248+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457248+0000","last_undegraded":"2023-07-20T10:06:43.457248+0000","last_fullsized":"2023-07-20T10:06:43.457248+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.466189+0000","last_change":"2023-07-20T10:06:43.462009+0000","last_active":"2023-07-20T10:06:43.466189+0000","last_peered":"2023-07-20T10:06:43.466189+0000","last_clean":"2023-07-20T10:06:43.466189+0000","last_became_active":"2023-07-20T10:06:43.461708+0000","last_became_peered":"2023-07-20T10:06:43.461708+0000","last_unstale":"2023-07-20T10:06:43.466189+0000","last_undegraded":"2023-07-20T10:06:43.466189+0000","last_fullsized":"2023-07-20T10:06:43.466189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:26.249050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464129+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:43.464129+0000","last_peered":"2023-07-20T10:06:43.464129+0000","last_clean":"2023-07-20T10:06:43.464129+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:43.464129+0000","last_undegraded":"2023-07-20T10:06:43.464129+0000","last_fullsized":"2023-07-20T10:06:43.464129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:08:24.570614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59184,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312656,"statfs":{"total":96636764160,"available":96576159744,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.871}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.872},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":1.0069999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.085},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68200000000000005,"15min":0.71599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":1.22,"15min":1.363},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70799999999999996,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.177,"15min":1.177},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.55100000000000005,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.204,"15min":1.23},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.874}]},{"osd":5,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.98899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.196},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.84999999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.749},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":1.034},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.876,"15min":1.2649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.57299999999999995,"5min":0.69299999999999995,"15min":0.81899999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46800000000000003,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.68700000000000006,"15min":0.70299999999999996},"last":0.317}]},{"osd":1,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.495}]},{"osd":4,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1890000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.381},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.504,"15min":0.502},"max":{"1min":0.83099999999999996,"5min":1.04,"15min":1.131},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86299999999999999,"5min":0.97699999999999998,"15min":1.4399999999999999},"last":0.749},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.86199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54508,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317332,"statfs":{"total":96636764160,"available":96580947968,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.312},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.377}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.626}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":4.0190000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":3.9750000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":3.3919999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.034}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":3.5139999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":4.1470000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:48.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:49.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 Processor -- start 2023-07-20T10:06:49.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 -- start start 2023-07-20T10:06:49.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3d6c0b1cc0 0x7f3d6c0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c0cdd60 con 0x7f3d6c0b04b0 2023-07-20T10:06:49.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d6c0b20a0 con 0x7f3d6c0ad720 2023-07-20T10:06:49.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d73b40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6c0cd430 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d720dd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3d6c0b04b0 0x7f3d6c160660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49560/0 (socket says 172.21.15.82:49560) 2023-07-20T10:06:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d720dd640 1 -- 172.21.15.82:0/3414064375 learned_addr learned my addr 172.21.15.82:0/3414064375 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:49.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.093+0000 7f3d718dc640 1 --2- 172.21.15.82:0/3414064375 >> v2:172.21.15.183:3300/0 conn(0x7f3d6c0b1cc0 0x7f3d6c0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618977406 0 0) 0x7f3d6c0cdd60 con 0x7f3d6c0b04b0 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d58003530 con 0x7f3d6c0b04b0 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043060693 0 0) 0x7f3d6c0b20a0 con 0x7f3d6c0ad720 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c0cdd60 con 0x7f3d6c0ad720 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d718dc640 1 -- 172.21.15.82:0/3414064375 >> v1:172.21.15.183:6789/0 conn(0x7f3d6c0ad720 legacy=0x7f3d6c0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d718dc640 1 -- 172.21.15.82:0/3414064375 >> v1:172.21.15.82:6789/0 conn(0x7f3d6c0b04b0 legacy=0x7f3d6c160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d718dc640 1 -- 172.21.15.82:0/3414064375 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0cd710 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d718dc640 1 --2- 172.21.15.82:0/3414064375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b1cc0 0x7f3d6c0b2a30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d680097c0 tx=0x7f3d6801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff205197493e511 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680ac640 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d680ac7a0 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d708da640 1 -- 172.21.15.82:0/3414064375 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680acb30 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.097+0000 7f3d73b40640 1 -- 172.21.15.82:0/3414064375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b1cc0 msgr2=0x7f3d6c0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3414064375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b1cc0 0x7f3d6c0b2a30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3d680097c0 tx=0x7f3d6801c3c0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- 172.21.15.82:0/3414064375 shutdown_connections 2023-07-20T10:06:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3414064375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b1cc0 0x7f3d6c0b2a30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- 172.21.15.82:0/3414064375 >> 172.21.15.82:0/3414064375 conn(0x7f3d6c0cada0 msgr2=0x7f3d6c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- 172.21.15.82:0/3414064375 shutdown_connections 2023-07-20T10:06:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- 172.21.15.82:0/3414064375 wait complete. 2023-07-20T10:06:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 Processor -- start 2023-07-20T10:06:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- start start 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b04b0 0x7f3d6c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d6c0b1cc0 0x7f3d6c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c1599a0 con 0x7f3d6c0ad720 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0af050 con 0x7f3d6c0b04b0 2023-07-20T10:06:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d73b40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0af330 con 0x7f3d6c0b1cc0 2023-07-20T10:06:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41126/0 (socket says 172.21.15.82:41126) 2023-07-20T10:06:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 -- 172.21.15.82:0/3720257535 learned_addr learned my addr 172.21.15.82:0/3720257535 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d720dd640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d6c0b1cc0 0x7f3d6c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d710db640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b04b0 0x7f3d6c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 -- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d6c0b1cc0 msgr2=0x7f3d6c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d6c0b1cc0 0x7f3d6c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 -- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b04b0 msgr2=0x7f3d6c0ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b04b0 0x7f3d6c0ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.101+0000 7f3d718dc640 1 -- 172.21.15.82:0/3720257535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68009420 con 0x7f3d6c0ad720 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d718dc640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f3d68018fd0 tx=0x7f3d68019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680b5610 con 0x7f3d6c0ad720 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d680b5790 con 0x7f3d6c0ad720 2023-07-20T10:06:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680b5b40 con 0x7f3d6c0ad720 2023-07-20T10:06:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c0b12f0 con 0x7f3d6c0ad720 2023-07-20T10:06:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c159630 con 0x7f3d6c0ad720 2023-07-20T10:06:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6c073c70 con 0x7f3d6c0ad720 2023-07-20T10:06:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3d680b3040 con 0x7f3d6c0ad720 2023-07-20T10:06:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 0x7f3d50068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d6811da00 con 0x7f3d6c0ad720 2023-07-20T10:06:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.105+0000 7f3d710db640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 0x7f3d50068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.109+0000 7f3d710db640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 0x7f3d50068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0acff0 tx=0x7f3d5c009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.109+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d680eae90 con 0x7f3d6c0ad720 2023-07-20T10:06:49.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.253+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d6c0af1c0 con 0x7f3d500663d0 2023-07-20T10:06:49.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.261+0000 7f3d627fc640 1 -- 172.21.15.82:0/3720257535 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306586 (secure 0 0 0) 0x7f3d6c0af1c0 con 0x7f3d500663d0 2023-07-20T10:06:49.244 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:49.245 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:49.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 msgr2=0x7f3d50068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 0x7f3d50068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0acff0 tx=0x7f3d5c009040 comp rx=0 tx=0).stop 2023-07-20T10:06:49.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 msgr2=0x7f3d6c14ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f3d68018fd0 tx=0x7f3d68019160 comp rx=0 tx=0).stop 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 shutdown_connections 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f3d500663d0 0x7f3d50068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d6c0b1cc0 0x7f3d6c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d6c0b04b0 0x7f3d6c0ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 --2- 172.21.15.82:0/3720257535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d6c0ad720 0x7f3d6c14ebe0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 >> 172.21.15.82:0/3720257535 conn(0x7f3d6c0cada0 msgr2=0x7f3d6c06fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:49.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 shutdown_connections 2023-07-20T10:06:49.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.265+0000 7f3d73b40640 1 -- 172.21.15.82:0/3720257535 wait complete. 2023-07-20T10:06:49.264 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T10:06:47.479121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312552,"kb_used_data":11144,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754662168,"statfs":{"total":773094113280,"available":772774060032,"internally_reserved":0,"allocated":11411456,"data_stored":6265256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.040307"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453138+0000","last_change":"2023-07-20T10:06:43.453138+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453138+0000","last_undegraded":"2023-07-20T10:06:43.453138+0000","last_fullsized":"2023-07-20T10:06:43.453138+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462647+0000","last_change":"2023-07-20T10:06:43.462647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462647+0000","last_undegraded":"2023-07-20T10:06:43.462647+0000","last_fullsized":"2023-07-20T10:06:43.462647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454149+0000","last_change":"2023-07-20T10:06:43.454149+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454149+0000","last_undegraded":"2023-07-20T10:06:43.454149+0000","last_fullsized":"2023-07-20T10:06:43.454149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464505+0000","last_change":"2023-07-20T10:06:43.464505+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464505+0000","last_undegraded":"2023-07-20T10:06:43.464505+0000","last_fullsized":"2023-07-20T10:06:43.464505+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460690+0000","last_change":"2023-07-20T10:06:43.460690+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460690+0000","last_undegraded":"2023-07-20T10:06:43.460690+0000","last_fullsized":"2023-07-20T10:06:43.460690+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456826+0000","last_change":"2023-07-20T10:06:43.456826+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456826+0000","last_undegraded":"2023-07-20T10:06:43.456826+0000","last_fullsized":"2023-07-20T10:06:43.456826+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466945+0000","last_change":"2023-07-20T10:06:43.466945+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466945+0000","last_undegraded":"2023-07-20T10:06:43.466945+0000","last_fullsized":"2023-07-20T10:06:43.466945+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457109+0000","last_change":"2023-07-20T10:06:43.457109+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457109+0000","last_undegraded":"2023-07-20T10:06:43.457109+0000","last_fullsized":"2023-07-20T10:06:43.457109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459312+0000","last_change":"2023-07-20T10:06:43.459312+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459312+0000","last_undegraded":"2023-07-20T10:06:43.459312+0000","last_fullsized":"2023-07-20T10:06:43.459312+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452720+0000","last_change":"2023-07-20T10:06:43.452720+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452720+0000","last_undegraded":"2023-07-20T10:06:43.452720+0000","last_fullsized":"2023-07-20T10:06:43.452720+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463736+0000","last_change":"2023-07-20T10:06:43.463736+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463736+0000","last_undegraded":"2023-07-20T10:06:43.463736+0000","last_fullsized":"2023-07-20T10:06:43.463736+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452403+0000","last_change":"2023-07-20T10:06:43.452403+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452403+0000","last_undegraded":"2023-07-20T10:06:43.452403+0000","last_fullsized":"2023-07-20T10:06:43.452403+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456648+0000","last_change":"2023-07-20T10:06:43.456648+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456648+0000","last_undegraded":"2023-07-20T10:06:43.456648+0000","last_fullsized":"2023-07-20T10:06:43.456648+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459909+0000","last_change":"2023-07-20T10:06:43.459909+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459909+0000","last_undegraded":"2023-07-20T10:06:43.459909+0000","last_fullsized":"2023-07-20T10:06:43.459909+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458578+0000","last_change":"2023-07-20T10:06:43.458578+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458578+0000","last_undegraded":"2023-07-20T10:06:43.458578+0000","last_fullsized":"2023-07-20T10:06:43.458578+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457467+0000","last_change":"2023-07-20T10:06:43.457467+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457467+0000","last_undegraded":"2023-07-20T10:06:43.457467+0000","last_fullsized":"2023-07-20T10:06:43.457467+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457437+0000","last_change":"2023-07-20T10:06:43.457437+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457437+0000","last_undegraded":"2023-07-20T10:06:43.457437+0000","last_fullsized":"2023-07-20T10:06:43.457437+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455558+0000","last_change":"2023-07-20T10:06:43.455558+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455558+0000","last_undegraded":"2023-07-20T10:06:43.455558+0000","last_fullsized":"2023-07-20T10:06:43.455558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459495+0000","last_change":"2023-07-20T10:06:43.459495+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459495+0000","last_undegraded":"2023-07-20T10:06:43.459495+0000","last_fullsized":"2023-07-20T10:06:43.459495+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.464042+0000","last_change":"2023-07-20T10:06:43.464042+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.464042+0000","last_undegraded":"2023-07-20T10:06:43.464042+0000","last_fullsized":"2023-07-20T10:06:43.464042+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460226+0000","last_change":"2023-07-20T10:06:43.460226+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460226+0000","last_undegraded":"2023-07-20T10:06:43.460226+0000","last_fullsized":"2023-07-20T10:06:43.460226+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459288+0000","last_change":"2023-07-20T10:06:43.459288+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459288+0000","last_undegraded":"2023-07-20T10:06:43.459288+0000","last_fullsized":"2023-07-20T10:06:43.459288+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463249+0000","last_change":"2023-07-20T10:06:43.463249+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463249+0000","last_undegraded":"2023-07-20T10:06:43.463249+0000","last_fullsized":"2023-07-20T10:06:43.463249+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.453695+0000","last_change":"2023-07-20T10:06:43.453695+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.453695+0000","last_undegraded":"2023-07-20T10:06:43.453695+0000","last_fullsized":"2023-07-20T10:06:43.453695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463647+0000","last_change":"2023-07-20T10:06:43.463647+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463647+0000","last_undegraded":"2023-07-20T10:06:43.463647+0000","last_fullsized":"2023-07-20T10:06:43.463647+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461058+0000","last_change":"2023-07-20T10:06:43.461058+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461058+0000","last_undegraded":"2023-07-20T10:06:43.461058+0000","last_fullsized":"2023-07-20T10:06:43.461058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452358+0000","last_change":"2023-07-20T10:06:43.452358+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452358+0000","last_undegraded":"2023-07-20T10:06:43.452358+0000","last_fullsized":"2023-07-20T10:06:43.452358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460758+0000","last_change":"2023-07-20T10:06:43.460758+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460758+0000","last_undegraded":"2023-07-20T10:06:43.460758+0000","last_fullsized":"2023-07-20T10:06:43.460758+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466460+0000","last_change":"2023-07-20T10:06:43.466460+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466460+0000","last_undegraded":"2023-07-20T10:06:43.466460+0000","last_fullsized":"2023-07-20T10:06:43.466460+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458212+0000","last_change":"2023-07-20T10:06:43.458212+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458212+0000","last_undegraded":"2023-07-20T10:06:43.458212+0000","last_fullsized":"2023-07-20T10:06:43.458212+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.459059+0000","last_change":"2023-07-20T10:06:43.459059+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.459059+0000","last_undegraded":"2023-07-20T10:06:43.459059+0000","last_fullsized":"2023-07-20T10:06:43.459059+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456980+0000","last_change":"2023-07-20T10:06:43.456980+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456980+0000","last_undegraded":"2023-07-20T10:06:43.456980+0000","last_fullsized":"2023-07-20T10:06:43.456980+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458676+0000","last_change":"2023-07-20T10:06:43.458676+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458676+0000","last_undegraded":"2023-07-20T10:06:43.458676+0000","last_fullsized":"2023-07-20T10:06:43.458676+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476636+0000","last_change":"2023-07-20T10:06:43.474094+0000","last_active":"2023-07-20T10:06:43.476636+0000","last_peered":"2023-07-20T10:06:43.476636+0000","last_clean":"2023-07-20T10:06:43.476636+0000","last_became_active":"2023-07-20T10:06:43.473779+0000","last_became_peered":"2023-07-20T10:06:43.473779+0000","last_unstale":"2023-07-20T10:06:43.476636+0000","last_undegraded":"2023-07-20T10:06:43.476636+0000","last_fullsized":"2023-07-20T10:06:43.476636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:27.575598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456453+0000","last_change":"2023-07-20T10:06:43.456453+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456453+0000","last_undegraded":"2023-07-20T10:06:43.456453+0000","last_fullsized":"2023-07-20T10:06:43.456453+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472820+0000","last_change":"2023-07-20T10:06:43.469840+0000","last_active":"2023-07-20T10:06:43.472820+0000","last_peered":"2023-07-20T10:06:43.472820+0000","last_clean":"2023-07-20T10:06:43.472820+0000","last_became_active":"2023-07-20T10:06:43.469543+0000","last_became_peered":"2023-07-20T10:06:43.469543+0000","last_unstale":"2023-07-20T10:06:43.472820+0000","last_undegraded":"2023-07-20T10:06:43.472820+0000","last_fullsized":"2023-07-20T10:06:43.472820+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:09.167707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466180+0000","last_change":"2023-07-20T10:06:43.466180+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466180+0000","last_undegraded":"2023-07-20T10:06:43.466180+0000","last_fullsized":"2023-07-20T10:06:43.466180+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481437+0000","last_change":"2023-07-20T10:06:43.480281+0000","last_active":"2023-07-20T10:06:43.481437+0000","last_peered":"2023-07-20T10:06:43.481437+0000","last_clean":"2023-07-20T10:06:43.481437+0000","last_became_active":"2023-07-20T10:06:43.479965+0000","last_became_peered":"2023-07-20T10:06:43.479965+0000","last_unstale":"2023-07-20T10:06:43.481437+0000","last_undegraded":"2023-07-20T10:06:43.481437+0000","last_fullsized":"2023-07-20T10:06:43.481437+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:45:41.292704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456920+0000","last_change":"2023-07-20T10:06:43.456920+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456920+0000","last_undegraded":"2023-07-20T10:06:43.456920+0000","last_fullsized":"2023-07-20T10:06:43.456920+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476971+0000","last_change":"2023-07-20T10:06:43.475691+0000","last_active":"2023-07-20T10:06:43.476971+0000","last_peered":"2023-07-20T10:06:43.476971+0000","last_clean":"2023-07-20T10:06:43.476971+0000","last_became_active":"2023-07-20T10:06:43.475393+0000","last_became_peered":"2023-07-20T10:06:43.475393+0000","last_unstale":"2023-07-20T10:06:43.476971+0000","last_undegraded":"2023-07-20T10:06:43.476971+0000","last_fullsized":"2023-07-20T10:06:43.476971+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:07.941110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458341+0000","last_change":"2023-07-20T10:06:43.458341+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458341+0000","last_undegraded":"2023-07-20T10:06:43.458341+0000","last_fullsized":"2023-07-20T10:06:43.458341+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471687+0000","last_change":"2023-07-20T10:06:43.469775+0000","last_active":"2023-07-20T10:06:43.471687+0000","last_peered":"2023-07-20T10:06:43.471687+0000","last_clean":"2023-07-20T10:06:43.471687+0000","last_became_active":"2023-07-20T10:06:43.469463+0000","last_became_peered":"2023-07-20T10:06:43.469463+0000","last_unstale":"2023-07-20T10:06:43.471687+0000","last_undegraded":"2023-07-20T10:06:43.471687+0000","last_fullsized":"2023-07-20T10:06:43.471687+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:35:09.433244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.461122+0000","last_change":"2023-07-20T10:06:43.461122+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461122+0000","last_undegraded":"2023-07-20T10:06:43.461122+0000","last_fullsized":"2023-07-20T10:06:43.461122+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471279+0000","last_change":"2023-07-20T10:06:43.467547+0000","last_active":"2023-07-20T10:06:43.471279+0000","last_peered":"2023-07-20T10:06:43.471279+0000","last_clean":"2023-07-20T10:06:43.471279+0000","last_became_active":"2023-07-20T10:06:43.467241+0000","last_became_peered":"2023-07-20T10:06:43.467241+0000","last_unstale":"2023-07-20T10:06:43.471279+0000","last_undegraded":"2023-07-20T10:06:43.471279+0000","last_fullsized":"2023-07-20T10:06:43.471279+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:46:38.434969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456298+0000","last_change":"2023-07-20T10:06:43.456298+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456298+0000","last_undegraded":"2023-07-20T10:06:43.456298+0000","last_fullsized":"2023-07-20T10:06:43.456298+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.454618+0000","last_change":"2023-07-20T10:06:43.454618+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454618+0000","last_undegraded":"2023-07-20T10:06:43.454618+0000","last_fullsized":"2023-07-20T10:06:43.454618+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:01:01.615753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455996+0000","last_change":"2023-07-20T10:06:43.455996+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455996+0000","last_undegraded":"2023-07-20T10:06:43.455996+0000","last_fullsized":"2023-07-20T10:06:43.455996+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479596+0000","last_change":"2023-07-20T10:06:43.477958+0000","last_active":"2023-07-20T10:06:43.479596+0000","last_peered":"2023-07-20T10:06:43.479596+0000","last_clean":"2023-07-20T10:06:43.479596+0000","last_became_active":"2023-07-20T10:06:43.476867+0000","last_became_peered":"2023-07-20T10:06:43.476867+0000","last_unstale":"2023-07-20T10:06:43.479596+0000","last_undegraded":"2023-07-20T10:06:43.479596+0000","last_fullsized":"2023-07-20T10:06:43.479596+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:55:17.042501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458231+0000","last_change":"2023-07-20T10:06:43.458231+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458231+0000","last_undegraded":"2023-07-20T10:06:43.458231+0000","last_fullsized":"2023-07-20T10:06:43.458231+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472211+0000","last_change":"2023-07-20T10:06:43.465731+0000","last_active":"2023-07-20T10:06:43.472211+0000","last_peered":"2023-07-20T10:06:43.472211+0000","last_clean":"2023-07-20T10:06:43.472211+0000","last_became_active":"2023-07-20T10:06:43.465435+0000","last_became_peered":"2023-07-20T10:06:43.465435+0000","last_unstale":"2023-07-20T10:06:43.472211+0000","last_undegraded":"2023-07-20T10:06:43.472211+0000","last_fullsized":"2023-07-20T10:06:43.472211+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:33.995162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.466408+0000","last_change":"2023-07-20T10:06:43.466408+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.466408+0000","last_undegraded":"2023-07-20T10:06:43.466408+0000","last_fullsized":"2023-07-20T10:06:43.466408+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":8,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472162+0000","last_change":"2023-07-20T10:06:43.472162+0000","last_active":"2023-07-20T10:06:43.472162+0000","last_peered":"2023-07-20T10:06:43.472162+0000","last_clean":"2023-07-20T10:06:43.472162+0000","last_became_active":"2023-07-20T10:06:43.471820+0000","last_became_peered":"2023-07-20T10:06:43.471820+0000","last_unstale":"2023-07-20T10:06:43.472162+0000","last_undegraded":"2023-07-20T10:06:43.472162+0000","last_fullsized":"2023-07-20T10:06:43.472162+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:41.452066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455082+0000","last_change":"2023-07-20T10:06:43.455082+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455082+0000","last_undegraded":"2023-07-20T10:06:43.455082+0000","last_fullsized":"2023-07-20T10:06:43.455082+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476905+0000","last_change":"2023-07-20T10:06:43.474965+0000","last_active":"2023-07-20T10:06:43.476905+0000","last_peered":"2023-07-20T10:06:43.476905+0000","last_clean":"2023-07-20T10:06:43.476905+0000","last_became_active":"2023-07-20T10:06:43.474482+0000","last_became_peered":"2023-07-20T10:06:43.474482+0000","last_unstale":"2023-07-20T10:06:43.476905+0000","last_undegraded":"2023-07-20T10:06:43.476905+0000","last_fullsized":"2023-07-20T10:06:43.476905+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:31.786764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460286+0000","last_change":"2023-07-20T10:06:43.460286+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460286+0000","last_undegraded":"2023-07-20T10:06:43.460286+0000","last_fullsized":"2023-07-20T10:06:43.460286+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474142+0000","last_change":"2023-07-20T10:06:43.470986+0000","last_active":"2023-07-20T10:06:43.474142+0000","last_peered":"2023-07-20T10:06:43.474142+0000","last_clean":"2023-07-20T10:06:43.474142+0000","last_became_active":"2023-07-20T10:06:43.470639+0000","last_became_peered":"2023-07-20T10:06:43.470639+0000","last_unstale":"2023-07-20T10:06:43.474142+0000","last_undegraded":"2023-07-20T10:06:43.474142+0000","last_fullsized":"2023-07-20T10:06:43.474142+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:06:29.428334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457933+0000","last_change":"2023-07-20T10:06:43.457933+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457933+0000","last_undegraded":"2023-07-20T10:06:43.457933+0000","last_fullsized":"2023-07-20T10:06:43.457933+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479539+0000","last_change":"2023-07-20T10:06:43.477620+0000","last_active":"2023-07-20T10:06:43.479539+0000","last_peered":"2023-07-20T10:06:43.479539+0000","last_clean":"2023-07-20T10:06:43.479539+0000","last_became_active":"2023-07-20T10:06:43.477161+0000","last_became_peered":"2023-07-20T10:06:43.477161+0000","last_unstale":"2023-07-20T10:06:43.479539+0000","last_undegraded":"2023-07-20T10:06:43.479539+0000","last_fullsized":"2023-07-20T10:06:43.479539+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:53:56.539245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458575+0000","last_change":"2023-07-20T10:06:43.458575+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458575+0000","last_undegraded":"2023-07-20T10:06:43.458575+0000","last_fullsized":"2023-07-20T10:06:43.458575+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474241+0000","last_change":"2023-07-20T10:06:43.470913+0000","last_active":"2023-07-20T10:06:43.474241+0000","last_peered":"2023-07-20T10:06:43.474241+0000","last_clean":"2023-07-20T10:06:43.474241+0000","last_became_active":"2023-07-20T10:06:43.470632+0000","last_became_peered":"2023-07-20T10:06:43.470632+0000","last_unstale":"2023-07-20T10:06:43.474241+0000","last_undegraded":"2023-07-20T10:06:43.474241+0000","last_fullsized":"2023-07-20T10:06:43.474241+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:53:57.136625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452279+0000","last_change":"2023-07-20T10:06:43.452279+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452279+0000","last_undegraded":"2023-07-20T10:06:43.452279+0000","last_fullsized":"2023-07-20T10:06:43.452279+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472030+0000","last_change":"2023-07-20T10:06:43.469587+0000","last_active":"2023-07-20T10:06:43.472030+0000","last_peered":"2023-07-20T10:06:43.472030+0000","last_clean":"2023-07-20T10:06:43.472030+0000","last_became_active":"2023-07-20T10:06:43.469322+0000","last_became_peered":"2023-07-20T10:06:43.469322+0000","last_unstale":"2023-07-20T10:06:43.472030+0000","last_undegraded":"2023-07-20T10:06:43.472030+0000","last_fullsized":"2023-07-20T10:06:43.472030+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:27.910463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452322+0000","last_change":"2023-07-20T10:06:43.452322+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452322+0000","last_undegraded":"2023-07-20T10:06:43.452322+0000","last_fullsized":"2023-07-20T10:06:43.452322+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.471307+0000","last_change":"2023-07-20T10:06:43.467283+0000","last_active":"2023-07-20T10:06:43.471307+0000","last_peered":"2023-07-20T10:06:43.471307+0000","last_clean":"2023-07-20T10:06:43.471307+0000","last_became_active":"2023-07-20T10:06:43.467005+0000","last_became_peered":"2023-07-20T10:06:43.467005+0000","last_unstale":"2023-07-20T10:06:43.471307+0000","last_undegraded":"2023-07-20T10:06:43.471307+0000","last_fullsized":"2023-07-20T10:06:43.471307+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:46.250920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463086+0000","last_change":"2023-07-20T10:06:43.463086+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463086+0000","last_undegraded":"2023-07-20T10:06:43.463086+0000","last_fullsized":"2023-07-20T10:06:43.463086+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481072+0000","last_change":"2023-07-20T10:06:43.478374+0000","last_active":"2023-07-20T10:06:43.481072+0000","last_peered":"2023-07-20T10:06:43.481072+0000","last_clean":"2023-07-20T10:06:43.481072+0000","last_became_active":"2023-07-20T10:06:43.478050+0000","last_became_peered":"2023-07-20T10:06:43.478050+0000","last_unstale":"2023-07-20T10:06:43.481072+0000","last_undegraded":"2023-07-20T10:06:43.481072+0000","last_fullsized":"2023-07-20T10:06:43.481072+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:01:54.399950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.455916+0000","last_change":"2023-07-20T10:06:43.455916+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.455916+0000","last_undegraded":"2023-07-20T10:06:43.455916+0000","last_fullsized":"2023-07-20T10:06:43.455916+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472841+0000","last_change":"2023-07-20T10:06:43.471424+0000","last_active":"2023-07-20T10:06:43.472841+0000","last_peered":"2023-07-20T10:06:43.472841+0000","last_clean":"2023-07-20T10:06:43.472841+0000","last_became_active":"2023-07-20T10:06:43.471115+0000","last_became_peered":"2023-07-20T10:06:43.471115+0000","last_unstale":"2023-07-20T10:06:43.472841+0000","last_undegraded":"2023-07-20T10:06:43.472841+0000","last_fullsized":"2023-07-20T10:06:43.472841+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:58.327337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456383+0000","last_change":"2023-07-20T10:06:43.456383+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456383+0000","last_undegraded":"2023-07-20T10:06:43.456383+0000","last_fullsized":"2023-07-20T10:06:43.456383+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476033+0000","last_change":"2023-07-20T10:06:43.474819+0000","last_active":"2023-07-20T10:06:43.476033+0000","last_peered":"2023-07-20T10:06:43.476033+0000","last_clean":"2023-07-20T10:06:43.476033+0000","last_became_active":"2023-07-20T10:06:43.474441+0000","last_became_peered":"2023-07-20T10:06:43.474441+0000","last_unstale":"2023-07-20T10:06:43.476033+0000","last_undegraded":"2023-07-20T10:06:43.476033+0000","last_fullsized":"2023-07-20T10:06:43.476033+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:17:18.850130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.463112+0000","last_change":"2023-07-20T10:06:43.463112+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.463112+0000","last_undegraded":"2023-07-20T10:06:43.463112+0000","last_fullsized":"2023-07-20T10:06:43.463112+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475262+0000","last_change":"2023-07-20T10:06:43.471746+0000","last_active":"2023-07-20T10:06:43.475262+0000","last_peered":"2023-07-20T10:06:43.475262+0000","last_clean":"2023-07-20T10:06:43.475262+0000","last_became_active":"2023-07-20T10:06:43.471193+0000","last_became_peered":"2023-07-20T10:06:43.471193+0000","last_unstale":"2023-07-20T10:06:43.475262+0000","last_undegraded":"2023-07-20T10:06:43.475262+0000","last_fullsized":"2023-07-20T10:06:43.475262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:21.480571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.452439+0000","last_change":"2023-07-20T10:06:43.452439+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.452439+0000","last_undegraded":"2023-07-20T10:06:43.452439+0000","last_fullsized":"2023-07-20T10:06:43.452439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474292+0000","last_change":"2023-07-20T10:06:43.471548+0000","last_active":"2023-07-20T10:06:43.474292+0000","last_peered":"2023-07-20T10:06:43.474292+0000","last_clean":"2023-07-20T10:06:43.474292+0000","last_became_active":"2023-07-20T10:06:43.471209+0000","last_became_peered":"2023-07-20T10:06:43.471209+0000","last_unstale":"2023-07-20T10:06:43.474292+0000","last_undegraded":"2023-07-20T10:06:43.474292+0000","last_fullsized":"2023-07-20T10:06:43.474292+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:09:05.078165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.454635+0000","last_change":"2023-07-20T10:06:43.454635+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.454635+0000","last_undegraded":"2023-07-20T10:06:43.454635+0000","last_fullsized":"2023-07-20T10:06:43.454635+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476018+0000","last_change":"2023-07-20T10:06:43.472376+0000","last_active":"2023-07-20T10:06:43.476018+0000","last_peered":"2023-07-20T10:06:43.476018+0000","last_clean":"2023-07-20T10:06:43.476018+0000","last_became_active":"2023-07-20T10:06:43.470495+0000","last_became_peered":"2023-07-20T10:06:43.470495+0000","last_unstale":"2023-07-20T10:06:43.476018+0000","last_undegraded":"2023-07-20T10:06:43.476018+0000","last_fullsized":"2023-07-20T10:06:43.476018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:44:19.495788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460712+0000","last_change":"2023-07-20T10:06:43.460712+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460712+0000","last_undegraded":"2023-07-20T10:06:43.460712+0000","last_fullsized":"2023-07-20T10:06:43.460712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472633+0000","last_change":"2023-07-20T10:06:43.469684+0000","last_active":"2023-07-20T10:06:43.472633+0000","last_peered":"2023-07-20T10:06:43.472633+0000","last_clean":"2023-07-20T10:06:43.472633+0000","last_became_active":"2023-07-20T10:06:43.469320+0000","last_became_peered":"2023-07-20T10:06:43.469320+0000","last_unstale":"2023-07-20T10:06:43.472633+0000","last_undegraded":"2023-07-20T10:06:43.472633+0000","last_fullsized":"2023-07-20T10:06:43.472633+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:47.597305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456774+0000","last_change":"2023-07-20T10:06:43.456774+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456774+0000","last_undegraded":"2023-07-20T10:06:43.456774+0000","last_fullsized":"2023-07-20T10:06:43.456774+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.479575+0000","last_change":"2023-07-20T10:06:43.477319+0000","last_active":"2023-07-20T10:06:43.479575+0000","last_peered":"2023-07-20T10:06:43.479575+0000","last_clean":"2023-07-20T10:06:43.479575+0000","last_became_active":"2023-07-20T10:06:43.477040+0000","last_became_peered":"2023-07-20T10:06:43.477040+0000","last_unstale":"2023-07-20T10:06:43.479575+0000","last_undegraded":"2023-07-20T10:06:43.479575+0000","last_fullsized":"2023-07-20T10:06:43.479575+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:02.111225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.467015+0000","last_change":"2023-07-20T10:06:43.467015+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.467015+0000","last_undegraded":"2023-07-20T10:06:43.467015+0000","last_fullsized":"2023-07-20T10:06:43.467015+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.472135+0000","last_change":"2023-07-20T10:06:43.469770+0000","last_active":"2023-07-20T10:06:43.472135+0000","last_peered":"2023-07-20T10:06:43.472135+0000","last_clean":"2023-07-20T10:06:43.472135+0000","last_became_active":"2023-07-20T10:06:43.469494+0000","last_became_peered":"2023-07-20T10:06:43.469494+0000","last_unstale":"2023-07-20T10:06:43.472135+0000","last_undegraded":"2023-07-20T10:06:43.472135+0000","last_fullsized":"2023-07-20T10:06:43.472135+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:27:51.397197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"96'183","reported_seq":557,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468930+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:43.468930+0000","last_peered":"2023-07-20T10:06:43.468930+0000","last_clean":"2023-07-20T10:06:43.468930+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:43.468930+0000","last_undegraded":"2023-07-20T10:06:43.468930+0000","last_fullsized":"2023-07-20T10:06:43.468930+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:35:40.653071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.460064+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:43.460064+0000","last_peered":"2023-07-20T10:06:43.460064+0000","last_clean":"2023-07-20T10:06:43.460064+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:43.460064+0000","last_undegraded":"2023-07-20T10:06:43.460064+0000","last_fullsized":"2023-07-20T10:06:43.460064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:19.864356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458273+0000","last_change":"2023-07-20T10:06:43.458273+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458273+0000","last_undegraded":"2023-07-20T10:06:43.458273+0000","last_fullsized":"2023-07-20T10:06:43.458273+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":3,"reported_epoch":105,"state":"creating+activating","last_fresh":"2023-07-20T10:06:43.461612+0000","last_change":"2023-07-20T10:06:43.461612+0000","last_active":"2023-07-20T10:06:42.429282+0000","last_peered":"2023-07-20T10:06:42.429282+0000","last_clean":"2023-07-20T10:06:42.429282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.461612+0000","last_undegraded":"2023-07-20T10:06:43.461612+0000","last_fullsized":"2023-07-20T10:06:43.461612+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:08.509539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.468810+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:43.468810+0000","last_peered":"2023-07-20T10:06:43.468810+0000","last_clean":"2023-07-20T10:06:43.468810+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:43.468810+0000","last_undegraded":"2023-07-20T10:06:43.468810+0000","last_fullsized":"2023-07-20T10:06:43.468810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:45:56.836205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460811+0000","last_change":"2023-07-20T10:06:43.460811+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460811+0000","last_undegraded":"2023-07-20T10:06:43.460811+0000","last_fullsized":"2023-07-20T10:06:43.460811+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.481063+0000","last_change":"2023-07-20T10:06:43.478316+0000","last_active":"2023-07-20T10:06:43.481063+0000","last_peered":"2023-07-20T10:06:43.481063+0000","last_clean":"2023-07-20T10:06:43.481063+0000","last_became_active":"2023-07-20T10:06:43.477958+0000","last_became_peered":"2023-07-20T10:06:43.477958+0000","last_unstale":"2023-07-20T10:06:43.481063+0000","last_undegraded":"2023-07-20T10:06:43.481063+0000","last_fullsized":"2023-07-20T10:06:43.481063+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:02.877329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.450090+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:43.450090+0000","last_peered":"2023-07-20T10:06:43.450090+0000","last_clean":"2023-07-20T10:06:43.450090+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:43.450090+0000","last_undegraded":"2023-07-20T10:06:43.450090+0000","last_fullsized":"2023-07-20T10:06:43.450090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:42.662902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.460547+0000","last_change":"2023-07-20T10:06:43.460547+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.460547+0000","last_undegraded":"2023-07-20T10:06:43.460547+0000","last_fullsized":"2023-07-20T10:06:43.460547+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.476014+0000","last_change":"2023-07-20T10:06:43.474746+0000","last_active":"2023-07-20T10:06:43.476014+0000","last_peered":"2023-07-20T10:06:43.476014+0000","last_clean":"2023-07-20T10:06:43.476014+0000","last_became_active":"2023-07-20T10:06:43.473956+0000","last_became_peered":"2023-07-20T10:06:43.473956+0000","last_unstale":"2023-07-20T10:06:43.476014+0000","last_undegraded":"2023-07-20T10:06:43.476014+0000","last_fullsized":"2023-07-20T10:06:43.476014+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:40:45.913787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":182,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.462393+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:43.462393+0000","last_peered":"2023-07-20T10:06:43.462393+0000","last_clean":"2023-07-20T10:06:43.462393+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:43.462393+0000","last_undegraded":"2023-07-20T10:06:43.462393+0000","last_fullsized":"2023-07-20T10:06:43.462393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:54.575030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.456458+0000","last_change":"2023-07-20T10:06:43.456458+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.456458+0000","last_undegraded":"2023-07-20T10:06:43.456458+0000","last_fullsized":"2023-07-20T10:06:43.456458+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.474224+0000","last_change":"2023-07-20T10:06:43.469866+0000","last_active":"2023-07-20T10:06:43.474224+0000","last_peered":"2023-07-20T10:06:43.474224+0000","last_clean":"2023-07-20T10:06:43.474224+0000","last_became_active":"2023-07-20T10:06:43.469563+0000","last_became_peered":"2023-07-20T10:06:43.469563+0000","last_unstale":"2023-07-20T10:06:43.474224+0000","last_undegraded":"2023-07-20T10:06:43.474224+0000","last_fullsized":"2023-07-20T10:06:43.474224+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:23.367618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464871+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:43.464871+0000","last_peered":"2023-07-20T10:06:43.464871+0000","last_clean":"2023-07-20T10:06:43.464871+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:43.464871+0000","last_undegraded":"2023-07-20T10:06:43.464871+0000","last_fullsized":"2023-07-20T10:06:43.464871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:06:44.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.458397+0000","last_change":"2023-07-20T10:06:43.458397+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.458397+0000","last_undegraded":"2023-07-20T10:06:43.458397+0000","last_fullsized":"2023-07-20T10:06:43.458397+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475911+0000","last_change":"2023-07-20T10:06:43.472464+0000","last_active":"2023-07-20T10:06:43.475911+0000","last_peered":"2023-07-20T10:06:43.475911+0000","last_clean":"2023-07-20T10:06:43.475911+0000","last_became_active":"2023-07-20T10:06:43.472186+0000","last_became_peered":"2023-07-20T10:06:43.472186+0000","last_unstale":"2023-07-20T10:06:43.475911+0000","last_undegraded":"2023-07-20T10:06:43.475911+0000","last_fullsized":"2023-07-20T10:06:43.475911+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:29:46.301380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.470891+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:43.470891+0000","last_peered":"2023-07-20T10:06:43.470891+0000","last_clean":"2023-07-20T10:06:43.470891+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:43.470891+0000","last_undegraded":"2023-07-20T10:06:43.470891+0000","last_fullsized":"2023-07-20T10:06:43.470891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:25:33.896767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.462072+0000","last_change":"2023-07-20T10:06:43.462072+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.462072+0000","last_undegraded":"2023-07-20T10:06:43.462072+0000","last_fullsized":"2023-07-20T10:06:43.462072+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.475981+0000","last_change":"2023-07-20T10:06:43.471785+0000","last_active":"2023-07-20T10:06:43.475981+0000","last_peered":"2023-07-20T10:06:43.475981+0000","last_clean":"2023-07-20T10:06:43.475981+0000","last_became_active":"2023-07-20T10:06:43.471478+0000","last_became_peered":"2023-07-20T10:06:43.471478+0000","last_unstale":"2023-07-20T10:06:43.475981+0000","last_undegraded":"2023-07-20T10:06:43.475981+0000","last_fullsized":"2023-07-20T10:06:43.475981+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:19.770806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.463053+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:43.463053+0000","last_peered":"2023-07-20T10:06:43.463053+0000","last_clean":"2023-07-20T10:06:43.463053+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:43.463053+0000","last_undegraded":"2023-07-20T10:06:43.463053+0000","last_fullsized":"2023-07-20T10:06:43.463053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:36:34.717075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2023-07-20T10:06:43.457248+0000","last_change":"2023-07-20T10:06:43.457248+0000","last_active":"2023-07-20T10:06:43.438673+0000","last_peered":"2023-07-20T10:06:43.438673+0000","last_clean":"2023-07-20T10:06:43.438673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:06:43.457248+0000","last_undegraded":"2023-07-20T10:06:43.457248+0000","last_fullsized":"2023-07-20T10:06:43.457248+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.466189+0000","last_change":"2023-07-20T10:06:43.462009+0000","last_active":"2023-07-20T10:06:43.466189+0000","last_peered":"2023-07-20T10:06:43.466189+0000","last_clean":"2023-07-20T10:06:43.466189+0000","last_became_active":"2023-07-20T10:06:43.461708+0000","last_became_peered":"2023-07-20T10:06:43.461708+0000","last_unstale":"2023-07-20T10:06:43.466189+0000","last_undegraded":"2023-07-20T10:06:43.466189+0000","last_fullsized":"2023-07-20T10:06:43.466189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:26.249050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-07-20T10:06:43.464129+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:43.464129+0000","last_peered":"2023-07-20T10:06:43.464129+0000","last_clean":"2023-07-20T10:06:43.464129+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:43.464129+0000","last_undegraded":"2023-07-20T10:06:43.464129+0000","last_fullsized":"2023-07-20T10:06:43.464129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:08:24.570614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59184,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312656,"statfs":{"total":96636764160,"available":96576159744,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.72299999999999998,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86299999999999999,"5min":1.0069999999999999,"15min":1.0589999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82999999999999996,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89100000000000001,"5min":1.008,"15min":1.008},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.879,"5min":1.075,"15min":1.075},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81899999999999995,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.72699999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.89500000000000002,"5min":1.716,"15min":1.716},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.71799999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.502,"15min":0.433},"max":{"1min":0.84299999999999997,"5min":1.056,"15min":1.056},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.81999999999999995,"5min":1.758,"15min":1.758},"last":0.871}]},{"osd":4,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78200000000000003,"5min":0.85899999999999999,"15min":0.98599999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66900000000000004,"15min":0.68100000000000005},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.878,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":1.8,"15min":1.8},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68300000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.83099999999999996,"5min":0.95499999999999996,"15min":1.0069999999999999},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:05:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.69999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.42499999999999999},"max":{"1min":0.90700000000000003,"5min":0.999,"15min":0.999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.38600000000000001},"max":{"1min":0.92200000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.91200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575046,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.82799999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.85399999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.92300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.872},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":1.0069999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.085},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68200000000000005,"15min":0.71599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.141},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":1.22,"15min":1.363},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70799999999999996,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.177,"15min":1.177},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.55100000000000005,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.204,"15min":1.23},"last":0.81200000000000006}]},{"osd":3,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.874}]},{"osd":5,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.98899999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.196},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.84999999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.749},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":1.034},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.876,"15min":1.2649999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.57299999999999995,"5min":0.69299999999999995,"15min":0.81899999999999995},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46800000000000003,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.68700000000000006,"15min":0.70299999999999996},"last":0.317}]},{"osd":1,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.495}]},{"osd":4,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1890000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.381},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.504,"15min":0.502},"max":{"1min":0.83099999999999996,"5min":1.04,"15min":1.131},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86299999999999999,"5min":0.97699999999999998,"15min":1.4399999999999999},"last":0.749},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.86199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54508,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317332,"statfs":{"total":96636764160,"available":96580947968,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61299999999999999,"5min":0.73299999999999998,"15min":0.92700000000000005},"last":0.312},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73699999999999999,"5min":0.78000000000000003,"15min":1.6599999999999999},"last":0.377}]},{"osd":1,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47799999999999998,"15min":0.47499999999999998},"min":{"1min":0.33700000000000002,"5min":0.32000000000000001,"15min":0.25700000000000001},"max":{"1min":0.58499999999999996,"5min":0.83799999999999997,"15min":0.876},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.38,"5min":0.375,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54700000000000004,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.81899999999999995,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.77600000000000002,"15min":0.78000000000000003},"min":{"1min":0.48299999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0589999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96899999999999997,"5min":1.1399999999999999,"15min":1.383},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79500000000000004},"min":{"1min":0.55500000000000005,"5min":0.54300000000000004,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.78900000000000003},"min":{"1min":0.58099999999999996,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":1.093,"5min":1.1240000000000001,"15min":1.1870000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.52100000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.01,"5min":1.169,"15min":1.51},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.629,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.218,"5min":1.218,"15min":1.3240000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.997,"5min":1.143,"15min":1.5820000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0640000000000001,"5min":1.204,"15min":1.393},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32364,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1277952,"data_stored":635565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46000000000000002,"15min":0.46999999999999997},"min":{"1min":0.29199999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.749,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.36499999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.47899999999999998},"min":{"1min":0.30399999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.375},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51300000000000001,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68700000000000006,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.437}]},{"osd":3,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79100000000000004,"5min":0.81200000000000006,"15min":1.052},"last":0.499},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.52600000000000002},"min":{"1min":0.40899999999999997,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.95799999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.1930000000000001},"last":0.626}]},{"osd":5,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.58799999999999997,"5min":0.48099999999999998,"15min":0.46999999999999997},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.54800000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.95899999999999996,"5min":1.1080000000000001,"15min":1.355},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.78400000000000003},"min":{"1min":0.54600000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96799999999999997,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.45000000000000001},"max":{"1min":0.96499999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1828,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1871872,"data_stored":1225933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":4.0190000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":3.9750000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.76300000000000001}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":3.3919999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.034}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":3.5139999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":4.1470000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:49.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-07-20T10:06:49.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.453138+0000', 'last_change': '2023-07-20T10:06:43.453138+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.453138+0000', 'last_undegraded': '2023-07-20T10:06:43.453138+0000', 'last_fullsized': '2023-07-20T10:06:43.453138+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-07-20T10:06:49.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.462647+0000', 'last_change': '2023-07-20T10:06:43.462647+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.462647+0000', 'last_undegraded': '2023-07-20T10:06:43.462647+0000', 'last_fullsized': '2023-07-20T10:06:43.462647+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-07-20T10:06:49.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.454149+0000', 'last_change': '2023-07-20T10:06:43.454149+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.454149+0000', 'last_undegraded': '2023-07-20T10:06:43.454149+0000', 'last_fullsized': '2023-07-20T10:06:43.454149+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-07-20T10:06:49.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.464505+0000', 'last_change': '2023-07-20T10:06:43.464505+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.464505+0000', 'last_undegraded': '2023-07-20T10:06:43.464505+0000', 'last_fullsized': '2023-07-20T10:06:43.464505+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-07-20T10:06:49.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460690+0000', 'last_change': '2023-07-20T10:06:43.460690+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460690+0000', 'last_undegraded': '2023-07-20T10:06:43.460690+0000', 'last_fullsized': '2023-07-20T10:06:43.460690+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-07-20T10:06:49.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456826+0000', 'last_change': '2023-07-20T10:06:43.456826+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456826+0000', 'last_undegraded': '2023-07-20T10:06:43.456826+0000', 'last_fullsized': '2023-07-20T10:06:43.456826+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-07-20T10:06:49.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.466945+0000', 'last_change': '2023-07-20T10:06:43.466945+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.466945+0000', 'last_undegraded': '2023-07-20T10:06:43.466945+0000', 'last_fullsized': '2023-07-20T10:06:43.466945+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:06:49.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-07-20T10:06:49.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.457109+0000', 'last_change': '2023-07-20T10:06:43.457109+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.457109+0000', 'last_undegraded': '2023-07-20T10:06:43.457109+0000', 'last_fullsized': '2023-07-20T10:06:43.457109+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-07-20T10:06:49.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.459312+0000', 'last_change': '2023-07-20T10:06:43.459312+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.459312+0000', 'last_undegraded': '2023-07-20T10:06:43.459312+0000', 'last_fullsized': '2023-07-20T10:06:43.459312+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-07-20T10:06:49.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452720+0000', 'last_change': '2023-07-20T10:06:43.452720+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452720+0000', 'last_undegraded': '2023-07-20T10:06:43.452720+0000', 'last_fullsized': '2023-07-20T10:06:43.452720+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-07-20T10:06:49.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.463736+0000', 'last_change': '2023-07-20T10:06:43.463736+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.463736+0000', 'last_undegraded': '2023-07-20T10:06:43.463736+0000', 'last_fullsized': '2023-07-20T10:06:43.463736+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-07-20T10:06:49.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452403+0000', 'last_change': '2023-07-20T10:06:43.452403+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452403+0000', 'last_undegraded': '2023-07-20T10:06:43.452403+0000', 'last_fullsized': '2023-07-20T10:06:43.452403+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-07-20T10:06:49.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456648+0000', 'last_change': '2023-07-20T10:06:43.456648+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456648+0000', 'last_undegraded': '2023-07-20T10:06:43.456648+0000', 'last_fullsized': '2023-07-20T10:06:43.456648+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-07-20T10:06:49.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.459909+0000', 'last_change': '2023-07-20T10:06:43.459909+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.459909+0000', 'last_undegraded': '2023-07-20T10:06:43.459909+0000', 'last_fullsized': '2023-07-20T10:06:43.459909+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-07-20T10:06:49.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458578+0000', 'last_change': '2023-07-20T10:06:43.458578+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458578+0000', 'last_undegraded': '2023-07-20T10:06:43.458578+0000', 'last_fullsized': '2023-07-20T10:06:43.458578+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-07-20T10:06:49.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.457467+0000', 'last_change': '2023-07-20T10:06:43.457467+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.457467+0000', 'last_undegraded': '2023-07-20T10:06:43.457467+0000', 'last_fullsized': '2023-07-20T10:06:43.457467+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-07-20T10:06:49.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.457437+0000', 'last_change': '2023-07-20T10:06:43.457437+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.457437+0000', 'last_undegraded': '2023-07-20T10:06:43.457437+0000', 'last_fullsized': '2023-07-20T10:06:43.457437+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-07-20T10:06:49.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.455558+0000', 'last_change': '2023-07-20T10:06:43.455558+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.455558+0000', 'last_undegraded': '2023-07-20T10:06:43.455558+0000', 'last_fullsized': '2023-07-20T10:06:43.455558+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-07-20T10:06:49.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.459495+0000', 'last_change': '2023-07-20T10:06:43.459495+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.459495+0000', 'last_undegraded': '2023-07-20T10:06:43.459495+0000', 'last_fullsized': '2023-07-20T10:06:43.459495+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-07-20T10:06:49.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.464042+0000', 'last_change': '2023-07-20T10:06:43.464042+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.464042+0000', 'last_undegraded': '2023-07-20T10:06:43.464042+0000', 'last_fullsized': '2023-07-20T10:06:43.464042+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-07-20T10:06:49.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460226+0000', 'last_change': '2023-07-20T10:06:43.460226+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460226+0000', 'last_undegraded': '2023-07-20T10:06:43.460226+0000', 'last_fullsized': '2023-07-20T10:06:43.460226+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-07-20T10:06:49.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.459288+0000', 'last_change': '2023-07-20T10:06:43.459288+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.459288+0000', 'last_undegraded': '2023-07-20T10:06:43.459288+0000', 'last_fullsized': '2023-07-20T10:06:43.459288+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-07-20T10:06:49.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.463249+0000', 'last_change': '2023-07-20T10:06:43.463249+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.463249+0000', 'last_undegraded': '2023-07-20T10:06:43.463249+0000', 'last_fullsized': '2023-07-20T10:06:43.463249+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-07-20T10:06:49.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.453695+0000', 'last_change': '2023-07-20T10:06:43.453695+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.453695+0000', 'last_undegraded': '2023-07-20T10:06:43.453695+0000', 'last_fullsized': '2023-07-20T10:06:43.453695+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-07-20T10:06:49.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.463647+0000', 'last_change': '2023-07-20T10:06:43.463647+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.463647+0000', 'last_undegraded': '2023-07-20T10:06:43.463647+0000', 'last_fullsized': '2023-07-20T10:06:43.463647+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-07-20T10:06:49.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.461058+0000', 'last_change': '2023-07-20T10:06:43.461058+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.461058+0000', 'last_undegraded': '2023-07-20T10:06:43.461058+0000', 'last_fullsized': '2023-07-20T10:06:43.461058+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-07-20T10:06:49.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452358+0000', 'last_change': '2023-07-20T10:06:43.452358+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452358+0000', 'last_undegraded': '2023-07-20T10:06:43.452358+0000', 'last_fullsized': '2023-07-20T10:06:43.452358+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-07-20T10:06:49.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460758+0000', 'last_change': '2023-07-20T10:06:43.460758+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460758+0000', 'last_undegraded': '2023-07-20T10:06:43.460758+0000', 'last_fullsized': '2023-07-20T10:06:43.460758+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-07-20T10:06:49.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.466460+0000', 'last_change': '2023-07-20T10:06:43.466460+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.466460+0000', 'last_undegraded': '2023-07-20T10:06:43.466460+0000', 'last_fullsized': '2023-07-20T10:06:43.466460+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:06:49.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-07-20T10:06:49.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458212+0000', 'last_change': '2023-07-20T10:06:43.458212+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458212+0000', 'last_undegraded': '2023-07-20T10:06:43.458212+0000', 'last_fullsized': '2023-07-20T10:06:43.458212+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-07-20T10:06:49.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.459059+0000', 'last_change': '2023-07-20T10:06:43.459059+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.459059+0000', 'last_undegraded': '2023-07-20T10:06:43.459059+0000', 'last_fullsized': '2023-07-20T10:06:43.459059+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-07-20T10:06:49.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456980+0000', 'last_change': '2023-07-20T10:06:43.456980+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456980+0000', 'last_undegraded': '2023-07-20T10:06:43.456980+0000', 'last_fullsized': '2023-07-20T10:06:43.456980+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-07-20T10:06:49.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458676+0000', 'last_change': '2023-07-20T10:06:43.458676+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458676+0000', 'last_undegraded': '2023-07-20T10:06:43.458676+0000', 'last_fullsized': '2023-07-20T10:06:43.458676+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-07-20T10:06:49.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456453+0000', 'last_change': '2023-07-20T10:06:43.456453+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456453+0000', 'last_undegraded': '2023-07-20T10:06:43.456453+0000', 'last_fullsized': '2023-07-20T10:06:43.456453+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-07-20T10:06:49.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.466180+0000', 'last_change': '2023-07-20T10:06:43.466180+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.466180+0000', 'last_undegraded': '2023-07-20T10:06:43.466180+0000', 'last_fullsized': '2023-07-20T10:06:43.466180+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:06:49.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-07-20T10:06:49.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456920+0000', 'last_change': '2023-07-20T10:06:43.456920+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456920+0000', 'last_undegraded': '2023-07-20T10:06:43.456920+0000', 'last_fullsized': '2023-07-20T10:06:43.456920+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-07-20T10:06:49.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458341+0000', 'last_change': '2023-07-20T10:06:43.458341+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458341+0000', 'last_undegraded': '2023-07-20T10:06:43.458341+0000', 'last_fullsized': '2023-07-20T10:06:43.458341+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-07-20T10:06:49.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.461122+0000', 'last_change': '2023-07-20T10:06:43.461122+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.461122+0000', 'last_undegraded': '2023-07-20T10:06:43.461122+0000', 'last_fullsized': '2023-07-20T10:06:43.461122+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-07-20T10:06:49.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456298+0000', 'last_change': '2023-07-20T10:06:43.456298+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456298+0000', 'last_undegraded': '2023-07-20T10:06:43.456298+0000', 'last_fullsized': '2023-07-20T10:06:43.456298+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-07-20T10:06:49.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 105, 'state': 'creating+activating', 'last_fresh': '2023-07-20T10:06:43.454618+0000', 'last_change': '2023-07-20T10:06:43.454618+0000', 'last_active': '2023-07-20T10:06:42.429282+0000', 'last_peered': '2023-07-20T10:06:42.429282+0000', 'last_clean': '2023-07-20T10:06:42.429282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.454618+0000', 'last_undegraded': '2023-07-20T10:06:43.454618+0000', 'last_fullsized': '2023-07-20T10:06:43.454618+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-21T21:01:01.615753+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-07-20T10:06:49.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.455996+0000', 'last_change': '2023-07-20T10:06:43.455996+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.455996+0000', 'last_undegraded': '2023-07-20T10:06:43.455996+0000', 'last_fullsized': '2023-07-20T10:06:43.455996+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-07-20T10:06:49.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458231+0000', 'last_change': '2023-07-20T10:06:43.458231+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458231+0000', 'last_undegraded': '2023-07-20T10:06:43.458231+0000', 'last_fullsized': '2023-07-20T10:06:43.458231+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-07-20T10:06:49.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.466408+0000', 'last_change': '2023-07-20T10:06:43.466408+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.466408+0000', 'last_undegraded': '2023-07-20T10:06:43.466408+0000', 'last_fullsized': '2023-07-20T10:06:43.466408+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:06:49.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-07-20T10:06:49.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.455082+0000', 'last_change': '2023-07-20T10:06:43.455082+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.455082+0000', 'last_undegraded': '2023-07-20T10:06:43.455082+0000', 'last_fullsized': '2023-07-20T10:06:43.455082+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-07-20T10:06:49.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460286+0000', 'last_change': '2023-07-20T10:06:43.460286+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460286+0000', 'last_undegraded': '2023-07-20T10:06:43.460286+0000', 'last_fullsized': '2023-07-20T10:06:43.460286+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-07-20T10:06:49.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.457933+0000', 'last_change': '2023-07-20T10:06:43.457933+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.457933+0000', 'last_undegraded': '2023-07-20T10:06:43.457933+0000', 'last_fullsized': '2023-07-20T10:06:43.457933+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T10:06:49.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-07-20T10:06:49.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458575+0000', 'last_change': '2023-07-20T10:06:43.458575+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458575+0000', 'last_undegraded': '2023-07-20T10:06:43.458575+0000', 'last_fullsized': '2023-07-20T10:06:43.458575+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-07-20T10:06:49.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452279+0000', 'last_change': '2023-07-20T10:06:43.452279+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452279+0000', 'last_undegraded': '2023-07-20T10:06:43.452279+0000', 'last_fullsized': '2023-07-20T10:06:43.452279+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-07-20T10:06:49.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452322+0000', 'last_change': '2023-07-20T10:06:43.452322+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452322+0000', 'last_undegraded': '2023-07-20T10:06:43.452322+0000', 'last_fullsized': '2023-07-20T10:06:43.452322+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-07-20T10:06:49.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.463086+0000', 'last_change': '2023-07-20T10:06:43.463086+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.463086+0000', 'last_undegraded': '2023-07-20T10:06:43.463086+0000', 'last_fullsized': '2023-07-20T10:06:43.463086+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-07-20T10:06:49.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.455916+0000', 'last_change': '2023-07-20T10:06:43.455916+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.455916+0000', 'last_undegraded': '2023-07-20T10:06:43.455916+0000', 'last_fullsized': '2023-07-20T10:06:43.455916+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-07-20T10:06:49.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456383+0000', 'last_change': '2023-07-20T10:06:43.456383+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456383+0000', 'last_undegraded': '2023-07-20T10:06:43.456383+0000', 'last_fullsized': '2023-07-20T10:06:43.456383+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-07-20T10:06:49.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.463112+0000', 'last_change': '2023-07-20T10:06:43.463112+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.463112+0000', 'last_undegraded': '2023-07-20T10:06:43.463112+0000', 'last_fullsized': '2023-07-20T10:06:43.463112+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-07-20T10:06:49.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.452439+0000', 'last_change': '2023-07-20T10:06:43.452439+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.452439+0000', 'last_undegraded': '2023-07-20T10:06:43.452439+0000', 'last_fullsized': '2023-07-20T10:06:43.452439+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T10:06:49.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-07-20T10:06:49.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.454635+0000', 'last_change': '2023-07-20T10:06:43.454635+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.454635+0000', 'last_undegraded': '2023-07-20T10:06:43.454635+0000', 'last_fullsized': '2023-07-20T10:06:43.454635+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T10:06:49.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-07-20T10:06:49.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460712+0000', 'last_change': '2023-07-20T10:06:43.460712+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460712+0000', 'last_undegraded': '2023-07-20T10:06:43.460712+0000', 'last_fullsized': '2023-07-20T10:06:43.460712+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-07-20T10:06:49.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456774+0000', 'last_change': '2023-07-20T10:06:43.456774+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456774+0000', 'last_undegraded': '2023-07-20T10:06:43.456774+0000', 'last_fullsized': '2023-07-20T10:06:43.456774+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-07-20T10:06:49.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.467015+0000', 'last_change': '2023-07-20T10:06:43.467015+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.467015+0000', 'last_undegraded': '2023-07-20T10:06:43.467015+0000', 'last_fullsized': '2023-07-20T10:06:43.467015+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T10:06:49.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-07-20T10:06:49.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458273+0000', 'last_change': '2023-07-20T10:06:43.458273+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458273+0000', 'last_undegraded': '2023-07-20T10:06:43.458273+0000', 'last_fullsized': '2023-07-20T10:06:43.458273+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-07-20T10:06:49.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 105, 'state': 'creating+activating', 'last_fresh': '2023-07-20T10:06:43.461612+0000', 'last_change': '2023-07-20T10:06:43.461612+0000', 'last_active': '2023-07-20T10:06:42.429282+0000', 'last_peered': '2023-07-20T10:06:42.429282+0000', 'last_clean': '2023-07-20T10:06:42.429282+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.461612+0000', 'last_undegraded': '2023-07-20T10:06:43.461612+0000', 'last_fullsized': '2023-07-20T10:06:43.461612+0000', 'mapping_epoch': 104, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 104, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:42.429282+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-07-21T12:14:08.509539+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-07-20T10:06:49.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460811+0000', 'last_change': '2023-07-20T10:06:43.460811+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460811+0000', 'last_undegraded': '2023-07-20T10:06:43.460811+0000', 'last_fullsized': '2023-07-20T10:06:43.460811+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T10:06:49.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-07-20T10:06:49.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.460547+0000', 'last_change': '2023-07-20T10:06:43.460547+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.460547+0000', 'last_undegraded': '2023-07-20T10:06:43.460547+0000', 'last_fullsized': '2023-07-20T10:06:43.460547+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T10:06:49.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-07-20T10:06:49.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.456458+0000', 'last_change': '2023-07-20T10:06:43.456458+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.456458+0000', 'last_undegraded': '2023-07-20T10:06:43.456458+0000', 'last_fullsized': '2023-07-20T10:06:43.456458+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-07-20T10:06:49.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.458397+0000', 'last_change': '2023-07-20T10:06:43.458397+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.458397+0000', 'last_undegraded': '2023-07-20T10:06:43.458397+0000', 'last_fullsized': '2023-07-20T10:06:43.458397+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-07-20T10:06:49.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.462072+0000', 'last_change': '2023-07-20T10:06:43.462072+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.462072+0000', 'last_undegraded': '2023-07-20T10:06:43.462072+0000', 'last_fullsized': '2023-07-20T10:06:43.462072+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T10:06:49.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-07-20T10:06:49.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 105, 'state': 'creating+peering', 'last_fresh': '2023-07-20T10:06:43.457248+0000', 'last_change': '2023-07-20T10:06:43.457248+0000', 'last_active': '2023-07-20T10:06:43.438673+0000', 'last_peered': '2023-07-20T10:06:43.438673+0000', 'last_clean': '2023-07-20T10:06:43.438673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T10:06:43.457248+0000', 'last_undegraded': '2023-07-20T10:06:43.457248+0000', 'last_fullsized': '2023-07-20T10:06:43.457248+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'last_clean_scrub_stamp': '2023-07-20T10:06:43.438673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T10:06:49.322 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:06:49.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 Processor -- start 2023-07-20T10:06:49.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 -- start start 2023-07-20T10:06:49.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f55440d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440b3520 con 0x7f55440d0d10 2023-07-20T10:06:49.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55440cff30 con 0x7f55440ce4c0 2023-07-20T10:06:49.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5549fa3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440d31c0 con 0x7f554415cab0 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f553bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f55440d0d10 0x7f55440cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49572/0 (socket says 172.21.15.82:49572) 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f553bfff640 1 -- 172.21.15.82:0/1248281443 learned_addr learned my addr 172.21.15.82:0/1248281443 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f55440d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901578760 0 0) 0x7f55440b3520 con 0x7f55440d0d10 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5530003530 con 0x7f55440d0d10 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195345935 0 0) 0x7f55440cff30 con 0x7f55440ce4c0 2023-07-20T10:06:49.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55440b3520 con 0x7f55440ce4c0 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821829858 0 0) 0x7f5530003530 con 0x7f55440d0d10 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 msgr2=0x7f55440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f55440d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 >> v1:172.21.15.183:6789/0 conn(0x7f55440ce4c0 legacy=0x7f55440cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440b2910 con 0x7f55440d0d10 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f552c001680 con 0x7f55440d0d10 2023-07-20T10:06:49.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 >> v1:172.21.15.82:6789/0 conn(0x7f55440d0d10 legacy=0x7f55440cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f5530003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55300040a0 0x7f55300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530004d10 0x7f5530005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553000ba40 con 0x7f5530004d10 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553000bbb0 con 0x7f55300040a0 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553000bd70 con 0x7f554415cab0 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f553bfff640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55300040a0 0x7f55300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f5530003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5543fff640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530004d10 0x7f5530005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 -- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55300040a0 msgr2=0x7f55300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f55300040a0 0x7f55300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 -- 172.21.15.82:0/1248281443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530004d10 msgr2=0x7f5530005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530004d10 0x7f5530005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f55437fe640 1 -- 172.21.15.82:0/1248281443 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5530003530 con 0x7f554415cab0 2023-07-20T10:06:49.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.481+0000 7f5543fff640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530004d10 0x7f5530005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:49.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.485+0000 7f55437fe640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f5530003b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5534009ae0 tx=0x7f553401ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1ad25acb65790ed server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c007ea0 con 0x7f554415cab0 2023-07-20T10:06:49.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55340a5570 con 0x7f554415cab0 2023-07-20T10:06:49.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5542ffd640 1 -- 172.21.15.82:0/1248281443 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55340a5920 con 0x7f554415cab0 2023-07-20T10:06:49.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 -- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 msgr2=0x7f5530003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1248281443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f554415cab0 0x7f5530003b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5534009ae0 tx=0x7f553401ca90 comp rx=0 tx=0).stop 2023-07-20T10:06:49.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5543fff640 1 -- 172.21.15.82:0/1248281443 reap_dead start 2023-07-20T10:06:49.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 -- 172.21.15.82:0/1248281443 shutdown_connections 2023-07-20T10:06:49.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 -- 172.21.15.82:0/1248281443 >> 172.21.15.82:0/1248281443 conn(0x7f554408c120 msgr2=0x7f554409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:49.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 -- 172.21.15.82:0/1248281443 shutdown_connections 2023-07-20T10:06:49.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.489+0000 7f5549fa3640 1 -- 172.21.15.82:0/1248281443 wait complete. 2023-07-20T10:06:49.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 Processor -- start 2023-07-20T10:06:49.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- start start 2023-07-20T10:06:49.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554415cab0 0x7f55440cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55440b5860 0x7f55440b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55440ca7d0 con 0x7f55440c8730 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554406aa00 con 0x7f554415cab0 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55440c90f0 con 0x7f55440b5860 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41152/0 (socket says 172.21.15.82:41152) 2023-07-20T10:06:49.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 -- 172.21.15.82:0/1323789380 learned_addr learned my addr 172.21.15.82:0/1323789380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:49.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f553bfff640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55440b5860 0x7f55440b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f55437fe640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554415cab0 0x7f55440cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 -- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55440b5860 msgr2=0x7f55440b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55440b5860 0x7f55440b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 -- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554415cab0 msgr2=0x7f55440cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554415cab0 0x7f55440cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 -- 172.21.15.82:0/1323789380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55440caa20 con 0x7f55440c8730 2023-07-20T10:06:49.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5543fff640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f55440ce910 tx=0x7f553c00ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c003b90 con 0x7f55440c8730 2023-07-20T10:06:49.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c003cf0 con 0x7f55440c8730 2023-07-20T10:06:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c00d9c0 con 0x7f55440c8730 2023-07-20T10:06:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55440cad00 con 0x7f55440c8730 2023-07-20T10:06:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55440b6500 con 0x7f55440c8730 2023-07-20T10:06:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.493+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55440b1270 con 0x7f55440c8730 2023-07-20T10:06:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.497+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f553c00db20 con 0x7f55440c8730 2023-07-20T10:06:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.497+0000 7f5540ff9640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 0x7f5524068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.497+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f553c083e30 con 0x7f55440c8730 2023-07-20T10:06:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.497+0000 7f55437fe640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 0x7f5524068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.497+0000 7f55437fe640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 0x7f5524068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55340af000 tx=0x7f55340046d0 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.501+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f553c051100 con 0x7f55440c8730 2023-07-20T10:06:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55440d2ce0 con 0x7f55440c8730 2023-07-20T10:06:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5540ff9640 1 -- 172.21.15.82:0/1323789380 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1016 (secure 0 0 0) 0x7f553c003e60 con 0x7f55440c8730 2023-07-20T10:06:49.681 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:49.681 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1008,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":107,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":320434176,"bytes_avail":772773679104,"bytes_total":773094113280,"write_bytes_sec":2377,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":50,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7800}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-20T10:04:20.728788+0000","services":{}},"progress_events":{}} 2023-07-20T10:06:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 msgr2=0x7f5524068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 0x7f5524068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55340af000 tx=0x7f55340046d0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 msgr2=0x7f55440c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f55440ce910 tx=0x7f553c00ff60 comp rx=0 tx=0).stop 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 shutdown_connections 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f55440c8730 0x7f55440c8bb0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f55240663a0 0x7f5524068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f55440b5860 0x7f55440b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 --2- 172.21.15.82:0/1323789380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f554415cab0 0x7f55440cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 >> 172.21.15.82:0/1323789380 conn(0x7f554408c120 msgr2=0x7f55440d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 shutdown_connections 2023-07-20T10:06:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.701+0000 7f5549fa3640 1 -- 172.21.15.82:0/1323789380 wait complete. 2023-07-20T10:06:49.702 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:06:49.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:49.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 Processor -- start 2023-07-20T10:06:49.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 -- start start 2023-07-20T10:06:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f668c0ca040 0x7f668c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15d4a0 0x7f668c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c0cde70 con 0x7f668c15c910 2023-07-20T10:06:49.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c0cbef0 con 0x7f668c0ca040 2023-07-20T10:06:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f66926cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0ca420 con 0x7f668c15d4a0 2023-07-20T10:06:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f668bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f668c0ca040 0x7f668c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f668bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f668c0ca040 0x7f668c0ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41156/0 (socket says 172.21.15.82:41156) 2023-07-20T10:06:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f668bfff640 1 -- 172.21.15.82:0/2125260210 learned_addr learned my addr 172.21.15.82:0/2125260210 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:49.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f6690c68640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15d4a0 0x7f668c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f668bfff640 1 -- 172.21.15.82:0/2125260210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15d4a0 msgr2=0x7f668c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.861+0000 7f668bfff640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15d4a0 0x7f668c0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668bfff640 1 -- 172.21.15.82:0/2125260210 >> v1:172.21.15.183:6789/0 conn(0x7f668c15c910 legacy=0x7f668c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668bfff640 1 -- 172.21.15.82:0/2125260210 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0cdb40 con 0x7f668c0ca040 2023-07-20T10:06:49.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668bfff640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c0ca040 0x7f668c0ad060 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f667c009870 tx=0x7f667c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf8dfd7707c5923 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668affd640 1 -- 172.21.15.82:0/2125260210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0aa610 con 0x7f668c0ca040 2023-07-20T10:06:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668affd640 1 -- 172.21.15.82:0/2125260210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0a6040 con 0x7f668c0ca040 2023-07-20T10:06:49.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f668affd640 1 -- 172.21.15.82:0/2125260210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0aa990 con 0x7f668c0ca040 2023-07-20T10:06:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 -- 172.21.15.82:0/2125260210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c0ca040 msgr2=0x7f668c0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c0ca040 0x7f668c0ad060 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f667c009870 tx=0x7f667c01c510 comp rx=0 tx=0).stop 2023-07-20T10:06:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 -- 172.21.15.82:0/2125260210 shutdown_connections 2023-07-20T10:06:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15d4a0 0x7f668c0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 --2- 172.21.15.82:0/2125260210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c0ca040 0x7f668c0ad060 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 -- 172.21.15.82:0/2125260210 >> 172.21.15.82:0/2125260210 conn(0x7f668c0cada0 msgr2=0x7f668c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 -- 172.21.15.82:0/2125260210 shutdown_connections 2023-07-20T10:06:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.865+0000 7f66926cb640 1 -- 172.21.15.82:0/2125260210 wait complete. 2023-07-20T10:06:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 Processor -- start 2023-07-20T10:06:49.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 -- start start 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f668c0ca040 0x7f668c0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15c910 0x7f668c152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c154ac0 con 0x7f668c15d4a0 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c165a30 con 0x7f668c0ca040 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f66926cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0ac690 con 0x7f668c15c910 2023-07-20T10:06:49.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f668bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f668c0ca040 0x7f668c0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41168/0 (socket says 172.21.15.82:41168) 2023-07-20T10:06:49.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 -- 172.21.15.82:0/363527660 learned_addr learned my addr 172.21.15.82:0/363527660 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:49.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f668b7fe640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15c910 0x7f668c152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 -- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15c910 msgr2=0x7f668c152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15c910 0x7f668c152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 -- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f668c0ca040 msgr2=0x7f668c0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:49.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f668c0ca040 0x7f668c0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:49.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 -- 172.21.15.82:0/363527660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0094d0 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.869+0000 7f6690c68640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6684007e90 tx=0x7f668400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684014420 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684014580 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684014930 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c153e80 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c154400 con 0x7f668c15d4a0 2023-07-20T10:06:49.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c154c00 con 0x7f668c15d4a0 2023-07-20T10:06:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6684014a90 con 0x7f668c15d4a0 2023-07-20T10:06:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 0x7f6678068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f66840845f0 con 0x7f668c15d4a0 2023-07-20T10:06:49.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f668bfff640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 0x7f6678068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:49.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.873+0000 7f668bfff640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 0x7f6678068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae000 tx=0x7f667c0b5040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:49.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:49.877+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f668c154c00 con 0x7f668c15d4a0 2023-07-20T10:06:50.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.053+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f668c0b16b0 con 0x7f66780663a0 2023-07-20T10:06:50.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.061+0000 7f6688ff9640 1 -- 172.21.15.82:0/363527660 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311957 (secure 0 0 0) 0x7f667c0aa610 con 0x7f66780663a0 2023-07-20T10:06:50.044 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 msgr2=0x7f6678068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 0x7f6678068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae000 tx=0x7f667c0b5040 comp rx=0 tx=0).stop 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 msgr2=0x7f668c0ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f6684007e90 tx=0x7f668400e4b0 comp rx=0 tx=0).stop 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 shutdown_connections 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f668c15d4a0 0x7f668c0ac150 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:50.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f66780663a0 0x7f6678068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f668c15c910 0x7f668c152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 --2- 172.21.15.82:0/363527660 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f668c0ca040 0x7f668c0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 >> 172.21.15.82:0/363527660 conn(0x7f668c0cada0 msgr2=0x7f668c06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 shutdown_connections 2023-07-20T10:06:50.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:50.065+0000 7f66926cb640 1 -- 172.21.15.82:0/363527660 wait complete. 2023-07-20T10:06:50.066 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:06:49.479461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":195,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312924,"kb_used_data":11496,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754661796,"statfs":{"total":773094113280,"available":772773679104,"internally_reserved":0,"allocated":11771904,"data_stored":6433252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.030832"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565748+0000","last_change":"2023-07-20T10:06:44.479213+0000","last_active":"2023-07-20T10:06:45.565748+0000","last_peered":"2023-07-20T10:06:45.565748+0000","last_clean":"2023-07-20T10:06:45.565748+0000","last_became_active":"2023-07-20T10:06:44.478871+0000","last_became_peered":"2023-07-20T10:06:44.478871+0000","last_unstale":"2023-07-20T10:06:45.565748+0000","last_undegraded":"2023-07-20T10:06:45.565748+0000","last_fullsized":"2023-07-20T10:06:45.565748+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:10.282036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461528+0000","last_change":"2023-07-20T10:06:44.465877+0000","last_active":"2023-07-20T10:06:45.461528+0000","last_peered":"2023-07-20T10:06:45.461528+0000","last_clean":"2023-07-20T10:06:45.461528+0000","last_became_active":"2023-07-20T10:06:44.465555+0000","last_became_peered":"2023-07-20T10:06:44.465555+0000","last_unstale":"2023-07-20T10:06:45.461528+0000","last_undegraded":"2023-07-20T10:06:45.461528+0000","last_fullsized":"2023-07-20T10:06:45.461528+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:03:37.100589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565208+0000","last_change":"2023-07-20T10:06:44.461793+0000","last_active":"2023-07-20T10:06:45.565208+0000","last_peered":"2023-07-20T10:06:45.565208+0000","last_clean":"2023-07-20T10:06:45.565208+0000","last_became_active":"2023-07-20T10:06:44.461418+0000","last_became_peered":"2023-07-20T10:06:44.461418+0000","last_unstale":"2023-07-20T10:06:45.565208+0000","last_undegraded":"2023-07-20T10:06:45.565208+0000","last_fullsized":"2023-07-20T10:06:45.565208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:25.098216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566315+0000","last_change":"2023-07-20T10:06:44.473183+0000","last_active":"2023-07-20T10:06:45.566315+0000","last_peered":"2023-07-20T10:06:45.566315+0000","last_clean":"2023-07-20T10:06:45.566315+0000","last_became_active":"2023-07-20T10:06:44.472926+0000","last_became_peered":"2023-07-20T10:06:44.472926+0000","last_unstale":"2023-07-20T10:06:45.566315+0000","last_undegraded":"2023-07-20T10:06:45.566315+0000","last_fullsized":"2023-07-20T10:06:45.566315+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:57.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460422+0000","last_change":"2023-07-20T10:06:44.473458+0000","last_active":"2023-07-20T10:06:45.460422+0000","last_peered":"2023-07-20T10:06:45.460422+0000","last_clean":"2023-07-20T10:06:45.460422+0000","last_became_active":"2023-07-20T10:06:44.473139+0000","last_became_peered":"2023-07-20T10:06:44.473139+0000","last_unstale":"2023-07-20T10:06:45.460422+0000","last_undegraded":"2023-07-20T10:06:45.460422+0000","last_fullsized":"2023-07-20T10:06:45.460422+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:09.518930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565914+0000","last_change":"2023-07-20T10:06:44.483006+0000","last_active":"2023-07-20T10:06:45.565914+0000","last_peered":"2023-07-20T10:06:45.565914+0000","last_clean":"2023-07-20T10:06:45.565914+0000","last_became_active":"2023-07-20T10:06:44.482744+0000","last_became_peered":"2023-07-20T10:06:44.482744+0000","last_unstale":"2023-07-20T10:06:45.565914+0000","last_undegraded":"2023-07-20T10:06:45.565914+0000","last_fullsized":"2023-07-20T10:06:45.565914+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:05.603759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569024+0000","last_change":"2023-07-20T10:06:44.478481+0000","last_active":"2023-07-20T10:06:45.569024+0000","last_peered":"2023-07-20T10:06:45.569024+0000","last_clean":"2023-07-20T10:06:45.569024+0000","last_became_active":"2023-07-20T10:06:44.478155+0000","last_became_peered":"2023-07-20T10:06:44.478155+0000","last_unstale":"2023-07-20T10:06:45.569024+0000","last_undegraded":"2023-07-20T10:06:45.569024+0000","last_fullsized":"2023-07-20T10:06:45.569024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:10.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566169+0000","last_change":"2023-07-20T10:06:44.477161+0000","last_active":"2023-07-20T10:06:45.566169+0000","last_peered":"2023-07-20T10:06:45.566169+0000","last_clean":"2023-07-20T10:06:45.566169+0000","last_became_active":"2023-07-20T10:06:44.476870+0000","last_became_peered":"2023-07-20T10:06:44.476870+0000","last_unstale":"2023-07-20T10:06:45.566169+0000","last_undegraded":"2023-07-20T10:06:45.566169+0000","last_fullsized":"2023-07-20T10:06:45.566169+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:40.088382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460501+0000","last_change":"2023-07-20T10:06:44.468447+0000","last_active":"2023-07-20T10:06:45.460501+0000","last_peered":"2023-07-20T10:06:45.460501+0000","last_clean":"2023-07-20T10:06:45.460501+0000","last_became_active":"2023-07-20T10:06:44.468027+0000","last_became_peered":"2023-07-20T10:06:44.468027+0000","last_unstale":"2023-07-20T10:06:45.460501+0000","last_undegraded":"2023-07-20T10:06:45.460501+0000","last_fullsized":"2023-07-20T10:06:45.460501+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:58.096542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455193+0000","last_change":"2023-07-20T10:06:44.471889+0000","last_active":"2023-07-20T10:06:45.455193+0000","last_peered":"2023-07-20T10:06:45.455193+0000","last_clean":"2023-07-20T10:06:45.455193+0000","last_became_active":"2023-07-20T10:06:44.471617+0000","last_became_peered":"2023-07-20T10:06:44.471617+0000","last_unstale":"2023-07-20T10:06:45.455193+0000","last_undegraded":"2023-07-20T10:06:45.455193+0000","last_fullsized":"2023-07-20T10:06:45.455193+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:35:15.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460402+0000","last_change":"2023-07-20T10:06:44.486095+0000","last_active":"2023-07-20T10:06:45.460402+0000","last_peered":"2023-07-20T10:06:45.460402+0000","last_clean":"2023-07-20T10:06:45.460402+0000","last_became_active":"2023-07-20T10:06:44.485482+0000","last_became_peered":"2023-07-20T10:06:44.485482+0000","last_unstale":"2023-07-20T10:06:45.460402+0000","last_undegraded":"2023-07-20T10:06:45.460402+0000","last_fullsized":"2023-07-20T10:06:45.460402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:56.287813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455150+0000","last_change":"2023-07-20T10:06:44.460434+0000","last_active":"2023-07-20T10:06:45.455150+0000","last_peered":"2023-07-20T10:06:45.455150+0000","last_clean":"2023-07-20T10:06:45.455150+0000","last_became_active":"2023-07-20T10:06:44.460144+0000","last_became_peered":"2023-07-20T10:06:44.460144+0000","last_unstale":"2023-07-20T10:06:45.455150+0000","last_undegraded":"2023-07-20T10:06:45.455150+0000","last_fullsized":"2023-07-20T10:06:45.455150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:50:29.531966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565436+0000","last_change":"2023-07-20T10:06:44.480597+0000","last_active":"2023-07-20T10:06:45.565436+0000","last_peered":"2023-07-20T10:06:45.565436+0000","last_clean":"2023-07-20T10:06:45.565436+0000","last_became_active":"2023-07-20T10:06:44.480292+0000","last_became_peered":"2023-07-20T10:06:44.480292+0000","last_unstale":"2023-07-20T10:06:45.565436+0000","last_undegraded":"2023-07-20T10:06:45.565436+0000","last_fullsized":"2023-07-20T10:06:45.565436+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:32.199441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460519+0000","last_change":"2023-07-20T10:06:44.484497+0000","last_active":"2023-07-20T10:06:45.460519+0000","last_peered":"2023-07-20T10:06:45.460519+0000","last_clean":"2023-07-20T10:06:45.460519+0000","last_became_active":"2023-07-20T10:06:44.484199+0000","last_became_peered":"2023-07-20T10:06:44.484199+0000","last_unstale":"2023-07-20T10:06:45.460519+0000","last_undegraded":"2023-07-20T10:06:45.460519+0000","last_fullsized":"2023-07-20T10:06:45.460519+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:08.950500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566666+0000","last_change":"2023-07-20T10:06:44.474455+0000","last_active":"2023-07-20T10:06:45.566666+0000","last_peered":"2023-07-20T10:06:45.566666+0000","last_clean":"2023-07-20T10:06:45.566666+0000","last_became_active":"2023-07-20T10:06:44.474166+0000","last_became_peered":"2023-07-20T10:06:44.474166+0000","last_unstale":"2023-07-20T10:06:45.566666+0000","last_undegraded":"2023-07-20T10:06:45.566666+0000","last_fullsized":"2023-07-20T10:06:45.566666+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:40:20.093026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565320+0000","last_change":"2023-07-20T10:06:44.474961+0000","last_active":"2023-07-20T10:06:45.565320+0000","last_peered":"2023-07-20T10:06:45.565320+0000","last_clean":"2023-07-20T10:06:45.565320+0000","last_became_active":"2023-07-20T10:06:44.474538+0000","last_became_peered":"2023-07-20T10:06:44.474538+0000","last_unstale":"2023-07-20T10:06:45.565320+0000","last_undegraded":"2023-07-20T10:06:45.565320+0000","last_fullsized":"2023-07-20T10:06:45.565320+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:32.663520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565431+0000","last_change":"2023-07-20T10:06:44.482351+0000","last_active":"2023-07-20T10:06:45.565431+0000","last_peered":"2023-07-20T10:06:45.565431+0000","last_clean":"2023-07-20T10:06:45.565431+0000","last_became_active":"2023-07-20T10:06:44.482027+0000","last_became_peered":"2023-07-20T10:06:44.482027+0000","last_unstale":"2023-07-20T10:06:45.565431+0000","last_undegraded":"2023-07-20T10:06:45.565431+0000","last_fullsized":"2023-07-20T10:06:45.565431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:37:23.975554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565436+0000","last_change":"2023-07-20T10:06:44.467591+0000","last_active":"2023-07-20T10:06:45.565436+0000","last_peered":"2023-07-20T10:06:45.565436+0000","last_clean":"2023-07-20T10:06:45.565436+0000","last_became_active":"2023-07-20T10:06:44.467315+0000","last_became_peered":"2023-07-20T10:06:44.467315+0000","last_unstale":"2023-07-20T10:06:45.565436+0000","last_undegraded":"2023-07-20T10:06:45.565436+0000","last_fullsized":"2023-07-20T10:06:45.565436+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:58.229576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460558+0000","last_change":"2023-07-20T10:06:44.477941+0000","last_active":"2023-07-20T10:06:45.460558+0000","last_peered":"2023-07-20T10:06:45.460558+0000","last_clean":"2023-07-20T10:06:45.460558+0000","last_became_active":"2023-07-20T10:06:44.477604+0000","last_became_peered":"2023-07-20T10:06:44.477604+0000","last_unstale":"2023-07-20T10:06:45.460558+0000","last_undegraded":"2023-07-20T10:06:45.460558+0000","last_fullsized":"2023-07-20T10:06:45.460558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:56:32.708640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566380+0000","last_change":"2023-07-20T10:06:44.471752+0000","last_active":"2023-07-20T10:06:45.566380+0000","last_peered":"2023-07-20T10:06:45.566380+0000","last_clean":"2023-07-20T10:06:45.566380+0000","last_became_active":"2023-07-20T10:06:44.471331+0000","last_became_peered":"2023-07-20T10:06:44.471331+0000","last_unstale":"2023-07-20T10:06:45.566380+0000","last_undegraded":"2023-07-20T10:06:45.566380+0000","last_fullsized":"2023-07-20T10:06:45.566380+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:52:25.569563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460894+0000","last_change":"2023-07-20T10:06:44.477067+0000","last_active":"2023-07-20T10:06:45.460894+0000","last_peered":"2023-07-20T10:06:45.460894+0000","last_clean":"2023-07-20T10:06:45.460894+0000","last_became_active":"2023-07-20T10:06:44.476707+0000","last_became_peered":"2023-07-20T10:06:44.476707+0000","last_unstale":"2023-07-20T10:06:45.460894+0000","last_undegraded":"2023-07-20T10:06:45.460894+0000","last_fullsized":"2023-07-20T10:06:45.460894+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:46:19.297607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460558+0000","last_change":"2023-07-20T10:06:44.483049+0000","last_active":"2023-07-20T10:06:45.460558+0000","last_peered":"2023-07-20T10:06:45.460558+0000","last_clean":"2023-07-20T10:06:45.460558+0000","last_became_active":"2023-07-20T10:06:44.482746+0000","last_became_peered":"2023-07-20T10:06:44.482746+0000","last_unstale":"2023-07-20T10:06:45.460558+0000","last_undegraded":"2023-07-20T10:06:45.460558+0000","last_fullsized":"2023-07-20T10:06:45.460558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:52.854614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569332+0000","last_change":"2023-07-20T10:06:44.482142+0000","last_active":"2023-07-20T10:06:45.569332+0000","last_peered":"2023-07-20T10:06:45.569332+0000","last_clean":"2023-07-20T10:06:45.569332+0000","last_became_active":"2023-07-20T10:06:44.481839+0000","last_became_peered":"2023-07-20T10:06:44.481839+0000","last_unstale":"2023-07-20T10:06:45.569332+0000","last_undegraded":"2023-07-20T10:06:45.569332+0000","last_fullsized":"2023-07-20T10:06:45.569332+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:29:50.060241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.567084+0000","last_change":"2023-07-20T10:06:44.459541+0000","last_active":"2023-07-20T10:06:45.567084+0000","last_peered":"2023-07-20T10:06:45.567084+0000","last_clean":"2023-07-20T10:06:45.567084+0000","last_became_active":"2023-07-20T10:06:44.459243+0000","last_became_peered":"2023-07-20T10:06:44.459243+0000","last_unstale":"2023-07-20T10:06:45.567084+0000","last_undegraded":"2023-07-20T10:06:45.567084+0000","last_fullsized":"2023-07-20T10:06:45.567084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:01.327166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461678+0000","last_change":"2023-07-20T10:06:44.475228+0000","last_active":"2023-07-20T10:06:45.461678+0000","last_peered":"2023-07-20T10:06:45.461678+0000","last_clean":"2023-07-20T10:06:45.461678+0000","last_became_active":"2023-07-20T10:06:44.474931+0000","last_became_peered":"2023-07-20T10:06:44.474931+0000","last_unstale":"2023-07-20T10:06:45.461678+0000","last_undegraded":"2023-07-20T10:06:45.461678+0000","last_fullsized":"2023-07-20T10:06:45.461678+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:16:29.039908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460741+0000","last_change":"2023-07-20T10:06:44.478304+0000","last_active":"2023-07-20T10:06:45.460741+0000","last_peered":"2023-07-20T10:06:45.460741+0000","last_clean":"2023-07-20T10:06:45.460741+0000","last_became_active":"2023-07-20T10:06:44.477957+0000","last_became_peered":"2023-07-20T10:06:44.477957+0000","last_unstale":"2023-07-20T10:06:45.460741+0000","last_undegraded":"2023-07-20T10:06:45.460741+0000","last_fullsized":"2023-07-20T10:06:45.460741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:28.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455278+0000","last_change":"2023-07-20T10:06:44.471458+0000","last_active":"2023-07-20T10:06:45.455278+0000","last_peered":"2023-07-20T10:06:45.455278+0000","last_clean":"2023-07-20T10:06:45.455278+0000","last_became_active":"2023-07-20T10:06:44.471185+0000","last_became_peered":"2023-07-20T10:06:44.471185+0000","last_unstale":"2023-07-20T10:06:45.455278+0000","last_undegraded":"2023-07-20T10:06:45.455278+0000","last_fullsized":"2023-07-20T10:06:45.455278+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:47.507244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566439+0000","last_change":"2023-07-20T10:06:44.471594+0000","last_active":"2023-07-20T10:06:45.566439+0000","last_peered":"2023-07-20T10:06:45.566439+0000","last_clean":"2023-07-20T10:06:45.566439+0000","last_became_active":"2023-07-20T10:06:44.471033+0000","last_became_peered":"2023-07-20T10:06:44.471033+0000","last_unstale":"2023-07-20T10:06:45.566439+0000","last_undegraded":"2023-07-20T10:06:45.566439+0000","last_fullsized":"2023-07-20T10:06:45.566439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:12.048395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569276+0000","last_change":"2023-07-20T10:06:44.485934+0000","last_active":"2023-07-20T10:06:45.569276+0000","last_peered":"2023-07-20T10:06:45.569276+0000","last_clean":"2023-07-20T10:06:45.569276+0000","last_became_active":"2023-07-20T10:06:44.485580+0000","last_became_peered":"2023-07-20T10:06:44.485580+0000","last_unstale":"2023-07-20T10:06:45.569276+0000","last_undegraded":"2023-07-20T10:06:45.569276+0000","last_fullsized":"2023-07-20T10:06:45.569276+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:09.468057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460887+0000","last_change":"2023-07-20T10:06:44.467302+0000","last_active":"2023-07-20T10:06:45.460887+0000","last_peered":"2023-07-20T10:06:45.460887+0000","last_clean":"2023-07-20T10:06:45.460887+0000","last_became_active":"2023-07-20T10:06:44.467001+0000","last_became_peered":"2023-07-20T10:06:44.467001+0000","last_unstale":"2023-07-20T10:06:45.460887+0000","last_undegraded":"2023-07-20T10:06:45.460887+0000","last_fullsized":"2023-07-20T10:06:45.460887+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:24:47.685161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460177+0000","last_change":"2023-07-20T10:06:44.480856+0000","last_active":"2023-07-20T10:06:45.460177+0000","last_peered":"2023-07-20T10:06:45.460177+0000","last_clean":"2023-07-20T10:06:45.460177+0000","last_became_active":"2023-07-20T10:06:44.480460+0000","last_became_peered":"2023-07-20T10:06:44.480460+0000","last_unstale":"2023-07-20T10:06:45.460177+0000","last_undegraded":"2023-07-20T10:06:45.460177+0000","last_fullsized":"2023-07-20T10:06:45.460177+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:38:19.668523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565446+0000","last_change":"2023-07-20T10:06:44.474793+0000","last_active":"2023-07-20T10:06:45.565446+0000","last_peered":"2023-07-20T10:06:45.565446+0000","last_clean":"2023-07-20T10:06:45.565446+0000","last_became_active":"2023-07-20T10:06:44.474202+0000","last_became_peered":"2023-07-20T10:06:44.474202+0000","last_unstale":"2023-07-20T10:06:45.565446+0000","last_undegraded":"2023-07-20T10:06:45.565446+0000","last_fullsized":"2023-07-20T10:06:45.565446+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:02:01.051138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566280+0000","last_change":"2023-07-20T10:06:44.473816+0000","last_active":"2023-07-20T10:06:45.566280+0000","last_peered":"2023-07-20T10:06:45.566280+0000","last_clean":"2023-07-20T10:06:45.566280+0000","last_became_active":"2023-07-20T10:06:44.473515+0000","last_became_peered":"2023-07-20T10:06:44.473515+0000","last_unstale":"2023-07-20T10:06:45.566280+0000","last_undegraded":"2023-07-20T10:06:45.566280+0000","last_fullsized":"2023-07-20T10:06:45.566280+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:32.199441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"106'4","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569953+0000","last_change":"2023-07-20T10:06:43.474094+0000","last_active":"2023-07-20T10:06:45.569953+0000","last_peered":"2023-07-20T10:06:45.569953+0000","last_clean":"2023-07-20T10:06:45.569953+0000","last_became_active":"2023-07-20T10:06:43.473779+0000","last_became_peered":"2023-07-20T10:06:43.473779+0000","last_unstale":"2023-07-20T10:06:45.569953+0000","last_undegraded":"2023-07-20T10:06:45.569953+0000","last_fullsized":"2023-07-20T10:06:45.569953+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:34:03.331916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566456+0000","last_change":"2023-07-20T10:06:44.482185+0000","last_active":"2023-07-20T10:06:45.566456+0000","last_peered":"2023-07-20T10:06:45.566456+0000","last_clean":"2023-07-20T10:06:45.566456+0000","last_became_active":"2023-07-20T10:06:44.481901+0000","last_became_peered":"2023-07-20T10:06:44.481901+0000","last_unstale":"2023-07-20T10:06:45.566456+0000","last_undegraded":"2023-07-20T10:06:45.566456+0000","last_fullsized":"2023-07-20T10:06:45.566456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:36.266744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460724+0000","last_change":"2023-07-20T10:06:43.469840+0000","last_active":"2023-07-20T10:06:45.460724+0000","last_peered":"2023-07-20T10:06:45.460724+0000","last_clean":"2023-07-20T10:06:45.460724+0000","last_became_active":"2023-07-20T10:06:43.469543+0000","last_became_peered":"2023-07-20T10:06:43.469543+0000","last_unstale":"2023-07-20T10:06:45.460724+0000","last_undegraded":"2023-07-20T10:06:45.460724+0000","last_fullsized":"2023-07-20T10:06:45.460724+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:47.597305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569421+0000","last_change":"2023-07-20T10:06:44.485728+0000","last_active":"2023-07-20T10:06:45.569421+0000","last_peered":"2023-07-20T10:06:45.569421+0000","last_clean":"2023-07-20T10:06:45.569421+0000","last_became_active":"2023-07-20T10:06:44.485388+0000","last_became_peered":"2023-07-20T10:06:44.485388+0000","last_unstale":"2023-07-20T10:06:45.569421+0000","last_undegraded":"2023-07-20T10:06:45.569421+0000","last_fullsized":"2023-07-20T10:06:45.569421+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:29.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569473+0000","last_change":"2023-07-20T10:06:43.480281+0000","last_active":"2023-07-20T10:06:45.569473+0000","last_peered":"2023-07-20T10:06:45.569473+0000","last_clean":"2023-07-20T10:06:45.569473+0000","last_became_active":"2023-07-20T10:06:43.479965+0000","last_became_peered":"2023-07-20T10:06:43.479965+0000","last_unstale":"2023-07-20T10:06:45.569473+0000","last_undegraded":"2023-07-20T10:06:45.569473+0000","last_fullsized":"2023-07-20T10:06:45.569473+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:51.403978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565561+0000","last_change":"2023-07-20T10:06:44.480342+0000","last_active":"2023-07-20T10:06:45.565561+0000","last_peered":"2023-07-20T10:06:45.565561+0000","last_clean":"2023-07-20T10:06:45.565561+0000","last_became_active":"2023-07-20T10:06:44.479871+0000","last_became_peered":"2023-07-20T10:06:44.479871+0000","last_unstale":"2023-07-20T10:06:45.565561+0000","last_undegraded":"2023-07-20T10:06:45.565561+0000","last_fullsized":"2023-07-20T10:06:45.565561+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:22.664330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569915+0000","last_change":"2023-07-20T10:06:43.475691+0000","last_active":"2023-07-20T10:06:45.569915+0000","last_peered":"2023-07-20T10:06:45.569915+0000","last_clean":"2023-07-20T10:06:45.569915+0000","last_became_active":"2023-07-20T10:06:43.475393+0000","last_became_peered":"2023-07-20T10:06:43.475393+0000","last_unstale":"2023-07-20T10:06:45.569915+0000","last_undegraded":"2023-07-20T10:06:45.569915+0000","last_fullsized":"2023-07-20T10:06:45.569915+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:01:16.071378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565823+0000","last_change":"2023-07-20T10:06:44.472677+0000","last_active":"2023-07-20T10:06:45.565823+0000","last_peered":"2023-07-20T10:06:45.565823+0000","last_clean":"2023-07-20T10:06:45.565823+0000","last_became_active":"2023-07-20T10:06:44.472402+0000","last_became_peered":"2023-07-20T10:06:44.472402+0000","last_unstale":"2023-07-20T10:06:45.565823+0000","last_undegraded":"2023-07-20T10:06:45.565823+0000","last_fullsized":"2023-07-20T10:06:45.565823+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:27.332890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461019+0000","last_change":"2023-07-20T10:06:43.469775+0000","last_active":"2023-07-20T10:06:45.461019+0000","last_peered":"2023-07-20T10:06:45.461019+0000","last_clean":"2023-07-20T10:06:45.461019+0000","last_became_active":"2023-07-20T10:06:43.469463+0000","last_became_peered":"2023-07-20T10:06:43.469463+0000","last_unstale":"2023-07-20T10:06:45.461019+0000","last_undegraded":"2023-07-20T10:06:45.461019+0000","last_fullsized":"2023-07-20T10:06:45.461019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:00.753045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569367+0000","last_change":"2023-07-20T10:06:44.480161+0000","last_active":"2023-07-20T10:06:45.569367+0000","last_peered":"2023-07-20T10:06:45.569367+0000","last_clean":"2023-07-20T10:06:45.569367+0000","last_became_active":"2023-07-20T10:06:44.479865+0000","last_became_peered":"2023-07-20T10:06:44.479865+0000","last_unstale":"2023-07-20T10:06:45.569367+0000","last_undegraded":"2023-07-20T10:06:45.569367+0000","last_fullsized":"2023-07-20T10:06:45.569367+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:09.350534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566316+0000","last_change":"2023-07-20T10:06:43.467547+0000","last_active":"2023-07-20T10:06:45.566316+0000","last_peered":"2023-07-20T10:06:45.566316+0000","last_clean":"2023-07-20T10:06:45.566316+0000","last_became_active":"2023-07-20T10:06:43.467241+0000","last_became_peered":"2023-07-20T10:06:43.467241+0000","last_unstale":"2023-07-20T10:06:45.566316+0000","last_undegraded":"2023-07-20T10:06:45.566316+0000","last_fullsized":"2023-07-20T10:06:45.566316+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:10:09.888239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566041+0000","last_change":"2023-07-20T10:06:44.477812+0000","last_active":"2023-07-20T10:06:45.566041+0000","last_peered":"2023-07-20T10:06:45.566041+0000","last_clean":"2023-07-20T10:06:45.566041+0000","last_became_active":"2023-07-20T10:06:44.477554+0000","last_became_peered":"2023-07-20T10:06:44.477554+0000","last_unstale":"2023-07-20T10:06:45.566041+0000","last_undegraded":"2023-07-20T10:06:45.566041+0000","last_fullsized":"2023-07-20T10:06:45.566041+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:31.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565392+0000","last_change":"2023-07-20T10:06:43.473697+0000","last_active":"2023-07-20T10:06:45.565392+0000","last_peered":"2023-07-20T10:06:45.565392+0000","last_clean":"2023-07-20T10:06:45.565392+0000","last_became_active":"2023-07-20T10:06:43.473432+0000","last_became_peered":"2023-07-20T10:06:43.473432+0000","last_unstale":"2023-07-20T10:06:45.565392+0000","last_undegraded":"2023-07-20T10:06:45.565392+0000","last_fullsized":"2023-07-20T10:06:45.565392+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:00.816545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565562+0000","last_change":"2023-07-20T10:06:44.472653+0000","last_active":"2023-07-20T10:06:45.565562+0000","last_peered":"2023-07-20T10:06:45.565562+0000","last_clean":"2023-07-20T10:06:45.565562+0000","last_became_active":"2023-07-20T10:06:44.472390+0000","last_became_peered":"2023-07-20T10:06:44.472390+0000","last_unstale":"2023-07-20T10:06:45.565562+0000","last_undegraded":"2023-07-20T10:06:45.565562+0000","last_fullsized":"2023-07-20T10:06:45.565562+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:12.993070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.568910+0000","last_change":"2023-07-20T10:06:43.477958+0000","last_active":"2023-07-20T10:06:45.568910+0000","last_peered":"2023-07-20T10:06:45.568910+0000","last_clean":"2023-07-20T10:06:45.568910+0000","last_became_active":"2023-07-20T10:06:43.476867+0000","last_became_peered":"2023-07-20T10:06:43.476867+0000","last_unstale":"2023-07-20T10:06:45.568910+0000","last_undegraded":"2023-07-20T10:06:45.568910+0000","last_fullsized":"2023-07-20T10:06:45.568910+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:45:04.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460700+0000","last_change":"2023-07-20T10:06:44.467460+0000","last_active":"2023-07-20T10:06:45.460700+0000","last_peered":"2023-07-20T10:06:45.460700+0000","last_clean":"2023-07-20T10:06:45.460700+0000","last_became_active":"2023-07-20T10:06:44.467171+0000","last_became_peered":"2023-07-20T10:06:44.467171+0000","last_unstale":"2023-07-20T10:06:45.460700+0000","last_undegraded":"2023-07-20T10:06:45.460700+0000","last_fullsized":"2023-07-20T10:06:45.460700+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:55:42.212096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461798+0000","last_change":"2023-07-20T10:06:43.465731+0000","last_active":"2023-07-20T10:06:45.461798+0000","last_peered":"2023-07-20T10:06:45.461798+0000","last_clean":"2023-07-20T10:06:45.461798+0000","last_became_active":"2023-07-20T10:06:43.465435+0000","last_became_peered":"2023-07-20T10:06:43.465435+0000","last_unstale":"2023-07-20T10:06:45.461798+0000","last_undegraded":"2023-07-20T10:06:45.461798+0000","last_fullsized":"2023-07-20T10:06:45.461798+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:39:42.122148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569333+0000","last_change":"2023-07-20T10:06:44.479420+0000","last_active":"2023-07-20T10:06:45.569333+0000","last_peered":"2023-07-20T10:06:45.569333+0000","last_clean":"2023-07-20T10:06:45.569333+0000","last_became_active":"2023-07-20T10:06:44.479131+0000","last_became_peered":"2023-07-20T10:06:44.479131+0000","last_unstale":"2023-07-20T10:06:45.569333+0000","last_undegraded":"2023-07-20T10:06:45.569333+0000","last_fullsized":"2023-07-20T10:06:45.569333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:15.901289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565674+0000","last_change":"2023-07-20T10:06:43.472162+0000","last_active":"2023-07-20T10:06:45.565674+0000","last_peered":"2023-07-20T10:06:45.565674+0000","last_clean":"2023-07-20T10:06:45.565674+0000","last_became_active":"2023-07-20T10:06:43.471820+0000","last_became_peered":"2023-07-20T10:06:43.471820+0000","last_unstale":"2023-07-20T10:06:45.565674+0000","last_undegraded":"2023-07-20T10:06:45.565674+0000","last_fullsized":"2023-07-20T10:06:45.565674+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:36.080964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565562+0000","last_change":"2023-07-20T10:06:44.471896+0000","last_active":"2023-07-20T10:06:45.565562+0000","last_peered":"2023-07-20T10:06:45.565562+0000","last_clean":"2023-07-20T10:06:45.565562+0000","last_became_active":"2023-07-20T10:06:44.471631+0000","last_became_peered":"2023-07-20T10:06:44.471631+0000","last_unstale":"2023-07-20T10:06:45.565562+0000","last_undegraded":"2023-07-20T10:06:45.565562+0000","last_fullsized":"2023-07-20T10:06:45.565562+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:06.257007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"106'3","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460855+0000","last_change":"2023-07-20T10:06:43.474965+0000","last_active":"2023-07-20T10:06:45.460855+0000","last_peered":"2023-07-20T10:06:45.460855+0000","last_clean":"2023-07-20T10:06:45.460855+0000","last_became_active":"2023-07-20T10:06:43.474482+0000","last_became_peered":"2023-07-20T10:06:43.474482+0000","last_unstale":"2023-07-20T10:06:45.460855+0000","last_undegraded":"2023-07-20T10:06:45.460855+0000","last_fullsized":"2023-07-20T10:06:45.460855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:23:41.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566876+0000","last_change":"2023-07-20T10:06:44.483698+0000","last_active":"2023-07-20T10:06:45.566876+0000","last_peered":"2023-07-20T10:06:45.566876+0000","last_clean":"2023-07-20T10:06:45.566876+0000","last_became_active":"2023-07-20T10:06:44.483439+0000","last_became_peered":"2023-07-20T10:06:44.483439+0000","last_unstale":"2023-07-20T10:06:45.566876+0000","last_undegraded":"2023-07-20T10:06:45.566876+0000","last_fullsized":"2023-07-20T10:06:45.566876+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:21:00.057046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"106'6","reported_seq":19,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566505+0000","last_change":"2023-07-20T10:06:43.470986+0000","last_active":"2023-07-20T10:06:45.566505+0000","last_peered":"2023-07-20T10:06:45.566505+0000","last_clean":"2023-07-20T10:06:45.566505+0000","last_became_active":"2023-07-20T10:06:43.470639+0000","last_became_peered":"2023-07-20T10:06:43.470639+0000","last_unstale":"2023-07-20T10:06:45.566505+0000","last_undegraded":"2023-07-20T10:06:45.566505+0000","last_fullsized":"2023-07-20T10:06:45.566505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:00.640368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565934+0000","last_change":"2023-07-20T10:06:44.476081+0000","last_active":"2023-07-20T10:06:45.565934+0000","last_peered":"2023-07-20T10:06:45.565934+0000","last_clean":"2023-07-20T10:06:45.565934+0000","last_became_active":"2023-07-20T10:06:44.475820+0000","last_became_peered":"2023-07-20T10:06:44.475820+0000","last_unstale":"2023-07-20T10:06:45.565934+0000","last_undegraded":"2023-07-20T10:06:45.565934+0000","last_fullsized":"2023-07-20T10:06:45.565934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:36.266744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569361+0000","last_change":"2023-07-20T10:06:43.477620+0000","last_active":"2023-07-20T10:06:45.569361+0000","last_peered":"2023-07-20T10:06:45.569361+0000","last_clean":"2023-07-20T10:06:45.569361+0000","last_became_active":"2023-07-20T10:06:43.477161+0000","last_became_peered":"2023-07-20T10:06:43.477161+0000","last_unstale":"2023-07-20T10:06:45.569361+0000","last_undegraded":"2023-07-20T10:06:45.569361+0000","last_fullsized":"2023-07-20T10:06:45.569361+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:27.492594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460163+0000","last_change":"2023-07-20T10:06:44.474124+0000","last_active":"2023-07-20T10:06:45.460163+0000","last_peered":"2023-07-20T10:06:45.460163+0000","last_clean":"2023-07-20T10:06:45.460163+0000","last_became_active":"2023-07-20T10:06:44.473798+0000","last_became_peered":"2023-07-20T10:06:44.473798+0000","last_unstale":"2023-07-20T10:06:45.460163+0000","last_undegraded":"2023-07-20T10:06:45.460163+0000","last_fullsized":"2023-07-20T10:06:45.460163+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:41.752987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566155+0000","last_change":"2023-07-20T10:06:43.470913+0000","last_active":"2023-07-20T10:06:45.566155+0000","last_peered":"2023-07-20T10:06:45.566155+0000","last_clean":"2023-07-20T10:06:45.566155+0000","last_became_active":"2023-07-20T10:06:43.470632+0000","last_became_peered":"2023-07-20T10:06:43.470632+0000","last_unstale":"2023-07-20T10:06:45.566155+0000","last_undegraded":"2023-07-20T10:06:45.566155+0000","last_fullsized":"2023-07-20T10:06:45.566155+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:51.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455322+0000","last_change":"2023-07-20T10:06:44.475123+0000","last_active":"2023-07-20T10:06:45.455322+0000","last_peered":"2023-07-20T10:06:45.455322+0000","last_clean":"2023-07-20T10:06:45.455322+0000","last_became_active":"2023-07-20T10:06:44.474851+0000","last_became_peered":"2023-07-20T10:06:44.474851+0000","last_unstale":"2023-07-20T10:06:45.455322+0000","last_undegraded":"2023-07-20T10:06:45.455322+0000","last_fullsized":"2023-07-20T10:06:45.455322+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:17.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566844+0000","last_change":"2023-07-20T10:06:43.469587+0000","last_active":"2023-07-20T10:06:45.566844+0000","last_peered":"2023-07-20T10:06:45.566844+0000","last_clean":"2023-07-20T10:06:45.566844+0000","last_became_active":"2023-07-20T10:06:43.469322+0000","last_became_peered":"2023-07-20T10:06:43.469322+0000","last_unstale":"2023-07-20T10:06:45.566844+0000","last_undegraded":"2023-07-20T10:06:45.566844+0000","last_fullsized":"2023-07-20T10:06:45.566844+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:09:24.249219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455225+0000","last_change":"2023-07-20T10:06:44.467121+0000","last_active":"2023-07-20T10:06:45.455225+0000","last_peered":"2023-07-20T10:06:45.455225+0000","last_clean":"2023-07-20T10:06:45.455225+0000","last_became_active":"2023-07-20T10:06:44.466290+0000","last_became_peered":"2023-07-20T10:06:44.466290+0000","last_unstale":"2023-07-20T10:06:45.455225+0000","last_undegraded":"2023-07-20T10:06:45.455225+0000","last_fullsized":"2023-07-20T10:06:45.455225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:16.043577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"106'8","reported_seq":21,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566042+0000","last_change":"2023-07-20T10:06:43.467283+0000","last_active":"2023-07-20T10:06:45.566042+0000","last_peered":"2023-07-20T10:06:45.566042+0000","last_clean":"2023-07-20T10:06:45.566042+0000","last_became_active":"2023-07-20T10:06:43.467005+0000","last_became_peered":"2023-07-20T10:06:43.467005+0000","last_unstale":"2023-07-20T10:06:45.566042+0000","last_undegraded":"2023-07-20T10:06:45.566042+0000","last_fullsized":"2023-07-20T10:06:45.566042+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:00.640368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569733+0000","last_change":"2023-07-20T10:06:44.476057+0000","last_active":"2023-07-20T10:06:45.569733+0000","last_peered":"2023-07-20T10:06:45.569733+0000","last_clean":"2023-07-20T10:06:45.569733+0000","last_became_active":"2023-07-20T10:06:44.475752+0000","last_became_peered":"2023-07-20T10:06:44.475752+0000","last_unstale":"2023-07-20T10:06:45.569733+0000","last_undegraded":"2023-07-20T10:06:45.569733+0000","last_fullsized":"2023-07-20T10:06:45.569733+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:42.692214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569799+0000","last_change":"2023-07-20T10:06:43.478374+0000","last_active":"2023-07-20T10:06:45.569799+0000","last_peered":"2023-07-20T10:06:45.569799+0000","last_clean":"2023-07-20T10:06:45.569799+0000","last_became_active":"2023-07-20T10:06:43.478050+0000","last_became_peered":"2023-07-20T10:06:43.478050+0000","last_unstale":"2023-07-20T10:06:45.569799+0000","last_undegraded":"2023-07-20T10:06:45.569799+0000","last_fullsized":"2023-07-20T10:06:45.569799+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:05.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566630+0000","last_change":"2023-07-20T10:06:44.482724+0000","last_active":"2023-07-20T10:06:45.566630+0000","last_peered":"2023-07-20T10:06:45.566630+0000","last_clean":"2023-07-20T10:06:45.566630+0000","last_became_active":"2023-07-20T10:06:44.482457+0000","last_became_peered":"2023-07-20T10:06:44.482457+0000","last_unstale":"2023-07-20T10:06:45.566630+0000","last_undegraded":"2023-07-20T10:06:45.566630+0000","last_fullsized":"2023-07-20T10:06:45.566630+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:49:01.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460885+0000","last_change":"2023-07-20T10:06:43.471424+0000","last_active":"2023-07-20T10:06:45.460885+0000","last_peered":"2023-07-20T10:06:45.460885+0000","last_clean":"2023-07-20T10:06:45.460885+0000","last_became_active":"2023-07-20T10:06:43.471115+0000","last_became_peered":"2023-07-20T10:06:43.471115+0000","last_unstale":"2023-07-20T10:06:45.460885+0000","last_undegraded":"2023-07-20T10:06:45.460885+0000","last_fullsized":"2023-07-20T10:06:45.460885+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:21.480571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566377+0000","last_change":"2023-07-20T10:06:44.479283+0000","last_active":"2023-07-20T10:06:45.566377+0000","last_peered":"2023-07-20T10:06:45.566377+0000","last_clean":"2023-07-20T10:06:45.566377+0000","last_became_active":"2023-07-20T10:06:44.479011+0000","last_became_peered":"2023-07-20T10:06:44.479011+0000","last_unstale":"2023-07-20T10:06:45.566377+0000","last_undegraded":"2023-07-20T10:06:45.566377+0000","last_fullsized":"2023-07-20T10:06:45.566377+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:12.993070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461045+0000","last_change":"2023-07-20T10:06:43.474819+0000","last_active":"2023-07-20T10:06:45.461045+0000","last_peered":"2023-07-20T10:06:45.461045+0000","last_clean":"2023-07-20T10:06:45.461045+0000","last_became_active":"2023-07-20T10:06:43.474441+0000","last_became_peered":"2023-07-20T10:06:43.474441+0000","last_unstale":"2023-07-20T10:06:45.461045+0000","last_undegraded":"2023-07-20T10:06:45.461045+0000","last_fullsized":"2023-07-20T10:06:45.461045+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:03:38.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461758+0000","last_change":"2023-07-20T10:06:44.466774+0000","last_active":"2023-07-20T10:06:45.461758+0000","last_peered":"2023-07-20T10:06:45.461758+0000","last_clean":"2023-07-20T10:06:45.461758+0000","last_became_active":"2023-07-20T10:06:44.466411+0000","last_became_peered":"2023-07-20T10:06:44.466411+0000","last_unstale":"2023-07-20T10:06:45.461758+0000","last_undegraded":"2023-07-20T10:06:45.461758+0000","last_fullsized":"2023-07-20T10:06:45.461758+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:54:42.901372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569895+0000","last_change":"2023-07-20T10:06:43.471746+0000","last_active":"2023-07-20T10:06:45.569895+0000","last_peered":"2023-07-20T10:06:45.569895+0000","last_clean":"2023-07-20T10:06:45.569895+0000","last_became_active":"2023-07-20T10:06:43.471193+0000","last_became_peered":"2023-07-20T10:06:43.471193+0000","last_unstale":"2023-07-20T10:06:45.569895+0000","last_undegraded":"2023-07-20T10:06:45.569895+0000","last_fullsized":"2023-07-20T10:06:45.569895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:23:56.340692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454931+0000","last_change":"2023-07-20T10:06:44.475271+0000","last_active":"2023-07-20T10:06:45.454931+0000","last_peered":"2023-07-20T10:06:45.454931+0000","last_clean":"2023-07-20T10:06:45.454931+0000","last_became_active":"2023-07-20T10:06:44.475006+0000","last_became_peered":"2023-07-20T10:06:44.475006+0000","last_unstale":"2023-07-20T10:06:45.454931+0000","last_undegraded":"2023-07-20T10:06:45.454931+0000","last_fullsized":"2023-07-20T10:06:45.454931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:30:18.452969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566265+0000","last_change":"2023-07-20T10:06:43.471548+0000","last_active":"2023-07-20T10:06:45.566265+0000","last_peered":"2023-07-20T10:06:45.566265+0000","last_clean":"2023-07-20T10:06:45.566265+0000","last_became_active":"2023-07-20T10:06:43.471209+0000","last_became_peered":"2023-07-20T10:06:43.471209+0000","last_unstale":"2023-07-20T10:06:45.566265+0000","last_undegraded":"2023-07-20T10:06:45.566265+0000","last_fullsized":"2023-07-20T10:06:45.566265+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:04.461418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565191+0000","last_change":"2023-07-20T10:06:44.472734+0000","last_active":"2023-07-20T10:06:45.565191+0000","last_peered":"2023-07-20T10:06:45.565191+0000","last_clean":"2023-07-20T10:06:45.565191+0000","last_became_active":"2023-07-20T10:06:44.472450+0000","last_became_peered":"2023-07-20T10:06:44.472450+0000","last_unstale":"2023-07-20T10:06:45.565191+0000","last_undegraded":"2023-07-20T10:06:45.565191+0000","last_fullsized":"2023-07-20T10:06:45.565191+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:08:17.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461454+0000","last_change":"2023-07-20T10:06:43.472376+0000","last_active":"2023-07-20T10:06:45.461454+0000","last_peered":"2023-07-20T10:06:45.461454+0000","last_clean":"2023-07-20T10:06:45.461454+0000","last_became_active":"2023-07-20T10:06:43.470495+0000","last_became_peered":"2023-07-20T10:06:43.470495+0000","last_unstale":"2023-07-20T10:06:45.461454+0000","last_undegraded":"2023-07-20T10:06:45.461454+0000","last_fullsized":"2023-07-20T10:06:45.461454+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:18:03.456196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569150+0000","last_change":"2023-07-20T10:06:44.482102+0000","last_active":"2023-07-20T10:06:45.569150+0000","last_peered":"2023-07-20T10:06:45.569150+0000","last_clean":"2023-07-20T10:06:45.569150+0000","last_became_active":"2023-07-20T10:06:44.481770+0000","last_became_peered":"2023-07-20T10:06:44.481770+0000","last_unstale":"2023-07-20T10:06:45.569150+0000","last_undegraded":"2023-07-20T10:06:45.569150+0000","last_fullsized":"2023-07-20T10:06:45.569150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:06:51.553395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569469+0000","last_change":"2023-07-20T10:06:43.469684+0000","last_active":"2023-07-20T10:06:45.569469+0000","last_peered":"2023-07-20T10:06:45.569469+0000","last_clean":"2023-07-20T10:06:45.569469+0000","last_became_active":"2023-07-20T10:06:43.469320+0000","last_became_peered":"2023-07-20T10:06:43.469320+0000","last_unstale":"2023-07-20T10:06:45.569469+0000","last_undegraded":"2023-07-20T10:06:45.569469+0000","last_fullsized":"2023-07-20T10:06:45.569469+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:01.212789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566166+0000","last_change":"2023-07-20T10:06:44.475180+0000","last_active":"2023-07-20T10:06:45.566166+0000","last_peered":"2023-07-20T10:06:45.566166+0000","last_clean":"2023-07-20T10:06:45.566166+0000","last_became_active":"2023-07-20T10:06:44.474858+0000","last_became_peered":"2023-07-20T10:06:44.474858+0000","last_unstale":"2023-07-20T10:06:45.566166+0000","last_undegraded":"2023-07-20T10:06:45.566166+0000","last_fullsized":"2023-07-20T10:06:45.566166+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:46.558975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.568974+0000","last_change":"2023-07-20T10:06:43.477319+0000","last_active":"2023-07-20T10:06:45.568974+0000","last_peered":"2023-07-20T10:06:45.568974+0000","last_clean":"2023-07-20T10:06:45.568974+0000","last_became_active":"2023-07-20T10:06:43.477040+0000","last_became_peered":"2023-07-20T10:06:43.477040+0000","last_unstale":"2023-07-20T10:06:45.568974+0000","last_undegraded":"2023-07-20T10:06:45.568974+0000","last_fullsized":"2023-07-20T10:06:45.568974+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:05.453031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569669+0000","last_change":"2023-07-20T10:06:44.480500+0000","last_active":"2023-07-20T10:06:45.569669+0000","last_peered":"2023-07-20T10:06:45.569669+0000","last_clean":"2023-07-20T10:06:45.569669+0000","last_became_active":"2023-07-20T10:06:44.480039+0000","last_became_peered":"2023-07-20T10:06:44.480039+0000","last_unstale":"2023-07-20T10:06:45.569669+0000","last_undegraded":"2023-07-20T10:06:45.569669+0000","last_fullsized":"2023-07-20T10:06:45.569669+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:51.276810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566496+0000","last_change":"2023-07-20T10:06:43.469770+0000","last_active":"2023-07-20T10:06:45.566496+0000","last_peered":"2023-07-20T10:06:45.566496+0000","last_clean":"2023-07-20T10:06:45.566496+0000","last_became_active":"2023-07-20T10:06:43.469494+0000","last_became_peered":"2023-07-20T10:06:43.469494+0000","last_unstale":"2023-07-20T10:06:45.566496+0000","last_undegraded":"2023-07-20T10:06:45.566496+0000","last_fullsized":"2023-07-20T10:06:45.566496+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:26:33.647057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"96'183","reported_seq":561,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569150+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:45.569150+0000","last_peered":"2023-07-20T10:06:45.569150+0000","last_clean":"2023-07-20T10:06:45.569150+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:45.569150+0000","last_undegraded":"2023-07-20T10:06:45.569150+0000","last_fullsized":"2023-07-20T10:06:45.569150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:16:39.665026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461282+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:45.461282+0000","last_peered":"2023-07-20T10:06:45.461282+0000","last_clean":"2023-07-20T10:06:45.461282+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:45.461282+0000","last_undegraded":"2023-07-20T10:06:45.461282+0000","last_fullsized":"2023-07-20T10:06:45.461282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:37.648389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566392+0000","last_change":"2023-07-20T10:06:44.476131+0000","last_active":"2023-07-20T10:06:45.566392+0000","last_peered":"2023-07-20T10:06:45.566392+0000","last_clean":"2023-07-20T10:06:45.566392+0000","last_became_active":"2023-07-20T10:06:44.473473+0000","last_became_peered":"2023-07-20T10:06:44.473473+0000","last_unstale":"2023-07-20T10:06:45.566392+0000","last_undegraded":"2023-07-20T10:06:45.566392+0000","last_fullsized":"2023-07-20T10:06:45.566392+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:27.332890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569871+0000","last_change":"2023-07-20T10:06:43.479147+0000","last_active":"2023-07-20T10:06:45.569871+0000","last_peered":"2023-07-20T10:06:45.569871+0000","last_clean":"2023-07-20T10:06:45.569871+0000","last_became_active":"2023-07-20T10:06:43.478838+0000","last_became_peered":"2023-07-20T10:06:43.478838+0000","last_unstale":"2023-07-20T10:06:45.569871+0000","last_undegraded":"2023-07-20T10:06:45.569871+0000","last_fullsized":"2023-07-20T10:06:45.569871+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:14.061929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569096+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:45.569096+0000","last_peered":"2023-07-20T10:06:45.569096+0000","last_clean":"2023-07-20T10:06:45.569096+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:45.569096+0000","last_undegraded":"2023-07-20T10:06:45.569096+0000","last_fullsized":"2023-07-20T10:06:45.569096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:02:18.173523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569779+0000","last_change":"2023-07-20T10:06:44.480688+0000","last_active":"2023-07-20T10:06:45.569779+0000","last_peered":"2023-07-20T10:06:45.569779+0000","last_clean":"2023-07-20T10:06:45.569779+0000","last_became_active":"2023-07-20T10:06:44.480327+0000","last_became_peered":"2023-07-20T10:06:44.480327+0000","last_unstale":"2023-07-20T10:06:45.569779+0000","last_undegraded":"2023-07-20T10:06:45.569779+0000","last_fullsized":"2023-07-20T10:06:45.569779+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:07.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569548+0000","last_change":"2023-07-20T10:06:43.478316+0000","last_active":"2023-07-20T10:06:45.569548+0000","last_peered":"2023-07-20T10:06:45.569548+0000","last_clean":"2023-07-20T10:06:45.569548+0000","last_became_active":"2023-07-20T10:06:43.477958+0000","last_became_peered":"2023-07-20T10:06:43.477958+0000","last_unstale":"2023-07-20T10:06:45.569548+0000","last_undegraded":"2023-07-20T10:06:45.569548+0000","last_fullsized":"2023-07-20T10:06:45.569548+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:09:43.016635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454973+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:45.454973+0000","last_peered":"2023-07-20T10:06:45.454973+0000","last_clean":"2023-07-20T10:06:45.454973+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:45.454973+0000","last_undegraded":"2023-07-20T10:06:45.454973+0000","last_fullsized":"2023-07-20T10:06:45.454973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:08.024078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460561+0000","last_change":"2023-07-20T10:06:44.468573+0000","last_active":"2023-07-20T10:06:45.460561+0000","last_peered":"2023-07-20T10:06:45.460561+0000","last_clean":"2023-07-20T10:06:45.460561+0000","last_became_active":"2023-07-20T10:06:44.468288+0000","last_became_peered":"2023-07-20T10:06:44.468288+0000","last_unstale":"2023-07-20T10:06:45.460561+0000","last_undegraded":"2023-07-20T10:06:45.460561+0000","last_fullsized":"2023-07-20T10:06:45.460561+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:01.581046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460903+0000","last_change":"2023-07-20T10:06:43.474746+0000","last_active":"2023-07-20T10:06:45.460903+0000","last_peered":"2023-07-20T10:06:45.460903+0000","last_clean":"2023-07-20T10:06:45.460903+0000","last_became_active":"2023-07-20T10:06:43.473956+0000","last_became_peered":"2023-07-20T10:06:43.473956+0000","last_unstale":"2023-07-20T10:06:45.460903+0000","last_undegraded":"2023-07-20T10:06:45.460903+0000","last_fullsized":"2023-07-20T10:06:45.460903+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:04.625352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461597+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:45.461597+0000","last_peered":"2023-07-20T10:06:45.461597+0000","last_clean":"2023-07-20T10:06:45.461597+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:45.461597+0000","last_undegraded":"2023-07-20T10:06:45.461597+0000","last_fullsized":"2023-07-20T10:06:45.461597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:33:42.675468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565567+0000","last_change":"2023-07-20T10:06:44.482384+0000","last_active":"2023-07-20T10:06:45.565567+0000","last_peered":"2023-07-20T10:06:45.565567+0000","last_clean":"2023-07-20T10:06:45.565567+0000","last_became_active":"2023-07-20T10:06:44.482116+0000","last_became_peered":"2023-07-20T10:06:44.482116+0000","last_unstale":"2023-07-20T10:06:45.565567+0000","last_undegraded":"2023-07-20T10:06:45.565567+0000","last_fullsized":"2023-07-20T10:06:45.565567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:41:33.887358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461456+0000","last_change":"2023-07-20T10:06:43.469866+0000","last_active":"2023-07-20T10:06:45.461456+0000","last_peered":"2023-07-20T10:06:45.461456+0000","last_clean":"2023-07-20T10:06:45.461456+0000","last_became_active":"2023-07-20T10:06:43.469563+0000","last_became_peered":"2023-07-20T10:06:43.469563+0000","last_unstale":"2023-07-20T10:06:45.461456+0000","last_undegraded":"2023-07-20T10:06:45.461456+0000","last_fullsized":"2023-07-20T10:06:45.461456+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:13:44.328162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566550+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:45.566550+0000","last_peered":"2023-07-20T10:06:45.566550+0000","last_clean":"2023-07-20T10:06:45.566550+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:45.566550+0000","last_undegraded":"2023-07-20T10:06:45.566550+0000","last_fullsized":"2023-07-20T10:06:45.566550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:10.754510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460939+0000","last_change":"2023-07-20T10:06:44.467288+0000","last_active":"2023-07-20T10:06:45.460939+0000","last_peered":"2023-07-20T10:06:45.460939+0000","last_clean":"2023-07-20T10:06:45.460939+0000","last_became_active":"2023-07-20T10:06:44.466999+0000","last_became_peered":"2023-07-20T10:06:44.466999+0000","last_unstale":"2023-07-20T10:06:45.460939+0000","last_undegraded":"2023-07-20T10:06:45.460939+0000","last_fullsized":"2023-07-20T10:06:45.460939+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:23.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455412+0000","last_change":"2023-07-20T10:06:43.472464+0000","last_active":"2023-07-20T10:06:45.455412+0000","last_peered":"2023-07-20T10:06:45.455412+0000","last_clean":"2023-07-20T10:06:45.455412+0000","last_became_active":"2023-07-20T10:06:43.472186+0000","last_became_peered":"2023-07-20T10:06:43.472186+0000","last_unstale":"2023-07-20T10:06:45.455412+0000","last_undegraded":"2023-07-20T10:06:45.455412+0000","last_fullsized":"2023-07-20T10:06:45.455412+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:23.887891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569539+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:45.569539+0000","last_peered":"2023-07-20T10:06:45.569539+0000","last_clean":"2023-07-20T10:06:45.569539+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:45.569539+0000","last_undegraded":"2023-07-20T10:06:45.569539+0000","last_fullsized":"2023-07-20T10:06:45.569539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:31.756871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461461+0000","last_change":"2023-07-20T10:06:44.481915+0000","last_active":"2023-07-20T10:06:45.461461+0000","last_peered":"2023-07-20T10:06:45.461461+0000","last_clean":"2023-07-20T10:06:45.461461+0000","last_became_active":"2023-07-20T10:06:44.481611+0000","last_became_peered":"2023-07-20T10:06:44.481611+0000","last_unstale":"2023-07-20T10:06:45.461461+0000","last_undegraded":"2023-07-20T10:06:45.461461+0000","last_fullsized":"2023-07-20T10:06:45.461461+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:46:50.126163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461067+0000","last_change":"2023-07-20T10:06:43.471785+0000","last_active":"2023-07-20T10:06:45.461067+0000","last_peered":"2023-07-20T10:06:45.461067+0000","last_clean":"2023-07-20T10:06:45.461067+0000","last_became_active":"2023-07-20T10:06:43.471478+0000","last_became_peered":"2023-07-20T10:06:43.471478+0000","last_unstale":"2023-07-20T10:06:45.461067+0000","last_undegraded":"2023-07-20T10:06:45.461067+0000","last_fullsized":"2023-07-20T10:06:45.461067+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:21:41.314151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566146+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:45.566146+0000","last_peered":"2023-07-20T10:06:45.566146+0000","last_clean":"2023-07-20T10:06:45.566146+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:45.566146+0000","last_undegraded":"2023-07-20T10:06:45.566146+0000","last_fullsized":"2023-07-20T10:06:45.566146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:38.815168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566040+0000","last_change":"2023-07-20T10:06:44.479305+0000","last_active":"2023-07-20T10:06:45.566040+0000","last_peered":"2023-07-20T10:06:45.566040+0000","last_clean":"2023-07-20T10:06:45.566040+0000","last_became_active":"2023-07-20T10:06:44.479035+0000","last_became_peered":"2023-07-20T10:06:44.479035+0000","last_unstale":"2023-07-20T10:06:45.566040+0000","last_undegraded":"2023-07-20T10:06:45.566040+0000","last_fullsized":"2023-07-20T10:06:45.566040+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:42.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454993+0000","last_change":"2023-07-20T10:06:43.462009+0000","last_active":"2023-07-20T10:06:45.454993+0000","last_peered":"2023-07-20T10:06:45.454993+0000","last_clean":"2023-07-20T10:06:45.454993+0000","last_became_active":"2023-07-20T10:06:43.461708+0000","last_became_peered":"2023-07-20T10:06:43.461708+0000","last_unstale":"2023-07-20T10:06:45.454993+0000","last_undegraded":"2023-07-20T10:06:45.454993+0000","last_fullsized":"2023-07-20T10:06:45.454993+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:56:10.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.570016+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:45.570016+0000","last_peered":"2023-07-20T10:06:45.570016+0000","last_clean":"2023-07-20T10:06:45.570016+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:45.570016+0000","last_undegraded":"2023-07-20T10:06:45.570016+0000","last_fullsized":"2023-07-20T10:06:45.570016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:52.377889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575045,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59228,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312612,"statfs":{"total":96636764160,"available":96576114688,"internally_reserved":0,"allocated":1916928,"data_stored":1246398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71199999999999997,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.93899999999999995,"5min":1.008,"15min":1.008},"last":0.745},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.075,"15min":1.075},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.69799999999999995},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.499,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.716,"15min":1.716},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.433},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.3759999999999999,"5min":1.758,"15min":1.758},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.434,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.97399999999999998,"5min":1.8,"15min":1.8},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1335296,"data_stored":658142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.75700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575045,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.872},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575045,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1323008,"data_stored":656134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":1.0069999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.085},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68200000000000005,"15min":0.71599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":1.22,"15min":1.363},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70799999999999996,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.177,"15min":1.177},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.55100000000000005,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.204,"15min":1.23},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.98899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.196},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.84999999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":1.034},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.876,"15min":1.2649999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.57299999999999995,"5min":0.69299999999999995,"15min":0.81899999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46800000000000003,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.68700000000000006,"15min":0.70299999999999996},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1890000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.381},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.747}]},{"osd":6,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.504,"15min":0.502},"max":{"1min":0.83099999999999996,"5min":1.04,"15min":1.131},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86299999999999999,"5min":0.97699999999999998,"15min":1.4399999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54552,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317288,"statfs":{"total":96636764160,"available":96580902912,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51200000000000001},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68000000000000005,"5min":0.76100000000000001,"15min":0.84499999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.25700000000000001},"max":{"1min":0.53000000000000003,"5min":0.83799999999999997,"15min":0.876},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65300000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63900000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.371},{"interface":"front","average":{"1min":0.503,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0700000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.99399999999999999,"5min":1.099,"15min":1.2689999999999999},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":1.087,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.044,"5min":1.218,"15min":1.3240000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79700000000000004,"15min":0.81299999999999994},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.96499999999999997,"5min":1.143,"15min":1.292},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.02,"5min":1.204,"15min":1.393},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1318912,"data_stored":656044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54300000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.497,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66400000000000003,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.372}]},{"osd":3,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":0.81200000000000006,"15min":1.052},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":1.399,"15min":1.399},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.89700000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.92000000000000004,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.74299999999999999,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94799999999999995,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.76800000000000002},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.74299999999999999,"15min":0.77000000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.86299999999999999,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.45000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90800000000000003,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1933312,"data_stored":1248612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.502},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:50.410 INFO:tasks.ceph.mds.d.smithi183.stderr:2023-07-20T10:06:50.435+0000 7f83cbd95640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:06:53.074 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:06:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.241+0000 7f506f288640 1 Processor -- start 2023-07-20T10:06:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.241+0000 7f506f288640 1 -- start start 2023-07-20T10:06:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f50680ca040 0x7f50680ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815c910 0x7f506815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f506815d2d0 0x7f50680c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680cde70 con 0x7f506815d2d0 2023-07-20T10:06:53.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506815d760 con 0x7f50680ca040 2023-07-20T10:06:53.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506f288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50680cbef0 con 0x7f506815c910 2023-07-20T10:06:53.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f506815d2d0 0x7f50680c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f506815d2d0 0x7f50680c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41174/0 (socket says 172.21.15.82:41174) 2023-07-20T10:06:53.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 -- 172.21.15.82:0/718858670 learned_addr learned my addr 172.21.15.82:0/718858670 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:53.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d024640 1 --2- 172.21.15.82:0/718858670 >> v2:172.21.15.183:3300/0 conn(0x7f50680ca040 0x7f50680ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506c823640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815c910 0x7f506815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 -- 172.21.15.82:0/718858670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815c910 msgr2=0x7f506815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815c910 0x7f506815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 -- 172.21.15.82:0/718858670 >> v2:172.21.15.183:3300/0 conn(0x7f50680ca040 msgr2=0x7f50680ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 --2- 172.21.15.82:0/718858670 >> v2:172.21.15.183:3300/0 conn(0x7f50680ca040 0x7f50680ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.245+0000 7f506d825640 1 -- 172.21.15.82:0/718858670 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680ca420 con 0x7f506815d2d0 2023-07-20T10:06:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506d825640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815d2d0 0x7f50680c8970 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f5068066a70 tx=0x7f506001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d33e8800126ee8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f505ffff640 1 -- 172.21.15.82:0/718858670 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000b2d0 con 0x7f506815d2d0 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f505ffff640 1 -- 172.21.15.82:0/718858670 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506000b430 con 0x7f506815d2d0 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f505ffff640 1 -- 172.21.15.82:0/718858670 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600a7b10 con 0x7f506815d2d0 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- 172.21.15.82:0/718858670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815d2d0 msgr2=0x7f50680c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815d2d0 0x7f50680c8970 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f5068066a70 tx=0x7f506001ebd0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- 172.21.15.82:0/718858670 shutdown_connections 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815d2d0 0x7f50680c8970 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 --2- 172.21.15.82:0/718858670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815c910 0x7f506815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 --2- 172.21.15.82:0/718858670 >> v2:172.21.15.183:3300/0 conn(0x7f50680ca040 0x7f50680ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- 172.21.15.82:0/718858670 >> 172.21.15.82:0/718858670 conn(0x7f50680cada0 msgr2=0x7f50680cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- 172.21.15.82:0/718858670 shutdown_connections 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- 172.21.15.82:0/718858670 wait complete. 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 Processor -- start 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.249+0000 7f506f288640 1 -- start start 2023-07-20T10:06:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50680ca040 0x7f5068150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 0x7f50680b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5068098f50 con 0x7f506815c910 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50680991f0 con 0x7f50680ca040 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506806b8e0 con 0x7f506815d2d0 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60456/0 (socket says 172.21.15.82:60456) 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 -- 172.21.15.82:0/911415983 learned_addr learned my addr 172.21.15.82:0/911415983 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506d024640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50680ca040 0x7f5068150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506d825640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 0x7f50680b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 -- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 msgr2=0x7f50680b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 0x7f50680b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 -- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50680ca040 msgr2=0x7f5068150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50680ca040 0x7f5068150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 -- 172.21.15.82:0/911415983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506000bd40 con 0x7f506815c910 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506d825640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 0x7f50680b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506c823640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f505800d800 tx=0x7f505800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800b6c0 con 0x7f506815c910 2023-07-20T10:06:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800b820 con 0x7f506815c910 2023-07-20T10:06:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800bb90 con 0x7f506815c910 2023-07-20T10:06:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506806bbc0 con 0x7f506815c910 2023-07-20T10:06:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50680994d0 con 0x7f506815c910 2023-07-20T10:06:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5068073c70 con 0x7f506815c910 2023-07-20T10:06:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.253+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f505800bcf0 con 0x7f506815c910 2023-07-20T10:06:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.257+0000 7f505dffb640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 0x7f504c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.257+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50580842f0 con 0x7f506815c910 2023-07-20T10:06:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.257+0000 7f506d024640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 0x7f504c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.257+0000 7f506d024640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 0x7f504c068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50640045f0 tx=0x7f5064008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.261+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5058055180 con 0x7f506815c910 2023-07-20T10:06:53.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.405+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50680c8eb0 con 0x7f504c0663a0 2023-07-20T10:06:53.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.413+0000 7f505dffb640 1 -- 172.21.15.82:0/911415983 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311957 (secure 0 0 0) 0x7f506400b740 con 0x7f504c0663a0 2023-07-20T10:06:53.397 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:53.398 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:06:53.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 msgr2=0x7f504c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 0x7f504c068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50640045f0 tx=0x7f5064008040 comp rx=0 tx=0).stop 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 msgr2=0x7f5068098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f505800d800 tx=0x7f505800dcc0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 shutdown_connections 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f504c0663a0 0x7f504c068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f506815d2d0 0x7f50680b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f506815c910 0x7f5068098a10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 --2- 172.21.15.82:0/911415983 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50680ca040 0x7f5068150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 >> 172.21.15.82:0/911415983 conn(0x7f50680cada0 msgr2=0x7f50680c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:53.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 shutdown_connections 2023-07-20T10:06:53.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.417+0000 7f506f288640 1 -- 172.21.15.82:0/911415983 wait complete. 2023-07-20T10:06:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:06:51.480033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":195,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312924,"kb_used_data":11496,"kb_used_omap":13,"kb_used_meta":301298,"kb_avail":754661796,"statfs":{"total":773094113280,"available":772773679104,"internally_reserved":0,"allocated":11771904,"data_stored":6433252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":308529240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001623"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565748+0000","last_change":"2023-07-20T10:06:44.479213+0000","last_active":"2023-07-20T10:06:45.565748+0000","last_peered":"2023-07-20T10:06:45.565748+0000","last_clean":"2023-07-20T10:06:45.565748+0000","last_became_active":"2023-07-20T10:06:44.478871+0000","last_became_peered":"2023-07-20T10:06:44.478871+0000","last_unstale":"2023-07-20T10:06:45.565748+0000","last_undegraded":"2023-07-20T10:06:45.565748+0000","last_fullsized":"2023-07-20T10:06:45.565748+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:10.282036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461528+0000","last_change":"2023-07-20T10:06:44.465877+0000","last_active":"2023-07-20T10:06:45.461528+0000","last_peered":"2023-07-20T10:06:45.461528+0000","last_clean":"2023-07-20T10:06:45.461528+0000","last_became_active":"2023-07-20T10:06:44.465555+0000","last_became_peered":"2023-07-20T10:06:44.465555+0000","last_unstale":"2023-07-20T10:06:45.461528+0000","last_undegraded":"2023-07-20T10:06:45.461528+0000","last_fullsized":"2023-07-20T10:06:45.461528+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:03:37.100589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565208+0000","last_change":"2023-07-20T10:06:44.461793+0000","last_active":"2023-07-20T10:06:45.565208+0000","last_peered":"2023-07-20T10:06:45.565208+0000","last_clean":"2023-07-20T10:06:45.565208+0000","last_became_active":"2023-07-20T10:06:44.461418+0000","last_became_peered":"2023-07-20T10:06:44.461418+0000","last_unstale":"2023-07-20T10:06:45.565208+0000","last_undegraded":"2023-07-20T10:06:45.565208+0000","last_fullsized":"2023-07-20T10:06:45.565208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:25.098216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566315+0000","last_change":"2023-07-20T10:06:44.473183+0000","last_active":"2023-07-20T10:06:45.566315+0000","last_peered":"2023-07-20T10:06:45.566315+0000","last_clean":"2023-07-20T10:06:45.566315+0000","last_became_active":"2023-07-20T10:06:44.472926+0000","last_became_peered":"2023-07-20T10:06:44.472926+0000","last_unstale":"2023-07-20T10:06:45.566315+0000","last_undegraded":"2023-07-20T10:06:45.566315+0000","last_fullsized":"2023-07-20T10:06:45.566315+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:57.655446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460422+0000","last_change":"2023-07-20T10:06:44.473458+0000","last_active":"2023-07-20T10:06:45.460422+0000","last_peered":"2023-07-20T10:06:45.460422+0000","last_clean":"2023-07-20T10:06:45.460422+0000","last_became_active":"2023-07-20T10:06:44.473139+0000","last_became_peered":"2023-07-20T10:06:44.473139+0000","last_unstale":"2023-07-20T10:06:45.460422+0000","last_undegraded":"2023-07-20T10:06:45.460422+0000","last_fullsized":"2023-07-20T10:06:45.460422+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:14:09.518930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565914+0000","last_change":"2023-07-20T10:06:44.483006+0000","last_active":"2023-07-20T10:06:45.565914+0000","last_peered":"2023-07-20T10:06:45.565914+0000","last_clean":"2023-07-20T10:06:45.565914+0000","last_became_active":"2023-07-20T10:06:44.482744+0000","last_became_peered":"2023-07-20T10:06:44.482744+0000","last_unstale":"2023-07-20T10:06:45.565914+0000","last_undegraded":"2023-07-20T10:06:45.565914+0000","last_fullsized":"2023-07-20T10:06:45.565914+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:05.603759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569024+0000","last_change":"2023-07-20T10:06:44.478481+0000","last_active":"2023-07-20T10:06:45.569024+0000","last_peered":"2023-07-20T10:06:45.569024+0000","last_clean":"2023-07-20T10:06:45.569024+0000","last_became_active":"2023-07-20T10:06:44.478155+0000","last_became_peered":"2023-07-20T10:06:44.478155+0000","last_unstale":"2023-07-20T10:06:45.569024+0000","last_undegraded":"2023-07-20T10:06:45.569024+0000","last_fullsized":"2023-07-20T10:06:45.569024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:10.046903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566169+0000","last_change":"2023-07-20T10:06:44.477161+0000","last_active":"2023-07-20T10:06:45.566169+0000","last_peered":"2023-07-20T10:06:45.566169+0000","last_clean":"2023-07-20T10:06:45.566169+0000","last_became_active":"2023-07-20T10:06:44.476870+0000","last_became_peered":"2023-07-20T10:06:44.476870+0000","last_unstale":"2023-07-20T10:06:45.566169+0000","last_undegraded":"2023-07-20T10:06:45.566169+0000","last_fullsized":"2023-07-20T10:06:45.566169+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:40.088382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460501+0000","last_change":"2023-07-20T10:06:44.468447+0000","last_active":"2023-07-20T10:06:45.460501+0000","last_peered":"2023-07-20T10:06:45.460501+0000","last_clean":"2023-07-20T10:06:45.460501+0000","last_became_active":"2023-07-20T10:06:44.468027+0000","last_became_peered":"2023-07-20T10:06:44.468027+0000","last_unstale":"2023-07-20T10:06:45.460501+0000","last_undegraded":"2023-07-20T10:06:45.460501+0000","last_fullsized":"2023-07-20T10:06:45.460501+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:58.096542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455193+0000","last_change":"2023-07-20T10:06:44.471889+0000","last_active":"2023-07-20T10:06:45.455193+0000","last_peered":"2023-07-20T10:06:45.455193+0000","last_clean":"2023-07-20T10:06:45.455193+0000","last_became_active":"2023-07-20T10:06:44.471617+0000","last_became_peered":"2023-07-20T10:06:44.471617+0000","last_unstale":"2023-07-20T10:06:45.455193+0000","last_undegraded":"2023-07-20T10:06:45.455193+0000","last_fullsized":"2023-07-20T10:06:45.455193+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:35:15.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460402+0000","last_change":"2023-07-20T10:06:44.486095+0000","last_active":"2023-07-20T10:06:45.460402+0000","last_peered":"2023-07-20T10:06:45.460402+0000","last_clean":"2023-07-20T10:06:45.460402+0000","last_became_active":"2023-07-20T10:06:44.485482+0000","last_became_peered":"2023-07-20T10:06:44.485482+0000","last_unstale":"2023-07-20T10:06:45.460402+0000","last_undegraded":"2023-07-20T10:06:45.460402+0000","last_fullsized":"2023-07-20T10:06:45.460402+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:56.287813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455150+0000","last_change":"2023-07-20T10:06:44.460434+0000","last_active":"2023-07-20T10:06:45.455150+0000","last_peered":"2023-07-20T10:06:45.455150+0000","last_clean":"2023-07-20T10:06:45.455150+0000","last_became_active":"2023-07-20T10:06:44.460144+0000","last_became_peered":"2023-07-20T10:06:44.460144+0000","last_unstale":"2023-07-20T10:06:45.455150+0000","last_undegraded":"2023-07-20T10:06:45.455150+0000","last_fullsized":"2023-07-20T10:06:45.455150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:50:29.531966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565436+0000","last_change":"2023-07-20T10:06:44.480597+0000","last_active":"2023-07-20T10:06:45.565436+0000","last_peered":"2023-07-20T10:06:45.565436+0000","last_clean":"2023-07-20T10:06:45.565436+0000","last_became_active":"2023-07-20T10:06:44.480292+0000","last_became_peered":"2023-07-20T10:06:44.480292+0000","last_unstale":"2023-07-20T10:06:45.565436+0000","last_undegraded":"2023-07-20T10:06:45.565436+0000","last_fullsized":"2023-07-20T10:06:45.565436+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:32.199441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460519+0000","last_change":"2023-07-20T10:06:44.484497+0000","last_active":"2023-07-20T10:06:45.460519+0000","last_peered":"2023-07-20T10:06:45.460519+0000","last_clean":"2023-07-20T10:06:45.460519+0000","last_became_active":"2023-07-20T10:06:44.484199+0000","last_became_peered":"2023-07-20T10:06:44.484199+0000","last_unstale":"2023-07-20T10:06:45.460519+0000","last_undegraded":"2023-07-20T10:06:45.460519+0000","last_fullsized":"2023-07-20T10:06:45.460519+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:08.950500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566666+0000","last_change":"2023-07-20T10:06:44.474455+0000","last_active":"2023-07-20T10:06:45.566666+0000","last_peered":"2023-07-20T10:06:45.566666+0000","last_clean":"2023-07-20T10:06:45.566666+0000","last_became_active":"2023-07-20T10:06:44.474166+0000","last_became_peered":"2023-07-20T10:06:44.474166+0000","last_unstale":"2023-07-20T10:06:45.566666+0000","last_undegraded":"2023-07-20T10:06:45.566666+0000","last_fullsized":"2023-07-20T10:06:45.566666+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:40:20.093026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565320+0000","last_change":"2023-07-20T10:06:44.474961+0000","last_active":"2023-07-20T10:06:45.565320+0000","last_peered":"2023-07-20T10:06:45.565320+0000","last_clean":"2023-07-20T10:06:45.565320+0000","last_became_active":"2023-07-20T10:06:44.474538+0000","last_became_peered":"2023-07-20T10:06:44.474538+0000","last_unstale":"2023-07-20T10:06:45.565320+0000","last_undegraded":"2023-07-20T10:06:45.565320+0000","last_fullsized":"2023-07-20T10:06:45.565320+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:32.663520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565431+0000","last_change":"2023-07-20T10:06:44.482351+0000","last_active":"2023-07-20T10:06:45.565431+0000","last_peered":"2023-07-20T10:06:45.565431+0000","last_clean":"2023-07-20T10:06:45.565431+0000","last_became_active":"2023-07-20T10:06:44.482027+0000","last_became_peered":"2023-07-20T10:06:44.482027+0000","last_unstale":"2023-07-20T10:06:45.565431+0000","last_undegraded":"2023-07-20T10:06:45.565431+0000","last_fullsized":"2023-07-20T10:06:45.565431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:37:23.975554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565436+0000","last_change":"2023-07-20T10:06:44.467591+0000","last_active":"2023-07-20T10:06:45.565436+0000","last_peered":"2023-07-20T10:06:45.565436+0000","last_clean":"2023-07-20T10:06:45.565436+0000","last_became_active":"2023-07-20T10:06:44.467315+0000","last_became_peered":"2023-07-20T10:06:44.467315+0000","last_unstale":"2023-07-20T10:06:45.565436+0000","last_undegraded":"2023-07-20T10:06:45.565436+0000","last_fullsized":"2023-07-20T10:06:45.565436+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:58.229576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460558+0000","last_change":"2023-07-20T10:06:44.477941+0000","last_active":"2023-07-20T10:06:45.460558+0000","last_peered":"2023-07-20T10:06:45.460558+0000","last_clean":"2023-07-20T10:06:45.460558+0000","last_became_active":"2023-07-20T10:06:44.477604+0000","last_became_peered":"2023-07-20T10:06:44.477604+0000","last_unstale":"2023-07-20T10:06:45.460558+0000","last_undegraded":"2023-07-20T10:06:45.460558+0000","last_fullsized":"2023-07-20T10:06:45.460558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:56:32.708640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566380+0000","last_change":"2023-07-20T10:06:44.471752+0000","last_active":"2023-07-20T10:06:45.566380+0000","last_peered":"2023-07-20T10:06:45.566380+0000","last_clean":"2023-07-20T10:06:45.566380+0000","last_became_active":"2023-07-20T10:06:44.471331+0000","last_became_peered":"2023-07-20T10:06:44.471331+0000","last_unstale":"2023-07-20T10:06:45.566380+0000","last_undegraded":"2023-07-20T10:06:45.566380+0000","last_fullsized":"2023-07-20T10:06:45.566380+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:52:25.569563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460894+0000","last_change":"2023-07-20T10:06:44.477067+0000","last_active":"2023-07-20T10:06:45.460894+0000","last_peered":"2023-07-20T10:06:45.460894+0000","last_clean":"2023-07-20T10:06:45.460894+0000","last_became_active":"2023-07-20T10:06:44.476707+0000","last_became_peered":"2023-07-20T10:06:44.476707+0000","last_unstale":"2023-07-20T10:06:45.460894+0000","last_undegraded":"2023-07-20T10:06:45.460894+0000","last_fullsized":"2023-07-20T10:06:45.460894+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:46:19.297607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460558+0000","last_change":"2023-07-20T10:06:44.483049+0000","last_active":"2023-07-20T10:06:45.460558+0000","last_peered":"2023-07-20T10:06:45.460558+0000","last_clean":"2023-07-20T10:06:45.460558+0000","last_became_active":"2023-07-20T10:06:44.482746+0000","last_became_peered":"2023-07-20T10:06:44.482746+0000","last_unstale":"2023-07-20T10:06:45.460558+0000","last_undegraded":"2023-07-20T10:06:45.460558+0000","last_fullsized":"2023-07-20T10:06:45.460558+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:52:52.854614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569332+0000","last_change":"2023-07-20T10:06:44.482142+0000","last_active":"2023-07-20T10:06:45.569332+0000","last_peered":"2023-07-20T10:06:45.569332+0000","last_clean":"2023-07-20T10:06:45.569332+0000","last_became_active":"2023-07-20T10:06:44.481839+0000","last_became_peered":"2023-07-20T10:06:44.481839+0000","last_unstale":"2023-07-20T10:06:45.569332+0000","last_undegraded":"2023-07-20T10:06:45.569332+0000","last_fullsized":"2023-07-20T10:06:45.569332+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:29:50.060241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.567084+0000","last_change":"2023-07-20T10:06:44.459541+0000","last_active":"2023-07-20T10:06:45.567084+0000","last_peered":"2023-07-20T10:06:45.567084+0000","last_clean":"2023-07-20T10:06:45.567084+0000","last_became_active":"2023-07-20T10:06:44.459243+0000","last_became_peered":"2023-07-20T10:06:44.459243+0000","last_unstale":"2023-07-20T10:06:45.567084+0000","last_undegraded":"2023-07-20T10:06:45.567084+0000","last_fullsized":"2023-07-20T10:06:45.567084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:01.327166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461678+0000","last_change":"2023-07-20T10:06:44.475228+0000","last_active":"2023-07-20T10:06:45.461678+0000","last_peered":"2023-07-20T10:06:45.461678+0000","last_clean":"2023-07-20T10:06:45.461678+0000","last_became_active":"2023-07-20T10:06:44.474931+0000","last_became_peered":"2023-07-20T10:06:44.474931+0000","last_unstale":"2023-07-20T10:06:45.461678+0000","last_undegraded":"2023-07-20T10:06:45.461678+0000","last_fullsized":"2023-07-20T10:06:45.461678+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:16:29.039908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460741+0000","last_change":"2023-07-20T10:06:44.478304+0000","last_active":"2023-07-20T10:06:45.460741+0000","last_peered":"2023-07-20T10:06:45.460741+0000","last_clean":"2023-07-20T10:06:45.460741+0000","last_became_active":"2023-07-20T10:06:44.477957+0000","last_became_peered":"2023-07-20T10:06:44.477957+0000","last_unstale":"2023-07-20T10:06:45.460741+0000","last_undegraded":"2023-07-20T10:06:45.460741+0000","last_fullsized":"2023-07-20T10:06:45.460741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:28.584988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455278+0000","last_change":"2023-07-20T10:06:44.471458+0000","last_active":"2023-07-20T10:06:45.455278+0000","last_peered":"2023-07-20T10:06:45.455278+0000","last_clean":"2023-07-20T10:06:45.455278+0000","last_became_active":"2023-07-20T10:06:44.471185+0000","last_became_peered":"2023-07-20T10:06:44.471185+0000","last_unstale":"2023-07-20T10:06:45.455278+0000","last_undegraded":"2023-07-20T10:06:45.455278+0000","last_fullsized":"2023-07-20T10:06:45.455278+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:47.507244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566439+0000","last_change":"2023-07-20T10:06:44.471594+0000","last_active":"2023-07-20T10:06:45.566439+0000","last_peered":"2023-07-20T10:06:45.566439+0000","last_clean":"2023-07-20T10:06:45.566439+0000","last_became_active":"2023-07-20T10:06:44.471033+0000","last_became_peered":"2023-07-20T10:06:44.471033+0000","last_unstale":"2023-07-20T10:06:45.566439+0000","last_undegraded":"2023-07-20T10:06:45.566439+0000","last_fullsized":"2023-07-20T10:06:45.566439+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:12.048395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569276+0000","last_change":"2023-07-20T10:06:44.485934+0000","last_active":"2023-07-20T10:06:45.569276+0000","last_peered":"2023-07-20T10:06:45.569276+0000","last_clean":"2023-07-20T10:06:45.569276+0000","last_became_active":"2023-07-20T10:06:44.485580+0000","last_became_peered":"2023-07-20T10:06:44.485580+0000","last_unstale":"2023-07-20T10:06:45.569276+0000","last_undegraded":"2023-07-20T10:06:45.569276+0000","last_fullsized":"2023-07-20T10:06:45.569276+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:09.468057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460887+0000","last_change":"2023-07-20T10:06:44.467302+0000","last_active":"2023-07-20T10:06:45.460887+0000","last_peered":"2023-07-20T10:06:45.460887+0000","last_clean":"2023-07-20T10:06:45.460887+0000","last_became_active":"2023-07-20T10:06:44.467001+0000","last_became_peered":"2023-07-20T10:06:44.467001+0000","last_unstale":"2023-07-20T10:06:45.460887+0000","last_undegraded":"2023-07-20T10:06:45.460887+0000","last_fullsized":"2023-07-20T10:06:45.460887+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:24:47.685161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460177+0000","last_change":"2023-07-20T10:06:44.480856+0000","last_active":"2023-07-20T10:06:45.460177+0000","last_peered":"2023-07-20T10:06:45.460177+0000","last_clean":"2023-07-20T10:06:45.460177+0000","last_became_active":"2023-07-20T10:06:44.480460+0000","last_became_peered":"2023-07-20T10:06:44.480460+0000","last_unstale":"2023-07-20T10:06:45.460177+0000","last_undegraded":"2023-07-20T10:06:45.460177+0000","last_fullsized":"2023-07-20T10:06:45.460177+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:38:19.668523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565446+0000","last_change":"2023-07-20T10:06:44.474793+0000","last_active":"2023-07-20T10:06:45.565446+0000","last_peered":"2023-07-20T10:06:45.565446+0000","last_clean":"2023-07-20T10:06:45.565446+0000","last_became_active":"2023-07-20T10:06:44.474202+0000","last_became_peered":"2023-07-20T10:06:44.474202+0000","last_unstale":"2023-07-20T10:06:45.565446+0000","last_undegraded":"2023-07-20T10:06:45.565446+0000","last_fullsized":"2023-07-20T10:06:45.565446+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:02:01.051138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566280+0000","last_change":"2023-07-20T10:06:44.473816+0000","last_active":"2023-07-20T10:06:45.566280+0000","last_peered":"2023-07-20T10:06:45.566280+0000","last_clean":"2023-07-20T10:06:45.566280+0000","last_became_active":"2023-07-20T10:06:44.473515+0000","last_became_peered":"2023-07-20T10:06:44.473515+0000","last_unstale":"2023-07-20T10:06:45.566280+0000","last_undegraded":"2023-07-20T10:06:45.566280+0000","last_fullsized":"2023-07-20T10:06:45.566280+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:32.199441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"106'4","reported_seq":17,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569953+0000","last_change":"2023-07-20T10:06:43.474094+0000","last_active":"2023-07-20T10:06:45.569953+0000","last_peered":"2023-07-20T10:06:45.569953+0000","last_clean":"2023-07-20T10:06:45.569953+0000","last_became_active":"2023-07-20T10:06:43.473779+0000","last_became_peered":"2023-07-20T10:06:43.473779+0000","last_unstale":"2023-07-20T10:06:45.569953+0000","last_undegraded":"2023-07-20T10:06:45.569953+0000","last_fullsized":"2023-07-20T10:06:45.569953+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:34:03.331916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566456+0000","last_change":"2023-07-20T10:06:44.482185+0000","last_active":"2023-07-20T10:06:45.566456+0000","last_peered":"2023-07-20T10:06:45.566456+0000","last_clean":"2023-07-20T10:06:45.566456+0000","last_became_active":"2023-07-20T10:06:44.481901+0000","last_became_peered":"2023-07-20T10:06:44.481901+0000","last_unstale":"2023-07-20T10:06:45.566456+0000","last_undegraded":"2023-07-20T10:06:45.566456+0000","last_fullsized":"2023-07-20T10:06:45.566456+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:36.266744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460724+0000","last_change":"2023-07-20T10:06:43.469840+0000","last_active":"2023-07-20T10:06:45.460724+0000","last_peered":"2023-07-20T10:06:45.460724+0000","last_clean":"2023-07-20T10:06:45.460724+0000","last_became_active":"2023-07-20T10:06:43.469543+0000","last_became_peered":"2023-07-20T10:06:43.469543+0000","last_unstale":"2023-07-20T10:06:45.460724+0000","last_undegraded":"2023-07-20T10:06:45.460724+0000","last_fullsized":"2023-07-20T10:06:45.460724+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:47.597305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569421+0000","last_change":"2023-07-20T10:06:44.485728+0000","last_active":"2023-07-20T10:06:45.569421+0000","last_peered":"2023-07-20T10:06:45.569421+0000","last_clean":"2023-07-20T10:06:45.569421+0000","last_became_active":"2023-07-20T10:06:44.485388+0000","last_became_peered":"2023-07-20T10:06:44.485388+0000","last_unstale":"2023-07-20T10:06:45.569421+0000","last_undegraded":"2023-07-20T10:06:45.569421+0000","last_fullsized":"2023-07-20T10:06:45.569421+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:29.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569473+0000","last_change":"2023-07-20T10:06:43.480281+0000","last_active":"2023-07-20T10:06:45.569473+0000","last_peered":"2023-07-20T10:06:45.569473+0000","last_clean":"2023-07-20T10:06:45.569473+0000","last_became_active":"2023-07-20T10:06:43.479965+0000","last_became_peered":"2023-07-20T10:06:43.479965+0000","last_unstale":"2023-07-20T10:06:45.569473+0000","last_undegraded":"2023-07-20T10:06:45.569473+0000","last_fullsized":"2023-07-20T10:06:45.569473+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:51.403978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565561+0000","last_change":"2023-07-20T10:06:44.480342+0000","last_active":"2023-07-20T10:06:45.565561+0000","last_peered":"2023-07-20T10:06:45.565561+0000","last_clean":"2023-07-20T10:06:45.565561+0000","last_became_active":"2023-07-20T10:06:44.479871+0000","last_became_peered":"2023-07-20T10:06:44.479871+0000","last_unstale":"2023-07-20T10:06:45.565561+0000","last_undegraded":"2023-07-20T10:06:45.565561+0000","last_fullsized":"2023-07-20T10:06:45.565561+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:22.664330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569915+0000","last_change":"2023-07-20T10:06:43.475691+0000","last_active":"2023-07-20T10:06:45.569915+0000","last_peered":"2023-07-20T10:06:45.569915+0000","last_clean":"2023-07-20T10:06:45.569915+0000","last_became_active":"2023-07-20T10:06:43.475393+0000","last_became_peered":"2023-07-20T10:06:43.475393+0000","last_unstale":"2023-07-20T10:06:45.569915+0000","last_undegraded":"2023-07-20T10:06:45.569915+0000","last_fullsized":"2023-07-20T10:06:45.569915+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:01:16.071378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565823+0000","last_change":"2023-07-20T10:06:44.472677+0000","last_active":"2023-07-20T10:06:45.565823+0000","last_peered":"2023-07-20T10:06:45.565823+0000","last_clean":"2023-07-20T10:06:45.565823+0000","last_became_active":"2023-07-20T10:06:44.472402+0000","last_became_peered":"2023-07-20T10:06:44.472402+0000","last_unstale":"2023-07-20T10:06:45.565823+0000","last_undegraded":"2023-07-20T10:06:45.565823+0000","last_fullsized":"2023-07-20T10:06:45.565823+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:27.332890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461019+0000","last_change":"2023-07-20T10:06:43.469775+0000","last_active":"2023-07-20T10:06:45.461019+0000","last_peered":"2023-07-20T10:06:45.461019+0000","last_clean":"2023-07-20T10:06:45.461019+0000","last_became_active":"2023-07-20T10:06:43.469463+0000","last_became_peered":"2023-07-20T10:06:43.469463+0000","last_unstale":"2023-07-20T10:06:45.461019+0000","last_undegraded":"2023-07-20T10:06:45.461019+0000","last_fullsized":"2023-07-20T10:06:45.461019+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:00.753045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569367+0000","last_change":"2023-07-20T10:06:44.480161+0000","last_active":"2023-07-20T10:06:45.569367+0000","last_peered":"2023-07-20T10:06:45.569367+0000","last_clean":"2023-07-20T10:06:45.569367+0000","last_became_active":"2023-07-20T10:06:44.479865+0000","last_became_peered":"2023-07-20T10:06:44.479865+0000","last_unstale":"2023-07-20T10:06:45.569367+0000","last_undegraded":"2023-07-20T10:06:45.569367+0000","last_fullsized":"2023-07-20T10:06:45.569367+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:09.350534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566316+0000","last_change":"2023-07-20T10:06:43.467547+0000","last_active":"2023-07-20T10:06:45.566316+0000","last_peered":"2023-07-20T10:06:45.566316+0000","last_clean":"2023-07-20T10:06:45.566316+0000","last_became_active":"2023-07-20T10:06:43.467241+0000","last_became_peered":"2023-07-20T10:06:43.467241+0000","last_unstale":"2023-07-20T10:06:45.566316+0000","last_undegraded":"2023-07-20T10:06:45.566316+0000","last_fullsized":"2023-07-20T10:06:45.566316+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:10:09.888239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566041+0000","last_change":"2023-07-20T10:06:44.477812+0000","last_active":"2023-07-20T10:06:45.566041+0000","last_peered":"2023-07-20T10:06:45.566041+0000","last_clean":"2023-07-20T10:06:45.566041+0000","last_became_active":"2023-07-20T10:06:44.477554+0000","last_became_peered":"2023-07-20T10:06:44.477554+0000","last_unstale":"2023-07-20T10:06:45.566041+0000","last_undegraded":"2023-07-20T10:06:45.566041+0000","last_fullsized":"2023-07-20T10:06:45.566041+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:31.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565392+0000","last_change":"2023-07-20T10:06:43.473697+0000","last_active":"2023-07-20T10:06:45.565392+0000","last_peered":"2023-07-20T10:06:45.565392+0000","last_clean":"2023-07-20T10:06:45.565392+0000","last_became_active":"2023-07-20T10:06:43.473432+0000","last_became_peered":"2023-07-20T10:06:43.473432+0000","last_unstale":"2023-07-20T10:06:45.565392+0000","last_undegraded":"2023-07-20T10:06:45.565392+0000","last_fullsized":"2023-07-20T10:06:45.565392+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:00.816545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565562+0000","last_change":"2023-07-20T10:06:44.472653+0000","last_active":"2023-07-20T10:06:45.565562+0000","last_peered":"2023-07-20T10:06:45.565562+0000","last_clean":"2023-07-20T10:06:45.565562+0000","last_became_active":"2023-07-20T10:06:44.472390+0000","last_became_peered":"2023-07-20T10:06:44.472390+0000","last_unstale":"2023-07-20T10:06:45.565562+0000","last_undegraded":"2023-07-20T10:06:45.565562+0000","last_fullsized":"2023-07-20T10:06:45.565562+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:12.993070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.568910+0000","last_change":"2023-07-20T10:06:43.477958+0000","last_active":"2023-07-20T10:06:45.568910+0000","last_peered":"2023-07-20T10:06:45.568910+0000","last_clean":"2023-07-20T10:06:45.568910+0000","last_became_active":"2023-07-20T10:06:43.476867+0000","last_became_peered":"2023-07-20T10:06:43.476867+0000","last_unstale":"2023-07-20T10:06:45.568910+0000","last_undegraded":"2023-07-20T10:06:45.568910+0000","last_fullsized":"2023-07-20T10:06:45.568910+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:45:04.550329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460700+0000","last_change":"2023-07-20T10:06:44.467460+0000","last_active":"2023-07-20T10:06:45.460700+0000","last_peered":"2023-07-20T10:06:45.460700+0000","last_clean":"2023-07-20T10:06:45.460700+0000","last_became_active":"2023-07-20T10:06:44.467171+0000","last_became_peered":"2023-07-20T10:06:44.467171+0000","last_unstale":"2023-07-20T10:06:45.460700+0000","last_undegraded":"2023-07-20T10:06:45.460700+0000","last_fullsized":"2023-07-20T10:06:45.460700+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:55:42.212096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461798+0000","last_change":"2023-07-20T10:06:43.465731+0000","last_active":"2023-07-20T10:06:45.461798+0000","last_peered":"2023-07-20T10:06:45.461798+0000","last_clean":"2023-07-20T10:06:45.461798+0000","last_became_active":"2023-07-20T10:06:43.465435+0000","last_became_peered":"2023-07-20T10:06:43.465435+0000","last_unstale":"2023-07-20T10:06:45.461798+0000","last_undegraded":"2023-07-20T10:06:45.461798+0000","last_fullsized":"2023-07-20T10:06:45.461798+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:39:42.122148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569333+0000","last_change":"2023-07-20T10:06:44.479420+0000","last_active":"2023-07-20T10:06:45.569333+0000","last_peered":"2023-07-20T10:06:45.569333+0000","last_clean":"2023-07-20T10:06:45.569333+0000","last_became_active":"2023-07-20T10:06:44.479131+0000","last_became_peered":"2023-07-20T10:06:44.479131+0000","last_unstale":"2023-07-20T10:06:45.569333+0000","last_undegraded":"2023-07-20T10:06:45.569333+0000","last_fullsized":"2023-07-20T10:06:45.569333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:15.901289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565674+0000","last_change":"2023-07-20T10:06:43.472162+0000","last_active":"2023-07-20T10:06:45.565674+0000","last_peered":"2023-07-20T10:06:45.565674+0000","last_clean":"2023-07-20T10:06:45.565674+0000","last_became_active":"2023-07-20T10:06:43.471820+0000","last_became_peered":"2023-07-20T10:06:43.471820+0000","last_unstale":"2023-07-20T10:06:45.565674+0000","last_undegraded":"2023-07-20T10:06:45.565674+0000","last_fullsized":"2023-07-20T10:06:45.565674+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:36.080964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565562+0000","last_change":"2023-07-20T10:06:44.471896+0000","last_active":"2023-07-20T10:06:45.565562+0000","last_peered":"2023-07-20T10:06:45.565562+0000","last_clean":"2023-07-20T10:06:45.565562+0000","last_became_active":"2023-07-20T10:06:44.471631+0000","last_became_peered":"2023-07-20T10:06:44.471631+0000","last_unstale":"2023-07-20T10:06:45.565562+0000","last_undegraded":"2023-07-20T10:06:45.565562+0000","last_fullsized":"2023-07-20T10:06:45.565562+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:06.257007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"106'3","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460855+0000","last_change":"2023-07-20T10:06:43.474965+0000","last_active":"2023-07-20T10:06:45.460855+0000","last_peered":"2023-07-20T10:06:45.460855+0000","last_clean":"2023-07-20T10:06:45.460855+0000","last_became_active":"2023-07-20T10:06:43.474482+0000","last_became_peered":"2023-07-20T10:06:43.474482+0000","last_unstale":"2023-07-20T10:06:45.460855+0000","last_undegraded":"2023-07-20T10:06:45.460855+0000","last_fullsized":"2023-07-20T10:06:45.460855+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:23:41.278786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566876+0000","last_change":"2023-07-20T10:06:44.483698+0000","last_active":"2023-07-20T10:06:45.566876+0000","last_peered":"2023-07-20T10:06:45.566876+0000","last_clean":"2023-07-20T10:06:45.566876+0000","last_became_active":"2023-07-20T10:06:44.483439+0000","last_became_peered":"2023-07-20T10:06:44.483439+0000","last_unstale":"2023-07-20T10:06:45.566876+0000","last_undegraded":"2023-07-20T10:06:45.566876+0000","last_fullsized":"2023-07-20T10:06:45.566876+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:21:00.057046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"106'6","reported_seq":19,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566505+0000","last_change":"2023-07-20T10:06:43.470986+0000","last_active":"2023-07-20T10:06:45.566505+0000","last_peered":"2023-07-20T10:06:45.566505+0000","last_clean":"2023-07-20T10:06:45.566505+0000","last_became_active":"2023-07-20T10:06:43.470639+0000","last_became_peered":"2023-07-20T10:06:43.470639+0000","last_unstale":"2023-07-20T10:06:45.566505+0000","last_undegraded":"2023-07-20T10:06:45.566505+0000","last_fullsized":"2023-07-20T10:06:45.566505+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:00.640368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565934+0000","last_change":"2023-07-20T10:06:44.476081+0000","last_active":"2023-07-20T10:06:45.565934+0000","last_peered":"2023-07-20T10:06:45.565934+0000","last_clean":"2023-07-20T10:06:45.565934+0000","last_became_active":"2023-07-20T10:06:44.475820+0000","last_became_peered":"2023-07-20T10:06:44.475820+0000","last_unstale":"2023-07-20T10:06:45.565934+0000","last_undegraded":"2023-07-20T10:06:45.565934+0000","last_fullsized":"2023-07-20T10:06:45.565934+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:36.266744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569361+0000","last_change":"2023-07-20T10:06:43.477620+0000","last_active":"2023-07-20T10:06:45.569361+0000","last_peered":"2023-07-20T10:06:45.569361+0000","last_clean":"2023-07-20T10:06:45.569361+0000","last_became_active":"2023-07-20T10:06:43.477161+0000","last_became_peered":"2023-07-20T10:06:43.477161+0000","last_unstale":"2023-07-20T10:06:45.569361+0000","last_undegraded":"2023-07-20T10:06:45.569361+0000","last_fullsized":"2023-07-20T10:06:45.569361+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:27.492594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460163+0000","last_change":"2023-07-20T10:06:44.474124+0000","last_active":"2023-07-20T10:06:45.460163+0000","last_peered":"2023-07-20T10:06:45.460163+0000","last_clean":"2023-07-20T10:06:45.460163+0000","last_became_active":"2023-07-20T10:06:44.473798+0000","last_became_peered":"2023-07-20T10:06:44.473798+0000","last_unstale":"2023-07-20T10:06:45.460163+0000","last_undegraded":"2023-07-20T10:06:45.460163+0000","last_fullsized":"2023-07-20T10:06:45.460163+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:41.752987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566155+0000","last_change":"2023-07-20T10:06:43.470913+0000","last_active":"2023-07-20T10:06:45.566155+0000","last_peered":"2023-07-20T10:06:45.566155+0000","last_clean":"2023-07-20T10:06:45.566155+0000","last_became_active":"2023-07-20T10:06:43.470632+0000","last_became_peered":"2023-07-20T10:06:43.470632+0000","last_unstale":"2023-07-20T10:06:45.566155+0000","last_undegraded":"2023-07-20T10:06:45.566155+0000","last_fullsized":"2023-07-20T10:06:45.566155+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:51.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455322+0000","last_change":"2023-07-20T10:06:44.475123+0000","last_active":"2023-07-20T10:06:45.455322+0000","last_peered":"2023-07-20T10:06:45.455322+0000","last_clean":"2023-07-20T10:06:45.455322+0000","last_became_active":"2023-07-20T10:06:44.474851+0000","last_became_peered":"2023-07-20T10:06:44.474851+0000","last_unstale":"2023-07-20T10:06:45.455322+0000","last_undegraded":"2023-07-20T10:06:45.455322+0000","last_fullsized":"2023-07-20T10:06:45.455322+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:17.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566844+0000","last_change":"2023-07-20T10:06:43.469587+0000","last_active":"2023-07-20T10:06:45.566844+0000","last_peered":"2023-07-20T10:06:45.566844+0000","last_clean":"2023-07-20T10:06:45.566844+0000","last_became_active":"2023-07-20T10:06:43.469322+0000","last_became_peered":"2023-07-20T10:06:43.469322+0000","last_unstale":"2023-07-20T10:06:45.566844+0000","last_undegraded":"2023-07-20T10:06:45.566844+0000","last_fullsized":"2023-07-20T10:06:45.566844+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:09:24.249219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455225+0000","last_change":"2023-07-20T10:06:44.467121+0000","last_active":"2023-07-20T10:06:45.455225+0000","last_peered":"2023-07-20T10:06:45.455225+0000","last_clean":"2023-07-20T10:06:45.455225+0000","last_became_active":"2023-07-20T10:06:44.466290+0000","last_became_peered":"2023-07-20T10:06:44.466290+0000","last_unstale":"2023-07-20T10:06:45.455225+0000","last_undegraded":"2023-07-20T10:06:45.455225+0000","last_fullsized":"2023-07-20T10:06:45.455225+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:16.043577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"106'8","reported_seq":21,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566042+0000","last_change":"2023-07-20T10:06:43.467283+0000","last_active":"2023-07-20T10:06:45.566042+0000","last_peered":"2023-07-20T10:06:45.566042+0000","last_clean":"2023-07-20T10:06:45.566042+0000","last_became_active":"2023-07-20T10:06:43.467005+0000","last_became_peered":"2023-07-20T10:06:43.467005+0000","last_unstale":"2023-07-20T10:06:45.566042+0000","last_undegraded":"2023-07-20T10:06:45.566042+0000","last_fullsized":"2023-07-20T10:06:45.566042+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:00.640368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569733+0000","last_change":"2023-07-20T10:06:44.476057+0000","last_active":"2023-07-20T10:06:45.569733+0000","last_peered":"2023-07-20T10:06:45.569733+0000","last_clean":"2023-07-20T10:06:45.569733+0000","last_became_active":"2023-07-20T10:06:44.475752+0000","last_became_peered":"2023-07-20T10:06:44.475752+0000","last_unstale":"2023-07-20T10:06:45.569733+0000","last_undegraded":"2023-07-20T10:06:45.569733+0000","last_fullsized":"2023-07-20T10:06:45.569733+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:42.692214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569799+0000","last_change":"2023-07-20T10:06:43.478374+0000","last_active":"2023-07-20T10:06:45.569799+0000","last_peered":"2023-07-20T10:06:45.569799+0000","last_clean":"2023-07-20T10:06:45.569799+0000","last_became_active":"2023-07-20T10:06:43.478050+0000","last_became_peered":"2023-07-20T10:06:43.478050+0000","last_unstale":"2023-07-20T10:06:45.569799+0000","last_undegraded":"2023-07-20T10:06:45.569799+0000","last_fullsized":"2023-07-20T10:06:45.569799+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:05.832695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566630+0000","last_change":"2023-07-20T10:06:44.482724+0000","last_active":"2023-07-20T10:06:45.566630+0000","last_peered":"2023-07-20T10:06:45.566630+0000","last_clean":"2023-07-20T10:06:45.566630+0000","last_became_active":"2023-07-20T10:06:44.482457+0000","last_became_peered":"2023-07-20T10:06:44.482457+0000","last_unstale":"2023-07-20T10:06:45.566630+0000","last_undegraded":"2023-07-20T10:06:45.566630+0000","last_fullsized":"2023-07-20T10:06:45.566630+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:49:01.929715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460885+0000","last_change":"2023-07-20T10:06:43.471424+0000","last_active":"2023-07-20T10:06:45.460885+0000","last_peered":"2023-07-20T10:06:45.460885+0000","last_clean":"2023-07-20T10:06:45.460885+0000","last_became_active":"2023-07-20T10:06:43.471115+0000","last_became_peered":"2023-07-20T10:06:43.471115+0000","last_unstale":"2023-07-20T10:06:45.460885+0000","last_undegraded":"2023-07-20T10:06:45.460885+0000","last_fullsized":"2023-07-20T10:06:45.460885+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:50:21.480571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566377+0000","last_change":"2023-07-20T10:06:44.479283+0000","last_active":"2023-07-20T10:06:45.566377+0000","last_peered":"2023-07-20T10:06:45.566377+0000","last_clean":"2023-07-20T10:06:45.566377+0000","last_became_active":"2023-07-20T10:06:44.479011+0000","last_became_peered":"2023-07-20T10:06:44.479011+0000","last_unstale":"2023-07-20T10:06:45.566377+0000","last_undegraded":"2023-07-20T10:06:45.566377+0000","last_fullsized":"2023-07-20T10:06:45.566377+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:12.993070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461045+0000","last_change":"2023-07-20T10:06:43.474819+0000","last_active":"2023-07-20T10:06:45.461045+0000","last_peered":"2023-07-20T10:06:45.461045+0000","last_clean":"2023-07-20T10:06:45.461045+0000","last_became_active":"2023-07-20T10:06:43.474441+0000","last_became_peered":"2023-07-20T10:06:43.474441+0000","last_unstale":"2023-07-20T10:06:45.461045+0000","last_undegraded":"2023-07-20T10:06:45.461045+0000","last_fullsized":"2023-07-20T10:06:45.461045+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:03:38.673357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461758+0000","last_change":"2023-07-20T10:06:44.466774+0000","last_active":"2023-07-20T10:06:45.461758+0000","last_peered":"2023-07-20T10:06:45.461758+0000","last_clean":"2023-07-20T10:06:45.461758+0000","last_became_active":"2023-07-20T10:06:44.466411+0000","last_became_peered":"2023-07-20T10:06:44.466411+0000","last_unstale":"2023-07-20T10:06:45.461758+0000","last_undegraded":"2023-07-20T10:06:45.461758+0000","last_fullsized":"2023-07-20T10:06:45.461758+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:54:42.901372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569895+0000","last_change":"2023-07-20T10:06:43.471746+0000","last_active":"2023-07-20T10:06:45.569895+0000","last_peered":"2023-07-20T10:06:45.569895+0000","last_clean":"2023-07-20T10:06:45.569895+0000","last_became_active":"2023-07-20T10:06:43.471193+0000","last_became_peered":"2023-07-20T10:06:43.471193+0000","last_unstale":"2023-07-20T10:06:45.569895+0000","last_undegraded":"2023-07-20T10:06:45.569895+0000","last_fullsized":"2023-07-20T10:06:45.569895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:23:56.340692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454931+0000","last_change":"2023-07-20T10:06:44.475271+0000","last_active":"2023-07-20T10:06:45.454931+0000","last_peered":"2023-07-20T10:06:45.454931+0000","last_clean":"2023-07-20T10:06:45.454931+0000","last_became_active":"2023-07-20T10:06:44.475006+0000","last_became_peered":"2023-07-20T10:06:44.475006+0000","last_unstale":"2023-07-20T10:06:45.454931+0000","last_undegraded":"2023-07-20T10:06:45.454931+0000","last_fullsized":"2023-07-20T10:06:45.454931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:30:18.452969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566265+0000","last_change":"2023-07-20T10:06:43.471548+0000","last_active":"2023-07-20T10:06:45.566265+0000","last_peered":"2023-07-20T10:06:45.566265+0000","last_clean":"2023-07-20T10:06:45.566265+0000","last_became_active":"2023-07-20T10:06:43.471209+0000","last_became_peered":"2023-07-20T10:06:43.471209+0000","last_unstale":"2023-07-20T10:06:45.566265+0000","last_undegraded":"2023-07-20T10:06:45.566265+0000","last_fullsized":"2023-07-20T10:06:45.566265+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:04.461418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565191+0000","last_change":"2023-07-20T10:06:44.472734+0000","last_active":"2023-07-20T10:06:45.565191+0000","last_peered":"2023-07-20T10:06:45.565191+0000","last_clean":"2023-07-20T10:06:45.565191+0000","last_became_active":"2023-07-20T10:06:44.472450+0000","last_became_peered":"2023-07-20T10:06:44.472450+0000","last_unstale":"2023-07-20T10:06:45.565191+0000","last_undegraded":"2023-07-20T10:06:45.565191+0000","last_fullsized":"2023-07-20T10:06:45.565191+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:08:17.809763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461454+0000","last_change":"2023-07-20T10:06:43.472376+0000","last_active":"2023-07-20T10:06:45.461454+0000","last_peered":"2023-07-20T10:06:45.461454+0000","last_clean":"2023-07-20T10:06:45.461454+0000","last_became_active":"2023-07-20T10:06:43.470495+0000","last_became_peered":"2023-07-20T10:06:43.470495+0000","last_unstale":"2023-07-20T10:06:45.461454+0000","last_undegraded":"2023-07-20T10:06:45.461454+0000","last_fullsized":"2023-07-20T10:06:45.461454+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:18:03.456196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569150+0000","last_change":"2023-07-20T10:06:44.482102+0000","last_active":"2023-07-20T10:06:45.569150+0000","last_peered":"2023-07-20T10:06:45.569150+0000","last_clean":"2023-07-20T10:06:45.569150+0000","last_became_active":"2023-07-20T10:06:44.481770+0000","last_became_peered":"2023-07-20T10:06:44.481770+0000","last_unstale":"2023-07-20T10:06:45.569150+0000","last_undegraded":"2023-07-20T10:06:45.569150+0000","last_fullsized":"2023-07-20T10:06:45.569150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:06:51.553395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569469+0000","last_change":"2023-07-20T10:06:43.469684+0000","last_active":"2023-07-20T10:06:45.569469+0000","last_peered":"2023-07-20T10:06:45.569469+0000","last_clean":"2023-07-20T10:06:45.569469+0000","last_became_active":"2023-07-20T10:06:43.469320+0000","last_became_peered":"2023-07-20T10:06:43.469320+0000","last_unstale":"2023-07-20T10:06:45.569469+0000","last_undegraded":"2023-07-20T10:06:45.569469+0000","last_fullsized":"2023-07-20T10:06:45.569469+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:01.212789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566166+0000","last_change":"2023-07-20T10:06:44.475180+0000","last_active":"2023-07-20T10:06:45.566166+0000","last_peered":"2023-07-20T10:06:45.566166+0000","last_clean":"2023-07-20T10:06:45.566166+0000","last_became_active":"2023-07-20T10:06:44.474858+0000","last_became_peered":"2023-07-20T10:06:44.474858+0000","last_unstale":"2023-07-20T10:06:45.566166+0000","last_undegraded":"2023-07-20T10:06:45.566166+0000","last_fullsized":"2023-07-20T10:06:45.566166+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:01:46.558975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.568974+0000","last_change":"2023-07-20T10:06:43.477319+0000","last_active":"2023-07-20T10:06:45.568974+0000","last_peered":"2023-07-20T10:06:45.568974+0000","last_clean":"2023-07-20T10:06:45.568974+0000","last_became_active":"2023-07-20T10:06:43.477040+0000","last_became_peered":"2023-07-20T10:06:43.477040+0000","last_unstale":"2023-07-20T10:06:45.568974+0000","last_undegraded":"2023-07-20T10:06:45.568974+0000","last_fullsized":"2023-07-20T10:06:45.568974+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:05.453031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569669+0000","last_change":"2023-07-20T10:06:44.480500+0000","last_active":"2023-07-20T10:06:45.569669+0000","last_peered":"2023-07-20T10:06:45.569669+0000","last_clean":"2023-07-20T10:06:45.569669+0000","last_became_active":"2023-07-20T10:06:44.480039+0000","last_became_peered":"2023-07-20T10:06:44.480039+0000","last_unstale":"2023-07-20T10:06:45.569669+0000","last_undegraded":"2023-07-20T10:06:45.569669+0000","last_fullsized":"2023-07-20T10:06:45.569669+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:51.276810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566496+0000","last_change":"2023-07-20T10:06:43.469770+0000","last_active":"2023-07-20T10:06:45.566496+0000","last_peered":"2023-07-20T10:06:45.566496+0000","last_clean":"2023-07-20T10:06:45.566496+0000","last_became_active":"2023-07-20T10:06:43.469494+0000","last_became_peered":"2023-07-20T10:06:43.469494+0000","last_unstale":"2023-07-20T10:06:45.566496+0000","last_undegraded":"2023-07-20T10:06:45.566496+0000","last_fullsized":"2023-07-20T10:06:45.566496+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:26:33.647057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"96'183","reported_seq":561,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569150+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:06:45.569150+0000","last_peered":"2023-07-20T10:06:45.569150+0000","last_clean":"2023-07-20T10:06:45.569150+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:06:45.569150+0000","last_undegraded":"2023-07-20T10:06:45.569150+0000","last_fullsized":"2023-07-20T10:06:45.569150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:16:39.665026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461282+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:06:45.461282+0000","last_peered":"2023-07-20T10:06:45.461282+0000","last_clean":"2023-07-20T10:06:45.461282+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:06:45.461282+0000","last_undegraded":"2023-07-20T10:06:45.461282+0000","last_fullsized":"2023-07-20T10:06:45.461282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:37.648389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566392+0000","last_change":"2023-07-20T10:06:44.476131+0000","last_active":"2023-07-20T10:06:45.566392+0000","last_peered":"2023-07-20T10:06:45.566392+0000","last_clean":"2023-07-20T10:06:45.566392+0000","last_became_active":"2023-07-20T10:06:44.473473+0000","last_became_peered":"2023-07-20T10:06:44.473473+0000","last_unstale":"2023-07-20T10:06:45.566392+0000","last_undegraded":"2023-07-20T10:06:45.566392+0000","last_fullsized":"2023-07-20T10:06:45.566392+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:27.332890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569871+0000","last_change":"2023-07-20T10:06:43.479147+0000","last_active":"2023-07-20T10:06:45.569871+0000","last_peered":"2023-07-20T10:06:45.569871+0000","last_clean":"2023-07-20T10:06:45.569871+0000","last_became_active":"2023-07-20T10:06:43.478838+0000","last_became_peered":"2023-07-20T10:06:43.478838+0000","last_unstale":"2023-07-20T10:06:45.569871+0000","last_undegraded":"2023-07-20T10:06:45.569871+0000","last_fullsized":"2023-07-20T10:06:45.569871+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:14.061929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569096+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:06:45.569096+0000","last_peered":"2023-07-20T10:06:45.569096+0000","last_clean":"2023-07-20T10:06:45.569096+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:06:45.569096+0000","last_undegraded":"2023-07-20T10:06:45.569096+0000","last_fullsized":"2023-07-20T10:06:45.569096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:02:18.173523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569779+0000","last_change":"2023-07-20T10:06:44.480688+0000","last_active":"2023-07-20T10:06:45.569779+0000","last_peered":"2023-07-20T10:06:45.569779+0000","last_clean":"2023-07-20T10:06:45.569779+0000","last_became_active":"2023-07-20T10:06:44.480327+0000","last_became_peered":"2023-07-20T10:06:44.480327+0000","last_unstale":"2023-07-20T10:06:45.569779+0000","last_undegraded":"2023-07-20T10:06:45.569779+0000","last_fullsized":"2023-07-20T10:06:45.569779+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:07.664828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569548+0000","last_change":"2023-07-20T10:06:43.478316+0000","last_active":"2023-07-20T10:06:45.569548+0000","last_peered":"2023-07-20T10:06:45.569548+0000","last_clean":"2023-07-20T10:06:45.569548+0000","last_became_active":"2023-07-20T10:06:43.477958+0000","last_became_peered":"2023-07-20T10:06:43.477958+0000","last_unstale":"2023-07-20T10:06:45.569548+0000","last_undegraded":"2023-07-20T10:06:45.569548+0000","last_fullsized":"2023-07-20T10:06:45.569548+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:09:43.016635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454973+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:06:45.454973+0000","last_peered":"2023-07-20T10:06:45.454973+0000","last_clean":"2023-07-20T10:06:45.454973+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:06:45.454973+0000","last_undegraded":"2023-07-20T10:06:45.454973+0000","last_fullsized":"2023-07-20T10:06:45.454973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:08.024078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460561+0000","last_change":"2023-07-20T10:06:44.468573+0000","last_active":"2023-07-20T10:06:45.460561+0000","last_peered":"2023-07-20T10:06:45.460561+0000","last_clean":"2023-07-20T10:06:45.460561+0000","last_became_active":"2023-07-20T10:06:44.468288+0000","last_became_peered":"2023-07-20T10:06:44.468288+0000","last_unstale":"2023-07-20T10:06:45.460561+0000","last_undegraded":"2023-07-20T10:06:45.460561+0000","last_fullsized":"2023-07-20T10:06:45.460561+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:01.581046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"106'1","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460903+0000","last_change":"2023-07-20T10:06:43.474746+0000","last_active":"2023-07-20T10:06:45.460903+0000","last_peered":"2023-07-20T10:06:45.460903+0000","last_clean":"2023-07-20T10:06:45.460903+0000","last_became_active":"2023-07-20T10:06:43.473956+0000","last_became_peered":"2023-07-20T10:06:43.473956+0000","last_unstale":"2023-07-20T10:06:45.460903+0000","last_undegraded":"2023-07-20T10:06:45.460903+0000","last_fullsized":"2023-07-20T10:06:45.460903+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:04.625352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":186,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461597+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:06:45.461597+0000","last_peered":"2023-07-20T10:06:45.461597+0000","last_clean":"2023-07-20T10:06:45.461597+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:06:45.461597+0000","last_undegraded":"2023-07-20T10:06:45.461597+0000","last_fullsized":"2023-07-20T10:06:45.461597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:33:42.675468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.565567+0000","last_change":"2023-07-20T10:06:44.482384+0000","last_active":"2023-07-20T10:06:45.565567+0000","last_peered":"2023-07-20T10:06:45.565567+0000","last_clean":"2023-07-20T10:06:45.565567+0000","last_became_active":"2023-07-20T10:06:44.482116+0000","last_became_peered":"2023-07-20T10:06:44.482116+0000","last_unstale":"2023-07-20T10:06:45.565567+0000","last_undegraded":"2023-07-20T10:06:45.565567+0000","last_fullsized":"2023-07-20T10:06:45.565567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:41:33.887358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"106'2","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461456+0000","last_change":"2023-07-20T10:06:43.469866+0000","last_active":"2023-07-20T10:06:45.461456+0000","last_peered":"2023-07-20T10:06:45.461456+0000","last_clean":"2023-07-20T10:06:45.461456+0000","last_became_active":"2023-07-20T10:06:43.469563+0000","last_became_peered":"2023-07-20T10:06:43.469563+0000","last_unstale":"2023-07-20T10:06:45.461456+0000","last_undegraded":"2023-07-20T10:06:45.461456+0000","last_fullsized":"2023-07-20T10:06:45.461456+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:13:44.328162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566550+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:06:45.566550+0000","last_peered":"2023-07-20T10:06:45.566550+0000","last_clean":"2023-07-20T10:06:45.566550+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:06:45.566550+0000","last_undegraded":"2023-07-20T10:06:45.566550+0000","last_fullsized":"2023-07-20T10:06:45.566550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:10.754510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.460939+0000","last_change":"2023-07-20T10:06:44.467288+0000","last_active":"2023-07-20T10:06:45.460939+0000","last_peered":"2023-07-20T10:06:45.460939+0000","last_clean":"2023-07-20T10:06:45.460939+0000","last_became_active":"2023-07-20T10:06:44.466999+0000","last_became_peered":"2023-07-20T10:06:44.466999+0000","last_unstale":"2023-07-20T10:06:45.460939+0000","last_undegraded":"2023-07-20T10:06:45.460939+0000","last_fullsized":"2023-07-20T10:06:45.460939+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:11:23.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.455412+0000","last_change":"2023-07-20T10:06:43.472464+0000","last_active":"2023-07-20T10:06:45.455412+0000","last_peered":"2023-07-20T10:06:45.455412+0000","last_clean":"2023-07-20T10:06:45.455412+0000","last_became_active":"2023-07-20T10:06:43.472186+0000","last_became_peered":"2023-07-20T10:06:43.472186+0000","last_unstale":"2023-07-20T10:06:45.455412+0000","last_undegraded":"2023-07-20T10:06:45.455412+0000","last_fullsized":"2023-07-20T10:06:45.455412+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:23.887891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.569539+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:06:45.569539+0000","last_peered":"2023-07-20T10:06:45.569539+0000","last_clean":"2023-07-20T10:06:45.569539+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:06:45.569539+0000","last_undegraded":"2023-07-20T10:06:45.569539+0000","last_fullsized":"2023-07-20T10:06:45.569539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:07:31.756871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461461+0000","last_change":"2023-07-20T10:06:44.481915+0000","last_active":"2023-07-20T10:06:45.461461+0000","last_peered":"2023-07-20T10:06:45.461461+0000","last_clean":"2023-07-20T10:06:45.461461+0000","last_became_active":"2023-07-20T10:06:44.481611+0000","last_became_peered":"2023-07-20T10:06:44.481611+0000","last_unstale":"2023-07-20T10:06:45.461461+0000","last_undegraded":"2023-07-20T10:06:45.461461+0000","last_fullsized":"2023-07-20T10:06:45.461461+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:46:50.126163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.461067+0000","last_change":"2023-07-20T10:06:43.471785+0000","last_active":"2023-07-20T10:06:45.461067+0000","last_peered":"2023-07-20T10:06:45.461067+0000","last_clean":"2023-07-20T10:06:45.461067+0000","last_became_active":"2023-07-20T10:06:43.471478+0000","last_became_peered":"2023-07-20T10:06:43.471478+0000","last_unstale":"2023-07-20T10:06:45.461067+0000","last_undegraded":"2023-07-20T10:06:45.461067+0000","last_fullsized":"2023-07-20T10:06:45.461067+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:21:41.314151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566146+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:06:45.566146+0000","last_peered":"2023-07-20T10:06:45.566146+0000","last_clean":"2023-07-20T10:06:45.566146+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:06:45.566146+0000","last_undegraded":"2023-07-20T10:06:45.566146+0000","last_fullsized":"2023-07-20T10:06:45.566146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:38.815168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.566040+0000","last_change":"2023-07-20T10:06:44.479305+0000","last_active":"2023-07-20T10:06:45.566040+0000","last_peered":"2023-07-20T10:06:45.566040+0000","last_clean":"2023-07-20T10:06:45.566040+0000","last_became_active":"2023-07-20T10:06:44.479035+0000","last_became_peered":"2023-07-20T10:06:44.479035+0000","last_unstale":"2023-07-20T10:06:45.566040+0000","last_undegraded":"2023-07-20T10:06:45.566040+0000","last_fullsized":"2023-07-20T10:06:45.566040+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:43.438673+0000","last_clean_scrub_stamp":"2023-07-20T10:06:43.438673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:13:42.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.454993+0000","last_change":"2023-07-20T10:06:43.462009+0000","last_active":"2023-07-20T10:06:45.454993+0000","last_peered":"2023-07-20T10:06:45.454993+0000","last_clean":"2023-07-20T10:06:45.454993+0000","last_became_active":"2023-07-20T10:06:43.461708+0000","last_became_peered":"2023-07-20T10:06:43.461708+0000","last_unstale":"2023-07-20T10:06:45.454993+0000","last_undegraded":"2023-07-20T10:06:45.454993+0000","last_fullsized":"2023-07-20T10:06:45.454993+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:06:42.429282+0000","last_clean_scrub_stamp":"2023-07-20T10:06:42.429282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:56:10.327938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":107,"state":"active+clean","last_fresh":"2023-07-20T10:06:45.570016+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:06:45.570016+0000","last_peered":"2023-07-20T10:06:45.570016+0000","last_clean":"2023-07-20T10:06:45.570016+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:06:45.570016+0000","last_undegraded":"2023-07-20T10:06:45.570016+0000","last_fullsized":"2023-07-20T10:06:45.570016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:30:52.377889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575045,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59228,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312612,"statfs":{"total":96636764160,"available":96576114688,"internally_reserved":0,"allocated":1916928,"data_stored":1246398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71199999999999997,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71999999999999997,"15min":0.746},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63700000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.47899999999999998,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.93899999999999995,"5min":1.008,"15min":1.008},"last":0.745},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.67800000000000005,"15min":0.69999999999999996},"min":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.075,"15min":1.075},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66900000000000004,"15min":0.69799999999999995},"min":{"1min":0.42699999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86099999999999999,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.499,"5min":0.47199999999999998,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.716,"15min":1.716},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.433},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.73799999999999999},"min":{"1min":0.45800000000000002,"5min":0.443,"15min":0.443},"max":{"1min":1.3759999999999999,"5min":1.758,"15min":1.758},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67400000000000004,"15min":0.67500000000000004},"min":{"1min":0.434,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.01,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.63600000000000001,"15min":0.61199999999999999},"min":{"1min":0.38100000000000001,"5min":0.34399999999999997,"15min":0.32400000000000001},"max":{"1min":0.97399999999999998,"5min":1.8,"15min":1.8},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.67200000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70599999999999996,"15min":0.69199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42499999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1335296,"data_stored":658142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.47899999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.89600000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.77600000000000002},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70599999999999996,"15min":0.71899999999999997},"min":{"1min":0.498,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90100000000000002,"5min":1.04,"15min":1.1259999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.103},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46200000000000002},"max":{"1min":0.79300000000000004,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.70699999999999996,"15min":0.72099999999999997},"min":{"1min":0.48399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86899999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"last":0.85099999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.25},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.498},"max":{"1min":0.88,"5min":0.95299999999999996,"15min":1.272},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.376,"15min":0.35999999999999999},"max":{"1min":0.82799999999999996,"5min":0.98699999999999999,"15min":1.173},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.45600000000000002,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.59699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":0.996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.622},"min":{"1min":0.40300000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.77500000000000002,"5min":1.0549999999999999,"15min":1.0649999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63800000000000001,"15min":0.63700000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.373},"max":{"1min":1.02,"5min":1.1160000000000001,"15min":1.155},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67000000000000004,"15min":0.66300000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40600000000000003},"max":{"1min":0.92100000000000004,"5min":0.95999999999999996,"15min":0.96399999999999997},"last":0.75700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575045,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.45700000000000002,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.99199999999999999,"15min":1.0329999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.73599999999999999,"15min":0.72199999999999998},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.36699999999999999},"max":{"1min":0.96299999999999997,"5min":0.97199999999999998,"15min":1.0069999999999999},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.73499999999999999,"15min":0.72399999999999998},"min":{"1min":0.46300000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.46600000000000003,"5min":0.40600000000000003,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.74199999999999999,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0129999999999999,"15min":1.0249999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.081},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90700000000000003,"5min":1.034,"15min":1.034},"last":0.872},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.42899999999999999},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79400000000000004,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.622,"15min":0.626},"min":{"1min":0.373,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.93400000000000005,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":0.73099999999999998,"5min":0.94899999999999995,"15min":1.016},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83299999999999996,"5min":1.024,"15min":1.3080000000000001},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:05:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69599999999999995,"15min":0.69199999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41999999999999998},"max":{"1min":0.89200000000000002,"5min":1.0680000000000001,"15min":1.145},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68500000000000005,"15min":0.70999999999999996},"min":{"1min":0.48999999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82699999999999996,"5min":0.96499999999999997,"15min":1.0329999999999999},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575045,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1323008,"data_stored":656134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.70399999999999996},"min":{"1min":0.39000000000000001,"5min":0.38800000000000001,"15min":0.38300000000000001},"max":{"1min":1.0069999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67400000000000004,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0580000000000001,"15min":1.085},"last":0.66700000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68200000000000005,"15min":0.71599999999999997},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.95899999999999996,"5min":1.125,"15min":1.141},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.41699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85899999999999999,"5min":1.22,"15min":1.363},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70799999999999996,"15min":0.73499999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.93899999999999995,"5min":1.177,"15min":1.177},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.55100000000000005,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":0.93999999999999995,"5min":1.204,"15min":1.23},"last":0.82799999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.49299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.871,"5min":1.0800000000000001,"15min":1.3180000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.71999999999999997,"15min":0.73499999999999999},"min":{"1min":0.47699999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96599999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.81399999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60499999999999998,"15min":0.622},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.98899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":1.196},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60499999999999998,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.32700000000000001,"15min":0.27500000000000002},"max":{"1min":0.84999999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.70299999999999996},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95399999999999996,"5min":0.95699999999999996,"15min":1.034},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:06:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.33300000000000002},"max":{"1min":0.81699999999999995,"5min":0.876,"15min":1.2649999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.84399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.57299999999999995,"5min":0.69299999999999995,"15min":0.81899999999999995},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46800000000000003,"15min":0.48499999999999999},"min":{"1min":0.36799999999999999,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.60299999999999998,"5min":0.68700000000000006,"15min":0.70299999999999996},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.46300000000000002,"15min":0.46700000000000003},"min":{"1min":0.33100000000000002,"5min":0.308,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.40500000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.81999999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55400000000000005,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72099999999999997,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.93000000000000005,"5min":1.083,"15min":1.1890000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.45900000000000002},"max":{"1min":0.83299999999999996,"5min":1.071,"15min":1.381},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.53600000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88600000000000001,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72899999999999998,"15min":0.77400000000000002},"min":{"1min":0.52700000000000002,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":0.93500000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.747}]},{"osd":6,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.753,"15min":0.79300000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94999999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72899999999999998,"15min":0.76600000000000001},"min":{"1min":0.57599999999999996,"5min":0.504,"15min":0.502},"max":{"1min":0.83099999999999996,"5min":1.04,"15min":1.131},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73299999999999998,"15min":0.77800000000000002},"min":{"1min":0.5,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.86299999999999999,"5min":0.97699999999999998,"15min":1.4399999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98499999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.65000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54552,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317288,"statfs":{"total":96636764160,"available":96580902912,"internally_reserved":0,"allocated":1314816,"data_stored":655974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":0.61399999999999999,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.505,"15min":0.51200000000000001},"min":{"1min":0.318,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.68000000000000005,"5min":0.76100000000000001,"15min":0.84499999999999997},"last":0.40699999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.25700000000000001},"max":{"1min":0.53000000000000003,"5min":0.83799999999999997,"15min":0.876},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.378,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.65300000000000002,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.441}]},{"osd":3,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.54400000000000004,"15min":0.55600000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63900000000000001,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.371},{"interface":"front","average":{"1min":0.503,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.35599999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.95199999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.77700000000000002},"min":{"1min":0.497,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0700000000000001,"5min":1.1890000000000001,"15min":1.25},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.52500000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.99399999999999999,"5min":1.099,"15min":1.2689999999999999},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.79300000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":1.087,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.78500000000000003},"min":{"1min":0.54400000000000004,"5min":0.45700000000000002,"15min":0.42599999999999999},"max":{"1min":0.94799999999999995,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.78400000000000003,"15min":0.80200000000000005},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.79500000000000004,"15min":0.80900000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.044,"5min":1.218,"15min":1.3240000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79700000000000004,"15min":0.81299999999999994},"min":{"1min":0.57999999999999996,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":0.96499999999999997,"5min":1.143,"15min":1.292},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.02,"5min":1.204,"15min":1.393},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1318912,"data_stored":656044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.45200000000000001,"15min":0.46500000000000002},"min":{"1min":0.26600000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54300000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.52100000000000002,"15min":0.53600000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.64300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46999999999999997,"15min":0.47699999999999998},"min":{"1min":0.32400000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.497,"5min":0.69199999999999995,"15min":1.0800000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66400000000000003,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.372}]},{"osd":3,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55700000000000005,"15min":0.57199999999999995},"min":{"1min":0.40000000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60899999999999999,"5min":0.81200000000000006,"15min":1.052},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.38,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67800000000000005,"5min":1.399,"15min":1.399},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.72699999999999998,"15min":0.749},"min":{"1min":0.51800000000000002,"5min":0.502,"15min":0.48599999999999999},"max":{"1min":0.89700000000000002,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.74399999999999999,"15min":0.76900000000000002},"min":{"1min":0.53000000000000003,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.92000000000000004,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.74299999999999999,"15min":0.76600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94799999999999995,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.73099999999999998,"15min":0.76800000000000002},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":0.94199999999999995,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.74299999999999999,"15min":0.77000000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95799999999999996,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.77700000000000002},"min":{"1min":0.56000000000000005,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":0.86299999999999999,"5min":1.0389999999999999,"15min":1.1879999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:06:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.45000000000000001},"max":{"1min":0.96899999999999997,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.90800000000000003,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575045,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37108,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334732,"statfs":{"total":96636764160,"available":96598765568,"internally_reserved":0,"allocated":1933312,"data_stored":1248612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.47699999999999998,"15min":0.45400000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":0.60099999999999998,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.58199999999999996,"15min":0.53900000000000003},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":0.69699999999999995,"5min":5.1619999999999999,"15min":5.1619999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.27600000000000002},"max":{"1min":0.73499999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.502},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.66700000000000004,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.38800000000000001,"15min":0.36799999999999999},"max":{"1min":0.71299999999999997,"5min":10.141999999999999,"15min":10.141999999999999},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.60799999999999998,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.314},"max":{"1min":0.57599999999999996,"5min":10.631,"15min":10.631},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59399999999999997,"15min":0.57899999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.63900000000000001,"5min":3.2909999999999999,"15min":3.2909999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1100000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.83599999999999997,"15min":0.81200000000000006},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.495},"max":{"1min":1.0409999999999999,"5min":3.125,"15min":3.125},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.90600000000000003,"15min":0.83599999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0149999999999999,"5min":7.4340000000000002,"15min":7.4340000000000002},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.83599999999999997,"15min":0.81100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.58199999999999996,"15min":0.48499999999999999},"max":{"1min":1.0009999999999999,"5min":3.161,"15min":3.161},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.88600000000000001,"15min":0.83299999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.46600000000000003},"max":{"1min":1.0860000000000001,"5min":5.1189999999999998,"15min":5.1189999999999998},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.90400000000000003,"15min":0.85099999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.048,"5min":5.1970000000000001,"15min":5.1970000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.82999999999999996,"15min":0.81899999999999995},"min":{"1min":0.51800000000000002,"5min":0.48299999999999998,"15min":0.47399999999999998},"max":{"1min":0.98499999999999999,"5min":1.766,"15min":1.766},"last":0.77500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:06:53.424 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:06:53.424 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:06:53.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 Processor -- start 2023-07-20T10:06:53.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 -- start start 2023-07-20T10:06:53.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f548406c120 0x7f54840cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54841602b0 0x7f5484160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840d0970 con 0x7f548406ab10 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5484160e20 con 0x7f548406c120 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f548a0cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840cd300 con 0x7f54841602b0 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f548406c120 0x7f54840cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f548406c120 0x7f54840cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60472/0 (socket says 172.21.15.82:60472) 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 -- 172.21.15.82:0/2580307136 learned_addr learned my addr 172.21.15.82:0/2580307136 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f547affd640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54841602b0 0x7f5484160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 -- 172.21.15.82:0/2580307136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54841602b0 msgr2=0x7f5484160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54841602b0 0x7f5484160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 -- 172.21.15.82:0/2580307136 >> v1:172.21.15.183:6789/0 conn(0x7f548406ab10 legacy=0x7f548406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.629+0000 7f54837fe640 1 -- 172.21.15.82:0/2580307136 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840cd5e0 con 0x7f548406c120 2023-07-20T10:06:53.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f54837fe640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548406c120 0x7f54840cdde0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5474009870 tx=0x7f547401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaa36f79959c77 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f5482ffd640 1 -- 172.21.15.82:0/2580307136 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740ac620 con 0x7f548406c120 2023-07-20T10:06:53.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f5482ffd640 1 -- 172.21.15.82:0/2580307136 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54740ac780 con 0x7f548406c120 2023-07-20T10:06:53.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f5482ffd640 1 -- 172.21.15.82:0/2580307136 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740acb10 con 0x7f548406c120 2023-07-20T10:06:53.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 -- 172.21.15.82:0/2580307136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548406c120 msgr2=0x7f54840cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548406c120 0x7f54840cdde0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f5474009870 tx=0x7f547401c4b0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 -- 172.21.15.82:0/2580307136 shutdown_connections 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54841602b0 0x7f5484160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 --2- 172.21.15.82:0/2580307136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f548406c120 0x7f54840cdde0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 -- 172.21.15.82:0/2580307136 >> 172.21.15.82:0/2580307136 conn(0x7f548408c0a0 msgr2=0x7f548409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:53.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 -- 172.21.15.82:0/2580307136 shutdown_connections 2023-07-20T10:06:53.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.633+0000 7f548a0cb640 1 -- 172.21.15.82:0/2580307136 wait complete. 2023-07-20T10:06:53.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 Processor -- start 2023-07-20T10:06:53.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- start start 2023-07-20T10:06:53.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f548406ab10 0x7f548414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 0x7f548414d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840b0b50 con 0x7f54841602b0 2023-07-20T10:06:53.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5484155a40 con 0x7f548406ab10 2023-07-20T10:06:53.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548414dfc0 con 0x7f548406c120 2023-07-20T10:06:53.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f54837fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f548406ab10 0x7f548414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60474/0 (socket says 172.21.15.82:60474) 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 -- 172.21.15.82:0/747781242 learned_addr learned my addr 172.21.15.82:0/747781242 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f547affd640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 0x7f548414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 -- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 msgr2=0x7f548414d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 0x7f548414d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 -- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f548406ab10 msgr2=0x7f548414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f548406ab10 0x7f548414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 -- 172.21.15.82:0/747781242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740094d0 con 0x7f54841602b0 2023-07-20T10:06:53.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f547affd640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 0x7f548414d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:53.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5483fff640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c770 tx=0x7f547c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c003b80 con 0x7f54841602b0 2023-07-20T10:06:53.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c003ce0 con 0x7f54841602b0 2023-07-20T10:06:53.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00aa90 con 0x7f54841602b0 2023-07-20T10:06:53.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5484155d00 con 0x7f54841602b0 2023-07-20T10:06:53.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.637+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548414db70 con 0x7f54841602b0 2023-07-20T10:06:53.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548414dd90 con 0x7f54841602b0 2023-07-20T10:06:53.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f547c00abf0 con 0x7f54841602b0 2023-07-20T10:06:53.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f5480ff9640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 0x7f5464068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f547c083c80 con 0x7f54841602b0 2023-07-20T10:06:53.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f54837fe640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 0x7f5464068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.641+0000 7f54837fe640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 0x7f5464068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54740ae000 tx=0x7f54740a7000 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.645+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f547c050fe0 con 0x7f54841602b0 2023-07-20T10:06:53.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.845+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f548404da30 con 0x7f54841602b0 2023-07-20T10:06:53.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.849+0000 7f5480ff9640 1 -- 172.21.15.82:0/747781242 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f547c054600 con 0x7f54841602b0 2023-07-20T10:06:53.831 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:06:53.832 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:06:53.832 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:06:53.832 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:06:53.832 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:06:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:06:53.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 msgr2=0x7f5464068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 0x7f5464068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54740ae000 tx=0x7f54740a7000 comp rx=0 tx=0).stop 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 msgr2=0x7f54840af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f547c00c770 tx=0x7f547c00cc30 comp rx=0 tx=0).stop 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 shutdown_connections 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54841602b0 0x7f54840af220 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f54640663a0 0x7f5464068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f548406c120 0x7f548414d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 --2- 172.21.15.82:0/747781242 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f548406ab10 0x7f548414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 >> 172.21.15.82:0/747781242 conn(0x7f548408c0a0 msgr2=0x7f54840b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 shutdown_connections 2023-07-20T10:06:53.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:53.853+0000 7f548a0cb640 1 -- 172.21.15.82:0/747781242 wait complete. 2023-07-20T10:06:53.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:06:53.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 Processor -- start 2023-07-20T10:06:53.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 -- start start 2023-07-20T10:06:53.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6f6015cab0 0x7f6f600d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:53.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f600b3520 con 0x7f6f600ce4c0 2023-07-20T10:06:53.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f600cff30 con 0x7f6f600d0d10 2023-07-20T10:06:53.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f66ecb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f600d31c0 con 0x7f6f6015cab0 2023-07-20T10:06:53.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6f6015cab0 0x7f6f600d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:53.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f65468640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6f600ce4c0 0x7f6f600cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39342/0 (socket says 172.21.15.82:39342) 2023-07-20T10:06:53.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6f6015cab0 0x7f6f600d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60482/0 (socket says 172.21.15.82:60482) 2023-07-20T10:06:53.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 -- 172.21.15.82:0/316480442 learned_addr learned my addr 172.21.15.82:0/316480442 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:53.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 -- 172.21.15.82:0/316480442 >> v1:172.21.15.183:6789/0 conn(0x7f6f600d0d10 legacy=0x7f6f600cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 -- 172.21.15.82:0/316480442 >> v1:172.21.15.82:6789/0 conn(0x7f6f600ce4c0 legacy=0x7f6f600cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f64c67640 1 -- 172.21.15.82:0/316480442 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600b2910 con 0x7f6f6015cab0 2023-07-20T10:06:53.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.013+0000 7f6f577fe640 1 -- 172.21.15.82:0/316480442 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273974222 0 0) 0x7f6f600b3520 con 0x7f6f600ce4c0 2023-07-20T10:06:53.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f64c67640 1 --2- 172.21.15.82:0/316480442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6015cab0 0x7f6f600d0300 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009870 tx=0x7f6f5c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0ab380caf44a46 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:53.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f577fe640 1 -- 172.21.15.82:0/316480442 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0aa670 con 0x7f6f6015cab0 2023-07-20T10:06:53.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f577fe640 1 -- 172.21.15.82:0/316480442 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0aa7d0 con 0x7f6f6015cab0 2023-07-20T10:06:53.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f577fe640 1 -- 172.21.15.82:0/316480442 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0aab60 con 0x7f6f6015cab0 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 -- 172.21.15.82:0/316480442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6015cab0 msgr2=0x7f6f600d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/316480442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6015cab0 0x7f6f600d0300 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009870 tx=0x7f6f5c01c510 comp rx=0 tx=0).stop 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 -- 172.21.15.82:0/316480442 shutdown_connections 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/316480442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f6015cab0 0x7f6f600d0300 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 -- 172.21.15.82:0/316480442 >> 172.21.15.82:0/316480442 conn(0x7f6f6008c120 msgr2=0x7f6f6009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 -- 172.21.15.82:0/316480442 shutdown_connections 2023-07-20T10:06:53.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.017+0000 7f6f66ecb640 1 -- 172.21.15.82:0/316480442 wait complete. 2023-07-20T10:06:54.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 Processor -- start 2023-07-20T10:06:54.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- start start 2023-07-20T10:06:54.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f600d0d10 0x7f6f600cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f6015cab0 0x7f6f6015ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600c7990 con 0x7f6f600ce4c0 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600b15f0 con 0x7f6f600d0d10 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f600b1310 con 0x7f6f6015cab0 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60492/0 (socket says 172.21.15.82:60492) 2023-07-20T10:06:54.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 -- 172.21.15.82:0/3318696806 learned_addr learned my addr 172.21.15.82:0/3318696806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f57fff640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f600d0d10 0x7f6f600cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f65468640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f6015cab0 0x7f6f6015ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 -- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f6015cab0 msgr2=0x7f6f6015ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f6015cab0 0x7f6f6015ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 -- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f600d0d10 msgr2=0x7f6f600cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f600d0d10 0x7f6f600cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 -- 172.21.15.82:0/3318696806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0094d0 con 0x7f6f600ce4c0 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f64c67640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0ac040 tx=0x7f6f5c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c004030 con 0x7f6f600ce4c0 2023-07-20T10:06:54.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0b7070 con 0x7f6f600ce4c0 2023-07-20T10:06:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0043d0 con 0x7f6f600ce4c0 2023-07-20T10:06:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f600c7340 con 0x7f6f600ce4c0 2023-07-20T10:06:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.021+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f600cc700 con 0x7f6f600ce4c0 2023-07-20T10:06:54.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60073c70 con 0x7f6f600ce4c0 2023-07-20T10:06:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6f5c003620 con 0x7f6f600ce4c0 2023-07-20T10:06:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f557fa640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 0x7f6f4c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f5c11e690 con 0x7f6f600ce4c0 2023-07-20T10:06:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f57fff640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 0x7f6f4c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.025+0000 7f6f57fff640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 0x7f6f4c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f600c6ca0 tx=0x7f6f50009040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.029+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f5c0eb9f0 con 0x7f6f600ce4c0 2023-07-20T10:06:54.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.205+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f60158340 con 0x7f6f600ce4c0 2023-07-20T10:06:54.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f557fa640 1 -- 172.21.15.82:0/3318696806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f6f5c0ef010 con 0x7f6f600ce4c0 2023-07-20T10:06:54.188 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:06:54.188 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:06:54.189 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:06:54.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 msgr2=0x7f6f4c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 0x7f6f4c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f600c6ca0 tx=0x7f6f50009040 comp rx=0 tx=0).stop 2023-07-20T10:06:54.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 msgr2=0x7f6f6015fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0ac040 tx=0x7f6f5c01ad50 comp rx=0 tx=0).stop 2023-07-20T10:06:54.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 shutdown_connections 2023-07-20T10:06:54.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f6f4c0663a0 0x7f6f4c068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6f6015cab0 0x7f6f6015ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f600d0d10 0x7f6f600cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 --2- 172.21.15.82:0/3318696806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f600ce4c0 0x7f6f6015fb10 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 >> 172.21.15.82:0/3318696806 conn(0x7f6f6008c120 msgr2=0x7f6f60153680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 shutdown_connections 2023-07-20T10:06:54.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.209+0000 7f6f66ecb640 1 -- 172.21.15.82:0/3318696806 wait complete. 2023-07-20T10:06:54.611 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:06:43.832751+0000', 'modified': '2023-07-20T10:06:47.478656+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7800}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7800': {'gid': 7800, 'name': 'd', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.183:6835/886744377', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6833', 'nonce': 886744377}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 886744377}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:06:54.611 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:06:54.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-20T10:06:54.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 Processor -- start 2023-07-20T10:06:54.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 -- start start 2023-07-20T10:06:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39ac0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f39ac0d0d10 0x7f39ac0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39ac0d16b0 con 0x7f39ac0cf110 2023-07-20T10:06:54.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39ac0d31c0 con 0x7f39ac0d0d10 2023-07-20T10:06:54.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b23a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0b3520 con 0x7f39ac15cab0 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b0940640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f39ac0cf110 0x7f39ac0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39350/0 (socket says 172.21.15.82:39350) 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39b0940640 1 -- 172.21.15.82:0/2126142134 learned_addr learned my addr 172.21.15.82:0/2126142134 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39abfff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39ac0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2126142134 >> v2:172.21.15.183:3300/0 conn(0x7f39ac0d0d10 0x7f39ac0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153792760 0 0) 0x7f39ac0d16b0 con 0x7f39ac0cf110 2023-07-20T10:06:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.773+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3998003530 con 0x7f39ac0cf110 2023-07-20T10:06:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754342969 0 0) 0x7f3998003530 con 0x7f39ac0cf110 2023-07-20T10:06:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 msgr2=0x7f39ac0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39ac0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 >> v2:172.21.15.183:3300/0 conn(0x7f39ac0d0d10 msgr2=0x7f39ac0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 --2- 172.21.15.82:0/2126142134 >> v2:172.21.15.183:3300/0 conn(0x7f39ac0d0d10 0x7f39ac0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0b2910 con 0x7f39ac0cf110 2023-07-20T10:06:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f39a4001a00 con 0x7f39ac0cf110 2023-07-20T10:06:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 >> v1:172.21.15.82:6789/0 conn(0x7f39ac0cf110 legacy=0x7f39ac0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3998003980 0x7f3998003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3998004d10 0x7f3998005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0b3520 con 0x7f3998003980 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399800b990 con 0x7f3998004d10 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399800bad0 con 0x7f39ac15cab0 2023-07-20T10:06:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2126142134 >> v2:172.21.15.183:3300/0 conn(0x7f39ac0d0d10 0x7f39ac0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3998003980 0x7f3998003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39b0940640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3998004d10 0x7f3998005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 -- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 msgr2=0x7f39980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 -- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3998004d10 msgr2=0x7f3998005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3998004d10 0x7f3998005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 -- 172.21.15.82:0/2126142134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3998003530 con 0x7f3998003980 2023-07-20T10:06:54.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39ac15cab0 0x7f39980047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39abfff640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3998003980 0x7f3998003da0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f399c009ae0 tx=0x7f399c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1819c60aa7cb3a8e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0a55f0 con 0x7f3998003980 2023-07-20T10:06:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c0a5750 con 0x7f3998003980 2023-07-20T10:06:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.777+0000 7f39ab7fe640 1 -- 172.21.15.82:0/2126142134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0a5b00 con 0x7f3998003980 2023-07-20T10:06:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- 172.21.15.82:0/2126142134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3998003980 msgr2=0x7f3998003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 --2- 172.21.15.82:0/2126142134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3998003980 0x7f3998003da0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f399c009ae0 tx=0x7f399c01ca20 comp rx=0 tx=0).stop 2023-07-20T10:06:54.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 -- 172.21.15.82:0/2126142134 reap_dead start 2023-07-20T10:06:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- 172.21.15.82:0/2126142134 shutdown_connections 2023-07-20T10:06:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- 172.21.15.82:0/2126142134 >> 172.21.15.82:0/2126142134 conn(0x7f39ac08c120 msgr2=0x7f39ac09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- 172.21.15.82:0/2126142134 shutdown_connections 2023-07-20T10:06:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- 172.21.15.82:0/2126142134 wait complete. 2023-07-20T10:06:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 Processor -- start 2023-07-20T10:06:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- start start 2023-07-20T10:06:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3998003980 0x7f39ac153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39ac0b58e0 0x7f39ac0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0b68f0 con 0x7f39ac0b5350 2023-07-20T10:06:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0c7800 con 0x7f39ac0b58e0 2023-07-20T10:06:54.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b23a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ac0b5d70 con 0x7f3998003980 2023-07-20T10:06:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60500/0 (socket says 172.21.15.82:60500) 2023-07-20T10:06:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 -- 172.21.15.82:0/4137534295 learned_addr learned my addr 172.21.15.82:0/4137534295 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39abfff640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3998003980 0x7f39ac153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39a3fff640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39ac0b58e0 0x7f39ac0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 -- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3998003980 msgr2=0x7f39ac153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3998003980 0x7f39ac153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.781+0000 7f39b0940640 1 -- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39ac0b58e0 msgr2=0x7f39ac0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39b0940640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39ac0b58e0 0x7f39ac0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39b0940640 1 -- 172.21.15.82:0/4137534295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0b6050 con 0x7f39ac0b5350 2023-07-20T10:06:54.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39b0940640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f90 tx=0x7f39a4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39a97fa640 1 -- 172.21.15.82:0/4137534295 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400eaa0 con 0x7f39ac0b5350 2023-07-20T10:06:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39a97fa640 1 -- 172.21.15.82:0/4137534295 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a400ec00 con 0x7f39ac0b5350 2023-07-20T10:06:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39a97fa640 1 -- 172.21.15.82:0/4137534295 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4013420 con 0x7f39ac0b5350 2023-07-20T10:06:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39ac0b6330 con 0x7f39ac0b5350 2023-07-20T10:06:54.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac153ca0 con 0x7f39ac0b5350 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.785+0000 7f39a97fa640 1 -- 172.21.15.82:0/4137534295 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39a4013580 con 0x7f39ac0b5350 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a97fa640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 0x7f398c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a97fa640 1 -- 172.21.15.82:0/4137534295 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a40840d0 con 0x7f39ac0b5350 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39abfff640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 0x7f398c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 Processor -- start 2023-07-20T10:06:54.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- start start 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39abfff640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 0x7f398c068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f399c0af000 tx=0x7f399c0046d0 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623582a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x5562357df950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562356a70a0 con 0x5562357dfe90 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556235635e40 con 0x55623582a640 2023-07-20T10:06:54.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556235633370 con 0x556235829d20 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60518/0 (socket says 172.21.15.82:60518) 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 -- 172.21.15.82:0/4060655461 learned_addr learned my addr 172.21.15.82:0/4060655461 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a3fff640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x5562357df950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39abfff640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623582a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 -- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 msgr2=0x55623582a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623582a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 -- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 msgr2=0x5562357df950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x5562357df950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 -- 172.21.15.82:0/4060655461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623532a890 con 0x5562357dfe90 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a3fff640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x5562357df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b0940640 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f39a4054eb0 tx=0x7f39a4059200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89bda303db70023 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a1ffb640 1 -- 172.21.15.82:0/4060655461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40518c0 con 0x5562357dfe90 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a1ffb640 1 -- 172.21.15.82:0/4060655461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a4051a20 con 0x5562357dfe90 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39a1ffb640 1 -- 172.21.15.82:0/4060655461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40511a0 con 0x5562357dfe90 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- 172.21.15.82:0/4060655461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 msgr2=0x5562357e0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f39a4054eb0 tx=0x7f39a4059200 comp rx=0 tx=0).stop 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- 172.21.15.82:0/4060655461 shutdown_connections 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x5562357e0270 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x5562357df950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 --2- 172.21.15.82:0/4060655461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623582a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- 172.21.15.82:0/4060655461 >> 172.21.15.82:0/4060655461 conn(0x5562357d7200 msgr2=0x5562357de230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- 172.21.15.82:0/4060655461 shutdown_connections 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.789+0000 7f39b5705000 1 -- 172.21.15.82:0/4060655461 wait complete. 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- start start 2023-07-20T10:06:54.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 Processor -- start 2023-07-20T10:06:54.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562357eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x5562357eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623562ec60 con 0x55623582a640 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562355eaae0 con 0x5562357dfe90 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562355ea780 con 0x556235829d20 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 10 client.0 _ll_register_callbacks cb 0x5562357cb820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60526/0 (socket says 172.21.15.82:60526) 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 -- 172.21.15.82:0/3527647609 learned_addr learned my addr 172.21.15.82:0/3527647609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39abfff640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562357eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39a3fff640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x5562357eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 -- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 msgr2=0x5562357eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x5562357eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 -- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 msgr2=0x5562357eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562357eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 -- 172.21.15.82:0/3527647609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ac153ca0 con 0x55623582a640 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b0940640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f39a4054eb0 tx=0x7f39a4058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce70aaf7541341e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4082070 con 0x55623582a640 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562355eefb0 con 0x55623582a640 2023-07-20T10:06:54.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39a40511a0 con 0x55623582a640 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39a406cad0 con 0x55623582a640 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 10 client.7971 fetch_fsmap learned FSMap version 50 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5562355f2d10 con 0x55623582a640 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562355eefb0 con 0x55623582a640 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f39a406cc30 con 0x55623582a640 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 10 client.7971 fetch_fsmap finished waiting for FSMap version 50 2023-07-20T10:06:54.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 10 client.7971 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 20 client.7971 populate_metadata read hostname 'smithi082' 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x5562357ec1b0 0x55623583b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 4 client.7971 mds_command: new command op to 7800 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 --> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55623565d410 con 0x5562357ec1b0 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.793+0000 7f39abfff640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x5562357ec1b0 0x55623583b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39abfff640 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x5562357ec1b0 0x55623583b290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4648c5f18e8fd48 server_cookie=903393849367d142 in_seq=0 out_seq=0 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f398affd640 10 client.7971 ms_handle_connect on v2:172.21.15.183:6833/886744377 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f398affd640 1 -- 172.21.15.82:0/3527647609 <== mds.0 v2:172.21.15.183:6833/886744377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55623565d410 con 0x5562357ec1b0 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f398affd640 10 client.7971 handle_command_reply: tid=0 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 client.7971 shutdown 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 msgr2=0x5562357eb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f39a4054eb0 tx=0x7f39a4058070 comp rx=0 tx=0).stop 2023-07-20T10:06:54.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 shutdown_connections 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x5562357ec1b0 0x55623583b290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55623582a640 0x5562357eb940 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x5562357eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 --2- 172.21.15.82:0/3527647609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562357eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f398affd640 0 client.7971 ms_handle_reset on v2:172.21.15.183:6833/886744377 2023-07-20T10:06:54.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 >> 172.21.15.82:0/3527647609 conn(0x5562357d7200 msgr2=0x5562357de230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 shutdown_connections 2023-07-20T10:06:54.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 1 -- 172.21.15.82:0/3527647609 wait complete. 2023-07-20T10:06:54.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.797+0000 7f39b5705000 20 client.7971 trim_cache size 0 max 16384 2023-07-20T10:06:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 Processor -- start 2023-07-20T10:06:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- start start 2023-07-20T10:06:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562358830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55623582a640 0x556235883b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562352eb940 con 0x556235829d20 2023-07-20T10:06:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562357dfbd0 con 0x5562357dfe90 2023-07-20T10:06:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562355f0540 con 0x55623582a640 2023-07-20T10:06:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60538/0 (socket says 172.21.15.82:60538) 2023-07-20T10:06:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 -- 172.21.15.82:0/357689839 learned_addr learned my addr 172.21.15.82:0/357689839 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b0940640 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55623582a640 0x556235883b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39abfff640 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562358830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 -- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55623582a640 msgr2=0x556235883b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55623582a640 0x556235883b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 -- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 msgr2=0x5562358830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562358830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 -- 172.21.15.82:0/357689839 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562355d8fa0 con 0x556235829d20 2023-07-20T10:06:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a3fff640 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d50 tx=0x7f3994009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a968e91bab3fd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a27fc640 1 -- 172.21.15.82:0/357689839 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39940205f0 con 0x556235829d20 2023-07-20T10:06:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a27fc640 1 -- 172.21.15.82:0/357689839 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994020770 con 0x556235829d20 2023-07-20T10:06:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39a27fc640 1 -- 172.21.15.82:0/357689839 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994020b20 con 0x556235829d20 2023-07-20T10:06:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- 172.21.15.82:0/357689839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 msgr2=0x556235883630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f3994009d50 tx=0x7f3994009190 comp rx=0 tx=0).stop 2023-07-20T10:06:54.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- 172.21.15.82:0/357689839 shutdown_connections 2023-07-20T10:06:54.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55623582a640 0x556235883b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556235829d20 0x556235883630 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 --2- 172.21.15.82:0/357689839 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562357dfe90 0x5562358830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.813+0000 7f39b5705000 1 -- 172.21.15.82:0/357689839 >> 172.21.15.82:0/357689839 conn(0x5562357d7200 msgr2=0x5562357e4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- 172.21.15.82:0/357689839 shutdown_connections 2023-07-20T10:06:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- 172.21.15.82:0/357689839 wait complete. 2023-07-20T10:06:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- start start 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 Processor -- start 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623583ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x55623583bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562357e60c0 con 0x5562357dfe90 2023-07-20T10:06:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556235637dc0 con 0x55623582a640 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562355f4fe0 con 0x556235829d20 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 10 client.0 _ll_register_callbacks cb 0x5562356a6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60546/0 (socket says 172.21.15.82:60546) 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 -- 172.21.15.82:0/2669400911 learned_addr learned my addr 172.21.15.82:0/2669400911 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623583ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b0940640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x55623583bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 -- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 msgr2=0x55623583ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623583ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 -- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 msgr2=0x55623583bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x55623583bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 -- 172.21.15.82:0/2669400911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3994009a30 con 0x5562357dfe90 2023-07-20T10:06:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39abfff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f399c01cf00 tx=0x7f399c01b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf958a78e72ab72 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0c7040 con 0x5562357dfe90 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562357dfd20 con 0x5562357dfe90 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f399c0ce480 con 0x5562357dfe90 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f399c0a5ea0 con 0x5562357dfe90 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 10 client.7977 fetch_fsmap learned FSMap version 50 2023-07-20T10:06:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55623532acc0 con 0x5562357dfe90 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562357dfd20 con 0x5562357dfe90 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f399c0bf040 con 0x5562357dfe90 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 10 client.7977 fetch_fsmap finished waiting for FSMap version 50 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 10 client.7977 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 20 client.7977 populate_metadata read hostname 'smithi082' 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x55623588d370 0x55623588f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 4 client.7977 mds_command: new command op to 7800 tid=0[{"prefix": "status"}] 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.817+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 --> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5562355f5a20 con 0x55623588d370 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x55623588d370 0x55623588f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f398affd640 10 client.7977 ms_handle_connect on v2:172.21.15.183:6833/886744377 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39a3fff640 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x55623588d370 0x55623588f760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90af4c9f86e4248f server_cookie=460509635143ae09 in_seq=0 out_seq=0 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f398affd640 1 -- 172.21.15.82:0/2669400911 <== mds.0 v2:172.21.15.183:6833/886744377 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5562355f5a20 con 0x55623588d370 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f398affd640 10 client.7977 handle_command_reply: tid=0 2023-07-20T10:06:54.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 client.7977 shutdown 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 msgr2=0x55623583b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f399c01cf00 tx=0x7f399c01b260 comp rx=0 tx=0).stop 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 shutdown_connections 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:6833/886744377,v1:172.21.15.183:6835/886744377] conn(0x55623588d370 0x55623588f760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55623582a640 0x55623583bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556235829d20 0x55623583ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f398affd640 0 client.7977 ms_handle_reset on v2:172.21.15.183:6833/886744377 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 --2- 172.21.15.82:0/2669400911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562357dfe90 0x55623583b550 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 >> 172.21.15.82:0/2669400911 conn(0x5562357d7200 msgr2=0x5562358287d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 shutdown_connections 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 1 -- 172.21.15.82:0/2669400911 wait complete. 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b5705000 20 client.7977 trim_cache size 0 max 16384 2023-07-20T10:06:54.819 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 7800, 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:06:54.820 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.358211756999999, 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 50, 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 107, 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 107, 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.317353627999999 2023-07-20T10:06:54.821 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 msgr2=0x7f398c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 0x7f398c068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f399c0af000 tx=0x7f399c0046d0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 msgr2=0x7f39ac0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f90 tx=0x7f39a4007bc0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 shutdown_connections 2023-07-20T10:06:54.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39ac0b5350 0x7f39ac0cdba0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39ac0b58e0 0x7f39ac0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f398c0663d0 0x7f398c068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 --2- 172.21.15.82:0/4137534295 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3998003980 0x7f39ac153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 >> 172.21.15.82:0/4137534295 conn(0x7f39ac08c120 msgr2=0x7f39ac15b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 shutdown_connections 2023-07-20T10:06:54.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.821+0000 7f39b23a3640 1 -- 172.21.15.82:0/4137534295 wait complete. 2023-07-20T10:06:54.825 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:06:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 Processor -- start 2023-07-20T10:06:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 -- start start 2023-07-20T10:06:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77181596b0 0x7f771815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77180cc900 0x7f77180ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77180ccd60 con 0x7f77180b2380 2023-07-20T10:06:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180ad600 con 0x7f77180cc900 2023-07-20T10:06:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f771e7a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180ad810 con 0x7f77181596b0 2023-07-20T10:06:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77180cc900 0x7f77180ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f77180cc900 0x7f77180ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60558/0 (socket says 172.21.15.82:60558) 2023-07-20T10:06:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 -- 172.21.15.82:0/3668038565 learned_addr learned my addr 172.21.15.82:0/3668038565 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f7717fff640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77181596b0 0x7f771815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 -- 172.21.15.82:0/3668038565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77181596b0 msgr2=0x7f771815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77181596b0 0x7f771815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 -- 172.21.15.82:0/3668038565 >> v1:172.21.15.183:6789/0 conn(0x7f77180b2380 legacy=0x7f77180c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.985+0000 7f77177fe640 1 -- 172.21.15.82:0/3668038565 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771815d0d0 con 0x7f77180cc900 2023-07-20T10:06:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f77177fe640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180cc900 0x7f77180ad0c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60814fe41181b92 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f7716ffd640 1 -- 172.21.15.82:0/3668038565 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a86f0 con 0x7f77180cc900 2023-07-20T10:06:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f7716ffd640 1 -- 172.21.15.82:0/3668038565 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c0a8850 con 0x7f77180cc900 2023-07-20T10:06:54.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f7716ffd640 1 -- 172.21.15.82:0/3668038565 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c0a8be0 con 0x7f77180cc900 2023-07-20T10:06:54.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 -- 172.21.15.82:0/3668038565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180cc900 msgr2=0x7f77180ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180cc900 0x7f77180ad0c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f770c009870 tx=0x7f770c01e720 comp rx=0 tx=0).stop 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 -- 172.21.15.82:0/3668038565 shutdown_connections 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180cc900 0x7f77180ad0c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 --2- 172.21.15.82:0/3668038565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77181596b0 0x7f771815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 -- 172.21.15.82:0/3668038565 >> 172.21.15.82:0/3668038565 conn(0x7f77180cada0 msgr2=0x7f77180cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 -- 172.21.15.82:0/3668038565 shutdown_connections 2023-07-20T10:06:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.989+0000 7f771e7a3640 1 -- 172.21.15.82:0/3668038565 wait complete. 2023-07-20T10:06:54.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 Processor -- start 2023-07-20T10:06:54.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- start start 2023-07-20T10:06:54.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77180cc900 0x7f77181f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77181596b0 0x7f7718155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7718155990 con 0x7f77180b2380 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77180c1e50 con 0x7f77181596b0 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77181f4d60 con 0x7f77180cc900 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60566/0 (socket says 172.21.15.82:60566) 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 -- 172.21.15.82:0/471204481 learned_addr learned my addr 172.21.15.82:0/471204481 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f77177fe640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77180cc900 0x7f77181f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771cd40640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77181596b0 0x7f7718155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 -- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77180cc900 msgr2=0x7f77181f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77180cc900 0x7f77181f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 -- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77181596b0 msgr2=0x7f7718155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:54.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77181596b0 0x7f7718155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:54.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 -- 172.21.15.82:0/471204481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0094d0 con 0x7f77180b2380 2023-07-20T10:06:54.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7717fff640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f770800e990 tx=0x7f770800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708009690 con 0x7f77180b2380 2023-07-20T10:06:54.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770800c9e0 con 0x7f77180b2380 2023-07-20T10:06:54.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800cd50 con 0x7f77180b2380 2023-07-20T10:06:54.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77180b2d20 con 0x7f77180b2380 2023-07-20T10:06:54.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7718155ec0 con 0x7f77180b2380 2023-07-20T10:06:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.993+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7718073c70 con 0x7f77180b2380 2023-07-20T10:06:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.997+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7708013470 con 0x7f77180b2380 2023-07-20T10:06:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.997+0000 7f7714ff9640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 0x7f7704068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.997+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77080840e0 con 0x7f77180b2380 2023-07-20T10:06:54.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.997+0000 7f77177fe640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 0x7f7704068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:54.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:54.997+0000 7f77177fe640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 0x7f7704068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b1000 tx=0x7f770c0a9000 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:54.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.001+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7708051460 con 0x7f77180b2380 2023-07-20T10:06:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77180cbbd0 con 0x7f77180b2380 2023-07-20T10:06:55.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f7714ff9640 1 -- 172.21.15.82:0/471204481 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7708054a80 con 0x7f77180b2380 2023-07-20T10:06:55.161 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:06:55.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 msgr2=0x7f7704068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 0x7f7704068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f770c0b1000 tx=0x7f770c0a9000 comp rx=0 tx=0).stop 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 msgr2=0x7f77180c28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f770800e990 tx=0x7f770800ee50 comp rx=0 tx=0).stop 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 shutdown_connections 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77181596b0 0x7f7718155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f77040663a0 0x7f7704068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:55.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77180cc900 0x7f77181f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 --2- 172.21.15.82:0/471204481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77180b2380 0x7f77180c28a0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 >> 172.21.15.82:0/471204481 conn(0x7f77180cada0 msgr2=0x7f771806b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 shutdown_connections 2023-07-20T10:06:55.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:55.181+0000 7f771e7a3640 1 -- 172.21.15.82:0/471204481 wait complete. 2023-07-20T10:06:55.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:06:55.183 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:06:55.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:06:55.184 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:06:55.184 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:55.185 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:06:55.185 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:06:55.186 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:06:55.186 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:55.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.188 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:06:55.198 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:06:55.199 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41386sec preferred_lft 41386sec 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.200 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.201 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:06:55.202 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:06:55.203 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:06:55.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.203 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:06:55.258 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:06:55.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.261 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:06:55.313 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:06:55.314 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:55.315 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:55.315 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:06:55.315 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:06:55.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.316 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:06:55.316 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:06:55.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:06:55.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:06:55.317 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:06:55.318 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:06:55.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.408 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:06:55.417 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:06:55.417 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:06:55.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:55.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.420 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:06:55.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:06:55.485 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:55.536 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:06:55.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:06:55.536 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:55.587 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:06:55.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:55.677 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:55.678 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:55.678 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:55.693 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:55.693 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:55.693 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:55.694 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:06:55.694 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:06:55.703 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:06:55.703 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:06:55.703 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:06:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:06:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:06:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:06:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:06:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:06:55.707 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:06:55.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:06:55.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:06:55.731 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:06:55.791 INFO:teuthology.orchestra.run.smithi082.stdout:client7986 2023-07-20T10:06:55.791 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:06:55.791 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:06:55.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:06:56.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 Processor -- start 2023-07-20T10:06:56.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 -- start start 2023-07-20T10:06:56.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd9415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940ccd90 con 0x7fcd941596b0 2023-07-20T10:06:56.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940ad810 con 0x7fcd940cc900 2023-07-20T10:06:56.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd98c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415d0d0 con 0x7fcd940b2a90 2023-07-20T10:06:56.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcd941596b0 0x7fcd940b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39356/0 (socket says 172.21.15.82:39356) 2023-07-20T10:06:56.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 -- 172.21.15.82:0/682495685 learned_addr learned my addr 172.21.15.82:0/682495685 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:56.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100025093 0 0) 0x7fcd940ccd90 con 0x7fcd941596b0 2023-07-20T10:06:56.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd89d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd9415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd80005740 con 0x7fcd941596b0 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 323473577 0 0) 0x7fcd80005740 con 0x7fcd941596b0 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 msgr2=0x7fcd9415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd9415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 >> v1:172.21.15.183:6789/0 conn(0x7fcd940cc900 legacy=0x7fcd940c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9415d3b0 con 0x7fcd941596b0 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fcd84001680 con 0x7fcd941596b0 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 >> v1:172.21.15.82:6789/0 conn(0x7fcd941596b0 legacy=0x7fcd940b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd80005bc0 0x7fcd80005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd800069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd80006f20 0x7fcd800073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415d0d0 con 0x7fcd80005bc0 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8000dbd0 con 0x7fcd80006f20 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8000dd90 con 0x7fcd940b2a90 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd80005bc0 0x7fcd80005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd89d9b640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd800069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd92d9d640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd80006f20 0x7fcd800073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 -- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 msgr2=0x7fcd800069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd940b2a90 0x7fcd800069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 -- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd80006f20 msgr2=0x7fcd800073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd80006f20 0x7fcd800073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd9259c640 1 -- 172.21.15.82:0/682495685 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80005740 con 0x7fcd80005bc0 2023-07-20T10:06:56.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.045+0000 7fcd92d9d640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd80006f20 0x7fcd800073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:06:56.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd9259c640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd80005bc0 0x7fcd80005fa0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400c210 tx=0x7fcd8401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b1cd2a17637bac server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84005ae0 con 0x7fcd80005bc0 2023-07-20T10:06:56.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84005c60 con 0x7fcd80005bc0 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd91d9b640 1 -- 172.21.15.82:0/682495685 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84007070 con 0x7fcd80005bc0 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 -- 172.21.15.82:0/682495685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd80005bc0 msgr2=0x7fcd80005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 --2- 172.21.15.82:0/682495685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd80005bc0 0x7fcd80005fa0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400c210 tx=0x7fcd8401cb70 comp rx=0 tx=0).stop 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd92d9d640 1 -- 172.21.15.82:0/682495685 reap_dead start 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 -- 172.21.15.82:0/682495685 shutdown_connections 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 -- 172.21.15.82:0/682495685 >> 172.21.15.82:0/682495685 conn(0x7fcd940cada0 msgr2=0x7fcd940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:56.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 -- 172.21.15.82:0/682495685 shutdown_connections 2023-07-20T10:06:56.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.049+0000 7fcd98c96640 1 -- 172.21.15.82:0/682495685 wait complete. 2023-07-20T10:06:56.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 Processor -- start 2023-07-20T10:06:56.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- start start 2023-07-20T10:06:56.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 0x7fcd9415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 0x7fcd940c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415c0f0 con 0x7fcd94154620 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94154fe0 con 0x7fcd940c3ec0 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940c1ef0 con 0x7fcd80005bc0 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60588/0 (socket says 172.21.15.82:60588) 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 -- 172.21.15.82:0/296944853 learned_addr learned my addr 172.21.15.82:0/296944853 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:56.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd9259c640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 0x7fcd9415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd92d9d640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 0x7fcd940c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 -- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 msgr2=0x7fcd9415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 0x7fcd9415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 -- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 msgr2=0x7fcd940c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 0x7fcd940c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 -- 172.21.15.82:0/296944853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940c21d0 con 0x7fcd94154620 2023-07-20T10:06:56.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd9259c640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 0x7fcd9415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:56.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd92d9d640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 0x7fcd940c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:56.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd89d9b640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c011e30 tx=0x7fcd7c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c00e040 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c00f040 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c009c00 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd940c24b0 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.053+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940c2a70 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94073c70 con 0x7fcd94154620 2023-07-20T10:06:56.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcd7c015850 con 0x7fcd94154620 2023-07-20T10:06:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd8b7fe640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 0x7fcd74068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd7c084d30 con 0x7fcd94154620 2023-07-20T10:06:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd9259c640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 0x7fcd74068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.057+0000 7fcd9259c640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 0x7fcd74068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd840ab000 tx=0x7fcd840a7070 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.061+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd7c051ef0 con 0x7fcd94154620 2023-07-20T10:06:56.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.229+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd940ad4d0 con 0x7fcd740663a0 2023-07-20T10:06:56.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.229+0000 7fcd8b7fe640 1 -- 172.21.15.82:0/296944853 <== mgr.7533 v2:172.21.15.82:6832/3784716253 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcd84001440 con 0x7fcd740663a0 2023-07-20T10:06:56.210 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:06:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:06:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:06:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:06:56.211 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:06:56.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 msgr2=0x7fcd74068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 0x7fcd74068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd840ab000 tx=0x7fcd840a7070 comp rx=0 tx=0).stop 2023-07-20T10:06:56.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 msgr2=0x7fcd94154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c011e30 tx=0x7fcd7c00f580 comp rx=0 tx=0).stop 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 shutdown_connections 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd940c3ec0 0x7fcd940c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd94154620 0x7fcd94154aa0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fcd740663a0 0x7fcd74068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 --2- 172.21.15.82:0/296944853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcd80005bc0 0x7fcd9415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 >> 172.21.15.82:0/296944853 conn(0x7fcd940cada0 msgr2=0x7fcd9406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:56.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 shutdown_connections 2023-07-20T10:06:56.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.233+0000 7fcd98c96640 1 -- 172.21.15.82:0/296944853 wait complete. 2023-07-20T10:06:56.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:06:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 Processor -- start 2023-07-20T10:06:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 -- start start 2023-07-20T10:06:56.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf4c06f710 0x7faf4c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 0x7faf4c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c070030 con 0x7faf4c15ec90 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c15bad0 con 0x7faf4c06f710 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf52434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c071950 con 0x7faf4c0ca5a0 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf4c06f710 0x7faf4c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf4c06f710 0x7faf4c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60592/0 (socket says 172.21.15.82:60592) 2023-07-20T10:06:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 -- 172.21.15.82:0/492721845 learned_addr learned my addr 172.21.15.82:0/492721845 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 0x7faf4c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 -- 172.21.15.82:0/492721845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 msgr2=0x7faf4c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 0x7faf4c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 -- 172.21.15.82:0/492721845 >> v1:172.21.15.183:6789/0 conn(0x7faf4c15ec90 legacy=0x7faf4c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4bfff640 1 -- 172.21.15.82:0/492721845 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c15b230 con 0x7faf4c06f710 2023-07-20T10:06:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.393+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 0x7faf4c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf4bfff640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c06faf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534e024e7fbc323d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf4affd640 1 -- 172.21.15.82:0/492721845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0aa5f0 con 0x7faf4c06f710 2023-07-20T10:06:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf4affd640 1 -- 172.21.15.82:0/492721845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0aa750 con 0x7faf4c06f710 2023-07-20T10:06:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf4affd640 1 -- 172.21.15.82:0/492721845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0aaae0 con 0x7faf4c06f710 2023-07-20T10:06:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 -- 172.21.15.82:0/492721845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 msgr2=0x7faf4c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c06faf0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 -- 172.21.15.82:0/492721845 shutdown_connections 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c0ca5a0 0x7faf4c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 --2- 172.21.15.82:0/492721845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c06faf0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 -- 172.21.15.82:0/492721845 >> 172.21.15.82:0/492721845 conn(0x7faf4c0cad50 msgr2=0x7faf4c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 -- 172.21.15.82:0/492721845 shutdown_connections 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.397+0000 7faf52434640 1 -- 172.21.15.82:0/492721845 wait complete. 2023-07-20T10:06:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 Processor -- start 2023-07-20T10:06:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- start start 2023-07-20T10:06:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 0x7faf4c0c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 0x7faf4c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c5e50 con 0x7faf4c06f710 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c68f0 con 0x7faf4c0ca5a0 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c7f90 con 0x7faf4c15ec90 2023-07-20T10:06:56.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60604/0 (socket says 172.21.15.82:60604) 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 -- 172.21.15.82:0/1906327678 learned_addr learned my addr 172.21.15.82:0/1906327678 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf509d1640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 0x7faf4c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 0x7faf4c0c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 -- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 msgr2=0x7faf4c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 0x7faf4c0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 -- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 msgr2=0x7faf4c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:56.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 0x7faf4c0c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:56.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 -- 172.21.15.82:0/1906327678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0094d0 con 0x7faf4c06f710 2023-07-20T10:06:56.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf509d1640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 0x7faf4c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:56.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 0x7faf4c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:06:56.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf4bfff640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0ac040 tx=0x7faf3c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0b3800 con 0x7faf4c06f710 2023-07-20T10:06:56.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0b3980 con 0x7faf4c06f710 2023-07-20T10:06:56.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c0c60f0 con 0x7faf4c06f710 2023-07-20T10:06:56.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0b3d30 con 0x7faf4c06f710 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c150970 con 0x7faf4c06f710 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.401+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c0b05a0 con 0x7faf4c06f710 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.405+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 47) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faf3c0c73a0 con 0x7faf4c06f710 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.405+0000 7faf48ff9640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 0x7faf38068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.405+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf3c0a7070 con 0x7faf4c06f710 2023-07-20T10:06:56.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.405+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 0x7faf38068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:56.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.405+0000 7faf4b7fe640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 0x7faf38068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf4c15d6f0 tx=0x7faf40008040 comp rx=0 tx=0).ready entity=mgr.7533 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:56.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.409+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf3c0ebc10 con 0x7faf4c06f710 2023-07-20T10:06:56.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:56.593+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7faf4c04da30 con 0x7faf4c06f710 2023-07-20T10:06:57.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.525+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7faf3c0ebfe0 con 0x7faf4c06f710 2023-07-20T10:06:57.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf48ff9640 1 -- 172.21.15.82:0/1906327678 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v48) v1 ==== 92+0+0 (secure 0 0 0) 0x7faf3c103890 con 0x7faf4c06f710 2023-07-20T10:06:57.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 msgr2=0x7faf38068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 0x7faf38068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf4c15d6f0 tx=0x7faf40008040 comp rx=0 tx=0).stop 2023-07-20T10:06:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 msgr2=0x7faf4c150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0ac040 tx=0x7faf3c01ad10 comp rx=0 tx=0).stop 2023-07-20T10:06:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 shutdown_connections 2023-07-20T10:06:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7faf380663a0 0x7faf38068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf4c15ec90 0x7faf4c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf4c0ca5a0 0x7faf4c0c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 --2- 172.21.15.82:0/1906327678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf4c06f710 0x7faf4c150430 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 >> 172.21.15.82:0/1906327678 conn(0x7faf4c0cad50 msgr2=0x7faf4c152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:57.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 shutdown_connections 2023-07-20T10:06:57.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.529+0000 7faf52434640 1 -- 172.21.15.82:0/1906327678 wait complete. 2023-07-20T10:06:57.533 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:06:57.674 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:57.699+0000 7fd94f197180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:57.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.701+0000 7f9ec5f8f640 1 Processor -- start 2023-07-20T10:06:57.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 -- start start 2023-07-20T10:06:57.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec015c6e0 0x7f9ec00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec00d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec00cdb40 con 0x7f9ec00d3200 2023-07-20T10:06:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00d07a0 con 0x7f9ec015c6e0 2023-07-20T10:06:57.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ec5f8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00cd4f0 con 0x7f9ec015cac0 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec015c6e0 0x7f9ec00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebeffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ec00d3200 0x7f9ec00cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39368/0 (socket says 172.21.15.82:39368) 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9ec015c6e0 0x7f9ec00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60634/0 (socket says 172.21.15.82:60634) 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebeffd640 1 -- 172.21.15.82:0/2903093683 learned_addr learned my addr 172.21.15.82:0/2903093683 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebffff640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec00d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:57.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/2903093683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 msgr2=0x7f9ec00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:57.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec00d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/2903093683 >> v1:172.21.15.82:6789/0 conn(0x7f9ec00d3200 legacy=0x7f9ec00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/2903093683 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341058403 0 0) 0x7f9ec00cdb40 con 0x7f9ec00d3200 2023-07-20T10:06:57.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.705+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/2903093683 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00cd7d0 con 0x7f9ec015c6e0 2023-07-20T10:06:57.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec00cf640 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00097c0 tx=0x7f9eb001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77737be29fca03b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:57.688 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f06064fd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:06:57.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/2903093683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00ab600 con 0x7f9ec015c6e0 2023-07-20T10:06:57.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/2903093683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00a7050 con 0x7f9ec015c6e0 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ebe7fc640 1 -- 172.21.15.82:0/2903093683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00ab980 con 0x7f9ec015c6e0 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/2903093683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 msgr2=0x7f9ec00cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec00cf640 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00097c0 tx=0x7f9eb001c360 comp rx=0 tx=0).stop 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/2903093683 shutdown_connections 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec00d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/2903093683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec00cf640 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/2903093683 >> 172.21.15.82:0/2903093683 conn(0x7f9ec00d2600 msgr2=0x7f9ec00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:57.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/2903093683 shutdown_connections 2023-07-20T10:06:57.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/2903093683 wait complete. 2023-07-20T10:06:57.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.709+0000 7f9ec5f8f640 1 Processor -- start 2023-07-20T10:06:57.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- start start 2023-07-20T10:06:57.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec00d3200 0x7f9ec00b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0158eb0 con 0x7f9ec015c6e0 2023-07-20T10:06:57.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01560b0 con 0x7f9ec00d3200 2023-07-20T10:06:57.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00b5fe0 con 0x7f9ec015cac0 2023-07-20T10:06:57.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:57.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60646/0 (socket says 172.21.15.82:60646) 2023-07-20T10:06:57.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 -- 172.21.15.82:0/3566407880 learned_addr learned my addr 172.21.15.82:0/3566407880 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec00d3200 0x7f9ec00b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebffff640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 -- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 msgr2=0x7f9ec01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec01555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 -- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec00d3200 msgr2=0x7f9ec00b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec00d3200 0x7f9ec00b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 -- 172.21.15.82:0/3566407880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0009420 con 0x7f9ec015c6e0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ebeffd640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8002240 tx=0x7f9ea800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800cea0 con 0x7f9ec015c6e0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea800a640 con 0x7f9ec015c6e0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea800a9f0 con 0x7f9ec015c6e0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec0158580 con 0x7f9ec015c6e0 2023-07-20T10:06:57.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec0158b40 con 0x7f9ec015c6e0 2023-07-20T10:06:57.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.713+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0159020 con 0x7f9ec015c6e0 2023-07-20T10:06:57.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.717+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f9ea800ab50 con 0x7f9ec015c6e0 2023-07-20T10:06:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.717+0000 7f9eb7fff640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 0x7f9ea40688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.717+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ea8083310 con 0x7f9ec015c6e0 2023-07-20T10:06:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.717+0000 7f9ebf7fe640 1 -- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 msgr2=0x7f9ea40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:57.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.717+0000 7f9ebf7fe640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 0x7f9ea40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:57.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.721+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ea8050730 con 0x7f9ec015c6e0 2023-07-20T10:06:57.806 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:06:57.810 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:06:57.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.873+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f9ec004da30 con 0x7f9ec015c6e0 2023-07-20T10:06:57.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.877+0000 7f9eb7fff640 1 -- 172.21.15.82:0/3566407880 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9ea8053d50 con 0x7f9ec015c6e0 2023-07-20T10:06:57.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 msgr2=0x7f9ea40688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:57.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 0x7f9ea40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 msgr2=0x7f9ec014fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:57.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8002240 tx=0x7f9ea800cc50 comp rx=0 tx=0).stop 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 shutdown_connections 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f9ea40663f0 0x7f9ea40688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ec015cac0 0x7f9ec01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ec015c6e0 0x7f9ec014fcf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 --2- 172.21.15.82:0/3566407880 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ec00d3200 0x7f9ec00b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:57.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 >> 172.21.15.82:0/3566407880 conn(0x7f9ec00d2600 msgr2=0x7f9ec00b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 shutdown_connections 2023-07-20T10:06:57.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:57.881+0000 7f9ec5f8f640 1 -- 172.21.15.82:0/3566407880 wait complete. 2023-07-20T10:06:57.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:06:58.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.085+0000 7f65ab59e640 1 Processor -- start 2023-07-20T10:06:58.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.085+0000 7f65ab59e640 1 -- start start 2023-07-20T10:06:58.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65ab59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65ab59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f65ac0cf9f0 0x7f65ac0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65ab59e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65ac0d1040 con 0x7f65ac0d20e0 2023-07-20T10:06:58.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65ab59e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac15cc50 con 0x7f65ac15c870 2023-07-20T10:06:58.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65ab59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ac0d1320 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aa59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65a3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f65ac0d20e0 0x7f65ac0cf2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39384/0 (socket says 172.21.15.82:39384) 2023-07-20T10:06:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aa59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60656/0 (socket says 172.21.15.82:60656) 2023-07-20T10:06:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65a3fff640 1 -- 172.21.15.82:0/2421980110 learned_addr learned my addr 172.21.15.82:0/2421980110 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:06:58.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aad9d640 1 --2- 172.21.15.82:0/2421980110 >> v2:172.21.15.183:3300/0 conn(0x7f65ac0cf9f0 0x7f65ac0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65a9d9b640 1 -- 172.21.15.82:0/2421980110 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360067536 0 0) 0x7f65ac0d1040 con 0x7f65ac0d20e0 2023-07-20T10:06:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65a9d9b640 1 -- 172.21.15.82:0/2421980110 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6598003530 con 0x7f65ac0d20e0 2023-07-20T10:06:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aad9d640 1 -- 172.21.15.82:0/2421980110 >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 msgr2=0x7f65ac0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aad9d640 1 --2- 172.21.15.82:0/2421980110 >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aad9d640 1 -- 172.21.15.82:0/2421980110 >> v1:172.21.15.82:6789/0 conn(0x7f65ac0d20e0 legacy=0x7f65ac0cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aad9d640 1 -- 172.21.15.82:0/2421980110 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ac0d1600 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.089+0000 7f65aa59c640 1 --2- 172.21.15.82:0/2421980110 >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:58.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65aad9d640 1 --2- 172.21.15.82:0/2421980110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0b5610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0ccef0 tx=0x7f65a401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c35f83185c6e8d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65a9d9b640 1 -- 172.21.15.82:0/2421980110 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40a59a0 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65a9d9b640 1 -- 172.21.15.82:0/2421980110 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a40a5b00 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65a9d9b640 1 -- 172.21.15.82:0/2421980110 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a40a5e90 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- 172.21.15.82:0/2421980110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 msgr2=0x7f65ac0b5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 --2- 172.21.15.82:0/2421980110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0b5610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0ccef0 tx=0x7f65a401c8e0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- 172.21.15.82:0/2421980110 shutdown_connections 2023-07-20T10:06:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 --2- 172.21.15.82:0/2421980110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0b5610 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 --2- 172.21.15.82:0/2421980110 >> v2:172.21.15.82:3300/0 conn(0x7f65ac15c870 0x7f65ac0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- 172.21.15.82:0/2421980110 >> 172.21.15.82:0/2421980110 conn(0x7f65ac0654e0 msgr2=0x7f65ac0658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:58.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- 172.21.15.82:0/2421980110 shutdown_connections 2023-07-20T10:06:58.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- 172.21.15.82:0/2421980110 wait complete. 2023-07-20T10:06:58.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 Processor -- start 2023-07-20T10:06:58.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.093+0000 7f65ab59e640 1 -- start start 2023-07-20T10:06:58.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65ac0d20e0 0x7f65ac14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac15abd0 con 0x7f65ac15c870 2023-07-20T10:06:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac0ca000 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ac14ba90 con 0x7f65ac0d20e0 2023-07-20T10:06:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60664/0 (socket says 172.21.15.82:60664) 2023-07-20T10:06:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aad9d640 1 -- 172.21.15.82:0/1788596366 learned_addr learned my addr 172.21.15.82:0/1788596366 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65a3fff640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65ac0d20e0 0x7f65ac14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 -- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65ac0d20e0 msgr2=0x7f65ac14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65ac0d20e0 0x7f65ac14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 -- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 msgr2=0x7f65ac15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 -- 172.21.15.82:0/1788596366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009420 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aad9d640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:06:58.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65aa59c640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0c9ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e910 tx=0x7f659c00edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:58.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00c9a0 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c00cb00 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a4009a70 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00ceb0 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ac15a510 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ac153790 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.097+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f659c013470 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.101+0000 7f65a2ffd640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 0x7f658c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.101+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f659c083f40 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.101+0000 7f65a3fff640 1 -- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 msgr2=0x7f658c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:58.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.101+0000 7f65a3fff640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 0x7f658c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:58.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.105+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f659c0513f0 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.097 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.118+0000 7fd94f197180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:58.120 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.141+0000 7f06064fd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:06:58.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.261+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f65ac15a370 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65a2ffd640 1 -- 172.21.15.82:0/1788596366 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f65ac15a370 con 0x7f65ac0cf9f0 2023-07-20T10:06:58.249 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.270+0000 7fd94f197180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 msgr2=0x7f658c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:06:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 0x7f658c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 msgr2=0x7f65ac0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0c9ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e910 tx=0x7f659c00edd0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 shutdown_connections 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ac15c870 0x7f65ac15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7f658c0663f0 0x7f658c0688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65ac0d20e0 0x7f65ac14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 --2- 172.21.15.82:0/1788596366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65ac0cf9f0 0x7f65ac0c9ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 >> 172.21.15.82:0/1788596366 conn(0x7f65ac0654e0 msgr2=0x7f65ac0658c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 shutdown_connections 2023-07-20T10:06:58.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.269+0000 7f65ab59e640 1 -- 172.21.15.82:0/1788596366 wait complete. 2023-07-20T10:06:58.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-07-20T10:06:58.275 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.293+0000 7f06064fd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:06:58.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.433+0000 7fdbd0537640 1 Processor -- start 2023-07-20T10:06:58.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 -- start start 2023-07-20T10:06:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc81602b0 0x7fdbc8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbc806ab10 0x7fdbc806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80ce4f0 con 0x7fdbc806c120 2023-07-20T10:06:58.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc806b4c0 con 0x7fdbc806ab10 2023-07-20T10:06:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbd0537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80d0970 con 0x7fdbc81602b0 2023-07-20T10:06:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbc806ab10 0x7fdbc806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdbc806ab10 0x7fdbc806af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60676/0 (socket says 172.21.15.82:60676) 2023-07-20T10:06:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 -- 172.21.15.82:0/2470776917 learned_addr learned my addr 172.21.15.82:0/2470776917 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:58.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcdad2640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc81602b0 0x7fdbc8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 -- 172.21.15.82:0/2470776917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc81602b0 msgr2=0x7fdbc8160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:06:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc81602b0 0x7fdbc8160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 -- 172.21.15.82:0/2470776917 >> v1:172.21.15.183:6789/0 conn(0x7fdbc806c120 legacy=0x7fdbc80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcead4640 1 -- 172.21.15.82:0/2470776917 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8160e20 con 0x7fdbc806ab10 2023-07-20T10:06:58.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.437+0000 7fdbcd2d1640 1 -- 172.21.15.82:0/2470776917 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509345845 0 0) 0x7fdbc80ce4f0 con 0x7fdbc806c120 2023-07-20T10:06:58.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbcead4640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806ab10 0x7fdbc806af80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009e50 tx=0x7fdbc001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2e4965aaf2e49e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:58.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbcd2d1640 1 -- 172.21.15.82:0/2470776917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a5730 con 0x7fdbc806ab10 2023-07-20T10:06:58.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbcd2d1640 1 -- 172.21.15.82:0/2470776917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc00a5890 con 0x7fdbc806ab10 2023-07-20T10:06:58.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbcd2d1640 1 -- 172.21.15.82:0/2470776917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a5c20 con 0x7fdbc806ab10 2023-07-20T10:06:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 -- 172.21.15.82:0/2470776917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806ab10 msgr2=0x7fdbc806af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806ab10 0x7fdbc806af80 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009e50 tx=0x7fdbc001c980 comp rx=0 tx=0).stop 2023-07-20T10:06:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 -- 172.21.15.82:0/2470776917 shutdown_connections 2023-07-20T10:06:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806ab10 0x7fdbc806af80 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 --2- 172.21.15.82:0/2470776917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc81602b0 0x7fdbc8160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 -- 172.21.15.82:0/2470776917 >> 172.21.15.82:0/2470776917 conn(0x7fdbc808c0a0 msgr2=0x7fdbc809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:06:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 -- 172.21.15.82:0/2470776917 shutdown_connections 2023-07-20T10:06:58.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.441+0000 7fdbd0537640 1 -- 172.21.15.82:0/2470776917 wait complete. 2023-07-20T10:06:58.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 Processor -- start 2023-07-20T10:06:58.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 -- start start 2023-07-20T10:06:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc806ab10 0x7fdbc80c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 0x7fdbc80b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbc81602b0 0x7fdbc80b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c7000 con 0x7fdbc806c120 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c6760 con 0x7fdbc81602b0 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbd0537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80c6a40 con 0x7fdbc806ab10 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 0x7fdbc80b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbce2d3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc806ab10 0x7fdbc80c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 0x7fdbc80b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60686/0 (socket says 172.21.15.82:60686) 2023-07-20T10:06:58.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 -- 172.21.15.82:0/1998502456 learned_addr learned my addr 172.21.15.82:0/1998502456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcead4640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbc81602b0 0x7fdbc80b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc806ab10 msgr2=0x7fdbc80c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdbc806ab10 0x7fdbc80c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbc81602b0 msgr2=0x7fdbc80b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbc81602b0 0x7fdbc80b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:06:58.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.445+0000 7fdbcdad2640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009b30 con 0x7fdbc806c120 2023-07-20T10:06:58.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbcdad2640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 0x7fdbc80b5d80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800e870 tx=0x7fdbb800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:06:58.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8009510 con 0x7fdbc806c120 2023-07-20T10:06:58.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb800eec0 con 0x7fdbc806c120 2023-07-20T10:06:58.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800cb40 con 0x7fdbc806c120 2023-07-20T10:06:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc80c6d20 con 0x7fdbc806c120 2023-07-20T10:06:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80cc400 con 0x7fdbc806c120 2023-07-20T10:06:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc804da30 con 0x7fdbc806c120 2023-07-20T10:06:58.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 48) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fdbb800cca0 con 0x7fdbc806c120 2023-07-20T10:06:58.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:06:58.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbb8083fc0 con 0x7fdbc806c120 2023-07-20T10:06:58.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbce2d3640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 msgr2=0x7fdbac0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:58.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.449+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:06:58.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.453+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbb80513d0 con 0x7fdbc806c120 2023-07-20T10:06:58.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.625+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbc8161100 con 0x7fdbac0663f0 2023-07-20T10:06:58.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.653+0000 7fdbce2d3640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 msgr2=0x7fdbac0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:58.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:58.653+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:06:58.734 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.758+0000 7fd94f197180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:58.767 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.785+0000 7f06064fd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:58.792 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.814+0000 7fd94f197180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:58.825 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.845+0000 7f06064fd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:06:58.848 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.870+0000 7fd94f197180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:58.881 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.901+0000 7f06064fd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:06:58.933 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:58.954+0000 7fd94f197180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:58.965 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:58.985+0000 7f06064fd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:06:58.991 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.014+0000 7fd94f197180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:59.023 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.041+0000 7f06064fd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:06:59.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:59.057+0000 7fdbce2d3640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 msgr2=0x7fdbac0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:59.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:59.057+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:06:59.076 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.098+0000 7fd94f197180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:59.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.129+0000 7f06064fd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:06:59.133 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.154+0000 7fd94f197180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:59.164 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.185+0000 7f06064fd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:06:59.275 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.298+0000 7fd94f197180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:59.305 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.325+0000 7f06064fd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:06:59.333 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.354+0000 7fd94f197180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:59.364 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.385+0000 7f06064fd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:06:59.576 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:59.576 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:59.576 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:59.584 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.606+0000 7fd94f197180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:59.605 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:06:59.605 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:06:59.605 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:06:59.613 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.633+0000 7f06064fd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:06:59.717 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.742+0000 7fd94f197180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:59.746 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.765+0000 7f06064fd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:06:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:59.861+0000 7fdbce2d3640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 msgr2=0x7fdbac0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3784716253 2023-07-20T10:06:59.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:06:59.861+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:06:59.842 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.866+0000 7fd94f197180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:59.871 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.889+0000 7f06064fd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:06:59.912 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:06:59.934+0000 7fd94f197180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:06:59.941 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:06:59.961+0000 7f06064fd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:07:00.049 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:00.070+0000 7fd94f197180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:07:00.075 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:00.093+0000 7f06064fd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:07:00.592 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:00.614+0000 7fd94f197180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:07:00.617 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:00.637+0000 7f06064fd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:07:00.676 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:00.698+0000 7fd94f197180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:07:00.701 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:00.721+0000 7f06064fd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:07:00.824 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:00.846+0000 7fd94f197180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:07:00.848 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:00.869+0000 7f06064fd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:07:00.907 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:00.930+0000 7fd94f197180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:07:00.932 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:00.953+0000 7f06064fd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:07:01.180 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:01.202+0000 7fd94f197180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:07:01.201 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.221+0000 7f06064fd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:07:01.241 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:07:01.262+0000 7fd94f197180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:07:01.262 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.281+0000 7f06064fd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:07:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:01.293+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 49) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fdbb80517a0 con 0x7fdbc806c120 2023-07-20T10:07:01.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:01.293+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 msgr2=0x7fdbac0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:07:01.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:01.293+0000 7fdbbeffd640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3784716253,v1:172.21.15.82:6833/3784716253] conn(0x7fdbac0663f0 0x7fdbac0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:01.388 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058952b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058952b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058952b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058952b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058952b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.389 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058c531640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.390 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058c531640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.390 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058c531640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.390 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058c531640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:01.390 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:07:01.409+0000 7f058c531640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:07:02.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.297+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 50) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fdbb8081fb0 con 0x7fdbc806c120 2023-07-20T10:07:02.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.297+0000 7fdbbeffd640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fdbac033920 0x7fdbac033d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.297+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 --> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbac034240 con 0x7fdbac033920 2023-07-20T10:07:02.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.301+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fdbac033920 0x7fdbac033d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.301+0000 7fdbce2d3640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fdbac033920 0x7fdbac033d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000f70 tx=0x7fdbc4007d40 comp rx=0 tx=0).ready entity=mgr.8010 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:07:02.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.369+0000 7fdbbeffd640 1 -- 172.21.15.82:0/1998502456 <== mgr.8010 v2:172.21.15.82:6832/3916730360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fdbac034240 con 0x7fdbac033920 2023-07-20T10:07:02.351 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /bad-path 2023-07-20T10:07:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fdbac033920 msgr2=0x7fdbac033d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fdbac033920 0x7fdbac033d00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000f70 tx=0x7fdbc4007d40 comp rx=0 tx=0).stop 2023-07-20T10:07:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 msgr2=0x7fdbc80b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 --2- 172.21.15.82:0/1998502456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbc806c120 0x7fdbc80b5d80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800e870 tx=0x7fdbb800ec70 comp rx=0 tx=0).stop 2023-07-20T10:07:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbcead4640 1 -- 172.21.15.82:0/1998502456 reap_dead start 2023-07-20T10:07:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 shutdown_connections 2023-07-20T10:07:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 >> 172.21.15.82:0/1998502456 conn(0x7fdbc808c0a0 msgr2=0x7fdbc80b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:07:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 shutdown_connections 2023-07-20T10:07:02.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.373+0000 7fdbd0537640 1 -- 172.21.15.82:0/1998502456 wait complete. 2023-07-20T10:07:02.374 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-07-20T10:07:02.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-20T10:07:02.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 Processor -- start 2023-07-20T10:07:02.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 -- start start 2023-07-20T10:07:02.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3ac40ca5a0 0x7f3ac415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 0x7f3ac415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac4071950 con 0x7f3ac406f710 2023-07-20T10:07:02.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac415bad0 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.581+0000 7f3acc737640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac415b230 con 0x7f3ac415ec90 2023-07-20T10:07:02.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3aca4d3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3ac406f710 0x7f3ac406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39388/0 (socket says 172.21.15.82:39388) 2023-07-20T10:07:02.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3aca4d3640 1 -- 172.21.15.82:0/3574891087 learned_addr learned my addr 172.21.15.82:0/3574891087 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:07:02.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/3574891087 >> v2:172.21.15.82:3300/0 conn(0x7f3ac40ca5a0 0x7f3ac415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3acacd4640 1 --2- 172.21.15.82:0/3574891087 >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 0x7f3ac415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 -- 172.21.15.82:0/3574891087 >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 msgr2=0x7f3ac415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:07:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/3574891087 >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 0x7f3ac415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 -- 172.21.15.82:0/3574891087 >> v1:172.21.15.82:6789/0 conn(0x7f3ac406f710 legacy=0x7f3ac406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 -- 172.21.15.82:0/3574891087 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac415b510 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3acacd4640 1 --2- 172.21.15.82:0/3574891087 >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 0x7f3ac415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:07:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac94d1640 1 -- 172.21.15.82:0/3574891087 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282270948 0 0) 0x7f3ac4071950 con 0x7f3ac406f710 2023-07-20T10:07:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/3574891087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac415e750 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097c0 tx=0x7f3ab401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ac52c23c2bd9d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:07:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac94d1640 1 -- 172.21.15.82:0/3574891087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40ab600 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac94d1640 1 -- 172.21.15.82:0/3574891087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab40a7050 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.585+0000 7f3ac94d1640 1 -- 172.21.15.82:0/3574891087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40ab980 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- 172.21.15.82:0/3574891087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40ca5a0 msgr2=0x7f3ac415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- 172.21.15.82:0/3574891087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac415e750 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40097c0 tx=0x7f3ab401c410 comp rx=0 tx=0).stop 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- 172.21.15.82:0/3574891087 shutdown_connections 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- 172.21.15.82:0/3574891087 >> v2:172.21.15.183:3300/0 conn(0x7f3ac415ec90 0x7f3ac415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- 172.21.15.82:0/3574891087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac415e750 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- 172.21.15.82:0/3574891087 >> 172.21.15.82:0/3574891087 conn(0x7f3ac40cad50 msgr2=0x7f3ac40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:07:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- 172.21.15.82:0/3574891087 shutdown_connections 2023-07-20T10:07:02.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- 172.21.15.82:0/3574891087 wait complete. 2023-07-20T10:07:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 Processor -- start 2023-07-20T10:07:02.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- start start 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac40c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ac415ec90 0x7f3ac41564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac40afed0 con 0x7f3ac406f710 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac4151210 con 0x7f3ac40ca5a0 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acc737640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac41514f0 con 0x7f3ac415ec90 2023-07-20T10:07:02.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60852/0 (socket says 172.21.15.82:60852) 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 -- 172.21.15.82:0/1202472707 learned_addr learned my addr 172.21.15.82:0/1202472707 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3acacd4640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ac415ec90 0x7f3ac41564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac40c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 -- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ac415ec90 msgr2=0x7f3ac41564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ac415ec90 0x7f3ac41564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 -- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ac40ca5a0 msgr2=0x7f3ac40c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac40c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.589+0000 7f3aca4d3640 1 -- 172.21.15.82:0/1202472707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009420 con 0x7f3ac406f710 2023-07-20T10:07:02.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3aca4d3640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000c480 tx=0x7f3ac000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:07:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac00074e0 con 0x7f3ac406f710 2023-07-20T10:07:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac0007660 con 0x7f3ac406f710 2023-07-20T10:07:02.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0004a30 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac41517d0 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac4151d90 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac404da30 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 50) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f3ac0004b90 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.593+0000 7f3abaffd640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 0x7f3aa80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.597+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3ac0082d30 con 0x7f3ac406f710 2023-07-20T10:07:02.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.597+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 0x7f3aa80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:07:02.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.597+0000 7f3ac9cd2640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 0x7f3aa80685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40ad000 tx=0x7f3ab40a6000 comp rx=0 tx=0).ready entity=mgr.8010 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:07:02.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.601+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ac0053e20 con 0x7f3ac406f710 2023-07-20T10:07:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.765+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 --> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ac40cb940 con 0x7f3aa8066120 2023-07-20T10:07:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.773+0000 7f3abaffd640 1 -- 172.21.15.82:0/1202472707 <== mgr.8010 v2:172.21.15.82:6832/3916730360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f3ac40cb940 con 0x7f3aa8066120 2023-07-20T10:07:02.754 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:07:02.754 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:07:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 msgr2=0x7f3aa80685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 0x7f3aa80685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3ab40ad000 tx=0x7f3ab40a6000 comp rx=0 tx=0).stop 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 msgr2=0x7f3ac4150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000c480 tx=0x7f3ac000c940 comp rx=0 tx=0).stop 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 shutdown_connections 2023-07-20T10:07:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f3aa8066120 0x7f3aa80685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ac415ec90 0x7f3ac41564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ac40ca5a0 0x7f3ac40c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 --2- 172.21.15.82:0/1202472707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ac406f710 0x7f3ac4150b80 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 >> 172.21.15.82:0/1202472707 conn(0x7f3ac40cad50 msgr2=0x7f3ac415d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 shutdown_connections 2023-07-20T10:07:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:07:02.777+0000 7f3acc737640 1 -- 172.21.15.82:0/1202472707 wait complete. 2023-07-20T10:07:02.775 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:07:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-20T10:07:27.866 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:07:27.870 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:07:57.929 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:07:57.934 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:08:00.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:00.387+0000 7f057bd10640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:00.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:00.387+0000 7f057bd10640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:00.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:00.387+0000 7f057bd10640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:00.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:00.387+0000 7f057bd10640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:00.362 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:00.387+0000 7f057bd10640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:02.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-20T10:08:02.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.951+0000 7fb455bfa640 1 Processor -- start 2023-07-20T10:08:02.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.951+0000 7fb455bfa640 1 -- start start 2023-07-20T10:08:02.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb455bfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4500ca5a0 0x7fb45015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb455bfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb450071950 con 0x7fb45006f710 2023-07-20T10:08:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb455bfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45015b230 con 0x7fb45015ec90 2023-07-20T10:08:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb455bfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45015bad0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4500ca5a0 0x7fb45015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:02.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4500ca5a0 0x7fb45015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34568/0 (socket says 172.21.15.82:34568) 2023-07-20T10:08:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 -- 172.21.15.82:0/362531305 learned_addr learned my addr 172.21.15.82:0/362531305 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 -- 172.21.15.82:0/362531305 >> v1:172.21.15.183:6789/0 conn(0x7fb45015ec90 legacy=0x7fb45015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 -- 172.21.15.82:0/362531305 >> v1:172.21.15.82:6789/0 conn(0x7fb45006f710 legacy=0x7fb45006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb446ffd640 1 -- 172.21.15.82:0/362531305 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45015b510 con 0x7fb4500ca5a0 2023-07-20T10:08:02.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.955+0000 7fb44effd640 1 -- 172.21.15.82:0/362531305 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189986593 0 0) 0x7fb450071950 con 0x7fb45006f710 2023-07-20T10:08:02.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb446ffd640 1 --2- 172.21.15.82:0/362531305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb45015e750 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb4380098a0 tx=0x7fb43801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32721f3afaf8ef19 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:02.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb44effd640 1 -- 172.21.15.82:0/362531305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380ab600 con 0x7fb4500ca5a0 2023-07-20T10:08:02.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb44effd640 1 -- 172.21.15.82:0/362531305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380ab760 con 0x7fb4500ca5a0 2023-07-20T10:08:02.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb44effd640 1 -- 172.21.15.82:0/362531305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380abaf0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- 172.21.15.82:0/362531305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 msgr2=0x7fb45015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 --2- 172.21.15.82:0/362531305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb45015e750 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fb4380098a0 tx=0x7fb43801c4f0 comp rx=0 tx=0).stop 2023-07-20T10:08:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- 172.21.15.82:0/362531305 shutdown_connections 2023-07-20T10:08:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 --2- 172.21.15.82:0/362531305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb45015e750 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:02.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- 172.21.15.82:0/362531305 >> 172.21.15.82:0/362531305 conn(0x7fb4500cad50 msgr2=0x7fb4500cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- 172.21.15.82:0/362531305 shutdown_connections 2023-07-20T10:08:02.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- 172.21.15.82:0/362531305 wait complete. 2023-07-20T10:08:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 Processor -- start 2023-07-20T10:08:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.959+0000 7fb455bfa640 1 -- start start 2023-07-20T10:08:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb45006f710 0x7fb4500c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:02.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb45015ec90 0x7fb4501534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500ade60 con 0x7fb4500ca5a0 2023-07-20T10:08:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450154d90 con 0x7fb45015ec90 2023-07-20T10:08:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb450155070 con 0x7fb45006f710 2023-07-20T10:08:02.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34582/0 (socket says 172.21.15.82:34582) 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 -- 172.21.15.82:0/2022578170 learned_addr learned my addr 172.21.15.82:0/2022578170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44f7fe640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb45006f710 0x7fb4500c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44ffff640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb45015ec90 0x7fb4501534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 -- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb45006f710 msgr2=0x7fb4500c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:02.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb45006f710 0x7fb4500c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 -- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb45015ec90 msgr2=0x7fb4501534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb45015ec90 0x7fb4501534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 -- 172.21.15.82:0/2022578170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4380094d0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb446ffd640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ad040 tx=0x7fb43801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b4800 con 0x7fb4500ca5a0 2023-07-20T10:08:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4380b49a0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4380b4d50 con 0x7fb4500ca5a0 2023-07-20T10:08:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450154aa0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500c62b0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4500c6440 con 0x7fb4500ca5a0 2023-07-20T10:08:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.963+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fb4380b3380 con 0x7fb4500ca5a0 2023-07-20T10:08:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.967+0000 7fb44cff9640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 0x7fb4300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.967+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fb43811ead0 con 0x7fb4500ca5a0 2023-07-20T10:08:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.967+0000 7fb44f7fe640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 0x7fb4300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.967+0000 7fb44f7fe640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 0x7fb4300689d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4400012f0 tx=0x7fb440009040 comp rx=0 tx=0).ready entity=mgr.8010 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:02.971+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4380eba50 con 0x7fb4500ca5a0 2023-07-20T10:08:03.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.139+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 --> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb450168440 con 0x7fb430066510 2023-07-20T10:08:03.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.151+0000 7fb44cff9640 1 -- 172.21.15.82:0/2022578170 <== mgr.8010 v2:172.21.15.82:6832/3916730360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fb440001ba0 con 0x7fb430066510 2023-07-20T10:08:03.129 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:03.129 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:07:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 msgr2=0x7fb4300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 0x7fb4300689d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb4400012f0 tx=0x7fb440009040 comp rx=0 tx=0).stop 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 msgr2=0x7fb4500c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fb4380ad040 tx=0x7fb43801ad30 comp rx=0 tx=0).stop 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 shutdown_connections 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fb430066510 0x7fb4300689d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb45015ec90 0x7fb4501534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4500ca5a0 0x7fb4500c7d60 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 --2- 172.21.15.82:0/2022578170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb45006f710 0x7fb4500c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 >> 172.21.15.82:0/2022578170 conn(0x7fb4500cad50 msgr2=0x7fb45006faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 shutdown_connections 2023-07-20T10:08:03.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.155+0000 7fb455bfa640 1 -- 172.21.15.82:0/2022578170 wait complete. 2023-07-20T10:08:03.149 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:07:02", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-20T10:08:03.150 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-07-20T10:08:03.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 Processor -- start 2023-07-20T10:08:03.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 -- start start 2023-07-20T10:08:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f60070450 0x7f1f600c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f60159670 con 0x7f1f60159290 2023-07-20T10:08:03.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6015d1f0 con 0x7f1f600c9da0 2023-07-20T10:08:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f661b6640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600ca250 con 0x7f1f60070450 2023-07-20T10:08:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f649b3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1f60070450 0x7f1f600c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f651b4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1f60159290 0x7f1f600cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44802/0 (socket says 172.21.15.82:44802) 2023-07-20T10:08:03.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f651b4640 1 -- 172.21.15.82:0/2269173548 learned_addr learned my addr 172.21.15.82:0/2269173548 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f649b3640 1 -- 172.21.15.82:0/2269173548 >> v1:172.21.15.183:6789/0 conn(0x7f1f600c9da0 legacy=0x7f1f6006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f649b3640 1 -- 172.21.15.82:0/2269173548 >> v1:172.21.15.82:6789/0 conn(0x7f1f60159290 legacy=0x7f1f600cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.319+0000 7f1f649b3640 1 -- 172.21.15.82:0/2269173548 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6015d4d0 con 0x7f1f60070450 2023-07-20T10:08:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f649b3640 1 --2- 172.21.15.82:0/2269173548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f60070450 0x7f1f600c9860 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1f500097c0 tx=0x7f1f5001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2461dff519e5c470 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f57fff640 1 -- 172.21.15.82:0/2269173548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500ab600 con 0x7f1f60070450 2023-07-20T10:08:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f57fff640 1 -- 172.21.15.82:0/2269173548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f500a7050 con 0x7f1f60070450 2023-07-20T10:08:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f57fff640 1 -- 172.21.15.82:0/2269173548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500ab980 con 0x7f1f60070450 2023-07-20T10:08:03.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 -- 172.21.15.82:0/2269173548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f60070450 msgr2=0x7f1f600c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 --2- 172.21.15.82:0/2269173548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f60070450 0x7f1f600c9860 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1f500097c0 tx=0x7f1f5001c2f0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 -- 172.21.15.82:0/2269173548 shutdown_connections 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 --2- 172.21.15.82:0/2269173548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f60070450 0x7f1f600c9860 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 -- 172.21.15.82:0/2269173548 >> 172.21.15.82:0/2269173548 conn(0x7f1f600ce080 msgr2=0x7f1f600ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 -- 172.21.15.82:0/2269173548 shutdown_connections 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.323+0000 7f1f661b6640 1 -- 172.21.15.82:0/2269173548 wait complete. 2023-07-20T10:08:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 Processor -- start 2023-07-20T10:08:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- start start 2023-07-20T10:08:03.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f60070450 0x7f1f600b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f60159290 0x7f1f60158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600b3ec0 con 0x7f1f600c9da0 2023-07-20T10:08:03.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600b1270 con 0x7f1f60159290 2023-07-20T10:08:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600b3690 con 0x7f1f60070450 2023-07-20T10:08:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40642/0 (socket says 172.21.15.82:40642) 2023-07-20T10:08:03.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 -- 172.21.15.82:0/386819676 learned_addr learned my addr 172.21.15.82:0/386819676 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 -- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f60070450 msgr2=0x7f1f600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f60070450 0x7f1f600b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 -- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f60159290 msgr2=0x7f1f60158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f60159290 0x7f1f60158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 -- 172.21.15.82:0/386819676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50009420 con 0x7f1f600c9da0 2023-07-20T10:08:03.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f649b3640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1f50018f00 tx=0x7f1f50019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500b4840 con 0x7f1f600c9da0 2023-07-20T10:08:03.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f500b49c0 con 0x7f1f600c9da0 2023-07-20T10:08:03.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500b4d70 con 0x7f1f600c9da0 2023-07-20T10:08:03.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f600b3900 con 0x7f1f600c9da0 2023-07-20T10:08:03.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f60159a30 con 0x7f1f600c9da0 2023-07-20T10:08:03.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.327+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f60159890 con 0x7f1f600c9da0 2023-07-20T10:08:03.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.331+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f1f500b2040 con 0x7f1f600c9da0 2023-07-20T10:08:03.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.331+0000 7f1f55ffb640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 0x7f1f440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.331+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1f5011e740 con 0x7f1f600c9da0 2023-07-20T10:08:03.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.331+0000 7f1f651b4640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 0x7f1f440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.331+0000 7f1f651b4640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 0x7f1f440689d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c001fe0 tx=0x7f1f5c0015d0 comp rx=0 tx=0).ready entity=mgr.8010 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.335+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f60159890 con 0x7f1f600c9da0 2023-07-20T10:08:03.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.503+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 --> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f60070890 con 0x7f1f44066510 2023-07-20T10:08:03.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.571+0000 7f1f55ffb640 1 -- 172.21.15.82:0/386819676 <== mgr.8010 v2:172.21.15.82:6832/3916730360 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f1f5c0020d0 con 0x7f1f44066510 2023-07-20T10:08:03.549 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /bad-path 2023-07-20T10:08:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 msgr2=0x7f1f440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 0x7f1f440689d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c001fe0 tx=0x7f1f5c0015d0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 msgr2=0x7f1f600b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1f50018f00 tx=0x7f1f50019090 comp rx=0 tx=0).stop 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 shutdown_connections 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f1f44066510 0x7f1f440689d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1f60159290 0x7f1f60158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f600c9da0 0x7f1f600b3150 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 --2- 172.21.15.82:0/386819676 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1f60070450 0x7f1f600b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 >> 172.21.15.82:0/386819676 conn(0x7f1f600ce080 msgr2=0x7f1f600cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:03.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 shutdown_connections 2023-07-20T10:08:03.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.575+0000 7f1f661b6640 1 -- 172.21.15.82:0/386819676 wait complete. 2023-07-20T10:08:03.569 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-07-20T10:08:03.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:08:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 Processor -- start 2023-07-20T10:08:03.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 -- start start 2023-07-20T10:08:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7ba00ca5a0 0x7f7ba015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba0071950 con 0x7f7ba006f710 2023-07-20T10:08:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba015b230 con 0x7f7ba015ec90 2023-07-20T10:08:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba6807640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba015bad0 con 0x7f7ba00ca5a0 2023-07-20T10:08:03.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ba006f710 0x7f7ba006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44804/0 (socket says 172.21.15.82:44804) 2023-07-20T10:08:03.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9ffff640 1 -- 172.21.15.82:0/799034443 learned_addr learned my addr 172.21.15.82:0/799034443 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:03.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/799034443 >> v2:172.21.15.183:3300/0 conn(0x7f7ba00ca5a0 0x7f7ba015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292220113 0 0) 0x7f7ba0071950 con 0x7f7ba006f710 2023-07-20T10:08:03.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b88003530 con 0x7f7ba006f710 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369953531 0 0) 0x7f7ba015b230 con 0x7f7ba015ec90 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba0071950 con 0x7f7ba015ec90 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3815534850 0 0) 0x7f7b88003530 con 0x7f7ba006f710 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 >> v2:172.21.15.183:3300/0 conn(0x7f7ba00ca5a0 msgr2=0x7f7ba015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 --2- 172.21.15.82:0/799034443 >> v2:172.21.15.183:3300/0 conn(0x7f7ba00ca5a0 0x7f7ba015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 >> v1:172.21.15.183:6789/0 conn(0x7f7ba015ec90 legacy=0x7f7ba015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba015b510 con 0x7f7ba006f710 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7b90001680 con 0x7f7ba006f710 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 >> v1:172.21.15.82:6789/0 conn(0x7f7ba006f710 legacy=0x7f7ba006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b88003bb0 0x7f7b88003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 0x7f7b88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b88005190 0x7f7b8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba015bad0 con 0x7f7b880047d0 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8800c0c0 con 0x7f7b88003bb0 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8800c280 con 0x7f7b88005190 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 0x7f7b88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9ffff640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b88003bb0 0x7f7b88003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7ba4da4640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b88005190 0x7f7b8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.735+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b88005190 msgr2=0x7f7b8800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:03.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b88005190 0x7f7b8800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b88003bb0 msgr2=0x7f7b88003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b88003bb0 0x7f7b88003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/799034443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88003530 con 0x7f7b880047d0 2023-07-20T10:08:03.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba4da4640 1 -- 172.21.15.82:0/799034443 reap_dead start 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 0x7f7b88004c50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009ab0 tx=0x7f7b9401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86d7706b38f7555 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a5620 con 0x7f7b880047d0 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940a5780 con 0x7f7b880047d0 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7b9effd640 1 -- 172.21.15.82:0/799034443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a5b30 con 0x7f7b880047d0 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 -- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 msgr2=0x7f7b88004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 0x7f7b88004c50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009ab0 tx=0x7f7b9401ca30 comp rx=0 tx=0).stop 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 -- 172.21.15.82:0/799034443 shutdown_connections 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 --2- 172.21.15.82:0/799034443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b880047d0 0x7f7b88004c50 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 -- 172.21.15.82:0/799034443 >> 172.21.15.82:0/799034443 conn(0x7f7ba00cad50 msgr2=0x7f7ba00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 -- 172.21.15.82:0/799034443 shutdown_connections 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.739+0000 7f7ba6807640 1 -- 172.21.15.82:0/799034443 wait complete. 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 Processor -- start 2023-07-20T10:08:03.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 -- start start 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b880047d0 0x7f7ba00c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 0x7f7ba01f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00cc0d0 con 0x7f7ba0150070 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01fa0b0 con 0x7f7ba01f96c0 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00b39e0 con 0x7f7b880047d0 2023-07-20T10:08:03.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40664/0 (socket says 172.21.15.82:40664) 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/1986582851 learned_addr learned my addr 172.21.15.82:0/1986582851 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9ffff640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b880047d0 0x7f7ba00c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba4da4640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 0x7f7ba01f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b880047d0 msgr2=0x7f7ba00c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b880047d0 0x7f7ba00c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 msgr2=0x7f7ba01f9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 0x7f7ba01f9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 -- 172.21.15.82:0/1986582851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00b3140 con 0x7f7ba0150070 2023-07-20T10:08:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba4da4640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 0x7f7ba01f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:03.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9f7fe640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009ab0 tx=0x7f7b940197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b6870 con 0x7f7ba0150070 2023-07-20T10:08:03.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940b69d0 con 0x7f7ba0150070 2023-07-20T10:08:03.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b6d80 con 0x7f7ba0150070 2023-07-20T10:08:03.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.743+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00b3420 con 0x7f7ba0150070 2023-07-20T10:08:03.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba00b2e10 con 0x7f7ba0150070 2023-07-20T10:08:03.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba004da30 con 0x7f7ba0150070 2023-07-20T10:08:03.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 53) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f7b940b4070 con 0x7f7ba0150070 2023-07-20T10:08:03.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7b9cff9640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 0x7f7b8c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:03.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7b9411e560 con 0x7f7ba0150070 2023-07-20T10:08:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7b9ffff640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 0x7f7b8c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.747+0000 7f7b9ffff640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 0x7f7b8c068a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000c10 tx=0x7f7b90001e30 comp rx=0 tx=0).ready entity=mgr.8010 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:03.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.751+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b940eb550 con 0x7f7ba0150070 2023-07-20T10:08:03.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:03.935+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f7ba00cb940 con 0x7f7ba0150070 2023-07-20T10:08:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7b940eb920 con 0x7f7ba0150070 2023-07-20T10:08:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7b9cff9640 1 -- 172.21.15.82:0/1986582851 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v54) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7b940eefe0 con 0x7f7ba0150070 2023-07-20T10:08:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 msgr2=0x7f7b8c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 0x7f7b8c068a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b90000c10 tx=0x7f7b90001e30 comp rx=0 tx=0).stop 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 msgr2=0x7f7ba00b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.011+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009ab0 tx=0x7f7b940197d0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 shutdown_connections 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f7b8c066540 0x7f7b8c068a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ba01f96c0 0x7f7ba01f9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ba0150070 0x7f7ba00b28d0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 --2- 172.21.15.82:0/1986582851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b880047d0 0x7f7ba00c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:03.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 >> 172.21.15.82:0/1986582851 conn(0x7f7ba00cad50 msgr2=0x7f7ba00afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:03.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 shutdown_connections 2023-07-20T10:08:03.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.015+0000 7f7ba6807640 1 -- 172.21.15.82:0/1986582851 wait complete. 2023-07-20T10:08:04.010 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:08:04.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:08:04.073 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:08:04.130 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:08:04.131 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:04.131 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:04.141 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:04.142 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:04.158 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:04.184+0000 7fccca20c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:08:04.165 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:04.187+0000 7f89dd02d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:08:04.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:04.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 Processor -- start 2023-07-20T10:08:04.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 -- start start 2023-07-20T10:08:04.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc53015cab0 0x7fc5300d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 0x7fc5300d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5300d16b0 con 0x7fc5300d0d10 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300d31c0 con 0x7fc53015cab0 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc53506a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5300b3520 con 0x7fc5300ce4c0 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc53015cab0 0x7fc5300d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc53015cab0 0x7fc5300d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40688/0 (socket says 172.21.15.82:40688) 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 -- 172.21.15.82:0/578001203 learned_addr learned my addr 172.21.15.82:0/578001203 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:04.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc527fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc5300d0d10 0x7fc5300cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44810/0 (socket says 172.21.15.82:44810) 2023-07-20T10:08:04.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52f59e640 1 --2- 172.21.15.82:0/578001203 >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 0x7fc5300d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 -- 172.21.15.82:0/578001203 >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 msgr2=0x7fc5300d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:04.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 --2- 172.21.15.82:0/578001203 >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 0x7fc5300d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 -- 172.21.15.82:0/578001203 >> v1:172.21.15.82:6789/0 conn(0x7fc5300d0d10 legacy=0x7fc5300cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52ed9d640 1 -- 172.21.15.82:0/578001203 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5300b2910 con 0x7fc53015cab0 2023-07-20T10:08:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52e59c640 1 -- 172.21.15.82:0/578001203 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644820358 0 0) 0x7fc5300d16b0 con 0x7fc5300d0d10 2023-07-20T10:08:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.383+0000 7fc52f59e640 1 --2- 172.21.15.82:0/578001203 >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 0x7fc5300d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:04.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc52ed9d640 1 --2- 172.21.15.82:0/578001203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc5300d0300 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc530071cd0 tx=0x7fc52001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e5057be404f59 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:04.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc52e59c640 1 -- 172.21.15.82:0/578001203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200ab5f0 con 0x7fc53015cab0 2023-07-20T10:08:04.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc52e59c640 1 -- 172.21.15.82:0/578001203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200ab750 con 0x7fc53015cab0 2023-07-20T10:08:04.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc52e59c640 1 -- 172.21.15.82:0/578001203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200abae0 con 0x7fc53015cab0 2023-07-20T10:08:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 -- 172.21.15.82:0/578001203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 msgr2=0x7fc5300d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 --2- 172.21.15.82:0/578001203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc5300d0300 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fc530071cd0 tx=0x7fc52001c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 -- 172.21.15.82:0/578001203 shutdown_connections 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 --2- 172.21.15.82:0/578001203 >> v2:172.21.15.183:3300/0 conn(0x7fc5300ce4c0 0x7fc5300d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 --2- 172.21.15.82:0/578001203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc5300d0300 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 -- 172.21.15.82:0/578001203 >> 172.21.15.82:0/578001203 conn(0x7fc53008c120 msgr2=0x7fc53009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 -- 172.21.15.82:0/578001203 shutdown_connections 2023-07-20T10:08:04.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.387+0000 7fc53506a640 1 -- 172.21.15.82:0/578001203 wait complete. 2023-07-20T10:08:04.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.391+0000 7fc53506a640 1 Processor -- start 2023-07-20T10:08:04.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.391+0000 7fc53506a640 1 -- start start 2023-07-20T10:08:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5300ce4c0 0x7fc53014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5300d0d10 0x7fc5301529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014df70 con 0x7fc53015cab0 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53014e0d0 con 0x7fc5300d0d10 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc530153bf0 con 0x7fc5300ce4c0 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40692/0 (socket says 172.21.15.82:40692) 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 -- 172.21.15.82:0/4102280595 learned_addr learned my addr 172.21.15.82:0/4102280595 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52ed9d640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5300ce4c0 0x7fc53014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc527fff640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5300d0d10 0x7fc5301529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 -- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5300ce4c0 msgr2=0x7fc53014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5300ce4c0 0x7fc53014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 -- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5300d0d10 msgr2=0x7fc5301529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5300d0d10 0x7fc5301529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 -- 172.21.15.82:0/4102280595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200094d0 con 0x7fc53015cab0 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc52f59e640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc528007dc0 tx=0x7fc52800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280039a0 con 0x7fc53015cab0 2023-07-20T10:08:04.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52800f040 con 0x7fc53015cab0 2023-07-20T10:08:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc530153ed0 con 0x7fc53015cab0 2023-07-20T10:08:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528003d40 con 0x7fc53015cab0 2023-07-20T10:08:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc530154490 con 0x7fc53015cab0 2023-07-20T10:08:04.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc530073c70 con 0x7fc53015cab0 2023-07-20T10:08:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.395+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fc528004030 con 0x7fc53015cab0 2023-07-20T10:08:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.399+0000 7fc5277fe640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 0x7fc510068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.399+0000 7fc52ed9d640 1 -- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 msgr2=0x7fc510068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.399+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc528084760 con 0x7fc53015cab0 2023-07-20T10:08:04.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.399+0000 7fc52ed9d640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 0x7fc510068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:04.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.403+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5280515b0 con 0x7fc53015cab0 2023-07-20T10:08:04.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.559+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5300b3d50 con 0x7fc53015cab0 2023-07-20T10:08:04.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.559+0000 7fc5277fe640 1 -- 172.21.15.82:0/4102280595 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18975 (secure 0 0 0) 0x7fc528054bd0 con 0x7fc53015cab0 2023-07-20T10:08:04.536 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:04.536 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":110,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:02.990040+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2674254560":"2023-07-21T10:07:01.288326+0000","172.21.15.82:6832/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:6833/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/4185959370":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2979139926":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3707206980":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/1784618799":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2038385173":"2023-07-21T10:07:01.288326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.559+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 msgr2=0x7fc510068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.559+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 0x7fc510068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 msgr2=0x7fc530152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fc528007dc0 tx=0x7fc52800d4a0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 shutdown_connections 2023-07-20T10:08:04.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc5100664c0 0x7fc510068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc53015cab0 0x7fc530152ef0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5300d0d10 0x7fc5301529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 --2- 172.21.15.82:0/4102280595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5300ce4c0 0x7fc53014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 >> 172.21.15.82:0/4102280595 conn(0x7fc53008c120 msgr2=0x7fc5300b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 shutdown_connections 2023-07-20T10:08:04.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.563+0000 7fc53506a640 1 -- 172.21.15.82:0/4102280595 wait complete. 2023-07-20T10:08:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:06:41.538221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:06:42.832437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:08:04.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:08:04.576 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:04.604+0000 7fccca20c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:08:04.602 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:04.627+0000 7f89dd02d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:08:04.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.727+0000 7fc223c9c640 1 Processor -- start 2023-07-20T10:08:04.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.727+0000 7fc223c9c640 1 -- start start 2023-07-20T10:08:04.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc223c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c06c120 0x7fc21c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc223c9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc21c1602b0 0x7fc21c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc223c9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c0d0970 con 0x7fc21c06ab10 2023-07-20T10:08:04.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc223c9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c160e20 con 0x7fc21c1602b0 2023-07-20T10:08:04.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc223c9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0cd300 con 0x7fc21c06c120 2023-07-20T10:08:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc21c1602b0 0x7fc21c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc21c1602b0 0x7fc21c160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40696/0 (socket says 172.21.15.82:40696) 2023-07-20T10:08:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 -- 172.21.15.82:0/3439444809 learned_addr learned my addr 172.21.15.82:0/3439444809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221a38640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c06c120 0x7fc21c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 -- 172.21.15.82:0/3439444809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c06c120 msgr2=0x7fc21c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:04.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c06c120 0x7fc21c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 -- 172.21.15.82:0/3439444809 >> v1:172.21.15.82:6789/0 conn(0x7fc21c06ab10 legacy=0x7fc21c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 -- 172.21.15.82:0/3439444809 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0cd5e0 con 0x7fc21c1602b0 2023-07-20T10:08:04.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc220a36640 1 -- 172.21.15.82:0/3439444809 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514406454 0 0) 0x7fc21c0d0970 con 0x7fc21c06ab10 2023-07-20T10:08:04.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.731+0000 7fc221237640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c1602b0 0x7fc21c160710 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009870 tx=0x7fc20c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dd53204985068b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc220a36640 1 -- 172.21.15.82:0/3439444809 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0ac620 con 0x7fc21c1602b0 2023-07-20T10:08:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc220a36640 1 -- 172.21.15.82:0/3439444809 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c0ac780 con 0x7fc21c1602b0 2023-07-20T10:08:04.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc220a36640 1 -- 172.21.15.82:0/3439444809 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0acb10 con 0x7fc21c1602b0 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 -- 172.21.15.82:0/3439444809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c1602b0 msgr2=0x7fc21c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c1602b0 0x7fc21c160710 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009870 tx=0x7fc20c01c4b0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 -- 172.21.15.82:0/3439444809 shutdown_connections 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c1602b0 0x7fc21c160710 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 --2- 172.21.15.82:0/3439444809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c06c120 0x7fc21c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 -- 172.21.15.82:0/3439444809 >> 172.21.15.82:0/3439444809 conn(0x7fc21c08c0a0 msgr2=0x7fc21c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:04.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 -- 172.21.15.82:0/3439444809 shutdown_connections 2023-07-20T10:08:04.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 -- 172.21.15.82:0/3439444809 wait complete. 2023-07-20T10:08:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.735+0000 7fc223c9c640 1 Processor -- start 2023-07-20T10:08:04.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- start start 2023-07-20T10:08:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc21c06ab10 0x7fc21c0c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c1602b0 0x7fc21c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c152420 con 0x7fc21c06c120 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0cae20 con 0x7fc21c06ab10 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0cb100 con 0x7fc21c1602b0 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40706/0 (socket says 172.21.15.82:40706) 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 -- 172.21.15.82:0/1117606964 learned_addr learned my addr 172.21.15.82:0/1117606964 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:04.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc222239640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c1602b0 0x7fc21c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221a38640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc21c06ab10 0x7fc21c0c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 -- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c1602b0 msgr2=0x7fc21c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c1602b0 0x7fc21c0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 -- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc21c06ab10 msgr2=0x7fc21c0c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc21c06ab10 0x7fc21c0c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 -- 172.21.15.82:0/1117606964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0094d0 con 0x7fc21c06c120 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc221237640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0af040 tx=0x7fc20c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:04.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0ac620 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c0b7420 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0b77d0 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0cb3e0 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.739+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0cb9a0 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c04da30 con 0x7fc21c06c120 2023-07-20T10:08:04.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fc20c0b3040 con 0x7fc21c06c120 2023-07-20T10:08:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc2127fc640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 0x7fc200068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc221a38640 1 -- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 msgr2=0x7fc200068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:04.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fc20c11e5a0 con 0x7fc21c06c120 2023-07-20T10:08:04.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.743+0000 7fc221a38640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 0x7fc200068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:04.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.747+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc20c0eb360 con 0x7fc21c06c120 2023-07-20T10:08:04.725 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:04.752+0000 7fccca20c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:08:04.761 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:04.783+0000 7f89dd02d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:08:04.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.895+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc21c155080 con 0x7fc21c06c120 2023-07-20T10:08:04.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.895+0000 7fc2127fc640 1 -- 172.21.15.82:0/1117606964 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc20c0ee980 con 0x7fc21c06c120 2023-07-20T10:08:04.873 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:08:04.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 msgr2=0x7fc200068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:04.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 0x7fc200068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 msgr2=0x7fc21c0b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:04.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fc20c0af040 tx=0x7fc20c019250 comp rx=0 tx=0).stop 2023-07-20T10:08:04.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 shutdown_connections 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fc2000664c0 0x7fc200068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc21c1602b0 0x7fc21c0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc21c06c120 0x7fc21c0b0270 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 --2- 172.21.15.82:0/1117606964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc21c06ab10 0x7fc21c0c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 >> 172.21.15.82:0/1117606964 conn(0x7fc21c08c0a0 msgr2=0x7fc21c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:04.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 shutdown_connections 2023-07-20T10:08:04.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:04.899+0000 7fc223c9c640 1 -- 172.21.15.82:0/1117606964 wait complete. 2023-07-20T10:08:04.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:08:05.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 Processor -- start 2023-07-20T10:08:05.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 -- start start 2023-07-20T10:08:05.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29b01602b0 0x7f29b0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b006ab10 0x7f29b006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b00ce4f0 con 0x7f29b006c120 2023-07-20T10:08:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b006b4a0 con 0x7f29b01602b0 2023-07-20T10:08:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b85c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00d0970 con 0x7f29b006ab10 2023-07-20T10:08:05.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b5b60640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29b01602b0 0x7f29b0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b5b60640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f29b01602b0 0x7f29b0160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40720/0 (socket says 172.21.15.82:40720) 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b5b60640 1 -- 172.21.15.82:0/1549525195 learned_addr learned my addr 172.21.15.82:0/1549525195 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b6361640 1 --1- 172.21.15.82:0/1549525195 >> v1:172.21.15.82:6789/0 conn(0x7f29b006c120 0x7f29b00cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44828/0 (socket says 172.21.15.82:44828) 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.107+0000 7f29b6b62640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b006ab10 0x7f29b006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b5b60640 1 -- 172.21.15.82:0/1549525195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b006ab10 msgr2=0x7f29b006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b5b60640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b006ab10 0x7f29b006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b5b60640 1 -- 172.21.15.82:0/1549525195 >> v1:172.21.15.82:6789/0 conn(0x7f29b006c120 legacy=0x7f29b00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b5b60640 1 -- 172.21.15.82:0/1549525195 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b0160e20 con 0x7f29b01602b0 2023-07-20T10:08:05.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b5b60640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b01602b0 0x7f29b0160740 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d559f97ab75bce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b535f640 1 -- 172.21.15.82:0/1549525195 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00ab680 con 0x7f29b01602b0 2023-07-20T10:08:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b535f640 1 -- 172.21.15.82:0/1549525195 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00ab7e0 con 0x7f29b01602b0 2023-07-20T10:08:05.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b535f640 1 -- 172.21.15.82:0/1549525195 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00abb70 con 0x7f29b01602b0 2023-07-20T10:08:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b85c5640 1 -- 172.21.15.82:0/1549525195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b01602b0 msgr2=0x7f29b0160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.111+0000 7f29b85c5640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b01602b0 0x7f29b0160740 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009870 tx=0x7f29a001c480 comp rx=0 tx=0).stop 2023-07-20T10:08:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- 172.21.15.82:0/1549525195 shutdown_connections 2023-07-20T10:08:05.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b006ab10 0x7f29b006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 --2- 172.21.15.82:0/1549525195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b01602b0 0x7f29b0160740 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- 172.21.15.82:0/1549525195 >> 172.21.15.82:0/1549525195 conn(0x7f29b008c0a0 msgr2=0x7f29b009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- 172.21.15.82:0/1549525195 shutdown_connections 2023-07-20T10:08:05.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- 172.21.15.82:0/1549525195 wait complete. 2023-07-20T10:08:05.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 Processor -- start 2023-07-20T10:08:05.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- start start 2023-07-20T10:08:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b006ab10 0x7f29b014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b01602b0 0x7f29b0157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00cc480 con 0x7f29b006c120 2023-07-20T10:08:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0156190 con 0x7f29b006ab10 2023-07-20T10:08:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b85c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0155580 con 0x7f29b01602b0 2023-07-20T10:08:05.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b6361640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b006ab10 0x7f29b014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40730/0 (socket says 172.21.15.82:40730) 2023-07-20T10:08:05.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 -- 172.21.15.82:0/4140476117 learned_addr learned my addr 172.21.15.82:0/4140476117 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:05.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b6b62640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b01602b0 0x7f29b0157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 -- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b01602b0 msgr2=0x7f29b0157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b01602b0 0x7f29b0157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 -- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b006ab10 msgr2=0x7f29b014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b006ab10 0x7f29b014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.115+0000 7f29b5b60640 1 -- 172.21.15.82:0/4140476117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a00094d0 con 0x7f29b006c120 2023-07-20T10:08:05.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b5b60640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29a001a0b0 tx=0x7f29a0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b5810 con 0x7f29b006c120 2023-07-20T10:08:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00b5970 con 0x7f29b006c120 2023-07-20T10:08:05.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b5d20 con 0x7f29b006c120 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b0155860 con 0x7f29b006c120 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b0155e20 con 0x7f29b006c120 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b0156320 con 0x7f29b006c120 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f29a00b4390 con 0x7f29b006c120 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 0x7f2994068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b6361640 1 -- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 msgr2=0x7f2994068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:05.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f29a011e950 con 0x7f29b006c120 2023-07-20T10:08:05.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.119+0000 7f29b6361640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 0x7f2994068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:05.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.123+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29a00eb730 con 0x7f29b006c120 2023-07-20T10:08:05.202 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.228+0000 7fccca20c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:05.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f29b004da30 con 0x7f29b006c120 2023-07-20T10:08:05.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29a6ffd640 1 -- 172.21.15.82:0/4140476117 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29a00eed50 con 0x7f29b006c120 2023-07-20T10:08:05.252 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:08:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 msgr2=0x7f2994068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:05.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 0x7f2994068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 msgr2=0x7f29b0156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f29a001a0b0 tx=0x7f29a0019220 comp rx=0 tx=0).stop 2023-07-20T10:08:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 shutdown_connections 2023-07-20T10:08:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f29940664c0 0x7f2994068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29b01602b0 0x7f29b0157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29b006c120 0x7f29b0156620 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 --2- 172.21.15.82:0/4140476117 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f29b006ab10 0x7f29b014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.275+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 >> 172.21.15.82:0/4140476117 conn(0x7f29b008c0a0 msgr2=0x7f29b00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.279+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 shutdown_connections 2023-07-20T10:08:05.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.279+0000 7f29b85c5640 1 -- 172.21.15.82:0/4140476117 wait complete. 2023-07-20T10:08:05.256 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.279+0000 7f89dd02d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:05.260 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.288+0000 7fccca20c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:08:05.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:08:05.316 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.344+0000 7fccca20c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:08:05.319 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.343+0000 7f89dd02d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:08:05.377 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.399+0000 7f89dd02d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:08:05.401 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.428+0000 7fccca20c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:08:05.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 Processor -- start 2023-07-20T10:08:05.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 -- start start 2023-07-20T10:08:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb8806c120 0x7fbb880cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880d0970 con 0x7fbb8806b220 2023-07-20T10:08:05.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb88160e20 con 0x7fbb881602b0 2023-07-20T10:08:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.443+0000 7fbb8fb82640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880cd300 con 0x7fbb8806c120 2023-07-20T10:08:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d91e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb8806c120 0x7fbb880cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8e11f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbb8806b220 0x7fbb880d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44840/0 (socket says 172.21.15.82:44840) 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8e11f640 1 -- 172.21.15.82:0/12329055 learned_addr learned my addr 172.21.15.82:0/12329055 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d11d640 1 --1- 172.21.15.82:0/12329055 >> v1:172.21.15.183:6789/0 conn(0x7fbb881602b0 0x7fbb8806ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:40028/0 (socket says 172.21.15.82:40028) 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d91e640 1 -- 172.21.15.82:0/12329055 >> v1:172.21.15.183:6789/0 conn(0x7fbb881602b0 legacy=0x7fbb8806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d91e640 1 -- 172.21.15.82:0/12329055 >> v1:172.21.15.82:6789/0 conn(0x7fbb8806b220 legacy=0x7fbb880d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d91e640 1 -- 172.21.15.82:0/12329055 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880cd5e0 con 0x7fbb8806c120 2023-07-20T10:08:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8c91c640 1 -- 172.21.15.82:0/12329055 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014551513 0 0) 0x7fbb88160e20 con 0x7fbb881602b0 2023-07-20T10:08:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8d91e640 1 --2- 172.21.15.82:0/12329055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8806c120 0x7fbb880cdde0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fe9448e97af3aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8c91c640 1 -- 172.21.15.82:0/12329055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840a58e0 con 0x7fbb8806c120 2023-07-20T10:08:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8c91c640 1 -- 172.21.15.82:0/12329055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb840a5a40 con 0x7fbb8806c120 2023-07-20T10:08:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.447+0000 7fbb8c91c640 1 -- 172.21.15.82:0/12329055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840a5dd0 con 0x7fbb8806c120 2023-07-20T10:08:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- 172.21.15.82:0/12329055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8806c120 msgr2=0x7fbb880cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/12329055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8806c120 0x7fbb880cdde0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009d90 tx=0x7fbb8401c800 comp rx=0 tx=0).stop 2023-07-20T10:08:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- 172.21.15.82:0/12329055 shutdown_connections 2023-07-20T10:08:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/12329055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb8806c120 0x7fbb880cdde0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- 172.21.15.82:0/12329055 >> 172.21.15.82:0/12329055 conn(0x7fbb8808c0a0 msgr2=0x7fbb8809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- 172.21.15.82:0/12329055 shutdown_connections 2023-07-20T10:08:05.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- 172.21.15.82:0/12329055 wait complete. 2023-07-20T10:08:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 Processor -- start 2023-07-20T10:08:05.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- start start 2023-07-20T10:08:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb8806b220 0x7fbb8814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 0x7fbb880b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb881525d0 con 0x7fbb881602b0 2023-07-20T10:08:05.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880b05b0 con 0x7fbb8806c120 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8fb82640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880b0890 con 0x7fbb8806b220 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8e11f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8d11d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 0x7fbb880b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8e11f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40740/0 (socket says 172.21.15.82:40740) 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8e11f640 1 -- 172.21.15.82:0/1712851591 learned_addr learned my addr 172.21.15.82:0/1712851591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:05.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.451+0000 7fbb8d91e640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb8806b220 0x7fbb8814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 -- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb8806b220 msgr2=0x7fbb8814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb8806b220 0x7fbb8814fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 -- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 msgr2=0x7fbb880b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 0x7fbb880b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 -- 172.21.15.82:0/1712851591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84009a70 con 0x7fbb881602b0 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8d11d640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 0x7fbb880b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8e11f640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c3c0 tx=0x7fbb8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005cf0 con 0x7fbb881602b0 2023-07-20T10:08:05.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb80005e50 con 0x7fbb881602b0 2023-07-20T10:08:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800072d0 con 0x7fbb881602b0 2023-07-20T10:08:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb881515b0 con 0x7fbb881602b0 2023-07-20T10:08:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb88151b70 con 0x7fbb881602b0 2023-07-20T10:08:05.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb88151d90 con 0x7fbb881602b0 2023-07-20T10:08:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fbb80007430 con 0x7fbb881602b0 2023-07-20T10:08:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 0x7fbb6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fbb80083820 con 0x7fbb881602b0 2023-07-20T10:08:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8d91e640 1 -- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 msgr2=0x7fbb6c068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:05.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.455+0000 7fbb8d91e640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 0x7fbb6c068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:05.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.459+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb80050810 con 0x7fbb881602b0 2023-07-20T10:08:05.459 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.484+0000 7fccca20c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:08:05.469 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.491+0000 7f89dd02d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:08:05.527 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.551+0000 7f89dd02d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:08:05.543 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.568+0000 7fccca20c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:08:05.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.611+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb8804da30 con 0x7fbb881602b0 2023-07-20T10:08:05.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.611+0000 7fbb7e7fc640 1 -- 172.21.15.82:0/1712851591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb80053e30 con 0x7fbb881602b0 2023-07-20T10:08:05.589 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 msgr2=0x7fbb6c068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 0x7fbb6c068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 msgr2=0x7fbb88152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fbb8000c3c0 tx=0x7fbb8000c880 comp rx=0 tx=0).stop 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 shutdown_connections 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fbb6c0664c0 0x7fbb6c068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb881602b0 0x7fbb88152090 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb8806c120 0x7fbb880b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 --2- 172.21.15.82:0/1712851591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb8806b220 0x7fbb8814fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 >> 172.21.15.82:0/1712851591 conn(0x7fbb8808c0a0 msgr2=0x7fbb880b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 shutdown_connections 2023-07-20T10:08:05.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.615+0000 7fbb8fb82640 1 -- 172.21.15.82:0/1712851591 wait complete. 2023-07-20T10:08:05.599 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.624+0000 7fccca20c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:08:05.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:08:05.616 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.639+0000 7f89dd02d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:08:05.675 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.699+0000 7f89dd02d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:08:05.740 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.768+0000 7fccca20c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:08:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.783+0000 7f0467582640 1 Processor -- start 2023-07-20T10:08:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.783+0000 7f0467582640 1 -- start start 2023-07-20T10:08:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0467582640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04601602b0 0x7f0460160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0467582640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 0x7f046006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0467582640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04600ce4f0 con 0x7f046006c120 2023-07-20T10:08:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0467582640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046006b4a0 con 0x7f04601602b0 2023-07-20T10:08:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0467582640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04600d0970 con 0x7f046006ab10 2023-07-20T10:08:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04601602b0 0x7f0460160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f04601602b0 0x7f0460160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40750/0 (socket says 172.21.15.82:40750) 2023-07-20T10:08:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 -- 172.21.15.82:0/672439231 learned_addr learned my addr 172.21.15.82:0/672439231 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0465b1f640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 0x7f046006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 -- 172.21.15.82:0/672439231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 msgr2=0x7f046006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 0x7f046006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 -- 172.21.15.82:0/672439231 >> v1:172.21.15.82:6789/0 conn(0x7f046006c120 legacy=0x7f04600cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 -- 172.21.15.82:0/672439231 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460160e20 con 0x7f04601602b0 2023-07-20T10:08:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0465b1f640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 0x7f046006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0464b1d640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601602b0 0x7f0460160740 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0450009870 tx=0x7f045001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ccac07f734e6eb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0457fff640 1 -- 172.21.15.82:0/672439231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500ab680 con 0x7f04601602b0 2023-07-20T10:08:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0457fff640 1 -- 172.21.15.82:0/672439231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04500ab7e0 con 0x7f04601602b0 2023-07-20T10:08:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.787+0000 7f0457fff640 1 -- 172.21.15.82:0/672439231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04500abb70 con 0x7f04601602b0 2023-07-20T10:08:05.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- 172.21.15.82:0/672439231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601602b0 msgr2=0x7f0460160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601602b0 0x7f0460160740 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0450009870 tx=0x7f045001c480 comp rx=0 tx=0).stop 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- 172.21.15.82:0/672439231 shutdown_connections 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f046006ab10 0x7f046006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- 172.21.15.82:0/672439231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04601602b0 0x7f0460160740 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- 172.21.15.82:0/672439231 >> 172.21.15.82:0/672439231 conn(0x7f046008c0a0 msgr2=0x7f046009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- 172.21.15.82:0/672439231 shutdown_connections 2023-07-20T10:08:05.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- 172.21.15.82:0/672439231 wait complete. 2023-07-20T10:08:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 Processor -- start 2023-07-20T10:08:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- start start 2023-07-20T10:08:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f046006c120 0x7f04600b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04601602b0 0x7f0460155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600b8220 con 0x7f046006ab10 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600b37c0 con 0x7f046006c120 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0467582640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04600c6320 con 0x7f04601602b0 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f046531e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f046531e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40756/0 (socket says 172.21.15.82:40756) 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f046531e640 1 -- 172.21.15.82:0/2361719042 learned_addr learned my addr 172.21.15.82:0/2361719042 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0465b1f640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04601602b0 0x7f0460155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.791+0000 7f0464b1d640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f046006c120 0x7f04600b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 -- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04601602b0 msgr2=0x7f0460155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04601602b0 0x7f0460155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 -- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f046006c120 msgr2=0x7f04600b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f046006c120 0x7f04600b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 -- 172.21.15.82:0/2361719042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04500094d0 con 0x7f046006ab10 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f046531e640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f045c00c7f0 tx=0x7f045c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c003b80 con 0x7f046006ab10 2023-07-20T10:08:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045c003ce0 con 0x7f046006ab10 2023-07-20T10:08:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045c00aa30 con 0x7f046006ab10 2023-07-20T10:08:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04600b7f40 con 0x7f046006ab10 2023-07-20T10:08:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04600c68a0 con 0x7f046006ab10 2023-07-20T10:08:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04600c6a90 con 0x7f046006ab10 2023-07-20T10:08:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.795+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f045c00ab90 con 0x7f046006ab10 2023-07-20T10:08:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.799+0000 7f0455ffb640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 0x7f0444068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.799+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f045c084120 con 0x7f046006ab10 2023-07-20T10:08:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.799+0000 7f0464b1d640 1 -- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 msgr2=0x7f0444068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:05.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.799+0000 7f0464b1d640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 0x7f0444068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.799+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f045c051080 con 0x7f046006ab10 2023-07-20T10:08:05.799 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:05.824+0000 7fccca20c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:08:05.823 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.847+0000 7f89dd02d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:08:05.883 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:05.907+0000 7f89dd02d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:08:05.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.951+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f046004da30 con 0x7f046006ab10 2023-07-20T10:08:05.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.951+0000 7f0455ffb640 1 -- 172.21.15.82:0/2361719042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f045c0546a0 con 0x7f046006ab10 2023-07-20T10:08:05.928 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:08:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 msgr2=0x7f0444068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 0x7f0444068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 msgr2=0x7f04600b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f045c00c7f0 tx=0x7f045c00ccb0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 shutdown_connections 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f04440664c0 0x7f0444068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04601602b0 0x7f0460155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f046006c120 0x7f04600b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 --2- 172.21.15.82:0/2361719042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f046006ab10 0x7f04600b3280 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 >> 172.21.15.82:0/2361719042 conn(0x7f046008c0a0 msgr2=0x7f0460072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 shutdown_connections 2023-07-20T10:08:05.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:05.955+0000 7f0467582640 1 -- 172.21.15.82:0/2361719042 wait complete. 2023-07-20T10:08:05.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:08:06.038 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:08:06.039 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:08:06.039 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:08:06.046 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:06.072+0000 7fccca20c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:08:06.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 Processor -- start 2023-07-20T10:08:06.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 -- start start 2023-07-20T10:08:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa10415cab0 0x7fa1040d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa1040ce4c0 0x7fa1040d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040d16b0 con 0x7fa1040d0d10 2023-07-20T10:08:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040d31c0 con 0x7fa1040ce4c0 2023-07-20T10:08:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa1088d8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b3520 con 0x7fa10415cab0 2023-07-20T10:08:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa0fbfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa1040d0d10 0x7fa1040cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44850/0 (socket says 172.21.15.82:44850) 2023-07-20T10:08:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa0fbfff640 1 -- 172.21.15.82:0/1405936199 learned_addr learned my addr 172.21.15.82:0/1405936199 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:06.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa102d9d640 1 --2- 172.21.15.82:0/1405936199 >> v2:172.21.15.82:3300/0 conn(0x7fa1040ce4c0 0x7fa1040d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa10259c640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa10415cab0 0x7fa1040d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa101d9b640 1 -- 172.21.15.82:0/1405936199 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923781210 0 0) 0x7fa1040d16b0 con 0x7fa1040d0d10 2023-07-20T10:08:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa101d9b640 1 -- 172.21.15.82:0/1405936199 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0f0003530 con 0x7fa1040d0d10 2023-07-20T10:08:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa102d9d640 1 -- 172.21.15.82:0/1405936199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa10415cab0 msgr2=0x7fa1040d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:06.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa102d9d640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa10415cab0 0x7fa1040d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa102d9d640 1 -- 172.21.15.82:0/1405936199 >> v1:172.21.15.82:6789/0 conn(0x7fa1040d0d10 legacy=0x7fa1040cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.151+0000 7fa102d9d640 1 -- 172.21.15.82:0/1405936199 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040b2910 con 0x7fa1040ce4c0 2023-07-20T10:08:06.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa102d9d640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040ce4c0 0x7fa1040d1170 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8243266984136828 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa101d9b640 1 -- 172.21.15.82:0/1405936199 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0a5900 con 0x7fa1040ce4c0 2023-07-20T10:08:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa101d9b640 1 -- 172.21.15.82:0/1405936199 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0a5a60 con 0x7fa1040ce4c0 2023-07-20T10:08:06.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa101d9b640 1 -- 172.21.15.82:0/1405936199 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0a5dd0 con 0x7fa1040ce4c0 2023-07-20T10:08:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- 172.21.15.82:0/1405936199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040ce4c0 msgr2=0x7fa1040d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040ce4c0 0x7fa1040d1170 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009d90 tx=0x7fa0fc01c920 comp rx=0 tx=0).stop 2023-07-20T10:08:06.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- 172.21.15.82:0/1405936199 shutdown_connections 2023-07-20T10:08:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1040ce4c0 0x7fa1040d1170 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 --2- 172.21.15.82:0/1405936199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa10415cab0 0x7fa1040d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- 172.21.15.82:0/1405936199 >> 172.21.15.82:0/1405936199 conn(0x7fa10408c120 msgr2=0x7fa10409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- 172.21.15.82:0/1405936199 shutdown_connections 2023-07-20T10:08:06.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- 172.21.15.82:0/1405936199 wait complete. 2023-07-20T10:08:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:08:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:08:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 Processor -- start 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.159+0000 7fa1088d8640 1 -- start start 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 0x7fa1040c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1040d0d10 0x7fa1040d27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040c9d40 con 0x7fa10415cab0 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040cc300 con 0x7fa1040d0d10 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040cb6f0 con 0x7fa1040ce4c0 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40776/0 (socket says 172.21.15.82:40776) 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa10259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 0x7fa1040c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 -- 172.21.15.82:0/2785233720 learned_addr learned my addr 172.21.15.82:0/2785233720 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:06.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa0fbfff640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1040d0d10 0x7fa1040d27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 -- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 msgr2=0x7fa1040c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 0x7fa1040c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 -- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1040d0d10 msgr2=0x7fa1040d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1040d0d10 0x7fa1040d27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 -- 172.21.15.82:0/2785233720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc009a70 con 0x7fa10415cab0 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa10259c640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 0x7fa1040c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:08:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa102d9d640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01a550 tx=0x7fa0fc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0ad850 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0ad9b0 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040cb9d0 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0add40 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040cbf90 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.163+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104073c70 con 0x7fa10415cab0 2023-07-20T10:08:06.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.167+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fa0fc0b4070 con 0x7fa10415cab0 2023-07-20T10:08:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.167+0000 7fa0faffd640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 0x7fa0e4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.167+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa0fc11f0b0 con 0x7fa10415cab0 2023-07-20T10:08:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.167+0000 7fa10259c640 1 -- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 msgr2=0x7fa0e4068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:06.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.167+0000 7fa10259c640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 0x7fa0e4068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:06.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.171+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0fc0ec260 con 0x7fa10415cab0 2023-07-20T10:08:06.148 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:06.171+0000 7f89dd02d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:08:06.182 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:06.208+0000 7fccca20c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:06.284 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:06.307+0000 7f89dd02d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:06.306 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:06.332+0000 7fccca20c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.331+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa1040b2590 con 0x7fa10415cab0 2023-07-20T10:08:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.331+0000 7fa0faffd640 1 -- 172.21.15.82:0/2785233720 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v110) v1 ==== 80+0+470 (secure 0 0 0) 0x7fa0fc0ef880 con 0x7fa10415cab0 2023-07-20T10:08:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2674254560 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/3784716253 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/3784716253 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4185959370 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.309 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2979139926 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.310 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3707206980 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.310 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1784618799 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.310 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2038385173 2023-07-21T10:07:01.288326+0000 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 msgr2=0x7fa0e4068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 0x7fa0e4068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 msgr2=0x7fa104157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc01a550 tx=0x7fa0fc0196c0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 shutdown_connections 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fa0e40664c0 0x7fa0e4068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa10415cab0 0x7fa104157090 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1040d0d10 0x7fa1040d27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 --2- 172.21.15.82:0/2785233720 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1040ce4c0 0x7fa1040c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 >> 172.21.15.82:0/2785233720 conn(0x7fa10408c120 msgr2=0x7fa1040af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 shutdown_connections 2023-07-20T10:08:06.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.335+0000 7fa1088d8640 1 -- 172.21.15.82:0/2785233720 wait complete. 2023-07-20T10:08:06.331 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:08:06.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:06.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:08:06.376 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:06.404+0000 7fccca20c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:08:06.390 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:08:06.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:06.391 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:08:06.402 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:08:06.402 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:06.412 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:08:06.413 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:06.413 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:06.416 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:06.439+0000 7f89dd02d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:06.425 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:08:06.425 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:08:06.425 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:06.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:08:06.464 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:06.489 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:06.511+0000 7f89dd02d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:08:06.513 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:06.540+0000 7fccca20c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 Processor -- start 2023-07-20T10:08:06.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 -- start start 2023-07-20T10:08:06.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefdc0d0d10 0x7fefdc0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fefdc0cd4b0 0x7fefdc0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0d16b0 con 0x7fefdc15cab0 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc0d31c0 con 0x7fefdc0d0d10 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe3ed8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc0b3520 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefdc0d0d10 0x7fefdc0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefdc0d0d10 0x7fefdc0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40784/0 (socket says 172.21.15.82:40784) 2023-07-20T10:08:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 -- 172.21.15.82:0/1853492274 learned_addr learned my addr 172.21.15.82:0/1853492274 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe2475640 1 --2- 172.21.15.82:0/1853492274 >> v2:172.21.15.183:3300/0 conn(0x7fefdc0cd4b0 0x7fefdc0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 -- 172.21.15.82:0/1853492274 >> v2:172.21.15.183:3300/0 conn(0x7fefdc0cd4b0 msgr2=0x7fefdc0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 --2- 172.21.15.82:0/1853492274 >> v2:172.21.15.183:3300/0 conn(0x7fefdc0cd4b0 0x7fefdc0cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 -- 172.21.15.82:0/1853492274 >> v1:172.21.15.183:6789/0 conn(0x7fefdc15cab0 legacy=0x7fefdc0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.631+0000 7fefe1473640 1 -- 172.21.15.82:0/1853492274 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0d0a10 con 0x7fefdc0d0d10 2023-07-20T10:08:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe1473640 1 --2- 172.21.15.82:0/1853492274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0d0d10 0x7fefdc0d1170 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fefdc071cd0 tx=0x7fefcc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7bab2fc25a6401 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe0c72640 1 -- 172.21.15.82:0/1853492274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0aa430 con 0x7fefdc0d0d10 2023-07-20T10:08:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe0c72640 1 -- 172.21.15.82:0/1853492274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc0aa590 con 0x7fefdc0d0d10 2023-07-20T10:08:06.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe0c72640 1 -- 172.21.15.82:0/1853492274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0aa920 con 0x7fefdc0d0d10 2023-07-20T10:08:06.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1853492274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0d0d10 msgr2=0x7fefdc0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1853492274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0d0d10 0x7fefdc0d1170 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fefdc071cd0 tx=0x7fefcc01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1853492274 shutdown_connections 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1853492274 >> v2:172.21.15.183:3300/0 conn(0x7fefdc0cd4b0 0x7fefdc0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1853492274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0d0d10 0x7fefdc0d1170 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1853492274 >> 172.21.15.82:0/1853492274 conn(0x7fefdc08c120 msgr2=0x7fefdc09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1853492274 shutdown_connections 2023-07-20T10:08:06.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.635+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1853492274 wait complete. 2023-07-20T10:08:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 Processor -- start 2023-07-20T10:08:06.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- start start 2023-07-20T10:08:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefdc0d0d10 0x7fefdc0c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 0x7fefdc15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1fd0b0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c70e0 con 0x7fefdc15cab0 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0b7b60 con 0x7fefdc0d0d10 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40792/0 (socket says 172.21.15.82:40792) 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 -- 172.21.15.82:0/1272464710 learned_addr learned my addr 172.21.15.82:0/1272464710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1473640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefdc0d0d10 0x7fefdc0c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe2475640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 0x7fefdc15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 -- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefdc0d0d10 msgr2=0x7fefdc0c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefdc0d0d10 0x7fefdc0c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 -- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 msgr2=0x7fefdc15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 0x7fefdc15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 -- 172.21.15.82:0/1272464710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc0094d0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe2475640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 0x7fefdc15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe1c74640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c3c0 tx=0x7fefd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd80052d0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8005430 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8003840 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0b7880 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.639+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc0c6d70 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc073c70 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fefd80039a0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefd27fc640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 0x7fefc0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fefd8083670 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefe1473640 1 -- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 msgr2=0x7fefc0068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.643+0000 7fefe1473640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 0x7fefc0068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:06.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.647+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefd80507d0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.632 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:06.655+0000 7f89dd02d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:06.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.827+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefdc072e00 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.827+0000 7fefd27fc640 1 -- 172.21.15.82:0/1272464710 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fefd8053df0 con 0x7fefdc0cd4b0 2023-07-20T10:08:06.805 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:06.806 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:08:06.806 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:08:06.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 msgr2=0x7fefc0068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:06.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 0x7fefc0068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 msgr2=0x7fefdc1fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fefd800c3c0 tx=0x7fefd800c880 comp rx=0 tx=0).stop 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 shutdown_connections 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7fefc00664c0 0x7fefc0068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefdc15cab0 0x7fefdc15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefdc0d0d10 0x7fefdc0c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 --2- 172.21.15.82:0/1272464710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefdc0cd4b0 0x7fefdc1fcb70 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:06.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 >> 172.21.15.82:0/1272464710 conn(0x7fefdc08c120 msgr2=0x7fefdc0af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:06.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 shutdown_connections 2023-07-20T10:08:06.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:06.831+0000 7fefe3ed8640 1 -- 172.21.15.82:0/1272464710 wait complete. 2023-07-20T10:08:06.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:07.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 Processor -- start 2023-07-20T10:08:07.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 -- start start 2023-07-20T10:08:07.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 0x7f99fc0cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 0x7f99fc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0cf880 con 0x7f99fc0d0d00 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0cd2a0 con 0x7f99fc15c590 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f9a01a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0b4f50 con 0x7f99fc0cd730 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fa7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f99fc0d0d00 0x7f99fc0b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44866/0 (socket says 172.21.15.82:44866) 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fa7fc640 1 -- 172.21.15.82:0/1432114713 learned_addr learned my addr 172.21.15.82:0/1432114713 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:07.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99faffd640 1 --2- 172.21.15.82:0/1432114713 >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 0x7f99fc0cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/1432114713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 0x7f99fc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99f9ffb640 1 -- 172.21.15.82:0/1432114713 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982729144 0 0) 0x7f99fc0cf880 con 0x7f99fc0d0d00 2023-07-20T10:08:07.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99f9ffb640 1 -- 172.21.15.82:0/1432114713 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4003530 con 0x7f99fc0d0d00 2023-07-20T10:08:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fb7fe640 1 -- 172.21.15.82:0/1432114713 >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 msgr2=0x7f99fc0cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/1432114713 >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 0x7f99fc0cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fb7fe640 1 -- 172.21.15.82:0/1432114713 >> v1:172.21.15.82:6789/0 conn(0x7f99fc0d0d00 legacy=0x7f99fc0b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99fb7fe640 1 -- 172.21.15.82:0/1432114713 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0cfab0 con 0x7f99fc0cd730 2023-07-20T10:08:07.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.035+0000 7f99faffd640 1 --2- 172.21.15.82:0/1432114713 >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 0x7f99fc0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:08:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/1432114713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 0x7f99fc0cdba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009d90 tx=0x7f99f401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e0923d65c12111 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f99f9ffb640 1 -- 172.21.15.82:0/1432114713 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40a59e0 con 0x7f99fc0cd730 2023-07-20T10:08:07.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f99f9ffb640 1 -- 172.21.15.82:0/1432114713 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40a5b40 con 0x7f99fc0cd730 2023-07-20T10:08:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f99f9ffb640 1 -- 172.21.15.82:0/1432114713 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40ad440 con 0x7f99fc0cd730 2023-07-20T10:08:07.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 -- 172.21.15.82:0/1432114713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 msgr2=0x7f99fc0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 --2- 172.21.15.82:0/1432114713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 0x7f99fc0cdba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009d90 tx=0x7f99f401c920 comp rx=0 tx=0).stop 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 -- 172.21.15.82:0/1432114713 shutdown_connections 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 --2- 172.21.15.82:0/1432114713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0cd730 0x7f99fc0cdba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 --2- 172.21.15.82:0/1432114713 >> v2:172.21.15.183:3300/0 conn(0x7f99fc15c590 0x7f99fc0cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 -- 172.21.15.82:0/1432114713 >> 172.21.15.82:0/1432114713 conn(0x7f99fc0654e0 msgr2=0x7f99fc0658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 -- 172.21.15.82:0/1432114713 shutdown_connections 2023-07-20T10:08:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.039+0000 7f9a01a48640 1 -- 172.21.15.82:0/1432114713 wait complete. 2023-07-20T10:08:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 Processor -- start 2023-07-20T10:08:07.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- start start 2023-07-20T10:08:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc0cd730 0x7f99fc0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0d0d00 0x7f99fc14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc14fe70 con 0x7f99fc15c590 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc15b1d0 con 0x7f99fc0cd730 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0ca350 con 0x7f99fc0d0d00 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40802/0 (socket says 172.21.15.82:40802) 2023-07-20T10:08:07.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 -- 172.21.15.82:0/3919058874 learned_addr learned my addr 172.21.15.82:0/3919058874 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fa7fc640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0d0d00 0x7f99fc14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99faffd640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc0cd730 0x7f99fc0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 -- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0d0d00 msgr2=0x7f99fc14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0d0d00 0x7f99fc14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 -- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc0cd730 msgr2=0x7f99fc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc0cd730 0x7f99fc0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 -- 172.21.15.82:0/3919058874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec009420 con 0x7f99fc15c590 2023-07-20T10:08:07.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99fb7fe640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f99f40b0040 tx=0x7f99f40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40adce0 con 0x7f99fc15c590 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f40ade40 con 0x7f99fc15c590 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f4009a70 con 0x7f99fc15c590 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40b9690 con 0x7f99fc15c590 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.043+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0ca910 con 0x7f99fc15c590 2023-07-20T10:08:07.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc04da30 con 0x7f99fc15c590 2023-07-20T10:08:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f99f40b97f0 con 0x7f99fc15c590 2023-07-20T10:08:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f99e3fff640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 0x7f99e80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f99f411f570 con 0x7f99fc15c590 2023-07-20T10:08:07.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f99faffd640 1 -- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 msgr2=0x7f99e80689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:07.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.047+0000 7f99faffd640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 0x7f99e80689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:07.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.051+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99f40ec4e0 con 0x7f99fc15c590 2023-07-20T10:08:07.048 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.076+0000 7fccca20c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:08:07.133 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.160+0000 7fccca20c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:08:07.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.215+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99fc0cc440 con 0x7f99fc15c590 2023-07-20T10:08:07.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.215+0000 7f99e3fff640 1 -- 172.21.15.82:0/3919058874 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+18975 (secure 0 0 0) 0x7f99f4009450 con 0x7f99fc15c590 2023-07-20T10:08:07.194 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:07.194 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":110,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:02.990040+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2674254560":"2023-07-21T10:07:01.288326+0000","172.21.15.82:6832/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:6833/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/4185959370":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2979139926":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3707206980":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/1784618799":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2038385173":"2023-07-21T10:07:01.288326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:07.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 msgr2=0x7f99e80689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 0x7f99e80689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 msgr2=0x7f99fc15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f99f40b0040 tx=0x7f99f40196c0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 shutdown_connections 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f99e80664f0 0x7f99e80689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99fc15c590 0x7f99fc15ac90 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0d0d00 0x7f99fc14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 --2- 172.21.15.82:0/3919058874 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc0cd730 0x7f99fc0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 >> 172.21.15.82:0/3919058874 conn(0x7f99fc0654e0 msgr2=0x7f99fc0b76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 shutdown_connections 2023-07-20T10:08:07.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.219+0000 7f9a01a48640 1 -- 172.21.15.82:0/3919058874 wait complete. 2023-07-20T10:08:07.199 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.223+0000 7f89dd02d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:08:07.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:06:41.538221+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:06:42.832437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:08:07.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:08:07.279 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.304+0000 7fccca20c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:08:07.287 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.311+0000 7f89dd02d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:08:07.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.383+0000 7f1653034640 1 Processor -- start 2023-07-20T10:08:07.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.383+0000 7f1653034640 1 -- start start 2023-07-20T10:08:07.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f1653034640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f164c1602b0 0x7f164c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f1653034640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f164c06ab10 0x7f164c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f1653034640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0ce4f0 con 0x7f164c06c120 2023-07-20T10:08:07.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f1653034640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0d0970 con 0x7f164c1602b0 2023-07-20T10:08:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f1653034640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c160e20 con 0x7f164c06ab10 2023-07-20T10:08:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f164c1602b0 0x7f164c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f164c1602b0 0x7f164c160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40806/0 (socket says 172.21.15.82:40806) 2023-07-20T10:08:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 -- 172.21.15.82:0/3564411598 learned_addr learned my addr 172.21.15.82:0/3564411598 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:07.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f16515d1640 1 --2- 172.21.15.82:0/3564411598 >> v2:172.21.15.183:3300/0 conn(0x7f164c06ab10 0x7f164c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.364 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.388+0000 7fccca20c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:08:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 -- 172.21.15.82:0/3564411598 >> v2:172.21.15.183:3300/0 conn(0x7f164c06ab10 msgr2=0x7f164c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:07.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 --2- 172.21.15.82:0/3564411598 >> v2:172.21.15.183:3300/0 conn(0x7f164c06ab10 0x7f164c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 -- 172.21.15.82:0/3564411598 >> v1:172.21.15.183:6789/0 conn(0x7f164c06c120 legacy=0x7f164c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 -- 172.21.15.82:0/3564411598 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0cd300 con 0x7f164c1602b0 2023-07-20T10:08:07.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.387+0000 7f164bfff640 1 --2- 172.21.15.82:0/3564411598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c160740 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f164c08ceb0 tx=0x7f163801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d582cc79a67a991 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f164b7fe640 1 -- 172.21.15.82:0/3564411598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380ab640 con 0x7f164c1602b0 2023-07-20T10:08:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f164b7fe640 1 -- 172.21.15.82:0/3564411598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380a7070 con 0x7f164c1602b0 2023-07-20T10:08:07.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f164b7fe640 1 -- 172.21.15.82:0/3564411598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380ab9c0 con 0x7f164c1602b0 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- 172.21.15.82:0/3564411598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 msgr2=0x7f164c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 --2- 172.21.15.82:0/3564411598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c160740 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f164c08ceb0 tx=0x7f163801c440 comp rx=0 tx=0).stop 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- 172.21.15.82:0/3564411598 shutdown_connections 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 --2- 172.21.15.82:0/3564411598 >> v2:172.21.15.183:3300/0 conn(0x7f164c06ab10 0x7f164c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 --2- 172.21.15.82:0/3564411598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c160740 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- 172.21.15.82:0/3564411598 >> 172.21.15.82:0/3564411598 conn(0x7f164c08c0a0 msgr2=0x7f164c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- 172.21.15.82:0/3564411598 shutdown_connections 2023-07-20T10:08:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- 172.21.15.82:0/3564411598 wait complete. 2023-07-20T10:08:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 Processor -- start 2023-07-20T10:08:07.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.391+0000 7f1653034640 1 -- start start 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f164c06ab10 0x7f164c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f164c06c120 0x7f164c0c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c85a0 con 0x7f164c1602b0 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c7990 con 0x7f164c06ab10 2023-07-20T10:08:07.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0c7c70 con 0x7f164c06c120 2023-07-20T10:08:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40814/0 (socket says 172.21.15.82:40814) 2023-07-20T10:08:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 -- 172.21.15.82:0/1354728710 learned_addr learned my addr 172.21.15.82:0/1354728710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1650dd0640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f164c06ab10 0x7f164c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f164bfff640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f164c06c120 0x7f164c0c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 -- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f164c06c120 msgr2=0x7f164c0c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f164c06c120 0x7f164c0c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 -- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f164c06ab10 msgr2=0x7f164c0b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f164c06ab10 0x7f164c0b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 -- 172.21.15.82:0/1354728710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380094d0 con 0x7f164c1602b0 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16515d1640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f164400efc0 tx=0x7f164400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644014480 con 0x7f164c1602b0 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164400f040 con 0x7f164c1602b0 2023-07-20T10:08:07.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c0c7f50 con 0x7f164c1602b0 2023-07-20T10:08:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644014820 con 0x7f164c1602b0 2023-07-20T10:08:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c0c8f70 con 0x7f164c1602b0 2023-07-20T10:08:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c0c8750 con 0x7f164c1602b0 2023-07-20T10:08:07.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.395+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1644014980 con 0x7f164c1602b0 2023-07-20T10:08:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.399+0000 7f16497fa640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 0x7f1630068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.399+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f1644084f20 con 0x7f164c1602b0 2023-07-20T10:08:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.399+0000 7f1650dd0640 1 -- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 msgr2=0x7f1630068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:07.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.399+0000 7f1650dd0640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 0x7f1630068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:07.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.403+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f164c0c8750 con 0x7f164c1602b0 2023-07-20T10:08:07.441 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.463+0000 7f89dd02d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:08:07.526 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f89dd02d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:08:07.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f164c0c8750 con 0x7f164c1602b0 2023-07-20T10:08:07.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f16497fa640 1 -- 172.21.15.82:0/1354728710 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f164c0c8750 con 0x7f164c1602b0 2023-07-20T10:08:07.527 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:08:07.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 msgr2=0x7f1630068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 0x7f1630068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 msgr2=0x7f164c0cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f164400efc0 tx=0x7f164400c490 comp rx=0 tx=0).stop 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 shutdown_connections 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f16300664c0 0x7f1630068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f164c1602b0 0x7f164c0cf2c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f164c06c120 0x7f164c0c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.551+0000 7f1653034640 1 --2- 172.21.15.82:0/1354728710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f164c06ab10 0x7f164c0b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.555+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 >> 172.21.15.82:0/1354728710 conn(0x7f164c08c0a0 msgr2=0x7f164c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.555+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 shutdown_connections 2023-07-20T10:08:07.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.555+0000 7f1653034640 1 -- 172.21.15.82:0/1354728710 wait complete. 2023-07-20T10:08:07.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:08:07.630 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.656+0000 7fccca20c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:08:07.690 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:07.716+0000 7fccca20c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:08:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.715+0000 7f9723567640 1 Processor -- start 2023-07-20T10:08:07.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.715+0000 7f9723567640 1 -- start start 2023-07-20T10:08:07.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.715+0000 7f9723567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9723567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f971c15cac0 0x7f971c0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9723567640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c0cdb40 con 0x7f971c0d3200 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9723567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c0d07a0 con 0x7f971c15cac0 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9723567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0cd4f0 con 0x7f971c15c6e0 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f971c15cac0 0x7f971c0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f971c15cac0 0x7f971c0d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40822/0 (socket says 172.21.15.82:40822) 2023-07-20T10:08:07.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 -- 172.21.15.82:0/3223527487 learned_addr learned my addr 172.21.15.82:0/3223527487 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721303640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 -- 172.21.15.82:0/3223527487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 msgr2=0x7f971c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 -- 172.21.15.82:0/3223527487 >> v1:172.21.15.82:6789/0 conn(0x7f971c0d3200 legacy=0x7f971c0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 -- 172.21.15.82:0/3223527487 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c0cd7d0 con 0x7f971c15cac0 2023-07-20T10:08:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9721b04640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c15cac0 0x7f971c0d0be0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f9714009e50 tx=0x7f971401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2956e0d5e82b2d90 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9713fff640 1 -- 172.21.15.82:0/3223527487 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140a56c0 con 0x7f971c15cac0 2023-07-20T10:08:07.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9713fff640 1 -- 172.21.15.82:0/3223527487 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97140a5820 con 0x7f971c15cac0 2023-07-20T10:08:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.719+0000 7f9713fff640 1 -- 172.21.15.82:0/3223527487 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140a5bb0 con 0x7f971c15cac0 2023-07-20T10:08:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- 172.21.15.82:0/3223527487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c15cac0 msgr2=0x7f971c0d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c15cac0 0x7f971c0d0be0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f9714009e50 tx=0x7f971401c8f0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- 172.21.15.82:0/3223527487 shutdown_connections 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c15cac0 0x7f971c0d0be0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- 172.21.15.82:0/3223527487 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- 172.21.15.82:0/3223527487 >> 172.21.15.82:0/3223527487 conn(0x7f971c0d2600 msgr2=0x7f971c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- 172.21.15.82:0/3223527487 shutdown_connections 2023-07-20T10:08:07.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- 172.21.15.82:0/3223527487 wait complete. 2023-07-20T10:08:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 Processor -- start 2023-07-20T10:08:07.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- start start 2023-07-20T10:08:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 0x7f971c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c159cc0 con 0x7f971c0d3200 2023-07-20T10:08:07.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0b5da0 con 0x7f971c15cac0 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9723567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c15c090 con 0x7f971c15c6e0 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9721303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9721303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40836/0 (socket says 172.21.15.82:40836) 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9721303640 1 -- 172.21.15.82:0/2474684605 learned_addr learned my addr 172.21.15.82:0/2474684605 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9720b02640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.723+0000 7f9721b04640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 0x7f971c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:07.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 -- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 msgr2=0x7f971c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 -- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 msgr2=0x7f971c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 0x7f971c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 -- 172.21.15.82:0/2474684605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714009b30 con 0x7f971c0d3200 2023-07-20T10:08:07.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721b04640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 0x7f971c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:07.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9721303640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f971800e870 tx=0x7f971800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:07.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718009510 con 0x7f971c0d3200 2023-07-20T10:08:07.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971800eec0 con 0x7f971c0d3200 2023-07-20T10:08:07.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971800cb40 con 0x7f971c0d3200 2023-07-20T10:08:07.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c1547b0 con 0x7f971c0d3200 2023-07-20T10:08:07.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c15bd60 con 0x7f971c0d3200 2023-07-20T10:08:07.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c154610 con 0x7f971c0d3200 2023-07-20T10:08:07.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.727+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 54) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f971800cca0 con 0x7f971c0d3200 2023-07-20T10:08:07.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.731+0000 7f9711ffb640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 0x7f97000689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:07.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.731+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f9718084350 con 0x7f971c0d3200 2023-07-20T10:08:07.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.731+0000 7f9720b02640 1 -- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 msgr2=0x7f97000689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3916730360 2023-07-20T10:08:07.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.731+0000 7f9720b02640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 0x7f97000689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:07.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.735+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f971c154610 con 0x7f971c0d3200 2023-07-20T10:08:07.809 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.831+0000 7f89dd02d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:08:07.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.883+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f971c154cd0 con 0x7f971c0d3200 2023-07-20T10:08:07.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9711ffb640 1 -- 172.21.15.82:0/2474684605 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f971c154cd0 con 0x7f971c0d3200 2023-07-20T10:08:07.862 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:08:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 msgr2=0x7f97000689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 0x7f97000689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 msgr2=0x7f971c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:07.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f971800e870 tx=0x7f971800ec70 comp rx=0 tx=0).stop 2023-07-20T10:08:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 shutdown_connections 2023-07-20T10:08:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:6832/3916730360,v1:172.21.15.82:6833/3916730360] conn(0x7f97000664f0 0x7f97000689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f971c15cac0 0x7f971c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f971c15c6e0 0x7f971c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 --2- 172.21.15.82:0/2474684605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f971c0d3200 0x7f971c159780 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 >> 172.21.15.82:0/2474684605 conn(0x7f971c0d2600 msgr2=0x7f971c06b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 shutdown_connections 2023-07-20T10:08:07.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:07.887+0000 7f9723567640 1 -- 172.21.15.82:0/2474684605 wait complete. 2023-07-20T10:08:07.871 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.895+0000 7f89dd02d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:08:07.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:08:07.948 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8965203640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.949 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8965203640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.949 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8965203640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.949 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8965203640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.949 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8965203640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8968a0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8968a0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8968a0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8968a0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:07.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:07.971+0000 7f8968a0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:08.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.067+0000 7f81c06cb640 1 Processor -- start 2023-07-20T10:08:08.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.067+0000 7f81c06cb640 1 -- start start 2023-07-20T10:08:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81c06cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81c06cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81b80ce5a0 0x7f81b806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81c06cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b8160ff0 con 0x7f81b815a340 2023-07-20T10:08:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81c06cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b815a720 con 0x7f81b80ce5a0 2023-07-20T10:08:08.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81c06cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80cea10 con 0x7f81b806c360 2023-07-20T10:08:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81be467640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f81b815a340 0x7f81b815d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44884/0 (socket says 172.21.15.82:44884) 2023-07-20T10:08:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81be467640 1 -- 172.21.15.82:0/3577867962 learned_addr learned my addr 172.21.15.82:0/3577867962 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bdc66640 1 --2- 172.21.15.82:0/3577867962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bec68640 1 --2- 172.21.15.82:0/3577867962 >> v2:172.21.15.183:3300/0 conn(0x7f81b80ce5a0 0x7f81b806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bd465640 1 -- 172.21.15.82:0/3577867962 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811849088 0 0) 0x7f81b8160ff0 con 0x7f81b815a340 2023-07-20T10:08:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bd465640 1 -- 172.21.15.82:0/3577867962 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a4003530 con 0x7f81b815a340 2023-07-20T10:08:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bdc66640 1 -- 172.21.15.82:0/3577867962 >> v2:172.21.15.183:3300/0 conn(0x7f81b80ce5a0 msgr2=0x7f81b806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bdc66640 1 --2- 172.21.15.82:0/3577867962 >> v2:172.21.15.183:3300/0 conn(0x7f81b80ce5a0 0x7f81b806ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bdc66640 1 -- 172.21.15.82:0/3577867962 >> v1:172.21.15.82:6789/0 conn(0x7f81b815a340 legacy=0x7f81b815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.071+0000 7f81bdc66640 1 -- 172.21.15.82:0/3577867962 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b81603e0 con 0x7f81b806c360 2023-07-20T10:08:08.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81bdc66640 1 --2- 172.21.15.82:0/3577867962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b80ce060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097c0 tx=0x7f81a801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db07651e18e89cf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81bd465640 1 -- 172.21.15.82:0/3577867962 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80ab650 con 0x7f81b806c360 2023-07-20T10:08:08.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81bd465640 1 -- 172.21.15.82:0/3577867962 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a80ab7b0 con 0x7f81b806c360 2023-07-20T10:08:08.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81bd465640 1 -- 172.21.15.82:0/3577867962 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80abb40 con 0x7f81b806c360 2023-07-20T10:08:08.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- 172.21.15.82:0/3577867962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 msgr2=0x7f81b80ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- 172.21.15.82:0/3577867962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b80ce060 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f81a80097c0 tx=0x7f81a801c450 comp rx=0 tx=0).stop 2023-07-20T10:08:08.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- 172.21.15.82:0/3577867962 shutdown_connections 2023-07-20T10:08:08.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- 172.21.15.82:0/3577867962 >> v2:172.21.15.183:3300/0 conn(0x7f81b80ce5a0 0x7f81b806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- 172.21.15.82:0/3577867962 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b80ce060 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- 172.21.15.82:0/3577867962 >> 172.21.15.82:0/3577867962 conn(0x7f81b8065310 msgr2=0x7f81b8065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- 172.21.15.82:0/3577867962 shutdown_connections 2023-07-20T10:08:08.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- 172.21.15.82:0/3577867962 wait complete. 2023-07-20T10:08:08.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 Processor -- start 2023-07-20T10:08:08.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- start start 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b8145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81b80ce5a0 0x7f81b80c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c6c30 con 0x7f81b815a340 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c4060 con 0x7f81b80ce5a0 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.075+0000 7f81c06cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8158000 con 0x7f81b806c360 2023-07-20T10:08:08.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40932/0 (socket says 172.21.15.82:40932) 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 -- 172.21.15.82:0/4147823721 learned_addr learned my addr 172.21.15.82:0/4147823721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bdc66640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81b80ce5a0 0x7f81b80c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81be467640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b8145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 -- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 msgr2=0x7f81b8145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b8145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 -- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81b80ce5a0 msgr2=0x7f81b80c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81b80ce5a0 0x7f81b80c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 -- 172.21.15.82:0/4147823721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8009420 con 0x7f81b815a340 2023-07-20T10:08:08.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81bec68640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e7f0 tx=0x7f81b000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0009530 con 0x7f81b815a340 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000eea0 con 0x7f81b815a340 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b81582e0 con 0x7f81b815a340 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000cb60 con 0x7f81b815a340 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b81588a0 con 0x7f81b815a340 2023-07-20T10:08:08.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b80b1d10 con 0x7f81b815a340 2023-07-20T10:08:08.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.079+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 55) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f81b000ccc0 con 0x7f81b815a340 2023-07-20T10:08:08.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.083+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f81b0083c60 con 0x7f81b815a340 2023-07-20T10:08:08.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.087+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81b0051170 con 0x7f81b815a340 2023-07-20T10:08:08.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.231+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f81b8158a90 con 0x7f81b815a340 2023-07-20T10:08:08.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.231+0000 7f81aeffd640 1 -- 172.21.15.82:0/4147823721 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81b0054790 con 0x7f81b815a340 2023-07-20T10:08:08.209 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:08:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 msgr2=0x7f81b80cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e7f0 tx=0x7f81b000ecb0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 shutdown_connections 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b815a340 0x7f81b80cbd50 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81b80ce5a0 0x7f81b80c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 --2- 172.21.15.82:0/4147823721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81b806c360 0x7f81b8145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 >> 172.21.15.82:0/4147823721 conn(0x7f81b8065310 msgr2=0x7f81b80b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 shutdown_connections 2023-07-20T10:08:08.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.235+0000 7f81c06cb640 1 -- 172.21.15.82:0/4147823721 wait complete. 2023-07-20T10:08:08.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:08:08.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 Processor -- start 2023-07-20T10:08:08.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 -- start start 2023-07-20T10:08:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 0x7f13380ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13380ad580 0x7f13380b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1338160390 con 0x7f1338160820 2023-07-20T10:08:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380b0670 con 0x7f13380ad580 2023-07-20T10:08:08.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133f696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380cc1d0 con 0x7f13380afd50 2023-07-20T10:08:08.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13380ad580 0x7f13380b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13380ad580 0x7f13380b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40940/0 (socket says 172.21.15.82:40940) 2023-07-20T10:08:08.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 -- 172.21.15.82:0/2495985668 learned_addr learned my addr 172.21.15.82:0/2495985668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:08.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133d432640 1 --2- 172.21.15.82:0/2495985668 >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 0x7f13380ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 -- 172.21.15.82:0/2495985668 >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 msgr2=0x7f13380ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:08.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 --2- 172.21.15.82:0/2495985668 >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 0x7f13380ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 -- 172.21.15.82:0/2495985668 >> v1:172.21.15.183:6789/0 conn(0x7f1338160820 legacy=0x7f1338160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133cc31640 1 -- 172.21.15.82:0/2495985668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380cc4b0 con 0x7f13380ad580 2023-07-20T10:08:08.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.395+0000 7f133d432640 1 --2- 172.21.15.82:0/2495985668 >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 0x7f13380ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:08.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133cc31640 1 --2- 172.21.15.82:0/2495985668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380ad580 0x7f13380b0130 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f133806c650 tx=0x7f132801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74db2aed6e53b143 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f132ffff640 1 -- 172.21.15.82:0/2495985668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280ab670 con 0x7f13380ad580 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f132ffff640 1 -- 172.21.15.82:0/2495985668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280ab7d0 con 0x7f13380ad580 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f132ffff640 1 -- 172.21.15.82:0/2495985668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280abb60 con 0x7f13380ad580 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 -- 172.21.15.82:0/2495985668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380ad580 msgr2=0x7f13380b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 --2- 172.21.15.82:0/2495985668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380ad580 0x7f13380b0130 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f133806c650 tx=0x7f132801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 -- 172.21.15.82:0/2495985668 shutdown_connections 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 --2- 172.21.15.82:0/2495985668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380ad580 0x7f13380b0130 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 --2- 172.21.15.82:0/2495985668 >> v2:172.21.15.183:3300/0 conn(0x7f13380afd50 0x7f13380ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 -- 172.21.15.82:0/2495985668 >> 172.21.15.82:0/2495985668 conn(0x7f13380cad50 msgr2=0x7f13380cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 -- 172.21.15.82:0/2495985668 shutdown_connections 2023-07-20T10:08:08.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.399+0000 7f133f696640 1 -- 172.21.15.82:0/2495985668 wait complete. 2023-07-20T10:08:08.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 Processor -- start 2023-07-20T10:08:08.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- start start 2023-07-20T10:08:08.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 0x7f133815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1338160820 0x7f133815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338157860 con 0x7f13380afd50 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338154f10 con 0x7f1338160820 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133815a810 con 0x7f13380ad580 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40954/0 (socket says 172.21.15.82:40954) 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 -- 172.21.15.82:0/756160337 learned_addr learned my addr 172.21.15.82:0/756160337 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:08.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133dc33640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1338160820 0x7f133815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133d432640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 0x7f133815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 -- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 msgr2=0x7f133815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 0x7f133815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 -- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1338160820 msgr2=0x7f133815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1338160820 0x7f133815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 -- 172.21.15.82:0/756160337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280094d0 con 0x7f13380afd50 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133d432640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 0x7f133815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:08.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133cc31640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f132801c9b0 tx=0x7f132801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280b4800 con 0x7f13380afd50 2023-07-20T10:08:08.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280b4980 con 0x7f13380afd50 2023-07-20T10:08:08.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13280b4d30 con 0x7f13380afd50 2023-07-20T10:08:08.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1338156f00 con 0x7f13380afd50 2023-07-20T10:08:08.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.403+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13381571a0 con 0x7f13380afd50 2023-07-20T10:08:08.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.407+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13381579a0 con 0x7f13380afd50 2023-07-20T10:08:08.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.407+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 55) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f13280b3380 con 0x7f13380afd50 2023-07-20T10:08:08.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.407+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f132811e470 con 0x7f13380afd50 2023-07-20T10:08:08.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.411+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13381579a0 con 0x7f13380afd50 2023-07-20T10:08:08.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.555+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13381579a0 con 0x7f13380afd50 2023-07-20T10:08:08.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.555+0000 7f132dffb640 1 -- 172.21.15.82:0/756160337 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13381579a0 con 0x7f13380afd50 2023-07-20T10:08:08.533 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:08:08.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 msgr2=0x7f133815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f132801c9b0 tx=0x7f132801ad10 comp rx=0 tx=0).stop 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 shutdown_connections 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1338160820 0x7f133815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13380afd50 0x7f133815e670 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 --2- 172.21.15.82:0/756160337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13380ad580 0x7f133815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 >> 172.21.15.82:0/756160337 conn(0x7f13380cad50 msgr2=0x7f1338160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 shutdown_connections 2023-07-20T10:08:08.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.559+0000 7f133f696640 1 -- 172.21.15.82:0/756160337 wait complete. 2023-07-20T10:08:08.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.715+0000 7f843bc34640 1 Processor -- start 2023-07-20T10:08:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.715+0000 7f843bc34640 1 -- start start 2023-07-20T10:08:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843bc34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f84340ad060 0x7f84340ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843bc34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340cde70 con 0x7f84340b0290 2023-07-20T10:08:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843bc34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340cbef0 con 0x7f84340afe10 2023-07-20T10:08:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843bc34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340ad440 con 0x7f84340ad060 2023-07-20T10:08:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843a1d1640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f84340b0290 0x7f843415d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44892/0 (socket says 172.21.15.82:44892) 2023-07-20T10:08:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f843a1d1640 1 -- 172.21.15.82:0/3665156826 learned_addr learned my addr 172.21.15.82:0/3665156826 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84399d0640 1 --2- 172.21.15.82:0/3665156826 >> v2:172.21.15.183:3300/0 conn(0x7f84340ad060 0x7f84340ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052447067 0 0) 0x7f84340cde70 con 0x7f84340b0290 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8420003530 con 0x7f84340b0290 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723037175 0 0) 0x7f84340cbef0 con 0x7f84340afe10 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84340cde70 con 0x7f84340afe10 2023-07-20T10:08:08.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84399d0640 1 -- 172.21.15.82:0/3665156826 >> v1:172.21.15.183:6789/0 conn(0x7f84340afe10 legacy=0x7f843415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84399d0640 1 -- 172.21.15.82:0/3665156826 >> v1:172.21.15.82:6789/0 conn(0x7f84340b0290 legacy=0x7f843415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.719+0000 7f84399d0640 1 -- 172.21.15.82:0/3665156826 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843415d730 con 0x7f84340ad060 2023-07-20T10:08:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f84399d0640 1 --2- 172.21.15.82:0/3665156826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340ad060 0x7f84340ca040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8430009d90 tx=0x7f843001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b52923746b21f3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a5920 con 0x7f84340ad060 2023-07-20T10:08:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a5a80 con 0x7f84340ad060 2023-07-20T10:08:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f84389ce640 1 -- 172.21.15.82:0/3665156826 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a5df0 con 0x7f84340ad060 2023-07-20T10:08:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- 172.21.15.82:0/3665156826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340ad060 msgr2=0x7f84340ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 --2- 172.21.15.82:0/3665156826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340ad060 0x7f84340ca040 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8430009d90 tx=0x7f843001c950 comp rx=0 tx=0).stop 2023-07-20T10:08:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- 172.21.15.82:0/3665156826 shutdown_connections 2023-07-20T10:08:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 --2- 172.21.15.82:0/3665156826 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340ad060 0x7f84340ca040 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- 172.21.15.82:0/3665156826 >> 172.21.15.82:0/3665156826 conn(0x7f84340cada0 msgr2=0x7f84340cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- 172.21.15.82:0/3665156826 shutdown_connections 2023-07-20T10:08:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- 172.21.15.82:0/3665156826 wait complete. 2023-07-20T10:08:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 Processor -- start 2023-07-20T10:08:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.723+0000 7f843bc34640 1 -- start start 2023-07-20T10:08:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84340afe10 0x7f8434164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 0x7f84341543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843406caf0 con 0x7f84340ad060 2023-07-20T10:08:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434164ab0 con 0x7f84340b0290 2023-07-20T10:08:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843406be70 con 0x7f84340afe10 2023-07-20T10:08:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40962/0 (socket says 172.21.15.82:40962) 2023-07-20T10:08:08.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 -- 172.21.15.82:0/1871367514 learned_addr learned my addr 172.21.15.82:0/1871367514 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843a1d1640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 0x7f84341543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84391cf640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84340afe10 0x7f8434164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 -- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84340afe10 msgr2=0x7f8434164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84340afe10 0x7f8434164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 -- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 msgr2=0x7f84341543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 0x7f84341543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 -- 172.21.15.82:0/1871367514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009a70 con 0x7f84340ad060 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843a1d1640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 0x7f84341543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f84399d0640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f843001a580 tx=0x7f84300196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430003db0 con 0x7f84340ad060 2023-07-20T10:08:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430004040 con 0x7f84340ad060 2023-07-20T10:08:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300043d0 con 0x7f84340ad060 2023-07-20T10:08:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843406c150 con 0x7f84340ad060 2023-07-20T10:08:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843406c710 con 0x7f84340ad060 2023-07-20T10:08:08.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8434073c70 con 0x7f84340ad060 2023-07-20T10:08:08.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.727+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 55) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f84300b4050 con 0x7f84340ad060 2023-07-20T10:08:08.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.731+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f843011ec50 con 0x7f84340ad060 2023-07-20T10:08:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.735+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84300ec1d0 con 0x7f84340ad060 2023-07-20T10:08:08.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.911+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 56) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f84300ebc80 con 0x7f84340ad060 2023-07-20T10:08:08.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.911+0000 7f842a7fc640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 0x7f841806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:08.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.911+0000 7f84391cf640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 0x7f841806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:08.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.915+0000 7f84391cf640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 0x7f841806e670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84340b0ec0 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:08.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.915+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84340cbbd0 con 0x7f84340ad060 2023-07-20T10:08:08.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.915+0000 7f842a7fc640 1 -- 172.21.15.82:0/1871367514 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f84300c4310 con 0x7f84340ad060 2023-07-20T10:08:08.892 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:08.892 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:08:08.892 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:08:08.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 msgr2=0x7f841806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 0x7f841806e670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f84340b0ec0 tx=0x7f8424009040 comp rx=0 tx=0).stop 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 msgr2=0x7f843406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f843001a580 tx=0x7f84300196f0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 shutdown_connections 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f841806c280 0x7f841806e670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84340b0290 0x7f84341543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84340afe10 0x7f8434164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 --2- 172.21.15.82:0/1871367514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84340ad060 0x7f843406b7b0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 >> 172.21.15.82:0/1871367514 conn(0x7f84340cada0 msgr2=0x7f8434070aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 shutdown_connections 2023-07-20T10:08:08.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:08.919+0000 7f843bc34640 1 -- 172.21.15.82:0/1871367514 wait complete. 2023-07-20T10:08:08.914 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:09.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.075+0000 7f5f7e419640 1 Processor -- start 2023-07-20T10:08:09.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.075+0000 7f5f7e419640 1 -- start start 2023-07-20T10:08:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7e419640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f780afda0 0x7f5f780ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7e419640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f780b2060 0x7f5f780b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7e419640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f780b06c0 con 0x7f5f7815a8e0 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7e419640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780b3160 con 0x7f5f780afda0 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7e419640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780b12a0 con 0x7f5f780b2060 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f777fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f7815a8e0 0x7f5f780b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44904/0 (socket says 172.21.15.82:44904) 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f777fe640 1 -- 172.21.15.82:0/3057066118 learned_addr learned my addr 172.21.15.82:0/3057066118 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:09.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f77fff640 1 --2- 172.21.15.82:0/3057066118 >> v2:172.21.15.183:3300/0 conn(0x7f5f780afda0 0x7f5f780ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f7c9b6640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f780b2060 0x7f5f780b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f76ffd640 1 -- 172.21.15.82:0/3057066118 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199497456 0 0) 0x7f5f780b06c0 con 0x7f5f7815a8e0 2023-07-20T10:08:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f77fff640 1 -- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f780b2060 msgr2=0x7f5f780b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:09.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f77fff640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f780b2060 0x7f5f780b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f77fff640 1 -- 172.21.15.82:0/3057066118 >> v1:172.21.15.82:6789/0 conn(0x7f5f7815a8e0 legacy=0x7f5f780b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.079+0000 7f5f77fff640 1 -- 172.21.15.82:0/3057066118 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780b1580 con 0x7f5f780afda0 2023-07-20T10:08:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f77fff640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f780ca6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097c0 tx=0x7f5f6801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a764a9046598e1b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f76ffd640 1 -- 172.21.15.82:0/3057066118 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680ab600 con 0x7f5f780afda0 2023-07-20T10:08:09.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f76ffd640 1 -- 172.21.15.82:0/3057066118 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680a7050 con 0x7f5f780afda0 2023-07-20T10:08:09.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f76ffd640 1 -- 172.21.15.82:0/3057066118 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680ab980 con 0x7f5f780afda0 2023-07-20T10:08:09.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 msgr2=0x7f5f780ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f780ca6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5f680097c0 tx=0x7f5f6801c330 comp rx=0 tx=0).stop 2023-07-20T10:08:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- 172.21.15.82:0/3057066118 shutdown_connections 2023-07-20T10:08:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f780b2060 0x7f5f780b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 --2- 172.21.15.82:0/3057066118 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f780ca6b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- 172.21.15.82:0/3057066118 >> 172.21.15.82:0/3057066118 conn(0x7f5f780cada0 msgr2=0x7f5f780cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- 172.21.15.82:0/3057066118 shutdown_connections 2023-07-20T10:08:09.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- 172.21.15.82:0/3057066118 wait complete. 2023-07-20T10:08:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 Processor -- start 2023-07-20T10:08:09.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.083+0000 7f5f7e419640 1 -- start start 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f7815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7815a8e0 0x7f5f7806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78151d30 con 0x7f5f780b2060 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78164d20 con 0x7f5f780afda0 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78165000 con 0x7f5f7815a8e0 2023-07-20T10:08:09.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40974/0 (socket says 172.21.15.82:40974) 2023-07-20T10:08:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 -- 172.21.15.82:0/1565149735 learned_addr learned my addr 172.21.15.82:0/1565149735 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f77fff640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f7815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7c9b6640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7815a8e0 0x7f5f7806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 -- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7815a8e0 msgr2=0x7f5f7806f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7815a8e0 0x7f5f7806f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 -- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 msgr2=0x7f5f7815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f7815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 -- 172.21.15.82:0/1565149735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009420 con 0x7f5f780b2060 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f777fe640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c450 tx=0x7f5f6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0074e0 con 0x7f5f780b2060 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c007640 con 0x7f5f780b2060 2023-07-20T10:08:09.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f780cbf90 con 0x7f5f780b2060 2023-07-20T10:08:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0049f0 con 0x7f5f780b2060 2023-07-20T10:08:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f780cc550 con 0x7f5f780b2060 2023-07-20T10:08:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.087+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f780cc770 con 0x7f5f780b2060 2023-07-20T10:08:09.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.091+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 56) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5f6c004b50 con 0x7f5f780b2060 2023-07-20T10:08:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.091+0000 7f5f74ff9640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 0x7f5f64068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.091+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f5f6c0832a0 con 0x7f5f780b2060 2023-07-20T10:08:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.091+0000 7f5f77fff640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 0x7f5f64068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.091+0000 7f5f77fff640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 0x7f5f64068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ad000 tx=0x7f5f680a6000 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.095+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f6c0506c0 con 0x7f5f780b2060 2023-07-20T10:08:09.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f78073c70 con 0x7f5f780b2060 2023-07-20T10:08:09.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f74ff9640 1 -- 172.21.15.82:0/1565149735 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+19600 (secure 0 0 0) 0x7f5f6c018090 con 0x7f5f780b2060 2023-07-20T10:08:09.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:09.220 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":111,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:07.899922+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/3691570425":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2887507161":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2466713202":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2223184229":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/4013363770":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2674254560":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2315466586":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3754899936":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6833/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/4185959370":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2979139926":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3707206980":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/1784618799":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/635904395":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2038385173":"2023-07-21T10:07:01.288326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:09.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 msgr2=0x7f5f64068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 0x7f5f64068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ad000 tx=0x7f5f680a6000 comp rx=0 tx=0).stop 2023-07-20T10:08:09.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 msgr2=0x7f5f78164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00c450 tx=0x7f5f6c00c910 comp rx=0 tx=0).stop 2023-07-20T10:08:09.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 shutdown_connections 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7815a8e0 0x7f5f7806f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f780b2060 0x7f5f78164410 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5f640660d0 0x7f5f64068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 --2- 172.21.15.82:0/1565149735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f780afda0 0x7f5f7815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 >> 172.21.15.82:0/1565149735 conn(0x7f5f780cada0 msgr2=0x7f5f7806c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 shutdown_connections 2023-07-20T10:08:09.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.243+0000 7f5f7e419640 1 -- 172.21.15.82:0/1565149735 wait complete. 2023-07-20T10:08:09.240 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:08:09.241 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:09.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 Processor -- start 2023-07-20T10:08:09.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 -- start start 2023-07-20T10:08:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb1c0d1170 0x7feb1c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0b3520 con 0x7feb1c15cab0 2023-07-20T10:08:09.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0d0a10 con 0x7feb1c0d0d10 2023-07-20T10:08:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb2329c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c0d31c0 con 0x7feb1c0d1170 2023-07-20T10:08:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21038640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feb1c15cab0 0x7feb1c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44918/0 (socket says 172.21.15.82:44918) 2023-07-20T10:08:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21038640 1 -- 172.21.15.82:0/1711816373 learned_addr learned my addr 172.21.15.82:0/1711816373 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:09.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21839640 1 --2- 172.21.15.82:0/1711816373 >> v2:172.21.15.82:3300/0 conn(0x7feb1c0d1170 0x7feb1c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb13fff640 1 -- 172.21.15.82:0/1711816373 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677003080 0 0) 0x7feb1c0b3520 con 0x7feb1c15cab0 2023-07-20T10:08:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb13fff640 1 -- 172.21.15.82:0/1711816373 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb08003530 con 0x7feb1c15cab0 2023-07-20T10:08:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21839640 1 -- 172.21.15.82:0/1711816373 >> v1:172.21.15.183:6789/0 conn(0x7feb1c0d0d10 legacy=0x7feb1c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21839640 1 -- 172.21.15.82:0/1711816373 >> v1:172.21.15.82:6789/0 conn(0x7feb1c15cab0 legacy=0x7feb1c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.403+0000 7feb21839640 1 -- 172.21.15.82:0/1711816373 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0b2910 con 0x7feb1c0d1170 2023-07-20T10:08:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb21839640 1 --2- 172.21.15.82:0/1711816373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c0cdbc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7feb14009d90 tx=0x7feb1401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135db9ca0f2a67e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb13fff640 1 -- 172.21.15.82:0/1711816373 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140a5940 con 0x7feb1c0d1170 2023-07-20T10:08:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb13fff640 1 -- 172.21.15.82:0/1711816373 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb140a5aa0 con 0x7feb1c0d1170 2023-07-20T10:08:09.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb13fff640 1 -- 172.21.15.82:0/1711816373 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140a5e10 con 0x7feb1c0d1170 2023-07-20T10:08:09.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 -- 172.21.15.82:0/1711816373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 msgr2=0x7feb1c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 --2- 172.21.15.82:0/1711816373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c0cdbc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7feb14009d90 tx=0x7feb1401c8f0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 -- 172.21.15.82:0/1711816373 shutdown_connections 2023-07-20T10:08:09.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 --2- 172.21.15.82:0/1711816373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c0cdbc0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 -- 172.21.15.82:0/1711816373 >> 172.21.15.82:0/1711816373 conn(0x7feb1c08c120 msgr2=0x7feb1c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 -- 172.21.15.82:0/1711816373 shutdown_connections 2023-07-20T10:08:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.407+0000 7feb2329c640 1 -- 172.21.15.82:0/1711816373 wait complete. 2023-07-20T10:08:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 Processor -- start 2023-07-20T10:08:09.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- start start 2023-07-20T10:08:09.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb1c0d0d10 0x7feb1c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 0x7feb1c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b7b20 con 0x7feb1c0d1170 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b6f90 con 0x7feb1c0d0d10 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c15c450 con 0x7feb1c15cab0 2023-07-20T10:08:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40994/0 (socket says 172.21.15.82:40994) 2023-07-20T10:08:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 -- 172.21.15.82:0/1129074425 learned_addr learned my addr 172.21.15.82:0/1129074425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb21038640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb1c0d0d10 0x7feb1c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb21839640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 0x7feb1c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 -- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 msgr2=0x7feb1c0b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 0x7feb1c0b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 -- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb1c0d0d10 msgr2=0x7feb1c0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb1c0d0d10 0x7feb1c0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 -- 172.21.15.82:0/1129074425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009a70 con 0x7feb1c0d1170 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb21839640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 0x7feb1c0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb20837640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c370 tx=0x7feb0c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c0052d0 con 0x7feb1c0d1170 2023-07-20T10:08:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c005430 con 0x7feb1c0d1170 2023-07-20T10:08:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c007260 con 0x7feb1c0d1170 2023-07-20T10:08:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c0b7180 con 0x7feb1c0d1170 2023-07-20T10:08:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.411+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c0b7740 con 0x7feb1c0d1170 2023-07-20T10:08:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c0b7c60 con 0x7feb1c0d1170 2023-07-20T10:08:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 56) v1 ==== 85496+0+0 (secure 0 0 0) 0x7feb0c0073c0 con 0x7feb1c0d1170 2023-07-20T10:08:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb11ffb640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 0x7feb00068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7feb0c0830b0 con 0x7feb1c0d1170 2023-07-20T10:08:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb21038640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 0x7feb00068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.415+0000 7feb21038640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 0x7feb00068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb180011f0 tx=0x7feb18007d40 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.419+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb1c0b7c60 con 0x7feb1c0d1170 2023-07-20T10:08:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb1c0b7c60 con 0x7feb1c0d1170 2023-07-20T10:08:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb11ffb640 1 -- 172.21.15.82:0/1129074425 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7feb1c0b7c60 con 0x7feb1c0d1170 2023-07-20T10:08:09.572 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:09.572 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:08:09.572 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:08:09.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 msgr2=0x7feb00068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 0x7feb00068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feb180011f0 tx=0x7feb18007d40 comp rx=0 tx=0).stop 2023-07-20T10:08:09.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 msgr2=0x7feb1c153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7feb0c00c370 tx=0x7feb0c00c830 comp rx=0 tx=0).stop 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 shutdown_connections 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb1c15cab0 0x7feb1c0b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb1c0d1170 0x7feb1c153e30 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7feb000660d0 0x7feb00068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 --2- 172.21.15.82:0/1129074425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb1c0d0d10 0x7feb1c0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 >> 172.21.15.82:0/1129074425 conn(0x7feb1c08c120 msgr2=0x7feb1c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 shutdown_connections 2023-07-20T10:08:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.595+0000 7feb2329c640 1 -- 172.21.15.82:0/1129074425 wait complete. 2023-07-20T10:08:09.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:09.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 Processor -- start 2023-07-20T10:08:09.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 -- start start 2023-07-20T10:08:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9eb40afda0 0x7f9eb40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40b2ee0 con 0x7f9eb40b2060 2023-07-20T10:08:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb40b3160 con 0x7f9eb40afda0 2023-07-20T10:08:09.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.755+0000 7f9ebaf8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b12a0 con 0x7f9eb415a8e0 2023-07-20T10:08:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9eb40afda0 0x7f9eb40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9eb40afda0 0x7f9eb40ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:37546/0 (socket says 172.21.15.82:37546) 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 -- 172.21.15.82:0/4033976316 learned_addr learned my addr 172.21.15.82:0/4033976316 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb952c640 1 --1- 172.21.15.82:0/4033976316 >> v1:172.21.15.183:6789/0 conn(0x7f9eb40b2060 0x7f9eb40b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:40088/0 (socket says 172.21.15.82:40088) 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eabfff640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eab7fe640 1 -- 172.21.15.82:0/4033976316 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509226568 0 0) 0x7f9eb40b2ee0 con 0x7f9eb40b2060 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eab7fe640 1 -- 172.21.15.82:0/4033976316 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c003530 con 0x7f9eb40b2060 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 -- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 msgr2=0x7f9eb40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:09.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 -- 172.21.15.82:0/4033976316 >> v1:172.21.15.183:6789/0 conn(0x7f9eb40b2060 legacy=0x7f9eb40b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 -- 172.21.15.82:0/4033976316 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb40b1580 con 0x7f9eb40afda0 2023-07-20T10:08:09.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eb8d2b640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40ca6b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00098a0 tx=0x7f9eb001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27226f7fef2efeb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eab7fe640 1 -- 172.21.15.82:0/4033976316 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00ac630 con 0x7f9eb40afda0 2023-07-20T10:08:09.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eab7fe640 1 -- 172.21.15.82:0/4033976316 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00ac790 con 0x7f9eb40afda0 2023-07-20T10:08:09.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.759+0000 7f9eab7fe640 1 -- 172.21.15.82:0/4033976316 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00acb20 con 0x7f9eb40afda0 2023-07-20T10:08:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 msgr2=0x7f9eb40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40ca6b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00098a0 tx=0x7f9eb001c3d0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4033976316 shutdown_connections 2023-07-20T10:08:09.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4033976316 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40ca6b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4033976316 >> 172.21.15.82:0/4033976316 conn(0x7f9eb40cada0 msgr2=0x7f9eb40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4033976316 shutdown_connections 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4033976316 wait complete. 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 Processor -- start 2023-07-20T10:08:09.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- start start 2023-07-20T10:08:09.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb415a1d0 con 0x7f9eb40b2060 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41532e0 con 0x7f9eb40afda0 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9ebaf8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40c6e00 con 0x7f9eb415a8e0 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40996/0 (socket says 172.21.15.82:40996) 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9eabfff640 1 -- 172.21.15.82:0/4103947142 learned_addr learned my addr 172.21.15.82:0/4103947142 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9eb8d2b640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.763+0000 7f9eb952c640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 -- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 msgr2=0x7f9eb40abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 -- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 msgr2=0x7f9eb40c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 -- 172.21.15.82:0/4103947142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00094d0 con 0x7f9eb40b2060 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eabfff640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e8a0 tx=0x7f9ea400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4009510 con 0x7f9eb40b2060 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400c940 con 0x7f9eb40b2060 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb415b260 con 0x7f9eb40b2060 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400ccb0 con 0x7f9eb40b2060 2023-07-20T10:08:09.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb415b820 con 0x7f9eb40b2060 2023-07-20T10:08:09.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb4073c70 con 0x7f9eb40b2060 2023-07-20T10:08:09.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 56) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9ea4013470 con 0x7f9eb40b2060 2023-07-20T10:08:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 0x7f9ea00685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f9ea4083d30 con 0x7f9eb40b2060 2023-07-20T10:08:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.767+0000 7f9eb8d2b640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 0x7f9ea00685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:09.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.771+0000 7f9eb8d2b640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 0x7f9ea00685c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00ae000 tx=0x7f9eb00a7000 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:09.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.771+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ea40511a0 con 0x7f9eb40b2060 2023-07-20T10:08:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.951+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9eb40ccb10 con 0x7f9eb40b2060 2023-07-20T10:08:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ea97fa640 1 -- 172.21.15.82:0/4103947142 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f9ea40547c0 con 0x7f9eb40b2060 2023-07-20T10:08:09.930 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:09.930 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:06:43.832751+0000","modified":"2023-07-20T10:06:47.478656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7800},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7800":{"gid":7800,"name":"d","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.183:6835/886744377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":886744377},{"type":"v1","addr":"172.21.15.183:6835","nonce":886744377}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-20T10:08:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 50 2023-07-20T10:08:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 msgr2=0x7f9ea00685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 0x7f9ea00685c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9eb00ae000 tx=0x7f9eb00a7000 comp rx=0 tx=0).stop 2023-07-20T10:08:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 msgr2=0x7f9eb4159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400e8a0 tx=0x7f9ea400eca0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 shutdown_connections 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9eb415a8e0 0x7f9eb40abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9eb40b2060 0x7f9eb4159c90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9ea0066100 0x7f9ea00685c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 --2- 172.21.15.82:0/4103947142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9eb40afda0 0x7f9eb40c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 >> 172.21.15.82:0/4103947142 conn(0x7f9eb40cada0 msgr2=0x7f9eb406fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 shutdown_connections 2023-07-20T10:08:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:09.955+0000 7f9ebaf8f640 1 -- 172.21.15.82:0/4103947142 wait complete. 2023-07-20T10:08:09.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:10.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.119+0000 7f30ba396640 1 Processor -- start 2023-07-20T10:08:10.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 -- start start 2023-07-20T10:08:10.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30b41596b0 0x7f30b415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30b40b2380 0x7f30b40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40b2d50 con 0x7f30b41596b0 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b40ad600 con 0x7f30b40b2380 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30ba396640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b40ccd60 con 0x7f30b40cc900 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30b41596b0 0x7f30b415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f30b41596b0 0x7f30b415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41036/0 (socket says 172.21.15.82:41036) 2023-07-20T10:08:10.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 -- 172.21.15.82:0/377441434 learned_addr learned my addr 172.21.15.82:0/377441434 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b8933640 1 --2- 172.21.15.82:0/377441434 >> v2:172.21.15.183:3300/0 conn(0x7f30b40b2380 0x7f30b40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b37fe640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 -- 172.21.15.82:0/377441434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 msgr2=0x7f30b40ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b40ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 -- 172.21.15.82:0/377441434 >> v2:172.21.15.183:3300/0 conn(0x7f30b40b2380 msgr2=0x7f30b40b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 --2- 172.21.15.82:0/377441434 >> v2:172.21.15.183:3300/0 conn(0x7f30b40b2380 0x7f30b40b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.123+0000 7f30b3fff640 1 -- 172.21.15.82:0/377441434 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40ad810 con 0x7f30b41596b0 2023-07-20T10:08:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30b3fff640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b41596b0 0x7f30b415dbb0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f30b40b0e20 tx=0x7f30a401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5156edbb025b3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30b2ffd640 1 -- 172.21.15.82:0/377441434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40a7c30 con 0x7f30b41596b0 2023-07-20T10:08:10.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30b2ffd640 1 -- 172.21.15.82:0/377441434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a40a7d90 con 0x7f30b41596b0 2023-07-20T10:08:10.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30b2ffd640 1 -- 172.21.15.82:0/377441434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40af660 con 0x7f30b41596b0 2023-07-20T10:08:10.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- 172.21.15.82:0/377441434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b41596b0 msgr2=0x7f30b415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b41596b0 0x7f30b415dbb0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f30b40b0e20 tx=0x7f30a401eba0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- 172.21.15.82:0/377441434 shutdown_connections 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 --2- 172.21.15.82:0/377441434 >> v2:172.21.15.183:3300/0 conn(0x7f30b40b2380 0x7f30b40b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b40ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 --2- 172.21.15.82:0/377441434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b41596b0 0x7f30b415dbb0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- 172.21.15.82:0/377441434 >> 172.21.15.82:0/377441434 conn(0x7f30b40cada0 msgr2=0x7f30b40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- 172.21.15.82:0/377441434 shutdown_connections 2023-07-20T10:08:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- 172.21.15.82:0/377441434 wait complete. 2023-07-20T10:08:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 Processor -- start 2023-07-20T10:08:10.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.127+0000 7f30ba396640 1 -- start start 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b4154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30b41596b0 0x7f30b4154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b40c4b30 con 0x7f30b40b2380 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b40c1e50 con 0x7f30b41596b0 2023-07-20T10:08:10.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41508a0 con 0x7f30b40cc900 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41046/0 (socket says 172.21.15.82:41046) 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 -- 172.21.15.82:0/76593924 learned_addr learned my addr 172.21.15.82:0/76593924 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b37fe640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b4154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b8933640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30b41596b0 0x7f30b4154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 -- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 msgr2=0x7f30b4154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b4154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 -- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30b41596b0 msgr2=0x7f30b4154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30b41596b0 0x7f30b4154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 -- 172.21.15.82:0/76593924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a400b770 con 0x7f30b40b2380 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b3fff640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b2c0 tx=0x7f30a401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40afe20 con 0x7f30b40b2380 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a40ba480 con 0x7f30b40b2380 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40ba830 con 0x7f30b40b2380 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b40c3fb0 con 0x7f30b40b2380 2023-07-20T10:08:10.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b40c4570 con 0x7f30b40b2380 2023-07-20T10:08:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.131+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b4073c70 con 0x7f30b40b2380 2023-07-20T10:08:10.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.135+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 57) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f30a40ba990 con 0x7f30b40b2380 2023-07-20T10:08:10.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.135+0000 7f30b0ff9640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 0x7f30a00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.135+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f30a411f6d0 con 0x7f30b40b2380 2023-07-20T10:08:10.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.135+0000 7f30b37fe640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 0x7f30a00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.135+0000 7f30b37fe640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 0x7f30a00687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f30b4155000 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.139+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30a40ec790 con 0x7f30b40b2380 2023-07-20T10:08:10.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.287+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30b40cbbd0 con 0x7f30b40b2380 2023-07-20T10:08:10.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.287+0000 7f30b0ff9640 1 -- 172.21.15.82:0/76593924 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+19600 (secure 0 0 0) 0x7f30a40efdb0 con 0x7f30b40b2380 2023-07-20T10:08:10.264 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:10.265 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":111,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:07.899922+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:06:41.538221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-20T10:06:42.832437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":7}]},{"pgid":"14.26","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/3691570425":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2887507161":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2466713202":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2223184229":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/4013363770":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2674254560":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2315466586":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3754899936":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6833/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/4185959370":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2979139926":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3707206980":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/1784618799":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/635904395":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2038385173":"2023-07-21T10:07:01.288326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 msgr2=0x7f30a00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 0x7f30a00687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f30b4155000 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 msgr2=0x7f30b4150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b2c0 tx=0x7f30a401d3e0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 shutdown_connections 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f30a0066310 0x7f30a00687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f30b41596b0 0x7f30b4154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f30b40cc900 0x7f30b4154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 --2- 172.21.15.82:0/76593924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30b40b2380 0x7f30b4150360 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 >> 172.21.15.82:0/76593924 conn(0x7f30b40cada0 msgr2=0x7f30b40cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 shutdown_connections 2023-07-20T10:08:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.291+0000 7f30ba396640 1 -- 172.21.15.82:0/76593924 wait complete. 2023-07-20T10:08:10.286 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:08:10.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.447+0000 7f4f8a8bd640 1 Processor -- start 2023-07-20T10:08:10.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.447+0000 7f4f8a8bd640 1 -- start start 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f8a8bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 0x7f4f8415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f8a8bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f840ccd60 con 0x7f4f840b2a90 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f8a8bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f840ad810 con 0x7f4f840cc900 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f8a8bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8415d0d0 con 0x7f4f841596b0 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f88e5a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4f840b2a90 0x7f4f840c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44922/0 (socket says 172.21.15.82:44922) 2023-07-20T10:08:10.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f88e5a640 1 -- 172.21.15.82:0/2110885198 learned_addr learned my addr 172.21.15.82:0/2110885198 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:10.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f83fff640 1 --2- 172.21.15.82:0/2110885198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 0x7f4f8415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838878909 0 0) 0x7f4f840ccd60 con 0x7f4f840b2a90 2023-07-20T10:08:10.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c005740 con 0x7f4f840b2a90 2023-07-20T10:08:10.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946113095 0 0) 0x7f4f840ad810 con 0x7f4f840cc900 2023-07-20T10:08:10.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f83fff640 1 -- 172.21.15.82:0/2110885198 >> v1:172.21.15.183:6789/0 conn(0x7f4f840cc900 legacy=0x7f4f840b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f83fff640 1 -- 172.21.15.82:0/2110885198 >> v1:172.21.15.82:6789/0 conn(0x7f4f840b2a90 legacy=0x7f4f840c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.451+0000 7f4f83fff640 1 -- 172.21.15.82:0/2110885198 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8415d3b0 con 0x7f4f841596b0 2023-07-20T10:08:10.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f83fff640 1 --2- 172.21.15.82:0/2110885198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 0x7f4f8415dbb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f740097f0 tx=0x7f4f7401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d14e4571908980 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740a7070 con 0x7f4f841596b0 2023-07-20T10:08:10.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740ab430 con 0x7f4f841596b0 2023-07-20T10:08:10.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f82ffd640 1 -- 172.21.15.82:0/2110885198 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740ab7a0 con 0x7f4f841596b0 2023-07-20T10:08:10.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/2110885198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 msgr2=0x7f4f8415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/2110885198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 0x7f4f8415dbb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f740097f0 tx=0x7f4f7401c490 comp rx=0 tx=0).stop 2023-07-20T10:08:10.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/2110885198 shutdown_connections 2023-07-20T10:08:10.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/2110885198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f841596b0 0x7f4f8415dbb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/2110885198 >> 172.21.15.82:0/2110885198 conn(0x7f4f840cada0 msgr2=0x7f4f840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:10.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/2110885198 shutdown_connections 2023-07-20T10:08:10.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/2110885198 wait complete. 2023-07-20T10:08:10.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 Processor -- start 2023-07-20T10:08:10.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.455+0000 7f4f8a8bd640 1 -- start start 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f840b2a90 0x7f4f840aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f840cc900 0x7f4f84158960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8415b080 con 0x7f4f841596b0 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8415b360 con 0x7f4f840cc900 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8415b640 con 0x7f4f840b2a90 2023-07-20T10:08:10.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41050/0 (socket says 172.21.15.82:41050) 2023-07-20T10:08:10.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 -- 172.21.15.82:0/3999214257 learned_addr learned my addr 172.21.15.82:0/3999214257 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:10.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f83fff640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f840b2a90 0x7f4f840aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f837fe640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f840cc900 0x7f4f84158960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 -- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f840b2a90 msgr2=0x7f4f840aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f840b2a90 0x7f4f840aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 -- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f840cc900 msgr2=0x7f4f84158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f840cc900 0x7f4f84158960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 -- 172.21.15.82:0/3999214257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f74009420 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f88e5a640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00cb40 tx=0x7f4f7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00aca0 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c00ae00 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c012620 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8415b920 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f84158ea0 con 0x7f4f841596b0 2023-07-20T10:08:10.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8415bb40 con 0x7f4f841596b0 2023-07-20T10:08:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.459+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 57) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f4f7c007070 con 0x7f4f841596b0 2023-07-20T10:08:10.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.463+0000 7f4f80ff9640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 0x7f4f700687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.463+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f4f7c084100 con 0x7f4f841596b0 2023-07-20T10:08:10.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.463+0000 7f4f83fff640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 0x7f4f700687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.463+0000 7f4f83fff640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 0x7f4f700687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f740af000 tx=0x7f4f740b6040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.467+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f7c051250 con 0x7f4f841596b0 2023-07-20T10:08:10.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.643+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f84073c70 con 0x7f4f841596b0 2023-07-20T10:08:10.621 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:08:10.643+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:08:10.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.651+0000 7f4f80ff9640 1 -- 172.21.15.82:0/3999214257 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f7c017090 con 0x7f4f841596b0 2023-07-20T10:08:10.627 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:08:10.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.651+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 msgr2=0x7f4f700687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.651+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 0x7f4f700687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4f740af000 tx=0x7f4f740b6040 comp rx=0 tx=0).stop 2023-07-20T10:08:10.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.651+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 msgr2=0x7f4f8406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.651+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00cb40 tx=0x7f4f7c00a060 comp rx=0 tx=0).stop 2023-07-20T10:08:10.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 shutdown_connections 2023-07-20T10:08:10.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4f841596b0 0x7f4f8406c930 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4f70066310 0x7f4f700687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4f840cc900 0x7f4f84158960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 --2- 172.21.15.82:0/3999214257 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4f840b2a90 0x7f4f840aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 >> 172.21.15.82:0/3999214257 conn(0x7f4f840cada0 msgr2=0x7f4f84071790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:10.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 shutdown_connections 2023-07-20T10:08:10.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.655+0000 7f4f8a8bd640 1 -- 172.21.15.82:0/3999214257 wait complete. 2023-07-20T10:08:10.638 INFO:tasks.ceph.mds.d.smithi183.stderr: -6756> 2023-07-20T10:06:50.435+0000 7f83cbd95640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:08:10.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:08:10.689 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:08:10.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 Processor -- start 2023-07-20T10:08:10.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 -- start start 2023-07-20T10:08:10.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1950161de0 0x7f19500afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19500b06e0 con 0x7f1950160ba0 2023-07-20T10:08:10.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19500c9370 con 0x7f19500b0290 2023-07-20T10:08:10.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1957e6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500c9650 con 0x7f1950161de0 2023-07-20T10:08:10.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1955c09640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1950160ba0 0x7f19500c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44924/0 (socket says 172.21.15.82:44924) 2023-07-20T10:08:10.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1955c09640 1 -- 172.21.15.82:0/1571391226 learned_addr learned my addr 172.21.15.82:0/1571391226 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:10.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1955408640 1 --2- 172.21.15.82:0/1571391226 >> v2:172.21.15.183:3300/0 conn(0x7f1950161de0 0x7f19500afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.815+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966979219 0 0) 0x7f194c001120 con 0x7f1950160ba0 2023-07-20T10:08:10.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c003530 con 0x7f1950160ba0 2023-07-20T10:08:10.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1955408640 1 -- 172.21.15.82:0/1571391226 >> v1:172.21.15.183:6789/0 conn(0x7f19500b0290 legacy=0x7f19500cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 222182805 0 0) 0x7f193c003530 con 0x7f1950160ba0 2023-07-20T10:08:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1955408640 1 -- 172.21.15.82:0/1571391226 >> v1:172.21.15.82:6789/0 conn(0x7f1950160ba0 legacy=0x7f19500c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1955408640 1 -- 172.21.15.82:0/1571391226 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950161300 con 0x7f1950161de0 2023-07-20T10:08:10.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1955408640 1 --2- 172.21.15.82:0/1571391226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1950161de0 0x7f19500afd50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f19400097c0 tx=0x7f194001c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2890df6ddc684c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c001810 con 0x7f1950161de0 2023-07-20T10:08:10.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400a7050 con 0x7f1950161de0 2023-07-20T10:08:10.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.819+0000 7f1954c07640 1 -- 172.21.15.82:0/1571391226 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400ab400 con 0x7f1950161de0 2023-07-20T10:08:10.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- 172.21.15.82:0/1571391226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1950161de0 msgr2=0x7f19500afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 --2- 172.21.15.82:0/1571391226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1950161de0 0x7f19500afd50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f19400097c0 tx=0x7f194001c220 comp rx=0 tx=0).stop 2023-07-20T10:08:10.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- 172.21.15.82:0/1571391226 shutdown_connections 2023-07-20T10:08:10.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 --2- 172.21.15.82:0/1571391226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1950161de0 0x7f19500afd50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- 172.21.15.82:0/1571391226 >> 172.21.15.82:0/1571391226 conn(0x7f19500cad50 msgr2=0x7f19500cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:10.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- 172.21.15.82:0/1571391226 shutdown_connections 2023-07-20T10:08:10.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- 172.21.15.82:0/1571391226 wait complete. 2023-07-20T10:08:10.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 Processor -- start 2023-07-20T10:08:10.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- start start 2023-07-20T10:08:10.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 0x7f19500c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 0x7f19500c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19501619c0 con 0x7f1950160ba0 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500c3ba0 con 0x7f19500b0290 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1957e6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500c2490 con 0x7f1950161de0 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41052/0 (socket says 172.21.15.82:41052) 2023-07-20T10:08:10.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 -- 172.21.15.82:0/653951146 learned_addr learned my addr 172.21.15.82:0/653951146 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f195640a640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 0x7f19500c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955c09640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 0x7f19500c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 -- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 msgr2=0x7f19500c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 0x7f19500c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 -- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 msgr2=0x7f19500c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:10.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 0x7f19500c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955408640 1 -- 172.21.15.82:0/653951146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009420 con 0x7f1950160ba0 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f1955c09640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 0x7f19500c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.823+0000 7f195640a640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 0x7f19500c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f1955408640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f19400ae040 tx=0x7f194001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400abdd0 con 0x7f1950160ba0 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400b7450 con 0x7f1950160ba0 2023-07-20T10:08:10.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19500c2f20 con 0x7f1950160ba0 2023-07-20T10:08:10.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400b7800 con 0x7f1950160ba0 2023-07-20T10:08:10.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19500c34e0 con 0x7f1950160ba0 2023-07-20T10:08:10.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19500c3ce0 con 0x7f1950160ba0 2023-07-20T10:08:10.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 57) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f19400b7960 con 0x7f1950160ba0 2023-07-20T10:08:10.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 0x7f19340687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:10.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7038+0+0 (secure 0 0 0) 0x7f194011e790 con 0x7f1950160ba0 2023-07-20T10:08:10.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.827+0000 7f1955c09640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 0x7f19340687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:10.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.831+0000 7f1955c09640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 0x7f19340687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f194c007950 tx=0x7f194c009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:10.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:10.831+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19500c3ce0 con 0x7f1950160ba0 2023-07-20T10:08:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.015+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19500c3ce0 con 0x7f1950160ba0 2023-07-20T10:08:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.651+0000 7f19467fc640 1 -- 172.21.15.82:0/653951146 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19500c3ce0 con 0x7f1950160ba0 2023-07-20T10:08:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 msgr2=0x7f19340687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 0x7f19340687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f194c007950 tx=0x7f194c009040 comp rx=0 tx=0).stop 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 msgr2=0x7f19500c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f19400ae040 tx=0x7f194001aa60 comp rx=0 tx=0).stop 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 shutdown_connections 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1950161de0 0x7f19500c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1950160ba0 0x7f19500c1f50 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1934066310 0x7f19340687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 --2- 172.21.15.82:0/653951146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19500b0290 0x7f19500c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 >> 172.21.15.82:0/653951146 conn(0x7f19500cad50 msgr2=0x7f19500aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 shutdown_connections 2023-07-20T10:08:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.655+0000 7f1957e6d640 1 -- 172.21.15.82:0/653951146 wait complete. 2023-07-20T10:08:11.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:08:11.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 Processor -- start 2023-07-20T10:08:11.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 -- start start 2023-07-20T10:08:11.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73c0159830 0x7f73c00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00cc8d0 con 0x7f73c00cc3e0 2023-07-20T10:08:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00ccbb0 con 0x7f73c0159450 2023-07-20T10:08:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73c5d67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00cce90 con 0x7f73c0159830 2023-07-20T10:08:11.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73bffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f73c00cc3e0 0x7f73c00afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44938/0 (socket says 172.21.15.82:44938) 2023-07-20T10:08:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73bffff640 1 -- 172.21.15.82:0/1310233115 learned_addr learned my addr 172.21.15.82:0/1310233115 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73c0159830 0x7f73c00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266069708 0 0) 0x7f73c00cc8d0 con 0x7f73c00cc3e0 2023-07-20T10:08:11.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a8003530 con 0x7f73c00cc3e0 2023-07-20T10:08:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718298557 0 0) 0x7f73a8003530 con 0x7f73c00cc3e0 2023-07-20T10:08:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73c0159830 msgr2=0x7f73c00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:11.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73c0159830 0x7f73c00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 >> v1:172.21.15.183:6789/0 conn(0x7f73c0159450 legacy=0x7f73c015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0159cc0 con 0x7f73c00cc3e0 2023-07-20T10:08:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f73b8001a20 con 0x7f73c00cc3e0 2023-07-20T10:08:11.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 >> v1:172.21.15.82:6789/0 conn(0x7f73c00cc3e0 legacy=0x7f73c00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8003a20 0x7f73a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a8004340 0x7f73a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73a8004fc0 0x7f73a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00cce90 con 0x7f73a8004340 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a800bed0 con 0x7f73a8004fc0 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a800c010 con 0x7f73a8003a20 2023-07-20T10:08:11.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a8004340 0x7f73a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73bf7fe640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8003a20 0x7f73a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73bffff640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73a8004fc0 0x7f73a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 -- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8003a20 msgr2=0x7f73a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8003a20 0x7f73a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 -- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73a8004fc0 msgr2=0x7f73a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:11.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73a8004fc0 0x7f73a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73beffd640 1 -- 172.21.15.82:0/1310233115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8003530 con 0x7f73a8004340 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.819+0000 7f73bffff640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73a8004fc0 0x7f73a800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73beffd640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a8004340 0x7f73a8004810 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009670 tx=0x7f73b401ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b781bb1a6f8d86 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b40a7880 con 0x7f73a8004340 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b40a79e0 con 0x7f73a8004340 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73be7fc640 1 -- 172.21.15.82:0/1310233115 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b40a7d90 con 0x7f73a8004340 2023-07-20T10:08:11.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 -- 172.21.15.82:0/1310233115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a8004340 msgr2=0x7f73a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 --2- 172.21.15.82:0/1310233115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73a8004340 0x7f73a8004810 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f73b4009670 tx=0x7f73b401ec80 comp rx=0 tx=0).stop 2023-07-20T10:08:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73bffff640 1 -- 172.21.15.82:0/1310233115 reap_dead start 2023-07-20T10:08:11.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 -- 172.21.15.82:0/1310233115 shutdown_connections 2023-07-20T10:08:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 -- 172.21.15.82:0/1310233115 >> 172.21.15.82:0/1310233115 conn(0x7f73c00cad50 msgr2=0x7f73c00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 -- 172.21.15.82:0/1310233115 shutdown_connections 2023-07-20T10:08:11.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.823+0000 7f73c5d67640 1 -- 172.21.15.82:0/1310233115 wait complete. 2023-07-20T10:08:11.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 Processor -- start 2023-07-20T10:08:11.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 -- start start 2023-07-20T10:08:11.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8004340 0x7f73c00ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73c00c8b60 0x7f73c01f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c01473d0 con 0x7f73c00c8fe0 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00c53a0 con 0x7f73c00c8b60 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00c5680 con 0x7f73a8004340 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41070/0 (socket says 172.21.15.82:41070) 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 -- 172.21.15.82:0/3219005792 learned_addr learned my addr 172.21.15.82:0/3219005792 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bf7fe640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8004340 0x7f73c00ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73beffd640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73c00c8b60 0x7f73c01f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 -- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8004340 msgr2=0x7f73c00ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8004340 0x7f73c00ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 -- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73c00c8b60 msgr2=0x7f73c01f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:11.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73c00c8b60 0x7f73c01f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 -- 172.21.15.82:0/3219005792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c00c5960 con 0x7f73c00c8fe0 2023-07-20T10:08:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73bffff640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73c00c1da0 tx=0x7f73b800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b800eb90 con 0x7f73c00c8fe0 2023-07-20T10:08:11.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b800ecf0 con 0x7f73c00c8fe0 2023-07-20T10:08:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8013640 con 0x7f73c00c8fe0 2023-07-20T10:08:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.827+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c00c5c40 con 0x7f73c00c8fe0 2023-07-20T10:08:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c00c6200 con 0x7f73c00c8fe0 2023-07-20T10:08:11.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c004da30 con 0x7f73c00c8fe0 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 57) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f73b80137a0 con 0x7f73c00c8fe0 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73a7fff640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 0x7f73ac0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7038+0+0 (secure 0 0 0) 0x7f73b80844a0 con 0x7f73c00c8fe0 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73bf7fe640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 0x7f73ac0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.831+0000 7f73bf7fe640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 0x7f73ac0687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73b0000c10 tx=0x7f73b00013f0 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:11.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.835+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73b80550a0 con 0x7f73c00c8fe0 2023-07-20T10:08:11.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:11.983+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f73c00cbbf0 con 0x7f73c00c8fe0 2023-07-20T10:08:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.663+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f73b80519e0 con 0x7f73c00c8fe0 2023-07-20T10:08:12.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.663+0000 7f73a7fff640 1 -- 172.21.15.82:0/3219005792 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7f73b806d940 con 0x7f73c00c8fe0 2023-07-20T10:08:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:08:12.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.667+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 msgr2=0x7f73ac0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 0x7f73ac0687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f73b0000c10 tx=0x7f73b00013f0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 msgr2=0x7f73c00c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73c00c1da0 tx=0x7f73b800e530 comp rx=0 tx=0).stop 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 shutdown_connections 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73c00c8fe0 0x7f73c00c6700 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f73ac066310 0x7f73ac0687d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73c00c8b60 0x7f73c01f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 --2- 172.21.15.82:0/3219005792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f73a8004340 0x7f73c00ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 >> 172.21.15.82:0/3219005792 conn(0x7f73c00cad50 msgr2=0x7f73c0071230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 shutdown_connections 2023-07-20T10:08:12.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.671+0000 7f73c5d67640 1 -- 172.21.15.82:0/3219005792 wait complete. 2023-07-20T10:08:12.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:08:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 Processor -- start 2023-07-20T10:08:12.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 -- start start 2023-07-20T10:08:12.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1dfc0ca5a0 0x7f1dfc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1dfc15ec90 0x7f1dfc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc071950 con 0x7f1dfc06f710 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15bad0 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1e021ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc15b230 con 0x7f1dfc15ec90 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1dfc0ca5a0 0x7f1dfc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1dfc06f710 0x7f1dfc06faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:44944/0 (socket says 172.21.15.82:44944) 2023-07-20T10:08:12.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfb7fe640 1 -- 172.21.15.82:0/2426657619 learned_addr learned my addr 172.21.15.82:0/2426657619 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfaffd640 1 -- 172.21.15.82:0/2426657619 >> v2:172.21.15.183:3300/0 conn(0x7f1dfc15ec90 msgr2=0x7f1dfc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfaffd640 1 --2- 172.21.15.82:0/2426657619 >> v2:172.21.15.183:3300/0 conn(0x7f1dfc15ec90 0x7f1dfc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfaffd640 1 -- 172.21.15.82:0/2426657619 >> v1:172.21.15.82:6789/0 conn(0x7f1dfc06f710 legacy=0x7f1dfc06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfaffd640 1 -- 172.21.15.82:0/2426657619 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc15b510 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.839+0000 7f1dfa7fc640 1 -- 172.21.15.82:0/2426657619 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408047667 0 0) 0x7f1dfc071950 con 0x7f1dfc06f710 2023-07-20T10:08:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1dfaffd640 1 --2- 172.21.15.82:0/2426657619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc0ca5a0 0x7f1dfc15e750 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1df00097c0 tx=0x7f1df001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e587404b8f02f5e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1dfa7fc640 1 -- 172.21.15.82:0/2426657619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00ab600 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1dfa7fc640 1 -- 172.21.15.82:0/2426657619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df00a7050 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1dfa7fc640 1 -- 172.21.15.82:0/2426657619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df00ab980 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 -- 172.21.15.82:0/2426657619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc0ca5a0 msgr2=0x7f1dfc15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 --2- 172.21.15.82:0/2426657619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc0ca5a0 0x7f1dfc15e750 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f1df00097c0 tx=0x7f1df001c410 comp rx=0 tx=0).stop 2023-07-20T10:08:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 -- 172.21.15.82:0/2426657619 shutdown_connections 2023-07-20T10:08:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 --2- 172.21.15.82:0/2426657619 >> v2:172.21.15.183:3300/0 conn(0x7f1dfc15ec90 0x7f1dfc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 --2- 172.21.15.82:0/2426657619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc0ca5a0 0x7f1dfc15e750 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 -- 172.21.15.82:0/2426657619 >> 172.21.15.82:0/2426657619 conn(0x7f1dfc0cad50 msgr2=0x7f1dfc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 -- 172.21.15.82:0/2426657619 shutdown_connections 2023-07-20T10:08:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 -- 172.21.15.82:0/2426657619 wait complete. 2023-07-20T10:08:12.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.843+0000 7f1e021ba640 1 Processor -- start 2023-07-20T10:08:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- start start 2023-07-20T10:08:12.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dfc06f710 0x7f1dfc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dfc0ca5a0 0x7f1dfc158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f9140 con 0x7f1dfc15ec90 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f9420 con 0x7f1dfc06f710 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f9700 con 0x7f1dfc0ca5a0 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41086/0 (socket says 172.21.15.82:41086) 2023-07-20T10:08:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 -- 172.21.15.82:0/3281130079 learned_addr learned my addr 172.21.15.82:0/3281130079 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfb7fe640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dfc06f710 0x7f1dfc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfaffd640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dfc0ca5a0 0x7f1dfc158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 -- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dfc0ca5a0 msgr2=0x7f1dfc158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dfc0ca5a0 0x7f1dfc158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 -- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dfc06f710 msgr2=0x7f1dfc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dfc06f710 0x7f1dfc0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:12.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 -- 172.21.15.82:0/3281130079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df0009420 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1dfbfff640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f1df400b970 tx=0x7f1df400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df400cb40 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df400ccc0 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc1f99e0 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4014680 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc1f8dd0 con 0x7f1dfc15ec90 2023-07-20T10:08:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.847+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc0c5430 con 0x7f1dfc15ec90 2023-07-20T10:08:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.851+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1df401d3b0 con 0x7f1dfc15ec90 2023-07-20T10:08:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.851+0000 7f1de3fff640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 0x7f1de8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:12.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.851+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6600+0+0 (secure 0 0 0) 0x7f1df4084090 con 0x7f1dfc15ec90 2023-07-20T10:08:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.851+0000 7f1dfb7fe640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 0x7f1de8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:12.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.851+0000 7f1dfb7fe640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 0x7f1de8068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f70 tx=0x7f1dec007c10 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:12.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:12.855+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1dfc0c5430 con 0x7f1dfc15ec90 2023-07-20T10:08:12.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.003+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1dfc0c5430 con 0x7f1dfc15ec90 2023-07-20T10:08:13.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.663+0000 7f1de3fff640 1 -- 172.21.15.82:0/3281130079 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1dfc0c5430 con 0x7f1dfc15ec90 2023-07-20T10:08:13.641 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:08:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 msgr2=0x7f1de8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 0x7f1de8068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1dec000f70 tx=0x7f1dec007c10 comp rx=0 tx=0).stop 2023-07-20T10:08:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 msgr2=0x7f1dfc15d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f1df400b970 tx=0x7f1df400be30 comp rx=0 tx=0).stop 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 shutdown_connections 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1dfc15ec90 0x7f1dfc15d060 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1dfc0ca5a0 0x7f1dfc158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1de80663a0 0x7f1de8068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 --2- 172.21.15.82:0/3281130079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1dfc06f710 0x7f1dfc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 >> 172.21.15.82:0/3281130079 conn(0x7f1dfc0cad50 msgr2=0x7f1dfc06faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 shutdown_connections 2023-07-20T10:08:13.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.667+0000 7f1e021ba640 1 -- 172.21.15.82:0/3281130079 wait complete. 2023-07-20T10:08:13.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:08:13.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 Processor -- start 2023-07-20T10:08:13.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 -- start start 2023-07-20T10:08:13.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa52006f710 0x7fa52006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5200ca5a0 0x7fa52015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa520070030 con 0x7fa52015ec90 2023-07-20T10:08:13.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52015bad0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.835+0000 7fa5280cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa520071950 con 0x7fa52006f710 2023-07-20T10:08:13.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5200ca5a0 0x7fa52015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5200ca5a0 0x7fa52015e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49962/0 (socket says 172.21.15.82:49962) 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 -- 172.21.15.82:0/3487623337 learned_addr learned my addr 172.21.15.82:0/3487623337 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa526668640 1 --1- 172.21.15.82:0/3487623337 >> v1:172.21.15.82:6789/0 conn(0x7fa52015ec90 0x7fa52015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41922/0 (socket says 172.21.15.82:41922) 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525e67640 1 --2- 172.21.15.82:0/3487623337 >> v2:172.21.15.183:3300/0 conn(0x7fa52006f710 0x7fa52006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 -- 172.21.15.82:0/3487623337 >> v2:172.21.15.183:3300/0 conn(0x7fa52006f710 msgr2=0x7fa52006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 --2- 172.21.15.82:0/3487623337 >> v2:172.21.15.183:3300/0 conn(0x7fa52006f710 0x7fa52006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 -- 172.21.15.82:0/3487623337 >> v1:172.21.15.82:6789/0 conn(0x7fa52015ec90 legacy=0x7fa52015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 -- 172.21.15.82:0/3487623337 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52015b230 con 0x7fa5200ca5a0 2023-07-20T10:08:13.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa525666640 1 --2- 172.21.15.82:0/3487623337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa52015e750 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fa5200ce230 tx=0x7fa51001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf7a68ab9d1c225 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:13.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa524e65640 1 -- 172.21.15.82:0/3487623337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100ac640 con 0x7fa5200ca5a0 2023-07-20T10:08:13.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa524e65640 1 -- 172.21.15.82:0/3487623337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5100ac7a0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.839+0000 7fa524e65640 1 -- 172.21.15.82:0/3487623337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100acb30 con 0x7fa5200ca5a0 2023-07-20T10:08:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- 172.21.15.82:0/3487623337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 msgr2=0x7fa52015e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- 172.21.15.82:0/3487623337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa52015e750 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fa5200ce230 tx=0x7fa51001c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- 172.21.15.82:0/3487623337 shutdown_connections 2023-07-20T10:08:13.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- 172.21.15.82:0/3487623337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa52015e750 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- 172.21.15.82:0/3487623337 >> v2:172.21.15.183:3300/0 conn(0x7fa52006f710 0x7fa52006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- 172.21.15.82:0/3487623337 >> 172.21.15.82:0/3487623337 conn(0x7fa5200cad50 msgr2=0x7fa5200cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- 172.21.15.82:0/3487623337 shutdown_connections 2023-07-20T10:08:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- 172.21.15.82:0/3487623337 wait complete. 2023-07-20T10:08:13.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 Processor -- start 2023-07-20T10:08:13.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- start start 2023-07-20T10:08:13.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa52006f710 0x7fa5201577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa52015ec90 0x7fa520158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200b1a80 con 0x7fa5200ca5a0 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200b1cf0 con 0x7fa52006f710 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa5280cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5200b1fd0 con 0x7fa52015ec90 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49966/0 (socket says 172.21.15.82:49966) 2023-07-20T10:08:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 -- 172.21.15.82:0/437999424 learned_addr learned my addr 172.21.15.82:0/437999424 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa526668640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa52015ec90 0x7fa520158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525e67640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa52006f710 0x7fa5201577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 -- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa52015ec90 msgr2=0x7fa520158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa52015ec90 0x7fa520158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 -- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa52006f710 msgr2=0x7fa5201577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa52006f710 0x7fa5201577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.843+0000 7fa525666640 1 -- 172.21.15.82:0/437999424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100094d0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa525666640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa5100190e0 tx=0x7fa510019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:13.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100b5640 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5100b57a0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100b5b10 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5200b22b0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa520157d30 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5200cf140 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa5100b3070 con 0x7fa5200ca5a0 2023-07-20T10:08:13.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 0x7fa504068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:13.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa51011e2e0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa525e67640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 0x7fa504068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:13.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.847+0000 7fa525e67640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 0x7fa504068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b9d0 tx=0x7fa51c008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:13.851+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5100eb5b0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.003+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa52004da30 con 0x7fa5200ca5a0 2023-07-20T10:08:13.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5167fc640 1 -- 172.21.15.82:0/437999424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v37) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa5100eebd0 con 0x7fa5200ca5a0 2023-07-20T10:08:13.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 msgr2=0x7fa504068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 0x7fa504068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b9d0 tx=0x7fa51c008040 comp rx=0 tx=0).stop 2023-07-20T10:08:13.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 msgr2=0x7fa5201589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:13.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa5100190e0 tx=0x7fa510019270 comp rx=0 tx=0).stop 2023-07-20T10:08:13.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 shutdown_connections 2023-07-20T10:08:13.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa52015ec90 0x7fa520158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5200ca5a0 0x7fa5201589e0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fa5040663a0 0x7fa504068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 --2- 172.21.15.82:0/437999424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa52006f710 0x7fa5201577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:13.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 >> 172.21.15.82:0/437999424 conn(0x7fa5200cad50 msgr2=0x7fa520164cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:13.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 shutdown_connections 2023-07-20T10:08:13.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.007+0000 7fa5280cb640 1 -- 172.21.15.82:0/437999424 wait complete. 2023-07-20T10:08:14.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:08:14.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.167+0000 7f816f888640 1 Processor -- start 2023-07-20T10:08:14.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.167+0000 7f816f888640 1 -- start start 2023-07-20T10:08:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816f888640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8168159830 0x7f81680cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816f888640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680cc8d0 con 0x7f81680cc3e0 2023-07-20T10:08:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816f888640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680ccbb0 con 0x7f8168159450 2023-07-20T10:08:14.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816f888640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680cce90 con 0x7f8168159830 2023-07-20T10:08:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8168159830 0x7f81680cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8168159830 0x7f81680cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49974/0 (socket says 172.21.15.82:49974) 2023-07-20T10:08:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 -- 172.21.15.82:0/2781650816 learned_addr learned my addr 172.21.15.82:0/2781650816 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:14.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816de25640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f81680cc3e0 0x7f81680afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41934/0 (socket says 172.21.15.82:41934) 2023-07-20T10:08:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 -- 172.21.15.82:0/2781650816 >> v1:172.21.15.183:6789/0 conn(0x7f8168159450 legacy=0x7f816815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 -- 172.21.15.82:0/2781650816 >> v1:172.21.15.82:6789/0 conn(0x7f81680cc3e0 legacy=0x7f81680afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f816ce23640 1 -- 172.21.15.82:0/2781650816 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168159cc0 con 0x7f8168159830 2023-07-20T10:08:14.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.171+0000 7f815ffff640 1 -- 172.21.15.82:0/2781650816 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171070285 0 0) 0x7f81680cc8d0 con 0x7f81680cc3e0 2023-07-20T10:08:14.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816ce23640 1 --2- 172.21.15.82:0/2781650816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8168159830 0x7f81680cbea0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8158009870 tx=0x7f815801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be2c3bcf9b7a012 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f815ffff640 1 -- 172.21.15.82:0/2781650816 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580ac640 con 0x7f8168159830 2023-07-20T10:08:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f815ffff640 1 -- 172.21.15.82:0/2781650816 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81580ac7a0 con 0x7f8168159830 2023-07-20T10:08:14.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f815ffff640 1 -- 172.21.15.82:0/2781650816 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580acb30 con 0x7f8168159830 2023-07-20T10:08:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- 172.21.15.82:0/2781650816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8168159830 msgr2=0x7f81680cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 --2- 172.21.15.82:0/2781650816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8168159830 0x7f81680cbea0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8158009870 tx=0x7f815801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- 172.21.15.82:0/2781650816 shutdown_connections 2023-07-20T10:08:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 --2- 172.21.15.82:0/2781650816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8168159830 0x7f81680cbea0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- 172.21.15.82:0/2781650816 >> 172.21.15.82:0/2781650816 conn(0x7f81680cad50 msgr2=0x7f81680cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- 172.21.15.82:0/2781650816 shutdown_connections 2023-07-20T10:08:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- 172.21.15.82:0/2781650816 wait complete. 2023-07-20T10:08:14.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 Processor -- start 2023-07-20T10:08:14.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- start start 2023-07-20T10:08:14.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81680cc3e0 0x7f81680c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8168159450 0x7f81681566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81680b1d90 con 0x7f81681f28a0 2023-07-20T10:08:14.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681f2da0 con 0x7f81680cc3e0 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.175+0000 7f816f888640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81681f3080 con 0x7f8168159450 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49980/0 (socket says 172.21.15.82:49980) 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 -- 172.21.15.82:0/3846016778 learned_addr learned my addr 172.21.15.82:0/3846016778 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816d624640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81680cc3e0 0x7f81680c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816ce23640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8168159450 0x7f81681566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 -- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8168159450 msgr2=0x7f81681566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8168159450 0x7f81681566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 -- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81680cc3e0 msgr2=0x7f81680c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81680cc3e0 0x7f81680c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 -- 172.21.15.82:0/3846016778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580094d0 con 0x7f81681f28a0 2023-07-20T10:08:14.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816de25640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8160001570 tx=0x7f816000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000a640 con 0x7f81681f28a0 2023-07-20T10:08:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000a7a0 con 0x7f81681f28a0 2023-07-20T10:08:14.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81681f3360 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000ab90 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8168153d00 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816804da30 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f816000acf0 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 0x7f814c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.179+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f81600837e0 con 0x7f81681f28a0 2023-07-20T10:08:14.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.183+0000 7f816d624640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 0x7f814c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.183+0000 7f816d624640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 0x7f814c068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81681f5df0 tx=0x7f8164009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.183+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8160050b30 con 0x7f81681f28a0 2023-07-20T10:08:14.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.331+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f81680c2080 con 0x7f81681f28a0 2023-07-20T10:08:14.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.335+0000 7f815dffb640 1 -- 172.21.15.82:0/3846016778 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8160054150 con 0x7f81681f28a0 2023-07-20T10:08:14.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 msgr2=0x7f814c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 0x7f814c068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81681f5df0 tx=0x7f8164009040 comp rx=0 tx=0).stop 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 msgr2=0x7f8168156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f8160001570 tx=0x7f816000cc70 comp rx=0 tx=0).stop 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 shutdown_connections 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81681f28a0 0x7f8168156be0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8168159450 0x7f81681566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f814c0663d0 0x7f814c068890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 --2- 172.21.15.82:0/3846016778 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81680cc3e0 0x7f81680c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 >> 172.21.15.82:0/3846016778 conn(0x7f81680cad50 msgr2=0x7f81680c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:14.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 shutdown_connections 2023-07-20T10:08:14.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.339+0000 7f816f888640 1 -- 172.21.15.82:0/3846016778 wait complete. 2023-07-20T10:08:14.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:08:14.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 Processor -- start 2023-07-20T10:08:14.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 -- start start 2023-07-20T10:08:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58e8159450 0x7f58e815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e80cc8d0 con 0x7f58e80afd50 2023-07-20T10:08:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e80ccbb0 con 0x7f58e8159830 2023-07-20T10:08:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58eef03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e80cce90 con 0x7f58e8159450 2023-07-20T10:08:14.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58ecc9f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f58e8159450 0x7f58e815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58ed4a0640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f58e80afd50 0x7f58e80b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41942/0 (socket says 172.21.15.82:41942) 2023-07-20T10:08:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.499+0000 7f58ed4a0640 1 -- 172.21.15.82:0/509793018 learned_addr learned my addr 172.21.15.82:0/509793018 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58ecc9f640 1 -- 172.21.15.82:0/509793018 >> v1:172.21.15.183:6789/0 conn(0x7f58e8159830 legacy=0x7f58e80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58ecc9f640 1 -- 172.21.15.82:0/509793018 >> v1:172.21.15.82:6789/0 conn(0x7f58e80afd50 legacy=0x7f58e80b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58ecc9f640 1 -- 172.21.15.82:0/509793018 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8159cc0 con 0x7f58e8159450 2023-07-20T10:08:14.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58ecc9f640 1 --2- 172.21.15.82:0/509793018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e815a4c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f58e40097c0 tx=0x7f58e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaba25011ad326b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58df7fe640 1 -- 172.21.15.82:0/509793018 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40ab5f0 con 0x7f58e8159450 2023-07-20T10:08:14.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58df7fe640 1 -- 172.21.15.82:0/509793018 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e40ab750 con 0x7f58e8159450 2023-07-20T10:08:14.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58df7fe640 1 -- 172.21.15.82:0/509793018 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40abae0 con 0x7f58e8159450 2023-07-20T10:08:14.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 -- 172.21.15.82:0/509793018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 msgr2=0x7f58e815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 --2- 172.21.15.82:0/509793018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e815a4c0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f58e40097c0 tx=0x7f58e401c410 comp rx=0 tx=0).stop 2023-07-20T10:08:14.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 -- 172.21.15.82:0/509793018 shutdown_connections 2023-07-20T10:08:14.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 --2- 172.21.15.82:0/509793018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e815a4c0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 -- 172.21.15.82:0/509793018 >> 172.21.15.82:0/509793018 conn(0x7f58e80cad50 msgr2=0x7f58e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 -- 172.21.15.82:0/509793018 shutdown_connections 2023-07-20T10:08:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.503+0000 7f58eef03640 1 -- 172.21.15.82:0/509793018 wait complete. 2023-07-20T10:08:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 Processor -- start 2023-07-20T10:08:14.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 -- start start 2023-07-20T10:08:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58e80afd50 0x7f58e81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e80acf50 0x7f58e8168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80ac2a0 con 0x7f58e8159450 2023-07-20T10:08:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80c12d0 con 0x7f58e80acf50 2023-07-20T10:08:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80c15b0 con 0x7f58e80afd50 2023-07-20T10:08:14.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49990/0 (socket says 172.21.15.82:49990) 2023-07-20T10:08:14.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 -- 172.21.15.82:0/230763726 learned_addr learned my addr 172.21.15.82:0/230763726 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:14.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 -- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58e80afd50 msgr2=0x7f58e81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58e80afd50 0x7f58e81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 -- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e80acf50 msgr2=0x7f58e8168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e80acf50 0x7f58e8168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 -- 172.21.15.82:0/230763726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e4009420 con 0x7f58e8159450 2023-07-20T10:08:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dffff640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f58d800b3e0 tx=0x7f58d800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8011830 con 0x7f58e8159450 2023-07-20T10:08:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d80119b0 con 0x7f58e8159450 2023-07-20T10:08:14.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8011d60 con 0x7f58e8159450 2023-07-20T10:08:14.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.507+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e80c1890 con 0x7f58e8159450 2023-07-20T10:08:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e8152700 con 0x7f58e8159450 2023-07-20T10:08:14.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e804da30 con 0x7f58e8159450 2023-07-20T10:08:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f58d801a400 con 0x7f58e8159450 2023-07-20T10:08:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58dd7fa640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 0x7f58d4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f58d8084030 con 0x7f58e8159450 2023-07-20T10:08:14.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.511+0000 7f58ecc9f640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 0x7f58d4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.515+0000 7f58ecc9f640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 0x7f58d4068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e4008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.515+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58d8051370 con 0x7f58e8159450 2023-07-20T10:08:14.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.675+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58e80ac6c0 con 0x7f58e8159450 2023-07-20T10:08:14.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.679+0000 7f58dd7fa640 1 -- 172.21.15.82:0/230763726 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58d8054990 con 0x7f58e8159450 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 msgr2=0x7f58d4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 0x7f58d4068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e4008040 comp rx=0 tx=0).stop 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 msgr2=0x7f58e80aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f58d800b3e0 tx=0x7f58d800b8a0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 shutdown_connections 2023-07-20T10:08:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f58d40663a0 0x7f58d4068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58e80acf50 0x7f58e8168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58e8159450 0x7f58e80aca10 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 --2- 172.21.15.82:0/230763726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58e80afd50 0x7f58e81521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 >> 172.21.15.82:0/230763726 conn(0x7f58e80cad50 msgr2=0x7f58e815ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 shutdown_connections 2023-07-20T10:08:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.683+0000 7f58eef03640 1 -- 172.21.15.82:0/230763726 wait complete. 2023-07-20T10:08:14.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-20T10:08:14.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.839+0000 7f15724bd640 1 Processor -- start 2023-07-20T10:08:14.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.839+0000 7f15724bd640 1 -- start start 2023-07-20T10:08:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f15724bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f156c1596b0 0x7f156c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f15724bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f15724bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c0ccd60 con 0x7f156c0b2380 2023-07-20T10:08:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f15724bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c0ad600 con 0x7f156c1596b0 2023-07-20T10:08:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f15724bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0ad810 con 0x7f156c0cc900 2023-07-20T10:08:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f156c1596b0 0x7f156c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f156c1596b0 0x7f156c15dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50002/0 (socket says 172.21.15.82:50002) 2023-07-20T10:08:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 -- 172.21.15.82:0/1817543543 learned_addr learned my addr 172.21.15.82:0/1817543543 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f1570a5a640 1 --1- 172.21.15.82:0/1817543543 >> v1:172.21.15.82:6789/0 conn(0x7f156c0b2380 0x7f156c0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41956/0 (socket says 172.21.15.82:41956) 2023-07-20T10:08:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156b7fe640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 -- 172.21.15.82:0/1817543543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 msgr2=0x7f156c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 -- 172.21.15.82:0/1817543543 >> v1:172.21.15.82:6789/0 conn(0x7f156c0b2380 legacy=0x7f156c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.843+0000 7f156bfff640 1 -- 172.21.15.82:0/1817543543 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c15d0d0 con 0x7f156c1596b0 2023-07-20T10:08:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f156bfff640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c1596b0 0x7f156c15dbb0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f155c009870 tx=0x7f155c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254a549d50c975ee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f156affd640 1 -- 172.21.15.82:0/1817543543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0aa670 con 0x7f156c1596b0 2023-07-20T10:08:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f156affd640 1 -- 172.21.15.82:0/1817543543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0aa7d0 con 0x7f156c1596b0 2023-07-20T10:08:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f156affd640 1 -- 172.21.15.82:0/1817543543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0aab60 con 0x7f156c1596b0 2023-07-20T10:08:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- 172.21.15.82:0/1817543543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c1596b0 msgr2=0x7f156c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c1596b0 0x7f156c15dbb0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f155c009870 tx=0x7f155c01c510 comp rx=0 tx=0).stop 2023-07-20T10:08:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- 172.21.15.82:0/1817543543 shutdown_connections 2023-07-20T10:08:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 --2- 172.21.15.82:0/1817543543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c1596b0 0x7f156c15dbb0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- 172.21.15.82:0/1817543543 >> 172.21.15.82:0/1817543543 conn(0x7f156c0cada0 msgr2=0x7f156c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- 172.21.15.82:0/1817543543 shutdown_connections 2023-07-20T10:08:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- 172.21.15.82:0/1817543543 wait complete. 2023-07-20T10:08:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 Processor -- start 2023-07-20T10:08:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.847+0000 7f15724bd640 1 -- start start 2023-07-20T10:08:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c09b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f156c1596b0 0x7f156c099e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0c2280 con 0x7f156c0b2380 2023-07-20T10:08:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c1f4d60 con 0x7f156c1596b0 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c098db0 con 0x7f156c0cc900 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50016/0 (socket says 172.21.15.82:50016) 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 -- 172.21.15.82:0/215518640 learned_addr learned my addr 172.21.15.82:0/215518640 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156b7fe640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c09b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f1570a5a640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f156c1596b0 0x7f156c099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 -- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 msgr2=0x7f156c09b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c09b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 -- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f156c1596b0 msgr2=0x7f156c099e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f156c1596b0 0x7f156c099e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 -- 172.21.15.82:0/215518640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0094d0 con 0x7f156c0b2380 2023-07-20T10:08:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156b7fe640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c09b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f156bfff640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f155c01abc0 tx=0x7f155c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b3800 con 0x7f156c0b2380 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c0b3980 con 0x7f156c0b2380 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0b3d30 con 0x7f156c0b2380 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c0b2d20 con 0x7f156c0b2380 2023-07-20T10:08:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c099370 con 0x7f156c0b2380 2023-07-20T10:08:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c073c70 con 0x7f156c0b2380 2023-07-20T10:08:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.851+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f155c0b2380 con 0x7f156c0b2380 2023-07-20T10:08:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.855+0000 7f1568ff9640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 0x7f1558068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.855+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f155c11e540 con 0x7f156c0b2380 2023-07-20T10:08:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.855+0000 7f156b7fe640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 0x7f1558068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:14.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.855+0000 7f156b7fe640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 0x7f1558068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f156c0b30f0 tx=0x7f1560008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:14.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:14.855+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f155c0eb7a0 con 0x7f156c0b2380 2023-07-20T10:08:15.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.055+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f156c0cbbd0 con 0x7f156c0b2380 2023-07-20T10:08:15.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.671+0000 7f1568ff9640 1 -- 172.21.15.82:0/215518640 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v678) v1 ==== 183+0+0 (secure 0 0 0) 0x7f155c0eedc0 con 0x7f156c0b2380 2023-07-20T10:08:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.671+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 msgr2=0x7f1558068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.671+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 0x7f1558068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f156c0b30f0 tx=0x7f1560008040 comp rx=0 tx=0).stop 2023-07-20T10:08:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.671+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 msgr2=0x7f156c0c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.671+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f155c01abc0 tx=0x7f155c01ad50 comp rx=0 tx=0).stop 2023-07-20T10:08:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 shutdown_connections 2023-07-20T10:08:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f15580663a0 0x7f1558068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f156c1596b0 0x7f156c099e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f156c0cc900 0x7f156c09b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 --2- 172.21.15.82:0/215518640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f156c0b2380 0x7f156c0c53f0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 >> 172.21.15.82:0/215518640 conn(0x7f156c0cada0 msgr2=0x7f156c0acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 shutdown_connections 2023-07-20T10:08:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.675+0000 7f15724bd640 1 -- 172.21.15.82:0/215518640 wait complete. 2023-07-20T10:08:15.670 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-20T10:08:15.671 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-07-20T10:08:15.671 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:08:15.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-20T10:08:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 Processor -- start 2023-07-20T10:08:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 -- start start 2023-07-20T10:08:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb8701596b0 0x7fb87015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8700cc900 0x7fb8700ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700ccd90 con 0x7fb8700b2380 2023-07-20T10:08:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ad600 con 0x7fb8700cc900 2023-07-20T10:08:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb87598f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ad810 con 0x7fb8701596b0 2023-07-20T10:08:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb8667fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8700cc900 0x7fb8700ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb8667fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb8700cc900 0x7fb8700ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50030/0 (socket says 172.21.15.82:50030) 2023-07-20T10:08:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.835+0000 7fb8667fc640 1 -- 172.21.15.82:0/2741964359 learned_addr learned my addr 172.21.15.82:0/2741964359 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb86effd640 1 --2- 172.21.15.82:0/2741964359 >> v2:172.21.15.183:3300/0 conn(0x7fb8701596b0 0x7fb87015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb8667fc640 1 -- 172.21.15.82:0/2741964359 >> v2:172.21.15.183:3300/0 conn(0x7fb8701596b0 msgr2=0x7fb87015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb8667fc640 1 --2- 172.21.15.82:0/2741964359 >> v2:172.21.15.183:3300/0 conn(0x7fb8701596b0 0x7fb87015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb8667fc640 1 -- 172.21.15.82:0/2741964359 >> v1:172.21.15.82:6789/0 conn(0x7fb8700b2380 legacy=0x7fb8700c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb86e7fc640 1 -- 172.21.15.82:0/2741964359 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062259175 0 0) 0x7fb8700ccd90 con 0x7fb8700b2380 2023-07-20T10:08:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb8667fc640 1 -- 172.21.15.82:0/2741964359 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87015d0d0 con 0x7fb8700cc900 2023-07-20T10:08:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb8667fc640 1 --2- 172.21.15.82:0/2741964359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700cc900 0x7fb8700ad0c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fb858009870 tx=0x7fb85801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fc7b637c22ebb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb86e7fc640 1 -- 172.21.15.82:0/2741964359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580aa430 con 0x7fb8700cc900 2023-07-20T10:08:15.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb86e7fc640 1 -- 172.21.15.82:0/2741964359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580aa590 con 0x7fb8700cc900 2023-07-20T10:08:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb86e7fc640 1 -- 172.21.15.82:0/2741964359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580aa920 con 0x7fb8700cc900 2023-07-20T10:08:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 -- 172.21.15.82:0/2741964359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700cc900 msgr2=0x7fb8700ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 --2- 172.21.15.82:0/2741964359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700cc900 0x7fb8700ad0c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fb858009870 tx=0x7fb85801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 -- 172.21.15.82:0/2741964359 shutdown_connections 2023-07-20T10:08:15.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 --2- 172.21.15.82:0/2741964359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8700cc900 0x7fb8700ad0c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 --2- 172.21.15.82:0/2741964359 >> v2:172.21.15.183:3300/0 conn(0x7fb8701596b0 0x7fb87015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.839+0000 7fb87598f640 1 -- 172.21.15.82:0/2741964359 >> 172.21.15.82:0/2741964359 conn(0x7fb8700cada0 msgr2=0x7fb8700cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- 172.21.15.82:0/2741964359 shutdown_connections 2023-07-20T10:08:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- 172.21.15.82:0/2741964359 wait complete. 2023-07-20T10:08:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 Processor -- start 2023-07-20T10:08:15.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- start start 2023-07-20T10:08:15.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700b2380 0x7fb87015c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8700cc900 0x7fb8701510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015c960 con 0x7fb8701596b0 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870151600 con 0x7fb8700cc900 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb87598f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87015b6e0 con 0x7fb8700b2380 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50034/0 (socket says 172.21.15.82:50034) 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 -- 172.21.15.82:0/3570571219 learned_addr learned my addr 172.21.15.82:0/3570571219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:15.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb8667fc640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8700cc900 0x7fb8701510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86effd640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700b2380 0x7fb87015c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 -- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700b2380 msgr2=0x7fb87015c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700b2380 0x7fb87015c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 -- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8700cc900 msgr2=0x7fb8701510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8700cc900 0x7fb8701510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 -- 172.21.15.82:0/3570571219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580094d0 con 0x7fb8701596b0 2023-07-20T10:08:15.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.843+0000 7fb86f7fe640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c890 tx=0x7fb86800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868003db0 con 0x7fb8701596b0 2023-07-20T10:08:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb868005070 con 0x7fb8701596b0 2023-07-20T10:08:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87015b9c0 con 0x7fb8701596b0 2023-07-20T10:08:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb868005420 con 0x7fb8701596b0 2023-07-20T10:08:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8701626a0 con 0x7fb8701596b0 2023-07-20T10:08:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87015bc00 con 0x7fb8701596b0 2023-07-20T10:08:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb868005580 con 0x7fb8701596b0 2023-07-20T10:08:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 0x7fb854068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb868083790 con 0x7fb8701596b0 2023-07-20T10:08:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86effd640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 0x7fb854068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:15.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.847+0000 7fb86effd640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 0x7fb854068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb870167540 tx=0x7fb860008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:15.851+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb868050bc0 con 0x7fb8701596b0 2023-07-20T10:08:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.051+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fb870162200 con 0x7fb8701596b0 2023-07-20T10:08:16.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.679+0000 7fb86cff9640 1 -- 172.21.15.82:0/3570571219 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v679) v1 ==== 151+0+0 (secure 0 0 0) 0x7fb8680541e0 con 0x7fb8701596b0 2023-07-20T10:08:16.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 msgr2=0x7fb854068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 0x7fb854068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb870167540 tx=0x7fb860008040 comp rx=0 tx=0).stop 2023-07-20T10:08:16.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 msgr2=0x7fb870154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c890 tx=0x7fb86800cd50 comp rx=0 tx=0).stop 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 shutdown_connections 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8701596b0 0x7fb870154ed0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fb8540663a0 0x7fb854068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8700cc900 0x7fb8701510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 --2- 172.21.15.82:0/3570571219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb8700b2380 0x7fb87015c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 >> 172.21.15.82:0/3570571219 conn(0x7fb8700cada0 msgr2=0x7fb8700ac990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:16.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 shutdown_connections 2023-07-20T10:08:16.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.683+0000 7fb87598f640 1 -- 172.21.15.82:0/3570571219 wait complete. 2023-07-20T10:08:16.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:16.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 Processor -- start 2023-07-20T10:08:16.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 -- start start 2023-07-20T10:08:16.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:16.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc0b12a0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc0b1580 con 0x7fd6bc15a8e0 2023-07-20T10:08:16.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.839+0000 7fd6c39ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0b3160 con 0x7fd6bc0afda0 2023-07-20T10:08:16.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1f57640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6bc0b2060 0x7fd6bc0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41972/0 (socket says 172.21.15.82:41972) 2023-07-20T10:08:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1f57640 1 -- 172.21.15.82:0/4218560996 learned_addr learned my addr 172.21.15.82:0/4218560996 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:16.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1756640 1 --2- 172.21.15.82:0/4218560996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214586865 0 0) 0x7fd6bc0b12a0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a8003530 con 0x7fd6bc0b2060 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059678563 0 0) 0x7fd6bc0b1580 con 0x7fd6bc15a8e0 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6bc0b12a0 con 0x7fd6bc15a8e0 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1756640 1 -- 172.21.15.82:0/4218560996 >> v1:172.21.15.183:6789/0 conn(0x7fd6bc15a8e0 legacy=0x7fd6bc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1756640 1 -- 172.21.15.82:0/4218560996 >> v1:172.21.15.82:6789/0 conn(0x7fd6bc0b2060 legacy=0x7fd6bc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1756640 1 -- 172.21.15.82:0/4218560996 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0b1860 con 0x7fd6bc0afda0 2023-07-20T10:08:16.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6c1756640 1 --2- 172.21.15.82:0/4218560996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc0ca6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009820 tx=0x7fd6b801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a428386409e533 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80ab600 con 0x7fd6bc0afda0 2023-07-20T10:08:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b80a7050 con 0x7fd6bc0afda0 2023-07-20T10:08:16.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.843+0000 7fd6b3fff640 1 -- 172.21.15.82:0/4218560996 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b80ab960 con 0x7fd6bc0afda0 2023-07-20T10:08:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- 172.21.15.82:0/4218560996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 msgr2=0x7fd6bc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/4218560996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc0ca6b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009820 tx=0x7fd6b801c350 comp rx=0 tx=0).stop 2023-07-20T10:08:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- 172.21.15.82:0/4218560996 shutdown_connections 2023-07-20T10:08:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/4218560996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc0ca6b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- 172.21.15.82:0/4218560996 >> 172.21.15.82:0/4218560996 conn(0x7fd6bc0cada0 msgr2=0x7fd6bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:16.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- 172.21.15.82:0/4218560996 shutdown_connections 2023-07-20T10:08:16.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- 172.21.15.82:0/4218560996 wait complete. 2023-07-20T10:08:16.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 Processor -- start 2023-07-20T10:08:16.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- start start 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6bc15a8e0 0x7fd6bc09b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc09beb0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0c5ad0 con 0x7fd6bc15a8e0 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c39ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0c5db0 con 0x7fd6bc0afda0 2023-07-20T10:08:16.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50042/0 (socket says 172.21.15.82:50042) 2023-07-20T10:08:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 -- 172.21.15.82:0/2727995160 learned_addr learned my addr 172.21.15.82:0/2727995160 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c1756640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:16.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c1f57640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6bc15a8e0 0x7fd6bc09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 -- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 msgr2=0x7fd6bc143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 -- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6bc15a8e0 msgr2=0x7fd6bc09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6bc15a8e0 0x7fd6bc09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.847+0000 7fd6c0f55640 1 -- 172.21.15.82:0/2727995160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009420 con 0x7fd6bc0b2060 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6c0f55640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c430 tx=0x7fd6ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0052d0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac005450 con 0x7fd6bc0b2060 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc0c6090 con 0x7fd6bc0b2060 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac003840 con 0x7fd6bc0b2060 2023-07-20T10:08:16.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc0c6650 con 0x7fd6bc0b2060 2023-07-20T10:08:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc073c70 con 0x7fd6bc0b2060 2023-07-20T10:08:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd6ac0039a0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 0x7fd6a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fd6ac0833c0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.851+0000 7fd6c1756640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 0x7fd6a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:16.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.855+0000 7fd6c1756640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 0x7fd6a0068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ad000 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:16.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:16.855+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6ac0507d0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.003+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6bc0cb990 con 0x7fd6bc0b2060 2023-07-20T10:08:16.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6b1ffb640 1 -- 172.21.15.82:0/2727995160 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15881 (secure 0 0 0) 0x7fd6ac053df0 con 0x7fd6bc0b2060 2023-07-20T10:08:16.982 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:16.982 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":114,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:13.659938+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.183:6835/886744377":"2023-07-21T10:08:10.647575+0000","172.21.15.82:6833/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3916730360":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/3691570425":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2887507161":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2466713202":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2223184229":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/4013363770":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2674254560":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2315466586":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6832/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3754899936":"2023-07-21T10:08:07.899863+0000","172.21.15.82:6833/3784716253":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/4185959370":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/2979139926":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/3707206980":"2023-07-21T10:07:01.288326+0000","172.21.15.82:0/1784618799":"2023-07-21T10:07:01.288326+0000","172.21.15.183:6833/886744377":"2023-07-21T10:08:10.647575+0000","172.21.15.82:0/635904395":"2023-07-21T10:08:07.899863+0000","172.21.15.82:0/2038385173":"2023-07-21T10:07:01.288326+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:16.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 msgr2=0x7fd6a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 0x7fd6a0068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ad000 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 msgr2=0x7fd6bc0c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac00c430 tx=0x7fd6ac00c8f0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 shutdown_connections 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd6a00663a0 0x7fd6a0068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6bc15a8e0 0x7fd6bc09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6bc0b2060 0x7fd6bc0c53f0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 --2- 172.21.15.82:0/2727995160 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6bc0afda0 0x7fd6bc143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:16.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 >> 172.21.15.82:0/2727995160 conn(0x7fd6bc0cada0 msgr2=0x7fd6bc070590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:16.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 shutdown_connections 2023-07-20T10:08:16.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.007+0000 7fd6c39ba640 1 -- 172.21.15.82:0/2727995160 wait complete. 2023-07-20T10:08:17.003 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:08:17.003 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:08:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.167+0000 7f134d456640 1 Processor -- start 2023-07-20T10:08:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.167+0000 7f134d456640 1 -- start start 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f134d456640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 0x7f13480cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f134d456640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13480cc3e0 0x7f13480afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f134d456640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480cc8d0 con 0x7f1348159450 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f134d456640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480cce90 con 0x7f13480cc3e0 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f134d456640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480ccbb0 con 0x7f1348159830 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13480cc3e0 0x7f13480afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f13480cc3e0 0x7f13480afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50058/0 (socket says 172.21.15.82:50058) 2023-07-20T10:08:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 -- 172.21.15.82:0/2772116377 learned_addr learned my addr 172.21.15.82:0/2772116377 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f133e7fc640 1 --2- 172.21.15.82:0/2772116377 >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 0x7f13480cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 -- 172.21.15.82:0/2772116377 >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 msgr2=0x7f13480cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 --2- 172.21.15.82:0/2772116377 >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 0x7f13480cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 -- 172.21.15.82:0/2772116377 >> v1:172.21.15.183:6789/0 conn(0x7f1348159450 legacy=0x7f134815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 -- 172.21.15.82:0/2772116377 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348159cc0 con 0x7f13480cc3e0 2023-07-20T10:08:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f133e7fc640 1 --2- 172.21.15.82:0/2772116377 >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 0x7f13480cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.171+0000 7f13477fe640 1 --2- 172.21.15.82:0/2772116377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f13480afd50 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f134815e190 tx=0x7f134001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d9ef1c5e936a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f13467fc640 1 -- 172.21.15.82:0/2772116377 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000b2d0 con 0x7f13480cc3e0 2023-07-20T10:08:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f13467fc640 1 -- 172.21.15.82:0/2772116377 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134000b430 con 0x7f13480cc3e0 2023-07-20T10:08:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f13467fc640 1 -- 172.21.15.82:0/2772116377 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13400a7ba0 con 0x7f13480cc3e0 2023-07-20T10:08:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- 172.21.15.82:0/2772116377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 msgr2=0x7f13480afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- 172.21.15.82:0/2772116377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f13480afd50 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f134815e190 tx=0x7f134001eba0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- 172.21.15.82:0/2772116377 shutdown_connections 2023-07-20T10:08:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- 172.21.15.82:0/2772116377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f13480afd50 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- 172.21.15.82:0/2772116377 >> v2:172.21.15.183:3300/0 conn(0x7f1348159830 0x7f13480cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- 172.21.15.82:0/2772116377 >> 172.21.15.82:0/2772116377 conn(0x7f13480cad50 msgr2=0x7f13480cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- 172.21.15.82:0/2772116377 shutdown_connections 2023-07-20T10:08:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- 172.21.15.82:0/2772116377 wait complete. 2023-07-20T10:08:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 Processor -- start 2023-07-20T10:08:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- start start 2023-07-20T10:08:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 0x7f1348150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1348162600 0x7f1348151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348164070 con 0x7f13480cc3e0 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1348162a90 con 0x7f1348162600 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f134d456640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1348162d70 con 0x7f1348159450 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.175+0000 7f1346ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50060/0 (socket says 172.21.15.82:50060) 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 -- 172.21.15.82:0/1870744665 learned_addr learned my addr 172.21.15.82:0/1870744665 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f13477fe640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1348162600 0x7f1348151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133e7fc640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 0x7f1348150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 -- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 msgr2=0x7f1348150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 0x7f1348150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 -- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1348162600 msgr2=0x7f1348151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1348162600 0x7f1348151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 -- 172.21.15.82:0/1870744665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134000bd40 con 0x7f13480cc3e0 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133e7fc640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 0x7f1348150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f1346ffd640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f133800c500 tx=0x7f133800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338005220 con 0x7f13480cc3e0 2023-07-20T10:08:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338005380 con 0x7f13480cc3e0 2023-07-20T10:08:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338007270 con 0x7f13480cc3e0 2023-07-20T10:08:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1348163050 con 0x7f13480cc3e0 2023-07-20T10:08:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1348163610 con 0x7f13480cc3e0 2023-07-20T10:08:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13481641e0 con 0x7f13480cc3e0 2023-07-20T10:08:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.179+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f13380073d0 con 0x7f13480cc3e0 2023-07-20T10:08:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.183+0000 7f133ffff640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 0x7f132c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.183+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1338083720 con 0x7f13480cc3e0 2023-07-20T10:08:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.183+0000 7f133e7fc640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 0x7f132c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.183+0000 7f133e7fc640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 0x7f132c068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1348071030 tx=0x7f1330008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.187+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1338050a90 con 0x7f13480cc3e0 2023-07-20T10:08:17.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.331+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1348163830 con 0x7f13480cc3e0 2023-07-20T10:08:17.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.331+0000 7f133ffff640 1 -- 172.21.15.82:0/1870744665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13380540b0 con 0x7f13480cc3e0 2023-07-20T10:08:17.309 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 msgr2=0x7f132c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 0x7f132c068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1348071030 tx=0x7f1330008040 comp rx=0 tx=0).stop 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 msgr2=0x7f1348163b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f133800c500 tx=0x7f133800c9c0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 shutdown_connections 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f132c0663a0 0x7f132c068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1348162600 0x7f1348151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1348159450 0x7f1348150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 --2- 172.21.15.82:0/1870744665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13480cc3e0 0x7f1348163b30 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 >> 172.21.15.82:0/1870744665 conn(0x7f13480cad50 msgr2=0x7f13480712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 shutdown_connections 2023-07-20T10:08:17.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.335+0000 7f134d456640 1 -- 172.21.15.82:0/1870744665 wait complete. 2023-07-20T10:08:17.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:08:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 Processor -- start 2023-07-20T10:08:17.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 -- start start 2023-07-20T10:08:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe64406b220 0x7fe644160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440ce4f0 con 0x7fe64406c120 2023-07-20T10:08:17.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440d0970 con 0x7fe6441602b0 2023-07-20T10:08:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe64a933640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe644160e20 con 0x7fe64406b220 2023-07-20T10:08:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe643fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe64406c120 0x7fe6440cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41984/0 (socket says 172.21.15.82:41984) 2023-07-20T10:08:17.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe643fff640 1 -- 172.21.15.82:0/150068618 learned_addr learned my addr 172.21.15.82:0/150068618 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:17.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888727604 0 0) 0x7fe6440ce4f0 con 0x7fe64406c120 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe648ed0640 1 --2- 172.21.15.82:0/150068618 >> v2:172.21.15.183:3300/0 conn(0x7fe64406b220 0x7fe644160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe630003530 con 0x7fe64406c120 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837615642 0 0) 0x7fe630003530 con 0x7fe64406c120 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 >> v2:172.21.15.183:3300/0 conn(0x7fe64406b220 msgr2=0x7fe644160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 --2- 172.21.15.82:0/150068618 >> v2:172.21.15.183:3300/0 conn(0x7fe64406b220 0x7fe644160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 >> v1:172.21.15.183:6789/0 conn(0x7fe6441602b0 legacy=0x7fe64406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440cd300 con 0x7fe64406c120 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fe634001680 con 0x7fe64406c120 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 >> v1:172.21.15.82:6789/0 conn(0x7fe64406c120 legacy=0x7fe6440cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6300039f0 0x7fe630003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6300047d0 0x7fe630004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 0x7fe63000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644160e20 con 0x7fe630005290 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63000c1d0 con 0x7fe6300047d0 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.495+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63000c390 con 0x7fe6300039f0 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 0x7fe63000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe63bfff640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6300047d0 0x7fe630004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe643fff640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6300039f0 0x7fe630003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 -- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6300039f0 msgr2=0x7fe630003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6300039f0 0x7fe630003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 -- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6300047d0 msgr2=0x7fe630004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6300047d0 0x7fe630004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 -- 172.21.15.82:0/150068618 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630003530 con 0x7fe630005290 2023-07-20T10:08:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 -- 172.21.15.82:0/150068618 reap_dead start 2023-07-20T10:08:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe648ed0640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 0x7fe63000b990 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009fc0 tx=0x7fe63c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1de82ab47324bb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0a5c60 con 0x7fe630005290 2023-07-20T10:08:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c00f040 con 0x7fe630005290 2023-07-20T10:08:17.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.499+0000 7fe6437fe640 1 -- 172.21.15.82:0/150068618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0039a0 con 0x7fe630005290 2023-07-20T10:08:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 msgr2=0x7fe63000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 0x7fe63000b990 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009fc0 tx=0x7fe63c01cc70 comp rx=0 tx=0).stop 2023-07-20T10:08:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- 172.21.15.82:0/150068618 shutdown_connections 2023-07-20T10:08:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 --2- 172.21.15.82:0/150068618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe630005290 0x7fe63000b990 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- 172.21.15.82:0/150068618 >> 172.21.15.82:0/150068618 conn(0x7fe64408c0a0 msgr2=0x7fe64409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- 172.21.15.82:0/150068618 shutdown_connections 2023-07-20T10:08:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- 172.21.15.82:0/150068618 wait complete. 2023-07-20T10:08:17.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 Processor -- start 2023-07-20T10:08:17.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- start start 2023-07-20T10:08:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe630005290 0x7fe6440c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440b7630 0x7fe6440b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c8990 con 0x7fe6440b71b0 2023-07-20T10:08:17.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c8bc0 con 0x7fe630005290 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe64a933640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c8ea0 con 0x7fe6440b7630 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50066/0 (socket says 172.21.15.82:50066) 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 -- 172.21.15.82:0/1406184037 learned_addr learned my addr 172.21.15.82:0/1406184037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe643fff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe630005290 0x7fe6440c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe648ed0640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440b7630 0x7fe6440b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 -- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440b7630 msgr2=0x7fe6440b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440b7630 0x7fe6440b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 -- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe630005290 msgr2=0x7fe6440c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe630005290 0x7fe6440c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 -- 172.21.15.82:0/1406184037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440b66d0 con 0x7fe6440b71b0 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.503+0000 7fe63bfff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00f5c0 tx=0x7fe62c00f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0052e0 con 0x7fe6440b71b0 2023-07-20T10:08:17.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c005440 con 0x7fe6440b71b0 2023-07-20T10:08:17.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440b69b0 con 0x7fe6440b71b0 2023-07-20T10:08:17.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c003840 con 0x7fe6440b71b0 2023-07-20T10:08:17.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6440c7490 con 0x7fe6440b71b0 2023-07-20T10:08:17.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64404da30 con 0x7fe6440b71b0 2023-07-20T10:08:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe62c0039a0 con 0x7fe6440b71b0 2023-07-20T10:08:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 0x7fe624068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe62c083ce0 con 0x7fe6440b71b0 2023-07-20T10:08:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe643fff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 0x7fe624068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.507+0000 7fe643fff640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 0x7fe624068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe634001130 tx=0x7fe634000ee0 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.511+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe62c051050 con 0x7fe6440b71b0 2023-07-20T10:08:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6440b64b0 con 0x7fe6440b71b0 2023-07-20T10:08:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe6417fa640 1 -- 172.21.15.82:0/1406184037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe62c054670 con 0x7fe6440b71b0 2023-07-20T10:08:17.639 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:08:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 msgr2=0x7fe624068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 0x7fe624068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe634001130 tx=0x7fe634000ee0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 msgr2=0x7fe6440afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00f5c0 tx=0x7fe62c00f9c0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 shutdown_connections 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe6440b7630 0x7fe6440b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6440b71b0 0x7fe6440afbc0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe6240663a0 0x7fe624068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 --2- 172.21.15.82:0/1406184037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe630005290 0x7fe6440c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 >> 172.21.15.82:0/1406184037 conn(0x7fe64408c0a0 msgr2=0x7fe6440b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 shutdown_connections 2023-07-20T10:08:17.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.663+0000 7fe64a933640 1 -- 172.21.15.82:0/1406184037 wait complete. 2023-07-20T10:08:17.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:08:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.823+0000 7fcc65d98640 1 Processor -- start 2023-07-20T10:08:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.823+0000 7fcc65d98640 1 -- start start 2023-07-20T10:08:17.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65d98640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc6015a560 0x7fcc600715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65d98640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc6006c780 0x7fcc6006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65d98640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc600cbdd0 con 0x7fcc600b0eb0 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65d98640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc600cc0b0 con 0x7fcc6006c780 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65d98640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600cc390 con 0x7fcc6015a560 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc6006c780 0x7fcc6006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc6006c780 0x7fcc6006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50070/0 (socket says 172.21.15.82:50070) 2023-07-20T10:08:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 -- 172.21.15.82:0/282884721 learned_addr learned my addr 172.21.15.82:0/282884721 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc65597640 1 --1- 172.21.15.82:0/282884721 >> v1:172.21.15.82:6789/0 conn(0x7fcc600b0eb0 0x7fcc6015dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41992/0 (socket says 172.21.15.82:41992) 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc64d96640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc6015a560 0x7fcc600715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 -- 172.21.15.82:0/282884721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc6015a560 msgr2=0x7fcc600715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc6015a560 0x7fcc600715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 -- 172.21.15.82:0/282884721 >> v1:172.21.15.82:6789/0 conn(0x7fcc600b0eb0 legacy=0x7fcc6015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc57fff640 1 -- 172.21.15.82:0/282884721 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc600cc670 con 0x7fcc6006c780 2023-07-20T10:08:17.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.827+0000 7fcc577fe640 1 -- 172.21.15.82:0/282884721 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447178368 0 0) 0x7fcc600cbdd0 con 0x7fcc600b0eb0 2023-07-20T10:08:17.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc57fff640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6006c780 0x7fcc6006b720 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009870 tx=0x7fcc5001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8513d50da12c3b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc577fe640 1 -- 172.21.15.82:0/282884721 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500ab650 con 0x7fcc6006c780 2023-07-20T10:08:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc577fe640 1 -- 172.21.15.82:0/282884721 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc500ab7b0 con 0x7fcc6006c780 2023-07-20T10:08:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc577fe640 1 -- 172.21.15.82:0/282884721 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc500abb40 con 0x7fcc6006c780 2023-07-20T10:08:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- 172.21.15.82:0/282884721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6006c780 msgr2=0x7fcc6006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6006c780 0x7fcc6006b720 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009870 tx=0x7fcc5001c540 comp rx=0 tx=0).stop 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- 172.21.15.82:0/282884721 shutdown_connections 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6006c780 0x7fcc6006b720 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 --2- 172.21.15.82:0/282884721 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc6015a560 0x7fcc600715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- 172.21.15.82:0/282884721 >> 172.21.15.82:0/282884721 conn(0x7fcc600ce080 msgr2=0x7fcc600ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- 172.21.15.82:0/282884721 shutdown_connections 2023-07-20T10:08:17.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- 172.21.15.82:0/282884721 wait complete. 2023-07-20T10:08:17.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 Processor -- start 2023-07-20T10:08:17.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.831+0000 7fcc65d98640 1 -- start start 2023-07-20T10:08:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 0x7fcc601f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc600b2360 0x7fcc600b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600c3c10 con 0x7fcc6015c830 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc600b2d20 con 0x7fcc600b2360 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6015d1f0 con 0x7fcc600b0eb0 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50078/0 (socket says 172.21.15.82:50078) 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 -- 172.21.15.82:0/4149771408 learned_addr learned my addr 172.21.15.82:0/4149771408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc57fff640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc600b2360 0x7fcc600b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc64d96640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 0x7fcc601f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 -- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 msgr2=0x7fcc601f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 0x7fcc601f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 -- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc600b2360 msgr2=0x7fcc600b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc600b2360 0x7fcc600b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 -- 172.21.15.82:0/4149771408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500094d0 con 0x7fcc6015c830 2023-07-20T10:08:17.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc64d96640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 0x7fcc601f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:17.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65597640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc58002240 tx=0x7fcc5800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800cea0 con 0x7fcc6015c830 2023-07-20T10:08:17.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5800a640 con 0x7fcc6015c830 2023-07-20T10:08:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800a9f0 con 0x7fcc6015c830 2023-07-20T10:08:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc600c7d00 con 0x7fcc6015c830 2023-07-20T10:08:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6015d410 con 0x7fcc6015c830 2023-07-20T10:08:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc600703d0 con 0x7fcc6015c830 2023-07-20T10:08:17.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.835+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcc5800ab50 con 0x7fcc6015c830 2023-07-20T10:08:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.839+0000 7fcc557fa640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 0x7fcc4c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.839+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcc58083390 con 0x7fcc6015c830 2023-07-20T10:08:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.839+0000 7fcc64d96640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 0x7fcc4c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:17.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.839+0000 7fcc64d96640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 0x7fcc4c068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c007a70 tx=0x7fcc5c008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:17.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.843+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc58050700 con 0x7fcc6015c830 2023-07-20T10:08:17.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.991+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcc600adff0 con 0x7fcc6015c830 2023-07-20T10:08:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.995+0000 7fcc557fa640 1 -- 172.21.15.82:0/4149771408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc58053d20 con 0x7fcc6015c830 2023-07-20T10:08:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 msgr2=0x7fcc4c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 0x7fcc4c068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c007a70 tx=0x7fcc5c008040 comp rx=0 tx=0).stop 2023-07-20T10:08:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 msgr2=0x7fcc6015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:17.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fcc58002240 tx=0x7fcc5800cc50 comp rx=0 tx=0).stop 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 shutdown_connections 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc6015c830 0x7fcc6015ccb0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcc4c0663a0 0x7fcc4c068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc600b2360 0x7fcc600b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 --2- 172.21.15.82:0/4149771408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc600b0eb0 0x7fcc601f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:17.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 >> 172.21.15.82:0/4149771408 conn(0x7fcc600ce080 msgr2=0x7fcc600aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:17.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 shutdown_connections 2023-07-20T10:08:17.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:17.999+0000 7fcc65d98640 1 -- 172.21.15.82:0/4149771408 wait complete. 2023-07-20T10:08:17.994 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:08:17.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:08:18.080 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:08:18.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:08:18.139 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:18.139 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:18.148 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:08:18.148 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:08:18.148 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:18.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:08:18.158 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:18.158 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:18.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:08:18.202 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:08:18.202 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:18.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:08:18.212 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:08:18.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:18.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 Processor -- start 2023-07-20T10:08:18.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 -- start start 2023-07-20T10:08:18.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f78c00afda0 0x7f78c00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78c00b2060 0x7f78c00b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c00b06c0 con 0x7f78c015a8e0 2023-07-20T10:08:18.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00b3160 con 0x7f78c00b2060 2023-07-20T10:08:18.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c7256640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c00b12a0 con 0x7f78c00afda0 2023-07-20T10:08:18.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78c00b2060 0x7f78c00b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f78c00b2060 0x7f78c00b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50086/0 (socket says 172.21.15.82:50086) 2023-07-20T10:08:18.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78b7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f78c015a8e0 0x7f78c00b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41996/0 (socket says 172.21.15.82:41996) 2023-07-20T10:08:18.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 -- 172.21.15.82:0/3481235151 learned_addr learned my addr 172.21.15.82:0/3481235151 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c4ff2640 1 --2- 172.21.15.82:0/3481235151 >> v2:172.21.15.183:3300/0 conn(0x7f78c00afda0 0x7f78c00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 -- 172.21.15.82:0/3481235151 >> v2:172.21.15.183:3300/0 conn(0x7f78c00afda0 msgr2=0x7f78c00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 --2- 172.21.15.82:0/3481235151 >> v2:172.21.15.183:3300/0 conn(0x7f78c00afda0 0x7f78c00ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 -- 172.21.15.82:0/3481235151 >> v1:172.21.15.82:6789/0 conn(0x7f78c015a8e0 legacy=0x7f78c00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78c57f3640 1 -- 172.21.15.82:0/3481235151 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00b1580 con 0x7f78c00b2060 2023-07-20T10:08:18.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.407+0000 7f78b77fe640 1 -- 172.21.15.82:0/3481235151 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319487132 0 0) 0x7f78c00b06c0 con 0x7f78c015a8e0 2023-07-20T10:08:18.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c57f3640 1 --2- 172.21.15.82:0/3481235151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c00b0180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b0b40 tx=0x7f78b801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9f7c836cd41835 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78b77fe640 1 -- 172.21.15.82:0/3481235151 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80a5740 con 0x7f78c00b2060 2023-07-20T10:08:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78b77fe640 1 -- 172.21.15.82:0/3481235151 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b80a58a0 con 0x7f78c00b2060 2023-07-20T10:08:18.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78b77fe640 1 -- 172.21.15.82:0/3481235151 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80a5c30 con 0x7f78c00b2060 2023-07-20T10:08:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 -- 172.21.15.82:0/3481235151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 msgr2=0x7f78c00b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 --2- 172.21.15.82:0/3481235151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c00b0180 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b0b40 tx=0x7f78b801c880 comp rx=0 tx=0).stop 2023-07-20T10:08:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 -- 172.21.15.82:0/3481235151 shutdown_connections 2023-07-20T10:08:18.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 --2- 172.21.15.82:0/3481235151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c00b0180 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 --2- 172.21.15.82:0/3481235151 >> v2:172.21.15.183:3300/0 conn(0x7f78c00afda0 0x7f78c00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 -- 172.21.15.82:0/3481235151 >> 172.21.15.82:0/3481235151 conn(0x7f78c00cada0 msgr2=0x7f78c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:18.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 -- 172.21.15.82:0/3481235151 shutdown_connections 2023-07-20T10:08:18.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.411+0000 7f78c7256640 1 -- 172.21.15.82:0/3481235151 wait complete. 2023-07-20T10:08:18.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 Processor -- start 2023-07-20T10:08:18.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- start start 2023-07-20T10:08:18.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78c00afda0 0x7f78c0159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78c015a8e0 0x7f78c015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01f6510 con 0x7f78c00b2060 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01578f0 con 0x7f78c00afda0 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0157bd0 con 0x7f78c015a8e0 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50096/0 (socket says 172.21.15.82:50096) 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 -- 172.21.15.82:0/1901830545 learned_addr learned my addr 172.21.15.82:0/1901830545 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:18.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c4ff2640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78c00afda0 0x7f78c0159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 -- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78c015a8e0 msgr2=0x7f78c015c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78c015a8e0 0x7f78c015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 -- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78c00afda0 msgr2=0x7f78c0159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78c00afda0 0x7f78c0159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 -- 172.21.15.82:0/1901830545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009b30 con 0x7f78c00b2060 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b7fff640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c450 tx=0x7f78b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00074e0 con 0x7f78c00b2060 2023-07-20T10:08:18.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0007640 con 0x7f78c00b2060 2023-07-20T10:08:18.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c0157eb0 con 0x7f78c00b2060 2023-07-20T10:08:18.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b00049f0 con 0x7f78c00b2060 2023-07-20T10:08:18.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.415+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c014df80 con 0x7f78c00b2060 2023-07-20T10:08:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c01583d0 con 0x7f78c00b2060 2023-07-20T10:08:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f78b0004b50 con 0x7f78c00b2060 2023-07-20T10:08:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78b57fa640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 0x7f78ac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f78b0083360 con 0x7f78c00b2060 2023-07-20T10:08:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78c4ff2640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 0x7f78ac068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.419+0000 7f78c4ff2640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 0x7f78ac068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009790 tx=0x7f78bc008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.423+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78c01583d0 con 0x7f78c00b2060 2023-07-20T10:08:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.599+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78c01583d0 con 0x7f78c00b2060 2023-07-20T10:08:18.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78b57fa640 1 -- 172.21.15.82:0/1901830545 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f78b0018de0 con 0x7f78c00b2060 2023-07-20T10:08:18.577 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:18.578 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6995,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/559634958","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":559634958},{"type":"v1","addr":"172.21.15.183:6835","nonce":559634958}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7282,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3539970885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3539970885},{"type":"v1","addr":"172.21.15.82:6837","nonce":3539970885}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2694197504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2694197504},{"type":"v1","addr":"172.21.15.183:6834","nonce":2694197504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7782,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3280743626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3280743626},{"type":"v1","addr":"172.21.15.82:6836","nonce":3280743626}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2023-07-20T10:08:18.578 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 52 2023-07-20T10:08:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 msgr2=0x7f78ac068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 0x7f78ac068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009790 tx=0x7f78bc008040 comp rx=0 tx=0).stop 2023-07-20T10:08:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 msgr2=0x7f78c014da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c450 tx=0x7f78b000c910 comp rx=0 tx=0).stop 2023-07-20T10:08:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 shutdown_connections 2023-07-20T10:08:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f78c015a8e0 0x7f78c015c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78c00b2060 0x7f78c014da40 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f78ac0663a0 0x7f78ac068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 --2- 172.21.15.82:0/1901830545 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78c00afda0 0x7f78c0159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 >> 172.21.15.82:0/1901830545 conn(0x7f78c00cada0 msgr2=0x7f78c006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 shutdown_connections 2023-07-20T10:08:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.603+0000 7f78c7256640 1 -- 172.21.15.82:0/1901830545 wait complete. 2023-07-20T10:08:18.598 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:08:18.599 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:08:18.599 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:08:18.599 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:08:18.599 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:08:18.600 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:08:18.600 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:08:18.600 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:08:18.600 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:08:18.601 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:08:18.601 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:08:18.601 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:08:18.601 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:08:18.601 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:08:18.602 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:08:18.602 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:08:18.612 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:08:18.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:08:18.613 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:08:18.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:08:18.618 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:08:18.618 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:08:18.619 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:08:18.619 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:08:18.656 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:08:18.657 DEBUG:teuthology.parallel:result is None 2023-07-20T10:08:18.659 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:08:18.660 DEBUG:teuthology.parallel:result is None 2023-07-20T10:08:18.666 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:08:18.666 DEBUG:teuthology.parallel:result is None 2023-07-20T10:08:18.668 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:08:18.668 DEBUG:teuthology.parallel:result is None 2023-07-20T10:08:18.669 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:08:18.744 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:08:18.748 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:08:18.758 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:08:18.760 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:08:18.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.839+0000 7f1ba21fa640 1 Processor -- start 2023-07-20T10:08:18.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.839+0000 7f1ba21fa640 1 -- start start 2023-07-20T10:08:18.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1ba21fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0afda0 0x7f1b9c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1ba21fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b9c0b2060 0x7f1b9c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1ba21fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c0b06c0 con 0x7f1b9c15a8e0 2023-07-20T10:08:18.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1ba21fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c0b3160 con 0x7f1b9c0b2060 2023-07-20T10:08:18.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1ba21fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0b12a0 con 0x7f1b9c0afda0 2023-07-20T10:08:18.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b9c0b2060 0x7f1b9c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1b9c0b2060 0x7f1b9c0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:40128/0 (socket says 172.21.15.82:40128) 2023-07-20T10:08:18.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 -- 172.21.15.82:0/3608775457 learned_addr learned my addr 172.21.15.82:0/3608775457 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0afda0 0x7f1b9c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 -- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0afda0 msgr2=0x7f1b9c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 --2- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0afda0 0x7f1b9c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 -- 172.21.15.82:0/3608775457 >> v1:172.21.15.183:6789/0 conn(0x7f1b9c15a8e0 legacy=0x7f1b9c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.843+0000 7f1b9bfff640 1 -- 172.21.15.82:0/3608775457 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0b1580 con 0x7f1b9c0b2060 2023-07-20T10:08:18.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1b9bfff640 1 --2- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c0b2060 0x7f1b9c0b0180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009e50 tx=0x7f1b9401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508efcdf74bcd056 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1b9a7fc640 1 -- 172.21.15.82:0/3608775457 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940a5780 con 0x7f1b9c0b2060 2023-07-20T10:08:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1b9a7fc640 1 -- 172.21.15.82:0/3608775457 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b940a58e0 con 0x7f1b9c0b2060 2023-07-20T10:08:18.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1b9a7fc640 1 -- 172.21.15.82:0/3608775457 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b940a5c70 con 0x7f1b9c0b2060 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c0b2060 msgr2=0x7f1b9c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c0b2060 0x7f1b9c0b0180 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1b94009e50 tx=0x7f1b9401c8c0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- 172.21.15.82:0/3608775457 shutdown_connections 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c0b2060 0x7f1b9c0b0180 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/3608775457 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0afda0 0x7f1b9c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- 172.21.15.82:0/3608775457 >> 172.21.15.82:0/3608775457 conn(0x7f1b9c0cada0 msgr2=0x7f1b9c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- 172.21.15.82:0/3608775457 shutdown_connections 2023-07-20T10:08:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- 172.21.15.82:0/3608775457 wait complete. 2023-07-20T10:08:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 Processor -- start 2023-07-20T10:08:18.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.847+0000 7f1ba21fa640 1 -- start start 2023-07-20T10:08:18.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0b2060 0x7f1b9c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 0x7f1b9c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0afc30 con 0x7f1b9c0afda0 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0afa20 con 0x7f1b9c15a8e0 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0ae450 con 0x7f1b9c0b2060 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50116/0 (socket says 172.21.15.82:50116) 2023-07-20T10:08:18.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 -- 172.21.15.82:0/869307037 learned_addr learned my addr 172.21.15.82:0/869307037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:18.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9bfff640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 0x7f1b9c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9affd640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0b2060 0x7f1b9c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 -- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0b2060 msgr2=0x7f1b9c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0b2060 0x7f1b9c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 -- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 msgr2=0x7f1b9c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 0x7f1b9c15ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:18.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 -- 172.21.15.82:0/869307037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009b30 con 0x7f1b9c0afda0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9bfff640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 0x7f1b9c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b9b7fe640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00e930 tx=0x7f1b8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c009690 con 0x7f1b9c0afda0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00ca00 con 0x7f1b9c0afda0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c157df0 con 0x7f1b9c0afda0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00cd70 con 0x7f1b9c0afda0 2023-07-20T10:08:18.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c1577a0 con 0x7f1b9c0afda0 2023-07-20T10:08:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c073c70 con 0x7f1b9c0afda0 2023-07-20T10:08:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.851+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b8c013470 con 0x7f1b9c0afda0 2023-07-20T10:08:18.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.855+0000 7f1b83fff640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 0x7f1b88068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.855+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1b8c084040 con 0x7f1b9c0afda0 2023-07-20T10:08:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.855+0000 7f1b9affd640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 0x7f1b88068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:18.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.855+0000 7f1b9affd640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 0x7f1b88068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c1f8390 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:18.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:18.859+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b8c051510 con 0x7f1b9c0afda0 2023-07-20T10:08:18.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:19.019+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1b9c0c9c50 con 0x7f1b9c0afda0 2023-07-20T10:08:20.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1b83fff640 1 -- 172.21.15.82:0/869307037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1b8c054b30 con 0x7f1b9c0afda0 2023-07-20T10:08:20.006 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:08:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 msgr2=0x7f1b88068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 0x7f1b88068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c1f8390 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2023-07-20T10:08:20.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 msgr2=0x7f1b9c0af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00e930 tx=0x7f1b8c00edf0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 shutdown_connections 2023-07-20T10:08:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1b880663d0 0x7f1b88068890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1b9c15a8e0 0x7f1b9c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1b9c0b2060 0x7f1b9c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 --2- 172.21.15.82:0/869307037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1b9c0afda0 0x7f1b9c0af4e0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 >> 172.21.15.82:0/869307037 conn(0x7f1b9c0cada0 msgr2=0x7f1b9c164a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 shutdown_connections 2023-07-20T10:08:20.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.031+0000 7f1ba21fa640 1 -- 172.21.15.82:0/869307037 wait complete. 2023-07-20T10:08:20.031 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:08:20.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 Processor -- start 2023-07-20T10:08:20.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 -- start start 2023-07-20T10:08:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 0x7fceec0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0b12a0 con 0x7fceec0b2060 2023-07-20T10:08:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0b1580 con 0x7fceec15a8e0 2023-07-20T10:08:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fcef1d03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0b3160 con 0x7fceec0afda0 2023-07-20T10:08:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceebfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fceec0b2060 0x7fceec0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42006/0 (socket says 172.21.15.82:42006) 2023-07-20T10:08:20.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceebfff640 1 -- 172.21.15.82:0/1588396286 learned_addr learned my addr 172.21.15.82:0/1588396286 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeb7fe640 1 --2- 172.21.15.82:0/1588396286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 0x7fceec0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312365882 0 0) 0x7fceec0b12a0 con 0x7fceec0b2060 2023-07-20T10:08:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced8003530 con 0x7fceec0b2060 2023-07-20T10:08:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644898519 0 0) 0x7fceec0b1580 con 0x7fceec15a8e0 2023-07-20T10:08:20.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceec0b12a0 con 0x7fceec15a8e0 2023-07-20T10:08:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeb7fe640 1 -- 172.21.15.82:0/1588396286 >> v1:172.21.15.183:6789/0 conn(0x7fceec15a8e0 legacy=0x7fceec0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeb7fe640 1 -- 172.21.15.82:0/1588396286 >> v1:172.21.15.82:6789/0 conn(0x7fceec0b2060 legacy=0x7fceec0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.199+0000 7fceeb7fe640 1 -- 172.21.15.82:0/1588396286 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0b1860 con 0x7fceec0afda0 2023-07-20T10:08:20.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fceeb7fe640 1 --2- 172.21.15.82:0/1588396286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 0x7fceec0ca6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fced4009820 tx=0x7fced401c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5ccf3466dc2065 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40ab600 con 0x7fceec0afda0 2023-07-20T10:08:20.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced40a7050 con 0x7fceec0afda0 2023-07-20T10:08:20.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fceeaffd640 1 -- 172.21.15.82:0/1588396286 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40ab980 con 0x7fceec0afda0 2023-07-20T10:08:20.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 -- 172.21.15.82:0/1588396286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 msgr2=0x7fceec0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 --2- 172.21.15.82:0/1588396286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 0x7fceec0ca6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fced4009820 tx=0x7fced401c350 comp rx=0 tx=0).stop 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 -- 172.21.15.82:0/1588396286 shutdown_connections 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 --2- 172.21.15.82:0/1588396286 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec0afda0 0x7fceec0ca6b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 -- 172.21.15.82:0/1588396286 >> 172.21.15.82:0/1588396286 conn(0x7fceec0cada0 msgr2=0x7fceec0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 -- 172.21.15.82:0/1588396286 shutdown_connections 2023-07-20T10:08:20.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.203+0000 7fcef1d03640 1 -- 172.21.15.82:0/1588396286 wait complete. 2023-07-20T10:08:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 Processor -- start 2023-07-20T10:08:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- start start 2023-07-20T10:08:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceec0b2060 0x7fceec151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec15a8e0 0x7fceec152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec15bf30 con 0x7fceec0afda0 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec151330 con 0x7fceec0b2060 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec151800 con 0x7fceec15a8e0 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50120/0 (socket says 172.21.15.82:50120) 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 -- 172.21.15.82:0/4032866142 learned_addr learned my addr 172.21.15.82:0/4032866142 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceebfff640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec15a8e0 0x7fceec152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcee2ffd640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceec0b2060 0x7fceec151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 -- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec15a8e0 msgr2=0x7fceec152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec15a8e0 0x7fceec152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 -- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceec0b2060 msgr2=0x7fceec151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceec0b2060 0x7fceec151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 -- 172.21.15.82:0/4032866142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4009420 con 0x7fceec0afda0 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fceeb7fe640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fced40ae040 tx=0x7fced401ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40b7450 con 0x7fceec0afda0 2023-07-20T10:08:20.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced40b75d0 con 0x7fceec0afda0 2023-07-20T10:08:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40b7980 con 0x7fceec0afda0 2023-07-20T10:08:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec0ac480 con 0x7fceec0afda0 2023-07-20T10:08:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.207+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec15b870 con 0x7fceec0afda0 2023-07-20T10:08:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec073c70 con 0x7fceec0afda0 2023-07-20T10:08:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fced40b7ae0 con 0x7fceec0afda0 2023-07-20T10:08:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcee8ff9640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 0x7fcecc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fced411e430 con 0x7fceec0afda0 2023-07-20T10:08:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcee2ffd640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 0x7fcecc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.211+0000 7fcee2ffd640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 0x7fcecc068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fceec15dd20 tx=0x7fcedc009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.215+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fced40ebc20 con 0x7fceec0afda0 2023-07-20T10:08:20.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fceec0cb990 con 0x7fceec0afda0 2023-07-20T10:08:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcee8ff9640 1 -- 172.21.15.82:0/4032866142 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fced40ef240 con 0x7fceec0afda0 2023-07-20T10:08:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:20.387 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:08:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:08:20.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:08:20.388 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.389 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:08:20.390 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:08:20.392 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.393 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.394 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:08:20.395 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.396 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.399 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.400 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.401 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:08:20.402 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:08:20.403 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:08:20.405 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:08:20.406 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:08:20.407 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.409 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:08:20.410 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:08:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:20.411 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:08:20.411 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:08:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 msgr2=0x7fcecc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 0x7fcecc068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fceec15dd20 tx=0x7fcedc009040 comp rx=0 tx=0).stop 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 msgr2=0x7fceec165c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fced40ae040 tx=0x7fced401ab90 comp rx=0 tx=0).stop 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 shutdown_connections 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceec15a8e0 0x7fceec152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fcecc0663a0 0x7fcecc068860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceec0b2060 0x7fceec151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 --2- 172.21.15.82:0/4032866142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceec0afda0 0x7fceec165c80 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 >> 172.21.15.82:0/4032866142 conn(0x7fceec0cada0 msgr2=0x7fceec1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 shutdown_connections 2023-07-20T10:08:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.411+0000 7fcef1d03640 1 -- 172.21.15.82:0/4032866142 wait complete. 2023-07-20T10:08:20.414 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:20.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 Processor -- start 2023-07-20T10:08:20.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 -- start start 2023-07-20T10:08:20.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c15c5f0 0x7f690c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f690c0ccfb0 0x7f690c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f690c0b7c20 con 0x7f690c0ce9a0 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f690c0cee50 con 0x7f690c0ccfb0 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6912ba5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c15c9d0 con 0x7f690c15c5f0 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f69123a4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f690c0ce9a0 0x7f690c0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42010/0 (socket says 172.21.15.82:42010) 2023-07-20T10:08:20.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f69123a4640 1 -- 172.21.15.82:0/1130673932 learned_addr learned my addr 172.21.15.82:0/1130673932 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f69113a2640 1 --2- 172.21.15.82:0/1130673932 >> v2:172.21.15.183:3300/0 conn(0x7f690c0ccfb0 0x7f690c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.579+0000 7f6911ba3640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c15c5f0 0x7f690c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f6910ba1640 1 -- 172.21.15.82:0/1130673932 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092968501 0 0) 0x7f690c0b7c20 con 0x7f690c0ce9a0 2023-07-20T10:08:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f6910ba1640 1 -- 172.21.15.82:0/1130673932 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68f8003530 con 0x7f690c0ce9a0 2023-07-20T10:08:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f69113a2640 1 -- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c15c5f0 msgr2=0x7f690c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f69113a2640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c15c5f0 0x7f690c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f69113a2640 1 -- 172.21.15.82:0/1130673932 >> v1:172.21.15.82:6789/0 conn(0x7f690c0ce9a0 legacy=0x7f690c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f69113a2640 1 -- 172.21.15.82:0/1130673932 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0ce030 con 0x7f690c0ccfb0 2023-07-20T10:08:20.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f69113a2640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0ce460 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0097c0 tx=0x7f68fc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=665bced69166d5e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f6910ba1640 1 -- 172.21.15.82:0/1130673932 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0a8970 con 0x7f690c0ccfb0 2023-07-20T10:08:20.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f6910ba1640 1 -- 172.21.15.82:0/1130673932 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc0a8ad0 con 0x7f690c0ccfb0 2023-07-20T10:08:20.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.583+0000 7f6910ba1640 1 -- 172.21.15.82:0/1130673932 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0a8e60 con 0x7f690c0ccfb0 2023-07-20T10:08:20.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 msgr2=0x7f690c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0ce460 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0097c0 tx=0x7f68fc01ec70 comp rx=0 tx=0).stop 2023-07-20T10:08:20.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- 172.21.15.82:0/1130673932 shutdown_connections 2023-07-20T10:08:20.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0ce460 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- 172.21.15.82:0/1130673932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c15c5f0 0x7f690c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- 172.21.15.82:0/1130673932 >> 172.21.15.82:0/1130673932 conn(0x7f690c065710 msgr2=0x7f690c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- 172.21.15.82:0/1130673932 shutdown_connections 2023-07-20T10:08:20.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- 172.21.15.82:0/1130673932 wait complete. 2023-07-20T10:08:20.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 Processor -- start 2023-07-20T10:08:20.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- start start 2023-07-20T10:08:20.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 0x7f690c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c0a9540 con 0x7f690c15c5f0 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c150130 con 0x7f690c0ccfb0 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f6912ba5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c14c9b0 con 0x7f690c0ce9a0 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f69123a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f69123a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50132/0 (socket says 172.21.15.82:50132) 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.587+0000 7f69123a4640 1 -- 172.21.15.82:0/796050166 learned_addr learned my addr 172.21.15.82:0/796050166 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69113a2640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 0x7f690c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f6911ba3640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 -- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 msgr2=0x7f690c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 0x7f690c15da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 -- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 msgr2=0x7f690c0a99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0a99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 -- 172.21.15.82:0/796050166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc009420 con 0x7f690c15c5f0 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69113a2640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 0x7f690c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:20.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f6911ba3640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:20.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69123a4640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f690400c450 tx=0x7f690400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904005cf0 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6904005e50 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c14cc90 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69040072b0 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c0a91d0 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0a96b0 con 0x7f690c15c5f0 2023-07-20T10:08:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.591+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6904007410 con 0x7f690c15c5f0 2023-07-20T10:08:20.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.595+0000 7f69027fc640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 0x7f68f0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.595+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6904082ff0 con 0x7f690c15c5f0 2023-07-20T10:08:20.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.595+0000 7f6911ba3640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 0x7f68f0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.595+0000 7f6911ba3640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 0x7f68f0068890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6908009fd0 tx=0x7f690800b040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.599+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69040b3700 con 0x7f690c15c5f0 2023-07-20T10:08:20.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.747+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f690c04da30 con 0x7f690c15c5f0 2023-07-20T10:08:20.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.747+0000 7f69027fc640 1 -- 172.21.15.82:0/796050166 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+14625 (secure 0 0 0) 0x7f69040540c0 con 0x7f690c15c5f0 2023-07-20T10:08:20.725 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:20.725 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":119,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:20.028009+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:20.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 msgr2=0x7f68f0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 0x7f68f0068890 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6908009fd0 tx=0x7f690800b040 comp rx=0 tx=0).stop 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 msgr2=0x7f690c14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f690400c450 tx=0x7f690400c910 comp rx=0 tx=0).stop 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 shutdown_connections 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f690c15c5f0 0x7f690c14be00 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f690c0ce9a0 0x7f690c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f68f00663d0 0x7f68f0068890 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 --2- 172.21.15.82:0/796050166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f690c0ccfb0 0x7f690c0a99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 >> 172.21.15.82:0/796050166 conn(0x7f690c065710 msgr2=0x7f690c0b7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 shutdown_connections 2023-07-20T10:08:20.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.751+0000 7f6912ba5640 1 -- 172.21.15.82:0/796050166 wait complete. 2023-07-20T10:08:20.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:08:20.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:08:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.911+0000 7f395d418640 1 Processor -- start 2023-07-20T10:08:20.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 -- start start 2023-07-20T10:08:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 0x7f39580cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f395815cac0 0x7f39580d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39580cdb40 con 0x7f39580d3200 2023-07-20T10:08:20.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580d07a0 con 0x7f395815cac0 2023-07-20T10:08:20.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f395d418640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39580cd4f0 con 0x7f395815c6e0 2023-07-20T10:08:20.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f395815cac0 0x7f39580d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f395815cac0 0x7f39580d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50140/0 (socket says 172.21.15.82:50140) 2023-07-20T10:08:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 -- 172.21.15.82:0/640158618 learned_addr learned my addr 172.21.15.82:0/640158618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f3956ffd640 1 --2- 172.21.15.82:0/640158618 >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 0x7f39580cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 -- 172.21.15.82:0/640158618 >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 msgr2=0x7f39580cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 --2- 172.21.15.82:0/640158618 >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 0x7f39580cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 -- 172.21.15.82:0/640158618 >> v1:172.21.15.183:6789/0 conn(0x7f39580d3200 legacy=0x7f39580cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:20.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f39577fe640 1 -- 172.21.15.82:0/640158618 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39580cd7d0 con 0x7f395815cac0 2023-07-20T10:08:20.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.915+0000 7f3956ffd640 1 --2- 172.21.15.82:0/640158618 >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 0x7f39580cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:20.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f39577fe640 1 --2- 172.21.15.82:0/640158618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395815cac0 0x7f39580d0be0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f395808a310 tx=0x7f395001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3979d8dbf769e94 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f39567fc640 1 -- 172.21.15.82:0/640158618 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500ab600 con 0x7f395815cac0 2023-07-20T10:08:20.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f39567fc640 1 -- 172.21.15.82:0/640158618 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39500a7050 con 0x7f395815cac0 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f39567fc640 1 -- 172.21.15.82:0/640158618 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39500ab980 con 0x7f395815cac0 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- 172.21.15.82:0/640158618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395815cac0 msgr2=0x7f39580d0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 --2- 172.21.15.82:0/640158618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395815cac0 0x7f39580d0be0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f395808a310 tx=0x7f395001c3a0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- 172.21.15.82:0/640158618 shutdown_connections 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 --2- 172.21.15.82:0/640158618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f395815cac0 0x7f39580d0be0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 --2- 172.21.15.82:0/640158618 >> v2:172.21.15.183:3300/0 conn(0x7f395815c6e0 0x7f39580cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- 172.21.15.82:0/640158618 >> 172.21.15.82:0/640158618 conn(0x7f39580d2600 msgr2=0x7f39580d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- 172.21.15.82:0/640158618 shutdown_connections 2023-07-20T10:08:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- 172.21.15.82:0/640158618 wait complete. 2023-07-20T10:08:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 Processor -- start 2023-07-20T10:08:20.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.919+0000 7f395d418640 1 -- start start 2023-07-20T10:08:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395815c6e0 0x7f3958153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f395815cac0 0x7f3958154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958157b10 con 0x7f39580d3200 2023-07-20T10:08:20.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3958157680 con 0x7f395815c6e0 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3958157070 con 0x7f395815cac0 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50142/0 (socket says 172.21.15.82:50142) 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 -- 172.21.15.82:0/20120422 learned_addr learned my addr 172.21.15.82:0/20120422 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f39577fe640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f395815cac0 0x7f3958154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f394e7fc640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395815c6e0 0x7f3958153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 -- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f395815cac0 msgr2=0x7f3958154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f395815cac0 0x7f3958154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 -- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395815c6e0 msgr2=0x7f3958153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395815c6e0 0x7f3958153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 -- 172.21.15.82:0/20120422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39500094d0 con 0x7f39580d3200 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f3956ffd640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f394800cf60 tx=0x7f394800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800d840 con 0x7f39580d3200 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394800d9a0 con 0x7f39580d3200 2023-07-20T10:08:20.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394800dd30 con 0x7f39580d3200 2023-07-20T10:08:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39581556e0 con 0x7f39580d3200 2023-07-20T10:08:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39581559c0 con 0x7f39580d3200 2023-07-20T10:08:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.923+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395804da30 con 0x7f39580d3200 2023-07-20T10:08:20.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.927+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3948015440 con 0x7f39580d3200 2023-07-20T10:08:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.927+0000 7f394ffff640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 0x7f3938068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.927+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3948084500 con 0x7f39580d3200 2023-07-20T10:08:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.927+0000 7f394e7fc640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 0x7f3938068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.927+0000 7f394e7fc640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 0x7f3938068890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3958167720 tx=0x7f3940009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:20.931+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3948051bd0 con 0x7f39580d3200 2023-07-20T10:08:21.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.079+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39580cf770 con 0x7f39580d3200 2023-07-20T10:08:21.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f394ffff640 1 -- 172.21.15.82:0/20120422 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39480551f0 con 0x7f39580d3200 2023-07-20T10:08:21.057 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:08:21.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 msgr2=0x7f3938068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 0x7f3938068890 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3958167720 tx=0x7f3940009040 comp rx=0 tx=0).stop 2023-07-20T10:08:21.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 msgr2=0x7f3958151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f394800cf60 tx=0x7f394800cf90 comp rx=0 tx=0).stop 2023-07-20T10:08:21.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 shutdown_connections 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f395815cac0 0x7f3958154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f39380663d0 0x7f3938068890 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f395815c6e0 0x7f3958153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 --2- 172.21.15.82:0/20120422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39580d3200 0x7f3958151c10 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 >> 172.21.15.82:0/20120422 conn(0x7f39580d2600 msgr2=0x7f39580b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 shutdown_connections 2023-07-20T10:08:21.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.083+0000 7f395d418640 1 -- 172.21.15.82:0/20120422 wait complete. 2023-07-20T10:08:21.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:08:21.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 Processor -- start 2023-07-20T10:08:21.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 -- start start 2023-07-20T10:08:21.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda6c159830 0x7fda6c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c0cc8d0 con 0x7fda6c159450 2023-07-20T10:08:21.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c0ccbb0 con 0x7fda6c0cc3e0 2023-07-20T10:08:21.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.243+0000 7fda70ecb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0cce90 con 0x7fda6c159830 2023-07-20T10:08:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda61d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fda6c159830 0x7fda6c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda6a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fda6c159450 0x7fda6c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42012/0 (socket says 172.21.15.82:42012) 2023-07-20T10:08:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda6a59c640 1 -- 172.21.15.82:0/155817116 learned_addr learned my addr 172.21.15.82:0/155817116 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:21.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda61d9b640 1 -- 172.21.15.82:0/155817116 >> v1:172.21.15.183:6789/0 conn(0x7fda6c0cc3e0 legacy=0x7fda6c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda61d9b640 1 -- 172.21.15.82:0/155817116 >> v1:172.21.15.82:6789/0 conn(0x7fda6c159450 legacy=0x7fda6c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda61d9b640 1 -- 172.21.15.82:0/155817116 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c159cc0 con 0x7fda6c159830 2023-07-20T10:08:21.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda61d9b640 1 --2- 172.21.15.82:0/155817116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c159830 0x7fda6c0cbea0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fda540097c0 tx=0x7fda5401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6495a4a3a770eb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda69d9b640 1 -- 172.21.15.82:0/155817116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ab600 con 0x7fda6c159830 2023-07-20T10:08:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda69d9b640 1 -- 172.21.15.82:0/155817116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda540a7050 con 0x7fda6c159830 2023-07-20T10:08:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.247+0000 7fda69d9b640 1 -- 172.21.15.82:0/155817116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda540ab980 con 0x7fda6c159830 2023-07-20T10:08:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- 172.21.15.82:0/155817116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c159830 msgr2=0x7fda6c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 --2- 172.21.15.82:0/155817116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c159830 0x7fda6c0cbea0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fda540097c0 tx=0x7fda5401c410 comp rx=0 tx=0).stop 2023-07-20T10:08:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- 172.21.15.82:0/155817116 shutdown_connections 2023-07-20T10:08:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 --2- 172.21.15.82:0/155817116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c159830 0x7fda6c0cbea0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- 172.21.15.82:0/155817116 >> 172.21.15.82:0/155817116 conn(0x7fda6c0cad50 msgr2=0x7fda6c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- 172.21.15.82:0/155817116 shutdown_connections 2023-07-20T10:08:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- 172.21.15.82:0/155817116 wait complete. 2023-07-20T10:08:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 Processor -- start 2023-07-20T10:08:21.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- start start 2023-07-20T10:08:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda6c0cc3e0 0x7fda6c164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda6c159450 0x7fda6c167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c169020 con 0x7fda6c1683b0 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c164850 con 0x7fda6c159450 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda70ecb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c163c40 con 0x7fda6c0cc3e0 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda6ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50164/0 (socket says 172.21.15.82:50164) 2023-07-20T10:08:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda6ad9d640 1 -- 172.21.15.82:0/678200421 learned_addr learned my addr 172.21.15.82:0/678200421 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda6a59c640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda6c0cc3e0 0x7fda6c164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.251+0000 7fda61d9b640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda6c159450 0x7fda6c167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 -- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda6c0cc3e0 msgr2=0x7fda6c164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda6c0cc3e0 0x7fda6c164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 -- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda6c159450 msgr2=0x7fda6c167e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda6c159450 0x7fda6c167e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 -- 172.21.15.82:0/678200421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009420 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6ad9d640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c7b0 tx=0x7fda6400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64003d90 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400ce60 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda640052b0 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c163f20 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c1644e0 con 0x7fda6c1683b0 2023-07-20T10:08:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c04da30 con 0x7fda6c1683b0 2023-07-20T10:08:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fda64006b20 con 0x7fda6c1683b0 2023-07-20T10:08:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 0x7fda4c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda64082e70 con 0x7fda6c1683b0 2023-07-20T10:08:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.255+0000 7fda6a59c640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 0x7fda4c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.259+0000 7fda6a59c640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 0x7fda4c068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda5c005890 tx=0x7fda5c009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.259+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda640505e0 con 0x7fda6c1683b0 2023-07-20T10:08:21.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.407+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fda6c164990 con 0x7fda6c1683b0 2023-07-20T10:08:21.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.407+0000 7fda637fe640 1 -- 172.21.15.82:0/678200421 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v119) v1 ==== 92+0+10 (secure 0 0 0) 0x7fda64017020 con 0x7fda6c1683b0 2023-07-20T10:08:21.385 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:08:21.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 msgr2=0x7fda4c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 0x7fda4c068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda5c005890 tx=0x7fda5c009040 comp rx=0 tx=0).stop 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 msgr2=0x7fda6c0c1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fda6400c7b0 tx=0x7fda6400cc70 comp rx=0 tx=0).stop 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 shutdown_connections 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda6c1683b0 0x7fda6c0c1c30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fda4c0663d0 0x7fda4c068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda6c159450 0x7fda6c167e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 --2- 172.21.15.82:0/678200421 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fda6c0cc3e0 0x7fda6c164ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 >> 172.21.15.82:0/678200421 conn(0x7fda6c0cad50 msgr2=0x7fda6c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 shutdown_connections 2023-07-20T10:08:21.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.411+0000 7fda70ecb640 1 -- 172.21.15.82:0/678200421 wait complete. 2023-07-20T10:08:21.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:08:21.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 Processor -- start 2023-07-20T10:08:21.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 -- start start 2023-07-20T10:08:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faba415a8e0 0x7faba40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40b12a0 con 0x7faba40afda0 2023-07-20T10:08:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40b1580 con 0x7faba40b2060 2023-07-20T10:08:21.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fabaa182640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b3160 con 0x7faba415a8e0 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fab9affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faba415a8e0 0x7faba40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7faba37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faba40afda0 0x7faba40b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42022/0 (socket says 172.21.15.82:42022) 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7faba37fe640 1 -- 172.21.15.82:0/3775765254 learned_addr learned my addr 172.21.15.82:0/3775765254 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.567+0000 7fab9affd640 1 -- 172.21.15.82:0/3775765254 >> v1:172.21.15.183:6789/0 conn(0x7faba40b2060 legacy=0x7faba40b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fab9affd640 1 -- 172.21.15.82:0/3775765254 >> v1:172.21.15.82:6789/0 conn(0x7faba40afda0 legacy=0x7faba40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fab9affd640 1 -- 172.21.15.82:0/3775765254 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40b1860 con 0x7faba415a8e0 2023-07-20T10:08:21.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7faba2ffd640 1 -- 172.21.15.82:0/3775765254 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593976696 0 0) 0x7faba40b12a0 con 0x7faba40afda0 2023-07-20T10:08:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fab9affd640 1 --2- 172.21.15.82:0/3775765254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba415a8e0 0x7faba40ca6b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097c0 tx=0x7fab8c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be08680f3bb4289 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7faba2ffd640 1 -- 172.21.15.82:0/3775765254 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0ab600 con 0x7faba415a8e0 2023-07-20T10:08:21.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7faba2ffd640 1 -- 172.21.15.82:0/3775765254 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c0a7050 con 0x7faba415a8e0 2023-07-20T10:08:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7faba2ffd640 1 -- 172.21.15.82:0/3775765254 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0ab980 con 0x7faba415a8e0 2023-07-20T10:08:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 -- 172.21.15.82:0/3775765254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba415a8e0 msgr2=0x7faba40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 --2- 172.21.15.82:0/3775765254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba415a8e0 0x7faba40ca6b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097c0 tx=0x7fab8c01c330 comp rx=0 tx=0).stop 2023-07-20T10:08:21.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 -- 172.21.15.82:0/3775765254 shutdown_connections 2023-07-20T10:08:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 --2- 172.21.15.82:0/3775765254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba415a8e0 0x7faba40ca6b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 -- 172.21.15.82:0/3775765254 >> 172.21.15.82:0/3775765254 conn(0x7faba40cada0 msgr2=0x7faba40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 -- 172.21.15.82:0/3775765254 shutdown_connections 2023-07-20T10:08:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.571+0000 7fabaa182640 1 -- 172.21.15.82:0/3775765254 wait complete. 2023-07-20T10:08:21.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 Processor -- start 2023-07-20T10:08:21.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 -- start start 2023-07-20T10:08:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faba40afda0 0x7faba4155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faba415a8e0 0x7faba40c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4159f10 con 0x7faba40b2060 2023-07-20T10:08:21.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4157410 con 0x7faba40afda0 2023-07-20T10:08:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fabaa182640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba4156370 con 0x7faba415a8e0 2023-07-20T10:08:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50168/0 (socket says 172.21.15.82:50168) 2023-07-20T10:08:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 -- 172.21.15.82:0/3753478305 learned_addr learned my addr 172.21.15.82:0/3753478305 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:21.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7faba37fe640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faba40afda0 0x7faba4155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7faba3fff640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faba415a8e0 0x7faba40c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 -- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faba415a8e0 msgr2=0x7faba40c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faba415a8e0 0x7faba40c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 -- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faba40afda0 msgr2=0x7faba4155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faba40afda0 0x7faba4155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 -- 172.21.15.82:0/3753478305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c009420 con 0x7faba40b2060 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.575+0000 7fab9affd640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fab8c018f40 tx=0x7fab8c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0b4600 con 0x7faba40b2060 2023-07-20T10:08:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c0b4780 con 0x7faba40b2060 2023-07-20T10:08:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0b4b30 con 0x7faba40b2060 2023-07-20T10:08:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba4156650 con 0x7faba40b2060 2023-07-20T10:08:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba4156c10 con 0x7faba40b2060 2023-07-20T10:08:21.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba4073c70 con 0x7faba40b2060 2023-07-20T10:08:21.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab8c0b2040 con 0x7faba40b2060 2023-07-20T10:08:21.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 0x7fab84068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab8c11dbb0 con 0x7faba40b2060 2023-07-20T10:08:21.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.579+0000 7faba37fe640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 0x7fab84068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.583+0000 7faba37fe640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 0x7fab84068890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fab940012f0 tx=0x7fab94004d50 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.583+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab8c0eb210 con 0x7faba40b2060 2023-07-20T10:08:21.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faba40cb990 con 0x7faba40b2060 2023-07-20T10:08:21.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7faba0ff9640 1 -- 172.21.15.82:0/3753478305 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+126 (secure 0 0 0) 0x7fab8c0b8090 con 0x7faba40b2060 2023-07-20T10:08:21.710 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:21.711 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:08:21.712 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:08:21.712 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:21.712 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:08:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 msgr2=0x7fab84068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 0x7fab84068890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fab940012f0 tx=0x7fab94004d50 comp rx=0 tx=0).stop 2023-07-20T10:08:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 msgr2=0x7faba40cd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fab8c018f40 tx=0x7fab8c0190d0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 shutdown_connections 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faba415a8e0 0x7faba40c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faba40b2060 0x7faba40cd610 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fab840663d0 0x7fab84068890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 --2- 172.21.15.82:0/3753478305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faba40afda0 0x7faba4155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 >> 172.21.15.82:0/3753478305 conn(0x7faba40cada0 msgr2=0x7faba4157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 shutdown_connections 2023-07-20T10:08:21.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.735+0000 7fabaa182640 1 -- 172.21.15.82:0/3753478305 wait complete. 2023-07-20T10:08:21.731 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:08:21.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:08:21.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 Processor -- start 2023-07-20T10:08:21.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 -- start start 2023-07-20T10:08:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0ce830 con 0x7f85bc06da10 2023-07-20T10:08:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc0cfd80 con 0x7f85bc0cdf10 2023-07-20T10:08:21.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85c15ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc160c30 con 0x7f85bc1600c0 2023-07-20T10:08:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85baffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:51038/0 (socket says 172.21.15.82:51038) 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 -- 172.21.15.82:0/2921588978 learned_addr learned my addr 172.21.15.82:0/2921588978 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85baffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:40224/0 (socket says 172.21.15.82:40224) 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85ba7fc640 1 -- 172.21.15.82:0/2921588978 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488613397 0 0) 0x7f85bc0ce830 con 0x7f85bc06da10 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85ba7fc640 1 -- 172.21.15.82:0/2921588978 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8003530 con 0x7f85bc06da10 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 -- 172.21.15.82:0/2921588978 >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 msgr2=0x7f85bc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 --2- 172.21.15.82:0/2921588978 >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 -- 172.21.15.82:0/2921588978 >> v1:172.21.15.183:6789/0 conn(0x7f85bc06da10 legacy=0x7f85bc06dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85b27fc640 1 -- 172.21.15.82:0/2921588978 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc160f10 con 0x7f85bc1600c0 2023-07-20T10:08:21.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.899+0000 7f85baffd640 1 --2- 172.21.15.82:0/2921588978 >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:08:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85b27fc640 1 --2- 172.21.15.82:0/2921588978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82709afd53de53e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85ba7fc640 1 -- 172.21.15.82:0/2921588978 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a57d0 con 0x7f85bc1600c0 2023-07-20T10:08:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85ba7fc640 1 -- 172.21.15.82:0/2921588978 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a5930 con 0x7f85bc1600c0 2023-07-20T10:08:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85ba7fc640 1 -- 172.21.15.82:0/2921588978 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5cc0 con 0x7f85bc1600c0 2023-07-20T10:08:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 -- 172.21.15.82:0/2921588978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 msgr2=0x7f85bc160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 --2- 172.21.15.82:0/2921588978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a401ca10 comp rx=0 tx=0).stop 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 -- 172.21.15.82:0/2921588978 shutdown_connections 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 --2- 172.21.15.82:0/2921588978 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc1600c0 0x7f85bc160520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 --2- 172.21.15.82:0/2921588978 >> v2:172.21.15.183:3300/0 conn(0x7f85bc0cdf10 0x7f85bc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 -- 172.21.15.82:0/2921588978 >> 172.21.15.82:0/2921588978 conn(0x7f85bc0b1e50 msgr2=0x7f85bc0b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 -- 172.21.15.82:0/2921588978 shutdown_connections 2023-07-20T10:08:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.903+0000 7f85c15ba640 1 -- 172.21.15.82:0/2921588978 wait complete. 2023-07-20T10:08:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 Processor -- start 2023-07-20T10:08:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- start start 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85bc06da10 0x7f85bc0c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc0cdf10 0x7f85bc0c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc0c1f40 con 0x7f85bc1600c0 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc14dc50 con 0x7f85bc06da10 2023-07-20T10:08:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc14df30 con 0x7f85bc0cdf10 2023-07-20T10:08:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85b27fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc0cdf10 0x7f85bc0c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85baffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85bc06da10 0x7f85bc0c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50184/0 (socket says 172.21.15.82:50184) 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 -- 172.21.15.82:0/1570861313 learned_addr learned my addr 172.21.15.82:0/1570861313 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 -- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc0cdf10 msgr2=0x7f85bc0c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc0cdf10 0x7f85bc0c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 -- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85bc06da10 msgr2=0x7f85bc0c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85bc06da10 0x7f85bc0c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 -- 172.21.15.82:0/1570861313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac009420 con 0x7f85bc1600c0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85bb7fe640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c3c0 tx=0x7f85b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40052d0 con 0x7f85bc1600c0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4005430 con 0x7f85bc1600c0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a4009b30 con 0x7f85bc1600c0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4003820 con 0x7f85bc1600c0 2023-07-20T10:08:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.907+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc0c58c0 con 0x7f85bc1600c0 2023-07-20T10:08:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc0c20b0 con 0x7f85bc1600c0 2023-07-20T10:08:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85b4003980 con 0x7f85bc1600c0 2023-07-20T10:08:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85b3fff640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 0x7f859c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f85b4083060 con 0x7f85bc1600c0 2023-07-20T10:08:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85baffd640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 0x7f859c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.911+0000 7f85baffd640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 0x7f859c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1578b0 tx=0x7f85ac009190 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:21.915+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85b40b3700 con 0x7f85bc1600c0 2023-07-20T10:08:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:22.063+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f85bc04da30 con 0x7f85bc1600c0 2023-07-20T10:08:23.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.047+0000 7f85b3fff640 1 -- 172.21.15.82:0/1570861313 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7f85b4050730 con 0x7f85bc1600c0 2023-07-20T10:08:23.023 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:08:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 msgr2=0x7f859c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 0x7f859c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1578b0 tx=0x7f85ac009190 comp rx=0 tx=0).stop 2023-07-20T10:08:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 msgr2=0x7f85bc0c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f85b400c3c0 tx=0x7f85b400c880 comp rx=0 tx=0).stop 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 shutdown_connections 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85bc1600c0 0x7f85bc0c6040 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85bc0cdf10 0x7f85bc0c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f859c0663a0 0x7f859c068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 --2- 172.21.15.82:0/1570861313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85bc06da10 0x7f85bc0c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 >> 172.21.15.82:0/1570861313 conn(0x7f85bc0b1e50 msgr2=0x7f85bc150420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 shutdown_connections 2023-07-20T10:08:23.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.051+0000 7f85c15ba640 1 -- 172.21.15.82:0/1570861313 wait complete. 2023-07-20T10:08:23.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:08:23.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 Processor -- start 2023-07-20T10:08:23.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 -- start start 2023-07-20T10:08:23.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd81415a050 0x7fd814070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd81415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd814069750 con 0x7fd81406ed50 2023-07-20T10:08:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd81406a0b0 con 0x7fd81415a050 2023-07-20T10:08:23.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd81880b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd814160e60 con 0x7fd8140cd470 2023-07-20T10:08:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd80bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd81406ed50 0x7fd8140ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:42038/0 (socket says 172.21.15.82:42038) 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.219+0000 7fd80bfff640 1 -- 172.21.15.82:0/4094361910 learned_addr learned my addr 172.21.15.82:0/4094361910 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd8137fe640 1 --2- 172.21.15.82:0/4094361910 >> v2:172.21.15.183:3300/0 conn(0x7fd81415a050 0x7fd814070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd813fff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd81415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082209119 0 0) 0x7fd814069750 con 0x7fd81406ed50 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd800003530 con 0x7fd81406ed50 2023-07-20T10:08:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979145389 0 0) 0x7fd800003530 con 0x7fd81406ed50 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 msgr2=0x7fd81415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd81415cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 >> v2:172.21.15.183:3300/0 conn(0x7fd81415a050 msgr2=0x7fd814070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 --2- 172.21.15.82:0/4094361910 >> v2:172.21.15.183:3300/0 conn(0x7fd81415a050 0x7fd814070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140699f0 con 0x7fd81406ed50 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd7fc001680 con 0x7fd81406ed50 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 >> v1:172.21.15.82:6789/0 conn(0x7fd81406ed50 legacy=0x7fd8140ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000039f0 0x7fd800003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8000047d0 0x7fd800004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd800005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81406a0b0 con 0x7fd8000047d0 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814160e60 con 0x7fd8000039f0 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80000ba40 con 0x7fd8140cd470 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8000047d0 0x7fd800004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd8137fe640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000039f0 0x7fd800003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd813fff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd800005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 -- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 msgr2=0x7fd800005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd800005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 -- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000039f0 msgr2=0x7fd800003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000039f0 0x7fd800003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd80bfff640 1 -- 172.21.15.82:0/4094361910 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800003530 con 0x7fd8000047d0 2023-07-20T10:08:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.223+0000 7fd813fff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8140cd470 0x7fd800005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd80bfff640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8000047d0 0x7fd800004c50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c210 tx=0x7fd7fc01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e1a012d4236b8b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0058e0 con 0x7fd8000047d0 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005a40 con 0x7fd8000047d0 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd812ffd640 1 -- 172.21.15.82:0/4094361910 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc005dd0 con 0x7fd8000047d0 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- 172.21.15.82:0/4094361910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8000047d0 msgr2=0x7fd800004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 --2- 172.21.15.82:0/4094361910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8000047d0 0x7fd800004c50 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c210 tx=0x7fd7fc01cc30 comp rx=0 tx=0).stop 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd813fff640 1 -- 172.21.15.82:0/4094361910 reap_dead start 2023-07-20T10:08:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- 172.21.15.82:0/4094361910 shutdown_connections 2023-07-20T10:08:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- 172.21.15.82:0/4094361910 >> 172.21.15.82:0/4094361910 conn(0x7fd8140b0c80 msgr2=0x7fd8140b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- 172.21.15.82:0/4094361910 shutdown_connections 2023-07-20T10:08:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- 172.21.15.82:0/4094361910 wait complete. 2023-07-20T10:08:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 Processor -- start 2023-07-20T10:08:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.227+0000 7fd81880b640 1 -- start start 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000047d0 0x7fd81414e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 0x7fd8140b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81414e700 con 0x7fd814154c40 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd814155600 con 0x7fd8000047d0 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140c4780 con 0x7fd8141f89d0 2023-07-20T10:08:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50206/0 (socket says 172.21.15.82:50206) 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 -- 172.21.15.82:0/2359948129 learned_addr learned my addr 172.21.15.82:0/2359948129 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd8137fe640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000047d0 0x7fd81414e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd80bfff640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 0x7fd8140b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 -- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 msgr2=0x7fd8140b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 0x7fd8140b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 -- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000047d0 msgr2=0x7fd81414e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000047d0 0x7fd81414e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 -- 172.21.15.82:0/2359948129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140b4ee0 con 0x7fd814154c40 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd80bfff640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 0x7fd8140b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd813fff640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c9790 tx=0x7fd80c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00e030 con 0x7fd814154c40 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c011e00 con 0x7fd814154c40 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0166b0 con 0x7fd814154c40 2023-07-20T10:08:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140b4370 con 0x7fd814154c40 2023-07-20T10:08:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8140b4920 con 0x7fd814154c40 2023-07-20T10:08:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd81404da30 con 0x7fd814154c40 2023-07-20T10:08:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.231+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd80c016810 con 0x7fd814154c40 2023-07-20T10:08:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.235+0000 7fd810ff9640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 0x7fd7f4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.235+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd80c00f070 con 0x7fd814154c40 2023-07-20T10:08:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.235+0000 7fd8137fe640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 0x7fd7f4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:23.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.235+0000 7fd8137fe640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 0x7fd7f4068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd804009b20 tx=0x7fd804008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:23.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.239+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd80c052a00 con 0x7fd814154c40 2023-07-20T10:08:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:23.383+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd814158280 con 0x7fd814154c40 2023-07-20T10:08:24.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.055+0000 7fd810ff9640 1 -- 172.21.15.82:0/2359948129 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd80c056020 con 0x7fd814154c40 2023-07-20T10:08:24.033 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:08:24.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.059+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 msgr2=0x7fd7f4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:24.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.059+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 0x7fd7f4068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd804009b20 tx=0x7fd804008040 comp rx=0 tx=0).stop 2023-07-20T10:08:24.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.059+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 msgr2=0x7fd8141550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:24.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.059+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fd8140c9790 tx=0x7fd80c009f90 comp rx=0 tx=0).stop 2023-07-20T10:08:24.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 shutdown_connections 2023-07-20T10:08:24.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd814154c40 0x7fd8141550c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8141f89d0 0x7fd8140b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fd7f40663a0 0x7fd7f4068860 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd804009b20 tx=0x7fd804008040 comp rx=0 tx=0).stop 2023-07-20T10:08:24.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 --2- 172.21.15.82:0/2359948129 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8000047d0 0x7fd81414e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.063+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 >> 172.21.15.82:0/2359948129 conn(0x7fd8140b0c80 msgr2=0x7fd814158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:24.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.067+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 shutdown_connections 2023-07-20T10:08:24.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.067+0000 7fd81880b640 1 -- 172.21.15.82:0/2359948129 wait complete. 2023-07-20T10:08:24.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:08:24.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 Processor -- start 2023-07-20T10:08:24.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 -- start start 2023-07-20T10:08:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c159450 0x7f402c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c159830 0x7f402c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f402c0cc3e0 0x7f402c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c0cce90 con 0x7f402c159450 2023-07-20T10:08:24.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402c0cc8d0 con 0x7f402c0cc3e0 2023-07-20T10:08:24.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4033dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0ccbb0 con 0x7f402c159830 2023-07-20T10:08:24.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c159450 0x7f402c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f402c159450 0x7f402c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50286/0 (socket says 172.21.15.82:50286) 2023-07-20T10:08:24.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 -- 172.21.15.82:0/1936874530 learned_addr learned my addr 172.21.15.82:0/1936874530 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031395640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c159830 0x7f402c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4032397640 1 --2- 172.21.15.82:0/1936874530 >> v2:172.21.15.183:3300/0 conn(0x7f402c0cc3e0 0x7f402c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 -- 172.21.15.82:0/1936874530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c159830 msgr2=0x7f402c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c159830 0x7f402c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 -- 172.21.15.82:0/1936874530 >> v2:172.21.15.183:3300/0 conn(0x7f402c0cc3e0 msgr2=0x7f402c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 --2- 172.21.15.82:0/1936874530 >> v2:172.21.15.183:3300/0 conn(0x7f402c0cc3e0 0x7f402c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.239+0000 7f4031b96640 1 -- 172.21.15.82:0/1936874530 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c159cc0 con 0x7f402c159450 2023-07-20T10:08:24.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4031b96640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c15a4c0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f402c0ce1b0 tx=0x7f402801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb6855a33003ac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:24.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4030b94640 1 -- 172.21.15.82:0/1936874530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ab680 con 0x7f402c159450 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4030b94640 1 -- 172.21.15.82:0/1936874530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280ab7e0 con 0x7f402c159450 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4030b94640 1 -- 172.21.15.82:0/1936874530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280abb70 con 0x7f402c159450 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 -- 172.21.15.82:0/1936874530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 msgr2=0x7f402c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c15a4c0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f402c0ce1b0 tx=0x7f402801e6e0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 -- 172.21.15.82:0/1936874530 shutdown_connections 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1936874530 >> v2:172.21.15.183:3300/0 conn(0x7f402c0cc3e0 0x7f402c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c159830 0x7f402c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1936874530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c15a4c0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 -- 172.21.15.82:0/1936874530 >> 172.21.15.82:0/1936874530 conn(0x7f402c0cad50 msgr2=0x7f402c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 -- 172.21.15.82:0/1936874530 shutdown_connections 2023-07-20T10:08:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.243+0000 7f4033dfa640 1 -- 172.21.15.82:0/1936874530 wait complete. 2023-07-20T10:08:24.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 Processor -- start 2023-07-20T10:08:24.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- start start 2023-07-20T10:08:24.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f402c0cc3e0 0x7f402c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c14c820 0x7f402c0c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0b1c80 con 0x7f402c159450 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0c2e20 con 0x7f402c0cc3e0 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0b0cf0 con 0x7f402c14c820 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50298/0 (socket says 172.21.15.82:50298) 2023-07-20T10:08:24.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 -- 172.21.15.82:0/1788259057 learned_addr learned my addr 172.21.15.82:0/1788259057 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4032397640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c14c820 0x7f402c0c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031b96640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f402c0cc3e0 0x7f402c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 -- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c14c820 msgr2=0x7f402c0c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c14c820 0x7f402c0c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 -- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f402c0cc3e0 msgr2=0x7f402c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f402c0cc3e0 0x7f402c0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 -- 172.21.15.82:0/1788259057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40280094d0 con 0x7f402c159450 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4031395640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f401c00d5f0 tx=0x7f401c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:24.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c0125f0 con 0x7f402c159450 2023-07-20T10:08:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c012750 con 0x7f402c159450 2023-07-20T10:08:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f402c0b3070 con 0x7f402c159450 2023-07-20T10:08:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c012ae0 con 0x7f402c159450 2023-07-20T10:08:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0b3630 con 0x7f402c159450 2023-07-20T10:08:24.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.247+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c04da30 con 0x7f402c159450 2023-07-20T10:08:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.251+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f401c012c40 con 0x7f402c159450 2023-07-20T10:08:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.251+0000 7f40227fc640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 0x7f4010068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.251+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f401c084bd0 con 0x7f402c159450 2023-07-20T10:08:24.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.251+0000 7f4031b96640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 0x7f4010068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:24.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.251+0000 7f4031b96640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 0x7f4010068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0000 tx=0x7f40280b5040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:24.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.255+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f401c052130 con 0x7f402c159450 2023-07-20T10:08:24.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:24.431+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f402c0cbbf0 con 0x7f402c159450 2023-07-20T10:08:25.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.063+0000 7f40227fc640 1 -- 172.21.15.82:0/1788259057 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f401c007380 con 0x7f402c159450 2023-07-20T10:08:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 15 and data pool 16 2023-07-20T10:08:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.067+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 msgr2=0x7f4010068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.067+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 0x7f4010068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0000 tx=0x7f40280b5040 comp rx=0 tx=0).stop 2023-07-20T10:08:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.067+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 msgr2=0x7f402c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.067+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f401c00d5f0 tx=0x7f401c00dab0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.067+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 shutdown_connections 2023-07-20T10:08:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f402c14c820 0x7f402c0c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f402c159450 0x7f402c14c2e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f40100663a0 0x7f4010068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 --2- 172.21.15.82:0/1788259057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f402c0cc3e0 0x7f402c0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 >> 172.21.15.82:0/1788259057 conn(0x7f402c0cad50 msgr2=0x7f402c163c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 shutdown_connections 2023-07-20T10:08:25.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.071+0000 7f4033dfa640 1 -- 172.21.15.82:0/1788259057 wait complete. 2023-07-20T10:08:25.087 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:25.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 Processor -- start 2023-07-20T10:08:25.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 -- start start 2023-07-20T10:08:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e000ca6b0 0x7f9e000b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000b06c0 con 0x7f9e000afda0 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e000b12a0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e08496640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000b3160 con 0x7f9e000ca6b0 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e000ca6b0 0x7f9e000b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e000ca6b0 0x7f9e000b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50306/0 (socket says 172.21.15.82:50306) 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 -- 172.21.15.82:0/1420609442 learned_addr learned my addr 172.21.15.82:0/1420609442 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06232640 1 --1- 172.21.15.82:0/1420609442 >> v1:172.21.15.82:6789/0 conn(0x7f9e000afda0 0x7f9e000b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50380/0 (socket says 172.21.15.82:50380) 2023-07-20T10:08:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 -- 172.21.15.82:0/1420609442 >> v1:172.21.15.183:6789/0 conn(0x7f9e0015a8e0 legacy=0x7f9e000b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 -- 172.21.15.82:0/1420609442 >> v1:172.21.15.82:6789/0 conn(0x7f9e000afda0 legacy=0x7f9e000b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e05230640 1 -- 172.21.15.82:0/1420609442 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120733270 0 0) 0x7f9e000b06c0 con 0x7f9e000afda0 2023-07-20T10:08:25.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.251+0000 7f9e06a33640 1 -- 172.21.15.82:0/1420609442 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e000b1580 con 0x7f9e000ca6b0 2023-07-20T10:08:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e06a33640 1 --2- 172.21.15.82:0/1420609442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e000ca6b0 0x7f9e000b0180 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15e1691eac305ec server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e05230640 1 -- 172.21.15.82:0/1420609442 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80aa610 con 0x7f9e000ca6b0 2023-07-20T10:08:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e05230640 1 -- 172.21.15.82:0/1420609442 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80a6040 con 0x7f9e000ca6b0 2023-07-20T10:08:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e05230640 1 -- 172.21.15.82:0/1420609442 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80aa990 con 0x7f9e000ca6b0 2023-07-20T10:08:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 -- 172.21.15.82:0/1420609442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e000ca6b0 msgr2=0x7f9e000b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 --2- 172.21.15.82:0/1420609442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e000ca6b0 0x7f9e000b0180 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009870 tx=0x7f9df801c4b0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 -- 172.21.15.82:0/1420609442 shutdown_connections 2023-07-20T10:08:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 --2- 172.21.15.82:0/1420609442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e000ca6b0 0x7f9e000b0180 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 -- 172.21.15.82:0/1420609442 >> 172.21.15.82:0/1420609442 conn(0x7f9e000cada0 msgr2=0x7f9e000cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 -- 172.21.15.82:0/1420609442 shutdown_connections 2023-07-20T10:08:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.255+0000 7f9e08496640 1 -- 172.21.15.82:0/1420609442 wait complete. 2023-07-20T10:08:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 Processor -- start 2023-07-20T10:08:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 -- start start 2023-07-20T10:08:25.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 0x7f9e0015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 0x7f9e0015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015dbf0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000c5d20 con 0x7f9e000afda0 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0015cf00 con 0x7f9e000ca6b0 2023-07-20T10:08:25.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50312/0 (socket says 172.21.15.82:50312) 2023-07-20T10:08:25.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 -- 172.21.15.82:0/1341115835 learned_addr learned my addr 172.21.15.82:0/1341115835 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06232640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 0x7f9e0015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e05a31640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 0x7f9e0015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 -- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 msgr2=0x7f9e0015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 0x7f9e0015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 -- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 msgr2=0x7f9e0015c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 0x7f9e0015c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 -- 172.21.15.82:0/1341115835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80094d0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06232640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 0x7f9e0015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e05a31640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 0x7f9e0015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e06a33640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ac040 tx=0x7f9df801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80bd5f0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df80bd770 con 0x7f9e0015a8e0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000c53f0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.259+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df80bdb20 con 0x7f9e0015a8e0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000c59b0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e000c5ed0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9df80b33f0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9df6ffd640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 0x7f9de4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9df811ee70 con 0x7f9e0015a8e0 2023-07-20T10:08:25.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9e06232640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 0x7f9de4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.263+0000 7f9e06232640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 0x7f9de4068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0012f0 tx=0x7f9dfc009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.267+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9df80ec0d0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e00073c70 con 0x7f9e0015a8e0 2023-07-20T10:08:25.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9df6ffd640 1 -- 172.21.15.82:0/1341115835 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f9df80ef6f0 con 0x7f9e0015a8e0 2023-07-20T10:08:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:25.395 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":122,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:24.436469+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 msgr2=0x7f9de4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 0x7f9de4068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0012f0 tx=0x7f9dfc009040 comp rx=0 tx=0).stop 2023-07-20T10:08:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 msgr2=0x7f9e000c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ac040 tx=0x7f9df801acf0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 shutdown_connections 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e0015a8e0 0x7f9e000c61b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e000ca6b0 0x7f9e0015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f9de40663a0 0x7f9de4068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 --2- 172.21.15.82:0/1341115835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e000afda0 0x7f9e0015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 >> 172.21.15.82:0/1341115835 conn(0x7f9e000cada0 msgr2=0x7f9e000af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 shutdown_connections 2023-07-20T10:08:25.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.419+0000 7f9e08496640 1 -- 172.21.15.82:0/1341115835 wait complete. 2023-07-20T10:08:25.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 Processor -- start 2023-07-20T10:08:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 -- start start 2023-07-20T10:08:25.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc0c00afda0 0x7fc0c00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c00b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00b2ee0 con 0x7fc0c00b2060 2023-07-20T10:08:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00b3160 con 0x7fc0c00afda0 2023-07-20T10:08:25.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0c4d82640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00b12a0 con 0x7fc0c015a8e0 2023-07-20T10:08:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc0c00afda0 0x7fc0c00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0b5d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c00b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc0c00afda0 0x7fc0c00ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:53830/0 (socket says 172.21.15.82:53830) 2023-07-20T10:08:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 -- 172.21.15.82:0/138084447 learned_addr learned my addr 172.21.15.82:0/138084447 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 -- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 msgr2=0x7fc0c00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 --2- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c00b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 -- 172.21.15.82:0/138084447 >> v1:172.21.15.183:6789/0 conn(0x7fc0c00b2060 legacy=0x7fc0c00b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0be59c640 1 -- 172.21.15.82:0/138084447 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00b1580 con 0x7fc0c00afda0 2023-07-20T10:08:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.579+0000 7fc0bdd9b640 1 -- 172.21.15.82:0/138084447 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462144172 0 0) 0x7fc0c00b2ee0 con 0x7fc0c00b2060 2023-07-20T10:08:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0be59c640 1 --2- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c00ca6b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009e80 tx=0x7fc0b001c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75cf00d77b4645e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0bdd9b640 1 -- 172.21.15.82:0/138084447 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00a5760 con 0x7fc0c00afda0 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0bdd9b640 1 -- 172.21.15.82:0/138084447 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b00a58c0 con 0x7fc0c00afda0 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0bdd9b640 1 -- 172.21.15.82:0/138084447 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b00a5c50 con 0x7fc0c00afda0 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 -- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 msgr2=0x7fc0c00ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c00ca6b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0009e80 tx=0x7fc0b001c8a0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 -- 172.21.15.82:0/138084447 shutdown_connections 2023-07-20T10:08:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c00b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/138084447 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c00ca6b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 -- 172.21.15.82:0/138084447 >> 172.21.15.82:0/138084447 conn(0x7fc0c00cada0 msgr2=0x7fc0c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 -- 172.21.15.82:0/138084447 shutdown_connections 2023-07-20T10:08:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.583+0000 7fc0c4d82640 1 -- 172.21.15.82:0/138084447 wait complete. 2023-07-20T10:08:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 Processor -- start 2023-07-20T10:08:25.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 -- start start 2023-07-20T10:08:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c0164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01587d0 con 0x7fc0c00b2060 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0164d80 con 0x7fc0c00afda0 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0c4d82640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c0165060 con 0x7fc0c015a8e0 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50318/0 (socket says 172.21.15.82:50318) 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 -- 172.21.15.82:0/1647678164 learned_addr learned my addr 172.21.15.82:0/1647678164 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0be59c640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0bed9d640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c0164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 -- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 msgr2=0x7fc0c0164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c0164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 -- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 msgr2=0x7fc0c015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c015d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 -- 172.21.15.82:0/1647678164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b0009b30 con 0x7fc0c00b2060 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.587+0000 7fc0b5d9b640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e870 tx=0x7fc0a800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8009530 con 0x7fc0c00b2060 2023-07-20T10:08:25.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800c940 con 0x7fc0c00b2060 2023-07-20T10:08:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800ccd0 con 0x7fc0c00b2060 2023-07-20T10:08:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c0158110 con 0x7fc0c00b2060 2023-07-20T10:08:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0157ad0 con 0x7fc0c00b2060 2023-07-20T10:08:25.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c0158910 con 0x7fc0c00b2060 2023-07-20T10:08:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc0a8013470 con 0x7fc0c00b2060 2023-07-20T10:08:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 0x7fc0a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0a8083f80 con 0x7fc0c00b2060 2023-07-20T10:08:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.591+0000 7fc0be59c640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 0x7fc0a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.595+0000 7fc0be59c640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 0x7fc0a0068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ae000 tx=0x7fc0b00a7070 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.595+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0c0158910 con 0x7fc0c00b2060 2023-07-20T10:08:25.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.747+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0c0158910 con 0x7fc0c00b2060 2023-07-20T10:08:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.747+0000 7fc0b77fe640 1 -- 172.21.15.82:0/1647678164 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+18282 (secure 0 0 0) 0x7fc0c0158910 con 0x7fc0c00b2060 2023-07-20T10:08:25.725 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:25.725 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":122,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:24.436469+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 msgr2=0x7fc0a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 0x7fc0a0068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00ae000 tx=0x7fc0b00a7070 comp rx=0 tx=0).stop 2023-07-20T10:08:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 msgr2=0x7fc0c01641e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800e870 tx=0x7fc0a800ed30 comp rx=0 tx=0).stop 2023-07-20T10:08:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 shutdown_connections 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc0c015a8e0 0x7fc0c0164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0c00b2060 0x7fc0c01641e0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc0a00663a0 0x7fc0a0068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 --2- 172.21.15.82:0/1647678164 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc0c00afda0 0x7fc0c015d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 >> 172.21.15.82:0/1647678164 conn(0x7fc0c00cada0 msgr2=0x7fc0c0152340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 shutdown_connections 2023-07-20T10:08:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.751+0000 7fc0c4d82640 1 -- 172.21.15.82:0/1647678164 wait complete. 2023-07-20T10:08:25.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:08:25.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 Processor -- start 2023-07-20T10:08:25.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 -- start start 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac140ccf10 0x7fac14160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac14069750 0x7fac14069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1406a1d0 con 0x7fac1406ddc0 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac141601b0 con 0x7fac14069750 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac1c32c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14161100 con 0x7fac140ccf10 2023-07-20T10:08:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.911+0000 7fac198c7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac14069750 0x7fac14069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac14069750 0x7fac14069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50328/0 (socket says 172.21.15.82:50328) 2023-07-20T10:08:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 -- 172.21.15.82:0/728703611 learned_addr learned my addr 172.21.15.82:0/728703611 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 -- 172.21.15.82:0/728703611 >> v2:172.21.15.183:3300/0 conn(0x7fac140ccf10 msgr2=0x7fac14160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 --2- 172.21.15.82:0/728703611 >> v2:172.21.15.183:3300/0 conn(0x7fac140ccf10 0x7fac14160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 -- 172.21.15.82:0/728703611 >> v1:172.21.15.183:6789/0 conn(0x7fac1406ddc0 legacy=0x7fac1415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 -- 172.21.15.82:0/728703611 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1406a4b0 con 0x7fac14069750 2023-07-20T10:08:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac198c7640 1 --2- 172.21.15.82:0/728703611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac14069750 0x7fac14069be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fac1406b1c0 tx=0x7fac0401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0df167228fc8bc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac190c6640 1 -- 172.21.15.82:0/728703611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040a7070 con 0x7fac14069750 2023-07-20T10:08:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac190c6640 1 -- 172.21.15.82:0/728703611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040ab430 con 0x7fac14069750 2023-07-20T10:08:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.915+0000 7fac190c6640 1 -- 172.21.15.82:0/728703611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040ab7c0 con 0x7fac14069750 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- 172.21.15.82:0/728703611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac14069750 msgr2=0x7fac14069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- 172.21.15.82:0/728703611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac14069750 0x7fac14069be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fac1406b1c0 tx=0x7fac0401c490 comp rx=0 tx=0).stop 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- 172.21.15.82:0/728703611 shutdown_connections 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- 172.21.15.82:0/728703611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac14069750 0x7fac14069be0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- 172.21.15.82:0/728703611 >> v2:172.21.15.183:3300/0 conn(0x7fac140ccf10 0x7fac14160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- 172.21.15.82:0/728703611 >> 172.21.15.82:0/728703611 conn(0x7fac140cf070 msgr2=0x7fac140cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- 172.21.15.82:0/728703611 shutdown_connections 2023-07-20T10:08:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- 172.21.15.82:0/728703611 wait complete. 2023-07-20T10:08:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 Processor -- start 2023-07-20T10:08:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- start start 2023-07-20T10:08:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac14069750 0x7fac141524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac140ccf10 0x7fac140b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14152dd0 con 0x7fac1406ddc0 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac140b21d0 con 0x7fac140ccf10 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac1c32c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14153070 con 0x7fac14069750 2023-07-20T10:08:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50332/0 (socket says 172.21.15.82:50332) 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 -- 172.21.15.82:0/3237381410 learned_addr learned my addr 172.21.15.82:0/3237381410 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 -- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac14069750 msgr2=0x7fac141524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac14069750 0x7fac141524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 -- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac140ccf10 msgr2=0x7fac140b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac140ccf10 0x7fac140b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.919+0000 7fac198c7640 1 -- 172.21.15.82:0/3237381410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040094d0 con 0x7fac1406ddc0 2023-07-20T10:08:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac198c7640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fac0401a0c0 tx=0x7fac04019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040b4830 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040b4990 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac040b4d40 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14153350 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac141544b0 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1404da30 con 0x7fac1406ddc0 2023-07-20T10:08:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac040c2460 con 0x7fac1406ddc0 2023-07-20T10:08:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 0x7fabf8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac0411efc0 con 0x7fac1406ddc0 2023-07-20T10:08:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.923+0000 7fac1a0c8640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 0x7fabf8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.927+0000 7fac1a0c8640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 0x7fabf8068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac10009690 tx=0x7fac10006c00 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:25.927+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac040ec200 con 0x7fac1406ddc0 2023-07-20T10:08:26.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:26.111+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fac141531b0 con 0x7fac1406ddc0 2023-07-20T10:08:27.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.079+0000 7fac0affd640 1 -- 172.21.15.82:0/3237381410 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7fac141531b0 con 0x7fac1406ddc0 2023-07-20T10:08:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 msgr2=0x7fabf8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 0x7fabf8068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac10009690 tx=0x7fac10006c00 comp rx=0 tx=0).stop 2023-07-20T10:08:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 msgr2=0x7fac14153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fac0401a0c0 tx=0x7fac04019230 comp rx=0 tx=0).stop 2023-07-20T10:08:27.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 shutdown_connections 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fabf80663d0 0x7fabf8068890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac140ccf10 0x7fac140b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac1406ddc0 0x7fac14153870 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 --2- 172.21.15.82:0/3237381410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac14069750 0x7fac141524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 >> 172.21.15.82:0/3237381410 conn(0x7fac140cf070 msgr2=0x7fac140c53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 shutdown_connections 2023-07-20T10:08:27.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.083+0000 7fac1c32c640 1 -- 172.21.15.82:0/3237381410 wait complete. 2023-07-20T10:08:27.083 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:08:27.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:08:27.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.251+0000 7fbff7a48640 1 Processor -- start 2023-07-20T10:08:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.251+0000 7fbff7a48640 1 -- start start 2023-07-20T10:08:27.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff7a48640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbff0159450 0x7fbff015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff7a48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbff0159830 0x7fbff00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff7a48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff00cc8d0 con 0x7fbff00cc3e0 2023-07-20T10:08:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff7a48640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00cce90 con 0x7fbff0159450 2023-07-20T10:08:27.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff7a48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff00ccbb0 con 0x7fbff0159830 2023-07-20T10:08:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbff0159450 0x7fbff015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbff0159450 0x7fbff015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50338/0 (socket says 172.21.15.82:50338) 2023-07-20T10:08:27.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 -- 172.21.15.82:0/2619627871 learned_addr learned my addr 172.21.15.82:0/2619627871 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff4fe3640 1 --2- 172.21.15.82:0/2619627871 >> v2:172.21.15.183:3300/0 conn(0x7fbff0159830 0x7fbff00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 -- 172.21.15.82:0/2619627871 >> v2:172.21.15.183:3300/0 conn(0x7fbff0159830 msgr2=0x7fbff00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 --2- 172.21.15.82:0/2619627871 >> v2:172.21.15.183:3300/0 conn(0x7fbff0159830 0x7fbff00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 -- 172.21.15.82:0/2619627871 >> v1:172.21.15.183:6789/0 conn(0x7fbff00cc3e0 legacy=0x7fbff00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.255+0000 7fbff57e4640 1 -- 172.21.15.82:0/2619627871 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0159cc0 con 0x7fbff0159450 2023-07-20T10:08:27.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff57e4640 1 --2- 172.21.15.82:0/2619627871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff0159450 0x7fbff015a4c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fbff015e190 tx=0x7fbfec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5daaff3f95f73f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbfe7fff640 1 -- 172.21.15.82:0/2619627871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5840 con 0x7fbff0159450 2023-07-20T10:08:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbfe7fff640 1 -- 172.21.15.82:0/2619627871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0a59a0 con 0x7fbff0159450 2023-07-20T10:08:27.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbfe7fff640 1 -- 172.21.15.82:0/2619627871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0a5d30 con 0x7fbff0159450 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- 172.21.15.82:0/2619627871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff0159450 msgr2=0x7fbff015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2619627871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff0159450 0x7fbff015a4c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fbff015e190 tx=0x7fbfec01c9a0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- 172.21.15.82:0/2619627871 shutdown_connections 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2619627871 >> v2:172.21.15.183:3300/0 conn(0x7fbff0159830 0x7fbff00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2619627871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff0159450 0x7fbff015a4c0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- 172.21.15.82:0/2619627871 >> 172.21.15.82:0/2619627871 conn(0x7fbff00cad50 msgr2=0x7fbff00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- 172.21.15.82:0/2619627871 shutdown_connections 2023-07-20T10:08:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- 172.21.15.82:0/2619627871 wait complete. 2023-07-20T10:08:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 Processor -- start 2023-07-20T10:08:27.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.259+0000 7fbff7a48640 1 -- start start 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 0x7fbff0156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbff0159450 0x7fbff00c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c2df0 con 0x7fbff00c1dd0 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c2270 con 0x7fbff0159450 2023-07-20T10:08:27.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff00c2550 con 0x7fbff00cc3e0 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff57e4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 0x7fbff0156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff57e4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 0x7fbff0156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:33396/0 (socket says 172.21.15.82:33396) 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff57e4640 1 -- 172.21.15.82:0/2547743247 learned_addr learned my addr 172.21.15.82:0/2547743247 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50354/0 (socket says 172.21.15.82:50354) 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff4fe3640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbff0159450 0x7fbff00c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 -- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 msgr2=0x7fbff0156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 0x7fbff0156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 -- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbff0159450 msgr2=0x7fbff00c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbff0159450 0x7fbff00c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:27.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 -- 172.21.15.82:0/2547743247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec009b30 con 0x7fbff00c1dd0 2023-07-20T10:08:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff5fe5640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fbff00cc800 tx=0x7fbfe800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80052d0 con 0x7fbff00c1dd0 2023-07-20T10:08:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe8005430 con 0x7fbff00c1dd0 2023-07-20T10:08:27.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff00c2830 con 0x7fbff00c1dd0 2023-07-20T10:08:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8011890 con 0x7fbff00c1dd0 2023-07-20T10:08:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff00c3dc0 con 0x7fbff00c1dd0 2023-07-20T10:08:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff004da30 con 0x7fbff00c1dd0 2023-07-20T10:08:27.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.263+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbfe80119f0 con 0x7fbff00c1dd0 2023-07-20T10:08:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.267+0000 7fbfe5ffb640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 0x7fbfd4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.267+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfe8083350 con 0x7fbff00c1dd0 2023-07-20T10:08:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.267+0000 7fbff57e4640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 0x7fbfd4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:27.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.267+0000 7fbff57e4640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 0x7fbfd4068890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000f90 tx=0x7fbfec0a7070 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:27.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.271+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfe8050760 con 0x7fbff00c1dd0 2023-07-20T10:08:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:27.447+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbff00cbbf0 con 0x7fbff00c1dd0 2023-07-20T10:08:28.069 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:08:28.073 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:08:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.094+0000 7fbfe5ffb640 1 -- 172.21.15.82:0/2547743247 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbfe8053d80 con 0x7fbff00c1dd0 2023-07-20T10:08:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 msgr2=0x7fbfd4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 0x7fbfd4068890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfec000f90 tx=0x7fbfec0a7070 comp rx=0 tx=0).stop 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 msgr2=0x7fbff0156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fbff00cc800 tx=0x7fbfe800c820 comp rx=0 tx=0).stop 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 shutdown_connections 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbff00c1dd0 0x7fbff0156130 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fbfd40663d0 0x7fbfd4068890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbff0159450 0x7fbff00c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 --2- 172.21.15.82:0/2547743247 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbff00cc3e0 0x7fbff0156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 >> 172.21.15.82:0/2547743247 conn(0x7fbff00cad50 msgr2=0x7fbff015c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 shutdown_connections 2023-07-20T10:08:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.098+0000 7fbff7a48640 1 -- 172.21.15.82:0/2547743247 wait complete. 2023-07-20T10:08:28.097 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:08:28.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:28.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.330+0000 7fc131b33640 1 Processor -- start 2023-07-20T10:08:28.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.330+0000 7fc131b33640 1 -- start start 2023-07-20T10:08:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc12c1596b0 0x7fc12c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc12c0cc900 0x7fc12c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0b2d50 con 0x7fc12c1596b0 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0ad600 con 0x7fc12c0cc900 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc131b33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c0ccd90 con 0x7fc12c0b2380 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc12c1596b0 0x7fc12c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc12c1596b0 0x7fc12c15dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50368/0 (socket says 172.21.15.82:50368) 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 -- 172.21.15.82:0/2645111588 learned_addr learned my addr 172.21.15.82:0/2645111588 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12bfff640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc123fff640 1 --2- 172.21.15.82:0/2645111588 >> v2:172.21.15.183:3300/0 conn(0x7fc12c0cc900 0x7fc12c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 -- 172.21.15.82:0/2645111588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 msgr2=0x7fc12c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c0b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 -- 172.21.15.82:0/2645111588 >> v2:172.21.15.183:3300/0 conn(0x7fc12c0cc900 msgr2=0x7fc12c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/2645111588 >> v2:172.21.15.183:3300/0 conn(0x7fc12c0cc900 0x7fc12c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.334+0000 7fc12b7fe640 1 -- 172.21.15.82:0/2645111588 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0ad810 con 0x7fc12c1596b0 2023-07-20T10:08:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15dbb0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009870 tx=0x7fc11c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63cd9d631133829 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc12affd640 1 -- 172.21.15.82:0/2645111588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0aa5f0 con 0x7fc12c1596b0 2023-07-20T10:08:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc12affd640 1 -- 172.21.15.82:0/2645111588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c0aa750 con 0x7fc12c1596b0 2023-07-20T10:08:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc12affd640 1 -- 172.21.15.82:0/2645111588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0aaae0 con 0x7fc12c1596b0 2023-07-20T10:08:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- 172.21.15.82:0/2645111588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 msgr2=0x7fc12c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15dbb0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009870 tx=0x7fc11c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- 172.21.15.82:0/2645111588 shutdown_connections 2023-07-20T10:08:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 --2- 172.21.15.82:0/2645111588 >> v2:172.21.15.183:3300/0 conn(0x7fc12c0cc900 0x7fc12c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c0b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 --2- 172.21.15.82:0/2645111588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15dbb0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- 172.21.15.82:0/2645111588 >> 172.21.15.82:0/2645111588 conn(0x7fc12c0cada0 msgr2=0x7fc12c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- 172.21.15.82:0/2645111588 shutdown_connections 2023-07-20T10:08:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- 172.21.15.82:0/2645111588 wait complete. 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 Processor -- start 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.338+0000 7fc131b33640 1 -- start start 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c14ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc12c0cc900 0x7fc12c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c15bbd0 con 0x7fc12c1596b0 2023-07-20T10:08:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c15c920 con 0x7fc12c0cc900 2023-07-20T10:08:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c150ba0 con 0x7fc12c0b2380 2023-07-20T10:08:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50374/0 (socket says 172.21.15.82:50374) 2023-07-20T10:08:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 -- 172.21.15.82:0/3013604026 learned_addr learned my addr 172.21.15.82:0/3013604026 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c14ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc123fff640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc12c0cc900 0x7fc12c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 -- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 msgr2=0x7fc12c14ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c14ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 -- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc12c0cc900 msgr2=0x7fc12c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc12c0cc900 0x7fc12c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 -- 172.21.15.82:0/3013604026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0094d0 con 0x7fc12c1596b0 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc12bfff640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc124007e60 tx=0x7fc12400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124014620 con 0x7fc12c1596b0 2023-07-20T10:08:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400ee90 con 0x7fc12c1596b0 2023-07-20T10:08:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1240149e0 con 0x7fc12c1596b0 2023-07-20T10:08:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c0c6c30 con 0x7fc12c1596b0 2023-07-20T10:08:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c151140 con 0x7fc12c1596b0 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c073c70 con 0x7fc12c1596b0 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.342+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc124014b40 con 0x7fc12c1596b0 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.346+0000 7fc128ff9640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 0x7fc10c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.346+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc124084670 con 0x7fc12c1596b0 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.346+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 0x7fc10c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.346+0000 7fc12b7fe640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 0x7fc10c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0ae000 tx=0x7fc11c0b5040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.350+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1240519f0 con 0x7fc12c1596b0 2023-07-20T10:08:28.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.526+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc12c0cbbd0 con 0x7fc12c1596b0 2023-07-20T10:08:28.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.526+0000 7fc128ff9640 1 -- 172.21.15.82:0/3013604026 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fc124055010 con 0x7fc12c1596b0 2023-07-20T10:08:28.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:28.505 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:08:28.505 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:08:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 msgr2=0x7fc10c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 0x7fc10c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0ae000 tx=0x7fc11c0b5040 comp rx=0 tx=0).stop 2023-07-20T10:08:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 msgr2=0x7fc12c15b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc124007e60 tx=0x7fc12400e4b0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 shutdown_connections 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc12c1596b0 0x7fc12c15b690 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fc10c0663d0 0x7fc10c068890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc12c0cc900 0x7fc12c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 --2- 172.21.15.82:0/3013604026 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc12c0b2380 0x7fc12c14ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 >> 172.21.15.82:0/3013604026 conn(0x7fc12c0cada0 msgr2=0x7fc12c153560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 shutdown_connections 2023-07-20T10:08:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.530+0000 7fc131b33640 1 -- 172.21.15.82:0/3013604026 wait complete. 2023-07-20T10:08:28.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:08:28.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.686+0000 7f50e2ba3640 1 Processor -- start 2023-07-20T10:08:28.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.686+0000 7f50e2ba3640 1 -- start start 2023-07-20T10:08:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e2ba3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e2ba3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0b12a0 con 0x7f50dc0afda0 2023-07-20T10:08:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e2ba3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0b1580 con 0x7f50dc0b2060 2023-07-20T10:08:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e2ba3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0b3160 con 0x7f50dc15a8e0 2023-07-20T10:08:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e093f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f50dc0afda0 0x7f50dc0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50382/0 (socket says 172.21.15.82:50382) 2023-07-20T10:08:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50390/0 (socket says 172.21.15.82:50390) 2023-07-20T10:08:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50e093f640 1 -- 172.21.15.82:0/2616735955 learned_addr learned my addr 172.21.15.82:0/2616735955 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 -- 172.21.15.82:0/2616735955 >> v1:172.21.15.183:6789/0 conn(0x7f50dc0b2060 legacy=0x7f50dc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 -- 172.21.15.82:0/2616735955 >> v1:172.21.15.82:6789/0 conn(0x7f50dc0afda0 legacy=0x7f50dc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 -- 172.21.15.82:0/2616735955 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0b1860 con 0x7f50dc15a8e0 2023-07-20T10:08:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d37fe640 1 -- 172.21.15.82:0/2616735955 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726335211 0 0) 0x7f50dc0b12a0 con 0x7f50dc0afda0 2023-07-20T10:08:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d3fff640 1 --2- 172.21.15.82:0/2616735955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0097c0 tx=0x7f50cc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a8db20d2f3a3b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d37fe640 1 -- 172.21.15.82:0/2616735955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab600 con 0x7f50dc15a8e0 2023-07-20T10:08:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d37fe640 1 -- 172.21.15.82:0/2616735955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0a7050 con 0x7f50dc15a8e0 2023-07-20T10:08:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.690+0000 7f50d37fe640 1 -- 172.21.15.82:0/2616735955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ab980 con 0x7f50dc15a8e0 2023-07-20T10:08:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- 172.21.15.82:0/2616735955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 msgr2=0x7f50dc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/2616735955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0097c0 tx=0x7f50cc01c330 comp rx=0 tx=0).stop 2023-07-20T10:08:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- 172.21.15.82:0/2616735955 shutdown_connections 2023-07-20T10:08:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/2616735955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0ca6b0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- 172.21.15.82:0/2616735955 >> 172.21.15.82:0/2616735955 conn(0x7f50dc0cada0 msgr2=0x7f50dc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:28.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- 172.21.15.82:0/2616735955 shutdown_connections 2023-07-20T10:08:28.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- 172.21.15.82:0/2616735955 wait complete. 2023-07-20T10:08:28.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 Processor -- start 2023-07-20T10:08:28.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- start start 2023-07-20T10:08:28.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 0x7f50dc15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc0b2060 0x7f50dc0ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc099d80 con 0x7f50dc15a8e0 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc09a1a0 con 0x7f50dc0afda0 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e2ba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc099100 con 0x7f50dc0b2060 2023-07-20T10:08:28.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e1140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e093f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 0x7f50dc15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e1140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50394/0 (socket says 172.21.15.82:50394) 2023-07-20T10:08:28.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e1140640 1 -- 172.21.15.82:0/1859489607 learned_addr learned my addr 172.21.15.82:0/1859489607 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:28.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.694+0000 7f50e093f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 0x7f50dc15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:53916/0 (socket says 172.21.15.82:53916) 2023-07-20T10:08:28.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d3fff640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc0b2060 0x7f50dc0ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 -- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc0b2060 msgr2=0x7f50dc0ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc0b2060 0x7f50dc0ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 -- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 msgr2=0x7f50dc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 0x7f50dc15d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 -- 172.21.15.82:0/1859489607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009420 con 0x7f50dc15a8e0 2023-07-20T10:08:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e1140640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c730 tx=0x7f50d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4003b80 con 0x7f50dc15a8e0 2023-07-20T10:08:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4003ce0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc0993e0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d400aa30 con 0x7f50dc15a8e0 2023-07-20T10:08:28.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc0999a0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc099ec0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50d400ab90 con 0x7f50dc15a8e0 2023-07-20T10:08:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 0x7f50c8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50d4083b70 con 0x7f50dc15a8e0 2023-07-20T10:08:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.698+0000 7f50e093f640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 0x7f50c8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.702+0000 7f50e093f640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 0x7f50c8068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50d8007bc0 tx=0x7f50d8007b10 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:28.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.702+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50dc099ec0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50dc099ec0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50d17fa640 1 -- 172.21.15.82:0/1859489607 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18269 (secure 0 0 0) 0x7f50dc099ec0 con 0x7f50dc15a8e0 2023-07-20T10:08:28.830 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:28.831 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":123,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:26.070849+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:08:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 msgr2=0x7f50c8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 0x7f50c8068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f50d8007bc0 tx=0x7f50d8007b10 comp rx=0 tx=0).stop 2023-07-20T10:08:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 msgr2=0x7f50dc0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f50d400c730 tx=0x7f50d400cbf0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 shutdown_connections 2023-07-20T10:08:28.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50dc15a8e0 0x7f50dc0cd140 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50dc0b2060 0x7f50dc0ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f50c80663d0 0x7f50c8068890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 --2- 172.21.15.82:0/1859489607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50dc0afda0 0x7f50dc15d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 >> 172.21.15.82:0/1859489607 conn(0x7f50dc0cada0 msgr2=0x7f50dc06c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:28.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 shutdown_connections 2023-07-20T10:08:28.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:28.854+0000 7f50e2ba3640 1 -- 172.21.15.82:0/1859489607 wait complete. 2023-07-20T10:08:28.851 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:08:28.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:08:28.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.014+0000 7f7efe3ba640 1 Processor -- start 2023-07-20T10:08:28.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.014+0000 7f7efe3ba640 1 -- start start 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efe3ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ef80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efe3ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80b06c0 con 0x7f7ef815a8e0 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efe3ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80b12a0 con 0x7f7ef80afda0 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efe3ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b3160 con 0x7f7ef80ca6b0 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ef815a8e0 0x7f7ef80b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50390/0 (socket says 172.21.15.82:50390) 2023-07-20T10:08:28.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 -- 172.21.15.82:0/3986520265 learned_addr learned my addr 172.21.15.82:0/3986520265 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:28.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efc957640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ef80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487603320 0 0) 0x7f7ef80b06c0 con 0x7f7ef815a8e0 2023-07-20T10:08:28.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee0003530 con 0x7f7ef815a8e0 2023-07-20T10:08:28.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 618534237 0 0) 0x7f7ee0003530 con 0x7f7ef815a8e0 2023-07-20T10:08:28.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 msgr2=0x7f7ef80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ef80b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 >> v1:172.21.15.183:6789/0 conn(0x7f7ef80afda0 legacy=0x7f7ef80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80b1580 con 0x7f7ef815a8e0 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f7eec001680 con 0x7f7ef815a8e0 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 >> v1:172.21.15.82:6789/0 conn(0x7f7ef815a8e0 legacy=0x7f7ef80b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00047d0 0x7f7ee0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ee0005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80b3160 con 0x7f7ee00047d0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000bb50 con 0x7f7ee00039b0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000bd10 con 0x7f7ef80ca6b0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00047d0 0x7f7ee0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efc957640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ee0005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef7fff640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 -- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 msgr2=0x7f7ee0005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:28.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ee0005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 -- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ee00039b0 msgr2=0x7f7ee0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ee00039b0 0x7f7ee0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7ef77fe640 1 -- 172.21.15.82:0/3986520265 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0003530 con 0x7f7ee00047d0 2023-07-20T10:08:28.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.018+0000 7f7efc957640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ef80ca6b0 0x7f7ee0005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00047d0 0x7f7ee0004c50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7ef815acf0 tx=0x7f7eec01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5e467f45577669 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0058e0 con 0x7f7ee00047d0 2023-07-20T10:08:29.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec005a40 con 0x7f7ee00047d0 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7ef6ffd640 1 -- 172.21.15.82:0/3986520265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec005df0 con 0x7f7ee00047d0 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 -- 172.21.15.82:0/3986520265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00047d0 msgr2=0x7f7ee0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/3986520265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ee00047d0 0x7f7ee0004c50 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7ef815acf0 tx=0x7f7eec01cb40 comp rx=0 tx=0).stop 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efc957640 1 -- 172.21.15.82:0/3986520265 reap_dead start 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 -- 172.21.15.82:0/3986520265 shutdown_connections 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 -- 172.21.15.82:0/3986520265 >> 172.21.15.82:0/3986520265 conn(0x7f7ef80cada0 msgr2=0x7f7ef80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 -- 172.21.15.82:0/3986520265 shutdown_connections 2023-07-20T10:08:29.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 -- 172.21.15.82:0/3986520265 wait complete. 2023-07-20T10:08:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.022+0000 7f7efe3ba640 1 Processor -- start 2023-07-20T10:08:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- start start 2023-07-20T10:08:29.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ee00047d0 0x7f7ef814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 0x7f7ef8099f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef809a930 con 0x7f7ef809a4b0 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80c53f0 con 0x7f7ef80c6470 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef80c56b0 con 0x7f7ee00047d0 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50410/0 (socket says 172.21.15.82:50410) 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 -- 172.21.15.82:0/11893370 learned_addr learned my addr 172.21.15.82:0/11893370 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef7fff640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ee00047d0 0x7f7ef814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 0x7f7ef8099f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 -- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ee00047d0 msgr2=0x7f7ef814bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ee00047d0 0x7f7ef814bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 -- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 msgr2=0x7f7ef8099f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 0x7f7ef8099f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 -- 172.21.15.82:0/11893370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80c5990 con 0x7f7ef809a4b0 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef77fe640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 0x7f7ef8099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efc957640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80c8e40 tx=0x7f7ef0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef001b070 con 0x7f7ef809a4b0 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000f040 con 0x7f7ef809a4b0 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef80c5c70 con 0x7f7ef809a4b0 2023-07-20T10:08:29.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000e050 con 0x7f7ef809a4b0 2023-07-20T10:08:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef80c68f0 con 0x7f7ef809a4b0 2023-07-20T10:08:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.026+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef8073c70 con 0x7f7ef809a4b0 2023-07-20T10:08:29.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.030+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ef0003ba0 con 0x7f7ef809a4b0 2023-07-20T10:08:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.030+0000 7f7ef4ff9640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 0x7f7ee4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.030+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ef0084500 con 0x7f7ef809a4b0 2023-07-20T10:08:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.030+0000 7f7ef7fff640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 0x7f7ee4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.030+0000 7f7ef7fff640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 0x7f7ee4068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ef809b600 tx=0x7f7ee8009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.034+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ef00516c0 con 0x7f7ef809a4b0 2023-07-20T10:08:29.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.182+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ef80cb990 con 0x7f7ee40663a0 2023-07-20T10:08:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.190+0000 7f7ef4ff9640 1 -- 172.21.15.82:0/11893370 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299723 (secure 0 0 0) 0x7f7ef80cb990 con 0x7f7ee40663a0 2023-07-20T10:08:29.169 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:29.171 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:08:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 msgr2=0x7f7ee4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 0x7f7ee4068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ef809b600 tx=0x7f7ee8009040 comp rx=0 tx=0).stop 2023-07-20T10:08:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 msgr2=0x7f7ef81f0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80c8e40 tx=0x7f7ef0009f90 comp rx=0 tx=0).stop 2023-07-20T10:08:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 shutdown_connections 2023-07-20T10:08:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ef809a4b0 0x7f7ef81f0b60 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f7ee40663a0 0x7f7ee4068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ef80c6470 0x7f7ef8099f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 --2- 172.21.15.82:0/11893370 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ee00047d0 0x7f7ef814bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 >> 172.21.15.82:0/11893370 conn(0x7f7ef80cada0 msgr2=0x7f7ef806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 shutdown_connections 2023-07-20T10:08:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.194+0000 7f7efe3ba640 1 -- 172.21.15.82:0/11893370 wait complete. 2023-07-20T10:08:29.189 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:08:27.925457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":318240,"kb_used_data":12732,"kb_used_omap":13,"kb_used_meta":305394,"kb_avail":754656480,"statfs":{"total":773094113280,"available":772768235520,"internally_reserved":0,"allocated":13037568,"data_stored":7120582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":312723544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.877887"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053981+0000","last_change":"2023-07-20T10:08:23.053981+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053981+0000","last_undegraded":"2023-07-20T10:08:23.053981+0000","last_fullsized":"2023-07-20T10:08:23.053981+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051961+0000","last_change":"2023-07-20T10:08:23.051961+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051961+0000","last_undegraded":"2023-07-20T10:08:23.051961+0000","last_fullsized":"2023-07-20T10:08:23.051961+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054994+0000","last_change":"2023-07-20T10:08:23.054994+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054994+0000","last_undegraded":"2023-07-20T10:08:23.054994+0000","last_fullsized":"2023-07-20T10:08:23.054994+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057440+0000","last_change":"2023-07-20T10:08:23.057440+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057440+0000","last_undegraded":"2023-07-20T10:08:23.057440+0000","last_fullsized":"2023-07-20T10:08:23.057440+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.058664+0000","last_change":"2023-07-20T10:08:23.058664+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.058664+0000","last_undegraded":"2023-07-20T10:08:23.058664+0000","last_fullsized":"2023-07-20T10:08:23.058664+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053788+0000","last_change":"2023-07-20T10:08:23.053788+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053788+0000","last_undegraded":"2023-07-20T10:08:23.053788+0000","last_fullsized":"2023-07-20T10:08:23.053788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054412+0000","last_change":"2023-07-20T10:08:23.054412+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054412+0000","last_undegraded":"2023-07-20T10:08:23.054412+0000","last_fullsized":"2023-07-20T10:08:23.054412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053778+0000","last_change":"2023-07-20T10:08:23.053778+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053778+0000","last_undegraded":"2023-07-20T10:08:23.053778+0000","last_fullsized":"2023-07-20T10:08:23.053778+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054166+0000","last_change":"2023-07-20T10:08:23.054166+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054166+0000","last_undegraded":"2023-07-20T10:08:23.054166+0000","last_fullsized":"2023-07-20T10:08:23.054166+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054834+0000","last_change":"2023-07-20T10:08:23.054834+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054834+0000","last_undegraded":"2023-07-20T10:08:23.054834+0000","last_fullsized":"2023-07-20T10:08:23.054834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.059027+0000","last_change":"2023-07-20T10:08:23.059027+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.059027+0000","last_undegraded":"2023-07-20T10:08:23.059027+0000","last_fullsized":"2023-07-20T10:08:23.059027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057141+0000","last_change":"2023-07-20T10:08:23.057141+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057141+0000","last_undegraded":"2023-07-20T10:08:23.057141+0000","last_fullsized":"2023-07-20T10:08:23.057141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057505+0000","last_change":"2023-07-20T10:08:23.057505+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057505+0000","last_undegraded":"2023-07-20T10:08:23.057505+0000","last_fullsized":"2023-07-20T10:08:23.057505+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053770+0000","last_change":"2023-07-20T10:08:23.053770+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053770+0000","last_undegraded":"2023-07-20T10:08:23.053770+0000","last_fullsized":"2023-07-20T10:08:23.053770+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051377+0000","last_change":"2023-07-20T10:08:23.051377+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051377+0000","last_undegraded":"2023-07-20T10:08:23.051377+0000","last_fullsized":"2023-07-20T10:08:23.051377+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053712+0000","last_change":"2023-07-20T10:08:23.053712+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053712+0000","last_undegraded":"2023-07-20T10:08:23.053712+0000","last_fullsized":"2023-07-20T10:08:23.053712+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057534+0000","last_change":"2023-07-20T10:08:23.057534+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057534+0000","last_undegraded":"2023-07-20T10:08:23.057534+0000","last_fullsized":"2023-07-20T10:08:23.057534+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054103+0000","last_change":"2023-07-20T10:08:23.054103+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054103+0000","last_undegraded":"2023-07-20T10:08:23.054103+0000","last_fullsized":"2023-07-20T10:08:23.054103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057229+0000","last_change":"2023-07-20T10:08:23.057229+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057229+0000","last_undegraded":"2023-07-20T10:08:23.057229+0000","last_fullsized":"2023-07-20T10:08:23.057229+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057977+0000","last_change":"2023-07-20T10:08:23.057977+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057977+0000","last_undegraded":"2023-07-20T10:08:23.057977+0000","last_fullsized":"2023-07-20T10:08:23.057977+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053811+0000","last_change":"2023-07-20T10:08:23.053811+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053811+0000","last_undegraded":"2023-07-20T10:08:23.053811+0000","last_fullsized":"2023-07-20T10:08:23.053811+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.050649+0000","last_change":"2023-07-20T10:08:23.050649+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.050649+0000","last_undegraded":"2023-07-20T10:08:23.050649+0000","last_fullsized":"2023-07-20T10:08:23.050649+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057076+0000","last_change":"2023-07-20T10:08:23.057076+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057076+0000","last_undegraded":"2023-07-20T10:08:23.057076+0000","last_fullsized":"2023-07-20T10:08:23.057076+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.050700+0000","last_change":"2023-07-20T10:08:23.050700+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.050700+0000","last_undegraded":"2023-07-20T10:08:23.050700+0000","last_fullsized":"2023-07-20T10:08:23.050700+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051234+0000","last_change":"2023-07-20T10:08:23.051234+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051234+0000","last_undegraded":"2023-07-20T10:08:23.051234+0000","last_fullsized":"2023-07-20T10:08:23.051234+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'205","reported_seq":659,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058239+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:08:23.058239+0000","last_peered":"2023-07-20T10:08:23.058239+0000","last_clean":"2023-07-20T10:08:23.058239+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:08:23.058239+0000","last_undegraded":"2023-07-20T10:08:23.058239+0000","last_fullsized":"2023-07-20T10:08:23.058239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:10:17.121875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.053598+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:08:23.053598+0000","last_peered":"2023-07-20T10:08:23.053598+0000","last_clean":"2023-07-20T10:08:23.053598+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:08:23.053598+0000","last_undegraded":"2023-07-20T10:08:23.053598+0000","last_fullsized":"2023-07-20T10:08:23.053598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:15.473993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.058412+0000","last_change":"2023-07-20T10:08:23.058412+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.058412+0000","last_undegraded":"2023-07-20T10:08:23.058412+0000","last_fullsized":"2023-07-20T10:08:23.058412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058105+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:08:23.058105+0000","last_peered":"2023-07-20T10:08:23.058105+0000","last_clean":"2023-07-20T10:08:23.058105+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:08:23.058105+0000","last_undegraded":"2023-07-20T10:08:23.058105+0000","last_fullsized":"2023-07-20T10:08:23.058105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:14.225517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053946+0000","last_change":"2023-07-20T10:08:23.053946+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053946+0000","last_undegraded":"2023-07-20T10:08:23.053946+0000","last_fullsized":"2023-07-20T10:08:23.053946+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.049037+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:08:23.049037+0000","last_peered":"2023-07-20T10:08:23.049037+0000","last_clean":"2023-07-20T10:08:23.049037+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:08:23.049037+0000","last_undegraded":"2023-07-20T10:08:23.049037+0000","last_fullsized":"2023-07-20T10:08:23.049037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:10.772811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057212+0000","last_change":"2023-07-20T10:08:23.057212+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057212+0000","last_undegraded":"2023-07-20T10:08:23.057212+0000","last_fullsized":"2023-07-20T10:08:23.057212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.054783+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:08:23.054783+0000","last_peered":"2023-07-20T10:08:23.054783+0000","last_clean":"2023-07-20T10:08:23.054783+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:08:23.054783+0000","last_undegraded":"2023-07-20T10:08:23.054783+0000","last_fullsized":"2023-07-20T10:08:23.054783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:45:32.835420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057709+0000","last_change":"2023-07-20T10:08:23.057709+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057709+0000","last_undegraded":"2023-07-20T10:08:23.057709+0000","last_fullsized":"2023-07-20T10:08:23.057709+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058628+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:08:23.058628+0000","last_peered":"2023-07-20T10:08:23.058628+0000","last_clean":"2023-07-20T10:08:23.058628+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:08:23.058628+0000","last_undegraded":"2023-07-20T10:08:23.058628+0000","last_fullsized":"2023-07-20T10:08:23.058628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:05:53.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051162+0000","last_change":"2023-07-20T10:08:23.051162+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051162+0000","last_undegraded":"2023-07-20T10:08:23.051162+0000","last_fullsized":"2023-07-20T10:08:23.051162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.059528+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:08:23.059528+0000","last_peered":"2023-07-20T10:08:23.059528+0000","last_clean":"2023-07-20T10:08:23.059528+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:08:23.059528+0000","last_undegraded":"2023-07-20T10:08:23.059528+0000","last_fullsized":"2023-07-20T10:08:23.059528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:09:01.377455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051249+0000","last_change":"2023-07-20T10:08:23.051249+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051249+0000","last_undegraded":"2023-07-20T10:08:23.051249+0000","last_fullsized":"2023-07-20T10:08:23.051249+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058665+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:08:23.058665+0000","last_peered":"2023-07-20T10:08:23.058665+0000","last_clean":"2023-07-20T10:08:23.058665+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:08:23.058665+0000","last_undegraded":"2023-07-20T10:08:23.058665+0000","last_fullsized":"2023-07-20T10:08:23.058665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:07.804910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051221+0000","last_change":"2023-07-20T10:08:23.051221+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051221+0000","last_undegraded":"2023-07-20T10:08:23.051221+0000","last_fullsized":"2023-07-20T10:08:23.051221+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058405+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:08:23.058405+0000","last_peered":"2023-07-20T10:08:23.058405+0000","last_clean":"2023-07-20T10:08:23.058405+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:08:23.058405+0000","last_undegraded":"2023-07-20T10:08:23.058405+0000","last_fullsized":"2023-07-20T10:08:23.058405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:17:45.066112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59384,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312456,"statfs":{"total":96636764160,"available":96575954944,"internally_reserved":0,"allocated":2076672,"data_stored":1333620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.153,"15min":1.153},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.95299999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.434,"15min":0.36899999999999999},"max":{"1min":0.89200000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.90900000000000003,"5min":1.05,"15min":1.075},"last":1.018}]},{"osd":2,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.716},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.433},"max":{"1min":0.96899999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":1.3759999999999999,"15min":1.758},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.8},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.875,"5min":0.995,"15min":0.999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0840000000000001,"15min":1.1220000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575065,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1470464,"data_stored":737082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.73799999999999999},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.90000000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.56000000000000005,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.53800000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.1259999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98899999999999999,"15min":1.103},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70999999999999996},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85799999999999998,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93000000000000005,"5min":1.1000000000000001,"15min":1.25},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71499999999999997,"15min":0.73499999999999999},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":1.272},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.98699999999999999,"15min":1.173},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":1.135,"15min":1.135},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93999999999999995,"5min":0.996,"15min":0.996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.73199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.98699999999999999,"15min":1.0620000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.036},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":1.0269999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.034},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.89200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.28599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0089999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.95199999999999996,"15min":1.024},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90800000000000003,"5min":1.0209999999999999,"15min":1.0680000000000001},"last":0.745},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":1.0049999999999999},"last":0.84199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":1.085},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.141},"last":0.754},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":0.98599999999999999,"15min":1.363},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.149,"15min":1.177},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.002,"5min":1.159,"15min":1.23},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.98899999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.196},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.034},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.85599999999999998,"15min":1.2649999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.60199999999999998,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.628}]},{"osd":2,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":1.002,"5min":1.083,"15min":1.1890000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.45900000000000002},"max":{"1min":0.98299999999999998,"5min":1.071,"15min":1.381},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":1.052,"15min":1.3260000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95499999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0129999999999999,"5min":1.04,"15min":1.131},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.4399999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.79000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45600000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56200000000000006,"5min":0.68899999999999995,"15min":0.876},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0289999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.41899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.2689999999999999},"last":0.747}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77900000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.53100000000000003,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.0680000000000001,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.069,"5min":1.218,"15min":1.3240000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.024,"5min":1.143,"15min":1.292},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.095,"5min":1.204,"15min":1.393},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44800000000000001,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67100000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":1.399,"15min":1.399},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":1.083,"15min":1.1779999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0309999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.77400000000000002},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.012,"5min":1.0389999999999999,"15min":1.107},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99299999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575063,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37240,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":2076672,"data_stored":1333620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.247},"max":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":3.0710000000000002},"last":0.308},{"interface":"front","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":3.2509999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53400000000000003,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.79900000000000004},"min":{"1min":0.55400000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.232,"15min":1.6779999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.80900000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.216,"5min":1.216,"15min":3.125},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0649999999999999,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.1950000000000001,"15min":3.161},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.1739999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3009999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.3089999999999999,"15min":1.766},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:08:29.196 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:08:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 Processor -- start 2023-07-20T10:08:29.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 -- start start 2023-07-20T10:08:29.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 0x7f43f415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f43f40cc900 0x7f43f40ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f40b2380 0x7f43f40b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40b2d50 con 0x7f43f40b2380 2023-07-20T10:08:29.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40ad600 con 0x7f43f40cc900 2023-07-20T10:08:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fc3fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40ccd60 con 0x7f43f41596b0 2023-07-20T10:08:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fa997640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f40b2380 0x7f43f40b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fa997640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43f40b2380 0x7f43f40b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50416/0 (socket says 172.21.15.82:50416) 2023-07-20T10:08:29.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.394+0000 7f43fa997640 1 -- 172.21.15.82:0/3526604645 learned_addr learned my addr 172.21.15.82:0/3526604645 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa196640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 0x7f43f415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43f9995640 1 --2- 172.21.15.82:0/3526604645 >> v2:172.21.15.183:3300/0 conn(0x7f43f40cc900 0x7f43f40ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 -- 172.21.15.82:0/3526604645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 msgr2=0x7f43f415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 0x7f43f415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 -- 172.21.15.82:0/3526604645 >> v2:172.21.15.183:3300/0 conn(0x7f43f40cc900 msgr2=0x7f43f40ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:29.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 --2- 172.21.15.82:0/3526604645 >> v2:172.21.15.183:3300/0 conn(0x7f43f40cc900 0x7f43f40ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 -- 172.21.15.82:0/3526604645 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40ad810 con 0x7f43f40b2380 2023-07-20T10:08:29.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa196640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 0x7f43f415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43fa997640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40b2380 0x7f43f40b2810 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f43f40cf380 tx=0x7f43ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d764950d3b5c6bd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43f9194640 1 -- 172.21.15.82:0/3526604645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0a5820 con 0x7f43f40b2380 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43f9194640 1 -- 172.21.15.82:0/3526604645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec0a5980 con 0x7f43f40b2380 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.398+0000 7f43f9194640 1 -- 172.21.15.82:0/3526604645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0a5d10 con 0x7f43f40b2380 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3526604645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40b2380 msgr2=0x7f43f40b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40b2380 0x7f43f40b2810 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f43f40cf380 tx=0x7f43ec01c9a0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3526604645 shutdown_connections 2023-07-20T10:08:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3526604645 >> v2:172.21.15.183:3300/0 conn(0x7f43f40cc900 0x7f43f40ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40b2380 0x7f43f40b2810 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3526604645 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f41596b0 0x7f43f415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3526604645 >> 172.21.15.82:0/3526604645 conn(0x7f43f40cada0 msgr2=0x7f43f40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3526604645 shutdown_connections 2023-07-20T10:08:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3526604645 wait complete. 2023-07-20T10:08:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 Processor -- start 2023-07-20T10:08:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- start start 2023-07-20T10:08:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f40b2380 0x7f43f406cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f41596b0 0x7f43f41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c27a0 con 0x7f43f40cc900 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f406d4c0 con 0x7f43f41596b0 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fc3fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40c4050 con 0x7f43f40b2380 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50418/0 (socket says 172.21.15.82:50418) 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 -- 172.21.15.82:0/3662846782 learned_addr learned my addr 172.21.15.82:0/3662846782 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fa196640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f40b2380 0x7f43f406cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43fa997640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f41596b0 0x7f43f41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 -- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f40b2380 msgr2=0x7f43f406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f40b2380 0x7f43f406cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 -- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f41596b0 msgr2=0x7f43f41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f41596b0 0x7f43f41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.402+0000 7f43f9995640 1 -- 172.21.15.82:0/3662846782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec009b30 con 0x7f43f40cc900 2023-07-20T10:08:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43f9995640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e8e0 tx=0x7f43e400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400ca00 con 0x7f43f40cc900 2023-07-20T10:08:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e400cb60 con 0x7f43f40cc900 2023-07-20T10:08:29.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4013470 con 0x7f43f40cc900 2023-07-20T10:08:29.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f40c31f0 con 0x7f43f40cc900 2023-07-20T10:08:29.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f40c3440 con 0x7f43f40cc900 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f40c41c0 con 0x7f43f40cc900 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43e40135d0 con 0x7f43f40cc900 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 0x7f43d8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43e4084130 con 0x7f43f40cc900 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.406+0000 7f43fa196640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 0x7f43d8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.410+0000 7f43fa196640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 0x7f43d8068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43f00045f0 tx=0x7f43f0008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.410+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43e4051420 con 0x7f43f40cc900 2023-07-20T10:08:29.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.558+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43f40c9180 con 0x7f43d80663d0 2023-07-20T10:08:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.562+0000 7f43eaffd640 1 -- 172.21.15.82:0/3662846782 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299723 (secure 0 0 0) 0x7f43f000b720 con 0x7f43d80663d0 2023-07-20T10:08:29.543 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:08:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 msgr2=0x7f43d8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 0x7f43d8068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43f00045f0 tx=0x7f43f0008040 comp rx=0 tx=0).stop 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 msgr2=0x7f43f40c2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f43e400e8e0 tx=0x7f43e400eda0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 shutdown_connections 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f43d80663d0 0x7f43d8068890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43f41596b0 0x7f43f41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43f40cc900 0x7f43f40c2cb0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 --2- 172.21.15.82:0/3662846782 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43f40b2380 0x7f43f406cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 >> 172.21.15.82:0/3662846782 conn(0x7f43f40cada0 msgr2=0x7f43f4156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 shutdown_connections 2023-07-20T10:08:29.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.566+0000 7f43fc3fa640 1 -- 172.21.15.82:0/3662846782 wait complete. 2023-07-20T10:08:29.563 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:08:27.925457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":318240,"kb_used_data":12732,"kb_used_omap":13,"kb_used_meta":305394,"kb_avail":754656480,"statfs":{"total":773094113280,"available":772768235520,"internally_reserved":0,"allocated":13037568,"data_stored":7120582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":312723544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.877887"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053981+0000","last_change":"2023-07-20T10:08:23.053981+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053981+0000","last_undegraded":"2023-07-20T10:08:23.053981+0000","last_fullsized":"2023-07-20T10:08:23.053981+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051961+0000","last_change":"2023-07-20T10:08:23.051961+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051961+0000","last_undegraded":"2023-07-20T10:08:23.051961+0000","last_fullsized":"2023-07-20T10:08:23.051961+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054994+0000","last_change":"2023-07-20T10:08:23.054994+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054994+0000","last_undegraded":"2023-07-20T10:08:23.054994+0000","last_fullsized":"2023-07-20T10:08:23.054994+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057440+0000","last_change":"2023-07-20T10:08:23.057440+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057440+0000","last_undegraded":"2023-07-20T10:08:23.057440+0000","last_fullsized":"2023-07-20T10:08:23.057440+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.058664+0000","last_change":"2023-07-20T10:08:23.058664+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.058664+0000","last_undegraded":"2023-07-20T10:08:23.058664+0000","last_fullsized":"2023-07-20T10:08:23.058664+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053788+0000","last_change":"2023-07-20T10:08:23.053788+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053788+0000","last_undegraded":"2023-07-20T10:08:23.053788+0000","last_fullsized":"2023-07-20T10:08:23.053788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054412+0000","last_change":"2023-07-20T10:08:23.054412+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054412+0000","last_undegraded":"2023-07-20T10:08:23.054412+0000","last_fullsized":"2023-07-20T10:08:23.054412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053778+0000","last_change":"2023-07-20T10:08:23.053778+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053778+0000","last_undegraded":"2023-07-20T10:08:23.053778+0000","last_fullsized":"2023-07-20T10:08:23.053778+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054166+0000","last_change":"2023-07-20T10:08:23.054166+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054166+0000","last_undegraded":"2023-07-20T10:08:23.054166+0000","last_fullsized":"2023-07-20T10:08:23.054166+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054834+0000","last_change":"2023-07-20T10:08:23.054834+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054834+0000","last_undegraded":"2023-07-20T10:08:23.054834+0000","last_fullsized":"2023-07-20T10:08:23.054834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.059027+0000","last_change":"2023-07-20T10:08:23.059027+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.059027+0000","last_undegraded":"2023-07-20T10:08:23.059027+0000","last_fullsized":"2023-07-20T10:08:23.059027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057141+0000","last_change":"2023-07-20T10:08:23.057141+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057141+0000","last_undegraded":"2023-07-20T10:08:23.057141+0000","last_fullsized":"2023-07-20T10:08:23.057141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057505+0000","last_change":"2023-07-20T10:08:23.057505+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057505+0000","last_undegraded":"2023-07-20T10:08:23.057505+0000","last_fullsized":"2023-07-20T10:08:23.057505+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053770+0000","last_change":"2023-07-20T10:08:23.053770+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053770+0000","last_undegraded":"2023-07-20T10:08:23.053770+0000","last_fullsized":"2023-07-20T10:08:23.053770+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051377+0000","last_change":"2023-07-20T10:08:23.051377+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051377+0000","last_undegraded":"2023-07-20T10:08:23.051377+0000","last_fullsized":"2023-07-20T10:08:23.051377+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053712+0000","last_change":"2023-07-20T10:08:23.053712+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053712+0000","last_undegraded":"2023-07-20T10:08:23.053712+0000","last_fullsized":"2023-07-20T10:08:23.053712+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057534+0000","last_change":"2023-07-20T10:08:23.057534+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057534+0000","last_undegraded":"2023-07-20T10:08:23.057534+0000","last_fullsized":"2023-07-20T10:08:23.057534+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.054103+0000","last_change":"2023-07-20T10:08:23.054103+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.054103+0000","last_undegraded":"2023-07-20T10:08:23.054103+0000","last_fullsized":"2023-07-20T10:08:23.054103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057229+0000","last_change":"2023-07-20T10:08:23.057229+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057229+0000","last_undegraded":"2023-07-20T10:08:23.057229+0000","last_fullsized":"2023-07-20T10:08:23.057229+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057977+0000","last_change":"2023-07-20T10:08:23.057977+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057977+0000","last_undegraded":"2023-07-20T10:08:23.057977+0000","last_fullsized":"2023-07-20T10:08:23.057977+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053811+0000","last_change":"2023-07-20T10:08:23.053811+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053811+0000","last_undegraded":"2023-07-20T10:08:23.053811+0000","last_fullsized":"2023-07-20T10:08:23.053811+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.050649+0000","last_change":"2023-07-20T10:08:23.050649+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.050649+0000","last_undegraded":"2023-07-20T10:08:23.050649+0000","last_fullsized":"2023-07-20T10:08:23.050649+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057076+0000","last_change":"2023-07-20T10:08:23.057076+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057076+0000","last_undegraded":"2023-07-20T10:08:23.057076+0000","last_fullsized":"2023-07-20T10:08:23.057076+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.050700+0000","last_change":"2023-07-20T10:08:23.050700+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.050700+0000","last_undegraded":"2023-07-20T10:08:23.050700+0000","last_fullsized":"2023-07-20T10:08:23.050700+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051234+0000","last_change":"2023-07-20T10:08:23.051234+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051234+0000","last_undegraded":"2023-07-20T10:08:23.051234+0000","last_fullsized":"2023-07-20T10:08:23.051234+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'205","reported_seq":659,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058239+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:08:23.058239+0000","last_peered":"2023-07-20T10:08:23.058239+0000","last_clean":"2023-07-20T10:08:23.058239+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:08:23.058239+0000","last_undegraded":"2023-07-20T10:08:23.058239+0000","last_fullsized":"2023-07-20T10:08:23.058239+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:10:17.121875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.053598+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:08:23.053598+0000","last_peered":"2023-07-20T10:08:23.053598+0000","last_clean":"2023-07-20T10:08:23.053598+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:08:23.053598+0000","last_undegraded":"2023-07-20T10:08:23.053598+0000","last_fullsized":"2023-07-20T10:08:23.053598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:15.473993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.058412+0000","last_change":"2023-07-20T10:08:23.058412+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.058412+0000","last_undegraded":"2023-07-20T10:08:23.058412+0000","last_fullsized":"2023-07-20T10:08:23.058412+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058105+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:08:23.058105+0000","last_peered":"2023-07-20T10:08:23.058105+0000","last_clean":"2023-07-20T10:08:23.058105+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:08:23.058105+0000","last_undegraded":"2023-07-20T10:08:23.058105+0000","last_fullsized":"2023-07-20T10:08:23.058105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:14.225517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.053946+0000","last_change":"2023-07-20T10:08:23.053946+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.053946+0000","last_undegraded":"2023-07-20T10:08:23.053946+0000","last_fullsized":"2023-07-20T10:08:23.053946+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":211,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.049037+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:08:23.049037+0000","last_peered":"2023-07-20T10:08:23.049037+0000","last_clean":"2023-07-20T10:08:23.049037+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:08:23.049037+0000","last_undegraded":"2023-07-20T10:08:23.049037+0000","last_fullsized":"2023-07-20T10:08:23.049037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:10.772811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057212+0000","last_change":"2023-07-20T10:08:23.057212+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057212+0000","last_undegraded":"2023-07-20T10:08:23.057212+0000","last_fullsized":"2023-07-20T10:08:23.057212+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":213,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.054783+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:08:23.054783+0000","last_peered":"2023-07-20T10:08:23.054783+0000","last_clean":"2023-07-20T10:08:23.054783+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:08:23.054783+0000","last_undegraded":"2023-07-20T10:08:23.054783+0000","last_fullsized":"2023-07-20T10:08:23.054783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:45:32.835420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.057709+0000","last_change":"2023-07-20T10:08:23.057709+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.057709+0000","last_undegraded":"2023-07-20T10:08:23.057709+0000","last_fullsized":"2023-07-20T10:08:23.057709+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058628+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:08:23.058628+0000","last_peered":"2023-07-20T10:08:23.058628+0000","last_clean":"2023-07-20T10:08:23.058628+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:08:23.058628+0000","last_undegraded":"2023-07-20T10:08:23.058628+0000","last_fullsized":"2023-07-20T10:08:23.058628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:05:53.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051162+0000","last_change":"2023-07-20T10:08:23.051162+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051162+0000","last_undegraded":"2023-07-20T10:08:23.051162+0000","last_fullsized":"2023-07-20T10:08:23.051162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.059528+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:08:23.059528+0000","last_peered":"2023-07-20T10:08:23.059528+0000","last_clean":"2023-07-20T10:08:23.059528+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:08:23.059528+0000","last_undegraded":"2023-07-20T10:08:23.059528+0000","last_fullsized":"2023-07-20T10:08:23.059528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:09:01.377455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051249+0000","last_change":"2023-07-20T10:08:23.051249+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051249+0000","last_undegraded":"2023-07-20T10:08:23.051249+0000","last_fullsized":"2023-07-20T10:08:23.051249+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":187,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058665+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:08:23.058665+0000","last_peered":"2023-07-20T10:08:23.058665+0000","last_clean":"2023-07-20T10:08:23.058665+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:08:23.058665+0000","last_undegraded":"2023-07-20T10:08:23.058665+0000","last_fullsized":"2023-07-20T10:08:23.058665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:07.804910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:08:24.047736+0000","last_change":"2023-07-20T10:08:24.047736+0000","last_active":"2023-07-20T10:08:24.047736+0000","last_peered":"2023-07-20T10:08:24.047736+0000","last_clean":"2023-07-20T10:08:24.047736+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:24.047736+0000","last_undegraded":"2023-07-20T10:08:24.047736+0000","last_fullsized":"2023-07-20T10:08:24.047736+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":120,"state":"creating+peering","last_fresh":"2023-07-20T10:08:23.051221+0000","last_change":"2023-07-20T10:08:23.051221+0000","last_active":"2023-07-20T10:08:23.039609+0000","last_peered":"2023-07-20T10:08:23.039609+0000","last_clean":"2023-07-20T10:08:23.039609+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:08:23.051221+0000","last_undegraded":"2023-07-20T10:08:23.051221+0000","last_fullsized":"2023-07-20T10:08:23.051221+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":120,"state":"active+clean","last_fresh":"2023-07-20T10:08:23.058405+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:08:23.058405+0000","last_peered":"2023-07-20T10:08:23.058405+0000","last_clean":"2023-07-20T10:08:23.058405+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:08:23.058405+0000","last_undegraded":"2023-07-20T10:08:23.058405+0000","last_fullsized":"2023-07-20T10:08:23.058405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:17:45.066112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59384,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312456,"statfs":{"total":96636764160,"available":96575954944,"internally_reserved":0,"allocated":2076672,"data_stored":1333620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.153,"15min":1.153},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.95299999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.88900000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.434,"15min":0.36899999999999999},"max":{"1min":0.89200000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.90900000000000003,"5min":1.05,"15min":1.075},"last":1.018}]},{"osd":2,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.716},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.433},"max":{"1min":0.96899999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":1.3759999999999999,"15min":1.758},"last":0.79900000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.8},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.875,"5min":0.995,"15min":0.999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0840000000000001,"15min":1.1220000000000001},"last":0.64100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575065,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1470464,"data_stored":737082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.73799999999999999},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.90000000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.63},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.56000000000000005,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.53800000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.1259999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98899999999999999,"15min":1.103},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70999999999999996},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85799999999999998,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93000000000000005,"5min":1.1000000000000001,"15min":1.25},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71499999999999997,"15min":0.73499999999999999},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":1.272},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.98699999999999999,"15min":1.173},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":1.135,"15min":1.135},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93999999999999995,"5min":0.996,"15min":0.996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.73199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.98699999999999999,"15min":1.0620000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.036},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":1.0269999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.034},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.89200000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.28599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0089999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.95199999999999996,"15min":1.024},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90800000000000003,"5min":1.0209999999999999,"15min":1.0680000000000001},"last":0.745},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":1.0049999999999999},"last":0.84199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":1.085},"last":0.80600000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.141},"last":0.754},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":0.98599999999999999,"15min":1.363},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.149,"15min":1.177},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.002,"5min":1.159,"15min":1.23},"last":0.85499999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.98899999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.196},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.034},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.85599999999999998,"15min":1.2649999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36660,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.60199999999999998,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.57099999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.628}]},{"osd":2,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":1.002,"5min":1.083,"15min":1.1890000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.45900000000000002},"max":{"1min":0.98299999999999998,"5min":1.071,"15min":1.381},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":1.052,"15min":1.3260000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95499999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0129999999999999,"5min":1.04,"15min":1.131},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.4399999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.79000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54708,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317132,"statfs":{"total":96636764160,"available":96580743168,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45600000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56200000000000006,"5min":0.68899999999999995,"15min":0.876},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.503}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0289999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.41899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.2689999999999999},"last":0.747}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77900000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.53100000000000003,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.86499999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.0680000000000001,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.069,"5min":1.218,"15min":1.3240000000000001},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.024,"5min":1.143,"15min":1.292},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.095,"5min":1.204,"15min":1.393},"last":0.72899999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1482752,"data_stored":743252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44800000000000001,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67100000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":1.399,"15min":1.399},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":1.083,"15min":1.1779999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0309999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.77400000000000002},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.012,"5min":1.0389999999999999,"15min":1.107},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99299999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.55000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575063,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37240,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334600,"statfs":{"total":96636764160,"available":96598630400,"internally_reserved":0,"allocated":2076672,"data_stored":1333620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.247},"max":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":3.0710000000000002},"last":0.308},{"interface":"front","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":3.2509999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53400000000000003,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.79900000000000004},"min":{"1min":0.55400000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.232,"15min":1.6779999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.80900000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.216,"5min":1.216,"15min":3.125},"last":0.77000000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0649999999999999,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.1950000000000001,"15min":3.161},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.1739999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3009999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.3089999999999999,"15min":1.766},"last":0.78900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:08:29.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:08:29.668 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T10:08:29.690+0000 7f50e2e29640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:08:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 Processor -- start 2023-07-20T10:08:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 -- start start 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0ca040 0x7f4a4c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c15ce50 0x7f4a4c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c0cde70 con 0x7f4a4c0ad060 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0ca4c0 con 0x7f4a4c0ca040 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a51b8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0ad440 con 0x7f4a4c15ce50 2023-07-20T10:08:29.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0ca040 0x7f4a4c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a4b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4a4c0ad060 0x7f4a4c0afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50394/0 (socket says 172.21.15.82:50394) 2023-07-20T10:08:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4a4c0ca040 0x7f4a4c15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50424/0 (socket says 172.21.15.82:50424) 2023-07-20T10:08:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a4b7fe640 1 -- 172.21.15.82:0/3381668595 learned_addr learned my addr 172.21.15.82:0/3381668595 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a4bfff640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c15ce50 0x7f4a4c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 -- 172.21.15.82:0/3381668595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c15ce50 msgr2=0x7f4a4c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c15ce50 0x7f4a4c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 -- 172.21.15.82:0/3381668595 >> v1:172.21.15.82:6789/0 conn(0x7f4a4c0ad060 legacy=0x7f4a4c0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.766+0000 7f4a43fff640 1 -- 172.21.15.82:0/3381668595 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0cbef0 con 0x7f4a4c0ca040 2023-07-20T10:08:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a43fff640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c15c910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4a340097c0 tx=0x7f4a3401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0ff31406024de0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a4affd640 1 -- 172.21.15.82:0/3381668595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340ab600 con 0x7f4a4c0ca040 2023-07-20T10:08:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a4affd640 1 -- 172.21.15.82:0/3381668595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a340a7050 con 0x7f4a4c0ca040 2023-07-20T10:08:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a4affd640 1 -- 172.21.15.82:0/3381668595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340ab980 con 0x7f4a4c0ca040 2023-07-20T10:08:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 -- 172.21.15.82:0/3381668595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 msgr2=0x7f4a4c15c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c15c910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4a340097c0 tx=0x7f4a3401c480 comp rx=0 tx=0).stop 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 -- 172.21.15.82:0/3381668595 shutdown_connections 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c15ce50 0x7f4a4c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/3381668595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c15c910 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 -- 172.21.15.82:0/3381668595 >> 172.21.15.82:0/3381668595 conn(0x7f4a4c0cada0 msgr2=0x7f4a4c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 -- 172.21.15.82:0/3381668595 shutdown_connections 2023-07-20T10:08:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.770+0000 7f4a51b8f640 1 -- 172.21.15.82:0/3381668595 wait complete. 2023-07-20T10:08:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 Processor -- start 2023-07-20T10:08:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- start start 2023-07-20T10:08:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c0ad060 0x7f4a4c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a4c15ce50 0x7f4a4c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0c25a0 con 0x7f4a4c0ca040 2023-07-20T10:08:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c156410 con 0x7f4a4c15ce50 2023-07-20T10:08:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0c22c0 con 0x7f4a4c0ad060 2023-07-20T10:08:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50440/0 (socket says 172.21.15.82:50440) 2023-07-20T10:08:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 -- 172.21.15.82:0/412564201 learned_addr learned my addr 172.21.15.82:0/412564201 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a4b7fe640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c0ad060 0x7f4a4c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a4bfff640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a4c15ce50 0x7f4a4c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 -- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c0ad060 msgr2=0x7f4a4c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c0ad060 0x7f4a4c154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 -- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a4c15ce50 msgr2=0x7f4a4c150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a4c15ce50 0x7f4a4c150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 -- 172.21.15.82:0/412564201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009420 con 0x7f4a4c0ca040 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a43fff640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4a340ae040 tx=0x7f4a34019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b4840 con 0x7f4a4c0ca040 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a340b49c0 con 0x7f4a4c0ca040 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340b4d70 con 0x7f4a4c0ca040 2023-07-20T10:08:29.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c156660 con 0x7f4a4c0ca040 2023-07-20T10:08:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.774+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c150f90 con 0x7f4a4c0ca040 2023-07-20T10:08:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c073c70 con 0x7f4a4c0ca040 2023-07-20T10:08:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4a340b2040 con 0x7f4a4c0ca040 2023-07-20T10:08:29.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a48ff9640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 0x7f4a2c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a3411e330 con 0x7f4a4c0ca040 2023-07-20T10:08:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a4b7fe640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 0x7f4a2c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:29.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.778+0000 7f4a4b7fe640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 0x7f4a2c068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c005890 tx=0x7f4a3c009040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:29.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.782+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a340eb4f0 con 0x7f4a4c0ca040 2023-07-20T10:08:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.926+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a4c164450 con 0x7f4a2c0663a0 2023-07-20T10:08:29.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.934+0000 7f4a48ff9640 1 -- 172.21.15.82:0/412564201 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311896 (secure 0 0 0) 0x7f4a3c001510 con 0x7f4a2c0663a0 2023-07-20T10:08:29.913 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:29.914 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:08:29.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 msgr2=0x7f4a2c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 0x7f4a2c068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c005890 tx=0x7f4a3c009040 comp rx=0 tx=0).stop 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 msgr2=0x7f4a4c158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4a340ae040 tx=0x7f4a34019220 comp rx=0 tx=0).stop 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 shutdown_connections 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f4a2c0663a0 0x7f4a2c068860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4a4c15ce50 0x7f4a4c150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a4c0ca040 0x7f4a4c158b40 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 --2- 172.21.15.82:0/412564201 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4a4c0ad060 0x7f4a4c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 >> 172.21.15.82:0/412564201 conn(0x7f4a4c0cada0 msgr2=0x7f4a4c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 shutdown_connections 2023-07-20T10:08:29.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:29.938+0000 7f4a51b8f640 1 -- 172.21.15.82:0/412564201 wait complete. 2023-07-20T10:08:29.933 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:08:29.925863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":336668,"kb_used_data":13096,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754638052,"statfs":{"total":773094113280,"available":772749365248,"internally_reserved":0,"allocated":13410304,"data_stored":7294748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001223"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535200+0000","last_change":"2023-07-20T10:08:25.088567+0000","last_active":"2023-07-20T10:08:26.535200+0000","last_peered":"2023-07-20T10:08:26.535200+0000","last_clean":"2023-07-20T10:08:26.535200+0000","last_became_active":"2023-07-20T10:08:25.086795+0000","last_became_peered":"2023-07-20T10:08:25.086795+0000","last_unstale":"2023-07-20T10:08:26.535200+0000","last_undegraded":"2023-07-20T10:08:26.535200+0000","last_fullsized":"2023-07-20T10:08:26.535200+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:26:30.327277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539096+0000","last_change":"2023-07-20T10:08:25.095614+0000","last_active":"2023-07-20T10:08:26.539096+0000","last_peered":"2023-07-20T10:08:26.539096+0000","last_clean":"2023-07-20T10:08:26.539096+0000","last_became_active":"2023-07-20T10:08:25.095201+0000","last_became_peered":"2023-07-20T10:08:25.095201+0000","last_unstale":"2023-07-20T10:08:26.539096+0000","last_undegraded":"2023-07-20T10:08:26.539096+0000","last_fullsized":"2023-07-20T10:08:26.539096+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:58:26.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535181+0000","last_change":"2023-07-20T10:08:25.087856+0000","last_active":"2023-07-20T10:08:26.535181+0000","last_peered":"2023-07-20T10:08:26.535181+0000","last_clean":"2023-07-20T10:08:26.535181+0000","last_became_active":"2023-07-20T10:08:25.087280+0000","last_became_peered":"2023-07-20T10:08:25.087280+0000","last_unstale":"2023-07-20T10:08:26.535181+0000","last_undegraded":"2023-07-20T10:08:26.535181+0000","last_fullsized":"2023-07-20T10:08:26.535181+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:48.244239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535022+0000","last_change":"2023-07-20T10:08:25.080773+0000","last_active":"2023-07-20T10:08:26.535022+0000","last_peered":"2023-07-20T10:08:26.535022+0000","last_clean":"2023-07-20T10:08:26.535022+0000","last_became_active":"2023-07-20T10:08:25.080162+0000","last_became_peered":"2023-07-20T10:08:25.080162+0000","last_unstale":"2023-07-20T10:08:26.535022+0000","last_undegraded":"2023-07-20T10:08:26.535022+0000","last_fullsized":"2023-07-20T10:08:26.535022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:31.500117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084292+0000","last_change":"2023-07-20T10:08:25.092477+0000","last_active":"2023-07-20T10:08:26.084292+0000","last_peered":"2023-07-20T10:08:26.084292+0000","last_clean":"2023-07-20T10:08:26.084292+0000","last_became_active":"2023-07-20T10:08:25.092042+0000","last_became_peered":"2023-07-20T10:08:25.092042+0000","last_unstale":"2023-07-20T10:08:26.084292+0000","last_undegraded":"2023-07-20T10:08:26.084292+0000","last_fullsized":"2023-07-20T10:08:26.084292+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:53.494822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538287+0000","last_change":"2023-07-20T10:08:25.088631+0000","last_active":"2023-07-20T10:08:26.538287+0000","last_peered":"2023-07-20T10:08:26.538287+0000","last_clean":"2023-07-20T10:08:26.538287+0000","last_became_active":"2023-07-20T10:08:25.088256+0000","last_became_peered":"2023-07-20T10:08:25.088256+0000","last_unstale":"2023-07-20T10:08:26.538287+0000","last_undegraded":"2023-07-20T10:08:26.538287+0000","last_fullsized":"2023-07-20T10:08:26.538287+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:04.986072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538492+0000","last_change":"2023-07-20T10:08:25.096007+0000","last_active":"2023-07-20T10:08:26.538492+0000","last_peered":"2023-07-20T10:08:26.538492+0000","last_clean":"2023-07-20T10:08:26.538492+0000","last_became_active":"2023-07-20T10:08:25.095678+0000","last_became_peered":"2023-07-20T10:08:25.095678+0000","last_unstale":"2023-07-20T10:08:26.538492+0000","last_undegraded":"2023-07-20T10:08:26.538492+0000","last_fullsized":"2023-07-20T10:08:26.538492+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:58.298640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082424+0000","last_change":"2023-07-20T10:08:25.086880+0000","last_active":"2023-07-20T10:08:26.082424+0000","last_peered":"2023-07-20T10:08:26.082424+0000","last_clean":"2023-07-20T10:08:26.082424+0000","last_became_active":"2023-07-20T10:08:25.086606+0000","last_became_peered":"2023-07-20T10:08:25.086606+0000","last_unstale":"2023-07-20T10:08:26.082424+0000","last_undegraded":"2023-07-20T10:08:26.082424+0000","last_fullsized":"2023-07-20T10:08:26.082424+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:44.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.091329+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.090464+0000","last_became_peered":"2023-07-20T10:08:25.090464+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:06.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084092+0000","last_change":"2023-07-20T10:08:25.095723+0000","last_active":"2023-07-20T10:08:26.084092+0000","last_peered":"2023-07-20T10:08:26.084092+0000","last_clean":"2023-07-20T10:08:26.084092+0000","last_became_active":"2023-07-20T10:08:25.095452+0000","last_became_peered":"2023-07-20T10:08:25.095452+0000","last_unstale":"2023-07-20T10:08:26.084092+0000","last_undegraded":"2023-07-20T10:08:26.084092+0000","last_fullsized":"2023-07-20T10:08:26.084092+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:34.544206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086844+0000","last_change":"2023-07-20T10:08:25.089704+0000","last_active":"2023-07-20T10:08:26.086844+0000","last_peered":"2023-07-20T10:08:26.086844+0000","last_clean":"2023-07-20T10:08:26.086844+0000","last_became_active":"2023-07-20T10:08:25.089379+0000","last_became_peered":"2023-07-20T10:08:25.089379+0000","last_unstale":"2023-07-20T10:08:26.086844+0000","last_undegraded":"2023-07-20T10:08:26.086844+0000","last_fullsized":"2023-07-20T10:08:26.086844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:04:49.393132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538684+0000","last_change":"2023-07-20T10:08:25.088568+0000","last_active":"2023-07-20T10:08:26.538684+0000","last_peered":"2023-07-20T10:08:26.538684+0000","last_clean":"2023-07-20T10:08:26.538684+0000","last_became_active":"2023-07-20T10:08:25.088271+0000","last_became_peered":"2023-07-20T10:08:25.088271+0000","last_unstale":"2023-07-20T10:08:26.538684+0000","last_undegraded":"2023-07-20T10:08:26.538684+0000","last_fullsized":"2023-07-20T10:08:26.538684+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:17.709652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534563+0000","last_change":"2023-07-20T10:08:25.077985+0000","last_active":"2023-07-20T10:08:26.534563+0000","last_peered":"2023-07-20T10:08:26.534563+0000","last_clean":"2023-07-20T10:08:26.534563+0000","last_became_active":"2023-07-20T10:08:25.077668+0000","last_became_peered":"2023-07-20T10:08:25.077668+0000","last_unstale":"2023-07-20T10:08:26.534563+0000","last_undegraded":"2023-07-20T10:08:26.534563+0000","last_fullsized":"2023-07-20T10:08:26.534563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:42:34.827824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538484+0000","last_change":"2023-07-20T10:08:25.092926+0000","last_active":"2023-07-20T10:08:26.538484+0000","last_peered":"2023-07-20T10:08:26.538484+0000","last_clean":"2023-07-20T10:08:26.538484+0000","last_became_active":"2023-07-20T10:08:25.092667+0000","last_became_peered":"2023-07-20T10:08:25.092667+0000","last_unstale":"2023-07-20T10:08:26.538484+0000","last_undegraded":"2023-07-20T10:08:26.538484+0000","last_fullsized":"2023-07-20T10:08:26.538484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:12:57.820581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539192+0000","last_change":"2023-07-20T10:08:25.096716+0000","last_active":"2023-07-20T10:08:26.539192+0000","last_peered":"2023-07-20T10:08:26.539192+0000","last_clean":"2023-07-20T10:08:26.539192+0000","last_became_active":"2023-07-20T10:08:25.096383+0000","last_became_peered":"2023-07-20T10:08:25.096383+0000","last_unstale":"2023-07-20T10:08:26.539192+0000","last_undegraded":"2023-07-20T10:08:26.539192+0000","last_fullsized":"2023-07-20T10:08:26.539192+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:02:25.015691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537901+0000","last_change":"2023-07-20T10:08:25.086246+0000","last_active":"2023-07-20T10:08:26.537901+0000","last_peered":"2023-07-20T10:08:26.537901+0000","last_clean":"2023-07-20T10:08:26.537901+0000","last_became_active":"2023-07-20T10:08:25.085921+0000","last_became_peered":"2023-07-20T10:08:25.085921+0000","last_unstale":"2023-07-20T10:08:26.537901+0000","last_undegraded":"2023-07-20T10:08:26.537901+0000","last_fullsized":"2023-07-20T10:08:26.537901+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:49.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535259+0000","last_change":"2023-07-20T10:08:25.088511+0000","last_active":"2023-07-20T10:08:26.535259+0000","last_peered":"2023-07-20T10:08:26.535259+0000","last_clean":"2023-07-20T10:08:26.535259+0000","last_became_active":"2023-07-20T10:08:25.086352+0000","last_became_peered":"2023-07-20T10:08:25.086352+0000","last_unstale":"2023-07-20T10:08:26.535259+0000","last_undegraded":"2023-07-20T10:08:26.535259+0000","last_fullsized":"2023-07-20T10:08:26.535259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:12.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539139+0000","last_change":"2023-07-20T10:08:25.088633+0000","last_active":"2023-07-20T10:08:26.539139+0000","last_peered":"2023-07-20T10:08:26.539139+0000","last_clean":"2023-07-20T10:08:26.539139+0000","last_became_active":"2023-07-20T10:08:25.088252+0000","last_became_peered":"2023-07-20T10:08:25.088252+0000","last_unstale":"2023-07-20T10:08:26.539139+0000","last_undegraded":"2023-07-20T10:08:26.539139+0000","last_fullsized":"2023-07-20T10:08:26.539139+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:19.214011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535309+0000","last_change":"2023-07-20T10:08:25.096677+0000","last_active":"2023-07-20T10:08:26.535309+0000","last_peered":"2023-07-20T10:08:26.535309+0000","last_clean":"2023-07-20T10:08:26.535309+0000","last_became_active":"2023-07-20T10:08:25.095478+0000","last_became_peered":"2023-07-20T10:08:25.095478+0000","last_unstale":"2023-07-20T10:08:26.535309+0000","last_undegraded":"2023-07-20T10:08:26.535309+0000","last_fullsized":"2023-07-20T10:08:26.535309+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:24:21.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538845+0000","last_change":"2023-07-20T10:08:25.081282+0000","last_active":"2023-07-20T10:08:26.538845+0000","last_peered":"2023-07-20T10:08:26.538845+0000","last_clean":"2023-07-20T10:08:26.538845+0000","last_became_active":"2023-07-20T10:08:25.080957+0000","last_became_peered":"2023-07-20T10:08:25.080957+0000","last_unstale":"2023-07-20T10:08:26.538845+0000","last_undegraded":"2023-07-20T10:08:26.538845+0000","last_fullsized":"2023-07-20T10:08:26.538845+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:46.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082709+0000","last_change":"2023-07-20T10:08:25.081233+0000","last_active":"2023-07-20T10:08:26.082709+0000","last_peered":"2023-07-20T10:08:26.082709+0000","last_clean":"2023-07-20T10:08:26.082709+0000","last_became_active":"2023-07-20T10:08:25.080833+0000","last_became_peered":"2023-07-20T10:08:25.080833+0000","last_unstale":"2023-07-20T10:08:26.082709+0000","last_undegraded":"2023-07-20T10:08:26.082709+0000","last_fullsized":"2023-07-20T10:08:26.082709+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:15.098899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084143+0000","last_change":"2023-07-20T10:08:25.098301+0000","last_active":"2023-07-20T10:08:26.084143+0000","last_peered":"2023-07-20T10:08:26.084143+0000","last_clean":"2023-07-20T10:08:26.084143+0000","last_became_active":"2023-07-20T10:08:25.098032+0000","last_became_peered":"2023-07-20T10:08:25.098032+0000","last_unstale":"2023-07-20T10:08:26.084143+0000","last_undegraded":"2023-07-20T10:08:26.084143+0000","last_fullsized":"2023-07-20T10:08:26.084143+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:10.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534907+0000","last_change":"2023-07-20T10:08:25.084031+0000","last_active":"2023-07-20T10:08:26.534907+0000","last_peered":"2023-07-20T10:08:26.534907+0000","last_clean":"2023-07-20T10:08:26.534907+0000","last_became_active":"2023-07-20T10:08:25.083719+0000","last_became_peered":"2023-07-20T10:08:25.083719+0000","last_unstale":"2023-07-20T10:08:26.534907+0000","last_undegraded":"2023-07-20T10:08:26.534907+0000","last_fullsized":"2023-07-20T10:08:26.534907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.419849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083722+0000","last_change":"2023-07-20T10:08:25.090791+0000","last_active":"2023-07-20T10:08:26.083722+0000","last_peered":"2023-07-20T10:08:26.083722+0000","last_clean":"2023-07-20T10:08:26.083722+0000","last_became_active":"2023-07-20T10:08:25.090506+0000","last_became_peered":"2023-07-20T10:08:25.090506+0000","last_unstale":"2023-07-20T10:08:26.083722+0000","last_undegraded":"2023-07-20T10:08:26.083722+0000","last_fullsized":"2023-07-20T10:08:26.083722+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539270+0000","last_change":"2023-07-20T10:08:25.082506+0000","last_active":"2023-07-20T10:08:26.539270+0000","last_peered":"2023-07-20T10:08:26.539270+0000","last_clean":"2023-07-20T10:08:26.539270+0000","last_became_active":"2023-07-20T10:08:25.082230+0000","last_became_peered":"2023-07-20T10:08:25.082230+0000","last_unstale":"2023-07-20T10:08:26.539270+0000","last_undegraded":"2023-07-20T10:08:26.539270+0000","last_fullsized":"2023-07-20T10:08:26.539270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:23.510435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539655+0000","last_change":"2023-07-20T10:08:25.089490+0000","last_active":"2023-07-20T10:08:26.539655+0000","last_peered":"2023-07-20T10:08:26.539655+0000","last_clean":"2023-07-20T10:08:26.539655+0000","last_became_active":"2023-07-20T10:08:25.089205+0000","last_became_peered":"2023-07-20T10:08:25.089205+0000","last_unstale":"2023-07-20T10:08:26.539655+0000","last_undegraded":"2023-07-20T10:08:26.539655+0000","last_fullsized":"2023-07-20T10:08:26.539655+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087130+0000","last_change":"2023-07-20T10:08:25.094938+0000","last_active":"2023-07-20T10:08:26.087130+0000","last_peered":"2023-07-20T10:08:26.087130+0000","last_clean":"2023-07-20T10:08:26.087130+0000","last_became_active":"2023-07-20T10:08:25.094670+0000","last_became_peered":"2023-07-20T10:08:25.094670+0000","last_unstale":"2023-07-20T10:08:26.087130+0000","last_undegraded":"2023-07-20T10:08:26.087130+0000","last_fullsized":"2023-07-20T10:08:26.087130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:38.245539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538585+0000","last_change":"2023-07-20T10:08:25.101741+0000","last_active":"2023-07-20T10:08:26.538585+0000","last_peered":"2023-07-20T10:08:26.538585+0000","last_clean":"2023-07-20T10:08:26.538585+0000","last_became_active":"2023-07-20T10:08:25.101467+0000","last_became_peered":"2023-07-20T10:08:25.101467+0000","last_unstale":"2023-07-20T10:08:26.538585+0000","last_undegraded":"2023-07-20T10:08:26.538585+0000","last_fullsized":"2023-07-20T10:08:26.538585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:37.030691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082734+0000","last_change":"2023-07-20T10:08:25.094492+0000","last_active":"2023-07-20T10:08:26.082734+0000","last_peered":"2023-07-20T10:08:26.082734+0000","last_clean":"2023-07-20T10:08:26.082734+0000","last_became_active":"2023-07-20T10:08:25.093652+0000","last_became_peered":"2023-07-20T10:08:25.093652+0000","last_unstale":"2023-07-20T10:08:26.082734+0000","last_undegraded":"2023-07-20T10:08:26.082734+0000","last_fullsized":"2023-07-20T10:08:26.082734+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:46.844014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538137+0000","last_change":"2023-07-20T10:08:25.083085+0000","last_active":"2023-07-20T10:08:26.538137+0000","last_peered":"2023-07-20T10:08:26.538137+0000","last_clean":"2023-07-20T10:08:26.538137+0000","last_became_active":"2023-07-20T10:08:25.082726+0000","last_became_peered":"2023-07-20T10:08:25.082726+0000","last_unstale":"2023-07-20T10:08:26.538137+0000","last_undegraded":"2023-07-20T10:08:26.538137+0000","last_fullsized":"2023-07-20T10:08:26.538137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:45.074650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538651+0000","last_change":"2023-07-20T10:08:25.095508+0000","last_active":"2023-07-20T10:08:26.538651+0000","last_peered":"2023-07-20T10:08:26.538651+0000","last_clean":"2023-07-20T10:08:26.538651+0000","last_became_active":"2023-07-20T10:08:25.095131+0000","last_became_peered":"2023-07-20T10:08:25.095131+0000","last_unstale":"2023-07-20T10:08:26.538651+0000","last_undegraded":"2023-07-20T10:08:26.538651+0000","last_fullsized":"2023-07-20T10:08:26.538651+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:48.329933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082340+0000","last_change":"2023-07-20T10:08:25.084554+0000","last_active":"2023-07-20T10:08:26.082340+0000","last_peered":"2023-07-20T10:08:26.082340+0000","last_clean":"2023-07-20T10:08:26.082340+0000","last_became_active":"2023-07-20T10:08:25.084057+0000","last_became_peered":"2023-07-20T10:08:25.084057+0000","last_unstale":"2023-07-20T10:08:26.082340+0000","last_undegraded":"2023-07-20T10:08:26.082340+0000","last_fullsized":"2023-07-20T10:08:26.082340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:13.131775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:25.089116+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:25.088727+0000","last_became_peered":"2023-07-20T10:08:25.088727+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:46:35.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"122'4","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:24.080708+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:24.080417+0000","last_became_peered":"2023-07-20T10:08:24.080417+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.481708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082376+0000","last_change":"2023-07-20T10:08:25.085456+0000","last_active":"2023-07-20T10:08:26.082376+0000","last_peered":"2023-07-20T10:08:26.082376+0000","last_clean":"2023-07-20T10:08:26.082376+0000","last_became_active":"2023-07-20T10:08:25.085147+0000","last_became_peered":"2023-07-20T10:08:25.085147+0000","last_unstale":"2023-07-20T10:08:26.082376+0000","last_undegraded":"2023-07-20T10:08:26.082376+0000","last_fullsized":"2023-07-20T10:08:26.082376+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:54.729481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082724+0000","last_change":"2023-07-20T10:08:24.076297+0000","last_active":"2023-07-20T10:08:26.082724+0000","last_peered":"2023-07-20T10:08:26.082724+0000","last_clean":"2023-07-20T10:08:26.082724+0000","last_became_active":"2023-07-20T10:08:24.075986+0000","last_became_peered":"2023-07-20T10:08:24.075986+0000","last_unstale":"2023-07-20T10:08:26.082724+0000","last_undegraded":"2023-07-20T10:08:26.082724+0000","last_fullsized":"2023-07-20T10:08:26.082724+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:04.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538280+0000","last_change":"2023-07-20T10:08:25.087181+0000","last_active":"2023-07-20T10:08:26.538280+0000","last_peered":"2023-07-20T10:08:26.538280+0000","last_clean":"2023-07-20T10:08:26.538280+0000","last_became_active":"2023-07-20T10:08:25.086275+0000","last_became_peered":"2023-07-20T10:08:25.086275+0000","last_unstale":"2023-07-20T10:08:26.538280+0000","last_undegraded":"2023-07-20T10:08:26.538280+0000","last_fullsized":"2023-07-20T10:08:26.538280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:48:30.735226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539133+0000","last_change":"2023-07-20T10:08:24.078102+0000","last_active":"2023-07-20T10:08:26.539133+0000","last_peered":"2023-07-20T10:08:26.539133+0000","last_clean":"2023-07-20T10:08:26.539133+0000","last_became_active":"2023-07-20T10:08:24.077784+0000","last_became_peered":"2023-07-20T10:08:24.077784+0000","last_unstale":"2023-07-20T10:08:26.539133+0000","last_undegraded":"2023-07-20T10:08:26.539133+0000","last_fullsized":"2023-07-20T10:08:26.539133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.568794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087005+0000","last_change":"2023-07-20T10:08:25.080768+0000","last_active":"2023-07-20T10:08:26.087005+0000","last_peered":"2023-07-20T10:08:26.087005+0000","last_clean":"2023-07-20T10:08:26.087005+0000","last_became_active":"2023-07-20T10:08:25.080358+0000","last_became_peered":"2023-07-20T10:08:25.080358+0000","last_unstale":"2023-07-20T10:08:26.087005+0000","last_undegraded":"2023-07-20T10:08:26.087005+0000","last_fullsized":"2023-07-20T10:08:26.087005+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:56:41.415357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084039+0000","last_change":"2023-07-20T10:08:24.074955+0000","last_active":"2023-07-20T10:08:26.084039+0000","last_peered":"2023-07-20T10:08:26.084039+0000","last_clean":"2023-07-20T10:08:26.084039+0000","last_became_active":"2023-07-20T10:08:24.074652+0000","last_became_peered":"2023-07-20T10:08:24.074652+0000","last_unstale":"2023-07-20T10:08:26.084039+0000","last_undegraded":"2023-07-20T10:08:26.084039+0000","last_fullsized":"2023-07-20T10:08:26.084039+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:34.196548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535144+0000","last_change":"2023-07-20T10:08:25.086465+0000","last_active":"2023-07-20T10:08:26.535144+0000","last_peered":"2023-07-20T10:08:26.535144+0000","last_clean":"2023-07-20T10:08:26.535144+0000","last_became_active":"2023-07-20T10:08:25.086127+0000","last_became_peered":"2023-07-20T10:08:25.086127+0000","last_unstale":"2023-07-20T10:08:26.535144+0000","last_undegraded":"2023-07-20T10:08:26.535144+0000","last_fullsized":"2023-07-20T10:08:26.535144+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:55:50.784530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538242+0000","last_change":"2023-07-20T10:08:24.084407+0000","last_active":"2023-07-20T10:08:26.538242+0000","last_peered":"2023-07-20T10:08:26.538242+0000","last_clean":"2023-07-20T10:08:26.538242+0000","last_became_active":"2023-07-20T10:08:24.084083+0000","last_became_peered":"2023-07-20T10:08:24.084083+0000","last_unstale":"2023-07-20T10:08:26.538242+0000","last_undegraded":"2023-07-20T10:08:26.538242+0000","last_fullsized":"2023-07-20T10:08:26.538242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:27:38.708920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535381+0000","last_change":"2023-07-20T10:08:25.096456+0000","last_active":"2023-07-20T10:08:26.535381+0000","last_peered":"2023-07-20T10:08:26.535381+0000","last_clean":"2023-07-20T10:08:26.535381+0000","last_became_active":"2023-07-20T10:08:25.095799+0000","last_became_peered":"2023-07-20T10:08:25.095799+0000","last_unstale":"2023-07-20T10:08:26.535381+0000","last_undegraded":"2023-07-20T10:08:26.535381+0000","last_fullsized":"2023-07-20T10:08:26.535381+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:16.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086528+0000","last_change":"2023-07-20T10:08:24.075528+0000","last_active":"2023-07-20T10:08:26.086528+0000","last_peered":"2023-07-20T10:08:26.086528+0000","last_clean":"2023-07-20T10:08:26.086528+0000","last_became_active":"2023-07-20T10:08:24.075247+0000","last_became_peered":"2023-07-20T10:08:24.075247+0000","last_unstale":"2023-07-20T10:08:26.086528+0000","last_undegraded":"2023-07-20T10:08:26.086528+0000","last_fullsized":"2023-07-20T10:08:26.086528+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:39:35.172438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539231+0000","last_change":"2023-07-20T10:08:25.101692+0000","last_active":"2023-07-20T10:08:26.539231+0000","last_peered":"2023-07-20T10:08:26.539231+0000","last_clean":"2023-07-20T10:08:26.539231+0000","last_became_active":"2023-07-20T10:08:25.101368+0000","last_became_peered":"2023-07-20T10:08:25.101368+0000","last_unstale":"2023-07-20T10:08:26.539231+0000","last_undegraded":"2023-07-20T10:08:26.539231+0000","last_fullsized":"2023-07-20T10:08:26.539231+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:24:10.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538967+0000","last_change":"2023-07-20T10:08:24.077869+0000","last_active":"2023-07-20T10:08:26.538967+0000","last_peered":"2023-07-20T10:08:26.538967+0000","last_clean":"2023-07-20T10:08:26.538967+0000","last_became_active":"2023-07-20T10:08:24.077569+0000","last_became_peered":"2023-07-20T10:08:24.077569+0000","last_unstale":"2023-07-20T10:08:26.538967+0000","last_undegraded":"2023-07-20T10:08:26.538967+0000","last_fullsized":"2023-07-20T10:08:26.538967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:00.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534969+0000","last_change":"2023-07-20T10:08:25.089629+0000","last_active":"2023-07-20T10:08:26.534969+0000","last_peered":"2023-07-20T10:08:26.534969+0000","last_clean":"2023-07-20T10:08:26.534969+0000","last_became_active":"2023-07-20T10:08:25.089168+0000","last_became_peered":"2023-07-20T10:08:25.089168+0000","last_unstale":"2023-07-20T10:08:26.534969+0000","last_undegraded":"2023-07-20T10:08:26.534969+0000","last_fullsized":"2023-07-20T10:08:26.534969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:40.537481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534370+0000","last_change":"2023-07-20T10:08:24.073102+0000","last_active":"2023-07-20T10:08:26.534370+0000","last_peered":"2023-07-20T10:08:26.534370+0000","last_clean":"2023-07-20T10:08:26.534370+0000","last_became_active":"2023-07-20T10:08:24.072813+0000","last_became_peered":"2023-07-20T10:08:24.072813+0000","last_unstale":"2023-07-20T10:08:26.534370+0000","last_undegraded":"2023-07-20T10:08:26.534370+0000","last_fullsized":"2023-07-20T10:08:26.534370+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534830+0000","last_change":"2023-07-20T10:08:25.089395+0000","last_active":"2023-07-20T10:08:26.534830+0000","last_peered":"2023-07-20T10:08:26.534830+0000","last_clean":"2023-07-20T10:08:26.534830+0000","last_became_active":"2023-07-20T10:08:25.089104+0000","last_became_peered":"2023-07-20T10:08:25.089104+0000","last_unstale":"2023-07-20T10:08:26.534830+0000","last_undegraded":"2023-07-20T10:08:26.534830+0000","last_fullsized":"2023-07-20T10:08:26.534830+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:09.528914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538965+0000","last_change":"2023-07-20T10:08:24.077971+0000","last_active":"2023-07-20T10:08:26.538965+0000","last_peered":"2023-07-20T10:08:26.538965+0000","last_clean":"2023-07-20T10:08:26.538965+0000","last_became_active":"2023-07-20T10:08:24.077681+0000","last_became_peered":"2023-07-20T10:08:24.077681+0000","last_unstale":"2023-07-20T10:08:26.538965+0000","last_undegraded":"2023-07-20T10:08:26.538965+0000","last_fullsized":"2023-07-20T10:08:26.538965+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:22.732475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083870+0000","last_change":"2023-07-20T10:08:25.086343+0000","last_active":"2023-07-20T10:08:26.083870+0000","last_peered":"2023-07-20T10:08:26.083870+0000","last_clean":"2023-07-20T10:08:26.083870+0000","last_became_active":"2023-07-20T10:08:25.086081+0000","last_became_peered":"2023-07-20T10:08:25.086081+0000","last_unstale":"2023-07-20T10:08:26.083870+0000","last_undegraded":"2023-07-20T10:08:26.083870+0000","last_fullsized":"2023-07-20T10:08:26.083870+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534791+0000","last_change":"2023-07-20T10:08:24.074758+0000","last_active":"2023-07-20T10:08:26.534791+0000","last_peered":"2023-07-20T10:08:26.534791+0000","last_clean":"2023-07-20T10:08:26.534791+0000","last_became_active":"2023-07-20T10:08:24.074158+0000","last_became_peered":"2023-07-20T10:08:24.074158+0000","last_unstale":"2023-07-20T10:08:26.534791+0000","last_undegraded":"2023-07-20T10:08:26.534791+0000","last_fullsized":"2023-07-20T10:08:26.534791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:27:10.619945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082522+0000","last_change":"2023-07-20T10:08:25.085660+0000","last_active":"2023-07-20T10:08:26.082522+0000","last_peered":"2023-07-20T10:08:26.082522+0000","last_clean":"2023-07-20T10:08:26.082522+0000","last_became_active":"2023-07-20T10:08:25.085364+0000","last_became_peered":"2023-07-20T10:08:25.085364+0000","last_unstale":"2023-07-20T10:08:26.082522+0000","last_undegraded":"2023-07-20T10:08:26.082522+0000","last_fullsized":"2023-07-20T10:08:26.082522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:36.318320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"122'3","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538497+0000","last_change":"2023-07-20T10:08:24.083329+0000","last_active":"2023-07-20T10:08:26.538497+0000","last_peered":"2023-07-20T10:08:26.538497+0000","last_clean":"2023-07-20T10:08:26.538497+0000","last_became_active":"2023-07-20T10:08:24.082973+0000","last_became_peered":"2023-07-20T10:08:24.082973+0000","last_unstale":"2023-07-20T10:08:26.538497+0000","last_undegraded":"2023-07-20T10:08:26.538497+0000","last_fullsized":"2023-07-20T10:08:26.538497+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:42.954255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084439+0000","last_change":"2023-07-20T10:08:25.086969+0000","last_active":"2023-07-20T10:08:26.084439+0000","last_peered":"2023-07-20T10:08:26.084439+0000","last_clean":"2023-07-20T10:08:26.084439+0000","last_became_active":"2023-07-20T10:08:25.086729+0000","last_became_peered":"2023-07-20T10:08:25.086729+0000","last_unstale":"2023-07-20T10:08:26.084439+0000","last_undegraded":"2023-07-20T10:08:26.084439+0000","last_fullsized":"2023-07-20T10:08:26.084439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:02:28.673617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"122'6","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538743+0000","last_change":"2023-07-20T10:08:24.080019+0000","last_active":"2023-07-20T10:08:26.538743+0000","last_peered":"2023-07-20T10:08:26.538743+0000","last_clean":"2023-07-20T10:08:26.538743+0000","last_became_active":"2023-07-20T10:08:24.079668+0000","last_became_peered":"2023-07-20T10:08:24.079668+0000","last_unstale":"2023-07-20T10:08:26.538743+0000","last_undegraded":"2023-07-20T10:08:26.538743+0000","last_fullsized":"2023-07-20T10:08:26.538743+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:06:28.749247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086973+0000","last_change":"2023-07-20T10:08:25.093705+0000","last_active":"2023-07-20T10:08:26.086973+0000","last_peered":"2023-07-20T10:08:26.086973+0000","last_clean":"2023-07-20T10:08:26.086973+0000","last_became_active":"2023-07-20T10:08:25.093407+0000","last_became_peered":"2023-07-20T10:08:25.093407+0000","last_unstale":"2023-07-20T10:08:26.086973+0000","last_undegraded":"2023-07-20T10:08:26.086973+0000","last_fullsized":"2023-07-20T10:08:26.086973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:49:22.431516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084448+0000","last_change":"2023-07-20T10:08:24.079405+0000","last_active":"2023-07-20T10:08:26.084448+0000","last_peered":"2023-07-20T10:08:26.084448+0000","last_clean":"2023-07-20T10:08:26.084448+0000","last_became_active":"2023-07-20T10:08:24.079112+0000","last_became_peered":"2023-07-20T10:08:24.079112+0000","last_unstale":"2023-07-20T10:08:26.084448+0000","last_undegraded":"2023-07-20T10:08:26.084448+0000","last_fullsized":"2023-07-20T10:08:26.084448+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:04.004519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.090341+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.089826+0000","last_became_peered":"2023-07-20T10:08:25.089826+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:54:35.201308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534687+0000","last_change":"2023-07-20T10:08:24.071808+0000","last_active":"2023-07-20T10:08:26.534687+0000","last_peered":"2023-07-20T10:08:26.534687+0000","last_clean":"2023-07-20T10:08:26.534687+0000","last_became_active":"2023-07-20T10:08:24.071549+0000","last_became_peered":"2023-07-20T10:08:24.071549+0000","last_unstale":"2023-07-20T10:08:26.534687+0000","last_undegraded":"2023-07-20T10:08:26.534687+0000","last_fullsized":"2023-07-20T10:08:26.534687+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:16.653765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082682+0000","last_change":"2023-07-20T10:08:25.082561+0000","last_active":"2023-07-20T10:08:26.082682+0000","last_peered":"2023-07-20T10:08:26.082682+0000","last_clean":"2023-07-20T10:08:26.082682+0000","last_became_active":"2023-07-20T10:08:25.082297+0000","last_became_peered":"2023-07-20T10:08:25.082297+0000","last_unstale":"2023-07-20T10:08:26.082682+0000","last_undegraded":"2023-07-20T10:08:26.082682+0000","last_fullsized":"2023-07-20T10:08:26.082682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:14.111684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082338+0000","last_change":"2023-07-20T10:08:24.074328+0000","last_active":"2023-07-20T10:08:26.082338+0000","last_peered":"2023-07-20T10:08:26.082338+0000","last_clean":"2023-07-20T10:08:26.082338+0000","last_became_active":"2023-07-20T10:08:24.074063+0000","last_became_peered":"2023-07-20T10:08:24.074063+0000","last_unstale":"2023-07-20T10:08:26.082338+0000","last_undegraded":"2023-07-20T10:08:26.082338+0000","last_fullsized":"2023-07-20T10:08:26.082338+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:24:21.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535339+0000","last_change":"2023-07-20T10:08:25.088276+0000","last_active":"2023-07-20T10:08:26.535339+0000","last_peered":"2023-07-20T10:08:26.535339+0000","last_clean":"2023-07-20T10:08:26.535339+0000","last_became_active":"2023-07-20T10:08:25.085953+0000","last_became_peered":"2023-07-20T10:08:25.085953+0000","last_unstale":"2023-07-20T10:08:26.535339+0000","last_undegraded":"2023-07-20T10:08:26.535339+0000","last_fullsized":"2023-07-20T10:08:26.535339+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"122'8","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538097+0000","last_change":"2023-07-20T10:08:24.078588+0000","last_active":"2023-07-20T10:08:26.538097+0000","last_peered":"2023-07-20T10:08:26.538097+0000","last_clean":"2023-07-20T10:08:26.538097+0000","last_became_active":"2023-07-20T10:08:24.078239+0000","last_became_peered":"2023-07-20T10:08:24.078239+0000","last_unstale":"2023-07-20T10:08:26.538097+0000","last_undegraded":"2023-07-20T10:08:26.538097+0000","last_fullsized":"2023-07-20T10:08:26.538097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534698+0000","last_change":"2023-07-20T10:08:25.085930+0000","last_active":"2023-07-20T10:08:26.534698+0000","last_peered":"2023-07-20T10:08:26.534698+0000","last_clean":"2023-07-20T10:08:26.534698+0000","last_became_active":"2023-07-20T10:08:25.085648+0000","last_became_peered":"2023-07-20T10:08:25.085648+0000","last_unstale":"2023-07-20T10:08:26.534698+0000","last_undegraded":"2023-07-20T10:08:26.534698+0000","last_fullsized":"2023-07-20T10:08:26.534698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:37:47.998853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083893+0000","last_change":"2023-07-20T10:08:24.079483+0000","last_active":"2023-07-20T10:08:26.083893+0000","last_peered":"2023-07-20T10:08:26.083893+0000","last_clean":"2023-07-20T10:08:26.083893+0000","last_became_active":"2023-07-20T10:08:24.079204+0000","last_became_peered":"2023-07-20T10:08:24.079204+0000","last_unstale":"2023-07-20T10:08:26.083893+0000","last_undegraded":"2023-07-20T10:08:26.083893+0000","last_fullsized":"2023-07-20T10:08:26.083893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:15.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538847+0000","last_change":"2023-07-20T10:08:25.085784+0000","last_active":"2023-07-20T10:08:26.538847+0000","last_peered":"2023-07-20T10:08:26.538847+0000","last_clean":"2023-07-20T10:08:26.538847+0000","last_became_active":"2023-07-20T10:08:25.085513+0000","last_became_peered":"2023-07-20T10:08:25.085513+0000","last_unstale":"2023-07-20T10:08:26.538847+0000","last_undegraded":"2023-07-20T10:08:26.538847+0000","last_fullsized":"2023-07-20T10:08:26.538847+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:09.648971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"123'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534948+0000","last_change":"2023-07-20T10:08:24.074944+0000","last_active":"2023-07-20T10:08:26.534948+0000","last_peered":"2023-07-20T10:08:26.534948+0000","last_clean":"2023-07-20T10:08:26.534948+0000","last_became_active":"2023-07-20T10:08:24.074497+0000","last_became_peered":"2023-07-20T10:08:24.074497+0000","last_unstale":"2023-07-20T10:08:26.534948+0000","last_undegraded":"2023-07-20T10:08:26.534948+0000","last_fullsized":"2023-07-20T10:08:26.534948+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:42.889551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534513+0000","last_change":"2023-07-20T10:08:25.088216+0000","last_active":"2023-07-20T10:08:26.534513+0000","last_peered":"2023-07-20T10:08:26.534513+0000","last_clean":"2023-07-20T10:08:26.534513+0000","last_became_active":"2023-07-20T10:08:25.087892+0000","last_became_peered":"2023-07-20T10:08:25.087892+0000","last_unstale":"2023-07-20T10:08:26.534513+0000","last_undegraded":"2023-07-20T10:08:26.534513+0000","last_fullsized":"2023-07-20T10:08:26.534513+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538788+0000","last_change":"2023-07-20T10:08:24.084219+0000","last_active":"2023-07-20T10:08:26.538788+0000","last_peered":"2023-07-20T10:08:26.538788+0000","last_clean":"2023-07-20T10:08:26.538788+0000","last_became_active":"2023-07-20T10:08:24.083944+0000","last_became_peered":"2023-07-20T10:08:24.083944+0000","last_unstale":"2023-07-20T10:08:26.538788+0000","last_undegraded":"2023-07-20T10:08:26.538788+0000","last_fullsized":"2023-07-20T10:08:26.538788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.502468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086706+0000","last_change":"2023-07-20T10:08:25.094537+0000","last_active":"2023-07-20T10:08:26.086706+0000","last_peered":"2023-07-20T10:08:26.086706+0000","last_clean":"2023-07-20T10:08:26.086706+0000","last_became_active":"2023-07-20T10:08:25.094223+0000","last_became_peered":"2023-07-20T10:08:25.094223+0000","last_unstale":"2023-07-20T10:08:26.086706+0000","last_undegraded":"2023-07-20T10:08:26.086706+0000","last_fullsized":"2023-07-20T10:08:26.086706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:52.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083891+0000","last_change":"2023-07-20T10:08:24.080323+0000","last_active":"2023-07-20T10:08:26.083891+0000","last_peered":"2023-07-20T10:08:26.083891+0000","last_clean":"2023-07-20T10:08:26.083891+0000","last_became_active":"2023-07-20T10:08:24.079747+0000","last_became_peered":"2023-07-20T10:08:24.079747+0000","last_unstale":"2023-07-20T10:08:26.083891+0000","last_undegraded":"2023-07-20T10:08:26.083891+0000","last_fullsized":"2023-07-20T10:08:26.083891+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:23:59.889428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082482+0000","last_change":"2023-07-20T10:08:25.094496+0000","last_active":"2023-07-20T10:08:26.082482+0000","last_peered":"2023-07-20T10:08:26.082482+0000","last_clean":"2023-07-20T10:08:26.082482+0000","last_became_active":"2023-07-20T10:08:25.094212+0000","last_became_peered":"2023-07-20T10:08:25.094212+0000","last_unstale":"2023-07-20T10:08:26.082482+0000","last_undegraded":"2023-07-20T10:08:26.082482+0000","last_fullsized":"2023-07-20T10:08:26.082482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:45.806454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539464+0000","last_change":"2023-07-20T10:08:24.075301+0000","last_active":"2023-07-20T10:08:26.539464+0000","last_peered":"2023-07-20T10:08:26.539464+0000","last_clean":"2023-07-20T10:08:26.539464+0000","last_became_active":"2023-07-20T10:08:24.075003+0000","last_became_peered":"2023-07-20T10:08:24.075003+0000","last_unstale":"2023-07-20T10:08:26.539464+0000","last_undegraded":"2023-07-20T10:08:26.539464+0000","last_fullsized":"2023-07-20T10:08:26.539464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082621+0000","last_change":"2023-07-20T10:08:25.086018+0000","last_active":"2023-07-20T10:08:26.082621+0000","last_peered":"2023-07-20T10:08:26.082621+0000","last_clean":"2023-07-20T10:08:26.082621+0000","last_became_active":"2023-07-20T10:08:25.085744+0000","last_became_peered":"2023-07-20T10:08:25.085744+0000","last_unstale":"2023-07-20T10:08:26.082621+0000","last_undegraded":"2023-07-20T10:08:26.082621+0000","last_fullsized":"2023-07-20T10:08:26.082621+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:32.968009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082595+0000","last_change":"2023-07-20T10:08:24.071090+0000","last_active":"2023-07-20T10:08:26.082595+0000","last_peered":"2023-07-20T10:08:26.082595+0000","last_clean":"2023-07-20T10:08:26.082595+0000","last_became_active":"2023-07-20T10:08:24.070806+0000","last_became_peered":"2023-07-20T10:08:24.070806+0000","last_unstale":"2023-07-20T10:08:26.082595+0000","last_undegraded":"2023-07-20T10:08:26.082595+0000","last_fullsized":"2023-07-20T10:08:26.082595+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:45:17.226186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538213+0000","last_change":"2023-07-20T10:08:25.096630+0000","last_active":"2023-07-20T10:08:26.538213+0000","last_peered":"2023-07-20T10:08:26.538213+0000","last_clean":"2023-07-20T10:08:26.538213+0000","last_became_active":"2023-07-20T10:08:25.096342+0000","last_became_peered":"2023-07-20T10:08:25.096342+0000","last_unstale":"2023-07-20T10:08:26.538213+0000","last_undegraded":"2023-07-20T10:08:26.538213+0000","last_fullsized":"2023-07-20T10:08:26.538213+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:33.401362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538900+0000","last_change":"2023-07-20T10:08:24.084619+0000","last_active":"2023-07-20T10:08:26.538900+0000","last_peered":"2023-07-20T10:08:26.538900+0000","last_clean":"2023-07-20T10:08:26.538900+0000","last_became_active":"2023-07-20T10:08:24.083543+0000","last_became_peered":"2023-07-20T10:08:24.083543+0000","last_unstale":"2023-07-20T10:08:26.538900+0000","last_undegraded":"2023-07-20T10:08:26.538900+0000","last_fullsized":"2023-07-20T10:08:26.538900+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:33.286678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087154+0000","last_change":"2023-07-20T10:08:25.094327+0000","last_active":"2023-07-20T10:08:26.087154+0000","last_peered":"2023-07-20T10:08:26.087154+0000","last_clean":"2023-07-20T10:08:26.087154+0000","last_became_active":"2023-07-20T10:08:25.093974+0000","last_became_peered":"2023-07-20T10:08:25.093974+0000","last_unstale":"2023-07-20T10:08:26.087154+0000","last_undegraded":"2023-07-20T10:08:26.087154+0000","last_fullsized":"2023-07-20T10:08:26.087154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:50.817306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082564+0000","last_change":"2023-07-20T10:08:24.073323+0000","last_active":"2023-07-20T10:08:26.082564+0000","last_peered":"2023-07-20T10:08:26.082564+0000","last_clean":"2023-07-20T10:08:26.082564+0000","last_became_active":"2023-07-20T10:08:24.072992+0000","last_became_peered":"2023-07-20T10:08:24.072992+0000","last_unstale":"2023-07-20T10:08:26.082564+0000","last_undegraded":"2023-07-20T10:08:26.082564+0000","last_fullsized":"2023-07-20T10:08:26.082564+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:38:45.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086884+0000","last_change":"2023-07-20T10:08:25.084756+0000","last_active":"2023-07-20T10:08:26.086884+0000","last_peered":"2023-07-20T10:08:26.086884+0000","last_clean":"2023-07-20T10:08:26.086884+0000","last_became_active":"2023-07-20T10:08:25.084370+0000","last_became_peered":"2023-07-20T10:08:25.084370+0000","last_unstale":"2023-07-20T10:08:26.086884+0000","last_undegraded":"2023-07-20T10:08:26.086884+0000","last_fullsized":"2023-07-20T10:08:26.086884+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:38.433026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082764+0000","last_change":"2023-07-20T10:08:24.071717+0000","last_active":"2023-07-20T10:08:26.082764+0000","last_peered":"2023-07-20T10:08:26.082764+0000","last_clean":"2023-07-20T10:08:26.082764+0000","last_became_active":"2023-07-20T10:08:24.071411+0000","last_became_peered":"2023-07-20T10:08:24.071411+0000","last_unstale":"2023-07-20T10:08:26.082764+0000","last_undegraded":"2023-07-20T10:08:26.082764+0000","last_fullsized":"2023-07-20T10:08:26.082764+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:04.521157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'205","reported_seq":666,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538088+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:08:26.538088+0000","last_peered":"2023-07-20T10:08:26.538088+0000","last_clean":"2023-07-20T10:08:26.538088+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:08:26.538088+0000","last_undegraded":"2023-07-20T10:08:26.538088+0000","last_fullsized":"2023-07-20T10:08:26.538088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:45.152092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086946+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:08:26.086946+0000","last_peered":"2023-07-20T10:08:26.086946+0000","last_clean":"2023-07-20T10:08:26.086946+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:08:26.086946+0000","last_undegraded":"2023-07-20T10:08:26.086946+0000","last_fullsized":"2023-07-20T10:08:26.086946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:10:51.943849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538446+0000","last_change":"2023-07-20T10:08:25.091219+0000","last_active":"2023-07-20T10:08:26.538446+0000","last_peered":"2023-07-20T10:08:26.538446+0000","last_clean":"2023-07-20T10:08:26.538446+0000","last_became_active":"2023-07-20T10:08:25.090943+0000","last_became_peered":"2023-07-20T10:08:25.090943+0000","last_unstale":"2023-07-20T10:08:26.538446+0000","last_undegraded":"2023-07-20T10:08:26.538446+0000","last_fullsized":"2023-07-20T10:08:26.538446+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:27:23.587967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538641+0000","last_change":"2023-07-20T10:08:24.087507+0000","last_active":"2023-07-20T10:08:26.538641+0000","last_peered":"2023-07-20T10:08:26.538641+0000","last_clean":"2023-07-20T10:08:26.538641+0000","last_became_active":"2023-07-20T10:08:24.087114+0000","last_became_peered":"2023-07-20T10:08:24.087114+0000","last_unstale":"2023-07-20T10:08:26.538641+0000","last_undegraded":"2023-07-20T10:08:26.538641+0000","last_fullsized":"2023-07-20T10:08:26.538641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:32.610312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537847+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:08:26.537847+0000","last_peered":"2023-07-20T10:08:26.537847+0000","last_clean":"2023-07-20T10:08:26.537847+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:08:26.537847+0000","last_undegraded":"2023-07-20T10:08:26.537847+0000","last_fullsized":"2023-07-20T10:08:26.537847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:11.970939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084346+0000","last_change":"2023-07-20T10:08:25.096821+0000","last_active":"2023-07-20T10:08:26.084346+0000","last_peered":"2023-07-20T10:08:26.084346+0000","last_clean":"2023-07-20T10:08:26.084346+0000","last_became_active":"2023-07-20T10:08:25.096524+0000","last_became_peered":"2023-07-20T10:08:25.096524+0000","last_unstale":"2023-07-20T10:08:26.084346+0000","last_undegraded":"2023-07-20T10:08:26.084346+0000","last_fullsized":"2023-07-20T10:08:26.084346+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:42:14.709711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086796+0000","last_change":"2023-07-20T10:08:24.080552+0000","last_active":"2023-07-20T10:08:26.086796+0000","last_peered":"2023-07-20T10:08:26.086796+0000","last_clean":"2023-07-20T10:08:26.086796+0000","last_became_active":"2023-07-20T10:08:24.080267+0000","last_became_peered":"2023-07-20T10:08:24.080267+0000","last_unstale":"2023-07-20T10:08:26.086796+0000","last_undegraded":"2023-07-20T10:08:26.086796+0000","last_fullsized":"2023-07-20T10:08:26.086796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:26.816286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082452+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:08:26.082452+0000","last_peered":"2023-07-20T10:08:26.082452+0000","last_clean":"2023-07-20T10:08:26.082452+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:08:26.082452+0000","last_undegraded":"2023-07-20T10:08:26.082452+0000","last_fullsized":"2023-07-20T10:08:26.082452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:38:24.438055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082480+0000","last_change":"2023-07-20T10:08:25.094884+0000","last_active":"2023-07-20T10:08:26.082480+0000","last_peered":"2023-07-20T10:08:26.082480+0000","last_clean":"2023-07-20T10:08:26.082480+0000","last_became_active":"2023-07-20T10:08:25.094564+0000","last_became_peered":"2023-07-20T10:08:25.094564+0000","last_unstale":"2023-07-20T10:08:26.082480+0000","last_undegraded":"2023-07-20T10:08:26.082480+0000","last_fullsized":"2023-07-20T10:08:26.082480+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:11:43.490249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539409+0000","last_change":"2023-07-20T10:08:24.077842+0000","last_active":"2023-07-20T10:08:26.539409+0000","last_peered":"2023-07-20T10:08:26.539409+0000","last_clean":"2023-07-20T10:08:26.539409+0000","last_became_active":"2023-07-20T10:08:24.077557+0000","last_became_peered":"2023-07-20T10:08:24.077557+0000","last_unstale":"2023-07-20T10:08:26.539409+0000","last_undegraded":"2023-07-20T10:08:26.539409+0000","last_fullsized":"2023-07-20T10:08:26.539409+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086789+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:08:26.086789+0000","last_peered":"2023-07-20T10:08:26.086789+0000","last_clean":"2023-07-20T10:08:26.086789+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:08:26.086789+0000","last_undegraded":"2023-07-20T10:08:26.086789+0000","last_fullsized":"2023-07-20T10:08:26.086789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:57:25.070233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534831+0000","last_change":"2023-07-20T10:08:25.089339+0000","last_active":"2023-07-20T10:08:26.534831+0000","last_peered":"2023-07-20T10:08:26.534831+0000","last_clean":"2023-07-20T10:08:26.534831+0000","last_became_active":"2023-07-20T10:08:25.087113+0000","last_became_peered":"2023-07-20T10:08:25.087113+0000","last_unstale":"2023-07-20T10:08:26.534831+0000","last_undegraded":"2023-07-20T10:08:26.534831+0000","last_fullsized":"2023-07-20T10:08:26.534831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:44:25.037278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538754+0000","last_change":"2023-07-20T10:08:24.084995+0000","last_active":"2023-07-20T10:08:26.538754+0000","last_peered":"2023-07-20T10:08:26.538754+0000","last_clean":"2023-07-20T10:08:26.538754+0000","last_became_active":"2023-07-20T10:08:24.084689+0000","last_became_peered":"2023-07-20T10:08:24.084689+0000","last_unstale":"2023-07-20T10:08:26.538754+0000","last_undegraded":"2023-07-20T10:08:26.538754+0000","last_fullsized":"2023-07-20T10:08:26.538754+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:35.867552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084034+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:08:26.084034+0000","last_peered":"2023-07-20T10:08:26.084034+0000","last_clean":"2023-07-20T10:08:26.084034+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:08:26.084034+0000","last_undegraded":"2023-07-20T10:08:26.084034+0000","last_fullsized":"2023-07-20T10:08:26.084034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:19.610923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082961+0000","last_change":"2023-07-20T10:08:25.094668+0000","last_active":"2023-07-20T10:08:26.082961+0000","last_peered":"2023-07-20T10:08:26.082961+0000","last_clean":"2023-07-20T10:08:26.082961+0000","last_became_active":"2023-07-20T10:08:25.086332+0000","last_became_peered":"2023-07-20T10:08:25.086332+0000","last_unstale":"2023-07-20T10:08:26.082961+0000","last_undegraded":"2023-07-20T10:08:26.082961+0000","last_fullsized":"2023-07-20T10:08:26.082961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:04:47.149375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082510+0000","last_change":"2023-07-20T10:08:24.071885+0000","last_active":"2023-07-20T10:08:26.082510+0000","last_peered":"2023-07-20T10:08:26.082510+0000","last_clean":"2023-07-20T10:08:26.082510+0000","last_became_active":"2023-07-20T10:08:24.071609+0000","last_became_peered":"2023-07-20T10:08:24.071609+0000","last_unstale":"2023-07-20T10:08:26.082510+0000","last_undegraded":"2023-07-20T10:08:26.082510+0000","last_fullsized":"2023-07-20T10:08:26.082510+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:13:03.009413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":197,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538752+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:08:26.538752+0000","last_peered":"2023-07-20T10:08:26.538752+0000","last_clean":"2023-07-20T10:08:26.538752+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:08:26.538752+0000","last_undegraded":"2023-07-20T10:08:26.538752+0000","last_fullsized":"2023-07-20T10:08:26.538752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:56.935188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535227+0000","last_change":"2023-07-20T10:08:25.089410+0000","last_active":"2023-07-20T10:08:26.535227+0000","last_peered":"2023-07-20T10:08:26.535227+0000","last_clean":"2023-07-20T10:08:26.535227+0000","last_became_active":"2023-07-20T10:08:25.089100+0000","last_became_peered":"2023-07-20T10:08:25.089100+0000","last_unstale":"2023-07-20T10:08:26.535227+0000","last_undegraded":"2023-07-20T10:08:26.535227+0000","last_fullsized":"2023-07-20T10:08:26.535227+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:13:07.242343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082796+0000","last_change":"2023-07-20T10:08:24.073395+0000","last_active":"2023-07-20T10:08:26.082796+0000","last_peered":"2023-07-20T10:08:26.082796+0000","last_clean":"2023-07-20T10:08:26.082796+0000","last_became_active":"2023-07-20T10:08:24.073129+0000","last_became_peered":"2023-07-20T10:08:24.073129+0000","last_unstale":"2023-07-20T10:08:26.082796+0000","last_undegraded":"2023-07-20T10:08:26.082796+0000","last_fullsized":"2023-07-20T10:08:26.082796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:22.490220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084163+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:08:26.084163+0000","last_peered":"2023-07-20T10:08:26.084163+0000","last_clean":"2023-07-20T10:08:26.084163+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:08:26.084163+0000","last_undegraded":"2023-07-20T10:08:26.084163+0000","last_fullsized":"2023-07-20T10:08:26.084163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:56.455614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535332+0000","last_change":"2023-07-20T10:08:25.088113+0000","last_active":"2023-07-20T10:08:26.535332+0000","last_peered":"2023-07-20T10:08:26.535332+0000","last_clean":"2023-07-20T10:08:26.535332+0000","last_became_active":"2023-07-20T10:08:25.087582+0000","last_became_peered":"2023-07-20T10:08:25.087582+0000","last_unstale":"2023-07-20T10:08:26.535332+0000","last_undegraded":"2023-07-20T10:08:26.535332+0000","last_fullsized":"2023-07-20T10:08:26.535332+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082341+0000","last_change":"2023-07-20T10:08:24.074895+0000","last_active":"2023-07-20T10:08:26.082341+0000","last_peered":"2023-07-20T10:08:26.082341+0000","last_clean":"2023-07-20T10:08:26.082341+0000","last_became_active":"2023-07-20T10:08:24.074605+0000","last_became_peered":"2023-07-20T10:08:24.074605+0000","last_unstale":"2023-07-20T10:08:26.082341+0000","last_undegraded":"2023-07-20T10:08:26.082341+0000","last_fullsized":"2023-07-20T10:08:26.082341+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:15.243950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":195,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539443+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:08:26.539443+0000","last_peered":"2023-07-20T10:08:26.539443+0000","last_clean":"2023-07-20T10:08:26.539443+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:08:26.539443+0000","last_undegraded":"2023-07-20T10:08:26.539443+0000","last_fullsized":"2023-07-20T10:08:26.539443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:20.082576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575064,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59432,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312408,"statfs":{"total":96636764160,"available":96575905792,"internally_reserved":0,"allocated":2121728,"data_stored":1354189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.153,"15min":1.153},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.95299999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.434,"15min":0.36899999999999999},"max":{"1min":0.89200000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.90900000000000003,"5min":1.05,"15min":1.075},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.716},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.433},"max":{"1min":0.96899999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":1.3759999999999999,"15min":1.758},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.8},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.875,"5min":0.995,"15min":0.999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0840000000000001,"15min":1.1220000000000001},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1540096,"data_stored":765829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.73799999999999999},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.90000000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.56000000000000005,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.53800000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.1259999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98899999999999999,"15min":1.103},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70999999999999996},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85799999999999998,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93000000000000005,"5min":1.1000000000000001,"15min":1.25},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71499999999999997,"15min":0.73499999999999999},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":1.272},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.98699999999999999,"15min":1.173},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":1.135,"15min":1.135},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93999999999999995,"5min":0.996,"15min":0.996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575064,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50652,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321188,"statfs":{"total":96636764160,"available":96584896512,"internally_reserved":0,"allocated":1519616,"data_stored":763661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.98699999999999999,"15min":1.0620000000000001},"last":1.052}]},{"osd":2,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.036},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":1.0269999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.034},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.28599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0089999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.95199999999999996,"15min":1.024},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90800000000000003,"5min":1.0209999999999999,"15min":1.0680000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":1.0049999999999999},"last":1.1699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575064,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1527808,"data_stored":763753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":1.085},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.141},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":0.98599999999999999,"15min":1.363},"last":0.62}]},{"osd":2,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.149,"15min":1.177},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.002,"5min":1.159,"15min":1.23},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.98899999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.196},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.034},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.85599999999999998,"15min":1.2649999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1523712,"data_stored":764243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.60199999999999998,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":1.002,"5min":1.083,"15min":1.1890000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.45900000000000002},"max":{"1min":0.98299999999999998,"5min":1.071,"15min":1.381},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":1.052,"15min":1.3260000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95499999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0129999999999999,"5min":1.04,"15min":1.131},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.4399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54748,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317092,"statfs":{"total":96636764160,"available":96580702208,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45600000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56200000000000006,"5min":0.68899999999999995,"15min":0.876},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.503},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.433}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0289999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.41899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.2689999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.63},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77900000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.53100000000000003,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.0680000000000001,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.069,"5min":1.218,"15min":1.3240000000000001},"last":0.753}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.024,"5min":1.143,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.095,"5min":1.204,"15min":1.393},"last":0.79400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44800000000000001,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.374},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67100000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":1.399,"15min":1.399},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":1.083,"15min":1.1779999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0309999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.77400000000000002},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.012,"5min":1.0389999999999999,"15min":1.107},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99299999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.755},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575064,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2129920,"data_stored":1355683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.247},"max":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":3.0710000000000002},"last":0.375},{"interface":"front","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":3.2509999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53400000000000003,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.79900000000000004},"min":{"1min":0.55400000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.232,"15min":1.6779999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.80900000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.216,"5min":1.216,"15min":3.125},"last":0.747}]},{"osd":5,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0649999999999999,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.1950000000000001,"15min":3.161},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.1739999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3009999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.3089999999999999,"15min":1.766},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:08:29.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:08:30.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 Processor -- start 2023-07-20T10:08:30.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 -- start start 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0afda0 0x7f1adc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1adc0b2060 0x7f1adc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0b06c0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc0b3160 con 0x7f1adc0b2060 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1ae0a6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc0b12a0 con 0x7f1adc0afda0 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1adad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1adc0b2060 0x7f1adc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1adad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1adc0b2060 0x7f1adc0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50446/0 (socket says 172.21.15.82:50446) 2023-07-20T10:08:30.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.138+0000 7f1adad9d640 1 -- 172.21.15.82:0/2934151866 learned_addr learned my addr 172.21.15.82:0/2934151866 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:30.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1adad9d640 1 -- 172.21.15.82:0/2934151866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0afda0 msgr2=0x7f1adc0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:30.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1adad9d640 1 --2- 172.21.15.82:0/2934151866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0afda0 0x7f1adc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1adad9d640 1 -- 172.21.15.82:0/2934151866 >> v1:172.21.15.183:6789/0 conn(0x7f1adc15a8e0 legacy=0x7f1adc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:30.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1adad9d640 1 -- 172.21.15.82:0/2934151866 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0b1580 con 0x7f1adc0b2060 2023-07-20T10:08:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1adad9d640 1 --2- 172.21.15.82:0/2934151866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc0b2060 0x7f1adc0b0180 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009e50 tx=0x7f1ad401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1622df03be33db84 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1ad9d9b640 1 -- 172.21.15.82:0/2934151866 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40a5700 con 0x7f1adc0b2060 2023-07-20T10:08:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1ad9d9b640 1 -- 172.21.15.82:0/2934151866 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad40a5860 con 0x7f1adc0b2060 2023-07-20T10:08:30.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1ad9d9b640 1 -- 172.21.15.82:0/2934151866 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40a5bf0 con 0x7f1adc0b2060 2023-07-20T10:08:30.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/2934151866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc0b2060 msgr2=0x7f1adc0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.142+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/2934151866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc0b2060 0x7f1adc0b0180 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009e50 tx=0x7f1ad401c880 comp rx=0 tx=0).stop 2023-07-20T10:08:30.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/2934151866 shutdown_connections 2023-07-20T10:08:30.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/2934151866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc0b2060 0x7f1adc0b0180 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/2934151866 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0afda0 0x7f1adc0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/2934151866 >> 172.21.15.82:0/2934151866 conn(0x7f1adc0cada0 msgr2=0x7f1adc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:30.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/2934151866 shutdown_connections 2023-07-20T10:08:30.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/2934151866 wait complete. 2023-07-20T10:08:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 Processor -- start 2023-07-20T10:08:30.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- start start 2023-07-20T10:08:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 0x7f1adc157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0b2060 0x7f1adc154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1526f0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1529d0 con 0x7f1adc0afda0 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ae0a6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc152cb0 con 0x7f1adc0b2060 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50452/0 (socket says 172.21.15.82:50452) 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 -- 172.21.15.82:0/1597745291 learned_addr learned my addr 172.21.15.82:0/1597745291 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:30.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ada59c640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 0x7f1adc157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ad1d9b640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0b2060 0x7f1adc154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 -- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0b2060 msgr2=0x7f1adc154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0b2060 0x7f1adc154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 -- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 msgr2=0x7f1adc157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 0x7f1adc157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1adad9d640 1 -- 172.21.15.82:0/1597745291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009b30 con 0x7f1adc15a8e0 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.146+0000 7f1ada59c640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 0x7f1adc157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1adad9d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40af040 tx=0x7f1ad4019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40b8670 con 0x7f1adc15a8e0 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad40b87d0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc152f90 con 0x7f1adc15a8e0 2023-07-20T10:08:30.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40b8b80 con 0x7f1adc15a8e0 2023-07-20T10:08:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc153790 con 0x7f1adc15a8e0 2023-07-20T10:08:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc073c70 con 0x7f1adc15a8e0 2023-07-20T10:08:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1ad40b8ce0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 0x7f1abc068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ad411f4f0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.150+0000 7f1ada59c640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 0x7f1abc068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.154+0000 7f1ada59c640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 0x7f1abc068890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1acc006fd0 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.154+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ad40ec8e0 con 0x7f1adc15a8e0 2023-07-20T10:08:30.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.350+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1adc0cb990 con 0x7f1adc15a8e0 2023-07-20T10:08:30.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ad37fe640 1 -- 172.21.15.82:0/1597745291 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1016 (secure 0 0 0) 0x7f1ad40eff00 con 0x7f1adc15a8e0 2023-07-20T10:08:30.329 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:30.329 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1109,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":123,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":344748032,"bytes_avail":772749365248,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":57,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8412}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-20T10:08:03.325016+0000","services":{}},"progress_events":{}} 2023-07-20T10:08:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 msgr2=0x7f1abc068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 0x7f1abc068890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1acc006fd0 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2023-07-20T10:08:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 msgr2=0x7f1adc159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40af040 tx=0x7f1ad4019620 comp rx=0 tx=0).stop 2023-07-20T10:08:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 shutdown_connections 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1adc15a8e0 0x7f1adc159940 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1adc0b2060 0x7f1adc154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f1abc0663d0 0x7f1abc068890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 --2- 172.21.15.82:0/1597745291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1adc0afda0 0x7f1adc157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 >> 172.21.15.82:0/1597745291 conn(0x7f1adc0cada0 msgr2=0x7f1adc0cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 shutdown_connections 2023-07-20T10:08:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.354+0000 7f1ae0a6d640 1 -- 172.21.15.82:0/1597745291 wait complete. 2023-07-20T10:08:30.350 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:08:30.350 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:08:30.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 Processor -- start 2023-07-20T10:08:30.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 -- start start 2023-07-20T10:08:30.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5db80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80b12a0 con 0x7f5db80afda0 2023-07-20T10:08:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80b1580 con 0x7f5db80b2060 2023-07-20T10:08:30.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5dbcc48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80b3160 con 0x7f5db815a8e0 2023-07-20T10:08:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5db80afda0 0x7f5db80b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50410/0 (socket says 172.21.15.82:50410) 2023-07-20T10:08:30.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db659c640 1 -- 172.21.15.82:0/1166606501 learned_addr learned my addr 172.21.15.82:0/1166606501 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db5d9b640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5db80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985140227 0 0) 0x7f5db80b12a0 con 0x7f5db80afda0 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da0003530 con 0x7f5db80afda0 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 488406701 0 0) 0x7f5da0003530 con 0x7f5db80afda0 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 msgr2=0x7f5db80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5db80ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 >> v1:172.21.15.183:6789/0 conn(0x7f5db80b2060 legacy=0x7f5db80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80b1860 con 0x7f5db80afda0 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f5da8001a00 con 0x7f5db80afda0 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 >> v1:172.21.15.82:6789/0 conn(0x7f5db80afda0 legacy=0x7f5db80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5da00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da0003f80 0x7f5da00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da0004d10 0x7f5da0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80b3160 con 0x7f5da0003f80 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da000bc20 con 0x7f5da0004d10 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da000bde0 con 0x7f5db815a8e0 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.514+0000 7f5db5d9b640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da0003f80 0x7f5da00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db659c640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5da00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db6d9d640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da0004d10 0x7f5da0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 -- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 msgr2=0x7f5da00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5db815a8e0 0x7f5da00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 -- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da0004d10 msgr2=0x7f5da0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da0004d10 0x7f5da0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 -- 172.21.15.82:0/1166606501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0003530 con 0x7f5da0003f80 2023-07-20T10:08:30.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db6d9d640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5da0004d10 0x7f5da0005170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db5d9b640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da0003f80 0x7f5da00047d0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009ae0 tx=0x7f5dac01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991d158d24720c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0a6510 con 0x7f5da0003f80 2023-07-20T10:08:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac0a6670 con 0x7f5da0003f80 2023-07-20T10:08:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.518+0000 7f5db559a640 1 -- 172.21.15.82:0/1166606501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0a6a20 con 0x7f5da0003f80 2023-07-20T10:08:30.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- 172.21.15.82:0/1166606501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da0003f80 msgr2=0x7f5da00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/1166606501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5da0003f80 0x7f5da00047d0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009ae0 tx=0x7f5dac01ca20 comp rx=0 tx=0).stop 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 -- 172.21.15.82:0/1166606501 reap_dead start 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- 172.21.15.82:0/1166606501 shutdown_connections 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- 172.21.15.82:0/1166606501 >> 172.21.15.82:0/1166606501 conn(0x7f5db80cada0 msgr2=0x7f5db80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- 172.21.15.82:0/1166606501 shutdown_connections 2023-07-20T10:08:30.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- 172.21.15.82:0/1166606501 wait complete. 2023-07-20T10:08:30.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 Processor -- start 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- start start 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0003f80 0x7f5db81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5db8154a90 0x7f5db8160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8154fc0 con 0x7f5db815df60 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81552a0 con 0x7f5db8154a90 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5dbcc48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db815c950 con 0x7f5da0003f80 2023-07-20T10:08:30.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50480/0 (socket says 172.21.15.82:50480) 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 -- 172.21.15.82:0/3284132617 learned_addr learned my addr 172.21.15.82:0/3284132617 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 -- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0003f80 msgr2=0x7f5db81538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0003f80 0x7f5db81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 -- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5db8154a90 msgr2=0x7f5db8160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5db8154a90 0x7f5db8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.522+0000 7f5db6d9d640 1 -- 172.21.15.82:0/3284132617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db815cc30 con 0x7f5db815df60 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5db6d9d640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5db80731b0 tx=0x7f5db000e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db00052e0 con 0x7f5db815df60 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0005460 con 0x7f5db815df60 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8153e20 con 0x7f5db815df60 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0003840 con 0x7f5db815df60 2023-07-20T10:08:30.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db8160c40 con 0x7f5db815df60 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db815c780 con 0x7f5db815df60 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5db00039a0 con 0x7f5db815df60 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 0x7f5d98068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5db00834d0 con 0x7f5db815df60 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5db659c640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 0x7f5d98068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:30.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.526+0000 7f5db659c640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 0x7f5d98068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5da8002240 tx=0x7f5da8001e70 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:30.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.530+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5db0050840 con 0x7f5db815df60 2023-07-20T10:08:30.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.674+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5db8073c70 con 0x7f5d980663d0 2023-07-20T10:08:30.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.682+0000 7f5da6ffd640 1 -- 172.21.15.82:0/3284132617 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311896 (secure 0 0 0) 0x7f5db8073c70 con 0x7f5d980663d0 2023-07-20T10:08:30.663 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:30.665 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:08:30.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 msgr2=0x7f5d98068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 0x7f5d98068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5da8002240 tx=0x7f5da8001e70 comp rx=0 tx=0).stop 2023-07-20T10:08:30.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 msgr2=0x7f5db806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5db80731b0 tx=0x7f5db000e760 comp rx=0 tx=0).stop 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 shutdown_connections 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db815df60 0x7f5db806fb20 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f5d980663d0 0x7f5d98068890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5db8154a90 0x7f5db8160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 --2- 172.21.15.82:0/3284132617 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5da0003f80 0x7f5db81538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 >> 172.21.15.82:0/3284132617 conn(0x7f5db80cada0 msgr2=0x7f5db80b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:30.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 shutdown_connections 2023-07-20T10:08:30.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:30.686+0000 7f5dbcc48640 1 -- 172.21.15.82:0/3284132617 wait complete. 2023-07-20T10:08:30.684 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:08:29.925863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":336668,"kb_used_data":13096,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754638052,"statfs":{"total":773094113280,"available":772749365248,"internally_reserved":0,"allocated":13410304,"data_stored":7294748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001223"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535200+0000","last_change":"2023-07-20T10:08:25.088567+0000","last_active":"2023-07-20T10:08:26.535200+0000","last_peered":"2023-07-20T10:08:26.535200+0000","last_clean":"2023-07-20T10:08:26.535200+0000","last_became_active":"2023-07-20T10:08:25.086795+0000","last_became_peered":"2023-07-20T10:08:25.086795+0000","last_unstale":"2023-07-20T10:08:26.535200+0000","last_undegraded":"2023-07-20T10:08:26.535200+0000","last_fullsized":"2023-07-20T10:08:26.535200+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:26:30.327277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539096+0000","last_change":"2023-07-20T10:08:25.095614+0000","last_active":"2023-07-20T10:08:26.539096+0000","last_peered":"2023-07-20T10:08:26.539096+0000","last_clean":"2023-07-20T10:08:26.539096+0000","last_became_active":"2023-07-20T10:08:25.095201+0000","last_became_peered":"2023-07-20T10:08:25.095201+0000","last_unstale":"2023-07-20T10:08:26.539096+0000","last_undegraded":"2023-07-20T10:08:26.539096+0000","last_fullsized":"2023-07-20T10:08:26.539096+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:58:26.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535181+0000","last_change":"2023-07-20T10:08:25.087856+0000","last_active":"2023-07-20T10:08:26.535181+0000","last_peered":"2023-07-20T10:08:26.535181+0000","last_clean":"2023-07-20T10:08:26.535181+0000","last_became_active":"2023-07-20T10:08:25.087280+0000","last_became_peered":"2023-07-20T10:08:25.087280+0000","last_unstale":"2023-07-20T10:08:26.535181+0000","last_undegraded":"2023-07-20T10:08:26.535181+0000","last_fullsized":"2023-07-20T10:08:26.535181+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:48.244239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535022+0000","last_change":"2023-07-20T10:08:25.080773+0000","last_active":"2023-07-20T10:08:26.535022+0000","last_peered":"2023-07-20T10:08:26.535022+0000","last_clean":"2023-07-20T10:08:26.535022+0000","last_became_active":"2023-07-20T10:08:25.080162+0000","last_became_peered":"2023-07-20T10:08:25.080162+0000","last_unstale":"2023-07-20T10:08:26.535022+0000","last_undegraded":"2023-07-20T10:08:26.535022+0000","last_fullsized":"2023-07-20T10:08:26.535022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:31.500117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084292+0000","last_change":"2023-07-20T10:08:25.092477+0000","last_active":"2023-07-20T10:08:26.084292+0000","last_peered":"2023-07-20T10:08:26.084292+0000","last_clean":"2023-07-20T10:08:26.084292+0000","last_became_active":"2023-07-20T10:08:25.092042+0000","last_became_peered":"2023-07-20T10:08:25.092042+0000","last_unstale":"2023-07-20T10:08:26.084292+0000","last_undegraded":"2023-07-20T10:08:26.084292+0000","last_fullsized":"2023-07-20T10:08:26.084292+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:53.494822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538287+0000","last_change":"2023-07-20T10:08:25.088631+0000","last_active":"2023-07-20T10:08:26.538287+0000","last_peered":"2023-07-20T10:08:26.538287+0000","last_clean":"2023-07-20T10:08:26.538287+0000","last_became_active":"2023-07-20T10:08:25.088256+0000","last_became_peered":"2023-07-20T10:08:25.088256+0000","last_unstale":"2023-07-20T10:08:26.538287+0000","last_undegraded":"2023-07-20T10:08:26.538287+0000","last_fullsized":"2023-07-20T10:08:26.538287+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:04.986072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538492+0000","last_change":"2023-07-20T10:08:25.096007+0000","last_active":"2023-07-20T10:08:26.538492+0000","last_peered":"2023-07-20T10:08:26.538492+0000","last_clean":"2023-07-20T10:08:26.538492+0000","last_became_active":"2023-07-20T10:08:25.095678+0000","last_became_peered":"2023-07-20T10:08:25.095678+0000","last_unstale":"2023-07-20T10:08:26.538492+0000","last_undegraded":"2023-07-20T10:08:26.538492+0000","last_fullsized":"2023-07-20T10:08:26.538492+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:58.298640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082424+0000","last_change":"2023-07-20T10:08:25.086880+0000","last_active":"2023-07-20T10:08:26.082424+0000","last_peered":"2023-07-20T10:08:26.082424+0000","last_clean":"2023-07-20T10:08:26.082424+0000","last_became_active":"2023-07-20T10:08:25.086606+0000","last_became_peered":"2023-07-20T10:08:25.086606+0000","last_unstale":"2023-07-20T10:08:26.082424+0000","last_undegraded":"2023-07-20T10:08:26.082424+0000","last_fullsized":"2023-07-20T10:08:26.082424+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:44.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.091329+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.090464+0000","last_became_peered":"2023-07-20T10:08:25.090464+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:06.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084092+0000","last_change":"2023-07-20T10:08:25.095723+0000","last_active":"2023-07-20T10:08:26.084092+0000","last_peered":"2023-07-20T10:08:26.084092+0000","last_clean":"2023-07-20T10:08:26.084092+0000","last_became_active":"2023-07-20T10:08:25.095452+0000","last_became_peered":"2023-07-20T10:08:25.095452+0000","last_unstale":"2023-07-20T10:08:26.084092+0000","last_undegraded":"2023-07-20T10:08:26.084092+0000","last_fullsized":"2023-07-20T10:08:26.084092+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:34.544206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086844+0000","last_change":"2023-07-20T10:08:25.089704+0000","last_active":"2023-07-20T10:08:26.086844+0000","last_peered":"2023-07-20T10:08:26.086844+0000","last_clean":"2023-07-20T10:08:26.086844+0000","last_became_active":"2023-07-20T10:08:25.089379+0000","last_became_peered":"2023-07-20T10:08:25.089379+0000","last_unstale":"2023-07-20T10:08:26.086844+0000","last_undegraded":"2023-07-20T10:08:26.086844+0000","last_fullsized":"2023-07-20T10:08:26.086844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:04:49.393132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538684+0000","last_change":"2023-07-20T10:08:25.088568+0000","last_active":"2023-07-20T10:08:26.538684+0000","last_peered":"2023-07-20T10:08:26.538684+0000","last_clean":"2023-07-20T10:08:26.538684+0000","last_became_active":"2023-07-20T10:08:25.088271+0000","last_became_peered":"2023-07-20T10:08:25.088271+0000","last_unstale":"2023-07-20T10:08:26.538684+0000","last_undegraded":"2023-07-20T10:08:26.538684+0000","last_fullsized":"2023-07-20T10:08:26.538684+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:17.709652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534563+0000","last_change":"2023-07-20T10:08:25.077985+0000","last_active":"2023-07-20T10:08:26.534563+0000","last_peered":"2023-07-20T10:08:26.534563+0000","last_clean":"2023-07-20T10:08:26.534563+0000","last_became_active":"2023-07-20T10:08:25.077668+0000","last_became_peered":"2023-07-20T10:08:25.077668+0000","last_unstale":"2023-07-20T10:08:26.534563+0000","last_undegraded":"2023-07-20T10:08:26.534563+0000","last_fullsized":"2023-07-20T10:08:26.534563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:42:34.827824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538484+0000","last_change":"2023-07-20T10:08:25.092926+0000","last_active":"2023-07-20T10:08:26.538484+0000","last_peered":"2023-07-20T10:08:26.538484+0000","last_clean":"2023-07-20T10:08:26.538484+0000","last_became_active":"2023-07-20T10:08:25.092667+0000","last_became_peered":"2023-07-20T10:08:25.092667+0000","last_unstale":"2023-07-20T10:08:26.538484+0000","last_undegraded":"2023-07-20T10:08:26.538484+0000","last_fullsized":"2023-07-20T10:08:26.538484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:12:57.820581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539192+0000","last_change":"2023-07-20T10:08:25.096716+0000","last_active":"2023-07-20T10:08:26.539192+0000","last_peered":"2023-07-20T10:08:26.539192+0000","last_clean":"2023-07-20T10:08:26.539192+0000","last_became_active":"2023-07-20T10:08:25.096383+0000","last_became_peered":"2023-07-20T10:08:25.096383+0000","last_unstale":"2023-07-20T10:08:26.539192+0000","last_undegraded":"2023-07-20T10:08:26.539192+0000","last_fullsized":"2023-07-20T10:08:26.539192+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:02:25.015691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537901+0000","last_change":"2023-07-20T10:08:25.086246+0000","last_active":"2023-07-20T10:08:26.537901+0000","last_peered":"2023-07-20T10:08:26.537901+0000","last_clean":"2023-07-20T10:08:26.537901+0000","last_became_active":"2023-07-20T10:08:25.085921+0000","last_became_peered":"2023-07-20T10:08:25.085921+0000","last_unstale":"2023-07-20T10:08:26.537901+0000","last_undegraded":"2023-07-20T10:08:26.537901+0000","last_fullsized":"2023-07-20T10:08:26.537901+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:49.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535259+0000","last_change":"2023-07-20T10:08:25.088511+0000","last_active":"2023-07-20T10:08:26.535259+0000","last_peered":"2023-07-20T10:08:26.535259+0000","last_clean":"2023-07-20T10:08:26.535259+0000","last_became_active":"2023-07-20T10:08:25.086352+0000","last_became_peered":"2023-07-20T10:08:25.086352+0000","last_unstale":"2023-07-20T10:08:26.535259+0000","last_undegraded":"2023-07-20T10:08:26.535259+0000","last_fullsized":"2023-07-20T10:08:26.535259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:12.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539139+0000","last_change":"2023-07-20T10:08:25.088633+0000","last_active":"2023-07-20T10:08:26.539139+0000","last_peered":"2023-07-20T10:08:26.539139+0000","last_clean":"2023-07-20T10:08:26.539139+0000","last_became_active":"2023-07-20T10:08:25.088252+0000","last_became_peered":"2023-07-20T10:08:25.088252+0000","last_unstale":"2023-07-20T10:08:26.539139+0000","last_undegraded":"2023-07-20T10:08:26.539139+0000","last_fullsized":"2023-07-20T10:08:26.539139+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:19.214011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535309+0000","last_change":"2023-07-20T10:08:25.096677+0000","last_active":"2023-07-20T10:08:26.535309+0000","last_peered":"2023-07-20T10:08:26.535309+0000","last_clean":"2023-07-20T10:08:26.535309+0000","last_became_active":"2023-07-20T10:08:25.095478+0000","last_became_peered":"2023-07-20T10:08:25.095478+0000","last_unstale":"2023-07-20T10:08:26.535309+0000","last_undegraded":"2023-07-20T10:08:26.535309+0000","last_fullsized":"2023-07-20T10:08:26.535309+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:24:21.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538845+0000","last_change":"2023-07-20T10:08:25.081282+0000","last_active":"2023-07-20T10:08:26.538845+0000","last_peered":"2023-07-20T10:08:26.538845+0000","last_clean":"2023-07-20T10:08:26.538845+0000","last_became_active":"2023-07-20T10:08:25.080957+0000","last_became_peered":"2023-07-20T10:08:25.080957+0000","last_unstale":"2023-07-20T10:08:26.538845+0000","last_undegraded":"2023-07-20T10:08:26.538845+0000","last_fullsized":"2023-07-20T10:08:26.538845+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:46.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082709+0000","last_change":"2023-07-20T10:08:25.081233+0000","last_active":"2023-07-20T10:08:26.082709+0000","last_peered":"2023-07-20T10:08:26.082709+0000","last_clean":"2023-07-20T10:08:26.082709+0000","last_became_active":"2023-07-20T10:08:25.080833+0000","last_became_peered":"2023-07-20T10:08:25.080833+0000","last_unstale":"2023-07-20T10:08:26.082709+0000","last_undegraded":"2023-07-20T10:08:26.082709+0000","last_fullsized":"2023-07-20T10:08:26.082709+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:15.098899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084143+0000","last_change":"2023-07-20T10:08:25.098301+0000","last_active":"2023-07-20T10:08:26.084143+0000","last_peered":"2023-07-20T10:08:26.084143+0000","last_clean":"2023-07-20T10:08:26.084143+0000","last_became_active":"2023-07-20T10:08:25.098032+0000","last_became_peered":"2023-07-20T10:08:25.098032+0000","last_unstale":"2023-07-20T10:08:26.084143+0000","last_undegraded":"2023-07-20T10:08:26.084143+0000","last_fullsized":"2023-07-20T10:08:26.084143+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:10.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534907+0000","last_change":"2023-07-20T10:08:25.084031+0000","last_active":"2023-07-20T10:08:26.534907+0000","last_peered":"2023-07-20T10:08:26.534907+0000","last_clean":"2023-07-20T10:08:26.534907+0000","last_became_active":"2023-07-20T10:08:25.083719+0000","last_became_peered":"2023-07-20T10:08:25.083719+0000","last_unstale":"2023-07-20T10:08:26.534907+0000","last_undegraded":"2023-07-20T10:08:26.534907+0000","last_fullsized":"2023-07-20T10:08:26.534907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.419849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083722+0000","last_change":"2023-07-20T10:08:25.090791+0000","last_active":"2023-07-20T10:08:26.083722+0000","last_peered":"2023-07-20T10:08:26.083722+0000","last_clean":"2023-07-20T10:08:26.083722+0000","last_became_active":"2023-07-20T10:08:25.090506+0000","last_became_peered":"2023-07-20T10:08:25.090506+0000","last_unstale":"2023-07-20T10:08:26.083722+0000","last_undegraded":"2023-07-20T10:08:26.083722+0000","last_fullsized":"2023-07-20T10:08:26.083722+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539270+0000","last_change":"2023-07-20T10:08:25.082506+0000","last_active":"2023-07-20T10:08:26.539270+0000","last_peered":"2023-07-20T10:08:26.539270+0000","last_clean":"2023-07-20T10:08:26.539270+0000","last_became_active":"2023-07-20T10:08:25.082230+0000","last_became_peered":"2023-07-20T10:08:25.082230+0000","last_unstale":"2023-07-20T10:08:26.539270+0000","last_undegraded":"2023-07-20T10:08:26.539270+0000","last_fullsized":"2023-07-20T10:08:26.539270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:23.510435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539655+0000","last_change":"2023-07-20T10:08:25.089490+0000","last_active":"2023-07-20T10:08:26.539655+0000","last_peered":"2023-07-20T10:08:26.539655+0000","last_clean":"2023-07-20T10:08:26.539655+0000","last_became_active":"2023-07-20T10:08:25.089205+0000","last_became_peered":"2023-07-20T10:08:25.089205+0000","last_unstale":"2023-07-20T10:08:26.539655+0000","last_undegraded":"2023-07-20T10:08:26.539655+0000","last_fullsized":"2023-07-20T10:08:26.539655+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087130+0000","last_change":"2023-07-20T10:08:25.094938+0000","last_active":"2023-07-20T10:08:26.087130+0000","last_peered":"2023-07-20T10:08:26.087130+0000","last_clean":"2023-07-20T10:08:26.087130+0000","last_became_active":"2023-07-20T10:08:25.094670+0000","last_became_peered":"2023-07-20T10:08:25.094670+0000","last_unstale":"2023-07-20T10:08:26.087130+0000","last_undegraded":"2023-07-20T10:08:26.087130+0000","last_fullsized":"2023-07-20T10:08:26.087130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:38.245539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538585+0000","last_change":"2023-07-20T10:08:25.101741+0000","last_active":"2023-07-20T10:08:26.538585+0000","last_peered":"2023-07-20T10:08:26.538585+0000","last_clean":"2023-07-20T10:08:26.538585+0000","last_became_active":"2023-07-20T10:08:25.101467+0000","last_became_peered":"2023-07-20T10:08:25.101467+0000","last_unstale":"2023-07-20T10:08:26.538585+0000","last_undegraded":"2023-07-20T10:08:26.538585+0000","last_fullsized":"2023-07-20T10:08:26.538585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:37.030691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082734+0000","last_change":"2023-07-20T10:08:25.094492+0000","last_active":"2023-07-20T10:08:26.082734+0000","last_peered":"2023-07-20T10:08:26.082734+0000","last_clean":"2023-07-20T10:08:26.082734+0000","last_became_active":"2023-07-20T10:08:25.093652+0000","last_became_peered":"2023-07-20T10:08:25.093652+0000","last_unstale":"2023-07-20T10:08:26.082734+0000","last_undegraded":"2023-07-20T10:08:26.082734+0000","last_fullsized":"2023-07-20T10:08:26.082734+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:46.844014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538137+0000","last_change":"2023-07-20T10:08:25.083085+0000","last_active":"2023-07-20T10:08:26.538137+0000","last_peered":"2023-07-20T10:08:26.538137+0000","last_clean":"2023-07-20T10:08:26.538137+0000","last_became_active":"2023-07-20T10:08:25.082726+0000","last_became_peered":"2023-07-20T10:08:25.082726+0000","last_unstale":"2023-07-20T10:08:26.538137+0000","last_undegraded":"2023-07-20T10:08:26.538137+0000","last_fullsized":"2023-07-20T10:08:26.538137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:45.074650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538651+0000","last_change":"2023-07-20T10:08:25.095508+0000","last_active":"2023-07-20T10:08:26.538651+0000","last_peered":"2023-07-20T10:08:26.538651+0000","last_clean":"2023-07-20T10:08:26.538651+0000","last_became_active":"2023-07-20T10:08:25.095131+0000","last_became_peered":"2023-07-20T10:08:25.095131+0000","last_unstale":"2023-07-20T10:08:26.538651+0000","last_undegraded":"2023-07-20T10:08:26.538651+0000","last_fullsized":"2023-07-20T10:08:26.538651+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:48.329933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082340+0000","last_change":"2023-07-20T10:08:25.084554+0000","last_active":"2023-07-20T10:08:26.082340+0000","last_peered":"2023-07-20T10:08:26.082340+0000","last_clean":"2023-07-20T10:08:26.082340+0000","last_became_active":"2023-07-20T10:08:25.084057+0000","last_became_peered":"2023-07-20T10:08:25.084057+0000","last_unstale":"2023-07-20T10:08:26.082340+0000","last_undegraded":"2023-07-20T10:08:26.082340+0000","last_fullsized":"2023-07-20T10:08:26.082340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:13.131775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:25.089116+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:25.088727+0000","last_became_peered":"2023-07-20T10:08:25.088727+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:46:35.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"122'4","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:24.080708+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:24.080417+0000","last_became_peered":"2023-07-20T10:08:24.080417+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.481708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082376+0000","last_change":"2023-07-20T10:08:25.085456+0000","last_active":"2023-07-20T10:08:26.082376+0000","last_peered":"2023-07-20T10:08:26.082376+0000","last_clean":"2023-07-20T10:08:26.082376+0000","last_became_active":"2023-07-20T10:08:25.085147+0000","last_became_peered":"2023-07-20T10:08:25.085147+0000","last_unstale":"2023-07-20T10:08:26.082376+0000","last_undegraded":"2023-07-20T10:08:26.082376+0000","last_fullsized":"2023-07-20T10:08:26.082376+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:54.729481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082724+0000","last_change":"2023-07-20T10:08:24.076297+0000","last_active":"2023-07-20T10:08:26.082724+0000","last_peered":"2023-07-20T10:08:26.082724+0000","last_clean":"2023-07-20T10:08:26.082724+0000","last_became_active":"2023-07-20T10:08:24.075986+0000","last_became_peered":"2023-07-20T10:08:24.075986+0000","last_unstale":"2023-07-20T10:08:26.082724+0000","last_undegraded":"2023-07-20T10:08:26.082724+0000","last_fullsized":"2023-07-20T10:08:26.082724+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:04.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538280+0000","last_change":"2023-07-20T10:08:25.087181+0000","last_active":"2023-07-20T10:08:26.538280+0000","last_peered":"2023-07-20T10:08:26.538280+0000","last_clean":"2023-07-20T10:08:26.538280+0000","last_became_active":"2023-07-20T10:08:25.086275+0000","last_became_peered":"2023-07-20T10:08:25.086275+0000","last_unstale":"2023-07-20T10:08:26.538280+0000","last_undegraded":"2023-07-20T10:08:26.538280+0000","last_fullsized":"2023-07-20T10:08:26.538280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:48:30.735226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539133+0000","last_change":"2023-07-20T10:08:24.078102+0000","last_active":"2023-07-20T10:08:26.539133+0000","last_peered":"2023-07-20T10:08:26.539133+0000","last_clean":"2023-07-20T10:08:26.539133+0000","last_became_active":"2023-07-20T10:08:24.077784+0000","last_became_peered":"2023-07-20T10:08:24.077784+0000","last_unstale":"2023-07-20T10:08:26.539133+0000","last_undegraded":"2023-07-20T10:08:26.539133+0000","last_fullsized":"2023-07-20T10:08:26.539133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.568794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087005+0000","last_change":"2023-07-20T10:08:25.080768+0000","last_active":"2023-07-20T10:08:26.087005+0000","last_peered":"2023-07-20T10:08:26.087005+0000","last_clean":"2023-07-20T10:08:26.087005+0000","last_became_active":"2023-07-20T10:08:25.080358+0000","last_became_peered":"2023-07-20T10:08:25.080358+0000","last_unstale":"2023-07-20T10:08:26.087005+0000","last_undegraded":"2023-07-20T10:08:26.087005+0000","last_fullsized":"2023-07-20T10:08:26.087005+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:56:41.415357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084039+0000","last_change":"2023-07-20T10:08:24.074955+0000","last_active":"2023-07-20T10:08:26.084039+0000","last_peered":"2023-07-20T10:08:26.084039+0000","last_clean":"2023-07-20T10:08:26.084039+0000","last_became_active":"2023-07-20T10:08:24.074652+0000","last_became_peered":"2023-07-20T10:08:24.074652+0000","last_unstale":"2023-07-20T10:08:26.084039+0000","last_undegraded":"2023-07-20T10:08:26.084039+0000","last_fullsized":"2023-07-20T10:08:26.084039+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:34.196548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535144+0000","last_change":"2023-07-20T10:08:25.086465+0000","last_active":"2023-07-20T10:08:26.535144+0000","last_peered":"2023-07-20T10:08:26.535144+0000","last_clean":"2023-07-20T10:08:26.535144+0000","last_became_active":"2023-07-20T10:08:25.086127+0000","last_became_peered":"2023-07-20T10:08:25.086127+0000","last_unstale":"2023-07-20T10:08:26.535144+0000","last_undegraded":"2023-07-20T10:08:26.535144+0000","last_fullsized":"2023-07-20T10:08:26.535144+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:55:50.784530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538242+0000","last_change":"2023-07-20T10:08:24.084407+0000","last_active":"2023-07-20T10:08:26.538242+0000","last_peered":"2023-07-20T10:08:26.538242+0000","last_clean":"2023-07-20T10:08:26.538242+0000","last_became_active":"2023-07-20T10:08:24.084083+0000","last_became_peered":"2023-07-20T10:08:24.084083+0000","last_unstale":"2023-07-20T10:08:26.538242+0000","last_undegraded":"2023-07-20T10:08:26.538242+0000","last_fullsized":"2023-07-20T10:08:26.538242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:27:38.708920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535381+0000","last_change":"2023-07-20T10:08:25.096456+0000","last_active":"2023-07-20T10:08:26.535381+0000","last_peered":"2023-07-20T10:08:26.535381+0000","last_clean":"2023-07-20T10:08:26.535381+0000","last_became_active":"2023-07-20T10:08:25.095799+0000","last_became_peered":"2023-07-20T10:08:25.095799+0000","last_unstale":"2023-07-20T10:08:26.535381+0000","last_undegraded":"2023-07-20T10:08:26.535381+0000","last_fullsized":"2023-07-20T10:08:26.535381+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:16.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086528+0000","last_change":"2023-07-20T10:08:24.075528+0000","last_active":"2023-07-20T10:08:26.086528+0000","last_peered":"2023-07-20T10:08:26.086528+0000","last_clean":"2023-07-20T10:08:26.086528+0000","last_became_active":"2023-07-20T10:08:24.075247+0000","last_became_peered":"2023-07-20T10:08:24.075247+0000","last_unstale":"2023-07-20T10:08:26.086528+0000","last_undegraded":"2023-07-20T10:08:26.086528+0000","last_fullsized":"2023-07-20T10:08:26.086528+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:39:35.172438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539231+0000","last_change":"2023-07-20T10:08:25.101692+0000","last_active":"2023-07-20T10:08:26.539231+0000","last_peered":"2023-07-20T10:08:26.539231+0000","last_clean":"2023-07-20T10:08:26.539231+0000","last_became_active":"2023-07-20T10:08:25.101368+0000","last_became_peered":"2023-07-20T10:08:25.101368+0000","last_unstale":"2023-07-20T10:08:26.539231+0000","last_undegraded":"2023-07-20T10:08:26.539231+0000","last_fullsized":"2023-07-20T10:08:26.539231+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:24:10.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538967+0000","last_change":"2023-07-20T10:08:24.077869+0000","last_active":"2023-07-20T10:08:26.538967+0000","last_peered":"2023-07-20T10:08:26.538967+0000","last_clean":"2023-07-20T10:08:26.538967+0000","last_became_active":"2023-07-20T10:08:24.077569+0000","last_became_peered":"2023-07-20T10:08:24.077569+0000","last_unstale":"2023-07-20T10:08:26.538967+0000","last_undegraded":"2023-07-20T10:08:26.538967+0000","last_fullsized":"2023-07-20T10:08:26.538967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:00.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534969+0000","last_change":"2023-07-20T10:08:25.089629+0000","last_active":"2023-07-20T10:08:26.534969+0000","last_peered":"2023-07-20T10:08:26.534969+0000","last_clean":"2023-07-20T10:08:26.534969+0000","last_became_active":"2023-07-20T10:08:25.089168+0000","last_became_peered":"2023-07-20T10:08:25.089168+0000","last_unstale":"2023-07-20T10:08:26.534969+0000","last_undegraded":"2023-07-20T10:08:26.534969+0000","last_fullsized":"2023-07-20T10:08:26.534969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:40.537481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534370+0000","last_change":"2023-07-20T10:08:24.073102+0000","last_active":"2023-07-20T10:08:26.534370+0000","last_peered":"2023-07-20T10:08:26.534370+0000","last_clean":"2023-07-20T10:08:26.534370+0000","last_became_active":"2023-07-20T10:08:24.072813+0000","last_became_peered":"2023-07-20T10:08:24.072813+0000","last_unstale":"2023-07-20T10:08:26.534370+0000","last_undegraded":"2023-07-20T10:08:26.534370+0000","last_fullsized":"2023-07-20T10:08:26.534370+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534830+0000","last_change":"2023-07-20T10:08:25.089395+0000","last_active":"2023-07-20T10:08:26.534830+0000","last_peered":"2023-07-20T10:08:26.534830+0000","last_clean":"2023-07-20T10:08:26.534830+0000","last_became_active":"2023-07-20T10:08:25.089104+0000","last_became_peered":"2023-07-20T10:08:25.089104+0000","last_unstale":"2023-07-20T10:08:26.534830+0000","last_undegraded":"2023-07-20T10:08:26.534830+0000","last_fullsized":"2023-07-20T10:08:26.534830+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:09.528914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538965+0000","last_change":"2023-07-20T10:08:24.077971+0000","last_active":"2023-07-20T10:08:26.538965+0000","last_peered":"2023-07-20T10:08:26.538965+0000","last_clean":"2023-07-20T10:08:26.538965+0000","last_became_active":"2023-07-20T10:08:24.077681+0000","last_became_peered":"2023-07-20T10:08:24.077681+0000","last_unstale":"2023-07-20T10:08:26.538965+0000","last_undegraded":"2023-07-20T10:08:26.538965+0000","last_fullsized":"2023-07-20T10:08:26.538965+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:22.732475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083870+0000","last_change":"2023-07-20T10:08:25.086343+0000","last_active":"2023-07-20T10:08:26.083870+0000","last_peered":"2023-07-20T10:08:26.083870+0000","last_clean":"2023-07-20T10:08:26.083870+0000","last_became_active":"2023-07-20T10:08:25.086081+0000","last_became_peered":"2023-07-20T10:08:25.086081+0000","last_unstale":"2023-07-20T10:08:26.083870+0000","last_undegraded":"2023-07-20T10:08:26.083870+0000","last_fullsized":"2023-07-20T10:08:26.083870+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534791+0000","last_change":"2023-07-20T10:08:24.074758+0000","last_active":"2023-07-20T10:08:26.534791+0000","last_peered":"2023-07-20T10:08:26.534791+0000","last_clean":"2023-07-20T10:08:26.534791+0000","last_became_active":"2023-07-20T10:08:24.074158+0000","last_became_peered":"2023-07-20T10:08:24.074158+0000","last_unstale":"2023-07-20T10:08:26.534791+0000","last_undegraded":"2023-07-20T10:08:26.534791+0000","last_fullsized":"2023-07-20T10:08:26.534791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:27:10.619945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082522+0000","last_change":"2023-07-20T10:08:25.085660+0000","last_active":"2023-07-20T10:08:26.082522+0000","last_peered":"2023-07-20T10:08:26.082522+0000","last_clean":"2023-07-20T10:08:26.082522+0000","last_became_active":"2023-07-20T10:08:25.085364+0000","last_became_peered":"2023-07-20T10:08:25.085364+0000","last_unstale":"2023-07-20T10:08:26.082522+0000","last_undegraded":"2023-07-20T10:08:26.082522+0000","last_fullsized":"2023-07-20T10:08:26.082522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:36.318320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"122'3","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538497+0000","last_change":"2023-07-20T10:08:24.083329+0000","last_active":"2023-07-20T10:08:26.538497+0000","last_peered":"2023-07-20T10:08:26.538497+0000","last_clean":"2023-07-20T10:08:26.538497+0000","last_became_active":"2023-07-20T10:08:24.082973+0000","last_became_peered":"2023-07-20T10:08:24.082973+0000","last_unstale":"2023-07-20T10:08:26.538497+0000","last_undegraded":"2023-07-20T10:08:26.538497+0000","last_fullsized":"2023-07-20T10:08:26.538497+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:42.954255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084439+0000","last_change":"2023-07-20T10:08:25.086969+0000","last_active":"2023-07-20T10:08:26.084439+0000","last_peered":"2023-07-20T10:08:26.084439+0000","last_clean":"2023-07-20T10:08:26.084439+0000","last_became_active":"2023-07-20T10:08:25.086729+0000","last_became_peered":"2023-07-20T10:08:25.086729+0000","last_unstale":"2023-07-20T10:08:26.084439+0000","last_undegraded":"2023-07-20T10:08:26.084439+0000","last_fullsized":"2023-07-20T10:08:26.084439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:02:28.673617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"122'6","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538743+0000","last_change":"2023-07-20T10:08:24.080019+0000","last_active":"2023-07-20T10:08:26.538743+0000","last_peered":"2023-07-20T10:08:26.538743+0000","last_clean":"2023-07-20T10:08:26.538743+0000","last_became_active":"2023-07-20T10:08:24.079668+0000","last_became_peered":"2023-07-20T10:08:24.079668+0000","last_unstale":"2023-07-20T10:08:26.538743+0000","last_undegraded":"2023-07-20T10:08:26.538743+0000","last_fullsized":"2023-07-20T10:08:26.538743+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:06:28.749247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086973+0000","last_change":"2023-07-20T10:08:25.093705+0000","last_active":"2023-07-20T10:08:26.086973+0000","last_peered":"2023-07-20T10:08:26.086973+0000","last_clean":"2023-07-20T10:08:26.086973+0000","last_became_active":"2023-07-20T10:08:25.093407+0000","last_became_peered":"2023-07-20T10:08:25.093407+0000","last_unstale":"2023-07-20T10:08:26.086973+0000","last_undegraded":"2023-07-20T10:08:26.086973+0000","last_fullsized":"2023-07-20T10:08:26.086973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:49:22.431516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084448+0000","last_change":"2023-07-20T10:08:24.079405+0000","last_active":"2023-07-20T10:08:26.084448+0000","last_peered":"2023-07-20T10:08:26.084448+0000","last_clean":"2023-07-20T10:08:26.084448+0000","last_became_active":"2023-07-20T10:08:24.079112+0000","last_became_peered":"2023-07-20T10:08:24.079112+0000","last_unstale":"2023-07-20T10:08:26.084448+0000","last_undegraded":"2023-07-20T10:08:26.084448+0000","last_fullsized":"2023-07-20T10:08:26.084448+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:04.004519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.090341+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.089826+0000","last_became_peered":"2023-07-20T10:08:25.089826+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:54:35.201308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534687+0000","last_change":"2023-07-20T10:08:24.071808+0000","last_active":"2023-07-20T10:08:26.534687+0000","last_peered":"2023-07-20T10:08:26.534687+0000","last_clean":"2023-07-20T10:08:26.534687+0000","last_became_active":"2023-07-20T10:08:24.071549+0000","last_became_peered":"2023-07-20T10:08:24.071549+0000","last_unstale":"2023-07-20T10:08:26.534687+0000","last_undegraded":"2023-07-20T10:08:26.534687+0000","last_fullsized":"2023-07-20T10:08:26.534687+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:16.653765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082682+0000","last_change":"2023-07-20T10:08:25.082561+0000","last_active":"2023-07-20T10:08:26.082682+0000","last_peered":"2023-07-20T10:08:26.082682+0000","last_clean":"2023-07-20T10:08:26.082682+0000","last_became_active":"2023-07-20T10:08:25.082297+0000","last_became_peered":"2023-07-20T10:08:25.082297+0000","last_unstale":"2023-07-20T10:08:26.082682+0000","last_undegraded":"2023-07-20T10:08:26.082682+0000","last_fullsized":"2023-07-20T10:08:26.082682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:14.111684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082338+0000","last_change":"2023-07-20T10:08:24.074328+0000","last_active":"2023-07-20T10:08:26.082338+0000","last_peered":"2023-07-20T10:08:26.082338+0000","last_clean":"2023-07-20T10:08:26.082338+0000","last_became_active":"2023-07-20T10:08:24.074063+0000","last_became_peered":"2023-07-20T10:08:24.074063+0000","last_unstale":"2023-07-20T10:08:26.082338+0000","last_undegraded":"2023-07-20T10:08:26.082338+0000","last_fullsized":"2023-07-20T10:08:26.082338+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:24:21.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535339+0000","last_change":"2023-07-20T10:08:25.088276+0000","last_active":"2023-07-20T10:08:26.535339+0000","last_peered":"2023-07-20T10:08:26.535339+0000","last_clean":"2023-07-20T10:08:26.535339+0000","last_became_active":"2023-07-20T10:08:25.085953+0000","last_became_peered":"2023-07-20T10:08:25.085953+0000","last_unstale":"2023-07-20T10:08:26.535339+0000","last_undegraded":"2023-07-20T10:08:26.535339+0000","last_fullsized":"2023-07-20T10:08:26.535339+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"122'8","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538097+0000","last_change":"2023-07-20T10:08:24.078588+0000","last_active":"2023-07-20T10:08:26.538097+0000","last_peered":"2023-07-20T10:08:26.538097+0000","last_clean":"2023-07-20T10:08:26.538097+0000","last_became_active":"2023-07-20T10:08:24.078239+0000","last_became_peered":"2023-07-20T10:08:24.078239+0000","last_unstale":"2023-07-20T10:08:26.538097+0000","last_undegraded":"2023-07-20T10:08:26.538097+0000","last_fullsized":"2023-07-20T10:08:26.538097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534698+0000","last_change":"2023-07-20T10:08:25.085930+0000","last_active":"2023-07-20T10:08:26.534698+0000","last_peered":"2023-07-20T10:08:26.534698+0000","last_clean":"2023-07-20T10:08:26.534698+0000","last_became_active":"2023-07-20T10:08:25.085648+0000","last_became_peered":"2023-07-20T10:08:25.085648+0000","last_unstale":"2023-07-20T10:08:26.534698+0000","last_undegraded":"2023-07-20T10:08:26.534698+0000","last_fullsized":"2023-07-20T10:08:26.534698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:37:47.998853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083893+0000","last_change":"2023-07-20T10:08:24.079483+0000","last_active":"2023-07-20T10:08:26.083893+0000","last_peered":"2023-07-20T10:08:26.083893+0000","last_clean":"2023-07-20T10:08:26.083893+0000","last_became_active":"2023-07-20T10:08:24.079204+0000","last_became_peered":"2023-07-20T10:08:24.079204+0000","last_unstale":"2023-07-20T10:08:26.083893+0000","last_undegraded":"2023-07-20T10:08:26.083893+0000","last_fullsized":"2023-07-20T10:08:26.083893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:15.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538847+0000","last_change":"2023-07-20T10:08:25.085784+0000","last_active":"2023-07-20T10:08:26.538847+0000","last_peered":"2023-07-20T10:08:26.538847+0000","last_clean":"2023-07-20T10:08:26.538847+0000","last_became_active":"2023-07-20T10:08:25.085513+0000","last_became_peered":"2023-07-20T10:08:25.085513+0000","last_unstale":"2023-07-20T10:08:26.538847+0000","last_undegraded":"2023-07-20T10:08:26.538847+0000","last_fullsized":"2023-07-20T10:08:26.538847+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:09.648971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"123'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534948+0000","last_change":"2023-07-20T10:08:24.074944+0000","last_active":"2023-07-20T10:08:26.534948+0000","last_peered":"2023-07-20T10:08:26.534948+0000","last_clean":"2023-07-20T10:08:26.534948+0000","last_became_active":"2023-07-20T10:08:24.074497+0000","last_became_peered":"2023-07-20T10:08:24.074497+0000","last_unstale":"2023-07-20T10:08:26.534948+0000","last_undegraded":"2023-07-20T10:08:26.534948+0000","last_fullsized":"2023-07-20T10:08:26.534948+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:42.889551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534513+0000","last_change":"2023-07-20T10:08:25.088216+0000","last_active":"2023-07-20T10:08:26.534513+0000","last_peered":"2023-07-20T10:08:26.534513+0000","last_clean":"2023-07-20T10:08:26.534513+0000","last_became_active":"2023-07-20T10:08:25.087892+0000","last_became_peered":"2023-07-20T10:08:25.087892+0000","last_unstale":"2023-07-20T10:08:26.534513+0000","last_undegraded":"2023-07-20T10:08:26.534513+0000","last_fullsized":"2023-07-20T10:08:26.534513+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538788+0000","last_change":"2023-07-20T10:08:24.084219+0000","last_active":"2023-07-20T10:08:26.538788+0000","last_peered":"2023-07-20T10:08:26.538788+0000","last_clean":"2023-07-20T10:08:26.538788+0000","last_became_active":"2023-07-20T10:08:24.083944+0000","last_became_peered":"2023-07-20T10:08:24.083944+0000","last_unstale":"2023-07-20T10:08:26.538788+0000","last_undegraded":"2023-07-20T10:08:26.538788+0000","last_fullsized":"2023-07-20T10:08:26.538788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.502468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086706+0000","last_change":"2023-07-20T10:08:25.094537+0000","last_active":"2023-07-20T10:08:26.086706+0000","last_peered":"2023-07-20T10:08:26.086706+0000","last_clean":"2023-07-20T10:08:26.086706+0000","last_became_active":"2023-07-20T10:08:25.094223+0000","last_became_peered":"2023-07-20T10:08:25.094223+0000","last_unstale":"2023-07-20T10:08:26.086706+0000","last_undegraded":"2023-07-20T10:08:26.086706+0000","last_fullsized":"2023-07-20T10:08:26.086706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:52.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083891+0000","last_change":"2023-07-20T10:08:24.080323+0000","last_active":"2023-07-20T10:08:26.083891+0000","last_peered":"2023-07-20T10:08:26.083891+0000","last_clean":"2023-07-20T10:08:26.083891+0000","last_became_active":"2023-07-20T10:08:24.079747+0000","last_became_peered":"2023-07-20T10:08:24.079747+0000","last_unstale":"2023-07-20T10:08:26.083891+0000","last_undegraded":"2023-07-20T10:08:26.083891+0000","last_fullsized":"2023-07-20T10:08:26.083891+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:23:59.889428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082482+0000","last_change":"2023-07-20T10:08:25.094496+0000","last_active":"2023-07-20T10:08:26.082482+0000","last_peered":"2023-07-20T10:08:26.082482+0000","last_clean":"2023-07-20T10:08:26.082482+0000","last_became_active":"2023-07-20T10:08:25.094212+0000","last_became_peered":"2023-07-20T10:08:25.094212+0000","last_unstale":"2023-07-20T10:08:26.082482+0000","last_undegraded":"2023-07-20T10:08:26.082482+0000","last_fullsized":"2023-07-20T10:08:26.082482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:45.806454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539464+0000","last_change":"2023-07-20T10:08:24.075301+0000","last_active":"2023-07-20T10:08:26.539464+0000","last_peered":"2023-07-20T10:08:26.539464+0000","last_clean":"2023-07-20T10:08:26.539464+0000","last_became_active":"2023-07-20T10:08:24.075003+0000","last_became_peered":"2023-07-20T10:08:24.075003+0000","last_unstale":"2023-07-20T10:08:26.539464+0000","last_undegraded":"2023-07-20T10:08:26.539464+0000","last_fullsized":"2023-07-20T10:08:26.539464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082621+0000","last_change":"2023-07-20T10:08:25.086018+0000","last_active":"2023-07-20T10:08:26.082621+0000","last_peered":"2023-07-20T10:08:26.082621+0000","last_clean":"2023-07-20T10:08:26.082621+0000","last_became_active":"2023-07-20T10:08:25.085744+0000","last_became_peered":"2023-07-20T10:08:25.085744+0000","last_unstale":"2023-07-20T10:08:26.082621+0000","last_undegraded":"2023-07-20T10:08:26.082621+0000","last_fullsized":"2023-07-20T10:08:26.082621+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:32.968009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082595+0000","last_change":"2023-07-20T10:08:24.071090+0000","last_active":"2023-07-20T10:08:26.082595+0000","last_peered":"2023-07-20T10:08:26.082595+0000","last_clean":"2023-07-20T10:08:26.082595+0000","last_became_active":"2023-07-20T10:08:24.070806+0000","last_became_peered":"2023-07-20T10:08:24.070806+0000","last_unstale":"2023-07-20T10:08:26.082595+0000","last_undegraded":"2023-07-20T10:08:26.082595+0000","last_fullsized":"2023-07-20T10:08:26.082595+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:45:17.226186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538213+0000","last_change":"2023-07-20T10:08:25.096630+0000","last_active":"2023-07-20T10:08:26.538213+0000","last_peered":"2023-07-20T10:08:26.538213+0000","last_clean":"2023-07-20T10:08:26.538213+0000","last_became_active":"2023-07-20T10:08:25.096342+0000","last_became_peered":"2023-07-20T10:08:25.096342+0000","last_unstale":"2023-07-20T10:08:26.538213+0000","last_undegraded":"2023-07-20T10:08:26.538213+0000","last_fullsized":"2023-07-20T10:08:26.538213+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:33.401362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538900+0000","last_change":"2023-07-20T10:08:24.084619+0000","last_active":"2023-07-20T10:08:26.538900+0000","last_peered":"2023-07-20T10:08:26.538900+0000","last_clean":"2023-07-20T10:08:26.538900+0000","last_became_active":"2023-07-20T10:08:24.083543+0000","last_became_peered":"2023-07-20T10:08:24.083543+0000","last_unstale":"2023-07-20T10:08:26.538900+0000","last_undegraded":"2023-07-20T10:08:26.538900+0000","last_fullsized":"2023-07-20T10:08:26.538900+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:33.286678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087154+0000","last_change":"2023-07-20T10:08:25.094327+0000","last_active":"2023-07-20T10:08:26.087154+0000","last_peered":"2023-07-20T10:08:26.087154+0000","last_clean":"2023-07-20T10:08:26.087154+0000","last_became_active":"2023-07-20T10:08:25.093974+0000","last_became_peered":"2023-07-20T10:08:25.093974+0000","last_unstale":"2023-07-20T10:08:26.087154+0000","last_undegraded":"2023-07-20T10:08:26.087154+0000","last_fullsized":"2023-07-20T10:08:26.087154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:50.817306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082564+0000","last_change":"2023-07-20T10:08:24.073323+0000","last_active":"2023-07-20T10:08:26.082564+0000","last_peered":"2023-07-20T10:08:26.082564+0000","last_clean":"2023-07-20T10:08:26.082564+0000","last_became_active":"2023-07-20T10:08:24.072992+0000","last_became_peered":"2023-07-20T10:08:24.072992+0000","last_unstale":"2023-07-20T10:08:26.082564+0000","last_undegraded":"2023-07-20T10:08:26.082564+0000","last_fullsized":"2023-07-20T10:08:26.082564+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:38:45.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086884+0000","last_change":"2023-07-20T10:08:25.084756+0000","last_active":"2023-07-20T10:08:26.086884+0000","last_peered":"2023-07-20T10:08:26.086884+0000","last_clean":"2023-07-20T10:08:26.086884+0000","last_became_active":"2023-07-20T10:08:25.084370+0000","last_became_peered":"2023-07-20T10:08:25.084370+0000","last_unstale":"2023-07-20T10:08:26.086884+0000","last_undegraded":"2023-07-20T10:08:26.086884+0000","last_fullsized":"2023-07-20T10:08:26.086884+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:38.433026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082764+0000","last_change":"2023-07-20T10:08:24.071717+0000","last_active":"2023-07-20T10:08:26.082764+0000","last_peered":"2023-07-20T10:08:26.082764+0000","last_clean":"2023-07-20T10:08:26.082764+0000","last_became_active":"2023-07-20T10:08:24.071411+0000","last_became_peered":"2023-07-20T10:08:24.071411+0000","last_unstale":"2023-07-20T10:08:26.082764+0000","last_undegraded":"2023-07-20T10:08:26.082764+0000","last_fullsized":"2023-07-20T10:08:26.082764+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:04.521157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'205","reported_seq":666,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538088+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:08:26.538088+0000","last_peered":"2023-07-20T10:08:26.538088+0000","last_clean":"2023-07-20T10:08:26.538088+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:08:26.538088+0000","last_undegraded":"2023-07-20T10:08:26.538088+0000","last_fullsized":"2023-07-20T10:08:26.538088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:45.152092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086946+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:08:26.086946+0000","last_peered":"2023-07-20T10:08:26.086946+0000","last_clean":"2023-07-20T10:08:26.086946+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:08:26.086946+0000","last_undegraded":"2023-07-20T10:08:26.086946+0000","last_fullsized":"2023-07-20T10:08:26.086946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:10:51.943849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538446+0000","last_change":"2023-07-20T10:08:25.091219+0000","last_active":"2023-07-20T10:08:26.538446+0000","last_peered":"2023-07-20T10:08:26.538446+0000","last_clean":"2023-07-20T10:08:26.538446+0000","last_became_active":"2023-07-20T10:08:25.090943+0000","last_became_peered":"2023-07-20T10:08:25.090943+0000","last_unstale":"2023-07-20T10:08:26.538446+0000","last_undegraded":"2023-07-20T10:08:26.538446+0000","last_fullsized":"2023-07-20T10:08:26.538446+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:27:23.587967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538641+0000","last_change":"2023-07-20T10:08:24.087507+0000","last_active":"2023-07-20T10:08:26.538641+0000","last_peered":"2023-07-20T10:08:26.538641+0000","last_clean":"2023-07-20T10:08:26.538641+0000","last_became_active":"2023-07-20T10:08:24.087114+0000","last_became_peered":"2023-07-20T10:08:24.087114+0000","last_unstale":"2023-07-20T10:08:26.538641+0000","last_undegraded":"2023-07-20T10:08:26.538641+0000","last_fullsized":"2023-07-20T10:08:26.538641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:32.610312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":197,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537847+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:08:26.537847+0000","last_peered":"2023-07-20T10:08:26.537847+0000","last_clean":"2023-07-20T10:08:26.537847+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:08:26.537847+0000","last_undegraded":"2023-07-20T10:08:26.537847+0000","last_fullsized":"2023-07-20T10:08:26.537847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:11.970939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084346+0000","last_change":"2023-07-20T10:08:25.096821+0000","last_active":"2023-07-20T10:08:26.084346+0000","last_peered":"2023-07-20T10:08:26.084346+0000","last_clean":"2023-07-20T10:08:26.084346+0000","last_became_active":"2023-07-20T10:08:25.096524+0000","last_became_peered":"2023-07-20T10:08:25.096524+0000","last_unstale":"2023-07-20T10:08:26.084346+0000","last_undegraded":"2023-07-20T10:08:26.084346+0000","last_fullsized":"2023-07-20T10:08:26.084346+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:42:14.709711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086796+0000","last_change":"2023-07-20T10:08:24.080552+0000","last_active":"2023-07-20T10:08:26.086796+0000","last_peered":"2023-07-20T10:08:26.086796+0000","last_clean":"2023-07-20T10:08:26.086796+0000","last_became_active":"2023-07-20T10:08:24.080267+0000","last_became_peered":"2023-07-20T10:08:24.080267+0000","last_unstale":"2023-07-20T10:08:26.086796+0000","last_undegraded":"2023-07-20T10:08:26.086796+0000","last_fullsized":"2023-07-20T10:08:26.086796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:26.816286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082452+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:08:26.082452+0000","last_peered":"2023-07-20T10:08:26.082452+0000","last_clean":"2023-07-20T10:08:26.082452+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:08:26.082452+0000","last_undegraded":"2023-07-20T10:08:26.082452+0000","last_fullsized":"2023-07-20T10:08:26.082452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:38:24.438055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082480+0000","last_change":"2023-07-20T10:08:25.094884+0000","last_active":"2023-07-20T10:08:26.082480+0000","last_peered":"2023-07-20T10:08:26.082480+0000","last_clean":"2023-07-20T10:08:26.082480+0000","last_became_active":"2023-07-20T10:08:25.094564+0000","last_became_peered":"2023-07-20T10:08:25.094564+0000","last_unstale":"2023-07-20T10:08:26.082480+0000","last_undegraded":"2023-07-20T10:08:26.082480+0000","last_fullsized":"2023-07-20T10:08:26.082480+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:11:43.490249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539409+0000","last_change":"2023-07-20T10:08:24.077842+0000","last_active":"2023-07-20T10:08:26.539409+0000","last_peered":"2023-07-20T10:08:26.539409+0000","last_clean":"2023-07-20T10:08:26.539409+0000","last_became_active":"2023-07-20T10:08:24.077557+0000","last_became_peered":"2023-07-20T10:08:24.077557+0000","last_unstale":"2023-07-20T10:08:26.539409+0000","last_undegraded":"2023-07-20T10:08:26.539409+0000","last_fullsized":"2023-07-20T10:08:26.539409+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086789+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:08:26.086789+0000","last_peered":"2023-07-20T10:08:26.086789+0000","last_clean":"2023-07-20T10:08:26.086789+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:08:26.086789+0000","last_undegraded":"2023-07-20T10:08:26.086789+0000","last_fullsized":"2023-07-20T10:08:26.086789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:57:25.070233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534831+0000","last_change":"2023-07-20T10:08:25.089339+0000","last_active":"2023-07-20T10:08:26.534831+0000","last_peered":"2023-07-20T10:08:26.534831+0000","last_clean":"2023-07-20T10:08:26.534831+0000","last_became_active":"2023-07-20T10:08:25.087113+0000","last_became_peered":"2023-07-20T10:08:25.087113+0000","last_unstale":"2023-07-20T10:08:26.534831+0000","last_undegraded":"2023-07-20T10:08:26.534831+0000","last_fullsized":"2023-07-20T10:08:26.534831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:44:25.037278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538754+0000","last_change":"2023-07-20T10:08:24.084995+0000","last_active":"2023-07-20T10:08:26.538754+0000","last_peered":"2023-07-20T10:08:26.538754+0000","last_clean":"2023-07-20T10:08:26.538754+0000","last_became_active":"2023-07-20T10:08:24.084689+0000","last_became_peered":"2023-07-20T10:08:24.084689+0000","last_unstale":"2023-07-20T10:08:26.538754+0000","last_undegraded":"2023-07-20T10:08:26.538754+0000","last_fullsized":"2023-07-20T10:08:26.538754+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:35.867552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084034+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:08:26.084034+0000","last_peered":"2023-07-20T10:08:26.084034+0000","last_clean":"2023-07-20T10:08:26.084034+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:08:26.084034+0000","last_undegraded":"2023-07-20T10:08:26.084034+0000","last_fullsized":"2023-07-20T10:08:26.084034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:19.610923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082961+0000","last_change":"2023-07-20T10:08:25.094668+0000","last_active":"2023-07-20T10:08:26.082961+0000","last_peered":"2023-07-20T10:08:26.082961+0000","last_clean":"2023-07-20T10:08:26.082961+0000","last_became_active":"2023-07-20T10:08:25.086332+0000","last_became_peered":"2023-07-20T10:08:25.086332+0000","last_unstale":"2023-07-20T10:08:26.082961+0000","last_undegraded":"2023-07-20T10:08:26.082961+0000","last_fullsized":"2023-07-20T10:08:26.082961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:04:47.149375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082510+0000","last_change":"2023-07-20T10:08:24.071885+0000","last_active":"2023-07-20T10:08:26.082510+0000","last_peered":"2023-07-20T10:08:26.082510+0000","last_clean":"2023-07-20T10:08:26.082510+0000","last_became_active":"2023-07-20T10:08:24.071609+0000","last_became_peered":"2023-07-20T10:08:24.071609+0000","last_unstale":"2023-07-20T10:08:26.082510+0000","last_undegraded":"2023-07-20T10:08:26.082510+0000","last_fullsized":"2023-07-20T10:08:26.082510+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:13:03.009413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":197,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538752+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:08:26.538752+0000","last_peered":"2023-07-20T10:08:26.538752+0000","last_clean":"2023-07-20T10:08:26.538752+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:08:26.538752+0000","last_undegraded":"2023-07-20T10:08:26.538752+0000","last_fullsized":"2023-07-20T10:08:26.538752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:56.935188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535227+0000","last_change":"2023-07-20T10:08:25.089410+0000","last_active":"2023-07-20T10:08:26.535227+0000","last_peered":"2023-07-20T10:08:26.535227+0000","last_clean":"2023-07-20T10:08:26.535227+0000","last_became_active":"2023-07-20T10:08:25.089100+0000","last_became_peered":"2023-07-20T10:08:25.089100+0000","last_unstale":"2023-07-20T10:08:26.535227+0000","last_undegraded":"2023-07-20T10:08:26.535227+0000","last_fullsized":"2023-07-20T10:08:26.535227+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:13:07.242343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082796+0000","last_change":"2023-07-20T10:08:24.073395+0000","last_active":"2023-07-20T10:08:26.082796+0000","last_peered":"2023-07-20T10:08:26.082796+0000","last_clean":"2023-07-20T10:08:26.082796+0000","last_became_active":"2023-07-20T10:08:24.073129+0000","last_became_peered":"2023-07-20T10:08:24.073129+0000","last_unstale":"2023-07-20T10:08:26.082796+0000","last_undegraded":"2023-07-20T10:08:26.082796+0000","last_fullsized":"2023-07-20T10:08:26.082796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:22.490220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084163+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:08:26.084163+0000","last_peered":"2023-07-20T10:08:26.084163+0000","last_clean":"2023-07-20T10:08:26.084163+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:08:26.084163+0000","last_undegraded":"2023-07-20T10:08:26.084163+0000","last_fullsized":"2023-07-20T10:08:26.084163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:56.455614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535332+0000","last_change":"2023-07-20T10:08:25.088113+0000","last_active":"2023-07-20T10:08:26.535332+0000","last_peered":"2023-07-20T10:08:26.535332+0000","last_clean":"2023-07-20T10:08:26.535332+0000","last_became_active":"2023-07-20T10:08:25.087582+0000","last_became_peered":"2023-07-20T10:08:25.087582+0000","last_unstale":"2023-07-20T10:08:26.535332+0000","last_undegraded":"2023-07-20T10:08:26.535332+0000","last_fullsized":"2023-07-20T10:08:26.535332+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082341+0000","last_change":"2023-07-20T10:08:24.074895+0000","last_active":"2023-07-20T10:08:26.082341+0000","last_peered":"2023-07-20T10:08:26.082341+0000","last_clean":"2023-07-20T10:08:26.082341+0000","last_became_active":"2023-07-20T10:08:24.074605+0000","last_became_peered":"2023-07-20T10:08:24.074605+0000","last_unstale":"2023-07-20T10:08:26.082341+0000","last_undegraded":"2023-07-20T10:08:26.082341+0000","last_fullsized":"2023-07-20T10:08:26.082341+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:15.243950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":195,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539443+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:08:26.539443+0000","last_peered":"2023-07-20T10:08:26.539443+0000","last_clean":"2023-07-20T10:08:26.539443+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:08:26.539443+0000","last_undegraded":"2023-07-20T10:08:26.539443+0000","last_fullsized":"2023-07-20T10:08:26.539443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:20.082576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575064,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59432,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312408,"statfs":{"total":96636764160,"available":96575905792,"internally_reserved":0,"allocated":2121728,"data_stored":1354189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.153,"15min":1.153},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.95299999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.434,"15min":0.36899999999999999},"max":{"1min":0.89200000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.90900000000000003,"5min":1.05,"15min":1.075},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.716},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.433},"max":{"1min":0.96899999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":1.3759999999999999,"15min":1.758},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.8},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.875,"5min":0.995,"15min":0.999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0840000000000001,"15min":1.1220000000000001},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575066,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1540096,"data_stored":765829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.73799999999999999},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.90000000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.56000000000000005,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.83599999999999997}]},{"osd":1,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.53800000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.1259999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98899999999999999,"15min":1.103},"last":0.80200000000000005}]},{"osd":2,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70999999999999996},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85799999999999998,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.77500000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93000000000000005,"5min":1.1000000000000001,"15min":1.25},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71499999999999997,"15min":0.73499999999999999},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":1.272},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.98699999999999999,"15min":1.173},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":1.135,"15min":1.135},"last":0.73999999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93999999999999995,"5min":0.996,"15min":0.996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575064,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50652,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321188,"statfs":{"total":96636764160,"available":96584896512,"internally_reserved":0,"allocated":1519616,"data_stored":763661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.98699999999999999,"15min":1.0620000000000001},"last":1.052}]},{"osd":2,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.036},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":1.0269999999999999},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.034},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.28599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0089999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.95199999999999996,"15min":1.024},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90800000000000003,"5min":1.0209999999999999,"15min":1.0680000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":1.0049999999999999},"last":1.1699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575064,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1527808,"data_stored":763753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":1.085},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.141},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":0.98599999999999999,"15min":1.363},"last":0.62}]},{"osd":2,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.149,"15min":1.177},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.002,"5min":1.159,"15min":1.23},"last":0.73799999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.98899999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.196},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.034},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.85599999999999998,"15min":1.2649999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1523712,"data_stored":764243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.60199999999999998,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":1.002,"5min":1.083,"15min":1.1890000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.45900000000000002},"max":{"1min":0.98299999999999998,"5min":1.071,"15min":1.381},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":1.052,"15min":1.3260000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95499999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0129999999999999,"5min":1.04,"15min":1.131},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.4399999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54748,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317092,"statfs":{"total":96636764160,"available":96580702208,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45600000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56200000000000006,"5min":0.68899999999999995,"15min":0.876},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.503},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.433}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0289999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.41899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.2689999999999999},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.63},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77900000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.53100000000000003,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.0680000000000001,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.069,"5min":1.218,"15min":1.3240000000000001},"last":0.753}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.024,"5min":1.143,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.095,"5min":1.204,"15min":1.393},"last":0.79400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44800000000000001,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.374},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67100000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":1.399,"15min":1.399},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":1.083,"15min":1.1779999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0309999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.77400000000000002},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.012,"5min":1.0389999999999999,"15min":1.107},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99299999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.755},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575064,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2129920,"data_stored":1355683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.247},"max":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":3.0710000000000002},"last":0.375},{"interface":"front","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":3.2509999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53400000000000003,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.79900000000000004},"min":{"1min":0.55400000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.232,"15min":1.6779999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.80900000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.216,"5min":1.216,"15min":3.125},"last":0.747}]},{"osd":5,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0649999999999999,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.82099999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.1950000000000001,"15min":3.161},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.1739999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.82799999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3009999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.3089999999999999,"15min":1.766},"last":0.77900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:08:33.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:08:33.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.862+0000 7fed68b1e640 1 Processor -- start 2023-07-20T10:08:33.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.862+0000 7fed68b1e640 1 -- start start 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed68b1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed68b1e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed640b2060 0x7fed640b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed68b1e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed640b06c0 con 0x7fed640afda0 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed68b1e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed640b3160 con 0x7fed640b2060 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed68b1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed640b12a0 con 0x7fed6415a8e0 2023-07-20T10:08:33.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed640b2060 0x7fed640b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fed640b2060 0x7fed640b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47060/0 (socket says 172.21.15.82:47060) 2023-07-20T10:08:33.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 -- 172.21.15.82:0/644889334 learned_addr learned my addr 172.21.15.82:0/644889334 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:33.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed59d9b640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 -- 172.21.15.82:0/644889334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 msgr2=0x7fed640ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:33.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 -- 172.21.15.82:0/644889334 >> v1:172.21.15.183:6789/0 conn(0x7fed640afda0 legacy=0x7fed640b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:33.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.866+0000 7fed62d9d640 1 -- 172.21.15.82:0/644889334 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640b1580 con 0x7fed640b2060 2023-07-20T10:08:33.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed62d9d640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640b2060 0x7fed640b0180 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009870 tx=0x7fed5c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3829db13a7735ba server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:33.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed61d9b640 1 -- 172.21.15.82:0/644889334 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0ab5f0 con 0x7fed640b2060 2023-07-20T10:08:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed61d9b640 1 -- 172.21.15.82:0/644889334 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0ab750 con 0x7fed640b2060 2023-07-20T10:08:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed61d9b640 1 -- 172.21.15.82:0/644889334 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0abae0 con 0x7fed640b2060 2023-07-20T10:08:33.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- 172.21.15.82:0/644889334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640b2060 msgr2=0x7fed640b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640b2060 0x7fed640b0180 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009870 tx=0x7fed5c01c3f0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- 172.21.15.82:0/644889334 shutdown_connections 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640b2060 0x7fed640b0180 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 --2- 172.21.15.82:0/644889334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- 172.21.15.82:0/644889334 >> 172.21.15.82:0/644889334 conn(0x7fed640cada0 msgr2=0x7fed640cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- 172.21.15.82:0/644889334 shutdown_connections 2023-07-20T10:08:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- 172.21.15.82:0/644889334 wait complete. 2023-07-20T10:08:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 Processor -- start 2023-07-20T10:08:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.870+0000 7fed68b1e640 1 -- start start 2023-07-20T10:08:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed640b2060 0x7fed64153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640c24d0 con 0x7fed640afda0 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed640c1ef0 con 0x7fed640b2060 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6415db50 con 0x7fed6415a8e0 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47074/0 (socket says 172.21.15.82:47074) 2023-07-20T10:08:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 -- 172.21.15.82:0/3191160181 learned_addr learned my addr 172.21.15.82:0/3191160181 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed59d9b640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed640b2060 0x7fed64153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed62d9d640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 -- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 msgr2=0x7fed640abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 -- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed640b2060 msgr2=0x7fed64153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:33.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed640b2060 0x7fed64153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 -- 172.21.15.82:0/3191160181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0094d0 con 0x7fed640afda0 2023-07-20T10:08:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed6259c640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c530 tx=0x7fed5400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54005220 con 0x7fed640afda0 2023-07-20T10:08:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54005380 con 0x7fed640afda0 2023-07-20T10:08:33.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54007270 con 0x7fed640afda0 2023-07-20T10:08:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed640acd40 con 0x7fed640afda0 2023-07-20T10:08:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed640ad020 con 0x7fed640afda0 2023-07-20T10:08:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed64073c70 con 0x7fed640afda0 2023-07-20T10:08:33.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.874+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed540073d0 con 0x7fed640afda0 2023-07-20T10:08:33.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.878+0000 7fed5b7fe640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 0x7fed44068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.878+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed540835f0 con 0x7fed640afda0 2023-07-20T10:08:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.878+0000 7fed59d9b640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 0x7fed44068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.878+0000 7fed59d9b640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 0x7fed44068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed641f66d0 tx=0x7fed4c009800 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:33.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:33.882+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed54050a00 con 0x7fed640afda0 2023-07-20T10:08:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.026+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed640b24f0 con 0x7fed440663a0 2023-07-20T10:08:34.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.034+0000 7fed5b7fe640 1 -- 172.21.15.82:0/3191160181 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311747 (secure 0 0 0) 0x7fed4c0046d0 con 0x7fed440663a0 2023-07-20T10:08:34.015 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:08:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 msgr2=0x7fed44068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 0x7fed44068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed641f66d0 tx=0x7fed4c009800 comp rx=0 tx=0).stop 2023-07-20T10:08:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 msgr2=0x7fed64155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c530 tx=0x7fed5400c9f0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 shutdown_connections 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fed6415a8e0 0x7fed640abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fed440663a0 0x7fed44068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fed640b2060 0x7fed64153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 --2- 172.21.15.82:0/3191160181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fed640afda0 0x7fed64155910 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 >> 172.21.15.82:0/3191160181 conn(0x7fed640cada0 msgr2=0x7fed6406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 shutdown_connections 2023-07-20T10:08:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.038+0000 7fed68b1e640 1 -- 172.21.15.82:0/3191160181 wait complete. 2023-07-20T10:08:34.035 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T10:08:33.926750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":336668,"kb_used_data":13096,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754638052,"statfs":{"total":773094113280,"available":772749365248,"internally_reserved":0,"allocated":13410304,"data_stored":7294748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.867054"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535200+0000","last_change":"2023-07-20T10:08:25.088567+0000","last_active":"2023-07-20T10:08:26.535200+0000","last_peered":"2023-07-20T10:08:26.535200+0000","last_clean":"2023-07-20T10:08:26.535200+0000","last_became_active":"2023-07-20T10:08:25.086795+0000","last_became_peered":"2023-07-20T10:08:25.086795+0000","last_unstale":"2023-07-20T10:08:26.535200+0000","last_undegraded":"2023-07-20T10:08:26.535200+0000","last_fullsized":"2023-07-20T10:08:26.535200+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:26:30.327277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539096+0000","last_change":"2023-07-20T10:08:25.095614+0000","last_active":"2023-07-20T10:08:26.539096+0000","last_peered":"2023-07-20T10:08:26.539096+0000","last_clean":"2023-07-20T10:08:26.539096+0000","last_became_active":"2023-07-20T10:08:25.095201+0000","last_became_peered":"2023-07-20T10:08:25.095201+0000","last_unstale":"2023-07-20T10:08:26.539096+0000","last_undegraded":"2023-07-20T10:08:26.539096+0000","last_fullsized":"2023-07-20T10:08:26.539096+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:58:26.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535181+0000","last_change":"2023-07-20T10:08:25.087856+0000","last_active":"2023-07-20T10:08:26.535181+0000","last_peered":"2023-07-20T10:08:26.535181+0000","last_clean":"2023-07-20T10:08:26.535181+0000","last_became_active":"2023-07-20T10:08:25.087280+0000","last_became_peered":"2023-07-20T10:08:25.087280+0000","last_unstale":"2023-07-20T10:08:26.535181+0000","last_undegraded":"2023-07-20T10:08:26.535181+0000","last_fullsized":"2023-07-20T10:08:26.535181+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:41:48.244239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535022+0000","last_change":"2023-07-20T10:08:25.080773+0000","last_active":"2023-07-20T10:08:26.535022+0000","last_peered":"2023-07-20T10:08:26.535022+0000","last_clean":"2023-07-20T10:08:26.535022+0000","last_became_active":"2023-07-20T10:08:25.080162+0000","last_became_peered":"2023-07-20T10:08:25.080162+0000","last_unstale":"2023-07-20T10:08:26.535022+0000","last_undegraded":"2023-07-20T10:08:26.535022+0000","last_fullsized":"2023-07-20T10:08:26.535022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:31.500117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084292+0000","last_change":"2023-07-20T10:08:25.092477+0000","last_active":"2023-07-20T10:08:26.084292+0000","last_peered":"2023-07-20T10:08:26.084292+0000","last_clean":"2023-07-20T10:08:26.084292+0000","last_became_active":"2023-07-20T10:08:25.092042+0000","last_became_peered":"2023-07-20T10:08:25.092042+0000","last_unstale":"2023-07-20T10:08:26.084292+0000","last_undegraded":"2023-07-20T10:08:26.084292+0000","last_fullsized":"2023-07-20T10:08:26.084292+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:53.494822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538287+0000","last_change":"2023-07-20T10:08:25.088631+0000","last_active":"2023-07-20T10:08:26.538287+0000","last_peered":"2023-07-20T10:08:26.538287+0000","last_clean":"2023-07-20T10:08:26.538287+0000","last_became_active":"2023-07-20T10:08:25.088256+0000","last_became_peered":"2023-07-20T10:08:25.088256+0000","last_unstale":"2023-07-20T10:08:26.538287+0000","last_undegraded":"2023-07-20T10:08:26.538287+0000","last_fullsized":"2023-07-20T10:08:26.538287+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:04.986072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538492+0000","last_change":"2023-07-20T10:08:25.096007+0000","last_active":"2023-07-20T10:08:26.538492+0000","last_peered":"2023-07-20T10:08:26.538492+0000","last_clean":"2023-07-20T10:08:26.538492+0000","last_became_active":"2023-07-20T10:08:25.095678+0000","last_became_peered":"2023-07-20T10:08:25.095678+0000","last_unstale":"2023-07-20T10:08:26.538492+0000","last_undegraded":"2023-07-20T10:08:26.538492+0000","last_fullsized":"2023-07-20T10:08:26.538492+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:58.298640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082424+0000","last_change":"2023-07-20T10:08:25.086880+0000","last_active":"2023-07-20T10:08:26.082424+0000","last_peered":"2023-07-20T10:08:26.082424+0000","last_clean":"2023-07-20T10:08:26.082424+0000","last_became_active":"2023-07-20T10:08:25.086606+0000","last_became_peered":"2023-07-20T10:08:25.086606+0000","last_unstale":"2023-07-20T10:08:26.082424+0000","last_undegraded":"2023-07-20T10:08:26.082424+0000","last_fullsized":"2023-07-20T10:08:26.082424+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:44.267468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.091329+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.090464+0000","last_became_peered":"2023-07-20T10:08:25.090464+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:06.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084092+0000","last_change":"2023-07-20T10:08:25.095723+0000","last_active":"2023-07-20T10:08:26.084092+0000","last_peered":"2023-07-20T10:08:26.084092+0000","last_clean":"2023-07-20T10:08:26.084092+0000","last_became_active":"2023-07-20T10:08:25.095452+0000","last_became_peered":"2023-07-20T10:08:25.095452+0000","last_unstale":"2023-07-20T10:08:26.084092+0000","last_undegraded":"2023-07-20T10:08:26.084092+0000","last_fullsized":"2023-07-20T10:08:26.084092+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:34.544206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086844+0000","last_change":"2023-07-20T10:08:25.089704+0000","last_active":"2023-07-20T10:08:26.086844+0000","last_peered":"2023-07-20T10:08:26.086844+0000","last_clean":"2023-07-20T10:08:26.086844+0000","last_became_active":"2023-07-20T10:08:25.089379+0000","last_became_peered":"2023-07-20T10:08:25.089379+0000","last_unstale":"2023-07-20T10:08:26.086844+0000","last_undegraded":"2023-07-20T10:08:26.086844+0000","last_fullsized":"2023-07-20T10:08:26.086844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:04:49.393132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538684+0000","last_change":"2023-07-20T10:08:25.088568+0000","last_active":"2023-07-20T10:08:26.538684+0000","last_peered":"2023-07-20T10:08:26.538684+0000","last_clean":"2023-07-20T10:08:26.538684+0000","last_became_active":"2023-07-20T10:08:25.088271+0000","last_became_peered":"2023-07-20T10:08:25.088271+0000","last_unstale":"2023-07-20T10:08:26.538684+0000","last_undegraded":"2023-07-20T10:08:26.538684+0000","last_fullsized":"2023-07-20T10:08:26.538684+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:17.709652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534563+0000","last_change":"2023-07-20T10:08:25.077985+0000","last_active":"2023-07-20T10:08:26.534563+0000","last_peered":"2023-07-20T10:08:26.534563+0000","last_clean":"2023-07-20T10:08:26.534563+0000","last_became_active":"2023-07-20T10:08:25.077668+0000","last_became_peered":"2023-07-20T10:08:25.077668+0000","last_unstale":"2023-07-20T10:08:26.534563+0000","last_undegraded":"2023-07-20T10:08:26.534563+0000","last_fullsized":"2023-07-20T10:08:26.534563+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:42:34.827824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538484+0000","last_change":"2023-07-20T10:08:25.092926+0000","last_active":"2023-07-20T10:08:26.538484+0000","last_peered":"2023-07-20T10:08:26.538484+0000","last_clean":"2023-07-20T10:08:26.538484+0000","last_became_active":"2023-07-20T10:08:25.092667+0000","last_became_peered":"2023-07-20T10:08:25.092667+0000","last_unstale":"2023-07-20T10:08:26.538484+0000","last_undegraded":"2023-07-20T10:08:26.538484+0000","last_fullsized":"2023-07-20T10:08:26.538484+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:12:57.820581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539192+0000","last_change":"2023-07-20T10:08:25.096716+0000","last_active":"2023-07-20T10:08:26.539192+0000","last_peered":"2023-07-20T10:08:26.539192+0000","last_clean":"2023-07-20T10:08:26.539192+0000","last_became_active":"2023-07-20T10:08:25.096383+0000","last_became_peered":"2023-07-20T10:08:25.096383+0000","last_unstale":"2023-07-20T10:08:26.539192+0000","last_undegraded":"2023-07-20T10:08:26.539192+0000","last_fullsized":"2023-07-20T10:08:26.539192+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:02:25.015691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537901+0000","last_change":"2023-07-20T10:08:25.086246+0000","last_active":"2023-07-20T10:08:26.537901+0000","last_peered":"2023-07-20T10:08:26.537901+0000","last_clean":"2023-07-20T10:08:26.537901+0000","last_became_active":"2023-07-20T10:08:25.085921+0000","last_became_peered":"2023-07-20T10:08:25.085921+0000","last_unstale":"2023-07-20T10:08:26.537901+0000","last_undegraded":"2023-07-20T10:08:26.537901+0000","last_fullsized":"2023-07-20T10:08:26.537901+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:49.609933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535259+0000","last_change":"2023-07-20T10:08:25.088511+0000","last_active":"2023-07-20T10:08:26.535259+0000","last_peered":"2023-07-20T10:08:26.535259+0000","last_clean":"2023-07-20T10:08:26.535259+0000","last_became_active":"2023-07-20T10:08:25.086352+0000","last_became_peered":"2023-07-20T10:08:25.086352+0000","last_unstale":"2023-07-20T10:08:26.535259+0000","last_undegraded":"2023-07-20T10:08:26.535259+0000","last_fullsized":"2023-07-20T10:08:26.535259+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:12.609824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539139+0000","last_change":"2023-07-20T10:08:25.088633+0000","last_active":"2023-07-20T10:08:26.539139+0000","last_peered":"2023-07-20T10:08:26.539139+0000","last_clean":"2023-07-20T10:08:26.539139+0000","last_became_active":"2023-07-20T10:08:25.088252+0000","last_became_peered":"2023-07-20T10:08:25.088252+0000","last_unstale":"2023-07-20T10:08:26.539139+0000","last_undegraded":"2023-07-20T10:08:26.539139+0000","last_fullsized":"2023-07-20T10:08:26.539139+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:45:19.214011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535309+0000","last_change":"2023-07-20T10:08:25.096677+0000","last_active":"2023-07-20T10:08:26.535309+0000","last_peered":"2023-07-20T10:08:26.535309+0000","last_clean":"2023-07-20T10:08:26.535309+0000","last_became_active":"2023-07-20T10:08:25.095478+0000","last_became_peered":"2023-07-20T10:08:25.095478+0000","last_unstale":"2023-07-20T10:08:26.535309+0000","last_undegraded":"2023-07-20T10:08:26.535309+0000","last_fullsized":"2023-07-20T10:08:26.535309+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:24:21.018736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538845+0000","last_change":"2023-07-20T10:08:25.081282+0000","last_active":"2023-07-20T10:08:26.538845+0000","last_peered":"2023-07-20T10:08:26.538845+0000","last_clean":"2023-07-20T10:08:26.538845+0000","last_became_active":"2023-07-20T10:08:25.080957+0000","last_became_peered":"2023-07-20T10:08:25.080957+0000","last_unstale":"2023-07-20T10:08:26.538845+0000","last_undegraded":"2023-07-20T10:08:26.538845+0000","last_fullsized":"2023-07-20T10:08:26.538845+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:46.399078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082709+0000","last_change":"2023-07-20T10:08:25.081233+0000","last_active":"2023-07-20T10:08:26.082709+0000","last_peered":"2023-07-20T10:08:26.082709+0000","last_clean":"2023-07-20T10:08:26.082709+0000","last_became_active":"2023-07-20T10:08:25.080833+0000","last_became_peered":"2023-07-20T10:08:25.080833+0000","last_unstale":"2023-07-20T10:08:26.082709+0000","last_undegraded":"2023-07-20T10:08:26.082709+0000","last_fullsized":"2023-07-20T10:08:26.082709+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:15.098899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084143+0000","last_change":"2023-07-20T10:08:25.098301+0000","last_active":"2023-07-20T10:08:26.084143+0000","last_peered":"2023-07-20T10:08:26.084143+0000","last_clean":"2023-07-20T10:08:26.084143+0000","last_became_active":"2023-07-20T10:08:25.098032+0000","last_became_peered":"2023-07-20T10:08:25.098032+0000","last_unstale":"2023-07-20T10:08:26.084143+0000","last_undegraded":"2023-07-20T10:08:26.084143+0000","last_fullsized":"2023-07-20T10:08:26.084143+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:10.815318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534907+0000","last_change":"2023-07-20T10:08:25.084031+0000","last_active":"2023-07-20T10:08:26.534907+0000","last_peered":"2023-07-20T10:08:26.534907+0000","last_clean":"2023-07-20T10:08:26.534907+0000","last_became_active":"2023-07-20T10:08:25.083719+0000","last_became_peered":"2023-07-20T10:08:25.083719+0000","last_unstale":"2023-07-20T10:08:26.534907+0000","last_undegraded":"2023-07-20T10:08:26.534907+0000","last_fullsized":"2023-07-20T10:08:26.534907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.419849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083722+0000","last_change":"2023-07-20T10:08:25.090791+0000","last_active":"2023-07-20T10:08:26.083722+0000","last_peered":"2023-07-20T10:08:26.083722+0000","last_clean":"2023-07-20T10:08:26.083722+0000","last_became_active":"2023-07-20T10:08:25.090506+0000","last_became_peered":"2023-07-20T10:08:25.090506+0000","last_unstale":"2023-07-20T10:08:26.083722+0000","last_undegraded":"2023-07-20T10:08:26.083722+0000","last_fullsized":"2023-07-20T10:08:26.083722+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539270+0000","last_change":"2023-07-20T10:08:25.082506+0000","last_active":"2023-07-20T10:08:26.539270+0000","last_peered":"2023-07-20T10:08:26.539270+0000","last_clean":"2023-07-20T10:08:26.539270+0000","last_became_active":"2023-07-20T10:08:25.082230+0000","last_became_peered":"2023-07-20T10:08:25.082230+0000","last_unstale":"2023-07-20T10:08:26.539270+0000","last_undegraded":"2023-07-20T10:08:26.539270+0000","last_fullsized":"2023-07-20T10:08:26.539270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:56:23.510435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539655+0000","last_change":"2023-07-20T10:08:25.089490+0000","last_active":"2023-07-20T10:08:26.539655+0000","last_peered":"2023-07-20T10:08:26.539655+0000","last_clean":"2023-07-20T10:08:26.539655+0000","last_became_active":"2023-07-20T10:08:25.089205+0000","last_became_peered":"2023-07-20T10:08:25.089205+0000","last_unstale":"2023-07-20T10:08:26.539655+0000","last_undegraded":"2023-07-20T10:08:26.539655+0000","last_fullsized":"2023-07-20T10:08:26.539655+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087130+0000","last_change":"2023-07-20T10:08:25.094938+0000","last_active":"2023-07-20T10:08:26.087130+0000","last_peered":"2023-07-20T10:08:26.087130+0000","last_clean":"2023-07-20T10:08:26.087130+0000","last_became_active":"2023-07-20T10:08:25.094670+0000","last_became_peered":"2023-07-20T10:08:25.094670+0000","last_unstale":"2023-07-20T10:08:26.087130+0000","last_undegraded":"2023-07-20T10:08:26.087130+0000","last_fullsized":"2023-07-20T10:08:26.087130+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:16:38.245539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538585+0000","last_change":"2023-07-20T10:08:25.101741+0000","last_active":"2023-07-20T10:08:26.538585+0000","last_peered":"2023-07-20T10:08:26.538585+0000","last_clean":"2023-07-20T10:08:26.538585+0000","last_became_active":"2023-07-20T10:08:25.101467+0000","last_became_peered":"2023-07-20T10:08:25.101467+0000","last_unstale":"2023-07-20T10:08:26.538585+0000","last_undegraded":"2023-07-20T10:08:26.538585+0000","last_fullsized":"2023-07-20T10:08:26.538585+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:37.030691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082734+0000","last_change":"2023-07-20T10:08:25.094492+0000","last_active":"2023-07-20T10:08:26.082734+0000","last_peered":"2023-07-20T10:08:26.082734+0000","last_clean":"2023-07-20T10:08:26.082734+0000","last_became_active":"2023-07-20T10:08:25.093652+0000","last_became_peered":"2023-07-20T10:08:25.093652+0000","last_unstale":"2023-07-20T10:08:26.082734+0000","last_undegraded":"2023-07-20T10:08:26.082734+0000","last_fullsized":"2023-07-20T10:08:26.082734+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:46.844014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538137+0000","last_change":"2023-07-20T10:08:25.083085+0000","last_active":"2023-07-20T10:08:26.538137+0000","last_peered":"2023-07-20T10:08:26.538137+0000","last_clean":"2023-07-20T10:08:26.538137+0000","last_became_active":"2023-07-20T10:08:25.082726+0000","last_became_peered":"2023-07-20T10:08:25.082726+0000","last_unstale":"2023-07-20T10:08:26.538137+0000","last_undegraded":"2023-07-20T10:08:26.538137+0000","last_fullsized":"2023-07-20T10:08:26.538137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:45.074650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538651+0000","last_change":"2023-07-20T10:08:25.095508+0000","last_active":"2023-07-20T10:08:26.538651+0000","last_peered":"2023-07-20T10:08:26.538651+0000","last_clean":"2023-07-20T10:08:26.538651+0000","last_became_active":"2023-07-20T10:08:25.095131+0000","last_became_peered":"2023-07-20T10:08:25.095131+0000","last_unstale":"2023-07-20T10:08:26.538651+0000","last_undegraded":"2023-07-20T10:08:26.538651+0000","last_fullsized":"2023-07-20T10:08:26.538651+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:48.329933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082340+0000","last_change":"2023-07-20T10:08:25.084554+0000","last_active":"2023-07-20T10:08:26.082340+0000","last_peered":"2023-07-20T10:08:26.082340+0000","last_clean":"2023-07-20T10:08:26.082340+0000","last_became_active":"2023-07-20T10:08:25.084057+0000","last_became_peered":"2023-07-20T10:08:25.084057+0000","last_unstale":"2023-07-20T10:08:26.082340+0000","last_undegraded":"2023-07-20T10:08:26.082340+0000","last_fullsized":"2023-07-20T10:08:26.082340+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:13.131775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:25.089116+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:25.088727+0000","last_became_peered":"2023-07-20T10:08:25.088727+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:46:35.188436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"122'4","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534952+0000","last_change":"2023-07-20T10:08:24.080708+0000","last_active":"2023-07-20T10:08:26.534952+0000","last_peered":"2023-07-20T10:08:26.534952+0000","last_clean":"2023-07-20T10:08:26.534952+0000","last_became_active":"2023-07-20T10:08:24.080417+0000","last_became_peered":"2023-07-20T10:08:24.080417+0000","last_unstale":"2023-07-20T10:08:26.534952+0000","last_undegraded":"2023-07-20T10:08:26.534952+0000","last_fullsized":"2023-07-20T10:08:26.534952+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.481708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082376+0000","last_change":"2023-07-20T10:08:25.085456+0000","last_active":"2023-07-20T10:08:26.082376+0000","last_peered":"2023-07-20T10:08:26.082376+0000","last_clean":"2023-07-20T10:08:26.082376+0000","last_became_active":"2023-07-20T10:08:25.085147+0000","last_became_peered":"2023-07-20T10:08:25.085147+0000","last_unstale":"2023-07-20T10:08:26.082376+0000","last_undegraded":"2023-07-20T10:08:26.082376+0000","last_fullsized":"2023-07-20T10:08:26.082376+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:28:54.729481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082724+0000","last_change":"2023-07-20T10:08:24.076297+0000","last_active":"2023-07-20T10:08:26.082724+0000","last_peered":"2023-07-20T10:08:26.082724+0000","last_clean":"2023-07-20T10:08:26.082724+0000","last_became_active":"2023-07-20T10:08:24.075986+0000","last_became_peered":"2023-07-20T10:08:24.075986+0000","last_unstale":"2023-07-20T10:08:26.082724+0000","last_undegraded":"2023-07-20T10:08:26.082724+0000","last_fullsized":"2023-07-20T10:08:26.082724+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:04.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538280+0000","last_change":"2023-07-20T10:08:25.087181+0000","last_active":"2023-07-20T10:08:26.538280+0000","last_peered":"2023-07-20T10:08:26.538280+0000","last_clean":"2023-07-20T10:08:26.538280+0000","last_became_active":"2023-07-20T10:08:25.086275+0000","last_became_peered":"2023-07-20T10:08:25.086275+0000","last_unstale":"2023-07-20T10:08:26.538280+0000","last_undegraded":"2023-07-20T10:08:26.538280+0000","last_fullsized":"2023-07-20T10:08:26.538280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:48:30.735226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539133+0000","last_change":"2023-07-20T10:08:24.078102+0000","last_active":"2023-07-20T10:08:26.539133+0000","last_peered":"2023-07-20T10:08:26.539133+0000","last_clean":"2023-07-20T10:08:26.539133+0000","last_became_active":"2023-07-20T10:08:24.077784+0000","last_became_peered":"2023-07-20T10:08:24.077784+0000","last_unstale":"2023-07-20T10:08:26.539133+0000","last_undegraded":"2023-07-20T10:08:26.539133+0000","last_fullsized":"2023-07-20T10:08:26.539133+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.568794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087005+0000","last_change":"2023-07-20T10:08:25.080768+0000","last_active":"2023-07-20T10:08:26.087005+0000","last_peered":"2023-07-20T10:08:26.087005+0000","last_clean":"2023-07-20T10:08:26.087005+0000","last_became_active":"2023-07-20T10:08:25.080358+0000","last_became_peered":"2023-07-20T10:08:25.080358+0000","last_unstale":"2023-07-20T10:08:26.087005+0000","last_undegraded":"2023-07-20T10:08:26.087005+0000","last_fullsized":"2023-07-20T10:08:26.087005+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:56:41.415357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084039+0000","last_change":"2023-07-20T10:08:24.074955+0000","last_active":"2023-07-20T10:08:26.084039+0000","last_peered":"2023-07-20T10:08:26.084039+0000","last_clean":"2023-07-20T10:08:26.084039+0000","last_became_active":"2023-07-20T10:08:24.074652+0000","last_became_peered":"2023-07-20T10:08:24.074652+0000","last_unstale":"2023-07-20T10:08:26.084039+0000","last_undegraded":"2023-07-20T10:08:26.084039+0000","last_fullsized":"2023-07-20T10:08:26.084039+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:09:34.196548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535144+0000","last_change":"2023-07-20T10:08:25.086465+0000","last_active":"2023-07-20T10:08:26.535144+0000","last_peered":"2023-07-20T10:08:26.535144+0000","last_clean":"2023-07-20T10:08:26.535144+0000","last_became_active":"2023-07-20T10:08:25.086127+0000","last_became_peered":"2023-07-20T10:08:25.086127+0000","last_unstale":"2023-07-20T10:08:26.535144+0000","last_undegraded":"2023-07-20T10:08:26.535144+0000","last_fullsized":"2023-07-20T10:08:26.535144+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:55:50.784530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538242+0000","last_change":"2023-07-20T10:08:24.084407+0000","last_active":"2023-07-20T10:08:26.538242+0000","last_peered":"2023-07-20T10:08:26.538242+0000","last_clean":"2023-07-20T10:08:26.538242+0000","last_became_active":"2023-07-20T10:08:24.084083+0000","last_became_peered":"2023-07-20T10:08:24.084083+0000","last_unstale":"2023-07-20T10:08:26.538242+0000","last_undegraded":"2023-07-20T10:08:26.538242+0000","last_fullsized":"2023-07-20T10:08:26.538242+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:27:38.708920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535381+0000","last_change":"2023-07-20T10:08:25.096456+0000","last_active":"2023-07-20T10:08:26.535381+0000","last_peered":"2023-07-20T10:08:26.535381+0000","last_clean":"2023-07-20T10:08:26.535381+0000","last_became_active":"2023-07-20T10:08:25.095799+0000","last_became_peered":"2023-07-20T10:08:25.095799+0000","last_unstale":"2023-07-20T10:08:26.535381+0000","last_undegraded":"2023-07-20T10:08:26.535381+0000","last_fullsized":"2023-07-20T10:08:26.535381+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:16.853989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086528+0000","last_change":"2023-07-20T10:08:24.075528+0000","last_active":"2023-07-20T10:08:26.086528+0000","last_peered":"2023-07-20T10:08:26.086528+0000","last_clean":"2023-07-20T10:08:26.086528+0000","last_became_active":"2023-07-20T10:08:24.075247+0000","last_became_peered":"2023-07-20T10:08:24.075247+0000","last_unstale":"2023-07-20T10:08:26.086528+0000","last_undegraded":"2023-07-20T10:08:26.086528+0000","last_fullsized":"2023-07-20T10:08:26.086528+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:39:35.172438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539231+0000","last_change":"2023-07-20T10:08:25.101692+0000","last_active":"2023-07-20T10:08:26.539231+0000","last_peered":"2023-07-20T10:08:26.539231+0000","last_clean":"2023-07-20T10:08:26.539231+0000","last_became_active":"2023-07-20T10:08:25.101368+0000","last_became_peered":"2023-07-20T10:08:25.101368+0000","last_unstale":"2023-07-20T10:08:26.539231+0000","last_undegraded":"2023-07-20T10:08:26.539231+0000","last_fullsized":"2023-07-20T10:08:26.539231+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:24:10.098429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538967+0000","last_change":"2023-07-20T10:08:24.077869+0000","last_active":"2023-07-20T10:08:26.538967+0000","last_peered":"2023-07-20T10:08:26.538967+0000","last_clean":"2023-07-20T10:08:26.538967+0000","last_became_active":"2023-07-20T10:08:24.077569+0000","last_became_peered":"2023-07-20T10:08:24.077569+0000","last_unstale":"2023-07-20T10:08:26.538967+0000","last_undegraded":"2023-07-20T10:08:26.538967+0000","last_fullsized":"2023-07-20T10:08:26.538967+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:00.206744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534969+0000","last_change":"2023-07-20T10:08:25.089629+0000","last_active":"2023-07-20T10:08:26.534969+0000","last_peered":"2023-07-20T10:08:26.534969+0000","last_clean":"2023-07-20T10:08:26.534969+0000","last_became_active":"2023-07-20T10:08:25.089168+0000","last_became_peered":"2023-07-20T10:08:25.089168+0000","last_unstale":"2023-07-20T10:08:26.534969+0000","last_undegraded":"2023-07-20T10:08:26.534969+0000","last_fullsized":"2023-07-20T10:08:26.534969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:40.537481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534370+0000","last_change":"2023-07-20T10:08:24.073102+0000","last_active":"2023-07-20T10:08:26.534370+0000","last_peered":"2023-07-20T10:08:26.534370+0000","last_clean":"2023-07-20T10:08:26.534370+0000","last_became_active":"2023-07-20T10:08:24.072813+0000","last_became_peered":"2023-07-20T10:08:24.072813+0000","last_unstale":"2023-07-20T10:08:26.534370+0000","last_undegraded":"2023-07-20T10:08:26.534370+0000","last_fullsized":"2023-07-20T10:08:26.534370+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534830+0000","last_change":"2023-07-20T10:08:25.089395+0000","last_active":"2023-07-20T10:08:26.534830+0000","last_peered":"2023-07-20T10:08:26.534830+0000","last_clean":"2023-07-20T10:08:26.534830+0000","last_became_active":"2023-07-20T10:08:25.089104+0000","last_became_peered":"2023-07-20T10:08:25.089104+0000","last_unstale":"2023-07-20T10:08:26.534830+0000","last_undegraded":"2023-07-20T10:08:26.534830+0000","last_fullsized":"2023-07-20T10:08:26.534830+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:09.528914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538965+0000","last_change":"2023-07-20T10:08:24.077971+0000","last_active":"2023-07-20T10:08:26.538965+0000","last_peered":"2023-07-20T10:08:26.538965+0000","last_clean":"2023-07-20T10:08:26.538965+0000","last_became_active":"2023-07-20T10:08:24.077681+0000","last_became_peered":"2023-07-20T10:08:24.077681+0000","last_unstale":"2023-07-20T10:08:26.538965+0000","last_undegraded":"2023-07-20T10:08:26.538965+0000","last_fullsized":"2023-07-20T10:08:26.538965+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:22.732475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083870+0000","last_change":"2023-07-20T10:08:25.086343+0000","last_active":"2023-07-20T10:08:26.083870+0000","last_peered":"2023-07-20T10:08:26.083870+0000","last_clean":"2023-07-20T10:08:26.083870+0000","last_became_active":"2023-07-20T10:08:25.086081+0000","last_became_peered":"2023-07-20T10:08:25.086081+0000","last_unstale":"2023-07-20T10:08:26.083870+0000","last_undegraded":"2023-07-20T10:08:26.083870+0000","last_fullsized":"2023-07-20T10:08:26.083870+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534791+0000","last_change":"2023-07-20T10:08:24.074758+0000","last_active":"2023-07-20T10:08:26.534791+0000","last_peered":"2023-07-20T10:08:26.534791+0000","last_clean":"2023-07-20T10:08:26.534791+0000","last_became_active":"2023-07-20T10:08:24.074158+0000","last_became_peered":"2023-07-20T10:08:24.074158+0000","last_unstale":"2023-07-20T10:08:26.534791+0000","last_undegraded":"2023-07-20T10:08:26.534791+0000","last_fullsized":"2023-07-20T10:08:26.534791+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:27:10.619945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082522+0000","last_change":"2023-07-20T10:08:25.085660+0000","last_active":"2023-07-20T10:08:26.082522+0000","last_peered":"2023-07-20T10:08:26.082522+0000","last_clean":"2023-07-20T10:08:26.082522+0000","last_became_active":"2023-07-20T10:08:25.085364+0000","last_became_peered":"2023-07-20T10:08:25.085364+0000","last_unstale":"2023-07-20T10:08:26.082522+0000","last_undegraded":"2023-07-20T10:08:26.082522+0000","last_fullsized":"2023-07-20T10:08:26.082522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:11:36.318320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"122'3","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538497+0000","last_change":"2023-07-20T10:08:24.083329+0000","last_active":"2023-07-20T10:08:26.538497+0000","last_peered":"2023-07-20T10:08:26.538497+0000","last_clean":"2023-07-20T10:08:26.538497+0000","last_became_active":"2023-07-20T10:08:24.082973+0000","last_became_peered":"2023-07-20T10:08:24.082973+0000","last_unstale":"2023-07-20T10:08:26.538497+0000","last_undegraded":"2023-07-20T10:08:26.538497+0000","last_fullsized":"2023-07-20T10:08:26.538497+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:42.954255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084439+0000","last_change":"2023-07-20T10:08:25.086969+0000","last_active":"2023-07-20T10:08:26.084439+0000","last_peered":"2023-07-20T10:08:26.084439+0000","last_clean":"2023-07-20T10:08:26.084439+0000","last_became_active":"2023-07-20T10:08:25.086729+0000","last_became_peered":"2023-07-20T10:08:25.086729+0000","last_unstale":"2023-07-20T10:08:26.084439+0000","last_undegraded":"2023-07-20T10:08:26.084439+0000","last_fullsized":"2023-07-20T10:08:26.084439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:02:28.673617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"122'6","reported_seq":19,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538743+0000","last_change":"2023-07-20T10:08:24.080019+0000","last_active":"2023-07-20T10:08:26.538743+0000","last_peered":"2023-07-20T10:08:26.538743+0000","last_clean":"2023-07-20T10:08:26.538743+0000","last_became_active":"2023-07-20T10:08:24.079668+0000","last_became_peered":"2023-07-20T10:08:24.079668+0000","last_unstale":"2023-07-20T10:08:26.538743+0000","last_undegraded":"2023-07-20T10:08:26.538743+0000","last_fullsized":"2023-07-20T10:08:26.538743+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:06:28.749247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086973+0000","last_change":"2023-07-20T10:08:25.093705+0000","last_active":"2023-07-20T10:08:26.086973+0000","last_peered":"2023-07-20T10:08:26.086973+0000","last_clean":"2023-07-20T10:08:26.086973+0000","last_became_active":"2023-07-20T10:08:25.093407+0000","last_became_peered":"2023-07-20T10:08:25.093407+0000","last_unstale":"2023-07-20T10:08:26.086973+0000","last_undegraded":"2023-07-20T10:08:26.086973+0000","last_fullsized":"2023-07-20T10:08:26.086973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:49:22.431516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084448+0000","last_change":"2023-07-20T10:08:24.079405+0000","last_active":"2023-07-20T10:08:26.084448+0000","last_peered":"2023-07-20T10:08:26.084448+0000","last_clean":"2023-07-20T10:08:26.084448+0000","last_became_active":"2023-07-20T10:08:24.079112+0000","last_became_peered":"2023-07-20T10:08:24.079112+0000","last_unstale":"2023-07-20T10:08:26.084448+0000","last_undegraded":"2023-07-20T10:08:26.084448+0000","last_fullsized":"2023-07-20T10:08:26.084448+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:04.004519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539351+0000","last_change":"2023-07-20T10:08:25.090341+0000","last_active":"2023-07-20T10:08:26.539351+0000","last_peered":"2023-07-20T10:08:26.539351+0000","last_clean":"2023-07-20T10:08:26.539351+0000","last_became_active":"2023-07-20T10:08:25.089826+0000","last_became_peered":"2023-07-20T10:08:25.089826+0000","last_unstale":"2023-07-20T10:08:26.539351+0000","last_undegraded":"2023-07-20T10:08:26.539351+0000","last_fullsized":"2023-07-20T10:08:26.539351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:54:35.201308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534687+0000","last_change":"2023-07-20T10:08:24.071808+0000","last_active":"2023-07-20T10:08:26.534687+0000","last_peered":"2023-07-20T10:08:26.534687+0000","last_clean":"2023-07-20T10:08:26.534687+0000","last_became_active":"2023-07-20T10:08:24.071549+0000","last_became_peered":"2023-07-20T10:08:24.071549+0000","last_unstale":"2023-07-20T10:08:26.534687+0000","last_undegraded":"2023-07-20T10:08:26.534687+0000","last_fullsized":"2023-07-20T10:08:26.534687+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:16.653765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082682+0000","last_change":"2023-07-20T10:08:25.082561+0000","last_active":"2023-07-20T10:08:26.082682+0000","last_peered":"2023-07-20T10:08:26.082682+0000","last_clean":"2023-07-20T10:08:26.082682+0000","last_became_active":"2023-07-20T10:08:25.082297+0000","last_became_peered":"2023-07-20T10:08:25.082297+0000","last_unstale":"2023-07-20T10:08:26.082682+0000","last_undegraded":"2023-07-20T10:08:26.082682+0000","last_fullsized":"2023-07-20T10:08:26.082682+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:42:14.111684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082338+0000","last_change":"2023-07-20T10:08:24.074328+0000","last_active":"2023-07-20T10:08:26.082338+0000","last_peered":"2023-07-20T10:08:26.082338+0000","last_clean":"2023-07-20T10:08:26.082338+0000","last_became_active":"2023-07-20T10:08:24.074063+0000","last_became_peered":"2023-07-20T10:08:24.074063+0000","last_unstale":"2023-07-20T10:08:26.082338+0000","last_undegraded":"2023-07-20T10:08:26.082338+0000","last_fullsized":"2023-07-20T10:08:26.082338+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:24:21.227206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535339+0000","last_change":"2023-07-20T10:08:25.088276+0000","last_active":"2023-07-20T10:08:26.535339+0000","last_peered":"2023-07-20T10:08:26.535339+0000","last_clean":"2023-07-20T10:08:26.535339+0000","last_became_active":"2023-07-20T10:08:25.085953+0000","last_became_peered":"2023-07-20T10:08:25.085953+0000","last_unstale":"2023-07-20T10:08:26.535339+0000","last_undegraded":"2023-07-20T10:08:26.535339+0000","last_fullsized":"2023-07-20T10:08:26.535339+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:08:15.361692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"122'8","reported_seq":21,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538097+0000","last_change":"2023-07-20T10:08:24.078588+0000","last_active":"2023-07-20T10:08:26.538097+0000","last_peered":"2023-07-20T10:08:26.538097+0000","last_clean":"2023-07-20T10:08:26.538097+0000","last_became_active":"2023-07-20T10:08:24.078239+0000","last_became_peered":"2023-07-20T10:08:24.078239+0000","last_unstale":"2023-07-20T10:08:26.538097+0000","last_undegraded":"2023-07-20T10:08:26.538097+0000","last_fullsized":"2023-07-20T10:08:26.538097+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.938490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534698+0000","last_change":"2023-07-20T10:08:25.085930+0000","last_active":"2023-07-20T10:08:26.534698+0000","last_peered":"2023-07-20T10:08:26.534698+0000","last_clean":"2023-07-20T10:08:26.534698+0000","last_became_active":"2023-07-20T10:08:25.085648+0000","last_became_peered":"2023-07-20T10:08:25.085648+0000","last_unstale":"2023-07-20T10:08:26.534698+0000","last_undegraded":"2023-07-20T10:08:26.534698+0000","last_fullsized":"2023-07-20T10:08:26.534698+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:37:47.998853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083893+0000","last_change":"2023-07-20T10:08:24.079483+0000","last_active":"2023-07-20T10:08:26.083893+0000","last_peered":"2023-07-20T10:08:26.083893+0000","last_clean":"2023-07-20T10:08:26.083893+0000","last_became_active":"2023-07-20T10:08:24.079204+0000","last_became_peered":"2023-07-20T10:08:24.079204+0000","last_unstale":"2023-07-20T10:08:26.083893+0000","last_undegraded":"2023-07-20T10:08:26.083893+0000","last_fullsized":"2023-07-20T10:08:26.083893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:15.845862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538847+0000","last_change":"2023-07-20T10:08:25.085784+0000","last_active":"2023-07-20T10:08:26.538847+0000","last_peered":"2023-07-20T10:08:26.538847+0000","last_clean":"2023-07-20T10:08:26.538847+0000","last_became_active":"2023-07-20T10:08:25.085513+0000","last_became_peered":"2023-07-20T10:08:25.085513+0000","last_unstale":"2023-07-20T10:08:26.538847+0000","last_undegraded":"2023-07-20T10:08:26.538847+0000","last_fullsized":"2023-07-20T10:08:26.538847+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:09.648971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"123'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534948+0000","last_change":"2023-07-20T10:08:24.074944+0000","last_active":"2023-07-20T10:08:26.534948+0000","last_peered":"2023-07-20T10:08:26.534948+0000","last_clean":"2023-07-20T10:08:26.534948+0000","last_became_active":"2023-07-20T10:08:24.074497+0000","last_became_peered":"2023-07-20T10:08:24.074497+0000","last_unstale":"2023-07-20T10:08:26.534948+0000","last_undegraded":"2023-07-20T10:08:26.534948+0000","last_fullsized":"2023-07-20T10:08:26.534948+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:42.889551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534513+0000","last_change":"2023-07-20T10:08:25.088216+0000","last_active":"2023-07-20T10:08:26.534513+0000","last_peered":"2023-07-20T10:08:26.534513+0000","last_clean":"2023-07-20T10:08:26.534513+0000","last_became_active":"2023-07-20T10:08:25.087892+0000","last_became_peered":"2023-07-20T10:08:25.087892+0000","last_unstale":"2023-07-20T10:08:26.534513+0000","last_undegraded":"2023-07-20T10:08:26.534513+0000","last_fullsized":"2023-07-20T10:08:26.534513+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:00.755081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538788+0000","last_change":"2023-07-20T10:08:24.084219+0000","last_active":"2023-07-20T10:08:26.538788+0000","last_peered":"2023-07-20T10:08:26.538788+0000","last_clean":"2023-07-20T10:08:26.538788+0000","last_became_active":"2023-07-20T10:08:24.083944+0000","last_became_peered":"2023-07-20T10:08:24.083944+0000","last_unstale":"2023-07-20T10:08:26.538788+0000","last_undegraded":"2023-07-20T10:08:26.538788+0000","last_fullsized":"2023-07-20T10:08:26.538788+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:56:29.502468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086706+0000","last_change":"2023-07-20T10:08:25.094537+0000","last_active":"2023-07-20T10:08:26.086706+0000","last_peered":"2023-07-20T10:08:26.086706+0000","last_clean":"2023-07-20T10:08:26.086706+0000","last_became_active":"2023-07-20T10:08:25.094223+0000","last_became_peered":"2023-07-20T10:08:25.094223+0000","last_unstale":"2023-07-20T10:08:26.086706+0000","last_undegraded":"2023-07-20T10:08:26.086706+0000","last_fullsized":"2023-07-20T10:08:26.086706+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:52.301655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.083891+0000","last_change":"2023-07-20T10:08:24.080323+0000","last_active":"2023-07-20T10:08:26.083891+0000","last_peered":"2023-07-20T10:08:26.083891+0000","last_clean":"2023-07-20T10:08:26.083891+0000","last_became_active":"2023-07-20T10:08:24.079747+0000","last_became_peered":"2023-07-20T10:08:24.079747+0000","last_unstale":"2023-07-20T10:08:26.083891+0000","last_undegraded":"2023-07-20T10:08:26.083891+0000","last_fullsized":"2023-07-20T10:08:26.083891+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:23:59.889428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082482+0000","last_change":"2023-07-20T10:08:25.094496+0000","last_active":"2023-07-20T10:08:26.082482+0000","last_peered":"2023-07-20T10:08:26.082482+0000","last_clean":"2023-07-20T10:08:26.082482+0000","last_became_active":"2023-07-20T10:08:25.094212+0000","last_became_peered":"2023-07-20T10:08:25.094212+0000","last_unstale":"2023-07-20T10:08:26.082482+0000","last_undegraded":"2023-07-20T10:08:26.082482+0000","last_fullsized":"2023-07-20T10:08:26.082482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:45.806454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539464+0000","last_change":"2023-07-20T10:08:24.075301+0000","last_active":"2023-07-20T10:08:26.539464+0000","last_peered":"2023-07-20T10:08:26.539464+0000","last_clean":"2023-07-20T10:08:26.539464+0000","last_became_active":"2023-07-20T10:08:24.075003+0000","last_became_peered":"2023-07-20T10:08:24.075003+0000","last_unstale":"2023-07-20T10:08:26.539464+0000","last_undegraded":"2023-07-20T10:08:26.539464+0000","last_fullsized":"2023-07-20T10:08:26.539464+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:48:03.670810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082621+0000","last_change":"2023-07-20T10:08:25.086018+0000","last_active":"2023-07-20T10:08:26.082621+0000","last_peered":"2023-07-20T10:08:26.082621+0000","last_clean":"2023-07-20T10:08:26.082621+0000","last_became_active":"2023-07-20T10:08:25.085744+0000","last_became_peered":"2023-07-20T10:08:25.085744+0000","last_unstale":"2023-07-20T10:08:26.082621+0000","last_undegraded":"2023-07-20T10:08:26.082621+0000","last_fullsized":"2023-07-20T10:08:26.082621+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:32.968009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082595+0000","last_change":"2023-07-20T10:08:24.071090+0000","last_active":"2023-07-20T10:08:26.082595+0000","last_peered":"2023-07-20T10:08:26.082595+0000","last_clean":"2023-07-20T10:08:26.082595+0000","last_became_active":"2023-07-20T10:08:24.070806+0000","last_became_peered":"2023-07-20T10:08:24.070806+0000","last_unstale":"2023-07-20T10:08:26.082595+0000","last_undegraded":"2023-07-20T10:08:26.082595+0000","last_fullsized":"2023-07-20T10:08:26.082595+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:45:17.226186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538213+0000","last_change":"2023-07-20T10:08:25.096630+0000","last_active":"2023-07-20T10:08:26.538213+0000","last_peered":"2023-07-20T10:08:26.538213+0000","last_clean":"2023-07-20T10:08:26.538213+0000","last_became_active":"2023-07-20T10:08:25.096342+0000","last_became_peered":"2023-07-20T10:08:25.096342+0000","last_unstale":"2023-07-20T10:08:26.538213+0000","last_undegraded":"2023-07-20T10:08:26.538213+0000","last_fullsized":"2023-07-20T10:08:26.538213+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:57:33.401362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538900+0000","last_change":"2023-07-20T10:08:24.084619+0000","last_active":"2023-07-20T10:08:26.538900+0000","last_peered":"2023-07-20T10:08:26.538900+0000","last_clean":"2023-07-20T10:08:26.538900+0000","last_became_active":"2023-07-20T10:08:24.083543+0000","last_became_peered":"2023-07-20T10:08:24.083543+0000","last_unstale":"2023-07-20T10:08:26.538900+0000","last_undegraded":"2023-07-20T10:08:26.538900+0000","last_fullsized":"2023-07-20T10:08:26.538900+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:33.286678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.087154+0000","last_change":"2023-07-20T10:08:25.094327+0000","last_active":"2023-07-20T10:08:26.087154+0000","last_peered":"2023-07-20T10:08:26.087154+0000","last_clean":"2023-07-20T10:08:26.087154+0000","last_became_active":"2023-07-20T10:08:25.093974+0000","last_became_peered":"2023-07-20T10:08:25.093974+0000","last_unstale":"2023-07-20T10:08:26.087154+0000","last_undegraded":"2023-07-20T10:08:26.087154+0000","last_fullsized":"2023-07-20T10:08:26.087154+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:50.817306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082564+0000","last_change":"2023-07-20T10:08:24.073323+0000","last_active":"2023-07-20T10:08:26.082564+0000","last_peered":"2023-07-20T10:08:26.082564+0000","last_clean":"2023-07-20T10:08:26.082564+0000","last_became_active":"2023-07-20T10:08:24.072992+0000","last_became_peered":"2023-07-20T10:08:24.072992+0000","last_unstale":"2023-07-20T10:08:26.082564+0000","last_undegraded":"2023-07-20T10:08:26.082564+0000","last_fullsized":"2023-07-20T10:08:26.082564+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:38:45.644601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086884+0000","last_change":"2023-07-20T10:08:25.084756+0000","last_active":"2023-07-20T10:08:26.086884+0000","last_peered":"2023-07-20T10:08:26.086884+0000","last_clean":"2023-07-20T10:08:26.086884+0000","last_became_active":"2023-07-20T10:08:25.084370+0000","last_became_peered":"2023-07-20T10:08:25.084370+0000","last_unstale":"2023-07-20T10:08:26.086884+0000","last_undegraded":"2023-07-20T10:08:26.086884+0000","last_fullsized":"2023-07-20T10:08:26.086884+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:38.433026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082764+0000","last_change":"2023-07-20T10:08:24.071717+0000","last_active":"2023-07-20T10:08:26.082764+0000","last_peered":"2023-07-20T10:08:26.082764+0000","last_clean":"2023-07-20T10:08:26.082764+0000","last_became_active":"2023-07-20T10:08:24.071411+0000","last_became_peered":"2023-07-20T10:08:24.071411+0000","last_unstale":"2023-07-20T10:08:26.082764+0000","last_undegraded":"2023-07-20T10:08:26.082764+0000","last_fullsized":"2023-07-20T10:08:26.082764+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:04.521157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'205","reported_seq":666,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538088+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:08:26.538088+0000","last_peered":"2023-07-20T10:08:26.538088+0000","last_clean":"2023-07-20T10:08:26.538088+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:08:26.538088+0000","last_undegraded":"2023-07-20T10:08:26.538088+0000","last_fullsized":"2023-07-20T10:08:26.538088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:45.152092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086946+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:08:26.086946+0000","last_peered":"2023-07-20T10:08:26.086946+0000","last_clean":"2023-07-20T10:08:26.086946+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:08:26.086946+0000","last_undegraded":"2023-07-20T10:08:26.086946+0000","last_fullsized":"2023-07-20T10:08:26.086946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:10:51.943849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538446+0000","last_change":"2023-07-20T10:08:25.091219+0000","last_active":"2023-07-20T10:08:26.538446+0000","last_peered":"2023-07-20T10:08:26.538446+0000","last_clean":"2023-07-20T10:08:26.538446+0000","last_became_active":"2023-07-20T10:08:25.090943+0000","last_became_peered":"2023-07-20T10:08:25.090943+0000","last_unstale":"2023-07-20T10:08:26.538446+0000","last_undegraded":"2023-07-20T10:08:26.538446+0000","last_fullsized":"2023-07-20T10:08:26.538446+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:27:23.587967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538641+0000","last_change":"2023-07-20T10:08:24.087507+0000","last_active":"2023-07-20T10:08:26.538641+0000","last_peered":"2023-07-20T10:08:26.538641+0000","last_clean":"2023-07-20T10:08:26.538641+0000","last_became_active":"2023-07-20T10:08:24.087114+0000","last_became_peered":"2023-07-20T10:08:24.087114+0000","last_unstale":"2023-07-20T10:08:26.538641+0000","last_undegraded":"2023-07-20T10:08:26.538641+0000","last_fullsized":"2023-07-20T10:08:26.538641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:32.610312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":198,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.537905+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:08:26.537905+0000","last_peered":"2023-07-20T10:08:26.537905+0000","last_clean":"2023-07-20T10:08:26.537905+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:08:26.537905+0000","last_undegraded":"2023-07-20T10:08:26.537905+0000","last_fullsized":"2023-07-20T10:08:26.537905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:23:11.970939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084346+0000","last_change":"2023-07-20T10:08:25.096821+0000","last_active":"2023-07-20T10:08:26.084346+0000","last_peered":"2023-07-20T10:08:26.084346+0000","last_clean":"2023-07-20T10:08:26.084346+0000","last_became_active":"2023-07-20T10:08:25.096524+0000","last_became_peered":"2023-07-20T10:08:25.096524+0000","last_unstale":"2023-07-20T10:08:26.084346+0000","last_undegraded":"2023-07-20T10:08:26.084346+0000","last_fullsized":"2023-07-20T10:08:26.084346+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:42:14.709711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086796+0000","last_change":"2023-07-20T10:08:24.080552+0000","last_active":"2023-07-20T10:08:26.086796+0000","last_peered":"2023-07-20T10:08:26.086796+0000","last_clean":"2023-07-20T10:08:26.086796+0000","last_became_active":"2023-07-20T10:08:24.080267+0000","last_became_peered":"2023-07-20T10:08:24.080267+0000","last_unstale":"2023-07-20T10:08:26.086796+0000","last_undegraded":"2023-07-20T10:08:26.086796+0000","last_fullsized":"2023-07-20T10:08:26.086796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:26.816286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":217,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082452+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:08:26.082452+0000","last_peered":"2023-07-20T10:08:26.082452+0000","last_clean":"2023-07-20T10:08:26.082452+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:08:26.082452+0000","last_undegraded":"2023-07-20T10:08:26.082452+0000","last_fullsized":"2023-07-20T10:08:26.082452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:38:24.438055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082480+0000","last_change":"2023-07-20T10:08:25.094884+0000","last_active":"2023-07-20T10:08:26.082480+0000","last_peered":"2023-07-20T10:08:26.082480+0000","last_clean":"2023-07-20T10:08:26.082480+0000","last_became_active":"2023-07-20T10:08:25.094564+0000","last_became_peered":"2023-07-20T10:08:25.094564+0000","last_unstale":"2023-07-20T10:08:26.082480+0000","last_undegraded":"2023-07-20T10:08:26.082480+0000","last_fullsized":"2023-07-20T10:08:26.082480+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:11:43.490249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"122'1","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539409+0000","last_change":"2023-07-20T10:08:24.077842+0000","last_active":"2023-07-20T10:08:26.539409+0000","last_peered":"2023-07-20T10:08:26.539409+0000","last_clean":"2023-07-20T10:08:26.539409+0000","last_became_active":"2023-07-20T10:08:24.077557+0000","last_became_peered":"2023-07-20T10:08:24.077557+0000","last_unstale":"2023-07-20T10:08:26.539409+0000","last_undegraded":"2023-07-20T10:08:26.539409+0000","last_fullsized":"2023-07-20T10:08:26.539409+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:33:36.379933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.086789+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:08:26.086789+0000","last_peered":"2023-07-20T10:08:26.086789+0000","last_clean":"2023-07-20T10:08:26.086789+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:08:26.086789+0000","last_undegraded":"2023-07-20T10:08:26.086789+0000","last_fullsized":"2023-07-20T10:08:26.086789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:57:25.070233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.534831+0000","last_change":"2023-07-20T10:08:25.089339+0000","last_active":"2023-07-20T10:08:26.534831+0000","last_peered":"2023-07-20T10:08:26.534831+0000","last_clean":"2023-07-20T10:08:26.534831+0000","last_became_active":"2023-07-20T10:08:25.087113+0000","last_became_peered":"2023-07-20T10:08:25.087113+0000","last_unstale":"2023-07-20T10:08:26.534831+0000","last_undegraded":"2023-07-20T10:08:26.534831+0000","last_fullsized":"2023-07-20T10:08:26.534831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:44:25.037278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538754+0000","last_change":"2023-07-20T10:08:24.084995+0000","last_active":"2023-07-20T10:08:26.538754+0000","last_peered":"2023-07-20T10:08:26.538754+0000","last_clean":"2023-07-20T10:08:26.538754+0000","last_became_active":"2023-07-20T10:08:24.084689+0000","last_became_peered":"2023-07-20T10:08:24.084689+0000","last_unstale":"2023-07-20T10:08:26.538754+0000","last_undegraded":"2023-07-20T10:08:26.538754+0000","last_fullsized":"2023-07-20T10:08:26.538754+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:35.867552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084034+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:08:26.084034+0000","last_peered":"2023-07-20T10:08:26.084034+0000","last_clean":"2023-07-20T10:08:26.084034+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:08:26.084034+0000","last_undegraded":"2023-07-20T10:08:26.084034+0000","last_fullsized":"2023-07-20T10:08:26.084034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:19.610923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082961+0000","last_change":"2023-07-20T10:08:25.094668+0000","last_active":"2023-07-20T10:08:26.082961+0000","last_peered":"2023-07-20T10:08:26.082961+0000","last_clean":"2023-07-20T10:08:26.082961+0000","last_became_active":"2023-07-20T10:08:25.086332+0000","last_became_peered":"2023-07-20T10:08:25.086332+0000","last_unstale":"2023-07-20T10:08:26.082961+0000","last_undegraded":"2023-07-20T10:08:26.082961+0000","last_fullsized":"2023-07-20T10:08:26.082961+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:04:47.149375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082510+0000","last_change":"2023-07-20T10:08:24.071885+0000","last_active":"2023-07-20T10:08:26.082510+0000","last_peered":"2023-07-20T10:08:26.082510+0000","last_clean":"2023-07-20T10:08:26.082510+0000","last_became_active":"2023-07-20T10:08:24.071609+0000","last_became_peered":"2023-07-20T10:08:24.071609+0000","last_unstale":"2023-07-20T10:08:26.082510+0000","last_undegraded":"2023-07-20T10:08:26.082510+0000","last_fullsized":"2023-07-20T10:08:26.082510+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:13:03.009413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":197,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.538752+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:08:26.538752+0000","last_peered":"2023-07-20T10:08:26.538752+0000","last_clean":"2023-07-20T10:08:26.538752+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:08:26.538752+0000","last_undegraded":"2023-07-20T10:08:26.538752+0000","last_fullsized":"2023-07-20T10:08:26.538752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:14:56.935188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535227+0000","last_change":"2023-07-20T10:08:25.089410+0000","last_active":"2023-07-20T10:08:26.535227+0000","last_peered":"2023-07-20T10:08:26.535227+0000","last_clean":"2023-07-20T10:08:26.535227+0000","last_became_active":"2023-07-20T10:08:25.089100+0000","last_became_peered":"2023-07-20T10:08:25.089100+0000","last_unstale":"2023-07-20T10:08:26.535227+0000","last_undegraded":"2023-07-20T10:08:26.535227+0000","last_fullsized":"2023-07-20T10:08:26.535227+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:13:07.242343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"122'2","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082796+0000","last_change":"2023-07-20T10:08:24.073395+0000","last_active":"2023-07-20T10:08:26.082796+0000","last_peered":"2023-07-20T10:08:26.082796+0000","last_clean":"2023-07-20T10:08:26.082796+0000","last_became_active":"2023-07-20T10:08:24.073129+0000","last_became_peered":"2023-07-20T10:08:24.073129+0000","last_unstale":"2023-07-20T10:08:26.082796+0000","last_undegraded":"2023-07-20T10:08:26.082796+0000","last_fullsized":"2023-07-20T10:08:26.082796+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:22.490220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":193,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.084163+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:08:26.084163+0000","last_peered":"2023-07-20T10:08:26.084163+0000","last_clean":"2023-07-20T10:08:26.084163+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:08:26.084163+0000","last_undegraded":"2023-07-20T10:08:26.084163+0000","last_fullsized":"2023-07-20T10:08:26.084163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:40:56.455614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.535332+0000","last_change":"2023-07-20T10:08:25.088113+0000","last_active":"2023-07-20T10:08:26.535332+0000","last_peered":"2023-07-20T10:08:26.535332+0000","last_clean":"2023-07-20T10:08:26.535332+0000","last_became_active":"2023-07-20T10:08:25.087582+0000","last_became_peered":"2023-07-20T10:08:25.087582+0000","last_unstale":"2023-07-20T10:08:26.535332+0000","last_undegraded":"2023-07-20T10:08:26.535332+0000","last_fullsized":"2023-07-20T10:08:26.535332+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:24.047736+0000","last_clean_scrub_stamp":"2023-07-20T10:08:24.047736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:24.878181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.082341+0000","last_change":"2023-07-20T10:08:24.074895+0000","last_active":"2023-07-20T10:08:26.082341+0000","last_peered":"2023-07-20T10:08:26.082341+0000","last_clean":"2023-07-20T10:08:26.082341+0000","last_became_active":"2023-07-20T10:08:24.074605+0000","last_became_peered":"2023-07-20T10:08:24.074605+0000","last_unstale":"2023-07-20T10:08:26.082341+0000","last_undegraded":"2023-07-20T10:08:26.082341+0000","last_fullsized":"2023-07-20T10:08:26.082341+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:08:23.039609+0000","last_clean_scrub_stamp":"2023-07-20T10:08:23.039609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:15.243950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":195,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-07-20T10:08:26.539443+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:08:26.539443+0000","last_peered":"2023-07-20T10:08:26.539443+0000","last_clean":"2023-07-20T10:08:26.539443+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:08:26.539443+0000","last_undegraded":"2023-07-20T10:08:26.539443+0000","last_fullsized":"2023-07-20T10:08:26.539443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:20.082576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575065,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59432,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312408,"statfs":{"total":96636764160,"available":96575905792,"internally_reserved":0,"allocated":2121728,"data_stored":1354189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.44600000000000001,"5min":0.434,"15min":0.42099999999999999},"max":{"1min":0.98399999999999999,"5min":1.153,"15min":1.153},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.95299999999999996,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69499999999999995,"15min":0.70699999999999996},"min":{"1min":0.504,"5min":0.434,"15min":0.36899999999999999},"max":{"1min":0.89200000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.46100000000000002,"5min":0.38300000000000001,"15min":0.35999999999999999},"max":{"1min":0.90900000000000003,"5min":1.05,"15min":1.075},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.69899999999999995},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.88,"5min":0.99399999999999999,"15min":1.0329999999999999},"last":0.749},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.01,"15min":1.716},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.433},"max":{"1min":0.96899999999999997,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.58799999999999997,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.94799999999999995,"5min":1.3759999999999999,"15min":1.758},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54800000000000004,"15min":0.54000000000000004},"min":{"1min":0.41399999999999998,"5min":0.32800000000000001,"15min":0.31900000000000001},"max":{"1min":0.78700000000000003,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.434},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.46999999999999997,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.92600000000000005,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64300000000000002,"15min":0.61699999999999999},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.32400000000000001},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.8},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.67900000000000005,"15min":0.66800000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77600000000000002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:07:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.875,"5min":0.995,"15min":0.999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63900000000000001},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.86399999999999999,"5min":1.0840000000000001,"15min":1.1220000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575067,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1540096,"data_stored":765829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.73799999999999999},"min":{"1min":0.34699999999999998,"5min":0.33200000000000002,"15min":0.32000000000000001},"max":{"1min":0.90000000000000002,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.752,"15min":0.77900000000000003},"min":{"1min":0.56000000000000005,"5min":0.48599999999999999,"15min":0.40899999999999997},"max":{"1min":0.89300000000000002,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70299999999999996,"15min":0.72099999999999997},"min":{"1min":0.53800000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.99299999999999999,"5min":1.04,"15min":1.1259999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.98899999999999999,"15min":1.103},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68000000000000005,"15min":0.70999999999999996},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85799999999999998,"5min":0.96699999999999997,"15min":1.2230000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70499999999999996,"15min":0.72499999999999998},"min":{"1min":0.58399999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72899999999999998,"15min":0.74399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93000000000000005,"5min":1.1000000000000001,"15min":1.25},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71499999999999997,"15min":0.73499999999999999},"min":{"1min":0.57099999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90100000000000002,"5min":0.95299999999999996,"15min":1.272},"last":0.63100000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":0.98699999999999999,"15min":1.173},"last":0.496},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.40600000000000003},"max":{"1min":0.92000000000000004,"5min":1.135,"15min":1.135},"last":0.752}]},{"osd":5,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.93999999999999995,"5min":0.996,"15min":0.996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63,"15min":0.61899999999999999},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":1.024,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:07:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.624,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":1.1160000000000001,"15min":1.155},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66500000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":0.85399999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.76800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575065,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50652,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321188,"statfs":{"total":96636764160,"available":96584896512,"internally_reserved":0,"allocated":1519616,"data_stored":763661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":0.88700000000000001,"5min":0.94399999999999995,"15min":1.0329999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.91000000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72299999999999998,"15min":0.72799999999999998},"min":{"1min":0.50800000000000001,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":0.872,"5min":0.98699999999999999,"15min":1.0620000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.036},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":1.0269999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.59499999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.034},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.94899999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.42599999999999999,"5min":0.35499999999999998,"15min":0.28599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.92300000000000004,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.628},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.0089999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63100000000000001,"15min":0.64900000000000002},"min":{"1min":0.46000000000000002,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.95199999999999996,"15min":1.024},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.48399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90800000000000003,"5min":1.0209999999999999,"15min":1.0680000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.67100000000000004,"15min":0.70199999999999996},"min":{"1min":0.434,"5min":0.42899999999999999,"15min":0.41099999999999998},"max":{"1min":0.90800000000000003,"5min":0.96499999999999997,"15min":1.0049999999999999},"last":0.91700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575065,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1527808,"data_stored":763753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.67500000000000004,"15min":0.71099999999999997},"min":{"1min":0.49099999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95799999999999996,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.54400000000000004,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.97199999999999998,"5min":0.98199999999999998,"15min":1.085},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68300000000000005,"15min":0.71899999999999997},"min":{"1min":0.54100000000000004,"5min":0.42199999999999999,"15min":0.39800000000000002},"max":{"1min":0.94099999999999995,"5min":0.95899999999999996,"15min":1.141},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66700000000000004,"15min":0.70299999999999996},"min":{"1min":0.45900000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.92600000000000005,"5min":0.98599999999999999,"15min":1.363},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.501,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.01,"5min":1.149,"15min":1.177},"last":0.62},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.63,"5min":0.48999999999999999,"15min":0.48299999999999998},"max":{"1min":1.002,"5min":1.159,"15min":1.23},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.51700000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.55900000000000005,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61599999999999999,"15min":0.625},"min":{"1min":0.38700000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.98899999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64100000000000001},"min":{"1min":0.42399999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.196},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.35999999999999999,"15min":0.32700000000000001},"max":{"1min":0.97199999999999998,"5min":0.97499999999999998,"15min":1.004},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70599999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.034},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:07:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.46600000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85099999999999998,"5min":0.85599999999999998,"15min":1.2649999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65600000000000003,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.443}]}]},{"osd":3,"up_from":13,"seq":55834575064,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1523712,"data_stored":764243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.26300000000000001,"5min":0.25600000000000001,"15min":0.255},"max":{"1min":0.60199999999999998,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.505,"15min":0.52400000000000002},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52400000000000002,"15min":0.55200000000000005},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.38700000000000001},"max":{"1min":0.76200000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.755,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.76600000000000001},"min":{"1min":0.55300000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":1.002,"5min":1.083,"15min":1.1890000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.74399999999999999,"15min":0.78300000000000003},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.45900000000000002},"max":{"1min":0.98299999999999998,"5min":1.071,"15min":1.381},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73599999999999999,"15min":0.77900000000000003},"min":{"1min":0.57499999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.51300000000000001,"15min":0.42099999999999999},"max":{"1min":0.96999999999999997,"5min":1.052,"15min":1.3260000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.752,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95499999999999996,"5min":1.1160000000000001,"15min":1.274},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72699999999999998,"15min":0.76800000000000002},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.0129999999999999,"5min":1.04,"15min":1.131},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:07:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.4399999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.155,"15min":1.5049999999999999},"last":0.78200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575064,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54748,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94317092,"statfs":{"total":96636764160,"available":96580702208,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.47499999999999998},"min":{"1min":0.312,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.69299999999999995,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.68899999999999995,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.45600000000000002,"15min":0.47099999999999997},"min":{"1min":0.32800000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56200000000000006,"5min":0.68899999999999995,"15min":0.876},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77700000000000002,"15min":0.96899999999999997},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.93000000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.41199999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.77800000000000002,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.78000000000000003},"min":{"1min":0.58799999999999997,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.0289999999999999,"5min":1.1890000000000001,"15min":1.25},"last":0.628},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77600000000000002,"15min":0.79900000000000004},"min":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.41899999999999998},"max":{"1min":1.127,"5min":1.127,"15min":1.2689999999999999},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.55900000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77900000000000003,"15min":0.79200000000000004},"min":{"1min":0.59299999999999997,"5min":0.53100000000000003,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.0680000000000001,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.069,"5min":1.218,"15min":1.3240000000000001},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81799999999999995},"min":{"1min":0.58799999999999997,"5min":0.52100000000000002,"15min":0.46400000000000002},"max":{"1min":1.024,"5min":1.143,"15min":1.292},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.82099999999999995},"min":{"1min":0.61499999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.095,"5min":1.204,"15min":1.393},"last":0.70199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575065,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1523712,"data_stored":763695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.44800000000000001,"15min":0.46100000000000002},"min":{"1min":0.28000000000000003,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55200000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.53600000000000003},"min":{"1min":0.42699999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.754,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.505}]},{"osd":2,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.34999999999999998,"5min":0.33500000000000002,"15min":0.28899999999999998},"max":{"1min":0.68600000000000005,"5min":0.81100000000000005,"15min":0.88300000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.56899999999999995},"min":{"1min":0.42599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67100000000000004,"5min":0.81200000000000006,"15min":0.82599999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77900000000000003,"5min":1.399,"15min":1.399},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72099999999999997,"15min":0.745},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":1.083,"15min":1.1779999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.59399999999999997,"5min":0.51600000000000001,"15min":0.47599999999999998},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.61799999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.998,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72499999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.85299999999999998,"5min":1.1080000000000001,"15min":1.1559999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.752,"15min":0.76900000000000002},"min":{"1min":0.53300000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0309999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.752,"15min":0.77400000000000002},"min":{"1min":0.56899999999999995,"5min":0.503,"15min":0.48499999999999999},"max":{"1min":1.012,"5min":1.0389999999999999,"15min":1.107},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:07:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.61399999999999999,"5min":0.51000000000000001,"15min":0.45000000000000001},"max":{"1min":0.99299999999999999,"5min":1.0509999999999999,"15min":1.6060000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.97299999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.60999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575065,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2129920,"data_stored":1355683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42899999999999999,"15min":0.45500000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.247},"max":{"1min":0.58599999999999997,"5min":0.64000000000000001,"15min":3.0710000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.52600000000000002,"15min":0.55100000000000005},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.63900000000000001,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.625}]},{"osd":2,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.501,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.748,"5min":0.748,"15min":3.2509999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.71799999999999997,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53400000000000003,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.79900000000000004},"min":{"1min":0.55400000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.036,"5min":1.232,"15min":1.6779999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77000000000000002,"15min":0.80900000000000005},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.216,"5min":1.216,"15min":3.125},"last":0.746}]},{"osd":5,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.84399999999999997},"min":{"1min":0.53400000000000003,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.0649999999999999,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78400000000000003,"15min":0.81100000000000005},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.81799999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0940000000000001,"5min":1.1950000000000001,"15min":3.161},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.83799999999999997},"min":{"1min":0.58099999999999996,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.1739999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:07:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.82599999999999996,"15min":0.85999999999999999},"min":{"1min":0.55200000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3009999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.81799999999999995},"min":{"1min":0.60699999999999998,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.3089999999999999,"15min":1.766},"last":0.875}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:08:34.042 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:08:34.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:08:34.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 Processor -- start 2023-07-20T10:08:34.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 -- start start 2023-07-20T10:08:34.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7efc8c158ce0 0x7efc8c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c0c95d0 con 0x7efc8c070970 2023-07-20T10:08:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c0c9fa0 con 0x7efc8c158ce0 2023-07-20T10:08:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc92b8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c1590c0 con 0x7efc8c06bd30 2023-07-20T10:08:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc83fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efc8c070970 0x7efc8c06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46260/0 (socket says 172.21.15.82:46260) 2023-07-20T10:08:34.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc83fff640 1 -- 172.21.15.82:0/1673670357 learned_addr learned my addr 172.21.15.82:0/1673670357 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:34.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9112c640 1 --2- 172.21.15.82:0/1673670357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9092b640 1 --2- 172.21.15.82:0/1673670357 >> v2:172.21.15.183:3300/0 conn(0x7efc8c158ce0 0x7efc8c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702899707 0 0) 0x7efc8c0c95d0 con 0x7efc8c070970 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc74003530 con 0x7efc8c070970 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9112c640 1 -- 172.21.15.82:0/1673670357 >> v2:172.21.15.183:3300/0 conn(0x7efc8c158ce0 msgr2=0x7efc8c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9112c640 1 --2- 172.21.15.82:0/1673670357 >> v2:172.21.15.183:3300/0 conn(0x7efc8c158ce0 0x7efc8c0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9112c640 1 -- 172.21.15.82:0/1673670357 >> v1:172.21.15.82:6789/0 conn(0x7efc8c070970 legacy=0x7efc8c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005907437 0 0) 0x7efc74003530 con 0x7efc8c070970 2023-07-20T10:08:34.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.250+0000 7efc9112c640 1 -- 172.21.15.82:0/1673670357 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0c89c0 con 0x7efc8c06bd30 2023-07-20T10:08:34.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc9112c640 1 --2- 172.21.15.82:0/1673670357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c070e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc84009d90 tx=0x7efc8401c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cc10ec5ba84bfc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c001680 con 0x7efc8c06bd30 2023-07-20T10:08:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840a8440 con 0x7efc8c06bd30 2023-07-20T10:08:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc837fe640 1 -- 172.21.15.82:0/1673670357 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840a87d0 con 0x7efc8c06bd30 2023-07-20T10:08:34.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 -- 172.21.15.82:0/1673670357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 msgr2=0x7efc8c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 --2- 172.21.15.82:0/1673670357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c070e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc84009d90 tx=0x7efc8401c870 comp rx=0 tx=0).stop 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 -- 172.21.15.82:0/1673670357 shutdown_connections 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 --2- 172.21.15.82:0/1673670357 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c070e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 --2- 172.21.15.82:0/1673670357 >> v2:172.21.15.183:3300/0 conn(0x7efc8c158ce0 0x7efc8c0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 -- 172.21.15.82:0/1673670357 >> 172.21.15.82:0/1673670357 conn(0x7efc8c0cad50 msgr2=0x7efc8c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 -- 172.21.15.82:0/1673670357 shutdown_connections 2023-07-20T10:08:34.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.254+0000 7efc92b8f640 1 -- 172.21.15.82:0/1673670357 wait complete. 2023-07-20T10:08:34.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 Processor -- start 2023-07-20T10:08:34.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- start start 2023-07-20T10:08:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8c158ce0 0x7efc8c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0c29f0 con 0x7efc8c070970 2023-07-20T10:08:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0c4240 con 0x7efc8c158ce0 2023-07-20T10:08:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0c4520 con 0x7efc8c06bd30 2023-07-20T10:08:34.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47076/0 (socket says 172.21.15.82:47076) 2023-07-20T10:08:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 -- 172.21.15.82:0/2228234925 learned_addr learned my addr 172.21.15.82:0/2228234925 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc9112c640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8c158ce0 0x7efc8c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc9092b640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 -- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 msgr2=0x7efc8c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c14c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 -- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8c158ce0 msgr2=0x7efc8c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8c158ce0 0x7efc8c14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 -- 172.21.15.82:0/2228234925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009a70 con 0x7efc8c070970 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc83fff640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c760 tx=0x7efc7c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c005ae0 con 0x7efc8c070970 2023-07-20T10:08:34.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c005c40 con 0x7efc8c070970 2023-07-20T10:08:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c007070 con 0x7efc8c070970 2023-07-20T10:08:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c0c4800 con 0x7efc8c070970 2023-07-20T10:08:34.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c0c3df0 con 0x7efc8c070970 2023-07-20T10:08:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.258+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c0c4010 con 0x7efc8c070970 2023-07-20T10:08:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.262+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc7c0071d0 con 0x7efc8c070970 2023-07-20T10:08:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.262+0000 7efc817fa640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.262+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc7c083b90 con 0x7efc8c070970 2023-07-20T10:08:34.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.262+0000 7efc9092b640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.262+0000 7efc9092b640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 0x7efc78068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc8c1f8450 tx=0x7efc88009190 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.266+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc7c054a30 con 0x7efc8c070970 2023-07-20T10:08:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.462+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efc8c04da30 con 0x7efc8c070970 2023-07-20T10:08:34.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.470+0000 7efc817fa640 1 -- 172.21.15.82:0/2228234925 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7efc7c0545c0 con 0x7efc8c070970 2023-07-20T10:08:34.447 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:08:34.448 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:08:34.448 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:08:34.448 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:08:34.448 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:08:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:08:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 msgr2=0x7efc78068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 0x7efc78068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc8c1f8450 tx=0x7efc88009190 comp rx=0 tx=0).stop 2023-07-20T10:08:34.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 msgr2=0x7efc8c0c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c760 tx=0x7efc7c00cc20 comp rx=0 tx=0).stop 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 shutdown_connections 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efc780663a0 0x7efc78068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc8c158ce0 0x7efc8c14f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc8c070970 0x7efc8c0c24b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 --2- 172.21.15.82:0/2228234925 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc8c06bd30 0x7efc8c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 >> 172.21.15.82:0/2228234925 conn(0x7efc8c0cad50 msgr2=0x7efc8c1536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:34.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 shutdown_connections 2023-07-20T10:08:34.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.474+0000 7efc92b8f640 1 -- 172.21.15.82:0/2228234925 wait complete. 2023-07-20T10:08:34.468 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:08:34.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.630+0000 7f0f9a72c640 1 Processor -- start 2023-07-20T10:08:34.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.630+0000 7f0f9a72c640 1 -- start start 2023-07-20T10:08:34.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f9a72c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f940b1cc0 0x7f0f940b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f9a72c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940cdd60 con 0x7f0f940ad720 2023-07-20T10:08:34.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f9a72c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f940b20a0 con 0x7f0f940b04b0 2023-07-20T10:08:34.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f9a72c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f940cd430 con 0x7f0f940b1cc0 2023-07-20T10:08:34.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f940b1cc0 0x7f0f940b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0f940b1cc0 0x7f0f940b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47086/0 (socket says 172.21.15.82:47086) 2023-07-20T10:08:34.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 -- 172.21.15.82:0/4216079634 learned_addr learned my addr 172.21.15.82:0/4216079634 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:34.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 -- 172.21.15.82:0/4216079634 >> v1:172.21.15.183:6789/0 conn(0x7f0f940b04b0 legacy=0x7f0f94160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 -- 172.21.15.82:0/4216079634 >> v1:172.21.15.82:6789/0 conn(0x7f0f940ad720 legacy=0x7f0f940afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.634+0000 7f0f93fff640 1 -- 172.21.15.82:0/4216079634 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940cd710 con 0x7f0f940b1cc0 2023-07-20T10:08:34.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f93fff640 1 --2- 172.21.15.82:0/4216079634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b1cc0 0x7f0f940b2a30 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009870 tx=0x7f0f8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc29a09a713aee7b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f92ffd640 1 -- 172.21.15.82:0/4216079634 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840a6040 con 0x7f0f940b1cc0 2023-07-20T10:08:34.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f92ffd640 1 -- 172.21.15.82:0/4216079634 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f840aa600 con 0x7f0f940b1cc0 2023-07-20T10:08:34.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f92ffd640 1 -- 172.21.15.82:0/4216079634 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840aa990 con 0x7f0f940b1cc0 2023-07-20T10:08:34.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- 172.21.15.82:0/4216079634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b1cc0 msgr2=0x7f0f940b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/4216079634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b1cc0 0x7f0f940b2a30 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009870 tx=0x7f0f8401c480 comp rx=0 tx=0).stop 2023-07-20T10:08:34.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- 172.21.15.82:0/4216079634 shutdown_connections 2023-07-20T10:08:34.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/4216079634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b1cc0 0x7f0f940b2a30 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- 172.21.15.82:0/4216079634 >> 172.21.15.82:0/4216079634 conn(0x7f0f940cada0 msgr2=0x7f0f940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:34.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- 172.21.15.82:0/4216079634 shutdown_connections 2023-07-20T10:08:34.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- 172.21.15.82:0/4216079634 wait complete. 2023-07-20T10:08:34.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 Processor -- start 2023-07-20T10:08:34.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- start start 2023-07-20T10:08:34.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 0x7f0f9414ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f940b1cc0 0x7f0f9415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f940aeef0 con 0x7f0f940b04b0 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f941576c0 con 0x7f0f940ad720 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.638+0000 7f0f9a72c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9414ef70 con 0x7f0f940b1cc0 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47100/0 (socket says 172.21.15.82:47100) 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 -- 172.21.15.82:0/485474075 learned_addr learned my addr 172.21.15.82:0/485474075 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 -- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f940b1cc0 msgr2=0x7f0f9415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f940b1cc0 0x7f0f9415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 -- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 msgr2=0x7f0f9414ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f93fff640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 0x7f0f9414ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 0x7f0f9414ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 -- 172.21.15.82:0/485474075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840094d0 con 0x7f0f940b04b0 2023-07-20T10:08:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f93fff640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 0x7f0f9414ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f937fe640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c3f0 tx=0x7f0f8800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880052d0 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f88005430 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f88003840 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f940b12f0 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f941573e0 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9406d550 con 0x7f0f940b04b0 2023-07-20T10:08:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.642+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0f880039a0 con 0x7f0f940b04b0 2023-07-20T10:08:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.646+0000 7f0f90ff9640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 0x7f0f80068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.646+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f880834e0 con 0x7f0f940b04b0 2023-07-20T10:08:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.646+0000 7f0f93fff640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 0x7f0f80068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:34.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.646+0000 7f0f93fff640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 0x7f0f80068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f840ae000 tx=0x7f0f84008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:34.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.650+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f9406d550 con 0x7f0f940b04b0 2023-07-20T10:08:34.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f940af0a0 con 0x7f0f940b04b0 2023-07-20T10:08:34.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f90ff9640 1 -- 172.21.15.82:0/485474075 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f0f940af0a0 con 0x7f0f940b04b0 2023-07-20T10:08:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:34.802 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:08:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 msgr2=0x7f0f80068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 0x7f0f80068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f840ae000 tx=0x7f0f84008040 comp rx=0 tx=0).stop 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 msgr2=0x7f0f940af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800c3f0 tx=0x7f0f8800c8b0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 shutdown_connections 2023-07-20T10:08:34.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0f940b1cc0 0x7f0f9415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0f940b04b0 0x7f0f940af380 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0f800663a0 0x7f0f80068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 --2- 172.21.15.82:0/485474075 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0f940ad720 0x7f0f9414ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 >> 172.21.15.82:0/485474075 conn(0x7f0f940cada0 msgr2=0x7f0f9406fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 shutdown_connections 2023-07-20T10:08:34.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:34.826+0000 7f0f9a72c640 1 -- 172.21.15.82:0/485474075 wait complete. 2023-07-20T10:08:35.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:08:24.436796+0000', 'modified': '2023-07-20T10:08:28.088269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8412}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8412': {'gid': 8412, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/4045822955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 4045822955}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 4045822955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:08:35.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:08:35.225 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T10:08:35.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.394+0000 7efce7e9c640 1 Processor -- start 2023-07-20T10:08:35.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.394+0000 7efce7e9c640 1 -- start start 2023-07-20T10:08:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce7e9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efce01596b0 0x7efce015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce7e9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce7e9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00ccd60 con 0x7efce00b2380 2023-07-20T10:08:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce7e9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce00ad600 con 0x7efce01596b0 2023-07-20T10:08:35.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce7e9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00ad810 con 0x7efce00cc900 2023-07-20T10:08:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efce01596b0 0x7efce015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efce01596b0 0x7efce015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47102/0 (socket says 172.21.15.82:47102) 2023-07-20T10:08:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce6439640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efce00b2380 0x7efce00c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46276/0 (socket says 172.21.15.82:46276) 2023-07-20T10:08:35.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 -- 172.21.15.82:0/235830796 learned_addr learned my addr 172.21.15.82:0/235830796 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5437640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 -- 172.21.15.82:0/235830796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 msgr2=0x7efce00ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce00ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 -- 172.21.15.82:0/235830796 >> v1:172.21.15.82:6789/0 conn(0x7efce00b2380 legacy=0x7efce00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5c38640 1 -- 172.21.15.82:0/235830796 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce015d0d0 con 0x7efce01596b0 2023-07-20T10:08:35.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce5437640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce00ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.398+0000 7efce4c36640 1 -- 172.21.15.82:0/235830796 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260930012 0 0) 0x7efce00ccd60 con 0x7efce00b2380 2023-07-20T10:08:35.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce5c38640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce01596b0 0x7efce015dbb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009870 tx=0x7efcdc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1787b6df3fcf94e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce4c36640 1 -- 172.21.15.82:0/235830796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0aa670 con 0x7efce01596b0 2023-07-20T10:08:35.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce4c36640 1 -- 172.21.15.82:0/235830796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc0aa7d0 con 0x7efce01596b0 2023-07-20T10:08:35.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce4c36640 1 -- 172.21.15.82:0/235830796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0aab60 con 0x7efce01596b0 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- 172.21.15.82:0/235830796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce01596b0 msgr2=0x7efce015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce01596b0 0x7efce015dbb0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009870 tx=0x7efcdc01c510 comp rx=0 tx=0).stop 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- 172.21.15.82:0/235830796 shutdown_connections 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce00ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 --2- 172.21.15.82:0/235830796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce01596b0 0x7efce015dbb0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- 172.21.15.82:0/235830796 >> 172.21.15.82:0/235830796 conn(0x7efce00cada0 msgr2=0x7efce00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- 172.21.15.82:0/235830796 shutdown_connections 2023-07-20T10:08:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- 172.21.15.82:0/235830796 wait complete. 2023-07-20T10:08:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 Processor -- start 2023-07-20T10:08:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.402+0000 7efce7e9c640 1 -- start start 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 0x7efce00b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c2430 con 0x7efce00b2380 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce01665b0 con 0x7efce01596b0 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce01670f0 con 0x7efce00cc900 2023-07-20T10:08:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47108/0 (socket says 172.21.15.82:47108) 2023-07-20T10:08:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 -- 172.21.15.82:0/760124342 learned_addr learned my addr 172.21.15.82:0/760124342 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5437640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce6439640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 0x7efce00b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 -- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 msgr2=0x7efce014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 -- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 msgr2=0x7efce00b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 0x7efce00b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 -- 172.21.15.82:0/760124342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0094d0 con 0x7efce00b2380 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce6439640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 0x7efce00b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce5c38640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0ac040 tx=0x7efcdc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efcd67fc640 1 -- 172.21.15.82:0/760124342 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0b3800 con 0x7efce00b2380 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efcd67fc640 1 -- 172.21.15.82:0/760124342 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc0b3980 con 0x7efce00b2380 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efcd67fc640 1 -- 172.21.15.82:0/760124342 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0b3d30 con 0x7efce00b2380 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce01667c0 con 0x7efce00b2380 2023-07-20T10:08:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.406+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce0166d80 con 0x7efce00b2380 2023-07-20T10:08:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efcd67fc640 1 -- 172.21.15.82:0/760124342 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efcdc0c73a0 con 0x7efce00b2380 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efcd67fc640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 0x7efcc4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efcd67fc640 1 -- 172.21.15.82:0/760124342 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcdc11eae0 con 0x7efce00b2380 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce5437640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 0x7efcc4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 Processor -- start 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 -- start start 2023-07-20T10:08:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce5437640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 0x7efcc4068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efce00b1d20 tx=0x7efcd0008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x5557133b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713367950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571322f0a0 con 0x555713367e90 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557131bde40 con 0x5557133b2640 2023-07-20T10:08:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557131bb370 con 0x5557133b1d20 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47112/0 (socket says 172.21.15.82:47112) 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 -- 172.21.15.82:0/1552309681 learned_addr learned my addr 172.21.15.82:0/1552309681 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce5c38640 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x5557133b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce5437640 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713367950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 -- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 msgr2=0x5557133b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x5557133b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 -- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 msgr2=0x555713367950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713367950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 -- 172.21.15.82:0/1552309681 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555712eb2890 con 0x555713367e90 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efce6439640 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7efcd80073c0 tx=0x7efcd8007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d9f430a2f5c09c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.410+0000 7efcc37fe640 1 -- 172.21.15.82:0/1552309681 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8001e30 con 0x555713367e90 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efcc37fe640 1 -- 172.21.15.82:0/1552309681 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8001f90 con 0x555713367e90 2023-07-20T10:08:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efcc37fe640 1 -- 172.21.15.82:0/1552309681 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8014680 con 0x555713367e90 2023-07-20T10:08:35.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/1552309681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 msgr2=0x555713368270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7efcd80073c0 tx=0x7efcd8007880 comp rx=0 tx=0).stop 2023-07-20T10:08:35.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/1552309681 shutdown_connections 2023-07-20T10:08:35.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713368270 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713367950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- 172.21.15.82:0/1552309681 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x5557133b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/1552309681 >> 172.21.15.82:0/1552309681 conn(0x55571335f200 msgr2=0x555713366230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/1552309681 shutdown_connections 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/1552309681 wait complete. 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- start start 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 Processor -- start 2023-07-20T10:08:35.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x555713373400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713373940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557131b6c60 con 0x555713367e90 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555713172ae0 con 0x5557133b2640 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x555713172780 con 0x5557133b1d20 2023-07-20T10:08:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 10 client.0 _ll_register_callbacks cb 0x555713353820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47116/0 (socket says 172.21.15.82:47116) 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 -- 172.21.15.82:0/171798130 learned_addr learned my addr 172.21.15.82:0/171798130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce6439640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713373940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5437640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x555713373400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 -- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 msgr2=0x555713373400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x555713373400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 -- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 msgr2=0x555713373940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713373940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 -- 172.21.15.82:0/171798130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd800f040 con 0x555713367e90 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce6439640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713373940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efce5c38640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7efcdc01abc0 tx=0x7efcdc0f3920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b3dfd2398828d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efcc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0f7a20 con 0x555713367e90 2023-07-20T10:08:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555713176fb0 con 0x555713367e90 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.414+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcdc0f3b80 con 0x555713367e90 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcdc0f3d40 con 0x555713367e90 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 10 client.8586 fetch_fsmap learned FSMap version 57 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55571317ad10 con 0x555713367e90 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555713176fb0 con 0x555713367e90 2023-07-20T10:08:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efcdc0c6070 con 0x555713367e90 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 10 client.8586 fetch_fsmap finished waiting for FSMap version 57 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 10 client.8586 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 20 client.8586 populate_metadata read hostname 'smithi082' 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713374210 0x5557133c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 4 client.8586 mds_command: new command op to 8412 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 --> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557131e5410 con 0x555713374210 2023-07-20T10:08:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efce5437640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713374210 0x5557133c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efce5437640 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713374210 0x5557133c3290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d16d465574b1e65 server_cookie=3a9128b135cc296 in_seq=0 out_seq=0 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 10 client.8586 ms_handle_connect on v2:172.21.15.82:6836/4045822955 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 1 -- 172.21.15.82:0/171798130 <== mds.0 v2:172.21.15.82:6836/4045822955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x5557131e5410 con 0x555713374210 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 10 client.8586 handle_command_reply: tid=0 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 client.8586 shutdown 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 msgr2=0x555713372ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7efcdc01abc0 tx=0x7efcdc0f3920 comp rx=0 tx=0).stop 2023-07-20T10:08:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 shutdown_connections 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713374210 0x5557133c3290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b2640 0x555713373940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x5557133b1d20 0x555713373400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 --2- 172.21.15.82:0/171798130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555713367e90 0x555713372ec0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 >> 172.21.15.82:0/171798130 conn(0x55571335f200 msgr2=0x555713366230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efcc0ff9640 0 client.8586 ms_handle_reset on v2:172.21.15.82:6836/4045822955 2023-07-20T10:08:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 shutdown_connections 2023-07-20T10:08:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 1 -- 172.21.15.82:0/171798130 wait complete. 2023-07-20T10:08:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.418+0000 7efceb204000 20 client.8586 trim_cache size 0 max 16384 2023-07-20T10:08:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 Processor -- start 2023-07-20T10:08:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- start start 2023-07-20T10:08:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x55571340b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x55571340b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555712e73940 con 0x5557133b2640 2023-07-20T10:08:35.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571336e0c0 con 0x5557133b1d20 2023-07-20T10:08:35.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557131f8e60 con 0x555713367e90 2023-07-20T10:08:35.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47132/0 (socket says 172.21.15.82:47132) 2023-07-20T10:08:35.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 -- 172.21.15.82:0/1321881168 learned_addr learned my addr 172.21.15.82:0/1321881168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce5c38640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x55571340b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce5437640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x55571340b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 -- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 msgr2=0x55571340b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x55571340b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 -- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 msgr2=0x55571340b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x55571340b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 -- 172.21.15.82:0/1321881168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555713160fa0 con 0x5557133b2640 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce5c38640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x55571340b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce5437640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x55571340b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efce6439640 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7efcd8001570 tx=0x7efcd800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2e5563f1182e9f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efcc3fff640 1 -- 172.21.15.82:0/1321881168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8001e30 con 0x5557133b2640 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efcc3fff640 1 -- 172.21.15.82:0/1321881168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd800b040 con 0x5557133b2640 2023-07-20T10:08:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efcc3fff640 1 -- 172.21.15.82:0/1321881168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8014480 con 0x5557133b2640 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- 172.21.15.82:0/1321881168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 msgr2=0x55571340bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7efcd8001570 tx=0x7efcd800c000 comp rx=0 tx=0).stop 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- 172.21.15.82:0/1321881168 shutdown_connections 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x55571340bb70 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x55571340b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 --2- 172.21.15.82:0/1321881168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x55571340b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.434+0000 7efceb204000 1 -- 172.21.15.82:0/1321881168 >> 172.21.15.82:0/1321881168 conn(0x55571335f200 msgr2=0x55571336ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- 172.21.15.82:0/1321881168 shutdown_connections 2023-07-20T10:08:35.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- 172.21.15.82:0/1321881168 wait complete. 2023-07-20T10:08:35.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- start start 2023-07-20T10:08:35.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 Processor -- start 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x5557133c3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x5557133c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555713153a80 con 0x5557133b2640 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x555713254440 con 0x5557133b1d20 2023-07-20T10:08:35.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557131532b0 con 0x555713367e90 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 10 client.0 _ll_register_callbacks cb 0x55571322eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47140/0 (socket says 172.21.15.82:47140) 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 -- 172.21.15.82:0/2581472780 learned_addr learned my addr 172.21.15.82:0/2581472780 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce5c38640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x5557133c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce5437640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x5557133c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 -- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 msgr2=0x5557133c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x5557133c3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 -- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 msgr2=0x5557133c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x5557133c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 -- 172.21.15.82:0/2581472780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555712eb2890 con 0x5557133b2640 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efce6439640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7efcd8022040 tx=0x7efcd8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c5bd05c2e52f6c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8004d80 con 0x5557133b2640 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcd8014480 con 0x5557133b2640 2023-07-20T10:08:35.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555713367d20 con 0x5557133b2640 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcd8014640 con 0x5557133b2640 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 10 client.8592 fetch_fsmap learned FSMap version 57 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x555712eb2cc0 con 0x5557133b2640 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555713367d20 con 0x5557133b2640 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efcd80147a0 con 0x5557133b2640 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 10 client.8592 fetch_fsmap finished waiting for FSMap version 57 2023-07-20T10:08:35.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 10 client.8592 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 20 client.8592 populate_metadata read hostname 'smithi082' 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.438+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713415370 0x555713417760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 4 client.8592 mds_command: new command op to 8412 tid=0[{"prefix": "status"}] 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 --> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55571317da20 con 0x555713415370 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce5c38640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713415370 0x555713417760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce5c38640 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713415370 0x555713417760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb8683fdea795b9 server_cookie=d69c428fff753c in_seq=0 out_seq=0 2023-07-20T10:08:35.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efcc0ff9640 10 client.8592 ms_handle_connect on v2:172.21.15.82:6836/4045822955 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efcc0ff9640 1 -- 172.21.15.82:0/2581472780 <== mds.0 v2:172.21.15.82:6836/4045822955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55571317da20 con 0x555713415370 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efcc0ff9640 10 client.8592 handle_command_reply: tid=0 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 client.8592 shutdown 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 msgr2=0x5557133c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7efcd8022040 tx=0x7efcd8001260 comp rx=0 tx=0).stop 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 shutdown_connections 2023-07-20T10:08:35.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:6836/4045822955,v1:172.21.15.82:6837/4045822955] conn(0x555713415370 0x555713417760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5557133b2640 0x5557133c43c0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5557133b1d20 0x5557133c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efcc0ff9640 0 client.8592 ms_handle_reset on v2:172.21.15.82:6836/4045822955 2023-07-20T10:08:35.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 --2- 172.21.15.82:0/2581472780 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x555713367e90 0x5557133c3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 >> 172.21.15.82:0/2581472780 conn(0x55571335f200 msgr2=0x5557133b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 shutdown_connections 2023-07-20T10:08:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 1 -- 172.21.15.82:0/2581472780 wait complete. 2023-07-20T10:08:35.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efceb204000 20 client.8592 trim_cache size 0 max 16384 2023-07-20T10:08:35.432 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:08:35.432 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:08:35.433 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:08:35.433 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 8412, 2023-07-20T10:08:35.433 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:08:35.433 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:08:35.434 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:08:35.434 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.385680434999999, 2023-07-20T10:08:35.434 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 57, 2023-07-20T10:08:35.434 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 123, 2023-07-20T10:08:35.435 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 123, 2023-07-20T10:08:35.435 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.66556898 2023-07-20T10:08:35.435 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:08:35.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 msgr2=0x7efcc4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 0x7efcc4068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efce00b1d20 tx=0x7efcd0008040 comp rx=0 tx=0).stop 2023-07-20T10:08:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 msgr2=0x7efce00c1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7efcdc0ac040 tx=0x7efcdc01ad50 comp rx=0 tx=0).stop 2023-07-20T10:08:35.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 shutdown_connections 2023-07-20T10:08:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7efcc40663d0 0x7efcc4068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efce01596b0 0x7efce00b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efce00cc900 0x7efce014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 --2- 172.21.15.82:0/760124342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efce00b2380 0x7efce00c1e50 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 >> 172.21.15.82:0/760124342 conn(0x7efce00cada0 msgr2=0x7efce00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 shutdown_connections 2023-07-20T10:08:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.442+0000 7efce7e9c640 1 -- 172.21.15.82:0/760124342 wait complete. 2023-07-20T10:08:35.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:08:35.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.602+0000 7ff81aaf9640 1 Processor -- start 2023-07-20T10:08:35.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.602+0000 7ff81aaf9640 1 -- start start 2023-07-20T10:08:35.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff81aaf9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff81415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff81aaf9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff8140cc900 0x7ff8140ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff81aaf9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8140ccd90 con 0x7ff8141596b0 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff81aaf9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8140ad600 con 0x7ff8140cc900 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff81aaf9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140ad810 con 0x7ff8140b2a90 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff818895640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff8141596b0 0x7ff8140b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46282/0 (socket says 172.21.15.82:46282) 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff818895640 1 -- 172.21.15.82:0/2886979301 learned_addr learned my addr 172.21.15.82:0/2886979301 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:35.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff819096640 1 --2- 172.21.15.82:0/2886979301 >> v2:172.21.15.82:3300/0 conn(0x7ff8140cc900 0x7ff8140ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff819096640 1 -- 172.21.15.82:0/2886979301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 msgr2=0x7ff81415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff813fff640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff81415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff819096640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff81415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff819096640 1 -- 172.21.15.82:0/2886979301 >> v1:172.21.15.82:6789/0 conn(0x7ff8141596b0 legacy=0x7ff8140b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff819096640 1 -- 172.21.15.82:0/2886979301 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81415d0d0 con 0x7ff8140cc900 2023-07-20T10:08:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff8137fe640 1 -- 172.21.15.82:0/2886979301 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840764868 0 0) 0x7ff8140ccd90 con 0x7ff8141596b0 2023-07-20T10:08:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.606+0000 7ff813fff640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff81415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:35.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff819096640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140ad0c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0097c0 tx=0x7ff80c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7189befe52613d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff8137fe640 1 -- 172.21.15.82:0/2886979301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0ab650 con 0x7ff8140cc900 2023-07-20T10:08:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff8137fe640 1 -- 172.21.15.82:0/2886979301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c0ab7b0 con 0x7ff8140cc900 2023-07-20T10:08:35.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff8137fe640 1 -- 172.21.15.82:0/2886979301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c0abb40 con 0x7ff8140cc900 2023-07-20T10:08:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- 172.21.15.82:0/2886979301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 msgr2=0x7ff8140ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140ad0c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ff80c0097c0 tx=0x7ff80c01c450 comp rx=0 tx=0).stop 2023-07-20T10:08:35.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- 172.21.15.82:0/2886979301 shutdown_connections 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140ad0c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/2886979301 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff81415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- 172.21.15.82:0/2886979301 >> 172.21.15.82:0/2886979301 conn(0x7ff8140cada0 msgr2=0x7ff8140cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- 172.21.15.82:0/2886979301 shutdown_connections 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- 172.21.15.82:0/2886979301 wait complete. 2023-07-20T10:08:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 Processor -- start 2023-07-20T10:08:35.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- start start 2023-07-20T10:08:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff8140b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 0x7ff814159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b1640 con 0x7ff8140cc900 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b1920 con 0x7ff8141596b0 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.610+0000 7ff81aaf9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8140b1c00 con 0x7ff8140b2a90 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47164/0 (socket says 172.21.15.82:47164) 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 -- 172.21.15.82:0/1365114227 learned_addr learned my addr 172.21.15.82:0/1365114227 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff818895640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff8140b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff819096640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 0x7ff814159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 -- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 msgr2=0x7ff8140b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff8140b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 -- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 msgr2=0x7ff814159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 0x7ff814159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 -- 172.21.15.82:0/1365114227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009420 con 0x7ff8140cc900 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff818895640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff8140b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff819096640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 0x7ff814159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff813fff640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c7c0 tx=0x7ff80800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808007a30 con 0x7ff8140cc900 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff808007b90 con 0x7ff8140cc900 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800ce70 con 0x7ff8140cc900 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8140b1ee0 con 0x7ff8140cc900 2023-07-20T10:08:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8140b26e0 con 0x7ff8140cc900 2023-07-20T10:08:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff814073c70 con 0x7ff8140cc900 2023-07-20T10:08:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.614+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff8080113f0 con 0x7ff8140cc900 2023-07-20T10:08:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.618+0000 7ff8117fa640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 0x7ff800068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.618+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff808084470 con 0x7ff8140cc900 2023-07-20T10:08:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.618+0000 7ff818895640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 0x7ff800068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.618+0000 7ff818895640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 0x7ff800068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff804007fd0 tx=0x7ff804005b80 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:35.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.618+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8080516b0 con 0x7ff8140cc900 2023-07-20T10:08:35.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8140c86b0 con 0x7ff8140cc900 2023-07-20T10:08:35.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff8117fa640 1 -- 172.21.15.82:0/1365114227 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff808054cd0 con 0x7ff8140cc900 2023-07-20T10:08:35.775 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 msgr2=0x7ff800068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 0x7ff800068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff804007fd0 tx=0x7ff804005b80 comp rx=0 tx=0).stop 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 msgr2=0x7ff8140c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.798+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff80800c7c0 tx=0x7ff80800cc80 comp rx=0 tx=0).stop 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 shutdown_connections 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7ff8000663a0 0x7ff800068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff8141596b0 0x7ff814159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff8140cc900 0x7ff8140c7640 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 --2- 172.21.15.82:0/1365114227 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff8140b2a90 0x7ff8140b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 >> 172.21.15.82:0/1365114227 conn(0x7ff8140cada0 msgr2=0x7ff81406d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 shutdown_connections 2023-07-20T10:08:35.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:35.802+0000 7ff81aaf9640 1 -- 172.21.15.82:0/1365114227 wait complete. 2023-07-20T10:08:35.795 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:08:35.796 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:08:35.796 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:08:35.796 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:08:35.797 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:08:35.797 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:08:35.797 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:08:35.797 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:08:35.798 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:08:35.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:35.798 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:08:35.808 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:08:35.808 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:08:35.808 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:08:35.808 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.808 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:08:35.809 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41285sec preferred_lft 41285sec 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.810 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:08:35.811 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:08:35.812 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:08:35.813 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:08:35.813 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:08:35.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:35.814 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:08:35.879 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:08:35.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:35.881 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:08:35.935 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:08:35.935 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:08:35.935 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:08:35.935 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:08:35.935 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:08:35.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:35.937 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:08:35.937 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:08:35.937 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:08:35.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:08:35.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:08:35.938 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:08:36.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:36.033 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:08:36.042 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:08:36.042 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:08:36.043 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:08:36.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:36.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:08:36.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:08:36.109 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:08:36.164 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:08:36.165 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:08:36.165 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:08:36.220 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:08:36.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:36.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:08:36.311 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:08:36.311 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:08:36.311 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:08:36.326 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:08:36.326 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:08:36.326 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:08:36.326 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:08:36.327 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:08:36.334 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:08:36.334 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:08:36.335 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:08:36.338 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:08:36.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:36.339 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:08:36.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:36.360 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:08:36.416 INFO:teuthology.orchestra.run.smithi082.stdout:client8604 2023-07-20T10:08:36.416 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:08:36.416 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:08:36.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:08:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 Processor -- start 2023-07-20T10:08:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 -- start start 2023-07-20T10:08:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f886415c5e0 0x7f88640adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640c91f0 0x7f88640ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640ab890 con 0x7f88640cd080 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640cd4f0 con 0x7f886415c5e0 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f886a367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864069ac0 con 0x7f88640c91f0 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8868904640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f88640cd080 0x7f8864160210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46286/0 (socket says 172.21.15.82:46286) 2023-07-20T10:08:36.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8868904640 1 -- 172.21.15.82:0/1624167879 learned_addr learned my addr 172.21.15.82:0/1624167879 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8863fff640 1 --2- 172.21.15.82:0/1624167879 >> v2:172.21.15.183:3300/0 conn(0x7f886415c5e0 0x7f88640adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640c91f0 0x7f88640ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697385138 0 0) 0x7f88640ab890 con 0x7f88640cd080 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c003530 con 0x7f88640cd080 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931683417 0 0) 0x7f884c003530 con 0x7f88640cd080 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640c91f0 msgr2=0x7f88640ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640c91f0 0x7f88640ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 >> v2:172.21.15.183:3300/0 conn(0x7f886415c5e0 msgr2=0x7f88640adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 --2- 172.21.15.82:0/1624167879 >> v2:172.21.15.183:3300/0 conn(0x7f886415c5e0 0x7f88640adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640ce2d0 con 0x7f88640cd080 2023-07-20T10:08:36.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f885c001a00 con 0x7f88640cd080 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 >> v1:172.21.15.82:6789/0 conn(0x7f88640cd080 legacy=0x7f8864160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f884c003980 0x7f884c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f884c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f884c004ec0 0x7f884c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640cd4f0 con 0x7f884c004370 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864069ac0 con 0x7f884c004ec0 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c00bed0 con 0x7f884c003980 2023-07-20T10:08:36.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f884c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8868904640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f884c004ec0 0x7f884c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8863fff640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f884c003980 0x7f884c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 -- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f884c003980 msgr2=0x7f884c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f884c003980 0x7f884c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 -- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f884c004ec0 msgr2=0x7f884c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f884c004ec0 0x7f884c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f88637fe640 1 -- 172.21.15.82:0/1624167879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c003530 con 0x7f884c004370 2023-07-20T10:08:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.674+0000 7f8868904640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f884c004ec0 0x7f884c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:36.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f88637fe640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f884c004850 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f88580099a0 tx=0x7f885801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92c3413a5711b82 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580a6510 con 0x7f884c004370 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580a6670 con 0x7f884c004370 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f8862ffd640 1 -- 172.21.15.82:0/1624167879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580a6a20 con 0x7f884c004370 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 -- 172.21.15.82:0/1624167879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 msgr2=0x7f884c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 --2- 172.21.15.82:0/1624167879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f884c004850 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f88580099a0 tx=0x7f885801c910 comp rx=0 tx=0).stop 2023-07-20T10:08:36.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f8868904640 1 -- 172.21.15.82:0/1624167879 reap_dead start 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 -- 172.21.15.82:0/1624167879 shutdown_connections 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 -- 172.21.15.82:0/1624167879 >> 172.21.15.82:0/1624167879 conn(0x7f88640cb620 msgr2=0x7f88640cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 -- 172.21.15.82:0/1624167879 shutdown_connections 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.678+0000 7f886a367640 1 -- 172.21.15.82:0/1624167879 wait complete. 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 Processor -- start 2023-07-20T10:08:36.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- start start 2023-07-20T10:08:36.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8864156e70 0x7f886415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886415d760 0x7f886406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b47a0 con 0x7f884c004370 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886415fa20 con 0x7f886415d760 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886415dd70 con 0x7f8864156e70 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47186/0 (socket says 172.21.15.82:47186) 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 -- 172.21.15.82:0/2001764494 learned_addr learned my addr 172.21.15.82:0/2001764494 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8868904640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886415d760 0x7f886406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f88637fe640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8864156e70 0x7f886415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 -- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8864156e70 msgr2=0x7f886415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8864156e70 0x7f886415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 -- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886415d760 msgr2=0x7f886406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886415d760 0x7f886406cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 -- 172.21.15.82:0/2001764494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886415e050 con 0x7f884c004370 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8863fff640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8854011660 tx=0x7f8854011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854015870 con 0x7f884c004370 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540159d0 con 0x7f884c004370 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854015d40 con 0x7f884c004370 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640b17c0 con 0x7f884c004370 2023-07-20T10:08:36.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.682+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640b1d80 con 0x7f884c004370 2023-07-20T10:08:36.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886415e290 con 0x7f884c004370 2023-07-20T10:08:36.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f885400f480 con 0x7f884c004370 2023-07-20T10:08:36.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f8860ff9640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 0x7f8850068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8854084330 con 0x7f884c004370 2023-07-20T10:08:36.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f88637fe640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 0x7f8850068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.686+0000 7f88637fe640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 0x7f8850068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88580af000 tx=0x7f88580046d0 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:36.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.690+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8854055090 con 0x7f884c004370 2023-07-20T10:08:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.854+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f88640ce890 con 0x7f88500663a0 2023-07-20T10:08:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f8860ff9640 1 -- 172.21.15.82:0/2001764494 <== mgr.8124 v2:172.21.15.82:6832/4046893014 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8858004040 con 0x7f88500663a0 2023-07-20T10:08:36.833 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:08:36.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:08:36.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:08:36.834 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:08:36.834 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:08:36.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 msgr2=0x7f8850068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 0x7f8850068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88580af000 tx=0x7f88580046d0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 msgr2=0x7f88640b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8854011660 tx=0x7f8854011a60 comp rx=0 tx=0).stop 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 shutdown_connections 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f88500663a0 0x7f8850068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886415d760 0x7f886406cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8864156e70 0x7f886415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 --2- 172.21.15.82:0/2001764494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c004370 0x7f88640b22a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 >> 172.21.15.82:0/2001764494 conn(0x7f88640cb620 msgr2=0x7f88640afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 shutdown_connections 2023-07-20T10:08:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:36.858+0000 7f886a367640 1 -- 172.21.15.82:0/2001764494 wait complete. 2023-07-20T10:08:36.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:08:36.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 Processor -- start 2023-07-20T10:08:36.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 -- start start 2023-07-20T10:08:36.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a180b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a180b44d0 0x7f0a180d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 0x7f0a1806a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a180b4930 con 0x7f0a180b44d0 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1815ff50 con 0x7f0a180d07a0 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1c8bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180d0f90 con 0x7f0a1815fb70 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a0e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a180b44d0 0x7f0a180d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a0e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a180b44d0 0x7f0a180d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47198/0 (socket says 172.21.15.82:47198) 2023-07-20T10:08:36.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a0e59c640 1 -- 172.21.15.82:0/1925858593 learned_addr learned my addr 172.21.15.82:0/1925858593 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:36.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a180b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.018+0000 7f0a1759e640 1 --2- 172.21.15.82:0/1925858593 >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 0x7f0a1806a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:36.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 -- 172.21.15.82:0/1925858593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 msgr2=0x7f0a180b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a180b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 -- 172.21.15.82:0/1925858593 >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 msgr2=0x7f0a1806a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/1925858593 >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 0x7f0a1806a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 -- 172.21.15.82:0/1925858593 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180cd190 con 0x7f0a180b44d0 2023-07-20T10:08:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a180b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1759e640 1 --2- 172.21.15.82:0/1925858593 >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 0x7f0a1806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180b44d0 0x7f0a180d0260 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f0a180d24c0 tx=0x7f0a0801c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b566f83822b165 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1659c640 1 -- 172.21.15.82:0/1925858593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080ab600 con 0x7f0a180b44d0 2023-07-20T10:08:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1659c640 1 -- 172.21.15.82:0/1925858593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a080a7050 con 0x7f0a180b44d0 2023-07-20T10:08:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1659c640 1 -- 172.21.15.82:0/1925858593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080ab980 con 0x7f0a180b44d0 2023-07-20T10:08:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/1925858593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180b44d0 msgr2=0x7f0a180d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180b44d0 0x7f0a180d0260 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f0a180d24c0 tx=0x7f0a0801c0f0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/1925858593 shutdown_connections 2023-07-20T10:08:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/1925858593 >> v2:172.21.15.183:3300/0 conn(0x7f0a180d07a0 0x7f0a1806a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180b44d0 0x7f0a180d0260 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/1925858593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a180b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.022+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/1925858593 >> 172.21.15.82:0/1925858593 conn(0x7f0a18065710 msgr2=0x7f0a18065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/1925858593 shutdown_connections 2023-07-20T10:08:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/1925858593 wait complete. 2023-07-20T10:08:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 Processor -- start 2023-07-20T10:08:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- start start 2023-07-20T10:08:37.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 0x7f0a181585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:37.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:37.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a181559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:37.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1815aa20 con 0x7f0a180d07a0 2023-07-20T10:08:37.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a181f4f40 con 0x7f0a180b44d0 2023-07-20T10:08:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a1c8bc640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18158cc0 con 0x7f0a1815fb70 2023-07-20T10:08:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47202/0 (socket says 172.21.15.82:47202) 2023-07-20T10:08:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 -- 172.21.15.82:0/283911158 learned_addr learned my addr 172.21.15.82:0/283911158 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 0x7f0a181585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 -- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 msgr2=0x7f0a181559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a181559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 -- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 msgr2=0x7f0a181585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 0x7f0a181585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 -- 172.21.15.82:0/283911158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080094d0 con 0x7f0a180d07a0 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 0x7f0a181585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.026+0000 7f0a0e59c640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801a7a0 tx=0x7f0a08018e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080b4620 con 0x7f0a180d07a0 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a080b4780 con 0x7f0a180d07a0 2023-07-20T10:08:37.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a18158fa0 con 0x7f0a180d07a0 2023-07-20T10:08:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a080b4b30 con 0x7f0a180d07a0 2023-07-20T10:08:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a18159560 con 0x7f0a180d07a0 2023-07-20T10:08:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1804da30 con 0x7f0a180d07a0 2023-07-20T10:08:37.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0a080b2070 con 0x7f0a180d07a0 2023-07-20T10:08:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 0x7f09f8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a0811dca0 con 0x7f0a180d07a0 2023-07-20T10:08:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.030+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 0x7f09f8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:37.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.034+0000 7f0a16d9d640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 0x7f09f8068890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a000097a0 tx=0x7f0a00008040 comp rx=0 tx=0).ready entity=mgr.8124 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:37.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.034+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a080eae60 con 0x7f0a180d07a0 2023-07-20T10:08:37.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:37.218+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f0a180d32e0 con 0x7f0a180d07a0 2023-07-20T10:08:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.186+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0a080eb230 con 0x7f0a180d07a0 2023-07-20T10:08:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.186+0000 7f0a0ffff640 1 -- 172.21.15.82:0/283911158 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7f0a080eae60 con 0x7f0a180d07a0 2023-07-20T10:08:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 msgr2=0x7f09f8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 0x7f09f8068890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0a000097a0 tx=0x7f0a00008040 comp rx=0 tx=0).stop 2023-07-20T10:08:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 msgr2=0x7f0a1815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f0a0801a7a0 tx=0x7f0a08018e90 comp rx=0 tx=0).stop 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 shutdown_connections 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a1815fb70 0x7f0a181559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a180d07a0 0x7f0a1815a4e0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f09f80663d0 0x7f09f8068890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 --2- 172.21.15.82:0/283911158 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a180b44d0 0x7f0a181585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 >> 172.21.15.82:0/283911158 conn(0x7f0a18065710 msgr2=0x7f0a180b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 shutdown_connections 2023-07-20T10:08:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.190+0000 7f0a1c8bc640 1 -- 172.21.15.82:0/283911158 wait complete. 2023-07-20T10:08:38.190 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:08:38.330 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:38.355+0000 7f9e01246180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:08:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.362+0000 7f0b3ef67640 1 Processor -- start 2023-07-20T10:08:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.362+0000 7f0b3ef67640 1 -- start start 2023-07-20T10:08:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3ef67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b381602b0 0x7f0b38160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3ef67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0b3806ab10 0x7f0b3806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3ef67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b380ce4f0 con 0x7f0b3806c120 2023-07-20T10:08:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3ef67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380d0970 con 0x7f0b381602b0 2023-07-20T10:08:38.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3ef67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b38160e20 con 0x7f0b3806ab10 2023-07-20T10:08:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b37fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b381602b0 0x7f0b38160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3cd03640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0b3806c120 0x7f0b380cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46300/0 (socket says 172.21.15.82:46300) 2023-07-20T10:08:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3cd03640 1 -- 172.21.15.82:0/4006733324 learned_addr learned my addr 172.21.15.82:0/4006733324 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:38.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b3d504640 1 --2- 172.21.15.82:0/4006733324 >> v2:172.21.15.183:3300/0 conn(0x7f0b3806ab10 0x7f0b3806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b37fff640 1 -- 172.21.15.82:0/4006733324 >> v2:172.21.15.183:3300/0 conn(0x7f0b3806ab10 msgr2=0x7f0b3806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b37fff640 1 --2- 172.21.15.82:0/4006733324 >> v2:172.21.15.183:3300/0 conn(0x7f0b3806ab10 0x7f0b3806af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b37fff640 1 -- 172.21.15.82:0/4006733324 >> v1:172.21.15.82:6789/0 conn(0x7f0b3806c120 legacy=0x7f0b380cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b37fff640 1 -- 172.21.15.82:0/4006733324 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380cd300 con 0x7f0b381602b0 2023-07-20T10:08:38.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.366+0000 7f0b377fe640 1 -- 172.21.15.82:0/4006733324 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330289392 0 0) 0x7f0b380ce4f0 con 0x7f0b3806c120 2023-07-20T10:08:38.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b37fff640 1 --2- 172.21.15.82:0/4006733324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b381602b0 0x7f0b38160740 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0b3808ceb0 tx=0x7f0b2401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a838a6699d8ad0bd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:38.346 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:38.370+0000 7fe0f044a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:08:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b377fe640 1 -- 172.21.15.82:0/4006733324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ac600 con 0x7f0b381602b0 2023-07-20T10:08:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b377fe640 1 -- 172.21.15.82:0/4006733324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240a8050 con 0x7f0b381602b0 2023-07-20T10:08:38.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b377fe640 1 -- 172.21.15.82:0/4006733324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ac980 con 0x7f0b381602b0 2023-07-20T10:08:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4006733324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b381602b0 msgr2=0x7f0b38160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4006733324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b381602b0 0x7f0b38160740 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0b3808ceb0 tx=0x7f0b2401c3a0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4006733324 shutdown_connections 2023-07-20T10:08:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4006733324 >> v2:172.21.15.183:3300/0 conn(0x7f0b3806ab10 0x7f0b3806af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4006733324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b381602b0 0x7f0b38160740 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4006733324 >> 172.21.15.82:0/4006733324 conn(0x7f0b3808c0a0 msgr2=0x7f0b3809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4006733324 shutdown_connections 2023-07-20T10:08:38.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.370+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4006733324 wait complete. 2023-07-20T10:08:38.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 Processor -- start 2023-07-20T10:08:38.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- start start 2023-07-20T10:08:38.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b3806ab10 0x7f0b38154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b381602b0 0x7f0b380c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380b6820 con 0x7f0b3806c120 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380b6b00 con 0x7f0b381602b0 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380b6de0 con 0x7f0b3806ab10 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47244/0 (socket says 172.21.15.82:47244) 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 -- 172.21.15.82:0/4072738455 learned_addr learned my addr 172.21.15.82:0/4072738455 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3d504640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b381602b0 0x7f0b380c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3cd03640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b3806ab10 0x7f0b38154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 -- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b3806ab10 msgr2=0x7f0b38154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b3806ab10 0x7f0b38154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 -- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b381602b0 msgr2=0x7f0b380c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b381602b0 0x7f0b380c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 -- 172.21.15.82:0/4072738455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24009420 con 0x7f0b3806c120 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b37fff640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0b24018fb0 tx=0x7f0b24019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b24006e20 con 0x7f0b3806c120 2023-07-20T10:08:38.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b24004030 con 0x7f0b3806c120 2023-07-20T10:08:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b380b70c0 con 0x7f0b3806c120 2023-07-20T10:08:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240043e0 con 0x7f0b3806c120 2023-07-20T10:08:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b380b78c0 con 0x7f0b3806c120 2023-07-20T10:08:38.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.374+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3804da30 con 0x7f0b3806c120 2023-07-20T10:08:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.378+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0b240b3040 con 0x7f0b3806c120 2023-07-20T10:08:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.378+0000 7f0b357fa640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 0x7f0b1c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.378+0000 7f0b3cd03640 1 -- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 msgr2=0x7f0b1c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.378+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b2411dd60 con 0x7f0b3806c120 2023-07-20T10:08:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.378+0000 7f0b3cd03640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 0x7f0b1c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:38.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.386+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b240eafd0 con 0x7f0b3806c120 2023-07-20T10:08:38.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.538+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0b380b7570 con 0x7f0b3806c120 2023-07-20T10:08:38.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b357fa640 1 -- 172.21.15.82:0/4072738455 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b240ee5f0 con 0x7f0b3806c120 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 msgr2=0x7f0b1c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 0x7f0b1c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 msgr2=0x7f0b38157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0b24018fb0 tx=0x7f0b24019140 comp rx=0 tx=0).stop 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 shutdown_connections 2023-07-20T10:08:38.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7f0b1c0663f0 0x7f0b1c0688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b381602b0 0x7f0b380c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b3806c120 0x7f0b38157c70 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 --2- 172.21.15.82:0/4072738455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b3806ab10 0x7f0b38154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 >> 172.21.15.82:0/4072738455 conn(0x7f0b3808c0a0 msgr2=0x7f0b3809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 shutdown_connections 2023-07-20T10:08:38.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.546+0000 7f0b3ef67640 1 -- 172.21.15.82:0/4072738455 wait complete. 2023-07-20T10:08:38.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:08:38.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.710+0000 7fe15d537640 1 Processor -- start 2023-07-20T10:08:38.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 -- start start 2023-07-20T10:08:38.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe15806c360 0x7fe1580ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe15806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe158160ff0 con 0x7fe15815a340 2023-07-20T10:08:38.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15815a720 con 0x7fe15806c360 2023-07-20T10:08:38.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe15d537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580cea10 con 0x7fe1580ce5a0 2023-07-20T10:08:38.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe15806c360 0x7fe1580ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe15806c360 0x7fe1580ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47260/0 (socket says 172.21.15.82:47260) 2023-07-20T10:08:38.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 -- 172.21.15.82:0/84141621 learned_addr learned my addr 172.21.15.82:0/84141621 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:38.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe156ffd640 1 --1- 172.21.15.82:0/84141621 >> v1:172.21.15.82:6789/0 conn(0x7fe15815a340 0x7fe15815d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46302/0 (socket says 172.21.15.82:46302) 2023-07-20T10:08:38.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe1577fe640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe15806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 -- 172.21.15.82:0/84141621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 msgr2=0x7fe15806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:38.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe15806ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 -- 172.21.15.82:0/84141621 >> v1:172.21.15.82:6789/0 conn(0x7fe15815a340 legacy=0x7fe15815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe14ffff640 1 -- 172.21.15.82:0/84141621 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1581603e0 con 0x7fe15806c360 2023-07-20T10:08:38.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.714+0000 7fe1577fe640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe15806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:38.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe14ffff640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15806c360 0x7fe1580ce060 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe1400098a0 tx=0x7fe14001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c519fe2b46b2862 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:38.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe1567fc640 1 -- 172.21.15.82:0/84141621 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400aa650 con 0x7fe15806c360 2023-07-20T10:08:38.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe1567fc640 1 -- 172.21.15.82:0/84141621 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1400aa7b0 con 0x7fe15806c360 2023-07-20T10:08:38.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe1567fc640 1 -- 172.21.15.82:0/84141621 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400aab40 con 0x7fe15806c360 2023-07-20T10:08:38.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 -- 172.21.15.82:0/84141621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15806c360 msgr2=0x7fe1580ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15806c360 0x7fe1580ce060 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe1400098a0 tx=0x7fe14001c4f0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 -- 172.21.15.82:0/84141621 shutdown_connections 2023-07-20T10:08:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe15806ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 --2- 172.21.15.82:0/84141621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15806c360 0x7fe1580ce060 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 -- 172.21.15.82:0/84141621 >> 172.21.15.82:0/84141621 conn(0x7fe158065310 msgr2=0x7fe158065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 -- 172.21.15.82:0/84141621 shutdown_connections 2023-07-20T10:08:38.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.718+0000 7fe15d537640 1 -- 172.21.15.82:0/84141621 wait complete. 2023-07-20T10:08:38.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 Processor -- start 2023-07-20T10:08:38.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 -- start start 2023-07-20T10:08:38.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe15806c360 0x7fe158155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe1580c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b5440 con 0x7fe15815a340 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe158157650 con 0x7fe15806c360 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe15d537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b47c0 con 0x7fe1580ce5a0 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47266/0 (socket says 172.21.15.82:47266) 2023-07-20T10:08:38.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 -- 172.21.15.82:0/1815202376 learned_addr learned my addr 172.21.15.82:0/1815202376 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:38.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe14ffff640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe1580c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe156ffd640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe15806c360 0x7fe158155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 -- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 msgr2=0x7fe1580c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe1580c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 -- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe15806c360 msgr2=0x7fe158155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe15806c360 0x7fe158155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 -- 172.21.15.82:0/1815202376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1400094d0 con 0x7fe15815a340 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe1577fe640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe150007e70 tx=0x7fe15000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150003ba0 con 0x7fe15815a340 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.722+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15000f040 con 0x7fe15815a340 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000de80 con 0x7fe15815a340 2023-07-20T10:08:38.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1580b4aa0 con 0x7fe15815a340 2023-07-20T10:08:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1580b5060 con 0x7fe15815a340 2023-07-20T10:08:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580b5580 con 0x7fe15815a340 2023-07-20T10:08:38.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe150004030 con 0x7fe15815a340 2023-07-20T10:08:38.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe14f7fe640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 0x7fe1380688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:38.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1500843c0 con 0x7fe15815a340 2023-07-20T10:08:38.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe156ffd640 1 -- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 msgr2=0x7fe1380688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:38.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.726+0000 7fe156ffd640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 0x7fe1380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:38.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.730+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1580b5580 con 0x7fe15815a340 2023-07-20T10:08:38.748 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:38.775+0000 7f9e01246180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:08:38.781 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:38.806+0000 7fe0f044a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:08:38.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.882+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe1580b5580 con 0x7fe15815a340 2023-07-20T10:08:38.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe14f7fe640 1 -- 172.21.15.82:0/1815202376 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe1580b5580 con 0x7fe15815a340 2023-07-20T10:08:38.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 msgr2=0x7fe1380688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:38.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 0x7fe1380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 msgr2=0x7fe158155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe150007e70 tx=0x7fe15000d4a0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 shutdown_connections 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe15815a340 0x7fe158155e50 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1580ce5a0 0x7fe1580c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fe138066420 0x7fe1380688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 --2- 172.21.15.82:0/1815202376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe15806c360 0x7fe158155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 >> 172.21.15.82:0/1815202376 conn(0x7fe158065310 msgr2=0x7fe1580656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 shutdown_connections 2023-07-20T10:08:38.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:38.890+0000 7fe15d537640 1 -- 172.21.15.82:0/1815202376 wait complete. 2023-07-20T10:08:38.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:38.887 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T10:08:38.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-20T10:08:38.903 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:38.931+0000 7f9e01246180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:08:38.937 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:38.962+0000 7fe0f044a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:08:39.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.106+0000 7feca052c640 1 Processor -- start 2023-07-20T10:08:39.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.106+0000 7feca052c640 1 -- start start 2023-07-20T10:08:39.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7feca052c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:39.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7feca052c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980ce4f0 con 0x7fec9806ab10 2023-07-20T10:08:39.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7feca052c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980d0970 con 0x7fec9806c120 2023-07-20T10:08:39.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7feca052c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec98160e20 con 0x7fec981602b0 2023-07-20T10:08:39.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9eac9640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec9806ab10 0x7fec9806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46316/0 (socket says 172.21.15.82:46316) 2023-07-20T10:08:39.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9eac9640 1 -- 172.21.15.82:0/817419309 learned_addr learned my addr 172.21.15.82:0/817419309 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:39.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9dac7640 1 --2- 172.21.15.82:0/817419309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874088875 0 0) 0x7fec980ce4f0 con 0x7fec9806ab10 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec84003530 con 0x7fec9806ab10 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9dac7640 1 -- 172.21.15.82:0/817419309 >> v1:172.21.15.183:6789/0 conn(0x7fec9806c120 legacy=0x7fec980cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406665122 0 0) 0x7fec980d0970 con 0x7fec9806c120 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9dac7640 1 -- 172.21.15.82:0/817419309 >> v1:172.21.15.82:6789/0 conn(0x7fec9806ab10 legacy=0x7fec9806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:39.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.110+0000 7fec9dac7640 1 -- 172.21.15.82:0/817419309 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980cd300 con 0x7fec981602b0 2023-07-20T10:08:39.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7fec9dac7640 1 --2- 172.21.15.82:0/817419309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98160710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fec880097f0 tx=0x7fec8801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98fba69b7f0223ea server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:39.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880ab600 con 0x7fec981602b0 2023-07-20T10:08:39.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec880a7050 con 0x7fec981602b0 2023-07-20T10:08:39.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7fec9d2c6640 1 -- 172.21.15.82:0/817419309 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec880ab980 con 0x7fec981602b0 2023-07-20T10:08:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- 172.21.15.82:0/817419309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 msgr2=0x7fec98160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 --2- 172.21.15.82:0/817419309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98160710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fec880097f0 tx=0x7fec8801c430 comp rx=0 tx=0).stop 2023-07-20T10:08:39.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- 172.21.15.82:0/817419309 shutdown_connections 2023-07-20T10:08:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 --2- 172.21.15.82:0/817419309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98160710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- 172.21.15.82:0/817419309 >> 172.21.15.82:0/817419309 conn(0x7fec9808c0a0 msgr2=0x7fec9809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- 172.21.15.82:0/817419309 shutdown_connections 2023-07-20T10:08:39.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- 172.21.15.82:0/817419309 wait complete. 2023-07-20T10:08:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 Processor -- start 2023-07-20T10:08:39.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.114+0000 7feca052c640 1 -- start start 2023-07-20T10:08:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 0x7fec980b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec9806c120 0x7fec98155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980c7c70 con 0x7fec9806ab10 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980afe20 con 0x7fec9806c120 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980b0100 con 0x7fec981602b0 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 0x7fec980b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 0x7fec980b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47278/0 (socket says 172.21.15.82:47278) 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 -- 172.21.15.82:0/1298267667 learned_addr learned my addr 172.21.15.82:0/1298267667 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec9806c120 0x7fec98155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9eac9640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 msgr2=0x7fec98156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec9806c120 msgr2=0x7fec98155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec9806c120 0x7fec98155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88009420 con 0x7fec9806ab10 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9eac9640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec981602b0 0x7fec98156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec9806c120 0x7fec98155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec9e2c8640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 0x7fec980b6180 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c4d0 tx=0x7fec9400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94005480 con 0x7fec9806ab10 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec94003600 con 0x7fec9806ab10 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec940039b0 con 0x7fec9806ab10 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec980b03e0 con 0x7fec9806ab10 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec980b66c0 con 0x7fec9806ab10 2023-07-20T10:08:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec980b6910 con 0x7fec9806ab10 2023-07-20T10:08:39.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.118+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fec94003b10 con 0x7fec9806ab10 2023-07-20T10:08:39.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.122+0000 7fec8effd640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:39.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.122+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec94083540 con 0x7fec9806ab10 2023-07-20T10:08:39.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.122+0000 7fec9dac7640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 msgr2=0x7fec7c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:39.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.122+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:08:39.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.126+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec940543f0 con 0x7fec9806ab10 2023-07-20T10:08:39.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.294+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fec98161100 con 0x7fec7c066420 2023-07-20T10:08:39.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.326+0000 7fec9dac7640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 msgr2=0x7fec7c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:39.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.326+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:08:39.390 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.415+0000 7f9e01246180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:39.426 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.450+0000 7fe0f044a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:39.448 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.475+0000 7f9e01246180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:08:39.485 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.506+0000 7fe0f044a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:08:39.504 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.531+0000 7f9e01246180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:08:39.540 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.562+0000 7fe0f044a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:08:39.590 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.615+0000 7f9e01246180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:08:39.626 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.650+0000 7fe0f044a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:08:39.648 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.675+0000 7f9e01246180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:08:39.684 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.706+0000 7fe0f044a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:08:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.730+0000 7fec9dac7640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 msgr2=0x7fec7c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:39.730+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:08:39.733 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.759+0000 7f9e01246180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:08:39.768 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.790+0000 7fe0f044a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:08:39.789 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.815+0000 7f9e01246180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:08:39.824 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.846+0000 7fe0f044a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:08:39.932 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:39.959+0000 7f9e01246180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:08:39.964 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:39.986+0000 7fe0f044a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:08:39.990 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.015+0000 7f9e01246180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:08:40.023 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.046+0000 7fe0f044a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:08:40.233 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:08:40.233 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:08:40.234 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:08:40.241 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.267+0000 7f9e01246180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:08:40.266 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:08:40.266 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:08:40.266 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:08:40.274 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.298+0000 7fe0f044a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:08:40.375 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.403+0000 7f9e01246180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:40.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.430+0000 7fe0f044a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:40.501 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.527+0000 7f9e01246180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:40.534+0000 7fec9dac7640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 msgr2=0x7fec7c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/4046893014 2023-07-20T10:08:40.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:40.534+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:08:40.529 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.554+0000 7fe0f044a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:08:40.571 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.599+0000 7f9e01246180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:08:40.599 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.622+0000 7fe0f044a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:08:40.706 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:40.731+0000 7f9e01246180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:40.733 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:40.758+0000 7fe0f044a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:08:41.251 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.275+0000 7f9e01246180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:08:41.272 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.294+0000 7fe0f044a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:08:41.335 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.363+0000 7f9e01246180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:08:41.355 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.378+0000 7fe0f044a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:08:41.484 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.511+0000 7f9e01246180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:08:41.502 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.526+0000 7fe0f044a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:08:41.568 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.595+0000 7f9e01246180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:08:41.585 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.610+0000 7fe0f044a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:08:41.840 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.867+0000 7f9e01246180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:08:41.852 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.874+0000 7fe0f044a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:08:41.901 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:08:41.927+0000 7f9e01246180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:08:41.912 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:41.934+0000 7fe0f044a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:08:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:41.946+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 60) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fec94050d30 con 0x7fec9806ab10 2023-07-20T10:08:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:41.946+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 msgr2=0x7fec7c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:08:41.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:41.946+0000 7fec8effd640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/4046893014,v1:172.21.15.82:6833/4046893014] conn(0x7fec7c066420 0x7fec7c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:42.047 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe072970640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.047 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe072970640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.047 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe072970640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.047 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe072970640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe072970640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe074974640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe074974640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe074974640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe074974640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.048 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:08:42.070+0000 7fe074974640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:08:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:42.954+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fec94083050 con 0x7fec9806ab10 2023-07-20T10:08:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:42.954+0000 7fec8effd640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec7c033ee0 0x7fec7c070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:42.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:42.954+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 --> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fec7c01c480 con 0x7fec7c033ee0 2023-07-20T10:08:42.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:42.954+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec7c033ee0 0x7fec7c070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:42.958+0000 7fec9dac7640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec7c033ee0 0x7fec7c070900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec880ad000 tx=0x7fec880a6000 comp rx=0 tx=0).ready entity=mgr.8631 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:42.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7fec8effd640 1 -- 172.21.15.82:0/1298267667 <== mgr.8631 v2:172.21.15.82:6832/2950283129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fec7c01c480 con 0x7fec7c033ee0 2023-07-20T10:08:42.997 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T10:08:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec7c033ee0 msgr2=0x7fec7c070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec7c033ee0 0x7fec7c070900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec880ad000 tx=0x7fec880a6000 comp rx=0 tx=0).stop 2023-07-20T10:08:42.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 msgr2=0x7fec980b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 --2- 172.21.15.82:0/1298267667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec9806ab10 0x7fec980b6180 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fec9400c4d0 tx=0x7fec9400c990 comp rx=0 tx=0).stop 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7fec9eac9640 1 -- 172.21.15.82:0/1298267667 reap_dead start 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 shutdown_connections 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 >> 172.21.15.82:0/1298267667 conn(0x7fec9808c0a0 msgr2=0x7fec9806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 shutdown_connections 2023-07-20T10:08:43.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.022+0000 7feca052c640 1 -- 172.21.15.82:0/1298267667 wait complete. 2023-07-20T10:08:43.019 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T10:08:43.019 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-20-10_09_00 in ~17s... 2023-07-20T10:08:43.019 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-20T10:08:43.020 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-20T10:08:43.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 Processor -- start 2023-07-20T10:08:43.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 -- start start 2023-07-20T10:08:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5f815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5f80afd50 0x7ff5f80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f80cc8d0 con 0x7ff5f8159830 2023-07-20T10:08:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f80cce90 con 0x7ff5f80afd50 2023-07-20T10:08:43.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5fce6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80b0700 con 0x7ff5f8159450 2023-07-20T10:08:43.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5edd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5f8159830 0x7ff5f80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:46326/0 (socket says 172.21.15.82:46326) 2023-07-20T10:08:43.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5edd9b640 1 -- 172.21.15.82:0/326725585 learned_addr learned my addr 172.21.15.82:0/326725585 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:08:43.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590166868 0 0) 0x7ff5f80cc8d0 con 0x7ff5f8159830 2023-07-20T10:08:43.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e4003530 con 0x7ff5f8159830 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.186+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/326725585 >> v2:172.21.15.183:3300/0 conn(0x7ff5f80afd50 0x7ff5f80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f659c640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5f815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425263247 0 0) 0x7ff5e4003530 con 0x7ff5f8159830 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 msgr2=0x7ff5f815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5f815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 >> v2:172.21.15.183:3300/0 conn(0x7ff5f80afd50 msgr2=0x7ff5f80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 --2- 172.21.15.82:0/326725585 >> v2:172.21.15.183:3300/0 conn(0x7ff5f80afd50 0x7ff5f80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f80ccbb0 con 0x7ff5f8159830 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7ff5e0001680 con 0x7ff5f8159830 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/326725585 >> v2:172.21.15.183:3300/0 conn(0x7ff5f80afd50 0x7ff5f80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 >> v1:172.21.15.82:6789/0 conn(0x7ff5f8159830 legacy=0x7ff5f80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5e4003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e40040a0 0x7ff5e40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e4004d10 0x7ff5e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80cce90 con 0x7ff5e40040a0 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80b0700 con 0x7ff5e4004d10 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e400ddb0 con 0x7ff5f8159450 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e40040a0 0x7ff5e40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f659c640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5e4003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e4004d10 0x7ff5e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 -- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 msgr2=0x7ff5e4003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:43.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f8159450 0x7ff5e4003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 -- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e4004d10 msgr2=0x7ff5e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:08:43.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e4004d10 0x7ff5e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 -- 172.21.15.82:0/326725585 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4003530 con 0x7ff5e40040a0 2023-07-20T10:08:43.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.190+0000 7ff5edd9b640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e40040a0 0x7ff5e40047d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0001ec0 tx=0x7ff5e001f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d394b6c2428606f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e00058e0 con 0x7ff5e40040a0 2023-07-20T10:08:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0005a40 con 0x7ff5e40040a0 2023-07-20T10:08:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5f5d9b640 1 -- 172.21.15.82:0/326725585 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0005e30 con 0x7ff5e40040a0 2023-07-20T10:08:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- 172.21.15.82:0/326725585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e40040a0 msgr2=0x7ff5e40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/326725585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5e40040a0 0x7ff5e40047d0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0001ec0 tx=0x7ff5e001f290 comp rx=0 tx=0).stop 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5f6d9d640 1 -- 172.21.15.82:0/326725585 reap_dead start 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- 172.21.15.82:0/326725585 shutdown_connections 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- 172.21.15.82:0/326725585 >> 172.21.15.82:0/326725585 conn(0x7ff5f80cad50 msgr2=0x7ff5f80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- 172.21.15.82:0/326725585 shutdown_connections 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- 172.21.15.82:0/326725585 wait complete. 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 Processor -- start 2023-07-20T10:08:43.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- start start 2023-07-20T10:08:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e40040a0 0x7ff5f81f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80c2200 0x7ff5f80abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80c2680 con 0x7ff5f814d2c0 2023-07-20T10:08:43.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f814dc80 con 0x7ff5e40040a0 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.194+0000 7ff5fce6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f81f55f0 con 0x7ff5f80c2200 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47428/0 (socket says 172.21.15.82:47428) 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 -- 172.21.15.82:0/2452852508 learned_addr learned my addr 172.21.15.82:0/2452852508 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5edd9b640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80c2200 0x7ff5f80abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f659c640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e40040a0 0x7ff5f81f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 -- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80c2200 msgr2=0x7ff5f80abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80c2200 0x7ff5f80abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 -- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e40040a0 msgr2=0x7ff5f81f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e40040a0 0x7ff5f81f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 -- 172.21.15.82:0/2452852508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f81f58d0 con 0x7ff5f814d2c0 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5f6d9d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80cacb0 tx=0x7ff5f0011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f000c070 con 0x7ff5f814d2c0 2023-07-20T10:08:43.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0015930 con 0x7ff5f814d2c0 2023-07-20T10:08:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0015ca0 con 0x7ff5f814d2c0 2023-07-20T10:08:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f81f5bb0 con 0x7ff5f814d2c0 2023-07-20T10:08:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f80ac030 con 0x7ff5f814d2c0 2023-07-20T10:08:43.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f80b2060 con 0x7ff5f814d2c0 2023-07-20T10:08:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff5f0021460 con 0x7ff5f814d2c0 2023-07-20T10:08:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.198+0000 7ff5ef7fe640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 0x7ff5d8068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:08:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.202+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff5f0083a60 con 0x7ff5f814d2c0 2023-07-20T10:08:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.202+0000 7ff5f659c640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 0x7ff5d8068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:08:43.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.202+0000 7ff5f659c640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 0x7ff5d8068610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8003b90 tx=0x7ff5e8009760 comp rx=0 tx=0).ready entity=mgr.8631 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:08:43.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.206+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5f80b2060 con 0x7ff5f814d2c0 2023-07-20T10:08:43.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.370+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 --> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5f80ac250 con 0x7ff5d8066150 2023-07-20T10:08:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5ef7fe640 1 -- 172.21.15.82:0/2452852508 <== mgr.8631 v2:172.21.15.82:6832/2950283129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7ff5f80ac250 con 0x7ff5d8066150 2023-07-20T10:08:43.354 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:08:43.354 INFO:teuthology.orchestra.run.smithi082.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-20T10:08:43.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 msgr2=0x7ff5d8068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 0x7ff5d8068610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8003b90 tx=0x7ff5e8009760 comp rx=0 tx=0).stop 2023-07-20T10:08:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 msgr2=0x7ff5f814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:08:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80cacb0 tx=0x7ff5f0011920 comp rx=0 tx=0).stop 2023-07-20T10:08:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 shutdown_connections 2023-07-20T10:08:43.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff5d8066150 0x7ff5d8068610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5f814d2c0 0x7ff5f814d740 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5f80c2200 0x7ff5f80abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 --2- 172.21.15.82:0/2452852508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5e40040a0 0x7ff5f81f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 >> 172.21.15.82:0/2452852508 conn(0x7ff5f80cad50 msgr2=0x7ff5f815c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 shutdown_connections 2023-07-20T10:08:43.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:08:43.378+0000 7ff5fce6d640 1 -- 172.21.15.82:0/2452852508 wait complete. 2023-07-20T10:08:43.374 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-20T10:08:43.374 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-07-20T10:08:43.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:43.375 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:43.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:43.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:43.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:44.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:44.387 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:44.399 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:44.400 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:44.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:45.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:45.402 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:45.414 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:45.415 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:45.415 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:46.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:46.417 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:46.428 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:46.429 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:46.429 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:47.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:47.430 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:47.441 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:47.442 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:47.442 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:48.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:48.443 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:48.455 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:48.455 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:48.456 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:49.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:49.457 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:49.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:49.469 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:49.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:50.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:50.471 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:50.482 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:50.483 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:50.483 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:51.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:51.485 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:51.496 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:51.497 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:51.497 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:52.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:52.498 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:52.510 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:52.510 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:52.511 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:53.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:53.512 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:53.524 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:53.525 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:53.525 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:54.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:54.527 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:54.538 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:54.538 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:54.539 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:55.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:55.540 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:55.551 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:55.552 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:55.552 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:56.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:56.554 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:56.565 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:56.566 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:56.566 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:57.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:57.567 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:57.579 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:57.579 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:57.580 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:58.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:08:58.132 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:08:58.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:58.581 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:58.593 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:58.593 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:58.594 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:08:59.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:08:59.596 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:08:59.607 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T10:08:59.608 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T10:08:59.608 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:09:00.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:00.034+0000 7fe065155640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:00.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:00.034+0000 7fe065155640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:00.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:00.034+0000 7fe065155640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:00.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:00.034+0000 7fe065155640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:00.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:00.034+0000 7fe065155640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:00.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:00.610 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:09:00.620 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_09_00_UTC 2023-07-20T10:09:00.621 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-10_09_00_UTC'} 2023-07-20T10:09:00.622 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-20-10_09_00_UTC'} 2023-07-20T10:09:00.622 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T10:09:00.622 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-20-10_09_00_UTC'] 2023-07-20T10:09:00.623 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689847723.0194654, now = 1689847740.623417, timo = 17 2023-07-20T10:09:01.624 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-20T10:09:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.802+0000 7fced6f67640 1 Processor -- start 2023-07-20T10:09:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.802+0000 7fced6f67640 1 -- start start 2023-07-20T10:09:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced6f67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fced00afd50 0x7fced00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced6f67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00b06b0 con 0x7fced0159450 2023-07-20T10:09:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced6f67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced00cc8d0 con 0x7fced0159830 2023-07-20T10:09:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced6f67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced00cce90 con 0x7fced00afd50 2023-07-20T10:09:01.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fced0159450 0x7fced015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41980/0 (socket says 172.21.15.82:41980) 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 -- 172.21.15.82:0/3150830971 learned_addr learned my addr 172.21.15.82:0/3150830971 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077224951 0 0) 0x7fced00b06b0 con 0x7fced0159450 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceb8005740 con 0x7fced0159450 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced5504640 1 --2- 172.21.15.82:0/3150830971 >> v2:172.21.15.183:3300/0 conn(0x7fced00afd50 0x7fced00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267940523 0 0) 0x7fceb8005740 con 0x7fced0159450 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 >> v2:172.21.15.183:3300/0 conn(0x7fced00afd50 msgr2=0x7fced00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 --2- 172.21.15.82:0/3150830971 >> v2:172.21.15.183:3300/0 conn(0x7fced00afd50 0x7fced00b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 >> v1:172.21.15.183:6789/0 conn(0x7fced0159830 legacy=0x7fced00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00ccbb0 con 0x7fced0159450 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fcec0001a00 con 0x7fced0159450 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 >> v1:172.21.15.82:6789/0 conn(0x7fced0159450 legacy=0x7fced015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 0x7fceb8006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceb80069e0 0x7fceb8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb80073a0 0x7fceb800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00cce90 con 0x7fceb8005c00 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800e2d0 con 0x7fceb80069e0 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb800e490 con 0x7fceb80073a0 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 0x7fceb8006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fcecffff640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceb80069e0 0x7fceb8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced5504640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb80073a0 0x7fceb800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 -- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb80073a0 msgr2=0x7fceb800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb80073a0 0x7fceb800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 -- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceb80069e0 msgr2=0x7fceb8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fceb80069e0 0x7fceb8006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced4d03640 1 -- 172.21.15.82:0/3150830971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8005740 con 0x7fceb8005c00 2023-07-20T10:09:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.806+0000 7fced5504640 1 -- 172.21.15.82:0/3150830971 reap_dead start 2023-07-20T10:09:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced4d03640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 0x7fceb8006020 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fcec00013e0 tx=0x7fcec001d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63746346ce737423 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00ad630 con 0x7fceb8005c00 2023-07-20T10:09:01.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec00a8070 con 0x7fceb8005c00 2023-07-20T10:09:01.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fcecf7fe640 1 -- 172.21.15.82:0/3150830971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00ada50 con 0x7fceb8005c00 2023-07-20T10:09:01.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 -- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 msgr2=0x7fceb8006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:01.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 0x7fceb8006020 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fcec00013e0 tx=0x7fcec001d250 comp rx=0 tx=0).stop 2023-07-20T10:09:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 -- 172.21.15.82:0/3150830971 shutdown_connections 2023-07-20T10:09:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 --2- 172.21.15.82:0/3150830971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fceb8005c00 0x7fceb8006020 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 -- 172.21.15.82:0/3150830971 >> 172.21.15.82:0/3150830971 conn(0x7fced00cad50 msgr2=0x7fced00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 -- 172.21.15.82:0/3150830971 shutdown_connections 2023-07-20T10:09:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.810+0000 7fced6f67640 1 -- 172.21.15.82:0/3150830971 wait complete. 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 Processor -- start 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- start start 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb8005c00 0x7fced0149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced00b3b00 0x7fced00b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c2d80 con 0x7fced0149970 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c2170 con 0x7fced00b3b00 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced00c2450 con 0x7fceb8005c00 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44560/0 (socket says 172.21.15.82:44560) 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 -- 172.21.15.82:0/4559349 learned_addr learned my addr 172.21.15.82:0/4559349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced4d03640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb8005c00 0x7fced0149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced5504640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced00b3b00 0x7fced00b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 -- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb8005c00 msgr2=0x7fced0149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb8005c00 0x7fced0149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 -- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced00b3b00 msgr2=0x7fced00b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced00b3b00 0x7fced00b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 -- 172.21.15.82:0/4559349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced00c2730 con 0x7fced0149970 2023-07-20T10:09:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecffff640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fcec400f770 tx=0x7fcec400fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4001350 con 0x7fced0149970 2023-07-20T10:09:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400feb0 con 0x7fced0149970 2023-07-20T10:09:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec40052f0 con 0x7fced0149970 2023-07-20T10:09:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced00c2a10 con 0x7fced0149970 2023-07-20T10:09:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced00b1bd0 con 0x7fced0149970 2023-07-20T10:09:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.814+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced004da30 con 0x7fced0149970 2023-07-20T10:09:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.818+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 63) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fcec400d730 con 0x7fced0149970 2023-07-20T10:09:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.818+0000 7fcecd7fa640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 0x7fcebc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.818+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fcec4083f80 con 0x7fced0149970 2023-07-20T10:09:01.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.818+0000 7fced4d03640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 0x7fcebc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:01.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.818+0000 7fced4d03640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 0x7fcebc068940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcec00ad000 tx=0x7fcec0009040 comp rx=0 tx=0).ready entity=mgr.8631 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:01.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.822+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcec4051010 con 0x7fced0149970 2023-07-20T10:09:01.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:01.986+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 --> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fced00cc6b0 con 0x7fcebc066480 2023-07-20T10:09:02.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.054+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 64) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fcec40513e0 con 0x7fced0149970 2023-07-20T10:09:02.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fcecd7fa640 1 -- 172.21.15.82:0/4559349 <== mgr.8631 v2:172.21.15.82:6832/2950283129 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcec0001a40 con 0x7fcebc066480 2023-07-20T10:09:02.037 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path snap_test_dir1 2023-07-20T10:09:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 msgr2=0x7fcebc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 0x7fcebc068940 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcec00ad000 tx=0x7fcec0009040 comp rx=0 tx=0).stop 2023-07-20T10:09:02.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 msgr2=0x7fced00b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fcec400f770 tx=0x7fcec400fb70 comp rx=0 tx=0).stop 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 shutdown_connections 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fcebc066480 0x7fcebc068940 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced00b3b00 0x7fced00b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced0149970 0x7fced00b35c0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 --2- 172.21.15.82:0/4559349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fceb8005c00 0x7fced0149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 >> 172.21.15.82:0/4559349 conn(0x7fced00cad50 msgr2=0x7fced015ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:02.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 shutdown_connections 2023-07-20T10:09:02.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.062+0000 7fced6f67640 1 -- 172.21.15.82:0/4559349 wait complete. 2023-07-20T10:09:02.058 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-20T10:09:02.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:02.059 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T10:09:02.068 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_09_00_UTC 2023-07-20T10:09:02.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_09_00_UTC 2023-07-20T10:09:02.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:02.070 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_09_00_UTC) 2023-07-20T10:09:02.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:02.130 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T10:09:02.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T10:09:02.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 Processor -- start 2023-07-20T10:09:02.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 -- start start 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0dac0b0200 0x7f0dac0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0c9690 con 0x7f0dac1591d0 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0ca520 con 0x7f0dac0cd800 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0db1733640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac0c8c00 con 0x7f0dac0b0200 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daaffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0dac1591d0 0x7f0dac070430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41994/0 (socket says 172.21.15.82:41994) 2023-07-20T10:09:02.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daaffd640 1 -- 172.21.15.82:0/1196314421 learned_addr learned my addr 172.21.15.82:0/1196314421 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:02.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0dab7fe640 1 --2- 172.21.15.82:0/1196314421 >> v2:172.21.15.183:3300/0 conn(0x7f0dac0b0200 0x7f0dac0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1873031725 0 0) 0x7f0dac0c9690 con 0x7f0dac1591d0 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d98003530 con 0x7f0dac1591d0 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643993288 0 0) 0x7f0dac0ca520 con 0x7f0dac0cd800 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dac0c9690 con 0x7f0dac0cd800 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0dab7fe640 1 -- 172.21.15.82:0/1196314421 >> v1:172.21.15.183:6789/0 conn(0x7f0dac0cd800 legacy=0x7f0dac0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0dab7fe640 1 -- 172.21.15.82:0/1196314421 >> v1:172.21.15.82:6789/0 conn(0x7f0dac1591d0 legacy=0x7f0dac070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.390+0000 7f0dab7fe640 1 -- 172.21.15.82:0/1196314421 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0c8df0 con 0x7f0dac0b0200 2023-07-20T10:09:02.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0dab7fe640 1 --2- 172.21.15.82:0/1196314421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac0c86c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009d90 tx=0x7f0da401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeada0285727c593 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:02.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a5950 con 0x7f0dac0b0200 2023-07-20T10:09:02.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da40a5ab0 con 0x7f0dac0b0200 2023-07-20T10:09:02.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0daa7fc640 1 -- 172.21.15.82:0/1196314421 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40a5e20 con 0x7f0dac0b0200 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 -- 172.21.15.82:0/1196314421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 msgr2=0x7f0dac0c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 --2- 172.21.15.82:0/1196314421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac0c86c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009d90 tx=0x7f0da401c890 comp rx=0 tx=0).stop 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 -- 172.21.15.82:0/1196314421 shutdown_connections 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 --2- 172.21.15.82:0/1196314421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac0c86c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 -- 172.21.15.82:0/1196314421 >> 172.21.15.82:0/1196314421 conn(0x7f0dac0caaf0 msgr2=0x7f0dac0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:02.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 -- 172.21.15.82:0/1196314421 shutdown_connections 2023-07-20T10:09:02.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.394+0000 7f0db1733640 1 -- 172.21.15.82:0/1196314421 wait complete. 2023-07-20T10:09:02.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 Processor -- start 2023-07-20T10:09:02.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- start start 2023-07-20T10:09:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:02.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dac1591d0 0x7f0dac154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac1f9160 con 0x7f0dac0cd800 2023-07-20T10:09:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b2a50 con 0x7f0dac0b0200 2023-07-20T10:09:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b1e80 con 0x7f0dac1591d0 2023-07-20T10:09:02.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0daaffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44570/0 (socket says 172.21.15.82:44570) 2023-07-20T10:09:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 -- 172.21.15.82:0/1431655058 learned_addr learned my addr 172.21.15.82:0/1431655058 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:02.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0dab7fe640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dac1591d0 0x7f0dac154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 -- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dac1591d0 msgr2=0x7f0dac154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dac1591d0 0x7f0dac154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 -- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 msgr2=0x7f0dac14b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac14b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 -- 172.21.15.82:0/1431655058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4009a70 con 0x7f0dac0cd800 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0daaffd640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:02.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da3fff640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c490 tx=0x7f0d9400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:02.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d940052d0 con 0x7f0dac0cd800 2023-07-20T10:09:02.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94005430 con 0x7f0dac0cd800 2023-07-20T10:09:02.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94012870 con 0x7f0dac0cd800 2023-07-20T10:09:02.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac0b2120 con 0x7f0dac0cd800 2023-07-20T10:09:02.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac0b26e0 con 0x7f0dac0cd800 2023-07-20T10:09:02.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.398+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac04da30 con 0x7f0dac0cd800 2023-07-20T10:09:02.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.402+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 64) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f0d940129d0 con 0x7f0dac0cd800 2023-07-20T10:09:02.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.402+0000 7f0da37fe640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 0x7f0d8c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:02.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.402+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0d94083e30 con 0x7f0dac0cd800 2023-07-20T10:09:02.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.402+0000 7f0daaffd640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 0x7f0d8c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:02.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.402+0000 7f0daaffd640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 0x7f0d8c0689d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c007fd0 tx=0x7f0d9c007d80 comp rx=0 tx=0).ready entity=mgr.8631 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:02.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.406+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d94050e00 con 0x7f0dac0cd800 2023-07-20T10:09:02.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:02.590+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0dac0cbd40 con 0x7f0dac0cd800 2023-07-20T10:09:03.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.058+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f0d940511d0 con 0x7f0dac0cd800 2023-07-20T10:09:03.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0da37fe640 1 -- 172.21.15.82:0/1431655058 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v65) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0d9406c3e0 con 0x7f0dac0cd800 2023-07-20T10:09:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 msgr2=0x7f0d8c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 0x7f0d8c0689d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c007fd0 tx=0x7f0d9c007d80 comp rx=0 tx=0).stop 2023-07-20T10:09:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 msgr2=0x7f0dac0b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c490 tx=0x7f0d9400c950 comp rx=0 tx=0).stop 2023-07-20T10:09:03.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 shutdown_connections 2023-07-20T10:09:03.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f0d8c066510 0x7f0d8c0689d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0dac1591d0 0x7f0dac154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0dac0cd800 0x7f0dac0b2ee0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 --2- 172.21.15.82:0/1431655058 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0dac0b0200 0x7f0dac14b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 >> 172.21.15.82:0/1431655058 conn(0x7f0dac0caaf0 msgr2=0x7f0dac14f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:03.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 shutdown_connections 2023-07-20T10:09:03.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.062+0000 7f0db1733640 1 -- 172.21.15.82:0/1431655058 wait complete. 2023-07-20T10:09:03.061 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:09:03.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:09:03.127 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:09:03.197 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:09:03.197 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:03.198 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:03.207 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:03.207 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:03.209 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:03.235+0000 7f5bf0c53180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:09:03.216 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:03.238+0000 7f8dec87d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:09:03.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:03.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 Processor -- start 2023-07-20T10:09:03.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 -- start start 2023-07-20T10:09:03.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93680afda0 0x7f93680ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b12a0 con 0x7f93680b2060 2023-07-20T10:09:03.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93680b1580 con 0x7f936815a8e0 2023-07-20T10:09:03.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936fbfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680b3160 con 0x7f93680afda0 2023-07-20T10:09:03.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93680afda0 0x7f93680ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f93680afda0 0x7f93680ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59416/0 (socket says 172.21.15.82:59416) 2023-07-20T10:09:03.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936e197640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f93680b2060 0x7f93680b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52018/0 (socket says 172.21.15.82:52018) 2023-07-20T10:09:03.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 -- 172.21.15.82:0/793690784 learned_addr learned my addr 172.21.15.82:0/793690784 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:03.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 -- 172.21.15.82:0/793690784 >> v1:172.21.15.183:6789/0 conn(0x7f936815a8e0 legacy=0x7f93680b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 -- 172.21.15.82:0/793690784 >> v1:172.21.15.82:6789/0 conn(0x7f93680b2060 legacy=0x7f93680b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936d996640 1 -- 172.21.15.82:0/793690784 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680b1860 con 0x7f93680afda0 2023-07-20T10:09:03.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.434+0000 7f936c994640 1 -- 172.21.15.82:0/793690784 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114891762 0 0) 0x7f93680b12a0 con 0x7f93680b2060 2023-07-20T10:09:03.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936d996640 1 --2- 172.21.15.82:0/793690784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f93680ca6b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9364009870 tx=0x7f936401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d96b489cbf37ff4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:03.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936c994640 1 -- 172.21.15.82:0/793690784 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93640ab610 con 0x7f93680afda0 2023-07-20T10:09:03.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936c994640 1 -- 172.21.15.82:0/793690784 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93640ab770 con 0x7f93680afda0 2023-07-20T10:09:03.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936c994640 1 -- 172.21.15.82:0/793690784 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93640abb00 con 0x7f93680afda0 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 -- 172.21.15.82:0/793690784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 msgr2=0x7f93680ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 --2- 172.21.15.82:0/793690784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f93680ca6b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f9364009870 tx=0x7f936401c3f0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 -- 172.21.15.82:0/793690784 shutdown_connections 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 --2- 172.21.15.82:0/793690784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f93680ca6b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 -- 172.21.15.82:0/793690784 >> 172.21.15.82:0/793690784 conn(0x7f93680cada0 msgr2=0x7f93680cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:03.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 -- 172.21.15.82:0/793690784 shutdown_connections 2023-07-20T10:09:03.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.438+0000 7f936fbfa640 1 -- 172.21.15.82:0/793690784 wait complete. 2023-07-20T10:09:03.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 Processor -- start 2023-07-20T10:09:03.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- start start 2023-07-20T10:09:03.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93680b2060 0x7f93680adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936815a8e0 0x7f93680ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815b5a0 con 0x7f93680afda0 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93680c4ad0 con 0x7f936815a8e0 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815ad20 con 0x7f93680b2060 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59424/0 (socket says 172.21.15.82:59424) 2023-07-20T10:09:03.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 -- 172.21.15.82:0/1695485400 learned_addr learned my addr 172.21.15.82:0/1695485400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:03.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d195640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93680b2060 0x7f93680adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936e197640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936815a8e0 0x7f93680ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 -- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93680b2060 msgr2=0x7f93680adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93680b2060 0x7f93680adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 -- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936815a8e0 msgr2=0x7f93680ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936815a8e0 0x7f93680ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 -- 172.21.15.82:0/1695485400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640094d0 con 0x7f93680afda0 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936d996640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f93640ad040 tx=0x7f936401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93640abe30 con 0x7f93680afda0 2023-07-20T10:09:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93640b8070 con 0x7f93680afda0 2023-07-20T10:09:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364004220 con 0x7f93680afda0 2023-07-20T10:09:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f936815afe0 con 0x7f93680afda0 2023-07-20T10:09:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.442+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93680ab030 con 0x7f93680afda0 2023-07-20T10:09:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93680aae90 con 0x7f93680afda0 2023-07-20T10:09:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f9364004380 con 0x7f93680afda0 2023-07-20T10:09:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f935e7fc640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 0x7f934c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f936d195640 1 -- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 msgr2=0x7f934c068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f936411e540 con 0x7f93680afda0 2023-07-20T10:09:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.446+0000 7f936d195640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 0x7f934c068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.450+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93680aae90 con 0x7f93680afda0 2023-07-20T10:09:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.602+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93680aae90 con 0x7f93680afda0 2023-07-20T10:09:03.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.602+0000 7f935e7fc640 1 -- 172.21.15.82:0/1695485400 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18769 (secure 0 0 0) 0x7f93680aae90 con 0x7f93680afda0 2023-07-20T10:09:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:03.580 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":124,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:41.941614+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1193855226":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/1311622631":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6833/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6832/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/467905236":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2263958707":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2514495626":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/3151351148":"2023-07-21T10:08:41.941567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 msgr2=0x7f934c068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 0x7f934c068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 msgr2=0x7f9368153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f93640ad040 tx=0x7f936401ac30 comp rx=0 tx=0).stop 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 shutdown_connections 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f934c0664c0 0x7f934c068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f936815a8e0 0x7f93680ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f93680b2060 0x7f93680adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 --2- 172.21.15.82:0/1695485400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93680afda0 0x7f9368153ba0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 >> 172.21.15.82:0/1695485400 conn(0x7f93680cada0 msgr2=0x7f93680cd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 shutdown_connections 2023-07-20T10:09:03.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.606+0000 7f936fbfa640 1 -- 172.21.15.82:0/1695485400 wait complete. 2023-07-20T10:09:03.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:08:22.111844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:08:23.430963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:09:03.602 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:09:03.627 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:03.654+0000 7f5bf0c53180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:09:03.646 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:03.670+0000 7f8dec87d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:09:03.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.774+0000 7f9da9e9c640 1 Processor -- start 2023-07-20T10:09:03.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.774+0000 7f9da9e9c640 1 -- start start 2023-07-20T10:09:03.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da9e9c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9da41602b0 0x7f9da4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da9e9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40ce4f0 con 0x7f9da406ab10 2023-07-20T10:09:03.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da9e9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da40d0970 con 0x7f9da406c120 2023-07-20T10:09:03.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da9e9c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da4160e20 con 0x7f9da41602b0 2023-07-20T10:09:03.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da3fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9da406ab10 0x7f9da406af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52024/0 (socket says 172.21.15.82:52024) 2023-07-20T10:09:03.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da3fff640 1 -- 172.21.15.82:0/2122947523 learned_addr learned my addr 172.21.15.82:0/2122947523 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:03.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da2ffd640 1 --2- 172.21.15.82:0/2122947523 >> v2:172.21.15.183:3300/0 conn(0x7f9da41602b0 0x7f9da4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145687485 0 0) 0x7f9da40ce4f0 con 0x7f9da406ab10 2023-07-20T10:09:03.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d8c003530 con 0x7f9da406ab10 2023-07-20T10:09:03.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da2ffd640 1 -- 172.21.15.82:0/2122947523 >> v1:172.21.15.183:6789/0 conn(0x7f9da406c120 legacy=0x7f9da40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224391946 0 0) 0x7f9da40d0970 con 0x7f9da406c120 2023-07-20T10:09:03.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da2ffd640 1 -- 172.21.15.82:0/2122947523 >> v1:172.21.15.82:6789/0 conn(0x7f9da406ab10 legacy=0x7f9da406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.778+0000 7f9da2ffd640 1 -- 172.21.15.82:0/2122947523 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da40cd300 con 0x7f9da41602b0 2023-07-20T10:09:03.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da2ffd640 1 --2- 172.21.15.82:0/2122947523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da41602b0 0x7f9da4160740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d9801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd10ed7b90849ae server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:03.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ab600 con 0x7f9da41602b0 2023-07-20T10:09:03.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980a7050 con 0x7f9da41602b0 2023-07-20T10:09:03.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da27fc640 1 -- 172.21.15.82:0/2122947523 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980ab980 con 0x7f9da41602b0 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 -- 172.21.15.82:0/2122947523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da41602b0 msgr2=0x7f9da4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/2122947523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da41602b0 0x7f9da4160740 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9d980097c0 tx=0x7f9d9801c330 comp rx=0 tx=0).stop 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 -- 172.21.15.82:0/2122947523 shutdown_connections 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/2122947523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da41602b0 0x7f9da4160740 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 -- 172.21.15.82:0/2122947523 >> 172.21.15.82:0/2122947523 conn(0x7f9da408c0a0 msgr2=0x7f9da409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 -- 172.21.15.82:0/2122947523 shutdown_connections 2023-07-20T10:09:03.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.782+0000 7f9da9e9c640 1 -- 172.21.15.82:0/2122947523 wait complete. 2023-07-20T10:09:03.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 Processor -- start 2023-07-20T10:09:03.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- start start 2023-07-20T10:09:03.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9da406ab10 0x7f9da4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 0x7f9da40b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da40c67e0 con 0x7f9da41602b0 2023-07-20T10:09:03.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da40b7de0 con 0x7f9da406c120 2023-07-20T10:09:03.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da40b80c0 con 0x7f9da406ab10 2023-07-20T10:09:03.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 0x7f9da40b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:60400/0 (socket says 172.21.15.82:60400) 2023-07-20T10:09:03.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 -- 172.21.15.82:0/3405760426 learned_addr learned my addr 172.21.15.82:0/3405760426 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da37fe640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9da406ab10 0x7f9da4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 -- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9da406ab10 msgr2=0x7f9da4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9da406ab10 0x7f9da4154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 -- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 msgr2=0x7f9da40b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 0x7f9da40b7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 -- 172.21.15.82:0/3405760426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009420 con 0x7f9da406c120 2023-07-20T10:09:03.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da3fff640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 0x7f9da40b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da2ffd640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000c10 tx=0x7f9d980190d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980b4400 con 0x7f9da406c120 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980b4560 con 0x7f9da406c120 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da40c6aa0 con 0x7f9da406c120 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980b48d0 con 0x7f9da406c120 2023-07-20T10:09:03.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.786+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da41557c0 con 0x7f9da406c120 2023-07-20T10:09:03.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da40c6fc0 con 0x7f9da406c120 2023-07-20T10:09:03.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f9d980b2040 con 0x7f9da406c120 2023-07-20T10:09:03.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9d8bfff640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 0x7f9d90068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:03.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9da37fe640 1 -- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 msgr2=0x7f9d90068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:03.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9d9811e1d0 con 0x7f9da406c120 2023-07-20T10:09:03.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.790+0000 7f9da37fe640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 0x7f9d90068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:03.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.794+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9da40c6fc0 con 0x7f9da406c120 2023-07-20T10:09:03.779 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:03.806+0000 7f5bf0c53180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:09:03.804 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:03.826+0000 7f8dec87d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:09:03.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9da40c6fc0 con 0x7f9da406c120 2023-07-20T10:09:03.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9d8bfff640 1 -- 172.21.15.82:0/3405760426 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9da40c6fc0 con 0x7f9da406c120 2023-07-20T10:09:03.922 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:09:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 msgr2=0x7f9d90068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 0x7f9d90068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 msgr2=0x7f9da40b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:03.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000c10 tx=0x7f9d980190d0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 shutdown_connections 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f9d900664c0 0x7f9d90068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9da41602b0 0x7f9da40b7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9da406c120 0x7f9da40b7220 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 --2- 172.21.15.82:0/3405760426 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9da406ab10 0x7f9da4154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.946+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 >> 172.21.15.82:0/3405760426 conn(0x7f9da408c0a0 msgr2=0x7f9da406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:03.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.950+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 shutdown_connections 2023-07-20T10:09:03.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:03.950+0000 7f9da9e9c640 1 -- 172.21.15.82:0/3405760426 wait complete. 2023-07-20T10:09:03.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:09:04.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 Processor -- start 2023-07-20T10:09:04.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 -- start start 2023-07-20T10:09:04.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd3601602b0 0x7fd360160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd36006ab10 0x7fd36006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3600ce4f0 con 0x7fd36006c120 2023-07-20T10:09:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3600d0970 con 0x7fd36006ab10 2023-07-20T10:09:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd364f33640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd360160e20 con 0x7fd3601602b0 2023-07-20T10:09:04.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd35ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd36006ab10 0x7fd36006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd35ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd36006ab10 0x7fd36006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59452/0 (socket says 172.21.15.82:59452) 2023-07-20T10:09:04.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd35ed9d640 1 -- 172.21.15.82:0/4116288657 learned_addr learned my addr 172.21.15.82:0/4116288657 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:04.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.158+0000 7fd357fff640 1 --2- 172.21.15.82:0/4116288657 >> v2:172.21.15.183:3300/0 conn(0x7fd3601602b0 0x7fd360160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35ed9d640 1 -- 172.21.15.82:0/4116288657 >> v2:172.21.15.183:3300/0 conn(0x7fd3601602b0 msgr2=0x7fd360160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:04.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35ed9d640 1 --2- 172.21.15.82:0/4116288657 >> v2:172.21.15.183:3300/0 conn(0x7fd3601602b0 0x7fd360160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35ed9d640 1 -- 172.21.15.82:0/4116288657 >> v1:172.21.15.183:6789/0 conn(0x7fd36006c120 legacy=0x7fd3600cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35ed9d640 1 -- 172.21.15.82:0/4116288657 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600cd300 con 0x7fd36006ab10 2023-07-20T10:09:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35ed9d640 1 --2- 172.21.15.82:0/4116288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36006ab10 0x7fd36006af10 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd36008ca40 tx=0x7fd35801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c695bca00a28bb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35dd9b640 1 -- 172.21.15.82:0/4116288657 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580a57d0 con 0x7fd36006ab10 2023-07-20T10:09:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35dd9b640 1 -- 172.21.15.82:0/4116288657 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580a5930 con 0x7fd36006ab10 2023-07-20T10:09:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd35dd9b640 1 -- 172.21.15.82:0/4116288657 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580a5cc0 con 0x7fd36006ab10 2023-07-20T10:09:04.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd364f33640 1 -- 172.21.15.82:0/4116288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36006ab10 msgr2=0x7fd36006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.162+0000 7fd364f33640 1 --2- 172.21.15.82:0/4116288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36006ab10 0x7fd36006af10 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd36008ca40 tx=0x7fd35801c910 comp rx=0 tx=0).stop 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- 172.21.15.82:0/4116288657 shutdown_connections 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 --2- 172.21.15.82:0/4116288657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd36006ab10 0x7fd36006af10 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 --2- 172.21.15.82:0/4116288657 >> v2:172.21.15.183:3300/0 conn(0x7fd3601602b0 0x7fd360160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- 172.21.15.82:0/4116288657 >> 172.21.15.82:0/4116288657 conn(0x7fd36008c0a0 msgr2=0x7fd36009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- 172.21.15.82:0/4116288657 shutdown_connections 2023-07-20T10:09:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- 172.21.15.82:0/4116288657 wait complete. 2023-07-20T10:09:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 Processor -- start 2023-07-20T10:09:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- start start 2023-07-20T10:09:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 0x7fd360157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd36006c120 0x7fd3601546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3600ca680 con 0x7fd3601602b0 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd360157b70 con 0x7fd36006ab10 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd364f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd360154bf0 con 0x7fd36006c120 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59454/0 (socket says 172.21.15.82:59454) 2023-07-20T10:09:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 0x7fd360157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 -- 172.21.15.82:0/3795237570 learned_addr learned my addr 172.21.15.82:0/3795237570 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:04.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd357fff640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd36006c120 0x7fd3601546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 -- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd36006c120 msgr2=0x7fd3601546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd36006c120 0x7fd3601546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 -- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 msgr2=0x7fd360157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 0x7fd360157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35ed9d640 1 -- 172.21.15.82:0/3795237570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009b30 con 0x7fd3601602b0 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.166+0000 7fd35e59c640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 0x7fd360157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:04.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd35ed9d640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fd3580af040 tx=0x7fd3580196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b8670 con 0x7fd3601602b0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580b87d0 con 0x7fd3601602b0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3600c9720 con 0x7fd3601602b0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580b8b60 con 0x7fd3601602b0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3600c9ce0 con 0x7fd3601602b0 2023-07-20T10:09:04.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3600ca7c0 con 0x7fd3601602b0 2023-07-20T10:09:04.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.170+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fd3580b8cc0 con 0x7fd3601602b0 2023-07-20T10:09:04.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.174+0000 7fd356ffd640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 0x7fd340068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.174+0000 7fd35e59c640 1 -- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 msgr2=0x7fd340068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:04.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.174+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd35811f6c0 con 0x7fd3601602b0 2023-07-20T10:09:04.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.174+0000 7fd35e59c640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 0x7fd340068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:04.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.178+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3600ca7c0 con 0x7fd3601602b0 2023-07-20T10:09:04.264 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.290+0000 7f5bf0c53180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.326+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3600ca7c0 con 0x7fd3601602b0 2023-07-20T10:09:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.326+0000 7fd356ffd640 1 -- 172.21.15.82:0/3795237570 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3600ca7c0 con 0x7fd3601602b0 2023-07-20T10:09:04.303 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:09:04.303 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.326+0000 7f8dec87d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 msgr2=0x7fd340068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 0x7fd340068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 msgr2=0x7fd3600caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fd3580af040 tx=0x7fd3580196b0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 shutdown_connections 2023-07-20T10:09:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd3400664c0 0x7fd340068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3601602b0 0x7fd3600caaa0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd36006c120 0x7fd3601546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 --2- 172.21.15.82:0/3795237570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd36006ab10 0x7fd360157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 >> 172.21.15.82:0/3795237570 conn(0x7fd36008c0a0 msgr2=0x7fd36009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 shutdown_connections 2023-07-20T10:09:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.330+0000 7fd364f33640 1 -- 172.21.15.82:0/3795237570 wait complete. 2023-07-20T10:09:04.323 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.350+0000 7f5bf0c53180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:09:04.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:09:04.366 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.390+0000 7f8dec87d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:09:04.379 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.406+0000 7f5bf0c53180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:09:04.424 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.450+0000 7f8dec87d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:09:04.465 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.490+0000 7f5bf0c53180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:09:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 Processor -- start 2023-07-20T10:09:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 -- start start 2023-07-20T10:09:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f151806c120 0x7f15180cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15181602b0 0x7f1518160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 0x7f151806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f151806b4c0 con 0x7f151806c120 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180d0970 con 0x7f151806ab10 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f1520733640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518160e20 con 0x7f15181602b0 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f151806c120 0x7f15180cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f151806c120 0x7f15180cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59458/0 (socket says 172.21.15.82:59458) 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 -- 172.21.15.82:0/3365527455 learned_addr learned my addr 172.21.15.82:0/3365527455 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151ecd0640 1 --2- 172.21.15.82:0/3365527455 >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 0x7f151806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151dcce640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15181602b0 0x7f1518160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 -- 172.21.15.82:0/3365527455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15181602b0 msgr2=0x7f1518160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:04.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15181602b0 0x7f1518160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 -- 172.21.15.82:0/3365527455 >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 msgr2=0x7f151806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:04.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 --2- 172.21.15.82:0/3365527455 >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 0x7f151806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151e4cf640 1 -- 172.21.15.82:0/3365527455 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180cd300 con 0x7f151806c120 2023-07-20T10:09:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.494+0000 7f151ecd0640 1 --2- 172.21.15.82:0/3365527455 >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 0x7f151806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f151e4cf640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f151806c120 0x7f15180cdde0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f151808b920 tx=0x7f151401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28835f6fefd0933b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f151d4cd640 1 -- 172.21.15.82:0/3365527455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140ab600 con 0x7f151806c120 2023-07-20T10:09:04.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f151d4cd640 1 -- 172.21.15.82:0/3365527455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15140a7050 con 0x7f151806c120 2023-07-20T10:09:04.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f151d4cd640 1 -- 172.21.15.82:0/3365527455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140ab980 con 0x7f151806c120 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 -- 172.21.15.82:0/3365527455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f151806c120 msgr2=0x7f15180cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f151806c120 0x7f15180cdde0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f151808b920 tx=0x7f151401c470 comp rx=0 tx=0).stop 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 -- 172.21.15.82:0/3365527455 shutdown_connections 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 --2- 172.21.15.82:0/3365527455 >> v2:172.21.15.183:3300/0 conn(0x7f151806ab10 0x7f151806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f15181602b0 0x7f1518160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 --2- 172.21.15.82:0/3365527455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f151806c120 0x7f15180cdde0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 -- 172.21.15.82:0/3365527455 >> 172.21.15.82:0/3365527455 conn(0x7f151808c0a0 msgr2=0x7f151809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 -- 172.21.15.82:0/3365527455 shutdown_connections 2023-07-20T10:09:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.498+0000 7f1520733640 1 -- 172.21.15.82:0/3365527455 wait complete. 2023-07-20T10:09:04.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 Processor -- start 2023-07-20T10:09:04.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- start start 2023-07-20T10:09:04.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f151806ab10 0x7f151815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f151806c120 0x7f1518156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518157820 con 0x7f15181602b0 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c6180 con 0x7f151806c120 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180c63d0 con 0x7f151806ab10 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59470/0 (socket says 172.21.15.82:59470) 2023-07-20T10:09:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 -- 172.21.15.82:0/4180426131 learned_addr learned my addr 172.21.15.82:0/4180426131 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151e4cf640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f151806ab10 0x7f151815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151dcce640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f151806c120 0x7f1518156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 -- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f151806ab10 msgr2=0x7f151815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f151806ab10 0x7f151815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 -- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f151806c120 msgr2=0x7f1518156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f151806c120 0x7f1518156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 -- 172.21.15.82:0/4180426131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15140094d0 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f151ecd0640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f1510007e10 tx=0x7f151000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510003ba0 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000f040 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000de80 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180c66b0 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.502+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15180c6c70 con 0x7f15181602b0 2023-07-20T10:09:04.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151804da30 con 0x7f15181602b0 2023-07-20T10:09:04.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1510004030 con 0x7f15181602b0 2023-07-20T10:09:04.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f150effd640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 0x7f14fc068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1510084690 con 0x7f15181602b0 2023-07-20T10:09:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f151e4cf640 1 -- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 msgr2=0x7f14fc068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.506+0000 7f151e4cf640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 0x7f14fc068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.510+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15100515e0 con 0x7f15181602b0 2023-07-20T10:09:04.516 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.542+0000 7f8dec87d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:09:04.524 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.550+0000 7f5bf0c53180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:09:04.574 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.598+0000 7f8dec87d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:09:04.609 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.634+0000 7f5bf0c53180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:09:04.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.662+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15180cee40 con 0x7f15181602b0 2023-07-20T10:09:04.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.662+0000 7f150effd640 1 -- 172.21.15.82:0/4180426131 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1510054c00 con 0x7f15181602b0 2023-07-20T10:09:04.639 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:09:04.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 msgr2=0x7f14fc068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:04.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 0x7f14fc068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 msgr2=0x7f15181572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f1510007e10 tx=0x7f151000d4a0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 shutdown_connections 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f14fc0664c0 0x7f14fc068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15181602b0 0x7f15181572e0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f151806c120 0x7f1518156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 --2- 172.21.15.82:0/4180426131 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f151806ab10 0x7f151815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 >> 172.21.15.82:0/4180426131 conn(0x7f151808c0a0 msgr2=0x7f15180af320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 shutdown_connections 2023-07-20T10:09:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.666+0000 7f1520733640 1 -- 172.21.15.82:0/4180426131 wait complete. 2023-07-20T10:09:04.661 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:09:04.662 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.686+0000 7f8dec87d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:09:04.665 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.690+0000 7f5bf0c53180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:09:04.720 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.746+0000 7f8dec87d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:09:04.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 Processor -- start 2023-07-20T10:09:04.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 -- start start 2023-07-20T10:09:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff30806c120 0x7ff3080cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 0x7ff308160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3080d0970 con 0x7ff30806ab10 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff308160e20 con 0x7ff30806c120 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff310182640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3080cd300 con 0x7ff3081602b0 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30e71f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff30806ab10 0x7ff30806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52028/0 (socket says 172.21.15.82:52028) 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30e71f640 1 -- 172.21.15.82:0/3593704398 learned_addr learned my addr 172.21.15.82:0/3593704398 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30df1e640 1 --2- 172.21.15.82:0/3593704398 >> v2:172.21.15.183:3300/0 conn(0x7ff30806c120 0x7ff3080cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30d71d640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 0x7ff308160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.809 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.834+0000 7f5bf0c53180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30cf1c640 1 -- 172.21.15.82:0/3593704398 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080248826 0 0) 0x7ff3080d0970 con 0x7ff30806ab10 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.830+0000 7ff30cf1c640 1 -- 172.21.15.82:0/3593704398 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f4003530 con 0x7ff30806ab10 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30df1e640 1 -- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 msgr2=0x7ff308160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30df1e640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 0x7ff308160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30df1e640 1 -- 172.21.15.82:0/3593704398 >> v1:172.21.15.82:6789/0 conn(0x7ff30806ab10 legacy=0x7ff30806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30df1e640 1 -- 172.21.15.82:0/3593704398 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080cd5e0 con 0x7ff30806c120 2023-07-20T10:09:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30d71d640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 0x7ff308160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30df1e640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30806c120 0x7ff3080cdde0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff3040097c0 tx=0x7ff30401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77460f37540b8f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30cf1c640 1 -- 172.21.15.82:0/3593704398 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040ab600 con 0x7ff30806c120 2023-07-20T10:09:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30cf1c640 1 -- 172.21.15.82:0/3593704398 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040a7050 con 0x7ff30806c120 2023-07-20T10:09:04.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.834+0000 7ff30cf1c640 1 -- 172.21.15.82:0/3593704398 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040ab980 con 0x7ff30806c120 2023-07-20T10:09:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30806c120 msgr2=0x7ff3080cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30806c120 0x7ff3080cdde0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff3040097c0 tx=0x7ff30401c3f0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- 172.21.15.82:0/3593704398 shutdown_connections 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3081602b0 0x7ff308160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 --2- 172.21.15.82:0/3593704398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30806c120 0x7ff3080cdde0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- 172.21.15.82:0/3593704398 >> 172.21.15.82:0/3593704398 conn(0x7ff30808c0a0 msgr2=0x7ff30809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- 172.21.15.82:0/3593704398 shutdown_connections 2023-07-20T10:09:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- 172.21.15.82:0/3593704398 wait complete. 2023-07-20T10:09:04.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 Processor -- start 2023-07-20T10:09:04.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.838+0000 7ff310182640 1 -- start start 2023-07-20T10:09:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 0x7ff308156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3081602b0 0x7ff30814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff308155a20 con 0x7ff30806ab10 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff308155d00 con 0x7ff3081602b0 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff308155fe0 con 0x7ff30806c120 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30df1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30df1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59486/0 (socket says 172.21.15.82:59486) 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30df1e640 1 -- 172.21.15.82:0/2591828315 learned_addr learned my addr 172.21.15.82:0/2591828315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 0x7ff308156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30e71f640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3081602b0 0x7ff30814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:04.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 -- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3081602b0 msgr2=0x7ff30814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3081602b0 0x7ff30814d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 -- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 msgr2=0x7ff30806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 -- 172.21.15.82:0/2591828315 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f8009420 con 0x7ff30806c120 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30df1e640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff30d71d640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 0x7ff308156ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e8e0 tx=0x7ff2f800eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800c8e0 con 0x7ff30806c120 2023-07-20T10:09:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f800ca40 con 0x7ff30806c120 2023-07-20T10:09:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f800cdf0 con 0x7ff30806c120 2023-07-20T10:09:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff304009420 con 0x7ff30806c120 2023-07-20T10:09:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3081565a0 con 0x7ff30806c120 2023-07-20T10:09:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.842+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30804da30 con 0x7ff30806c120 2023-07-20T10:09:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.846+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ff2f8013470 con 0x7ff30806c120 2023-07-20T10:09:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.846+0000 7ff2fe7fc640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 0x7ff2ec0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.846+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff2f8084480 con 0x7ff30806c120 2023-07-20T10:09:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.846+0000 7ff30df1e640 1 -- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 msgr2=0x7ff2ec0689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.846+0000 7ff30df1e640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 0x7ff2ec0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:04.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.850+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2f8051490 con 0x7ff30806c120 2023-07-20T10:09:04.868 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:04.894+0000 7f5bf0c53180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:09:04.871 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.894+0000 7f8dec87d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:09:04.930 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:04.954+0000 7f8dec87d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:09:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:04.998+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3080cee40 con 0x7ff30806c120 2023-07-20T10:09:04.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff2fe7fc640 1 -- 172.21.15.82:0/2591828315 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2f8054ab0 con 0x7ff30806c120 2023-07-20T10:09:04.977 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:09:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 msgr2=0x7ff2ec0689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 0x7ff2ec0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 msgr2=0x7ff308156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 0x7ff308156ac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e8e0 tx=0x7ff2f800eda0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 shutdown_connections 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7ff2ec0664f0 0x7ff2ec0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3081602b0 0x7ff30814d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30806c120 0x7ff308156ac0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 --2- 172.21.15.82:0/2591828315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30806ab10 0x7ff30806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 >> 172.21.15.82:0/2591828315 conn(0x7ff30808c0a0 msgr2=0x7ff3080b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 shutdown_connections 2023-07-20T10:09:04.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.002+0000 7ff310182640 1 -- 172.21.15.82:0/2591828315 wait complete. 2023-07-20T10:09:04.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T10:09:05.112 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:09:05.113 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:09:05.113 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:09:05.120 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:05.146+0000 7f5bf0c53180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:09:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 Processor -- start 2023-07-20T10:09:05.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 -- start start 2023-07-20T10:09:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 0x7f94f40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 0x7f94f40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40d16b0 con 0x7f94f415cab0 2023-07-20T10:09:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40d31c0 con 0x7f94f40cd4b0 2023-07-20T10:09:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94fa0e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40b3520 con 0x7f94f40d0d10 2023-07-20T10:09:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f94f415cab0 0x7f94f40d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52038/0 (socket says 172.21.15.82:52038) 2023-07-20T10:09:05.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f37fe640 1 -- 172.21.15.82:0/821934611 learned_addr learned my addr 172.21.15.82:0/821934611 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/821934611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 0x7f94f40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f3fff640 1 --2- 172.21.15.82:0/821934611 >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 0x7f94f40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f27fc640 1 -- 172.21.15.82:0/821934611 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354271320 0 0) 0x7f94f40d16b0 con 0x7f94f415cab0 2023-07-20T10:09:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f27fc640 1 -- 172.21.15.82:0/821934611 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94dc003530 con 0x7f94f415cab0 2023-07-20T10:09:05.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f2ffd640 1 -- 172.21.15.82:0/821934611 >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 msgr2=0x7f94f40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/821934611 >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 0x7f94f40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f2ffd640 1 -- 172.21.15.82:0/821934611 >> v1:172.21.15.82:6789/0 conn(0x7f94f415cab0 legacy=0x7f94f40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f2ffd640 1 -- 172.21.15.82:0/821934611 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40d0a10 con 0x7f94f40d0d10 2023-07-20T10:09:05.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.206+0000 7f94f3fff640 1 --2- 172.21.15.82:0/821934611 >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 0x7f94f40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:05.185 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:09:05.186 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:09:05.186 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:09:05.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/821934611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 0x7f94f40d1170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64321ac81a31c4d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94f27fc640 1 -- 172.21.15.82:0/821934611 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80ab650 con 0x7f94f40d0d10 2023-07-20T10:09:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94f27fc640 1 -- 172.21.15.82:0/821934611 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80ab7b0 con 0x7f94f40d0d10 2023-07-20T10:09:05.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94f27fc640 1 -- 172.21.15.82:0/821934611 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80abb40 con 0x7f94f40d0d10 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 -- 172.21.15.82:0/821934611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 msgr2=0x7f94f40d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/821934611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 0x7f94f40d1170 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c450 comp rx=0 tx=0).stop 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 -- 172.21.15.82:0/821934611 shutdown_connections 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/821934611 >> v2:172.21.15.183:3300/0 conn(0x7f94f40cd4b0 0x7f94f40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/821934611 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40d0d10 0x7f94f40d1170 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 -- 172.21.15.82:0/821934611 >> 172.21.15.82:0/821934611 conn(0x7f94f408c120 msgr2=0x7f94f409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:05.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 -- 172.21.15.82:0/821934611 shutdown_connections 2023-07-20T10:09:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.210+0000 7f94fa0e5640 1 -- 172.21.15.82:0/821934611 wait complete. 2023-07-20T10:09:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 Processor -- start 2023-07-20T10:09:05.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- start start 2023-07-20T10:09:05.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40cd4b0 0x7f94f4153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94f415cab0 0x7f94f40b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41f49d0 con 0x7f94f40d0d10 2023-07-20T10:09:05.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4154030 con 0x7f94f415cab0 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41f4c00 con 0x7f94f40cd4b0 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40cd4b0 0x7f94f4153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59496/0 (socket says 172.21.15.82:59496) 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 -- 172.21.15.82:0/2172933662 learned_addr learned my addr 172.21.15.82:0/2172933662 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f3fff640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94f415cab0 0x7f94f40b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 -- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40cd4b0 msgr2=0x7f94f4153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40cd4b0 0x7f94f4153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 -- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94f415cab0 msgr2=0x7f94f40b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94f415cab0 0x7f94f40b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 -- 172.21.15.82:0/2172933662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009a70 con 0x7f94f40d0d10 2023-07-20T10:09:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94f2ffd640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f94e801ab00 tx=0x7f94e801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80bf610 con 0x7f94f40d0d10 2023-07-20T10:09:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80bf770 con 0x7f94f40d0d10 2023-07-20T10:09:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80bfb20 con 0x7f94f40d0d10 2023-07-20T10:09:05.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e8009420 con 0x7f94f40d0d10 2023-07-20T10:09:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.214+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f41f51c0 con 0x7f94f40d0d10 2023-07-20T10:09:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f4073c70 con 0x7f94f40d0d10 2023-07-20T10:09:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f94f40ce690 con 0x7f94f40d0d10 2023-07-20T10:09:05.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94dbfff640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 0x7f94e0068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f94e811e8a0 con 0x7f94f40d0d10 2023-07-20T10:09:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94f37fe640 1 -- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 msgr2=0x7f94e0068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:05.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f94f37fe640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 0x7f94e0068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:05.196 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:05.218+0000 7f8dec87d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:09:05.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.222+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94e80eba30 con 0x7f94f40d0d10 2023-07-20T10:09:05.256 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:05.282+0000 7f5bf0c53180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:05.331 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:05.354+0000 7f8dec87d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:05.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.382+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94f40b2ea0 con 0x7f94f40d0d10 2023-07-20T10:09:05.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94dbfff640 1 -- 172.21.15.82:0/2172933662 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v124) v1 ==== 80+0+469 (secure 0 0 0) 0x7f94e80ef050 con 0x7f94f40d0d10 2023-07-20T10:09:05.360 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1193855226 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.360 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1311622631 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/4046893014 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/4046893014 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/467905236 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2263958707 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2514495626 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.361 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3151351148 2023-07-21T10:08:41.941567+0000 2023-07-20T10:09:05.362 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T10:09:05.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 msgr2=0x7f94e0068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:05.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 0x7f94e0068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 msgr2=0x7f94f40b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f94e801ab00 tx=0x7f94e801ac90 comp rx=0 tx=0).stop 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 shutdown_connections 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f94e00664c0 0x7f94e0068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f94f415cab0 0x7f94f40b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f40d0d10 0x7f94f40b00c0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 --2- 172.21.15.82:0/2172933662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f94f40cd4b0 0x7f94f4153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 >> 172.21.15.82:0/2172933662 conn(0x7f94f408c120 msgr2=0x7f94f406b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 shutdown_connections 2023-07-20T10:09:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.386+0000 7f94fa0e5640 1 -- 172.21.15.82:0/2172933662 wait complete. 2023-07-20T10:09:05.381 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:05.406+0000 7f5bf0c53180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:05.382 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T10:09:05.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:05.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T10:09:05.433 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T10:09:05.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:05.434 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T10:09:05.443 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:09:05.444 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:05.452 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:05.478+0000 7f5bf0c53180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:09:05.454 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:09:05.454 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:05.454 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:05.462 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:05.486+0000 7f8dec87d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:05.471 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:09:05.471 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:09:05.471 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:05.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:09:05.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:05.534 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:05.558+0000 7f8dec87d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:09:05.589 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:05.614+0000 7f5bf0c53180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:05.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 Processor -- start 2023-07-20T10:09:05.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 -- start start 2023-07-20T10:09:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd14415cab0 0x7fd1440d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440b3520 con 0x7fd1440ce4c0 2023-07-20T10:09:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440cff30 con 0x7fd1440d0d10 2023-07-20T10:09:05.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd14b91e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440d31c0 con 0x7fd14415cab0 2023-07-20T10:09:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd149ebb640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd1440ce4c0 0x7fd1440cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52050/0 (socket says 172.21.15.82:52050) 2023-07-20T10:09:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd149ebb640 1 -- 172.21.15.82:0/98637136 learned_addr learned my addr 172.21.15.82:0/98637136 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:05.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd1496ba640 1 --2- 172.21.15.82:0/98637136 >> v2:172.21.15.183:3300/0 conn(0x7fd14415cab0 0x7fd1440d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984065746 0 0) 0x7fd1440b3520 con 0x7fd1440ce4c0 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd130003530 con 0x7fd1440ce4c0 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852283067 0 0) 0x7fd1440cff30 con 0x7fd1440d0d10 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1440b3520 con 0x7fd1440d0d10 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd1496ba640 1 -- 172.21.15.82:0/98637136 >> v1:172.21.15.183:6789/0 conn(0x7fd1440d0d10 legacy=0x7fd1440cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd1496ba640 1 -- 172.21.15.82:0/98637136 >> v1:172.21.15.82:6789/0 conn(0x7fd1440ce4c0 legacy=0x7fd1440cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.678+0000 7fd1496ba640 1 -- 172.21.15.82:0/98637136 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440b2910 con 0x7fd14415cab0 2023-07-20T10:09:05.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd1496ba640 1 --2- 172.21.15.82:0/98637136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd14415cab0 0x7fd1440d0300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097c0 tx=0x7fd14001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4944b3fb55f6c94e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:05.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400ab650 con 0x7fd14415cab0 2023-07-20T10:09:05.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1400ab7b0 con 0x7fd14415cab0 2023-07-20T10:09:05.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd13bfff640 1 -- 172.21.15.82:0/98637136 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400abb40 con 0x7fd14415cab0 2023-07-20T10:09:05.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 -- 172.21.15.82:0/98637136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd14415cab0 msgr2=0x7fd1440d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 --2- 172.21.15.82:0/98637136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd14415cab0 0x7fd1440d0300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097c0 tx=0x7fd14001c450 comp rx=0 tx=0).stop 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 -- 172.21.15.82:0/98637136 shutdown_connections 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 --2- 172.21.15.82:0/98637136 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd14415cab0 0x7fd1440d0300 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 -- 172.21.15.82:0/98637136 >> 172.21.15.82:0/98637136 conn(0x7fd14408c120 msgr2=0x7fd14409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 -- 172.21.15.82:0/98637136 shutdown_connections 2023-07-20T10:09:05.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.682+0000 7fd14b91e640 1 -- 172.21.15.82:0/98637136 wait complete. 2023-07-20T10:09:05.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 Processor -- start 2023-07-20T10:09:05.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- start start 2023-07-20T10:09:05.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1440ce4c0 0x7fd1440cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd14415cab0 0x7fd144152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1441518b0 con 0x7fd1440d0d10 2023-07-20T10:09:05.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440cff10 con 0x7fd1440ce4c0 2023-07-20T10:09:05.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c6400 con 0x7fd14415cab0 2023-07-20T10:09:05.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd1496ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1440ce4c0 0x7fd1440cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59512/0 (socket says 172.21.15.82:59512) 2023-07-20T10:09:05.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 -- 172.21.15.82:0/3842132230 learned_addr learned my addr 172.21.15.82:0/3842132230 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:05.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd149ebb640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd14415cab0 0x7fd144152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 -- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd14415cab0 msgr2=0x7fd144152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd14415cab0 0x7fd144152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 -- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1440ce4c0 msgr2=0x7fd1440cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1440ce4c0 0x7fd1440cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 -- 172.21.15.82:0/3842132230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140009420 con 0x7fd1440d0d10 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd148eb9640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c430 tx=0x7fd13400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340052d0 con 0x7fd1440d0d10 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134005450 con 0x7fd1440d0d10 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440c66e0 con 0x7fd1440d0d10 2023-07-20T10:09:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134003840 con 0x7fd1440d0d10 2023-07-20T10:09:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.686+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1440c6ca0 con 0x7fd1440d0d10 2023-07-20T10:09:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd144073c70 con 0x7fd1440d0d10 2023-07-20T10:09:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fd1340039a0 con 0x7fd1440d0d10 2023-07-20T10:09:05.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd139ffb640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 0x7fd128068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:05.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd1496ba640 1 -- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 msgr2=0x7fd128068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:05.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd1340837f0 con 0x7fd1440d0d10 2023-07-20T10:09:05.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.690+0000 7fd1496ba640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 0x7fd128068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:05.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.694+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1340508b0 con 0x7fd1440d0d10 2023-07-20T10:09:05.674 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:05.698+0000 7f8dec87d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:05.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.874+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1440cce90 con 0x7fd1440d0d10 2023-07-20T10:09:05.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd139ffb640 1 -- 172.21.15.82:0/3842132230 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fd134053ed0 con 0x7fd1440d0d10 2023-07-20T10:09:05.853 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:05.854 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:09:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:09:05.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 msgr2=0x7fd128068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 0x7fd128068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 msgr2=0x7fd144151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:05.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c430 tx=0x7fd13400c8f0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 shutdown_connections 2023-07-20T10:09:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fd1280664c0 0x7fd128068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd14415cab0 0x7fd144152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1440d0d10 0x7fd144151370 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 --2- 172.21.15.82:0/3842132230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1440ce4c0 0x7fd1440cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:05.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 >> 172.21.15.82:0/3842132230 conn(0x7fd14408c120 msgr2=0x7fd1440d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 shutdown_connections 2023-07-20T10:09:05.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:05.878+0000 7fd14b91e640 1 -- 172.21.15.82:0/3842132230 wait complete. 2023-07-20T10:09:05.873 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:06.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 Processor -- start 2023-07-20T10:09:06.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 -- start start 2023-07-20T10:09:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940b3520 con 0x7f4c9415cab0 2023-07-20T10:09:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940d0a10 con 0x7f4c940d0d10 2023-07-20T10:09:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9bc26640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940d31c0 con 0x7f4c940d1170 2023-07-20T10:09:06.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c999c2640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4c9415cab0 0x7f4c940d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52062/0 (socket says 172.21.15.82:52062) 2023-07-20T10:09:06.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c999c2640 1 -- 172.21.15.82:0/778591420 learned_addr learned my addr 172.21.15.82:0/778591420 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:06.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9a1c3640 1 --2- 172.21.15.82:0/778591420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160243382 0 0) 0x7f4c940d0a10 con 0x7f4c940d0d10 2023-07-20T10:09:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c80003530 con 0x7f4c940d0d10 2023-07-20T10:09:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012795503 0 0) 0x7f4c940b3520 con 0x7f4c9415cab0 2023-07-20T10:09:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c940d0a10 con 0x7f4c9415cab0 2023-07-20T10:09:06.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/778591420 >> v1:172.21.15.183:6789/0 conn(0x7f4c940d0d10 legacy=0x7f4c940cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/778591420 >> v1:172.21.15.82:6789/0 conn(0x7f4c9415cab0 legacy=0x7f4c940d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.082+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/778591420 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940b2910 con 0x7f4c940d1170 2023-07-20T10:09:06.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9a1c3640 1 --2- 172.21.15.82:0/778591420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cdbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009dc0 tx=0x7f4c8c01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f39e806c8a4b16 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0a5980 con 0x7f4c940d1170 2023-07-20T10:09:06.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0a5ae0 con 0x7f4c940d1170 2023-07-20T10:09:06.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c989c0640 1 -- 172.21.15.82:0/778591420 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0a5e70 con 0x7f4c940d1170 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 -- 172.21.15.82:0/778591420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 msgr2=0x7f4c940cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/778591420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cdbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009dc0 tx=0x7f4c8c01c910 comp rx=0 tx=0).stop 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 -- 172.21.15.82:0/778591420 shutdown_connections 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/778591420 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cdbc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 -- 172.21.15.82:0/778591420 >> 172.21.15.82:0/778591420 conn(0x7f4c9408c120 msgr2=0x7f4c9409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 -- 172.21.15.82:0/778591420 shutdown_connections 2023-07-20T10:09:06.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.086+0000 7f4c9bc26640 1 -- 172.21.15.82:0/778591420 wait complete. 2023-07-20T10:09:06.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 Processor -- start 2023-07-20T10:09:06.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 -- start start 2023-07-20T10:09:06.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c940d0d10 0x7f4c940c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940cf2d0 con 0x7f4c9415cab0 2023-07-20T10:09:06.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c86e0 con 0x7f4c940d0d10 2023-07-20T10:09:06.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9bc26640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940c89c0 con 0x7f4c940d1170 2023-07-20T10:09:06.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59520/0 (socket says 172.21.15.82:59520) 2023-07-20T10:09:06.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/930523148 learned_addr learned my addr 172.21.15.82:0/930523148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:06.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c999c2640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c940d0d10 0x7f4c940c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c991c1640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 msgr2=0x7f4c940cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c940d0d10 msgr2=0x7f4c940c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c940d0d10 0x7f4c940c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 -- 172.21.15.82:0/930523148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009a70 con 0x7f4c9415cab0 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.090+0000 7f4c9a1c3640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c019520 tx=0x7f4c8c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0b9860 con 0x7f4c9415cab0 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0b99c0 con 0x7f4c9415cab0 2023-07-20T10:09:06.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0b9d70 con 0x7f4c9415cab0 2023-07-20T10:09:06.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c940c8ca0 con 0x7f4c9415cab0 2023-07-20T10:09:06.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c940cfca0 con 0x7f4c9415cab0 2023-07-20T10:09:06.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94073c70 con 0x7f4c9415cab0 2023-07-20T10:09:06.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f4c8c0ad440 con 0x7f4c9415cab0 2023-07-20T10:09:06.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 0x7f4c78068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c999c2640 1 -- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 msgr2=0x7f4c78068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:06.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4c8c11f610 con 0x7f4c9415cab0 2023-07-20T10:09:06.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.094+0000 7f4c999c2640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 0x7f4c78068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:06.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.102+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c8c0ec850 con 0x7f4c9415cab0 2023-07-20T10:09:06.136 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.162+0000 7f5bf0c53180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:09:06.221 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.246+0000 7f5bf0c53180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:09:06.229 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.254+0000 7f8dec87d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:09:06.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.254+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c94157870 con 0x7f4c9415cab0 2023-07-20T10:09:06.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.254+0000 7f4c8a7fc640 1 -- 172.21.15.82:0/930523148 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+18769 (secure 0 0 0) 0x7f4c8c0efe70 con 0x7f4c9415cab0 2023-07-20T10:09:06.231 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:06.231 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":124,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:08:41.941614+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1193855226":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/1311622631":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6833/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6832/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/467905236":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2263958707":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2514495626":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/3151351148":"2023-07-21T10:08:41.941567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 msgr2=0x7f4c78068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 0x7f4c78068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 msgr2=0x7f4c940cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c019520 tx=0x7f4c8c0196b0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 shutdown_connections 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f4c780664c0 0x7f4c78068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9415cab0 0x7f4c940cd710 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c940d1170 0x7f4c940cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 --2- 172.21.15.82:0/930523148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c940d0d10 0x7f4c940c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 >> 172.21.15.82:0/930523148 conn(0x7f4c9408c120 msgr2=0x7f4c940af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 shutdown_connections 2023-07-20T10:09:06.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.258+0000 7f4c9bc26640 1 -- 172.21.15.82:0/930523148 wait complete. 2023-07-20T10:09:06.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:08:22.111844+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:08:23.430963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:09:06.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:09:06.319 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.342+0000 7f8dec87d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:09:06.370 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.394+0000 7f5bf0c53180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:09:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.422+0000 7fec48e07640 1 Processor -- start 2023-07-20T10:09:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.422+0000 7fec48e07640 1 -- start start 2023-07-20T10:09:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec48e07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 0x7fec440cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec48e07640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 0x7fec44160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec48e07640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440d0970 con 0x7fec441602b0 2023-07-20T10:09:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec48e07640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec44160e20 con 0x7fec4406b220 2023-07-20T10:09:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec48e07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440cd300 con 0x7fec4406c120 2023-07-20T10:09:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec3bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec441602b0 0x7fec4406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52076/0 (socket says 172.21.15.82:52076) 2023-07-20T10:09:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec3bfff640 1 -- 172.21.15.82:0/393420328 learned_addr learned my addr 172.21.15.82:0/393420328 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec4259c640 1 --2- 172.21.15.82:0/393420328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 0x7fec440cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec42d9d640 1 --2- 172.21.15.82:0/393420328 >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 0x7fec44160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec41d9b640 1 -- 172.21.15.82:0/393420328 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591637957 0 0) 0x7fec440d0970 con 0x7fec441602b0 2023-07-20T10:09:06.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec41d9b640 1 -- 172.21.15.82:0/393420328 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec30003530 con 0x7fec441602b0 2023-07-20T10:09:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec4259c640 1 -- 172.21.15.82:0/393420328 >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 msgr2=0x7fec44160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec4259c640 1 --2- 172.21.15.82:0/393420328 >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 0x7fec44160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec4259c640 1 -- 172.21.15.82:0/393420328 >> v1:172.21.15.82:6789/0 conn(0x7fec441602b0 legacy=0x7fec4406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec4259c640 1 -- 172.21.15.82:0/393420328 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440cd5e0 con 0x7fec4406c120 2023-07-20T10:09:06.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.426+0000 7fec42d9d640 1 --2- 172.21.15.82:0/393420328 >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 0x7fec44160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec4259c640 1 --2- 172.21.15.82:0/393420328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 0x7fec440cdde0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec340097c0 tx=0x7fec3401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9b4555835d064e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec41d9b640 1 -- 172.21.15.82:0/393420328 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340ab600 con 0x7fec4406c120 2023-07-20T10:09:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec41d9b640 1 -- 172.21.15.82:0/393420328 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec340a7050 con 0x7fec4406c120 2023-07-20T10:09:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec41d9b640 1 -- 172.21.15.82:0/393420328 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340ab980 con 0x7fec4406c120 2023-07-20T10:09:06.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- 172.21.15.82:0/393420328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 msgr2=0x7fec440cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 --2- 172.21.15.82:0/393420328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 0x7fec440cdde0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec340097c0 tx=0x7fec3401c3f0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- 172.21.15.82:0/393420328 shutdown_connections 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 --2- 172.21.15.82:0/393420328 >> v2:172.21.15.183:3300/0 conn(0x7fec4406b220 0x7fec44160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 --2- 172.21.15.82:0/393420328 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec4406c120 0x7fec440cdde0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- 172.21.15.82:0/393420328 >> 172.21.15.82:0/393420328 conn(0x7fec4408c0a0 msgr2=0x7fec4409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- 172.21.15.82:0/393420328 shutdown_connections 2023-07-20T10:09:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- 172.21.15.82:0/393420328 wait complete. 2023-07-20T10:09:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 Processor -- start 2023-07-20T10:09:06.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.430+0000 7fec48e07640 1 -- start start 2023-07-20T10:09:06.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 0x7fec440c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 0x7fec44154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec441602b0 0x7fec440cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c77b0 con 0x7fec4406c120 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c7a90 con 0x7fec4406b220 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c7d70 con 0x7fec441602b0 2023-07-20T10:09:06.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 0x7fec44154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 0x7fec44154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59522/0 (socket says 172.21.15.82:59522) 2023-07-20T10:09:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3bfff640 1 -- 172.21.15.82:0/782490222 learned_addr learned my addr 172.21.15.82:0/782490222 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 0x7fec440c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec42d9d640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec441602b0 0x7fec440cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 -- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec441602b0 msgr2=0x7fec440cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec441602b0 0x7fec440cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 -- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 msgr2=0x7fec44154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 0x7fec44154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 -- 172.21.15.82:0/782490222 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c009a70 con 0x7fec4406b220 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec4259c640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 0x7fec440c71d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec340ab000 tx=0x7fec3401ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34006e20 con 0x7fec4406b220 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec340b7450 con 0x7fec4406b220 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec34009420 con 0x7fec4406b220 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340b7800 con 0x7fec4406b220 2023-07-20T10:09:06.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec440c8330 con 0x7fec4406b220 2023-07-20T10:09:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.434+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4404da30 con 0x7fec4406b220 2023-07-20T10:09:06.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.438+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fec340b7960 con 0x7fec4406b220 2023-07-20T10:09:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.438+0000 7fec3affd640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 0x7fec240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.438+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fec3411e770 con 0x7fec4406b220 2023-07-20T10:09:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.438+0000 7fec3bfff640 1 -- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 msgr2=0x7fec240689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:06.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.438+0000 7fec3bfff640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 0x7fec240689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:06.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.442+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec340eb7a0 con 0x7fec4406b220 2023-07-20T10:09:06.454 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.482+0000 7f5bf0c53180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:09:06.474 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.498+0000 7f8dec87d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:09:06.558 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.582+0000 7f8dec87d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:09:06.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec440c7eb0 con 0x7fec4406b220 2023-07-20T10:09:06.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec3affd640 1 -- 172.21.15.82:0/782490222 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec440c7eb0 con 0x7fec4406b220 2023-07-20T10:09:06.569 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:09:06.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 msgr2=0x7fec240689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:06.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 0x7fec240689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 msgr2=0x7fec440c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 0x7fec440c71d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fec340ab000 tx=0x7fec3401ac30 comp rx=0 tx=0).stop 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 shutdown_connections 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7fec240664f0 0x7fec240689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec441602b0 0x7fec440cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec4406c120 0x7fec44154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 --2- 172.21.15.82:0/782490222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec4406b220 0x7fec440c71d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 >> 172.21.15.82:0/782490222 conn(0x7fec4408c0a0 msgr2=0x7fec4415ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 shutdown_connections 2023-07-20T10:09:06.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.594+0000 7fec48e07640 1 -- 172.21.15.82:0/782490222 wait complete. 2023-07-20T10:09:06.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:09:06.726 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.750+0000 7f5bf0c53180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:09:06.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.758+0000 7f7eaff03640 1 Processor -- start 2023-07-20T10:09:06.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.758+0000 7f7eaff03640 1 -- start start 2023-07-20T10:09:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eaff03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 0x7f7ea8160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eaff03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea80ce4f0 con 0x7f7ea806c120 2023-07-20T10:09:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eaff03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea80d0970 con 0x7f7ea806ab10 2023-07-20T10:09:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eaff03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea8160e20 con 0x7f7ea81602b0 2023-07-20T10:09:06.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eadc9f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ea806c120 0x7f7ea80cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52082/0 (socket says 172.21.15.82:52082) 2023-07-20T10:09:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eadc9f640 1 -- 172.21.15.82:0/3592034651 learned_addr learned my addr 172.21.15.82:0/3592034651 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:06.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7ead49e640 1 --2- 172.21.15.82:0/3592034651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 0x7f7ea8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344812994 0 0) 0x7f7ea80ce4f0 con 0x7f7ea806c120 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e94003530 con 0x7f7ea806c120 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832594922 0 0) 0x7f7ea80d0970 con 0x7f7ea806ab10 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea80ce4f0 con 0x7f7ea806ab10 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7ead49e640 1 -- 172.21.15.82:0/3592034651 >> v1:172.21.15.183:6789/0 conn(0x7f7ea806ab10 legacy=0x7f7ea806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7ead49e640 1 -- 172.21.15.82:0/3592034651 >> v1:172.21.15.82:6789/0 conn(0x7f7ea806c120 legacy=0x7f7ea80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.762+0000 7f7ead49e640 1 -- 172.21.15.82:0/3592034651 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80cd300 con 0x7f7ea81602b0 2023-07-20T10:09:06.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7ead49e640 1 --2- 172.21.15.82:0/3592034651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 0x7f7ea8160710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097f0 tx=0x7f7e9801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba93dc1d986e093 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab600 con 0x7f7ea81602b0 2023-07-20T10:09:06.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e980a7050 con 0x7f7ea81602b0 2023-07-20T10:09:06.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eacc9d640 1 -- 172.21.15.82:0/3592034651 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980ab980 con 0x7f7ea81602b0 2023-07-20T10:09:06.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- 172.21.15.82:0/3592034651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 msgr2=0x7f7ea8160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 --2- 172.21.15.82:0/3592034651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 0x7f7ea8160710 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097f0 tx=0x7f7e9801c430 comp rx=0 tx=0).stop 2023-07-20T10:09:06.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- 172.21.15.82:0/3592034651 shutdown_connections 2023-07-20T10:09:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 --2- 172.21.15.82:0/3592034651 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea81602b0 0x7f7ea8160710 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- 172.21.15.82:0/3592034651 >> 172.21.15.82:0/3592034651 conn(0x7f7ea808c0a0 msgr2=0x7f7ea809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- 172.21.15.82:0/3592034651 shutdown_connections 2023-07-20T10:09:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- 172.21.15.82:0/3592034651 wait complete. 2023-07-20T10:09:06.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 Processor -- start 2023-07-20T10:09:06.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.766+0000 7f7eaff03640 1 -- start start 2023-07-20T10:09:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea806ab10 0x7f7ea80b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 0x7f7ea80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80c6530 con 0x7f7ea806c120 2023-07-20T10:09:06.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80cb7a0 con 0x7f7ea81602b0 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80cba80 con 0x7f7ea806ab10 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59526/0 (socket says 172.21.15.82:59526) 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 -- 172.21.15.82:0/533704474 learned_addr learned my addr 172.21.15.82:0/533704474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eadc9f640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea806ab10 0x7f7ea80b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eae4a0640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 0x7f7ea80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 -- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea806ab10 msgr2=0x7f7ea80b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea806ab10 0x7f7ea80b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 -- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 msgr2=0x7f7ea80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 0x7f7ea80cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 -- 172.21.15.82:0/533704474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009420 con 0x7f7ea806c120 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eae4a0640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 0x7f7ea80cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7ead49e640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097f0 tx=0x7f7e980191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980b4400 con 0x7f7ea806c120 2023-07-20T10:09:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e980b4560 con 0x7f7ea806c120 2023-07-20T10:09:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e980b48d0 con 0x7f7ea806c120 2023-07-20T10:09:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea80cbd60 con 0x7f7ea806c120 2023-07-20T10:09:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea80cc320 con 0x7f7ea806c120 2023-07-20T10:09:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.770+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea80cc510 con 0x7f7ea806c120 2023-07-20T10:09:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.774+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 65) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7e980b2040 con 0x7f7ea806c120 2023-07-20T10:09:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.774+0000 7f7e9e7fc640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.774+0000 7f7eadc9f640 1 -- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 msgr2=0x7f7e8c0689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2950283129 2023-07-20T10:09:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.774+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f7e9811de30 con 0x7f7ea806c120 2023-07-20T10:09:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.774+0000 7f7eadc9f640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.778+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e980eae20 con 0x7f7ea806c120 2023-07-20T10:09:06.787 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:06.814+0000 7f5bf0c53180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:09:06.851 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.874+0000 7f8dec87d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:09:06.911 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:06.934+0000 7f8dec87d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:09:06.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.942+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ea804da30 con 0x7f7ea806c120 2023-07-20T10:09:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.950+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 66) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7e980eb1f0 con 0x7f7ea806c120 2023-07-20T10:09:06.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.950+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 msgr2=0x7f7e8c0689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:06.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.950+0000 7f7e9e7fc640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.950+0000 7f7e9e7fc640 1 -- 172.21.15.82:0/533704474 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e980f0ec0 con 0x7f7ea806c120 2023-07-20T10:09:06.927 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:09:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 msgr2=0x7f7ea80cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097f0 tx=0x7f7e980191d0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 shutdown_connections 2023-07-20T10:09:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:6832/2950283129,v1:172.21.15.82:6833/2950283129] conn(0x7f7e8c0664f0 0x7f7e8c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ea81602b0 0x7f7ea80cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ea806c120 0x7f7ea80cf060 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 --2- 172.21.15.82:0/533704474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ea806ab10 0x7f7ea80b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:06.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 >> 172.21.15.82:0/533704474 conn(0x7f7ea808c0a0 msgr2=0x7f7ea806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:06.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 shutdown_connections 2023-07-20T10:09:06.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:06.954+0000 7f7eaff03640 1 -- 172.21.15.82:0/533704474 wait complete. 2023-07-20T10:09:06.953 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T10:09:06.995 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d75abd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.995 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d75abd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.995 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d75abd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.995 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d75abd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.996 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d75abd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.996 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d792c4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.997 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d792c4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.997 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d792c4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.997 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d792c4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:06.997 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:07.018+0000 7f8d792c4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 Processor -- start 2023-07-20T10:09:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 -- start start 2023-07-20T10:09:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffad0159450 0x7ffad015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 0x7ffad00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00cc8d0 con 0x7ffad00cc3e0 2023-07-20T10:09:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00cce90 con 0x7ffad0159450 2023-07-20T10:09:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.130+0000 7ffad5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00ccbb0 con 0x7ffad0159830 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffad0159450 0x7ffad015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffacf7fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ffad00cc3e0 0x7ffad00afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:54966/0 (socket says 172.21.15.82:54966) 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffacf7fe640 1 -- 172.21.15.82:0/3804577327 learned_addr learned my addr 172.21.15.82:0/3804577327 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7fface7fc640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 0x7ffad00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffacdffb640 1 -- 172.21.15.82:0/3804577327 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377818718 0 0) 0x7ffad00cc8d0 con 0x7ffad00cc3e0 2023-07-20T10:09:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffacdffb640 1 -- 172.21.15.82:0/3804577327 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab8005740 con 0x7ffad00cc3e0 2023-07-20T10:09:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 -- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 msgr2=0x7ffad00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 0x7ffad00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 -- 172.21.15.82:0/3804577327 >> v1:172.21.15.183:6789/0 conn(0x7ffad00cc3e0 legacy=0x7ffad00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 -- 172.21.15.82:0/3804577327 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0159cc0 con 0x7ffad0159450 2023-07-20T10:09:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7fface7fc640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 0x7ffad00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.134+0000 7ffaceffd640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad0159450 0x7ffad015a4c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffac00097c0 tx=0x7ffac001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e349d8867d2925a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffacdffb640 1 -- 172.21.15.82:0/3804577327 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00a7070 con 0x7ffad0159450 2023-07-20T10:09:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffacdffb640 1 -- 172.21.15.82:0/3804577327 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac00ab430 con 0x7ffad0159450 2023-07-20T10:09:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffacdffb640 1 -- 172.21.15.82:0/3804577327 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac00ab7c0 con 0x7ffad0159450 2023-07-20T10:09:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad0159450 msgr2=0x7ffad015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad0159450 0x7ffad015a4c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffac00097c0 tx=0x7ffac001c450 comp rx=0 tx=0).stop 2023-07-20T10:09:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- 172.21.15.82:0/3804577327 shutdown_connections 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad0159830 0x7ffad00cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- 172.21.15.82:0/3804577327 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad0159450 0x7ffad015a4c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- 172.21.15.82:0/3804577327 >> 172.21.15.82:0/3804577327 conn(0x7ffad00cad50 msgr2=0x7ffad00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- 172.21.15.82:0/3804577327 shutdown_connections 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- 172.21.15.82:0/3804577327 wait complete. 2023-07-20T10:09:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 Processor -- start 2023-07-20T10:09:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- start start 2023-07-20T10:09:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad00cc3e0 0x7ffad01f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad01515e0 0x7ffad00c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c61d0 con 0x7ffad0159450 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c3e30 con 0x7ffad00cc3e0 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7ffad5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0156aa0 con 0x7ffad01515e0 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7fface7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7fface7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59640/0 (socket says 172.21.15.82:59640) 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.138+0000 7fface7fc640 1 -- 172.21.15.82:0/1014777614 learned_addr learned my addr 172.21.15.82:0/1014777614 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffaceffd640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad00cc3e0 0x7ffad01f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffacf7fe640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad01515e0 0x7ffad00c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 -- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad01515e0 msgr2=0x7ffad00c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad01515e0 0x7ffad00c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 -- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad00cc3e0 msgr2=0x7ffad01f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad00cc3e0 0x7ffad01f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 -- 172.21.15.82:0/1014777614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009420 con 0x7ffad0159450 2023-07-20T10:09:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7fface7fc640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7ffac400e980 tx=0x7ffac400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400ca00 con 0x7ffad0159450 2023-07-20T10:09:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400cb60 con 0x7ffad0159450 2023-07-20T10:09:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4013470 con 0x7ffad0159450 2023-07-20T10:09:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac0009420 con 0x7ffad0159450 2023-07-20T10:09:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad0157060 con 0x7ffad0159450 2023-07-20T10:09:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad004da30 con 0x7ffad0159450 2023-07-20T10:09:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.142+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 66) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ffac40135d0 con 0x7ffad0159450 2023-07-20T10:09:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.146+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6836+0+0 (secure 0 0 0) 0x7ffac4083d60 con 0x7ffad0159450 2023-07-20T10:09:07.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.150+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffac40512e0 con 0x7ffad0159450 2023-07-20T10:09:07.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.294+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffad00cbbf0 con 0x7ffad0159450 2023-07-20T10:09:07.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.294+0000 7ffab77fe640 1 -- 172.21.15.82:0/1014777614 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffac4054900 con 0x7ffad0159450 2023-07-20T10:09:07.271 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 msgr2=0x7ffad014d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7ffac400e980 tx=0x7ffac400ee40 comp rx=0 tx=0).stop 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 shutdown_connections 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffad01515e0 0x7ffad00c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffad0159450 0x7ffad014d7c0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 --2- 172.21.15.82:0/1014777614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffad00cc3e0 0x7ffad01f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 >> 172.21.15.82:0/1014777614 conn(0x7ffad00cad50 msgr2=0x7ffad0070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 shutdown_connections 2023-07-20T10:09:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.298+0000 7ffad5626640 1 -- 172.21.15.82:0/1014777614 wait complete. 2023-07-20T10:09:07.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T10:09:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.498+0000 7f4700f40640 1 Processor -- start 2023-07-20T10:09:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.498+0000 7f4700f40640 1 -- start start 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f4700f40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f4700f40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc0cc8d0 con 0x7f46fc159830 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f4700f40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc0ccbb0 con 0x7f46fc0afd50 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f4700f40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0cce90 con 0x7f46fc159450 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f1d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f46fc159830 0x7f46fc0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52098/0 (socket says 172.21.15.82:52098) 2023-07-20T10:09:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f1d9b640 1 -- 172.21.15.82:0/562448975 learned_addr learned my addr 172.21.15.82:0/562448975 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46fa59c640 1 --2- 172.21.15.82:0/562448975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586197882 0 0) 0x7f46fc0cc8d0 con 0x7f46fc159830 2023-07-20T10:09:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e8003530 con 0x7f46fc159830 2023-07-20T10:09:07.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503953192 0 0) 0x7f46fc0ccbb0 con 0x7f46fc0afd50 2023-07-20T10:09:07.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46fc0cc8d0 con 0x7f46fc0afd50 2023-07-20T10:09:07.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46fa59c640 1 -- 172.21.15.82:0/562448975 >> v1:172.21.15.183:6789/0 conn(0x7f46fc0afd50 legacy=0x7f46fc15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46fa59c640 1 -- 172.21.15.82:0/562448975 >> v1:172.21.15.82:6789/0 conn(0x7f46fc159830 legacy=0x7f46fc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.502+0000 7f46fa59c640 1 -- 172.21.15.82:0/562448975 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc159cc0 con 0x7f46fc159450 2023-07-20T10:09:07.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f46fa59c640 1 --2- 172.21.15.82:0/562448975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc15a4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0097f0 tx=0x7f46ec01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66682835e6b0f2e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0ab600 con 0x7f46fc159450 2023-07-20T10:09:07.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0a7050 con 0x7f46fc159450 2023-07-20T10:09:07.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f46f9d9b640 1 -- 172.21.15.82:0/562448975 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0ab980 con 0x7f46fc159450 2023-07-20T10:09:07.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- 172.21.15.82:0/562448975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 msgr2=0x7f46fc15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 --2- 172.21.15.82:0/562448975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc15a4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0097f0 tx=0x7f46ec01c490 comp rx=0 tx=0).stop 2023-07-20T10:09:07.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- 172.21.15.82:0/562448975 shutdown_connections 2023-07-20T10:09:07.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 --2- 172.21.15.82:0/562448975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc15a4c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- 172.21.15.82:0/562448975 >> 172.21.15.82:0/562448975 conn(0x7f46fc0cad50 msgr2=0x7f46fc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:07.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- 172.21.15.82:0/562448975 shutdown_connections 2023-07-20T10:09:07.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- 172.21.15.82:0/562448975 wait complete. 2023-07-20T10:09:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 Processor -- start 2023-07-20T10:09:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.506+0000 7f4700f40640 1 -- start start 2023-07-20T10:09:07.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 0x7f46fc14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14d800 con 0x7f46fc14b7a0 2023-07-20T10:09:07.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc1683b0 con 0x7f46fc0afd50 2023-07-20T10:09:07.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc14cfe0 con 0x7f46fc159450 2023-07-20T10:09:07.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59656/0 (socket says 172.21.15.82:59656) 2023-07-20T10:09:07.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 0x7f46fc14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fad9d640 1 -- 172.21.15.82:0/4149410954 learned_addr learned my addr 172.21.15.82:0/4149410954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:07.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46f1d9b640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 -- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 msgr2=0x7f46fc14d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc14d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 -- 172.21.15.82:0/4149410954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 msgr2=0x7f46fc152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 -- 172.21.15.82:0/4149410954 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec009420 con 0x7f46fc0afd50 2023-07-20T10:09:07.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fad9d640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:07.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46fa59c640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 0x7f46fc14c8e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06c780 tx=0x7f46ec01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0b7450 con 0x7f46fc0afd50 2023-07-20T10:09:07.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0b75b0 con 0x7f46fc0afd50 2023-07-20T10:09:07.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc167d60 con 0x7f46fc0afd50 2023-07-20T10:09:07.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0b7960 con 0x7f46fc0afd50 2023-07-20T10:09:07.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc14db50 con 0x7f46fc0afd50 2023-07-20T10:09:07.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.510+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc167bc0 con 0x7f46fc0afd50 2023-07-20T10:09:07.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.514+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 66) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f46ec0b7ac0 con 0x7f46fc0afd50 2023-07-20T10:09:07.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.514+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f46ec11dd40 con 0x7f46fc0afd50 2023-07-20T10:09:07.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.514+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46ec0eb340 con 0x7f46fc0afd50 2023-07-20T10:09:07.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.662+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46fc167bc0 con 0x7f46fc0afd50 2023-07-20T10:09:07.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.662+0000 7f46f37fe640 1 -- 172.21.15.82:0/4149410954 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46fc167bc0 con 0x7f46fc0afd50 2023-07-20T10:09:07.639 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 msgr2=0x7f46fc14c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 0x7f46fc14c8e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06c780 tx=0x7f46ec01acd0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 shutdown_connections 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc14b7a0 0x7f46fc152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46fc159450 0x7f46fc14d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 --2- 172.21.15.82:0/4149410954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f46fc0afd50 0x7f46fc14c8e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 >> 172.21.15.82:0/4149410954 conn(0x7f46fc0cad50 msgr2=0x7f46fc06be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:07.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 shutdown_connections 2023-07-20T10:09:07.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.666+0000 7f4700f40640 1 -- 172.21.15.82:0/4149410954 wait complete. 2023-07-20T10:09:07.659 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:07.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 Processor -- start 2023-07-20T10:09:07.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 -- start start 2023-07-20T10:09:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0b3520 con 0x7f3e3c15cab0 2023-07-20T10:09:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0d0a10 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e414cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c0d31c0 con 0x7f3e3c0d1170 2023-07-20T10:09:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3e3c15cab0 0x7f3e3c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52100/0 (socket says 172.21.15.82:52100) 2023-07-20T10:09:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59664/0 (socket says 172.21.15.82:59664) 2023-07-20T10:09:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3affd640 1 -- 172.21.15.82:0/2350978723 learned_addr learned my addr 172.21.15.82:0/2350978723 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3b7fe640 1 -- 172.21.15.82:0/2350978723 >> v1:172.21.15.183:6789/0 conn(0x7f3e3c0d0d10 legacy=0x7f3e3c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.822+0000 7f3e3b7fe640 1 -- 172.21.15.82:0/2350978723 >> v1:172.21.15.82:6789/0 conn(0x7f3e3c15cab0 legacy=0x7f3e3c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3b7fe640 1 -- 172.21.15.82:0/2350978723 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0b2910 con 0x7f3e3c0d1170 2023-07-20T10:09:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3a7fc640 1 -- 172.21.15.82:0/2350978723 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 883683452 0 0) 0x7f3e3c0b3520 con 0x7f3e3c15cab0 2023-07-20T10:09:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3b7fe640 1 --2- 172.21.15.82:0/2350978723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3e340097c0 tx=0x7f3e3401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33da46352f0622ce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3a7fc640 1 -- 172.21.15.82:0/2350978723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340ab600 con 0x7f3e3c0d1170 2023-07-20T10:09:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3a7fc640 1 -- 172.21.15.82:0/2350978723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a7050 con 0x7f3e3c0d1170 2023-07-20T10:09:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e3a7fc640 1 -- 172.21.15.82:0/2350978723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340ab980 con 0x7f3e3c0d1170 2023-07-20T10:09:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 -- 172.21.15.82:0/2350978723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d1170 msgr2=0x7f3e3c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 --2- 172.21.15.82:0/2350978723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3e340097c0 tx=0x7f3e3401c3e0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 -- 172.21.15.82:0/2350978723 shutdown_connections 2023-07-20T10:09:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 --2- 172.21.15.82:0/2350978723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c0cdbc0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 -- 172.21.15.82:0/2350978723 >> 172.21.15.82:0/2350978723 conn(0x7f3e3c08c120 msgr2=0x7f3e3c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:07.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 -- 172.21.15.82:0/2350978723 shutdown_connections 2023-07-20T10:09:07.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.826+0000 7f3e414cb640 1 -- 172.21.15.82:0/2350978723 wait complete. 2023-07-20T10:09:07.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 Processor -- start 2023-07-20T10:09:07.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 -- start start 2023-07-20T10:09:07.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e3c15cab0 0x7f3e3c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c15f980 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c15fbb0 con 0x7f3e3c0d1170 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e414cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0c8bb0 con 0x7f3e3c15cab0 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59674/0 (socket says 172.21.15.82:59674) 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 -- 172.21.15.82:0/379772863 learned_addr learned my addr 172.21.15.82:0/379772863 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:07.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e327fc640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3b7fe640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e3c15cab0 0x7f3e3c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 -- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e3c15cab0 msgr2=0x7f3e3c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e3c15cab0 0x7f3e3c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 -- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e3c0d1170 msgr2=0x7f3e3c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:07.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 -- 172.21.15.82:0/379772863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009420 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.830+0000 7f3e3affd640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001570 tx=0x7f3e2c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:07.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00a640 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2c00a7c0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0c7df0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00ab70 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c0c83b0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c073c70 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 66) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3e2c00acd0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.834+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f3e2c0831b0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.838+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e2c050730 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.962+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 67) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f3e2c0501e0 con 0x7f3e3c0d0d10 2023-07-20T10:09:07.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.962+0000 7f3e33fff640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 0x7f3e1c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:07.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.962+0000 7f3e327fc640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 0x7f3e1c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:07.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:07.966+0000 7f3e327fc640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 0x7f3e1c06e4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c15bba0 tx=0x7f3e24009060 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e3c158840 con 0x7f3e3c0d0d10 2023-07-20T10:09:08.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e33fff640 1 -- 172.21.15.82:0/379772863 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f3e2c06d690 con 0x7f3e3c0d0d10 2023-07-20T10:09:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:08.009 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:09:08.010 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:09:08.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 msgr2=0x7f3e1c06e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 0x7f3e1c06e4d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c15bba0 tx=0x7f3e24009060 comp rx=0 tx=0).stop 2023-07-20T10:09:08.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 msgr2=0x7f3e3c15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c001570 tx=0x7f3e2c00cd20 comp rx=0 tx=0).stop 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 shutdown_connections 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3e1c06c0e0 0x7f3e1c06e4d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3e3c15cab0 0x7f3e3c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3e3c0d1170 0x7f3e3c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 --2- 172.21.15.82:0/379772863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e3c0d0d10 0x7f3e3c15f440 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 >> 172.21.15.82:0/379772863 conn(0x7f3e3c08c120 msgr2=0x7f3e3c158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 shutdown_connections 2023-07-20T10:09:08.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.034+0000 7f3e414cb640 1 -- 172.21.15.82:0/379772863 wait complete. 2023-07-20T10:09:08.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:08.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 Processor -- start 2023-07-20T10:09:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 -- start start 2023-07-20T10:09:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c0ca040 0x7faa0c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa0c15d4a0 0x7faa0c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c0cde70 con 0x7faa0c15c910 2023-07-20T10:09:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c0cbef0 con 0x7faa0c15d4a0 2023-07-20T10:09:08.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa11bba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0ca420 con 0x7faa0c0ca040 2023-07-20T10:09:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa0c15d4a0 0x7faa0c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faa0c15d4a0 0x7faa0c0b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59690/0 (socket says 172.21.15.82:59690) 2023-07-20T10:09:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 -- 172.21.15.82:0/3707955069 learned_addr learned my addr 172.21.15.82:0/3707955069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0b7fe640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c0ca040 0x7faa0c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 -- 172.21.15.82:0/3707955069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c0ca040 msgr2=0x7faa0c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c0ca040 0x7faa0c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 -- 172.21.15.82:0/3707955069 >> v1:172.21.15.183:6789/0 conn(0x7faa0c15c910 legacy=0x7faa0c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.194+0000 7faa0bfff640 1 -- 172.21.15.82:0/3707955069 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0cdb40 con 0x7faa0c15d4a0 2023-07-20T10:09:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa0bfff640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15d4a0 0x7faa0c0b1170 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7faa04009e50 tx=0x7faa0401daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fae7f67d3b8236 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa0affd640 1 -- 172.21.15.82:0/3707955069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040a6970 con 0x7faa0c15d4a0 2023-07-20T10:09:08.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa0affd640 1 -- 172.21.15.82:0/3707955069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa040a6ad0 con 0x7faa0c15d4a0 2023-07-20T10:09:08.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa0affd640 1 -- 172.21.15.82:0/3707955069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa040a6e60 con 0x7faa0c15d4a0 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 -- 172.21.15.82:0/3707955069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15d4a0 msgr2=0x7faa0c0b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15d4a0 0x7faa0c0b1170 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7faa04009e50 tx=0x7faa0401daf0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 -- 172.21.15.82:0/3707955069 shutdown_connections 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15d4a0 0x7faa0c0b1170 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 --2- 172.21.15.82:0/3707955069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c0ca040 0x7faa0c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 -- 172.21.15.82:0/3707955069 >> 172.21.15.82:0/3707955069 conn(0x7faa0c0cada0 msgr2=0x7faa0c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 -- 172.21.15.82:0/3707955069 shutdown_connections 2023-07-20T10:09:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.198+0000 7faa11bba640 1 -- 172.21.15.82:0/3707955069 wait complete. 2023-07-20T10:09:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 Processor -- start 2023-07-20T10:09:08.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- start start 2023-07-20T10:09:08.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa0c0ca040 0x7faa0c14eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c15d4a0 0x7faa0c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0ab550 con 0x7faa0c15c910 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c098f50 con 0x7faa0c0ca040 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c154540 con 0x7faa0c15d4a0 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59706/0 (socket says 172.21.15.82:59706) 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 -- 172.21.15.82:0/2855370917 learned_addr learned my addr 172.21.15.82:0/2855370917 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa0b7fe640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa0c0ca040 0x7faa0c14eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa0bfff640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c15d4a0 0x7faa0c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 -- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c15d4a0 msgr2=0x7faa0c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c15d4a0 0x7faa0c06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 -- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa0c0ca040 msgr2=0x7faa0c14eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa0c0ca040 0x7faa0c14eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 -- 172.21.15.82:0/2855370917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009b30 con 0x7faa0c15c910 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa03fff640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c500 tx=0x7fa9f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4005220 con 0x7faa0c15c910 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4005380 con 0x7faa0c15c910 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4007270 con 0x7faa0c15c910 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c154820 con 0x7faa0c15c910 2023-07-20T10:09:08.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.202+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c0ab170 con 0x7faa0c15c910 2023-07-20T10:09:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c0ab330 con 0x7faa0c15c910 2023-07-20T10:09:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 67) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa9f40073d0 con 0x7faa0c15c910 2023-07-20T10:09:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa08ff9640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 0x7fa9ec068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fa9f4083550 con 0x7faa0c15c910 2023-07-20T10:09:08.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa0b7fe640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 0x7fa9ec068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.206+0000 7faa0b7fe640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 0x7fa9ec068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc006aa0 tx=0x7fa9fc008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.210+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9f4050a00 con 0x7faa0c15c910 2023-07-20T10:09:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.362+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa0c073c70 con 0x7faa0c15c910 2023-07-20T10:09:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.362+0000 7faa08ff9640 1 -- 172.21.15.82:0/2855370917 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+19505 (secure 0 0 0) 0x7fa9f4054020 con 0x7faa0c15c910 2023-07-20T10:09:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:08.339 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":126,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:07.945867+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":126,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3661222862":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2912998301":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3813052049":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3727649753":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/403722108":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6833/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6832/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3207199541":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1237946915":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2165152006":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1193855226":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/1311622631":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6833/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6832/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/467905236":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2263958707":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2514495626":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/3151351148":"2023-07-21T10:08:41.941567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:08.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 msgr2=0x7fa9ec068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 0x7fa9ec068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc006aa0 tx=0x7fa9fc008040 comp rx=0 tx=0).stop 2023-07-20T10:09:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 msgr2=0x7faa0c098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400c500 tx=0x7fa9f400c9c0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 shutdown_connections 2023-07-20T10:09:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fa9ec0660d0 0x7fa9ec068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faa0c15d4a0 0x7faa0c06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa0c15c910 0x7faa0c098a10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 --2- 172.21.15.82:0/2855370917 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa0c0ca040 0x7faa0c14eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 >> 172.21.15.82:0/2855370917 conn(0x7faa0c0cada0 msgr2=0x7faa0c0c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 shutdown_connections 2023-07-20T10:09:08.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.366+0000 7faa11bba640 1 -- 172.21.15.82:0/2855370917 wait complete. 2023-07-20T10:09:08.360 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T10:09:08.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:08.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.522+0000 7fea646cb640 1 Processor -- start 2023-07-20T10:09:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.522+0000 7fea646cb640 1 -- start start 2023-07-20T10:09:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.522+0000 7fea646cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fea5c1596b0 0x7fea5c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea646cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea5c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea646cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea5c0ccd90 con 0x7fea5c0cc900 2023-07-20T10:09:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea646cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea5c0ad600 con 0x7fea5c1596b0 2023-07-20T10:09:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea646cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0ad810 con 0x7fea5c0b2a90 2023-07-20T10:09:08.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fea5c0cc900 0x7fea5c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52116/0 (socket says 172.21.15.82:52116) 2023-07-20T10:09:08.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 -- 172.21.15.82:0/4293554449 learned_addr learned my addr 172.21.15.82:0/4293554449 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:08.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62c68640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea5c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62467640 1 --2- 172.21.15.82:0/4293554449 >> v2:172.21.15.183:3300/0 conn(0x7fea5c1596b0 0x7fea5c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930697408 0 0) 0x7fea5c0ccd90 con 0x7fea5c0cc900 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea48005740 con 0x7fea5c0cc900 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760870225 0 0) 0x7fea48005740 con 0x7fea5c0cc900 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 msgr2=0x7fea5c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea5c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 >> v2:172.21.15.183:3300/0 conn(0x7fea5c1596b0 msgr2=0x7fea5c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 --2- 172.21.15.82:0/4293554449 >> v2:172.21.15.183:3300/0 conn(0x7fea5c1596b0 0x7fea5c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c15d0d0 con 0x7fea5c0cc900 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fea4c001680 con 0x7fea5c0cc900 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62467640 1 --2- 172.21.15.82:0/4293554449 >> v2:172.21.15.183:3300/0 conn(0x7fea5c1596b0 0x7fea5c15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 >> v1:172.21.15.82:6789/0 conn(0x7fea5c0cc900 legacy=0x7fea5c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea48005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea48006110 0x7fea480069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea48006f20 0x7fea480073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0ad600 con 0x7fea48006110 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0ad810 con 0x7fea48006f20 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4800dba0 con 0x7fea5c0b2a90 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea48006110 0x7fea480069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62467640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea48005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62c68640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea48006f20 0x7fea480073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 -- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 msgr2=0x7fea48005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea5c0b2a90 0x7fea48005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 -- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea48006f20 msgr2=0x7fea480073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea48006f20 0x7fea480073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea61c66640 1 -- 172.21.15.82:0/4293554449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48005740 con 0x7fea48006110 2023-07-20T10:09:08.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.526+0000 7fea62c68640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea48006f20 0x7fea480073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:08.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea61c66640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea48006110 0x7fea480069e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c240 tx=0x7fea4c01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78a336c464732ea server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c005ae0 con 0x7fea48006110 2023-07-20T10:09:08.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0ab070 con 0x7fea48006110 2023-07-20T10:09:08.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea61465640 1 -- 172.21.15.82:0/4293554449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c007070 con 0x7fea48006110 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- 172.21.15.82:0/4293554449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea48006110 msgr2=0x7fea480069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 --2- 172.21.15.82:0/4293554449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea48006110 0x7fea480069e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c240 tx=0x7fea4c01f350 comp rx=0 tx=0).stop 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea62c68640 1 -- 172.21.15.82:0/4293554449 reap_dead start 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- 172.21.15.82:0/4293554449 shutdown_connections 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- 172.21.15.82:0/4293554449 >> 172.21.15.82:0/4293554449 conn(0x7fea5c0cada0 msgr2=0x7fea5c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- 172.21.15.82:0/4293554449 shutdown_connections 2023-07-20T10:09:08.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- 172.21.15.82:0/4293554449 wait complete. 2023-07-20T10:09:08.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 Processor -- start 2023-07-20T10:09:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.530+0000 7fea646cb640 1 -- start start 2023-07-20T10:09:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea48006110 0x7fea5c09b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea5c0c2cb0 0x7fea5c0c3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c09a400 con 0x7fea5c0c6300 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c1ef0 con 0x7fea5c0c2cb0 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c0c21d0 con 0x7fea48006110 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59724/0 (socket says 172.21.15.82:59724) 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 -- 172.21.15.82:0/1666752408 learned_addr learned my addr 172.21.15.82:0/1666752408 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:08.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea62467640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea48006110 0x7fea5c09b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea62c68640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea5c0c2cb0 0x7fea5c0c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 -- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea48006110 msgr2=0x7fea5c09b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea48006110 0x7fea5c09b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 -- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea5c0c2cb0 msgr2=0x7fea5c0c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea5c0c2cb0 0x7fea5c0c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 -- 172.21.15.82:0/1666752408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0c24b0 con 0x7fea5c0c6300 2023-07-20T10:09:08.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea61c66640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c240 tx=0x7fea48007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c001640 con 0x7fea5c0c6300 2023-07-20T10:09:08.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c005e70 con 0x7fea5c0c6300 2023-07-20T10:09:08.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c007270 con 0x7fea5c0c6300 2023-07-20T10:09:08.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c0c2790 con 0x7fea5c0c6300 2023-07-20T10:09:08.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c09b730 con 0x7fea5c0c6300 2023-07-20T10:09:08.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c0c2920 con 0x7fea5c0c6300 2023-07-20T10:09:08.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.534+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 67) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fea4c0073d0 con 0x7fea5c0c6300 2023-07-20T10:09:08.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.538+0000 7fea52ffd640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 0x7fea400685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.538+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fea4c0b7040 con 0x7fea5c0c6300 2023-07-20T10:09:08.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.538+0000 7fea62467640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 0x7fea400685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.538+0000 7fea62467640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 0x7fea400685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea58009de0 tx=0x7fea58009190 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.542+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea4c0ee4f0 con 0x7fea5c0c6300 2023-07-20T10:09:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.722+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea5c073c70 con 0x7fea5c0c6300 2023-07-20T10:09:08.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.722+0000 7fea52ffd640 1 -- 172.21.15.82:0/1666752408 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fea4c0f1b10 con 0x7fea5c0c6300 2023-07-20T10:09:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:08.699 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:09:08.699 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:09:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 msgr2=0x7fea400685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 0x7fea400685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea58009de0 tx=0x7fea58009190 comp rx=0 tx=0).stop 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 msgr2=0x7fea5c0c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00c240 tx=0x7fea48007a10 comp rx=0 tx=0).stop 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 shutdown_connections 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fea40066100 0x7fea400685c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fea5c0c2cb0 0x7fea5c0c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fea5c0c6300 0x7fea5c0c6760 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 --2- 172.21.15.82:0/1666752408 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fea48006110 0x7fea5c09b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 >> 172.21.15.82:0/1666752408 conn(0x7fea5c0cada0 msgr2=0x7fea5c158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 shutdown_connections 2023-07-20T10:09:08.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.726+0000 7fea646cb640 1 -- 172.21.15.82:0/1666752408 wait complete. 2023-07-20T10:09:08.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 Processor -- start 2023-07-20T10:09:08.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 -- start start 2023-07-20T10:09:08.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f111c15cab0 0x7f111c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0d0d10 0x7f111c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f111c0cf110 0x7f111c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0d31c0 con 0x7f111c15cab0 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0d16b0 con 0x7f111c0cf110 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f11218bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0b3520 con 0x7f111c0d0d10 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.886+0000 7f111affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f111c15cab0 0x7f111c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f111c15cab0 0x7f111c0d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59734/0 (socket says 172.21.15.82:59734) 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 -- 172.21.15.82:0/4228132773 learned_addr learned my addr 172.21.15.82:0/4228132773 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111b7fe640 1 --2- 172.21.15.82:0/4228132773 >> v2:172.21.15.183:3300/0 conn(0x7f111c0cf110 0x7f111c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f11127fc640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0d0d10 0x7f111c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 -- 172.21.15.82:0/4228132773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0d0d10 msgr2=0x7f111c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0d0d10 0x7f111c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 -- 172.21.15.82:0/4228132773 >> v2:172.21.15.183:3300/0 conn(0x7f111c0cf110 msgr2=0x7f111c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:08.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 --2- 172.21.15.82:0/4228132773 >> v2:172.21.15.183:3300/0 conn(0x7f111c0cf110 0x7f111c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 -- 172.21.15.82:0/4228132773 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0b2910 con 0x7f111c15cab0 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111affd640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c15cab0 0x7f111c0d0300 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f111c08bb70 tx=0x7f110401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35bae7722c773903 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111a7fc640 1 -- 172.21.15.82:0/4228132773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040aa5f0 con 0x7f111c15cab0 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111a7fc640 1 -- 172.21.15.82:0/4228132773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11040aa750 con 0x7f111c15cab0 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.890+0000 7f111a7fc640 1 -- 172.21.15.82:0/4228132773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040aaae0 con 0x7f111c15cab0 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- 172.21.15.82:0/4228132773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c15cab0 msgr2=0x7f111c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c15cab0 0x7f111c0d0300 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f111c08bb70 tx=0x7f110401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- 172.21.15.82:0/4228132773 shutdown_connections 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- 172.21.15.82:0/4228132773 >> v2:172.21.15.183:3300/0 conn(0x7f111c0cf110 0x7f111c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0d0d10 0x7f111c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- 172.21.15.82:0/4228132773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c15cab0 0x7f111c0d0300 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- 172.21.15.82:0/4228132773 >> 172.21.15.82:0/4228132773 conn(0x7f111c08c120 msgr2=0x7f111c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- 172.21.15.82:0/4228132773 shutdown_connections 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- 172.21.15.82:0/4228132773 wait complete. 2023-07-20T10:09:08.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 Processor -- start 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- start start 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0cf110 0x7f111c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 0x7f111c15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c15e910 con 0x7f111c0d0d10 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c153fa0 con 0x7f111c15cab0 2023-07-20T10:09:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11218bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c15dfe0 con 0x7f111c0cf110 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11127fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f111affd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0cf110 0x7f111c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11127fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59738/0 (socket says 172.21.15.82:59738) 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f11127fc640 1 -- 172.21.15.82:0/1915479086 learned_addr learned my addr 172.21.15.82:0/1915479086 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.894+0000 7f111b7fe640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 0x7f111c15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 -- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0cf110 msgr2=0x7f111c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0cf110 0x7f111c1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 -- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 msgr2=0x7f111c15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 0x7f111c15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 -- 172.21.15.82:0/1915479086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040094d0 con 0x7f111c0d0d10 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f111b7fe640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 0x7f111c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11127fc640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d5f0 tx=0x7f110c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0125f0 con 0x7f111c0d0d10 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c012750 con 0x7f111c0d0d10 2023-07-20T10:09:08.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c012ae0 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c15e2c0 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c152a30 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c073c70 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.898+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 67) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f110c012c40 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.902+0000 7f1118ff9640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 0x7f10fc068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.902+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f110c0840f0 con 0x7f111c0d0d10 2023-07-20T10:09:08.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.902+0000 7f111affd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 0x7f10fc068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:08.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.902+0000 7f111affd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 0x7f10fc068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11040ae000 tx=0x7f11040b5040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:08.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:08.906+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f110c051530 con 0x7f111c0d0d10 2023-07-20T10:09:09.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.090+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 68) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f110c051900 con 0x7f111c0d0d10 2023-07-20T10:09:09.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.106+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f111c0b2310 con 0x7f111c0d0d10 2023-07-20T10:09:09.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.106+0000 7f1118ff9640 1 -- 172.21.15.82:0/1915479086 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f110c06d3b0 con 0x7f111c0d0d10 2023-07-20T10:09:09.084 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:09.084 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:08:24.436796+0000","modified":"2023-07-20T10:08:28.088269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8412":{"gid":8412,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/4045822955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":4045822955},{"type":"v1","addr":"172.21.15.82:6837","nonce":4045822955}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-20T10:09:09.084 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 57 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 msgr2=0x7f10fc068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 0x7f10fc068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f11040ae000 tx=0x7f11040b5040 comp rx=0 tx=0).stop 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 msgr2=0x7f111c153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f110c00d5f0 tx=0x7f110c00dab0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 shutdown_connections 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f10fc0660d0 0x7f10fc068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f111c15cab0 0x7f111c15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f111c0d0d10 0x7f111c153700 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 --2- 172.21.15.82:0/1915479086 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f111c0cf110 0x7f111c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 >> 172.21.15.82:0/1915479086 conn(0x7f111c08c120 msgr2=0x7f111c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 shutdown_connections 2023-07-20T10:09:09.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.110+0000 7f11218bd640 1 -- 172.21.15.82:0/1915479086 wait complete. 2023-07-20T10:09:09.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:09.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.266+0000 7ff06759e640 1 Processor -- start 2023-07-20T10:09:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.266+0000 7ff06759e640 1 -- start start 2023-07-20T10:09:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06759e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff06815d060 0x7ff06806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0680c86d0 0x7ff0680ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06759e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068070660 con 0x7ff06815d440 2023-07-20T10:09:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06759e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680cd2a0 con 0x7ff0680c86d0 2023-07-20T10:09:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06759e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680ca6f0 con 0x7ff06815d060 2023-07-20T10:09:09.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0680c86d0 0x7ff0680ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0680c86d0 0x7ff0680ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59762/0 (socket says 172.21.15.82:59762) 2023-07-20T10:09:09.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 -- 172.21.15.82:0/2251958347 learned_addr learned my addr 172.21.15.82:0/2251958347 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff06659c640 1 --2- 172.21.15.82:0/2251958347 >> v2:172.21.15.183:3300/0 conn(0x7ff06815d060 0x7ff06806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 -- 172.21.15.82:0/2251958347 >> v2:172.21.15.183:3300/0 conn(0x7ff06815d060 msgr2=0x7ff06806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 --2- 172.21.15.82:0/2251958347 >> v2:172.21.15.183:3300/0 conn(0x7ff06815d060 0x7ff06806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 -- 172.21.15.82:0/2251958347 >> v1:172.21.15.183:6789/0 conn(0x7ff06815d440 legacy=0x7ff068070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 -- 172.21.15.82:0/2251958347 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680cd490 con 0x7ff0680c86d0 2023-07-20T10:09:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff05dd9b640 1 --2- 172.21.15.82:0/2251958347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff0680ccd60 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff068071f00 tx=0x7ff05001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de9cf5daab4200b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.270+0000 7ff065d9b640 1 -- 172.21.15.82:0/2251958347 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500aa5f0 con 0x7ff0680c86d0 2023-07-20T10:09:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff065d9b640 1 -- 172.21.15.82:0/2251958347 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500aa750 con 0x7ff0680c86d0 2023-07-20T10:09:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff065d9b640 1 -- 172.21.15.82:0/2251958347 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500aaae0 con 0x7ff0680c86d0 2023-07-20T10:09:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- 172.21.15.82:0/2251958347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 msgr2=0x7ff0680ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- 172.21.15.82:0/2251958347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff0680ccd60 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff068071f00 tx=0x7ff05001c490 comp rx=0 tx=0).stop 2023-07-20T10:09:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- 172.21.15.82:0/2251958347 shutdown_connections 2023-07-20T10:09:09.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- 172.21.15.82:0/2251958347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff0680ccd60 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- 172.21.15.82:0/2251958347 >> v2:172.21.15.183:3300/0 conn(0x7ff06815d060 0x7ff06806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- 172.21.15.82:0/2251958347 >> 172.21.15.82:0/2251958347 conn(0x7ff0680ce080 msgr2=0x7ff0680ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- 172.21.15.82:0/2251958347 shutdown_connections 2023-07-20T10:09:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- 172.21.15.82:0/2251958347 wait complete. 2023-07-20T10:09:09.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 Processor -- start 2023-07-20T10:09:09.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- start start 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff06815d060 0x7ff0681502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff06815d440 0x7ff0680c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068153cc0 con 0x7ff0680c86d0 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068156230 con 0x7ff06815d440 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06759e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff068156510 con 0x7ff06815d060 2023-07-20T10:09:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59764/0 (socket says 172.21.15.82:59764) 2023-07-20T10:09:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.274+0000 7ff06659c640 1 -- 172.21.15.82:0/3958926469 learned_addr learned my addr 172.21.15.82:0/3958926469 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05dd9b640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff06815d060 0x7ff0681502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff066d9d640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff06815d440 0x7ff0680c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 -- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff06815d060 msgr2=0x7ff0681502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff06815d060 0x7ff0681502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 -- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff06815d440 msgr2=0x7ff0680c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff06815d440 0x7ff0680c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 -- 172.21.15.82:0/3958926469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500094d0 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06659c640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ff05800d800 tx=0x7ff05800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800b6c0 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05800b820 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0681567f0 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05800bb90 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff068150820 con 0x7ff0680c86d0 2023-07-20T10:09:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06804da30 con 0x7ff0680c86d0 2023-07-20T10:09:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 68) v1 ==== 85704+0+0 (secure 0 0 0) 0x7ff05800bcf0 con 0x7ff0680c86d0 2023-07-20T10:09:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 0x7ff048068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.278+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6892+0+0 (secure 0 0 0) 0x7ff058084530 con 0x7ff0680c86d0 2023-07-20T10:09:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.282+0000 7ff05dd9b640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 0x7ff048068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.282+0000 7ff05dd9b640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 0x7ff048068800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae000 tx=0x7ff0500b5040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.282+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff058055150 con 0x7ff0680c86d0 2023-07-20T10:09:09.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.430+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff06806ae70 con 0x7ff0680c86d0 2023-07-20T10:09:09.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.430+0000 7ff05f7fe640 1 -- 172.21.15.82:0/3958926469 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+19505 (secure 0 0 0) 0x7ff058054ce0 con 0x7ff0680c86d0 2023-07-20T10:09:09.408 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:09.408 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":126,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:07.945867+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:08:22.111844+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-20T10:08:23.430963+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":126,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3661222862":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2912998301":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3813052049":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3727649753":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/403722108":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6833/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6832/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3207199541":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1237946915":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2165152006":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1193855226":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/1311622631":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6833/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6832/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/467905236":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2263958707":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2514495626":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/3151351148":"2023-07-21T10:08:41.941567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:09.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 msgr2=0x7ff048068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 0x7ff048068800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae000 tx=0x7ff0500b5040 comp rx=0 tx=0).stop 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 msgr2=0x7ff068156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7ff05800d800 tx=0x7ff05800dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 shutdown_connections 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff048066340 0x7ff048068800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff06815d440 0x7ff0680c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff06815d060 0x7ff0681502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 --2- 172.21.15.82:0/3958926469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0680c86d0 0x7ff068156ff0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 >> 172.21.15.82:0/3958926469 conn(0x7ff0680ce080 msgr2=0x7ff0680ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 shutdown_connections 2023-07-20T10:09:09.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.434+0000 7ff06759e640 1 -- 172.21.15.82:0/3958926469 wait complete. 2023-07-20T10:09:09.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T10:09:09.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 Processor -- start 2023-07-20T10:09:09.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 -- start start 2023-07-20T10:09:09.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 0x7f59840b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59840b04b0 0x7f5984160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840cdd60 con 0x7f59840ad720 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840b20a0 con 0x7f59840b04b0 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5989ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840cd430 con 0x7f59840b1cc0 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5983fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f59840b04b0 0x7f5984160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5982ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f59840ad720 0x7f59840afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52122/0 (socket says 172.21.15.82:52122) 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5982ffd640 1 -- 172.21.15.82:0/2414250456 learned_addr learned my addr 172.21.15.82:0/2414250456 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f59837fe640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 0x7f59840b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5983fff640 1 -- 172.21.15.82:0/2414250456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 msgr2=0x7f59840b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:09.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5983fff640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 0x7f59840b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5983fff640 1 -- 172.21.15.82:0/2414250456 >> v1:172.21.15.82:6789/0 conn(0x7f59840ad720 legacy=0x7f59840afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f5983fff640 1 -- 172.21.15.82:0/2414250456 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840cd710 con 0x7f59840b04b0 2023-07-20T10:09:09.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.594+0000 7f59837fe640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 0x7f59840b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:09.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5983fff640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840b04b0 0x7f5984160660 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f597c009d90 tx=0x7f597c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773064e637bc0f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f59827fc640 1 -- 172.21.15.82:0/2414250456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0a5970 con 0x7f59840b04b0 2023-07-20T10:09:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f59827fc640 1 -- 172.21.15.82:0/2414250456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c0a5ad0 con 0x7f59840b04b0 2023-07-20T10:09:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f59827fc640 1 -- 172.21.15.82:0/2414250456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0a5e60 con 0x7f59840b04b0 2023-07-20T10:09:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- 172.21.15.82:0/2414250456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840b04b0 msgr2=0x7f5984160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840b04b0 0x7f5984160660 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f597c009d90 tx=0x7f597c01c890 comp rx=0 tx=0).stop 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- 172.21.15.82:0/2414250456 shutdown_connections 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840b04b0 0x7f5984160660 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 --2- 172.21.15.82:0/2414250456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b1cc0 0x7f59840b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- 172.21.15.82:0/2414250456 >> 172.21.15.82:0/2414250456 conn(0x7f59840cada0 msgr2=0x7f59840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- 172.21.15.82:0/2414250456 shutdown_connections 2023-07-20T10:09:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- 172.21.15.82:0/2414250456 wait complete. 2023-07-20T10:09:09.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 Processor -- start 2023-07-20T10:09:09.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.598+0000 7f5989ee5640 1 -- start start 2023-07-20T10:09:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b04b0 0x7f5984150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 0x7f598415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598415f7c0 con 0x7f59840ad720 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840aca20 con 0x7f59840b1cc0 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840acd00 con 0x7f59840b04b0 2023-07-20T10:09:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59772/0 (socket says 172.21.15.82:59772) 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 -- 172.21.15.82:0/759623692 learned_addr learned my addr 172.21.15.82:0/759623692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5982ffd640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b04b0 0x7f5984150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5983fff640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 0x7f598415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 -- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b04b0 msgr2=0x7f5984150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b04b0 0x7f5984150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 -- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 msgr2=0x7f598415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 0x7f598415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 -- 172.21.15.82:0/759623692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c009a70 con 0x7f59840ad720 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5983fff640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 0x7f598415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f59837fe640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f597400d800 tx=0x7f597400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740096c0 con 0x7f59840ad720 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5974009820 con 0x7f59840ad720 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5974009bd0 con 0x7f59840ad720 2023-07-20T10:09:09.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840b12f0 con 0x7f59840ad720 2023-07-20T10:09:09.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59840ad2c0 con 0x7f59840ad720 2023-07-20T10:09:09.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.602+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5984073c70 con 0x7f59840ad720 2023-07-20T10:09:09.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.606+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 68) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f5974009d30 con 0x7f59840ad720 2023-07-20T10:09:09.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.606+0000 7f596bfff640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 0x7f5970068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.606+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f59740848f0 con 0x7f59840ad720 2023-07-20T10:09:09.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.606+0000 7f5982ffd640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 0x7f5970068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.606+0000 7f5982ffd640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 0x7f5970068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f598415b8a0 tx=0x7f5978009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.610+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59740518c0 con 0x7f59840ad720 2023-07-20T10:09:09.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.786+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5984159cd0 con 0x7f59840ad720 2023-07-20T10:09:09.763 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T10:09:09.786+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T10:09:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.794+0000 7f596bfff640 1 -- 172.21.15.82:0/759623692 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5974054ee0 con 0x7f59840ad720 2023-07-20T10:09:09.770 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T10:09:09.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 msgr2=0x7f5970068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 0x7f5970068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f598415b8a0 tx=0x7f5978009040 comp rx=0 tx=0).stop 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 msgr2=0x7f5984158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f597400d800 tx=0x7f597400dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 shutdown_connections 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f5970066340 0x7f5970068800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f59840b1cc0 0x7f598415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f59840b04b0 0x7f5984150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 --2- 172.21.15.82:0/759623692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59840ad720 0x7f5984158990 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 >> 172.21.15.82:0/759623692 conn(0x7f59840cada0 msgr2=0x7f5984158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 shutdown_connections 2023-07-20T10:09:09.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.798+0000 7f5989ee5640 1 -- 172.21.15.82:0/759623692 wait complete. 2023-07-20T10:09:09.781 INFO:tasks.ceph.mds.c.smithi082.stderr: -6707> 2023-07-20T10:08:29.690+0000 7f50e2e29640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:09:09.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T10:09:09.831 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:09:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.958+0000 7f4c98634640 1 Processor -- start 2023-07-20T10:09:09.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.958+0000 7f4c98634640 1 -- start start 2023-07-20T10:09:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9006c120 0x7f4c900cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4c901602b0 0x7f4c90160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c9006ab10 0x7f4c9006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9006b4a0 con 0x7f4c9006c120 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900d0970 con 0x7f4c901602b0 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c98634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90160e20 con 0x7f4c9006ab10 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9006c120 0x7f4c900cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c9006c120 0x7f4c900cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59786/0 (socket says 172.21.15.82:59786) 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 -- 172.21.15.82:0/2837129490 learned_addr learned my addr 172.21.15.82:0/2837129490 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c95bcf640 1 --2- 172.21.15.82:0/2837129490 >> v2:172.21.15.183:3300/0 conn(0x7f4c901602b0 0x7f4c90160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c96bd1640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c9006ab10 0x7f4c9006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 -- 172.21.15.82:0/2837129490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c9006ab10 msgr2=0x7f4c9006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c9006ab10 0x7f4c9006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 -- 172.21.15.82:0/2837129490 >> v2:172.21.15.183:3300/0 conn(0x7f4c901602b0 msgr2=0x7f4c90160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 --2- 172.21.15.82:0/2837129490 >> v2:172.21.15.183:3300/0 conn(0x7f4c901602b0 0x7f4c90160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.962+0000 7f4c963d0640 1 -- 172.21.15.82:0/2837129490 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900cd300 con 0x7f4c9006c120 2023-07-20T10:09:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c963d0640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cdde0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4c9008ca40 tx=0x7f4c8c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb8f796722b4fd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c953ce640 1 -- 172.21.15.82:0/2837129490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0ab600 con 0x7f4c9006c120 2023-07-20T10:09:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c953ce640 1 -- 172.21.15.82:0/2837129490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0ab760 con 0x7f4c9006c120 2023-07-20T10:09:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c953ce640 1 -- 172.21.15.82:0/2837129490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0abaf0 con 0x7f4c9006c120 2023-07-20T10:09:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 -- 172.21.15.82:0/2837129490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 msgr2=0x7f4c900cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cdde0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f4c9008ca40 tx=0x7f4c8c01c440 comp rx=0 tx=0).stop 2023-07-20T10:09:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 -- 172.21.15.82:0/2837129490 shutdown_connections 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 --2- 172.21.15.82:0/2837129490 >> v2:172.21.15.183:3300/0 conn(0x7f4c901602b0 0x7f4c90160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c9006ab10 0x7f4c9006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 --2- 172.21.15.82:0/2837129490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cdde0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 -- 172.21.15.82:0/2837129490 >> 172.21.15.82:0/2837129490 conn(0x7f4c9008c0a0 msgr2=0x7f4c9009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 -- 172.21.15.82:0/2837129490 shutdown_connections 2023-07-20T10:09:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 -- 172.21.15.82:0/2837129490 wait complete. 2023-07-20T10:09:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.966+0000 7f4c98634640 1 Processor -- start 2023-07-20T10:09:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- start start 2023-07-20T10:09:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c9006ab10 0x7f4c90156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 0x7f4c900b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900cae20 con 0x7f4c9006c120 2023-07-20T10:09:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900cb630 con 0x7f4c9006ab10 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900cb070 con 0x7f4c901602b0 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59796/0 (socket says 172.21.15.82:59796) 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 -- 172.21.15.82:0/667427502 learned_addr learned my addr 172.21.15.82:0/667427502 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c963d0640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c9006ab10 0x7f4c90156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c96bd1640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 0x7f4c900b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 -- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 msgr2=0x7f4c900b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 0x7f4c900b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 -- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c9006ab10 msgr2=0x7f4c90156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c9006ab10 0x7f4c90156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 -- 172.21.15.82:0/667427502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0094d0 con 0x7f4c9006c120 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c96bd1640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 0x7f4c900b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c95bcf640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e870 tx=0x7f4c8000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80009510 con 0x7f4c9006c120 2023-07-20T10:09:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8000eec0 con 0x7f4c9006c120 2023-07-20T10:09:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000cb40 con 0x7f4c9006c120 2023-07-20T10:09:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c900cb350 con 0x7f4c9006c120 2023-07-20T10:09:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c900c6fa0 con 0x7f4c9006c120 2023-07-20T10:09:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.970+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9004da30 con 0x7f4c9006c120 2023-07-20T10:09:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.974+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 68) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f4c8000ccc0 con 0x7f4c9006c120 2023-07-20T10:09:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.974+0000 7f4c86ffd640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 0x7f4c740687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.974+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6950+0+0 (secure 0 0 0) 0x7f4c800840c0 con 0x7f4c9006c120 2023-07-20T10:09:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.974+0000 7f4c963d0640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 0x7f4c740687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.974+0000 7f4c963d0640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 0x7f4c740687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0af000 tx=0x7f4c8c0b6040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:09.978+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c80054da0 con 0x7f4c9006c120 2023-07-20T10:09:10.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.158+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c900cee40 con 0x7f4c9006c120 2023-07-20T10:09:10.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.794+0000 7f4c86ffd640 1 -- 172.21.15.82:0/667427502 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c80054930 con 0x7f4c9006c120 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 msgr2=0x7f4c740687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 0x7f4c740687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0af000 tx=0x7f4c8c0b6040 comp rx=0 tx=0).stop 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 msgr2=0x7f4c900cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000e870 tx=0x7f4c8000ec70 comp rx=0 tx=0).stop 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 shutdown_connections 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4c74066310 0x7f4c740687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c901602b0 0x7f4c900b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c9006c120 0x7f4c900cbd00 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 --2- 172.21.15.82:0/667427502 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c9006ab10 0x7f4c90156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 >> 172.21.15.82:0/667427502 conn(0x7f4c9008c0a0 msgr2=0x7f4c900af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:10.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 shutdown_connections 2023-07-20T10:09:10.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:10.798+0000 7f4c98634640 1 -- 172.21.15.82:0/667427502 wait complete. 2023-07-20T10:09:10.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T10:09:10.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 Processor -- start 2023-07-20T10:09:10.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 -- start start 2023-07-20T10:09:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca14160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fca1406ab10 0x7fca1406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:10.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca140ce4f0 con 0x7fca1406c120 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1406b4c0 con 0x7fca1406ab10 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca19abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca140d0970 con 0x7fca141602b0 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca13fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fca1406ab10 0x7fca1406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca137fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fca1406c120 0x7fca140cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52136/0 (socket says 172.21.15.82:52136) 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca137fe640 1 -- 172.21.15.82:0/4179106877 learned_addr learned my addr 172.21.15.82:0/4179106877 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:10.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca0bfff640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca14160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca13fff640 1 -- 172.21.15.82:0/4179106877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 msgr2=0x7fca14160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca13fff640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca14160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca13fff640 1 -- 172.21.15.82:0/4179106877 >> v1:172.21.15.82:6789/0 conn(0x7fca1406c120 legacy=0x7fca140cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca13fff640 1 -- 172.21.15.82:0/4179106877 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca14160e20 con 0x7fca1406ab10 2023-07-20T10:09:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca12ffd640 1 -- 172.21.15.82:0/4179106877 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685679740 0 0) 0x7fca140ce4f0 con 0x7fca1406c120 2023-07-20T10:09:10.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.014+0000 7fca0bfff640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca14160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca13fff640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406ab10 0x7fca1406af80 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bed1a8a6752b6e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca12ffd640 1 -- 172.21.15.82:0/4179106877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0a5870 con 0x7fca1406ab10 2023-07-20T10:09:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca12ffd640 1 -- 172.21.15.82:0/4179106877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c0a59d0 con 0x7fca1406ab10 2023-07-20T10:09:10.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca12ffd640 1 -- 172.21.15.82:0/4179106877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0c0a5d60 con 0x7fca1406ab10 2023-07-20T10:09:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 -- 172.21.15.82:0/4179106877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406ab10 msgr2=0x7fca1406af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406ab10 0x7fca1406af80 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fca0c009d90 tx=0x7fca0c01c8c0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 -- 172.21.15.82:0/4179106877 shutdown_connections 2023-07-20T10:09:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406ab10 0x7fca1406af80 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 --2- 172.21.15.82:0/4179106877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca14160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 -- 172.21.15.82:0/4179106877 >> 172.21.15.82:0/4179106877 conn(0x7fca1408c0a0 msgr2=0x7fca1409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 -- 172.21.15.82:0/4179106877 shutdown_connections 2023-07-20T10:09:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.018+0000 7fca19abd640 1 -- 172.21.15.82:0/4179106877 wait complete. 2023-07-20T10:09:10.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 Processor -- start 2023-07-20T10:09:10.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- start start 2023-07-20T10:09:10.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca140c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca140ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca140c9720 con 0x7fca1406c120 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca140cc260 con 0x7fca1406ab10 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca140c8e70 con 0x7fca141602b0 2023-07-20T10:09:11.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59822/0 (socket says 172.21.15.82:59822) 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 -- 172.21.15.82:0/1242145624 learned_addr learned my addr 172.21.15.82:0/1242145624 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 -- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 msgr2=0x7fca140ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca140ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 -- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 msgr2=0x7fca140c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:11.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca137fe640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca140c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca140c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 -- 172.21.15.82:0/1242145624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c009a70 con 0x7fca1406c120 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca137fe640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca140c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca0bfff640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d800 tx=0x7fc9fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0096c0 con 0x7fca1406c120 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc009820 con 0x7fca1406c120 2023-07-20T10:09:11.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca140c9970 con 0x7fca1406c120 2023-07-20T10:09:11.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc009bd0 con 0x7fca1406c120 2023-07-20T10:09:11.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.022+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca140c9f30 con 0x7fca1406c120 2023-07-20T10:09:11.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1404da30 con 0x7fca1406c120 2023-07-20T10:09:11.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 68) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fc9fc009d30 con 0x7fca1406c120 2023-07-20T10:09:11.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca10ff9640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 0x7fc9f40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:11.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6950+0+0 (secure 0 0 0) 0x7fc9fc084900 con 0x7fca1406c120 2023-07-20T10:09:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca137fe640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 0x7fc9f40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.026+0000 7fca137fe640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 0x7fc9f40687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca04000f70 tx=0x7fca04009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:11.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.030+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9fc051910 con 0x7fca1406c120 2023-07-20T10:09:11.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.182+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca140cee40 con 0x7fca1406c120 2023-07-20T10:09:11.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:11.806+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc9fc051ce0 con 0x7fca1406c120 2023-07-20T10:09:12.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.102+0000 7fca10ff9640 1 -- 172.21.15.82:0/1242145624 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc9fc081c40 con 0x7fca1406c120 2023-07-20T10:09:12.077 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T10:09:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 msgr2=0x7fc9f40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 0x7fc9f40687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fca04000f70 tx=0x7fca04009040 comp rx=0 tx=0).stop 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 msgr2=0x7fca140cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d800 tx=0x7fc9fc00dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 shutdown_connections 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc9f4066310 0x7fc9f40687d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fca141602b0 0x7fca140ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca1406c120 0x7fca140cbd20 secure :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d800 tx=0x7fc9fc00dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 --2- 172.21.15.82:0/1242145624 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca1406ab10 0x7fca140c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 >> 172.21.15.82:0/1242145624 conn(0x7fca1408c0a0 msgr2=0x7fca1415afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.106+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 shutdown_connections 2023-07-20T10:09:12.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.110+0000 7fca19abd640 1 -- 172.21.15.82:0/1242145624 wait complete. 2023-07-20T10:09:12.107 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T10:09:12.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.282+0000 7efe19e6a640 1 Processor -- start 2023-07-20T10:09:12.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.282+0000 7efe19e6a640 1 -- start start 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe19e6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe1415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe19e6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe140afd50 0x7efe140b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe19e6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe140cc8d0 con 0x7efe14159830 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe19e6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140cce90 con 0x7efe140afd50 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe19e6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140b0700 con 0x7efe14159450 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe140afd50 0x7efe140b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efe140afd50 0x7efe140b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59836/0 (socket says 172.21.15.82:59836) 2023-07-20T10:09:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 -- 172.21.15.82:0/565568209 learned_addr learned my addr 172.21.15.82:0/565568209 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe137fe640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe1415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 -- 172.21.15.82:0/565568209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 msgr2=0x7efe1415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe1415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 -- 172.21.15.82:0/565568209 >> v1:172.21.15.183:6789/0 conn(0x7efe14159830 legacy=0x7efe140cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.286+0000 7efe13fff640 1 -- 172.21.15.82:0/565568209 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140ccbb0 con 0x7efe140afd50 2023-07-20T10:09:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe13fff640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140afd50 0x7efe140b01c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009e80 tx=0x7efe0c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811579c24d85c807 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe12ffd640 1 -- 172.21.15.82:0/565568209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0a5880 con 0x7efe140afd50 2023-07-20T10:09:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe12ffd640 1 -- 172.21.15.82:0/565568209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c0a59e0 con 0x7efe140afd50 2023-07-20T10:09:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe12ffd640 1 -- 172.21.15.82:0/565568209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0a5d70 con 0x7efe140afd50 2023-07-20T10:09:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- 172.21.15.82:0/565568209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140afd50 msgr2=0x7efe140b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140afd50 0x7efe140b01c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009e80 tx=0x7efe0c01c9c0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- 172.21.15.82:0/565568209 shutdown_connections 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140afd50 0x7efe140b01c0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 --2- 172.21.15.82:0/565568209 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe1415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- 172.21.15.82:0/565568209 >> 172.21.15.82:0/565568209 conn(0x7efe140cad50 msgr2=0x7efe140cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- 172.21.15.82:0/565568209 shutdown_connections 2023-07-20T10:09:12.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- 172.21.15.82:0/565568209 wait complete. 2023-07-20T10:09:12.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 Processor -- start 2023-07-20T10:09:12.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.290+0000 7efe19e6a640 1 -- start start 2023-07-20T10:09:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 0x7efe140b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe14155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140b0ba0 con 0x7efe140c1380 2023-07-20T10:09:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c7e40 con 0x7efe140afd50 2023-07-20T10:09:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe140c8120 con 0x7efe14159450 2023-07-20T10:09:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59840/0 (socket says 172.21.15.82:59840) 2023-07-20T10:09:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 -- 172.21.15.82:0/2320302228 learned_addr learned my addr 172.21.15.82:0/2320302228 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe137fe640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 0x7efe140b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 -- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 msgr2=0x7efe14155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe0affd640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe14155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe14155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 -- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 msgr2=0x7efe140b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 0x7efe140b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 -- 172.21.15.82:0/2320302228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009b30 con 0x7efe140c1380 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe137fe640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 0x7efe140b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe0affd640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe14155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe13fff640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0af040 tx=0x7efe0c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b8670 con 0x7efe140c1380 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c0b8830 con 0x7efe140c1380 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b8be0 con 0x7efe140c1380 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe140c8400 con 0x7efe140c1380 2023-07-20T10:09:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe140b38f0 con 0x7efe140c1380 2023-07-20T10:09:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1404da30 con 0x7efe140c1380 2023-07-20T10:09:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.294+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe0c0b8d40 con 0x7efe140c1380 2023-07-20T10:09:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.298+0000 7efe10ff9640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 0x7efdf4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.298+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6512+0+0 (secure 0 0 0) 0x7efe0c11f7e0 con 0x7efe140c1380 2023-07-20T10:09:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.298+0000 7efe137fe640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 0x7efdf4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.298+0000 7efe137fe640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 0x7efdf4068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe04009840 tx=0x7efe04008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.302+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe0c0eca50 con 0x7efe140c1380 2023-07-20T10:09:12.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:12.450+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efe140b0fa0 con 0x7efe140c1380 2023-07-20T10:09:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.121+0000 7efe10ff9640 1 -- 172.21.15.82:0/2320302228 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7efe0c0f0070 con 0x7efe140c1380 2023-07-20T10:09:13.100 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T10:09:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.125+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 msgr2=0x7efdf4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.125+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 0x7efdf4068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efe04009840 tx=0x7efe04008040 comp rx=0 tx=0).stop 2023-07-20T10:09:13.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.125+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 msgr2=0x7efe14157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.125+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0af040 tx=0x7efe0c019760 comp rx=0 tx=0).stop 2023-07-20T10:09:13.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 shutdown_connections 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7efdf40663a0 0x7efdf4068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efe140c1380 0x7efe14157410 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efe14159450 0x7efe14155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 --2- 172.21.15.82:0/2320302228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efe140afd50 0x7efe140b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 >> 172.21.15.82:0/2320302228 conn(0x7efe140cad50 msgr2=0x7efe140c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 shutdown_connections 2023-07-20T10:09:13.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.129+0000 7efe19e6a640 1 -- 172.21.15.82:0/2320302228 wait complete. 2023-07-20T10:09:13.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T10:09:13.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 Processor -- start 2023-07-20T10:09:13.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 -- start start 2023-07-20T10:09:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463415c6e0 0x7f46340cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46340cdb40 con 0x7f463415cac0 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46340d07a0 con 0x7f463415c6e0 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46399fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46340cd4f0 con 0x7f46340d3200 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f4632ffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f463415c6e0 0x7f46340cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46337fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f463415cac0 0x7f46340d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34982/0 (socket says 172.21.15.82:34982) 2023-07-20T10:09:13.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46327fc640 1 --2- 172.21.15.82:0/3357218042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.293+0000 7f46337fe640 1 -- 172.21.15.82:0/3357218042 learned_addr learned my addr 172.21.15.82:0/3357218042 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f46327fc640 1 -- 172.21.15.82:0/3357218042 >> v2:172.21.15.183:3300/0 conn(0x7f463415c6e0 msgr2=0x7f46340cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f46327fc640 1 --2- 172.21.15.82:0/3357218042 >> v2:172.21.15.183:3300/0 conn(0x7f463415c6e0 0x7f46340cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f46327fc640 1 -- 172.21.15.82:0/3357218042 >> v1:172.21.15.183:6789/0 conn(0x7f463415cac0 legacy=0x7f46340d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f46327fc640 1 -- 172.21.15.82:0/3357218042 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46340cd7d0 con 0x7f46340d3200 2023-07-20T10:09:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f46327fc640 1 --2- 172.21.15.82:0/3357218042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340cdfd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46280097c0 tx=0x7f462801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0745ac9ec3c27d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f4631ffb640 1 -- 172.21.15.82:0/3357218042 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280ab600 con 0x7f46340d3200 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f4631ffb640 1 -- 172.21.15.82:0/3357218042 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280a7050 con 0x7f46340d3200 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.297+0000 7f4631ffb640 1 -- 172.21.15.82:0/3357218042 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280ab980 con 0x7f46340d3200 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- 172.21.15.82:0/3357218042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 msgr2=0x7f46340cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- 172.21.15.82:0/3357218042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340cdfd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46280097c0 tx=0x7f462801c360 comp rx=0 tx=0).stop 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- 172.21.15.82:0/3357218042 shutdown_connections 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- 172.21.15.82:0/3357218042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340cdfd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- 172.21.15.82:0/3357218042 >> v2:172.21.15.183:3300/0 conn(0x7f463415c6e0 0x7f46340cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- 172.21.15.82:0/3357218042 >> 172.21.15.82:0/3357218042 conn(0x7f46340d2600 msgr2=0x7f46340d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- 172.21.15.82:0/3357218042 shutdown_connections 2023-07-20T10:09:13.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- 172.21.15.82:0/3357218042 wait complete. 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 Processor -- start 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- start start 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 0x7f46340c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340b5220 con 0x7f463415c6e0 2023-07-20T10:09:13.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46341538b0 con 0x7f463415cac0 2023-07-20T10:09:13.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46399fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634153b80 con 0x7f46340d3200 2023-07-20T10:09:13.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60952/0 (socket says 172.21.15.82:60952) 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 -- 172.21.15.82:0/4231205846 learned_addr learned my addr 172.21.15.82:0/4231205846 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f4632ffd640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46337fe640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 0x7f46340c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 -- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 msgr2=0x7f46340c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 -- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 msgr2=0x7f46340c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 0x7f46340c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46327fc640 1 -- 172.21.15.82:0/4231205846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628009420 con 0x7f463415c6e0 2023-07-20T10:09:13.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.301+0000 7f46337fe640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 0x7f46340c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:13.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f46327fc640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f462801aa10 tx=0x7f462801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280b4420 con 0x7f463415c6e0 2023-07-20T10:09:13.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46280b45a0 con 0x7f463415c6e0 2023-07-20T10:09:13.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46280b4950 con 0x7f463415c6e0 2023-07-20T10:09:13.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4634153e60 con 0x7f463415c6e0 2023-07-20T10:09:13.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4634154420 con 0x7f463415c6e0 2023-07-20T10:09:13.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463404da30 con 0x7f463415c6e0 2023-07-20T10:09:13.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f46280b2070 con 0x7f463415c6e0 2023-07-20T10:09:13.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 0x7f4620068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f462811d290 con 0x7f463415c6e0 2023-07-20T10:09:13.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.305+0000 7f4632ffd640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 0x7f4620068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.309+0000 7f4632ffd640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 0x7f4620068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46240113e0 tx=0x7f462400b040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.309+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46280ea4d0 con 0x7f463415c6e0 2023-07-20T10:09:13.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.457+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f46340b8580 con 0x7f463415c6e0 2023-07-20T10:09:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f461bfff640 1 -- 172.21.15.82:0/4231205846 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v43) v1 ==== 115+0+0 (secure 0 0 0) 0x7f46280edaf0 con 0x7f463415c6e0 2023-07-20T10:09:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 msgr2=0x7f4620068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 0x7f4620068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46240113e0 tx=0x7f462400b040 comp rx=0 tx=0).stop 2023-07-20T10:09:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 msgr2=0x7f46340c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f462801aa10 tx=0x7f462801aba0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 shutdown_connections 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f46200663a0 0x7f4620068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f463415cac0 0x7f46340c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f463415c6e0 0x7f46340c96d0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 --2- 172.21.15.82:0/4231205846 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f46340d3200 0x7f46340c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 >> 172.21.15.82:0/4231205846 conn(0x7f46340d2600 msgr2=0x7f46340b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 shutdown_connections 2023-07-20T10:09:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.465+0000 7f46399fa640 1 -- 172.21.15.82:0/4231205846 wait complete. 2023-07-20T10:09:13.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T10:09:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.629+0000 7fee6cd37640 1 Processor -- start 2023-07-20T10:09:13.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.629+0000 7fee6cd37640 1 -- start start 2023-07-20T10:09:13.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6cd37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee6806f710 0x7fee6806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6cd37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee6815a6f0 0x7fee6815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6cd37640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee68070030 con 0x7fee680ca5a0 2023-07-20T10:09:13.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6cd37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815bad0 con 0x7fee6806f710 2023-07-20T10:09:13.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6cd37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee68071950 con 0x7fee6815a6f0 2023-07-20T10:09:13.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fee6806f710 0x7fee6806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee5dd9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fee680ca5a0 0x7fee6815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45702/0 (socket says 172.21.15.82:45702) 2023-07-20T10:09:13.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee5dd9b640 1 -- 172.21.15.82:0/1453428954 learned_addr learned my addr 172.21.15.82:0/1453428954 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:13.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee66d9d640 1 --2- 172.21.15.82:0/1453428954 >> v2:172.21.15.183:3300/0 conn(0x7fee6815a6f0 0x7fee6815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6659c640 1 -- 172.21.15.82:0/1453428954 >> v2:172.21.15.183:3300/0 conn(0x7fee6815a6f0 msgr2=0x7fee6815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6659c640 1 --2- 172.21.15.82:0/1453428954 >> v2:172.21.15.183:3300/0 conn(0x7fee6815a6f0 0x7fee6815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6659c640 1 -- 172.21.15.82:0/1453428954 >> v1:172.21.15.82:6789/0 conn(0x7fee680ca5a0 legacy=0x7fee6815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.633+0000 7fee6659c640 1 -- 172.21.15.82:0/1453428954 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6815b230 con 0x7fee6806f710 2023-07-20T10:09:13.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6659c640 1 --2- 172.21.15.82:0/1453428954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6806f710 0x7fee6806faf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fee6815dfd0 tx=0x7fee5801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8726e8eb7a722cc0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee65d9b640 1 -- 172.21.15.82:0/1453428954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004230 con 0x7fee6806f710 2023-07-20T10:09:13.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee65d9b640 1 -- 172.21.15.82:0/1453428954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee580a7050 con 0x7fee6806f710 2023-07-20T10:09:13.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee65d9b640 1 -- 172.21.15.82:0/1453428954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58003620 con 0x7fee6806f710 2023-07-20T10:09:13.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- 172.21.15.82:0/1453428954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6806f710 msgr2=0x7fee6806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1453428954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6806f710 0x7fee6806faf0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fee6815dfd0 tx=0x7fee5801c460 comp rx=0 tx=0).stop 2023-07-20T10:09:13.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- 172.21.15.82:0/1453428954 shutdown_connections 2023-07-20T10:09:13.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1453428954 >> v2:172.21.15.183:3300/0 conn(0x7fee6815a6f0 0x7fee6815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1453428954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6806f710 0x7fee6806faf0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- 172.21.15.82:0/1453428954 >> 172.21.15.82:0/1453428954 conn(0x7fee680cad50 msgr2=0x7fee680cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- 172.21.15.82:0/1453428954 shutdown_connections 2023-07-20T10:09:13.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- 172.21.15.82:0/1453428954 wait complete. 2023-07-20T10:09:13.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 Processor -- start 2023-07-20T10:09:13.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.637+0000 7fee6cd37640 1 -- start start 2023-07-20T10:09:13.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6806f710 0x7fee680c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee680ca5a0 0x7fee680b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c4950 con 0x7fee6815a6f0 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c7ab0 con 0x7fee6806f710 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c7d90 con 0x7fee680ca5a0 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60960/0 (socket says 172.21.15.82:60960) 2023-07-20T10:09:13.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 -- 172.21.15.82:0/1113914599 learned_addr learned my addr 172.21.15.82:0/1113914599 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:13.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6659c640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6806f710 0x7fee680c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee5dd9b640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee680ca5a0 0x7fee680b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 -- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee680ca5a0 msgr2=0x7fee680b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee680ca5a0 0x7fee680b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 -- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6806f710 msgr2=0x7fee680c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6806f710 0x7fee680c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 -- 172.21.15.82:0/1113914599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee58009420 con 0x7fee6815a6f0 2023-07-20T10:09:13.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee66d9d640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fee6000efc0 tx=0x7fee6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60009ba0 con 0x7fee6815a6f0 2023-07-20T10:09:13.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000f040 con 0x7fee6815a6f0 2023-07-20T10:09:13.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600146c0 con 0x7fee6815a6f0 2023-07-20T10:09:13.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680c8070 con 0x7fee6815a6f0 2023-07-20T10:09:13.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee680c8630 con 0x7fee6815a6f0 2023-07-20T10:09:13.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee681576f0 con 0x7fee6815a6f0 2023-07-20T10:09:13.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.641+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee60014820 con 0x7fee6815a6f0 2023-07-20T10:09:13.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.645+0000 7fee5f7fe640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 0x7fee48068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.645+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fee600849b0 con 0x7fee6815a6f0 2023-07-20T10:09:13.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.645+0000 7fee6659c640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 0x7fee48068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.645+0000 7fee6659c640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 0x7fee48068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fee580ad000 tx=0x7fee58008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.649+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee60051c80 con 0x7fee6815a6f0 2023-07-20T10:09:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.793+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fee6804da30 con 0x7fee6815a6f0 2023-07-20T10:09:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee5f7fe640 1 -- 172.21.15.82:0/1113914599 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7fee600552a0 con 0x7fee6815a6f0 2023-07-20T10:09:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 msgr2=0x7fee48068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 0x7fee48068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fee580ad000 tx=0x7fee58008040 comp rx=0 tx=0).stop 2023-07-20T10:09:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 msgr2=0x7fee6813f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fee6000efc0 tx=0x7fee6000c490 comp rx=0 tx=0).stop 2023-07-20T10:09:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 shutdown_connections 2023-07-20T10:09:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fee480663a0 0x7fee48068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee6815a6f0 0x7fee6813f370 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee680ca5a0 0x7fee680b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 --2- 172.21.15.82:0/1113914599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee6806f710 0x7fee680c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 >> 172.21.15.82:0/1113914599 conn(0x7fee680cad50 msgr2=0x7fee680afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 shutdown_connections 2023-07-20T10:09:13.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.801+0000 7fee6cd37640 1 -- 172.21.15.82:0/1113914599 wait complete. 2023-07-20T10:09:13.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T10:09:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.961+0000 7fdab57ba640 1 Processor -- start 2023-07-20T10:09:13.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 -- start start 2023-07-20T10:09:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdab0159450 0x7fdab015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdab00afd50 0x7fdab00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00b06b0 con 0x7fdab0159830 2023-07-20T10:09:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00cce90 con 0x7fdab0159450 2023-07-20T10:09:13.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdab57ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00cc8d0 con 0x7fdab00afd50 2023-07-20T10:09:13.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaa67fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdab0159830 0x7fdab00cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45714/0 (socket says 172.21.15.82:45714) 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaeffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdab0159450 0x7fdab015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4101026818 learned_addr learned my addr 172.21.15.82:0/4101026818 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaf7fe640 1 --2- 172.21.15.82:0/4101026818 >> v2:172.21.15.183:3300/0 conn(0x7fdab00afd50 0x7fdab00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaeffd640 1 -- 172.21.15.82:0/4101026818 >> v2:172.21.15.183:3300/0 conn(0x7fdab00afd50 msgr2=0x7fdab00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaeffd640 1 --2- 172.21.15.82:0/4101026818 >> v2:172.21.15.183:3300/0 conn(0x7fdab00afd50 0x7fdab00b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaeffd640 1 -- 172.21.15.82:0/4101026818 >> v1:172.21.15.82:6789/0 conn(0x7fdab0159830 legacy=0x7fdab00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.965+0000 7fdaaeffd640 1 -- 172.21.15.82:0/4101026818 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00ccbb0 con 0x7fdab0159450 2023-07-20T10:09:13.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdaaeffd640 1 --2- 172.21.15.82:0/4101026818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0159450 0x7fdab015a4c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fdab00c1da0 tx=0x7fdaa001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f94034bde7a409b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdaae7fc640 1 -- 172.21.15.82:0/4101026818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00ab610 con 0x7fdab0159450 2023-07-20T10:09:13.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdaae7fc640 1 -- 172.21.15.82:0/4101026818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa00ab770 con 0x7fdab0159450 2023-07-20T10:09:13.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdaae7fc640 1 -- 172.21.15.82:0/4101026818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00abb00 con 0x7fdab0159450 2023-07-20T10:09:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- 172.21.15.82:0/4101026818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0159450 msgr2=0x7fdab015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 --2- 172.21.15.82:0/4101026818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0159450 0x7fdab015a4c0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fdab00c1da0 tx=0x7fdaa001c410 comp rx=0 tx=0).stop 2023-07-20T10:09:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- 172.21.15.82:0/4101026818 shutdown_connections 2023-07-20T10:09:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 --2- 172.21.15.82:0/4101026818 >> v2:172.21.15.183:3300/0 conn(0x7fdab00afd50 0x7fdab00b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 --2- 172.21.15.82:0/4101026818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0159450 0x7fdab015a4c0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- 172.21.15.82:0/4101026818 >> 172.21.15.82:0/4101026818 conn(0x7fdab00cad50 msgr2=0x7fdab00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- 172.21.15.82:0/4101026818 shutdown_connections 2023-07-20T10:09:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- 172.21.15.82:0/4101026818 wait complete. 2023-07-20T10:09:13.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 Processor -- start 2023-07-20T10:09:13.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.969+0000 7fdab57ba640 1 -- start start 2023-07-20T10:09:13.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 0x7fdab0165440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdab0165980 0x7fdab00c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0152e70 con 0x7fdab00afd50 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0165ec0 con 0x7fdab0159450 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab01661a0 con 0x7fdab0165980 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60984/0 (socket says 172.21.15.82:60984) 2023-07-20T10:09:13.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 -- 172.21.15.82:0/1886663016 learned_addr learned my addr 172.21.15.82:0/1886663016 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaa67fc640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 0x7fdab0165440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaf7fe640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdab0165980 0x7fdab00c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 -- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdab0165980 msgr2=0x7fdab00c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdab0165980 0x7fdab00c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 -- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 msgr2=0x7fdab0165440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:13.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 0x7fdab0165440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:13.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 -- 172.21.15.82:0/1886663016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa0009420 con 0x7fdab00afd50 2023-07-20T10:09:13.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaa67fc640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 0x7fdab0165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:13.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaaeffd640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00ad040 tx=0x7fdaa001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00b5810 con 0x7fdab00afd50 2023-07-20T10:09:13.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa00b5990 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00b5d40 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab0166480 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab0166a40 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.973+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab0166c30 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.977+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdaa00bf410 con 0x7fdab00afd50 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.977+0000 7fdaa7fff640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 0x7fda90068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:13.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.977+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fdaa011ea10 con 0x7fdab00afd50 2023-07-20T10:09:13.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.977+0000 7fdaa67fc640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 0x7fda90068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:13.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.977+0000 7fdaa67fc640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 0x7fda90068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdab00b0270 tx=0x7fda98009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:13.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:13.981+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdaa00ebba0 con 0x7fdab00afd50 2023-07-20T10:09:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.129+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdab004da30 con 0x7fdab00afd50 2023-07-20T10:09:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.133+0000 7fdaa7fff640 1 -- 172.21.15.82:0/1886663016 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdaa00ab5d0 con 0x7fdab00afd50 2023-07-20T10:09:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.133+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 msgr2=0x7fda90068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.133+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 0x7fda90068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdab00b0270 tx=0x7fda98009040 comp rx=0 tx=0).stop 2023-07-20T10:09:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.133+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 msgr2=0x7fdab0152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:14.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.133+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00ad040 tx=0x7fdaa001ac50 comp rx=0 tx=0).stop 2023-07-20T10:09:14.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 shutdown_connections 2023-07-20T10:09:14.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fda900663a0 0x7fda90068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdab0165980 0x7fdab00c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdab0159450 0x7fdab0165440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 --2- 172.21.15.82:0/1886663016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab00afd50 0x7fdab0152930 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 >> 172.21.15.82:0/1886663016 conn(0x7fdab00cad50 msgr2=0x7fdab015b790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 shutdown_connections 2023-07-20T10:09:14.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.137+0000 7fdab57ba640 1 -- 172.21.15.82:0/1886663016 wait complete. 2023-07-20T10:09:14.131 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-20T10:09:14.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 Processor -- start 2023-07-20T10:09:14.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 -- start start 2023-07-20T10:09:14.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e7815cab0 0x7f6e780d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e780d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6e780cf110 0x7f6e780cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780d31c0 con 0x7f6e7815cab0 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e780d16b0 con 0x7f6e780cf110 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7f288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780b3520 con 0x7f6e780d0d10 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7d024640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e7815cab0 0x7f6e780d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7d024640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6e7815cab0 0x7f6e780d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60986/0 (socket says 172.21.15.82:60986) 2023-07-20T10:09:14.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.293+0000 7f6e7d024640 1 -- 172.21.15.82:0/3096455736 learned_addr learned my addr 172.21.15.82:0/3096455736 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:14.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7c823640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e780d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d825640 1 --2- 172.21.15.82:0/3096455736 >> v2:172.21.15.183:3300/0 conn(0x7f6e780cf110 0x7f6e780cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 -- 172.21.15.82:0/3096455736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 msgr2=0x7f6e780d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e780d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 -- 172.21.15.82:0/3096455736 >> v2:172.21.15.183:3300/0 conn(0x7f6e780cf110 msgr2=0x7f6e780cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3096455736 >> v2:172.21.15.183:3300/0 conn(0x7f6e780cf110 0x7f6e780cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 -- 172.21.15.82:0/3096455736 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780b2910 con 0x7f6e7815cab0 2023-07-20T10:09:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7815cab0 0x7f6e780d0300 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f6e7808bb70 tx=0x7f6e7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f82948e4dda3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e6ffff640 1 -- 172.21.15.82:0/3096455736 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740aa5f0 con 0x7f6e7815cab0 2023-07-20T10:09:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e6ffff640 1 -- 172.21.15.82:0/3096455736 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740aa750 con 0x7f6e7815cab0 2023-07-20T10:09:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e6ffff640 1 -- 172.21.15.82:0/3096455736 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740aaae0 con 0x7f6e7815cab0 2023-07-20T10:09:14.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7f288640 1 -- 172.21.15.82:0/3096455736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7815cab0 msgr2=0x7f6e780d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:14.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.297+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7815cab0 0x7f6e780d0300 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f6e7808bb70 tx=0x7f6e7401c4d0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- 172.21.15.82:0/3096455736 shutdown_connections 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3096455736 >> v2:172.21.15.183:3300/0 conn(0x7f6e780cf110 0x7f6e780cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e780d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3096455736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7815cab0 0x7f6e780d0300 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- 172.21.15.82:0/3096455736 >> 172.21.15.82:0/3096455736 conn(0x7f6e7808c120 msgr2=0x7f6e7809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- 172.21.15.82:0/3096455736 shutdown_connections 2023-07-20T10:09:14.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- 172.21.15.82:0/3096455736 wait complete. 2023-07-20T10:09:14.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 Processor -- start 2023-07-20T10:09:14.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- start start 2023-07-20T10:09:14.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e78153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7815cab0 0x7f6e7815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815e910 con 0x7f6e780cf110 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e78153fa0 con 0x7f6e7815cab0 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7f288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7815dfe0 con 0x7f6e780d0d10 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32770/0 (socket says 172.21.15.82:32770) 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 -- 172.21.15.82:0/3760845609 learned_addr learned my addr 172.21.15.82:0/3760845609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:14.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7c823640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e78153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d825640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7815cab0 0x7f6e7815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 -- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 msgr2=0x7f6e78153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e78153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 -- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7815cab0 msgr2=0x7f6e7815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7815cab0 0x7f6e7815eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 -- 172.21.15.82:0/3760845609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740094d0 con 0x7f6e780cf110 2023-07-20T10:09:14.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.301+0000 7f6e7d024640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401ab80 tx=0x7f6e7401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:14.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740b3800 con 0x7f6e780cf110 2023-07-20T10:09:14.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740b3980 con 0x7f6e780cf110 2023-07-20T10:09:14.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740b3d30 con 0x7f6e780cf110 2023-07-20T10:09:14.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7815e2c0 con 0x7f6e780cf110 2023-07-20T10:09:14.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e78152a30 con 0x7f6e780cf110 2023-07-20T10:09:14.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e78073c70 con 0x7f6e780cf110 2023-07-20T10:09:14.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6e740b2380 con 0x7f6e780cf110 2023-07-20T10:09:14.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 0x7f6e5c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:14.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f6e740a7070 con 0x7f6e780cf110 2023-07-20T10:09:14.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.305+0000 7f6e7c823640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 0x7f6e5c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:14.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.309+0000 7f6e7c823640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 0x7f6e5c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815bab0 tx=0x7f6e68008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:14.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.309+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e740eb760 con 0x7f6e780cf110 2023-07-20T10:09:14.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:14.505+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f6e780b2310 con 0x7f6e780cf110 2023-07-20T10:09:15.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.121+0000 7f6e6dffb640 1 -- 172.21.15.82:0/3760845609 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v725) v1 ==== 148+0+0 (secure 0 0 0) 0x7f6e740eed80 con 0x7f6e780cf110 2023-07-20T10:09:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 msgr2=0x7f6e5c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 0x7f6e5c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e7815bab0 tx=0x7f6e68008040 comp rx=0 tx=0).stop 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 msgr2=0x7f6e781524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f6e7401ab80 tx=0x7f6e7401ad10 comp rx=0 tx=0).stop 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 shutdown_connections 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6e5c0663a0 0x7f6e5c068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6e7815cab0 0x7f6e7815eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6e780d0d10 0x7f6e78153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 --2- 172.21.15.82:0/3760845609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e780cf110 0x7f6e781524f0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 >> 172.21.15.82:0/3760845609 conn(0x7f6e7808c120 msgr2=0x7f6e7806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 shutdown_connections 2023-07-20T10:09:15.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.125+0000 7f6e7f288640 1 -- 172.21.15.82:0/3760845609 wait complete. 2023-07-20T10:09:15.120 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-07-20T10:09:15.121 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T10:09:15.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-07-20T10:09:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 Processor -- start 2023-07-20T10:09:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 -- start start 2023-07-20T10:09:15.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2f0c0b2060 0x7f2f0c0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0b06c0 con 0x7f2f0c0afda0 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b3160 con 0x7f2f0c0b2060 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f11427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b12a0 con 0x7f2f0c15a8e0 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2f0c0afda0 0x7f2f0c0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45726/0 (socket says 172.21.15.82:45726) 2023-07-20T10:09:15.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0affd640 1 -- 172.21.15.82:0/3927153322 learned_addr learned my addr 172.21.15.82:0/3927153322 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:15.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0b7fe640 1 --2- 172.21.15.82:0/3927153322 >> v2:172.21.15.82:3300/0 conn(0x7f2f0c0b2060 0x7f2f0c0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0a7fc640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f09ffb640 1 -- 172.21.15.82:0/3927153322 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023125559 0 0) 0x7f2f0c0b06c0 con 0x7f2f0c0afda0 2023-07-20T10:09:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f09ffb640 1 -- 172.21.15.82:0/3927153322 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef4003530 con 0x7f2f0c0afda0 2023-07-20T10:09:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0b7fe640 1 -- 172.21.15.82:0/3927153322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 msgr2=0x7f2f0c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0b7fe640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0b7fe640 1 -- 172.21.15.82:0/3927153322 >> v1:172.21.15.82:6789/0 conn(0x7f2f0c0afda0 legacy=0x7f2f0c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.285+0000 7f2f0b7fe640 1 -- 172.21.15.82:0/3927153322 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0b1580 con 0x7f2f0c0b2060 2023-07-20T10:09:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f0b7fe640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c0b0180 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009d90 tx=0x7f2f0401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25fb9f90bd8f122 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f09ffb640 1 -- 172.21.15.82:0/3927153322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040a58c0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f09ffb640 1 -- 172.21.15.82:0/3927153322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f040a5a20 con 0x7f2f0c0b2060 2023-07-20T10:09:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f09ffb640 1 -- 172.21.15.82:0/3927153322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040a5d90 con 0x7f2f0c0b2060 2023-07-20T10:09:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 -- 172.21.15.82:0/3927153322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 msgr2=0x7f2f0c0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c0b0180 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009d90 tx=0x7f2f0401c800 comp rx=0 tx=0).stop 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 -- 172.21.15.82:0/3927153322 shutdown_connections 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c0b0180 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 --2- 172.21.15.82:0/3927153322 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 -- 172.21.15.82:0/3927153322 >> 172.21.15.82:0/3927153322 conn(0x7f2f0c0cada0 msgr2=0x7f2f0c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 -- 172.21.15.82:0/3927153322 shutdown_connections 2023-07-20T10:09:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.289+0000 7f2f11427640 1 -- 172.21.15.82:0/3927153322 wait complete. 2023-07-20T10:09:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 Processor -- start 2023-07-20T10:09:15.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- start start 2023-07-20T10:09:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 0x7f2f0c1f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c155bc0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1f4df0 con 0x7f2f0c0afda0 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1f50d0 con 0x7f2f0c15a8e0 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32778/0 (socket says 172.21.15.82:32778) 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 -- 172.21.15.82:0/1910976583 learned_addr learned my addr 172.21.15.82:0/1910976583 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0affd640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 0x7f2f0c1f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0b7fe640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 -- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 msgr2=0x7f2f0c06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 -- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 msgr2=0x7f2f0c1f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 0x7f2f0c1f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 -- 172.21.15.82:0/1910976583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04009a70 con 0x7f2f0c0b2060 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0affd640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 0x7f2f0c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f0a7fc640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000d5f0 tx=0x7f2f0000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000125f0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00012750 con 0x7f2f0c0b2060 2023-07-20T10:09:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c1f53b0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00012ae0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c1f7e30 con 0x7f2f0c0b2060 2023-07-20T10:09:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.293+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c1f7ff0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.297+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2f00012c40 con 0x7f2f0c0b2060 2023-07-20T10:09:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.297+0000 7f2ef37fe640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 0x7f2ef8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.297+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f2f00084410 con 0x7f2f0c0b2060 2023-07-20T10:09:15.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.297+0000 7f2f0affd640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 0x7f2ef8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.297+0000 7f2f0affd640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 0x7f2ef8068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005890 tx=0x7f2efc009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:15.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.301+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f000516b0 con 0x7f2f0c0b2060 2023-07-20T10:09:15.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:15.497+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f2f0c073c70 con 0x7f2f0c0b2060 2023-07-20T10:09:16.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2ef37fe640 1 -- 172.21.15.82:0/1910976583 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v726) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2f00007380 con 0x7f2f0c0b2060 2023-07-20T10:09:16.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 msgr2=0x7f2ef8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 0x7f2ef8068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2efc005890 tx=0x7f2efc009040 comp rx=0 tx=0).stop 2023-07-20T10:09:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 msgr2=0x7f2f0c155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000d5f0 tx=0x7f2f0000dab0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 shutdown_connections 2023-07-20T10:09:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f2ef80663a0 0x7f2ef8068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2f0c15a8e0 0x7f2f0c06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f0c0b2060 0x7f2f0c155680 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 --2- 172.21.15.82:0/1910976583 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2f0c0afda0 0x7f2f0c1f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 >> 172.21.15.82:0/1910976583 conn(0x7f2f0c0cada0 msgr2=0x7f2f0c06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 shutdown_connections 2023-07-20T10:09:16.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.125+0000 7f2f11427640 1 -- 172.21.15.82:0/1910976583 wait complete. 2023-07-20T10:09:16.124 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:16.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 Processor -- start 2023-07-20T10:09:16.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 -- start start 2023-07-20T10:09:16.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d9815cab0 0x7f6d980d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d980ce4c0 0x7f6d980d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d980d16b0 con 0x7f6d980d0d10 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980d31c0 con 0x7f6d9815cab0 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d9ea34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d980b3520 con 0x7f6d980ce4c0 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d9815cab0 0x7f6d980d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d9815cab0 0x7f6d980d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32790/0 (socket says 172.21.15.82:32790) 2023-07-20T10:09:16.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 -- 172.21.15.82:0/1618585603 learned_addr learned my addr 172.21.15.82:0/1618585603 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:16.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 -- 172.21.15.82:0/1618585603 >> v2:172.21.15.183:3300/0 conn(0x7f6d980ce4c0 msgr2=0x7f6d980d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 --2- 172.21.15.82:0/1618585603 >> v2:172.21.15.183:3300/0 conn(0x7f6d980ce4c0 0x7f6d980d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 -- 172.21.15.82:0/1618585603 >> v1:172.21.15.183:6789/0 conn(0x7f6d980d0d10 legacy=0x7f6d980cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.289+0000 7f6d97fff640 1 -- 172.21.15.82:0/1618585603 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d980b2910 con 0x7f6d9815cab0 2023-07-20T10:09:16.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d97fff640 1 --2- 172.21.15.82:0/1618585603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9815cab0 0x7f6d980d0300 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f6d98071cd0 tx=0x7f6d8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a189d965bc1a7aba server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d96ffd640 1 -- 172.21.15.82:0/1618585603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880ac410 con 0x7f6d9815cab0 2023-07-20T10:09:16.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d96ffd640 1 -- 172.21.15.82:0/1618585603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880ac570 con 0x7f6d9815cab0 2023-07-20T10:09:16.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d96ffd640 1 -- 172.21.15.82:0/1618585603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880ac900 con 0x7f6d9815cab0 2023-07-20T10:09:16.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 -- 172.21.15.82:0/1618585603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9815cab0 msgr2=0x7f6d980d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/1618585603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9815cab0 0x7f6d980d0300 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f6d98071cd0 tx=0x7f6d8801c490 comp rx=0 tx=0).stop 2023-07-20T10:09:16.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 -- 172.21.15.82:0/1618585603 shutdown_connections 2023-07-20T10:09:16.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/1618585603 >> v2:172.21.15.183:3300/0 conn(0x7f6d980ce4c0 0x7f6d980d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/1618585603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d9815cab0 0x7f6d980d0300 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 -- 172.21.15.82:0/1618585603 >> 172.21.15.82:0/1618585603 conn(0x7f6d9808c120 msgr2=0x7f6d9809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 -- 172.21.15.82:0/1618585603 shutdown_connections 2023-07-20T10:09:16.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.293+0000 7f6d9ea34640 1 -- 172.21.15.82:0/1618585603 wait complete. 2023-07-20T10:09:16.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 Processor -- start 2023-07-20T10:09:16.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- start start 2023-07-20T10:09:16.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d980d0d10 0x7f6d980b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d98153f50 0x7f6d9815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b73b0 con 0x7f6d980ce4c0 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b6820 con 0x7f6d98153f50 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d980b62a0 con 0x7f6d980d0d10 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32796/0 (socket says 172.21.15.82:32796) 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 -- 172.21.15.82:0/3793913745 learned_addr learned my addr 172.21.15.82:0/3793913745 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d977fe640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d980d0d10 0x7f6d980b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9cfd1640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d98153f50 0x7f6d9815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 -- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d980d0d10 msgr2=0x7f6d980b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d980d0d10 0x7f6d980b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 -- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d98153f50 msgr2=0x7f6d9815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d98153f50 0x7f6d9815e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 -- 172.21.15.82:0/3793913745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d880094d0 con 0x7f6d980ce4c0 2023-07-20T10:09:16.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d97fff640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6d880af040 tx=0x7f6d88019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880acea0 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880b5630 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d980b6540 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880ac410 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d980b7040 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.297+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d98073c70 con 0x7f6d980ce4c0 2023-07-20T10:09:16.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.301+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6d880b3070 con 0x7f6d980ce4c0 2023-07-20T10:09:16.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.301+0000 7f6d94ff9640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 0x7f6d84068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.301+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f6d8811e580 con 0x7f6d980ce4c0 2023-07-20T10:09:16.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.301+0000 7f6d977fe640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 0x7f6d84068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.301+0000 7f6d977fe640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 0x7f6d84068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d980ccaa0 tx=0x7f6d8c009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.305+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d880eb840 con 0x7f6d980ce4c0 2023-07-20T10:09:16.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.453+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d980b3a70 con 0x7f6d980ce4c0 2023-07-20T10:09:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.453+0000 7f6d94ff9640 1 -- 172.21.15.82:0/3793913745 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+15924 (secure 0 0 0) 0x7f6d880eee60 con 0x7f6d980ce4c0 2023-07-20T10:09:16.431 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:16.431 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":129,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:13.108057+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/4045822955":"2023-07-21T10:09:09.791750+0000","172.21.15.82:0/3661222862":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2912998301":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3813052049":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3727649753":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/403722108":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6833/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:6832/2950283129":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/3207199541":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1237946915":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/2165152006":"2023-07-21T10:09:06.941500+0000","172.21.15.82:0/1193855226":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/1311622631":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6833/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6832/4046893014":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/467905236":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2263958707":"2023-07-21T10:08:41.941567+0000","172.21.15.82:0/2514495626":"2023-07-21T10:08:41.941567+0000","172.21.15.82:6836/4045822955":"2023-07-21T10:09:09.791750+0000","172.21.15.82:0/3151351148":"2023-07-21T10:08:41.941567+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 msgr2=0x7f6d84068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 0x7f6d84068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6d980ccaa0 tx=0x7f6d8c009040 comp rx=0 tx=0).stop 2023-07-20T10:09:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 msgr2=0x7f6d98158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6d880af040 tx=0x7f6d88019230 comp rx=0 tx=0).stop 2023-07-20T10:09:16.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 shutdown_connections 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6d840663a0 0x7f6d84068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d98153f50 0x7f6d9815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d980d0d10 0x7f6d980b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 --2- 172.21.15.82:0/3793913745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d980ce4c0 0x7f6d98158340 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 >> 172.21.15.82:0/3793913745 conn(0x7f6d9808c120 msgr2=0x7f6d9806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 shutdown_connections 2023-07-20T10:09:16.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.457+0000 7f6d9ea34640 1 -- 172.21.15.82:0/3793913745 wait complete. 2023-07-20T10:09:16.452 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:09:16.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:09:16.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.617+0000 7f6ef5767640 1 Processor -- start 2023-07-20T10:09:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.617+0000 7f6ef5767640 1 -- start start 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6ef5767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6ef015a6f0 0x7f6ef015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6ef5767640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef0071950 con 0x7f6ef006f710 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6ef5767640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef015b230 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6ef5767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef015bad0 con 0x7f6ef015a6f0 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eeeffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6ef006f710 0x7f6ef006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45738/0 (socket says 172.21.15.82:45738) 2023-07-20T10:09:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eeeffd640 1 -- 172.21.15.82:0/181104043 learned_addr learned my addr 172.21.15.82:0/181104043 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eef7fe640 1 --2- 172.21.15.82:0/181104043 >> v2:172.21.15.183:3300/0 conn(0x7f6ef015a6f0 0x7f6ef015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eee7fc640 1 -- 172.21.15.82:0/181104043 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770111080 0 0) 0x7f6ef0071950 con 0x7f6ef006f710 2023-07-20T10:09:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eee7fc640 1 -- 172.21.15.82:0/181104043 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6edc003530 con 0x7f6ef006f710 2023-07-20T10:09:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eef7fe640 1 -- 172.21.15.82:0/181104043 >> v1:172.21.15.183:6789/0 conn(0x7f6ef00ca5a0 legacy=0x7f6ef015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eef7fe640 1 -- 172.21.15.82:0/181104043 >> v1:172.21.15.82:6789/0 conn(0x7f6ef006f710 legacy=0x7f6ef006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.621+0000 7f6eef7fe640 1 -- 172.21.15.82:0/181104043 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef015b510 con 0x7f6ef015a6f0 2023-07-20T10:09:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6eef7fe640 1 --2- 172.21.15.82:0/181104043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef015a6f0 0x7f6ef015ab60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009dc0 tx=0x7f6ee801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893094a0841b7029 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6eee7fc640 1 -- 172.21.15.82:0/181104043 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80a59c0 con 0x7f6ef015a6f0 2023-07-20T10:09:16.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6eee7fc640 1 -- 172.21.15.82:0/181104043 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee80a5b20 con 0x7f6ef015a6f0 2023-07-20T10:09:16.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6eee7fc640 1 -- 172.21.15.82:0/181104043 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80a5e90 con 0x7f6ef015a6f0 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- 172.21.15.82:0/181104043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef015a6f0 msgr2=0x7f6ef015ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 --2- 172.21.15.82:0/181104043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef015a6f0 0x7f6ef015ab60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009dc0 tx=0x7f6ee801c900 comp rx=0 tx=0).stop 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- 172.21.15.82:0/181104043 shutdown_connections 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 --2- 172.21.15.82:0/181104043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef015a6f0 0x7f6ef015ab60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- 172.21.15.82:0/181104043 >> 172.21.15.82:0/181104043 conn(0x7f6ef00cad50 msgr2=0x7f6ef00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- 172.21.15.82:0/181104043 shutdown_connections 2023-07-20T10:09:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- 172.21.15.82:0/181104043 wait complete. 2023-07-20T10:09:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 Processor -- start 2023-07-20T10:09:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.625+0000 7f6ef5767640 1 -- start start 2023-07-20T10:09:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef006f710 0x7f6ef00c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ef015a6f0 0x7f6ef0154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef00c4610 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0153af0 con 0x7f6ef006f710 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef01540b0 con 0x7f6ef015a6f0 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6eef7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ef015a6f0 0x7f6ef0154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32812/0 (socket says 172.21.15.82:32812) 2023-07-20T10:09:16.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 -- 172.21.15.82:0/2637552786 learned_addr learned my addr 172.21.15.82:0/2637552786 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:16.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6eeeffd640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef006f710 0x7f6ef00c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 -- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ef015a6f0 msgr2=0x7f6ef0154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ef015a6f0 0x7f6ef0154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 -- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef006f710 msgr2=0x7f6ef00c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef006f710 0x7f6ef00c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 -- 172.21.15.82:0/2637552786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009a70 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee67fc640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c4d0 tx=0x7f6ed800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed80052d0 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed8005430 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef015d910 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8012830 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef00b38e0 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.629+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0154220 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.633+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ed8012990 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.633+0000 7f6ee7fff640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 0x7f6ed0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.633+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f6ed8083840 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.633+0000 7f6eeeffd640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 0x7f6ed0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.633+0000 7f6eeeffd640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 0x7f6ed0068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00011f0 tx=0x7f6ee0007d40 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.637+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ed8050c20 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.781+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ef00b3a70 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.781+0000 7f6ee7fff640 1 -- 172.21.15.82:0/2637552786 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ed8054240 con 0x7f6ef00ca5a0 2023-07-20T10:09:16.760 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:09:16.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 msgr2=0x7f6ed0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 0x7f6ed0068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00011f0 tx=0x7f6ee0007d40 comp rx=0 tx=0).stop 2023-07-20T10:09:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 msgr2=0x7f6ef00ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c4d0 tx=0x7f6ed800c990 comp rx=0 tx=0).stop 2023-07-20T10:09:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 shutdown_connections 2023-07-20T10:09:16.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f6ed00663a0 0x7f6ed0068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ef015a6f0 0x7f6ef0154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ef00ca5a0 0x7f6ef00ae0f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 --2- 172.21.15.82:0/2637552786 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ef006f710 0x7f6ef00c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 >> 172.21.15.82:0/2637552786 conn(0x7f6ef00cad50 msgr2=0x7f6ef00cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 shutdown_connections 2023-07-20T10:09:16.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.785+0000 7f6ef5767640 1 -- 172.21.15.82:0/2637552786 wait complete. 2023-07-20T10:09:16.780 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:09:16.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 Processor -- start 2023-07-20T10:09:16.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 -- start start 2023-07-20T10:09:16.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1ea4070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ea406b620 0x7f1ea406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40c95d0 con 0x7f1ea4158ce0 2023-07-20T10:09:16.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea4071310 con 0x7f1ea406b620 2023-07-20T10:09:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1eab703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea406bff0 con 0x7f1ea4070970 2023-07-20T10:09:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1ea949f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ea4158ce0 0x7f1ea40c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45752/0 (socket says 172.21.15.82:45752) 2023-07-20T10:09:16.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1ea949f640 1 -- 172.21.15.82:0/2428972045 learned_addr learned my addr 172.21.15.82:0/2428972045 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976320139 0 0) 0x7f1ea40c95d0 con 0x7f1ea4158ce0 2023-07-20T10:09:16.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1ea9ca0640 1 --2- 172.21.15.82:0/2428972045 >> v2:172.21.15.183:3300/0 conn(0x7f1ea406b620 0x7f1ea406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1ea4070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.945+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e90003530 con 0x7f1ea4158ce0 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2877274591 0 0) 0x7f1e90003530 con 0x7f1ea4158ce0 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 msgr2=0x7f1ea4070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1ea4070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 >> v2:172.21.15.183:3300/0 conn(0x7f1ea406b620 msgr2=0x7f1ea406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 --2- 172.21.15.82:0/2428972045 >> v2:172.21.15.183:3300/0 conn(0x7f1ea406b620 0x7f1ea406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea41590c0 con 0x7f1ea4158ce0 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f1ea0001680 con 0x7f1ea4158ce0 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 >> v1:172.21.15.82:6789/0 conn(0x7f1ea4158ce0 legacy=0x7f1ea40c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e900039f0 0x7f1e90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1e900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4071310 con 0x7f1e900039f0 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea406bff0 con 0x7f1e90004d10 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9000dba0 con 0x7f1ea4070970 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1e900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea9ca0640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea949f640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e900039f0 0x7f1e90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e90004d10 msgr2=0x7f1e90005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1e90004d10 0x7f1e90005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/2428972045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e900039f0 msgr2=0x7f1e90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:16.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e900039f0 0x7f1e90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/2428972045 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90003530 con 0x7f1ea4070970 2023-07-20T10:09:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.949+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1e900047d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009ae0 tx=0x7f1e9401ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7257627b44a967bb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940a64d0 con 0x7f1ea4070970 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e940a6630 con 0x7f1ea4070970 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1e9bfff640 1 -- 172.21.15.82:0/2428972045 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940a69e0 con 0x7f1ea4070970 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 msgr2=0x7f1e900047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 --2- 172.21.15.82:0/2428972045 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea4070970 0x7f1e900047d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1e94009ae0 tx=0x7f1e9401ca60 comp rx=0 tx=0).stop 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1ea9ca0640 1 -- 172.21.15.82:0/2428972045 reap_dead start 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- 172.21.15.82:0/2428972045 shutdown_connections 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- 172.21.15.82:0/2428972045 >> 172.21.15.82:0/2428972045 conn(0x7f1ea40cad50 msgr2=0x7f1ea40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- 172.21.15.82:0/2428972045 shutdown_connections 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- 172.21.15.82:0/2428972045 wait complete. 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 Processor -- start 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 -- start start 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea4070970 0x7f1ea40c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.953+0000 7f1eab703640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea415e890 0x7f1ea414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40c8350 con 0x7f1ea415e410 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b1b40 con 0x7f1ea4070970 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40b1e20 con 0x7f1ea415e890 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea949f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea4070970 0x7f1ea40c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32840/0 (socket says 172.21.15.82:32840) 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/854994375 learned_addr learned my addr 172.21.15.82:0/854994375 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea9ca0640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea415e890 0x7f1ea414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea415e890 msgr2=0x7f1ea414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea415e890 0x7f1ea414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea4070970 msgr2=0x7f1ea40c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea4070970 0x7f1ea40c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 -- 172.21.15.82:0/854994375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40b2100 con 0x7f1ea415e410 2023-07-20T10:09:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1ea8c9e640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b0040 tx=0x7f1e90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940bf070 con 0x7f1ea415e410 2023-07-20T10:09:16.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400f0c0 con 0x7f1ea415e410 2023-07-20T10:09:16.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e940a69c0 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea40b23e0 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea40c7a50 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea404da30 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.957+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1e940a6b20 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.961+0000 7f1e99ffb640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 0x7f1e88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.961+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f1e940aa070 con 0x7f1ea415e410 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.961+0000 7f1ea949f640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 0x7f1e88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.961+0000 7f1ea949f640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 0x7f1e88068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0001c00 tx=0x7f1ea0001de0 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:16.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:16.965+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e940eb880 con 0x7f1ea415e410 2023-07-20T10:09:17.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.109+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ea40ad830 con 0x7f1ea415e410 2023-07-20T10:09:17.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.109+0000 7f1e99ffb640 1 -- 172.21.15.82:0/854994375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e940eeea0 con 0x7f1ea415e410 2023-07-20T10:09:17.087 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:09:17.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 msgr2=0x7f1e88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 0x7f1e88068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0001c00 tx=0x7f1ea0001de0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 msgr2=0x7f1ea414b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b0040 tx=0x7f1e90005800 comp rx=0 tx=0).stop 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 shutdown_connections 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f1e88066390 0x7f1e88068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ea415e890 0x7f1ea414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ea415e410 0x7f1ea414b3a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 --2- 172.21.15.82:0/854994375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ea4070970 0x7f1ea40c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 >> 172.21.15.82:0/854994375 conn(0x7f1ea40cad50 msgr2=0x7f1ea415f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:17.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 shutdown_connections 2023-07-20T10:09:17.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.113+0000 7f1eab703640 1 -- 172.21.15.82:0/854994375 wait complete. 2023-07-20T10:09:17.109 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T10:09:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.273+0000 7fce5303a640 1 Processor -- start 2023-07-20T10:09:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.273+0000 7fce5303a640 1 -- start start 2023-07-20T10:09:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fce4c159290 0x7fce4c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0cd770 0x7fce4c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce4c0c9da0 0x7fce4c06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0ca220 con 0x7fce4c0c9da0 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c070990 con 0x7fce4c159290 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce5303a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c159670 con 0x7fce4c0cd770 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce4c0c9da0 0x7fce4c06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce4c0c9da0 0x7fce4c06ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32848/0 (socket says 172.21.15.82:32848) 2023-07-20T10:09:17.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 -- 172.21.15.82:0/4088707386 learned_addr learned my addr 172.21.15.82:0/4088707386 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:17.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52038640 1 --2- 172.21.15.82:0/4088707386 >> v2:172.21.15.183:3300/0 conn(0x7fce4c159290 0x7fce4c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce51837640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0cd770 0x7fce4c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 -- 172.21.15.82:0/4088707386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0cd770 msgr2=0x7fce4c0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:17.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0cd770 0x7fce4c0c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 -- 172.21.15.82:0/4088707386 >> v2:172.21.15.183:3300/0 conn(0x7fce4c159290 msgr2=0x7fce4c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:17.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 --2- 172.21.15.82:0/4088707386 >> v2:172.21.15.183:3300/0 conn(0x7fce4c159290 0x7fce4c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.277+0000 7fce52839640 1 -- 172.21.15.82:0/4088707386 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c15d1f0 con 0x7fce4c0c9da0 2023-07-20T10:09:17.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce52839640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c0c9da0 0x7fce4c06ba50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0734d0 tx=0x7fce4401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1de97c432303b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce51036640 1 -- 172.21.15.82:0/4088707386 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440a5700 con 0x7fce4c0c9da0 2023-07-20T10:09:17.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce51036640 1 -- 172.21.15.82:0/4088707386 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440a5860 con 0x7fce4c0c9da0 2023-07-20T10:09:17.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce51036640 1 -- 172.21.15.82:0/4088707386 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440a5bf0 con 0x7fce4c0c9da0 2023-07-20T10:09:17.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- 172.21.15.82:0/4088707386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c0c9da0 msgr2=0x7fce4c06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c0c9da0 0x7fce4c06ba50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0734d0 tx=0x7fce4401c880 comp rx=0 tx=0).stop 2023-07-20T10:09:17.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- 172.21.15.82:0/4088707386 shutdown_connections 2023-07-20T10:09:17.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c0c9da0 0x7fce4c06ba50 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 --2- 172.21.15.82:0/4088707386 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0cd770 0x7fce4c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 --2- 172.21.15.82:0/4088707386 >> v2:172.21.15.183:3300/0 conn(0x7fce4c159290 0x7fce4c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- 172.21.15.82:0/4088707386 >> 172.21.15.82:0/4088707386 conn(0x7fce4c0ce080 msgr2=0x7fce4c0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- 172.21.15.82:0/4088707386 shutdown_connections 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- 172.21.15.82:0/4088707386 wait complete. 2023-07-20T10:09:17.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 Processor -- start 2023-07-20T10:09:17.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.281+0000 7fce5303a640 1 -- start start 2023-07-20T10:09:17.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 0x7fce4c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 0x7fce4c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c15c540 con 0x7fce4c159290 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c15af60 con 0x7fce4c0cd770 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c15b240 con 0x7fce4c0c9da0 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32852/0 (socket says 172.21.15.82:32852) 2023-07-20T10:09:17.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 -- 172.21.15.82:0/3157885097 learned_addr learned my addr 172.21.15.82:0/3157885097 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52038640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 0x7fce4c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce51837640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 0x7fce4c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 -- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 msgr2=0x7fce4c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 0x7fce4c157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 -- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 msgr2=0x7fce4c15c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 0x7fce4c15c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 -- 172.21.15.82:0/3157885097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44009b30 con 0x7fce4c159290 2023-07-20T10:09:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52038640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 0x7fce4c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce51837640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 0x7fce4c15c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce52839640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fce440af040 tx=0x7fce44019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440b8670 con 0x7fce4c159290 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440b87f0 con 0x7fce4c159290 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440b8ba0 con 0x7fce4c159290 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c15b520 con 0x7fce4c159290 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c15bae0 con 0x7fce4c159290 2023-07-20T10:09:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c04da30 con 0x7fce4c159290 2023-07-20T10:09:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.285+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce440b8d00 con 0x7fce4c159290 2023-07-20T10:09:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.289+0000 7fce42ffd640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 0x7fce30068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.289+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fce4411f3e0 con 0x7fce4c159290 2023-07-20T10:09:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.289+0000 7fce52038640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 0x7fce30068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.289+0000 7fce52038640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 0x7fce30068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce48007a70 tx=0x7fce48008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.293+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce440ec7c0 con 0x7fce4c159290 2023-07-20T10:09:17.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.437+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fce4c15b380 con 0x7fce4c159290 2023-07-20T10:09:17.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce42ffd640 1 -- 172.21.15.82:0/3157885097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7fce4c15b380 con 0x7fce4c159290 2023-07-20T10:09:17.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 msgr2=0x7fce30068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 0x7fce30068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fce48007a70 tx=0x7fce48008040 comp rx=0 tx=0).stop 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 msgr2=0x7fce4c1568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fce440af040 tx=0x7fce44019620 comp rx=0 tx=0).stop 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 shutdown_connections 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fce300663a0 0x7fce30068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce4c159290 0x7fce4c1568b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce4c0cd770 0x7fce4c15c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 --2- 172.21.15.82:0/3157885097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce4c0c9da0 0x7fce4c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 >> 172.21.15.82:0/3157885097 conn(0x7fce4c0ce080 msgr2=0x7fce4c0b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:17.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 shutdown_connections 2023-07-20T10:09:17.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.445+0000 7fce5303a640 1 -- 172.21.15.82:0/3157885097 wait complete. 2023-07-20T10:09:17.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T10:09:17.444 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:09:17.494 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T10:09:17.540 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T10:09:17.541 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:17.541 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:17.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:09:17.550 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:09:17.551 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:17.595 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:09:17.595 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:17.596 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:17.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T10:09:17.604 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T10:09:17.605 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:17.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T10:09:17.650 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T10:09:17.651 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:17.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 Processor -- start 2023-07-20T10:09:17.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 -- start start 2023-07-20T10:09:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f784c0d1170 0x7f784c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0b3520 con 0x7f784c15cab0 2023-07-20T10:09:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0d0a10 con 0x7f784c0d0d10 2023-07-20T10:09:17.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7853cbd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0d31c0 con 0x7f784c0d1170 2023-07-20T10:09:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7851a59640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f784c15cab0 0x7f784c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45756/0 (socket says 172.21.15.82:45756) 2023-07-20T10:09:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7851a59640 1 -- 172.21.15.82:0/1903140937 learned_addr learned my addr 172.21.15.82:0/1903140937 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:17.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f785225a640 1 --2- 172.21.15.82:0/1903140937 >> v2:172.21.15.82:3300/0 conn(0x7f784c0d1170 0x7f784c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7850a57640 1 -- 172.21.15.82:0/1903140937 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699736828 0 0) 0x7f784c0b3520 con 0x7f784c15cab0 2023-07-20T10:09:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f7850a57640 1 -- 172.21.15.82:0/1903140937 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7838003530 con 0x7f784c15cab0 2023-07-20T10:09:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f785225a640 1 -- 172.21.15.82:0/1903140937 >> v1:172.21.15.183:6789/0 conn(0x7f784c0d0d10 legacy=0x7f784c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f785225a640 1 -- 172.21.15.82:0/1903140937 >> v1:172.21.15.82:6789/0 conn(0x7f784c15cab0 legacy=0x7f784c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.813+0000 7f785225a640 1 -- 172.21.15.82:0/1903140937 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0b2910 con 0x7f784c0d1170 2023-07-20T10:09:17.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f785225a640 1 --2- 172.21.15.82:0/1903140937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c0cdbc0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f78440097c0 tx=0x7f784401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c9416868a6d0b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7850a57640 1 -- 172.21.15.82:0/1903140937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440ac410 con 0x7f784c0d1170 2023-07-20T10:09:17.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7850a57640 1 -- 172.21.15.82:0/1903140937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78440ac570 con 0x7f784c0d1170 2023-07-20T10:09:17.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7850a57640 1 -- 172.21.15.82:0/1903140937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440ac8e0 con 0x7f784c0d1170 2023-07-20T10:09:17.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 -- 172.21.15.82:0/1903140937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 msgr2=0x7f784c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 --2- 172.21.15.82:0/1903140937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c0cdbc0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f78440097c0 tx=0x7f784401c420 comp rx=0 tx=0).stop 2023-07-20T10:09:17.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 -- 172.21.15.82:0/1903140937 shutdown_connections 2023-07-20T10:09:17.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 --2- 172.21.15.82:0/1903140937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c0cdbc0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 -- 172.21.15.82:0/1903140937 >> 172.21.15.82:0/1903140937 conn(0x7f784c08c120 msgr2=0x7f784c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:17.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 -- 172.21.15.82:0/1903140937 shutdown_connections 2023-07-20T10:09:17.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.817+0000 7f7853cbd640 1 -- 172.21.15.82:0/1903140937 wait complete. 2023-07-20T10:09:17.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 Processor -- start 2023-07-20T10:09:17.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- start start 2023-07-20T10:09:17.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f784c0d0d10 0x7f784c154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 0x7f784c0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c15fd50 con 0x7f784c0d1170 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0cbf10 con 0x7f784c15cab0 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c15f700 con 0x7f784c0d0d10 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32874/0 (socket says 172.21.15.82:32874) 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 -- 172.21.15.82:0/657061114 learned_addr learned my addr 172.21.15.82:0/657061114 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:17.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f785225a640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 0x7f784c0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851a59640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f784c0d0d10 0x7f784c154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 -- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f784c0d0d10 msgr2=0x7f784c154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f784c0d0d10 0x7f784c154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 -- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 msgr2=0x7f784c0c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 0x7f784c0c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 -- 172.21.15.82:0/657061114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844009420 con 0x7f784c0d1170 2023-07-20T10:09:17.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f785225a640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 0x7f784c0c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7851258640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c3c0 tx=0x7f783c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0052d0 con 0x7f784c0d1170 2023-07-20T10:09:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c005430 con 0x7f784c0d1170 2023-07-20T10:09:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c15f9e0 con 0x7f784c0d1170 2023-07-20T10:09:17.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c003840 con 0x7f784c0d1170 2023-07-20T10:09:17.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c0d3590 con 0x7f784c0d1170 2023-07-20T10:09:17.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.821+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c073c70 con 0x7f784c0d1170 2023-07-20T10:09:17.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.825+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f783c0039a0 con 0x7f784c0d1170 2023-07-20T10:09:17.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.825+0000 7f78427fc640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 0x7f7830068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.825+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f783c083490 con 0x7f784c0d1170 2023-07-20T10:09:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.825+0000 7f7851a59640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 0x7f7830068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:17.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.825+0000 7f7851a59640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 0x7f7830068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7848001570 tx=0x7f7848009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:17.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:17.829+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f783c050730 con 0x7f784c0d1170 2023-07-20T10:09:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f784c0cc0d0 con 0x7f784c0d1170 2023-07-20T10:09:17.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f78427fc640 1 -- 172.21.15.82:0/657061114 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f783c017de0 con 0x7f784c0d1170 2023-07-20T10:09:17.985 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:17.985 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2736406156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2736406156},{"type":"v1","addr":"172.21.15.183:6833","nonce":2736406156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7055,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4038779637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4038779637},{"type":"v1","addr":"172.21.15.183:6835","nonce":4038779637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/1560559283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1560559283},{"type":"v1","addr":"172.21.15.82:6835","nonce":1560559283}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":8892,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/381239047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":381239047},{"type":"v1","addr":"172.21.15.82:6837","nonce":381239047}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-07-20T10:09:17.985 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 59 2023-07-20T10:09:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 msgr2=0x7f7830068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 0x7f7830068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7848001570 tx=0x7f7848009040 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 msgr2=0x7f784c153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c3c0 tx=0x7f783c00c880 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 shutdown_connections 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f78300663a0 0x7f7830068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f784c15cab0 0x7f784c0c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f784c0d1170 0x7f784c153ab0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 --2- 172.21.15.82:0/657061114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f784c0d0d10 0x7f784c154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:17.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 >> 172.21.15.82:0/657061114 conn(0x7f784c08c120 msgr2=0x7f784c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 shutdown_connections 2023-07-20T10:09:17.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.009+0000 7f7853cbd640 1 -- 172.21.15.82:0/657061114 wait complete. 2023-07-20T10:09:18.005 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T10:09:18.005 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T10:09:18.006 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T10:09:18.006 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:09:18.006 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T10:09:18.006 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T10:09:18.007 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T10:09:18.007 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:09:18.007 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T10:09:18.007 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T10:09:18.008 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T10:09:18.008 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:09:18.008 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T10:09:18.008 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T10:09:18.008 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T10:09:18.009 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T10:09:18.017 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T10:09:18.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T10:09:18.019 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T10:09:18.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T10:09:18.023 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T10:09:18.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T10:09:18.024 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T10:09:18.024 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T10:09:18.062 INFO:tasks.ceph.mds.a:Started 2023-07-20T10:09:18.062 DEBUG:teuthology.parallel:result is None 2023-07-20T10:09:18.065 INFO:tasks.ceph.mds.c:Started 2023-07-20T10:09:18.065 DEBUG:teuthology.parallel:result is None 2023-07-20T10:09:18.069 INFO:tasks.ceph.mds.b:Started 2023-07-20T10:09:18.069 DEBUG:teuthology.parallel:result is None 2023-07-20T10:09:18.071 INFO:tasks.ceph.mds.d:Started 2023-07-20T10:09:18.072 DEBUG:teuthology.parallel:result is None 2023-07-20T10:09:18.072 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T10:09:18.153 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T10:09:18.153 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T10:09:18.154 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T10:09:18.177+0000 7f43c7fe6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-20T10:09:18.168 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T10:09:18.168 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T10:09:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 Processor -- start 2023-07-20T10:09:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 -- start start 2023-07-20T10:09:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99201596b0 0x7f992015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99200b2a90 0x7f99200ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200ccd90 con 0x7f99200cc900 2023-07-20T10:09:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200ad600 con 0x7f99201596b0 2023-07-20T10:09:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9927bdb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200ad810 con 0x7f99200b2a90 2023-07-20T10:09:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99201596b0 0x7f992015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f99201596b0 0x7f992015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32914/0 (socket says 172.21.15.82:32914) 2023-07-20T10:09:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 -- 172.21.15.82:0/2518152046 learned_addr learned my addr 172.21.15.82:0/2518152046 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9926178640 1 --2- 172.21.15.82:0/2518152046 >> v2:172.21.15.183:3300/0 conn(0x7f99200b2a90 0x7f99200ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 -- 172.21.15.82:0/2518152046 >> v2:172.21.15.183:3300/0 conn(0x7f99200b2a90 msgr2=0x7f99200ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 --2- 172.21.15.82:0/2518152046 >> v2:172.21.15.183:3300/0 conn(0x7f99200b2a90 0x7f99200ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 -- 172.21.15.82:0/2518152046 >> v1:172.21.15.183:6789/0 conn(0x7f99200cc900 legacy=0x7f99200b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.245+0000 7f9925977640 1 -- 172.21.15.82:0/2518152046 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992015d0d0 con 0x7f99201596b0 2023-07-20T10:09:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9925977640 1 --2- 172.21.15.82:0/2518152046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f992015dbb0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f991c009870 tx=0x7f991c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af76fc489b88bac server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9924975640 1 -- 172.21.15.82:0/2518152046 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0aa430 con 0x7f99201596b0 2023-07-20T10:09:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9924975640 1 -- 172.21.15.82:0/2518152046 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0aa590 con 0x7f99201596b0 2023-07-20T10:09:18.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9924975640 1 -- 172.21.15.82:0/2518152046 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0aa920 con 0x7f99201596b0 2023-07-20T10:09:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 -- 172.21.15.82:0/2518152046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 msgr2=0x7f992015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 --2- 172.21.15.82:0/2518152046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f992015dbb0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f991c009870 tx=0x7f991c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 -- 172.21.15.82:0/2518152046 shutdown_connections 2023-07-20T10:09:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 --2- 172.21.15.82:0/2518152046 >> v2:172.21.15.183:3300/0 conn(0x7f99200b2a90 0x7f99200ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 --2- 172.21.15.82:0/2518152046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f992015dbb0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 -- 172.21.15.82:0/2518152046 >> 172.21.15.82:0/2518152046 conn(0x7f99200cada0 msgr2=0x7f99200cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 -- 172.21.15.82:0/2518152046 shutdown_connections 2023-07-20T10:09:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.249+0000 7f9927bdb640 1 -- 172.21.15.82:0/2518152046 wait complete. 2023-07-20T10:09:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 Processor -- start 2023-07-20T10:09:18.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 -- start start 2023-07-20T10:09:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99200cc900 0x7f99200b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f99200b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920148f70 con 0x7f99201596b0 2023-07-20T10:09:18.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c4d20 con 0x7f99200b2a90 2023-07-20T10:09:18.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9927bdb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c3740 con 0x7f99200cc900 2023-07-20T10:09:18.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9926178640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f99200b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:33258/0 (socket says 172.21.15.82:33258) 2023-07-20T10:09:18.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 -- 172.21.15.82:0/1165442572 learned_addr learned my addr 172.21.15.82:0/1165442572 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925176640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99200cc900 0x7f99200b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 -- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99200cc900 msgr2=0x7f99200b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99200cc900 0x7f99200b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 -- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 msgr2=0x7f99200b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f99200b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 -- 172.21.15.82:0/1165442572 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0094d0 con 0x7f99200b2a90 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9926178640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f99200b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:18.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.253+0000 7f9925977640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f991c0190e0 tx=0x7f991c01ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0aa430 con 0x7f99200b2a90 2023-07-20T10:09:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0b3820 con 0x7f99200b2a90 2023-07-20T10:09:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0b3bd0 con 0x7f99200b2a90 2023-07-20T10:09:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200c3a20 con 0x7f99200b2a90 2023-07-20T10:09:18.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200c3fe0 con 0x7f99200b2a90 2023-07-20T10:09:18.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920073c70 con 0x7f99200b2a90 2023-07-20T10:09:18.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f991c0b3d30 con 0x7f99200b2a90 2023-07-20T10:09:18.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 0x7f9904068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:18.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f991c11e670 con 0x7f99200b2a90 2023-07-20T10:09:18.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f9925176640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 0x7f9904068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.257+0000 7f9925176640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 0x7f9904068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99200b1bb0 tx=0x7f9910009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.261+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f991c0eb930 con 0x7f99200b2a90 2023-07-20T10:09:18.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:18.417+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f99200c56a0 con 0x7f99200b2a90 2023-07-20T10:09:19.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.149+0000 7f99167fc640 1 -- 172.21.15.82:0/1165442572 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f991c0eef50 con 0x7f99200b2a90 2023-07-20T10:09:19.128 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T10:09:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 msgr2=0x7f9904068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 0x7f9904068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99200b1bb0 tx=0x7f9910009040 comp rx=0 tx=0).stop 2023-07-20T10:09:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 msgr2=0x7f99200c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f991c0190e0 tx=0x7f991c01ad10 comp rx=0 tx=0).stop 2023-07-20T10:09:19.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 shutdown_connections 2023-07-20T10:09:19.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f99040663d0 0x7f9904068890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99201596b0 0x7f99200b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99200cc900 0x7f99200b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 --2- 172.21.15.82:0/1165442572 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99200b2a90 0x7f99200c47e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 >> 172.21.15.82:0/1165442572 conn(0x7f99200cada0 msgr2=0x7f9920071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:19.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 shutdown_connections 2023-07-20T10:09:19.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.153+0000 7f9927bdb640 1 -- 172.21.15.82:0/1165442572 wait complete. 2023-07-20T10:09:19.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T10:09:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 Processor -- start 2023-07-20T10:09:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 -- start start 2023-07-20T10:09:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f50d815d440 0x7f50d806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d8070660 con 0x7f50d815d060 2023-07-20T10:09:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80cd490 con 0x7f50d80c86d0 2023-07-20T10:09:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dd5a9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80ca6f0 con 0x7f50d815d440 2023-07-20T10:09:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50d7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f50d815d060 0x7f50d8070b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45770/0 (socket says 172.21.15.82:45770) 2023-07-20T10:09:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50d7fff640 1 -- 172.21.15.82:0/2064872035 learned_addr learned my addr 172.21.15.82:0/2064872035 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dcda8640 1 --2- 172.21.15.82:0/2064872035 >> v2:172.21.15.82:3300/0 conn(0x7f50d815d440 0x7f50d806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dcda8640 1 -- 172.21.15.82:0/2064872035 >> v1:172.21.15.183:6789/0 conn(0x7f50d80c86d0 legacy=0x7f50d8071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dcda8640 1 -- 172.21.15.82:0/2064872035 >> v1:172.21.15.82:6789/0 conn(0x7f50d815d060 legacy=0x7f50d8070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50dcda8640 1 -- 172.21.15.82:0/2064872035 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80cd770 con 0x7f50d815d440 2023-07-20T10:09:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.321+0000 7f50d6ffd640 1 -- 172.21.15.82:0/2064872035 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469435675 0 0) 0x7f50d8070660 con 0x7f50d815d060 2023-07-20T10:09:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dcda8640 1 --2- 172.21.15.82:0/2064872035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d440 0x7f50d806c3d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009d90 tx=0x7f50d001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee2786711179c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50d6ffd640 1 -- 172.21.15.82:0/2064872035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00a59e0 con 0x7f50d815d440 2023-07-20T10:09:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50d6ffd640 1 -- 172.21.15.82:0/2064872035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d00a5b40 con 0x7f50d815d440 2023-07-20T10:09:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50d6ffd640 1 -- 172.21.15.82:0/2064872035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d00ad440 con 0x7f50d815d440 2023-07-20T10:09:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 -- 172.21.15.82:0/2064872035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d440 msgr2=0x7f50d806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/2064872035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d440 0x7f50d806c3d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009d90 tx=0x7f50d001c920 comp rx=0 tx=0).stop 2023-07-20T10:09:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 -- 172.21.15.82:0/2064872035 shutdown_connections 2023-07-20T10:09:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/2064872035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d440 0x7f50d806c3d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 -- 172.21.15.82:0/2064872035 >> 172.21.15.82:0/2064872035 conn(0x7f50d80ce080 msgr2=0x7f50d80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 -- 172.21.15.82:0/2064872035 shutdown_connections 2023-07-20T10:09:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 -- 172.21.15.82:0/2064872035 wait complete. 2023-07-20T10:09:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.325+0000 7f50dd5a9640 1 Processor -- start 2023-07-20T10:09:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- start start 2023-07-20T10:09:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d80c86d0 0x7f50d81f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d815d440 0x7f50d80c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c64b0 con 0x7f50d815d060 2023-07-20T10:09:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c39d0 con 0x7f50d80c86d0 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80c3cb0 con 0x7f50d815d440 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32954/0 (socket says 172.21.15.82:32954) 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 -- 172.21.15.82:0/1640799901 learned_addr learned my addr 172.21.15.82:0/1640799901 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d7fff640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d80c86d0 0x7f50d81f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dcda8640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d815d440 0x7f50d80c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 -- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d815d440 msgr2=0x7f50d80c7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d815d440 0x7f50d80c7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 -- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d80c86d0 msgr2=0x7f50d81f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d80c86d0 0x7f50d81f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 -- 172.21.15.82:0/1640799901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009a70 con 0x7f50d815d060 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d77fe640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c3c0 tx=0x7f50cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0052d0 con 0x7f50d815d060 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc005430 con 0x7f50d815d060 2023-07-20T10:09:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc003840 con 0x7f50d815d060 2023-07-20T10:09:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d80c3f90 con 0x7f50d815d060 2023-07-20T10:09:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80c4550 con 0x7f50d815d060 2023-07-20T10:09:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.329+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80c4770 con 0x7f50d815d060 2023-07-20T10:09:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.333+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50cc0039a0 con 0x7f50d815d060 2023-07-20T10:09:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.333+0000 7f50d4ff9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 0x7f50c4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.333+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f50cc083070 con 0x7f50d815d060 2023-07-20T10:09:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.333+0000 7f50d7fff640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 0x7f50c4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.333+0000 7f50d7fff640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 0x7f50c4068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000f70 tx=0x7f50c8007240 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.337+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50cc0b3700 con 0x7f50d815d060 2023-07-20T10:09:19.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f50d804da30 con 0x7f50d815d060 2023-07-20T10:09:19.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50d4ff9640 1 -- 172.21.15.82:0/1640799901 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f50cc050720 con 0x7f50d815d060 2023-07-20T10:09:19.517 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:19.517 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:09:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T10:09:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.518 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T10:09:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T10:09:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.519 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:09:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:09:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T10:09:19.521 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T10:09:19.522 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.522 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.522 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:09:19.522 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:09:19.523 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.524 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T10:09:19.524 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T10:09:19.524 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.525 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.525 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:09:19.525 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:09:19.525 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.526 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.527 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T10:09:19.527 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T10:09:19.527 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.527 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.528 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:09:19.528 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:09:19.528 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.528 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.529 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T10:09:19.530 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T10:09:19.530 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.530 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.530 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.531 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.531 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.533 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T10:09:19.534 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.535 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.537 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.538 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.540 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.541 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T10:09:19.541 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T10:09:19.542 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.542 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T10:09:19.542 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T10:09:19.542 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.542 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.543 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T10:09:19.544 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:09:19.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:09:19.546 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T10:09:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T10:09:19.548 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:09:19.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T10:09:19.550 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:19.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T10:09:19.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T10:09:19.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.553 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:19.553 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T10:09:19.553 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:09:19.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 msgr2=0x7f50c4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 0x7f50c4068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000f70 tx=0x7f50c8007240 comp rx=0 tx=0).stop 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 msgr2=0x7f50d80c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c3c0 tx=0x7f50cc00c880 comp rx=0 tx=0).stop 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 shutdown_connections 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f50c40663a0 0x7f50c4068860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f50d815d440 0x7f50d80c7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50d815d060 0x7f50d80c6d40 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 --2- 172.21.15.82:0/1640799901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50d80c86d0 0x7f50d81f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 >> 172.21.15.82:0/1640799901 conn(0x7f50d80ce080 msgr2=0x7f50d806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:19.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 shutdown_connections 2023-07-20T10:09:19.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.541+0000 7f50dd5a9640 1 -- 172.21.15.82:0/1640799901 wait complete. 2023-07-20T10:09:19.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:19.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.717+0000 7f4e19940640 1 Processor -- start 2023-07-20T10:09:19.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.717+0000 7f4e19940640 1 -- start start 2023-07-20T10:09:19.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e19940640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 0x7f4e1415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e19940640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4e140b1170 0x7f4e140b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e19940640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e140cde70 con 0x7f4e140ca040 2023-07-20T10:09:19.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e19940640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140cbef0 con 0x7f4e140b1170 2023-07-20T10:09:19.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e19940640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140ca420 con 0x7f4e140ad060 2023-07-20T10:09:19.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e12ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4e140ca040 0x7f4e1415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45786/0 (socket says 172.21.15.82:45786) 2023-07-20T10:09:19.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e12ffd640 1 -- 172.21.15.82:0/4225821355 learned_addr learned my addr 172.21.15.82:0/4225821355 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e137fe640 1 --2- 172.21.15.82:0/4225821355 >> v2:172.21.15.82:3300/0 conn(0x7f4e140b1170 0x7f4e140b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e127fc640 1 --2- 172.21.15.82:0/4225821355 >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 0x7f4e1415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e11ffb640 1 -- 172.21.15.82:0/4225821355 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871879247 0 0) 0x7f4e140cde70 con 0x7f4e140ca040 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e11ffb640 1 -- 172.21.15.82:0/4225821355 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dfc003530 con 0x7f4e140ca040 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e137fe640 1 -- 172.21.15.82:0/4225821355 >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 msgr2=0x7f4e1415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e137fe640 1 --2- 172.21.15.82:0/4225821355 >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 0x7f4e1415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e137fe640 1 -- 172.21.15.82:0/4225821355 >> v1:172.21.15.82:6789/0 conn(0x7f4e140ca040 legacy=0x7f4e1415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e137fe640 1 -- 172.21.15.82:0/4225821355 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140cdb40 con 0x7f4e140b1170 2023-07-20T10:09:19.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.721+0000 7f4e127fc640 1 --2- 172.21.15.82:0/4225821355 >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 0x7f4e1415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:19.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e137fe640 1 --2- 172.21.15.82:0/4225821355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140b1170 0x7f4e140b1600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4e14068d50 tx=0x7f4e0c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bf5edc2cddbf97 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e11ffb640 1 -- 172.21.15.82:0/4225821355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0ab600 con 0x7f4e140b1170 2023-07-20T10:09:19.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e11ffb640 1 -- 172.21.15.82:0/4225821355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0a7050 con 0x7f4e140b1170 2023-07-20T10:09:19.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e11ffb640 1 -- 172.21.15.82:0/4225821355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0ab980 con 0x7f4e140b1170 2023-07-20T10:09:19.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- 172.21.15.82:0/4225821355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140b1170 msgr2=0x7f4e140b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 --2- 172.21.15.82:0/4225821355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140b1170 0x7f4e140b1600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f4e14068d50 tx=0x7f4e0c01c430 comp rx=0 tx=0).stop 2023-07-20T10:09:19.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- 172.21.15.82:0/4225821355 shutdown_connections 2023-07-20T10:09:19.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 --2- 172.21.15.82:0/4225821355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140b1170 0x7f4e140b1600 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 --2- 172.21.15.82:0/4225821355 >> v2:172.21.15.183:3300/0 conn(0x7f4e140ad060 0x7f4e1415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- 172.21.15.82:0/4225821355 >> 172.21.15.82:0/4225821355 conn(0x7f4e140cada0 msgr2=0x7f4e140cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:19.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- 172.21.15.82:0/4225821355 shutdown_connections 2023-07-20T10:09:19.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- 172.21.15.82:0/4225821355 wait complete. 2023-07-20T10:09:19.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 Processor -- start 2023-07-20T10:09:19.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 -- start start 2023-07-20T10:09:19.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.725+0000 7f4e19940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e140ad060 0x7f4e140ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 0x7f4e14070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140ae2d0 con 0x7f4e140ca040 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140af520 con 0x7f4e140b1170 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140af800 con 0x7f4e140ad060 2023-07-20T10:09:19.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32964/0 (socket says 172.21.15.82:32964) 2023-07-20T10:09:19.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 -- 172.21.15.82:0/3041186930 learned_addr learned my addr 172.21.15.82:0/3041186930 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 -- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e140ad060 msgr2=0x7f4e140ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e140ad060 0x7f4e140ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 -- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 msgr2=0x7f4e14070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e127fc640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 0x7f4e14070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 0x7f4e14070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 -- 172.21.15.82:0/3041186930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009420 con 0x7f4e140ca040 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e127fc640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 0x7f4e14070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e137fe640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0ae040 tx=0x7f4e0c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0abe10 con 0x7f4e140ca040 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0b7450 con 0x7f4e140ca040 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0b7800 con 0x7f4e140ca040 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140adc80 con 0x7f4e140ca040 2023-07-20T10:09:19.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e14156bb0 con 0x7f4e140ca040 2023-07-20T10:09:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e14073c70 con 0x7f4e140ca040 2023-07-20T10:09:19.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.729+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4e0c0b7960 con 0x7f4e140ca040 2023-07-20T10:09:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.733+0000 7f4dfbfff640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 0x7f4e00068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.733+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f4e0c11e380 con 0x7f4e140ca040 2023-07-20T10:09:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.733+0000 7f4e12ffd640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 0x7f4e00068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:19.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.733+0000 7f4e12ffd640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 0x7f4e00068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007fd0 tx=0x7f4e04007940 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:19.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.733+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e0c0eb8f0 con 0x7f4e140ca040 2023-07-20T10:09:19.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.881+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e140ae410 con 0x7f4e140ca040 2023-07-20T10:09:19.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4dfbfff640 1 -- 172.21.15.82:0/3041186930 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+14669 (secure 0 0 0) 0x7f4e0c0eef10 con 0x7f4e140ca040 2023-07-20T10:09:19.860 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:19.861 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":133,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:19.161233+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 msgr2=0x7f4e00068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 0x7f4e00068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007fd0 tx=0x7f4e04007940 comp rx=0 tx=0).stop 2023-07-20T10:09:19.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 msgr2=0x7f4e141507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:19.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0ae040 tx=0x7f4e0c01ac70 comp rx=0 tx=0).stop 2023-07-20T10:09:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 shutdown_connections 2023-07-20T10:09:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4e000663d0 0x7f4e00068890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e140ca040 0x7f4e141507d0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e140b1170 0x7f4e14070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 --2- 172.21.15.82:0/3041186930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4e140ad060 0x7f4e140ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:19.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 >> 172.21.15.82:0/3041186930 conn(0x7f4e140cada0 msgr2=0x7f4e14161e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:19.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 shutdown_connections 2023-07-20T10:09:19.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:19.885+0000 7f4e19940640 1 -- 172.21.15.82:0/3041186930 wait complete. 2023-07-20T10:09:19.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T10:09:19.882 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T10:09:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 Processor -- start 2023-07-20T10:09:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 -- start start 2023-07-20T10:09:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f62b015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f62b00afd50 0x7f62b00b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b00cc8d0 con 0x7f62b0159830 2023-07-20T10:09:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b00cce90 con 0x7f62b00afd50 2023-07-20T10:09:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62b57a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00b0700 con 0x7f62b0159450 2023-07-20T10:09:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62a67fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f62b0159830 0x7f62b00cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45800/0 (socket says 172.21.15.82:45800) 2023-07-20T10:09:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.049+0000 7f62a67fc640 1 -- 172.21.15.82:0/3759852279 learned_addr learned my addr 172.21.15.82:0/3759852279 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 --2- 172.21.15.82:0/3759852279 >> v2:172.21.15.183:3300/0 conn(0x7f62b00afd50 0x7f62b00b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62aeffd640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f62b015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649016340 0 0) 0x7f62b00cc8d0 con 0x7f62b0159830 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c003530 con 0x7f62b0159830 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695784062 0 0) 0x7f629c003530 con 0x7f62b0159830 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 msgr2=0x7f62b015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f62b015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 >> v2:172.21.15.183:3300/0 conn(0x7f62b00afd50 msgr2=0x7f62b00b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 --2- 172.21.15.82:0/3759852279 >> v2:172.21.15.183:3300/0 conn(0x7f62b00afd50 0x7f62b00b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b00ccbb0 con 0x7f62b0159830 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f6298001a00 con 0x7f62b0159830 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 >> v1:172.21.15.82:6789/0 conn(0x7f62b0159830 legacy=0x7f62b00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c003a20 0x7f629c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f629c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f629c004d10 0x7f629c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00cce90 con 0x7f629c004d10 2023-07-20T10:09:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00b0700 con 0x7f629c003a20 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c00b9c0 con 0x7f62b0159450 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f629c004d10 0x7f629c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62a67fc640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f629c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62aeffd640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c003a20 0x7f629c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 -- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 msgr2=0x7f629c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0159450 0x7f629c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 -- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c003a20 msgr2=0x7f629c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c003a20 0x7f629c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.053+0000 7f62af7fe640 1 -- 172.21.15.82:0/3759852279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c003530 con 0x7f629c004d10 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62af7fe640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f629c004d10 0x7f629c005190 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009ae0 tx=0x7f62a801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c576e10ce989094 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80a5680 con 0x7f629c004d10 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a80a57e0 con 0x7f629c004d10 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62ae7fc640 1 -- 172.21.15.82:0/3759852279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80a5b90 con 0x7f629c004d10 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- 172.21.15.82:0/3759852279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f629c004d10 msgr2=0x7f629c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 --2- 172.21.15.82:0/3759852279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f629c004d10 0x7f629c005190 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009ae0 tx=0x7f62a801ca90 comp rx=0 tx=0).stop 2023-07-20T10:09:20.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62af7fe640 1 -- 172.21.15.82:0/3759852279 reap_dead start 2023-07-20T10:09:20.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- 172.21.15.82:0/3759852279 shutdown_connections 2023-07-20T10:09:20.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- 172.21.15.82:0/3759852279 >> 172.21.15.82:0/3759852279 conn(0x7f62b00cad50 msgr2=0x7f62b00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- 172.21.15.82:0/3759852279 shutdown_connections 2023-07-20T10:09:20.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- 172.21.15.82:0/3759852279 wait complete. 2023-07-20T10:09:20.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 Processor -- start 2023-07-20T10:09:20.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.057+0000 7f62b57a3640 1 -- start start 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c004d10 0x7f62b0152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0166d80 0x7f62b00b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0166330 con 0x7f62b0167200 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b0166b70 con 0x7f629c004d10 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b00c5c00 con 0x7f62b0166d80 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32990/0 (socket says 172.21.15.82:32990) 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 -- 172.21.15.82:0/1070607810 learned_addr learned my addr 172.21.15.82:0/1070607810 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62a67fc640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0166d80 0x7f62b00b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62aeffd640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c004d10 0x7f62b0152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 -- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0166d80 msgr2=0x7f62b00b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0166d80 0x7f62b00b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 -- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c004d10 msgr2=0x7f62b0152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c004d10 0x7f62b0152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 -- 172.21.15.82:0/1070607810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b01657b0 con 0x7f62b0167200 2023-07-20T10:09:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62af7fe640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f62a80b0040 tx=0x7f629c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80a5680 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8004230 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b0165a90 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80ad650 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b0166050 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b00c5dc0 con 0x7f62b0167200 2023-07-20T10:09:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.061+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f62a80b4070 con 0x7f62b0167200 2023-07-20T10:09:20.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.065+0000 7f62a7fff640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 0x7f6290068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.065+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f62a811d5c0 con 0x7f62b0167200 2023-07-20T10:09:20.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.065+0000 7f62aeffd640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 0x7f6290068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.065+0000 7f62aeffd640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 0x7f6290068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009ae0 tx=0x7f62a0008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.069+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62a80eabe0 con 0x7f62b0167200 2023-07-20T10:09:20.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62b004da30 con 0x7f62b0167200 2023-07-20T10:09:20.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62a7fff640 1 -- 172.21.15.82:0/1070607810 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62a80b20a0 con 0x7f62b0167200 2023-07-20T10:09:20.197 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T10:09:20.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 msgr2=0x7f6290068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 0x7f6290068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009ae0 tx=0x7f62a0008040 comp rx=0 tx=0).stop 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 msgr2=0x7f62b00b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f62a80b0040 tx=0x7f629c005800 comp rx=0 tx=0).stop 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 shutdown_connections 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f62900663a0 0x7f6290068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62b0167200 0x7f62b00b27d0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f62b0166d80 0x7f62b00b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 --2- 172.21.15.82:0/1070607810 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f629c004d10 0x7f62b0152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 >> 172.21.15.82:0/1070607810 conn(0x7f62b00cad50 msgr2=0x7f62b00ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 shutdown_connections 2023-07-20T10:09:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.221+0000 7f62b57a3640 1 -- 172.21.15.82:0/1070607810 wait complete. 2023-07-20T10:09:20.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T10:09:20.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 Processor -- start 2023-07-20T10:09:20.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 -- start start 2023-07-20T10:09:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faafc15c8e0 0x7faafc06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faafc0d0ca0 0x7faafc0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0d1690 con 0x7faafc0d0ca0 2023-07-20T10:09:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc0cd5e0 con 0x7faafc15c8e0 2023-07-20T10:09:20.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab02a27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc06b020 con 0x7faafc0d0320 2023-07-20T10:09:20.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faafc0d0ca0 0x7faafc0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faafc0d0ca0 0x7faafc0d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33002/0 (socket says 172.21.15.82:33002) 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 -- 172.21.15.82:0/1238312992 learned_addr learned my addr 172.21.15.82:0/1238312992 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7faafb7fe640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7faafbfff640 1 --2- 172.21.15.82:0/1238312992 >> v2:172.21.15.183:3300/0 conn(0x7faafc15c8e0 0x7faafc06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 -- 172.21.15.82:0/1238312992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 msgr2=0x7faafc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 -- 172.21.15.82:0/1238312992 >> v2:172.21.15.183:3300/0 conn(0x7faafc15c8e0 msgr2=0x7faafc06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:20.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 --2- 172.21.15.82:0/1238312992 >> v2:172.21.15.183:3300/0 conn(0x7faafc15c8e0 0x7faafc06aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.385+0000 7fab00fc4640 1 -- 172.21.15.82:0/1238312992 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0cf800 con 0x7faafc0d0ca0 2023-07-20T10:09:20.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab00fc4640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc0d1150 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faafc0d37e0 tx=0x7faaf401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b64f3bff3ec1007 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7faafaffd640 1 -- 172.21.15.82:0/1238312992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40a5820 con 0x7faafc0d0ca0 2023-07-20T10:09:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7faafaffd640 1 -- 172.21.15.82:0/1238312992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40a5980 con 0x7faafc0d0ca0 2023-07-20T10:09:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7faafaffd640 1 -- 172.21.15.82:0/1238312992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf40a5d10 con 0x7faafc0d0ca0 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 -- 172.21.15.82:0/1238312992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 msgr2=0x7faafc0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc0d1150 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7faafc0d37e0 tx=0x7faaf401c9a0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 -- 172.21.15.82:0/1238312992 shutdown_connections 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc0d1150 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 --2- 172.21.15.82:0/1238312992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 --2- 172.21.15.82:0/1238312992 >> v2:172.21.15.183:3300/0 conn(0x7faafc15c8e0 0x7faafc06aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 -- 172.21.15.82:0/1238312992 >> 172.21.15.82:0/1238312992 conn(0x7faafc065d40 msgr2=0x7faafc09b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 -- 172.21.15.82:0/1238312992 shutdown_connections 2023-07-20T10:09:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 -- 172.21.15.82:0/1238312992 wait complete. 2023-07-20T10:09:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.389+0000 7fab02a27640 1 Processor -- start 2023-07-20T10:09:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- start start 2023-07-20T10:09:20.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 0x7faafc0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c7be0 con 0x7faafc0d0ca0 2023-07-20T10:09:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c8b90 con 0x7faafc15c8e0 2023-07-20T10:09:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0c6f60 con 0x7faafc0d0320 2023-07-20T10:09:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33008/0 (socket says 172.21.15.82:33008) 2023-07-20T10:09:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 -- 172.21.15.82:0/1642446331 learned_addr learned my addr 172.21.15.82:0/1642446331 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafbfff640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab00fc4640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 0x7faafc0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 -- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 msgr2=0x7faafc0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 -- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 msgr2=0x7faafc0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 0x7faafc0c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 -- 172.21.15.82:0/1642446331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4009b30 con 0x7faafc0d0ca0 2023-07-20T10:09:20.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab00fc4640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 0x7faafc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafbfff640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faafb7fe640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d5f0 tx=0x7faaf000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf0018070 con 0x7faafc0d0ca0 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf0004240 con 0x7faafc0d0ca0 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00043f0 con 0x7faafc0d0ca0 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc0c7240 con 0x7faafc0d0ca0 2023-07-20T10:09:20.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0c7800 con 0x7faafc0d0ca0 2023-07-20T10:09:20.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.393+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc0c7d20 con 0x7faafc0d0ca0 2023-07-20T10:09:20.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.397+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faaf0003620 con 0x7faafc0d0ca0 2023-07-20T10:09:20.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.397+0000 7faaf8ff9640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 0x7faae8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.397+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7faaf0083950 con 0x7faafc0d0ca0 2023-07-20T10:09:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.397+0000 7faafbfff640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 0x7faae8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.397+0000 7faafbfff640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 0x7faae8068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaec007a70 tx=0x7faaec008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.401+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faafc0c7d20 con 0x7faafc0d0ca0 2023-07-20T10:09:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.545+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faafc0c7d20 con 0x7faafc0d0ca0 2023-07-20T10:09:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.545+0000 7faaf8ff9640 1 -- 172.21.15.82:0/1642446331 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v133) v1 ==== 92+0+10 (secure 0 0 0) 0x7faafc0c7d20 con 0x7faafc0d0ca0 2023-07-20T10:09:20.524 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T10:09:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 msgr2=0x7faae8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 0x7faae8068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faaec007a70 tx=0x7faaec008040 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 msgr2=0x7faafc14ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7faaf000d5f0 tx=0x7faaf000dab0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 shutdown_connections 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faae80663d0 0x7faae8068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faafc15c8e0 0x7faafc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faafc0d0ca0 0x7faafc14ec30 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 --2- 172.21.15.82:0/1642446331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faafc0d0320 0x7faafc0c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 >> 172.21.15.82:0/1642446331 conn(0x7faafc065d40 msgr2=0x7faafc155850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 shutdown_connections 2023-07-20T10:09:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.549+0000 7fab02a27640 1 -- 172.21.15.82:0/1642446331 wait complete. 2023-07-20T10:09:20.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T10:09:20.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 Processor -- start 2023-07-20T10:09:20.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 -- start start 2023-07-20T10:09:20.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3f0c0ccfb0 0x7f3f0c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c0b7c20 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c15c9d0 con 0x7f3f0c15c5f0 2023-07-20T10:09:20.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f1308a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c0b4980 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f12889640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3f0c0ce9a0 0x7f3f0c0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45810/0 (socket says 172.21.15.82:45810) 2023-07-20T10:09:20.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f12889640 1 -- 172.21.15.82:0/2639181870 learned_addr learned my addr 172.21.15.82:0/2639181870 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:20.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11887640 1 --2- 172.21.15.82:0/2639181870 >> v2:172.21.15.183:3300/0 conn(0x7f3f0c0ccfb0 0x7f3f0c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11086640 1 -- 172.21.15.82:0/2639181870 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155019542 0 0) 0x7f3f0c0b7c20 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11086640 1 -- 172.21.15.82:0/2639181870 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef8003530 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11887640 1 -- 172.21.15.82:0/2639181870 >> v1:172.21.15.183:6789/0 conn(0x7f3f0c15c5f0 legacy=0x7f3f0c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11887640 1 -- 172.21.15.82:0/2639181870 >> v1:172.21.15.82:6789/0 conn(0x7f3f0c0ce9a0 legacy=0x7f3f0c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.709+0000 7f3f11887640 1 -- 172.21.15.82:0/2639181870 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0ce030 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f11887640 1 --2- 172.21.15.82:0/2639181870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c0ccfb0 0x7f3f0c0ce460 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c132a6eac41195f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f11086640 1 -- 172.21.15.82:0/2639181870 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0a8970 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f11086640 1 -- 172.21.15.82:0/2639181870 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0a8ad0 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f11086640 1 -- 172.21.15.82:0/2639181870 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0a8e60 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 -- 172.21.15.82:0/2639181870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c0ccfb0 msgr2=0x7f3f0c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 --2- 172.21.15.82:0/2639181870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c0ccfb0 0x7f3f0c0ce460 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0097c0 tx=0x7f3efc01ec70 comp rx=0 tx=0).stop 2023-07-20T10:09:20.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 -- 172.21.15.82:0/2639181870 shutdown_connections 2023-07-20T10:09:20.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 --2- 172.21.15.82:0/2639181870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c0ccfb0 0x7f3f0c0ce460 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 -- 172.21.15.82:0/2639181870 >> 172.21.15.82:0/2639181870 conn(0x7f3f0c065710 msgr2=0x7f3f0c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 -- 172.21.15.82:0/2639181870 shutdown_connections 2023-07-20T10:09:20.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.713+0000 7f3f1308a640 1 -- 172.21.15.82:0/2639181870 wait complete. 2023-07-20T10:09:20.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 Processor -- start 2023-07-20T10:09:20.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- start start 2023-07-20T10:09:20.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f0c0ccfb0 0x7f3f0c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c15c5f0 0x7f3f0c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0a91f0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c158430 con 0x7f3f0c15c5f0 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c158710 con 0x7f3f0c0ccfb0 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33014/0 (socket says 172.21.15.82:33014) 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 -- 172.21.15.82:0/360342864 learned_addr learned my addr 172.21.15.82:0/360342864 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f12889640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c15c5f0 0x7f3f0c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f12088640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f0c0ccfb0 0x7f3f0c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 -- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f0c0ccfb0 msgr2=0x7f3f0c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f0c0ccfb0 0x7f3f0c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 -- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c15c5f0 msgr2=0x7f3f0c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c15c5f0 0x7f3f0c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 -- 172.21.15.82:0/360342864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc009420 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f11887640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b3040 tx=0x7f3efc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0b9630 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc0b97b0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0b9b60 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c1589f0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.717+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c158fb0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c1591a0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3efc0b7040 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f02ffd640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 0x7f3ef0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:20.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f3efc121a20 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f12088640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 0x7f3ef0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:20.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.721+0000 7f3f12088640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 0x7f3ef0068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007fd0 tx=0x7f3f08009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:20.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.725+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3efc0ef0d0 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.873+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3f0c158850 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.873+0000 7f3f02ffd640 1 -- 172.21.15.82:0/360342864 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3f0c158850 con 0x7f3f0c0ce9a0 2023-07-20T10:09:20.851 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:20.851 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:09:20.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:20.851 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:20.852 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 msgr2=0x7f3ef0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 0x7f3ef0068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007fd0 tx=0x7f3f08009040 comp rx=0 tx=0).stop 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 msgr2=0x7f3f0c1578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b3040 tx=0x7f3efc01ba10 comp rx=0 tx=0).stop 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 shutdown_connections 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f3ef00663a0 0x7f3ef0068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3f0c15c5f0 0x7f3f0c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f0c0ce9a0 0x7f3f0c1578c0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 --2- 172.21.15.82:0/360342864 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3f0c0ccfb0 0x7f3f0c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 >> 172.21.15.82:0/360342864 conn(0x7f3f0c065710 msgr2=0x7f3f0c0b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 shutdown_connections 2023-07-20T10:09:20.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:20.877+0000 7f3f1308a640 1 -- 172.21.15.82:0/360342864 wait complete. 2023-07-20T10:09:20.871 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T10:09:20.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T10:09:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 Processor -- start 2023-07-20T10:09:21.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 -- start start 2023-07-20T10:09:21.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 0x7fc8c4160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8c406a860 0x7fc8c40ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c415cb00 con 0x7fc8c40ce580 2023-07-20T10:09:21.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c4161190 con 0x7fc8c406a860 2023-07-20T10:09:21.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8cae61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40ce9f0 con 0x7fc8c415c720 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c8bfd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 0x7fc8c4160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c3fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc8c406a860 0x7fc8c40ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c93fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fc8c40ce580 0x7fc8c406f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:35044/0 (socket says 172.21.15.82:35044) 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c93fe640 1 -- 172.21.15.82:0/1593470398 learned_addr learned my addr 172.21.15.82:0/1593470398 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c37fe640 1 -- 172.21.15.82:0/1593470398 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004750529 0 0) 0x7fc8c415cb00 con 0x7fc8c40ce580 2023-07-20T10:09:21.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c37fe640 1 -- 172.21.15.82:0/1593470398 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ac003530 con 0x7fc8c40ce580 2023-07-20T10:09:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c3fff640 1 -- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 msgr2=0x7fc8c4160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c3fff640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 0x7fc8c4160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c3fff640 1 -- 172.21.15.82:0/1593470398 >> v1:172.21.15.183:6789/0 conn(0x7fc8c40ce580 legacy=0x7fc8c406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c3fff640 1 -- 172.21.15.82:0/1593470398 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c406ad40 con 0x7fc8c406a860 2023-07-20T10:09:21.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.041+0000 7fc8c8bfd640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 0x7fc8c4160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:21.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8c3fff640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c40ce040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009dc0 tx=0x7fc8b801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6520d9538ab63c9d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8c37fe640 1 -- 172.21.15.82:0/1593470398 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80a59c0 con 0x7fc8c406a860 2023-07-20T10:09:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8c37fe640 1 -- 172.21.15.82:0/1593470398 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b80a5b20 con 0x7fc8c406a860 2023-07-20T10:09:21.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8c37fe640 1 -- 172.21.15.82:0/1593470398 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80a5e90 con 0x7fc8c406a860 2023-07-20T10:09:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 -- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 msgr2=0x7fc8c40ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c40ce040 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009dc0 tx=0x7fc8b801c900 comp rx=0 tx=0).stop 2023-07-20T10:09:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 -- 172.21.15.82:0/1593470398 shutdown_connections 2023-07-20T10:09:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c40ce040 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:21.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 --2- 172.21.15.82:0/1593470398 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c415c720 0x7fc8c4160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 -- 172.21.15.82:0/1593470398 >> 172.21.15.82:0/1593470398 conn(0x7fc8c406da00 msgr2=0x7fc8c406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 -- 172.21.15.82:0/1593470398 shutdown_connections 2023-07-20T10:09:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.045+0000 7fc8cae61640 1 -- 172.21.15.82:0/1593470398 wait complete. 2023-07-20T10:09:21.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 Processor -- start 2023-07-20T10:09:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 -- start start 2023-07-20T10:09:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c415b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c40ce580 0x7fc8c41542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415fca0 con 0x7fc8c415c720 2023-07-20T10:09:21.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4153e50 con 0x7fc8c406a860 2023-07-20T10:09:21.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8cae61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415fe80 con 0x7fc8c40ce580 2023-07-20T10:09:21.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33028/0 (socket says 172.21.15.82:33028) 2023-07-20T10:09:21.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 -- 172.21.15.82:0/819884468 learned_addr learned my addr 172.21.15.82:0/819884468 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:21.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c8bfd640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c415b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c3fff640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c40ce580 0x7fc8c41542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 -- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c40ce580 msgr2=0x7fc8c41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:21.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c40ce580 0x7fc8c41542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:21.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 -- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 msgr2=0x7fc8c415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:21.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c415b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:21.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 -- 172.21.15.82:0/819884468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4009420 con 0x7fc8c415c720 2023-07-20T10:09:21.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.049+0000 7fc8c93fe640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c450 tx=0x7fc8bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:21.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc005cf0 con 0x7fc8c415c720 2023-07-20T10:09:21.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc005e50 con 0x7fc8c415c720 2023-07-20T10:09:21.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc0072b0 con 0x7fc8c415c720 2023-07-20T10:09:21.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b8009a70 con 0x7fc8c415c720 2023-07-20T10:09:21.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c4160160 con 0x7fc8c415c720 2023-07-20T10:09:21.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c4153fc0 con 0x7fc8c415c720 2023-07-20T10:09:21.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc8bc007410 con 0x7fc8c415c720 2023-07-20T10:09:21.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 0x7fc8b0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:21.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fc8bc082cc0 con 0x7fc8c415c720 2023-07-20T10:09:21.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.053+0000 7fc8c8bfd640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 0x7fc8b0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:21.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.057+0000 7fc8c8bfd640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 0x7fc8b0068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8c406e300 tx=0x7fc8b4009190 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:21.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.057+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8bc089080 con 0x7fc8c415c720 2023-07-20T10:09:21.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:21.221+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc8c404da30 con 0x7fc8c415c720 2023-07-20T10:09:22.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.165+0000 7fc8c17fa640 1 -- 172.21.15.82:0/819884468 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8bc017020 con 0x7fc8c415c720 2023-07-20T10:09:22.142 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T10:09:22.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 msgr2=0x7fc8b0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 0x7fc8b0068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc8c406e300 tx=0x7fc8b4009190 comp rx=0 tx=0).stop 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 msgr2=0x7fc8c4152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c450 tx=0x7fc8bc00c910 comp rx=0 tx=0).stop 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 shutdown_connections 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fc8b00663a0 0x7fc8b0068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8c415c720 0x7fc8c4152760 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc8c40ce580 0x7fc8c41542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 --2- 172.21.15.82:0/819884468 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8c406a860 0x7fc8c415b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 >> 172.21.15.82:0/819884468 conn(0x7fc8c406da00 msgr2=0x7fc8c40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 shutdown_connections 2023-07-20T10:09:22.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.173+0000 7fc8cae61640 1 -- 172.21.15.82:0/819884468 wait complete. 2023-07-20T10:09:22.173 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T10:09:22.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 Processor -- start 2023-07-20T10:09:22.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 -- start start 2023-07-20T10:09:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fced4159450 0x7fced415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fced40afd50 0x7fced40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced40b06b0 con 0x7fced4159830 2023-07-20T10:09:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced40cce90 con 0x7fced40afd50 2023-07-20T10:09:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fceda567640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced40cc8d0 con 0x7fced4159450 2023-07-20T10:09:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fced4159830 0x7fced40cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:45824/0 (socket says 172.21.15.82:45824) 2023-07-20T10:09:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced8b04640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fced40afd50 0x7fced40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced37fe640 1 -- 172.21.15.82:0/2271800719 learned_addr learned my addr 172.21.15.82:0/2271800719 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced3fff640 1 --2- 172.21.15.82:0/2271800719 >> v2:172.21.15.183:3300/0 conn(0x7fced4159450 0x7fced415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced8b04640 1 -- 172.21.15.82:0/2271800719 >> v2:172.21.15.183:3300/0 conn(0x7fced4159450 msgr2=0x7fced415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced8b04640 1 --2- 172.21.15.82:0/2271800719 >> v2:172.21.15.183:3300/0 conn(0x7fced4159450 0x7fced415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced8b04640 1 -- 172.21.15.82:0/2271800719 >> v1:172.21.15.82:6789/0 conn(0x7fced4159830 legacy=0x7fced40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.349+0000 7fced8b04640 1 -- 172.21.15.82:0/2271800719 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced40ccbb0 con 0x7fced40afd50 2023-07-20T10:09:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fced8b04640 1 --2- 172.21.15.82:0/2271800719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced40b0170 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fced406a6c0 tx=0x7fcecc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b142eb7a7bda83ed server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:22.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fced2ffd640 1 -- 172.21.15.82:0/2271800719 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0a59a0 con 0x7fced40afd50 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fced2ffd640 1 -- 172.21.15.82:0/2271800719 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc0a5b00 con 0x7fced40afd50 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fced2ffd640 1 -- 172.21.15.82:0/2271800719 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0a5e90 con 0x7fced40afd50 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 -- 172.21.15.82:0/2271800719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 msgr2=0x7fced40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 --2- 172.21.15.82:0/2271800719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced40b0170 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fced406a6c0 tx=0x7fcecc01c8e0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 -- 172.21.15.82:0/2271800719 shutdown_connections 2023-07-20T10:09:22.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 --2- 172.21.15.82:0/2271800719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced40b0170 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 --2- 172.21.15.82:0/2271800719 >> v2:172.21.15.183:3300/0 conn(0x7fced4159450 0x7fced415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 -- 172.21.15.82:0/2271800719 >> 172.21.15.82:0/2271800719 conn(0x7fced40cad50 msgr2=0x7fced40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 -- 172.21.15.82:0/2271800719 shutdown_connections 2023-07-20T10:09:22.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.353+0000 7fceda567640 1 -- 172.21.15.82:0/2271800719 wait complete. 2023-07-20T10:09:22.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 Processor -- start 2023-07-20T10:09:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- start start 2023-07-20T10:09:22.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fced4159450 0x7fced4162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced4163200 0x7fced40ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41650b0 con 0x7fced40afd50 2023-07-20T10:09:22.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced41628a0 con 0x7fced4163200 2023-07-20T10:09:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40c8340 con 0x7fced4159450 2023-07-20T10:09:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33056/0 (socket says 172.21.15.82:33056) 2023-07-20T10:09:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 -- 172.21.15.82:0/1752360208 learned_addr learned my addr 172.21.15.82:0/1752360208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:22.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 -- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fced4159450 msgr2=0x7fced4162cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fced4159450 0x7fced4162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 -- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced4163200 msgr2=0x7fced40ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:22.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced4163200 0x7fced40ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 -- 172.21.15.82:0/1752360208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009a70 con 0x7fced40afd50 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced3fff640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d800 tx=0x7fcec400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400b6c0 con 0x7fced40afd50 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400b820 con 0x7fced40afd50 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400bb90 con 0x7fced40afd50 2023-07-20T10:09:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced4164530 con 0x7fced40afd50 2023-07-20T10:09:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced4164af0 con 0x7fced40afd50 2023-07-20T10:09:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.357+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced4162600 con 0x7fced40afd50 2023-07-20T10:09:22.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.361+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcec400bcf0 con 0x7fced40afd50 2023-07-20T10:09:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.361+0000 7fced0ff9640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 0x7fcec0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.361+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5608+0+0 (secure 0 0 0) 0x7fcec4084b30 con 0x7fced40afd50 2023-07-20T10:09:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.361+0000 7fced37fe640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 0x7fcec0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.361+0000 7fced37fe640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 0x7fcec0068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fced415bb30 tx=0x7fcec8007a50 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:22.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.365+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcec4055b60 con 0x7fced40afd50 2023-07-20T10:09:22.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:22.513+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fced4162600 con 0x7fced40afd50 2023-07-20T10:09:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.177+0000 7fced0ff9640 1 -- 172.21.15.82:0/1752360208 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) v1 ==== 170+0+0 (secure 0 0 0) 0x7fced4162600 con 0x7fced40afd50 2023-07-20T10:09:23.153 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T10:09:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.185+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 msgr2=0x7fcec0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:23.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.185+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 0x7fcec0068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fced415bb30 tx=0x7fcec8007a50 comp rx=0 tx=0).stop 2023-07-20T10:09:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 msgr2=0x7fced4154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:23.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fcec400d800 tx=0x7fcec400dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 shutdown_connections 2023-07-20T10:09:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcec00663a0 0x7fcec0068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fced4163200 0x7fced40ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fced4159450 0x7fced4162cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 --2- 172.21.15.82:0/1752360208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fced40afd50 0x7fced4154a50 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.189+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 >> 172.21.15.82:0/1752360208 conn(0x7fced40cad50 msgr2=0x7fced40cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:23.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.193+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 shutdown_connections 2023-07-20T10:09:23.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.193+0000 7fceda567640 1 -- 172.21.15.82:0/1752360208 wait complete. 2023-07-20T10:09:23.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T10:09:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 Processor -- start 2023-07-20T10:09:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 -- start start 2023-07-20T10:09:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbd2006f710 0x7fbd2006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 0x7fbd2015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd2015ec90 0x7fbd2015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2015bad0 con 0x7fbd2015ec90 2023-07-20T10:09:23.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd20070030 con 0x7fbd2006f710 2023-07-20T10:09:23.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd265d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20071950 con 0x7fbd200ca5a0 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd2015ec90 0x7fbd2015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbd2015ec90 0x7fbd2015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42156/0 (socket says 172.21.15.82:42156) 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 -- 172.21.15.82:0/4040171203 learned_addr learned my addr 172.21.15.82:0/4040171203 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd1f7fe640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 0x7fbd2015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd1ffff640 1 --2- 172.21.15.82:0/4040171203 >> v2:172.21.15.183:3300/0 conn(0x7fbd2006f710 0x7fbd2006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 -- 172.21.15.82:0/4040171203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 msgr2=0x7fbd2015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:23.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 0x7fbd2015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 -- 172.21.15.82:0/4040171203 >> v2:172.21.15.183:3300/0 conn(0x7fbd2006f710 msgr2=0x7fbd2006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:23.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 --2- 172.21.15.82:0/4040171203 >> v2:172.21.15.183:3300/0 conn(0x7fbd2006f710 0x7fbd2006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd24b6f640 1 -- 172.21.15.82:0/4040171203 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2015b230 con 0x7fbd2015ec90 2023-07-20T10:09:23.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.369+0000 7fbd1f7fe640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 0x7fbd2015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:23.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd24b6f640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2015ec90 0x7fbd2015a6f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ce230 tx=0x7fbd1801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac89b8d25965e285 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:23.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd1effd640 1 -- 172.21.15.82:0/4040171203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a5730 con 0x7fbd2015ec90 2023-07-20T10:09:23.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd1effd640 1 -- 172.21.15.82:0/4040171203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180a5890 con 0x7fbd2015ec90 2023-07-20T10:09:23.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd1effd640 1 -- 172.21.15.82:0/4040171203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a5c20 con 0x7fbd2015ec90 2023-07-20T10:09:23.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 -- 172.21.15.82:0/4040171203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2015ec90 msgr2=0x7fbd2015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:23.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2015ec90 0x7fbd2015a6f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ce230 tx=0x7fbd1801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 -- 172.21.15.82:0/4040171203 shutdown_connections 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd2015ec90 0x7fbd2015a6f0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 --2- 172.21.15.82:0/4040171203 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd200ca5a0 0x7fbd2015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 --2- 172.21.15.82:0/4040171203 >> v2:172.21.15.183:3300/0 conn(0x7fbd2006f710 0x7fbd2006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 -- 172.21.15.82:0/4040171203 >> 172.21.15.82:0/4040171203 conn(0x7fbd200cad50 msgr2=0x7fbd200cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 -- 172.21.15.82:0/4040171203 shutdown_connections 2023-07-20T10:09:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 -- 172.21.15.82:0/4040171203 wait complete. 2023-07-20T10:09:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.373+0000 7fbd265d2640 1 Processor -- start 2023-07-20T10:09:23.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- start start 2023-07-20T10:09:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2006f710 0x7fbd20152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2015ec90 0x7fbd2015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20152280 con 0x7fbd200ca5a0 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200cbea0 con 0x7fbd2015ec90 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200cccc0 con 0x7fbd2006f710 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42162/0 (socket says 172.21.15.82:42162) 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 -- 172.21.15.82:0/3170168708 learned_addr learned my addr 172.21.15.82:0/3170168708 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1ffff640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2006f710 0x7fbd20152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd24b6f640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2015ec90 0x7fbd2015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 -- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2006f710 msgr2=0x7fbd20152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2006f710 0x7fbd20152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 -- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2015ec90 msgr2=0x7fbd2015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2015ec90 0x7fbd2015bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 -- 172.21.15.82:0/3170168708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009b30 con 0x7fbd200ca5a0 2023-07-20T10:09:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1f7fe640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400e810 tx=0x7fbd1400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400c8d0 con 0x7fbd200ca5a0 2023-07-20T10:09:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1400ca30 con 0x7fbd200ca5a0 2023-07-20T10:09:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400cdc0 con 0x7fbd200ca5a0 2023-07-20T10:09:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd200cc0b0 con 0x7fbd200ca5a0 2023-07-20T10:09:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd200cc670 con 0x7fbd200ca5a0 2023-07-20T10:09:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.377+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2004da30 con 0x7fbd200ca5a0 2023-07-20T10:09:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.381+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbd14013410 con 0x7fbd200ca5a0 2023-07-20T10:09:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.381+0000 7fbd1cff9640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 0x7fbd0c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.381+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5990+0+0 (secure 0 0 0) 0x7fbd14083cb0 con 0x7fbd200ca5a0 2023-07-20T10:09:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.381+0000 7fbd1ffff640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 0x7fbd0c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.381+0000 7fbd1ffff640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 0x7fbd0c068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd100045f0 tx=0x7fbd10008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.385+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd14050ff0 con 0x7fbd200ca5a0 2023-07-20T10:09:23.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:23.561+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbd201fcc70 con 0x7fbd200ca5a0 2023-07-20T10:09:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.177+0000 7fbd1cff9640 1 -- 172.21.15.82:0/3170168708 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v62) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbd14009480 con 0x7fbd200ca5a0 2023-07-20T10:09:24.155 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 17 and data pool 18 2023-07-20T10:09:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.193+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 msgr2=0x7fbd0c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.193+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 0x7fbd0c068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd100045f0 tx=0x7fbd10008040 comp rx=0 tx=0).stop 2023-07-20T10:09:24.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.193+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 msgr2=0x7fbd20154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.193+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400e810 tx=0x7fbd1400ecd0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.197+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 shutdown_connections 2023-07-20T10:09:24.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.197+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fbd0c0663a0 0x7fbd0c068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.197+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbd2015ec90 0x7fbd2015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.197+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd200ca5a0 0x7fbd20154110 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.197+0000 7fbd265d2640 1 --2- 172.21.15.82:0/3170168708 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbd2006f710 0x7fbd20152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.201+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 >> 172.21.15.82:0/3170168708 conn(0x7fbd200cad50 msgr2=0x7fbd2006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:24.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.201+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 shutdown_connections 2023-07-20T10:09:24.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.201+0000 7fbd265d2640 1 -- 172.21.15.82:0/3170168708 wait complete. 2023-07-20T10:09:24.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 Processor -- start 2023-07-20T10:09:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 -- start start 2023-07-20T10:09:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff388089740 0x7ff3880b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880ad7d0 0x7ff3880ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3880cda90 con 0x7ff38816dbb0 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38816e040 con 0x7ff388089740 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38ef8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880cd160 con 0x7ff3880ad7d0 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38cd2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff388089740 0x7ff3880b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38cd2b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff388089740 0x7ff3880b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42170/0 (socket says 172.21.15.82:42170) 2023-07-20T10:09:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38cd2b640 1 -- 172.21.15.82:0/2529534064 learned_addr learned my addr 172.21.15.82:0/2529534064 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335937184 0 0) 0x7ff3880cda90 con 0x7ff38816dbb0 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.373+0000 7ff38d52c640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880ad7d0 0x7ff3880ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff378003510 con 0x7ff38816dbb0 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff38cd2b640 1 -- 172.21.15.82:0/2529534064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880ad7d0 msgr2=0x7ff3880ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff38cd2b640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880ad7d0 0x7ff3880ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 <== mon.1 v1:172.21.15.183:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635610796 0 0) 0x7ff378003510 con 0x7ff38816dbb0 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff38cd2b640 1 -- 172.21.15.82:0/2529534064 >> v1:172.21.15.183:6789/0 conn(0x7ff38816dbb0 legacy=0x7ff3880ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff38cd2b640 1 -- 172.21.15.82:0/2529534064 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880cd440 con 0x7ff388089740 2023-07-20T10:09:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff38cd2b640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff3880b2570 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ff37c008120 tx=0x7ff37c01c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c088ceb1af0f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374001680 con 0x7ff388089740 2023-07-20T10:09:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c004030 con 0x7ff388089740 2023-07-20T10:09:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.385+0000 7ff3877fe640 1 -- 172.21.15.82:0/2529534064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0043a0 con 0x7ff388089740 2023-07-20T10:09:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- 172.21.15.82:0/2529534064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 msgr2=0x7ff3880b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff3880b2570 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7ff37c008120 tx=0x7ff37c01c6d0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- 172.21.15.82:0/2529534064 shutdown_connections 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880ad7d0 0x7ff3880ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/2529534064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff3880b2570 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- 172.21.15.82:0/2529534064 >> 172.21.15.82:0/2529534064 conn(0x7ff388069750 msgr2=0x7ff388069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- 172.21.15.82:0/2529534064 shutdown_connections 2023-07-20T10:09:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- 172.21.15.82:0/2529534064 wait complete. 2023-07-20T10:09:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 Processor -- start 2023-07-20T10:09:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- start start 2023-07-20T10:09:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3880ad7d0 0x7ff388070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880c53f0 0x7ff3880c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880865a0 con 0x7ff388089740 2023-07-20T10:09:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880c5920 con 0x7ff3880ad7d0 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38ef8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880c5c00 con 0x7ff3880c53f0 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38cd2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38cd2b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42182/0 (socket says 172.21.15.82:42182) 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38cd2b640 1 -- 172.21.15.82:0/306648955 learned_addr learned my addr 172.21.15.82:0/306648955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff38d52c640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880c53f0 0x7ff3880c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.389+0000 7ff387fff640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3880ad7d0 0x7ff388070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 -- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880c53f0 msgr2=0x7ff3880c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880c53f0 0x7ff3880c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 -- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3880ad7d0 msgr2=0x7ff388070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3880ad7d0 0x7ff388070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 -- 172.21.15.82:0/306648955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c00a580 con 0x7ff388089740 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38cd2b640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ff37c000c10 tx=0x7ff37c019470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0bc070 con 0x7ff388089740 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c003910 con 0x7ff388089740 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c003aa0 con 0x7ff388089740 2023-07-20T10:09:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3880c5ee0 con 0x7ff388089740 2023-07-20T10:09:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3880c64a0 con 0x7ff388089740 2023-07-20T10:09:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388073c70 con 0x7ff388089740 2023-07-20T10:09:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff37c003c00 con 0x7ff388089740 2023-07-20T10:09:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 0x7ff36c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff37c0aa070 con 0x7ff388089740 2023-07-20T10:09:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.393+0000 7ff387fff640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 0x7ff36c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.397+0000 7ff387fff640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 0x7ff36c068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3740017b0 tx=0x7ff3740013b0 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.397+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff37c0eb240 con 0x7ff388089740 2023-07-20T10:09:24.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3880ce130 con 0x7ff388089740 2023-07-20T10:09:24.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff3857fa640 1 -- 172.21.15.82:0/306648955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+18394 (secure 0 0 0) 0x7ff3880ce130 con 0x7ff388089740 2023-07-20T10:09:24.525 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:24.525 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":136,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:23.567465+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 msgr2=0x7ff36c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 0x7ff36c068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3740017b0 tx=0x7ff3740013b0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 msgr2=0x7ff388086060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7ff37c000c10 tx=0x7ff37c019470 comp rx=0 tx=0).stop 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 shutdown_connections 2023-07-20T10:09:24.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff36c0663a0 0x7ff36c068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3880c53f0 0x7ff3880c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3880ad7d0 0x7ff388070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 --2- 172.21.15.82:0/306648955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff388089740 0x7ff388086060 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 >> 172.21.15.82:0/306648955 conn(0x7ff388069750 msgr2=0x7ff3880ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 shutdown_connections 2023-07-20T10:09:24.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.549+0000 7ff38ef8f640 1 -- 172.21.15.82:0/306648955 wait complete. 2023-07-20T10:09:24.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:24.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 Processor -- start 2023-07-20T10:09:24.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 -- start start 2023-07-20T10:09:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6c00c1a00 0x7fb6c00aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c00cc560 con 0x7fb6c0160bc0 2023-07-20T10:09:24.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c00ad7e0 con 0x7fb6c0160fa0 2023-07-20T10:09:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c766d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c00cc790 con 0x7fb6c00c1a00 2023-07-20T10:09:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c5409640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb6c0160bc0 0x7fb6c006c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36358/0 (socket says 172.21.15.82:36358) 2023-07-20T10:09:24.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.709+0000 7fb6c5409640 1 -- 172.21.15.82:0/2769358908 learned_addr learned my addr 172.21.15.82:0/2769358908 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6c5c0a640 1 --2- 172.21.15.82:0/2769358908 >> v2:172.21.15.183:3300/0 conn(0x7fb6c00c1a00 0x7fb6c00aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872393556 0 0) 0x7fb6c00cc560 con 0x7fb6c0160bc0 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac003530 con 0x7fb6c0160bc0 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6c5c0a640 1 -- 172.21.15.82:0/2769358908 >> v1:172.21.15.183:6789/0 conn(0x7fb6c0160fa0 legacy=0x7fb6c00c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2543455140 0 0) 0x7fb6ac003530 con 0x7fb6c0160bc0 2023-07-20T10:09:24.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6c5c0a640 1 -- 172.21.15.82:0/2769358908 >> v1:172.21.15.82:6789/0 conn(0x7fb6c0160bc0 legacy=0x7fb6c006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6c5c0a640 1 -- 172.21.15.82:0/2769358908 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c00cca70 con 0x7fb6c00c1a00 2023-07-20T10:09:24.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.713+0000 7fb6c5c0a640 1 --2- 172.21.15.82:0/2769358908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c00aae90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097c0 tx=0x7fb6b801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8986a5c227c088b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc001a00 con 0x7fb6c00c1a00 2023-07-20T10:09:24.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b80a7050 con 0x7fb6c00c1a00 2023-07-20T10:09:24.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6b7fff640 1 -- 172.21.15.82:0/2769358908 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80ab620 con 0x7fb6c00c1a00 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- 172.21.15.82:0/2769358908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 msgr2=0x7fb6c00aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 --2- 172.21.15.82:0/2769358908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c00aae90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80097c0 tx=0x7fb6b801c370 comp rx=0 tx=0).stop 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- 172.21.15.82:0/2769358908 shutdown_connections 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 --2- 172.21.15.82:0/2769358908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c00aae90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- 172.21.15.82:0/2769358908 >> 172.21.15.82:0/2769358908 conn(0x7fb6c00cada0 msgr2=0x7fb6c00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- 172.21.15.82:0/2769358908 shutdown_connections 2023-07-20T10:09:24.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- 172.21.15.82:0/2769358908 wait complete. 2023-07-20T10:09:24.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 Processor -- start 2023-07-20T10:09:24.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.717+0000 7fb6c766d640 1 -- start start 2023-07-20T10:09:24.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c0151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 0x7fb6c015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0070220 con 0x7fb6c0160bc0 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0152510 con 0x7fb6c00c1a00 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c01529e0 con 0x7fb6c0160fa0 2023-07-20T10:09:24.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42190/0 (socket says 172.21.15.82:42190) 2023-07-20T10:09:24.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 -- 172.21.15.82:0/1473623505 learned_addr learned my addr 172.21.15.82:0/1473623505 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:24.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c5c0a640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 0x7fb6c015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c5409640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c0151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 -- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 msgr2=0x7fb6c015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 0x7fb6c015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 -- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 msgr2=0x7fb6c0151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c0151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 -- 172.21.15.82:0/1473623505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b8009420 con 0x7fb6c0160bc0 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c5c0a640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 0x7fb6c015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c4c08640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c3f0 tx=0x7fb6b000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b00052d0 con 0x7fb6c0160bc0 2023-07-20T10:09:24.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b0005430 con 0x7fb6c0160bc0 2023-07-20T10:09:24.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0003840 con 0x7fb6c0160bc0 2023-07-20T10:09:24.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c006fc60 con 0x7fb6c0160bc0 2023-07-20T10:09:24.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c0159cd0 con 0x7fb6c0160bc0 2023-07-20T10:09:24.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c0159b30 con 0x7fb6c0160bc0 2023-07-20T10:09:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.721+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6b00039a0 con 0x7fb6c0160bc0 2023-07-20T10:09:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.725+0000 7fb6b5ffb640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 0x7fb6a4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.725+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb6b0083460 con 0x7fb6c0160bc0 2023-07-20T10:09:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.725+0000 7fb6c5409640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 0x7fb6a4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.725+0000 7fb6c5409640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 0x7fb6a4068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0012f0 tx=0x7fb6bc009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.729+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6c0159b30 con 0x7fb6c0160bc0 2023-07-20T10:09:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.877+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6c0159b30 con 0x7fb6c0160bc0 2023-07-20T10:09:24.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.877+0000 7fb6b5ffb640 1 -- 172.21.15.82:0/1473623505 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+18394 (secure 0 0 0) 0x7fb6c0159b30 con 0x7fb6c0160bc0 2023-07-20T10:09:24.855 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:24.855 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":136,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:23.567465+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:24.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 msgr2=0x7fb6a4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 0x7fb6a4068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0012f0 tx=0x7fb6bc009040 comp rx=0 tx=0).stop 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 msgr2=0x7fb6c00c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c3f0 tx=0x7fb6b000c8b0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 shutdown_connections 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb6a40663a0 0x7fb6a4068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6c0160fa0 0x7fb6c015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0160bc0 0x7fb6c00c1de0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 --2- 172.21.15.82:0/1473623505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6c00c1a00 0x7fb6c0151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 >> 172.21.15.82:0/1473623505 conn(0x7fb6c00cada0 msgr2=0x7fb6c00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 shutdown_connections 2023-07-20T10:09:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:24.881+0000 7fb6c766d640 1 -- 172.21.15.82:0/1473623505 wait complete. 2023-07-20T10:09:24.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T10:09:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 Processor -- start 2023-07-20T10:09:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 -- start start 2023-07-20T10:09:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f378006f710 0x7f378006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 0x7f378015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f378015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378015bad0 con 0x7f378006f710 2023-07-20T10:09:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3780070030 con 0x7f37800ca5a0 2023-07-20T10:09:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f37871fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3780071950 con 0x7f378015ec90 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f378006f710 0x7f378006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f378006f710 0x7f378006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42200/0 (socket says 172.21.15.82:42200) 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 -- 172.21.15.82:0/4274879116 learned_addr learned my addr 172.21.15.82:0/4274879116 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3785797640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f378015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3777fff640 1 --2- 172.21.15.82:0/4274879116 >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 0x7f378015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 -- 172.21.15.82:0/4274879116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 msgr2=0x7f378015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f378015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 -- 172.21.15.82:0/4274879116 >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 msgr2=0x7f378015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 --2- 172.21.15.82:0/4274879116 >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 0x7f378015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3784f96640 1 -- 172.21.15.82:0/4274879116 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378015b230 con 0x7f378006f710 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3785797640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f378015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:25.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.041+0000 7f3777fff640 1 --2- 172.21.15.82:0/4274879116 >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 0x7f378015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f3784f96640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378006f710 0x7f378006faf0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f37800702d0 tx=0x7f377c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21f819e3c7539d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37777fe640 1 -- 172.21.15.82:0/4274879116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0ac600 con 0x7f378006f710 2023-07-20T10:09:25.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37777fe640 1 -- 172.21.15.82:0/4274879116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c0a8050 con 0x7f378006f710 2023-07-20T10:09:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37777fe640 1 -- 172.21.15.82:0/4274879116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0ac980 con 0x7f378006f710 2023-07-20T10:09:25.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 -- 172.21.15.82:0/4274879116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378006f710 msgr2=0x7f378006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378006f710 0x7f378006faf0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f37800702d0 tx=0x7f377c01c4d0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 -- 172.21.15.82:0/4274879116 shutdown_connections 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 --2- 172.21.15.82:0/4274879116 >> v2:172.21.15.183:3300/0 conn(0x7f37800ca5a0 0x7f378015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f378015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 --2- 172.21.15.82:0/4274879116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f378006f710 0x7f378006faf0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 -- 172.21.15.82:0/4274879116 >> 172.21.15.82:0/4274879116 conn(0x7f37800cad50 msgr2=0x7f37800cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:25.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 -- 172.21.15.82:0/4274879116 shutdown_connections 2023-07-20T10:09:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.045+0000 7f37871fa640 1 -- 172.21.15.82:0/4274879116 wait complete. 2023-07-20T10:09:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 Processor -- start 2023-07-20T10:09:25.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 -- start start 2023-07-20T10:09:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f378006f710 0x7f3780151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f37800cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780151ec0 con 0x7f37800ca5a0 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800cbea0 con 0x7f378006f710 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37871fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37801538e0 con 0x7f378015ec90 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42208/0 (socket says 172.21.15.82:42208) 2023-07-20T10:09:25.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 -- 172.21.15.82:0/3747694500 learned_addr learned my addr 172.21.15.82:0/3747694500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:25.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3784f96640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f378006f710 0x7f3780151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3785797640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f37800cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 -- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 msgr2=0x7f37800cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f37800cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 -- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f378006f710 msgr2=0x7f3780151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f378006f710 0x7f3780151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 -- 172.21.15.82:0/3747694500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0094d0 con 0x7f37800ca5a0 2023-07-20T10:09:25.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3785797640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f37800cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f3777fff640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f377000c7f0 tx=0x7f377000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.049+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000cea0 con 0x7f37800ca5a0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770004230 con 0x7f37800ca5a0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770007830 con 0x7f37800ca5a0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3780153b60 con 0x7f37800ca5a0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3780154120 con 0x7f37800ca5a0 2023-07-20T10:09:25.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378004da30 con 0x7f37800ca5a0 2023-07-20T10:09:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3770007990 con 0x7f37800ca5a0 2023-07-20T10:09:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37757fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3770083f80 con 0x7f37800ca5a0 2023-07-20T10:09:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.053+0000 7f3784f96640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:25.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.057+0000 7f3784f96640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 0x7f376c068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f377c0ae000 tx=0x7f377c0a7000 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.057+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3770051260 con 0x7f37800ca5a0 2023-07-20T10:09:25.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:25.245+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37800cb940 con 0x7f37800ca5a0 2023-07-20T10:09:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.205+0000 7f37757fa640 1 -- 172.21.15.82:0/3747694500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7f377001e0b0 con 0x7f37800ca5a0 2023-07-20T10:09:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 msgr2=0x7f376c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 0x7f376c068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f377c0ae000 tx=0x7f377c0a7000 comp rx=0 tx=0).stop 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 msgr2=0x7f37801640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f377000c7f0 tx=0x7f377000ccb0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 shutdown_connections 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378015ec90 0x7f37800cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37800ca5a0 0x7f37801640a0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 --2- 172.21.15.82:0/3747694500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f378006f710 0x7f3780151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 >> 172.21.15.82:0/3747694500 conn(0x7f37800cad50 msgr2=0x7f37800af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 shutdown_connections 2023-07-20T10:09:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.209+0000 7f37871fa640 1 -- 172.21.15.82:0/3747694500 wait complete. 2023-07-20T10:09:26.209 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T10:09:26.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T10:09:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.377+0000 7fdb2ba27640 1 Processor -- start 2023-07-20T10:09:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.377+0000 7fdb2ba27640 1 -- start start 2023-07-20T10:09:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb2ba27640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdb24159830 0x7fdb240cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb2ba27640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb240cc3e0 0x7fdb240afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb2ba27640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb240cc8d0 con 0x7fdb24159450 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb2ba27640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240cce90 con 0x7fdb240cc3e0 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb2ba27640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb240ccbb0 con 0x7fdb24159830 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb240cc3e0 0x7fdb240afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdb240cc3e0 0x7fdb240afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42216/0 (socket says 172.21.15.82:42216) 2023-07-20T10:09:26.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 -- 172.21.15.82:0/1834428266 learned_addr learned my addr 172.21.15.82:0/1834428266 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:26.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb28fc2640 1 --2- 172.21.15.82:0/1834428266 >> v2:172.21.15.183:3300/0 conn(0x7fdb24159830 0x7fdb240cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 -- 172.21.15.82:0/1834428266 >> v2:172.21.15.183:3300/0 conn(0x7fdb24159830 msgr2=0x7fdb240cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:26.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 --2- 172.21.15.82:0/1834428266 >> v2:172.21.15.183:3300/0 conn(0x7fdb24159830 0x7fdb240cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 -- 172.21.15.82:0/1834428266 >> v1:172.21.15.183:6789/0 conn(0x7fdb24159450 legacy=0x7fdb2415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.381+0000 7fdb29fc4640 1 -- 172.21.15.82:0/1834428266 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24159cc0 con 0x7fdb240cc3e0 2023-07-20T10:09:26.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb29fc4640 1 --2- 172.21.15.82:0/1834428266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb240afd50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb2415e190 tx=0x7fdb1c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89777cfbe1b9132 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:26.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb1bfff640 1 -- 172.21.15.82:0/1834428266 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a7990 con 0x7fdb240cc3e0 2023-07-20T10:09:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb1bfff640 1 -- 172.21.15.82:0/1834428266 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0a7af0 con 0x7fdb240cc3e0 2023-07-20T10:09:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb1bfff640 1 -- 172.21.15.82:0/1834428266 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0a7e80 con 0x7fdb240cc3e0 2023-07-20T10:09:26.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- 172.21.15.82:0/1834428266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 msgr2=0x7fdb240afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/1834428266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb240afd50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fdb2415e190 tx=0x7fdb1c01ebb0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- 172.21.15.82:0/1834428266 shutdown_connections 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/1834428266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb240afd50 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/1834428266 >> v2:172.21.15.183:3300/0 conn(0x7fdb24159830 0x7fdb240cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- 172.21.15.82:0/1834428266 >> 172.21.15.82:0/1834428266 conn(0x7fdb240cad50 msgr2=0x7fdb240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- 172.21.15.82:0/1834428266 shutdown_connections 2023-07-20T10:09:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- 172.21.15.82:0/1834428266 wait complete. 2023-07-20T10:09:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 Processor -- start 2023-07-20T10:09:26.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.385+0000 7fdb2ba27640 1 -- start start 2023-07-20T10:09:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 0x7fdb240c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb240c8e20 0x7fdb241f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb241f5f80 con 0x7fdb240cc3e0 2023-07-20T10:09:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb240c92a0 con 0x7fdb24159450 2023-07-20T10:09:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb24148fc0 con 0x7fdb240c8e20 2023-07-20T10:09:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42220/0 (socket says 172.21.15.82:42220) 2023-07-20T10:09:26.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 -- 172.21.15.82:0/3142617861 learned_addr learned my addr 172.21.15.82:0/3142617861 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb28fc2640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 0x7fdb240c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb29fc4640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb240c8e20 0x7fdb241f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 -- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb240c8e20 msgr2=0x7fdb241f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb240c8e20 0x7fdb241f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 -- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 msgr2=0x7fdb240c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 0x7fdb240c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 -- 172.21.15.82:0/3142617861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c009b30 con 0x7fdb240cc3e0 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb28fc2640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 0x7fdb240c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb297c3640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c500 tx=0x7fdb2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20005220 con 0x7fdb240cc3e0 2023-07-20T10:09:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb20005380 con 0x7fdb240cc3e0 2023-07-20T10:09:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb20007270 con 0x7fdb240cc3e0 2023-07-20T10:09:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb240c2e20 con 0x7fdb240cc3e0 2023-07-20T10:09:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb240c33e0 con 0x7fdb240cc3e0 2023-07-20T10:09:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2404da30 con 0x7fdb240cc3e0 2023-07-20T10:09:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.389+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdb200073d0 con 0x7fdb240cc3e0 2023-07-20T10:09:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.393+0000 7fdb19ffb640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 0x7fdb08068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.393+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdb20083790 con 0x7fdb240cc3e0 2023-07-20T10:09:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.393+0000 7fdb28fc2640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 0x7fdb08068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.393+0000 7fdb28fc2640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 0x7fdb08068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c1b90 tx=0x7fdb14008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:26.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.397+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb20050af0 con 0x7fdb240cc3e0 2023-07-20T10:09:26.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:26.577+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdb240cbbf0 con 0x7fdb240cc3e0 2023-07-20T10:09:27.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.209+0000 7fdb19ffb640 1 -- 172.21.15.82:0/3142617861 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb20054110 con 0x7fdb240cc3e0 2023-07-20T10:09:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 msgr2=0x7fdb08068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 0x7fdb08068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb240c1b90 tx=0x7fdb14008040 comp rx=0 tx=0).stop 2023-07-20T10:09:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 msgr2=0x7fdb241f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fdb2000c500 tx=0x7fdb2000c9c0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 shutdown_connections 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fdb080663a0 0x7fdb08068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdb240c8e20 0x7fdb241f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdb24159450 0x7fdb240c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 --2- 172.21.15.82:0/3142617861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb240cc3e0 0x7fdb241f4800 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 >> 172.21.15.82:0/3142617861 conn(0x7fdb240cad50 msgr2=0x7fdb240712a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 shutdown_connections 2023-07-20T10:09:27.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.213+0000 7fdb2ba27640 1 -- 172.21.15.82:0/3142617861 wait complete. 2023-07-20T10:09:27.211 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T10:09:27.211 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 Processor -- start 2023-07-20T10:09:27.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 -- start start 2023-07-20T10:09:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb015cab0 0x7f4bb00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bb00d0d10 0x7f4bb00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb00d16b0 con 0x7f4bb00cf110 2023-07-20T10:09:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb00d31c0 con 0x7f4bb00d0d10 2023-07-20T10:09:27.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4bb5fdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00b3520 con 0x7f4bb015cab0 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bb00d0d10 0x7f4bb00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4bb00d0d10 0x7f4bb00d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42228/0 (socket says 172.21.15.82:42228) 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 -- 172.21.15.82:0/1152148960 learned_addr learned my addr 172.21.15.82:0/1152148960 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4baf7fe640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb015cab0 0x7f4bb00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 -- 172.21.15.82:0/1152148960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb015cab0 msgr2=0x7f4bb00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:27.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb015cab0 0x7f4bb00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 -- 172.21.15.82:0/1152148960 >> v1:172.21.15.183:6789/0 conn(0x7f4bb00cf110 legacy=0x7f4bb00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:27.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.377+0000 7f4ba7fff640 1 -- 172.21.15.82:0/1152148960 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00b2910 con 0x7f4bb00d0d10 2023-07-20T10:09:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00d0d10 0x7f4bb00d1170 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697a834fae9d57eb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4baeffd640 1 -- 172.21.15.82:0/1152148960 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980aa5f0 con 0x7f4bb00d0d10 2023-07-20T10:09:27.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4baeffd640 1 -- 172.21.15.82:0/1152148960 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980aa750 con 0x7f4bb00d0d10 2023-07-20T10:09:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4baeffd640 1 -- 172.21.15.82:0/1152148960 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980aaae0 con 0x7f4bb00d0d10 2023-07-20T10:09:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1152148960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00d0d10 msgr2=0x7f4bb00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00d0d10 0x7f4bb00d1170 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009870 tx=0x7f4b9801c4d0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1152148960 shutdown_connections 2023-07-20T10:09:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00d0d10 0x7f4bb00d1170 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1152148960 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb015cab0 0x7f4bb00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1152148960 >> 172.21.15.82:0/1152148960 conn(0x7f4bb008c120 msgr2=0x7f4bb009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1152148960 shutdown_connections 2023-07-20T10:09:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.381+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1152148960 wait complete. 2023-07-20T10:09:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 Processor -- start 2023-07-20T10:09:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- start start 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 0x7f4bb015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 0x7f4bb015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00cab60 con 0x7f4bb00cf110 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00c9800 con 0x7f4bb015cab0 2023-07-20T10:09:27.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb00c9ac0 con 0x7f4bb00d0d10 2023-07-20T10:09:27.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42242/0 (socket says 172.21.15.82:42242) 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 -- 172.21.15.82:0/1296737636 learned_addr learned my addr 172.21.15.82:0/1296737636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 0x7f4bb015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baffff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 0x7f4bb015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 -- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 msgr2=0x7f4bb015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 0x7f4bb015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 -- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 msgr2=0x7f4bb015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 0x7f4bb015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 -- 172.21.15.82:0/1296737636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980094d0 con 0x7f4bb00cf110 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 0x7f4bb015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baffff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 0x7f4bb015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4baf7fe640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000d800 tx=0x7f4ba000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000b6c0 con 0x7f4bb00cf110 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba000b820 con 0x7f4bb00cf110 2023-07-20T10:09:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb00c9da0 con 0x7f4bb00cf110 2023-07-20T10:09:27.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba000bb90 con 0x7f4bb00cf110 2023-07-20T10:09:27.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.385+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb00ca360 con 0x7f4bb00cf110 2023-07-20T10:09:27.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb0073c70 con 0x7f4bb00cf110 2023-07-20T10:09:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4ba000bcf0 con 0x7f4bb00cf110 2023-07-20T10:09:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4bacff9640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 0x7f4b90068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4ba00844f0 con 0x7f4bb00cf110 2023-07-20T10:09:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 0x7f4b90068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.389+0000 7f4ba7fff640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 0x7f4b90068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b980ae000 tx=0x7f4b980a7000 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.393+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ba0055230 con 0x7f4bb00cf110 2023-07-20T10:09:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bb00b2590 con 0x7f4bb00cf110 2023-07-20T10:09:27.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bacff9640 1 -- 172.21.15.82:0/1296737636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f4ba0054dc0 con 0x7f4bb00cf110 2023-07-20T10:09:27.549 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:27.549 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T10:09:27.549 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T10:09:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 msgr2=0x7f4b90068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 0x7f4b90068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b980ae000 tx=0x7f4b980a7000 comp rx=0 tx=0).stop 2023-07-20T10:09:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 msgr2=0x7f4bb0157ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4ba000d800 tx=0x7f4ba000dcc0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 shutdown_connections 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f4b900663a0 0x7f4b90068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4bb015cab0 0x7f4bb015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4bb00d0d10 0x7f4bb015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 --2- 172.21.15.82:0/1296737636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bb00cf110 0x7f4bb0157ad0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 >> 172.21.15.82:0/1296737636 conn(0x7f4bb008c120 msgr2=0x7f4bb006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 shutdown_connections 2023-07-20T10:09:27.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.573+0000 7f4bb5fdf640 1 -- 172.21.15.82:0/1296737636 wait complete. 2023-07-20T10:09:27.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T10:09:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.729+0000 7f9b9d2e5640 1 Processor -- start 2023-07-20T10:09:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.729+0000 7f9b9d2e5640 1 -- start start 2023-07-20T10:09:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b9d2e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b9815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b9d2e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980cde70 con 0x7f9b980ca040 2023-07-20T10:09:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b9d2e5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980cbef0 con 0x7f9b980b1170 2023-07-20T10:09:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b9d2e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ca420 con 0x7f9b980ad060 2023-07-20T10:09:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b96ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b980ca040 0x7f9b9815c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36362/0 (socket says 172.21.15.82:36362) 2023-07-20T10:09:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b96ffd640 1 -- 172.21.15.82:0/3158638688 learned_addr learned my addr 172.21.15.82:0/3158638688 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b8e7fc640 1 --2- 172.21.15.82:0/3158638688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b9815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143985129 0 0) 0x7f9b980cde70 con 0x7f9b980ca040 2023-07-20T10:09:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b84003530 con 0x7f9b980ca040 2023-07-20T10:09:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782973026 0 0) 0x7f9b980cbef0 con 0x7f9b980b1170 2023-07-20T10:09:27.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b980cde70 con 0x7f9b980b1170 2023-07-20T10:09:27.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3158638688 >> v1:172.21.15.183:6789/0 conn(0x7f9b980b1170 legacy=0x7f9b980b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3158638688 >> v1:172.21.15.82:6789/0 conn(0x7f9b980ca040 legacy=0x7f9b9815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.733+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3158638688 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b980cdb40 con 0x7f9b980ad060 2023-07-20T10:09:27.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b8e7fc640 1 --2- 172.21.15.82:0/3158638688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b9815d020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9b880097f0 tx=0x7f9b8801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f84b37104305be3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880a7070 con 0x7f9b980ad060 2023-07-20T10:09:27.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b880ab430 con 0x7f9b980ad060 2023-07-20T10:09:27.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b967fc640 1 -- 172.21.15.82:0/3158638688 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880ab7c0 con 0x7f9b980ad060 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3158638688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 msgr2=0x7f9b9815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3158638688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b9815d020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9b880097f0 tx=0x7f9b8801c490 comp rx=0 tx=0).stop 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3158638688 shutdown_connections 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3158638688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b9815d020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3158638688 >> 172.21.15.82:0/3158638688 conn(0x7f9b980cada0 msgr2=0x7f9b980cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:27.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3158638688 shutdown_connections 2023-07-20T10:09:27.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.737+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3158638688 wait complete. 2023-07-20T10:09:27.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 Processor -- start 2023-07-20T10:09:27.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- start start 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b981573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 0x7f9b980ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980abff0 con 0x7f9b980b1170 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981578f0 con 0x7f9b980ca040 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ab3e0 con 0x7f9b980ad060 2023-07-20T10:09:27.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42258/0 (socket says 172.21.15.82:42258) 2023-07-20T10:09:27.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3701025356 learned_addr learned my addr 172.21.15.82:0/3701025356 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b96ffd640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b981573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 msgr2=0x7f9b981573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b981573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 msgr2=0x7f9b980ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b977fe640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 0x7f9b980ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 0x7f9b980ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/3701025356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009420 con 0x7f9b980b1170 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b96ffd640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b981573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b977fe640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 0x7f9b980ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8e7fc640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f9b880190a0 tx=0x7f9b8801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880bf610 con 0x7f9b980b1170 2023-07-20T10:09:27.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b880bf790 con 0x7f9b980b1170 2023-07-20T10:09:27.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880bfb40 con 0x7f9b980b1170 2023-07-20T10:09:27.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980ab6c0 con 0x7f9b980b1170 2023-07-20T10:09:27.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980abc80 con 0x7f9b980b1170 2023-07-20T10:09:27.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.741+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b980ac160 con 0x7f9b980b1170 2023-07-20T10:09:27.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.745+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9b880b5400 con 0x7f9b980b1170 2023-07-20T10:09:27.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.745+0000 7f9b8ffff640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 0x7f9b78068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:27.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.745+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f9b8811e2c0 con 0x7f9b980b1170 2023-07-20T10:09:27.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.745+0000 7f9b96ffd640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 0x7f9b78068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:27.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.745+0000 7f9b96ffd640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 0x7f9b78068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000f70 tx=0x7f9b80009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:27.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.749+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b880eb4f0 con 0x7f9b980b1170 2023-07-20T10:09:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b98073c70 con 0x7f9b980b1170 2023-07-20T10:09:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b8ffff640 1 -- 172.21.15.82:0/3701025356 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+18381 (secure 0 0 0) 0x7f9b880eeb10 con 0x7f9b980b1170 2023-07-20T10:09:27.873 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:27.874 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":137,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T10:09:25.178864+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T10:09:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 msgr2=0x7f9b78068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 0x7f9b78068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b80000f70 tx=0x7f9b80009040 comp rx=0 tx=0).stop 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 msgr2=0x7f9b9815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f9b880190a0 tx=0x7f9b8801acd0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 shutdown_connections 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f9b780663d0 0x7f9b78068890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b980ca040 0x7f9b980ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b980b1170 0x7f9b9815baf0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 --2- 172.21.15.82:0/3701025356 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b980ad060 0x7f9b981573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.897+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 >> 172.21.15.82:0/3701025356 conn(0x7f9b980cada0 msgr2=0x7f9b9806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.901+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 shutdown_connections 2023-07-20T10:09:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:27.901+0000 7f9b9d2e5640 1 -- 172.21.15.82:0/3701025356 wait complete. 2023-07-20T10:09:27.895 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T10:09:27.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:09:28.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 Processor -- start 2023-07-20T10:09:28.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 -- start start 2023-07-20T10:09:28.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f177015cab0 0x7f17700d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17700d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17700cf110 0x7f17700cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700d31c0 con 0x7f17700cf110 2023-07-20T10:09:28.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17700d16b0 con 0x7f177015cab0 2023-07-20T10:09:28.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f1777b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700b3520 con 0x7f17700d0d10 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17700cf110 0x7f17700cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17700cf110 0x7f17700cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42270/0 (socket says 172.21.15.82:42270) 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 -- 172.21.15.82:0/2552371757 learned_addr learned my addr 172.21.15.82:0/2552371757 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f177509e640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17700d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f177589f640 1 --2- 172.21.15.82:0/2552371757 >> v2:172.21.15.183:3300/0 conn(0x7f177015cab0 0x7f17700d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 -- 172.21.15.82:0/2552371757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 msgr2=0x7f17700d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17700d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 -- 172.21.15.82:0/2552371757 >> v2:172.21.15.183:3300/0 conn(0x7f177015cab0 msgr2=0x7f17700d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 --2- 172.21.15.82:0/2552371757 >> v2:172.21.15.183:3300/0 conn(0x7f177015cab0 0x7f17700d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.061+0000 7f17760a0640 1 -- 172.21.15.82:0/2552371757 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17700b2910 con 0x7f17700cf110 2023-07-20T10:09:28.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f17760a0640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700cf5a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f177006a660 tx=0x7f176801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b6183ced0db0a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f177489d640 1 -- 172.21.15.82:0/2552371757 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680a5820 con 0x7f17700cf110 2023-07-20T10:09:28.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f177489d640 1 -- 172.21.15.82:0/2552371757 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17680a5980 con 0x7f17700cf110 2023-07-20T10:09:28.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f177489d640 1 -- 172.21.15.82:0/2552371757 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680a5d10 con 0x7f17700cf110 2023-07-20T10:09:28.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 -- 172.21.15.82:0/2552371757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 msgr2=0x7f17700cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700cf5a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f177006a660 tx=0x7f176801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 -- 172.21.15.82:0/2552371757 shutdown_connections 2023-07-20T10:09:28.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700cf5a0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 --2- 172.21.15.82:0/2552371757 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17700d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 --2- 172.21.15.82:0/2552371757 >> v2:172.21.15.183:3300/0 conn(0x7f177015cab0 0x7f17700d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 -- 172.21.15.82:0/2552371757 >> 172.21.15.82:0/2552371757 conn(0x7f177008c120 msgr2=0x7f177009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 -- 172.21.15.82:0/2552371757 shutdown_connections 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.065+0000 7f1777b03640 1 -- 172.21.15.82:0/2552371757 wait complete. 2023-07-20T10:09:28.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 Processor -- start 2023-07-20T10:09:28.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- start start 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17701425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177015cab0 0x7f17700cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1770142af0 con 0x7f17700cf110 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700c84c0 con 0x7f177015cab0 2023-07-20T10:09:28.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17700c87a0 con 0x7f17700d0d10 2023-07-20T10:09:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42276/0 (socket says 172.21.15.82:42276) 2023-07-20T10:09:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 -- 172.21.15.82:0/2788029523 learned_addr learned my addr 172.21.15.82:0/2788029523 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f17760a0640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177015cab0 0x7f17700cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177509e640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17701425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 -- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 msgr2=0x7f17701425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17701425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 -- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177015cab0 msgr2=0x7f17700cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177015cab0 0x7f17700cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 -- 172.21.15.82:0/2788029523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768009b30 con 0x7f17700cf110 2023-07-20T10:09:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177509e640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17701425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f177589f640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d5f0 tx=0x7f176c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c0125f0 con 0x7f17700cf110 2023-07-20T10:09:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c012750 con 0x7f17700cf110 2023-07-20T10:09:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176c012ae0 con 0x7f17700cf110 2023-07-20T10:09:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17700c8a80 con 0x7f17700cf110 2023-07-20T10:09:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700c9040 con 0x7f17700cf110 2023-07-20T10:09:28.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.069+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1770073c70 con 0x7f17700cf110 2023-07-20T10:09:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.073+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f176c012c40 con 0x7f17700cf110 2023-07-20T10:09:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.073+0000 7f17667fc640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 0x7f1754068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.073+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f176c084360 con 0x7f17700cf110 2023-07-20T10:09:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.073+0000 7f177509e640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 0x7f1754068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.073+0000 7f177509e640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 0x7f1754068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1770155640 tx=0x7f1760008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.077+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f176c051610 con 0x7f17700cf110 2023-07-20T10:09:28.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.221+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17700b31b0 con 0x7f17540663a0 2023-07-20T10:09:28.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.233+0000 7f17667fc640 1 -- 172.21.15.82:0/2788029523 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299699 (secure 0 0 0) 0x7f176000b6f0 con 0x7f17540663a0 2023-07-20T10:09:28.211 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:28.212 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:09:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 msgr2=0x7f1754068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 0x7f1754068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1770155640 tx=0x7f1760008040 comp rx=0 tx=0).stop 2023-07-20T10:09:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 msgr2=0x7f17700c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f176c00d5f0 tx=0x7f176c00dab0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 shutdown_connections 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f17540663a0 0x7f1754068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177015cab0 0x7f17700cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17700d0d10 0x7f17701425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 --2- 172.21.15.82:0/2788029523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17700cf110 0x7f17700c7e20 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 >> 172.21.15.82:0/2788029523 conn(0x7f177008c120 msgr2=0x7f17700d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 shutdown_connections 2023-07-20T10:09:28.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.237+0000 7f1777b03640 1 -- 172.21.15.82:0/2788029523 wait complete. 2023-07-20T10:09:28.231 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:09:26.968899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337704,"kb_used_data":14140,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754637016,"statfs":{"total":773094113280,"available":772748304384,"internally_reserved":0,"allocated":14479360,"data_stored":7864234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.801786"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.180123+0000","last_change":"2023-07-20T10:09:22.180123+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.180123+0000","last_undegraded":"2023-07-20T10:09:22.180123+0000","last_fullsized":"2023-07-20T10:09:22.180123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169734+0000","last_change":"2023-07-20T10:09:22.169734+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169734+0000","last_undegraded":"2023-07-20T10:09:22.169734+0000","last_fullsized":"2023-07-20T10:09:22.169734+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.176067+0000","last_change":"2023-07-20T10:09:22.176067+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.176067+0000","last_undegraded":"2023-07-20T10:09:22.176067+0000","last_fullsized":"2023-07-20T10:09:22.176067+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169721+0000","last_change":"2023-07-20T10:09:22.169721+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169721+0000","last_undegraded":"2023-07-20T10:09:22.169721+0000","last_fullsized":"2023-07-20T10:09:22.169721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178839+0000","last_change":"2023-07-20T10:09:22.178839+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178839+0000","last_undegraded":"2023-07-20T10:09:22.178839+0000","last_fullsized":"2023-07-20T10:09:22.178839+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173034+0000","last_change":"2023-07-20T10:09:22.173034+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173034+0000","last_undegraded":"2023-07-20T10:09:22.173034+0000","last_fullsized":"2023-07-20T10:09:22.173034+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.180117+0000","last_change":"2023-07-20T10:09:22.180117+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.180117+0000","last_undegraded":"2023-07-20T10:09:22.180117+0000","last_fullsized":"2023-07-20T10:09:22.180117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.172798+0000","last_change":"2023-07-20T10:09:22.172798+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.172798+0000","last_undegraded":"2023-07-20T10:09:22.172798+0000","last_fullsized":"2023-07-20T10:09:22.172798+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169735+0000","last_change":"2023-07-20T10:09:22.169735+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169735+0000","last_undegraded":"2023-07-20T10:09:22.169735+0000","last_fullsized":"2023-07-20T10:09:22.169735+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173920+0000","last_change":"2023-07-20T10:09:22.173920+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173920+0000","last_undegraded":"2023-07-20T10:09:22.173920+0000","last_fullsized":"2023-07-20T10:09:22.173920+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175509+0000","last_change":"2023-07-20T10:09:22.175509+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175509+0000","last_undegraded":"2023-07-20T10:09:22.175509+0000","last_fullsized":"2023-07-20T10:09:22.175509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175427+0000","last_change":"2023-07-20T10:09:22.175427+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175427+0000","last_undegraded":"2023-07-20T10:09:22.175427+0000","last_fullsized":"2023-07-20T10:09:22.175427+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.172829+0000","last_change":"2023-07-20T10:09:22.172829+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.172829+0000","last_undegraded":"2023-07-20T10:09:22.172829+0000","last_fullsized":"2023-07-20T10:09:22.172829+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175491+0000","last_change":"2023-07-20T10:09:22.175491+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175491+0000","last_undegraded":"2023-07-20T10:09:22.175491+0000","last_fullsized":"2023-07-20T10:09:22.175491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170861+0000","last_change":"2023-07-20T10:09:22.170861+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170861+0000","last_undegraded":"2023-07-20T10:09:22.170861+0000","last_fullsized":"2023-07-20T10:09:22.170861+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.176183+0000","last_change":"2023-07-20T10:09:22.176183+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.176183+0000","last_undegraded":"2023-07-20T10:09:22.176183+0000","last_fullsized":"2023-07-20T10:09:22.176183+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173831+0000","last_change":"2023-07-20T10:09:22.173831+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173831+0000","last_undegraded":"2023-07-20T10:09:22.173831+0000","last_fullsized":"2023-07-20T10:09:22.173831+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178979+0000","last_change":"2023-07-20T10:09:22.178979+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178979+0000","last_undegraded":"2023-07-20T10:09:22.178979+0000","last_fullsized":"2023-07-20T10:09:22.178979+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179571+0000","last_change":"2023-07-20T10:09:22.179571+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179571+0000","last_undegraded":"2023-07-20T10:09:22.179571+0000","last_fullsized":"2023-07-20T10:09:22.179571+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173878+0000","last_change":"2023-07-20T10:09:22.173878+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173878+0000","last_undegraded":"2023-07-20T10:09:22.173878+0000","last_fullsized":"2023-07-20T10:09:22.173878+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178282+0000","last_change":"2023-07-20T10:09:22.178282+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178282+0000","last_undegraded":"2023-07-20T10:09:22.178282+0000","last_fullsized":"2023-07-20T10:09:22.178282+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178344+0000","last_change":"2023-07-20T10:09:22.178344+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178344+0000","last_undegraded":"2023-07-20T10:09:22.178344+0000","last_fullsized":"2023-07-20T10:09:22.178344+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173108+0000","last_change":"2023-07-20T10:09:22.173108+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173108+0000","last_undegraded":"2023-07-20T10:09:22.173108+0000","last_fullsized":"2023-07-20T10:09:22.173108+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175491+0000","last_change":"2023-07-20T10:09:22.175491+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175491+0000","last_undegraded":"2023-07-20T10:09:22.175491+0000","last_fullsized":"2023-07-20T10:09:22.175491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170797+0000","last_change":"2023-07-20T10:09:22.170797+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170797+0000","last_undegraded":"2023-07-20T10:09:22.170797+0000","last_fullsized":"2023-07-20T10:09:22.170797+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"126'227","reported_seq":762,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.177017+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:09:22.177017+0000","last_peered":"2023-07-20T10:09:22.177017+0000","last_clean":"2023-07-20T10:09:22.177017+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:09:22.177017+0000","last_undegraded":"2023-07-20T10:09:22.177017+0000","last_fullsized":"2023-07-20T10:09:22.177017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:01.458749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":242,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180903+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:09:22.180903+0000","last_peered":"2023-07-20T10:09:22.180903+0000","last_clean":"2023-07-20T10:09:22.180903+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:09:22.180903+0000","last_undegraded":"2023-07-20T10:09:22.180903+0000","last_fullsized":"2023-07-20T10:09:22.180903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:25.491243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170728+0000","last_change":"2023-07-20T10:09:22.170728+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170728+0000","last_undegraded":"2023-07-20T10:09:22.170728+0000","last_fullsized":"2023-07-20T10:09:22.170728+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.176878+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:09:22.176878+0000","last_peered":"2023-07-20T10:09:22.176878+0000","last_clean":"2023-07-20T10:09:22.176878+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:09:22.176878+0000","last_undegraded":"2023-07-20T10:09:22.176878+0000","last_fullsized":"2023-07-20T10:09:22.176878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:19:08.241167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.171098+0000","last_change":"2023-07-20T10:09:22.171098+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.171098+0000","last_undegraded":"2023-07-20T10:09:22.171098+0000","last_fullsized":"2023-07-20T10:09:22.171098+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.174301+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:09:22.174301+0000","last_peered":"2023-07-20T10:09:22.174301+0000","last_clean":"2023-07-20T10:09:22.174301+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:09:22.174301+0000","last_undegraded":"2023-07-20T10:09:22.174301+0000","last_fullsized":"2023-07-20T10:09:22.174301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:46:39.499584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.171947+0000","last_change":"2023-07-20T10:09:22.171947+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.171947+0000","last_undegraded":"2023-07-20T10:09:22.171947+0000","last_fullsized":"2023-07-20T10:09:22.171947+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":242,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180850+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:09:22.180850+0000","last_peered":"2023-07-20T10:09:22.180850+0000","last_clean":"2023-07-20T10:09:22.180850+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:09:22.180850+0000","last_undegraded":"2023-07-20T10:09:22.180850+0000","last_fullsized":"2023-07-20T10:09:22.180850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:42.522896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179626+0000","last_change":"2023-07-20T10:09:22.179626+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179626+0000","last_undegraded":"2023-07-20T10:09:22.179626+0000","last_fullsized":"2023-07-20T10:09:22.179626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.171360+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:09:22.171360+0000","last_peered":"2023-07-20T10:09:22.171360+0000","last_clean":"2023-07-20T10:09:22.171360+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:09:22.171360+0000","last_undegraded":"2023-07-20T10:09:22.171360+0000","last_fullsized":"2023-07-20T10:09:22.171360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:28:14.462668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179756+0000","last_change":"2023-07-20T10:09:22.179756+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179756+0000","last_undegraded":"2023-07-20T10:09:22.179756+0000","last_fullsized":"2023-07-20T10:09:22.179756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.177332+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:09:22.177332+0000","last_peered":"2023-07-20T10:09:22.177332+0000","last_clean":"2023-07-20T10:09:22.177332+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:09:22.177332+0000","last_undegraded":"2023-07-20T10:09:22.177332+0000","last_fullsized":"2023-07-20T10:09:22.177332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:24.755315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179118+0000","last_change":"2023-07-20T10:09:22.179118+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179118+0000","last_undegraded":"2023-07-20T10:09:22.179118+0000","last_fullsized":"2023-07-20T10:09:22.179118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.171812+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:09:22.171812+0000","last_peered":"2023-07-20T10:09:22.171812+0000","last_clean":"2023-07-20T10:09:22.171812+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:09:22.171812+0000","last_undegraded":"2023-07-20T10:09:22.171812+0000","last_fullsized":"2023-07-20T10:09:22.171812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:15:22.402549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170803+0000","last_change":"2023-07-20T10:09:22.170803+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170803+0000","last_undegraded":"2023-07-20T10:09:22.170803+0000","last_fullsized":"2023-07-20T10:09:22.170803+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":213,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180453+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:09:22.180453+0000","last_peered":"2023-07-20T10:09:22.180453+0000","last_clean":"2023-07-20T10:09:22.180453+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:09:22.180453+0000","last_undegraded":"2023-07-20T10:09:22.180453+0000","last_fullsized":"2023-07-20T10:09:22.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:53.415170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59560,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312280,"statfs":{"total":96636764160,"available":96575774720,"internally_reserved":0,"allocated":2256896,"data_stored":1426580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.153,"15min":1.153},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71399999999999997,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.92100000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.35999999999999999},"max":{"1min":1.018,"5min":1.05,"15min":1.075},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0329999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.01,"15min":1.716},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.3759999999999999,"15min":1.758},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.82999999999999996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0149999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.436,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.8},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.995,"15min":0.999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.84699999999999998,"5min":0.97699999999999998,"15min":1.1220000000000001},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.73199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.77500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.29599999999999999},"max":{"1min":0.86199999999999999,"5min":0.99299999999999999,"15min":1.1259999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.103},"last":0.626}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.0389999999999999,"5min":1.1000000000000001,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.173},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":1.135,"15min":1.135},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.024,"15min":1.0549999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.84999999999999998,"5min":1.02,"15min":1.155},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.77000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1650688,"data_stored":830014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.0620000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40899999999999997},"max":{"1min":0.92000000000000004,"5min":1.036,"15min":1.036},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.034},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":0.879,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0089999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":1.012,"15min":1.0680000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":1.085},"last":0.751}]},{"osd":1,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":1.141},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.96699999999999997,"5min":0.98599999999999999,"15min":1.363},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":1.0169999999999999,"15min":1.177},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.0049999999999999,"15min":1.23},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.196},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32700000000000001},"max":{"1min":0.878,"5min":0.97199999999999998,"15min":1.004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36836,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335004,"statfs":{"total":96636764160,"available":96599044096,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.443},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.497},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.873,"5min":1.083,"15min":1.1890000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.78000000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":1.071,"15min":1.381},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":1.107,"15min":1.274},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":1.04,"15min":1.131},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":1.018,"15min":1.4399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.56399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.155,"15min":1.5049999999999999},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54884,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.68899999999999995,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.622,"5min":0.77500000000000002,"15min":0.96899999999999997},"last":0.38}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.93000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.25},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41899999999999998},"max":{"1min":1.073,"5min":1.127,"15min":1.2689999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.45700000000000002},"max":{"1min":1.083,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.095,"5min":1.218,"15min":1.3240000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.143,"15min":1.292},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.028,"5min":1.204,"15min":1.393},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60499999999999998,"5min":0.79100000000000004,"15min":0.82599999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95099999999999996,"5min":1.399,"15min":1.399},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0329999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.76000000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.026}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.995},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.117},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575074,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2256896,"data_stored":1426580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.45400000000000001},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0710000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.51700000000000002,"15min":0.54500000000000004},"min":{"1min":0.29199999999999998,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.625,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":3.2509999999999999},"last":0.434},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73999999999999999,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0409999999999999,"5min":1.232,"15min":1.6779999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.216,"15min":3.125},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.044,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":3.161},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0209999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.0880000000000001,"5min":1.3089999999999999,"15min":1.766},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:09:28.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:09:28.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:09:28.326 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:09:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.441+0000 7fb50c6f9640 1 Processor -- start 2023-07-20T10:09:28.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.441+0000 7fb50c6f9640 1 -- start start 2023-07-20T10:09:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50c6f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb5040afda0 0x7fb5040ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50c6f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040b12a0 con 0x7fb5040b2060 2023-07-20T10:09:28.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50c6f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5040b1580 con 0x7fb50415a8e0 2023-07-20T10:09:28.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50c6f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5040b3160 con 0x7fb5040afda0 2023-07-20T10:09:28.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50ac96640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb5040b2060 0x7fb5040b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36368/0 (socket says 172.21.15.82:36368) 2023-07-20T10:09:28.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50ac96640 1 -- 172.21.15.82:0/2465271519 learned_addr learned my addr 172.21.15.82:0/2465271519 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006895291 0 0) 0x7fb5040b12a0 con 0x7fb5040b2060 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f0003530 con 0x7fb5040b2060 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 --2- 172.21.15.82:0/2465271519 >> v2:172.21.15.183:3300/0 conn(0x7fb5040afda0 0x7fb5040ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1673970976 0 0) 0x7fb4f0003530 con 0x7fb5040b2060 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 >> v2:172.21.15.183:3300/0 conn(0x7fb5040afda0 msgr2=0x7fb5040ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 --2- 172.21.15.82:0/2465271519 >> v2:172.21.15.183:3300/0 conn(0x7fb5040afda0 0x7fb5040ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 >> v1:172.21.15.183:6789/0 conn(0x7fb50415a8e0 legacy=0x7fb5040b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040b1860 con 0x7fb5040b2060 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fb4fc001a00 con 0x7fb5040b2060 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 >> v1:172.21.15.82:6789/0 conn(0x7fb5040b2060 legacy=0x7fb5040b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 0x7fb4f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4f00047d0 0x7fb4f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0005390 0x7fb4f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040b3160 con 0x7fb4f0003980 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000c220 con 0x7fb4f00047d0 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f000c3e0 con 0x7fb4f0005390 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 0x7fb4f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509c94640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4f00047d0 0x7fb4f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50ac96640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0005390 0x7fb4f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 -- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0005390 msgr2=0x7fb4f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0005390 0x7fb4f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 -- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4f00047d0 msgr2=0x7fb4f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4f00047d0 0x7fb4f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50a495640 1 -- 172.21.15.82:0/2465271519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0003530 con 0x7fb4f0003980 2023-07-20T10:09:28.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb50ac96640 1 -- 172.21.15.82:0/2465271519 reap_dead start 2023-07-20T10:09:28.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.445+0000 7fb509c94640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4f00047d0 0x7fb4f0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50a495640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 0x7fb4f0003da0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb50000ba30 tx=0x7fb50001c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454609bd5d3bd549 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000ac5f0 con 0x7fb4f0003980 2023-07-20T10:09:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5000ac750 con 0x7fb4f0003980 2023-07-20T10:09:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb509493640 1 -- 172.21.15.82:0/2465271519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000acb00 con 0x7fb4f0003980 2023-07-20T10:09:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 -- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 msgr2=0x7fb4f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 0x7fb4f0003da0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb50000ba30 tx=0x7fb50001c650 comp rx=0 tx=0).stop 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 -- 172.21.15.82:0/2465271519 shutdown_connections 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/2465271519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4f0003980 0x7fb4f0003da0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 -- 172.21.15.82:0/2465271519 >> 172.21.15.82:0/2465271519 conn(0x7fb5040cada0 msgr2=0x7fb5040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 -- 172.21.15.82:0/2465271519 shutdown_connections 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.449+0000 7fb50c6f9640 1 -- 172.21.15.82:0/2465271519 wait complete. 2023-07-20T10:09:28.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 Processor -- start 2023-07-20T10:09:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- start start 2023-07-20T10:09:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0003980 0x7fb5040cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 0x7fb50415bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cde70 con 0x7fb5040ccce0 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cd260 con 0x7fb5041f9b40 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cd540 con 0x7fb4f0003980 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42296/0 (socket says 172.21.15.82:42296) 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 -- 172.21.15.82:0/312282811 learned_addr learned my addr 172.21.15.82:0/312282811 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50a495640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0003980 0x7fb5040cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb509c94640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 0x7fb50415bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 -- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0003980 msgr2=0x7fb5040cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0003980 0x7fb5040cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 -- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 msgr2=0x7fb50415bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 0x7fb50415bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 -- 172.21.15.82:0/312282811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040b2f30 con 0x7fb5040ccce0 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb509c94640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 0x7fb50415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:28.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50ac96640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb5040cf3b0 tx=0x7fb4fc007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00ea80 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00ebe0 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc013420 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040cd820 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5041f8ff0 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.453+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504073c70 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.457+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb4fc013580 con 0x7fb5040ccce0 2023-07-20T10:09:28.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.457+0000 7fb4faffd640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 0x7fb4e8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.457+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb4fc084120 con 0x7fb5040ccce0 2023-07-20T10:09:28.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.457+0000 7fb50a495640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 0x7fb4e8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.457+0000 7fb50a495640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 0x7fb4e8068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5000b0000 tx=0x7fb5000b7040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.461+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4fc051460 con 0x7fb5040ccce0 2023-07-20T10:09:28.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.605+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb50415bd70 con 0x7fb4e80663d0 2023-07-20T10:09:28.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.613+0000 7fb4faffd640 1 -- 172.21.15.82:0/312282811 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299699 (secure 0 0 0) 0x7fb50415bd70 con 0x7fb4e80663d0 2023-07-20T10:09:28.590 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:28.592 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 msgr2=0x7fb4e8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 0x7fb4e8068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5000b0000 tx=0x7fb5000b7040 comp rx=0 tx=0).stop 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 msgr2=0x7fb50415c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb5040cf3b0 tx=0x7fb4fc007bc0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 shutdown_connections 2023-07-20T10:09:28.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4e80663d0 0x7fb4e8068890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb5040ccce0 0x7fb50415c4b0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5041f9b40 0x7fb50415bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 --2- 172.21.15.82:0/312282811 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4f0003980 0x7fb5040cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 >> 172.21.15.82:0/312282811 conn(0x7fb5040cada0 msgr2=0x7fb50406c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 shutdown_connections 2023-07-20T10:09:28.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.617+0000 7fb50c6f9640 1 -- 172.21.15.82:0/312282811 wait complete. 2023-07-20T10:09:28.611 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T10:09:26.968899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337704,"kb_used_data":14140,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754637016,"statfs":{"total":773094113280,"available":772748304384,"internally_reserved":0,"allocated":14479360,"data_stored":7864234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.801786"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.180123+0000","last_change":"2023-07-20T10:09:22.180123+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.180123+0000","last_undegraded":"2023-07-20T10:09:22.180123+0000","last_fullsized":"2023-07-20T10:09:22.180123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169734+0000","last_change":"2023-07-20T10:09:22.169734+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169734+0000","last_undegraded":"2023-07-20T10:09:22.169734+0000","last_fullsized":"2023-07-20T10:09:22.169734+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.176067+0000","last_change":"2023-07-20T10:09:22.176067+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.176067+0000","last_undegraded":"2023-07-20T10:09:22.176067+0000","last_fullsized":"2023-07-20T10:09:22.176067+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169721+0000","last_change":"2023-07-20T10:09:22.169721+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169721+0000","last_undegraded":"2023-07-20T10:09:22.169721+0000","last_fullsized":"2023-07-20T10:09:22.169721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178839+0000","last_change":"2023-07-20T10:09:22.178839+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178839+0000","last_undegraded":"2023-07-20T10:09:22.178839+0000","last_fullsized":"2023-07-20T10:09:22.178839+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173034+0000","last_change":"2023-07-20T10:09:22.173034+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173034+0000","last_undegraded":"2023-07-20T10:09:22.173034+0000","last_fullsized":"2023-07-20T10:09:22.173034+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.180117+0000","last_change":"2023-07-20T10:09:22.180117+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.180117+0000","last_undegraded":"2023-07-20T10:09:22.180117+0000","last_fullsized":"2023-07-20T10:09:22.180117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.172798+0000","last_change":"2023-07-20T10:09:22.172798+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.172798+0000","last_undegraded":"2023-07-20T10:09:22.172798+0000","last_fullsized":"2023-07-20T10:09:22.172798+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.169735+0000","last_change":"2023-07-20T10:09:22.169735+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.169735+0000","last_undegraded":"2023-07-20T10:09:22.169735+0000","last_fullsized":"2023-07-20T10:09:22.169735+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173920+0000","last_change":"2023-07-20T10:09:22.173920+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173920+0000","last_undegraded":"2023-07-20T10:09:22.173920+0000","last_fullsized":"2023-07-20T10:09:22.173920+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175509+0000","last_change":"2023-07-20T10:09:22.175509+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175509+0000","last_undegraded":"2023-07-20T10:09:22.175509+0000","last_fullsized":"2023-07-20T10:09:22.175509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175427+0000","last_change":"2023-07-20T10:09:22.175427+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175427+0000","last_undegraded":"2023-07-20T10:09:22.175427+0000","last_fullsized":"2023-07-20T10:09:22.175427+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.172829+0000","last_change":"2023-07-20T10:09:22.172829+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.172829+0000","last_undegraded":"2023-07-20T10:09:22.172829+0000","last_fullsized":"2023-07-20T10:09:22.172829+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175491+0000","last_change":"2023-07-20T10:09:22.175491+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175491+0000","last_undegraded":"2023-07-20T10:09:22.175491+0000","last_fullsized":"2023-07-20T10:09:22.175491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170861+0000","last_change":"2023-07-20T10:09:22.170861+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170861+0000","last_undegraded":"2023-07-20T10:09:22.170861+0000","last_fullsized":"2023-07-20T10:09:22.170861+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.176183+0000","last_change":"2023-07-20T10:09:22.176183+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.176183+0000","last_undegraded":"2023-07-20T10:09:22.176183+0000","last_fullsized":"2023-07-20T10:09:22.176183+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173831+0000","last_change":"2023-07-20T10:09:22.173831+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173831+0000","last_undegraded":"2023-07-20T10:09:22.173831+0000","last_fullsized":"2023-07-20T10:09:22.173831+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178979+0000","last_change":"2023-07-20T10:09:22.178979+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178979+0000","last_undegraded":"2023-07-20T10:09:22.178979+0000","last_fullsized":"2023-07-20T10:09:22.178979+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179571+0000","last_change":"2023-07-20T10:09:22.179571+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179571+0000","last_undegraded":"2023-07-20T10:09:22.179571+0000","last_fullsized":"2023-07-20T10:09:22.179571+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173878+0000","last_change":"2023-07-20T10:09:22.173878+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173878+0000","last_undegraded":"2023-07-20T10:09:22.173878+0000","last_fullsized":"2023-07-20T10:09:22.173878+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178282+0000","last_change":"2023-07-20T10:09:22.178282+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178282+0000","last_undegraded":"2023-07-20T10:09:22.178282+0000","last_fullsized":"2023-07-20T10:09:22.178282+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.178344+0000","last_change":"2023-07-20T10:09:22.178344+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.178344+0000","last_undegraded":"2023-07-20T10:09:22.178344+0000","last_fullsized":"2023-07-20T10:09:22.178344+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.173108+0000","last_change":"2023-07-20T10:09:22.173108+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.173108+0000","last_undegraded":"2023-07-20T10:09:22.173108+0000","last_fullsized":"2023-07-20T10:09:22.173108+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.175491+0000","last_change":"2023-07-20T10:09:22.175491+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.175491+0000","last_undegraded":"2023-07-20T10:09:22.175491+0000","last_fullsized":"2023-07-20T10:09:22.175491+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170797+0000","last_change":"2023-07-20T10:09:22.170797+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170797+0000","last_undegraded":"2023-07-20T10:09:22.170797+0000","last_fullsized":"2023-07-20T10:09:22.170797+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"126'227","reported_seq":762,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.177017+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:09:22.177017+0000","last_peered":"2023-07-20T10:09:22.177017+0000","last_clean":"2023-07-20T10:09:22.177017+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:09:22.177017+0000","last_undegraded":"2023-07-20T10:09:22.177017+0000","last_fullsized":"2023-07-20T10:09:22.177017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:01.458749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":242,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180903+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:09:22.180903+0000","last_peered":"2023-07-20T10:09:22.180903+0000","last_clean":"2023-07-20T10:09:22.180903+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:09:22.180903+0000","last_undegraded":"2023-07-20T10:09:22.180903+0000","last_fullsized":"2023-07-20T10:09:22.180903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:27:25.491243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170728+0000","last_change":"2023-07-20T10:09:22.170728+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170728+0000","last_undegraded":"2023-07-20T10:09:22.170728+0000","last_fullsized":"2023-07-20T10:09:22.170728+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":216,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.176878+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:09:22.176878+0000","last_peered":"2023-07-20T10:09:22.176878+0000","last_clean":"2023-07-20T10:09:22.176878+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:09:22.176878+0000","last_undegraded":"2023-07-20T10:09:22.176878+0000","last_fullsized":"2023-07-20T10:09:22.176878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:19:08.241167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.171098+0000","last_change":"2023-07-20T10:09:22.171098+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.171098+0000","last_undegraded":"2023-07-20T10:09:22.171098+0000","last_fullsized":"2023-07-20T10:09:22.171098+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":238,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.174301+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:09:22.174301+0000","last_peered":"2023-07-20T10:09:22.174301+0000","last_clean":"2023-07-20T10:09:22.174301+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:09:22.174301+0000","last_undegraded":"2023-07-20T10:09:22.174301+0000","last_fullsized":"2023-07-20T10:09:22.174301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:46:39.499584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.171947+0000","last_change":"2023-07-20T10:09:22.171947+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.171947+0000","last_undegraded":"2023-07-20T10:09:22.171947+0000","last_fullsized":"2023-07-20T10:09:22.171947+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":242,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180850+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:09:22.180850+0000","last_peered":"2023-07-20T10:09:22.180850+0000","last_clean":"2023-07-20T10:09:22.180850+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:09:22.180850+0000","last_undegraded":"2023-07-20T10:09:22.180850+0000","last_fullsized":"2023-07-20T10:09:22.180850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:50:42.522896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179626+0000","last_change":"2023-07-20T10:09:22.179626+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179626+0000","last_undegraded":"2023-07-20T10:09:22.179626+0000","last_fullsized":"2023-07-20T10:09:22.179626+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":212,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.171360+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:09:22.171360+0000","last_peered":"2023-07-20T10:09:22.171360+0000","last_clean":"2023-07-20T10:09:22.171360+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:09:22.171360+0000","last_undegraded":"2023-07-20T10:09:22.171360+0000","last_fullsized":"2023-07-20T10:09:22.171360+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:28:14.462668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179756+0000","last_change":"2023-07-20T10:09:22.179756+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179756+0000","last_undegraded":"2023-07-20T10:09:22.179756+0000","last_fullsized":"2023-07-20T10:09:22.179756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":216,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.177332+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:09:22.177332+0000","last_peered":"2023-07-20T10:09:22.177332+0000","last_clean":"2023-07-20T10:09:22.177332+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:09:22.177332+0000","last_undegraded":"2023-07-20T10:09:22.177332+0000","last_fullsized":"2023-07-20T10:09:22.177332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:24.755315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.179118+0000","last_change":"2023-07-20T10:09:22.179118+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.179118+0000","last_undegraded":"2023-07-20T10:09:22.179118+0000","last_fullsized":"2023-07-20T10:09:22.179118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.171812+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:09:22.171812+0000","last_peered":"2023-07-20T10:09:22.171812+0000","last_clean":"2023-07-20T10:09:22.171812+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:09:22.171812+0000","last_undegraded":"2023-07-20T10:09:22.171812+0000","last_fullsized":"2023-07-20T10:09:22.171812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:15:22.402549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T10:09:23.167134+0000","last_change":"2023-07-20T10:09:23.167134+0000","last_active":"2023-07-20T10:09:23.167134+0000","last_peered":"2023-07-20T10:09:23.167134+0000","last_clean":"2023-07-20T10:09:23.167134+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:23.167134+0000","last_undegraded":"2023-07-20T10:09:23.167134+0000","last_fullsized":"2023-07-20T10:09:23.167134+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-07-20T10:09:22.170803+0000","last_change":"2023-07-20T10:09:22.170803+0000","last_active":"2023-07-20T10:09:22.157127+0000","last_peered":"2023-07-20T10:09:22.157127+0000","last_clean":"2023-07-20T10:09:22.157127+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T10:09:22.170803+0000","last_undegraded":"2023-07-20T10:09:22.170803+0000","last_fullsized":"2023-07-20T10:09:22.170803+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":213,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-07-20T10:09:22.180453+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:09:22.180453+0000","last_peered":"2023-07-20T10:09:22.180453+0000","last_clean":"2023-07-20T10:09:22.180453+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:09:22.180453+0000","last_undegraded":"2023-07-20T10:09:22.180453+0000","last_fullsized":"2023-07-20T10:09:22.180453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:53.415170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59560,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312280,"statfs":{"total":96636764160,"available":96575774720,"internally_reserved":0,"allocated":2256896,"data_stored":1426580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.153,"15min":1.153},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71399999999999997,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.92100000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.35999999999999999},"max":{"1min":1.018,"5min":1.05,"15min":1.075},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0329999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.01,"15min":1.716},"last":0.57499999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.3759999999999999,"15min":1.758},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.82999999999999996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0149999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.436,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.8},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.995,"15min":0.999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.84699999999999998,"5min":0.97699999999999998,"15min":1.1220000000000001},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.73199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.77500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.29599999999999999},"max":{"1min":0.86199999999999999,"5min":0.99299999999999999,"15min":1.1259999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.103},"last":0.626}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.748}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.0389999999999999,"5min":1.1000000000000001,"15min":1.25},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.173},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":1.135,"15min":1.135},"last":0.86099999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.024,"15min":1.0549999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.84999999999999998,"5min":1.02,"15min":1.155},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.77000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50788,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321052,"statfs":{"total":96636764160,"available":96584757248,"internally_reserved":0,"allocated":1650688,"data_stored":830014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.0620000000000001},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40899999999999997},"max":{"1min":0.92000000000000004,"5min":1.036,"15min":1.036},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82399999999999995}]},{"osd":3,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.034},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":0.879,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0089999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":1.012,"15min":1.0680000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.66100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":1.085},"last":0.751}]},{"osd":1,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":1.141},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.96699999999999997,"5min":0.98599999999999999,"15min":1.363},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":1.0169999999999999,"15min":1.177},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.0049999999999999,"15min":1.23},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.196},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32700000000000001},"max":{"1min":0.878,"5min":0.97199999999999998,"15min":1.004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2649999999999999},"last":0.621},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.54700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575073,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36836,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335004,"statfs":{"total":96636764160,"available":96599044096,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.443},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.497},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.873,"5min":1.083,"15min":1.1890000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.78000000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":1.071,"15min":1.381},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":1.107,"15min":1.274},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":1.04,"15min":1.131},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":1.018,"15min":1.4399999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.56399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.155,"15min":1.5049999999999999},"last":0.68000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575073,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54884,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.68899999999999995,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.622,"5min":0.77500000000000002,"15min":0.96899999999999997},"last":0.38}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.93000000000000005},"last":0.505},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.25},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41899999999999998},"max":{"1min":1.073,"5min":1.127,"15min":1.2689999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.45700000000000002},"max":{"1min":1.083,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.095,"5min":1.218,"15min":1.3240000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.143,"15min":1.292},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.028,"5min":1.204,"15min":1.393},"last":0.755}]}]},{"osd":1,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1662976,"data_stored":836212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60499999999999998,"5min":0.79100000000000004,"15min":0.82599999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95099999999999996,"5min":1.399,"15min":1.399},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.95899999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0329999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.76000000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.026}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.995},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.89000000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.117},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575074,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2204,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2256896,"data_stored":1426580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.45400000000000001},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0710000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.51700000000000002,"15min":0.54500000000000004},"min":{"1min":0.29199999999999998,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.625,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":3.2509999999999999},"last":0.434},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73999999999999999,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0409999999999999,"5min":1.232,"15min":1.6779999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.216,"15min":3.125},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.044,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":3.161},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0209999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.0880000000000001,"5min":1.3089999999999999,"15min":1.766},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:09:28.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:09:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 Processor -- start 2023-07-20T10:09:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 -- start start 2023-07-20T10:09:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb4ac0afda0 0x7fb4ac0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 0x7fb4ac0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4ac0b2ee0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b3160 con 0x7fb4ac0afda0 2023-07-20T10:09:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4b1967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b12a0 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aa7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 0x7fb4ac0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4ab7fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb4ac0b2060 0x7fb4ac0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:42310/0 (socket says 172.21.15.82:42310) 2023-07-20T10:09:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4ab7fe640 1 -- 172.21.15.82:0/4012646502 learned_addr learned my addr 172.21.15.82:0/4012646502 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:28.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aaffd640 1 --2- 172.21.15.82:0/4012646502 >> v2:172.21.15.183:3300/0 conn(0x7fb4ac0afda0 0x7fb4ac0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/4012646502 >> v2:172.21.15.183:3300/0 conn(0x7fb4ac0afda0 msgr2=0x7fb4ac0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aa7fc640 1 --2- 172.21.15.82:0/4012646502 >> v2:172.21.15.183:3300/0 conn(0x7fb4ac0afda0 0x7fb4ac0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4a9ffb640 1 -- 172.21.15.82:0/4012646502 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602813085 0 0) 0x7fb4ac0b2ee0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/4012646502 >> v1:172.21.15.183:6789/0 conn(0x7fb4ac0b2060 legacy=0x7fb4ac0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.813+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/4012646502 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0b1580 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4aa7fc640 1 --2- 172.21.15.82:0/4012646502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 0x7fb4ac0b29a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009dc0 tx=0x7fb4a001c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c7bbd9aadeef2a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4a9ffb640 1 -- 172.21.15.82:0/4012646502 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00a58a0 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4a9ffb640 1 -- 172.21.15.82:0/4012646502 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a00a5a00 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4a9ffb640 1 -- 172.21.15.82:0/4012646502 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00a5d90 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 -- 172.21.15.82:0/4012646502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 msgr2=0x7fb4ac0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 --2- 172.21.15.82:0/4012646502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 0x7fb4ac0b29a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009dc0 tx=0x7fb4a001c7e0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 -- 172.21.15.82:0/4012646502 shutdown_connections 2023-07-20T10:09:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 --2- 172.21.15.82:0/4012646502 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac15a8e0 0x7fb4ac0b29a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 --2- 172.21.15.82:0/4012646502 >> v2:172.21.15.183:3300/0 conn(0x7fb4ac0afda0 0x7fb4ac0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 -- 172.21.15.82:0/4012646502 >> 172.21.15.82:0/4012646502 conn(0x7fb4ac0cada0 msgr2=0x7fb4ac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 -- 172.21.15.82:0/4012646502 shutdown_connections 2023-07-20T10:09:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.817+0000 7fb4b1967640 1 -- 172.21.15.82:0/4012646502 wait complete. 2023-07-20T10:09:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 Processor -- start 2023-07-20T10:09:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 -- start start 2023-07-20T10:09:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0afda0 0x7fb4ac157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac15a8e0 0x7fb4ac0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0c1a80 con 0x7fb4ac0b2060 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1583b0 con 0x7fb4ac15a8e0 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac158610 con 0x7fb4ac0afda0 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42304/0 (socket says 172.21.15.82:42304) 2023-07-20T10:09:28.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/1999777958 learned_addr learned my addr 172.21.15.82:0/1999777958 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aaffd640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0afda0 0x7fb4ac157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4ab7fe640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac15a8e0 0x7fb4ac0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0afda0 msgr2=0x7fb4ac157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0afda0 0x7fb4ac157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac15a8e0 msgr2=0x7fb4ac0abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac15a8e0 0x7fb4ac0abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 -- 172.21.15.82:0/1999777958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0009a70 con 0x7fb4ac0b2060 2023-07-20T10:09:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4aa7fc640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b0040 tx=0x7fb4a0019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00a58a0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a00b9860 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a00b9bf0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.821+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac1588f0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac158eb0 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac073c70 con 0x7fb4ac0b2060 2023-07-20T10:09:28.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb4a00b9d50 con 0x7fb4ac0b2060 2023-07-20T10:09:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb493fff640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 0x7fb498068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb4a011f280 con 0x7fb4ac0b2060 2023-07-20T10:09:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb4aaffd640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 0x7fb498068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.825+0000 7fb4aaffd640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 0x7fb498068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009ac0 tx=0x7fb49c009190 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:28.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.829+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4a00ec530 con 0x7fb4ac0b2060 2023-07-20T10:09:28.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.973+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4ac0b24b0 con 0x7fb4980663a0 2023-07-20T10:09:28.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.981+0000 7fb493fff640 1 -- 172.21.15.82:0/1999777958 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311872 (secure 0 0 0) 0x7fb49c0119e0 con 0x7fb4980663a0 2023-07-20T10:09:28.962 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:28.963 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:09:28.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 msgr2=0x7fb498068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 0x7fb498068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009ac0 tx=0x7fb49c009190 comp rx=0 tx=0).stop 2023-07-20T10:09:28.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 msgr2=0x7fb4ac1f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:28.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b0040 tx=0x7fb4a0019580 comp rx=0 tx=0).stop 2023-07-20T10:09:28.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 shutdown_connections 2023-07-20T10:09:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fb4980663a0 0x7fb498068860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4ac15a8e0 0x7fb4ac0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4ac0b2060 0x7fb4ac1f89e0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 --2- 172.21.15.82:0/1999777958 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4ac0afda0 0x7fb4ac157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 >> 172.21.15.82:0/1999777958 conn(0x7fb4ac0cada0 msgr2=0x7fb4ac156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 shutdown_connections 2023-07-20T10:09:28.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:28.985+0000 7fb4b1967640 1 -- 172.21.15.82:0/1999777958 wait complete. 2023-07-20T10:09:28.981 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:09:28.969284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338080,"kb_used_data":14504,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754636640,"statfs":{"total":773094113280,"available":772747919360,"internally_reserved":0,"allocated":14852096,"data_stored":8039100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001248"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692761+0000","last_change":"2023-07-20T10:09:24.206522+0000","last_active":"2023-07-20T10:09:25.692761+0000","last_peered":"2023-07-20T10:09:25.692761+0000","last_clean":"2023-07-20T10:09:25.692761+0000","last_became_active":"2023-07-20T10:09:24.206244+0000","last_became_peered":"2023-07-20T10:09:24.206244+0000","last_unstale":"2023-07-20T10:09:25.692761+0000","last_undegraded":"2023-07-20T10:09:25.692761+0000","last_fullsized":"2023-07-20T10:09:25.692761+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:01.404246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185412+0000","last_change":"2023-07-20T10:09:24.213055+0000","last_active":"2023-07-20T10:09:25.185412+0000","last_peered":"2023-07-20T10:09:25.185412+0000","last_clean":"2023-07-20T10:09:25.185412+0000","last_became_active":"2023-07-20T10:09:24.212765+0000","last_became_peered":"2023-07-20T10:09:24.212765+0000","last_unstale":"2023-07-20T10:09:25.185412+0000","last_undegraded":"2023-07-20T10:09:25.185412+0000","last_fullsized":"2023-07-20T10:09:25.185412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:23:46.124787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184915+0000","last_change":"2023-07-20T10:09:24.207247+0000","last_active":"2023-07-20T10:09:25.184915+0000","last_peered":"2023-07-20T10:09:25.184915+0000","last_clean":"2023-07-20T10:09:25.184915+0000","last_became_active":"2023-07-20T10:09:24.206936+0000","last_became_peered":"2023-07-20T10:09:24.206936+0000","last_unstale":"2023-07-20T10:09:25.184915+0000","last_undegraded":"2023-07-20T10:09:25.184915+0000","last_fullsized":"2023-07-20T10:09:25.184915+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:26.905876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691968+0000","last_change":"2023-07-20T10:09:24.214657+0000","last_active":"2023-07-20T10:09:25.691968+0000","last_peered":"2023-07-20T10:09:25.691968+0000","last_clean":"2023-07-20T10:09:25.691968+0000","last_became_active":"2023-07-20T10:09:24.214055+0000","last_became_peered":"2023-07-20T10:09:24.214055+0000","last_unstale":"2023-07-20T10:09:25.691968+0000","last_undegraded":"2023-07-20T10:09:25.691968+0000","last_fullsized":"2023-07-20T10:09:25.691968+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:36:40.922821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692936+0000","last_change":"2023-07-20T10:09:24.203018+0000","last_active":"2023-07-20T10:09:25.692936+0000","last_peered":"2023-07-20T10:09:25.692936+0000","last_clean":"2023-07-20T10:09:25.692936+0000","last_became_active":"2023-07-20T10:09:24.202706+0000","last_became_peered":"2023-07-20T10:09:24.202706+0000","last_unstale":"2023-07-20T10:09:25.692936+0000","last_undegraded":"2023-07-20T10:09:25.692936+0000","last_fullsized":"2023-07-20T10:09:25.692936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:24.209478+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:24.209214+0000","last_became_peered":"2023-07-20T10:09:24.209214+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:28:38.836444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527633+0000","last_change":"2023-07-20T10:09:24.213677+0000","last_active":"2023-07-20T10:09:25.527633+0000","last_peered":"2023-07-20T10:09:25.527633+0000","last_clean":"2023-07-20T10:09:25.527633+0000","last_became_active":"2023-07-20T10:09:24.213371+0000","last_became_peered":"2023-07-20T10:09:24.213371+0000","last_unstale":"2023-07-20T10:09:25.527633+0000","last_undegraded":"2023-07-20T10:09:25.527633+0000","last_fullsized":"2023-07-20T10:09:25.527633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:05.329000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183875+0000","last_change":"2023-07-20T10:09:24.203541+0000","last_active":"2023-07-20T10:09:25.183875+0000","last_peered":"2023-07-20T10:09:25.183875+0000","last_clean":"2023-07-20T10:09:25.183875+0000","last_became_active":"2023-07-20T10:09:24.198932+0000","last_became_peered":"2023-07-20T10:09:24.198932+0000","last_unstale":"2023-07-20T10:09:25.183875+0000","last_undegraded":"2023-07-20T10:09:25.183875+0000","last_fullsized":"2023-07-20T10:09:25.183875+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692348+0000","last_change":"2023-07-20T10:09:24.216551+0000","last_active":"2023-07-20T10:09:25.692348+0000","last_peered":"2023-07-20T10:09:25.692348+0000","last_clean":"2023-07-20T10:09:25.692348+0000","last_became_active":"2023-07-20T10:09:24.216236+0000","last_became_peered":"2023-07-20T10:09:24.216236+0000","last_unstale":"2023-07-20T10:09:25.692348+0000","last_undegraded":"2023-07-20T10:09:25.692348+0000","last_fullsized":"2023-07-20T10:09:25.692348+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:26.173017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185190+0000","last_change":"2023-07-20T10:09:24.212968+0000","last_active":"2023-07-20T10:09:25.185190+0000","last_peered":"2023-07-20T10:09:25.185190+0000","last_clean":"2023-07-20T10:09:25.185190+0000","last_became_active":"2023-07-20T10:09:24.212709+0000","last_became_peered":"2023-07-20T10:09:24.212709+0000","last_unstale":"2023-07-20T10:09:25.185190+0000","last_undegraded":"2023-07-20T10:09:25.185190+0000","last_fullsized":"2023-07-20T10:09:25.185190+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:23:03.374906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692547+0000","last_change":"2023-07-20T10:09:24.200709+0000","last_active":"2023-07-20T10:09:25.692547+0000","last_peered":"2023-07-20T10:09:25.692547+0000","last_clean":"2023-07-20T10:09:25.692547+0000","last_became_active":"2023-07-20T10:09:24.200442+0000","last_became_peered":"2023-07-20T10:09:24.200442+0000","last_unstale":"2023-07-20T10:09:25.692547+0000","last_undegraded":"2023-07-20T10:09:25.692547+0000","last_fullsized":"2023-07-20T10:09:25.692547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:04.433246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528125+0000","last_change":"2023-07-20T10:09:24.217395+0000","last_active":"2023-07-20T10:09:25.528125+0000","last_peered":"2023-07-20T10:09:25.528125+0000","last_clean":"2023-07-20T10:09:25.528125+0000","last_became_active":"2023-07-20T10:09:24.217001+0000","last_became_peered":"2023-07-20T10:09:24.217001+0000","last_unstale":"2023-07-20T10:09:25.528125+0000","last_undegraded":"2023-07-20T10:09:25.528125+0000","last_fullsized":"2023-07-20T10:09:25.528125+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184783+0000","last_change":"2023-07-20T10:09:24.207584+0000","last_active":"2023-07-20T10:09:25.184783+0000","last_peered":"2023-07-20T10:09:25.184783+0000","last_clean":"2023-07-20T10:09:25.184783+0000","last_became_active":"2023-07-20T10:09:24.207330+0000","last_became_peered":"2023-07-20T10:09:24.207330+0000","last_unstale":"2023-07-20T10:09:25.184783+0000","last_undegraded":"2023-07-20T10:09:25.184783+0000","last_fullsized":"2023-07-20T10:09:25.184783+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184239+0000","last_change":"2023-07-20T10:09:24.200784+0000","last_active":"2023-07-20T10:09:25.184239+0000","last_peered":"2023-07-20T10:09:25.184239+0000","last_clean":"2023-07-20T10:09:25.184239+0000","last_became_active":"2023-07-20T10:09:24.199386+0000","last_became_peered":"2023-07-20T10:09:24.199386+0000","last_unstale":"2023-07-20T10:09:25.184239+0000","last_undegraded":"2023-07-20T10:09:25.184239+0000","last_fullsized":"2023-07-20T10:09:25.184239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692261+0000","last_change":"2023-07-20T10:09:24.200123+0000","last_active":"2023-07-20T10:09:25.692261+0000","last_peered":"2023-07-20T10:09:25.692261+0000","last_clean":"2023-07-20T10:09:25.692261+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.692261+0000","last_undegraded":"2023-07-20T10:09:25.692261+0000","last_fullsized":"2023-07-20T10:09:25.692261+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:39.353011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527562+0000","last_change":"2023-07-20T10:09:24.205975+0000","last_active":"2023-07-20T10:09:25.527562+0000","last_peered":"2023-07-20T10:09:25.527562+0000","last_clean":"2023-07-20T10:09:25.527562+0000","last_became_active":"2023-07-20T10:09:24.205708+0000","last_became_peered":"2023-07-20T10:09:24.205708+0000","last_unstale":"2023-07-20T10:09:25.527562+0000","last_undegraded":"2023-07-20T10:09:25.527562+0000","last_fullsized":"2023-07-20T10:09:25.527562+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:36.557585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185292+0000","last_change":"2023-07-20T10:09:24.211548+0000","last_active":"2023-07-20T10:09:25.185292+0000","last_peered":"2023-07-20T10:09:25.185292+0000","last_clean":"2023-07-20T10:09:25.185292+0000","last_became_active":"2023-07-20T10:09:24.211287+0000","last_became_peered":"2023-07-20T10:09:24.211287+0000","last_unstale":"2023-07-20T10:09:25.185292+0000","last_undegraded":"2023-07-20T10:09:25.185292+0000","last_fullsized":"2023-07-20T10:09:25.185292+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:51.134025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185481+0000","last_change":"2023-07-20T10:09:24.207039+0000","last_active":"2023-07-20T10:09:25.185481+0000","last_peered":"2023-07-20T10:09:25.185481+0000","last_clean":"2023-07-20T10:09:25.185481+0000","last_became_active":"2023-07-20T10:09:24.206739+0000","last_became_peered":"2023-07-20T10:09:24.206739+0000","last_unstale":"2023-07-20T10:09:25.185481+0000","last_undegraded":"2023-07-20T10:09:25.185481+0000","last_fullsized":"2023-07-20T10:09:25.185481+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:21.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677166+0000","last_change":"2023-07-20T10:09:24.217285+0000","last_active":"2023-07-20T10:09:25.677166+0000","last_peered":"2023-07-20T10:09:25.677166+0000","last_clean":"2023-07-20T10:09:25.677166+0000","last_became_active":"2023-07-20T10:09:24.217006+0000","last_became_peered":"2023-07-20T10:09:24.217006+0000","last_unstale":"2023-07-20T10:09:25.677166+0000","last_undegraded":"2023-07-20T10:09:25.677166+0000","last_fullsized":"2023-07-20T10:09:25.677166+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486446+0000","last_change":"2023-07-20T10:09:24.202531+0000","last_active":"2023-07-20T10:09:25.486446+0000","last_peered":"2023-07-20T10:09:25.486446+0000","last_clean":"2023-07-20T10:09:25.486446+0000","last_became_active":"2023-07-20T10:09:24.202075+0000","last_became_peered":"2023-07-20T10:09:24.202075+0000","last_unstale":"2023-07-20T10:09:25.486446+0000","last_undegraded":"2023-07-20T10:09:25.486446+0000","last_fullsized":"2023-07-20T10:09:25.486446+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:40.802972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691807+0000","last_change":"2023-07-20T10:09:24.213309+0000","last_active":"2023-07-20T10:09:25.691807+0000","last_peered":"2023-07-20T10:09:25.691807+0000","last_clean":"2023-07-20T10:09:25.691807+0000","last_became_active":"2023-07-20T10:09:24.213018+0000","last_became_peered":"2023-07-20T10:09:24.213018+0000","last_unstale":"2023-07-20T10:09:25.691807+0000","last_undegraded":"2023-07-20T10:09:25.691807+0000","last_fullsized":"2023-07-20T10:09:25.691807+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:36:06.785715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692852+0000","last_change":"2023-07-20T10:09:24.210846+0000","last_active":"2023-07-20T10:09:25.692852+0000","last_peered":"2023-07-20T10:09:25.692852+0000","last_clean":"2023-07-20T10:09:25.692852+0000","last_became_active":"2023-07-20T10:09:24.210501+0000","last_became_peered":"2023-07-20T10:09:24.210501+0000","last_unstale":"2023-07-20T10:09:25.692852+0000","last_undegraded":"2023-07-20T10:09:25.692852+0000","last_fullsized":"2023-07-20T10:09:25.692852+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:50.189522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692032+0000","last_change":"2023-07-20T10:09:24.215719+0000","last_active":"2023-07-20T10:09:25.692032+0000","last_peered":"2023-07-20T10:09:25.692032+0000","last_clean":"2023-07-20T10:09:25.692032+0000","last_became_active":"2023-07-20T10:09:24.214104+0000","last_became_peered":"2023-07-20T10:09:24.214104+0000","last_unstale":"2023-07-20T10:09:25.692032+0000","last_undegraded":"2023-07-20T10:09:25.692032+0000","last_fullsized":"2023-07-20T10:09:25.692032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:01:24.172464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.187972+0000","last_change":"2023-07-20T10:09:24.202213+0000","last_active":"2023-07-20T10:09:25.187972+0000","last_peered":"2023-07-20T10:09:25.187972+0000","last_clean":"2023-07-20T10:09:25.187972+0000","last_became_active":"2023-07-20T10:09:24.201478+0000","last_became_peered":"2023-07-20T10:09:24.201478+0000","last_unstale":"2023-07-20T10:09:25.187972+0000","last_undegraded":"2023-07-20T10:09:25.187972+0000","last_fullsized":"2023-07-20T10:09:25.187972+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:34.488440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188824+0000","last_change":"2023-07-20T10:09:24.197064+0000","last_active":"2023-07-20T10:09:25.188824+0000","last_peered":"2023-07-20T10:09:25.188824+0000","last_clean":"2023-07-20T10:09:25.188824+0000","last_became_active":"2023-07-20T10:09:24.196604+0000","last_became_peered":"2023-07-20T10:09:24.196604+0000","last_unstale":"2023-07-20T10:09:25.188824+0000","last_undegraded":"2023-07-20T10:09:25.188824+0000","last_fullsized":"2023-07-20T10:09:25.188824+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:23:17.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486525+0000","last_change":"2023-07-20T10:09:24.203640+0000","last_active":"2023-07-20T10:09:25.486525+0000","last_peered":"2023-07-20T10:09:25.486525+0000","last_clean":"2023-07-20T10:09:25.486525+0000","last_became_active":"2023-07-20T10:09:24.203213+0000","last_became_peered":"2023-07-20T10:09:24.203213+0000","last_unstale":"2023-07-20T10:09:25.486525+0000","last_undegraded":"2023-07-20T10:09:25.486525+0000","last_fullsized":"2023-07-20T10:09:25.486525+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:49:25.919022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677174+0000","last_change":"2023-07-20T10:09:24.218504+0000","last_active":"2023-07-20T10:09:25.677174+0000","last_peered":"2023-07-20T10:09:25.677174+0000","last_clean":"2023-07-20T10:09:25.677174+0000","last_became_active":"2023-07-20T10:09:24.218162+0000","last_became_peered":"2023-07-20T10:09:24.218162+0000","last_unstale":"2023-07-20T10:09:25.677174+0000","last_undegraded":"2023-07-20T10:09:25.677174+0000","last_fullsized":"2023-07-20T10:09:25.677174+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528119+0000","last_change":"2023-07-20T10:09:24.207693+0000","last_active":"2023-07-20T10:09:25.528119+0000","last_peered":"2023-07-20T10:09:25.528119+0000","last_clean":"2023-07-20T10:09:25.528119+0000","last_became_active":"2023-07-20T10:09:24.207434+0000","last_became_peered":"2023-07-20T10:09:24.207434+0000","last_unstale":"2023-07-20T10:09:25.528119+0000","last_undegraded":"2023-07-20T10:09:25.528119+0000","last_fullsized":"2023-07-20T10:09:25.528119+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486578+0000","last_change":"2023-07-20T10:09:24.195332+0000","last_active":"2023-07-20T10:09:25.486578+0000","last_peered":"2023-07-20T10:09:25.486578+0000","last_clean":"2023-07-20T10:09:25.486578+0000","last_became_active":"2023-07-20T10:09:24.195051+0000","last_became_peered":"2023-07-20T10:09:24.195051+0000","last_unstale":"2023-07-20T10:09:25.486578+0000","last_undegraded":"2023-07-20T10:09:25.486578+0000","last_fullsized":"2023-07-20T10:09:25.486578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:59.186508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184271+0000","last_change":"2023-07-20T10:09:24.211480+0000","last_active":"2023-07-20T10:09:25.184271+0000","last_peered":"2023-07-20T10:09:25.184271+0000","last_clean":"2023-07-20T10:09:25.184271+0000","last_became_active":"2023-07-20T10:09:24.211180+0000","last_became_peered":"2023-07-20T10:09:24.211180+0000","last_unstale":"2023-07-20T10:09:25.184271+0000","last_undegraded":"2023-07-20T10:09:25.184271+0000","last_fullsized":"2023-07-20T10:09:25.184271+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188085+0000","last_change":"2023-07-20T10:09:24.194005+0000","last_active":"2023-07-20T10:09:25.188085+0000","last_peered":"2023-07-20T10:09:25.188085+0000","last_clean":"2023-07-20T10:09:25.188085+0000","last_became_active":"2023-07-20T10:09:24.193682+0000","last_became_peered":"2023-07-20T10:09:24.193682+0000","last_unstale":"2023-07-20T10:09:25.188085+0000","last_undegraded":"2023-07-20T10:09:25.188085+0000","last_fullsized":"2023-07-20T10:09:25.188085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:29:02.534279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188151+0000","last_change":"2023-07-20T10:09:24.202412+0000","last_active":"2023-07-20T10:09:25.188151+0000","last_peered":"2023-07-20T10:09:25.188151+0000","last_clean":"2023-07-20T10:09:25.188151+0000","last_became_active":"2023-07-20T10:09:24.201888+0000","last_became_peered":"2023-07-20T10:09:24.201888+0000","last_unstale":"2023-07-20T10:09:25.188151+0000","last_undegraded":"2023-07-20T10:09:25.188151+0000","last_fullsized":"2023-07-20T10:09:25.188151+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:26:54.010025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185039+0000","last_change":"2023-07-20T10:09:24.212400+0000","last_active":"2023-07-20T10:09:25.185039+0000","last_peered":"2023-07-20T10:09:25.185039+0000","last_clean":"2023-07-20T10:09:25.185039+0000","last_became_active":"2023-07-20T10:09:24.212132+0000","last_became_peered":"2023-07-20T10:09:24.212132+0000","last_unstale":"2023-07-20T10:09:25.185039+0000","last_undegraded":"2023-07-20T10:09:25.185039+0000","last_fullsized":"2023-07-20T10:09:25.185039+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"136'4","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677237+0000","last_change":"2023-07-20T10:09:23.203740+0000","last_active":"2023-07-20T10:09:25.677237+0000","last_peered":"2023-07-20T10:09:25.677237+0000","last_clean":"2023-07-20T10:09:25.677237+0000","last_became_active":"2023-07-20T10:09:23.203441+0000","last_became_peered":"2023-07-20T10:09:23.203441+0000","last_unstale":"2023-07-20T10:09:25.677237+0000","last_undegraded":"2023-07-20T10:09:25.677237+0000","last_fullsized":"2023-07-20T10:09:25.677237+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527960+0000","last_change":"2023-07-20T10:09:24.208722+0000","last_active":"2023-07-20T10:09:25.527960+0000","last_peered":"2023-07-20T10:09:25.527960+0000","last_clean":"2023-07-20T10:09:25.527960+0000","last_became_active":"2023-07-20T10:09:24.208453+0000","last_became_peered":"2023-07-20T10:09:24.208453+0000","last_unstale":"2023-07-20T10:09:25.527960+0000","last_undegraded":"2023-07-20T10:09:25.527960+0000","last_fullsized":"2023-07-20T10:09:25.527960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:43.081780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185214+0000","last_change":"2023-07-20T10:09:23.197755+0000","last_active":"2023-07-20T10:09:25.185214+0000","last_peered":"2023-07-20T10:09:25.185214+0000","last_clean":"2023-07-20T10:09:25.185214+0000","last_became_active":"2023-07-20T10:09:23.197468+0000","last_became_peered":"2023-07-20T10:09:23.197468+0000","last_unstale":"2023-07-20T10:09:25.185214+0000","last_undegraded":"2023-07-20T10:09:25.185214+0000","last_fullsized":"2023-07-20T10:09:25.185214+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:40:56.693179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188629+0000","last_change":"2023-07-20T10:09:24.207499+0000","last_active":"2023-07-20T10:09:25.188629+0000","last_peered":"2023-07-20T10:09:25.188629+0000","last_clean":"2023-07-20T10:09:25.188629+0000","last_became_active":"2023-07-20T10:09:24.207220+0000","last_became_peered":"2023-07-20T10:09:24.207220+0000","last_unstale":"2023-07-20T10:09:25.188629+0000","last_undegraded":"2023-07-20T10:09:25.188629+0000","last_fullsized":"2023-07-20T10:09:25.188629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:27:03.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692216+0000","last_change":"2023-07-20T10:09:23.209116+0000","last_active":"2023-07-20T10:09:25.692216+0000","last_peered":"2023-07-20T10:09:25.692216+0000","last_clean":"2023-07-20T10:09:25.692216+0000","last_became_active":"2023-07-20T10:09:23.208785+0000","last_became_peered":"2023-07-20T10:09:23.208785+0000","last_unstale":"2023-07-20T10:09:25.692216+0000","last_undegraded":"2023-07-20T10:09:25.692216+0000","last_fullsized":"2023-07-20T10:09:25.692216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:17.337454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692374+0000","last_change":"2023-07-20T10:09:24.216514+0000","last_active":"2023-07-20T10:09:25.692374+0000","last_peered":"2023-07-20T10:09:25.692374+0000","last_clean":"2023-07-20T10:09:25.692374+0000","last_became_active":"2023-07-20T10:09:24.216176+0000","last_became_peered":"2023-07-20T10:09:24.216176+0000","last_unstale":"2023-07-20T10:09:25.692374+0000","last_undegraded":"2023-07-20T10:09:25.692374+0000","last_fullsized":"2023-07-20T10:09:25.692374+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:42.831478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185300+0000","last_change":"2023-07-20T10:09:23.195399+0000","last_active":"2023-07-20T10:09:25.185300+0000","last_peered":"2023-07-20T10:09:25.185300+0000","last_clean":"2023-07-20T10:09:25.185300+0000","last_became_active":"2023-07-20T10:09:23.195115+0000","last_became_peered":"2023-07-20T10:09:23.195115+0000","last_unstale":"2023-07-20T10:09:25.185300+0000","last_undegraded":"2023-07-20T10:09:25.185300+0000","last_fullsized":"2023-07-20T10:09:25.185300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:24.202983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184711+0000","last_change":"2023-07-20T10:09:24.205317+0000","last_active":"2023-07-20T10:09:25.184711+0000","last_peered":"2023-07-20T10:09:25.184711+0000","last_clean":"2023-07-20T10:09:25.184711+0000","last_became_active":"2023-07-20T10:09:24.205021+0000","last_became_peered":"2023-07-20T10:09:24.205021+0000","last_unstale":"2023-07-20T10:09:25.184711+0000","last_undegraded":"2023-07-20T10:09:25.184711+0000","last_fullsized":"2023-07-20T10:09:25.184711+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692585+0000","last_change":"2023-07-20T10:09:23.203133+0000","last_active":"2023-07-20T10:09:25.692585+0000","last_peered":"2023-07-20T10:09:25.692585+0000","last_clean":"2023-07-20T10:09:25.692585+0000","last_became_active":"2023-07-20T10:09:23.202767+0000","last_became_peered":"2023-07-20T10:09:23.202767+0000","last_unstale":"2023-07-20T10:09:25.692585+0000","last_undegraded":"2023-07-20T10:09:25.692585+0000","last_fullsized":"2023-07-20T10:09:25.692585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:21.537591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692404+0000","last_change":"2023-07-20T10:09:24.204248+0000","last_active":"2023-07-20T10:09:25.692404+0000","last_peered":"2023-07-20T10:09:25.692404+0000","last_clean":"2023-07-20T10:09:25.692404+0000","last_became_active":"2023-07-20T10:09:24.203959+0000","last_became_peered":"2023-07-20T10:09:24.203959+0000","last_unstale":"2023-07-20T10:09:25.692404+0000","last_undegraded":"2023-07-20T10:09:25.692404+0000","last_fullsized":"2023-07-20T10:09:25.692404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:06:10.313498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527695+0000","last_change":"2023-07-20T10:09:23.200556+0000","last_active":"2023-07-20T10:09:25.527695+0000","last_peered":"2023-07-20T10:09:25.527695+0000","last_clean":"2023-07-20T10:09:25.527695+0000","last_became_active":"2023-07-20T10:09:23.199819+0000","last_became_peered":"2023-07-20T10:09:23.199819+0000","last_unstale":"2023-07-20T10:09:25.527695+0000","last_undegraded":"2023-07-20T10:09:25.527695+0000","last_fullsized":"2023-07-20T10:09:25.527695+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:31.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184389+0000","last_change":"2023-07-20T10:09:24.203345+0000","last_active":"2023-07-20T10:09:25.184389+0000","last_peered":"2023-07-20T10:09:25.184389+0000","last_clean":"2023-07-20T10:09:25.184389+0000","last_became_active":"2023-07-20T10:09:24.203067+0000","last_became_peered":"2023-07-20T10:09:24.203067+0000","last_unstale":"2023-07-20T10:09:25.184389+0000","last_undegraded":"2023-07-20T10:09:25.184389+0000","last_fullsized":"2023-07-20T10:09:25.184389+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188038+0000","last_change":"2023-07-20T10:09:23.200265+0000","last_active":"2023-07-20T10:09:25.188038+0000","last_peered":"2023-07-20T10:09:25.188038+0000","last_clean":"2023-07-20T10:09:25.188038+0000","last_became_active":"2023-07-20T10:09:23.199908+0000","last_became_peered":"2023-07-20T10:09:23.199908+0000","last_unstale":"2023-07-20T10:09:25.188038+0000","last_undegraded":"2023-07-20T10:09:25.188038+0000","last_fullsized":"2023-07-20T10:09:25.188038+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:40.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184873+0000","last_change":"2023-07-20T10:09:24.204484+0000","last_active":"2023-07-20T10:09:25.184873+0000","last_peered":"2023-07-20T10:09:25.184873+0000","last_clean":"2023-07-20T10:09:25.184873+0000","last_became_active":"2023-07-20T10:09:24.204185+0000","last_became_peered":"2023-07-20T10:09:24.204185+0000","last_unstale":"2023-07-20T10:09:25.184873+0000","last_undegraded":"2023-07-20T10:09:25.184873+0000","last_fullsized":"2023-07-20T10:09:25.184873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527687+0000","last_change":"2023-07-20T10:09:23.200240+0000","last_active":"2023-07-20T10:09:25.527687+0000","last_peered":"2023-07-20T10:09:25.527687+0000","last_clean":"2023-07-20T10:09:25.527687+0000","last_became_active":"2023-07-20T10:09:23.199918+0000","last_became_peered":"2023-07-20T10:09:23.199918+0000","last_unstale":"2023-07-20T10:09:25.527687+0000","last_undegraded":"2023-07-20T10:09:25.527687+0000","last_fullsized":"2023-07-20T10:09:25.527687+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:08:53.025581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188388+0000","last_change":"2023-07-20T10:09:24.202556+0000","last_active":"2023-07-20T10:09:25.188388+0000","last_peered":"2023-07-20T10:09:25.188388+0000","last_clean":"2023-07-20T10:09:25.188388+0000","last_became_active":"2023-07-20T10:09:24.202265+0000","last_became_peered":"2023-07-20T10:09:24.202265+0000","last_unstale":"2023-07-20T10:09:25.188388+0000","last_undegraded":"2023-07-20T10:09:25.188388+0000","last_fullsized":"2023-07-20T10:09:25.188388+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:03:59.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185376+0000","last_change":"2023-07-20T10:09:23.200942+0000","last_active":"2023-07-20T10:09:25.185376+0000","last_peered":"2023-07-20T10:09:25.185376+0000","last_clean":"2023-07-20T10:09:25.185376+0000","last_became_active":"2023-07-20T10:09:23.200638+0000","last_became_peered":"2023-07-20T10:09:23.200638+0000","last_unstale":"2023-07-20T10:09:25.185376+0000","last_undegraded":"2023-07-20T10:09:25.185376+0000","last_fullsized":"2023-07-20T10:09:25.185376+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:51.204187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692724+0000","last_change":"2023-07-20T10:09:24.205774+0000","last_active":"2023-07-20T10:09:25.692724+0000","last_peered":"2023-07-20T10:09:25.692724+0000","last_clean":"2023-07-20T10:09:25.692724+0000","last_became_active":"2023-07-20T10:09:24.205472+0000","last_became_peered":"2023-07-20T10:09:24.205472+0000","last_unstale":"2023-07-20T10:09:25.692724+0000","last_undegraded":"2023-07-20T10:09:25.692724+0000","last_fullsized":"2023-07-20T10:09:25.692724+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486535+0000","last_change":"2023-07-20T10:09:23.201687+0000","last_active":"2023-07-20T10:09:25.486535+0000","last_peered":"2023-07-20T10:09:25.486535+0000","last_clean":"2023-07-20T10:09:25.486535+0000","last_became_active":"2023-07-20T10:09:23.201415+0000","last_became_peered":"2023-07-20T10:09:23.201415+0000","last_unstale":"2023-07-20T10:09:25.486535+0000","last_undegraded":"2023-07-20T10:09:25.486535+0000","last_fullsized":"2023-07-20T10:09:25.486535+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:21:17.992360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528093+0000","last_change":"2023-07-20T10:09:24.209064+0000","last_active":"2023-07-20T10:09:25.528093+0000","last_peered":"2023-07-20T10:09:25.528093+0000","last_clean":"2023-07-20T10:09:25.528093+0000","last_became_active":"2023-07-20T10:09:24.208767+0000","last_became_peered":"2023-07-20T10:09:24.208767+0000","last_unstale":"2023-07-20T10:09:25.528093+0000","last_undegraded":"2023-07-20T10:09:25.528093+0000","last_fullsized":"2023-07-20T10:09:25.528093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692297+0000","last_change":"2023-07-20T10:09:23.207108+0000","last_active":"2023-07-20T10:09:25.692297+0000","last_peered":"2023-07-20T10:09:25.692297+0000","last_clean":"2023-07-20T10:09:25.692297+0000","last_became_active":"2023-07-20T10:09:23.206757+0000","last_became_peered":"2023-07-20T10:09:23.206757+0000","last_unstale":"2023-07-20T10:09:25.692297+0000","last_undegraded":"2023-07-20T10:09:25.692297+0000","last_fullsized":"2023-07-20T10:09:25.692297+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:02.620046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188963+0000","last_change":"2023-07-20T10:09:24.196874+0000","last_active":"2023-07-20T10:09:25.188963+0000","last_peered":"2023-07-20T10:09:25.188963+0000","last_clean":"2023-07-20T10:09:25.188963+0000","last_became_active":"2023-07-20T10:09:24.196208+0000","last_became_peered":"2023-07-20T10:09:24.196208+0000","last_unstale":"2023-07-20T10:09:25.188963+0000","last_undegraded":"2023-07-20T10:09:25.188963+0000","last_fullsized":"2023-07-20T10:09:25.188963+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.476155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692000+0000","last_change":"2023-07-20T10:09:23.210788+0000","last_active":"2023-07-20T10:09:25.692000+0000","last_peered":"2023-07-20T10:09:25.692000+0000","last_clean":"2023-07-20T10:09:25.692000+0000","last_became_active":"2023-07-20T10:09:23.210501+0000","last_became_peered":"2023-07-20T10:09:23.210501+0000","last_unstale":"2023-07-20T10:09:25.692000+0000","last_undegraded":"2023-07-20T10:09:25.692000+0000","last_fullsized":"2023-07-20T10:09:25.692000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:48.324992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527588+0000","last_change":"2023-07-20T10:09:24.208196+0000","last_active":"2023-07-20T10:09:25.527588+0000","last_peered":"2023-07-20T10:09:25.527588+0000","last_clean":"2023-07-20T10:09:25.527588+0000","last_became_active":"2023-07-20T10:09:24.207934+0000","last_became_peered":"2023-07-20T10:09:24.207934+0000","last_unstale":"2023-07-20T10:09:25.527588+0000","last_undegraded":"2023-07-20T10:09:25.527588+0000","last_fullsized":"2023-07-20T10:09:25.527588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:08.159051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527615+0000","last_change":"2023-07-20T10:09:23.203563+0000","last_active":"2023-07-20T10:09:25.527615+0000","last_peered":"2023-07-20T10:09:25.527615+0000","last_clean":"2023-07-20T10:09:25.527615+0000","last_became_active":"2023-07-20T10:09:23.203316+0000","last_became_peered":"2023-07-20T10:09:23.203316+0000","last_unstale":"2023-07-20T10:09:25.527615+0000","last_undegraded":"2023-07-20T10:09:25.527615+0000","last_fullsized":"2023-07-20T10:09:25.527615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183873+0000","last_change":"2023-07-20T10:09:24.200631+0000","last_active":"2023-07-20T10:09:25.183873+0000","last_peered":"2023-07-20T10:09:25.183873+0000","last_clean":"2023-07-20T10:09:25.183873+0000","last_became_active":"2023-07-20T10:09:24.200158+0000","last_became_peered":"2023-07-20T10:09:24.200158+0000","last_unstale":"2023-07-20T10:09:25.183873+0000","last_undegraded":"2023-07-20T10:09:25.183873+0000","last_fullsized":"2023-07-20T10:09:25.183873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:22.547597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691757+0000","last_change":"2023-07-20T10:09:23.208866+0000","last_active":"2023-07-20T10:09:25.691757+0000","last_peered":"2023-07-20T10:09:25.691757+0000","last_clean":"2023-07-20T10:09:25.691757+0000","last_became_active":"2023-07-20T10:09:23.208537+0000","last_became_peered":"2023-07-20T10:09:23.208537+0000","last_unstale":"2023-07-20T10:09:25.691757+0000","last_undegraded":"2023-07-20T10:09:25.691757+0000","last_fullsized":"2023-07-20T10:09:25.691757+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:06:39.750800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184484+0000","last_change":"2023-07-20T10:09:24.198304+0000","last_active":"2023-07-20T10:09:25.184484+0000","last_peered":"2023-07-20T10:09:25.184484+0000","last_clean":"2023-07-20T10:09:25.184484+0000","last_became_active":"2023-07-20T10:09:24.198020+0000","last_became_peered":"2023-07-20T10:09:24.198020+0000","last_unstale":"2023-07-20T10:09:25.184484+0000","last_undegraded":"2023-07-20T10:09:25.184484+0000","last_fullsized":"2023-07-20T10:09:25.184484+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:10.724352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184093+0000","last_change":"2023-07-20T10:09:23.205138+0000","last_active":"2023-07-20T10:09:25.184093+0000","last_peered":"2023-07-20T10:09:25.184093+0000","last_clean":"2023-07-20T10:09:25.184093+0000","last_became_active":"2023-07-20T10:09:23.204625+0000","last_became_peered":"2023-07-20T10:09:23.204625+0000","last_unstale":"2023-07-20T10:09:25.184093+0000","last_undegraded":"2023-07-20T10:09:25.184093+0000","last_fullsized":"2023-07-20T10:09:25.184093+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188126+0000","last_change":"2023-07-20T10:09:24.195459+0000","last_active":"2023-07-20T10:09:25.188126+0000","last_peered":"2023-07-20T10:09:25.188126+0000","last_clean":"2023-07-20T10:09:25.188126+0000","last_became_active":"2023-07-20T10:09:24.195081+0000","last_became_peered":"2023-07-20T10:09:24.195081+0000","last_unstale":"2023-07-20T10:09:25.188126+0000","last_undegraded":"2023-07-20T10:09:25.188126+0000","last_fullsized":"2023-07-20T10:09:25.188126+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:31.494561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691385+0000","last_change":"2023-07-20T10:09:23.208239+0000","last_active":"2023-07-20T10:09:25.691385+0000","last_peered":"2023-07-20T10:09:25.691385+0000","last_clean":"2023-07-20T10:09:25.691385+0000","last_became_active":"2023-07-20T10:09:23.207878+0000","last_became_peered":"2023-07-20T10:09:23.207878+0000","last_unstale":"2023-07-20T10:09:25.691385+0000","last_undegraded":"2023-07-20T10:09:25.691385+0000","last_fullsized":"2023-07-20T10:09:25.691385+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:34.484748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528188+0000","last_change":"2023-07-20T10:09:24.206586+0000","last_active":"2023-07-20T10:09:25.528188+0000","last_peered":"2023-07-20T10:09:25.528188+0000","last_clean":"2023-07-20T10:09:25.528188+0000","last_became_active":"2023-07-20T10:09:24.206333+0000","last_became_peered":"2023-07-20T10:09:24.206333+0000","last_unstale":"2023-07-20T10:09:25.528188+0000","last_undegraded":"2023-07-20T10:09:25.528188+0000","last_fullsized":"2023-07-20T10:09:25.528188+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528001+0000","last_change":"2023-07-20T10:09:23.201967+0000","last_active":"2023-07-20T10:09:25.528001+0000","last_peered":"2023-07-20T10:09:25.528001+0000","last_clean":"2023-07-20T10:09:25.528001+0000","last_became_active":"2023-07-20T10:09:23.201533+0000","last_became_peered":"2023-07-20T10:09:23.201533+0000","last_unstale":"2023-07-20T10:09:25.528001+0000","last_undegraded":"2023-07-20T10:09:25.528001+0000","last_fullsized":"2023-07-20T10:09:25.528001+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:31.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185042+0000","last_change":"2023-07-20T10:09:24.210036+0000","last_active":"2023-07-20T10:09:25.185042+0000","last_peered":"2023-07-20T10:09:25.185042+0000","last_clean":"2023-07-20T10:09:25.185042+0000","last_became_active":"2023-07-20T10:09:24.209776+0000","last_became_peered":"2023-07-20T10:09:24.209776+0000","last_unstale":"2023-07-20T10:09:25.185042+0000","last_undegraded":"2023-07-20T10:09:25.185042+0000","last_fullsized":"2023-07-20T10:09:25.185042+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.980522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677182+0000","last_change":"2023-07-20T10:09:23.207246+0000","last_active":"2023-07-20T10:09:25.677182+0000","last_peered":"2023-07-20T10:09:25.677182+0000","last_clean":"2023-07-20T10:09:25.677182+0000","last_became_active":"2023-07-20T10:09:23.206903+0000","last_became_peered":"2023-07-20T10:09:23.206903+0000","last_unstale":"2023-07-20T10:09:25.677182+0000","last_undegraded":"2023-07-20T10:09:25.677182+0000","last_fullsized":"2023-07-20T10:09:25.677182+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:09.714345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692629+0000","last_change":"2023-07-20T10:09:24.220166+0000","last_active":"2023-07-20T10:09:25.692629+0000","last_peered":"2023-07-20T10:09:25.692629+0000","last_clean":"2023-07-20T10:09:25.692629+0000","last_became_active":"2023-07-20T10:09:24.219885+0000","last_became_peered":"2023-07-20T10:09:24.219885+0000","last_unstale":"2023-07-20T10:09:25.692629+0000","last_undegraded":"2023-07-20T10:09:25.692629+0000","last_fullsized":"2023-07-20T10:09:25.692629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:18:50.167028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677304+0000","last_change":"2023-07-20T10:09:23.207830+0000","last_active":"2023-07-20T10:09:25.677304+0000","last_peered":"2023-07-20T10:09:25.677304+0000","last_clean":"2023-07-20T10:09:25.677304+0000","last_became_active":"2023-07-20T10:09:23.207282+0000","last_became_peered":"2023-07-20T10:09:23.207282+0000","last_unstale":"2023-07-20T10:09:25.677304+0000","last_undegraded":"2023-07-20T10:09:25.677304+0000","last_fullsized":"2023-07-20T10:09:25.677304+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486648+0000","last_change":"2023-07-20T10:09:24.196857+0000","last_active":"2023-07-20T10:09:25.486648+0000","last_peered":"2023-07-20T10:09:25.486648+0000","last_clean":"2023-07-20T10:09:25.486648+0000","last_became_active":"2023-07-20T10:09:24.196322+0000","last_became_peered":"2023-07-20T10:09:24.196322+0000","last_unstale":"2023-07-20T10:09:25.486648+0000","last_undegraded":"2023-07-20T10:09:25.486648+0000","last_fullsized":"2023-07-20T10:09:25.486648+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:34:31.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528170+0000","last_change":"2023-07-20T10:09:23.200546+0000","last_active":"2023-07-20T10:09:25.528170+0000","last_peered":"2023-07-20T10:09:25.528170+0000","last_clean":"2023-07-20T10:09:25.528170+0000","last_became_active":"2023-07-20T10:09:23.200207+0000","last_became_peered":"2023-07-20T10:09:23.200207+0000","last_unstale":"2023-07-20T10:09:25.528170+0000","last_undegraded":"2023-07-20T10:09:25.528170+0000","last_fullsized":"2023-07-20T10:09:25.528170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:52.906732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527716+0000","last_change":"2023-07-20T10:09:24.211709+0000","last_active":"2023-07-20T10:09:25.527716+0000","last_peered":"2023-07-20T10:09:25.527716+0000","last_clean":"2023-07-20T10:09:25.527716+0000","last_became_active":"2023-07-20T10:09:24.211448+0000","last_became_peered":"2023-07-20T10:09:24.211448+0000","last_unstale":"2023-07-20T10:09:25.527716+0000","last_undegraded":"2023-07-20T10:09:25.527716+0000","last_fullsized":"2023-07-20T10:09:25.527716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:14.813947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692788+0000","last_change":"2023-07-20T10:09:23.200040+0000","last_active":"2023-07-20T10:09:25.692788+0000","last_peered":"2023-07-20T10:09:25.692788+0000","last_clean":"2023-07-20T10:09:25.692788+0000","last_became_active":"2023-07-20T10:09:23.199720+0000","last_became_peered":"2023-07-20T10:09:23.199720+0000","last_unstale":"2023-07-20T10:09:25.692788+0000","last_undegraded":"2023-07-20T10:09:25.692788+0000","last_fullsized":"2023-07-20T10:09:25.692788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:22.368036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184009+0000","last_change":"2023-07-20T10:09:24.200457+0000","last_active":"2023-07-20T10:09:25.184009+0000","last_peered":"2023-07-20T10:09:25.184009+0000","last_clean":"2023-07-20T10:09:25.184009+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.184009+0000","last_undegraded":"2023-07-20T10:09:25.184009+0000","last_fullsized":"2023-07-20T10:09:25.184009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:23.378042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692867+0000","last_change":"2023-07-20T10:09:23.197179+0000","last_active":"2023-07-20T10:09:25.692867+0000","last_peered":"2023-07-20T10:09:25.692867+0000","last_clean":"2023-07-20T10:09:25.692867+0000","last_became_active":"2023-07-20T10:09:23.196779+0000","last_became_peered":"2023-07-20T10:09:23.196779+0000","last_unstale":"2023-07-20T10:09:25.692867+0000","last_undegraded":"2023-07-20T10:09:25.692867+0000","last_fullsized":"2023-07-20T10:09:25.692867+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691655+0000","last_change":"2023-07-20T10:09:24.208431+0000","last_active":"2023-07-20T10:09:25.691655+0000","last_peered":"2023-07-20T10:09:25.691655+0000","last_clean":"2023-07-20T10:09:25.691655+0000","last_became_active":"2023-07-20T10:09:24.208119+0000","last_became_peered":"2023-07-20T10:09:24.208119+0000","last_unstale":"2023-07-20T10:09:25.691655+0000","last_undegraded":"2023-07-20T10:09:25.691655+0000","last_fullsized":"2023-07-20T10:09:25.691655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:36:53.327634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:23.200286+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:23.199939+0000","last_became_peered":"2023-07-20T10:09:23.199939+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:13:55.929972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184906+0000","last_change":"2023-07-20T10:09:24.217781+0000","last_active":"2023-07-20T10:09:25.184906+0000","last_peered":"2023-07-20T10:09:25.184906+0000","last_clean":"2023-07-20T10:09:25.184906+0000","last_became_active":"2023-07-20T10:09:24.217439+0000","last_became_peered":"2023-07-20T10:09:24.217439+0000","last_unstale":"2023-07-20T10:09:25.184906+0000","last_undegraded":"2023-07-20T10:09:25.184906+0000","last_fullsized":"2023-07-20T10:09:25.184906+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:53.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691558+0000","last_change":"2023-07-20T10:09:23.204306+0000","last_active":"2023-07-20T10:09:25.691558+0000","last_peered":"2023-07-20T10:09:25.691558+0000","last_clean":"2023-07-20T10:09:25.691558+0000","last_became_active":"2023-07-20T10:09:23.204004+0000","last_became_peered":"2023-07-20T10:09:23.204004+0000","last_unstale":"2023-07-20T10:09:25.691558+0000","last_undegraded":"2023-07-20T10:09:25.691558+0000","last_fullsized":"2023-07-20T10:09:25.691558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:30:07.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691940+0000","last_change":"2023-07-20T10:09:24.213311+0000","last_active":"2023-07-20T10:09:25.691940+0000","last_peered":"2023-07-20T10:09:25.691940+0000","last_clean":"2023-07-20T10:09:25.691940+0000","last_became_active":"2023-07-20T10:09:24.213027+0000","last_became_peered":"2023-07-20T10:09:24.213027+0000","last_unstale":"2023-07-20T10:09:25.691940+0000","last_undegraded":"2023-07-20T10:09:25.691940+0000","last_fullsized":"2023-07-20T10:09:25.691940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:31.538183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"136'8","reported_seq":21,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183895+0000","last_change":"2023-07-20T10:09:23.200233+0000","last_active":"2023-07-20T10:09:25.183895+0000","last_peered":"2023-07-20T10:09:25.183895+0000","last_clean":"2023-07-20T10:09:25.183895+0000","last_became_active":"2023-07-20T10:09:23.199952+0000","last_became_peered":"2023-07-20T10:09:23.199952+0000","last_unstale":"2023-07-20T10:09:25.183895+0000","last_undegraded":"2023-07-20T10:09:25.183895+0000","last_fullsized":"2023-07-20T10:09:25.183895+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:00.394240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"126'227","reported_seq":768,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691641+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:09:25.691641+0000","last_peered":"2023-07-20T10:09:25.691641+0000","last_clean":"2023-07-20T10:09:25.691641+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:09:25.691641+0000","last_undegraded":"2023-07-20T10:09:25.691641+0000","last_fullsized":"2023-07-20T10:09:25.691641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:39.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188288+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:09:25.188288+0000","last_peered":"2023-07-20T10:09:25.188288+0000","last_clean":"2023-07-20T10:09:25.188288+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:09:25.188288+0000","last_undegraded":"2023-07-20T10:09:25.188288+0000","last_fullsized":"2023-07-20T10:09:25.188288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:50.850322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677088+0000","last_change":"2023-07-20T10:09:24.214767+0000","last_active":"2023-07-20T10:09:25.677088+0000","last_peered":"2023-07-20T10:09:25.677088+0000","last_clean":"2023-07-20T10:09:25.677088+0000","last_became_active":"2023-07-20T10:09:24.214479+0000","last_became_peered":"2023-07-20T10:09:24.214479+0000","last_unstale":"2023-07-20T10:09:25.677088+0000","last_undegraded":"2023-07-20T10:09:25.677088+0000","last_fullsized":"2023-07-20T10:09:25.677088+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184449+0000","last_change":"2023-07-20T10:09:23.195015+0000","last_active":"2023-07-20T10:09:25.184449+0000","last_peered":"2023-07-20T10:09:25.184449+0000","last_clean":"2023-07-20T10:09:25.184449+0000","last_became_active":"2023-07-20T10:09:23.194736+0000","last_became_peered":"2023-07-20T10:09:23.194736+0000","last_unstale":"2023-07-20T10:09:25.184449+0000","last_undegraded":"2023-07-20T10:09:25.184449+0000","last_fullsized":"2023-07-20T10:09:25.184449+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691340+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:09:25.691340+0000","last_peered":"2023-07-20T10:09:25.691340+0000","last_clean":"2023-07-20T10:09:25.691340+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:09:25.691340+0000","last_undegraded":"2023-07-20T10:09:25.691340+0000","last_fullsized":"2023-07-20T10:09:25.691340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:45.398983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184632+0000","last_change":"2023-07-20T10:09:24.213903+0000","last_active":"2023-07-20T10:09:25.184632+0000","last_peered":"2023-07-20T10:09:25.184632+0000","last_clean":"2023-07-20T10:09:25.184632+0000","last_became_active":"2023-07-20T10:09:24.213621+0000","last_became_peered":"2023-07-20T10:09:24.213621+0000","last_unstale":"2023-07-20T10:09:25.184632+0000","last_undegraded":"2023-07-20T10:09:25.184632+0000","last_fullsized":"2023-07-20T10:09:25.184632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:32.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184468+0000","last_change":"2023-07-20T10:09:23.195348+0000","last_active":"2023-07-20T10:09:25.184468+0000","last_peered":"2023-07-20T10:09:25.184468+0000","last_clean":"2023-07-20T10:09:25.184468+0000","last_became_active":"2023-07-20T10:09:23.194624+0000","last_became_peered":"2023-07-20T10:09:23.194624+0000","last_unstale":"2023-07-20T10:09:25.184468+0000","last_undegraded":"2023-07-20T10:09:25.184468+0000","last_fullsized":"2023-07-20T10:09:25.184468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486297+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:09:25.486297+0000","last_peered":"2023-07-20T10:09:25.486297+0000","last_clean":"2023-07-20T10:09:25.486297+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:09:25.486297+0000","last_undegraded":"2023-07-20T10:09:25.486297+0000","last_fullsized":"2023-07-20T10:09:25.486297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:36:44.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486370+0000","last_change":"2023-07-20T10:09:24.188340+0000","last_active":"2023-07-20T10:09:25.486370+0000","last_peered":"2023-07-20T10:09:25.486370+0000","last_clean":"2023-07-20T10:09:25.486370+0000","last_became_active":"2023-07-20T10:09:24.188066+0000","last_became_peered":"2023-07-20T10:09:24.188066+0000","last_unstale":"2023-07-20T10:09:25.486370+0000","last_undegraded":"2023-07-20T10:09:25.486370+0000","last_fullsized":"2023-07-20T10:09:25.486370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:13.858613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184019+0000","last_change":"2023-07-20T10:09:23.194975+0000","last_active":"2023-07-20T10:09:25.184019+0000","last_peered":"2023-07-20T10:09:25.184019+0000","last_clean":"2023-07-20T10:09:25.184019+0000","last_became_active":"2023-07-20T10:09:23.193772+0000","last_became_peered":"2023-07-20T10:09:23.193772+0000","last_unstale":"2023-07-20T10:09:25.184019+0000","last_undegraded":"2023-07-20T10:09:25.184019+0000","last_fullsized":"2023-07-20T10:09:25.184019+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:49.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188100+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:09:25.188100+0000","last_peered":"2023-07-20T10:09:25.188100+0000","last_clean":"2023-07-20T10:09:25.188100+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:09:25.188100+0000","last_undegraded":"2023-07-20T10:09:25.188100+0000","last_fullsized":"2023-07-20T10:09:25.188100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:02.671676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.676975+0000","last_change":"2023-07-20T10:09:24.216027+0000","last_active":"2023-07-20T10:09:25.676975+0000","last_peered":"2023-07-20T10:09:25.676975+0000","last_clean":"2023-07-20T10:09:25.676975+0000","last_became_active":"2023-07-20T10:09:24.215731+0000","last_became_peered":"2023-07-20T10:09:24.215731+0000","last_unstale":"2023-07-20T10:09:25.676975+0000","last_undegraded":"2023-07-20T10:09:25.676975+0000","last_fullsized":"2023-07-20T10:09:25.676975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:54.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677267+0000","last_change":"2023-07-20T10:09:23.207983+0000","last_active":"2023-07-20T10:09:25.677267+0000","last_peered":"2023-07-20T10:09:25.677267+0000","last_clean":"2023-07-20T10:09:25.677267+0000","last_became_active":"2023-07-20T10:09:23.207684+0000","last_became_peered":"2023-07-20T10:09:23.207684+0000","last_unstale":"2023-07-20T10:09:25.677267+0000","last_undegraded":"2023-07-20T10:09:25.677267+0000","last_fullsized":"2023-07-20T10:09:25.677267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":218,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185177+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:09:25.185177+0000","last_peered":"2023-07-20T10:09:25.185177+0000","last_clean":"2023-07-20T10:09:25.185177+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:09:25.185177+0000","last_undegraded":"2023-07-20T10:09:25.185177+0000","last_fullsized":"2023-07-20T10:09:25.185177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:07.742083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188608+0000","last_change":"2023-07-20T10:09:24.210555+0000","last_active":"2023-07-20T10:09:25.188608+0000","last_peered":"2023-07-20T10:09:25.188608+0000","last_clean":"2023-07-20T10:09:25.188608+0000","last_became_active":"2023-07-20T10:09:24.210282+0000","last_became_peered":"2023-07-20T10:09:24.210282+0000","last_unstale":"2023-07-20T10:09:25.188608+0000","last_undegraded":"2023-07-20T10:09:25.188608+0000","last_fullsized":"2023-07-20T10:09:25.188608+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:00:57.679158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188531+0000","last_change":"2023-07-20T10:09:23.200213+0000","last_active":"2023-07-20T10:09:25.188531+0000","last_peered":"2023-07-20T10:09:25.188531+0000","last_clean":"2023-07-20T10:09:25.188531+0000","last_became_active":"2023-07-20T10:09:23.199855+0000","last_became_peered":"2023-07-20T10:09:23.199855+0000","last_unstale":"2023-07-20T10:09:25.188531+0000","last_undegraded":"2023-07-20T10:09:25.188531+0000","last_fullsized":"2023-07-20T10:09:25.188531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:18.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692362+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:09:25.692362+0000","last_peered":"2023-07-20T10:09:25.692362+0000","last_clean":"2023-07-20T10:09:25.692362+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:09:25.692362+0000","last_undegraded":"2023-07-20T10:09:25.692362+0000","last_fullsized":"2023-07-20T10:09:25.692362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:13.906449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185543+0000","last_change":"2023-07-20T10:09:24.203211+0000","last_active":"2023-07-20T10:09:25.185543+0000","last_peered":"2023-07-20T10:09:25.185543+0000","last_clean":"2023-07-20T10:09:25.185543+0000","last_became_active":"2023-07-20T10:09:24.202899+0000","last_became_peered":"2023-07-20T10:09:24.202899+0000","last_unstale":"2023-07-20T10:09:25.185543+0000","last_undegraded":"2023-07-20T10:09:25.185543+0000","last_fullsized":"2023-07-20T10:09:25.185543+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:59.996920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"136'3","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188660+0000","last_change":"2023-07-20T10:09:23.199280+0000","last_active":"2023-07-20T10:09:25.188660+0000","last_peered":"2023-07-20T10:09:25.188660+0000","last_clean":"2023-07-20T10:09:25.188660+0000","last_became_active":"2023-07-20T10:09:23.198746+0000","last_became_peered":"2023-07-20T10:09:23.198746+0000","last_unstale":"2023-07-20T10:09:25.188660+0000","last_undegraded":"2023-07-20T10:09:25.188660+0000","last_fullsized":"2023-07-20T10:09:25.188660+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:32.920465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185271+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:09:25.185271+0000","last_peered":"2023-07-20T10:09:25.185271+0000","last_clean":"2023-07-20T10:09:25.185271+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:09:25.185271+0000","last_undegraded":"2023-07-20T10:09:25.185271+0000","last_fullsized":"2023-07-20T10:09:25.185271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:04.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188806+0000","last_change":"2023-07-20T10:09:24.197578+0000","last_active":"2023-07-20T10:09:25.188806+0000","last_peered":"2023-07-20T10:09:25.188806+0000","last_clean":"2023-07-20T10:09:25.188806+0000","last_became_active":"2023-07-20T10:09:24.197306+0000","last_became_peered":"2023-07-20T10:09:24.197306+0000","last_unstale":"2023-07-20T10:09:25.188806+0000","last_undegraded":"2023-07-20T10:09:25.188806+0000","last_fullsized":"2023-07-20T10:09:25.188806+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:42.208337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"136'6","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184545+0000","last_change":"2023-07-20T10:09:23.193201+0000","last_active":"2023-07-20T10:09:25.184545+0000","last_peered":"2023-07-20T10:09:25.184545+0000","last_clean":"2023-07-20T10:09:25.184545+0000","last_became_active":"2023-07-20T10:09:23.192873+0000","last_became_peered":"2023-07-20T10:09:23.192873+0000","last_unstale":"2023-07-20T10:09:25.184545+0000","last_undegraded":"2023-07-20T10:09:25.184545+0000","last_fullsized":"2023-07-20T10:09:25.184545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677336+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:09:25.677336+0000","last_peered":"2023-07-20T10:09:25.677336+0000","last_clean":"2023-07-20T10:09:25.677336+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:09:25.677336+0000","last_undegraded":"2023-07-20T10:09:25.677336+0000","last_fullsized":"2023-07-20T10:09:25.677336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:24.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2310144,"data_stored":1447849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.153,"15min":1.153},"last":1.038},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71399999999999997,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.92100000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.35999999999999999},"max":{"1min":1.018,"5min":1.05,"15min":1.075},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0329999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.01,"15min":1.716},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.3759999999999999,"15min":1.758},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.82999999999999996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0149999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.436,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.8},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.995,"15min":0.999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.84699999999999998,"5min":0.97699999999999998,"15min":1.1220000000000001},"last":0.93700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":857287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.73199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.77500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.29599999999999999},"max":{"1min":0.86199999999999999,"5min":0.99299999999999999,"15min":1.1259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.103},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.0389999999999999,"5min":1.1000000000000001,"15min":1.25},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.173},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":1.135,"15min":1.135},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.028},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.024,"15min":1.0549999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.84999999999999998,"5min":1.02,"15min":1.155},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.88200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1708032,"data_stored":856865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.0620000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40899999999999997},"max":{"1min":0.92000000000000004,"5min":1.036,"15min":1.036},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.034},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":0.879,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":7,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":1.012,"15min":1.0680000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834575075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1712128,"data_stored":858269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":1.085},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":1.141},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.96699999999999997,"5min":0.98599999999999999,"15min":1.363},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":1.0169999999999999,"15min":1.177},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.0049999999999999,"15min":1.23},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.196},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32700000000000001},"max":{"1min":0.878,"5min":0.97199999999999998,"15min":1.004},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2649999999999999},"last":1.032},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.0109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36888,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334952,"statfs":{"total":96636764160,"available":96598990848,"internally_reserved":0,"allocated":1716224,"data_stored":858303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.443},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.503}]},{"osd":2,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.873,"5min":1.083,"15min":1.1890000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.78000000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":1.071,"15min":1.381},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.878}]},{"osd":6,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":1.107,"15min":1.274},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":1.04,"15min":1.131},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":1.018,"15min":1.4399999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.56399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.155,"15min":1.5049999999999999},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54928,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316912,"statfs":{"total":96636764160,"available":96580517888,"internally_reserved":0,"allocated":1699840,"data_stored":856705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.68899999999999995,"15min":0.876},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.622,"5min":0.77500000000000002,"15min":0.96899999999999997},"last":0.436}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.373}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.25},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41899999999999998},"max":{"1min":1.073,"5min":1.127,"15min":1.2689999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.45700000000000002},"max":{"1min":1.083,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.095,"5min":1.218,"15min":1.3240000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.143,"15min":1.292},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.028,"5min":1.204,"15min":1.393},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":856727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.441},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60499999999999998,"5min":0.79100000000000004,"15min":0.82599999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95099999999999996,"5min":1.399,"15min":1.399},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0329999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.76000000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.117},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37464,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334376,"statfs":{"total":96636764160,"available":96598401024,"internally_reserved":0,"allocated":2297856,"data_stored":1447095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.45400000000000001},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0710000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.51700000000000002,"15min":0.54500000000000004},"min":{"1min":0.29199999999999998,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.625,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":3.2509999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73999999999999999,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0409999999999999,"5min":1.232,"15min":1.6779999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.216,"15min":3.125},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.044,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.503}]},{"osd":6,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":3.161},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0209999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.0880000000000001,"5min":1.3089999999999999,"15min":1.766},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:09:28.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T10:09:29.128 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T10:09:29.153+0000 7f43c1fda640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T10:09:29.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 Processor -- start 2023-07-20T10:09:29.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 -- start start 2023-07-20T10:09:29.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406f350 0x7feec406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feec406b970 0x7feec40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feec40b2470 0x7feec415c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40b28e0 con 0x7feec40b2470 2023-07-20T10:09:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40cf4a0 con 0x7feec406b970 2023-07-20T10:09:29.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecc493640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40ce890 con 0x7feec406f350 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feec40b2470 0x7feec415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feec9a2e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feec406b970 0x7feec40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feec40b2470 0x7feec415c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42320/0 (socket says 172.21.15.82:42320) 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 -- 172.21.15.82:0/3050257759 learned_addr learned my addr 172.21.15.82:0/3050257759 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feeca22f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406f350 0x7feec406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 -- 172.21.15.82:0/3050257759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406f350 msgr2=0x7feec406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 --2- 172.21.15.82:0/3050257759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406f350 0x7feec406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 -- 172.21.15.82:0/3050257759 >> v2:172.21.15.183:3300/0 conn(0x7feec406b970 msgr2=0x7feec40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 --2- 172.21.15.82:0/3050257759 >> v2:172.21.15.183:3300/0 conn(0x7feec406b970 0x7feec40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.185+0000 7feecaa30640 1 -- 172.21.15.82:0/3050257759 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40ceb70 con 0x7feec40b2470 2023-07-20T10:09:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecaa30640 1 --2- 172.21.15.82:0/3050257759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec415c120 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7feec408aaa0 tx=0x7feebc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e03384772d6392 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feec922d640 1 -- 172.21.15.82:0/3050257759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0ac640 con 0x7feec40b2470 2023-07-20T10:09:29.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feec922d640 1 -- 172.21.15.82:0/3050257759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc0ac7a0 con 0x7feec40b2470 2023-07-20T10:09:29.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feec922d640 1 -- 172.21.15.82:0/3050257759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0acb30 con 0x7feec40b2470 2023-07-20T10:09:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 -- 172.21.15.82:0/3050257759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 msgr2=0x7feec415c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 --2- 172.21.15.82:0/3050257759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec415c120 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7feec408aaa0 tx=0x7feebc01c440 comp rx=0 tx=0).stop 2023-07-20T10:09:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 -- 172.21.15.82:0/3050257759 shutdown_connections 2023-07-20T10:09:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 --2- 172.21.15.82:0/3050257759 >> v2:172.21.15.183:3300/0 conn(0x7feec406b970 0x7feec40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 --2- 172.21.15.82:0/3050257759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec415c120 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 --2- 172.21.15.82:0/3050257759 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406f350 0x7feec406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 -- 172.21.15.82:0/3050257759 >> 172.21.15.82:0/3050257759 conn(0x7feec4089fa0 msgr2=0x7feec40d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 -- 172.21.15.82:0/3050257759 shutdown_connections 2023-07-20T10:09:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.189+0000 7feecc493640 1 -- 172.21.15.82:0/3050257759 wait complete. 2023-07-20T10:09:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 Processor -- start 2023-07-20T10:09:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- start start 2023-07-20T10:09:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406b970 0x7feec41534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feec406f350 0x7feec415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec415e200 con 0x7feec40b2470 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec415f5f0 con 0x7feec406f350 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec415eb60 con 0x7feec406b970 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42326/0 (socket says 172.21.15.82:42326) 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 -- 172.21.15.82:0/2433503662 learned_addr learned my addr 172.21.15.82:0/2433503662 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feec9a2e640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feec406f350 0x7feec415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feeca22f640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406b970 0x7feec41534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 -- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406b970 msgr2=0x7feec41534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406b970 0x7feec41534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 -- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feec406f350 msgr2=0x7feec415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feec406f350 0x7feec415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 -- 172.21.15.82:0/2433503662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0094d0 con 0x7feec40b2470 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecaa30640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7feebc0af040 tx=0x7feebc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0b5630 con 0x7feec40b2470 2023-07-20T10:09:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc0b5790 con 0x7feec40b2470 2023-07-20T10:09:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec4150d50 con 0x7feec40b2470 2023-07-20T10:09:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc0b5b40 con 0x7feec40b2470 2023-07-20T10:09:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.193+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec415db40 con 0x7feec40b2470 2023-07-20T10:09:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec415e340 con 0x7feec40b2470 2023-07-20T10:09:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feebc0b3040 con 0x7feec40b2470 2023-07-20T10:09:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feebaffd640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 0x7feea8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7feebc11dfe0 con 0x7feec40b2470 2023-07-20T10:09:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feeca22f640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 0x7feea8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.197+0000 7feeca22f640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 0x7feea8068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feec40d0d00 tx=0x7feec000b040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.201+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feec415e340 con 0x7feec40b2470 2023-07-20T10:09:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feec415e340 con 0x7feec40b2470 2023-07-20T10:09:29.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feebaffd640 1 -- 172.21.15.82:0/2433503662 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1016 (secure 0 0 0) 0x7feec415e340 con 0x7feec40b2470 2023-07-20T10:09:29.378 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:29.378 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1168,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":346193920,"bytes_avail":772747919360,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":66,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8997}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-20T10:08:03.325016+0000","services":{}},"progress_events":{}} 2023-07-20T10:09:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 msgr2=0x7feea8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 0x7feea8068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feec40d0d00 tx=0x7feec000b040 comp rx=0 tx=0).stop 2023-07-20T10:09:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 msgr2=0x7feec4150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7feebc0af040 tx=0x7feebc0191e0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 shutdown_connections 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7feea80663a0 0x7feea8068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feec40b2470 0x7feec4150810 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feec406f350 0x7feec415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 --2- 172.21.15.82:0/2433503662 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feec406b970 0x7feec41534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 >> 172.21.15.82:0/2433503662 conn(0x7feec4089fa0 msgr2=0x7feec4154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 shutdown_connections 2023-07-20T10:09:29.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.401+0000 7feecc493640 1 -- 172.21.15.82:0/2433503662 wait complete. 2023-07-20T10:09:29.398 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T10:09:29.398 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:09:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 Processor -- start 2023-07-20T10:09:29.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 -- start start 2023-07-20T10:09:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faf3815c5e0 0x7faf380adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf38069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf380ab890 con 0x7faf380c91f0 2023-07-20T10:09:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf38069ac0 con 0x7faf3815c5e0 2023-07-20T10:09:29.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3cd40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380ce2d0 con 0x7faf380cd250 2023-07-20T10:09:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf2ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7faf380c91f0 0x7faf380ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36374/0 (socket says 172.21.15.82:36374) 2023-07-20T10:09:29.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf2ffff640 1 -- 172.21.15.82:0/214149309 learned_addr learned my addr 172.21.15.82:0/214149309 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf36d9d640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf38069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf3659c640 1 --2- 172.21.15.82:0/214149309 >> v2:172.21.15.183:3300/0 conn(0x7faf3815c5e0 0x7faf380adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332787390 0 0) 0x7faf380ab890 con 0x7faf380c91f0 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf24003530 con 0x7faf380c91f0 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 418934164 0 0) 0x7faf24003530 con 0x7faf380c91f0 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 msgr2=0x7faf38069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf38069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 >> v2:172.21.15.183:3300/0 conn(0x7faf3815c5e0 msgr2=0x7faf380adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 --2- 172.21.15.82:0/214149309 >> v2:172.21.15.183:3300/0 conn(0x7faf3815c5e0 0x7faf380adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380ce5b0 con 0x7faf380c91f0 2023-07-20T10:09:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7faf20001680 con 0x7faf380c91f0 2023-07-20T10:09:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 >> v1:172.21.15.82:6789/0 conn(0x7faf380c91f0 legacy=0x7faf380ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf24003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24003f00 0x7faf240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf24004d10 0x7faf24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf38069ac0 con 0x7faf24004d10 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380ce2d0 con 0x7faf24003f00 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.561+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2400b990 con 0x7faf380cd250 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf24004d10 0x7faf24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf3659c640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf24003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf2ffff640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24003f00 0x7faf240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 -- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 msgr2=0x7faf24003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf380cd250 0x7faf24003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 -- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24003f00 msgr2=0x7faf240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24003f00 0x7faf240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 -- 172.21.15.82:0/214149309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24003530 con 0x7faf24004d10 2023-07-20T10:09:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf36d9d640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf24004d10 0x7faf24005190 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7faf30009f90 tx=0x7faf3001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f600f4f299a2b412 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300a5c30 con 0x7faf24004d10 2023-07-20T10:09:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3000f040 con 0x7faf24004d10 2023-07-20T10:09:29.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.565+0000 7faf35d9b640 1 -- 172.21.15.82:0/214149309 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300ad440 con 0x7faf24004d10 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- 172.21.15.82:0/214149309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf24004d10 msgr2=0x7faf24005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 --2- 172.21.15.82:0/214149309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf24004d10 0x7faf24005190 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7faf30009f90 tx=0x7faf3001cbc0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 -- 172.21.15.82:0/214149309 reap_dead start 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- 172.21.15.82:0/214149309 shutdown_connections 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- 172.21.15.82:0/214149309 >> 172.21.15.82:0/214149309 conn(0x7faf380cb620 msgr2=0x7faf380cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- 172.21.15.82:0/214149309 shutdown_connections 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- 172.21.15.82:0/214149309 wait complete. 2023-07-20T10:09:29.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 Processor -- start 2023-07-20T10:09:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- start start 2023-07-20T10:09:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d10 0x7faf381f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 0x7faf380c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380c53b0 con 0x7faf380c4f00 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380c8260 con 0x7faf24004d10 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3cd40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380c26b0 con 0x7faf381f50f0 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42334/0 (socket says 172.21.15.82:42334) 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 -- 172.21.15.82:0/99459040 learned_addr learned my addr 172.21.15.82:0/99459040 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:29.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf3659c640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d10 0x7faf381f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf2ffff640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 0x7faf380c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 -- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 msgr2=0x7faf380c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 0x7faf380c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 -- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d10 msgr2=0x7faf381f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d10 0x7faf381f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf36d9d640 1 -- 172.21.15.82:0/99459040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf380c2990 con 0x7faf380c4f00 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.569+0000 7faf2ffff640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 0x7faf380c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:29.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf36d9d640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7faf300b0040 tx=0x7faf30009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300039a0 con 0x7faf380c4f00 2023-07-20T10:09:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30003b00 con 0x7faf380c4f00 2023-07-20T10:09:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30003e90 con 0x7faf380c4f00 2023-07-20T10:09:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf380c2c70 con 0x7faf380c4f00 2023-07-20T10:09:29.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380c7a40 con 0x7faf380c4f00 2023-07-20T10:09:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf38073c70 con 0x7faf380c4f00 2023-07-20T10:09:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faf300b4040 con 0x7faf380c4f00 2023-07-20T10:09:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 0x7faf18068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7faf3011dfe0 con 0x7faf380c4f00 2023-07-20T10:09:29.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.573+0000 7faf3659c640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 0x7faf18068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:29.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.577+0000 7faf3659c640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 0x7faf18068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf3806e2a0 tx=0x7faf28009190 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:29.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.577+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf300eb340 con 0x7faf380c4f00 2023-07-20T10:09:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.721+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf380c2820 con 0x7faf180663d0 2023-07-20T10:09:29.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.729+0000 7faf2effd640 1 -- 172.21.15.82:0/99459040 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311872 (secure 0 0 0) 0x7faf380c2820 con 0x7faf180663d0 2023-07-20T10:09:29.708 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:29.709 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:09:29.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 msgr2=0x7faf18068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 0x7faf18068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faf3806e2a0 tx=0x7faf28009190 comp rx=0 tx=0).stop 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 msgr2=0x7faf380c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7faf300b0040 tx=0x7faf30009750 comp rx=0 tx=0).stop 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 shutdown_connections 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7faf180663d0 0x7faf18068890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf380c4f00 0x7faf380c7500 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf381f50f0 0x7faf380c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 --2- 172.21.15.82:0/99459040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf24004d10 0x7faf381f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 >> 172.21.15.82:0/99459040 conn(0x7faf380cb620 msgr2=0x7faf38156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 shutdown_connections 2023-07-20T10:09:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:29.733+0000 7faf3cd40640 1 -- 172.21.15.82:0/99459040 wait complete. 2023-07-20T10:09:29.728 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T10:09:28.969284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338080,"kb_used_data":14504,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754636640,"statfs":{"total":773094113280,"available":772747919360,"internally_reserved":0,"allocated":14852096,"data_stored":8039100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001248"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692761+0000","last_change":"2023-07-20T10:09:24.206522+0000","last_active":"2023-07-20T10:09:25.692761+0000","last_peered":"2023-07-20T10:09:25.692761+0000","last_clean":"2023-07-20T10:09:25.692761+0000","last_became_active":"2023-07-20T10:09:24.206244+0000","last_became_peered":"2023-07-20T10:09:24.206244+0000","last_unstale":"2023-07-20T10:09:25.692761+0000","last_undegraded":"2023-07-20T10:09:25.692761+0000","last_fullsized":"2023-07-20T10:09:25.692761+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:01.404246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185412+0000","last_change":"2023-07-20T10:09:24.213055+0000","last_active":"2023-07-20T10:09:25.185412+0000","last_peered":"2023-07-20T10:09:25.185412+0000","last_clean":"2023-07-20T10:09:25.185412+0000","last_became_active":"2023-07-20T10:09:24.212765+0000","last_became_peered":"2023-07-20T10:09:24.212765+0000","last_unstale":"2023-07-20T10:09:25.185412+0000","last_undegraded":"2023-07-20T10:09:25.185412+0000","last_fullsized":"2023-07-20T10:09:25.185412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:23:46.124787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184915+0000","last_change":"2023-07-20T10:09:24.207247+0000","last_active":"2023-07-20T10:09:25.184915+0000","last_peered":"2023-07-20T10:09:25.184915+0000","last_clean":"2023-07-20T10:09:25.184915+0000","last_became_active":"2023-07-20T10:09:24.206936+0000","last_became_peered":"2023-07-20T10:09:24.206936+0000","last_unstale":"2023-07-20T10:09:25.184915+0000","last_undegraded":"2023-07-20T10:09:25.184915+0000","last_fullsized":"2023-07-20T10:09:25.184915+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:26.905876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691968+0000","last_change":"2023-07-20T10:09:24.214657+0000","last_active":"2023-07-20T10:09:25.691968+0000","last_peered":"2023-07-20T10:09:25.691968+0000","last_clean":"2023-07-20T10:09:25.691968+0000","last_became_active":"2023-07-20T10:09:24.214055+0000","last_became_peered":"2023-07-20T10:09:24.214055+0000","last_unstale":"2023-07-20T10:09:25.691968+0000","last_undegraded":"2023-07-20T10:09:25.691968+0000","last_fullsized":"2023-07-20T10:09:25.691968+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:36:40.922821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692936+0000","last_change":"2023-07-20T10:09:24.203018+0000","last_active":"2023-07-20T10:09:25.692936+0000","last_peered":"2023-07-20T10:09:25.692936+0000","last_clean":"2023-07-20T10:09:25.692936+0000","last_became_active":"2023-07-20T10:09:24.202706+0000","last_became_peered":"2023-07-20T10:09:24.202706+0000","last_unstale":"2023-07-20T10:09:25.692936+0000","last_undegraded":"2023-07-20T10:09:25.692936+0000","last_fullsized":"2023-07-20T10:09:25.692936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:24.209478+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:24.209214+0000","last_became_peered":"2023-07-20T10:09:24.209214+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:28:38.836444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527633+0000","last_change":"2023-07-20T10:09:24.213677+0000","last_active":"2023-07-20T10:09:25.527633+0000","last_peered":"2023-07-20T10:09:25.527633+0000","last_clean":"2023-07-20T10:09:25.527633+0000","last_became_active":"2023-07-20T10:09:24.213371+0000","last_became_peered":"2023-07-20T10:09:24.213371+0000","last_unstale":"2023-07-20T10:09:25.527633+0000","last_undegraded":"2023-07-20T10:09:25.527633+0000","last_fullsized":"2023-07-20T10:09:25.527633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:05.329000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183875+0000","last_change":"2023-07-20T10:09:24.203541+0000","last_active":"2023-07-20T10:09:25.183875+0000","last_peered":"2023-07-20T10:09:25.183875+0000","last_clean":"2023-07-20T10:09:25.183875+0000","last_became_active":"2023-07-20T10:09:24.198932+0000","last_became_peered":"2023-07-20T10:09:24.198932+0000","last_unstale":"2023-07-20T10:09:25.183875+0000","last_undegraded":"2023-07-20T10:09:25.183875+0000","last_fullsized":"2023-07-20T10:09:25.183875+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692348+0000","last_change":"2023-07-20T10:09:24.216551+0000","last_active":"2023-07-20T10:09:25.692348+0000","last_peered":"2023-07-20T10:09:25.692348+0000","last_clean":"2023-07-20T10:09:25.692348+0000","last_became_active":"2023-07-20T10:09:24.216236+0000","last_became_peered":"2023-07-20T10:09:24.216236+0000","last_unstale":"2023-07-20T10:09:25.692348+0000","last_undegraded":"2023-07-20T10:09:25.692348+0000","last_fullsized":"2023-07-20T10:09:25.692348+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:26.173017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185190+0000","last_change":"2023-07-20T10:09:24.212968+0000","last_active":"2023-07-20T10:09:25.185190+0000","last_peered":"2023-07-20T10:09:25.185190+0000","last_clean":"2023-07-20T10:09:25.185190+0000","last_became_active":"2023-07-20T10:09:24.212709+0000","last_became_peered":"2023-07-20T10:09:24.212709+0000","last_unstale":"2023-07-20T10:09:25.185190+0000","last_undegraded":"2023-07-20T10:09:25.185190+0000","last_fullsized":"2023-07-20T10:09:25.185190+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:23:03.374906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692547+0000","last_change":"2023-07-20T10:09:24.200709+0000","last_active":"2023-07-20T10:09:25.692547+0000","last_peered":"2023-07-20T10:09:25.692547+0000","last_clean":"2023-07-20T10:09:25.692547+0000","last_became_active":"2023-07-20T10:09:24.200442+0000","last_became_peered":"2023-07-20T10:09:24.200442+0000","last_unstale":"2023-07-20T10:09:25.692547+0000","last_undegraded":"2023-07-20T10:09:25.692547+0000","last_fullsized":"2023-07-20T10:09:25.692547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:04.433246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528125+0000","last_change":"2023-07-20T10:09:24.217395+0000","last_active":"2023-07-20T10:09:25.528125+0000","last_peered":"2023-07-20T10:09:25.528125+0000","last_clean":"2023-07-20T10:09:25.528125+0000","last_became_active":"2023-07-20T10:09:24.217001+0000","last_became_peered":"2023-07-20T10:09:24.217001+0000","last_unstale":"2023-07-20T10:09:25.528125+0000","last_undegraded":"2023-07-20T10:09:25.528125+0000","last_fullsized":"2023-07-20T10:09:25.528125+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184783+0000","last_change":"2023-07-20T10:09:24.207584+0000","last_active":"2023-07-20T10:09:25.184783+0000","last_peered":"2023-07-20T10:09:25.184783+0000","last_clean":"2023-07-20T10:09:25.184783+0000","last_became_active":"2023-07-20T10:09:24.207330+0000","last_became_peered":"2023-07-20T10:09:24.207330+0000","last_unstale":"2023-07-20T10:09:25.184783+0000","last_undegraded":"2023-07-20T10:09:25.184783+0000","last_fullsized":"2023-07-20T10:09:25.184783+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184239+0000","last_change":"2023-07-20T10:09:24.200784+0000","last_active":"2023-07-20T10:09:25.184239+0000","last_peered":"2023-07-20T10:09:25.184239+0000","last_clean":"2023-07-20T10:09:25.184239+0000","last_became_active":"2023-07-20T10:09:24.199386+0000","last_became_peered":"2023-07-20T10:09:24.199386+0000","last_unstale":"2023-07-20T10:09:25.184239+0000","last_undegraded":"2023-07-20T10:09:25.184239+0000","last_fullsized":"2023-07-20T10:09:25.184239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692261+0000","last_change":"2023-07-20T10:09:24.200123+0000","last_active":"2023-07-20T10:09:25.692261+0000","last_peered":"2023-07-20T10:09:25.692261+0000","last_clean":"2023-07-20T10:09:25.692261+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.692261+0000","last_undegraded":"2023-07-20T10:09:25.692261+0000","last_fullsized":"2023-07-20T10:09:25.692261+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:39.353011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527562+0000","last_change":"2023-07-20T10:09:24.205975+0000","last_active":"2023-07-20T10:09:25.527562+0000","last_peered":"2023-07-20T10:09:25.527562+0000","last_clean":"2023-07-20T10:09:25.527562+0000","last_became_active":"2023-07-20T10:09:24.205708+0000","last_became_peered":"2023-07-20T10:09:24.205708+0000","last_unstale":"2023-07-20T10:09:25.527562+0000","last_undegraded":"2023-07-20T10:09:25.527562+0000","last_fullsized":"2023-07-20T10:09:25.527562+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:36.557585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185292+0000","last_change":"2023-07-20T10:09:24.211548+0000","last_active":"2023-07-20T10:09:25.185292+0000","last_peered":"2023-07-20T10:09:25.185292+0000","last_clean":"2023-07-20T10:09:25.185292+0000","last_became_active":"2023-07-20T10:09:24.211287+0000","last_became_peered":"2023-07-20T10:09:24.211287+0000","last_unstale":"2023-07-20T10:09:25.185292+0000","last_undegraded":"2023-07-20T10:09:25.185292+0000","last_fullsized":"2023-07-20T10:09:25.185292+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:51.134025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185481+0000","last_change":"2023-07-20T10:09:24.207039+0000","last_active":"2023-07-20T10:09:25.185481+0000","last_peered":"2023-07-20T10:09:25.185481+0000","last_clean":"2023-07-20T10:09:25.185481+0000","last_became_active":"2023-07-20T10:09:24.206739+0000","last_became_peered":"2023-07-20T10:09:24.206739+0000","last_unstale":"2023-07-20T10:09:25.185481+0000","last_undegraded":"2023-07-20T10:09:25.185481+0000","last_fullsized":"2023-07-20T10:09:25.185481+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:21.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677166+0000","last_change":"2023-07-20T10:09:24.217285+0000","last_active":"2023-07-20T10:09:25.677166+0000","last_peered":"2023-07-20T10:09:25.677166+0000","last_clean":"2023-07-20T10:09:25.677166+0000","last_became_active":"2023-07-20T10:09:24.217006+0000","last_became_peered":"2023-07-20T10:09:24.217006+0000","last_unstale":"2023-07-20T10:09:25.677166+0000","last_undegraded":"2023-07-20T10:09:25.677166+0000","last_fullsized":"2023-07-20T10:09:25.677166+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486446+0000","last_change":"2023-07-20T10:09:24.202531+0000","last_active":"2023-07-20T10:09:25.486446+0000","last_peered":"2023-07-20T10:09:25.486446+0000","last_clean":"2023-07-20T10:09:25.486446+0000","last_became_active":"2023-07-20T10:09:24.202075+0000","last_became_peered":"2023-07-20T10:09:24.202075+0000","last_unstale":"2023-07-20T10:09:25.486446+0000","last_undegraded":"2023-07-20T10:09:25.486446+0000","last_fullsized":"2023-07-20T10:09:25.486446+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:40.802972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691807+0000","last_change":"2023-07-20T10:09:24.213309+0000","last_active":"2023-07-20T10:09:25.691807+0000","last_peered":"2023-07-20T10:09:25.691807+0000","last_clean":"2023-07-20T10:09:25.691807+0000","last_became_active":"2023-07-20T10:09:24.213018+0000","last_became_peered":"2023-07-20T10:09:24.213018+0000","last_unstale":"2023-07-20T10:09:25.691807+0000","last_undegraded":"2023-07-20T10:09:25.691807+0000","last_fullsized":"2023-07-20T10:09:25.691807+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:36:06.785715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692852+0000","last_change":"2023-07-20T10:09:24.210846+0000","last_active":"2023-07-20T10:09:25.692852+0000","last_peered":"2023-07-20T10:09:25.692852+0000","last_clean":"2023-07-20T10:09:25.692852+0000","last_became_active":"2023-07-20T10:09:24.210501+0000","last_became_peered":"2023-07-20T10:09:24.210501+0000","last_unstale":"2023-07-20T10:09:25.692852+0000","last_undegraded":"2023-07-20T10:09:25.692852+0000","last_fullsized":"2023-07-20T10:09:25.692852+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:50.189522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692032+0000","last_change":"2023-07-20T10:09:24.215719+0000","last_active":"2023-07-20T10:09:25.692032+0000","last_peered":"2023-07-20T10:09:25.692032+0000","last_clean":"2023-07-20T10:09:25.692032+0000","last_became_active":"2023-07-20T10:09:24.214104+0000","last_became_peered":"2023-07-20T10:09:24.214104+0000","last_unstale":"2023-07-20T10:09:25.692032+0000","last_undegraded":"2023-07-20T10:09:25.692032+0000","last_fullsized":"2023-07-20T10:09:25.692032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:01:24.172464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.187972+0000","last_change":"2023-07-20T10:09:24.202213+0000","last_active":"2023-07-20T10:09:25.187972+0000","last_peered":"2023-07-20T10:09:25.187972+0000","last_clean":"2023-07-20T10:09:25.187972+0000","last_became_active":"2023-07-20T10:09:24.201478+0000","last_became_peered":"2023-07-20T10:09:24.201478+0000","last_unstale":"2023-07-20T10:09:25.187972+0000","last_undegraded":"2023-07-20T10:09:25.187972+0000","last_fullsized":"2023-07-20T10:09:25.187972+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:34.488440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188824+0000","last_change":"2023-07-20T10:09:24.197064+0000","last_active":"2023-07-20T10:09:25.188824+0000","last_peered":"2023-07-20T10:09:25.188824+0000","last_clean":"2023-07-20T10:09:25.188824+0000","last_became_active":"2023-07-20T10:09:24.196604+0000","last_became_peered":"2023-07-20T10:09:24.196604+0000","last_unstale":"2023-07-20T10:09:25.188824+0000","last_undegraded":"2023-07-20T10:09:25.188824+0000","last_fullsized":"2023-07-20T10:09:25.188824+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:23:17.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486525+0000","last_change":"2023-07-20T10:09:24.203640+0000","last_active":"2023-07-20T10:09:25.486525+0000","last_peered":"2023-07-20T10:09:25.486525+0000","last_clean":"2023-07-20T10:09:25.486525+0000","last_became_active":"2023-07-20T10:09:24.203213+0000","last_became_peered":"2023-07-20T10:09:24.203213+0000","last_unstale":"2023-07-20T10:09:25.486525+0000","last_undegraded":"2023-07-20T10:09:25.486525+0000","last_fullsized":"2023-07-20T10:09:25.486525+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:49:25.919022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677174+0000","last_change":"2023-07-20T10:09:24.218504+0000","last_active":"2023-07-20T10:09:25.677174+0000","last_peered":"2023-07-20T10:09:25.677174+0000","last_clean":"2023-07-20T10:09:25.677174+0000","last_became_active":"2023-07-20T10:09:24.218162+0000","last_became_peered":"2023-07-20T10:09:24.218162+0000","last_unstale":"2023-07-20T10:09:25.677174+0000","last_undegraded":"2023-07-20T10:09:25.677174+0000","last_fullsized":"2023-07-20T10:09:25.677174+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528119+0000","last_change":"2023-07-20T10:09:24.207693+0000","last_active":"2023-07-20T10:09:25.528119+0000","last_peered":"2023-07-20T10:09:25.528119+0000","last_clean":"2023-07-20T10:09:25.528119+0000","last_became_active":"2023-07-20T10:09:24.207434+0000","last_became_peered":"2023-07-20T10:09:24.207434+0000","last_unstale":"2023-07-20T10:09:25.528119+0000","last_undegraded":"2023-07-20T10:09:25.528119+0000","last_fullsized":"2023-07-20T10:09:25.528119+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486578+0000","last_change":"2023-07-20T10:09:24.195332+0000","last_active":"2023-07-20T10:09:25.486578+0000","last_peered":"2023-07-20T10:09:25.486578+0000","last_clean":"2023-07-20T10:09:25.486578+0000","last_became_active":"2023-07-20T10:09:24.195051+0000","last_became_peered":"2023-07-20T10:09:24.195051+0000","last_unstale":"2023-07-20T10:09:25.486578+0000","last_undegraded":"2023-07-20T10:09:25.486578+0000","last_fullsized":"2023-07-20T10:09:25.486578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:59.186508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184271+0000","last_change":"2023-07-20T10:09:24.211480+0000","last_active":"2023-07-20T10:09:25.184271+0000","last_peered":"2023-07-20T10:09:25.184271+0000","last_clean":"2023-07-20T10:09:25.184271+0000","last_became_active":"2023-07-20T10:09:24.211180+0000","last_became_peered":"2023-07-20T10:09:24.211180+0000","last_unstale":"2023-07-20T10:09:25.184271+0000","last_undegraded":"2023-07-20T10:09:25.184271+0000","last_fullsized":"2023-07-20T10:09:25.184271+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188085+0000","last_change":"2023-07-20T10:09:24.194005+0000","last_active":"2023-07-20T10:09:25.188085+0000","last_peered":"2023-07-20T10:09:25.188085+0000","last_clean":"2023-07-20T10:09:25.188085+0000","last_became_active":"2023-07-20T10:09:24.193682+0000","last_became_peered":"2023-07-20T10:09:24.193682+0000","last_unstale":"2023-07-20T10:09:25.188085+0000","last_undegraded":"2023-07-20T10:09:25.188085+0000","last_fullsized":"2023-07-20T10:09:25.188085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:29:02.534279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188151+0000","last_change":"2023-07-20T10:09:24.202412+0000","last_active":"2023-07-20T10:09:25.188151+0000","last_peered":"2023-07-20T10:09:25.188151+0000","last_clean":"2023-07-20T10:09:25.188151+0000","last_became_active":"2023-07-20T10:09:24.201888+0000","last_became_peered":"2023-07-20T10:09:24.201888+0000","last_unstale":"2023-07-20T10:09:25.188151+0000","last_undegraded":"2023-07-20T10:09:25.188151+0000","last_fullsized":"2023-07-20T10:09:25.188151+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:26:54.010025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185039+0000","last_change":"2023-07-20T10:09:24.212400+0000","last_active":"2023-07-20T10:09:25.185039+0000","last_peered":"2023-07-20T10:09:25.185039+0000","last_clean":"2023-07-20T10:09:25.185039+0000","last_became_active":"2023-07-20T10:09:24.212132+0000","last_became_peered":"2023-07-20T10:09:24.212132+0000","last_unstale":"2023-07-20T10:09:25.185039+0000","last_undegraded":"2023-07-20T10:09:25.185039+0000","last_fullsized":"2023-07-20T10:09:25.185039+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"136'4","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677237+0000","last_change":"2023-07-20T10:09:23.203740+0000","last_active":"2023-07-20T10:09:25.677237+0000","last_peered":"2023-07-20T10:09:25.677237+0000","last_clean":"2023-07-20T10:09:25.677237+0000","last_became_active":"2023-07-20T10:09:23.203441+0000","last_became_peered":"2023-07-20T10:09:23.203441+0000","last_unstale":"2023-07-20T10:09:25.677237+0000","last_undegraded":"2023-07-20T10:09:25.677237+0000","last_fullsized":"2023-07-20T10:09:25.677237+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527960+0000","last_change":"2023-07-20T10:09:24.208722+0000","last_active":"2023-07-20T10:09:25.527960+0000","last_peered":"2023-07-20T10:09:25.527960+0000","last_clean":"2023-07-20T10:09:25.527960+0000","last_became_active":"2023-07-20T10:09:24.208453+0000","last_became_peered":"2023-07-20T10:09:24.208453+0000","last_unstale":"2023-07-20T10:09:25.527960+0000","last_undegraded":"2023-07-20T10:09:25.527960+0000","last_fullsized":"2023-07-20T10:09:25.527960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:43.081780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185214+0000","last_change":"2023-07-20T10:09:23.197755+0000","last_active":"2023-07-20T10:09:25.185214+0000","last_peered":"2023-07-20T10:09:25.185214+0000","last_clean":"2023-07-20T10:09:25.185214+0000","last_became_active":"2023-07-20T10:09:23.197468+0000","last_became_peered":"2023-07-20T10:09:23.197468+0000","last_unstale":"2023-07-20T10:09:25.185214+0000","last_undegraded":"2023-07-20T10:09:25.185214+0000","last_fullsized":"2023-07-20T10:09:25.185214+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:40:56.693179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188629+0000","last_change":"2023-07-20T10:09:24.207499+0000","last_active":"2023-07-20T10:09:25.188629+0000","last_peered":"2023-07-20T10:09:25.188629+0000","last_clean":"2023-07-20T10:09:25.188629+0000","last_became_active":"2023-07-20T10:09:24.207220+0000","last_became_peered":"2023-07-20T10:09:24.207220+0000","last_unstale":"2023-07-20T10:09:25.188629+0000","last_undegraded":"2023-07-20T10:09:25.188629+0000","last_fullsized":"2023-07-20T10:09:25.188629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:27:03.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692216+0000","last_change":"2023-07-20T10:09:23.209116+0000","last_active":"2023-07-20T10:09:25.692216+0000","last_peered":"2023-07-20T10:09:25.692216+0000","last_clean":"2023-07-20T10:09:25.692216+0000","last_became_active":"2023-07-20T10:09:23.208785+0000","last_became_peered":"2023-07-20T10:09:23.208785+0000","last_unstale":"2023-07-20T10:09:25.692216+0000","last_undegraded":"2023-07-20T10:09:25.692216+0000","last_fullsized":"2023-07-20T10:09:25.692216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:17.337454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692374+0000","last_change":"2023-07-20T10:09:24.216514+0000","last_active":"2023-07-20T10:09:25.692374+0000","last_peered":"2023-07-20T10:09:25.692374+0000","last_clean":"2023-07-20T10:09:25.692374+0000","last_became_active":"2023-07-20T10:09:24.216176+0000","last_became_peered":"2023-07-20T10:09:24.216176+0000","last_unstale":"2023-07-20T10:09:25.692374+0000","last_undegraded":"2023-07-20T10:09:25.692374+0000","last_fullsized":"2023-07-20T10:09:25.692374+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:42.831478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185300+0000","last_change":"2023-07-20T10:09:23.195399+0000","last_active":"2023-07-20T10:09:25.185300+0000","last_peered":"2023-07-20T10:09:25.185300+0000","last_clean":"2023-07-20T10:09:25.185300+0000","last_became_active":"2023-07-20T10:09:23.195115+0000","last_became_peered":"2023-07-20T10:09:23.195115+0000","last_unstale":"2023-07-20T10:09:25.185300+0000","last_undegraded":"2023-07-20T10:09:25.185300+0000","last_fullsized":"2023-07-20T10:09:25.185300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:24.202983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184711+0000","last_change":"2023-07-20T10:09:24.205317+0000","last_active":"2023-07-20T10:09:25.184711+0000","last_peered":"2023-07-20T10:09:25.184711+0000","last_clean":"2023-07-20T10:09:25.184711+0000","last_became_active":"2023-07-20T10:09:24.205021+0000","last_became_peered":"2023-07-20T10:09:24.205021+0000","last_unstale":"2023-07-20T10:09:25.184711+0000","last_undegraded":"2023-07-20T10:09:25.184711+0000","last_fullsized":"2023-07-20T10:09:25.184711+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692585+0000","last_change":"2023-07-20T10:09:23.203133+0000","last_active":"2023-07-20T10:09:25.692585+0000","last_peered":"2023-07-20T10:09:25.692585+0000","last_clean":"2023-07-20T10:09:25.692585+0000","last_became_active":"2023-07-20T10:09:23.202767+0000","last_became_peered":"2023-07-20T10:09:23.202767+0000","last_unstale":"2023-07-20T10:09:25.692585+0000","last_undegraded":"2023-07-20T10:09:25.692585+0000","last_fullsized":"2023-07-20T10:09:25.692585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:21.537591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692404+0000","last_change":"2023-07-20T10:09:24.204248+0000","last_active":"2023-07-20T10:09:25.692404+0000","last_peered":"2023-07-20T10:09:25.692404+0000","last_clean":"2023-07-20T10:09:25.692404+0000","last_became_active":"2023-07-20T10:09:24.203959+0000","last_became_peered":"2023-07-20T10:09:24.203959+0000","last_unstale":"2023-07-20T10:09:25.692404+0000","last_undegraded":"2023-07-20T10:09:25.692404+0000","last_fullsized":"2023-07-20T10:09:25.692404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:06:10.313498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527695+0000","last_change":"2023-07-20T10:09:23.200556+0000","last_active":"2023-07-20T10:09:25.527695+0000","last_peered":"2023-07-20T10:09:25.527695+0000","last_clean":"2023-07-20T10:09:25.527695+0000","last_became_active":"2023-07-20T10:09:23.199819+0000","last_became_peered":"2023-07-20T10:09:23.199819+0000","last_unstale":"2023-07-20T10:09:25.527695+0000","last_undegraded":"2023-07-20T10:09:25.527695+0000","last_fullsized":"2023-07-20T10:09:25.527695+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:31.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184389+0000","last_change":"2023-07-20T10:09:24.203345+0000","last_active":"2023-07-20T10:09:25.184389+0000","last_peered":"2023-07-20T10:09:25.184389+0000","last_clean":"2023-07-20T10:09:25.184389+0000","last_became_active":"2023-07-20T10:09:24.203067+0000","last_became_peered":"2023-07-20T10:09:24.203067+0000","last_unstale":"2023-07-20T10:09:25.184389+0000","last_undegraded":"2023-07-20T10:09:25.184389+0000","last_fullsized":"2023-07-20T10:09:25.184389+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188038+0000","last_change":"2023-07-20T10:09:23.200265+0000","last_active":"2023-07-20T10:09:25.188038+0000","last_peered":"2023-07-20T10:09:25.188038+0000","last_clean":"2023-07-20T10:09:25.188038+0000","last_became_active":"2023-07-20T10:09:23.199908+0000","last_became_peered":"2023-07-20T10:09:23.199908+0000","last_unstale":"2023-07-20T10:09:25.188038+0000","last_undegraded":"2023-07-20T10:09:25.188038+0000","last_fullsized":"2023-07-20T10:09:25.188038+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:40.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184873+0000","last_change":"2023-07-20T10:09:24.204484+0000","last_active":"2023-07-20T10:09:25.184873+0000","last_peered":"2023-07-20T10:09:25.184873+0000","last_clean":"2023-07-20T10:09:25.184873+0000","last_became_active":"2023-07-20T10:09:24.204185+0000","last_became_peered":"2023-07-20T10:09:24.204185+0000","last_unstale":"2023-07-20T10:09:25.184873+0000","last_undegraded":"2023-07-20T10:09:25.184873+0000","last_fullsized":"2023-07-20T10:09:25.184873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527687+0000","last_change":"2023-07-20T10:09:23.200240+0000","last_active":"2023-07-20T10:09:25.527687+0000","last_peered":"2023-07-20T10:09:25.527687+0000","last_clean":"2023-07-20T10:09:25.527687+0000","last_became_active":"2023-07-20T10:09:23.199918+0000","last_became_peered":"2023-07-20T10:09:23.199918+0000","last_unstale":"2023-07-20T10:09:25.527687+0000","last_undegraded":"2023-07-20T10:09:25.527687+0000","last_fullsized":"2023-07-20T10:09:25.527687+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:08:53.025581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188388+0000","last_change":"2023-07-20T10:09:24.202556+0000","last_active":"2023-07-20T10:09:25.188388+0000","last_peered":"2023-07-20T10:09:25.188388+0000","last_clean":"2023-07-20T10:09:25.188388+0000","last_became_active":"2023-07-20T10:09:24.202265+0000","last_became_peered":"2023-07-20T10:09:24.202265+0000","last_unstale":"2023-07-20T10:09:25.188388+0000","last_undegraded":"2023-07-20T10:09:25.188388+0000","last_fullsized":"2023-07-20T10:09:25.188388+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:03:59.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185376+0000","last_change":"2023-07-20T10:09:23.200942+0000","last_active":"2023-07-20T10:09:25.185376+0000","last_peered":"2023-07-20T10:09:25.185376+0000","last_clean":"2023-07-20T10:09:25.185376+0000","last_became_active":"2023-07-20T10:09:23.200638+0000","last_became_peered":"2023-07-20T10:09:23.200638+0000","last_unstale":"2023-07-20T10:09:25.185376+0000","last_undegraded":"2023-07-20T10:09:25.185376+0000","last_fullsized":"2023-07-20T10:09:25.185376+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:51.204187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692724+0000","last_change":"2023-07-20T10:09:24.205774+0000","last_active":"2023-07-20T10:09:25.692724+0000","last_peered":"2023-07-20T10:09:25.692724+0000","last_clean":"2023-07-20T10:09:25.692724+0000","last_became_active":"2023-07-20T10:09:24.205472+0000","last_became_peered":"2023-07-20T10:09:24.205472+0000","last_unstale":"2023-07-20T10:09:25.692724+0000","last_undegraded":"2023-07-20T10:09:25.692724+0000","last_fullsized":"2023-07-20T10:09:25.692724+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486535+0000","last_change":"2023-07-20T10:09:23.201687+0000","last_active":"2023-07-20T10:09:25.486535+0000","last_peered":"2023-07-20T10:09:25.486535+0000","last_clean":"2023-07-20T10:09:25.486535+0000","last_became_active":"2023-07-20T10:09:23.201415+0000","last_became_peered":"2023-07-20T10:09:23.201415+0000","last_unstale":"2023-07-20T10:09:25.486535+0000","last_undegraded":"2023-07-20T10:09:25.486535+0000","last_fullsized":"2023-07-20T10:09:25.486535+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:21:17.992360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528093+0000","last_change":"2023-07-20T10:09:24.209064+0000","last_active":"2023-07-20T10:09:25.528093+0000","last_peered":"2023-07-20T10:09:25.528093+0000","last_clean":"2023-07-20T10:09:25.528093+0000","last_became_active":"2023-07-20T10:09:24.208767+0000","last_became_peered":"2023-07-20T10:09:24.208767+0000","last_unstale":"2023-07-20T10:09:25.528093+0000","last_undegraded":"2023-07-20T10:09:25.528093+0000","last_fullsized":"2023-07-20T10:09:25.528093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692297+0000","last_change":"2023-07-20T10:09:23.207108+0000","last_active":"2023-07-20T10:09:25.692297+0000","last_peered":"2023-07-20T10:09:25.692297+0000","last_clean":"2023-07-20T10:09:25.692297+0000","last_became_active":"2023-07-20T10:09:23.206757+0000","last_became_peered":"2023-07-20T10:09:23.206757+0000","last_unstale":"2023-07-20T10:09:25.692297+0000","last_undegraded":"2023-07-20T10:09:25.692297+0000","last_fullsized":"2023-07-20T10:09:25.692297+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:02.620046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188963+0000","last_change":"2023-07-20T10:09:24.196874+0000","last_active":"2023-07-20T10:09:25.188963+0000","last_peered":"2023-07-20T10:09:25.188963+0000","last_clean":"2023-07-20T10:09:25.188963+0000","last_became_active":"2023-07-20T10:09:24.196208+0000","last_became_peered":"2023-07-20T10:09:24.196208+0000","last_unstale":"2023-07-20T10:09:25.188963+0000","last_undegraded":"2023-07-20T10:09:25.188963+0000","last_fullsized":"2023-07-20T10:09:25.188963+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.476155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692000+0000","last_change":"2023-07-20T10:09:23.210788+0000","last_active":"2023-07-20T10:09:25.692000+0000","last_peered":"2023-07-20T10:09:25.692000+0000","last_clean":"2023-07-20T10:09:25.692000+0000","last_became_active":"2023-07-20T10:09:23.210501+0000","last_became_peered":"2023-07-20T10:09:23.210501+0000","last_unstale":"2023-07-20T10:09:25.692000+0000","last_undegraded":"2023-07-20T10:09:25.692000+0000","last_fullsized":"2023-07-20T10:09:25.692000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:48.324992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527588+0000","last_change":"2023-07-20T10:09:24.208196+0000","last_active":"2023-07-20T10:09:25.527588+0000","last_peered":"2023-07-20T10:09:25.527588+0000","last_clean":"2023-07-20T10:09:25.527588+0000","last_became_active":"2023-07-20T10:09:24.207934+0000","last_became_peered":"2023-07-20T10:09:24.207934+0000","last_unstale":"2023-07-20T10:09:25.527588+0000","last_undegraded":"2023-07-20T10:09:25.527588+0000","last_fullsized":"2023-07-20T10:09:25.527588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:08.159051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527615+0000","last_change":"2023-07-20T10:09:23.203563+0000","last_active":"2023-07-20T10:09:25.527615+0000","last_peered":"2023-07-20T10:09:25.527615+0000","last_clean":"2023-07-20T10:09:25.527615+0000","last_became_active":"2023-07-20T10:09:23.203316+0000","last_became_peered":"2023-07-20T10:09:23.203316+0000","last_unstale":"2023-07-20T10:09:25.527615+0000","last_undegraded":"2023-07-20T10:09:25.527615+0000","last_fullsized":"2023-07-20T10:09:25.527615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183873+0000","last_change":"2023-07-20T10:09:24.200631+0000","last_active":"2023-07-20T10:09:25.183873+0000","last_peered":"2023-07-20T10:09:25.183873+0000","last_clean":"2023-07-20T10:09:25.183873+0000","last_became_active":"2023-07-20T10:09:24.200158+0000","last_became_peered":"2023-07-20T10:09:24.200158+0000","last_unstale":"2023-07-20T10:09:25.183873+0000","last_undegraded":"2023-07-20T10:09:25.183873+0000","last_fullsized":"2023-07-20T10:09:25.183873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:22.547597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691757+0000","last_change":"2023-07-20T10:09:23.208866+0000","last_active":"2023-07-20T10:09:25.691757+0000","last_peered":"2023-07-20T10:09:25.691757+0000","last_clean":"2023-07-20T10:09:25.691757+0000","last_became_active":"2023-07-20T10:09:23.208537+0000","last_became_peered":"2023-07-20T10:09:23.208537+0000","last_unstale":"2023-07-20T10:09:25.691757+0000","last_undegraded":"2023-07-20T10:09:25.691757+0000","last_fullsized":"2023-07-20T10:09:25.691757+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:06:39.750800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184484+0000","last_change":"2023-07-20T10:09:24.198304+0000","last_active":"2023-07-20T10:09:25.184484+0000","last_peered":"2023-07-20T10:09:25.184484+0000","last_clean":"2023-07-20T10:09:25.184484+0000","last_became_active":"2023-07-20T10:09:24.198020+0000","last_became_peered":"2023-07-20T10:09:24.198020+0000","last_unstale":"2023-07-20T10:09:25.184484+0000","last_undegraded":"2023-07-20T10:09:25.184484+0000","last_fullsized":"2023-07-20T10:09:25.184484+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:10.724352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184093+0000","last_change":"2023-07-20T10:09:23.205138+0000","last_active":"2023-07-20T10:09:25.184093+0000","last_peered":"2023-07-20T10:09:25.184093+0000","last_clean":"2023-07-20T10:09:25.184093+0000","last_became_active":"2023-07-20T10:09:23.204625+0000","last_became_peered":"2023-07-20T10:09:23.204625+0000","last_unstale":"2023-07-20T10:09:25.184093+0000","last_undegraded":"2023-07-20T10:09:25.184093+0000","last_fullsized":"2023-07-20T10:09:25.184093+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188126+0000","last_change":"2023-07-20T10:09:24.195459+0000","last_active":"2023-07-20T10:09:25.188126+0000","last_peered":"2023-07-20T10:09:25.188126+0000","last_clean":"2023-07-20T10:09:25.188126+0000","last_became_active":"2023-07-20T10:09:24.195081+0000","last_became_peered":"2023-07-20T10:09:24.195081+0000","last_unstale":"2023-07-20T10:09:25.188126+0000","last_undegraded":"2023-07-20T10:09:25.188126+0000","last_fullsized":"2023-07-20T10:09:25.188126+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:31.494561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691385+0000","last_change":"2023-07-20T10:09:23.208239+0000","last_active":"2023-07-20T10:09:25.691385+0000","last_peered":"2023-07-20T10:09:25.691385+0000","last_clean":"2023-07-20T10:09:25.691385+0000","last_became_active":"2023-07-20T10:09:23.207878+0000","last_became_peered":"2023-07-20T10:09:23.207878+0000","last_unstale":"2023-07-20T10:09:25.691385+0000","last_undegraded":"2023-07-20T10:09:25.691385+0000","last_fullsized":"2023-07-20T10:09:25.691385+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:34.484748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528188+0000","last_change":"2023-07-20T10:09:24.206586+0000","last_active":"2023-07-20T10:09:25.528188+0000","last_peered":"2023-07-20T10:09:25.528188+0000","last_clean":"2023-07-20T10:09:25.528188+0000","last_became_active":"2023-07-20T10:09:24.206333+0000","last_became_peered":"2023-07-20T10:09:24.206333+0000","last_unstale":"2023-07-20T10:09:25.528188+0000","last_undegraded":"2023-07-20T10:09:25.528188+0000","last_fullsized":"2023-07-20T10:09:25.528188+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528001+0000","last_change":"2023-07-20T10:09:23.201967+0000","last_active":"2023-07-20T10:09:25.528001+0000","last_peered":"2023-07-20T10:09:25.528001+0000","last_clean":"2023-07-20T10:09:25.528001+0000","last_became_active":"2023-07-20T10:09:23.201533+0000","last_became_peered":"2023-07-20T10:09:23.201533+0000","last_unstale":"2023-07-20T10:09:25.528001+0000","last_undegraded":"2023-07-20T10:09:25.528001+0000","last_fullsized":"2023-07-20T10:09:25.528001+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:31.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185042+0000","last_change":"2023-07-20T10:09:24.210036+0000","last_active":"2023-07-20T10:09:25.185042+0000","last_peered":"2023-07-20T10:09:25.185042+0000","last_clean":"2023-07-20T10:09:25.185042+0000","last_became_active":"2023-07-20T10:09:24.209776+0000","last_became_peered":"2023-07-20T10:09:24.209776+0000","last_unstale":"2023-07-20T10:09:25.185042+0000","last_undegraded":"2023-07-20T10:09:25.185042+0000","last_fullsized":"2023-07-20T10:09:25.185042+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.980522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677182+0000","last_change":"2023-07-20T10:09:23.207246+0000","last_active":"2023-07-20T10:09:25.677182+0000","last_peered":"2023-07-20T10:09:25.677182+0000","last_clean":"2023-07-20T10:09:25.677182+0000","last_became_active":"2023-07-20T10:09:23.206903+0000","last_became_peered":"2023-07-20T10:09:23.206903+0000","last_unstale":"2023-07-20T10:09:25.677182+0000","last_undegraded":"2023-07-20T10:09:25.677182+0000","last_fullsized":"2023-07-20T10:09:25.677182+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:09.714345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692629+0000","last_change":"2023-07-20T10:09:24.220166+0000","last_active":"2023-07-20T10:09:25.692629+0000","last_peered":"2023-07-20T10:09:25.692629+0000","last_clean":"2023-07-20T10:09:25.692629+0000","last_became_active":"2023-07-20T10:09:24.219885+0000","last_became_peered":"2023-07-20T10:09:24.219885+0000","last_unstale":"2023-07-20T10:09:25.692629+0000","last_undegraded":"2023-07-20T10:09:25.692629+0000","last_fullsized":"2023-07-20T10:09:25.692629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:18:50.167028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677304+0000","last_change":"2023-07-20T10:09:23.207830+0000","last_active":"2023-07-20T10:09:25.677304+0000","last_peered":"2023-07-20T10:09:25.677304+0000","last_clean":"2023-07-20T10:09:25.677304+0000","last_became_active":"2023-07-20T10:09:23.207282+0000","last_became_peered":"2023-07-20T10:09:23.207282+0000","last_unstale":"2023-07-20T10:09:25.677304+0000","last_undegraded":"2023-07-20T10:09:25.677304+0000","last_fullsized":"2023-07-20T10:09:25.677304+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486648+0000","last_change":"2023-07-20T10:09:24.196857+0000","last_active":"2023-07-20T10:09:25.486648+0000","last_peered":"2023-07-20T10:09:25.486648+0000","last_clean":"2023-07-20T10:09:25.486648+0000","last_became_active":"2023-07-20T10:09:24.196322+0000","last_became_peered":"2023-07-20T10:09:24.196322+0000","last_unstale":"2023-07-20T10:09:25.486648+0000","last_undegraded":"2023-07-20T10:09:25.486648+0000","last_fullsized":"2023-07-20T10:09:25.486648+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:34:31.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528170+0000","last_change":"2023-07-20T10:09:23.200546+0000","last_active":"2023-07-20T10:09:25.528170+0000","last_peered":"2023-07-20T10:09:25.528170+0000","last_clean":"2023-07-20T10:09:25.528170+0000","last_became_active":"2023-07-20T10:09:23.200207+0000","last_became_peered":"2023-07-20T10:09:23.200207+0000","last_unstale":"2023-07-20T10:09:25.528170+0000","last_undegraded":"2023-07-20T10:09:25.528170+0000","last_fullsized":"2023-07-20T10:09:25.528170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:52.906732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527716+0000","last_change":"2023-07-20T10:09:24.211709+0000","last_active":"2023-07-20T10:09:25.527716+0000","last_peered":"2023-07-20T10:09:25.527716+0000","last_clean":"2023-07-20T10:09:25.527716+0000","last_became_active":"2023-07-20T10:09:24.211448+0000","last_became_peered":"2023-07-20T10:09:24.211448+0000","last_unstale":"2023-07-20T10:09:25.527716+0000","last_undegraded":"2023-07-20T10:09:25.527716+0000","last_fullsized":"2023-07-20T10:09:25.527716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:14.813947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692788+0000","last_change":"2023-07-20T10:09:23.200040+0000","last_active":"2023-07-20T10:09:25.692788+0000","last_peered":"2023-07-20T10:09:25.692788+0000","last_clean":"2023-07-20T10:09:25.692788+0000","last_became_active":"2023-07-20T10:09:23.199720+0000","last_became_peered":"2023-07-20T10:09:23.199720+0000","last_unstale":"2023-07-20T10:09:25.692788+0000","last_undegraded":"2023-07-20T10:09:25.692788+0000","last_fullsized":"2023-07-20T10:09:25.692788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:22.368036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184009+0000","last_change":"2023-07-20T10:09:24.200457+0000","last_active":"2023-07-20T10:09:25.184009+0000","last_peered":"2023-07-20T10:09:25.184009+0000","last_clean":"2023-07-20T10:09:25.184009+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.184009+0000","last_undegraded":"2023-07-20T10:09:25.184009+0000","last_fullsized":"2023-07-20T10:09:25.184009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:23.378042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692867+0000","last_change":"2023-07-20T10:09:23.197179+0000","last_active":"2023-07-20T10:09:25.692867+0000","last_peered":"2023-07-20T10:09:25.692867+0000","last_clean":"2023-07-20T10:09:25.692867+0000","last_became_active":"2023-07-20T10:09:23.196779+0000","last_became_peered":"2023-07-20T10:09:23.196779+0000","last_unstale":"2023-07-20T10:09:25.692867+0000","last_undegraded":"2023-07-20T10:09:25.692867+0000","last_fullsized":"2023-07-20T10:09:25.692867+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691655+0000","last_change":"2023-07-20T10:09:24.208431+0000","last_active":"2023-07-20T10:09:25.691655+0000","last_peered":"2023-07-20T10:09:25.691655+0000","last_clean":"2023-07-20T10:09:25.691655+0000","last_became_active":"2023-07-20T10:09:24.208119+0000","last_became_peered":"2023-07-20T10:09:24.208119+0000","last_unstale":"2023-07-20T10:09:25.691655+0000","last_undegraded":"2023-07-20T10:09:25.691655+0000","last_fullsized":"2023-07-20T10:09:25.691655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:36:53.327634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:23.200286+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:23.199939+0000","last_became_peered":"2023-07-20T10:09:23.199939+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:13:55.929972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184906+0000","last_change":"2023-07-20T10:09:24.217781+0000","last_active":"2023-07-20T10:09:25.184906+0000","last_peered":"2023-07-20T10:09:25.184906+0000","last_clean":"2023-07-20T10:09:25.184906+0000","last_became_active":"2023-07-20T10:09:24.217439+0000","last_became_peered":"2023-07-20T10:09:24.217439+0000","last_unstale":"2023-07-20T10:09:25.184906+0000","last_undegraded":"2023-07-20T10:09:25.184906+0000","last_fullsized":"2023-07-20T10:09:25.184906+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:53.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691558+0000","last_change":"2023-07-20T10:09:23.204306+0000","last_active":"2023-07-20T10:09:25.691558+0000","last_peered":"2023-07-20T10:09:25.691558+0000","last_clean":"2023-07-20T10:09:25.691558+0000","last_became_active":"2023-07-20T10:09:23.204004+0000","last_became_peered":"2023-07-20T10:09:23.204004+0000","last_unstale":"2023-07-20T10:09:25.691558+0000","last_undegraded":"2023-07-20T10:09:25.691558+0000","last_fullsized":"2023-07-20T10:09:25.691558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:30:07.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691940+0000","last_change":"2023-07-20T10:09:24.213311+0000","last_active":"2023-07-20T10:09:25.691940+0000","last_peered":"2023-07-20T10:09:25.691940+0000","last_clean":"2023-07-20T10:09:25.691940+0000","last_became_active":"2023-07-20T10:09:24.213027+0000","last_became_peered":"2023-07-20T10:09:24.213027+0000","last_unstale":"2023-07-20T10:09:25.691940+0000","last_undegraded":"2023-07-20T10:09:25.691940+0000","last_fullsized":"2023-07-20T10:09:25.691940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:31.538183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"136'8","reported_seq":21,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183895+0000","last_change":"2023-07-20T10:09:23.200233+0000","last_active":"2023-07-20T10:09:25.183895+0000","last_peered":"2023-07-20T10:09:25.183895+0000","last_clean":"2023-07-20T10:09:25.183895+0000","last_became_active":"2023-07-20T10:09:23.199952+0000","last_became_peered":"2023-07-20T10:09:23.199952+0000","last_unstale":"2023-07-20T10:09:25.183895+0000","last_undegraded":"2023-07-20T10:09:25.183895+0000","last_fullsized":"2023-07-20T10:09:25.183895+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:00.394240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"126'227","reported_seq":768,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691641+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:09:25.691641+0000","last_peered":"2023-07-20T10:09:25.691641+0000","last_clean":"2023-07-20T10:09:25.691641+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:09:25.691641+0000","last_undegraded":"2023-07-20T10:09:25.691641+0000","last_fullsized":"2023-07-20T10:09:25.691641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:39.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188288+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:09:25.188288+0000","last_peered":"2023-07-20T10:09:25.188288+0000","last_clean":"2023-07-20T10:09:25.188288+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:09:25.188288+0000","last_undegraded":"2023-07-20T10:09:25.188288+0000","last_fullsized":"2023-07-20T10:09:25.188288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:50.850322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677088+0000","last_change":"2023-07-20T10:09:24.214767+0000","last_active":"2023-07-20T10:09:25.677088+0000","last_peered":"2023-07-20T10:09:25.677088+0000","last_clean":"2023-07-20T10:09:25.677088+0000","last_became_active":"2023-07-20T10:09:24.214479+0000","last_became_peered":"2023-07-20T10:09:24.214479+0000","last_unstale":"2023-07-20T10:09:25.677088+0000","last_undegraded":"2023-07-20T10:09:25.677088+0000","last_fullsized":"2023-07-20T10:09:25.677088+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184449+0000","last_change":"2023-07-20T10:09:23.195015+0000","last_active":"2023-07-20T10:09:25.184449+0000","last_peered":"2023-07-20T10:09:25.184449+0000","last_clean":"2023-07-20T10:09:25.184449+0000","last_became_active":"2023-07-20T10:09:23.194736+0000","last_became_peered":"2023-07-20T10:09:23.194736+0000","last_unstale":"2023-07-20T10:09:25.184449+0000","last_undegraded":"2023-07-20T10:09:25.184449+0000","last_fullsized":"2023-07-20T10:09:25.184449+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691340+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:09:25.691340+0000","last_peered":"2023-07-20T10:09:25.691340+0000","last_clean":"2023-07-20T10:09:25.691340+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:09:25.691340+0000","last_undegraded":"2023-07-20T10:09:25.691340+0000","last_fullsized":"2023-07-20T10:09:25.691340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:45.398983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184632+0000","last_change":"2023-07-20T10:09:24.213903+0000","last_active":"2023-07-20T10:09:25.184632+0000","last_peered":"2023-07-20T10:09:25.184632+0000","last_clean":"2023-07-20T10:09:25.184632+0000","last_became_active":"2023-07-20T10:09:24.213621+0000","last_became_peered":"2023-07-20T10:09:24.213621+0000","last_unstale":"2023-07-20T10:09:25.184632+0000","last_undegraded":"2023-07-20T10:09:25.184632+0000","last_fullsized":"2023-07-20T10:09:25.184632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:32.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184468+0000","last_change":"2023-07-20T10:09:23.195348+0000","last_active":"2023-07-20T10:09:25.184468+0000","last_peered":"2023-07-20T10:09:25.184468+0000","last_clean":"2023-07-20T10:09:25.184468+0000","last_became_active":"2023-07-20T10:09:23.194624+0000","last_became_peered":"2023-07-20T10:09:23.194624+0000","last_unstale":"2023-07-20T10:09:25.184468+0000","last_undegraded":"2023-07-20T10:09:25.184468+0000","last_fullsized":"2023-07-20T10:09:25.184468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486297+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:09:25.486297+0000","last_peered":"2023-07-20T10:09:25.486297+0000","last_clean":"2023-07-20T10:09:25.486297+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:09:25.486297+0000","last_undegraded":"2023-07-20T10:09:25.486297+0000","last_fullsized":"2023-07-20T10:09:25.486297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:36:44.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486370+0000","last_change":"2023-07-20T10:09:24.188340+0000","last_active":"2023-07-20T10:09:25.486370+0000","last_peered":"2023-07-20T10:09:25.486370+0000","last_clean":"2023-07-20T10:09:25.486370+0000","last_became_active":"2023-07-20T10:09:24.188066+0000","last_became_peered":"2023-07-20T10:09:24.188066+0000","last_unstale":"2023-07-20T10:09:25.486370+0000","last_undegraded":"2023-07-20T10:09:25.486370+0000","last_fullsized":"2023-07-20T10:09:25.486370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:13.858613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184019+0000","last_change":"2023-07-20T10:09:23.194975+0000","last_active":"2023-07-20T10:09:25.184019+0000","last_peered":"2023-07-20T10:09:25.184019+0000","last_clean":"2023-07-20T10:09:25.184019+0000","last_became_active":"2023-07-20T10:09:23.193772+0000","last_became_peered":"2023-07-20T10:09:23.193772+0000","last_unstale":"2023-07-20T10:09:25.184019+0000","last_undegraded":"2023-07-20T10:09:25.184019+0000","last_fullsized":"2023-07-20T10:09:25.184019+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:49.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188100+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:09:25.188100+0000","last_peered":"2023-07-20T10:09:25.188100+0000","last_clean":"2023-07-20T10:09:25.188100+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:09:25.188100+0000","last_undegraded":"2023-07-20T10:09:25.188100+0000","last_fullsized":"2023-07-20T10:09:25.188100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:02.671676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.676975+0000","last_change":"2023-07-20T10:09:24.216027+0000","last_active":"2023-07-20T10:09:25.676975+0000","last_peered":"2023-07-20T10:09:25.676975+0000","last_clean":"2023-07-20T10:09:25.676975+0000","last_became_active":"2023-07-20T10:09:24.215731+0000","last_became_peered":"2023-07-20T10:09:24.215731+0000","last_unstale":"2023-07-20T10:09:25.676975+0000","last_undegraded":"2023-07-20T10:09:25.676975+0000","last_fullsized":"2023-07-20T10:09:25.676975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:54.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677267+0000","last_change":"2023-07-20T10:09:23.207983+0000","last_active":"2023-07-20T10:09:25.677267+0000","last_peered":"2023-07-20T10:09:25.677267+0000","last_clean":"2023-07-20T10:09:25.677267+0000","last_became_active":"2023-07-20T10:09:23.207684+0000","last_became_peered":"2023-07-20T10:09:23.207684+0000","last_unstale":"2023-07-20T10:09:25.677267+0000","last_undegraded":"2023-07-20T10:09:25.677267+0000","last_fullsized":"2023-07-20T10:09:25.677267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":218,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185177+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:09:25.185177+0000","last_peered":"2023-07-20T10:09:25.185177+0000","last_clean":"2023-07-20T10:09:25.185177+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:09:25.185177+0000","last_undegraded":"2023-07-20T10:09:25.185177+0000","last_fullsized":"2023-07-20T10:09:25.185177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:07.742083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188608+0000","last_change":"2023-07-20T10:09:24.210555+0000","last_active":"2023-07-20T10:09:25.188608+0000","last_peered":"2023-07-20T10:09:25.188608+0000","last_clean":"2023-07-20T10:09:25.188608+0000","last_became_active":"2023-07-20T10:09:24.210282+0000","last_became_peered":"2023-07-20T10:09:24.210282+0000","last_unstale":"2023-07-20T10:09:25.188608+0000","last_undegraded":"2023-07-20T10:09:25.188608+0000","last_fullsized":"2023-07-20T10:09:25.188608+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:00:57.679158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188531+0000","last_change":"2023-07-20T10:09:23.200213+0000","last_active":"2023-07-20T10:09:25.188531+0000","last_peered":"2023-07-20T10:09:25.188531+0000","last_clean":"2023-07-20T10:09:25.188531+0000","last_became_active":"2023-07-20T10:09:23.199855+0000","last_became_peered":"2023-07-20T10:09:23.199855+0000","last_unstale":"2023-07-20T10:09:25.188531+0000","last_undegraded":"2023-07-20T10:09:25.188531+0000","last_fullsized":"2023-07-20T10:09:25.188531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:18.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692362+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:09:25.692362+0000","last_peered":"2023-07-20T10:09:25.692362+0000","last_clean":"2023-07-20T10:09:25.692362+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:09:25.692362+0000","last_undegraded":"2023-07-20T10:09:25.692362+0000","last_fullsized":"2023-07-20T10:09:25.692362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:13.906449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185543+0000","last_change":"2023-07-20T10:09:24.203211+0000","last_active":"2023-07-20T10:09:25.185543+0000","last_peered":"2023-07-20T10:09:25.185543+0000","last_clean":"2023-07-20T10:09:25.185543+0000","last_became_active":"2023-07-20T10:09:24.202899+0000","last_became_peered":"2023-07-20T10:09:24.202899+0000","last_unstale":"2023-07-20T10:09:25.185543+0000","last_undegraded":"2023-07-20T10:09:25.185543+0000","last_fullsized":"2023-07-20T10:09:25.185543+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:59.996920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"136'3","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188660+0000","last_change":"2023-07-20T10:09:23.199280+0000","last_active":"2023-07-20T10:09:25.188660+0000","last_peered":"2023-07-20T10:09:25.188660+0000","last_clean":"2023-07-20T10:09:25.188660+0000","last_became_active":"2023-07-20T10:09:23.198746+0000","last_became_peered":"2023-07-20T10:09:23.198746+0000","last_unstale":"2023-07-20T10:09:25.188660+0000","last_undegraded":"2023-07-20T10:09:25.188660+0000","last_fullsized":"2023-07-20T10:09:25.188660+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:32.920465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185271+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:09:25.185271+0000","last_peered":"2023-07-20T10:09:25.185271+0000","last_clean":"2023-07-20T10:09:25.185271+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:09:25.185271+0000","last_undegraded":"2023-07-20T10:09:25.185271+0000","last_fullsized":"2023-07-20T10:09:25.185271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:04.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188806+0000","last_change":"2023-07-20T10:09:24.197578+0000","last_active":"2023-07-20T10:09:25.188806+0000","last_peered":"2023-07-20T10:09:25.188806+0000","last_clean":"2023-07-20T10:09:25.188806+0000","last_became_active":"2023-07-20T10:09:24.197306+0000","last_became_peered":"2023-07-20T10:09:24.197306+0000","last_unstale":"2023-07-20T10:09:25.188806+0000","last_undegraded":"2023-07-20T10:09:25.188806+0000","last_fullsized":"2023-07-20T10:09:25.188806+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:42.208337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"136'6","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184545+0000","last_change":"2023-07-20T10:09:23.193201+0000","last_active":"2023-07-20T10:09:25.184545+0000","last_peered":"2023-07-20T10:09:25.184545+0000","last_clean":"2023-07-20T10:09:25.184545+0000","last_became_active":"2023-07-20T10:09:23.192873+0000","last_became_peered":"2023-07-20T10:09:23.192873+0000","last_unstale":"2023-07-20T10:09:25.184545+0000","last_undegraded":"2023-07-20T10:09:25.184545+0000","last_fullsized":"2023-07-20T10:09:25.184545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677336+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:09:25.677336+0000","last_peered":"2023-07-20T10:09:25.677336+0000","last_clean":"2023-07-20T10:09:25.677336+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:09:25.677336+0000","last_undegraded":"2023-07-20T10:09:25.677336+0000","last_fullsized":"2023-07-20T10:09:25.677336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:24.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2310144,"data_stored":1447849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.153,"15min":1.153},"last":1.038},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71399999999999997,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.92100000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.35999999999999999},"max":{"1min":1.018,"5min":1.05,"15min":1.075},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0329999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.01,"15min":1.716},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.3759999999999999,"15min":1.758},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.82999999999999996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0149999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.436,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.8},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.995,"15min":0.999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.84699999999999998,"5min":0.97699999999999998,"15min":1.1220000000000001},"last":0.93700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":857287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.73199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.77500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.29599999999999999},"max":{"1min":0.86199999999999999,"5min":0.99299999999999999,"15min":1.1259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.103},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.0389999999999999,"5min":1.1000000000000001,"15min":1.25},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.173},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":1.135,"15min":1.135},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.028},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.024,"15min":1.0549999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.84999999999999998,"5min":1.02,"15min":1.155},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.88200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1708032,"data_stored":856865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.0620000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40899999999999997},"max":{"1min":0.92000000000000004,"5min":1.036,"15min":1.036},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.034},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":0.879,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":7,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":1.012,"15min":1.0680000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834575075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1712128,"data_stored":858269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":1.085},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":1.141},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.96699999999999997,"5min":0.98599999999999999,"15min":1.363},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":1.0169999999999999,"15min":1.177},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.0049999999999999,"15min":1.23},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.196},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32700000000000001},"max":{"1min":0.878,"5min":0.97199999999999998,"15min":1.004},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2649999999999999},"last":1.032},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.0109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36888,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334952,"statfs":{"total":96636764160,"available":96598990848,"internally_reserved":0,"allocated":1716224,"data_stored":858303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.443},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.503}]},{"osd":2,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.873,"5min":1.083,"15min":1.1890000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.78000000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":1.071,"15min":1.381},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.878}]},{"osd":6,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":1.107,"15min":1.274},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":1.04,"15min":1.131},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":1.018,"15min":1.4399999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.56399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.155,"15min":1.5049999999999999},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54928,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316912,"statfs":{"total":96636764160,"available":96580517888,"internally_reserved":0,"allocated":1699840,"data_stored":856705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.68899999999999995,"15min":0.876},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.622,"5min":0.77500000000000002,"15min":0.96899999999999997},"last":0.436}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.373}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.25},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41899999999999998},"max":{"1min":1.073,"5min":1.127,"15min":1.2689999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.45700000000000002},"max":{"1min":1.083,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.095,"5min":1.218,"15min":1.3240000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.143,"15min":1.292},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.028,"5min":1.204,"15min":1.393},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":856727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.441},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60499999999999998,"5min":0.79100000000000004,"15min":0.82599999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95099999999999996,"5min":1.399,"15min":1.399},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0329999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.76000000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.117},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37464,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334376,"statfs":{"total":96636764160,"available":96598401024,"internally_reserved":0,"allocated":2297856,"data_stored":1447095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.45400000000000001},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0710000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.51700000000000002,"15min":0.54500000000000004},"min":{"1min":0.29199999999999998,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.625,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":3.2509999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73999999999999999,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0409999999999999,"5min":1.232,"15min":1.6779999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.216,"15min":3.125},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.044,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.503}]},{"osd":6,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":3.161},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0209999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.0880000000000001,"5min":1.3089999999999999,"15min":1.766},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:09:32.736 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T10:09:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.909+0000 7fe739940640 1 Processor -- start 2023-07-20T10:09:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.909+0000 7fe739940640 1 -- start start 2023-07-20T10:09:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe739940640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7340ad060 0x7fe73415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe739940640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7340cde70 con 0x7fe7340ca040 2023-07-20T10:09:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe739940640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7340cbef0 con 0x7fe7340b1170 2023-07-20T10:09:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe739940640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7340ca420 con 0x7fe7340ad060 2023-07-20T10:09:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe72a7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7340ad060 0x7fe73415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe732ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe7340ca040 0x7fe73415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36390/0 (socket says 172.21.15.82:36390) 2023-07-20T10:09:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe732ffd640 1 -- 172.21.15.82:0/442616640 learned_addr learned my addr 172.21.15.82:0/442616640 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe72a7fc640 1 -- 172.21.15.82:0/442616640 >> v1:172.21.15.183:6789/0 conn(0x7fe7340b1170 legacy=0x7fe7340b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe72a7fc640 1 -- 172.21.15.82:0/442616640 >> v1:172.21.15.82:6789/0 conn(0x7fe7340ca040 legacy=0x7fe73415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe72a7fc640 1 -- 172.21.15.82:0/442616640 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7340cdb40 con 0x7fe7340ad060 2023-07-20T10:09:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe72a7fc640 1 --2- 172.21.15.82:0/442616640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ad060 0x7fe73415d020 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009d90 tx=0x7fe71c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a369f3e0f46f56da server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe7327fc640 1 -- 172.21.15.82:0/442616640 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0a5a00 con 0x7fe7340ad060 2023-07-20T10:09:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.913+0000 7fe7327fc640 1 -- 172.21.15.82:0/442616640 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c0a5b60 con 0x7fe7340ad060 2023-07-20T10:09:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe7327fc640 1 -- 172.21.15.82:0/442616640 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0ad440 con 0x7fe7340ad060 2023-07-20T10:09:32.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- 172.21.15.82:0/442616640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ad060 msgr2=0x7fe73415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 --2- 172.21.15.82:0/442616640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ad060 0x7fe73415d020 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009d90 tx=0x7fe71c01c920 comp rx=0 tx=0).stop 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- 172.21.15.82:0/442616640 shutdown_connections 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 --2- 172.21.15.82:0/442616640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ad060 0x7fe73415d020 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- 172.21.15.82:0/442616640 >> 172.21.15.82:0/442616640 conn(0x7fe7340cada0 msgr2=0x7fe7340cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- 172.21.15.82:0/442616640 shutdown_connections 2023-07-20T10:09:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- 172.21.15.82:0/442616640 wait complete. 2023-07-20T10:09:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 Processor -- start 2023-07-20T10:09:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- start start 2023-07-20T10:09:32.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7340ad060 0x7fe73415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:32.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7340b1170 0x7fe734154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:32.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:32.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73415a8b0 con 0x7fe7340ca040 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73415ab90 con 0x7fe7340b1170 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe739940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73415ae70 con 0x7fe7340ad060 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe7337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe7337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42362/0 (socket says 172.21.15.82:42362) 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe7337fe640 1 -- 172.21.15.82:0/687258788 learned_addr learned my addr 172.21.15.82:0/687258788 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.917+0000 7fe732ffd640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7340ad060 0x7fe73415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:32.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe72a7fc640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7340b1170 0x7fe734154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:32.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 -- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7340ad060 msgr2=0x7fe73415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7340ad060 0x7fe73415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 -- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7340b1170 msgr2=0x7fe734154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7340b1170 0x7fe734154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 -- 172.21.15.82:0/687258788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c009a70 con 0x7fe7340ca040 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe7337fe640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c430 tx=0x7fe72c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c005220 con 0x7fe7340ca040 2023-07-20T10:09:32.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c005380 con 0x7fe7340ca040 2023-07-20T10:09:32.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73415b150 con 0x7fe7340ca040 2023-07-20T10:09:32.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007270 con 0x7fe7340ca040 2023-07-20T10:09:32.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe734156f30 con 0x7fe7340ca040 2023-07-20T10:09:32.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe734073c70 con 0x7fe7340ca040 2023-07-20T10:09:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe72c0073d0 con 0x7fe7340ca040 2023-07-20T10:09:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 0x7fe714068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.921+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fe72c0832b0 con 0x7fe7340ca040 2023-07-20T10:09:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.925+0000 7fe732ffd640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 0x7fe714068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:32.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.925+0000 7fe732ffd640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 0x7fe714068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe724005890 tx=0x7fe724009040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:32.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:32.929+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe72c050740 con 0x7fe7340ca040 2023-07-20T10:09:33.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.073+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe73415d560 con 0x7fe7140663a0 2023-07-20T10:09:33.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.081+0000 7fe730ff9640 1 -- 172.21.15.82:0/687258788 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311872 (secure 0 0 0) 0x7fe724001490 con 0x7fe7140663a0 2023-07-20T10:09:33.060 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:33.061 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T10:09:33.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 msgr2=0x7fe714068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 0x7fe714068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe724005890 tx=0x7fe724009040 comp rx=0 tx=0).stop 2023-07-20T10:09:33.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 msgr2=0x7fe734156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c430 tx=0x7fe72c00c8f0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 shutdown_connections 2023-07-20T10:09:33.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fe7140663a0 0x7fe714068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7340ca040 0x7fe734156230 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7340b1170 0x7fe734154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 --2- 172.21.15.82:0/687258788 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7340ad060 0x7fe73415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 >> 172.21.15.82:0/687258788 conn(0x7fe7340cada0 msgr2=0x7fe7340ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:33.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 shutdown_connections 2023-07-20T10:09:33.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.085+0000 7fe739940640 1 -- 172.21.15.82:0/687258788 wait complete. 2023-07-20T10:09:33.079 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T10:09:32.970310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338080,"kb_used_data":14504,"kb_used_omap":13,"kb_used_meta":323442,"kb_avail":754636640,"statfs":{"total":773094113280,"available":772747919360,"internally_reserved":0,"allocated":14852096,"data_stored":8039100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":331204696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.790253"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692761+0000","last_change":"2023-07-20T10:09:24.206522+0000","last_active":"2023-07-20T10:09:25.692761+0000","last_peered":"2023-07-20T10:09:25.692761+0000","last_clean":"2023-07-20T10:09:25.692761+0000","last_became_active":"2023-07-20T10:09:24.206244+0000","last_became_peered":"2023-07-20T10:09:24.206244+0000","last_unstale":"2023-07-20T10:09:25.692761+0000","last_undegraded":"2023-07-20T10:09:25.692761+0000","last_fullsized":"2023-07-20T10:09:25.692761+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:01.404246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185412+0000","last_change":"2023-07-20T10:09:24.213055+0000","last_active":"2023-07-20T10:09:25.185412+0000","last_peered":"2023-07-20T10:09:25.185412+0000","last_clean":"2023-07-20T10:09:25.185412+0000","last_became_active":"2023-07-20T10:09:24.212765+0000","last_became_peered":"2023-07-20T10:09:24.212765+0000","last_unstale":"2023-07-20T10:09:25.185412+0000","last_undegraded":"2023-07-20T10:09:25.185412+0000","last_fullsized":"2023-07-20T10:09:25.185412+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:23:46.124787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184915+0000","last_change":"2023-07-20T10:09:24.207247+0000","last_active":"2023-07-20T10:09:25.184915+0000","last_peered":"2023-07-20T10:09:25.184915+0000","last_clean":"2023-07-20T10:09:25.184915+0000","last_became_active":"2023-07-20T10:09:24.206936+0000","last_became_peered":"2023-07-20T10:09:24.206936+0000","last_unstale":"2023-07-20T10:09:25.184915+0000","last_undegraded":"2023-07-20T10:09:25.184915+0000","last_fullsized":"2023-07-20T10:09:25.184915+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:26.905876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691968+0000","last_change":"2023-07-20T10:09:24.214657+0000","last_active":"2023-07-20T10:09:25.691968+0000","last_peered":"2023-07-20T10:09:25.691968+0000","last_clean":"2023-07-20T10:09:25.691968+0000","last_became_active":"2023-07-20T10:09:24.214055+0000","last_became_peered":"2023-07-20T10:09:24.214055+0000","last_unstale":"2023-07-20T10:09:25.691968+0000","last_undegraded":"2023-07-20T10:09:25.691968+0000","last_fullsized":"2023-07-20T10:09:25.691968+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:36:40.922821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692936+0000","last_change":"2023-07-20T10:09:24.203018+0000","last_active":"2023-07-20T10:09:25.692936+0000","last_peered":"2023-07-20T10:09:25.692936+0000","last_clean":"2023-07-20T10:09:25.692936+0000","last_became_active":"2023-07-20T10:09:24.202706+0000","last_became_peered":"2023-07-20T10:09:24.202706+0000","last_unstale":"2023-07-20T10:09:25.692936+0000","last_undegraded":"2023-07-20T10:09:25.692936+0000","last_fullsized":"2023-07-20T10:09:25.692936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:24.209478+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:24.209214+0000","last_became_peered":"2023-07-20T10:09:24.209214+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:28:38.836444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527633+0000","last_change":"2023-07-20T10:09:24.213677+0000","last_active":"2023-07-20T10:09:25.527633+0000","last_peered":"2023-07-20T10:09:25.527633+0000","last_clean":"2023-07-20T10:09:25.527633+0000","last_became_active":"2023-07-20T10:09:24.213371+0000","last_became_peered":"2023-07-20T10:09:24.213371+0000","last_unstale":"2023-07-20T10:09:25.527633+0000","last_undegraded":"2023-07-20T10:09:25.527633+0000","last_fullsized":"2023-07-20T10:09:25.527633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:12:05.329000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183875+0000","last_change":"2023-07-20T10:09:24.203541+0000","last_active":"2023-07-20T10:09:25.183875+0000","last_peered":"2023-07-20T10:09:25.183875+0000","last_clean":"2023-07-20T10:09:25.183875+0000","last_became_active":"2023-07-20T10:09:24.198932+0000","last_became_peered":"2023-07-20T10:09:24.198932+0000","last_unstale":"2023-07-20T10:09:25.183875+0000","last_undegraded":"2023-07-20T10:09:25.183875+0000","last_fullsized":"2023-07-20T10:09:25.183875+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692348+0000","last_change":"2023-07-20T10:09:24.216551+0000","last_active":"2023-07-20T10:09:25.692348+0000","last_peered":"2023-07-20T10:09:25.692348+0000","last_clean":"2023-07-20T10:09:25.692348+0000","last_became_active":"2023-07-20T10:09:24.216236+0000","last_became_peered":"2023-07-20T10:09:24.216236+0000","last_unstale":"2023-07-20T10:09:25.692348+0000","last_undegraded":"2023-07-20T10:09:25.692348+0000","last_fullsized":"2023-07-20T10:09:25.692348+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:07:26.173017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185190+0000","last_change":"2023-07-20T10:09:24.212968+0000","last_active":"2023-07-20T10:09:25.185190+0000","last_peered":"2023-07-20T10:09:25.185190+0000","last_clean":"2023-07-20T10:09:25.185190+0000","last_became_active":"2023-07-20T10:09:24.212709+0000","last_became_peered":"2023-07-20T10:09:24.212709+0000","last_unstale":"2023-07-20T10:09:25.185190+0000","last_undegraded":"2023-07-20T10:09:25.185190+0000","last_fullsized":"2023-07-20T10:09:25.185190+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:23:03.374906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692547+0000","last_change":"2023-07-20T10:09:24.200709+0000","last_active":"2023-07-20T10:09:25.692547+0000","last_peered":"2023-07-20T10:09:25.692547+0000","last_clean":"2023-07-20T10:09:25.692547+0000","last_became_active":"2023-07-20T10:09:24.200442+0000","last_became_peered":"2023-07-20T10:09:24.200442+0000","last_unstale":"2023-07-20T10:09:25.692547+0000","last_undegraded":"2023-07-20T10:09:25.692547+0000","last_fullsized":"2023-07-20T10:09:25.692547+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:54:04.433246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528125+0000","last_change":"2023-07-20T10:09:24.217395+0000","last_active":"2023-07-20T10:09:25.528125+0000","last_peered":"2023-07-20T10:09:25.528125+0000","last_clean":"2023-07-20T10:09:25.528125+0000","last_became_active":"2023-07-20T10:09:24.217001+0000","last_became_peered":"2023-07-20T10:09:24.217001+0000","last_unstale":"2023-07-20T10:09:25.528125+0000","last_undegraded":"2023-07-20T10:09:25.528125+0000","last_fullsized":"2023-07-20T10:09:25.528125+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184783+0000","last_change":"2023-07-20T10:09:24.207584+0000","last_active":"2023-07-20T10:09:25.184783+0000","last_peered":"2023-07-20T10:09:25.184783+0000","last_clean":"2023-07-20T10:09:25.184783+0000","last_became_active":"2023-07-20T10:09:24.207330+0000","last_became_peered":"2023-07-20T10:09:24.207330+0000","last_unstale":"2023-07-20T10:09:25.184783+0000","last_undegraded":"2023-07-20T10:09:25.184783+0000","last_fullsized":"2023-07-20T10:09:25.184783+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184239+0000","last_change":"2023-07-20T10:09:24.200784+0000","last_active":"2023-07-20T10:09:25.184239+0000","last_peered":"2023-07-20T10:09:25.184239+0000","last_clean":"2023-07-20T10:09:25.184239+0000","last_became_active":"2023-07-20T10:09:24.199386+0000","last_became_peered":"2023-07-20T10:09:24.199386+0000","last_unstale":"2023-07-20T10:09:25.184239+0000","last_undegraded":"2023-07-20T10:09:25.184239+0000","last_fullsized":"2023-07-20T10:09:25.184239+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692261+0000","last_change":"2023-07-20T10:09:24.200123+0000","last_active":"2023-07-20T10:09:25.692261+0000","last_peered":"2023-07-20T10:09:25.692261+0000","last_clean":"2023-07-20T10:09:25.692261+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.692261+0000","last_undegraded":"2023-07-20T10:09:25.692261+0000","last_fullsized":"2023-07-20T10:09:25.692261+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:39.353011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527562+0000","last_change":"2023-07-20T10:09:24.205975+0000","last_active":"2023-07-20T10:09:25.527562+0000","last_peered":"2023-07-20T10:09:25.527562+0000","last_clean":"2023-07-20T10:09:25.527562+0000","last_became_active":"2023-07-20T10:09:24.205708+0000","last_became_peered":"2023-07-20T10:09:24.205708+0000","last_unstale":"2023-07-20T10:09:25.527562+0000","last_undegraded":"2023-07-20T10:09:25.527562+0000","last_fullsized":"2023-07-20T10:09:25.527562+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:36.557585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185292+0000","last_change":"2023-07-20T10:09:24.211548+0000","last_active":"2023-07-20T10:09:25.185292+0000","last_peered":"2023-07-20T10:09:25.185292+0000","last_clean":"2023-07-20T10:09:25.185292+0000","last_became_active":"2023-07-20T10:09:24.211287+0000","last_became_peered":"2023-07-20T10:09:24.211287+0000","last_unstale":"2023-07-20T10:09:25.185292+0000","last_undegraded":"2023-07-20T10:09:25.185292+0000","last_fullsized":"2023-07-20T10:09:25.185292+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:51.134025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185481+0000","last_change":"2023-07-20T10:09:24.207039+0000","last_active":"2023-07-20T10:09:25.185481+0000","last_peered":"2023-07-20T10:09:25.185481+0000","last_clean":"2023-07-20T10:09:25.185481+0000","last_became_active":"2023-07-20T10:09:24.206739+0000","last_became_peered":"2023-07-20T10:09:24.206739+0000","last_unstale":"2023-07-20T10:09:25.185481+0000","last_undegraded":"2023-07-20T10:09:25.185481+0000","last_fullsized":"2023-07-20T10:09:25.185481+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:21.136327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677166+0000","last_change":"2023-07-20T10:09:24.217285+0000","last_active":"2023-07-20T10:09:25.677166+0000","last_peered":"2023-07-20T10:09:25.677166+0000","last_clean":"2023-07-20T10:09:25.677166+0000","last_became_active":"2023-07-20T10:09:24.217006+0000","last_became_peered":"2023-07-20T10:09:24.217006+0000","last_unstale":"2023-07-20T10:09:25.677166+0000","last_undegraded":"2023-07-20T10:09:25.677166+0000","last_fullsized":"2023-07-20T10:09:25.677166+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486446+0000","last_change":"2023-07-20T10:09:24.202531+0000","last_active":"2023-07-20T10:09:25.486446+0000","last_peered":"2023-07-20T10:09:25.486446+0000","last_clean":"2023-07-20T10:09:25.486446+0000","last_became_active":"2023-07-20T10:09:24.202075+0000","last_became_peered":"2023-07-20T10:09:24.202075+0000","last_unstale":"2023-07-20T10:09:25.486446+0000","last_undegraded":"2023-07-20T10:09:25.486446+0000","last_fullsized":"2023-07-20T10:09:25.486446+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:40.802972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691807+0000","last_change":"2023-07-20T10:09:24.213309+0000","last_active":"2023-07-20T10:09:25.691807+0000","last_peered":"2023-07-20T10:09:25.691807+0000","last_clean":"2023-07-20T10:09:25.691807+0000","last_became_active":"2023-07-20T10:09:24.213018+0000","last_became_peered":"2023-07-20T10:09:24.213018+0000","last_unstale":"2023-07-20T10:09:25.691807+0000","last_undegraded":"2023-07-20T10:09:25.691807+0000","last_fullsized":"2023-07-20T10:09:25.691807+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:36:06.785715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692852+0000","last_change":"2023-07-20T10:09:24.210846+0000","last_active":"2023-07-20T10:09:25.692852+0000","last_peered":"2023-07-20T10:09:25.692852+0000","last_clean":"2023-07-20T10:09:25.692852+0000","last_became_active":"2023-07-20T10:09:24.210501+0000","last_became_peered":"2023-07-20T10:09:24.210501+0000","last_unstale":"2023-07-20T10:09:25.692852+0000","last_undegraded":"2023-07-20T10:09:25.692852+0000","last_fullsized":"2023-07-20T10:09:25.692852+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:50.189522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692032+0000","last_change":"2023-07-20T10:09:24.215719+0000","last_active":"2023-07-20T10:09:25.692032+0000","last_peered":"2023-07-20T10:09:25.692032+0000","last_clean":"2023-07-20T10:09:25.692032+0000","last_became_active":"2023-07-20T10:09:24.214104+0000","last_became_peered":"2023-07-20T10:09:24.214104+0000","last_unstale":"2023-07-20T10:09:25.692032+0000","last_undegraded":"2023-07-20T10:09:25.692032+0000","last_fullsized":"2023-07-20T10:09:25.692032+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:01:24.172464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.187972+0000","last_change":"2023-07-20T10:09:24.202213+0000","last_active":"2023-07-20T10:09:25.187972+0000","last_peered":"2023-07-20T10:09:25.187972+0000","last_clean":"2023-07-20T10:09:25.187972+0000","last_became_active":"2023-07-20T10:09:24.201478+0000","last_became_peered":"2023-07-20T10:09:24.201478+0000","last_unstale":"2023-07-20T10:09:25.187972+0000","last_undegraded":"2023-07-20T10:09:25.187972+0000","last_fullsized":"2023-07-20T10:09:25.187972+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:16:34.488440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188824+0000","last_change":"2023-07-20T10:09:24.197064+0000","last_active":"2023-07-20T10:09:25.188824+0000","last_peered":"2023-07-20T10:09:25.188824+0000","last_clean":"2023-07-20T10:09:25.188824+0000","last_became_active":"2023-07-20T10:09:24.196604+0000","last_became_peered":"2023-07-20T10:09:24.196604+0000","last_unstale":"2023-07-20T10:09:25.188824+0000","last_undegraded":"2023-07-20T10:09:25.188824+0000","last_fullsized":"2023-07-20T10:09:25.188824+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:23:17.291362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486525+0000","last_change":"2023-07-20T10:09:24.203640+0000","last_active":"2023-07-20T10:09:25.486525+0000","last_peered":"2023-07-20T10:09:25.486525+0000","last_clean":"2023-07-20T10:09:25.486525+0000","last_became_active":"2023-07-20T10:09:24.203213+0000","last_became_peered":"2023-07-20T10:09:24.203213+0000","last_unstale":"2023-07-20T10:09:25.486525+0000","last_undegraded":"2023-07-20T10:09:25.486525+0000","last_fullsized":"2023-07-20T10:09:25.486525+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:49:25.919022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677174+0000","last_change":"2023-07-20T10:09:24.218504+0000","last_active":"2023-07-20T10:09:25.677174+0000","last_peered":"2023-07-20T10:09:25.677174+0000","last_clean":"2023-07-20T10:09:25.677174+0000","last_became_active":"2023-07-20T10:09:24.218162+0000","last_became_peered":"2023-07-20T10:09:24.218162+0000","last_unstale":"2023-07-20T10:09:25.677174+0000","last_undegraded":"2023-07-20T10:09:25.677174+0000","last_fullsized":"2023-07-20T10:09:25.677174+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528119+0000","last_change":"2023-07-20T10:09:24.207693+0000","last_active":"2023-07-20T10:09:25.528119+0000","last_peered":"2023-07-20T10:09:25.528119+0000","last_clean":"2023-07-20T10:09:25.528119+0000","last_became_active":"2023-07-20T10:09:24.207434+0000","last_became_peered":"2023-07-20T10:09:24.207434+0000","last_unstale":"2023-07-20T10:09:25.528119+0000","last_undegraded":"2023-07-20T10:09:25.528119+0000","last_fullsized":"2023-07-20T10:09:25.528119+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:24.135089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486578+0000","last_change":"2023-07-20T10:09:24.195332+0000","last_active":"2023-07-20T10:09:25.486578+0000","last_peered":"2023-07-20T10:09:25.486578+0000","last_clean":"2023-07-20T10:09:25.486578+0000","last_became_active":"2023-07-20T10:09:24.195051+0000","last_became_peered":"2023-07-20T10:09:24.195051+0000","last_unstale":"2023-07-20T10:09:25.486578+0000","last_undegraded":"2023-07-20T10:09:25.486578+0000","last_fullsized":"2023-07-20T10:09:25.486578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:14:59.186508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184271+0000","last_change":"2023-07-20T10:09:24.211480+0000","last_active":"2023-07-20T10:09:25.184271+0000","last_peered":"2023-07-20T10:09:25.184271+0000","last_clean":"2023-07-20T10:09:25.184271+0000","last_became_active":"2023-07-20T10:09:24.211180+0000","last_became_peered":"2023-07-20T10:09:24.211180+0000","last_unstale":"2023-07-20T10:09:25.184271+0000","last_undegraded":"2023-07-20T10:09:25.184271+0000","last_fullsized":"2023-07-20T10:09:25.184271+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:49.476319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188085+0000","last_change":"2023-07-20T10:09:24.194005+0000","last_active":"2023-07-20T10:09:25.188085+0000","last_peered":"2023-07-20T10:09:25.188085+0000","last_clean":"2023-07-20T10:09:25.188085+0000","last_became_active":"2023-07-20T10:09:24.193682+0000","last_became_peered":"2023-07-20T10:09:24.193682+0000","last_unstale":"2023-07-20T10:09:25.188085+0000","last_undegraded":"2023-07-20T10:09:25.188085+0000","last_fullsized":"2023-07-20T10:09:25.188085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:29:02.534279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188151+0000","last_change":"2023-07-20T10:09:24.202412+0000","last_active":"2023-07-20T10:09:25.188151+0000","last_peered":"2023-07-20T10:09:25.188151+0000","last_clean":"2023-07-20T10:09:25.188151+0000","last_became_active":"2023-07-20T10:09:24.201888+0000","last_became_peered":"2023-07-20T10:09:24.201888+0000","last_unstale":"2023-07-20T10:09:25.188151+0000","last_undegraded":"2023-07-20T10:09:25.188151+0000","last_fullsized":"2023-07-20T10:09:25.188151+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:26:54.010025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185039+0000","last_change":"2023-07-20T10:09:24.212400+0000","last_active":"2023-07-20T10:09:25.185039+0000","last_peered":"2023-07-20T10:09:25.185039+0000","last_clean":"2023-07-20T10:09:25.185039+0000","last_became_active":"2023-07-20T10:09:24.212132+0000","last_became_peered":"2023-07-20T10:09:24.212132+0000","last_unstale":"2023-07-20T10:09:25.185039+0000","last_undegraded":"2023-07-20T10:09:25.185039+0000","last_fullsized":"2023-07-20T10:09:25.185039+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"136'4","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677237+0000","last_change":"2023-07-20T10:09:23.203740+0000","last_active":"2023-07-20T10:09:25.677237+0000","last_peered":"2023-07-20T10:09:25.677237+0000","last_clean":"2023-07-20T10:09:25.677237+0000","last_became_active":"2023-07-20T10:09:23.203441+0000","last_became_peered":"2023-07-20T10:09:23.203441+0000","last_unstale":"2023-07-20T10:09:25.677237+0000","last_undegraded":"2023-07-20T10:09:25.677237+0000","last_fullsized":"2023-07-20T10:09:25.677237+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527960+0000","last_change":"2023-07-20T10:09:24.208722+0000","last_active":"2023-07-20T10:09:25.527960+0000","last_peered":"2023-07-20T10:09:25.527960+0000","last_clean":"2023-07-20T10:09:25.527960+0000","last_became_active":"2023-07-20T10:09:24.208453+0000","last_became_peered":"2023-07-20T10:09:24.208453+0000","last_unstale":"2023-07-20T10:09:25.527960+0000","last_undegraded":"2023-07-20T10:09:25.527960+0000","last_fullsized":"2023-07-20T10:09:25.527960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:43.081780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185214+0000","last_change":"2023-07-20T10:09:23.197755+0000","last_active":"2023-07-20T10:09:25.185214+0000","last_peered":"2023-07-20T10:09:25.185214+0000","last_clean":"2023-07-20T10:09:25.185214+0000","last_became_active":"2023-07-20T10:09:23.197468+0000","last_became_peered":"2023-07-20T10:09:23.197468+0000","last_unstale":"2023-07-20T10:09:25.185214+0000","last_undegraded":"2023-07-20T10:09:25.185214+0000","last_fullsized":"2023-07-20T10:09:25.185214+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:40:56.693179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188629+0000","last_change":"2023-07-20T10:09:24.207499+0000","last_active":"2023-07-20T10:09:25.188629+0000","last_peered":"2023-07-20T10:09:25.188629+0000","last_clean":"2023-07-20T10:09:25.188629+0000","last_became_active":"2023-07-20T10:09:24.207220+0000","last_became_peered":"2023-07-20T10:09:24.207220+0000","last_unstale":"2023-07-20T10:09:25.188629+0000","last_undegraded":"2023-07-20T10:09:25.188629+0000","last_fullsized":"2023-07-20T10:09:25.188629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:27:03.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692216+0000","last_change":"2023-07-20T10:09:23.209116+0000","last_active":"2023-07-20T10:09:25.692216+0000","last_peered":"2023-07-20T10:09:25.692216+0000","last_clean":"2023-07-20T10:09:25.692216+0000","last_became_active":"2023-07-20T10:09:23.208785+0000","last_became_peered":"2023-07-20T10:09:23.208785+0000","last_unstale":"2023-07-20T10:09:25.692216+0000","last_undegraded":"2023-07-20T10:09:25.692216+0000","last_fullsized":"2023-07-20T10:09:25.692216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:17.337454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692374+0000","last_change":"2023-07-20T10:09:24.216514+0000","last_active":"2023-07-20T10:09:25.692374+0000","last_peered":"2023-07-20T10:09:25.692374+0000","last_clean":"2023-07-20T10:09:25.692374+0000","last_became_active":"2023-07-20T10:09:24.216176+0000","last_became_peered":"2023-07-20T10:09:24.216176+0000","last_unstale":"2023-07-20T10:09:25.692374+0000","last_undegraded":"2023-07-20T10:09:25.692374+0000","last_fullsized":"2023-07-20T10:09:25.692374+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:42.831478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185300+0000","last_change":"2023-07-20T10:09:23.195399+0000","last_active":"2023-07-20T10:09:25.185300+0000","last_peered":"2023-07-20T10:09:25.185300+0000","last_clean":"2023-07-20T10:09:25.185300+0000","last_became_active":"2023-07-20T10:09:23.195115+0000","last_became_peered":"2023-07-20T10:09:23.195115+0000","last_unstale":"2023-07-20T10:09:25.185300+0000","last_undegraded":"2023-07-20T10:09:25.185300+0000","last_fullsized":"2023-07-20T10:09:25.185300+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:12:24.202983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184711+0000","last_change":"2023-07-20T10:09:24.205317+0000","last_active":"2023-07-20T10:09:25.184711+0000","last_peered":"2023-07-20T10:09:25.184711+0000","last_clean":"2023-07-20T10:09:25.184711+0000","last_became_active":"2023-07-20T10:09:24.205021+0000","last_became_peered":"2023-07-20T10:09:24.205021+0000","last_unstale":"2023-07-20T10:09:25.184711+0000","last_undegraded":"2023-07-20T10:09:25.184711+0000","last_fullsized":"2023-07-20T10:09:25.184711+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692585+0000","last_change":"2023-07-20T10:09:23.203133+0000","last_active":"2023-07-20T10:09:25.692585+0000","last_peered":"2023-07-20T10:09:25.692585+0000","last_clean":"2023-07-20T10:09:25.692585+0000","last_became_active":"2023-07-20T10:09:23.202767+0000","last_became_peered":"2023-07-20T10:09:23.202767+0000","last_unstale":"2023-07-20T10:09:25.692585+0000","last_undegraded":"2023-07-20T10:09:25.692585+0000","last_fullsized":"2023-07-20T10:09:25.692585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:21.537591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692404+0000","last_change":"2023-07-20T10:09:24.204248+0000","last_active":"2023-07-20T10:09:25.692404+0000","last_peered":"2023-07-20T10:09:25.692404+0000","last_clean":"2023-07-20T10:09:25.692404+0000","last_became_active":"2023-07-20T10:09:24.203959+0000","last_became_peered":"2023-07-20T10:09:24.203959+0000","last_unstale":"2023-07-20T10:09:25.692404+0000","last_undegraded":"2023-07-20T10:09:25.692404+0000","last_fullsized":"2023-07-20T10:09:25.692404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:06:10.313498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527695+0000","last_change":"2023-07-20T10:09:23.200556+0000","last_active":"2023-07-20T10:09:25.527695+0000","last_peered":"2023-07-20T10:09:25.527695+0000","last_clean":"2023-07-20T10:09:25.527695+0000","last_became_active":"2023-07-20T10:09:23.199819+0000","last_became_peered":"2023-07-20T10:09:23.199819+0000","last_unstale":"2023-07-20T10:09:25.527695+0000","last_undegraded":"2023-07-20T10:09:25.527695+0000","last_fullsized":"2023-07-20T10:09:25.527695+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:31.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184389+0000","last_change":"2023-07-20T10:09:24.203345+0000","last_active":"2023-07-20T10:09:25.184389+0000","last_peered":"2023-07-20T10:09:25.184389+0000","last_clean":"2023-07-20T10:09:25.184389+0000","last_became_active":"2023-07-20T10:09:24.203067+0000","last_became_peered":"2023-07-20T10:09:24.203067+0000","last_unstale":"2023-07-20T10:09:25.184389+0000","last_undegraded":"2023-07-20T10:09:25.184389+0000","last_fullsized":"2023-07-20T10:09:25.184389+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:39:05.367438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188038+0000","last_change":"2023-07-20T10:09:23.200265+0000","last_active":"2023-07-20T10:09:25.188038+0000","last_peered":"2023-07-20T10:09:25.188038+0000","last_clean":"2023-07-20T10:09:25.188038+0000","last_became_active":"2023-07-20T10:09:23.199908+0000","last_became_peered":"2023-07-20T10:09:23.199908+0000","last_unstale":"2023-07-20T10:09:25.188038+0000","last_undegraded":"2023-07-20T10:09:25.188038+0000","last_fullsized":"2023-07-20T10:09:25.188038+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:40.067659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184873+0000","last_change":"2023-07-20T10:09:24.204484+0000","last_active":"2023-07-20T10:09:25.184873+0000","last_peered":"2023-07-20T10:09:25.184873+0000","last_clean":"2023-07-20T10:09:25.184873+0000","last_became_active":"2023-07-20T10:09:24.204185+0000","last_became_peered":"2023-07-20T10:09:24.204185+0000","last_unstale":"2023-07-20T10:09:25.184873+0000","last_undegraded":"2023-07-20T10:09:25.184873+0000","last_fullsized":"2023-07-20T10:09:25.184873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:15:17.938844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527687+0000","last_change":"2023-07-20T10:09:23.200240+0000","last_active":"2023-07-20T10:09:25.527687+0000","last_peered":"2023-07-20T10:09:25.527687+0000","last_clean":"2023-07-20T10:09:25.527687+0000","last_became_active":"2023-07-20T10:09:23.199918+0000","last_became_peered":"2023-07-20T10:09:23.199918+0000","last_unstale":"2023-07-20T10:09:25.527687+0000","last_undegraded":"2023-07-20T10:09:25.527687+0000","last_fullsized":"2023-07-20T10:09:25.527687+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:08:53.025581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188388+0000","last_change":"2023-07-20T10:09:24.202556+0000","last_active":"2023-07-20T10:09:25.188388+0000","last_peered":"2023-07-20T10:09:25.188388+0000","last_clean":"2023-07-20T10:09:25.188388+0000","last_became_active":"2023-07-20T10:09:24.202265+0000","last_became_peered":"2023-07-20T10:09:24.202265+0000","last_unstale":"2023-07-20T10:09:25.188388+0000","last_undegraded":"2023-07-20T10:09:25.188388+0000","last_fullsized":"2023-07-20T10:09:25.188388+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:03:59.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185376+0000","last_change":"2023-07-20T10:09:23.200942+0000","last_active":"2023-07-20T10:09:25.185376+0000","last_peered":"2023-07-20T10:09:25.185376+0000","last_clean":"2023-07-20T10:09:25.185376+0000","last_became_active":"2023-07-20T10:09:23.200638+0000","last_became_peered":"2023-07-20T10:09:23.200638+0000","last_unstale":"2023-07-20T10:09:25.185376+0000","last_undegraded":"2023-07-20T10:09:25.185376+0000","last_fullsized":"2023-07-20T10:09:25.185376+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:51.204187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692724+0000","last_change":"2023-07-20T10:09:24.205774+0000","last_active":"2023-07-20T10:09:25.692724+0000","last_peered":"2023-07-20T10:09:25.692724+0000","last_clean":"2023-07-20T10:09:25.692724+0000","last_became_active":"2023-07-20T10:09:24.205472+0000","last_became_peered":"2023-07-20T10:09:24.205472+0000","last_unstale":"2023-07-20T10:09:25.692724+0000","last_undegraded":"2023-07-20T10:09:25.692724+0000","last_fullsized":"2023-07-20T10:09:25.692724+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:58.875586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486535+0000","last_change":"2023-07-20T10:09:23.201687+0000","last_active":"2023-07-20T10:09:25.486535+0000","last_peered":"2023-07-20T10:09:25.486535+0000","last_clean":"2023-07-20T10:09:25.486535+0000","last_became_active":"2023-07-20T10:09:23.201415+0000","last_became_peered":"2023-07-20T10:09:23.201415+0000","last_unstale":"2023-07-20T10:09:25.486535+0000","last_undegraded":"2023-07-20T10:09:25.486535+0000","last_fullsized":"2023-07-20T10:09:25.486535+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:21:17.992360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528093+0000","last_change":"2023-07-20T10:09:24.209064+0000","last_active":"2023-07-20T10:09:25.528093+0000","last_peered":"2023-07-20T10:09:25.528093+0000","last_clean":"2023-07-20T10:09:25.528093+0000","last_became_active":"2023-07-20T10:09:24.208767+0000","last_became_peered":"2023-07-20T10:09:24.208767+0000","last_unstale":"2023-07-20T10:09:25.528093+0000","last_undegraded":"2023-07-20T10:09:25.528093+0000","last_fullsized":"2023-07-20T10:09:25.528093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:33:59.778196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"136'1","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692297+0000","last_change":"2023-07-20T10:09:23.207108+0000","last_active":"2023-07-20T10:09:25.692297+0000","last_peered":"2023-07-20T10:09:25.692297+0000","last_clean":"2023-07-20T10:09:25.692297+0000","last_became_active":"2023-07-20T10:09:23.206757+0000","last_became_peered":"2023-07-20T10:09:23.206757+0000","last_unstale":"2023-07-20T10:09:25.692297+0000","last_undegraded":"2023-07-20T10:09:25.692297+0000","last_fullsized":"2023-07-20T10:09:25.692297+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:02.620046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188963+0000","last_change":"2023-07-20T10:09:24.196874+0000","last_active":"2023-07-20T10:09:25.188963+0000","last_peered":"2023-07-20T10:09:25.188963+0000","last_clean":"2023-07-20T10:09:25.188963+0000","last_became_active":"2023-07-20T10:09:24.196208+0000","last_became_peered":"2023-07-20T10:09:24.196208+0000","last_unstale":"2023-07-20T10:09:25.188963+0000","last_undegraded":"2023-07-20T10:09:25.188963+0000","last_fullsized":"2023-07-20T10:09:25.188963+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.476155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692000+0000","last_change":"2023-07-20T10:09:23.210788+0000","last_active":"2023-07-20T10:09:25.692000+0000","last_peered":"2023-07-20T10:09:25.692000+0000","last_clean":"2023-07-20T10:09:25.692000+0000","last_became_active":"2023-07-20T10:09:23.210501+0000","last_became_peered":"2023-07-20T10:09:23.210501+0000","last_unstale":"2023-07-20T10:09:25.692000+0000","last_undegraded":"2023-07-20T10:09:25.692000+0000","last_fullsized":"2023-07-20T10:09:25.692000+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:49:48.324992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527588+0000","last_change":"2023-07-20T10:09:24.208196+0000","last_active":"2023-07-20T10:09:25.527588+0000","last_peered":"2023-07-20T10:09:25.527588+0000","last_clean":"2023-07-20T10:09:25.527588+0000","last_became_active":"2023-07-20T10:09:24.207934+0000","last_became_peered":"2023-07-20T10:09:24.207934+0000","last_unstale":"2023-07-20T10:09:25.527588+0000","last_undegraded":"2023-07-20T10:09:25.527588+0000","last_fullsized":"2023-07-20T10:09:25.527588+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:08.159051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527615+0000","last_change":"2023-07-20T10:09:23.203563+0000","last_active":"2023-07-20T10:09:25.527615+0000","last_peered":"2023-07-20T10:09:25.527615+0000","last_clean":"2023-07-20T10:09:25.527615+0000","last_became_active":"2023-07-20T10:09:23.203316+0000","last_became_peered":"2023-07-20T10:09:23.203316+0000","last_unstale":"2023-07-20T10:09:25.527615+0000","last_undegraded":"2023-07-20T10:09:25.527615+0000","last_fullsized":"2023-07-20T10:09:25.527615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183873+0000","last_change":"2023-07-20T10:09:24.200631+0000","last_active":"2023-07-20T10:09:25.183873+0000","last_peered":"2023-07-20T10:09:25.183873+0000","last_clean":"2023-07-20T10:09:25.183873+0000","last_became_active":"2023-07-20T10:09:24.200158+0000","last_became_peered":"2023-07-20T10:09:24.200158+0000","last_unstale":"2023-07-20T10:09:25.183873+0000","last_undegraded":"2023-07-20T10:09:25.183873+0000","last_fullsized":"2023-07-20T10:09:25.183873+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:22.547597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691757+0000","last_change":"2023-07-20T10:09:23.208866+0000","last_active":"2023-07-20T10:09:25.691757+0000","last_peered":"2023-07-20T10:09:25.691757+0000","last_clean":"2023-07-20T10:09:25.691757+0000","last_became_active":"2023-07-20T10:09:23.208537+0000","last_became_peered":"2023-07-20T10:09:23.208537+0000","last_unstale":"2023-07-20T10:09:25.691757+0000","last_undegraded":"2023-07-20T10:09:25.691757+0000","last_fullsized":"2023-07-20T10:09:25.691757+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:06:39.750800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184484+0000","last_change":"2023-07-20T10:09:24.198304+0000","last_active":"2023-07-20T10:09:25.184484+0000","last_peered":"2023-07-20T10:09:25.184484+0000","last_clean":"2023-07-20T10:09:25.184484+0000","last_became_active":"2023-07-20T10:09:24.198020+0000","last_became_peered":"2023-07-20T10:09:24.198020+0000","last_unstale":"2023-07-20T10:09:25.184484+0000","last_undegraded":"2023-07-20T10:09:25.184484+0000","last_fullsized":"2023-07-20T10:09:25.184484+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:10.724352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184093+0000","last_change":"2023-07-20T10:09:23.205138+0000","last_active":"2023-07-20T10:09:25.184093+0000","last_peered":"2023-07-20T10:09:25.184093+0000","last_clean":"2023-07-20T10:09:25.184093+0000","last_became_active":"2023-07-20T10:09:23.204625+0000","last_became_peered":"2023-07-20T10:09:23.204625+0000","last_unstale":"2023-07-20T10:09:25.184093+0000","last_undegraded":"2023-07-20T10:09:25.184093+0000","last_fullsized":"2023-07-20T10:09:25.184093+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188126+0000","last_change":"2023-07-20T10:09:24.195459+0000","last_active":"2023-07-20T10:09:25.188126+0000","last_peered":"2023-07-20T10:09:25.188126+0000","last_clean":"2023-07-20T10:09:25.188126+0000","last_became_active":"2023-07-20T10:09:24.195081+0000","last_became_peered":"2023-07-20T10:09:24.195081+0000","last_unstale":"2023-07-20T10:09:25.188126+0000","last_undegraded":"2023-07-20T10:09:25.188126+0000","last_fullsized":"2023-07-20T10:09:25.188126+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:05:31.494561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691385+0000","last_change":"2023-07-20T10:09:23.208239+0000","last_active":"2023-07-20T10:09:25.691385+0000","last_peered":"2023-07-20T10:09:25.691385+0000","last_clean":"2023-07-20T10:09:25.691385+0000","last_became_active":"2023-07-20T10:09:23.207878+0000","last_became_peered":"2023-07-20T10:09:23.207878+0000","last_unstale":"2023-07-20T10:09:25.691385+0000","last_undegraded":"2023-07-20T10:09:25.691385+0000","last_fullsized":"2023-07-20T10:09:25.691385+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:34.484748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528188+0000","last_change":"2023-07-20T10:09:24.206586+0000","last_active":"2023-07-20T10:09:25.528188+0000","last_peered":"2023-07-20T10:09:25.528188+0000","last_clean":"2023-07-20T10:09:25.528188+0000","last_became_active":"2023-07-20T10:09:24.206333+0000","last_became_peered":"2023-07-20T10:09:24.206333+0000","last_unstale":"2023-07-20T10:09:25.528188+0000","last_undegraded":"2023-07-20T10:09:25.528188+0000","last_fullsized":"2023-07-20T10:09:25.528188+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:26.213513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528001+0000","last_change":"2023-07-20T10:09:23.201967+0000","last_active":"2023-07-20T10:09:25.528001+0000","last_peered":"2023-07-20T10:09:25.528001+0000","last_clean":"2023-07-20T10:09:25.528001+0000","last_became_active":"2023-07-20T10:09:23.201533+0000","last_became_peered":"2023-07-20T10:09:23.201533+0000","last_unstale":"2023-07-20T10:09:25.528001+0000","last_undegraded":"2023-07-20T10:09:25.528001+0000","last_fullsized":"2023-07-20T10:09:25.528001+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:31.727830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185042+0000","last_change":"2023-07-20T10:09:24.210036+0000","last_active":"2023-07-20T10:09:25.185042+0000","last_peered":"2023-07-20T10:09:25.185042+0000","last_clean":"2023-07-20T10:09:25.185042+0000","last_became_active":"2023-07-20T10:09:24.209776+0000","last_became_peered":"2023-07-20T10:09:24.209776+0000","last_unstale":"2023-07-20T10:09:25.185042+0000","last_undegraded":"2023-07-20T10:09:25.185042+0000","last_fullsized":"2023-07-20T10:09:25.185042+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:15:24.980522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677182+0000","last_change":"2023-07-20T10:09:23.207246+0000","last_active":"2023-07-20T10:09:25.677182+0000","last_peered":"2023-07-20T10:09:25.677182+0000","last_clean":"2023-07-20T10:09:25.677182+0000","last_became_active":"2023-07-20T10:09:23.206903+0000","last_became_peered":"2023-07-20T10:09:23.206903+0000","last_unstale":"2023-07-20T10:09:25.677182+0000","last_undegraded":"2023-07-20T10:09:25.677182+0000","last_fullsized":"2023-07-20T10:09:25.677182+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:09.714345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692629+0000","last_change":"2023-07-20T10:09:24.220166+0000","last_active":"2023-07-20T10:09:25.692629+0000","last_peered":"2023-07-20T10:09:25.692629+0000","last_clean":"2023-07-20T10:09:25.692629+0000","last_became_active":"2023-07-20T10:09:24.219885+0000","last_became_peered":"2023-07-20T10:09:24.219885+0000","last_unstale":"2023-07-20T10:09:25.692629+0000","last_undegraded":"2023-07-20T10:09:25.692629+0000","last_fullsized":"2023-07-20T10:09:25.692629+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:18:50.167028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677304+0000","last_change":"2023-07-20T10:09:23.207830+0000","last_active":"2023-07-20T10:09:25.677304+0000","last_peered":"2023-07-20T10:09:25.677304+0000","last_clean":"2023-07-20T10:09:25.677304+0000","last_became_active":"2023-07-20T10:09:23.207282+0000","last_became_peered":"2023-07-20T10:09:23.207282+0000","last_unstale":"2023-07-20T10:09:25.677304+0000","last_undegraded":"2023-07-20T10:09:25.677304+0000","last_fullsized":"2023-07-20T10:09:25.677304+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486648+0000","last_change":"2023-07-20T10:09:24.196857+0000","last_active":"2023-07-20T10:09:25.486648+0000","last_peered":"2023-07-20T10:09:25.486648+0000","last_clean":"2023-07-20T10:09:25.486648+0000","last_became_active":"2023-07-20T10:09:24.196322+0000","last_became_peered":"2023-07-20T10:09:24.196322+0000","last_unstale":"2023-07-20T10:09:25.486648+0000","last_undegraded":"2023-07-20T10:09:25.486648+0000","last_fullsized":"2023-07-20T10:09:25.486648+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:34:31.139955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.528170+0000","last_change":"2023-07-20T10:09:23.200546+0000","last_active":"2023-07-20T10:09:25.528170+0000","last_peered":"2023-07-20T10:09:25.528170+0000","last_clean":"2023-07-20T10:09:25.528170+0000","last_became_active":"2023-07-20T10:09:23.200207+0000","last_became_peered":"2023-07-20T10:09:23.200207+0000","last_unstale":"2023-07-20T10:09:25.528170+0000","last_undegraded":"2023-07-20T10:09:25.528170+0000","last_fullsized":"2023-07-20T10:09:25.528170+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:52.906732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527716+0000","last_change":"2023-07-20T10:09:24.211709+0000","last_active":"2023-07-20T10:09:25.527716+0000","last_peered":"2023-07-20T10:09:25.527716+0000","last_clean":"2023-07-20T10:09:25.527716+0000","last_became_active":"2023-07-20T10:09:24.211448+0000","last_became_peered":"2023-07-20T10:09:24.211448+0000","last_unstale":"2023-07-20T10:09:25.527716+0000","last_undegraded":"2023-07-20T10:09:25.527716+0000","last_fullsized":"2023-07-20T10:09:25.527716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:42:14.813947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692788+0000","last_change":"2023-07-20T10:09:23.200040+0000","last_active":"2023-07-20T10:09:25.692788+0000","last_peered":"2023-07-20T10:09:25.692788+0000","last_clean":"2023-07-20T10:09:25.692788+0000","last_became_active":"2023-07-20T10:09:23.199720+0000","last_became_peered":"2023-07-20T10:09:23.199720+0000","last_unstale":"2023-07-20T10:09:25.692788+0000","last_undegraded":"2023-07-20T10:09:25.692788+0000","last_fullsized":"2023-07-20T10:09:25.692788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:22.368036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184009+0000","last_change":"2023-07-20T10:09:24.200457+0000","last_active":"2023-07-20T10:09:25.184009+0000","last_peered":"2023-07-20T10:09:25.184009+0000","last_clean":"2023-07-20T10:09:25.184009+0000","last_became_active":"2023-07-20T10:09:24.199771+0000","last_became_peered":"2023-07-20T10:09:24.199771+0000","last_unstale":"2023-07-20T10:09:25.184009+0000","last_undegraded":"2023-07-20T10:09:25.184009+0000","last_fullsized":"2023-07-20T10:09:25.184009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:54:23.378042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692867+0000","last_change":"2023-07-20T10:09:23.197179+0000","last_active":"2023-07-20T10:09:25.692867+0000","last_peered":"2023-07-20T10:09:25.692867+0000","last_clean":"2023-07-20T10:09:25.692867+0000","last_became_active":"2023-07-20T10:09:23.196779+0000","last_became_peered":"2023-07-20T10:09:23.196779+0000","last_unstale":"2023-07-20T10:09:25.692867+0000","last_undegraded":"2023-07-20T10:09:25.692867+0000","last_fullsized":"2023-07-20T10:09:25.692867+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:53.200473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691655+0000","last_change":"2023-07-20T10:09:24.208431+0000","last_active":"2023-07-20T10:09:25.691655+0000","last_peered":"2023-07-20T10:09:25.691655+0000","last_clean":"2023-07-20T10:09:25.691655+0000","last_became_active":"2023-07-20T10:09:24.208119+0000","last_became_peered":"2023-07-20T10:09:24.208119+0000","last_unstale":"2023-07-20T10:09:25.691655+0000","last_undegraded":"2023-07-20T10:09:25.691655+0000","last_fullsized":"2023-07-20T10:09:25.691655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:36:53.327634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.527736+0000","last_change":"2023-07-20T10:09:23.200286+0000","last_active":"2023-07-20T10:09:25.527736+0000","last_peered":"2023-07-20T10:09:25.527736+0000","last_clean":"2023-07-20T10:09:25.527736+0000","last_became_active":"2023-07-20T10:09:23.199939+0000","last_became_peered":"2023-07-20T10:09:23.199939+0000","last_unstale":"2023-07-20T10:09:25.527736+0000","last_undegraded":"2023-07-20T10:09:25.527736+0000","last_fullsized":"2023-07-20T10:09:25.527736+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:13:55.929972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184906+0000","last_change":"2023-07-20T10:09:24.217781+0000","last_active":"2023-07-20T10:09:25.184906+0000","last_peered":"2023-07-20T10:09:25.184906+0000","last_clean":"2023-07-20T10:09:25.184906+0000","last_became_active":"2023-07-20T10:09:24.217439+0000","last_became_peered":"2023-07-20T10:09:24.217439+0000","last_unstale":"2023-07-20T10:09:25.184906+0000","last_undegraded":"2023-07-20T10:09:25.184906+0000","last_fullsized":"2023-07-20T10:09:25.184906+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:53.916739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691558+0000","last_change":"2023-07-20T10:09:23.204306+0000","last_active":"2023-07-20T10:09:25.691558+0000","last_peered":"2023-07-20T10:09:25.691558+0000","last_clean":"2023-07-20T10:09:25.691558+0000","last_became_active":"2023-07-20T10:09:23.204004+0000","last_became_peered":"2023-07-20T10:09:23.204004+0000","last_unstale":"2023-07-20T10:09:25.691558+0000","last_undegraded":"2023-07-20T10:09:25.691558+0000","last_fullsized":"2023-07-20T10:09:25.691558+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:30:07.648631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691940+0000","last_change":"2023-07-20T10:09:24.213311+0000","last_active":"2023-07-20T10:09:25.691940+0000","last_peered":"2023-07-20T10:09:25.691940+0000","last_clean":"2023-07-20T10:09:25.691940+0000","last_became_active":"2023-07-20T10:09:24.213027+0000","last_became_peered":"2023-07-20T10:09:24.213027+0000","last_unstale":"2023-07-20T10:09:25.691940+0000","last_undegraded":"2023-07-20T10:09:25.691940+0000","last_fullsized":"2023-07-20T10:09:25.691940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:59:31.538183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"136'8","reported_seq":21,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.183895+0000","last_change":"2023-07-20T10:09:23.200233+0000","last_active":"2023-07-20T10:09:25.183895+0000","last_peered":"2023-07-20T10:09:25.183895+0000","last_clean":"2023-07-20T10:09:25.183895+0000","last_became_active":"2023-07-20T10:09:23.199952+0000","last_became_peered":"2023-07-20T10:09:23.199952+0000","last_unstale":"2023-07-20T10:09:25.183895+0000","last_undegraded":"2023-07-20T10:09:25.183895+0000","last_fullsized":"2023-07-20T10:09:25.183895+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:10:00.394240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"126'227","reported_seq":768,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691641+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T10:09:25.691641+0000","last_peered":"2023-07-20T10:09:25.691641+0000","last_clean":"2023-07-20T10:09:25.691641+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T10:09:25.691641+0000","last_undegraded":"2023-07-20T10:09:25.691641+0000","last_fullsized":"2023-07-20T10:09:25.691641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:39.369895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188288+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T10:09:25.188288+0000","last_peered":"2023-07-20T10:09:25.188288+0000","last_clean":"2023-07-20T10:09:25.188288+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T10:09:25.188288+0000","last_undegraded":"2023-07-20T10:09:25.188288+0000","last_fullsized":"2023-07-20T10:09:25.188288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:46:50.850322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677088+0000","last_change":"2023-07-20T10:09:24.214767+0000","last_active":"2023-07-20T10:09:25.677088+0000","last_peered":"2023-07-20T10:09:25.677088+0000","last_clean":"2023-07-20T10:09:25.677088+0000","last_became_active":"2023-07-20T10:09:24.214479+0000","last_became_peered":"2023-07-20T10:09:24.214479+0000","last_unstale":"2023-07-20T10:09:25.677088+0000","last_undegraded":"2023-07-20T10:09:25.677088+0000","last_fullsized":"2023-07-20T10:09:25.677088+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:10:00.227881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"136'2","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184449+0000","last_change":"2023-07-20T10:09:23.195015+0000","last_active":"2023-07-20T10:09:25.184449+0000","last_peered":"2023-07-20T10:09:25.184449+0000","last_clean":"2023-07-20T10:09:25.184449+0000","last_became_active":"2023-07-20T10:09:23.194736+0000","last_became_peered":"2023-07-20T10:09:23.194736+0000","last_unstale":"2023-07-20T10:09:25.184449+0000","last_undegraded":"2023-07-20T10:09:25.184449+0000","last_fullsized":"2023-07-20T10:09:25.184449+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:35.233874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.691340+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T10:09:25.691340+0000","last_peered":"2023-07-20T10:09:25.691340+0000","last_clean":"2023-07-20T10:09:25.691340+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T10:09:25.691340+0000","last_undegraded":"2023-07-20T10:09:25.691340+0000","last_fullsized":"2023-07-20T10:09:25.691340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:45.398983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184632+0000","last_change":"2023-07-20T10:09:24.213903+0000","last_active":"2023-07-20T10:09:25.184632+0000","last_peered":"2023-07-20T10:09:25.184632+0000","last_clean":"2023-07-20T10:09:25.184632+0000","last_became_active":"2023-07-20T10:09:24.213621+0000","last_became_peered":"2023-07-20T10:09:24.213621+0000","last_unstale":"2023-07-20T10:09:25.184632+0000","last_undegraded":"2023-07-20T10:09:25.184632+0000","last_fullsized":"2023-07-20T10:09:25.184632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:32.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184468+0000","last_change":"2023-07-20T10:09:23.195348+0000","last_active":"2023-07-20T10:09:25.184468+0000","last_peered":"2023-07-20T10:09:25.184468+0000","last_clean":"2023-07-20T10:09:25.184468+0000","last_became_active":"2023-07-20T10:09:23.194624+0000","last_became_peered":"2023-07-20T10:09:23.194624+0000","last_unstale":"2023-07-20T10:09:25.184468+0000","last_undegraded":"2023-07-20T10:09:25.184468+0000","last_fullsized":"2023-07-20T10:09:25.184468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":244,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486297+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T10:09:25.486297+0000","last_peered":"2023-07-20T10:09:25.486297+0000","last_clean":"2023-07-20T10:09:25.486297+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T10:09:25.486297+0000","last_undegraded":"2023-07-20T10:09:25.486297+0000","last_fullsized":"2023-07-20T10:09:25.486297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:36:44.689711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.486370+0000","last_change":"2023-07-20T10:09:24.188340+0000","last_active":"2023-07-20T10:09:25.486370+0000","last_peered":"2023-07-20T10:09:25.486370+0000","last_clean":"2023-07-20T10:09:25.486370+0000","last_became_active":"2023-07-20T10:09:24.188066+0000","last_became_peered":"2023-07-20T10:09:24.188066+0000","last_unstale":"2023-07-20T10:09:25.486370+0000","last_undegraded":"2023-07-20T10:09:25.486370+0000","last_fullsized":"2023-07-20T10:09:25.486370+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:13.858613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184019+0000","last_change":"2023-07-20T10:09:23.194975+0000","last_active":"2023-07-20T10:09:25.184019+0000","last_peered":"2023-07-20T10:09:25.184019+0000","last_clean":"2023-07-20T10:09:25.184019+0000","last_became_active":"2023-07-20T10:09:23.193772+0000","last_became_peered":"2023-07-20T10:09:23.193772+0000","last_unstale":"2023-07-20T10:09:25.184019+0000","last_undegraded":"2023-07-20T10:09:25.184019+0000","last_fullsized":"2023-07-20T10:09:25.184019+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:25:49.179515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188100+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T10:09:25.188100+0000","last_peered":"2023-07-20T10:09:25.188100+0000","last_clean":"2023-07-20T10:09:25.188100+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T10:09:25.188100+0000","last_undegraded":"2023-07-20T10:09:25.188100+0000","last_fullsized":"2023-07-20T10:09:25.188100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:02.671676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.676975+0000","last_change":"2023-07-20T10:09:24.216027+0000","last_active":"2023-07-20T10:09:25.676975+0000","last_peered":"2023-07-20T10:09:25.676975+0000","last_clean":"2023-07-20T10:09:25.676975+0000","last_became_active":"2023-07-20T10:09:24.215731+0000","last_became_peered":"2023-07-20T10:09:24.215731+0000","last_unstale":"2023-07-20T10:09:25.676975+0000","last_undegraded":"2023-07-20T10:09:25.676975+0000","last_fullsized":"2023-07-20T10:09:25.676975+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:37:54.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677267+0000","last_change":"2023-07-20T10:09:23.207983+0000","last_active":"2023-07-20T10:09:25.677267+0000","last_peered":"2023-07-20T10:09:25.677267+0000","last_clean":"2023-07-20T10:09:25.677267+0000","last_became_active":"2023-07-20T10:09:23.207684+0000","last_became_peered":"2023-07-20T10:09:23.207684+0000","last_unstale":"2023-07-20T10:09:25.677267+0000","last_undegraded":"2023-07-20T10:09:25.677267+0000","last_fullsized":"2023-07-20T10:09:25.677267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:29:40.488899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":218,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185177+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T10:09:25.185177+0000","last_peered":"2023-07-20T10:09:25.185177+0000","last_clean":"2023-07-20T10:09:25.185177+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T10:09:25.185177+0000","last_undegraded":"2023-07-20T10:09:25.185177+0000","last_fullsized":"2023-07-20T10:09:25.185177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:07.742083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188608+0000","last_change":"2023-07-20T10:09:24.210555+0000","last_active":"2023-07-20T10:09:25.188608+0000","last_peered":"2023-07-20T10:09:25.188608+0000","last_clean":"2023-07-20T10:09:25.188608+0000","last_became_active":"2023-07-20T10:09:24.210282+0000","last_became_peered":"2023-07-20T10:09:24.210282+0000","last_unstale":"2023-07-20T10:09:25.188608+0000","last_undegraded":"2023-07-20T10:09:25.188608+0000","last_fullsized":"2023-07-20T10:09:25.188608+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:00:57.679158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188531+0000","last_change":"2023-07-20T10:09:23.200213+0000","last_active":"2023-07-20T10:09:25.188531+0000","last_peered":"2023-07-20T10:09:25.188531+0000","last_clean":"2023-07-20T10:09:25.188531+0000","last_became_active":"2023-07-20T10:09:23.199855+0000","last_became_peered":"2023-07-20T10:09:23.199855+0000","last_unstale":"2023-07-20T10:09:25.188531+0000","last_undegraded":"2023-07-20T10:09:25.188531+0000","last_fullsized":"2023-07-20T10:09:25.188531+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:18.135593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":222,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.692362+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T10:09:25.692362+0000","last_peered":"2023-07-20T10:09:25.692362+0000","last_clean":"2023-07-20T10:09:25.692362+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T10:09:25.692362+0000","last_undegraded":"2023-07-20T10:09:25.692362+0000","last_fullsized":"2023-07-20T10:09:25.692362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:35:13.906449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185543+0000","last_change":"2023-07-20T10:09:24.203211+0000","last_active":"2023-07-20T10:09:25.185543+0000","last_peered":"2023-07-20T10:09:25.185543+0000","last_clean":"2023-07-20T10:09:25.185543+0000","last_became_active":"2023-07-20T10:09:24.202899+0000","last_became_peered":"2023-07-20T10:09:24.202899+0000","last_unstale":"2023-07-20T10:09:25.185543+0000","last_undegraded":"2023-07-20T10:09:25.185543+0000","last_fullsized":"2023-07-20T10:09:25.185543+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:59.996920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"136'3","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188660+0000","last_change":"2023-07-20T10:09:23.199280+0000","last_active":"2023-07-20T10:09:25.188660+0000","last_peered":"2023-07-20T10:09:25.188660+0000","last_clean":"2023-07-20T10:09:25.188660+0000","last_became_active":"2023-07-20T10:09:23.198746+0000","last_became_peered":"2023-07-20T10:09:23.198746+0000","last_unstale":"2023-07-20T10:09:25.188660+0000","last_undegraded":"2023-07-20T10:09:25.188660+0000","last_fullsized":"2023-07-20T10:09:25.188660+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:32.920465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":217,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.185271+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T10:09:25.185271+0000","last_peered":"2023-07-20T10:09:25.185271+0000","last_clean":"2023-07-20T10:09:25.185271+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T10:09:25.185271+0000","last_undegraded":"2023-07-20T10:09:25.185271+0000","last_fullsized":"2023-07-20T10:09:25.185271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:04.200888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.188806+0000","last_change":"2023-07-20T10:09:24.197578+0000","last_active":"2023-07-20T10:09:25.188806+0000","last_peered":"2023-07-20T10:09:25.188806+0000","last_clean":"2023-07-20T10:09:25.188806+0000","last_became_active":"2023-07-20T10:09:24.197306+0000","last_became_peered":"2023-07-20T10:09:24.197306+0000","last_unstale":"2023-07-20T10:09:25.188806+0000","last_undegraded":"2023-07-20T10:09:25.188806+0000","last_fullsized":"2023-07-20T10:09:25.188806+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:23.167134+0000","last_clean_scrub_stamp":"2023-07-20T10:09:23.167134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:42.208337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"136'6","reported_seq":19,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.184545+0000","last_change":"2023-07-20T10:09:23.193201+0000","last_active":"2023-07-20T10:09:25.184545+0000","last_peered":"2023-07-20T10:09:25.184545+0000","last_clean":"2023-07-20T10:09:25.184545+0000","last_became_active":"2023-07-20T10:09:23.192873+0000","last_became_peered":"2023-07-20T10:09:23.192873+0000","last_unstale":"2023-07-20T10:09:25.184545+0000","last_undegraded":"2023-07-20T10:09:25.184545+0000","last_fullsized":"2023-07-20T10:09:25.184545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T10:09:22.157127+0000","last_clean_scrub_stamp":"2023-07-20T10:09:22.157127+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:25:39.161411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":219,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-07-20T10:09:25.677336+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T10:09:25.677336+0000","last_peered":"2023-07-20T10:09:25.677336+0000","last_clean":"2023-07-20T10:09:25.677336+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T10:09:25.677336+0000","last_undegraded":"2023-07-20T10:09:25.677336+0000","last_fullsized":"2023-07-20T10:09:25.677336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:24.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59616,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312224,"statfs":{"total":96636764160,"available":96575717376,"internally_reserved":0,"allocated":2310144,"data_stored":1447849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.71199999999999997,"15min":0.73999999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.153,"15min":1.153},"last":1.038},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.71399999999999997,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.40300000000000002,"15min":0.35299999999999998},"max":{"1min":0.92100000000000004,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.92300000000000004}]},{"osd":1,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36899999999999999},"max":{"1min":0.90100000000000002,"5min":0.93899999999999995,"15min":1.008},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.70499999999999996},"min":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.35999999999999999},"max":{"1min":1.018,"5min":1.05,"15min":1.075},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67300000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.42699999999999999,"15min":0.40999999999999998},"max":{"1min":0.998,"5min":0.998,"15min":1.0329999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.57099999999999995,"5min":0.498,"15min":0.40600000000000003},"max":{"1min":0.91100000000000003,"5min":1.01,"15min":1.716},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.443,"15min":0.433},"max":{"1min":0.97399999999999998,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72099999999999997,"15min":0.73999999999999999},"min":{"1min":0.53900000000000003,"5min":0.45800000000000002,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":1.3759999999999999,"15min":1.758},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":0.82999999999999996,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.434,"15min":0.40100000000000002},"max":{"1min":0.93799999999999994,"5min":1.01,"15min":1.0149999999999999},"last":0.79000000000000004}]},{"osd":5,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.621},"min":{"1min":0.436,"5min":0.377,"15min":0.32400000000000001},"max":{"1min":0.95899999999999996,"5min":0.97499999999999998,"15min":1.8},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jul 20 10:08:49 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71199999999999997,"15min":0.69599999999999995},"min":{"1min":0.51200000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.995,"15min":0.999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63900000000000001},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.84699999999999998,"5min":0.97699999999999998,"15min":1.1220000000000001},"last":0.93700000000000006}]}]},{"osd":6,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":857287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69899999999999995,"15min":0.73199999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.32000000000000001},"max":{"1min":0.93500000000000005,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.77500000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.40899999999999997},"max":{"1min":1.004,"5min":1.0620000000000001,"15min":1.2010000000000001},"last":0.77800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.69299999999999995,"15min":0.71699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.29599999999999999},"max":{"1min":0.86199999999999999,"5min":0.99299999999999999,"15min":1.1259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.71799999999999997},"min":{"1min":0.436,"5min":0.42299999999999999,"15min":0.33200000000000002},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.103},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67600000000000005,"15min":0.71099999999999997},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.71999999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":0.95699999999999996,"15min":1.0129999999999999},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72399999999999998,"15min":0.74399999999999999},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":1.0389999999999999,"5min":1.1000000000000001,"15min":1.25},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.73199999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.92000000000000004,"15min":1.173},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.54400000000000004,"5min":0.45600000000000002,"15min":0.40600000000000003},"max":{"1min":0.96099999999999997,"5min":1.135,"15min":1.135},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.42399999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.028},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.024,"15min":1.0549999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.373},"max":{"1min":0.84999999999999998,"5min":1.02,"15min":1.155},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.52000000000000002,"5min":0.42399999999999999,"15min":0.40600000000000003},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.88200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1708032,"data_stored":856865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69699999999999995,"15min":0.70699999999999996},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.34999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.52500000000000002,"5min":0.42399999999999999,"15min":0.36699999999999999},"max":{"1min":0.90600000000000003,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.497,"5min":0.46300000000000002,"15min":0.33400000000000002},"max":{"1min":0.84799999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.72199999999999998},"min":{"1min":0.501,"5min":0.433,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.0620000000000001},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.74199999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40899999999999997},"max":{"1min":0.92000000000000004,"5min":1.036,"15min":1.036},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53500000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.034},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.54600000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98699999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28599999999999998},"max":{"1min":0.879,"5min":0.89700000000000002,"15min":0.98499999999999999},"last":0.499},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.61799999999999999},"min":{"1min":0.39600000000000002,"5min":0.373,"15min":0.33300000000000002},"max":{"1min":0.96799999999999997,"5min":0.96999999999999997,"15min":0.99199999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":1.0089999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63400000000000001,"15min":0.65200000000000002},"min":{"1min":0.434,"5min":0.42299999999999999,"15min":0.35499999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63}]},{"osd":7,"last update":"Thu Jul 20 10:08:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.68700000000000006},"min":{"1min":0.47199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.97099999999999997,"5min":1.012,"15min":1.0680000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.41099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834575075,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1712128,"data_stored":858269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.45200000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":1.0069999999999999,"15min":1.0960000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.68500000000000005,"15min":0.69899999999999995},"min":{"1min":0.53300000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92200000000000004,"5min":0.98199999999999998,"15min":1.085},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.71999999999999997},"min":{"1min":0.53600000000000003,"5min":0.42499999999999999,"15min":0.39800000000000002},"max":{"1min":0.996,"5min":0.996,"15min":1.141},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66700000000000004,"15min":0.69799999999999995},"min":{"1min":0.47199999999999998,"5min":0.40799999999999997,"15min":0.36499999999999999},"max":{"1min":0.96699999999999997,"5min":0.98599999999999999,"15min":1.363},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.68100000000000005,"15min":0.72899999999999998},"min":{"1min":0.45300000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90400000000000003,"5min":1.0169999999999999,"15min":1.177},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.77700000000000002,"15min":0.78000000000000003},"min":{"1min":0.61599999999999999,"5min":0.51800000000000002,"15min":0.48299999999999998},"max":{"1min":0.99399999999999999,"5min":1.0049999999999999,"15min":1.23},"last":0.85299999999999998}]},{"osd":3,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.70299999999999996,"15min":0.71999999999999997},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":1.3180000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.72399999999999998,"15min":0.73699999999999999},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.64500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.31900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.196},"last":0.96599999999999997}]},{"osd":6,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32700000000000001},"max":{"1min":0.878,"5min":0.97199999999999998,"15min":1.004},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.52700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.98999999999999999}]},{"osd":7,"last update":"Thu Jul 20 10:08:46 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.62},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.2649999999999999},"last":1.032},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.63900000000000001},"min":{"1min":0.40400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91000000000000003,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.0109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575074,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36888,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334952,"statfs":{"total":96636764160,"available":96598990848,"internally_reserved":0,"allocated":1716224,"data_stored":858303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.42399999999999999,"15min":0.443},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.79600000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":0.61599999999999999,"5min":0.69899999999999995,"15min":0.70299999999999996},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.30499999999999999,"5min":0.29799999999999999,"15min":0.29299999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50800000000000001,"15min":0.52200000000000002},"min":{"1min":0.32800000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.69299999999999995,"5min":0.72299999999999998,"15min":0.81999999999999995},"last":0.503}]},{"osd":2,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":0.83799999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54700000000000004,"15min":0.56899999999999995},"min":{"1min":0.377,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72599999999999998,"15min":0.76000000000000001},"min":{"1min":0.5,"5min":0.49399999999999999,"15min":0.436},"max":{"1min":0.873,"5min":1.083,"15min":1.1890000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.751,"15min":0.78000000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.45900000000000002},"max":{"1min":0.91700000000000004,"5min":1.071,"15min":1.381},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.77400000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.96599999999999997,"5min":1.0649999999999999,"15min":1.2330000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73699999999999999,"15min":0.76900000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.92900000000000005,"5min":1.052,"15min":1.3260000000000001},"last":0.878}]},{"osd":6,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.88300000000000001,"5min":1.107,"15min":1.274},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.76200000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.504},"max":{"1min":0.98399999999999999,"5min":1.04,"15min":1.131},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 10:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53400000000000003,"5min":0.5,"15min":0.49199999999999999},"max":{"1min":0.95399999999999996,"5min":1.018,"15min":1.4399999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76500000000000001,"15min":0.79300000000000004},"min":{"1min":0.56399999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.155,"15min":1.5049999999999999},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575074,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54928,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316912,"statfs":{"total":96636764160,"available":96580517888,"internally_reserved":0,"allocated":1699840,"data_stored":856705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46800000000000003},"min":{"1min":0.314,"5min":0.26600000000000001,"15min":0.247},"max":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.89300000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.73699999999999999,"15min":0.84499999999999997},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44700000000000001,"15min":0.46800000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.58099999999999996,"5min":0.68899999999999995,"15min":0.876},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.35399999999999998,"15min":0.32900000000000001},"max":{"1min":0.622,"5min":0.77500000000000002,"15min":0.96899999999999997},"last":0.436}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53500000000000003,"15min":0.55400000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.93000000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.38200000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.71599999999999997,"5min":0.81899999999999995,"15min":0.95199999999999996},"last":0.373}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.499,"5min":0.48299999999999998,"15min":0.39100000000000001},"max":{"1min":1.03,"5min":1.1890000000000001,"15min":1.25},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.76900000000000002,"15min":0.79200000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.41899999999999998},"max":{"1min":1.073,"5min":1.127,"15min":1.2689999999999999},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77800000000000002,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0589999999999999,"5min":1.1619999999999999,"15min":1.2470000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78700000000000003},"min":{"1min":0.55600000000000005,"5min":0.54400000000000004,"15min":0.45700000000000002},"max":{"1min":1.083,"5min":1.1040000000000001,"15min":1.1870000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.1579999999999999,"15min":1.2150000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.80000000000000004,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.47199999999999998},"max":{"1min":1.095,"5min":1.218,"15min":1.3240000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.81000000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.143,"15min":1.292},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79500000000000004,"15min":0.81799999999999995},"min":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.028,"5min":1.204,"15min":1.393},"last":0.83199999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":856727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.23400000000000001},"max":{"1min":0.55900000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.441},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.53400000000000003},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.77300000000000002,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.5,"15min":0.48499999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28699999999999998},"max":{"1min":4.9029999999999996,"5min":4.9029999999999996,"15min":4.9029999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":4.4390000000000001,"5min":4.4390000000000001,"15min":4.4390000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53900000000000003,"15min":0.56699999999999995},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.60499999999999998,"5min":0.79100000000000004,"15min":0.82599999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95099999999999996,"5min":1.399,"15min":1.399},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.47599999999999998},"max":{"1min":0.89800000000000002,"5min":1.0269999999999999,"15min":1.0840000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.749,"15min":0.76000000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.0329999999999999,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.76000000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.77200000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jul 20 10:08:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.77400000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.117},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.76000000000000001,"15min":0.77800000000000002},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.69499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575075,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37464,"kb_used_data":2244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334376,"statfs":{"total":96636764160,"available":96598401024,"internally_reserved":0,"allocated":2297856,"data_stored":1447095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.43099999999999999,"15min":0.45400000000000001},"min":{"1min":0.25700000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":3.0710000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.51700000000000002,"15min":0.54500000000000004},"min":{"1min":0.29199999999999998,"5min":0.28199999999999997,"15min":0.27200000000000002},"max":{"1min":0.625,"5min":4.0190000000000001,"15min":5.1619999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":3.2509999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54500000000000004,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.626,"5min":3.9750000000000001,"15min":10.141999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.54200000000000004},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.63900000000000001,"5min":0.95799999999999996,"15min":10.631},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73999999999999999,"5min":0.76800000000000002,"15min":3.2909999999999999},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76800000000000002,"15min":0.79400000000000004},"min":{"1min":0.53900000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0409999999999999,"5min":1.232,"15min":1.6779999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76700000000000002,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96799999999999997,"5min":1.216,"15min":3.125},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80000000000000004,"15min":0.84099999999999997},"min":{"1min":0.61699999999999999,"5min":0.49099999999999999,"15min":0.38500000000000001},"max":{"1min":1.105,"5min":3.3919999999999999,"15min":7.4340000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.78300000000000003,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.044,"5min":1.3400000000000001,"15min":1.7949999999999999},"last":0.503}]},{"osd":6,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76700000000000002,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":3.161},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.80400000000000005,"15min":0.83199999999999996},"min":{"1min":0.59099999999999997,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":1.0669999999999999,"5min":3.5139999999999998,"15min":5.1189999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jul 20 10:08:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0209999999999999,"5min":4.1470000000000002,"15min":5.1970000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.56100000000000005,"5min":0.51800000000000002,"15min":0.47399999999999998},"max":{"1min":1.0880000000000001,"5min":1.3089999999999999,"15min":1.766},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T10:09:33.086 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T10:09:33.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T10:09:33.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 Processor -- start 2023-07-20T10:09:33.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 -- start start 2023-07-20T10:09:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f193c0afdc0 0x7f193c070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f193c0b0250 0x7f193c070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0c95d0 con 0x7f193c158ce0 2023-07-20T10:09:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c1590c0 con 0x7f193c0afdc0 2023-07-20T10:09:33.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f19439ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0c89c0 con 0x7f193c0b0250 2023-07-20T10:09:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f193c0afdc0 0x7f193c070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f193c0afdc0 0x7f193c070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58740/0 (socket says 172.21.15.82:58740) 2023-07-20T10:09:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 -- 172.21.15.82:0/2683842522 learned_addr learned my addr 172.21.15.82:0/2683842522 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:33.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 -- 172.21.15.82:0/2683842522 >> v2:172.21.15.183:3300/0 conn(0x7f193c0b0250 msgr2=0x7f193c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:33.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 --2- 172.21.15.82:0/2683842522 >> v2:172.21.15.183:3300/0 conn(0x7f193c0b0250 0x7f193c070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 -- 172.21.15.82:0/2683842522 >> v1:172.21.15.183:6789/0 conn(0x7f193c158ce0 legacy=0x7f193c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:33.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.297+0000 7f1940f55640 1 -- 172.21.15.82:0/2683842522 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0c8ca0 con 0x7f193c0afdc0 2023-07-20T10:09:33.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f1940f55640 1 --2- 172.21.15.82:0/2683842522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0afdc0 0x7f193c070970 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f193c06c420 tx=0x7f192c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ea259284ea35a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f1933fff640 1 -- 172.21.15.82:0/2683842522 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0aa5f0 con 0x7f193c0afdc0 2023-07-20T10:09:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f1933fff640 1 -- 172.21.15.82:0/2683842522 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c0aa750 con 0x7f193c0afdc0 2023-07-20T10:09:33.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f1933fff640 1 -- 172.21.15.82:0/2683842522 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0aaae0 con 0x7f193c0afdc0 2023-07-20T10:09:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 -- 172.21.15.82:0/2683842522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0afdc0 msgr2=0x7f193c070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 --2- 172.21.15.82:0/2683842522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0afdc0 0x7f193c070970 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f193c06c420 tx=0x7f192c01c490 comp rx=0 tx=0).stop 2023-07-20T10:09:33.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 -- 172.21.15.82:0/2683842522 shutdown_connections 2023-07-20T10:09:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 --2- 172.21.15.82:0/2683842522 >> v2:172.21.15.183:3300/0 conn(0x7f193c0b0250 0x7f193c070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 --2- 172.21.15.82:0/2683842522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0afdc0 0x7f193c070970 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 -- 172.21.15.82:0/2683842522 >> 172.21.15.82:0/2683842522 conn(0x7f193c0cad50 msgr2=0x7f193c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 -- 172.21.15.82:0/2683842522 shutdown_connections 2023-07-20T10:09:33.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 -- 172.21.15.82:0/2683842522 wait complete. 2023-07-20T10:09:33.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.301+0000 7f19439ba640 1 Processor -- start 2023-07-20T10:09:33.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- start start 2023-07-20T10:09:33.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f193c0afdc0 0x7f193c14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f193c158ce0 0x7f193c1497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c14b450 con 0x7f193c0b0250 2023-07-20T10:09:33.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c149320 con 0x7f193c158ce0 2023-07-20T10:09:33.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c14b170 con 0x7f193c0afdc0 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58744/0 (socket says 172.21.15.82:58744) 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 -- 172.21.15.82:0/785717749 learned_addr learned my addr 172.21.15.82:0/785717749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1941756640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f193c0afdc0 0x7f193c14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1941f57640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f193c158ce0 0x7f193c1497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 -- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f193c0afdc0 msgr2=0x7f193c14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f193c0afdc0 0x7f193c14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 -- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f193c158ce0 msgr2=0x7f193c1497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f193c158ce0 0x7f193c1497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 -- 172.21.15.82:0/785717749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0094d0 con 0x7f193c0b0250 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1940f55640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f192c01a0c0 tx=0x7f192c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0b3800 con 0x7f193c0b0250 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c0b3960 con 0x7f193c0b0250 2023-07-20T10:09:33.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c148cd0 con 0x7f193c0b0250 2023-07-20T10:09:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0b3d10 con 0x7f193c0b0250 2023-07-20T10:09:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c148960 con 0x7f193c0b0250 2023-07-20T10:09:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.305+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c1494b0 con 0x7f193c0b0250 2023-07-20T10:09:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.309+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f192c0c73a0 con 0x7f193c0b0250 2023-07-20T10:09:33.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.309+0000 7f1931ffb640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 0x7f1920068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.309+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f192c0a7070 con 0x7f193c0b0250 2023-07-20T10:09:33.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.309+0000 7f1941756640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 0x7f1920068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.309+0000 7f1941756640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 0x7f1920068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19380098e0 tx=0x7f1938009060 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.313+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f192c0ebc80 con 0x7f193c0b0250 2023-07-20T10:09:33.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.509+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f193c04da30 con 0x7f193c0b0250 2023-07-20T10:09:33.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f1931ffb640 1 -- 172.21.15.82:0/785717749 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f192c0ef2a0 con 0x7f193c0b0250 2023-07-20T10:09:33.492 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T10:09:33.493 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T10:09:33.493 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T10:09:33.493 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T10:09:33.493 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T10:09:33.493 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T10:09:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 msgr2=0x7f1920068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 0x7f1920068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19380098e0 tx=0x7f1938009060 comp rx=0 tx=0).stop 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 msgr2=0x7f193c0c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f192c01a0c0 tx=0x7f192c01acd0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 shutdown_connections 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f19200663a0 0x7f1920068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f193c158ce0 0x7f193c1497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f193c0b0250 0x7f193c0c1e00 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 --2- 172.21.15.82:0/785717749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f193c0afdc0 0x7f193c14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 >> 172.21.15.82:0/785717749 conn(0x7f193c0cad50 msgr2=0x7f193c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 shutdown_connections 2023-07-20T10:09:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.517+0000 7f19439ba640 1 -- 172.21.15.82:0/785717749 wait complete. 2023-07-20T10:09:33.513 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T10:09:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 Processor -- start 2023-07-20T10:09:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 -- start start 2023-07-20T10:09:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 0x7ff5ac0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 0x7ff5ac0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0cdd60 con 0x7ff5ac0b02e0 2023-07-20T10:09:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b0770 con 0x7ff5ac0ad720 2023-07-20T10:09:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5b0c6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b20a0 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5ac0b02e0 0x7ff5ac06b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38206/0 (socket says 172.21.15.82:38206) 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aad9d640 1 -- 172.21.15.82:0/4037275206 learned_addr learned my addr 172.21.15.82:0/4037275206 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/4037275206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 0x7ff5ac0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5a9d9b640 1 --2- 172.21.15.82:0/4037275206 >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 0x7ff5ac0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5a959a640 1 -- 172.21.15.82:0/4037275206 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727143233 0 0) 0x7ff5ac0cdd60 con 0x7ff5ac0b02e0 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5a959a640 1 -- 172.21.15.82:0/4037275206 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff594003530 con 0x7ff5ac0b02e0 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aa59c640 1 -- 172.21.15.82:0/4037275206 >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 msgr2=0x7ff5ac0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/4037275206 >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 0x7ff5ac0afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aa59c640 1 -- 172.21.15.82:0/4037275206 >> v1:172.21.15.82:6789/0 conn(0x7ff5ac0b02e0 legacy=0x7ff5ac06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5aa59c640 1 -- 172.21.15.82:0/4037275206 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0cd430 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.677+0000 7ff5a9d9b640 1 --2- 172.21.15.82:0/4037275206 >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 0x7ff5ac0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:33.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/4037275206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 0x7ff5ac0b2a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0097c0 tx=0x7ff59c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511741e457725354 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5a959a640 1 -- 172.21.15.82:0/4037275206 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0ab600 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5a959a640 1 -- 172.21.15.82:0/4037275206 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0a7050 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5a959a640 1 -- 172.21.15.82:0/4037275206 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0ab980 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/4037275206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 msgr2=0x7ff5ac0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/4037275206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 0x7ff5ac0b2a30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0097c0 tx=0x7ff59c01c3c0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/4037275206 shutdown_connections 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/4037275206 >> v2:172.21.15.183:3300/0 conn(0x7ff5ac0ad720 0x7ff5ac0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/4037275206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0b1cc0 0x7ff5ac0b2a30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/4037275206 >> 172.21.15.82:0/4037275206 conn(0x7ff5ac0cada0 msgr2=0x7ff5ac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:33.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/4037275206 shutdown_connections 2023-07-20T10:09:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.681+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/4037275206 wait complete. 2023-07-20T10:09:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 Processor -- start 2023-07-20T10:09:33.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- start start 2023-07-20T10:09:33.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0ad720 0x7ff5ac0acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 0x7ff5ac15ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15f590 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15f870 con 0x7ff5ac0b02e0 2023-07-20T10:09:33.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15fb50 con 0x7ff5ac0ad720 2023-07-20T10:09:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58750/0 (socket says 172.21.15.82:58750) 2023-07-20T10:09:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 -- 172.21.15.82:0/3715069388 learned_addr learned my addr 172.21.15.82:0/3715069388 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0ad720 0x7ff5ac0acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5a9d9b640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 0x7ff5ac15ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 -- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0ad720 msgr2=0x7ff5ac0acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0ad720 0x7ff5ac0acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 -- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 msgr2=0x7ff5ac15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 0x7ff5ac15ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 -- 172.21.15.82:0/3715069388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009420 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5a9d9b640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 0x7ff5ac15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5aad9d640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cb40 tx=0x7ff5a400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400aca0 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a400ae00 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4012620 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c009420 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.685+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0b12f0 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac160070 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5a4007070 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff59affd640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 0x7ff58c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:33.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff5a4083ef0 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 0x7ff58c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:33.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.689+0000 7ff5aa59c640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 0x7ff58c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0ad000 tx=0x7ff59c0a6000 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:33.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.693+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5a4051250 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.869+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5ac0cccf0 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff59affd640 1 -- 172.21.15.82:0/3715069388 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7ff5a4017020 con 0x7ff5ac0b1cc0 2023-07-20T10:09:33.848 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:33.848 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T10:09:33.848 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T10:09:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 msgr2=0x7ff58c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 0x7ff58c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0ad000 tx=0x7ff59c0a6000 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 msgr2=0x7ff5ac15b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400cb40 tx=0x7ff5a400a060 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 shutdown_connections 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ff58c0663a0 0x7ff58c068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5ac0b1cc0 0x7ff5ac15b250 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5ac0b02e0 0x7ff5ac15ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 --2- 172.21.15.82:0/3715069388 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5ac0ad720 0x7ff5ac0acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:33.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 >> 172.21.15.82:0/3715069388 conn(0x7ff5ac0cada0 msgr2=0x7ff5ac159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 shutdown_connections 2023-07-20T10:09:33.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:33.873+0000 7ff5b0c6a640 1 -- 172.21.15.82:0/3715069388 wait complete. 2023-07-20T10:09:34.270 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T10:09:23.567798+0000', 'modified': '2023-07-20T10:09:27.209730+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8997}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8997': {'gid': 8997, 'name': 'c', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2741581419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 2741581419}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2741581419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T10:09:34.271 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T10:09:34.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T10:09:34.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 Processor -- start 2023-07-20T10:09:34.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 -- start start 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcdf00ad060 0x7fcdf015d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 0x7fcdf00b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf00cde70 con 0x7fcdf00ca040 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00cbef0 con 0x7fcdf00ad060 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdf4f03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf00ca420 con 0x7fcdf00b1170 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcde5d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcdf00ad060 0x7fcdf015d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdee59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcdf00ca040 0x7fcdf015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38212/0 (socket says 172.21.15.82:38212) 2023-07-20T10:09:34.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdee59c640 1 -- 172.21.15.82:0/1501181209 learned_addr learned my addr 172.21.15.82:0/1501181209 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:34.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/1501181209 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 0x7fcdf00b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcde5d9b640 1 -- 172.21.15.82:0/1501181209 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 msgr2=0x7fcdf00b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/1501181209 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 0x7fcdf00b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcde5d9b640 1 -- 172.21.15.82:0/1501181209 >> v1:172.21.15.82:6789/0 conn(0x7fcdf00ca040 legacy=0x7fcdf015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcde5d9b640 1 -- 172.21.15.82:0/1501181209 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf00cdb40 con 0x7fcdf00ad060 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/1501181209 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 0x7fcdf00b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:34.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.441+0000 7fcdedd9b640 1 -- 172.21.15.82:0/1501181209 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884439193 0 0) 0x7fcdf00cde70 con 0x7fcdf00ca040 2023-07-20T10:09:34.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/1501181209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf015d020 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fcdf015c850 tx=0x7fcdd801d540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab5448e7a7b19bd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdedd9b640 1 -- 172.21.15.82:0/1501181209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80ab650 con 0x7fcdf00ad060 2023-07-20T10:09:34.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdedd9b640 1 -- 172.21.15.82:0/1501181209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd80ab7b0 con 0x7fcdf00ad060 2023-07-20T10:09:34.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdedd9b640 1 -- 172.21.15.82:0/1501181209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80abb40 con 0x7fcdf00ad060 2023-07-20T10:09:34.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 -- 172.21.15.82:0/1501181209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 msgr2=0x7fcdf015d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/1501181209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf015d020 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fcdf015c850 tx=0x7fcdd801d540 comp rx=0 tx=0).stop 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 -- 172.21.15.82:0/1501181209 shutdown_connections 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/1501181209 >> v2:172.21.15.183:3300/0 conn(0x7fcdf00b1170 0x7fcdf00b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/1501181209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf015d020 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 -- 172.21.15.82:0/1501181209 >> 172.21.15.82:0/1501181209 conn(0x7fcdf00cada0 msgr2=0x7fcdf00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 -- 172.21.15.82:0/1501181209 shutdown_connections 2023-07-20T10:09:34.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 -- 172.21.15.82:0/1501181209 wait complete. 2023-07-20T10:09:34.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.445+0000 7fcdf4f03640 1 Processor -- start 2023-07-20T10:09:34.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- start start 2023-07-20T10:09:34.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00b1170 0x7fcdf013b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00ca040 0x7fcdf014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf013c010 con 0x7fcdf00ad060 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0153a40 con 0x7fcdf00ca040 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0151120 con 0x7fcdf00b1170 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58776/0 (socket says 172.21.15.82:58776) 2023-07-20T10:09:34.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 -- 172.21.15.82:0/690518877 learned_addr learned my addr 172.21.15.82:0/690518877 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00ca040 0x7fcdf014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00b1170 0x7fcdf013b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 -- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00b1170 msgr2=0x7fcdf013b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00b1170 0x7fcdf013b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 -- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00ca040 msgr2=0x7fcdf014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00ca040 0x7fcdf014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 -- 172.21.15.82:0/690518877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8009420 con 0x7fcdf00ad060 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdee59c640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fcde000cac0 tx=0x7fcde000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcde77fe640 1 -- 172.21.15.82:0/690518877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000a640 con 0x7fcdf00ad060 2023-07-20T10:09:34.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcde77fe640 1 -- 172.21.15.82:0/690518877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000a7a0 con 0x7fcdf00ad060 2023-07-20T10:09:34.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcde77fe640 1 -- 172.21.15.82:0/690518877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000ab50 con 0x7fcdf00ad060 2023-07-20T10:09:34.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf013b770 con 0x7fcdf00ad060 2023-07-20T10:09:34.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.449+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf013bd30 con 0x7fcdf00ad060 2023-07-20T10:09:34.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde77fe640 1 -- 172.21.15.82:0/690518877 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcde0017020 con 0x7fcdf00ad060 2023-07-20T10:09:34.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde77fe640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 0x7fcdd0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde77fe640 1 -- 172.21.15.82:0/690518877 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcde0087c40 con 0x7fcdf00ad060 2023-07-20T10:09:34.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 0x7fcdd0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 Processor -- start 2023-07-20T10:09:34.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 -- start start 2023-07-20T10:09:34.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 0x7fcdd0068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80af000 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c38100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557909ab50a0 con 0x557909bede90 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557909a43e40 con 0x557909c37d20 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557909a41370 con 0x557909c38640 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58788/0 (socket says 172.21.15.82:58788) 2023-07-20T10:09:34.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 -- 172.21.15.82:0/109925813 learned_addr learned my addr 172.21.15.82:0/109925813 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdee59c640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c38100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 -- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 msgr2=0x557909bed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 -- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 msgr2=0x557909c38100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c38100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdeed9d640 1 -- 172.21.15.82:0/109925813 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557909738890 con 0x557909bede90 2023-07-20T10:09:34.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.453+0000 7fcdee59c640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c38100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:34.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fcde800caa0 tx=0x7fcde800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d1a94c4c3e86b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdcffff640 1 -- 172.21.15.82:0/109925813 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800eb70 con 0x557909bede90 2023-07-20T10:09:34.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdcffff640 1 -- 172.21.15.82:0/109925813 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800ecd0 con 0x557909bede90 2023-07-20T10:09:34.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdcffff640 1 -- 172.21.15.82:0/109925813 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8013450 con 0x557909bede90 2023-07-20T10:09:34.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- 172.21.15.82:0/109925813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 msgr2=0x557909bee270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fcde800caa0 tx=0x7fcde800cf60 comp rx=0 tx=0).stop 2023-07-20T10:09:34.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- 172.21.15.82:0/109925813 shutdown_connections 2023-07-20T10:09:34.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bee270 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- 172.21.15.82:0/109925813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c38100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- 172.21.15.82:0/109925813 >> 172.21.15.82:0/109925813 conn(0x557909be5200 msgr2=0x557909bec230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- 172.21.15.82:0/109925813 shutdown_connections 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- 172.21.15.82:0/109925813 wait complete. 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- start start 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 Processor -- start 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909bf8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bf9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557909a3cc60 con 0x557909bede90 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579099f8ae0 con 0x557909c37d20 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579099f8780 con 0x557909c38640 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdf8268000 10 client.0 _ll_register_callbacks cb 0x557909bd9820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58794/0 (socket says 172.21.15.82:58794) 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 -- 172.21.15.82:0/1800032245 learned_addr learned my addr 172.21.15.82:0/1800032245 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909bf8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bf9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 -- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 msgr2=0x557909bf9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bf9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 -- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 msgr2=0x557909bf8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909bf8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.457+0000 7fcdee59c640 1 -- 172.21.15.82:0/1800032245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde800c700 con 0x557909bede90 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdee59c640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcde00550b0 tx=0x7fcde005cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fee80c326d7608c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde00700d0 con 0x557909bede90 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcde0070230 con 0x557909bede90 2023-07-20T10:09:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579099fcfb0 con 0x557909bede90 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcde00549a0 con 0x557909bede90 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 10 client.9171 fetch_fsmap learned FSMap version 66 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x557909a00d10 con 0x557909bede90 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde0074080 con 0x557909bede90 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcde0054b00 con 0x557909bede90 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 10 client.9171 fetch_fsmap finished waiting for FSMap version 66 2023-07-20T10:09:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 10 client.9171 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 20 client.9171 populate_metadata read hostname 'smithi082' 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3e360 0x557909c3e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 4 client.9171 mds_command: new command op to 8997 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 --> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557909a6b410 con 0x557909c3e360 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3e360 0x557909c3e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3e360 0x557909c3e740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da8b5b847c1fed9 server_cookie=c6de3b59349f0f34 in_seq=0 out_seq=0 2023-07-20T10:09:34.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 10 client.9171 ms_handle_connect on v2:172.21.15.82:6835/2741581419 2023-07-20T10:09:34.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/1800032245 <== mds.0 v2:172.21.15.82:6835/2741581419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557909a6b410 con 0x557909c3e360 2023-07-20T10:09:34.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 10 client.9171 handle_command_reply: tid=0 2023-07-20T10:09:34.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 client.9171 shutdown 2023-07-20T10:09:34.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 msgr2=0x557909bf2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fcde00550b0 tx=0x7fcde005cc30 comp rx=0 tx=0).stop 2023-07-20T10:09:34.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 shutdown_connections 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3e360 0x557909c3e740 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909bf9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909bf8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdcd7fa640 0 client.9171 ms_handle_reset on v2:172.21.15.82:6835/2741581419 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 --2- 172.21.15.82:0/1800032245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909bf2820 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 >> 172.21.15.82:0/1800032245 conn(0x557909be5200 msgr2=0x557909bec230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 shutdown_connections 2023-07-20T10:09:34.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 1 -- 172.21.15.82:0/1800032245 wait complete. 2023-07-20T10:09:34.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.461+0000 7fcdf8268000 20 client.9171 trim_cache size 0 max 16384 2023-07-20T10:09:34.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 Processor -- start 2023-07-20T10:09:34.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 -- start start 2023-07-20T10:09:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909bede90 0x557909c914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c91f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579096f9940 con 0x557909c37d20 2023-07-20T10:09:34.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579099d9a80 con 0x557909bede90 2023-07-20T10:09:34.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557909a7ee60 con 0x557909c38640 2023-07-20T10:09:34.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58796/0 (socket says 172.21.15.82:58796) 2023-07-20T10:09:34.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 -- 172.21.15.82:0/285648495 learned_addr learned my addr 172.21.15.82:0/285648495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdee59c640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909bede90 0x557909c914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c91f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 -- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 msgr2=0x557909c91f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c91f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 -- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909bede90 msgr2=0x557909c914e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909bede90 0x557909c914e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 -- 172.21.15.82:0/285648495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579099e6fa0 con 0x557909c37d20 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.477+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ad040 tx=0x7fcdd8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ddb8214f52757f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcde4d99640 1 -- 172.21.15.82:0/285648495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80bc040 con 0x557909c37d20 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcde4d99640 1 -- 172.21.15.82:0/285648495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd80c3aa0 con 0x557909c37d20 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcde4d99640 1 -- 172.21.15.82:0/285648495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80c3e30 con 0x557909c37d20 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/285648495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 msgr2=0x557909c91a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ad040 tx=0x7fcdd8004740 comp rx=0 tx=0).stop 2023-07-20T10:09:34.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/285648495 shutdown_connections 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c91f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909c37d20 0x557909c91a20 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- 172.21.15.82:0/285648495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909bede90 0x557909c914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/285648495 >> 172.21.15.82:0/285648495 conn(0x557909be5200 msgr2=0x557909bee270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/285648495 shutdown_connections 2023-07-20T10:09:34.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/285648495 wait complete. 2023-07-20T10:09:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- start start 2023-07-20T10:09:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 Processor -- start 2023-07-20T10:09:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c3b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c3bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557909a0ae10 con 0x557909bede90 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557909a3f7c0 con 0x557909c37d20 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557909a40c60 con 0x557909c38640 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 10 client.0 _ll_register_callbacks cb 0x557909ab4ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58802/0 (socket says 172.21.15.82:58802) 2023-07-20T10:09:34.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 -- 172.21.15.82:0/689287992 learned_addr learned my addr 172.21.15.82:0/689287992 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdeed9d640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c3bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c3b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 -- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 msgr2=0x557909c3bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c3bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 -- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 msgr2=0x557909c3b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c3b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 -- 172.21.15.82:0/689287992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf00cdb40 con 0x557909bede90 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdee59c640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcde000a430 tx=0x7fcde0007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2628856fc3ff4b2b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0001960 con 0x557909bede90 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcde0075060 con 0x557909bede90 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.481+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557909bf0620 con 0x557909bede90 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcde0057d20 con 0x557909bede90 2023-07-20T10:09:34.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 10 client.9177 fetch_fsmap learned FSMap version 66 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x557909738cc0 con 0x557909bede90 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557909bf0620 con 0x557909bede90 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcde0059920 con 0x557909bede90 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 10 client.9177 fetch_fsmap finished waiting for FSMap version 66 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 10 client.9177 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T10:09:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 20 client.9177 populate_metadata read hostname 'smithi082' 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3c740 0x557909c9e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 4 client.9177 mds_command: new command op to 8997 tid=0[{"prefix": "status"}] 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 --> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557909a03a20 con 0x557909c3c740 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3c740 0x557909c9e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcde5d9b640 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3c740 0x557909c9e570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb425ddaf73fdbb server_cookie=e8b9857334ee2d18 in_seq=0 out_seq=0 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 10 client.9177 ms_handle_connect on v2:172.21.15.82:6835/2741581419 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 1 -- 172.21.15.82:0/689287992 <== mds.0 v2:172.21.15.82:6835/2741581419 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x557909a03a20 con 0x557909c3c740 2023-07-20T10:09:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 10 client.9177 handle_command_reply: tid=0 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 client.9177 shutdown 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 msgr2=0x557909c3b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fcde000a430 tx=0x7fcde0007d80 comp rx=0 tx=0).stop 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 shutdown_connections 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:6835/2741581419,v1:172.21.15.82:6837/2741581419] conn(0x557909c3c740 0x557909c9e570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557909c38640 0x557909c3bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557909c37d20 0x557909c3b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdcd7fa640 0 client.9177 ms_handle_reset on v2:172.21.15.82:6835/2741581419 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 --2- 172.21.15.82:0/689287992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557909bede90 0x557909c3b330 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 >> 172.21.15.82:0/689287992 conn(0x557909be5200 msgr2=0x557909bee270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 shutdown_connections 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 1 -- 172.21.15.82:0/689287992 wait complete. 2023-07-20T10:09:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf8268000 20 client.9177 trim_cache size 0 max 16384 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 8997, 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T10:09:34.470 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.3099738, 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 66, 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 137, 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 137, 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.304587694999999 2023-07-20T10:09:34.471 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T10:09:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 msgr2=0x7fcdd0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 0x7fcdd0068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80af000 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2023-07-20T10:09:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 msgr2=0x7fcdf0150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fcde000cac0 tx=0x7fcde000cf80 comp rx=0 tx=0).stop 2023-07-20T10:09:34.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 shutdown_connections 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7fcdd00663d0 0x7fcdd0068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcdf00ca040 0x7fcdf014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcdf00b1170 0x7fcdf013b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 --2- 172.21.15.82:0/690518877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcdf00ad060 0x7fcdf0150be0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 >> 172.21.15.82:0/690518877 conn(0x7fcdf00cada0 msgr2=0x7fcdf00c4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 shutdown_connections 2023-07-20T10:09:34.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.485+0000 7fcdf4f03640 1 -- 172.21.15.82:0/690518877 wait complete. 2023-07-20T10:09:34.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T10:09:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.641+0000 7ffb02a88640 1 Processor -- start 2023-07-20T10:09:34.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.641+0000 7ffb02a88640 1 -- start start 2023-07-20T10:09:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb02a88640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffafc15a8e0 0x7ffafc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb02a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb02a88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc0b06c0 con 0x7ffafc0afda0 2023-07-20T10:09:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb02a88640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc0b3160 con 0x7ffafc15a8e0 2023-07-20T10:09:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb02a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc0b12a0 con 0x7ffafc0b2060 2023-07-20T10:09:34.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:44854/0 (socket says 172.21.15.82:44854) 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 -- 172.21.15.82:0/214564618 learned_addr learned my addr 172.21.15.82:0/214564618 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb00824640 1 --1- 172.21.15.82:0/214564618 >> v1:172.21.15.183:6789/0 conn(0x7ffafc0afda0 0x7ffafc0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34922/0 (socket says 172.21.15.82:34922) 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffaf3fff640 1 --2- 172.21.15.82:0/214564618 >> v2:172.21.15.183:3300/0 conn(0x7ffafc15a8e0 0x7ffafc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffaf37fe640 1 -- 172.21.15.82:0/214564618 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352239618 0 0) 0x7ffafc0b06c0 con 0x7ffafc0afda0 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 -- 172.21.15.82:0/214564618 >> v2:172.21.15.183:3300/0 conn(0x7ffafc15a8e0 msgr2=0x7ffafc0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:34.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 --2- 172.21.15.82:0/214564618 >> v2:172.21.15.183:3300/0 conn(0x7ffafc15a8e0 0x7ffafc0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 -- 172.21.15.82:0/214564618 >> v1:172.21.15.183:6789/0 conn(0x7ffafc0afda0 legacy=0x7ffafc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.645+0000 7ffb01025640 1 -- 172.21.15.82:0/214564618 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc0b1580 con 0x7ffafc0b2060 2023-07-20T10:09:34.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb01025640 1 --2- 172.21.15.82:0/214564618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009e50 tx=0x7ffaf401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2036251584a15d0e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffaf37fe640 1 -- 172.21.15.82:0/214564618 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40a5780 con 0x7ffafc0b2060 2023-07-20T10:09:34.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffaf37fe640 1 -- 172.21.15.82:0/214564618 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40a58e0 con 0x7ffafc0b2060 2023-07-20T10:09:34.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffaf37fe640 1 -- 172.21.15.82:0/214564618 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40a5c70 con 0x7ffafc0b2060 2023-07-20T10:09:34.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 -- 172.21.15.82:0/214564618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 msgr2=0x7ffafc0b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 --2- 172.21.15.82:0/214564618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009e50 tx=0x7ffaf401c8c0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 -- 172.21.15.82:0/214564618 shutdown_connections 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 --2- 172.21.15.82:0/214564618 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc0b0180 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 --2- 172.21.15.82:0/214564618 >> v2:172.21.15.183:3300/0 conn(0x7ffafc15a8e0 0x7ffafc0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 -- 172.21.15.82:0/214564618 >> 172.21.15.82:0/214564618 conn(0x7ffafc0cada0 msgr2=0x7ffafc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 -- 172.21.15.82:0/214564618 shutdown_connections 2023-07-20T10:09:34.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 -- 172.21.15.82:0/214564618 wait complete. 2023-07-20T10:09:34.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.649+0000 7ffb02a88640 1 Processor -- start 2023-07-20T10:09:34.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- start start 2023-07-20T10:09:34.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffafc15a8e0 0x7ffafc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc14f180 con 0x7ffafc0afda0 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc152700 con 0x7ffafc15a8e0 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc1529e0 con 0x7ffafc0b2060 2023-07-20T10:09:34.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58810/0 (socket says 172.21.15.82:58810) 2023-07-20T10:09:34.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 -- 172.21.15.82:0/3826627520 learned_addr learned my addr 172.21.15.82:0/3826627520 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:34.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffaf3fff640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb01025640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffafc15a8e0 0x7ffafc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 -- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 msgr2=0x7ffafc15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 -- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffafc15a8e0 msgr2=0x7ffafc15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffafc15a8e0 0x7ffafc15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 -- 172.21.15.82:0/3826627520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009b30 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb00824640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800c520 tx=0x7ffaf800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80074e0 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8007640 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc15c4f0 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80049f0 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc15cab0 con 0x7ffafc0afda0 2023-07-20T10:09:34.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.653+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc073c70 con 0x7ffafc0afda0 2023-07-20T10:09:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.657+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffaf8004b50 con 0x7ffafc0afda0 2023-07-20T10:09:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.657+0000 7ffaf17fa640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 0x7ffae8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.657+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ffaf80834b0 con 0x7ffafc0afda0 2023-07-20T10:09:34.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.657+0000 7ffaf3fff640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 0x7ffae8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:34.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.657+0000 7ffaf3fff640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 0x7ffae8068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffafc1f5e10 tx=0x7ffaec009190 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:34.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.661+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaf80508a0 con 0x7ffafc0afda0 2023-07-20T10:09:34.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.837+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffafc072e00 con 0x7ffafc0afda0 2023-07-20T10:09:34.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.837+0000 7ffaf17fa640 1 -- 172.21.15.82:0/3826627520 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffaf8053ec0 con 0x7ffafc0afda0 2023-07-20T10:09:34.815 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T10:09:34.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 msgr2=0x7ffae8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 0x7ffae8068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffafc1f5e10 tx=0x7ffaec009190 comp rx=0 tx=0).stop 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 msgr2=0x7ffafc14e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800c520 tx=0x7ffaf800c9e0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 shutdown_connections 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7ffae80663a0 0x7ffae8068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffafc15a8e0 0x7ffafc15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffafc0b2060 0x7ffafc15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 --2- 172.21.15.82:0/3826627520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffafc0afda0 0x7ffafc14e9a0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 >> 172.21.15.82:0/3826627520 conn(0x7ffafc0cada0 msgr2=0x7ffafc06f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 shutdown_connections 2023-07-20T10:09:34.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:34.841+0000 7ffb02a88640 1 -- 172.21.15.82:0/3826627520 wait complete. 2023-07-20T10:09:34.835 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T10:09:34.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T10:09:34.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T10:09:34.836 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T10:09:34.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T10:09:34.837 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T10:09:34.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T10:09:34.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T10:09:34.838 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:09:34.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:34.838 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T10:09:34.848 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T10:09:34.849 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41226sec preferred_lft 41226sec 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.850 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.851 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T10:09:34.852 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T10:09:34.853 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T10:09:34.853 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T10:09:34.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:34.854 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T10:09:34.913 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T10:09:34.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:34.916 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T10:09:34.969 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T10:09:34.969 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T10:09:34.969 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T10:09:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T10:09:34.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:34.971 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T10:09:34.971 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T10:09:34.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T10:09:34.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T10:09:34.972 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T10:09:34.973 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T10:09:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:35.066 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T10:09:35.075 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T10:09:35.075 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T10:09:35.076 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:09:35.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:35.076 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T10:09:35.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:09:35.144 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T10:09:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T10:09:35.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T10:09:35.196 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:09:35.250 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T10:09:35.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:35.251 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:09:35.341 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:09:35.342 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:09:35.342 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:09:35.357 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:09:35.357 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:09:35.357 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:09:35.357 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:09:35.357 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:09:35.366 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T10:09:35.366 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T10:09:35.366 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T10:09:35.366 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T10:09:35.366 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T10:09:35.367 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T10:09:35.367 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T10:09:35.367 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T10:09:35.369 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T10:09:35.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:35.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T10:09:35.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:35.392 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T10:09:35.450 INFO:teuthology.orchestra.run.smithi082.stdout:client7589 2023-07-20T10:09:35.450 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T10:09:35.451 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T10:09:35.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T10:09:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.701+0000 7f57bc607640 1 Processor -- start 2023-07-20T10:09:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.701+0000 7f57bc607640 1 -- start start 2023-07-20T10:09:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.701+0000 7f57bc607640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f57b415cab0 0x7f57b40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.701+0000 7f57bc607640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f57b40ce4c0 0x7f57b40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57bc607640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b40d16b0 con 0x7f57b40d0d10 2023-07-20T10:09:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57bc607640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40d31c0 con 0x7f57b415cab0 2023-07-20T10:09:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57bc607640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40b3520 con 0x7f57b40ce4c0 2023-07-20T10:09:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b9ba2640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f57b40d0d10 0x7f57b40cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38220/0 (socket says 172.21.15.82:38220) 2023-07-20T10:09:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b9ba2640 1 -- 172.21.15.82:0/476566782 learned_addr learned my addr 172.21.15.82:0/476566782 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/476566782 >> v2:172.21.15.82:3300/0 conn(0x7f57b415cab0 0x7f57b40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57baba4640 1 --2- 172.21.15.82:0/476566782 >> v2:172.21.15.183:3300/0 conn(0x7f57b40ce4c0 0x7f57b40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 -- 172.21.15.82:0/476566782 >> v2:172.21.15.183:3300/0 conn(0x7f57b40ce4c0 msgr2=0x7f57b40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/476566782 >> v2:172.21.15.183:3300/0 conn(0x7f57b40ce4c0 0x7f57b40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 -- 172.21.15.82:0/476566782 >> v1:172.21.15.82:6789/0 conn(0x7f57b40d0d10 legacy=0x7f57b40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 -- 172.21.15.82:0/476566782 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40b2910 con 0x7f57b415cab0 2023-07-20T10:09:35.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b93a1640 1 -- 172.21.15.82:0/476566782 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644906503 0 0) 0x7f57b40d16b0 con 0x7f57b40d0d10 2023-07-20T10:09:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/476566782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b415cab0 0x7f57b40d0300 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f57b4071cd0 tx=0x7f57b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9f3977166f3171 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b93a1640 1 -- 172.21.15.82:0/476566782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0004230 con 0x7f57b415cab0 2023-07-20T10:09:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b93a1640 1 -- 172.21.15.82:0/476566782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b00a7050 con 0x7f57b415cab0 2023-07-20T10:09:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.705+0000 7f57b93a1640 1 -- 172.21.15.82:0/476566782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0003620 con 0x7f57b415cab0 2023-07-20T10:09:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- 172.21.15.82:0/476566782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b415cab0 msgr2=0x7f57b40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- 172.21.15.82:0/476566782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b415cab0 0x7f57b40d0300 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f57b4071cd0 tx=0x7f57b001c430 comp rx=0 tx=0).stop 2023-07-20T10:09:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- 172.21.15.82:0/476566782 shutdown_connections 2023-07-20T10:09:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- 172.21.15.82:0/476566782 >> v2:172.21.15.183:3300/0 conn(0x7f57b40ce4c0 0x7f57b40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- 172.21.15.82:0/476566782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b415cab0 0x7f57b40d0300 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- 172.21.15.82:0/476566782 >> 172.21.15.82:0/476566782 conn(0x7f57b408c120 msgr2=0x7f57b409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- 172.21.15.82:0/476566782 shutdown_connections 2023-07-20T10:09:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- 172.21.15.82:0/476566782 wait complete. 2023-07-20T10:09:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 Processor -- start 2023-07-20T10:09:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- start start 2023-07-20T10:09:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57b40d0d10 0x7f57b4156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57b415cab0 0x7f57b4157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41576b0 con 0x7f57b40ce4c0 2023-07-20T10:09:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41578f0 con 0x7f57b415cab0 2023-07-20T10:09:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57bc607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4157bd0 con 0x7f57b40d0d10 2023-07-20T10:09:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58824/0 (socket says 172.21.15.82:58824) 2023-07-20T10:09:35.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 -- 172.21.15.82:0/2911515935 learned_addr learned my addr 172.21.15.82:0/2911515935 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:35.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57baba4640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57b415cab0 0x7f57b4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57b9ba2640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57b40d0d10 0x7f57b4156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 -- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57b40d0d10 msgr2=0x7f57b4156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57b40d0d10 0x7f57b4156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 -- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57b415cab0 msgr2=0x7f57b4157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57b415cab0 0x7f57b4157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.709+0000 7f57ba3a3640 1 -- 172.21.15.82:0/2911515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0009420 con 0x7f57b40ce4c0 2023-07-20T10:09:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57ba3a3640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f57b0019040 tx=0x7f57b00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:35.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0003c70 con 0x7f57b40ce4c0 2023-07-20T10:09:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0003dd0 con 0x7f57b40ce4c0 2023-07-20T10:09:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00ab660 con 0x7f57b40ce4c0 2023-07-20T10:09:35.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b4157eb0 con 0x7f57b40ce4c0 2023-07-20T10:09:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40cabd0 con 0x7f57b40ce4c0 2023-07-20T10:09:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b4073c70 con 0x7f57b40ce4c0 2023-07-20T10:09:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f57b00b2040 con 0x7f57b40ce4c0 2023-07-20T10:09:35.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 0x7f5798068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f57b011e0d0 con 0x7f57b40ce4c0 2023-07-20T10:09:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.713+0000 7f57b9ba2640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 0x7f5798068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.717+0000 7f57b9ba2640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 0x7f5798068890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b4149230 tx=0x7f57a4007b60 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:35.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.717+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57b00eb390 con 0x7f57b40ce4c0 2023-07-20T10:09:35.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.885+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b40b25c0 con 0x7f57980663d0 2023-07-20T10:09:35.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.885+0000 7f57aaffd640 1 -- 172.21.15.82:0/2911515935 <== mgr.8736 v2:172.21.15.82:6832/3908346675 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f57a40071f0 con 0x7f57980663d0 2023-07-20T10:09:35.862 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T10:09:35.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T10:09:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T10:09:35.863 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T10:09:35.863 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T10:09:35.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 msgr2=0x7f5798068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 0x7f5798068890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b4149230 tx=0x7f57a4007b60 comp rx=0 tx=0).stop 2023-07-20T10:09:35.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 msgr2=0x7f57b415f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:35.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f57b0019040 tx=0x7f57b00191d0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 shutdown_connections 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f57980663d0 0x7f5798068890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57b415cab0 0x7f57b4157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57b40d0d10 0x7f57b4156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 --2- 172.21.15.82:0/2911515935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57b40ce4c0 0x7f57b415f570 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 >> 172.21.15.82:0/2911515935 conn(0x7f57b408c120 msgr2=0x7f57b40b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:35.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 shutdown_connections 2023-07-20T10:09:35.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:35.889+0000 7f57bc607640 1 -- 172.21.15.82:0/2911515935 wait complete. 2023-07-20T10:09:35.883 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T10:09:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 Processor -- start 2023-07-20T10:09:36.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 -- start start 2023-07-20T10:09:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21a806f710 0x7f21a806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 0x7f21a815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a815bad0 con 0x7f21a806f710 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a8070030 con 0x7f21a815ec90 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21acb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8071950 con 0x7f21a80ca5a0 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21a806f710 0x7f21a806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21a806f710 0x7f21a806faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58832/0 (socket says 172.21.15.82:58832) 2023-07-20T10:09:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 -- 172.21.15.82:0/1907585349 learned_addr learned my addr 172.21.15.82:0/1907585349 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 -- 172.21.15.82:0/1907585349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 msgr2=0x7f21a815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 --2- 172.21.15.82:0/1907585349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 -- 172.21.15.82:0/1907585349 >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 msgr2=0x7f21a815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a6d9d640 1 --2- 172.21.15.82:0/1907585349 >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 0x7f21a815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 --2- 172.21.15.82:0/1907585349 >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 0x7f21a815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a659c640 1 -- 172.21.15.82:0/1907585349 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a815b230 con 0x7f21a806f710 2023-07-20T10:09:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.049+0000 7f21a6d9d640 1 --2- 172.21.15.82:0/1907585349 >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 0x7f21a815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21a659c640 1 --2- 172.21.15.82:0/1907585349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a806f710 0x7f21a806faf0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f21a80702d0 tx=0x7f219801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6574866bf479cf88 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21a5d9b640 1 -- 172.21.15.82:0/1907585349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980a5730 con 0x7f21a806f710 2023-07-20T10:09:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21a5d9b640 1 -- 172.21.15.82:0/1907585349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21980a5890 con 0x7f21a806f710 2023-07-20T10:09:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21a5d9b640 1 -- 172.21.15.82:0/1907585349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980a5c20 con 0x7f21a806f710 2023-07-20T10:09:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 -- 172.21.15.82:0/1907585349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a806f710 msgr2=0x7f21a806faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 --2- 172.21.15.82:0/1907585349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a806f710 0x7f21a806faf0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f21a80702d0 tx=0x7f219801c9a0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 -- 172.21.15.82:0/1907585349 shutdown_connections 2023-07-20T10:09:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 --2- 172.21.15.82:0/1907585349 >> v2:172.21.15.183:3300/0 conn(0x7f21a815ec90 0x7f21a815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 --2- 172.21.15.82:0/1907585349 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 --2- 172.21.15.82:0/1907585349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a806f710 0x7f21a806faf0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 -- 172.21.15.82:0/1907585349 >> 172.21.15.82:0/1907585349 conn(0x7f21a80cad50 msgr2=0x7f21a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 -- 172.21.15.82:0/1907585349 shutdown_connections 2023-07-20T10:09:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.053+0000 7f21acb37640 1 -- 172.21.15.82:0/1907585349 wait complete. 2023-07-20T10:09:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 Processor -- start 2023-07-20T10:09:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 -- start start 2023-07-20T10:09:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 0x7f21a8158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a80c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80c7420 con 0x7f21a815ec90 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80c7620 con 0x7f21a806f710 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a8154930 con 0x7f21a80ca5a0 2023-07-20T10:09:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58840/0 (socket says 172.21.15.82:58840) 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 -- 172.21.15.82:0/2102072832 learned_addr learned my addr 172.21.15.82:0/2102072832 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a659c640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 0x7f21a8158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f219dd9b640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a80c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 -- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 msgr2=0x7f21a80c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a80c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 -- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 msgr2=0x7f21a8158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 0x7f21a8158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 -- 172.21.15.82:0/2102072832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009b30 con 0x7f21a815ec90 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a659c640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 0x7f21a8158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f219dd9b640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a80c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T10:09:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21a6d9d640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f21a000c7f0 tx=0x7f21a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0004230 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a00043b0 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a8154c10 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.057+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0003860 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a81551d0 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a804da30 con 0x7f21a815ec90 2023-07-20T10:09:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 69) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f21a0003bd0 con 0x7f21a815ec90 2023-07-20T10:09:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f219f7fe640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 0x7f2188068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f21a0084580 con 0x7f21a815ec90 2023-07-20T10:09:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f21a659c640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 0x7f2188068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.061+0000 7f21a659c640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 0x7f2188068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21980ae000 tx=0x7f21980a7070 comp rx=0 tx=0).ready entity=mgr.8736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:36.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.065+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21a0051720 con 0x7f21a815ec90 2023-07-20T10:09:36.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:36.249+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f21a80ae550 con 0x7f21a815ec90 2023-07-20T10:09:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.025+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f21a0051af0 con 0x7f21a815ec90 2023-07-20T10:09:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.025+0000 7f219f7fe640 1 -- 172.21.15.82:0/2102072832 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v70) v1 ==== 92+0+0 (secure 0 0 0) 0x7f21a006f7c0 con 0x7f21a815ec90 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 msgr2=0x7f2188068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 0x7f2188068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f21980ae000 tx=0x7f21980a7070 comp rx=0 tx=0).stop 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 msgr2=0x7f21a80c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f21a000c7f0 tx=0x7f21a000ccb0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 shutdown_connections 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f21880663a0 0x7f2188068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21a815ec90 0x7f21a80c6ee0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21a80ca5a0 0x7f21a80c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 --2- 172.21.15.82:0/2102072832 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21a806f710 0x7f21a8158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 >> 172.21.15.82:0/2102072832 conn(0x7f21a80cad50 msgr2=0x7f21a80aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 shutdown_connections 2023-07-20T10:09:37.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.029+0000 7f21acb37640 1 -- 172.21.15.82:0/2102072832 wait complete. 2023-07-20T10:09:37.028 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T10:09:37.169 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:37.194+0000 7f3fbfe25180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:09:37.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.201+0000 7f828fd11640 1 Processor -- start 2023-07-20T10:09:37.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.201+0000 7f828fd11640 1 -- start start 2023-07-20T10:09:37.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828fd11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 0x7f8288160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828fd11640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f828806ab10 0x7f828806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828fd11640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82880ce4f0 con 0x7f828806c120 2023-07-20T10:09:37.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828fd11640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828806b4c0 con 0x7f828806ab10 2023-07-20T10:09:37.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828fd11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880d0970 con 0x7f82881602b0 2023-07-20T10:09:37.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828d2ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 0x7f8288160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828e2ae640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f828806ab10 0x7f828806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828daad640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f828806c120 0x7f82880cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34934/0 (socket says 172.21.15.82:34934) 2023-07-20T10:09:37.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828daad640 1 -- 172.21.15.82:0/1834643464 learned_addr learned my addr 172.21.15.82:0/1834643464 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828caab640 1 -- 172.21.15.82:0/1834643464 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886419996 0 0) 0x7f82880ce4f0 con 0x7f828806c120 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828caab640 1 -- 172.21.15.82:0/1834643464 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8274003530 con 0x7f828806c120 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828e2ae640 1 -- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 msgr2=0x7f8288160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828e2ae640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 0x7f8288160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828e2ae640 1 -- 172.21.15.82:0/1834643464 >> v1:172.21.15.183:6789/0 conn(0x7f828806c120 legacy=0x7f82880cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828e2ae640 1 -- 172.21.15.82:0/1834643464 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288160e20 con 0x7f828806ab10 2023-07-20T10:09:37.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.205+0000 7f828d2ac640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 0x7f8288160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T10:09:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828e2ae640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f828806af80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64adaf3a7ae145ed server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828caab640 1 -- 172.21.15.82:0/1834643464 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800a5870 con 0x7f828806ab10 2023-07-20T10:09:37.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828caab640 1 -- 172.21.15.82:0/1834643464 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800a59d0 con 0x7f828806ab10 2023-07-20T10:09:37.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828caab640 1 -- 172.21.15.82:0/1834643464 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800a5d60 con 0x7f828806ab10 2023-07-20T10:09:37.185 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f46cc24d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 -- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 msgr2=0x7f828806af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f828806af80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f828001c8c0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 -- 172.21.15.82:0/1834643464 shutdown_connections 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f828806af80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 --2- 172.21.15.82:0/1834643464 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82881602b0 0x7f8288160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 -- 172.21.15.82:0/1834643464 >> 172.21.15.82:0/1834643464 conn(0x7f828808c0a0 msgr2=0x7f828809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 -- 172.21.15.82:0/1834643464 shutdown_connections 2023-07-20T10:09:37.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 -- 172.21.15.82:0/1834643464 wait complete. 2023-07-20T10:09:37.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.209+0000 7f828fd11640 1 Processor -- start 2023-07-20T10:09:37.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- start start 2023-07-20T10:09:37.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f82880b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f828806c120 0x7f82880b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880b1490 con 0x7f82881602b0 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82880cbc90 con 0x7f828806ab10 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82880cbf10 con 0x7f828806c120 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828daad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f82880b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828d2ac640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f828806c120 0x7f82880b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58868/0 (socket says 172.21.15.82:58868) 2023-07-20T10:09:37.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828daad640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f82880b7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:58684/0 (socket says 172.21.15.82:58684) 2023-07-20T10:09:37.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 -- 172.21.15.82:0/3043141748 learned_addr learned my addr 172.21.15.82:0/3043141748 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:37.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 -- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f828806c120 msgr2=0x7f82880b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f828806c120 0x7f82880b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 -- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 msgr2=0x7f82880b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f82880b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 -- 172.21.15.82:0/3043141748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278009420 con 0x7f82881602b0 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828e2ae640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f8280019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800b9650 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800b97b0 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8280009a70 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800b9b60 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82880cc4d0 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.213+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82880cc050 con 0x7f82881602b0 2023-07-20T10:09:37.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.217+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f82800b9cc0 con 0x7f82881602b0 2023-07-20T10:09:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.217+0000 7f827e7fc640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 0x7f826c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.217+0000 7f828daad640 1 -- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 msgr2=0x7f826c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.217+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f828011f230 con 0x7f82881602b0 2023-07-20T10:09:37.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.217+0000 7f828daad640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 0x7f826c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:37.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.225+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82880cc050 con 0x7f82881602b0 2023-07-20T10:09:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.377+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f82880cc050 con 0x7f82881602b0 2023-07-20T10:09:37.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.381+0000 7f827e7fc640 1 -- 172.21.15.82:0/3043141748 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f82880cc050 con 0x7f82881602b0 2023-07-20T10:09:37.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 msgr2=0x7f826c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:37.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 0x7f826c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 msgr2=0x7f82881555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f8280009d90 tx=0x7f8280019660 comp rx=0 tx=0).stop 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 shutdown_connections 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f826c0663f0 0x7f826c0688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82881602b0 0x7f82881555a0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f828806c120 0x7f82880b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 --2- 172.21.15.82:0/3043141748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828806ab10 0x7f82880b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 >> 172.21.15.82:0/3043141748 conn(0x7f828808c0a0 msgr2=0x7f82880cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 shutdown_connections 2023-07-20T10:09:37.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.385+0000 7f828fd11640 1 -- 172.21.15.82:0/3043141748 wait complete. 2023-07-20T10:09:37.381 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T10:09:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 Processor -- start 2023-07-20T10:09:37.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 -- start start 2023-07-20T10:09:37.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f4406c120 0x7f7f440cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f44160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f440d0970 con 0x7f7f4406ab10 2023-07-20T10:09:37.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f44160e20 con 0x7f7f4406c120 2023-07-20T10:09:37.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f49f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440cd300 con 0x7f7f441602b0 2023-07-20T10:09:37.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f43fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7f4406ab10 0x7f7f4406af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38244/0 (socket says 172.21.15.82:38244) 2023-07-20T10:09:37.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f43fff640 1 -- 172.21.15.82:0/3282867606 learned_addr learned my addr 172.21.15.82:0/3282867606 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:37.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f3bfff640 1 --2- 172.21.15.82:0/3282867606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f44160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f437fe640 1 --2- 172.21.15.82:0/3282867606 >> v2:172.21.15.183:3300/0 conn(0x7f7f4406c120 0x7f7f440cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f42ffd640 1 -- 172.21.15.82:0/3282867606 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374108790 0 0) 0x7f7f440d0970 con 0x7f7f4406ab10 2023-07-20T10:09:37.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f42ffd640 1 -- 172.21.15.82:0/3282867606 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f30003530 con 0x7f7f4406ab10 2023-07-20T10:09:37.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f3bfff640 1 -- 172.21.15.82:0/3282867606 >> v2:172.21.15.183:3300/0 conn(0x7f7f4406c120 msgr2=0x7f7f440cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T10:09:37.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f3bfff640 1 --2- 172.21.15.82:0/3282867606 >> v2:172.21.15.183:3300/0 conn(0x7f7f4406c120 0x7f7f440cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f3bfff640 1 -- 172.21.15.82:0/3282867606 >> v1:172.21.15.82:6789/0 conn(0x7f7f4406ab10 legacy=0x7f7f4406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.553+0000 7f7f3bfff640 1 -- 172.21.15.82:0/3282867606 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f440cd5e0 con 0x7f7f441602b0 2023-07-20T10:09:37.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f3bfff640 1 --2- 172.21.15.82:0/3282867606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f44160710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0097c0 tx=0x7f7f2c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7299f629e9b3939 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f42ffd640 1 -- 172.21.15.82:0/3282867606 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0ab600 con 0x7f7f441602b0 2023-07-20T10:09:37.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f42ffd640 1 -- 172.21.15.82:0/3282867606 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0a7050 con 0x7f7f441602b0 2023-07-20T10:09:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f42ffd640 1 -- 172.21.15.82:0/3282867606 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0ab980 con 0x7f7f441602b0 2023-07-20T10:09:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 -- 172.21.15.82:0/3282867606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 msgr2=0x7f7f44160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 --2- 172.21.15.82:0/3282867606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f44160710 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0097c0 tx=0x7f7f2c01c3f0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 -- 172.21.15.82:0/3282867606 shutdown_connections 2023-07-20T10:09:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 --2- 172.21.15.82:0/3282867606 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f44160710 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 --2- 172.21.15.82:0/3282867606 >> v2:172.21.15.183:3300/0 conn(0x7f7f4406c120 0x7f7f440cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 -- 172.21.15.82:0/3282867606 >> 172.21.15.82:0/3282867606 conn(0x7f7f4408c0a0 msgr2=0x7f7f4409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 -- 172.21.15.82:0/3282867606 shutdown_connections 2023-07-20T10:09:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.557+0000 7f7f49f03640 1 -- 172.21.15.82:0/3282867606 wait complete. 2023-07-20T10:09:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 Processor -- start 2023-07-20T10:09:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- start start 2023-07-20T10:09:37.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4406c120 0x7f7f44152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f440c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f440c8680 con 0x7f7f4406ab10 2023-07-20T10:09:37.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44152750 con 0x7f7f4406c120 2023-07-20T10:09:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f44152a30 con 0x7f7f441602b0 2023-07-20T10:09:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58870/0 (socket says 172.21.15.82:58870) 2023-07-20T10:09:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 -- 172.21.15.82:0/1763486877 learned_addr learned my addr 172.21.15.82:0/1763486877 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:37.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f43fff640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f440c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f3bfff640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4406c120 0x7f7f44152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 -- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 msgr2=0x7f7f440c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f440c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 -- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4406c120 msgr2=0x7f7f44152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4406c120 0x7f7f44152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 -- 172.21.15.82:0/1763486877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c009420 con 0x7f7f4406ab10 2023-07-20T10:09:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f437fe640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400e930 tx=0x7f7f3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34009690 con 0x7f7f4406ab10 2023-07-20T10:09:37.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3400ca00 con 0x7f7f4406ab10 2023-07-20T10:09:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f440c88b0 con 0x7f7f4406ab10 2023-07-20T10:09:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400cd70 con 0x7f7f4406ab10 2023-07-20T10:09:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f440c8e70 con 0x7f7f4406ab10 2023-07-20T10:09:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.561+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f4404da30 con 0x7f7f4406ab10 2023-07-20T10:09:37.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.565+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f7f34013470 con 0x7f7f4406ab10 2023-07-20T10:09:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.565+0000 7f7f40ff9640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 0x7f7f240688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.565+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f7f34084150 con 0x7f7f4406ab10 2023-07-20T10:09:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.565+0000 7f7f3bfff640 1 -- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 msgr2=0x7f7f240688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:37.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.565+0000 7f7f3bfff640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 0x7f7f240688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:37.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.569+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f34051600 con 0x7f7f4406ab10 2023-07-20T10:09:37.583 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:37.610+0000 7f3fbfe25180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:09:37.621 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:37.645+0000 7f46cc24d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T10:09:37.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.721+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7f4406a8f0 con 0x7f7f4406ab10 2023-07-20T10:09:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.725+0000 7f7f40ff9640 1 -- 172.21.15.82:0/1763486877 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7f34054c20 con 0x7f7f4406ab10 2023-07-20T10:09:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 msgr2=0x7f7f240688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 0x7f7f240688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 msgr2=0x7f7f44154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400e930 tx=0x7f7f3400edf0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 shutdown_connections 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f7f240663f0 0x7f7f240688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f441602b0 0x7f7f440c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f4406c120 0x7f7f44152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 --2- 172.21.15.82:0/1763486877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f4406ab10 0x7f7f44154c70 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 >> 172.21.15.82:0/1763486877 conn(0x7f7f4408c0a0 msgr2=0x7f7f44158480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 shutdown_connections 2023-07-20T10:09:37.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.729+0000 7f7f49f03640 1 -- 172.21.15.82:0/1763486877 wait complete. 2023-07-20T10:09:37.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T10:09:37.725 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T10:09:37.734 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:37.762+0000 7f3fbfe25180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:09:37.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-07-20T10:09:37.779 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:37.801+0000 7f46cc24d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T10:09:37.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 Processor -- start 2023-07-20T10:09:37.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 -- start start 2023-07-20T10:09:37.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 0x7f593c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0ce4f0 con 0x7f593c1602b0 2023-07-20T10:09:37.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0d0970 con 0x7f593c06c120 2023-07-20T10:09:37.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.949+0000 7f5943288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c160e20 con 0x7f593c06b220 2023-07-20T10:09:37.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5940823640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f593c1602b0 0x7f593c06ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38248/0 (socket says 172.21.15.82:38248) 2023-07-20T10:09:37.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5940823640 1 -- 172.21.15.82:0/2507125556 learned_addr learned my addr 172.21.15.82:0/2507125556 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:37.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5941825640 1 --2- 172.21.15.82:0/2507125556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 0x7f593c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5933fff640 1 -- 172.21.15.82:0/2507125556 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131853147 0 0) 0x7f593c0ce4f0 con 0x7f593c1602b0 2023-07-20T10:09:37.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5933fff640 1 -- 172.21.15.82:0/2507125556 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5928003530 con 0x7f593c1602b0 2023-07-20T10:09:37.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5941825640 1 -- 172.21.15.82:0/2507125556 >> v1:172.21.15.183:6789/0 conn(0x7f593c06c120 legacy=0x7f593c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5941825640 1 -- 172.21.15.82:0/2507125556 >> v1:172.21.15.82:6789/0 conn(0x7f593c1602b0 legacy=0x7f593c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5941825640 1 -- 172.21.15.82:0/2507125556 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0cd300 con 0x7f593c06b220 2023-07-20T10:09:37.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5941825640 1 --2- 172.21.15.82:0/2507125556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 0x7f593c160740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5934009dc0 tx=0x7f593401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89875bbb05138dab server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5933fff640 1 -- 172.21.15.82:0/2507125556 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340a5970 con 0x7f593c06b220 2023-07-20T10:09:37.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5933fff640 1 -- 172.21.15.82:0/2507125556 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59340a5ad0 con 0x7f593c06b220 2023-07-20T10:09:37.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.953+0000 7f5933fff640 1 -- 172.21.15.82:0/2507125556 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340a5e60 con 0x7f593c06b220 2023-07-20T10:09:37.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- 172.21.15.82:0/2507125556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 msgr2=0x7f593c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 --2- 172.21.15.82:0/2507125556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 0x7f593c160740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5934009dc0 tx=0x7f593401c8b0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- 172.21.15.82:0/2507125556 shutdown_connections 2023-07-20T10:09:37.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 --2- 172.21.15.82:0/2507125556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06b220 0x7f593c160740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- 172.21.15.82:0/2507125556 >> 172.21.15.82:0/2507125556 conn(0x7f593c08c0a0 msgr2=0x7f593c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:37.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- 172.21.15.82:0/2507125556 shutdown_connections 2023-07-20T10:09:37.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- 172.21.15.82:0/2507125556 wait complete. 2023-07-20T10:09:37.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 Processor -- start 2023-07-20T10:09:37.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- start start 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 0x7f593c0b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06c120 0x7f593c0cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f593c1602b0 0x7f593c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0cbda0 con 0x7f593c06b220 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0cc770 con 0x7f593c1602b0 2023-07-20T10:09:37.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5943288640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c155460 con 0x7f593c06c120 2023-07-20T10:09:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5941024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 0x7f593c0b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5941024640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 0x7f593c0b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58872/0 (socket says 172.21.15.82:58872) 2023-07-20T10:09:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5941024640 1 -- 172.21.15.82:0/2128478181 learned_addr learned my addr 172.21.15.82:0/2128478181 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06c120 0x7f593c0cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.957+0000 7f5941825640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f593c1602b0 0x7f593c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06c120 msgr2=0x7f593c0cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f593c06c120 0x7f593c0cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f593c1602b0 msgr2=0x7f593c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f593c1602b0 0x7f593c154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5934009a70 con 0x7f593c06b220 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941825640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f593c1602b0 0x7f593c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5941024640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 0x7f593c0b68a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f593800c530 tx=0x7f593800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938005220 con 0x7f593c06b220 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938005380 con 0x7f593c06b220 2023-07-20T10:09:37.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938007270 con 0x7f593c06b220 2023-07-20T10:09:37.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c0caeb0 con 0x7f593c06b220 2023-07-20T10:09:37.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c0cb470 con 0x7f593c06b220 2023-07-20T10:09:37.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c0b2810 con 0x7f593c06b220 2023-07-20T10:09:37.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 70) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f59380073d0 con 0x7f593c06b220 2023-07-20T10:09:37.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:37.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5940823640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 msgr2=0x7f59200688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:37.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f59380837c0 con 0x7f593c06b220 2023-07-20T10:09:37.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.961+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T10:09:37.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:37.965+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5938050b00 con 0x7f593c06b220 2023-07-20T10:09:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:38.137+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f593c161100 con 0x7f59200663f0 2023-07-20T10:09:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:38.165+0000 7f5940823640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 msgr2=0x7f59200688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:38.165+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T10:09:38.213 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.238+0000 7f3fbfe25180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:38.269 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.293+0000 7f46cc24d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:38.270 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.298+0000 7f3fbfe25180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:09:38.326 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.353+0000 7f3fbfe25180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:09:38.327 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.353+0000 7f46cc24d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T10:09:38.383 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.409+0000 7f46cc24d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T10:09:38.411 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.437+0000 7f3fbfe25180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:09:38.469 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.493+0000 7f3fbfe25180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:09:38.470 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.493+0000 7f46cc24d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T10:09:38.527 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.549+0000 7f46cc24d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T10:09:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:38.569+0000 7f5940823640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 msgr2=0x7f59200688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:38.569+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T10:09:38.552 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.577+0000 7f3fbfe25180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:09:38.608 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.633+0000 7f3fbfe25180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:09:38.612 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.637+0000 7f46cc24d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T10:09:38.668 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.693+0000 7f46cc24d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T10:09:38.749 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.773+0000 7f3fbfe25180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:09:38.807 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:38.833+0000 7f3fbfe25180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:09:38.809 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.833+0000 7f46cc24d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T10:09:38.867 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:38.893+0000 7f46cc24d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T10:09:39.044 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:09:39.045 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:09:39.045 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:09:39.052 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:39.081+0000 7f3fbfe25180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:09:39.106 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T10:09:39.107 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T10:09:39.107 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T10:09:39.115 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:39.137+0000 7f46cc24d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T10:09:39.188 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:39.217+0000 7f3fbfe25180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:39.251 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:39.277+0000 7f46cc24d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:39.311 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:39.341+0000 7f3fbfe25180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:39.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:39.373+0000 7f5940823640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 msgr2=0x7f59200688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3908346675 2023-07-20T10:09:39.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:39.373+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T10:09:39.376 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:39.401+0000 7f46cc24d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T10:09:39.381 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:39.409+0000 7f3fbfe25180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:09:39.446 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:39.469+0000 7f46cc24d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T10:09:39.525 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:39.545+0000 7f3fbfe25180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:39.581 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:39.605+0000 7f46cc24d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T10:09:40.046 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.077+0000 7f3fbfe25180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:09:40.119 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.145+0000 7f46cc24d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T10:09:40.131 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.161+0000 7f3fbfe25180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:09:40.208 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.233+0000 7f46cc24d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T10:09:40.282 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.313+0000 7f3fbfe25180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:09:40.355 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.381+0000 7f46cc24d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T10:09:40.364 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.393+0000 7f3fbfe25180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:09:40.439 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.461+0000 7f46cc24d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T10:09:40.629 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.661+0000 7f3fbfe25180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:09:40.688 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T10:09:40.717+0000 7f3fbfe25180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:09:40.708 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.733+0000 7f46cc24d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T10:09:40.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:40.773+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 71) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f5938050ed0 con 0x7f593c06b220 2023-07-20T10:09:40.772 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.797+0000 7f46cc24d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T10:09:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:40.805+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 72) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f5938081ac0 con 0x7f593c06b220 2023-07-20T10:09:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:40.805+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 msgr2=0x7f59200688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T10:09:40.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:40.805+0000 7f5931ffb640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/3908346675,v1:172.21.15.82:6833/3908346675] conn(0x7f59200663f0 0x7f59200688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:40.897 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f464e620640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f464e620640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f464e620640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f464e620640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f464e620640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f4651626640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f4651626640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.899 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f4651626640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.899 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f4651626640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:40.899 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:09:40.921+0000 7f4651626640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:09:41.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.813+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mon.0 v2:172.21.15.82:3300/0 9 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f59380517a0 con 0x7f593c06b220 2023-07-20T10:09:41.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.813+0000 7f5931ffb640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f5920034090 0x7f5920070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:41.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.813+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 --> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5920070e70 con 0x7f5920034090 2023-07-20T10:09:41.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.817+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f5920034090 0x7f5920070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:41.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.817+0000 7f5940823640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f5920034090 0x7f5920070930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b6de0 tx=0x7f592c007d40 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:41.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.885+0000 7f5931ffb640 1 -- 172.21.15.82:0/2128478181 <== mgr.9207 v2:172.21.15.82:6832/2398472456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f5920070e70 con 0x7f5920034090 2023-07-20T10:09:41.861 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1 2023-07-20T10:09:41.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f5920034090 msgr2=0x7f5920070930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:41.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f5920034090 0x7f5920070930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b6de0 tx=0x7f592c007d40 comp rx=0 tx=0).stop 2023-07-20T10:09:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 msgr2=0x7f593c0b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 --2- 172.21.15.82:0/2128478181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f593c06b220 0x7f593c0b68a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f593800c530 tx=0x7f593800c9f0 comp rx=0 tx=0).stop 2023-07-20T10:09:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5941825640 1 -- 172.21.15.82:0/2128478181 reap_dead start 2023-07-20T10:09:41.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 shutdown_connections 2023-07-20T10:09:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 >> 172.21.15.82:0/2128478181 conn(0x7f593c08c0a0 msgr2=0x7f593c0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 shutdown_connections 2023-07-20T10:09:41.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:41.889+0000 7f5943288640 1 -- 172.21.15.82:0/2128478181 wait complete. 2023-07-20T10:09:41.883 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-07-20T10:09:41.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-07-20T10:09:42.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 Processor -- start 2023-07-20T10:09:42.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 -- start start 2023-07-20T10:09:42.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f750c15a6f0 0x7f750c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c071950 con 0x7f750c06f710 2023-07-20T10:09:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c15b230 con 0x7f750c0ca5a0 2023-07-20T10:09:42.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.053+0000 7f7512fba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c15bad0 con 0x7f750c15a6f0 2023-07-20T10:09:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7510d56640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f750c06f710 0x7f750c06faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38252/0 (socket says 172.21.15.82:38252) 2023-07-20T10:09:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7510d56640 1 -- 172.21.15.82:0/2394764075 learned_addr learned my addr 172.21.15.82:0/2394764075 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7511557640 1 --2- 172.21.15.82:0/2394764075 >> v2:172.21.15.82:3300/0 conn(0x7f750c15a6f0 0x7f750c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7511557640 1 -- 172.21.15.82:0/2394764075 >> v1:172.21.15.183:6789/0 conn(0x7f750c0ca5a0 legacy=0x7f750c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7511557640 1 -- 172.21.15.82:0/2394764075 >> v1:172.21.15.82:6789/0 conn(0x7f750c06f710 legacy=0x7f750c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7511557640 1 -- 172.21.15.82:0/2394764075 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c15b510 con 0x7f750c15a6f0 2023-07-20T10:09:42.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f7511557640 1 --2- 172.21.15.82:0/2394764075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c15a6f0 0x7f750c15ab60 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7504009dc0 tx=0x7f750401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302f1cde0964a6e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f750b7fe640 1 -- 172.21.15.82:0/2394764075 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040a59c0 con 0x7f750c15a6f0 2023-07-20T10:09:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f750b7fe640 1 -- 172.21.15.82:0/2394764075 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75040a5b20 con 0x7f750c15a6f0 2023-07-20T10:09:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.057+0000 7f750b7fe640 1 -- 172.21.15.82:0/2394764075 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040ad440 con 0x7f750c15a6f0 2023-07-20T10:09:42.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- 172.21.15.82:0/2394764075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c15a6f0 msgr2=0x7f750c15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 --2- 172.21.15.82:0/2394764075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c15a6f0 0x7f750c15ab60 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7504009dc0 tx=0x7f750401c900 comp rx=0 tx=0).stop 2023-07-20T10:09:42.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- 172.21.15.82:0/2394764075 shutdown_connections 2023-07-20T10:09:42.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 --2- 172.21.15.82:0/2394764075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c15a6f0 0x7f750c15ab60 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- 172.21.15.82:0/2394764075 >> 172.21.15.82:0/2394764075 conn(0x7f750c0cad50 msgr2=0x7f750c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- 172.21.15.82:0/2394764075 shutdown_connections 2023-07-20T10:09:42.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- 172.21.15.82:0/2394764075 wait complete. 2023-07-20T10:09:42.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 Processor -- start 2023-07-20T10:09:42.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- start start 2023-07-20T10:09:42.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f750c0ca5a0 0x7f750c0cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 0x7f750c15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0ac7c0 con 0x7f750c06f710 2023-07-20T10:09:42.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c157b00 con 0x7f750c15a6f0 2023-07-20T10:09:42.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7512fba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c157de0 con 0x7f750c0ca5a0 2023-07-20T10:09:42.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59036/0 (socket says 172.21.15.82:59036) 2023-07-20T10:09:42.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 -- 172.21.15.82:0/352158211 learned_addr learned my addr 172.21.15.82:0/352158211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:42.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7511557640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 0x7f750c15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f750bfff640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f750c0ca5a0 0x7f750c0cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 -- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f750c0ca5a0 msgr2=0x7f750c0cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f750c0ca5a0 0x7f750c0cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 -- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 msgr2=0x7f750c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 0x7f750c15cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7510d56640 1 -- 172.21.15.82:0/352158211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009a70 con 0x7f750c06f710 2023-07-20T10:09:42.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.061+0000 7f7511557640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 0x7f750c15cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T10:09:42.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f7510d56640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f750000c500 tx=0x7f750000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500005cf0 con 0x7f750c06f710 2023-07-20T10:09:42.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7500005e50 con 0x7f750c06f710 2023-07-20T10:09:42.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75000072f0 con 0x7f750c06f710 2023-07-20T10:09:42.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c1580c0 con 0x7f750c06f710 2023-07-20T10:09:42.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c158680 con 0x7f750c06f710 2023-07-20T10:09:42.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c158870 con 0x7f750c06f710 2023-07-20T10:09:42.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f7500007450 con 0x7f750c06f710 2023-07-20T10:09:42.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 0x7f74f00685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f7500083160 con 0x7f750c06f710 2023-07-20T10:09:42.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.065+0000 7f750bfff640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 0x7f74f00685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.069+0000 7f750bfff640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 0x7f74f00685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f750c0c8880 tx=0x7f74f8009040 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.069+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7500050780 con 0x7f750c06f710 2023-07-20T10:09:42.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.237+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 --> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f750c157f50 con 0x7f74f0066120 2023-07-20T10:09:42.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.297+0000 7f75097fa640 1 -- 172.21.15.82:0/352158211 <== mgr.9207 v2:172.21.15.82:6832/2398472456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f750c157f50 con 0x7f74f0066120 2023-07-20T10:09:42.274 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path /snap_test_dir1 2023-07-20T10:09:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 msgr2=0x7f74f00685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 0x7f74f00685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f750c0c8880 tx=0x7f74f8009040 comp rx=0 tx=0).stop 2023-07-20T10:09:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 msgr2=0x7f750c0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f750000c500 tx=0x7f750000c9c0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 shutdown_connections 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f74f0066120 0x7f74f00685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f750c15a6f0 0x7f750c15cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f750c0ca5a0 0x7f750c0cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 --2- 172.21.15.82:0/352158211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f750c06f710 0x7f750c0ac280 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 >> 172.21.15.82:0/352158211 conn(0x7f750c0cad50 msgr2=0x7f750c0ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 shutdown_connections 2023-07-20T10:09:42.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.301+0000 7f7512fba640 1 -- 172.21.15.82:0/352158211 wait complete. 2023-07-20T10:09:42.295 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-07-20T10:09:42.295 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-20T10:09:42.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-07-20T10:09:42.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.461+0000 7f1cea2ec640 1 Processor -- start 2023-07-20T10:09:42.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.461+0000 7f1cea2ec640 1 -- start start 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1cea2ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1cea2ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce4071950 con 0x7f1ce415ec90 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1cea2ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce415b230 con 0x7f1ce406f710 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1cea2ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce415bad0 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce8889640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1ce415ec90 0x7f1ce415a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38266/0 (socket says 172.21.15.82:38266) 2023-07-20T10:09:42.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce8889640 1 -- 172.21.15.82:0/1441299105 learned_addr learned my addr 172.21.15.82:0/1441299105 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T10:09:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce37fe640 1 --2- 172.21.15.82:0/1441299105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31942645 0 0) 0x7f1ce4071950 con 0x7f1ce415ec90 2023-07-20T10:09:42.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ccc003530 con 0x7f1ce415ec90 2023-07-20T10:09:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832417100 0 0) 0x7f1ce415b230 con 0x7f1ce406f710 2023-07-20T10:09:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4071950 con 0x7f1ce406f710 2023-07-20T10:09:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce37fe640 1 -- 172.21.15.82:0/1441299105 >> v1:172.21.15.183:6789/0 conn(0x7f1ce406f710 legacy=0x7f1ce406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce37fe640 1 -- 172.21.15.82:0/1441299105 >> v1:172.21.15.82:6789/0 conn(0x7f1ce415ec90 legacy=0x7f1ce415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.465+0000 7f1ce37fe640 1 -- 172.21.15.82:0/1441299105 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce415b510 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1ce37fe640 1 --2- 172.21.15.82:0/1441299105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce415e750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80097f0 tx=0x7f1cd801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a6c9c9e57c1f0f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80ac600 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80a8050 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1ce2ffd640 1 -- 172.21.15.82:0/1441299105 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80ac980 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- 172.21.15.82:0/1441299105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce415e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/1441299105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce415e750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80097f0 tx=0x7f1cd801c490 comp rx=0 tx=0).stop 2023-07-20T10:09:42.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- 172.21.15.82:0/1441299105 shutdown_connections 2023-07-20T10:09:42.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/1441299105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce415e750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- 172.21.15.82:0/1441299105 >> 172.21.15.82:0/1441299105 conn(0x7f1ce40cad50 msgr2=0x7f1ce40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:42.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- 172.21.15.82:0/1441299105 shutdown_connections 2023-07-20T10:09:42.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- 172.21.15.82:0/1441299105 wait complete. 2023-07-20T10:09:42.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 Processor -- start 2023-07-20T10:09:42.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.469+0000 7f1cea2ec640 1 -- start start 2023-07-20T10:09:42.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ce406f710 0x7f1ce40c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce40acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c5a90 con 0x7f1ce415ec90 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce414d2c0 con 0x7f1ce406f710 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c7920 con 0x7f1ce40ca5a0 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59038/0 (socket says 172.21.15.82:59038) 2023-07-20T10:09:42.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 -- 172.21.15.82:0/743291472 learned_addr learned my addr 172.21.15.82:0/743291472 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce37fe640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce40acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce3fff640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ce406f710 0x7f1ce40c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 -- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 msgr2=0x7f1ce40acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce40acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 -- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ce406f710 msgr2=0x7f1ce40c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ce406f710 0x7f1ce40c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 -- 172.21.15.82:0/743291472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009420 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce8889640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00caf0 tx=0x7f1cdc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00ac40 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00ada0 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc012620 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce40ad5a0 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40c72d0 con 0x7f1ce415ec90 2023-07-20T10:09:42.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce404da30 con 0x7f1ce415ec90 2023-07-20T10:09:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.473+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 73) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f1cdc007070 con 0x7f1ce415ec90 2023-07-20T10:09:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.477+0000 7f1ce0ff9640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 0x7f1cd00685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T10:09:42.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.477+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f1cdc0839d0 con 0x7f1ce415ec90 2023-07-20T10:09:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.477+0000 7f1ce3fff640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 0x7f1cd00685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T10:09:42.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.477+0000 7f1ce3fff640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 0x7f1cd00685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40011f0 tx=0x7f1cd4009040 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T10:09:42.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.481+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1cdc0510c0 con 0x7f1ce415ec90 2023-07-20T10:09:42.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.653+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 --> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ce4168440 con 0x7f1cd0066120 2023-07-20T10:09:42.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1ce0ff9640 1 -- 172.21.15.82:0/743291472 <== mgr.9207 v2:172.21.15.82:6832/2398472456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f1cd40014e0 con 0x7f1cd0066120 2023-07-20T10:09:42.636 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T10:09:42.636 INFO:teuthology.orchestra.run.smithi082.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-07-20T10:09:42.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 msgr2=0x7f1cd00685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 0x7f1cd00685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40011f0 tx=0x7f1cd4009040 comp rx=0 tx=0).stop 2023-07-20T10:09:42.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 msgr2=0x7f1ce41554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T10:09:42.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00caf0 tx=0x7f1cdc00a060 comp rx=0 tx=0).stop 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 shutdown_connections 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f1cd0066120 0x7f1cd00685e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ce415ec90 0x7f1ce41554d0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ce40ca5a0 0x7f1ce40acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 --2- 172.21.15.82:0/743291472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ce406f710 0x7f1ce40c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 >> 172.21.15.82:0/743291472 conn(0x7f1ce40cad50 msgr2=0x7f1ce406faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 shutdown_connections 2023-07-20T10:09:42.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T10:09:42.661+0000 7f1cea2ec640 1 -- 172.21.15.82:0/743291472 wait complete. 2023-07-20T10:09:42.657 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-07-20T10:09:42.658 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-07-20T10:09:58.433 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:09:58.437 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:10:00.287 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:10:00.312+0000 7f4640604640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:10:00.287 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:10:00.312+0000 7f4640604640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:10:00.287 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:10:00.312+0000 7f4640604640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:10:00.287 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:10:00.312+0000 7f4640604640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:10:00.288 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T10:10:00.312+0000 7f4640604640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T10:10:28.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:10:28.497 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:10:58.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:10:58.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:11:28.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:11:28.938 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:11:58.996 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:11:59.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:12:29.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:12:29.074 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:12:59.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:12:59.233 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:13:29.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:13:29.287 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:13:59.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:13:59.349 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:14:29.457 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:14:29.462 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:14:59.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:14:59.827 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:15:30.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:15:30.006 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:16:00.080 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:16:00.084 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:16:30.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:16:30.228 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:17:00.278 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:17:00.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:17:30.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:17:30.359 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:18:00.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:18:00.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:18:30.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:18:30.507 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:19:00.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:19:00.567 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:19:30.631 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:19:30.636 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:20:00.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:20:00.784 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:20:30.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:20:30.842 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:21:00.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:21:00.927 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:21:30.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:21:30.989 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:22:01.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:22:01.053 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:22:31.176 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:22:31.180 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:23:01.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:23:01.240 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:23:31.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:23:31.298 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:24:01.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:24:01.477 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:24:31.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:24:31.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:25:01.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:25:01.603 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:25:31.653 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:25:31.658 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:26:01.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:26:01.763 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:26:31.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:26:31.833 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:27:01.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:27:01.978 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:27:32.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:27:32.193 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:28:02.250 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:28:02.254 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:28:32.306 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:28:32.311 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:29:02.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:29:02.421 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:29:32.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:29:32.484 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:30:02.543 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:30:02.547 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:30:32.673 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:30:32.677 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:31:02.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:31:02.900 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:31:32.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:31:32.961 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:32:03.018 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:32:03.022 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:32:33.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:32:33.128 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:33:03.353 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:33:03.357 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:33:33.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:33:33.431 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:34:03.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:34:03.509 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:34:33.834 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:34:33.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:35:03.896 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:35:03.900 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:35:33.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:35:33.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:36:04.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:36:04.036 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:36:34.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:36:34.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:37:04.158 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:37:04.162 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:37:34.243 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:37:34.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:38:04.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:38:04.333 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:38:34.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:38:34.390 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:39:04.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:39:04.455 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:39:34.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:39:34.749 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:40:04.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:40:04.821 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:40:34.878 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:40:34.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:41:04.963 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:41:04.967 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:41:35.015 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:41:35.021 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:42:05.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:42:05.150 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:42:35.480 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:42:35.485 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:43:05.551 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:43:05.555 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:43:35.656 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:43:35.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:44:05.785 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:44:05.790 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:44:35.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:44:35.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:45:05.916 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:45:05.921 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:45:35.982 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:45:35.986 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:46:06.056 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:46:06.060 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:46:36.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:46:36.264 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:47:06.421 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:47:06.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:47:36.504 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:47:36.509 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:48:06.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:48:06.571 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:48:36.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:48:36.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:49:06.819 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:49:06.824 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:49:37.129 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:49:37.133 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:50:07.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:50:07.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:50:37.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:50:37.387 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:51:07.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:51:07.568 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:51:37.645 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:51:37.649 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:52:07.709 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:52:07.713 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:52:37.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:52:37.871 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:53:07.930 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:53:07.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:53:38.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:53:38.276 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:54:08.324 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:54:08.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:54:38.389 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:54:38.393 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:55:08.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:55:08.619 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:55:38.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:55:38.680 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:56:08.757 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:56:08.761 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:56:38.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:56:38.850 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:57:08.913 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:57:08.917 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:57:38.985 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:57:38.990 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:58:09.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:58:09.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:58:39.209 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:58:39.214 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:59:09.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:59:09.394 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:59:39.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T10:59:39.458 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:00:09.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:00:09.533 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:00:39.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:00:39.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:01:09.788 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:01:09.792 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:01:39.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:01:39.947 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:02:10.014 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:02:10.018 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:02:40.098 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:02:40.102 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:03:10.159 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:03:10.163 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:03:40.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:03:40.252 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:04:10.527 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:04:10.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:04:40.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:04:40.594 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:05:10.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:05:10.653 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:05:15.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:15.660 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:05:15.674 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_11_00_UTC 2023-07-20T11:05:15.675 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_12_00_UTC 2023-07-20T11:05:15.675 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_13_00_UTC 2023-07-20T11:05:15.675 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_14_00_UTC 2023-07-20T11:05:15.676 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_15_00_UTC 2023-07-20T11:05:15.676 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_16_00_UTC 2023-07-20T11:05:15.676 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_17_00_UTC 2023-07-20T11:05:15.676 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_18_00_UTC 2023-07-20T11:05:15.677 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_19_00_UTC 2023-07-20T11:05:15.677 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_20_00_UTC 2023-07-20T11:05:15.677 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_21_00_UTC 2023-07-20T11:05:15.677 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_22_00_UTC 2023-07-20T11:05:15.678 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_23_00_UTC 2023-07-20T11:05:15.678 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_24_00_UTC 2023-07-20T11:05:15.678 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_25_00_UTC 2023-07-20T11:05:15.678 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_26_00_UTC 2023-07-20T11:05:15.679 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_27_00_UTC 2023-07-20T11:05:15.679 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_28_00_UTC 2023-07-20T11:05:15.679 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_29_00_UTC 2023-07-20T11:05:15.679 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_30_00_UTC 2023-07-20T11:05:15.680 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_31_00_UTC 2023-07-20T11:05:15.680 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_32_00_UTC 2023-07-20T11:05:15.680 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_33_00_UTC 2023-07-20T11:05:15.681 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_34_00_UTC 2023-07-20T11:05:15.681 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_35_00_UTC 2023-07-20T11:05:15.681 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_36_00_UTC 2023-07-20T11:05:15.681 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_37_00_UTC 2023-07-20T11:05:15.682 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_38_00_UTC 2023-07-20T11:05:15.682 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_39_00_UTC 2023-07-20T11:05:15.682 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_40_00_UTC 2023-07-20T11:05:15.682 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_41_00_UTC 2023-07-20T11:05:15.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_42_00_UTC 2023-07-20T11:05:15.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_43_00_UTC 2023-07-20T11:05:15.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_44_00_UTC 2023-07-20T11:05:15.683 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_45_01_UTC 2023-07-20T11:05:15.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_46_00_UTC 2023-07-20T11:05:15.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_47_00_UTC 2023-07-20T11:05:15.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_48_00_UTC 2023-07-20T11:05:15.684 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_49_00_UTC 2023-07-20T11:05:15.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_50_00_UTC 2023-07-20T11:05:15.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_51_00_UTC 2023-07-20T11:05:15.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_52_00_UTC 2023-07-20T11:05:15.685 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_53_00_UTC 2023-07-20T11:05:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_54_00_UTC 2023-07-20T11:05:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_55_00_UTC 2023-07-20T11:05:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_56_00_UTC 2023-07-20T11:05:15.686 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_57_00_UTC 2023-07-20T11:05:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_58_00_UTC 2023-07-20T11:05:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_59_00_UTC 2023-07-20T11:05:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_00_00_UTC 2023-07-20T11:05:15.687 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_01_00_UTC 2023-07-20T11:05:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_02_00_UTC 2023-07-20T11:05:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_03_00_UTC 2023-07-20T11:05:15.688 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_04_00_UTC 2023-07-20T11:05:15.689 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_05_00_UTC 2023-07-20T11:05:15.690 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-10_11_00_UTC', 'scheduled-2023-07-20-10_12_00_UTC', 'scheduled-2023-07-20-10_13_00_UTC', 'scheduled-2023-07-20-10_14_00_UTC', 'scheduled-2023-07-20-10_15_00_UTC', 'scheduled-2023-07-20-10_16_00_UTC', 'scheduled-2023-07-20-10_17_00_UTC', 'scheduled-2023-07-20-10_18_00_UTC', 'scheduled-2023-07-20-10_19_00_UTC', 'scheduled-2023-07-20-10_20_00_UTC', 'scheduled-2023-07-20-10_21_00_UTC', 'scheduled-2023-07-20-10_22_00_UTC', 'scheduled-2023-07-20-10_23_00_UTC', 'scheduled-2023-07-20-10_24_00_UTC', 'scheduled-2023-07-20-10_25_00_UTC', 'scheduled-2023-07-20-10_26_00_UTC', 'scheduled-2023-07-20-10_27_00_UTC', 'scheduled-2023-07-20-10_28_00_UTC', 'scheduled-2023-07-20-10_29_00_UTC', 'scheduled-2023-07-20-10_30_00_UTC', 'scheduled-2023-07-20-10_31_00_UTC', 'scheduled-2023-07-20-10_32_00_UTC', 'scheduled-2023-07-20-10_33_00_UTC', 'scheduled-2023-07-20-10_34_00_UTC', 'scheduled-2023-07-20-10_35_00_UTC', 'scheduled-2023-07-20-10_36_00_UTC', 'scheduled-2023-07-20-10_37_00_UTC', 'scheduled-2023-07-20-10_38_00_UTC', 'scheduled-2023-07-20-10_39_00_UTC', 'scheduled-2023-07-20-10_40_00_UTC', 'scheduled-2023-07-20-10_41_00_UTC', 'scheduled-2023-07-20-10_42_00_UTC', 'scheduled-2023-07-20-10_43_00_UTC', 'scheduled-2023-07-20-10_44_00_UTC', 'scheduled-2023-07-20-10_45_01_UTC', 'scheduled-2023-07-20-10_46_00_UTC', 'scheduled-2023-07-20-10_47_00_UTC', 'scheduled-2023-07-20-10_48_00_UTC', 'scheduled-2023-07-20-10_49_00_UTC', 'scheduled-2023-07-20-10_50_00_UTC', 'scheduled-2023-07-20-10_51_00_UTC', 'scheduled-2023-07-20-10_52_00_UTC', 'scheduled-2023-07-20-10_53_00_UTC', 'scheduled-2023-07-20-10_54_00_UTC', 'scheduled-2023-07-20-10_55_00_UTC', 'scheduled-2023-07-20-10_56_00_UTC', 'scheduled-2023-07-20-10_57_00_UTC', 'scheduled-2023-07-20-10_58_00_UTC', 'scheduled-2023-07-20-10_59_00_UTC', 'scheduled-2023-07-20-11_00_00_UTC', 'scheduled-2023-07-20-11_01_00_UTC', 'scheduled-2023-07-20-11_02_00_UTC', 'scheduled-2023-07-20-11_03_00_UTC', 'scheduled-2023-07-20-11_04_00_UTC', 'scheduled-2023-07-20-11_05_00_UTC'] 2023-07-20T11:05:15.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-07-20T11:05:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.904+0000 7f65c0834640 1 Processor -- start 2023-07-20T11:05:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.904+0000 7f65c0834640 1 -- start start 2023-07-20T11:05:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65c0834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65c0834640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65bc15a6f0 0x7f65bc15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65c0834640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc070030 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65c0834640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15bad0 con 0x7f65bc15a6f0 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65c0834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc071950 con 0x7f65bc06f710 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65b1d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f65bc0ca5a0 0x7f65bc15e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58880/0 (socket says 172.21.15.82:58880) 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65b1d9b640 1 -- 172.21.15.82:0/2261911265 learned_addr learned my addr 172.21.15.82:0/2261911265 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 --2- 172.21.15.82:0/2261911265 >> v2:172.21.15.82:3300/0 conn(0x7f65bc15a6f0 0x7f65bc15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65ba59c640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65b9d9b640 1 -- 172.21.15.82:0/2261911265 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914249239 0 0) 0x7f65bc070030 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65b9d9b640 1 -- 172.21.15.82:0/2261911265 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a8003530 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 -- 172.21.15.82:0/2261911265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 msgr2=0x7f65bc06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc06faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 -- 172.21.15.82:0/2261911265 >> v1:172.21.15.82:6789/0 conn(0x7f65bc0ca5a0 legacy=0x7f65bc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 -- 172.21.15.82:0/2261911265 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc15b230 con 0x7f65bc15a6f0 2023-07-20T11:05:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.908+0000 7f65bad9d640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ab60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097c0 tx=0x7f65b401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b0a681f248696c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:15.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65b9d9b640 1 -- 172.21.15.82:0/2261911265 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40ab650 con 0x7f65bc15a6f0 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65b9d9b640 1 -- 172.21.15.82:0/2261911265 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40ab7b0 con 0x7f65bc15a6f0 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65b9d9b640 1 -- 172.21.15.82:0/2261911265 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40abb40 con 0x7f65bc15a6f0 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- 172.21.15.82:0/2261911265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc15a6f0 msgr2=0x7f65bc15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ab60 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f65b40097c0 tx=0x7f65b401c450 comp rx=0 tx=0).stop 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- 172.21.15.82:0/2261911265 shutdown_connections 2023-07-20T11:05:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ab60 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:15.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- 172.21.15.82:0/2261911265 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc06faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:15.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- 172.21.15.82:0/2261911265 >> 172.21.15.82:0/2261911265 conn(0x7f65bc0cad50 msgr2=0x7f65bc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:15.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- 172.21.15.82:0/2261911265 shutdown_connections 2023-07-20T11:05:15.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- 172.21.15.82:0/2261911265 wait complete. 2023-07-20T11:05:15.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 Processor -- start 2023-07-20T11:05:15.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- start start 2023-07-20T11:05:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0c7f30 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0c7320 con 0x7f65bc15a6f0 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.912+0000 7f65c0834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0c7600 con 0x7f65bc06f710 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48220/0 (socket says 172.21.15.82:48220) 2023-07-20T11:05:15.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 -- 172.21.15.82:0/1002388857 learned_addr learned my addr 172.21.15.82:0/1002388857 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65ba59c640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65bad9d640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 -- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 msgr2=0x7f65bc155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 -- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc15a6f0 msgr2=0x7f65bc15ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 -- 172.21.15.82:0/1002388857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009420 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65ba59c640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:15.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b1d9b640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c4d0 tx=0x7f65a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:15.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4005cf0 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4005e50 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0c78e0 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4007270 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc155ea0 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc0c80a0 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.916+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f65a40073d0 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.920+0000 7f65b37fe640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 0x7f659c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:15.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.920+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f65a4083670 con 0x7f65bc0ca5a0 2023-07-20T11:05:15.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.920+0000 7f65ba59c640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 0x7f659c0688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:15.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.920+0000 7f65ba59c640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 0x7f659c0688b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009fd0 tx=0x7f65ac00b040 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:15.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:15.924+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65a4050820 con 0x7f65bc0ca5a0 2023-07-20T11:05:16.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.088+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 --> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65bc15e230 con 0x7f659c0663f0 2023-07-20T11:05:16.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.096+0000 7f65b37fe640 1 -- 172.21.15.82:0/1002388857 <== mgr.9207 v2:172.21.15.82:6832/2398472456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f65ac00f050 con 0x7f659c0663f0 2023-07-20T11:05:16.081 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:16.081 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:09:41", "first": "2023-07-20T10:10:00", "last": "2023-07-20T11:05:00", "last_pruned": "2023-07-20T11:05:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-07-20T11:05:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 msgr2=0x7f659c0688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 0x7f659c0688b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009fd0 tx=0x7f65ac00b040 comp rx=0 tx=0).stop 2023-07-20T11:05:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 msgr2=0x7f65bc15c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f65a400c4d0 tx=0x7f65a400c990 comp rx=0 tx=0).stop 2023-07-20T11:05:16.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 shutdown_connections 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f659c0663f0 0x7f659c0688b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65bc15a6f0 0x7f65bc15ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65bc0ca5a0 0x7f65bc15c780 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 --2- 172.21.15.82:0/1002388857 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65bc06f710 0x7f65bc155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 >> 172.21.15.82:0/1002388857 conn(0x7f65bc0cad50 msgr2=0x7f65bc0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 shutdown_connections 2023-07-20T11:05:16.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.100+0000 7f65c0834640 1 -- 172.21.15.82:0/1002388857 wait complete. 2023-07-20T11:05:16.102 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T10:09:41", "first": "2023-07-20T10:10:00", "last": "2023-07-20T11:05:00", "last_pruned": "2023-07-20T11:05:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-07-20T11:05:16.102 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T10:09:41', 'first': '2023-07-20T10:10:00', 'last': '2023-07-20T11:05:00', 'last_pruned': '2023-07-20T11:05:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-07-20T11:05:16.102 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-07-20T11:05:16.103 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-07-20T11:05:16.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-07-20T11:05:16.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.260+0000 7f684ab8f640 1 Processor -- start 2023-07-20T11:05:16.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.260+0000 7f684ab8f640 1 -- start start 2023-07-20T11:05:16.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684ab8f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6844158ce0 0x7f68440c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684ab8f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6844070970 0x7f6844070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684ab8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68440c95d0 con 0x7f684406b620 2023-07-20T11:05:16.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684ab8f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440c9fa0 con 0x7f6844070970 2023-07-20T11:05:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684ab8f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68441590c0 con 0x7f6844158ce0 2023-07-20T11:05:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6844070970 0x7f6844070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684912c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f684406b620 0x7f68440cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58894/0 (socket says 172.21.15.82:58894) 2023-07-20T11:05:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684912c640 1 -- 172.21.15.82:0/2760589491 learned_addr learned my addr 172.21.15.82:0/2760589491 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:16.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f684892b640 1 --2- 172.21.15.82:0/2760589491 >> v2:172.21.15.183:3300/0 conn(0x7f6844158ce0 0x7f68440c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 -- 172.21.15.82:0/2760589491 >> v2:172.21.15.183:3300/0 conn(0x7f6844158ce0 msgr2=0x7f68440c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 --2- 172.21.15.82:0/2760589491 >> v2:172.21.15.183:3300/0 conn(0x7f6844158ce0 0x7f68440c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 -- 172.21.15.82:0/2760589491 >> v1:172.21.15.82:6789/0 conn(0x7f684406b620 legacy=0x7f68440cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 -- 172.21.15.82:0/2760589491 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440c89c0 con 0x7f6844070970 2023-07-20T11:05:16.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683b7fe640 1 -- 172.21.15.82:0/2760589491 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145749564 0 0) 0x7f68440c95d0 con 0x7f684406b620 2023-07-20T11:05:16.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.264+0000 7f683bfff640 1 --2- 172.21.15.82:0/2760589491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f6844070e00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f684406a6c0 tx=0x7f683401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364621e6939f7b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683b7fe640 1 -- 172.21.15.82:0/2760589491 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834004230 con 0x7f6844070970 2023-07-20T11:05:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683b7fe640 1 -- 172.21.15.82:0/2760589491 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68340a7050 con 0x7f6844070970 2023-07-20T11:05:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683b7fe640 1 -- 172.21.15.82:0/2760589491 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834003620 con 0x7f6844070970 2023-07-20T11:05:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- 172.21.15.82:0/2760589491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 msgr2=0x7f6844070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- 172.21.15.82:0/2760589491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f6844070e00 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f684406a6c0 tx=0x7f683401c460 comp rx=0 tx=0).stop 2023-07-20T11:05:16.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- 172.21.15.82:0/2760589491 shutdown_connections 2023-07-20T11:05:16.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- 172.21.15.82:0/2760589491 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f6844070e00 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- 172.21.15.82:0/2760589491 >> v2:172.21.15.183:3300/0 conn(0x7f6844158ce0 0x7f68440c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- 172.21.15.82:0/2760589491 >> 172.21.15.82:0/2760589491 conn(0x7f68440cad50 msgr2=0x7f68440cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:16.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- 172.21.15.82:0/2760589491 shutdown_connections 2023-07-20T11:05:16.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- 172.21.15.82:0/2760589491 wait complete. 2023-07-20T11:05:16.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 Processor -- start 2023-07-20T11:05:16.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- start start 2023-07-20T11:05:16.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 0x7f684414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6844158ce0 0x7f684414f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440ae4f0 con 0x7f6844070970 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440ae830 con 0x7f6844158ce0 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f684ab8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440ae210 con 0x7f684406b620 2023-07-20T11:05:16.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48248/0 (socket says 172.21.15.82:48248) 2023-07-20T11:05:16.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.268+0000 7f683bfff640 1 -- 172.21.15.82:0/482884435 learned_addr learned my addr 172.21.15.82:0/482884435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:16.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684912c640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6844158ce0 0x7f684414f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684892b640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 0x7f684414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 -- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 msgr2=0x7f684414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 0x7f684414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 -- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6844158ce0 msgr2=0x7f684414f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6844158ce0 0x7f684414f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 -- 172.21.15.82:0/482884435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834009420 con 0x7f6844070970 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684892b640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 0x7f684414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f683bfff640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f68340ae040 tx=0x7f6834019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834003b70 con 0x7f6844070970 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6834003cd0 con 0x7f6844070970 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68440aead0 con 0x7f6844070970 2023-07-20T11:05:16.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68340ab680 con 0x7f6844070970 2023-07-20T11:05:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684414c150 con 0x7f6844070970 2023-07-20T11:05:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68440ae690 con 0x7f6844070970 2023-07-20T11:05:16.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f68340b2040 con 0x7f6844070970 2023-07-20T11:05:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.272+0000 7f68397fa640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 0x7f68300688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.276+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f683411e040 con 0x7f6844070970 2023-07-20T11:05:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.276+0000 7f684892b640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 0x7f68300688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.276+0000 7f684892b640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 0x7f68300688b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6840009bb0 tx=0x7f6840008040 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:16.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.280+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68440ae690 con 0x7f6844070970 2023-07-20T11:05:16.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.444+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 --> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f68440719b0 con 0x7f68300663f0 2023-07-20T11:05:16.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.524+0000 7f68397fa640 1 -- 172.21.15.82:0/482884435 <== mgr.9207 v2:172.21.15.82:6832/2398472456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7f68400098e0 con 0x7f68300663f0 2023-07-20T11:05:16.510 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1 2023-07-20T11:05:16.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 msgr2=0x7f68300688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 0x7f68300688b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6840009bb0 tx=0x7f6840008040 comp rx=0 tx=0).stop 2023-07-20T11:05:16.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 msgr2=0x7f68440af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f68340ae040 tx=0x7f6834019200 comp rx=0 tx=0).stop 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 shutdown_connections 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f68300663f0 0x7f68300688b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6844158ce0 0x7f684414f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6844070970 0x7f68440af2d0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 --2- 172.21.15.82:0/482884435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f684406b620 0x7f684414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 >> 172.21.15.82:0/482884435 conn(0x7f68440cad50 msgr2=0x7f68441593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:16.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 shutdown_connections 2023-07-20T11:05:16.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:16.528+0000 7f684ab8f640 1 -- 172.21.15.82:0/482884435 wait complete. 2023-07-20T11:05:16.530 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-07-20T11:05:16.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.531 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:05:16.542 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_11_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_12_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_13_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_14_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_15_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_16_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_17_00_UTC 2023-07-20T11:05:16.543 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_18_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_19_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_20_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_21_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_22_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_23_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_24_00_UTC 2023-07-20T11:05:16.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_25_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_26_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_27_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_28_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_29_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_30_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_31_00_UTC 2023-07-20T11:05:16.545 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_32_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_33_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_34_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_35_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_36_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_37_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_38_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_39_00_UTC 2023-07-20T11:05:16.546 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_40_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_41_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_42_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_43_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_44_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_45_01_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_46_00_UTC 2023-07-20T11:05:16.547 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_47_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_48_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_49_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_50_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_51_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_52_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_53_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_54_00_UTC 2023-07-20T11:05:16.548 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_55_00_UTC 2023-07-20T11:05:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_56_00_UTC 2023-07-20T11:05:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_57_00_UTC 2023-07-20T11:05:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_58_00_UTC 2023-07-20T11:05:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-10_59_00_UTC 2023-07-20T11:05:16.549 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_00_00_UTC 2023-07-20T11:05:16.550 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_01_00_UTC 2023-07-20T11:05:16.550 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_02_00_UTC 2023-07-20T11:05:16.550 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_03_00_UTC 2023-07-20T11:05:16.550 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_04_00_UTC 2023-07-20T11:05:16.550 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_05_00_UTC 2023-07-20T11:05:16.551 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_11_00_UTC 2023-07-20T11:05:16.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.552 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_11_00_UTC) 2023-07-20T11:05:16.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_12_00_UTC 2023-07-20T11:05:16.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.609 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_12_00_UTC) 2023-07-20T11:05:16.665 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_13_00_UTC 2023-07-20T11:05:16.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.666 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_13_00_UTC) 2023-07-20T11:05:16.721 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_14_00_UTC 2023-07-20T11:05:16.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.722 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_14_00_UTC) 2023-07-20T11:05:16.777 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_15_00_UTC 2023-07-20T11:05:16.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.778 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_15_00_UTC) 2023-07-20T11:05:16.833 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_16_00_UTC 2023-07-20T11:05:16.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.834 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_16_00_UTC) 2023-07-20T11:05:16.889 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_17_00_UTC 2023-07-20T11:05:16.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.890 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_17_00_UTC) 2023-07-20T11:05:16.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_18_00_UTC 2023-07-20T11:05:16.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:16.946 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_18_00_UTC) 2023-07-20T11:05:17.005 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_19_00_UTC 2023-07-20T11:05:17.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.006 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_19_00_UTC) 2023-07-20T11:05:17.069 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_20_00_UTC 2023-07-20T11:05:17.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.071 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_20_00_UTC) 2023-07-20T11:05:17.124 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_21_00_UTC 2023-07-20T11:05:17.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.125 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_21_00_UTC) 2023-07-20T11:05:17.180 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_22_00_UTC 2023-07-20T11:05:17.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.181 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_22_00_UTC) 2023-07-20T11:05:17.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_23_00_UTC 2023-07-20T11:05:17.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.237 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_23_00_UTC) 2023-07-20T11:05:17.292 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_24_00_UTC 2023-07-20T11:05:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.293 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_24_00_UTC) 2023-07-20T11:05:17.351 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_25_00_UTC 2023-07-20T11:05:17.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.352 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_25_00_UTC) 2023-07-20T11:05:17.409 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_26_00_UTC 2023-07-20T11:05:17.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.410 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_26_00_UTC) 2023-07-20T11:05:17.465 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_27_00_UTC 2023-07-20T11:05:17.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.467 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_27_00_UTC) 2023-07-20T11:05:17.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_28_00_UTC 2023-07-20T11:05:17.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.527 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_28_00_UTC) 2023-07-20T11:05:17.580 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_29_00_UTC 2023-07-20T11:05:17.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.581 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_29_00_UTC) 2023-07-20T11:05:17.641 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_30_00_UTC 2023-07-20T11:05:17.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.642 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_30_00_UTC) 2023-07-20T11:05:17.696 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_31_00_UTC 2023-07-20T11:05:17.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.697 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_31_00_UTC) 2023-07-20T11:05:17.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_32_00_UTC 2023-07-20T11:05:17.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.753 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_32_00_UTC) 2023-07-20T11:05:17.813 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_33_00_UTC 2023-07-20T11:05:17.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.814 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_33_00_UTC) 2023-07-20T11:05:17.869 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_34_00_UTC 2023-07-20T11:05:17.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.870 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_34_00_UTC) 2023-07-20T11:05:17.925 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_35_00_UTC 2023-07-20T11:05:17.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.926 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_35_00_UTC) 2023-07-20T11:05:17.981 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_36_00_UTC 2023-07-20T11:05:17.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:17.982 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_36_00_UTC) 2023-07-20T11:05:18.036 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_37_00_UTC 2023-07-20T11:05:18.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.037 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_37_00_UTC) 2023-07-20T11:05:18.100 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_38_00_UTC 2023-07-20T11:05:18.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.101 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_38_00_UTC) 2023-07-20T11:05:18.160 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_39_00_UTC 2023-07-20T11:05:18.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.161 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_39_00_UTC) 2023-07-20T11:05:18.216 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_40_00_UTC 2023-07-20T11:05:18.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.217 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_40_00_UTC) 2023-07-20T11:05:18.276 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_41_00_UTC 2023-07-20T11:05:18.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.277 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_41_00_UTC) 2023-07-20T11:05:18.333 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_42_00_UTC 2023-07-20T11:05:18.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.334 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_42_00_UTC) 2023-07-20T11:05:18.389 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_43_00_UTC 2023-07-20T11:05:18.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.390 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_43_00_UTC) 2023-07-20T11:05:18.445 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_44_00_UTC 2023-07-20T11:05:18.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.446 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_44_00_UTC) 2023-07-20T11:05:18.502 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_45_01_UTC 2023-07-20T11:05:18.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.502 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_45_01_UTC) 2023-07-20T11:05:18.556 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_46_00_UTC 2023-07-20T11:05:18.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.558 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_46_00_UTC) 2023-07-20T11:05:18.613 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_47_00_UTC 2023-07-20T11:05:18.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.613 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_47_00_UTC) 2023-07-20T11:05:18.669 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_48_00_UTC 2023-07-20T11:05:18.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.670 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_48_00_UTC) 2023-07-20T11:05:18.739 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_49_00_UTC 2023-07-20T11:05:18.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.749 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_49_00_UTC) 2023-07-20T11:05:18.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_50_00_UTC 2023-07-20T11:05:18.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.798 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_50_00_UTC) 2023-07-20T11:05:18.853 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_51_00_UTC 2023-07-20T11:05:18.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.854 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_51_00_UTC) 2023-07-20T11:05:18.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_52_00_UTC 2023-07-20T11:05:18.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.910 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_52_00_UTC) 2023-07-20T11:05:18.968 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_53_00_UTC 2023-07-20T11:05:18.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:18.969 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_53_00_UTC) 2023-07-20T11:05:19.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_54_00_UTC 2023-07-20T11:05:19.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.029 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_54_00_UTC) 2023-07-20T11:05:19.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_55_00_UTC 2023-07-20T11:05:19.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.135 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_55_00_UTC) 2023-07-20T11:05:19.168 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_56_00_UTC 2023-07-20T11:05:19.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.169 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_56_00_UTC) 2023-07-20T11:05:19.225 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_57_00_UTC 2023-07-20T11:05:19.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.226 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_57_00_UTC) 2023-07-20T11:05:19.281 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_58_00_UTC 2023-07-20T11:05:19.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.282 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_58_00_UTC) 2023-07-20T11:05:19.337 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-10_59_00_UTC 2023-07-20T11:05:19.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.338 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-10_59_00_UTC) 2023-07-20T11:05:19.402 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_00_00_UTC 2023-07-20T11:05:19.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.403 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_00_00_UTC) 2023-07-20T11:05:19.461 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_01_00_UTC 2023-07-20T11:05:19.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.462 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_01_00_UTC) 2023-07-20T11:05:19.523 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_02_00_UTC 2023-07-20T11:05:19.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.524 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_02_00_UTC) 2023-07-20T11:05:19.584 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_03_00_UTC 2023-07-20T11:05:19.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.585 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_03_00_UTC) 2023-07-20T11:05:19.641 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_04_00_UTC 2023-07-20T11:05:19.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.642 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_04_00_UTC) 2023-07-20T11:05:19.696 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_05_00_UTC 2023-07-20T11:05:19.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.697 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_05_00_UTC) 2023-07-20T11:05:19.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:19.757 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T11:05:19.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T11:05:20.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 Processor -- start 2023-07-20T11:05:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 -- start start 2023-07-20T11:05:20.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fba2c158ce0 0x7fba2c0c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba2c06bd30 0x7fba2c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c0c95d0 con 0x7fba2c070970 2023-07-20T11:05:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c0c9fa0 con 0x7fba2c06bd30 2023-07-20T11:05:20.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba30a34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2c1590c0 con 0x7fba2c158ce0 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fba2c06bd30 0x7fba2c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba21d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba2c070970 0x7fba2c06b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58908/0 (socket says 172.21.15.82:58908) 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba21d9b640 1 -- 172.21.15.82:0/3960482923 learned_addr learned my addr 172.21.15.82:0/3960482923 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2a59c640 1 --2- 172.21.15.82:0/3960482923 >> v2:172.21.15.183:3300/0 conn(0x7fba2c158ce0 0x7fba2c0c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba29d9b640 1 -- 172.21.15.82:0/3960482923 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699009949 0 0) 0x7fba2c0c95d0 con 0x7fba2c070970 2023-07-20T11:05:20.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2ad9d640 1 -- 172.21.15.82:0/3960482923 >> v2:172.21.15.183:3300/0 conn(0x7fba2c158ce0 msgr2=0x7fba2c0c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2ad9d640 1 --2- 172.21.15.82:0/3960482923 >> v2:172.21.15.183:3300/0 conn(0x7fba2c158ce0 0x7fba2c0c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2ad9d640 1 -- 172.21.15.82:0/3960482923 >> v1:172.21.15.82:6789/0 conn(0x7fba2c070970 legacy=0x7fba2c06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:20.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.032+0000 7fba2ad9d640 1 -- 172.21.15.82:0/3960482923 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0c89c0 con 0x7fba2c06bd30 2023-07-20T11:05:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba2ad9d640 1 --2- 172.21.15.82:0/3960482923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c06bd30 0x7fba2c070e00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fba2c06a6c0 tx=0x7fba2401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b28cd519e71a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:20.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba29d9b640 1 -- 172.21.15.82:0/3960482923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240a5730 con 0x7fba2c06bd30 2023-07-20T11:05:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba29d9b640 1 -- 172.21.15.82:0/3960482923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba240a5890 con 0x7fba2c06bd30 2023-07-20T11:05:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba29d9b640 1 -- 172.21.15.82:0/3960482923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240a5c20 con 0x7fba2c06bd30 2023-07-20T11:05:20.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 -- 172.21.15.82:0/3960482923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c06bd30 msgr2=0x7fba2c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 --2- 172.21.15.82:0/3960482923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c06bd30 0x7fba2c070e00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fba2c06a6c0 tx=0x7fba2401c910 comp rx=0 tx=0).stop 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 -- 172.21.15.82:0/3960482923 shutdown_connections 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 --2- 172.21.15.82:0/3960482923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c06bd30 0x7fba2c070e00 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 --2- 172.21.15.82:0/3960482923 >> v2:172.21.15.183:3300/0 conn(0x7fba2c158ce0 0x7fba2c0c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 -- 172.21.15.82:0/3960482923 >> 172.21.15.82:0/3960482923 conn(0x7fba2c0cad50 msgr2=0x7fba2c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:20.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 -- 172.21.15.82:0/3960482923 shutdown_connections 2023-07-20T11:05:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.036+0000 7fba30a34640 1 -- 172.21.15.82:0/3960482923 wait complete. 2023-07-20T11:05:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 Processor -- start 2023-07-20T11:05:20.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 -- start start 2023-07-20T11:05:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 0x7fba2c167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c158ce0 0x7fba2c0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14b210 con 0x7fba2c070970 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14b4f0 con 0x7fba2c06bd30 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c14b7d0 con 0x7fba2c158ce0 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:20.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48264/0 (socket says 172.21.15.82:48264) 2023-07-20T11:05:20.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 -- 172.21.15.82:0/1652882576 learned_addr learned my addr 172.21.15.82:0/1652882576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 -- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c158ce0 msgr2=0x7fba2c0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c158ce0 0x7fba2c0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba2a59c640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 0x7fba2c167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 -- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 msgr2=0x7fba2c167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 0x7fba2c167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:20.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 -- 172.21.15.82:0/1652882576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24009a70 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba2a59c640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 0x7fba2c167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba21d9b640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fba140011f0 tx=0x7fba1400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140074e0 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14007640 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14004a10 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.040+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c14bab0 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c167b50 con 0x7fba2c070970 2023-07-20T11:05:20.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c14bfd0 con 0x7fba2c070970 2023-07-20T11:05:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fba14004b70 con 0x7fba2c070970 2023-07-20T11:05:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba237fe640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 0x7fba100688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:20.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fba140833c0 con 0x7fba2c070970 2023-07-20T11:05:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba2a59c640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 0x7fba100688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:20.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.044+0000 7fba2a59c640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 0x7fba100688e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009a40 tx=0x7fba1c008040 comp rx=0 tx=0).ready entity=mgr.9207 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:20.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.048+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba2c14bfd0 con 0x7fba2c070970 2023-07-20T11:05:20.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:20.288+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fba2c14bfd0 con 0x7fba2c070970 2023-07-20T11:05:21.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.088+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fba14050800 con 0x7fba2c070970 2023-07-20T11:05:21.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.088+0000 7fba237fe640 1 -- 172.21.15.82:0/1652882576 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v78) v1 ==== 93+0+0 (secure 0 0 0) 0x7fba14070df0 con 0x7fba2c070970 2023-07-20T11:05:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 msgr2=0x7fba100688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 0x7fba100688e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009a40 tx=0x7fba1c008040 comp rx=0 tx=0).stop 2023-07-20T11:05:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 msgr2=0x7fba2c14a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fba140011f0 tx=0x7fba1400c9b0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 shutdown_connections 2023-07-20T11:05:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fba10066420 0x7fba100688e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba2c158ce0 0x7fba2c0adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba2c070970 0x7fba2c14a5d0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 --2- 172.21.15.82:0/1652882576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba2c06bd30 0x7fba2c167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 >> 172.21.15.82:0/1652882576 conn(0x7fba2c0cad50 msgr2=0x7fba2c0cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 shutdown_connections 2023-07-20T11:05:21.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.092+0000 7fba30a34640 1 -- 172.21.15.82:0/1652882576 wait complete. 2023-07-20T11:05:21.111 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:05:21.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:05:21.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:05:21.251 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:05:21.252 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:21.252 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:21.263 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:21.263 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:21.281 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:21.300+0000 7fec52c76180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:05:21.291 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:21.300 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:21.317+0000 7fb611b58180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:05:21.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.496+0000 7f2a74c0b640 1 Processor -- start 2023-07-20T11:05:21.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.496+0000 7f2a74c0b640 1 -- start start 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.496+0000 7f2a74c0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 0x7f2a700d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a74c0b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2a700cd4b0 0x7f2a700cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a74c0b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a700d16b0 con 0x7f2a7015cab0 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a74c0b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a700d31c0 con 0x7f2a700cd4b0 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a74c0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700b3520 con 0x7f2a700d0d10 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2a7015cab0 0x7f2a700d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58918/0 (socket says 172.21.15.82:58918) 2023-07-20T11:05:21.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6e59c640 1 -- 172.21.15.82:0/3455537967 learned_addr learned my addr 172.21.15.82:0/3455537967 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a67fff640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 0x7f2a700d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 --2- 172.21.15.82:0/3455537967 >> v2:172.21.15.183:3300/0 conn(0x7f2a700cd4b0 0x7f2a700cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6dd9b640 1 -- 172.21.15.82:0/3455537967 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421847543 0 0) 0x7f2a700d16b0 con 0x7f2a7015cab0 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6dd9b640 1 -- 172.21.15.82:0/3455537967 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a5c003530 con 0x7f2a7015cab0 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 -- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 msgr2=0x7f2a700d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:21.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 0x7f2a700d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 -- 172.21.15.82:0/3455537967 >> v1:172.21.15.82:6789/0 conn(0x7f2a7015cab0 legacy=0x7f2a700d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 -- 172.21.15.82:0/3455537967 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700d0a10 con 0x7f2a700cd4b0 2023-07-20T11:05:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a67fff640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 0x7f2a700d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:21.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.500+0000 7f2a6ed9d640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a700cd940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d90 tx=0x7f2a6801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2028bcd5246838db server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:21.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a6dd9b640 1 -- 172.21.15.82:0/3455537967 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680a59e0 con 0x7f2a700cd4b0 2023-07-20T11:05:21.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a6dd9b640 1 -- 172.21.15.82:0/3455537967 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a680a5b40 con 0x7f2a700cd4b0 2023-07-20T11:05:21.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a6dd9b640 1 -- 172.21.15.82:0/3455537967 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680ad440 con 0x7f2a700cd4b0 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 msgr2=0x7f2a700cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a700cd940 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d90 tx=0x7f2a6801c920 comp rx=0 tx=0).stop 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- 172.21.15.82:0/3455537967 shutdown_connections 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a700cd940 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/3455537967 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a700d0d10 0x7f2a700d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- 172.21.15.82:0/3455537967 >> 172.21.15.82:0/3455537967 conn(0x7f2a7008c120 msgr2=0x7f2a7009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- 172.21.15.82:0/3455537967 shutdown_connections 2023-07-20T11:05:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- 172.21.15.82:0/3455537967 wait complete. 2023-07-20T11:05:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 Processor -- start 2023-07-20T11:05:21.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- start start 2023-07-20T11:05:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a7014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a7015cab0 0x7f2a70157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70150140 con 0x7f2a700d0d10 2023-07-20T11:05:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700c7c50 con 0x7f2a700cd4b0 2023-07-20T11:05:21.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.504+0000 7f2a74c0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700c7f30 con 0x7f2a7015cab0 2023-07-20T11:05:21.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48308/0 (socket says 172.21.15.82:48308) 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 -- 172.21.15.82:0/716680975 learned_addr learned my addr 172.21.15.82:0/716680975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a6e59c640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a7014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a6ed9d640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a7015cab0 0x7f2a70157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 -- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a7015cab0 msgr2=0x7f2a70157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a7015cab0 0x7f2a70157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 -- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 msgr2=0x7f2a7014fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a7014fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 -- 172.21.15.82:0/716680975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009420 con 0x7f2a700d0d10 2023-07-20T11:05:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a67fff640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800e980 tx=0x7f2a5800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:21.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800ca00 con 0x7f2a700d0d10 2023-07-20T11:05:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800cb60 con 0x7f2a700d0d10 2023-07-20T11:05:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a68009a70 con 0x7f2a700d0d10 2023-07-20T11:05:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58013470 con 0x7f2a700d0d10 2023-07-20T11:05:21.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a700c84f0 con 0x7f2a700d0d10 2023-07-20T11:05:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a70073c70 con 0x7f2a700d0d10 2023-07-20T11:05:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.508+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f2a580135d0 con 0x7f2a700d0d10 2023-07-20T11:05:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.512+0000 7f2a66ffd640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 0x7f2a50068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.512+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f2a58084230 con 0x7f2a700d0d10 2023-07-20T11:05:21.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.512+0000 7f2a6e59c640 1 -- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 msgr2=0x7f2a50068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:21.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.512+0000 7f2a6e59c640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 0x7f2a50068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:21.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.516+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a58051480 con 0x7f2a700d0d10 2023-07-20T11:05:21.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.668+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a700d12a0 con 0x7f2a700d0d10 2023-07-20T11:05:21.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a66ffd640 1 -- 172.21.15.82:0/716680975 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+19050 (secure 0 0 0) 0x7f2a58054aa0 con 0x7f2a700d0d10 2023-07-20T11:05:21.652 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:21.652 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":144,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:21.084805+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4125546988":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/3897637817":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1206262133":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1313050434":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1761844848":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6833/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6832/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1145221661":"2023-07-21T10:09:40.802557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":45,"length":12},{"begin":101,"length":12}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 msgr2=0x7f2a50068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 0x7f2a50068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 msgr2=0x7f2a700c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800e980 tx=0x7f2a5800ee40 comp rx=0 tx=0).stop 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 shutdown_connections 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f2a500663d0 0x7f2a50068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2a7015cab0 0x7f2a70157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a700d0d10 0x7f2a700c8a10 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 --2- 172.21.15.82:0/716680975 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2a700cd4b0 0x7f2a7014fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 >> 172.21.15.82:0/716680975 conn(0x7f2a7008c120 msgr2=0x7f2a700af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:21.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 shutdown_connections 2023-07-20T11:05:21.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.672+0000 7f2a74c0b640 1 -- 172.21.15.82:0/716680975 wait complete. 2023-07-20T11:05:21.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:09:21.268928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:09:22.560604+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 144, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:05:21.676 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:05:21.718 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:21.737+0000 7fb611b58180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:05:21.719 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:21.736+0000 7fec52c76180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:05:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 Processor -- start 2023-07-20T11:05:21.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 -- start start 2023-07-20T11:05:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fade015c6e0 0x7fade00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fade00d3200 0x7fade00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade015cac0 0x7fade00d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00cdb40 con 0x7fade00d3200 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade00d07a0 con 0x7fade015c6e0 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade792c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00cd4f0 con 0x7fade015cac0 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fade00d3200 0x7fade00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fade00d3200 0x7fade00cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48322/0 (socket says 172.21.15.82:48322) 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 -- 172.21.15.82:0/610131460 learned_addr learned my addr 172.21.15.82:0/610131460 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:21.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade56c8640 1 --2- 172.21.15.82:0/610131460 >> v2:172.21.15.183:3300/0 conn(0x7fade015c6e0 0x7fade00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade5ec9640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade015cac0 0x7fade00d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 -- 172.21.15.82:0/610131460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade015cac0 msgr2=0x7fade00d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade015cac0 0x7fade00d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 -- 172.21.15.82:0/610131460 >> v2:172.21.15.183:3300/0 conn(0x7fade015c6e0 msgr2=0x7fade00cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 --2- 172.21.15.82:0/610131460 >> v2:172.21.15.183:3300/0 conn(0x7fade015c6e0 0x7fade00cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.896+0000 7fade4ec7640 1 -- 172.21.15.82:0/610131460 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00cd7d0 con 0x7fade00d3200 2023-07-20T11:05:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade4ec7640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade00d3200 0x7fade00cdfd0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fade008a310 tx=0x7fadd001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd41b033525154f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fadd7fff640 1 -- 172.21.15.82:0/610131460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd00ab600 con 0x7fade00d3200 2023-07-20T11:05:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fadd7fff640 1 -- 172.21.15.82:0/610131460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd00a7050 con 0x7fade00d3200 2023-07-20T11:05:21.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fadd7fff640 1 -- 172.21.15.82:0/610131460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd00ab980 con 0x7fade00d3200 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 -- 172.21.15.82:0/610131460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade00d3200 msgr2=0x7fade00cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade00d3200 0x7fade00cdfd0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fade008a310 tx=0x7fadd001c3e0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 -- 172.21.15.82:0/610131460 shutdown_connections 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade015cac0 0x7fade00d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 --2- 172.21.15.82:0/610131460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade00d3200 0x7fade00cdfd0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 --2- 172.21.15.82:0/610131460 >> v2:172.21.15.183:3300/0 conn(0x7fade015c6e0 0x7fade00cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.900+0000 7fade792c640 1 -- 172.21.15.82:0/610131460 >> 172.21.15.82:0/610131460 conn(0x7fade00d2600 msgr2=0x7fade00d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.904+0000 7fade792c640 1 -- 172.21.15.82:0/610131460 shutdown_connections 2023-07-20T11:05:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.904+0000 7fade792c640 1 -- 172.21.15.82:0/610131460 wait complete. 2023-07-20T11:05:21.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.904+0000 7fade792c640 1 Processor -- start 2023-07-20T11:05:21.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.904+0000 7fade792c640 1 -- start start 2023-07-20T11:05:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade00d3200 0x7fade01f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade015c6e0 0x7fade00c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01f5a70 con 0x7fade015cac0 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01f4ec0 con 0x7fade015c6e0 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00c6800 con 0x7fade00d3200 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48326/0 (socket says 172.21.15.82:48326) 2023-07-20T11:05:21.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 -- 172.21.15.82:0/4015120528 learned_addr learned my addr 172.21.15.82:0/4015120528 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:21.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade4ec7640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade015c6e0 0x7fade00c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade56c8640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade00d3200 0x7fade01f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 -- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade00d3200 msgr2=0x7fade01f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade00d3200 0x7fade01f8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 -- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade015c6e0 msgr2=0x7fade00c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade015c6e0 0x7fade00c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 -- 172.21.15.82:0/4015120528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00094d0 con 0x7fade015cac0 2023-07-20T11:05:21.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade5ec9640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007e60 tx=0x7fadd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8014420 con 0x7fade015cac0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80145a0 con 0x7fade015cac0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade01f50d0 con 0x7fade015cac0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd8014950 con 0x7fade015cac0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade01f5690 con 0x7fade015cac0 2023-07-20T11:05:21.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.908+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade01f5bb0 con 0x7fade015cac0 2023-07-20T11:05:21.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.912+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fadd8014ab0 con 0x7fade015cac0 2023-07-20T11:05:21.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.912+0000 7fadd5ffb640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 0x7fadc4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:21.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.912+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fadd8084910 con 0x7fade015cac0 2023-07-20T11:05:21.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.912+0000 7fade56c8640 1 -- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 msgr2=0x7fadc4068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:21.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.912+0000 7fade56c8640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 0x7fadc4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:21.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:21.916+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fade01f5bb0 con 0x7fade015cac0 2023-07-20T11:05:21.902 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:21.921+0000 7fb611b58180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:05:21.941 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:21.960+0000 7fec52c76180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:05:22.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.068+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fade01f5bb0 con 0x7fade015cac0 2023-07-20T11:05:22.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.068+0000 7fadd5ffb640 1 -- 172.21.15.82:0/4015120528 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7fade01f5bb0 con 0x7fade015cac0 2023-07-20T11:05:22.049 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:05:22.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 msgr2=0x7fadc4068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:22.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 0x7fadc4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 msgr2=0x7fade014f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007e60 tx=0x7fadd800e4b0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 shutdown_connections 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7fadc40663a0 0x7fadc4068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fade015cac0 0x7fade014f180 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fade015c6e0 0x7fade00c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 --2- 172.21.15.82:0/4015120528 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fade00d3200 0x7fade01f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 >> 172.21.15.82:0/4015120528 conn(0x7fade00d2600 msgr2=0x7fade015bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 shutdown_connections 2023-07-20T11:05:22.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.072+0000 7fade792c640 1 -- 172.21.15.82:0/4015120528 wait complete. 2023-07-20T11:05:22.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:05:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.276+0000 7f77d0626640 1 Processor -- start 2023-07-20T11:05:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.276+0000 7f77d0626640 1 -- start start 2023-07-20T11:05:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.276+0000 7f77d0626640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f77c806b220 0x7f77c8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77d0626640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80ce4f0 con 0x7f77c806c120 2023-07-20T11:05:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77d0626640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80d0970 con 0x7f77c81602b0 2023-07-20T11:05:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77d0626640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c8160e20 con 0x7f77c806b220 2023-07-20T11:05:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77ce3c2640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f77c806c120 0x7f77c80cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58930/0 (socket says 172.21.15.82:58930) 2023-07-20T11:05:22.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77ce3c2640 1 -- 172.21.15.82:0/620481937 learned_addr learned my addr 172.21.15.82:0/620481937 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cebc3640 1 --2- 172.21.15.82:0/620481937 >> v2:172.21.15.183:3300/0 conn(0x7f77c806b220 0x7f77c8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cd3c0640 1 -- 172.21.15.82:0/620481937 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376554594 0 0) 0x7f77c80ce4f0 con 0x7f77c806c120 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cd3c0640 1 -- 172.21.15.82:0/620481937 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b4003530 con 0x7f77c806c120 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cebc3640 1 -- 172.21.15.82:0/620481937 >> v1:172.21.15.183:6789/0 conn(0x7f77c81602b0 legacy=0x7f77c806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cebc3640 1 -- 172.21.15.82:0/620481937 >> v1:172.21.15.82:6789/0 conn(0x7f77c806c120 legacy=0x7f77c80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cebc3640 1 -- 172.21.15.82:0/620481937 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80cd300 con 0x7f77c806b220 2023-07-20T11:05:22.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.280+0000 7f77cebc3640 1 --2- 172.21.15.82:0/620481937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806b220 0x7f77c8160740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009d90 tx=0x7f77c001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4e5c6f05f3d670 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77cd3c0640 1 -- 172.21.15.82:0/620481937 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00a58c0 con 0x7f77c806b220 2023-07-20T11:05:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77cd3c0640 1 -- 172.21.15.82:0/620481937 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c00a5a20 con 0x7f77c806b220 2023-07-20T11:05:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77cd3c0640 1 -- 172.21.15.82:0/620481937 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00a5db0 con 0x7f77c806b220 2023-07-20T11:05:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- 172.21.15.82:0/620481937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806b220 msgr2=0x7f77c8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 --2- 172.21.15.82:0/620481937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806b220 0x7f77c8160740 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009d90 tx=0x7f77c001c800 comp rx=0 tx=0).stop 2023-07-20T11:05:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- 172.21.15.82:0/620481937 shutdown_connections 2023-07-20T11:05:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 --2- 172.21.15.82:0/620481937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806b220 0x7f77c8160740 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- 172.21.15.82:0/620481937 >> 172.21.15.82:0/620481937 conn(0x7f77c808c0a0 msgr2=0x7f77c809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- 172.21.15.82:0/620481937 shutdown_connections 2023-07-20T11:05:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- 172.21.15.82:0/620481937 wait complete. 2023-07-20T11:05:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 Processor -- start 2023-07-20T11:05:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- start start 2023-07-20T11:05:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806c120 0x7f77c80c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77c81602b0 0x7f77c8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c85e0 con 0x7f77c806b220 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b7b70 con 0x7f77c806c120 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77d0626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c7680 con 0x7f77c81602b0 2023-07-20T11:05:22.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.284+0000 7f77ce3c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48338/0 (socket says 172.21.15.82:48338) 2023-07-20T11:05:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 -- 172.21.15.82:0/1103092642 learned_addr learned my addr 172.21.15.82:0/1103092642 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77cdbc1640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806c120 0x7f77c80c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77cebc3640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77c81602b0 0x7f77c8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 -- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77c81602b0 msgr2=0x7f77c8156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77c81602b0 0x7f77c8156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 -- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806c120 msgr2=0x7f77c80c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806c120 0x7f77c80c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 -- 172.21.15.82:0/1103092642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009a70 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77ce3c2640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c500 tx=0x7f77c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4005cf0 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4005e50 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c40072f0 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80c7960 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80c7f20 con 0x7f77c806b220 2023-07-20T11:05:22.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c804da30 con 0x7f77c806b220 2023-07-20T11:05:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.288+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f77c4007450 con 0x7f77c806b220 2023-07-20T11:05:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.292+0000 7f77beffd640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 0x7f77ac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.292+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f77c4083650 con 0x7f77c806b220 2023-07-20T11:05:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.292+0000 7f77cdbc1640 1 -- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 msgr2=0x7f77ac068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.292+0000 7f77cdbc1640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 0x7f77ac068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:22.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.300+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77c4050890 con 0x7f77c806b220 2023-07-20T11:05:22.382 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.401+0000 7fb611b58180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:22.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.448+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77c806a8f0 con 0x7f77c806b220 2023-07-20T11:05:22.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.448+0000 7f77beffd640 1 -- 172.21.15.82:0/1103092642 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f77c4053eb0 con 0x7f77c806b220 2023-07-20T11:05:22.430 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:05:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 msgr2=0x7f77ac068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:22.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 0x7f77ac068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 msgr2=0x7f77c80b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c500 tx=0x7f77c400c9c0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 shutdown_connections 2023-07-20T11:05:22.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f77ac0663a0 0x7f77ac068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f77c81602b0 0x7f77c8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f77c806c120 0x7f77c80c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 --2- 172.21.15.82:0/1103092642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77c806b220 0x7f77c80b6670 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 >> 172.21.15.82:0/1103092642 conn(0x7f77c808c0a0 msgr2=0x7f77c806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 shutdown_connections 2023-07-20T11:05:22.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.452+0000 7f77d0626640 1 -- 172.21.15.82:0/1103092642 wait complete. 2023-07-20T11:05:22.440 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.457+0000 7fb611b58180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:05:22.443 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.464+0000 7fec52c76180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:22.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:05:22.496 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.513+0000 7fb611b58180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:05:22.507 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.524+0000 7fec52c76180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:05:22.565 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.584+0000 7fec52c76180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:05:22.582 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.601+0000 7fb611b58180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:05:22.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.616+0000 7f0532b00640 1 Processor -- start 2023-07-20T11:05:22.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.616+0000 7f0532b00640 1 -- start start 2023-07-20T11:05:22.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f0532b00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f052c06b220 0x7f052c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f0532b00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0ce4f0 con 0x7f052c1602b0 2023-07-20T11:05:22.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f0532b00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0d0970 con 0x7f052c06c120 2023-07-20T11:05:22.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f0532b00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c160e20 con 0x7f052c06b220 2023-07-20T11:05:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f052c06b220 0x7f052c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f052c06b220 0x7f052c160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48344/0 (socket says 172.21.15.82:48344) 2023-07-20T11:05:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f052bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f052c1602b0 0x7f052c06ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58936/0 (socket says 172.21.15.82:58936) 2023-07-20T11:05:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 -- 172.21.15.82:0/3414864023 learned_addr learned my addr 172.21.15.82:0/3414864023 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:22.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 -- 172.21.15.82:0/3414864023 >> v1:172.21.15.183:6789/0 conn(0x7f052c06c120 legacy=0x7f052c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 -- 172.21.15.82:0/3414864023 >> v1:172.21.15.82:6789/0 conn(0x7f052c1602b0 legacy=0x7f052c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f053109d640 1 -- 172.21.15.82:0/3414864023 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0cd300 con 0x7f052c06b220 2023-07-20T11:05:22.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.620+0000 7f052b7fe640 1 -- 172.21.15.82:0/3414864023 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981288647 0 0) 0x7f052c0ce4f0 con 0x7f052c1602b0 2023-07-20T11:05:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f053109d640 1 --2- 172.21.15.82:0/3414864023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06b220 0x7f052c160740 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0524009e50 tx=0x7f052401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980ce1fd8b607349 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f052b7fe640 1 -- 172.21.15.82:0/3414864023 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240a5780 con 0x7f052c06b220 2023-07-20T11:05:22.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f052b7fe640 1 -- 172.21.15.82:0/3414864023 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05240a58e0 con 0x7f052c06b220 2023-07-20T11:05:22.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f052b7fe640 1 -- 172.21.15.82:0/3414864023 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240a5c70 con 0x7f052c06b220 2023-07-20T11:05:22.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- 172.21.15.82:0/3414864023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06b220 msgr2=0x7f052c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 --2- 172.21.15.82:0/3414864023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06b220 0x7f052c160740 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f0524009e50 tx=0x7f052401c8c0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- 172.21.15.82:0/3414864023 shutdown_connections 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 --2- 172.21.15.82:0/3414864023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06b220 0x7f052c160740 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- 172.21.15.82:0/3414864023 >> 172.21.15.82:0/3414864023 conn(0x7f052c08c0a0 msgr2=0x7f052c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- 172.21.15.82:0/3414864023 shutdown_connections 2023-07-20T11:05:22.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- 172.21.15.82:0/3414864023 wait complete. 2023-07-20T11:05:22.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 Processor -- start 2023-07-20T11:05:22.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.624+0000 7f0532b00640 1 -- start start 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f052c06b220 0x7f052c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f052c1602b0 0x7f052c0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0ca6c0 con 0x7f052c06c120 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0cbc20 con 0x7f052c1602b0 2023-07-20T11:05:22.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0ca3e0 con 0x7f052c06b220 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48350/0 (socket says 172.21.15.82:48350) 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 -- 172.21.15.82:0/2232274500 learned_addr learned my addr 172.21.15.82:0/2232274500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f053109d640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f052c1602b0 0x7f052c0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f053089c640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f052c06b220 0x7f052c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 -- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f052c06b220 msgr2=0x7f052c0cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f052c06b220 0x7f052c0cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 -- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f052c1602b0 msgr2=0x7f052c0b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f052c1602b0 0x7f052c0b1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 -- 172.21.15.82:0/2232274500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009b30 con 0x7f052c06c120 2023-07-20T11:05:22.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f052bfff640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f051800c410 tx=0x7f051800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180074e0 con 0x7f052c06c120 2023-07-20T11:05:22.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518007640 con 0x7f052c06c120 2023-07-20T11:05:22.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518004a30 con 0x7f052c06c120 2023-07-20T11:05:22.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c0cac00 con 0x7f052c06c120 2023-07-20T11:05:22.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c0cb1c0 con 0x7f052c06c120 2023-07-20T11:05:22.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c0caa60 con 0x7f052c06c120 2023-07-20T11:05:22.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.628+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0518004b90 con 0x7f052c06c120 2023-07-20T11:05:22.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.632+0000 7f05297fa640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 0x7f0510068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.632+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f0518083da0 con 0x7f052c06c120 2023-07-20T11:05:22.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.632+0000 7f053089c640 1 -- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 msgr2=0x7f0510068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:22.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.632+0000 7f053089c640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 0x7f0510068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:22.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.636+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f052c0caa60 con 0x7f052c06c120 2023-07-20T11:05:22.639 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.657+0000 7fb611b58180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:05:22.656 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.676+0000 7fec52c76180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:05:22.714 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.732+0000 7fec52c76180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:05:22.724 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.741+0000 7fb611b58180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:05:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.784+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f052c0caa60 con 0x7f052c06c120 2023-07-20T11:05:22.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.784+0000 7f05297fa640 1 -- 172.21.15.82:0/2232274500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7f052c0caa60 con 0x7f052c06c120 2023-07-20T11:05:22.766 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:05:22.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 msgr2=0x7f0510068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 0x7f0510068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 msgr2=0x7f052c1586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f051800c410 tx=0x7f051800c8d0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 shutdown_connections 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f05100663a0 0x7f0510068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f052c1602b0 0x7f052c0b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f052c06c120 0x7f052c1586f0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 --2- 172.21.15.82:0/2232274500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f052c06b220 0x7f052c0cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 >> 172.21.15.82:0/2232274500 conn(0x7f052c08c0a0 msgr2=0x7f052c06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 shutdown_connections 2023-07-20T11:05:22.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.788+0000 7f0532b00640 1 -- 172.21.15.82:0/2232274500 wait complete. 2023-07-20T11:05:22.780 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.801+0000 7fb611b58180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:05:22.787 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:05:22.802 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.820+0000 7fec52c76180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:05:22.862 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:22.880+0000 7fec52c76180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:05:22.922 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:22.941+0000 7fb611b58180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:05:22.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 Processor -- start 2023-07-20T11:05:22.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 -- start start 2023-07-20T11:05:22.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39a01602b0 0x7f39a0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 0x7f39a006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a00ce4f0 con 0x7f39a006c120 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a006b4a0 con 0x7f39a01602b0 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a8737640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00d0970 con 0x7f39a006ab10 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39a01602b0 0x7f39a0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f39a01602b0 0x7f39a0160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48362/0 (socket says 172.21.15.82:48362) 2023-07-20T11:05:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 -- 172.21.15.82:0/2382550596 learned_addr learned my addr 172.21.15.82:0/2382550596 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:22.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a6cd4640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 0x7f39a006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 -- 172.21.15.82:0/2382550596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 msgr2=0x7f39a006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:22.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 0x7f39a006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 -- 172.21.15.82:0/2382550596 >> v1:172.21.15.183:6789/0 conn(0x7f39a006c120 legacy=0x7f39a00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a5cd2640 1 -- 172.21.15.82:0/2382550596 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0160e20 con 0x7f39a01602b0 2023-07-20T11:05:22.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.952+0000 7f39a6cd4640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 0x7f39a006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:22.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a5cd2640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a01602b0 0x7f39a0160740 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3990009870 tx=0x7f399001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d374f6d9fa245268 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a54d1640 1 -- 172.21.15.82:0/2382550596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900ab680 con 0x7f39a01602b0 2023-07-20T11:05:22.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a54d1640 1 -- 172.21.15.82:0/2382550596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900ab7e0 con 0x7f39a01602b0 2023-07-20T11:05:22.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a54d1640 1 -- 172.21.15.82:0/2382550596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900abb70 con 0x7f39a01602b0 2023-07-20T11:05:22.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 -- 172.21.15.82:0/2382550596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a01602b0 msgr2=0x7f39a0160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a01602b0 0x7f39a0160740 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f3990009870 tx=0x7f399001c480 comp rx=0 tx=0).stop 2023-07-20T11:05:22.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 -- 172.21.15.82:0/2382550596 shutdown_connections 2023-07-20T11:05:22.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a006ab10 0x7f39a006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 --2- 172.21.15.82:0/2382550596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a01602b0 0x7f39a0160740 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 -- 172.21.15.82:0/2382550596 >> 172.21.15.82:0/2382550596 conn(0x7f39a008c0a0 msgr2=0x7f39a009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:22.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 -- 172.21.15.82:0/2382550596 shutdown_connections 2023-07-20T11:05:22.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.956+0000 7f39a8737640 1 -- 172.21.15.82:0/2382550596 wait complete. 2023-07-20T11:05:22.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 Processor -- start 2023-07-20T11:05:22.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- start start 2023-07-20T11:05:22.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39a006ab10 0x7f39a0154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a01602b0 0x7f39a00cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00b0010 con 0x7f39a006c120 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00b02f0 con 0x7f39a006ab10 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00b05d0 con 0x7f39a01602b0 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a64d3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39a006ab10 0x7f39a0154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48364/0 (socket says 172.21.15.82:48364) 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a6cd4640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a01602b0 0x7f39a00cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:22.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 -- 172.21.15.82:0/912444112 learned_addr learned my addr 172.21.15.82:0/912444112 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:22.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 -- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a01602b0 msgr2=0x7f39a00cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a01602b0 0x7f39a00cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 -- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39a006ab10 msgr2=0x7f39a0154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39a006ab10 0x7f39a0154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 -- 172.21.15.82:0/912444112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900094d0 con 0x7f39a006c120 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a5cd2640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f39900ad040 tx=0x7f3990019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900b5810 con 0x7f39a006c120 2023-07-20T11:05:22.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900b5990 con 0x7f39a006c120 2023-07-20T11:05:22.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a00b08b0 con 0x7f39a006c120 2023-07-20T11:05:22.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900b5d40 con 0x7f39a006c120 2023-07-20T11:05:22.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a0154bb0 con 0x7f39a006c120 2023-07-20T11:05:22.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.960+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a00b0dd0 con 0x7f39a006c120 2023-07-20T11:05:22.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.964+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f39900bf410 con 0x7f39a006c120 2023-07-20T11:05:22.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.964+0000 7f3996ffd640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 0x7f3984068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:22.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.964+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f399011ee20 con 0x7f39a006c120 2023-07-20T11:05:22.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.964+0000 7f39a64d3640 1 -- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 msgr2=0x7f3984068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:22.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.964+0000 7f39a64d3640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 0x7f3984068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:22.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:22.972+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39a00b0dd0 con 0x7f39a006c120 2023-07-20T11:05:22.982 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.001+0000 7fb611b58180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:05:23.014 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.032+0000 7fec52c76180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:05:23.074 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.092+0000 7fec52c76180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:05:23.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.120+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39a00b0dd0 con 0x7f39a006c120 2023-07-20T11:05:23.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f3996ffd640 1 -- 172.21.15.82:0/912444112 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39a00b0dd0 con 0x7f39a006c120 2023-07-20T11:05:23.103 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:05:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 msgr2=0x7f3984068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 0x7f3984068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 msgr2=0x7f39a00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f39900ad040 tx=0x7f3990019220 comp rx=0 tx=0).stop 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 shutdown_connections 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f39840663a0 0x7f3984068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39a01602b0 0x7f39a00cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a006c120 0x7f39a00cad90 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 --2- 172.21.15.82:0/912444112 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39a006ab10 0x7f39a0154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 >> 172.21.15.82:0/912444112 conn(0x7f39a008c0a0 msgr2=0x7f39a00d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 shutdown_connections 2023-07-20T11:05:23.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.124+0000 7f39a8737640 1 -- 172.21.15.82:0/912444112 wait complete. 2023-07-20T11:05:23.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T11:05:23.226 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:05:23.226 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:05:23.227 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:05:23.235 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.253+0000 7fb611b58180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:05:23.326 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:05:23.326 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:05:23.327 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:05:23.335 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.356+0000 7fec52c76180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:05:23.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.368+0000 7f7978ef9640 1 Processor -- start 2023-07-20T11:05:23.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 -- start start 2023-07-20T11:05:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f797415cab0 0x7f79740d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 0x7f79740d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79740d16b0 con 0x7f79740d0d10 2023-07-20T11:05:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79740d31c0 con 0x7f797415cab0 2023-07-20T11:05:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7978ef9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79740b3520 con 0x7f79740ce4c0 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f797415cab0 0x7f79740d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f797415cab0 0x7f79740d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57068/0 (socket says 172.21.15.82:57068) 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 -- 172.21.15.82:0/1915826549 learned_addr learned my addr 172.21.15.82:0/1915826549 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7972d9d640 1 --2- 172.21.15.82:0/1915826549 >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 0x7f79740d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 -- 172.21.15.82:0/1915826549 >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 msgr2=0x7f79740d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 --2- 172.21.15.82:0/1915826549 >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 0x7f79740d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 -- 172.21.15.82:0/1915826549 >> v1:172.21.15.183:6789/0 conn(0x7f79740d0d10 legacy=0x7f79740cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f797259c640 1 -- 172.21.15.82:0/1915826549 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740b2910 con 0x7f797415cab0 2023-07-20T11:05:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.372+0000 7f7972d9d640 1 --2- 172.21.15.82:0/1915826549 >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 0x7f79740d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f797259c640 1 --2- 172.21.15.82:0/1915826549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740d0300 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f7974071cd0 tx=0x7f796401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc7dcd215c912cb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7971d9b640 1 -- 172.21.15.82:0/1915826549 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640ab5f0 con 0x7f797415cab0 2023-07-20T11:05:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7971d9b640 1 -- 172.21.15.82:0/1915826549 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640ab750 con 0x7f797415cab0 2023-07-20T11:05:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7971d9b640 1 -- 172.21.15.82:0/1915826549 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640abae0 con 0x7f797415cab0 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- 172.21.15.82:0/1915826549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 msgr2=0x7f79740d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 --2- 172.21.15.82:0/1915826549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740d0300 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f7974071cd0 tx=0x7f796401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- 172.21.15.82:0/1915826549 shutdown_connections 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 --2- 172.21.15.82:0/1915826549 >> v2:172.21.15.183:3300/0 conn(0x7f79740ce4c0 0x7f79740d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 --2- 172.21.15.82:0/1915826549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740d0300 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- 172.21.15.82:0/1915826549 >> 172.21.15.82:0/1915826549 conn(0x7f797408c120 msgr2=0x7f797409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- 172.21.15.82:0/1915826549 shutdown_connections 2023-07-20T11:05:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- 172.21.15.82:0/1915826549 wait complete. 2023-07-20T11:05:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 Processor -- start 2023-07-20T11:05:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.376+0000 7f7978ef9640 1 -- start start 2023-07-20T11:05:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 0x7f79740cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740d0d10 0x7f79740b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79741585c0 con 0x7f797415cab0 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740c7210 con 0x7f79740ce4c0 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79740c6600 con 0x7f79740d0d10 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7972d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7972d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57072/0 (socket says 172.21.15.82:57072) 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 0x7f79740cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7972d9d640 1 -- 172.21.15.82:0/581732686 learned_addr learned my addr 172.21.15.82:0/581732686 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f796bfff640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740d0d10 0x7f79740b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 -- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740d0d10 msgr2=0x7f79740b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740d0d10 0x7f79740b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 -- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 msgr2=0x7f79740b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 -- 172.21.15.82:0/581732686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79640094d0 con 0x7f79740ce4c0 2023-07-20T11:05:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7972d9d640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:23.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f797259c640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 0x7f79740cbef0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f79640ac000 tx=0x7f796401ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:23.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640be5f0 con 0x7f79740ce4c0 2023-07-20T11:05:23.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640be750 con 0x7f79740ce4c0 2023-07-20T11:05:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79740c68e0 con 0x7f79740ce4c0 2023-07-20T11:05:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640beb00 con 0x7f79740ce4c0 2023-07-20T11:05:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79740c6ea0 con 0x7f79740ce4c0 2023-07-20T11:05:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.380+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7974073c70 con 0x7f79740ce4c0 2023-07-20T11:05:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.384+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f79640059a0 con 0x7f79740ce4c0 2023-07-20T11:05:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.384+0000 7f796affd640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 0x7f7954068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.384+0000 7f796bfff640 1 -- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 msgr2=0x7f7954068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.384+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f79640a8050 con 0x7f79740ce4c0 2023-07-20T11:05:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.384+0000 7f796bfff640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 0x7f7954068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.388+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79640ebe80 con 0x7f79740ce4c0 2023-07-20T11:05:23.372 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.389+0000 7fb611b58180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:23.475 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.492+0000 7fec52c76180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:23.497 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.517+0000 7fb611b58180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.548+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79740b2590 con 0x7f79740ce4c0 2023-07-20T11:05:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.548+0000 7f796affd640 1 -- 172.21.15.82:0/581732686 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v144) v1 ==== 80+0+470 (secure 0 0 0) 0x7f79640ef4a0 con 0x7f79740ce4c0 2023-07-20T11:05:23.530 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4125546988 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.530 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3897637817 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.531 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1206262133 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.531 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1313050434 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.531 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1761844848 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.531 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/3908346675 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.531 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/3908346675 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.532 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1145221661 2023-07-21T10:09:40.802557+0000 2023-07-20T11:05:23.532 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T11:05:23.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 msgr2=0x7f7954068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:23.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 0x7f7954068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 msgr2=0x7f79740cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 0x7f79740cbef0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f79640ac000 tx=0x7f796401ad10 comp rx=0 tx=0).stop 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 shutdown_connections 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f79540663d0 0x7f7954068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f797415cab0 0x7f79740b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f79740d0d10 0x7f79740b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 --2- 172.21.15.82:0/581732686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f79740ce4c0 0x7f79740cbef0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 >> 172.21.15.82:0/581732686 conn(0x7f797408c120 msgr2=0x7f797406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 shutdown_connections 2023-07-20T11:05:23.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.552+0000 7f7978ef9640 1 -- 172.21.15.82:0/581732686 wait complete. 2023-07-20T11:05:23.552 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T11:05:23.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:23.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T11:05:23.567 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.585+0000 7fb611b58180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:05:23.608 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.628+0000 7fec52c76180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:23.611 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:05:23.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:23.612 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T11:05:23.623 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:05:23.623 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:23.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:05:23.635 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:23.636 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:23.676 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:05:23.676 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:05:23.677 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:23.683 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.704+0000 7fec52c76180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:05:23.686 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:05:23.686 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:23.704 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:23.721+0000 7fb611b58180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:23.825 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:23.844+0000 7fec52c76180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 Processor -- start 2023-07-20T11:05:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 -- start start 2023-07-20T11:05:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92000d0d10 0x7f92000d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92000d16b0 con 0x7f92000cd4b0 2023-07-20T11:05:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92000b3520 con 0x7f920015cab0 2023-07-20T11:05:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f920786d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92000d31c0 con 0x7f92000d0d10 2023-07-20T11:05:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f9204e08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92000d0d10 0x7f92000d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f9204e08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f92000d0d10 0x7f92000d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57086/0 (socket says 172.21.15.82:57086) 2023-07-20T11:05:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.848+0000 7f9204e08640 1 -- 172.21.15.82:0/3585881403 learned_addr learned my addr 172.21.15.82:0/3585881403 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f9204e08640 1 -- 172.21.15.82:0/3585881403 >> v1:172.21.15.183:6789/0 conn(0x7f920015cab0 legacy=0x7f92000d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f9204e08640 1 -- 172.21.15.82:0/3585881403 >> v1:172.21.15.82:6789/0 conn(0x7f92000cd4b0 legacy=0x7f92000cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f9204e08640 1 -- 172.21.15.82:0/3585881403 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92000d0a10 con 0x7f92000d0d10 2023-07-20T11:05:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f91f7fff640 1 -- 172.21.15.82:0/3585881403 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821825681 0 0) 0x7f92000d16b0 con 0x7f92000cd4b0 2023-07-20T11:05:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f9204e08640 1 --2- 172.21.15.82:0/3585881403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000d0d10 0x7f92000d1170 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009870 tx=0x7f91f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bb25498a31249b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f91f7fff640 1 -- 172.21.15.82:0/3585881403 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00ab610 con 0x7f92000d0d10 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f91f7fff640 1 -- 172.21.15.82:0/3585881403 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f00ab770 con 0x7f92000d0d10 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.852+0000 7f91f7fff640 1 -- 172.21.15.82:0/3585881403 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00abb00 con 0x7f92000d0d10 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- 172.21.15.82:0/3585881403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000d0d10 msgr2=0x7f92000d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 --2- 172.21.15.82:0/3585881403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000d0d10 0x7f92000d1170 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f91f0009870 tx=0x7f91f001c510 comp rx=0 tx=0).stop 2023-07-20T11:05:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- 172.21.15.82:0/3585881403 shutdown_connections 2023-07-20T11:05:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 --2- 172.21.15.82:0/3585881403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000d0d10 0x7f92000d1170 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- 172.21.15.82:0/3585881403 >> 172.21.15.82:0/3585881403 conn(0x7f920008c120 msgr2=0x7f920009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- 172.21.15.82:0/3585881403 shutdown_connections 2023-07-20T11:05:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- 172.21.15.82:0/3585881403 wait complete. 2023-07-20T11:05:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 Processor -- start 2023-07-20T11:05:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- start start 2023-07-20T11:05:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92000d0d10 0x7f920015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f920015cab0 0x7f9200153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92000c8de0 con 0x7f92000cd4b0 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92000c7a30 con 0x7f920015cab0 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f920786d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9200156f90 con 0x7f92000d0d10 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57102/0 (socket says 172.21.15.82:57102) 2023-07-20T11:05:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 -- 172.21.15.82:0/1813703485 learned_addr learned my addr 172.21.15.82:0/1813703485 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9204e08640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92000d0d10 0x7f920015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205e0a640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f920015cab0 0x7f9200153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 -- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92000d0d10 msgr2=0x7f920015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92000d0d10 0x7f920015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 -- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f920015cab0 msgr2=0x7f9200153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f920015cab0 0x7f9200153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.856+0000 7f9205609640 1 -- 172.21.15.82:0/1813703485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00094d0 con 0x7f92000cd4b0 2023-07-20T11:05:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f9205609640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c560 tx=0x7f91fc00ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc005220 con 0x7f92000cd4b0 2023-07-20T11:05:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91fc005380 con 0x7f92000cd4b0 2023-07-20T11:05:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91fc007270 con 0x7f92000cd4b0 2023-07-20T11:05:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92000c8400 con 0x7f92000cd4b0 2023-07-20T11:05:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92000c73e0 con 0x7f92000cd4b0 2023-07-20T11:05:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9200073c70 con 0x7f92000cd4b0 2023-07-20T11:05:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f91fc0073d0 con 0x7f92000cd4b0 2023-07-20T11:05:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 0x7f91e4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f91fc0837c0 con 0x7f92000cd4b0 2023-07-20T11:05:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f9204e08640 1 -- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 msgr2=0x7f91e4068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.860+0000 7f9204e08640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 0x7f91e4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:23.864+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91fc050a00 con 0x7f92000cd4b0 2023-07-20T11:05:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.044+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9200072e00 con 0x7f92000cd4b0 2023-07-20T11:05:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.044+0000 7f91f5ffb640 1 -- 172.21.15.82:0/1813703485 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f91fc054020 con 0x7f92000cd4b0 2023-07-20T11:05:24.027 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:24.028 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T11:05:24.031 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T11:05:24.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 msgr2=0x7f91e4068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:24.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 0x7f91e4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 msgr2=0x7f92000c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c560 tx=0x7f91fc00ca20 comp rx=0 tx=0).stop 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 shutdown_connections 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f91e40663a0 0x7f91e4068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f920015cab0 0x7f9200153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f92000d0d10 0x7f920015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 --2- 172.21.15.82:0/1813703485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92000cd4b0 0x7f92000c7ec0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 >> 172.21.15.82:0/1813703485 conn(0x7f920008c120 msgr2=0x7f920006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 shutdown_connections 2023-07-20T11:05:24.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.048+0000 7f920786d640 1 -- 172.21.15.82:0/1813703485 wait complete. 2023-07-20T11:05:24.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:24.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 Processor -- start 2023-07-20T11:05:24.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 -- start start 2023-07-20T11:05:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d840d0d10 0x7f7d840d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7d840cd4b0 0x7f7d840cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840d16b0 con 0x7f7d8415cab0 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840d31c0 con 0x7f7d840d0d10 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d897ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840b3520 con 0x7f7d840cd4b0 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d840d0d10 0x7f7d840d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7d840d0d10 0x7f7d840d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57112/0 (socket says 172.21.15.82:57112) 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 -- 172.21.15.82:0/43545804 learned_addr learned my addr 172.21.15.82:0/43545804 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d837fe640 1 --2- 172.21.15.82:0/43545804 >> v2:172.21.15.183:3300/0 conn(0x7f7d840cd4b0 0x7f7d840cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 -- 172.21.15.82:0/43545804 >> v2:172.21.15.183:3300/0 conn(0x7f7d840cd4b0 msgr2=0x7f7d840cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 --2- 172.21.15.82:0/43545804 >> v2:172.21.15.183:3300/0 conn(0x7f7d840cd4b0 0x7f7d840cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 -- 172.21.15.82:0/43545804 >> v1:172.21.15.183:6789/0 conn(0x7f7d8415cab0 legacy=0x7f7d840d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.212+0000 7f7d7bfff640 1 -- 172.21.15.82:0/43545804 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840d0a10 con 0x7f7d840d0d10 2023-07-20T11:05:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d7bfff640 1 --2- 172.21.15.82:0/43545804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840d1170 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f7d84071cd0 tx=0x7f7d6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1298c9b98f67a4b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d827fc640 1 -- 172.21.15.82:0/43545804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0aa430 con 0x7f7d840d0d10 2023-07-20T11:05:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d827fc640 1 -- 172.21.15.82:0/43545804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0aa590 con 0x7f7d840d0d10 2023-07-20T11:05:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d827fc640 1 -- 172.21.15.82:0/43545804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0aa920 con 0x7f7d840d0d10 2023-07-20T11:05:24.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 -- 172.21.15.82:0/43545804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 msgr2=0x7f7d840d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 --2- 172.21.15.82:0/43545804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840d1170 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f7d84071cd0 tx=0x7f7d6c01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 -- 172.21.15.82:0/43545804 shutdown_connections 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 --2- 172.21.15.82:0/43545804 >> v2:172.21.15.183:3300/0 conn(0x7f7d840cd4b0 0x7f7d840cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 --2- 172.21.15.82:0/43545804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840d1170 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 -- 172.21.15.82:0/43545804 >> 172.21.15.82:0/43545804 conn(0x7f7d8408c120 msgr2=0x7f7d8409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 -- 172.21.15.82:0/43545804 shutdown_connections 2023-07-20T11:05:24.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.216+0000 7f7d897ba640 1 -- 172.21.15.82:0/43545804 wait complete. 2023-07-20T11:05:24.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.220+0000 7f7d897ba640 1 Processor -- start 2023-07-20T11:05:24.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.220+0000 7f7d897ba640 1 -- start start 2023-07-20T11:05:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.220+0000 7f7d897ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d840cd4b0 0x7f7d840c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d8415cab0 0x7f7d840c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c8bc0 con 0x7f7d840d0d10 2023-07-20T11:05:24.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c7f80 con 0x7f7d8415cab0 2023-07-20T11:05:24.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c8220 con 0x7f7d840cd4b0 2023-07-20T11:05:24.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57114/0 (socket says 172.21.15.82:57114) 2023-07-20T11:05:24.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 -- 172.21.15.82:0/3662766474 learned_addr learned my addr 172.21.15.82:0/3662766474 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:24.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d82ffd640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d840cd4b0 0x7f7d840c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d837fe640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d8415cab0 0x7f7d840c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 -- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d840cd4b0 msgr2=0x7f7d840c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d840cd4b0 0x7f7d840c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 -- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d8415cab0 msgr2=0x7f7d840c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d8415cab0 0x7f7d840c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 -- 172.21.15.82:0/3662766474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c0094d0 con 0x7f7d840d0d10 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7bfff640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0190e0 tx=0x7f7d6c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0aa430 con 0x7f7d840d0d10 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0b3800 con 0x7f7d840d0d10 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0b3bb0 con 0x7f7d840d0d10 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d840c8500 con 0x7f7d840d0d10 2023-07-20T11:05:24.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d840c8fe0 con 0x7f7d840d0d10 2023-07-20T11:05:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d840c89b0 con 0x7f7d840d0d10 2023-07-20T11:05:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.224+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f7d6c0b3d10 con 0x7f7d840d0d10 2023-07-20T11:05:24.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.228+0000 7f7d7b7fe640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 0x7f7d64068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.228+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7d6c11ea80 con 0x7f7d840d0d10 2023-07-20T11:05:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.228+0000 7f7d82ffd640 1 -- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 msgr2=0x7f7d64068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:24.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.228+0000 7f7d82ffd640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 0x7f7d64068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:24.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.232+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d840c89b0 con 0x7f7d840d0d10 2023-07-20T11:05:24.248 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.265+0000 7fb611b58180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:05:24.336 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.353+0000 7fb611b58180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:05:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.384+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d840c89b0 con 0x7f7d840d0d10 2023-07-20T11:05:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.384+0000 7f7d7b7fe640 1 -- 172.21.15.82:0/3662766474 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+19050 (secure 0 0 0) 0x7f7d840c89b0 con 0x7f7d840d0d10 2023-07-20T11:05:24.366 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:24.366 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":144,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:21.084805+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4125546988":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/3897637817":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1206262133":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1313050434":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1761844848":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6833/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6832/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1145221661":"2023-07-21T10:09:40.802557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":45,"length":12},{"begin":101,"length":12}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 msgr2=0x7f7d64068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 0x7f7d64068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 msgr2=0x7f7d840c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0190e0 tx=0x7f7d6c01ad10 comp rx=0 tx=0).stop 2023-07-20T11:05:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 shutdown_connections 2023-07-20T11:05:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f7d640663a0 0x7f7d64068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d8415cab0 0x7f7d840c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d840d0d10 0x7f7d840c67a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 --2- 172.21.15.82:0/3662766474 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7d840cd4b0 0x7f7d840c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 >> 172.21.15.82:0/3662766474 conn(0x7f7d8408c120 msgr2=0x7f7d840af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 shutdown_connections 2023-07-20T11:05:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.388+0000 7f7d897ba640 1 -- 172.21.15.82:0/3662766474 wait complete. 2023-07-20T11:05:24.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T10:09:21.268928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T10:09:22.560604+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 144, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:05:24.388 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:05:24.392 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:24.412+0000 7fec52c76180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:05:24.479 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:24.500+0000 7fec52c76180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:05:24.483 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.501+0000 7fb611b58180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:05:24.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 Processor -- start 2023-07-20T11:05:24.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 -- start start 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f471c1602b0 0x7f471c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 0x7f471c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c0ce4f0 con 0x7f471c06c120 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471c06b4a0 con 0x7f471c1602b0 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f4722b2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0d0970 con 0x7f471c06ab10 2023-07-20T11:05:24.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f47208c8640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f471c06c120 0x7f471c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57994/0 (socket says 172.21.15.82:57994) 2023-07-20T11:05:24.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f47208c8640 1 -- 172.21.15.82:0/1331603147 learned_addr learned my addr 172.21.15.82:0/1331603147 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f47210c9640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 0x7f471c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f471bfff640 1 --2- 172.21.15.82:0/1331603147 >> v2:172.21.15.183:3300/0 conn(0x7f471c1602b0 0x7f471c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f471b7fe640 1 -- 172.21.15.82:0/1331603147 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593515679 0 0) 0x7f471c0ce4f0 con 0x7f471c06c120 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.552+0000 7f471b7fe640 1 -- 172.21.15.82:0/1331603147 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c003530 con 0x7f471c06c120 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471bfff640 1 -- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 msgr2=0x7f471c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:24.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471bfff640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 0x7f471c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471bfff640 1 -- 172.21.15.82:0/1331603147 >> v1:172.21.15.82:6789/0 conn(0x7f471c06c120 legacy=0x7f471c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471bfff640 1 -- 172.21.15.82:0/1331603147 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c160e20 con 0x7f471c1602b0 2023-07-20T11:05:24.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f47210c9640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 0x7f471c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:24.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471bfff640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c160740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f47080097c0 tx=0x7f470801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e12a6d15ced349 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471b7fe640 1 -- 172.21.15.82:0/1331603147 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080ac620 con 0x7f471c1602b0 2023-07-20T11:05:24.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471b7fe640 1 -- 172.21.15.82:0/1331603147 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47080ac780 con 0x7f471c1602b0 2023-07-20T11:05:24.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f471b7fe640 1 -- 172.21.15.82:0/1331603147 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080acb10 con 0x7f471c1602b0 2023-07-20T11:05:24.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f4722b2c640 1 -- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 msgr2=0x7f471c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.556+0000 7f4722b2c640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c160740 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f47080097c0 tx=0x7f470801c3c0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- 172.21.15.82:0/1331603147 shutdown_connections 2023-07-20T11:05:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06ab10 0x7f471c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 --2- 172.21.15.82:0/1331603147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c160740 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- 172.21.15.82:0/1331603147 >> 172.21.15.82:0/1331603147 conn(0x7f471c08c0a0 msgr2=0x7f471c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- 172.21.15.82:0/1331603147 shutdown_connections 2023-07-20T11:05:24.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- 172.21.15.82:0/1331603147 wait complete. 2023-07-20T11:05:24.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 Processor -- start 2023-07-20T11:05:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- start start 2023-07-20T11:05:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06c120 0x7f471c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0b80a0 con 0x7f471c06ab10 2023-07-20T11:05:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0cf6a0 con 0x7f471c1602b0 2023-07-20T11:05:24.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f4722b2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0c5b60 con 0x7f471c06c120 2023-07-20T11:05:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57128/0 (socket says 172.21.15.82:57128) 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 -- 172.21.15.82:0/2414646281 learned_addr learned my addr 172.21.15.82:0/2414646281 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f471bfff640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06c120 0x7f471c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47210c9640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 -- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06c120 msgr2=0x7f471c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06c120 0x7f471c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 -- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 msgr2=0x7f471c0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c0c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.560+0000 7f47208c8640 1 -- 172.21.15.82:0/2414646281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009a70 con 0x7f471c06ab10 2023-07-20T11:05:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47208c8640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f471000c4d0 tx=0x7f471000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710005cf0 con 0x7f471c06ab10 2023-07-20T11:05:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710005e50 con 0x7f471c06ab10 2023-07-20T11:05:24.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100072d0 con 0x7f471c06ab10 2023-07-20T11:05:24.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4708009420 con 0x7f471c06ab10 2023-07-20T11:05:24.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c0cc310 con 0x7f471c06ab10 2023-07-20T11:05:24.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c04da30 con 0x7f471c06ab10 2023-07-20T11:05:24.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f4710007430 con 0x7f471c06ab10 2023-07-20T11:05:24.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 0x7f4700068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f4710083630 con 0x7f471c06ab10 2023-07-20T11:05:24.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f471bfff640 1 -- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 msgr2=0x7f4700068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:24.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.564+0000 7f471bfff640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 0x7f4700068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:24.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.568+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47100507e0 con 0x7f471c06ab10 2023-07-20T11:05:24.567 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.585+0000 7fb611b58180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:05:24.633 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:24.652+0000 7fec52c76180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:05:24.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.720+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f471c0cee40 con 0x7f471c06ab10 2023-07-20T11:05:24.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.720+0000 7f47197fa640 1 -- 172.21.15.82:0/2414646281 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4710053e00 con 0x7f471c06ab10 2023-07-20T11:05:24.701 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 msgr2=0x7f4700068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 0x7f4700068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 msgr2=0x7f471c0b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f471000c4d0 tx=0x7f471000c8d0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 shutdown_connections 2023-07-20T11:05:24.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f47000663a0 0x7f4700068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f471c1602b0 0x7f471c0c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f471c06c120 0x7f471c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 --2- 172.21.15.82:0/2414646281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f471c06ab10 0x7f471c0b54b0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 >> 172.21.15.82:0/2414646281 conn(0x7f471c08c0a0 msgr2=0x7f471c072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 shutdown_connections 2023-07-20T11:05:24.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.724+0000 7f4722b2c640 1 -- 172.21.15.82:0/2414646281 wait complete. 2023-07-20T11:05:24.720 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:24.740+0000 7fec52c76180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:05:24.723 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:05:24.835 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.853+0000 7fb611b58180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:05:24.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 Processor -- start 2023-07-20T11:05:24.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 -- start start 2023-07-20T11:05:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4c740cce60 0x7f4c740cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c740cfaa0 0x7f4c7415af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7415e4d0 con 0x7f4c7415dfd0 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7415aae0 con 0x7f4c740cfaa0 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c7b340640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c740ce8c0 con 0x7f4c740cce60 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c740cfaa0 0x7f4c7415af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c740cfaa0 0x7f4c7415af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57142/0 (socket says 172.21.15.82:57142) 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 -- 172.21.15.82:0/488914346 learned_addr learned my addr 172.21.15.82:0/488914346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:24.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c788db640 1 --1- 172.21.15.82:0/488914346 >> v1:172.21.15.82:6789/0 conn(0x7f4c7415dfd0 0x7f4c740ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57998/0 (socket says 172.21.15.82:57998) 2023-07-20T11:05:24.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c790dc640 1 --2- 172.21.15.82:0/488914346 >> v2:172.21.15.183:3300/0 conn(0x7f4c740cce60 0x7f4c740cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 -- 172.21.15.82:0/488914346 >> v2:172.21.15.183:3300/0 conn(0x7f4c740cce60 msgr2=0x7f4c740cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:24.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 --2- 172.21.15.82:0/488914346 >> v2:172.21.15.183:3300/0 conn(0x7f4c740cce60 0x7f4c740cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 -- 172.21.15.82:0/488914346 >> v1:172.21.15.82:6789/0 conn(0x7f4c7415dfd0 legacy=0x7f4c740ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c798dd640 1 -- 172.21.15.82:0/488914346 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7415e7b0 con 0x7f4c740cfaa0 2023-07-20T11:05:24.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.888+0000 7f4c6bfff640 1 -- 172.21.15.82:0/488914346 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618356383 0 0) 0x7f4c7415e4d0 con 0x7f4c7415dfd0 2023-07-20T11:05:24.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c798dd640 1 --2- 172.21.15.82:0/488914346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c740cfaa0 0x7f4c7415af30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f4c740b22a0 tx=0x7f4c6c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9b36541bac68f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c6bfff640 1 -- 172.21.15.82:0/488914346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0a5860 con 0x7f4c740cfaa0 2023-07-20T11:05:24.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c6bfff640 1 -- 172.21.15.82:0/488914346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0a59c0 con 0x7f4c740cfaa0 2023-07-20T11:05:24.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c6bfff640 1 -- 172.21.15.82:0/488914346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0a5d50 con 0x7f4c740cfaa0 2023-07-20T11:05:24.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 -- 172.21.15.82:0/488914346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c740cfaa0 msgr2=0x7f4c7415af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 --2- 172.21.15.82:0/488914346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c740cfaa0 0x7f4c7415af30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f4c740b22a0 tx=0x7f4c6c01c9a0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 -- 172.21.15.82:0/488914346 shutdown_connections 2023-07-20T11:05:24.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 --2- 172.21.15.82:0/488914346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c740cfaa0 0x7f4c7415af30 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 --2- 172.21.15.82:0/488914346 >> v2:172.21.15.183:3300/0 conn(0x7f4c740cce60 0x7f4c740cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 -- 172.21.15.82:0/488914346 >> 172.21.15.82:0/488914346 conn(0x7f4c74065310 msgr2=0x7f4c74065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:24.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 -- 172.21.15.82:0/488914346 shutdown_connections 2023-07-20T11:05:24.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.892+0000 7f4c7b340640 1 -- 172.21.15.82:0/488914346 wait complete. 2023-07-20T11:05:24.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 Processor -- start 2023-07-20T11:05:24.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 -- start start 2023-07-20T11:05:24.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 0x7f4c740c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c740cfaa0 0x7f4c740b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740ca940 con 0x7f4c7415dfd0 2023-07-20T11:05:24.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740c8650 con 0x7f4c740cfaa0 2023-07-20T11:05:24.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740c8930 con 0x7f4c740cce60 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57158/0 (socket says 172.21.15.82:57158) 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 -- 172.21.15.82:0/241022326 learned_addr learned my addr 172.21.15.82:0/241022326 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c788db640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c740cfaa0 0x7f4c740b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c790dc640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 0x7f4c740c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 -- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 msgr2=0x7f4c740c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 0x7f4c740c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 -- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c740cfaa0 msgr2=0x7f4c740b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c740cfaa0 0x7f4c740b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 -- 172.21.15.82:0/241022326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009b30 con 0x7f4c7415dfd0 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c790dc640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 0x7f4c740c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c798dd640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0195b0 tx=0x7f4c6c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0b8470 con 0x7f4c7415dfd0 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0b85d0 con 0x7f4c7415dfd0 2023-07-20T11:05:24.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c740c8c10 con 0x7f4c7415dfd0 2023-07-20T11:05:24.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.896+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0b8940 con 0x7f4c7415dfd0 2023-07-20T11:05:24.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c740c91d0 con 0x7f4c7415dfd0 2023-07-20T11:05:24.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c740c8a70 con 0x7f4c7415dfd0 2023-07-20T11:05:24.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f4c6c0b8aa0 con 0x7f4c7415dfd0 2023-07-20T11:05:24.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c69ffb640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 0x7f4c58068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:24.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c790dc640 1 -- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 msgr2=0x7f4c58068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2398472456 2023-07-20T11:05:24.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f4c6c11ef90 con 0x7f4c7415dfd0 2023-07-20T11:05:24.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.900+0000 7f4c790dc640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 0x7f4c58068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:24.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:24.904+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c740c8a70 con 0x7f4c7415dfd0 2023-07-20T11:05:24.896 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:24.913+0000 7fb611b58180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:05:25.025 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.044+0000 7fec52c76180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:05:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.076+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c740c8a70 con 0x7f4c7415dfd0 2023-07-20T11:05:25.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c69ffb640 1 -- 172.21.15.82:0/241022326 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c740c8a70 con 0x7f4c7415dfd0 2023-07-20T11:05:25.060 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 msgr2=0x7f4c58068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 0x7f4c58068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 msgr2=0x7f4c740b1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0195b0 tx=0x7f4c6c019740 comp rx=0 tx=0).stop 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 shutdown_connections 2023-07-20T11:05:25.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:6832/2398472456,v1:172.21.15.82:6833/2398472456] conn(0x7f4c580663a0 0x7f4c58068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c7415dfd0 0x7f4c740b1910 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c740cfaa0 0x7f4c740b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 --2- 172.21.15.82:0/241022326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c740cce60 0x7f4c740c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 >> 172.21.15.82:0/241022326 conn(0x7f4c74065310 msgr2=0x7f4c740b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 shutdown_connections 2023-07-20T11:05:25.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.080+0000 7f4c7b340640 1 -- 172.21.15.82:0/241022326 wait complete. 2023-07-20T11:05:25.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:05:25.090 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.108+0000 7fec52c76180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:05:25.170 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdf5bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.170 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdf5bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.170 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdf5bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.170 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdf5bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.170 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdf5bd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.171 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdbdb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.171 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdbdb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.171 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdbdb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.172 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdbdb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.172 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:25.188+0000 7febdbdb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.260+0000 7f47c972c640 1 Processor -- start 2023-07-20T11:05:25.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.260+0000 7f47c972c640 1 -- start start 2023-07-20T11:05:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c972c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 0x7f47c406adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c972c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47c40d25e0 0x7f47c40d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c972c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c40d0220 con 0x7f47c415c7c0 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c972c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c40d2fd0 con 0x7f47c40d25e0 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c972c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c40d0500 con 0x7f47c40cf0a0 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f47c415c7c0 0x7f47c40cd1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58004/0 (socket says 172.21.15.82:58004) 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c2ffd640 1 -- 172.21.15.82:0/3230406192 learned_addr learned my addr 172.21.15.82:0/3230406192 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:25.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c37fe640 1 --2- 172.21.15.82:0/3230406192 >> v2:172.21.15.82:3300/0 conn(0x7f47c40d25e0 0x7f47c40d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c27fc640 1 -- 172.21.15.82:0/3230406192 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 353312340 0 0) 0x7f47c40d0220 con 0x7f47c415c7c0 2023-07-20T11:05:25.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c27fc640 1 -- 172.21.15.82:0/3230406192 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b0003530 con 0x7f47c415c7c0 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c37fe640 1 -- 172.21.15.82:0/3230406192 >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 msgr2=0x7f47c406adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47ba7fc640 1 --2- 172.21.15.82:0/3230406192 >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 0x7f47c406adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c37fe640 1 --2- 172.21.15.82:0/3230406192 >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 0x7f47c406adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c37fe640 1 -- 172.21.15.82:0/3230406192 >> v1:172.21.15.82:6789/0 conn(0x7f47c415c7c0 legacy=0x7f47c40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47c37fe640 1 -- 172.21.15.82:0/3230406192 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c406b710 con 0x7f47c40d25e0 2023-07-20T11:05:25.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.264+0000 7f47ba7fc640 1 --2- 172.21.15.82:0/3230406192 >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 0x7f47c406adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c37fe640 1 --2- 172.21.15.82:0/3230406192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c40d2a90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f47c408c9f0 tx=0x7f47bc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282f09cbaf9e6f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c27fc640 1 -- 172.21.15.82:0/3230406192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a59a0 con 0x7f47c40d25e0 2023-07-20T11:05:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c27fc640 1 -- 172.21.15.82:0/3230406192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0a5b00 con 0x7f47c40d25e0 2023-07-20T11:05:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c27fc640 1 -- 172.21.15.82:0/3230406192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a5e70 con 0x7f47c40d25e0 2023-07-20T11:05:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- 172.21.15.82:0/3230406192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 msgr2=0x7f47c40d2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 --2- 172.21.15.82:0/3230406192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c40d2a90 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f47c408c9f0 tx=0x7f47bc01c8e0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- 172.21.15.82:0/3230406192 shutdown_connections 2023-07-20T11:05:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 --2- 172.21.15.82:0/3230406192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c40d2a90 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 --2- 172.21.15.82:0/3230406192 >> v2:172.21.15.183:3300/0 conn(0x7f47c40cf0a0 0x7f47c406adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- 172.21.15.82:0/3230406192 >> 172.21.15.82:0/3230406192 conn(0x7f47c408c0a0 msgr2=0x7f47c409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- 172.21.15.82:0/3230406192 shutdown_connections 2023-07-20T11:05:25.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- 172.21.15.82:0/3230406192 wait complete. 2023-07-20T11:05:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 Processor -- start 2023-07-20T11:05:25.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 -- start start 2023-07-20T11:05:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 0x7f47c4155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.268+0000 7f47c972c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 0x7f47c41538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41409a0 con 0x7f47c40d25e0 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41593d0 con 0x7f47c415c7c0 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40c5de0 con 0x7f47c40cf0a0 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57266/0 (socket says 172.21.15.82:57266) 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 -- 172.21.15.82:0/558720287 learned_addr learned my addr 172.21.15.82:0/558720287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 -- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 msgr2=0x7f47c4155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c2ffd640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 0x7f47c4155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c37fe640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 0x7f47c41538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 0x7f47c4155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 -- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 msgr2=0x7f47c41538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 0x7f47c41538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 -- 172.21.15.82:0/558720287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009a70 con 0x7f47c40d25e0 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c37fe640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 0x7f47c41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c2ffd640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 0x7f47c4155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47ba7fc640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c7f0 tx=0x7f47ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00cea0 con 0x7f47c40d25e0 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac007a30 con 0x7f47c40d25e0 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c413fd20 con 0x7f47c40d25e0 2023-07-20T11:05:25.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac007dc0 con 0x7f47c40d25e0 2023-07-20T11:05:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41402e0 con 0x7f47c40d25e0 2023-07-20T11:05:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.272+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c4140ae0 con 0x7f47c40d25e0 2023-07-20T11:05:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.276+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 80) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f47ac024480 con 0x7f47c40d25e0 2023-07-20T11:05:25.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.276+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f47ac083e80 con 0x7f47c40d25e0 2023-07-20T11:05:25.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.280+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47ac0514f0 con 0x7f47c40d25e0 2023-07-20T11:05:25.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47c4140ae0 con 0x7f47c40d25e0 2023-07-20T11:05:25.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47bbfff640 1 -- 172.21.15.82:0/558720287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47c4140ae0 con 0x7f47c40d25e0 2023-07-20T11:05:25.409 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:05:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 msgr2=0x7f47c41558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c7f0 tx=0x7f47ac00ccb0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 shutdown_connections 2023-07-20T11:05:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47c415c7c0 0x7f47c41538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47c40d25e0 0x7f47c41558d0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 --2- 172.21.15.82:0/558720287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47c40cf0a0 0x7f47c4155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 >> 172.21.15.82:0/558720287 conn(0x7f47c408c0a0 msgr2=0x7f47c40b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 shutdown_connections 2023-07-20T11:05:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.428+0000 7f47c972c640 1 -- 172.21.15.82:0/558720287 wait complete. 2023-07-20T11:05:25.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:05:25.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 Processor -- start 2023-07-20T11:05:25.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 -- start start 2023-07-20T11:05:25.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f74070970 0x7f5f74070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5f7406b620 0x7f5f7406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f740c95d0 con 0x7f5f74158ce0 2023-07-20T11:05:25.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7406bff0 con 0x7f5f7406b620 2023-07-20T11:05:25.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f78940640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f741590c0 con 0x7f5f74070970 2023-07-20T11:05:25.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f7259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f74158ce0 0x7f5f740c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58012/0 (socket says 172.21.15.82:58012) 2023-07-20T11:05:25.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f7259c640 1 -- 172.21.15.82:0/1777601589 learned_addr learned my addr 172.21.15.82:0/1777601589 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:25.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f72d9d640 1 --2- 172.21.15.82:0/1777601589 >> v2:172.21.15.82:3300/0 conn(0x7f5f7406b620 0x7f5f7406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f6bfff640 1 --2- 172.21.15.82:0/1777601589 >> v2:172.21.15.183:3300/0 conn(0x7f5f74070970 0x7f5f74070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f72d9d640 1 -- 172.21.15.82:0/1777601589 >> v2:172.21.15.183:3300/0 conn(0x7f5f74070970 msgr2=0x7f5f74070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:25.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f72d9d640 1 --2- 172.21.15.82:0/1777601589 >> v2:172.21.15.183:3300/0 conn(0x7f5f74070970 0x7f5f74070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f72d9d640 1 -- 172.21.15.82:0/1777601589 >> v1:172.21.15.82:6789/0 conn(0x7f5f74158ce0 legacy=0x7f5f740c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f72d9d640 1 -- 172.21.15.82:0/1777601589 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740c89c0 con 0x7f5f7406b620 2023-07-20T11:05:25.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.632+0000 7f5f71d9b640 1 -- 172.21.15.82:0/1777601589 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622701962 0 0) 0x7f5f740c95d0 con 0x7f5f74158ce0 2023-07-20T11:05:25.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f72d9d640 1 --2- 172.21.15.82:0/1777601589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7406b620 0x7f5f7406bab0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ca5f0 tx=0x7f5f6c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d97d07e3d956d43 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f71d9b640 1 -- 172.21.15.82:0/1777601589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0a5730 con 0x7f5f7406b620 2023-07-20T11:05:25.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f71d9b640 1 -- 172.21.15.82:0/1777601589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c0a5890 con 0x7f5f7406b620 2023-07-20T11:05:25.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f71d9b640 1 -- 172.21.15.82:0/1777601589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0a5c20 con 0x7f5f7406b620 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 -- 172.21.15.82:0/1777601589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7406b620 msgr2=0x7f5f7406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 --2- 172.21.15.82:0/1777601589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7406b620 0x7f5f7406bab0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f5f740ca5f0 tx=0x7f5f6c01c910 comp rx=0 tx=0).stop 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 -- 172.21.15.82:0/1777601589 shutdown_connections 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 --2- 172.21.15.82:0/1777601589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7406b620 0x7f5f7406bab0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 --2- 172.21.15.82:0/1777601589 >> v2:172.21.15.183:3300/0 conn(0x7f5f74070970 0x7f5f74070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 -- 172.21.15.82:0/1777601589 >> 172.21.15.82:0/1777601589 conn(0x7f5f740cad50 msgr2=0x7f5f740cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 -- 172.21.15.82:0/1777601589 shutdown_connections 2023-07-20T11:05:25.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.636+0000 7f5f78940640 1 -- 172.21.15.82:0/1777601589 wait complete. 2023-07-20T11:05:25.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 Processor -- start 2023-07-20T11:05:25.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- start start 2023-07-20T11:05:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7406b620 0x7f5f741457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f74158ce0 0x7f5f7414a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740c5e00 con 0x7f5f74070970 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74148930 con 0x7f5f74158ce0 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74148cf0 con 0x7f5f7406b620 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57292/0 (socket says 172.21.15.82:57292) 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 -- 172.21.15.82:0/2413625746 learned_addr learned my addr 172.21.15.82:0/2413625746 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f72d9d640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f74158ce0 0x7f5f7414a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f7259c640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7406b620 0x7f5f741457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 -- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7406b620 msgr2=0x7f5f741457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7406b620 0x7f5f741457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 -- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f74158ce0 msgr2=0x7f5f7414a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f74158ce0 0x7f5f7414a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 -- 172.21.15.82:0/2413625746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009a70 con 0x7f5f74070970 2023-07-20T11:05:25.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6bfff640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e930 tx=0x7f5f5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c009690 con 0x7f5f74070970 2023-07-20T11:05:25.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00ca00 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00cd70 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f740c54d0 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740c5a90 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.640+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f740c9240 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.644+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 80) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5f5c013470 con 0x7f5f74070970 2023-07-20T11:05:25.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.644+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f5f5c083d20 con 0x7f5f74070970 2023-07-20T11:05:25.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.648+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f740c9240 con 0x7f5f74070970 2023-07-20T11:05:25.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.792+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f740c9240 con 0x7f5f74070970 2023-07-20T11:05:25.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.792+0000 7f5f6affd640 1 -- 172.21.15.82:0/2413625746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f740c9240 con 0x7f5f74070970 2023-07-20T11:05:25.774 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:05:25.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 msgr2=0x7f5f7414a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e930 tx=0x7f5f5c00edf0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 shutdown_connections 2023-07-20T11:05:25.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f74158ce0 0x7f5f7414a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f74070970 0x7f5f7414a0d0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 --2- 172.21.15.82:0/2413625746 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f7406b620 0x7f5f741457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 >> 172.21.15.82:0/2413625746 conn(0x7f5f740cad50 msgr2=0x7f5f74151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 shutdown_connections 2023-07-20T11:05:25.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.796+0000 7f5f78940640 1 -- 172.21.15.82:0/2413625746 wait complete. 2023-07-20T11:05:25.794 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 Processor -- start 2023-07-20T11:05:25.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 -- start start 2023-07-20T11:05:25.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdc040ca6b0 0x7fdc040b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040b06c0 con 0x7fdc040afda0 2023-07-20T11:05:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040b12a0 con 0x7fdc0415a8e0 2023-07-20T11:05:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc0a427640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc040b3160 con 0x7fdc040ca6b0 2023-07-20T11:05:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc03fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdc040afda0 0x7fdc040b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58016/0 (socket says 172.21.15.82:58016) 2023-07-20T11:05:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.952+0000 7fdc03fff640 1 -- 172.21.15.82:0/1143476076 learned_addr learned my addr 172.21.15.82:0/1143476076 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc089c4640 1 --2- 172.21.15.82:0/1143476076 >> v2:172.21.15.183:3300/0 conn(0x7fdc040ca6b0 0x7fdc040b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586884285 0 0) 0x7fdc040b06c0 con 0x7fdc040afda0 2023-07-20T11:05:25.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbec003530 con 0x7fdc040afda0 2023-07-20T11:05:25.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc089c4640 1 -- 172.21.15.82:0/1143476076 >> v1:172.21.15.183:6789/0 conn(0x7fdc0415a8e0 legacy=0x7fdc040b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997835325 0 0) 0x7fdc040b12a0 con 0x7fdc0415a8e0 2023-07-20T11:05:25.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc089c4640 1 -- 172.21.15.82:0/1143476076 >> v1:172.21.15.82:6789/0 conn(0x7fdc040afda0 legacy=0x7fdc040b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc089c4640 1 -- 172.21.15.82:0/1143476076 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040b1580 con 0x7fdc040ca6b0 2023-07-20T11:05:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc089c4640 1 --2- 172.21.15.82:0/1143476076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040ca6b0 0x7fdc040b0180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009d90 tx=0x7fdbfc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2745016c29ad58cc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0a5980 con 0x7fdc040ca6b0 2023-07-20T11:05:25.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc0a5ae0 con 0x7fdc040ca6b0 2023-07-20T11:05:25.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.956+0000 7fdc02ffd640 1 -- 172.21.15.82:0/1143476076 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0a5e70 con 0x7fdc040ca6b0 2023-07-20T11:05:25.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- 172.21.15.82:0/1143476076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040ca6b0 msgr2=0x7fdc040b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 --2- 172.21.15.82:0/1143476076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040ca6b0 0x7fdc040b0180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009d90 tx=0x7fdbfc01c8c0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- 172.21.15.82:0/1143476076 shutdown_connections 2023-07-20T11:05:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 --2- 172.21.15.82:0/1143476076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040ca6b0 0x7fdc040b0180 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- 172.21.15.82:0/1143476076 >> 172.21.15.82:0/1143476076 conn(0x7fdc040cada0 msgr2=0x7fdc040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- 172.21.15.82:0/1143476076 shutdown_connections 2023-07-20T11:05:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- 172.21.15.82:0/1143476076 wait complete. 2023-07-20T11:05:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 Processor -- start 2023-07-20T11:05:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- start start 2023-07-20T11:05:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 0x7fdc04153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc0415a8e0 0x7fdc040aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040cd440 con 0x7fdc040ca6b0 2023-07-20T11:05:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0414c1f0 con 0x7fdc040afda0 2023-07-20T11:05:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc0a427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040cd860 con 0x7fdc0415a8e0 2023-07-20T11:05:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57302/0 (socket says 172.21.15.82:57302) 2023-07-20T11:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 -- 172.21.15.82:0/2683963279 learned_addr learned my addr 172.21.15.82:0/2683963279 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc089c4640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc0415a8e0 0x7fdc040aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc03fff640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 0x7fdc04153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 -- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc0415a8e0 msgr2=0x7fdc040aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc0415a8e0 0x7fdc040aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 -- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 msgr2=0x7fdc04153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 0x7fdc04153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc037fe640 1 -- 172.21.15.82:0/2683963279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc009a70 con 0x7fdc040ca6b0 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.960+0000 7fdc03fff640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 0x7fdc04153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:25.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc037fe640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c3f0 tx=0x7fdbf800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80054e0 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf8003600 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc040cc7c0 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8003990 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc040ccd80 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc04073c70 con 0x7fdc040ca6b0 2023-07-20T11:05:25.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 80) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdbf8003af0 con 0x7fdc040ca6b0 2023-07-20T11:05:25.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.964+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fdbf80831c0 con 0x7fdc040ca6b0 2023-07-20T11:05:25.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:25.968+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbf80506a0 con 0x7fdc040ca6b0 2023-07-20T11:05:26.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.136+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fdbf8050150 con 0x7fdc040ca6b0 2023-07-20T11:05:26.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.136+0000 7fdc00ff9640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 0x7fdbf006e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.140+0000 7fdc03fff640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 0x7fdbf006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.144+0000 7fdc03fff640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 0x7fdbf006e520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4005890 tx=0x7fdbf4009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc04072e00 con 0x7fdc040ca6b0 2023-07-20T11:05:26.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc00ff9640 1 -- 172.21.15.82:0/2683963279 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fdbf806d0a0 con 0x7fdc040ca6b0 2023-07-20T11:05:26.141 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:26.141 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T11:05:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T11:05:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 msgr2=0x7fdbf006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 0x7fdbf006e520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4005890 tx=0x7fdbf4009040 comp rx=0 tx=0).stop 2023-07-20T11:05:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 msgr2=0x7fdc0414bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c3f0 tx=0x7fdbf800c8b0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 shutdown_connections 2023-07-20T11:05:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdbf006c130 0x7fdbf006e520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdc0415a8e0 0x7fdc040aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc040ca6b0 0x7fdc0414bcb0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 --2- 172.21.15.82:0/2683963279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdc040afda0 0x7fdc04153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 >> 172.21.15.82:0/2683963279 conn(0x7fdc040cada0 msgr2=0x7fdc0406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 shutdown_connections 2023-07-20T11:05:26.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.160+0000 7fdc0a427640 1 -- 172.21.15.82:0/2683963279 wait complete. 2023-07-20T11:05:26.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:26.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 Processor -- start 2023-07-20T11:05:26.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 -- start start 2023-07-20T11:05:26.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fec000d0d00 0x7fec000cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec000cf880 con 0x7fec000cd730 2023-07-20T11:05:26.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec000cd2a0 con 0x7fec0015c590 2023-07-20T11:05:26.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7fec05448640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000b4f50 con 0x7fec000d0d00 2023-07-20T11:05:26.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7febff7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fec000cd730 0x7fec000ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58018/0 (socket says 172.21.15.82:58018) 2023-07-20T11:05:26.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7febff7fe640 1 -- 172.21.15.82:0/40935198 learned_addr learned my addr 172.21.15.82:0/40935198 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:26.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7febf7fff640 1 --2- 172.21.15.82:0/40935198 >> v2:172.21.15.183:3300/0 conn(0x7fec000d0d00 0x7fec000cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.324+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779138967 0 0) 0x7fec000cf880 con 0x7fec000cd730 2023-07-20T11:05:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febec003530 con 0x7fec000cd730 2023-07-20T11:05:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febf7fff640 1 -- 172.21.15.82:0/40935198 >> v1:172.21.15.183:6789/0 conn(0x7fec0015c590 legacy=0x7fec000b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633695554 0 0) 0x7fec000cd2a0 con 0x7fec0015c590 2023-07-20T11:05:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febf7fff640 1 -- 172.21.15.82:0/40935198 >> v1:172.21.15.82:6789/0 conn(0x7fec000cd730 legacy=0x7fec000ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febf7fff640 1 -- 172.21.15.82:0/40935198 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000cfab0 con 0x7fec000d0d00 2023-07-20T11:05:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febf7fff640 1 --2- 172.21.15.82:0/40935198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec000cf340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7febe80097c0 tx=0x7febe801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d22b6c70f9306d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80ab650 con 0x7fec000d0d00 2023-07-20T11:05:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe80ab7b0 con 0x7fec000d0d00 2023-07-20T11:05:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7febfe7fc640 1 -- 172.21.15.82:0/40935198 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80abb40 con 0x7fec000d0d00 2023-07-20T11:05:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7fec05448640 1 -- 172.21.15.82:0/40935198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 msgr2=0x7fec000cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.328+0000 7fec05448640 1 --2- 172.21.15.82:0/40935198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec000cf340 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7febe80097c0 tx=0x7febe801c450 comp rx=0 tx=0).stop 2023-07-20T11:05:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- 172.21.15.82:0/40935198 shutdown_connections 2023-07-20T11:05:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 --2- 172.21.15.82:0/40935198 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec000cf340 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- 172.21.15.82:0/40935198 >> 172.21.15.82:0/40935198 conn(0x7fec000654e0 msgr2=0x7fec000658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- 172.21.15.82:0/40935198 shutdown_connections 2023-07-20T11:05:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- 172.21.15.82:0/40935198 wait complete. 2023-07-20T11:05:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 Processor -- start 2023-07-20T11:05:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- start start 2023-07-20T11:05:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec000cd730 0x7fec001544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec001553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0013d5a0 con 0x7fec0015c590 2023-07-20T11:05:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec00154a20 con 0x7fec000d0d00 2023-07-20T11:05:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7fec05448640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0013d7f0 con 0x7fec000cd730 2023-07-20T11:05:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57316/0 (socket says 172.21.15.82:57316) 2023-07-20T11:05:26.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 -- 172.21.15.82:0/4118560668 learned_addr learned my addr 172.21.15.82:0/4118560668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:26.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febf7fff640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec001553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febfeffd640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec000cd730 0x7fec001544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 -- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec000cd730 msgr2=0x7fec001544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec000cd730 0x7fec001544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 -- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 msgr2=0x7fec001553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec001553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 -- 172.21.15.82:0/4118560668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8009420 con 0x7fec0015c590 2023-07-20T11:05:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febf7fff640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec001553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febff7fe640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7febf800cb40 tx=0x7febf800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.332+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf800aca0 con 0x7fec0015c590 2023-07-20T11:05:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf800ae00 con 0x7fec0015c590 2023-07-20T11:05:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8012620 con 0x7fec0015c590 2023-07-20T11:05:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0013dad0 con 0x7fec0015c590 2023-07-20T11:05:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0013e090 con 0x7fec0015c590 2023-07-20T11:05:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0013e280 con 0x7fec0015c590 2023-07-20T11:05:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7febf8007070 con 0x7fec0015c590 2023-07-20T11:05:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febf77fe640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 0x7febe0068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6866+0+0 (secure 0 0 0) 0x7febf8083cf0 con 0x7fec0015c590 2023-07-20T11:05:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febfeffd640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 0x7febe0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.336+0000 7febfeffd640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 0x7febe0068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febf0000f70 tx=0x7febf0009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.340+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febf8051180 con 0x7fec0015c590 2023-07-20T11:05:26.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.492+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec0004da30 con 0x7fec0015c590 2023-07-20T11:05:26.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7febf77fe640 1 -- 172.21.15.82:0/4118560668 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+19548 (secure 0 0 0) 0x7febf8017090 con 0x7fec0015c590 2023-07-20T11:05:26.475 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:26.476 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":146,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:26.122995+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4231089151":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/3221618049":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/96402490":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6833/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4062347335":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4125546988":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/3897637817":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1206262133":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1313050434":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/4117276803":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/1761844848":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6833/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/2211374485":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1145221661":"2023-07-21T10:09:40.802557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:26.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 msgr2=0x7febe0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 0x7febe0068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7febf0000f70 tx=0x7febf0009040 comp rx=0 tx=0).stop 2023-07-20T11:05:26.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 msgr2=0x7fec00155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7febf800cb40 tx=0x7febf800a060 comp rx=0 tx=0).stop 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 shutdown_connections 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7febe00660d0 0x7febe0068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec0015c590 0x7fec00155920 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec000d0d00 0x7fec001553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 --2- 172.21.15.82:0/4118560668 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fec000cd730 0x7fec001544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 >> 172.21.15.82:0/4118560668 conn(0x7fec000654e0 msgr2=0x7fec000b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 shutdown_connections 2023-07-20T11:05:26.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.496+0000 7fec05448640 1 -- 172.21.15.82:0/4118560668 wait complete. 2023-07-20T11:05:26.496 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:05:26.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:26.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 Processor -- start 2023-07-20T11:05:26.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 -- start start 2023-07-20T11:05:26.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f848015cab0 0x7f84800d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800d0d10 0x7f84800d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f84800cf110 0x7f84800cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800d31c0 con 0x7f848015cab0 2023-07-20T11:05:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800d16b0 con 0x7f84800cf110 2023-07-20T11:05:26.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84853ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800b3520 con 0x7f84800d0d10 2023-07-20T11:05:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f848015cab0 0x7f84800d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f848015cab0 0x7f84800d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57318/0 (socket says 172.21.15.82:57318) 2023-07-20T11:05:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 -- 172.21.15.82:0/1276587787 learned_addr learned my addr 172.21.15.82:0/1276587787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f84767fc640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800d0d10 0x7f84800d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847f7fe640 1 --2- 172.21.15.82:0/1276587787 >> v2:172.21.15.183:3300/0 conn(0x7f84800cf110 0x7f84800cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 -- 172.21.15.82:0/1276587787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800d0d10 msgr2=0x7f84800d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800d0d10 0x7f84800d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 -- 172.21.15.82:0/1276587787 >> v2:172.21.15.183:3300/0 conn(0x7f84800cf110 msgr2=0x7f84800cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 --2- 172.21.15.82:0/1276587787 >> v2:172.21.15.183:3300/0 conn(0x7f84800cf110 0x7f84800cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.656+0000 7f847effd640 1 -- 172.21.15.82:0/1276587787 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800b2910 con 0x7f848015cab0 2023-07-20T11:05:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f847effd640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f84800d0300 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f848008bb70 tx=0x7f847001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ac36d72fdd03f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f847e7fc640 1 -- 172.21.15.82:0/1276587787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700a5820 con 0x7f848015cab0 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f847e7fc640 1 -- 172.21.15.82:0/1276587787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84700a5980 con 0x7f848015cab0 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f847e7fc640 1 -- 172.21.15.82:0/1276587787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84700a5d10 con 0x7f848015cab0 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 -- 172.21.15.82:0/1276587787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 msgr2=0x7f84800d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f84800d0300 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f848008bb70 tx=0x7f847001c9a0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 -- 172.21.15.82:0/1276587787 shutdown_connections 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 --2- 172.21.15.82:0/1276587787 >> v2:172.21.15.183:3300/0 conn(0x7f84800cf110 0x7f84800cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800d0d10 0x7f84800d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 --2- 172.21.15.82:0/1276587787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f84800d0300 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 -- 172.21.15.82:0/1276587787 >> 172.21.15.82:0/1276587787 conn(0x7f848008c120 msgr2=0x7f848009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 -- 172.21.15.82:0/1276587787 shutdown_connections 2023-07-20T11:05:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.660+0000 7f84853ba640 1 -- 172.21.15.82:0/1276587787 wait complete. 2023-07-20T11:05:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 Processor -- start 2023-07-20T11:05:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- start start 2023-07-20T11:05:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800cf110 0x7f848015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84800d0d10 0x7f8480155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800b6420 con 0x7f848015cab0 2023-07-20T11:05:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848015d780 con 0x7f84800d0d10 2023-07-20T11:05:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848015da60 con 0x7f84800cf110 2023-07-20T11:05:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57322/0 (socket says 172.21.15.82:57322) 2023-07-20T11:05:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 -- 172.21.15.82:0/1857002235 learned_addr learned my addr 172.21.15.82:0/1857002235 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84767fc640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84800d0d10 0x7f8480155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847effd640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800cf110 0x7f848015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 -- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800cf110 msgr2=0x7f848015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800cf110 0x7f848015cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 -- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84800d0d10 msgr2=0x7f8480155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84800d0d10 0x7f8480155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 -- 172.21.15.82:0/1857002235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470009b30 con 0x7f848015cab0 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f847f7fe640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f847800e7f0 tx=0x7f847800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780094b0 con 0x7f848015cab0 2023-07-20T11:05:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847800c730 con 0x7f848015cab0 2023-07-20T11:05:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848015dd40 con 0x7f848015cab0 2023-07-20T11:05:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800cac0 con 0x7f848015cab0 2023-07-20T11:05:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.664+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848015d470 con 0x7f848015cab0 2023-07-20T11:05:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84800b6590 con 0x7f848015cab0 2023-07-20T11:05:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f847800cc20 con 0x7f848015cab0 2023-07-20T11:05:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f8477fff640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 0x7f8460068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f8478083d40 con 0x7f848015cab0 2023-07-20T11:05:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f847effd640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 0x7f8460068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.668+0000 7f847effd640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 0x7f8460068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84700ae000 tx=0x7f84700a7070 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.672+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84780511b0 con 0x7f848015cab0 2023-07-20T11:05:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.848+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8480073c70 con 0x7f848015cab0 2023-07-20T11:05:26.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f8477fff640 1 -- 172.21.15.82:0/1857002235 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f84780547d0 con 0x7f848015cab0 2023-07-20T11:05:26.832 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:26.832 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T11:05:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T11:05:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 msgr2=0x7f8460068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 0x7f8460068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f84700ae000 tx=0x7f84700a7070 comp rx=0 tx=0).stop 2023-07-20T11:05:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 msgr2=0x7f848015ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f847800e7f0 tx=0x7f847800ecb0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 shutdown_connections 2023-07-20T11:05:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f84600660d0 0x7f8460068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848015cab0 0x7f848015ae20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f84800d0d10 0x7f8480155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 --2- 172.21.15.82:0/1857002235 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f84800cf110 0x7f848015cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 >> 172.21.15.82:0/1857002235 conn(0x7f848008c120 msgr2=0x7f84800cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 shutdown_connections 2023-07-20T11:05:26.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:26.852+0000 7f84853ba640 1 -- 172.21.15.82:0/1857002235 wait complete. 2023-07-20T11:05:26.852 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:26.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 Processor -- start 2023-07-20T11:05:26.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 -- start start 2023-07-20T11:05:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 0x7f19bc06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19bc160fa0 0x7f19bc0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc0cc560 con 0x7f19bc06c700 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0ad7e0 con 0x7f19bc160fa0 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c3b74640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0cc790 con 0x7f19bc160bc0 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c110f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19bc160fa0 0x7f19bc0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c110f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f19bc160fa0 0x7f19bc0c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57332/0 (socket says 172.21.15.82:57332) 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c110f640 1 -- 172.21.15.82:0/2633105961 learned_addr learned my addr 172.21.15.82:0/2633105961 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:26.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.012+0000 7f19c1910640 1 --2- 172.21.15.82:0/2633105961 >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 0x7f19bc06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c110f640 1 -- 172.21.15.82:0/2633105961 >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 msgr2=0x7f19bc06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c110f640 1 --2- 172.21.15.82:0/2633105961 >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 0x7f19bc06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c110f640 1 -- 172.21.15.82:0/2633105961 >> v1:172.21.15.183:6789/0 conn(0x7f19bc06c700 legacy=0x7f19bc0aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c110f640 1 -- 172.21.15.82:0/2633105961 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc0cca70 con 0x7f19bc160fa0 2023-07-20T11:05:26.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c1910640 1 --2- 172.21.15.82:0/2633105961 >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 0x7f19bc06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:26.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c110f640 1 --2- 172.21.15.82:0/2633105961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc0c12f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0cf420 tx=0x7f19ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ae08e39adcb0e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:26.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c090e640 1 -- 172.21.15.82:0/2633105961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0aa430 con 0x7f19bc160fa0 2023-07-20T11:05:26.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c090e640 1 -- 172.21.15.82:0/2633105961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0aa590 con 0x7f19bc160fa0 2023-07-20T11:05:26.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c090e640 1 -- 172.21.15.82:0/2633105961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0aa920 con 0x7f19bc160fa0 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 -- 172.21.15.82:0/2633105961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 msgr2=0x7f19bc0c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 --2- 172.21.15.82:0/2633105961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc0c12f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0cf420 tx=0x7f19ac01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 -- 172.21.15.82:0/2633105961 shutdown_connections 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 --2- 172.21.15.82:0/2633105961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc0c12f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 --2- 172.21.15.82:0/2633105961 >> v2:172.21.15.183:3300/0 conn(0x7f19bc160bc0 0x7f19bc06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.016+0000 7f19c3b74640 1 -- 172.21.15.82:0/2633105961 >> 172.21.15.82:0/2633105961 conn(0x7f19bc0cada0 msgr2=0x7f19bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:26.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- 172.21.15.82:0/2633105961 shutdown_connections 2023-07-20T11:05:27.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- 172.21.15.82:0/2633105961 wait complete. 2023-07-20T11:05:27.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 Processor -- start 2023-07-20T11:05:27.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- start start 2023-07-20T11:05:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc06c700 0x7f19bc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc160bc0 0x7f19bc151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc06fed0 con 0x7f19bc160fa0 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0b0b20 con 0x7f19bc06c700 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc070120 con 0x7f19bc160bc0 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57348/0 (socket says 172.21.15.82:57348) 2023-07-20T11:05:27.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 -- 172.21.15.82:0/1649807812 learned_addr learned my addr 172.21.15.82:0/1649807812 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c1910640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc06c700 0x7f19bc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c110f640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc160bc0 0x7f19bc151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 -- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc160bc0 msgr2=0x7f19bc151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc160bc0 0x7f19bc151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 -- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc06c700 msgr2=0x7f19bc0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc06c700 0x7f19bc0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 -- 172.21.15.82:0/1649807812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0094d0 con 0x7f19bc160fa0 2023-07-20T11:05:27.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c2111640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c430 tx=0x7f19b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4005220 con 0x7f19bc160fa0 2023-07-20T11:05:27.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4005380 con 0x7f19bc160fa0 2023-07-20T11:05:27.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4007270 con 0x7f19bc160fa0 2023-07-20T11:05:27.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.020+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc070400 con 0x7f19bc160fa0 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc152150 con 0x7f19bc160fa0 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc073c70 con 0x7f19bc160fa0 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f19b40073d0 con 0x7f19bc160fa0 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19b27fc640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 0x7f19a0068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f19b40831d0 con 0x7f19bc160fa0 2023-07-20T11:05:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19c1910640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 0x7f19a0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.024+0000 7f19c1910640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 0x7f19a0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0718e0 tx=0x7f19b8009910 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.028+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19b4050640 con 0x7f19bc160fa0 2023-07-20T11:05:27.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.224+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19bc15e050 con 0x7f19bc160fa0 2023-07-20T11:05:27.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19b27fc640 1 -- 172.21.15.82:0/1649807812 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f19b4053c60 con 0x7f19bc160fa0 2023-07-20T11:05:27.208 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:27.208 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T10:09:23.567798+0000","modified":"2023-07-20T10:09:27.209730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8997},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8997":{"gid":8997,"name":"c","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2741581419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2741581419},{"type":"v1","addr":"172.21.15.82:6837","nonce":2741581419}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-20T11:05:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 66 2023-07-20T11:05:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 msgr2=0x7f19a0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 0x7f19a0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0718e0 tx=0x7f19b8009910 comp rx=0 tx=0).stop 2023-07-20T11:05:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 msgr2=0x7f19bc153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f19b400c430 tx=0x7f19b400c8f0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 shutdown_connections 2023-07-20T11:05:27.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f19a00660d0 0x7f19a0068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19bc160fa0 0x7f19bc153670 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f19bc160bc0 0x7f19bc151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 --2- 172.21.15.82:0/1649807812 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19bc06c700 0x7f19bc0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 >> 172.21.15.82:0/1649807812 conn(0x7f19bc0cada0 msgr2=0x7f19bc0ac570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 shutdown_connections 2023-07-20T11:05:27.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.228+0000 7f19c3b74640 1 -- 172.21.15.82:0/1649807812 wait complete. 2023-07-20T11:05:27.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 Processor -- start 2023-07-20T11:05:27.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 -- start start 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43c015cab0 0x7f43c00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00b3520 con 0x7f43c00d0d10 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00cff30 con 0x7f43c00ce4c0 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43c66ca640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00d31c0 con 0x7f43c015cab0 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43c015cab0 0x7f43c00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43c015cab0 0x7f43c00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57378/0 (socket says 172.21.15.82:57378) 2023-07-20T11:05:27.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 -- 172.21.15.82:0/3309356032 learned_addr learned my addr 172.21.15.82:0/3309356032 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:27.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 -- 172.21.15.82:0/3309356032 >> v1:172.21.15.183:6789/0 conn(0x7f43c00ce4c0 legacy=0x7f43c00cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:27.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 -- 172.21.15.82:0/3309356032 >> v1:172.21.15.82:6789/0 conn(0x7f43c00d0d10 legacy=0x7f43c00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.388+0000 7f43bffff640 1 -- 172.21.15.82:0/3309356032 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00b2910 con 0x7f43c015cab0 2023-07-20T11:05:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43bffff640 1 --2- 172.21.15.82:0/3309356032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c00d0300 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009870 tx=0x7f43b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3362de4873e460 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43beffd640 1 -- 172.21.15.82:0/3309356032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00aa430 con 0x7f43c015cab0 2023-07-20T11:05:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43beffd640 1 -- 172.21.15.82:0/3309356032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00aa590 con 0x7f43c015cab0 2023-07-20T11:05:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43beffd640 1 -- 172.21.15.82:0/3309356032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00aa920 con 0x7f43c015cab0 2023-07-20T11:05:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 -- 172.21.15.82:0/3309356032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 msgr2=0x7f43c00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 --2- 172.21.15.82:0/3309356032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c00d0300 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009870 tx=0x7f43b001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 -- 172.21.15.82:0/3309356032 shutdown_connections 2023-07-20T11:05:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 --2- 172.21.15.82:0/3309356032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c00d0300 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 -- 172.21.15.82:0/3309356032 >> 172.21.15.82:0/3309356032 conn(0x7f43c008c120 msgr2=0x7f43c009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 -- 172.21.15.82:0/3309356032 shutdown_connections 2023-07-20T11:05:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.392+0000 7f43c66ca640 1 -- 172.21.15.82:0/3309356032 wait complete. 2023-07-20T11:05:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 Processor -- start 2023-07-20T11:05:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- start start 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43c00ce4c0 0x7f43c014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c00d0d10 0x7f43c006af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00cbc70 con 0x7f43c015cab0 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00caff0 con 0x7f43c00d0d10 2023-07-20T11:05:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00cb2d0 con 0x7f43c00ce4c0 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57380/0 (socket says 172.21.15.82:57380) 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 -- 172.21.15.82:0/1182449008 learned_addr learned my addr 172.21.15.82:0/1182449008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43bffff640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43c00ce4c0 0x7f43c014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43bf7fe640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c00d0d10 0x7f43c006af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 -- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43c00ce4c0 msgr2=0x7f43c014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43c00ce4c0 0x7f43c014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 -- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c00d0d10 msgr2=0x7f43c006af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c00d0d10 0x7f43c006af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 -- 172.21.15.82:0/1182449008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00094d0 con 0x7f43c015cab0 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c4c67640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f43b800b9e0 tx=0x7f43b800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8003b80 con 0x7f43c015cab0 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8003ce0 con 0x7f43c015cab0 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c00cb5b0 con 0x7f43c015cab0 2023-07-20T11:05:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800cb60 con 0x7f43c015cab0 2023-07-20T11:05:27.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c014e330 con 0x7f43c015cab0 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.396+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c0073c70 con 0x7f43c015cab0 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.400+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f43b800ccc0 con 0x7f43c015cab0 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.400+0000 7f43bcff9640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 0x7f43ac068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.400+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f43b80839e0 con 0x7f43c015cab0 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.400+0000 7f43bffff640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 0x7f43ac068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.400+0000 7f43bffff640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 0x7f43ac068590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ae000 tx=0x7f43b00b5040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.404+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43b8050e50 con 0x7f43c015cab0 2023-07-20T11:05:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.552+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c0069750 con 0x7f43c015cab0 2023-07-20T11:05:27.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.552+0000 7f43bcff9640 1 -- 172.21.15.82:0/1182449008 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+19548 (secure 0 0 0) 0x7f43b8054470 con 0x7f43c015cab0 2023-07-20T11:05:27.535 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:27.535 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":146,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:26.122995+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-20T10:09:21.268928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-20T10:09:22.560604+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4231089151":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/3221618049":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/96402490":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6833/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4062347335":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4125546988":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/3897637817":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1206262133":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1313050434":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/4117276803":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/1761844848":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6833/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/2211374485":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1145221661":"2023-07-21T10:09:40.802557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 msgr2=0x7f43ac068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 0x7f43ac068590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43b00ae000 tx=0x7f43b00b5040 comp rx=0 tx=0).stop 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 msgr2=0x7f43c006b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f43b800b9e0 tx=0x7f43b800bea0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 shutdown_connections 2023-07-20T11:05:27.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43ac0660d0 0x7f43ac068590 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43c015cab0 0x7f43c006b460 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c00d0d10 0x7f43c006af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 --2- 172.21.15.82:0/1182449008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43c00ce4c0 0x7f43c014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 >> 172.21.15.82:0/1182449008 conn(0x7f43c008c120 msgr2=0x7f43c0157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 shutdown_connections 2023-07-20T11:05:27.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.556+0000 7f43c66ca640 1 -- 172.21.15.82:0/1182449008 wait complete. 2023-07-20T11:05:27.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T11:05:27.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 Processor -- start 2023-07-20T11:05:27.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 -- start start 2023-07-20T11:05:27.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977006be30 0x7f97700715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f977006c8b0 0x7f9770159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977015e130 con 0x7f97700b3860 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977015e410 con 0x7f977006be30 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f977600b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977015e6f0 con 0x7f977006c8b0 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977006be30 0x7f97700715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977006be30 0x7f97700715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57396/0 (socket says 172.21.15.82:57396) 2023-07-20T11:05:27.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 -- 172.21.15.82:0/1211907964 learned_addr learned my addr 172.21.15.82:0/1211907964 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:27.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 -- 172.21.15.82:0/1211907964 >> v2:172.21.15.183:3300/0 conn(0x7f977006c8b0 msgr2=0x7f9770159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:27.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 --2- 172.21.15.82:0/1211907964 >> v2:172.21.15.183:3300/0 conn(0x7f977006c8b0 0x7f9770159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 -- 172.21.15.82:0/1211907964 >> v1:172.21.15.183:6789/0 conn(0x7f97700b3860 legacy=0x7f977006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:27.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.716+0000 7f9774808640 1 -- 172.21.15.82:0/1211907964 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977015e9d0 con 0x7f977006be30 2023-07-20T11:05:27.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f9774808640 1 --2- 172.21.15.82:0/1211907964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977006be30 0x7f97700715a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f97700664f0 tx=0x7f976001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e7d166012a619d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f9767fff640 1 -- 172.21.15.82:0/1211907964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600ab620 con 0x7f977006be30 2023-07-20T11:05:27.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f9767fff640 1 -- 172.21.15.82:0/1211907964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600ab780 con 0x7f977006be30 2023-07-20T11:05:27.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f9767fff640 1 -- 172.21.15.82:0/1211907964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600abb10 con 0x7f977006be30 2023-07-20T11:05:27.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 -- 172.21.15.82:0/1211907964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977006be30 msgr2=0x7f97700715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 --2- 172.21.15.82:0/1211907964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977006be30 0x7f97700715a0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f97700664f0 tx=0x7f976001c400 comp rx=0 tx=0).stop 2023-07-20T11:05:27.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 -- 172.21.15.82:0/1211907964 shutdown_connections 2023-07-20T11:05:27.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 --2- 172.21.15.82:0/1211907964 >> v2:172.21.15.183:3300/0 conn(0x7f977006c8b0 0x7f9770159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 --2- 172.21.15.82:0/1211907964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977006be30 0x7f97700715a0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 -- 172.21.15.82:0/1211907964 >> 172.21.15.82:0/1211907964 conn(0x7f97700ce080 msgr2=0x7f97700ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:27.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 -- 172.21.15.82:0/1211907964 shutdown_connections 2023-07-20T11:05:27.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.720+0000 7f977600b640 1 -- 172.21.15.82:0/1211907964 wait complete. 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 Processor -- start 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- start start 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977006be30 0x7f9770149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 0x7f9770152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701546d0 con 0x7f97700b3860 2023-07-20T11:05:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701599a0 con 0x7f977006c8b0 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159c80 con 0x7f977006be30 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9774808640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 0x7f9770152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57402/0 (socket says 172.21.15.82:57402) 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 -- 172.21.15.82:0/534113477 learned_addr learned my addr 172.21.15.82:0/534113477 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9775009640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977006be30 0x7f9770149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 -- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977006be30 msgr2=0x7f9770149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977006be30 0x7f9770149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 -- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 msgr2=0x7f9770152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 0x7f9770152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 -- 172.21.15.82:0/534113477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600094d0 con 0x7f97700b3860 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9774808640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 0x7f9770152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977580a640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f976800b970 tx=0x7f976800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800cb40 con 0x7f97700b3860 2023-07-20T11:05:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800ccc0 con 0x7f97700b3860 2023-07-20T11:05:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9770159f60 con 0x7f97700b3860 2023-07-20T11:05:27.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768014680 con 0x7f97700b3860 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.724+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770152c90 con 0x7f97700b3860 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770154840 con 0x7f97700b3860 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 81) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f976801d3b0 con 0x7f97700b3860 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f9765ffb640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 0x7f9754068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f9768083c80 con 0x7f97700b3860 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f9775009640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 0x7f9754068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:27.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.728+0000 7f9775009640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 0x7f9754068590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f976c0098e0 tx=0x7f976c009060 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:27.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.732+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97680510f0 con 0x7f97700b3860 2023-07-20T11:05:27.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.908+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f977004da30 con 0x7f97700b3860 2023-07-20T11:05:27.891 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T11:05:27.912+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T11:05:27.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.916+0000 7f9765ffb640 1 -- 172.21.15.82:0/534113477 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9768019090 con 0x7f97700b3860 2023-07-20T11:05:27.898 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T11:05:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 msgr2=0x7f9754068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 0x7f9754068590 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f976c0098e0 tx=0x7f976c009060 comp rx=0 tx=0).stop 2023-07-20T11:05:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 msgr2=0x7f9770151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f976800b970 tx=0x7f976800be30 comp rx=0 tx=0).stop 2023-07-20T11:05:27.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 shutdown_connections 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f97540660d0 0x7f9754068590 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97700b3860 0x7f9770151020 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977006c8b0 0x7f9770152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 --2- 172.21.15.82:0/534113477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977006be30 0x7f9770149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 >> 172.21.15.82:0/534113477 conn(0x7f97700ce080 msgr2=0x7f977015afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 shutdown_connections 2023-07-20T11:05:27.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:27.920+0000 7f977600b640 1 -- 172.21.15.82:0/534113477 wait complete. 2023-07-20T11:05:27.920 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T11:05:27.960 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:05:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.084+0000 7fd1be456640 1 Processor -- start 2023-07-20T11:05:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.084+0000 7fd1be456640 1 -- start start 2023-07-20T11:05:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1be456640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd1b8159830 0x7fd1b80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1be456640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80cc8d0 con 0x7fd1b80cc3e0 2023-07-20T11:05:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1be456640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80ccbb0 con 0x7fd1b8159450 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1be456640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80cce90 con 0x7fd1b8159830 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1bc9f3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd1b80cc3e0 0x7fd1b80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58044/0 (socket says 172.21.15.82:58044) 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1bc9f3640 1 -- 172.21.15.82:0/1551434759 learned_addr learned my addr 172.21.15.82:0/1551434759 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b77fe640 1 --2- 172.21.15.82:0/1551434759 >> v2:172.21.15.183:3300/0 conn(0x7fd1b8159830 0x7fd1b80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b6ffd640 1 -- 172.21.15.82:0/1551434759 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952619819 0 0) 0x7fd1b80cc8d0 con 0x7fd1b80cc3e0 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b6ffd640 1 -- 172.21.15.82:0/1551434759 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a0003530 con 0x7fd1b80cc3e0 2023-07-20T11:05:28.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b77fe640 1 -- 172.21.15.82:0/1551434759 >> v1:172.21.15.183:6789/0 conn(0x7fd1b8159450 legacy=0x7fd1b815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b77fe640 1 -- 172.21.15.82:0/1551434759 >> v1:172.21.15.82:6789/0 conn(0x7fd1b80cc3e0 legacy=0x7fd1b80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.088+0000 7fd1b77fe640 1 -- 172.21.15.82:0/1551434759 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b8159cc0 con 0x7fd1b8159830 2023-07-20T11:05:28.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1b77fe640 1 --2- 172.21.15.82:0/1551434759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159830 0x7fd1b80cbea0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097c0 tx=0x7fd1ac01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb9d7f43f3a9f701 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1b6ffd640 1 -- 172.21.15.82:0/1551434759 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0ad660 con 0x7fd1b8159830 2023-07-20T11:05:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1b6ffd640 1 -- 172.21.15.82:0/1551434759 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0ad7c0 con 0x7fd1b8159830 2023-07-20T11:05:28.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1b6ffd640 1 -- 172.21.15.82:0/1551434759 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0adb50 con 0x7fd1b8159830 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- 172.21.15.82:0/1551434759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159830 msgr2=0x7fd1b80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 --2- 172.21.15.82:0/1551434759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159830 0x7fd1b80cbea0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0097c0 tx=0x7fd1ac01c450 comp rx=0 tx=0).stop 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- 172.21.15.82:0/1551434759 shutdown_connections 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 --2- 172.21.15.82:0/1551434759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159830 0x7fd1b80cbea0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- 172.21.15.82:0/1551434759 >> 172.21.15.82:0/1551434759 conn(0x7fd1b80cad50 msgr2=0x7fd1b80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:28.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- 172.21.15.82:0/1551434759 shutdown_connections 2023-07-20T11:05:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- 172.21.15.82:0/1551434759 wait complete. 2023-07-20T11:05:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 Processor -- start 2023-07-20T11:05:28.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.092+0000 7fd1be456640 1 -- start start 2023-07-20T11:05:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 0x7fd1b80c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:28.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 0x7fd1b80c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c4780 con 0x7fd1b8168710 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c38d0 con 0x7fd1b8159450 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80c6ef0 con 0x7fd1b80cc3e0 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57424/0 (socket says 172.21.15.82:57424) 2023-07-20T11:05:28.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 -- 172.21.15.82:0/773725941 learned_addr learned my addr 172.21.15.82:0/773725941 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:28.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b7fff640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 0x7fd1b80c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b77fe640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 0x7fd1b80c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 -- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 msgr2=0x7fd1b80c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 0x7fd1b80c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 -- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 msgr2=0x7fd1b80c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 0x7fd1b80c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 -- 172.21.15.82:0/773725941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009420 con 0x7fd1b8168710 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b7fff640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 0x7fd1b80c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b77fe640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 0x7fd1b80c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1bc9f3640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000cbe0 tx=0x7fd1b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000ad40 con 0x7fd1b8168710 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b0012400 con 0x7fd1b8168710 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000aea0 con 0x7fd1b8168710 2023-07-20T11:05:28.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80c3b00 con 0x7fd1b8168710 2023-07-20T11:05:28.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b80c40c0 con 0x7fd1b8168710 2023-07-20T11:05:28.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80c48c0 con 0x7fd1b8168710 2023-07-20T11:05:28.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.096+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 82) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fd1b0007070 con 0x7fd1b8168710 2023-07-20T11:05:28.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.100+0000 7fd1b4ff9640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 0x7fd1a4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:28.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.100+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fd1b0083f90 con 0x7fd1b8168710 2023-07-20T11:05:28.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.100+0000 7fd1b7fff640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 0x7fd1a4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:28.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.100+0000 7fd1b7fff640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 0x7fd1a4068800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1b81f7f90 tx=0x7fd1a8009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:28.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.104+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1b00b4700 con 0x7fd1b8168710 2023-07-20T11:05:28.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.288+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd1b804da30 con 0x7fd1b8168710 2023-07-20T11:05:28.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.916+0000 7fd1b4ff9640 1 -- 172.21.15.82:0/773725941 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd1b80c48c0 con 0x7fd1b8168710 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 msgr2=0x7fd1a4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 0x7fd1a4068800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd1b81f7f90 tx=0x7fd1a8009040 comp rx=0 tx=0).stop 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 msgr2=0x7fd1b8158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000cbe0 tx=0x7fd1b000a430 comp rx=0 tx=0).stop 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 shutdown_connections 2023-07-20T11:05:28.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd1a4066340 0x7fd1a4068800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1b8168710 0x7fd1b8158270 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1b8159450 0x7fd1b80c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 --2- 172.21.15.82:0/773725941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1b80cc3e0 0x7fd1b80c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 >> 172.21.15.82:0/773725941 conn(0x7fd1b80cad50 msgr2=0x7fd1b815ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 shutdown_connections 2023-07-20T11:05:28.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:28.920+0000 7fd1be456640 1 -- 172.21.15.82:0/773725941 wait complete. 2023-07-20T11:05:28.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T11:05:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.132+0000 7fe131bf3640 1 Processor -- start 2023-07-20T11:05:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 -- start start 2023-07-20T11:05:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe12c159450 0x7fe12c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe12c159830 0x7fe12c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c0cc8d0 con 0x7fe12c0cc3e0 2023-07-20T11:05:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c0cce90 con 0x7fe12c159450 2023-07-20T11:05:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe131bf3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c0ccbb0 con 0x7fe12c159830 2023-07-20T11:05:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe12c159450 0x7fe12c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe12c159450 0x7fe12c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57426/0 (socket says 172.21.15.82:57426) 2023-07-20T11:05:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 -- 172.21.15.82:0/4220648335 learned_addr learned my addr 172.21.15.82:0/4220648335 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 -- 172.21.15.82:0/4220648335 >> v2:172.21.15.183:3300/0 conn(0x7fe12c159830 msgr2=0x7fe12c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 --2- 172.21.15.82:0/4220648335 >> v2:172.21.15.183:3300/0 conn(0x7fe12c159830 0x7fe12c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 -- 172.21.15.82:0/4220648335 >> v1:172.21.15.183:6789/0 conn(0x7fe12c0cc3e0 legacy=0x7fe12c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.136+0000 7fe12b7fe640 1 -- 172.21.15.82:0/4220648335 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c159cc0 con 0x7fe12c159450 2023-07-20T11:05:29.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe12b7fe640 1 --2- 172.21.15.82:0/4220648335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c159450 0x7fe12c15a4c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fe12c15e190 tx=0x7fe11c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60afccc068991aeb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe12affd640 1 -- 172.21.15.82:0/4220648335 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0ab670 con 0x7fe12c159450 2023-07-20T11:05:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe12affd640 1 -- 172.21.15.82:0/4220648335 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c0ab7d0 con 0x7fe12c159450 2023-07-20T11:05:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe12affd640 1 -- 172.21.15.82:0/4220648335 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0abb60 con 0x7fe12c159450 2023-07-20T11:05:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 -- 172.21.15.82:0/4220648335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c159450 msgr2=0x7fe12c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4220648335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c159450 0x7fe12c15a4c0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fe12c15e190 tx=0x7fe11c01c490 comp rx=0 tx=0).stop 2023-07-20T11:05:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 -- 172.21.15.82:0/4220648335 shutdown_connections 2023-07-20T11:05:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4220648335 >> v2:172.21.15.183:3300/0 conn(0x7fe12c159830 0x7fe12c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4220648335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c159450 0x7fe12c15a4c0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:29.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 -- 172.21.15.82:0/4220648335 >> 172.21.15.82:0/4220648335 conn(0x7fe12c0cad50 msgr2=0x7fe12c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:29.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 -- 172.21.15.82:0/4220648335 shutdown_connections 2023-07-20T11:05:29.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.140+0000 7fe131bf3640 1 -- 172.21.15.82:0/4220648335 wait complete. 2023-07-20T11:05:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 Processor -- start 2023-07-20T11:05:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 -- start start 2023-07-20T11:05:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe12c0cc3e0 0x7fe12c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe12c159450 0x7fe12c0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c27d0 con 0x7fe12c1521c0 2023-07-20T11:05:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c2ab0 con 0x7fe12c0cc3e0 2023-07-20T11:05:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe131bf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c0c2d90 con 0x7fe12c159450 2023-07-20T11:05:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57432/0 (socket says 172.21.15.82:57432) 2023-07-20T11:05:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 -- 172.21.15.82:0/4235571496 learned_addr learned my addr 172.21.15.82:0/4235571496 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12b7fe640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe12c0cc3e0 0x7fe12c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe123fff640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe12c159450 0x7fe12c0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 -- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe12c159450 msgr2=0x7fe12c0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe12c159450 0x7fe12c0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 -- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe12c0cc3e0 msgr2=0x7fe12c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe12c0cc3e0 0x7fe12c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 -- 172.21.15.82:0/4235571496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0094d0 con 0x7fe12c1521c0 2023-07-20T11:05:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.144+0000 7fe12bfff640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fe12400c780 tx=0x7fe12400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124003d90 con 0x7fe12c1521c0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c1541a0 con 0x7fe12c1521c0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400ce30 con 0x7fe12c1521c0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124005290 con 0x7fe12c1521c0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c0c4be0 con 0x7fe12c1521c0 2023-07-20T11:05:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c1543e0 con 0x7fe12c1521c0 2023-07-20T11:05:29.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 82) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fe1240053f0 con 0x7fe12c1521c0 2023-07-20T11:05:29.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 0x7fe10c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:29.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fe124083630 con 0x7fe12c1521c0 2023-07-20T11:05:29.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.148+0000 7fe12b7fe640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 0x7fe10c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:29.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.152+0000 7fe12b7fe640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 0x7fe10c068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0af000 tx=0x7fe11c0b6040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:29.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.152+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe12c1543e0 con 0x7fe12c1521c0 2023-07-20T11:05:29.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.300+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe12c0c2910 con 0x7fe12c1521c0 2023-07-20T11:05:29.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:29.932+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe1240056a0 con 0x7fe12c1521c0 2023-07-20T11:05:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.148+0000 7fe128ff9640 1 -- 172.21.15.82:0/4235571496 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe124080300 con 0x7fe12c1521c0 2023-07-20T11:05:30.131 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T11:05:30.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.152+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 msgr2=0x7fe10c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.152+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 0x7fe10c068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0af000 tx=0x7fe11c0b6040 comp rx=0 tx=0).stop 2023-07-20T11:05:30.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.152+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 msgr2=0x7fe12c1515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.152+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fe12400c780 tx=0x7fe12400cc40 comp rx=0 tx=0).stop 2023-07-20T11:05:30.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 shutdown_connections 2023-07-20T11:05:30.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe10c066340 0x7fe10c068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe12c1521c0 0x7fe12c1515c0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe12c159450 0x7fe12c0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 --2- 172.21.15.82:0/4235571496 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe12c0cc3e0 0x7fe12c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 >> 172.21.15.82:0/4235571496 conn(0x7fe12c0cad50 msgr2=0x7fe12c0c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:30.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 shutdown_connections 2023-07-20T11:05:30.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.156+0000 7fe131bf3640 1 -- 172.21.15.82:0/4235571496 wait complete. 2023-07-20T11:05:30.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T11:05:30.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 Processor -- start 2023-07-20T11:05:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 -- start start 2023-07-20T11:05:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d04159830 0x7f6d040cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d040cc3e0 0x7f6d040afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d040cc8d0 con 0x7f6d04159450 2023-07-20T11:05:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d040cce90 con 0x7f6d040cc3e0 2023-07-20T11:05:30.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d0b227640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040ccbb0 con 0x7f6d04159830 2023-07-20T11:05:30.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d08fc3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6d04159450 0x7f6d0415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58054/0 (socket says 172.21.15.82:58054) 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2082275330 learned_addr learned my addr 172.21.15.82:0/2082275330 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d097c4640 1 --2- 172.21.15.82:0/2082275330 >> v2:172.21.15.183:3300/0 conn(0x7f6d040cc3e0 0x7f6d040afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d03fff640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d04159830 0x7f6d040cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963468116 0 0) 0x7f6d040cc8d0 con 0x7f6d04159450 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cec005740 con 0x7f6d04159450 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102340054 0 0) 0x7f6cec005740 con 0x7f6d04159450 2023-07-20T11:05:30.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d04159830 msgr2=0x7f6d040cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d04159830 0x7f6d040cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 >> v2:172.21.15.183:3300/0 conn(0x7f6d040cc3e0 msgr2=0x7f6d040afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 --2- 172.21.15.82:0/2082275330 >> v2:172.21.15.183:3300/0 conn(0x7f6d040cc3e0 0x7f6d040afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04159cc0 con 0x7f6d04159450 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f6cf40016a0 con 0x7f6d04159450 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 >> v1:172.21.15.82:6789/0 conn(0x7f6d04159450 legacy=0x7f6d0415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6cec006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0069e0 0x7f6cec006e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec007360 0x7f6cec00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040cce90 con 0x7f6cec005c00 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.336+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040ccbb0 con 0x7f6cec007360 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec00e0e0 con 0x7f6cec0069e0 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6cec006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d097c4640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec007360 0x7f6cec00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d03fff640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0069e0 0x7f6cec006e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0069e0 msgr2=0x7f6cec006e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:30.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6cec0069e0 0x7f6cec006e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec007360 msgr2=0x7f6cec00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:30.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6cec007360 0x7f6cec00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2082275330 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec005740 con 0x7f6cec005c00 2023-07-20T11:05:30.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6cec006020 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c160 tx=0x7f6cf401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d74f7edfedbc59 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:30.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40058e0 con 0x7f6cec005c00 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4005a40 con 0x7f6cec005c00 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.340+0000 7f6d037fe640 1 -- 172.21.15.82:0/2082275330 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4005df0 con 0x7f6cec005c00 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- 172.21.15.82:0/2082275330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 msgr2=0x7f6cec006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2082275330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6cec006020 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6cf400c160 tx=0x7f6cf401cb30 comp rx=0 tx=0).stop 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d097c4640 1 -- 172.21.15.82:0/2082275330 reap_dead start 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- 172.21.15.82:0/2082275330 shutdown_connections 2023-07-20T11:05:30.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- 172.21.15.82:0/2082275330 >> 172.21.15.82:0/2082275330 conn(0x7f6d040cad50 msgr2=0x7f6d040cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:30.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- 172.21.15.82:0/2082275330 shutdown_connections 2023-07-20T11:05:30.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- 172.21.15.82:0/2082275330 wait complete. 2023-07-20T11:05:30.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 Processor -- start 2023-07-20T11:05:30.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- start start 2023-07-20T11:05:30.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d040b0c30 0x7f6d041f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 0x7f6d041f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041582e0 con 0x7f6cec005c00 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d041f5de0 con 0x7f6d040b0c30 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d0b227640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d040c3970 con 0x7f6d041f5410 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d08fc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d08fc3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57450/0 (socket says 172.21.15.82:57450) 2023-07-20T11:05:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2292150851 learned_addr learned my addr 172.21.15.82:0/2292150851 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d03fff640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d040b0c30 0x7f6d041f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.344+0000 7f6d097c4640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 0x7f6d041f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 msgr2=0x7f6d041f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 0x7f6d041f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d040b0c30 msgr2=0x7f6d041f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d040b0c30 0x7f6d041f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 -- 172.21.15.82:0/2292150851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d040c3c50 con 0x7f6cec005c00 2023-07-20T11:05:30.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d097c4640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 0x7f6d041f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:30.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d08fc3640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4007040 tx=0x7f6cec007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:30.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf40047f0 con 0x7f6cec005c00 2023-07-20T11:05:30.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf4004970 con 0x7f6cec005c00 2023-07-20T11:05:30.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d040c3f30 con 0x7f6cec005c00 2023-07-20T11:05:30.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4004d20 con 0x7f6cec005c00 2023-07-20T11:05:30.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d040c44f0 con 0x7f6cec005c00 2023-07-20T11:05:30.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d040c46b0 con 0x7f6cec005c00 2023-07-20T11:05:30.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6cf40070d0 con 0x7f6cec005c00 2023-07-20T11:05:30.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 0x7f6cf0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:30.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6470+0+0 (secure 0 0 0) 0x7f6cf411d370 con 0x7f6cec005c00 2023-07-20T11:05:30.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.348+0000 7f6d03fff640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 0x7f6cf0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:30.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.352+0000 7f6d03fff640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 0x7f6cf0068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d040b1050 tx=0x7f6cf8009190 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:30.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.352+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cf40ea5d0 con 0x7f6cec005c00 2023-07-20T11:05:30.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:30.500+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d0404da30 con 0x7f6cec005c00 2023-07-20T11:05:31.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.172+0000 7f6d017fa640 1 -- 172.21.15.82:0/2292150851 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6cf40edbf0 con 0x7f6cec005c00 2023-07-20T11:05:31.154 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T11:05:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 msgr2=0x7f6cf0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 0x7f6cf0068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d040b1050 tx=0x7f6cf8009190 comp rx=0 tx=0).stop 2023-07-20T11:05:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 msgr2=0x7f6d040af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4007040 tx=0x7f6cec007a10 comp rx=0 tx=0).stop 2023-07-20T11:05:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 shutdown_connections 2023-07-20T11:05:31.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f6cf00663d0 0x7f6cf0068890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d041f5410 0x7f6d041f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d040b0c30 0x7f6d041f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 --2- 172.21.15.82:0/2292150851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cec005c00 0x7f6d040af5f0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 >> 172.21.15.82:0/2292150851 conn(0x7f6d040cad50 msgr2=0x7f6d0415a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.176+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 shutdown_connections 2023-07-20T11:05:31.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.180+0000 7f6d0b227640 1 -- 172.21.15.82:0/2292150851 wait complete. 2023-07-20T11:05:31.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T11:05:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 Processor -- start 2023-07-20T11:05:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 -- start start 2023-07-20T11:05:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafc406f710 0x7fafc406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4070030 con 0x7fafc40ca5a0 2023-07-20T11:05:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4071950 con 0x7fafc415a6f0 2023-07-20T11:05:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafcb4cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc415bad0 con 0x7fafc406f710 2023-07-20T11:05:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafc406f710 0x7fafc406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fafc406f710 0x7fafc406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57458/0 (socket says 172.21.15.82:57458) 2023-07-20T11:05:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 -- 172.21.15.82:0/1745084918 learned_addr learned my addr 172.21.15.82:0/1745084918 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 -- 172.21.15.82:0/1745084918 >> v1:172.21.15.183:6789/0 conn(0x7fafc415a6f0 legacy=0x7fafc40c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 -- 172.21.15.82:0/1745084918 >> v1:172.21.15.82:6789/0 conn(0x7fafc40ca5a0 legacy=0x7fafc415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.344+0000 7fafc9267640 1 -- 172.21.15.82:0/1745084918 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc415b230 con 0x7fafc406f710 2023-07-20T11:05:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafc9267640 1 --2- 172.21.15.82:0/1745084918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc406f710 0x7fafc406faf0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009870 tx=0x7fafc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2441d013a880c8a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafbbfff640 1 -- 172.21.15.82:0/1745084918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00aa430 con 0x7fafc406f710 2023-07-20T11:05:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafbbfff640 1 -- 172.21.15.82:0/1745084918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc00aa590 con 0x7fafc406f710 2023-07-20T11:05:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafbbfff640 1 -- 172.21.15.82:0/1745084918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00aa920 con 0x7fafc406f710 2023-07-20T11:05:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 -- 172.21.15.82:0/1745084918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc406f710 msgr2=0x7fafc406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/1745084918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc406f710 0x7fafc406faf0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009870 tx=0x7fafc001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 -- 172.21.15.82:0/1745084918 shutdown_connections 2023-07-20T11:05:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/1745084918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc406f710 0x7fafc406faf0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 -- 172.21.15.82:0/1745084918 >> 172.21.15.82:0/1745084918 conn(0x7fafc40cad50 msgr2=0x7fafc40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 -- 172.21.15.82:0/1745084918 shutdown_connections 2023-07-20T11:05:31.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.348+0000 7fafcb4cb640 1 -- 172.21.15.82:0/1745084918 wait complete. 2023-07-20T11:05:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 Processor -- start 2023-07-20T11:05:31.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- start start 2023-07-20T11:05:31.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 0x7fafc4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 0x7fafc4153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40b3550 con 0x7fafc40ca5a0 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40cd0b0 con 0x7fafc415a6f0 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40cd390 con 0x7fafc406f710 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57462/0 (socket says 172.21.15.82:57462) 2023-07-20T11:05:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 -- 172.21.15.82:0/2554327020 learned_addr learned my addr 172.21.15.82:0/2554327020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc9267640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 0x7fafc4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc9a68640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 0x7fafc4153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 -- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 msgr2=0x7fafc4159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 0x7fafc4159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 -- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 msgr2=0x7fafc4153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 0x7fafc4153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 -- 172.21.15.82:0/2554327020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc00094d0 con 0x7fafc40ca5a0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc9267640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 0x7fafc4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc9a68640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 0x7fafc4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafc8a66640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c4d0 tx=0x7fafb400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40052d0 con 0x7fafc40ca5a0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4005430 con 0x7fafc40ca5a0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc40cd670 con 0x7fafc40ca5a0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4012830 con 0x7fafc40ca5a0 2023-07-20T11:05:31.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.352+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4153390 con 0x7fafc40ca5a0 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc40cd860 con 0x7fafc40ca5a0 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fafb4012990 con 0x7fafc40ca5a0 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafb9ffb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 0x7fafa8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fafb40838e0 con 0x7fafc40ca5a0 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafc9267640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 0x7fafa8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.356+0000 7fafc9267640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 0x7fafa8068890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ae000 tx=0x7fafc00a7000 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.360+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafb4050ce0 con 0x7fafc40ca5a0 2023-07-20T11:05:31.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.508+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fafc404da30 con 0x7fafc40ca5a0 2023-07-20T11:05:31.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.512+0000 7fafb9ffb640 1 -- 172.21.15.82:0/2554327020 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v49) v1 ==== 115+0+0 (secure 0 0 0) 0x7fafb4054300 con 0x7fafc40ca5a0 2023-07-20T11:05:31.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.512+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 msgr2=0x7fafa8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.512+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 0x7fafa8068890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fafc00ae000 tx=0x7fafc00a7000 comp rx=0 tx=0).stop 2023-07-20T11:05:31.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.512+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 msgr2=0x7fafc4153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.512+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c4d0 tx=0x7fafb400c990 comp rx=0 tx=0).stop 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 shutdown_connections 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fafa80663d0 0x7fafa8068890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fafc415a6f0 0x7fafc4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafc40ca5a0 0x7fafc4153870 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 --2- 172.21.15.82:0/2554327020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fafc406f710 0x7fafc4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 >> 172.21.15.82:0/2554327020 conn(0x7fafc40cad50 msgr2=0x7fafc40ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:31.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 shutdown_connections 2023-07-20T11:05:31.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.516+0000 7fafcb4cb640 1 -- 172.21.15.82:0/2554327020 wait complete. 2023-07-20T11:05:31.514 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T11:05:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 Processor -- start 2023-07-20T11:05:31.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 -- start start 2023-07-20T11:05:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f387c159830 0x7f387c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f387c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0cc8d0 con 0x7f387c159450 2023-07-20T11:05:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0cce90 con 0x7f387c159830 2023-07-20T11:05:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f38845fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0ccbb0 con 0x7f387c0cc3e0 2023-07-20T11:05:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f3882396640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f387c159450 0x7f387c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:58070/0 (socket says 172.21.15.82:58070) 2023-07-20T11:05:31.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.684+0000 7f3882396640 1 -- 172.21.15.82:0/543467689 learned_addr learned my addr 172.21.15.82:0/543467689 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3882b97640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f387c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 --2- 172.21.15.82:0/543467689 >> v2:172.21.15.183:3300/0 conn(0x7f387c159830 0x7f387c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435712104 0 0) 0x7f387c0cc8d0 con 0x7f387c159450 2023-07-20T11:05:31.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3868003530 con 0x7f387c159450 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2116446469 0 0) 0x7f3868003530 con 0x7f387c159450 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 msgr2=0x7f387c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f387c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 >> v2:172.21.15.183:3300/0 conn(0x7f387c159830 msgr2=0x7f387c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 --2- 172.21.15.82:0/543467689 >> v2:172.21.15.183:3300/0 conn(0x7f387c159830 0x7f387c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c159cc0 con 0x7f387c159450 2023-07-20T11:05:31.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f3878001a00 con 0x7f387c159450 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 >> v1:172.21.15.82:6789/0 conn(0x7f387c159450 legacy=0x7f387c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f38680039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3868003fc0 0x7f38680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868004d10 0x7f3868005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0cce90 con 0x7f3868003fc0 2023-07-20T11:05:31.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0ccbb0 con 0x7f3868004d10 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386800dc20 con 0x7f387c0cc3e0 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3868003fc0 0x7f38680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3882b97640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868004d10 0x7f3868005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3882396640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f38680039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 -- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 msgr2=0x7f38680039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0cc3e0 0x7f38680039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 -- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868004d10 msgr2=0x7f3868005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868004d10 0x7f3868005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3881b95640 1 -- 172.21.15.82:0/543467689 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868003530 con 0x7f3868003fc0 2023-07-20T11:05:31.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.688+0000 7f3882b97640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868004d10 0x7f3868005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f3881b95640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3868003fc0 0x7f38680047d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f386c009ae0 tx=0x7f386c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35972401d548ba8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c0a5680 con 0x7f3868003fc0 2023-07-20T11:05:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c0a57e0 con 0x7f3868003fc0 2023-07-20T11:05:31.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f3881394640 1 -- 172.21.15.82:0/543467689 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c0a5b90 con 0x7f3868003fc0 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- 172.21.15.82:0/543467689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3868003fc0 msgr2=0x7f38680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 --2- 172.21.15.82:0/543467689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3868003fc0 0x7f38680047d0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f386c009ae0 tx=0x7f386c01ca90 comp rx=0 tx=0).stop 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f3882b97640 1 -- 172.21.15.82:0/543467689 reap_dead start 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- 172.21.15.82:0/543467689 shutdown_connections 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- 172.21.15.82:0/543467689 >> 172.21.15.82:0/543467689 conn(0x7f387c0cad50 msgr2=0x7f387c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- 172.21.15.82:0/543467689 shutdown_connections 2023-07-20T11:05:31.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- 172.21.15.82:0/543467689 wait complete. 2023-07-20T11:05:31.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 Processor -- start 2023-07-20T11:05:31.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 -- start start 2023-07-20T11:05:31.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.692+0000 7f38845fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868003fc0 0x7f387c150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0c88e0 0x7f387c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0c92a0 con 0x7f387c1f1e50 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c151370 con 0x7f3868003fc0 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c151c10 con 0x7f387c0c88e0 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57478/0 (socket says 172.21.15.82:57478) 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 -- 172.21.15.82:0/1347481049 learned_addr learned my addr 172.21.15.82:0/1347481049 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882396640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868003fc0 0x7f387c150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3881b95640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0c88e0 0x7f387c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 -- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0c88e0 msgr2=0x7f387c0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0c88e0 0x7f387c0c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 -- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868003fc0 msgr2=0x7f387c150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868003fc0 0x7f387c150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 -- 172.21.15.82:0/1347481049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c1f2bf0 con 0x7f387c1f1e50 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3882b97640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f387c0cc800 tx=0x7f3874011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874004440 con 0x7f387c1f1e50 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3874003620 con 0x7f387c1f1e50 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c1515c0 con 0x7f387c1f1e50 2023-07-20T11:05:31.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38740039d0 con 0x7f387c1f1e50 2023-07-20T11:05:31.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c150dc0 con 0x7f387c1f1e50 2023-07-20T11:05:31.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c151da0 con 0x7f387c1f1e50 2023-07-20T11:05:31.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3874003b30 con 0x7f387c1f1e50 2023-07-20T11:05:31.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.696+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 0x7f3860068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:31.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.700+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f3874083fe0 con 0x7f387c1f1e50 2023-07-20T11:05:31.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.700+0000 7f3882396640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 0x7f3860068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:31.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.700+0000 7f3882396640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 0x7f3860068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3878001340 tx=0x7f38780018d0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:31.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.704+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3874051380 con 0x7f387c1f1e50 2023-07-20T11:05:31.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.852+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f387c04da30 con 0x7f387c1f1e50 2023-07-20T11:05:31.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f3872ffd640 1 -- 172.21.15.82:0/1347481049 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7f38740549a0 con 0x7f387c1f1e50 2023-07-20T11:05:31.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 msgr2=0x7f3860068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 0x7f3860068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3878001340 tx=0x7f38780018d0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 msgr2=0x7f387c1f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f387c0cc800 tx=0x7f3874011860 comp rx=0 tx=0).stop 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 shutdown_connections 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f38600663d0 0x7f3860068890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f387c1f1e50 0x7f387c1f22d0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f387c0c88e0 0x7f387c0c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 --2- 172.21.15.82:0/1347481049 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3868003fc0 0x7f387c150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:31.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 >> 172.21.15.82:0/1347481049 conn(0x7f387c0cad50 msgr2=0x7f387c15b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:31.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 shutdown_connections 2023-07-20T11:05:31.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:31.856+0000 7f38845fa640 1 -- 172.21.15.82:0/1347481049 wait complete. 2023-07-20T11:05:31.858 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T11:05:31.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 Processor -- start 2023-07-20T11:05:32.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 -- start start 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0af815c6e0 0x7f0af80cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af80cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 0x7f0af80d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80cdb40 con 0x7f0af815c6e0 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af80d07a0 con 0x7f0af815cac0 2023-07-20T11:05:32.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0afd7d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80cd4f0 con 0x7f0af80d3200 2023-07-20T11:05:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0af815c6e0 0x7f0af80cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0af815c6e0 0x7f0af80cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57484/0 (socket says 172.21.15.82:57484) 2023-07-20T11:05:32.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 -- 172.21.15.82:0/4044678828 learned_addr learned my addr 172.21.15.82:0/4044678828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af77fe640 1 --2- 172.21.15.82:0/4044678828 >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 0x7f0af80d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0aeffff640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af80cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 -- 172.21.15.82:0/4044678828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 msgr2=0x7f0af80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af80cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 -- 172.21.15.82:0/4044678828 >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 msgr2=0x7f0af80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:32.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/4044678828 >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 0x7f0af80d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af6ffd640 1 -- 172.21.15.82:0/4044678828 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80cd7d0 con 0x7f0af815c6e0 2023-07-20T11:05:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0af77fe640 1 --2- 172.21.15.82:0/4044678828 >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 0x7f0af80d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.020+0000 7f0aeffff640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af80cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:32.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80cf640 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f0af80662a0 tx=0x7f0ae801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c67ec7aa441579 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0af67fc640 1 -- 172.21.15.82:0/4044678828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ab600 con 0x7f0af815c6e0 2023-07-20T11:05:32.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0af67fc640 1 -- 172.21.15.82:0/4044678828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80a7050 con 0x7f0af815c6e0 2023-07-20T11:05:32.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0af67fc640 1 -- 172.21.15.82:0/4044678828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80ab980 con 0x7f0af815c6e0 2023-07-20T11:05:32.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 -- 172.21.15.82:0/4044678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 msgr2=0x7f0af80cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80cf640 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f0af80662a0 tx=0x7f0ae801c3e0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 -- 172.21.15.82:0/4044678828 shutdown_connections 2023-07-20T11:05:32.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/4044678828 >> v2:172.21.15.183:3300/0 conn(0x7f0af815cac0 0x7f0af80d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af80cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/4044678828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80cf640 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 -- 172.21.15.82:0/4044678828 >> 172.21.15.82:0/4044678828 conn(0x7f0af80d2600 msgr2=0x7f0af80d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 -- 172.21.15.82:0/4044678828 shutdown_connections 2023-07-20T11:05:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.024+0000 7f0afd7d2640 1 -- 172.21.15.82:0/4044678828 wait complete. 2023-07-20T11:05:32.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 Processor -- start 2023-07-20T11:05:32.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- start start 2023-07-20T11:05:32.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af814ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 0x7f0af814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af814d3d0 con 0x7f0af815c6e0 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8159cd0 con 0x7f0af815cac0 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8159f70 con 0x7f0af80d3200 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57500/0 (socket says 172.21.15.82:57500) 2023-07-20T11:05:32.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 -- 172.21.15.82:0/3687513166 learned_addr learned my addr 172.21.15.82:0/3687513166 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af814ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0af77fe640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 0x7f0af814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 -- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 msgr2=0x7f0af814ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af814ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 -- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 msgr2=0x7f0af814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 0x7f0af814bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 -- 172.21.15.82:0/3687513166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae80094d0 con 0x7f0af815c6e0 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0af77fe640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 0x7f0af814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aeffff640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c7c0 tx=0x7f0ae000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0007820 con 0x7f0af815c6e0 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0007980 con 0x7f0af815c6e0 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0007d10 con 0x7f0af815c6e0 2023-07-20T11:05:32.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af814eaf0 con 0x7f0af815c6e0 2023-07-20T11:05:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af80b3e40 con 0x7f0af815c6e0 2023-07-20T11:05:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.028+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af804da30 con 0x7f0af815c6e0 2023-07-20T11:05:32.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.032+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ae00113f0 con 0x7f0af815c6e0 2023-07-20T11:05:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.032+0000 7f0aef7fe640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 0x7f0ad8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.032+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f0ae0084000 con 0x7f0af815c6e0 2023-07-20T11:05:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.032+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 0x7f0ad8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.032+0000 7f0af6ffd640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 0x7f0ad8068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ad000 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.036+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae0051310 con 0x7f0af815c6e0 2023-07-20T11:05:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.184+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0af80b8580 con 0x7f0af815c6e0 2023-07-20T11:05:32.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0aef7fe640 1 -- 172.21.15.82:0/3687513166 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ae0054930 con 0x7f0af815c6e0 2023-07-20T11:05:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 msgr2=0x7f0ad8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 0x7f0ad8068890 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ad000 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2023-07-20T11:05:32.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 msgr2=0x7f0af80b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000c7c0 tx=0x7f0ae000cc80 comp rx=0 tx=0).stop 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 shutdown_connections 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0ad80663d0 0x7f0ad8068890 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0af815cac0 0x7f0af814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0af815c6e0 0x7f0af80b3900 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 --2- 172.21.15.82:0/3687513166 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0af80d3200 0x7f0af814ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 >> 172.21.15.82:0/3687513166 conn(0x7f0af80d2600 msgr2=0x7f0af8158b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 shutdown_connections 2023-07-20T11:05:32.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.192+0000 7f0afd7d2640 1 -- 172.21.15.82:0/3687513166 wait complete. 2023-07-20T11:05:32.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-07-20T11:05:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 Processor -- start 2023-07-20T11:05:32.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 -- start start 2023-07-20T11:05:32.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd96015c5f0 0x7fd9600b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600b7c20 con 0x7fd9600ce9a0 2023-07-20T11:05:32.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600cee50 con 0x7fd96015c5f0 2023-07-20T11:05:32.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd96525b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015c9d0 con 0x7fd9600ccfb0 2023-07-20T11:05:32.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd96015c5f0 0x7fd9600b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd96015c5f0 0x7fd9600b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57510/0 (socket says 172.21.15.82:57510) 2023-07-20T11:05:32.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 -- 172.21.15.82:0/32035332 learned_addr learned my addr 172.21.15.82:0/32035332 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:32.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95f7fe640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 -- 172.21.15.82:0/32035332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 msgr2=0x7fd9600ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:32.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 -- 172.21.15.82:0/32035332 >> v1:172.21.15.183:6789/0 conn(0x7fd9600ce9a0 legacy=0x7fd9600b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:32.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95ffff640 1 -- 172.21.15.82:0/32035332 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600ce030 con 0x7fd96015c5f0 2023-07-20T11:05:32.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.352+0000 7fd95f7fe640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd95ffff640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96015c5f0 0x7fd9600b4270 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd950009870 tx=0x7fd95001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dbc06aa2fdc1ad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd95effd640 1 -- 172.21.15.82:0/32035332 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500a89b0 con 0x7fd96015c5f0 2023-07-20T11:05:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd95effd640 1 -- 172.21.15.82:0/32035332 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500a8b10 con 0x7fd96015c5f0 2023-07-20T11:05:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd95effd640 1 -- 172.21.15.82:0/32035332 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500a8ea0 con 0x7fd96015c5f0 2023-07-20T11:05:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 -- 172.21.15.82:0/32035332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96015c5f0 msgr2=0x7fd9600b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96015c5f0 0x7fd9600b4270 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd950009870 tx=0x7fd95001ecf0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 -- 172.21.15.82:0/32035332 shutdown_connections 2023-07-20T11:05:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 --2- 172.21.15.82:0/32035332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96015c5f0 0x7fd9600b4270 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 -- 172.21.15.82:0/32035332 >> 172.21.15.82:0/32035332 conn(0x7fd960065710 msgr2=0x7fd960065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 -- 172.21.15.82:0/32035332 shutdown_connections 2023-07-20T11:05:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.356+0000 7fd96525b640 1 -- 172.21.15.82:0/32035332 wait complete. 2023-07-20T11:05:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 Processor -- start 2023-07-20T11:05:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- start start 2023-07-20T11:05:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 0x7fd96015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c95e0 con 0x7fd9600ce9a0 2023-07-20T11:05:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c98c0 con 0x7fd96015c5f0 2023-07-20T11:05:32.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600c9ba0 con 0x7fd9600ccfb0 2023-07-20T11:05:32.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57518/0 (socket says 172.21.15.82:57518) 2023-07-20T11:05:32.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 -- 172.21.15.82:0/1817360037 learned_addr learned my addr 172.21.15.82:0/1817360037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95ffff640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd964a5a640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 0x7fd96015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 -- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 msgr2=0x7fd9600cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 -- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 msgr2=0x7fd96015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 0x7fd96015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 -- 172.21.15.82:0/1817360037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500094d0 con 0x7fd9600ce9a0 2023-07-20T11:05:32.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd964a5a640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 0x7fd96015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:32.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95f7fe640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c7c0 tx=0x7fd95400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954007a30 con 0x7fd9600ce9a0 2023-07-20T11:05:32.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954007b90 con 0x7fd9600ce9a0 2023-07-20T11:05:32.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400ce70 con 0x7fd9600ce9a0 2023-07-20T11:05:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9600c9e80 con 0x7fd9600ce9a0 2023-07-20T11:05:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9600cc370 con 0x7fd9600ce9a0 2023-07-20T11:05:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.360+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96004da30 con 0x7fd9600ce9a0 2023-07-20T11:05:32.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.364+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd9540113f0 con 0x7fd9600ce9a0 2023-07-20T11:05:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.364+0000 7fd95cff9640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 0x7fd94c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:32.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.364+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fd9540843c0 con 0x7fd9600ce9a0 2023-07-20T11:05:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.364+0000 7fd95ffff640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 0x7fd94c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.364+0000 7fd95ffff640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 0x7fd94c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9500b2000 tx=0x7fd950009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.368+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9540516d0 con 0x7fd9600ce9a0 2023-07-20T11:05:32.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:32.564+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fd9600b5990 con 0x7fd9600ce9a0 2023-07-20T11:05:33.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.176+0000 7fd95cff9640 1 -- 172.21.15.82:0/1817360037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2433) v1 ==== 178+0+0 (secure 0 0 0) 0x7fd954054cf0 con 0x7fd9600ce9a0 2023-07-20T11:05:33.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 msgr2=0x7fd94c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 0x7fd94c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9500b2000 tx=0x7fd950009040 comp rx=0 tx=0).stop 2023-07-20T11:05:33.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 msgr2=0x7fd96015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd95400c7c0 tx=0x7fd95400cc80 comp rx=0 tx=0).stop 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 shutdown_connections 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd94c0663a0 0x7fd94c068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd96015c5f0 0x7fd96015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600ce9a0 0x7fd96015d820 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 --2- 172.21.15.82:0/1817360037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9600ccfb0 0x7fd9600cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 >> 172.21.15.82:0/1817360037 conn(0x7fd960065710 msgr2=0x7fd9600b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:33.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 shutdown_connections 2023-07-20T11:05:33.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.180+0000 7fd96525b640 1 -- 172.21.15.82:0/1817360037 wait complete. 2023-07-20T11:05:33.182 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-20T11:05:33.183 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-07-20T11:05:33.183 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T11:05:33.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-20T11:05:33.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 Processor -- start 2023-07-20T11:05:33.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 -- start start 2023-07-20T11:05:33.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3a80b2a90 0x7fa3a815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a80ccd90 con 0x7fa3a81596b0 2023-07-20T11:05:33.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a80ad600 con 0x7fa3a80b2a90 2023-07-20T11:05:33.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3b03f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80ad810 con 0x7fa3a80cc900 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3a80b2a90 0x7fa3a815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa3a80b2a90 0x7fa3a815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34062/0 (socket says 172.21.15.82:34062) 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 -- 172.21.15.82:0/3597617269 learned_addr learned my addr 172.21.15.82:0/3597617269 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ae990640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 -- 172.21.15.82:0/3597617269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 msgr2=0x7fa3a80ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 -- 172.21.15.82:0/3597617269 >> v1:172.21.15.82:6789/0 conn(0x7fa3a81596b0 legacy=0x7fa3a80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ad98e640 1 -- 172.21.15.82:0/3597617269 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a815d0d0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.344+0000 7fa3ae990640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3ad98e640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a815dbb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa3980098a0 tx=0x7fa39801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23a9b2c025c2952 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3ad18d640 1 -- 172.21.15.82:0/3597617269 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980aa650 con 0x7fa3a80b2a90 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3ad18d640 1 -- 172.21.15.82:0/3597617269 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980aa7b0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3ad18d640 1 -- 172.21.15.82:0/3597617269 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980aab40 con 0x7fa3a80b2a90 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3597617269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 msgr2=0x7fa3a815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a815dbb0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa3980098a0 tx=0x7fa39801c4f0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3597617269 shutdown_connections 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3597617269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a815dbb0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3597617269 >> 172.21.15.82:0/3597617269 conn(0x7fa3a80cada0 msgr2=0x7fa3a80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3597617269 shutdown_connections 2023-07-20T11:05:33.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.348+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3597617269 wait complete. 2023-07-20T11:05:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 Processor -- start 2023-07-20T11:05:33.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 -- start start 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a81596b0 0x7fa3a80c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81f9240 con 0x7fa3a80b2a90 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c5e50 con 0x7fa3a81596b0 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c5520 con 0x7fa3a80cc900 2023-07-20T11:05:33.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34068/0 (socket says 172.21.15.82:34068) 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 -- 172.21.15.82:0/3505376105 learned_addr learned my addr 172.21.15.82:0/3505376105 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ad98e640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae990640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a81596b0 0x7fa3a80c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 -- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 msgr2=0x7fa3a80991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 -- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a81596b0 msgr2=0x7fa3a80c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a81596b0 0x7fa3a80c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 -- 172.21.15.82:0/3505376105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980094d0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3ae18f640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c7a0 tx=0x7fa3a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4003b80 con 0x7fa3a80b2a90 2023-07-20T11:05:33.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4003ce0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80c5800 con 0x7fa3a80b2a90 2023-07-20T11:05:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.352+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400aa90 con 0x7fa3a80b2a90 2023-07-20T11:05:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a809b7c0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8073c70 con 0x7fa3a80b2a90 2023-07-20T11:05:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3a400abf0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa39effd640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 0x7fa38c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fa3a4083ba0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa3ad98e640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 0x7fa38c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:33.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.356+0000 7fa3ad98e640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 0x7fa38c068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa3980ae000 tx=0x7fa3980b5040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:33.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.360+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3a4050fb0 con 0x7fa3a80b2a90 2023-07-20T11:05:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:33.560+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fa3a80cdde0 con 0x7fa3a80b2a90 2023-07-20T11:05:34.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa39effd640 1 -- 172.21.15.82:0/3505376105 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2434) v1 ==== 177+0+0 (secure 0 0 0) 0x7fa3a40545d0 con 0x7fa3a80b2a90 2023-07-20T11:05:34.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 msgr2=0x7fa38c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 0x7fa38c068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa3980ae000 tx=0x7fa3980b5040 comp rx=0 tx=0).stop 2023-07-20T11:05:34.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 msgr2=0x7fa3a809b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c7a0 tx=0x7fa3a400cc60 comp rx=0 tx=0).stop 2023-07-20T11:05:34.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 shutdown_connections 2023-07-20T11:05:34.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa38c0663a0 0x7fa38c068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a81596b0 0x7fa3a80c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa3a80cc900 0x7fa3a80991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 --2- 172.21.15.82:0/3505376105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3a80b2a90 0x7fa3a809b280 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 >> 172.21.15.82:0/3505376105 conn(0x7fa3a80cada0 msgr2=0x7fa3a8163be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 shutdown_connections 2023-07-20T11:05:34.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.180+0000 7fa3b03f3640 1 -- 172.21.15.82:0/3505376105 wait complete. 2023-07-20T11:05:34.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 Processor -- start 2023-07-20T11:05:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 -- start start 2023-07-20T11:05:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34e815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80ccd60 con 0x7f34e80cc900 2023-07-20T11:05:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e80ad810 con 0x7f34e80b2a90 2023-07-20T11:05:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ef159640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815d0d0 con 0x7f34e81596b0 2023-07-20T11:05:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f34e80cc900 0x7f34e80b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55602/0 (socket says 172.21.15.82:55602) 2023-07-20T11:05:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e7fff640 1 -- 172.21.15.82:0/2353542300 learned_addr learned my addr 172.21.15.82:0/2353542300 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34e815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505722684 0 0) 0x7f34e80ccd60 con 0x7f34e80cc900 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d8003530 con 0x7f34e80cc900 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 306052298 0 0) 0x7f34d8003530 con 0x7f34e80cc900 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 msgr2=0x7f34e815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34e815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 >> v1:172.21.15.183:6789/0 conn(0x7f34e80b2a90 legacy=0x7f34e80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e815d3b0 con 0x7f34e80cc900 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f34d4001680 con 0x7f34e80cc900 2023-07-20T11:05:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34e815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 >> v1:172.21.15.82:6789/0 conn(0x7f34e80cc900 legacy=0x7f34e80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d80039b0 0x7f34d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d8004d10 0x7f34d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815d0d0 con 0x7f34d80039b0 2023-07-20T11:05:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800ba40 con 0x7f34d8004d10 2023-07-20T11:05:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d800bc00 con 0x7f34e81596b0 2023-07-20T11:05:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d80039b0 0x7f34d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34e7fff640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ed6f6640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d8004d10 0x7f34d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 -- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 msgr2=0x7f34d80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34e81596b0 0x7f34d80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 -- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d8004d10 msgr2=0x7f34d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34d8004d10 0x7f34d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.344+0000 7f34ecef5640 1 -- 172.21.15.82:0/2353542300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc009a70 con 0x7f34d80039b0 2023-07-20T11:05:34.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ecef5640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d80039b0 0x7f34d8003dd0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00e320 tx=0x7f34dc01cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b08cf87d2d376a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0a5c70 con 0x7f34d80039b0 2023-07-20T11:05:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00f040 con 0x7f34d80039b0 2023-07-20T11:05:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34e77fe640 1 -- 172.21.15.82:0/2353542300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0ad440 con 0x7f34d80039b0 2023-07-20T11:05:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 -- 172.21.15.82:0/2353542300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d80039b0 msgr2=0x7f34d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 --2- 172.21.15.82:0/2353542300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34d80039b0 0x7f34d8003dd0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00e320 tx=0x7f34dc01cd70 comp rx=0 tx=0).stop 2023-07-20T11:05:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ed6f6640 1 -- 172.21.15.82:0/2353542300 reap_dead start 2023-07-20T11:05:34.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 -- 172.21.15.82:0/2353542300 shutdown_connections 2023-07-20T11:05:34.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 -- 172.21.15.82:0/2353542300 >> 172.21.15.82:0/2353542300 conn(0x7f34e80cada0 msgr2=0x7f34e80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 -- 172.21.15.82:0/2353542300 shutdown_connections 2023-07-20T11:05:34.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.348+0000 7f34ef159640 1 -- 172.21.15.82:0/2353542300 wait complete. 2023-07-20T11:05:34.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 Processor -- start 2023-07-20T11:05:34.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- start start 2023-07-20T11:05:34.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34d80039b0 0x7f34e81544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 0x7f34e815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c1e50 con 0x7f34e80c4a90 2023-07-20T11:05:34.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e815bde0 con 0x7f34e80c4610 2023-07-20T11:05:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8070a70 con 0x7f34d80039b0 2023-07-20T11:05:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34078/0 (socket says 172.21.15.82:34078) 2023-07-20T11:05:34.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 -- 172.21.15.82:0/1196276636 learned_addr learned my addr 172.21.15.82:0/1196276636 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:34.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ecef5640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34d80039b0 0x7f34e81544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34e7fff640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 0x7f34e815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 -- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34d80039b0 msgr2=0x7f34e81544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34d80039b0 0x7f34e81544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 -- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 msgr2=0x7f34e815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 0x7f34e815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 -- 172.21.15.82:0/1196276636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8070d50 con 0x7f34e80c4a90 2023-07-20T11:05:34.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34e7fff640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 0x7f34e815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:34.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ed6f6640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c10 tx=0x7f34e000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00052e0 con 0x7f34e80c4a90 2023-07-20T11:05:34.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0005460 con 0x7f34e80c4a90 2023-07-20T11:05:34.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0003840 con 0x7f34e80c4a90 2023-07-20T11:05:34.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e8071030 con 0x7f34e80c4a90 2023-07-20T11:05:34.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.352+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e81549f0 con 0x7f34e80c4a90 2023-07-20T11:05:34.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e80c22e0 con 0x7f34e80c4a90 2023-07-20T11:05:34.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34e00039a0 con 0x7f34e80c4a90 2023-07-20T11:05:34.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34e57fa640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 0x7f34cc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f34e0083520 con 0x7f34e80c4a90 2023-07-20T11:05:34.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34ecef5640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 0x7f34cc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.356+0000 7f34ecef5640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 0x7f34cc068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00e320 tx=0x7f34dc004ac0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.360+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34e80c22e0 con 0x7f34e80c4a90 2023-07-20T11:05:34.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.512+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34e80c22e0 con 0x7f34e80c4a90 2023-07-20T11:05:34.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.512+0000 7f34e57fa640 1 -- 172.21.15.82:0/1196276636 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+15871 (secure 0 0 0) 0x7f34e80c22e0 con 0x7f34e80c4a90 2023-07-20T11:05:34.493 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:34.494 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":149,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:31.161569+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4231089151":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/3221618049":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/96402490":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6837/2741581419":"2023-07-21T11:05:27.912510+0000","172.21.15.82:6833/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4062347335":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/2398472456":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/4125546988":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/3897637817":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6835/2741581419":"2023-07-21T11:05:27.912510+0000","172.21.15.82:0/1206262133":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1313050434":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/4117276803":"2023-07-21T11:05:25.119275+0000","172.21.15.82:0/1761844848":"2023-07-21T10:09:40.802557+0000","172.21.15.82:6833/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/2211374485":"2023-07-21T11:05:25.119275+0000","172.21.15.82:6832/3908346675":"2023-07-21T10:09:40.802557+0000","172.21.15.82:0/1145221661":"2023-07-21T10:09:40.802557+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 msgr2=0x7f34cc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 0x7f34cc068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00e320 tx=0x7f34dc004ac0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 msgr2=0x7f34e815b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f34e0000c10 tx=0x7f34e000e8a0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 shutdown_connections 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f34cc0663a0 0x7f34cc068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e80c4a90 0x7f34e815b8a0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f34e80c4610 0x7f34e815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 --2- 172.21.15.82:0/1196276636 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f34d80039b0 0x7f34e81544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 >> 172.21.15.82:0/1196276636 conn(0x7f34e80cada0 msgr2=0x7f34e80aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 shutdown_connections 2023-07-20T11:05:34.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.516+0000 7f34ef159640 1 -- 172.21.15.82:0/1196276636 wait complete. 2023-07-20T11:05:34.514 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:05:34.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:05:34.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 Processor -- start 2023-07-20T11:05:34.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 -- start start 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b0159450 0x7fe1b015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1b0159830 0x7fe1b00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe1b00cc3e0 0x7fe1b00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00cce90 con 0x7fe1b0159830 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b00cc8d0 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b7e0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00ccbb0 con 0x7fe1b0159450 2023-07-20T11:05:34.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1b0159830 0x7fe1b00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe1b0159830 0x7fe1b00cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34080/0 (socket says 172.21.15.82:34080) 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 -- 172.21.15.82:0/1643513472 learned_addr learned my addr 172.21.15.82:0/1643513472 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b63a8640 1 --2- 172.21.15.82:0/1643513472 >> v2:172.21.15.183:3300/0 conn(0x7fe1b00cc3e0 0x7fe1b00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b5ba7640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b0159450 0x7fe1b015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 -- 172.21.15.82:0/1643513472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b0159450 msgr2=0x7fe1b015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b0159450 0x7fe1b015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 -- 172.21.15.82:0/1643513472 >> v2:172.21.15.183:3300/0 conn(0x7fe1b00cc3e0 msgr2=0x7fe1b00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/1643513472 >> v2:172.21.15.183:3300/0 conn(0x7fe1b00cc3e0 0x7fe1b00afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.676+0000 7fe1b53a6640 1 -- 172.21.15.82:0/1643513472 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0159cc0 con 0x7fe1b0159830 2023-07-20T11:05:34.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b0159830 0x7fe1b00cbea0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00ce1b0 tx=0x7fe1a001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f89371b94de0691 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b4ba5640 1 -- 172.21.15.82:0/1643513472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00a7b40 con 0x7fe1b0159830 2023-07-20T11:05:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b4ba5640 1 -- 172.21.15.82:0/1643513472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a00a7ca0 con 0x7fe1b0159830 2023-07-20T11:05:34.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b4ba5640 1 -- 172.21.15.82:0/1643513472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00af660 con 0x7fe1b0159830 2023-07-20T11:05:34.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/1643513472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b0159830 msgr2=0x7fe1b00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b0159830 0x7fe1b00cbea0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00ce1b0 tx=0x7fe1a001eba0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/1643513472 shutdown_connections 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/1643513472 >> v2:172.21.15.183:3300/0 conn(0x7fe1b00cc3e0 0x7fe1b00afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b0159830 0x7fe1b00cbea0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/1643513472 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b0159450 0x7fe1b015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/1643513472 >> 172.21.15.82:0/1643513472 conn(0x7fe1b00cad50 msgr2=0x7fe1b00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/1643513472 shutdown_connections 2023-07-20T11:05:34.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.680+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/1643513472 wait complete. 2023-07-20T11:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 Processor -- start 2023-07-20T11:05:34.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- start start 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 0x7fe1b0154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b00c1dd0 0x7fe1b0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00c3620 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00c22d0 con 0x7fe1b0159450 2023-07-20T11:05:34.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00c25b0 con 0x7fe1b00c1dd0 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34090/0 (socket says 172.21.15.82:34090) 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 -- 172.21.15.82:0/3283117710 learned_addr learned my addr 172.21.15.82:0/3283117710 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 0x7fe1b0154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b63a8640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b00c1dd0 0x7fe1b0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 -- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b00c1dd0 msgr2=0x7fe1b0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b00c1dd0 0x7fe1b0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 -- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 msgr2=0x7fe1b0154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 0x7fe1b0154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 -- 172.21.15.82:0/3283117710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a000b770 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 0x7fe1b0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b5ba7640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac007ef0 tx=0x7fe1ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac014620 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac014780 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac014b30 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b00c2890 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.684+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b00ce780 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b00c3890 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe1ac014c90 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1a67fc640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 0x7fe194068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fe1ac084870 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 0x7fe194068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.688+0000 7fe1b53a6640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 0x7fe194068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b1000 tx=0x7fe1a00a9070 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.692+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1ac051be0 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1b00ce9d0 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1a67fc640 1 -- 172.21.15.82:0/3283117710 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1b00ce9d0 con 0x7fe1b00cc3e0 2023-07-20T11:05:34.821 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 msgr2=0x7fe194068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 0x7fe194068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00b1000 tx=0x7fe1a00a9070 comp rx=0 tx=0).stop 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 msgr2=0x7fe1b00ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac007ef0 tx=0x7fe1ac00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 shutdown_connections 2023-07-20T11:05:34.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fe1940663a0 0x7fe194068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe1b00c1dd0 0x7fe1b0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1b0159450 0x7fe1b0154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.840+0000 7fe1b7e0b640 1 --2- 172.21.15.82:0/3283117710 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1b00cc3e0 0x7fe1b00ce240 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.844+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 >> 172.21.15.82:0/3283117710 conn(0x7fe1b00cad50 msgr2=0x7fe1b015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.844+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 shutdown_connections 2023-07-20T11:05:34.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:34.844+0000 7fe1b7e0b640 1 -- 172.21.15.82:0/3283117710 wait complete. 2023-07-20T11:05:34.842 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:05:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 Processor -- start 2023-07-20T11:05:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 -- start start 2023-07-20T11:05:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85f40ca5a0 0x7f85f415e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85f415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f4071950 con 0x7f85f406f710 2023-07-20T11:05:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f415bad0 con 0x7f85f40ca5a0 2023-07-20T11:05:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f9a34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415b230 con 0x7f85f415ec90 2023-07-20T11:05:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f85f406f710 0x7f85f406faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55606/0 (socket says 172.21.15.82:55606) 2023-07-20T11:05:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f2ffd640 1 -- 172.21.15.82:0/1588037671 learned_addr learned my addr 172.21.15.82:0/1588037671 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85ea7fc640 1 --2- 172.21.15.82:0/1588037671 >> v2:172.21.15.183:3300/0 conn(0x7f85f40ca5a0 0x7f85f415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f37fe640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85f415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990105033 0 0) 0x7f85f4071950 con 0x7f85f406f710 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e0003530 con 0x7f85f406f710 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512941370 0 0) 0x7f85e0003530 con 0x7f85f406f710 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 msgr2=0x7f85f415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85f415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 >> v2:172.21.15.183:3300/0 conn(0x7f85f40ca5a0 msgr2=0x7f85f415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 --2- 172.21.15.82:0/1588037671 >> v2:172.21.15.183:3300/0 conn(0x7f85f40ca5a0 0x7f85f415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f415b510 con 0x7f85f406f710 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f85e4001680 con 0x7f85f406f710 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 >> v1:172.21.15.82:6789/0 conn(0x7f85f406f710 legacy=0x7f85f406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00039f0 0x7f85e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e0004d10 0x7f85e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415bad0 con 0x7f85e00039f0 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415b230 con 0x7f85e0004d10 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e000b990 con 0x7f85f415ec90 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00039f0 0x7f85e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85ea7fc640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.004+0000 7f85f37fe640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e0004d10 0x7f85e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 -- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 msgr2=0x7f85e00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85f415ec90 0x7f85e00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 -- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e0004d10 msgr2=0x7f85e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85e0004d10 0x7f85e0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 -- 172.21.15.82:0/1588037671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0003530 con 0x7f85e00039f0 2023-07-20T11:05:34.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00039f0 0x7f85e0003e10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c1c0 tx=0x7f85e4021020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40d6d436acde5e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40a9c10 con 0x7f85e00039f0 2023-07-20T11:05:34.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e40a9d70 con 0x7f85e00039f0 2023-07-20T11:05:34.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f27fc640 1 -- 172.21.15.82:0/1588037671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4005b20 con 0x7f85e00039f0 2023-07-20T11:05:34.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 -- 172.21.15.82:0/1588037671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00039f0 msgr2=0x7f85e0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1588037671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85e00039f0 0x7f85e0003e10 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c1c0 tx=0x7f85e4021020 comp rx=0 tx=0).stop 2023-07-20T11:05:34.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f37fe640 1 -- 172.21.15.82:0/1588037671 reap_dead start 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 -- 172.21.15.82:0/1588037671 shutdown_connections 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 -- 172.21.15.82:0/1588037671 >> 172.21.15.82:0/1588037671 conn(0x7f85f40cad50 msgr2=0x7f85f40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 -- 172.21.15.82:0/1588037671 shutdown_connections 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.008+0000 7f85f9a34640 1 -- 172.21.15.82:0/1588037671 wait complete. 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 Processor -- start 2023-07-20T11:05:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 -- start start 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00039f0 0x7f85f40c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f41507b0 0x7f85f40c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40c77d0 con 0x7f85f414ffe0 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40c53a0 con 0x7f85f41507b0 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40c5680 con 0x7f85e00039f0 2023-07-20T11:05:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34108/0 (socket says 172.21.15.82:34108) 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 -- 172.21.15.82:0/1068914182 learned_addr learned my addr 172.21.15.82:0/1068914182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00039f0 0x7f85f40c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85ea7fc640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f41507b0 0x7f85f40c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 -- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00039f0 msgr2=0x7f85f40c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00039f0 0x7f85f40c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 -- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f41507b0 msgr2=0x7f85f40c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f41507b0 0x7f85f40c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 -- 172.21.15.82:0/1068914182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40c5960 con 0x7f85f414ffe0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f37fe640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f85f40702f0 tx=0x7f85ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00e040 con 0x7f85f414ffe0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec00f040 con 0x7f85f414ffe0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec015430 con 0x7f85f414ffe0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.012+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f40c5c40 con 0x7f85f414ffe0 2023-07-20T11:05:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f4150460 con 0x7f85f414ffe0 2023-07-20T11:05:34.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f40c5e30 con 0x7f85f414ffe0 2023-07-20T11:05:34.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85ec015590 con 0x7f85f414ffe0 2023-07-20T11:05:34.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f0ff9640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 0x7f85d4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f85ec084590 con 0x7f85f414ffe0 2023-07-20T11:05:35.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 0x7f85d4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.016+0000 7f85f2ffd640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 0x7f85d4068890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85e40af000 tx=0x7f85e40ab070 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.020+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85ec051880 con 0x7f85f414ffe0 2023-07-20T11:05:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85f404da30 con 0x7f85f414ffe0 2023-07-20T11:05:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f0ff9640 1 -- 172.21.15.82:0/1068914182 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f85ec054ea0 con 0x7f85f414ffe0 2023-07-20T11:05:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:05:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 msgr2=0x7f85d4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 0x7f85d4068890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f85e40af000 tx=0x7f85e40ab070 comp rx=0 tx=0).stop 2023-07-20T11:05:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 msgr2=0x7f85f40afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f85f40702f0 tx=0x7f85ec00f580 comp rx=0 tx=0).stop 2023-07-20T11:05:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 shutdown_connections 2023-07-20T11:05:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85d40663d0 0x7f85d4068890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85f414ffe0 0x7f85f40afa40 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85f41507b0 0x7f85f40c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 --2- 172.21.15.82:0/1068914182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85e00039f0 0x7f85f40c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 >> 172.21.15.82:0/1068914182 conn(0x7f85f40cad50 msgr2=0x7f85f40c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:35.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 shutdown_connections 2023-07-20T11:05:35.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.172+0000 7f85f9a34640 1 -- 172.21.15.82:0/1068914182 wait complete. 2023-07-20T11:05:35.174 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T11:05:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.332+0000 7fbe93ba3640 1 Processor -- start 2023-07-20T11:05:35.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 -- start start 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe8c06f710 0x7fbe8c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 0x7fbe8c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 0x7fbe8c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c15bad0 con 0x7fbe8c06f710 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c070030 con 0x7fbe8c15ec90 2023-07-20T11:05:35.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe93ba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c071950 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe8c06f710 0x7fbe8c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbe8c06f710 0x7fbe8c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34122/0 (socket says 172.21.15.82:34122) 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 -- 172.21.15.82:0/4201207949 learned_addr learned my addr 172.21.15.82:0/4201207949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe92140640 1 --2- 172.21.15.82:0/4201207949 >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 0x7fbe8c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9113e640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 0x7fbe8c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 -- 172.21.15.82:0/4201207949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 msgr2=0x7fbe8c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:35.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 0x7fbe8c15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 -- 172.21.15.82:0/4201207949 >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 msgr2=0x7fbe8c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4201207949 >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 0x7fbe8c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9193f640 1 -- 172.21.15.82:0/4201207949 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c15b230 con 0x7fbe8c06f710 2023-07-20T11:05:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe92140640 1 --2- 172.21.15.82:0/4201207949 >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 0x7fbe8c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:35.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.336+0000 7fbe9113e640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 0x7fbe8c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c06f710 0x7fbe8c06faf0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0702d0 tx=0x7fbe8801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b666b91b4b0989 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe9093d640 1 -- 172.21.15.82:0/4201207949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880a5730 con 0x7fbe8c06f710 2023-07-20T11:05:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe9093d640 1 -- 172.21.15.82:0/4201207949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880a5890 con 0x7fbe8c06f710 2023-07-20T11:05:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe9093d640 1 -- 172.21.15.82:0/4201207949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880a5c20 con 0x7fbe8c06f710 2023-07-20T11:05:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4201207949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c06f710 msgr2=0x7fbe8c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c06f710 0x7fbe8c06faf0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0702d0 tx=0x7fbe8801c9a0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4201207949 shutdown_connections 2023-07-20T11:05:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4201207949 >> v2:172.21.15.183:3300/0 conn(0x7fbe8c15ec90 0x7fbe8c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c0ca5a0 0x7fbe8c15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4201207949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c06f710 0x7fbe8c06faf0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4201207949 >> 172.21.15.82:0/4201207949 conn(0x7fbe8c0cad50 msgr2=0x7fbe8c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4201207949 shutdown_connections 2023-07-20T11:05:35.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4201207949 wait complete. 2023-07-20T11:05:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 Processor -- start 2023-07-20T11:05:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.340+0000 7fbe93ba3640 1 -- start start 2023-07-20T11:05:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c06f710 0x7fbe8c0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe8c15ec90 0x7fbe8c0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c86d0 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c7390 con 0x7fbe8c15ec90 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c0c7630 con 0x7fbe8c06f710 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34124/0 (socket says 172.21.15.82:34124) 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 -- 172.21.15.82:0/4058869593 learned_addr learned my addr 172.21.15.82:0/4058869593 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:35.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c06f710 0x7fbe8c0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe92140640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe8c15ec90 0x7fbe8c0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 -- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c06f710 msgr2=0x7fbe8c0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c06f710 0x7fbe8c0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 -- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe8c15ec90 msgr2=0x7fbe8c0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe8c15ec90 0x7fbe8c0c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 -- 172.21.15.82:0/4058869593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe88009b30 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe9113e640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c7c0 tx=0x7fbe7c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c007a30 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c007b90 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c0c7910 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00ce70 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c0c7ed0 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c04da30 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.344+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbe7c0113f0 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.348+0000 7fbe827fc640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 0x7fbe70068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.348+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fbe7c0840f0 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.348+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 0x7fbe70068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.348+0000 7fbe9193f640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 0x7fbe70068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ae000 tx=0x7fbe880a7070 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.352+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe7c051370 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.496+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbe8c072e00 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe827fc640 1 -- 172.21.15.82:0/4058869593 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe7c054990 con 0x7fbe8c0ca5a0 2023-07-20T11:05:35.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 msgr2=0x7fbe70068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 0x7fbe70068860 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ae000 tx=0x7fbe880a7070 comp rx=0 tx=0).stop 2023-07-20T11:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 msgr2=0x7fbe8c146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00c7c0 tx=0x7fbe7c00cc80 comp rx=0 tx=0).stop 2023-07-20T11:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 shutdown_connections 2023-07-20T11:05:35.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fbe700663a0 0x7fbe70068860 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbe8c15ec90 0x7fbe8c0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe8c0ca5a0 0x7fbe8c146850 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 --2- 172.21.15.82:0/4058869593 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbe8c06f710 0x7fbe8c0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 >> 172.21.15.82:0/4058869593 conn(0x7fbe8c0cad50 msgr2=0x7fbe8c06bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 shutdown_connections 2023-07-20T11:05:35.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.504+0000 7fbe93ba3640 1 -- 172.21.15.82:0/4058869593 wait complete. 2023-07-20T11:05:35.504 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:05:35.505 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:05:35.573 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:05:35.623 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:05:35.624 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:35.624 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:35.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:05:35.634 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:05:35.634 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:35.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:05:35.644 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:35.644 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:35.682 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:05:35.683 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:05:35.683 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:35.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:05:35.693 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T11:05:35.694 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:35.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 Processor -- start 2023-07-20T11:05:35.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 -- start start 2023-07-20T11:05:35.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f6c15d060 0x7f5f6c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c070660 con 0x7f5f6c15d440 2023-07-20T11:05:35.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0cd490 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72f05640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0ca6f0 con 0x7f5f6c15d060 2023-07-20T11:05:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72704640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5f6c15d440 0x7f5f6c071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55608/0 (socket says 172.21.15.82:55608) 2023-07-20T11:05:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f72704640 1 -- 172.21.15.82:0/1770328431 learned_addr learned my addr 172.21.15.82:0/1770328431 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:35.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f71f03640 1 --2- 172.21.15.82:0/1770328431 >> v2:172.21.15.183:3300/0 conn(0x7f5f6c15d060 0x7f5f6c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f70f01640 1 -- 172.21.15.82:0/1770328431 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454268525 0 0) 0x7f5f6c070660 con 0x7f5f6c15d440 2023-07-20T11:05:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.888+0000 7f5f70f01640 1 -- 172.21.15.82:0/1770328431 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f58003530 con 0x7f5f6c15d440 2023-07-20T11:05:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f71f03640 1 -- 172.21.15.82:0/1770328431 >> v1:172.21.15.183:6789/0 conn(0x7f5f6c0c86d0 legacy=0x7f5f6c070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f71f03640 1 -- 172.21.15.82:0/1770328431 >> v1:172.21.15.82:6789/0 conn(0x7f5f6c15d440 legacy=0x7f5f6c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f71f03640 1 -- 172.21.15.82:0/1770328431 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0cd770 con 0x7f5f6c15d060 2023-07-20T11:05:35.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f71f03640 1 --2- 172.21.15.82:0/1770328431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d060 0x7f5f6c06c3d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009d90 tx=0x7f5f6801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372c5fa7a7c75a75 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f70f01640 1 -- 172.21.15.82:0/1770328431 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680a59e0 con 0x7f5f6c15d060 2023-07-20T11:05:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f70f01640 1 -- 172.21.15.82:0/1770328431 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680a5b40 con 0x7f5f6c15d060 2023-07-20T11:05:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f70f01640 1 -- 172.21.15.82:0/1770328431 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680ad440 con 0x7f5f6c15d060 2023-07-20T11:05:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f72f05640 1 -- 172.21.15.82:0/1770328431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d060 msgr2=0x7f5f6c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f72f05640 1 --2- 172.21.15.82:0/1770328431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d060 0x7f5f6c06c3d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009d90 tx=0x7f5f6801c920 comp rx=0 tx=0).stop 2023-07-20T11:05:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f72f05640 1 -- 172.21.15.82:0/1770328431 shutdown_connections 2023-07-20T11:05:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f72f05640 1 --2- 172.21.15.82:0/1770328431 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d060 0x7f5f6c06c3d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.892+0000 7f5f72f05640 1 -- 172.21.15.82:0/1770328431 >> 172.21.15.82:0/1770328431 conn(0x7f5f6c0ce080 msgr2=0x7f5f6c0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- 172.21.15.82:0/1770328431 shutdown_connections 2023-07-20T11:05:35.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- 172.21.15.82:0/1770328431 wait complete. 2023-07-20T11:05:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 Processor -- start 2023-07-20T11:05:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- start start 2023-07-20T11:05:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f6c15d060 0x7f5f6c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d440 0x7f5f6c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15c060 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c153580 con 0x7f5f6c15d440 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72f05640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c15baa0 con 0x7f5f6c15d060 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34132/0 (socket says 172.21.15.82:34132) 2023-07-20T11:05:35.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 -- 172.21.15.82:0/2509157825 learned_addr learned my addr 172.21.15.82:0/2509157825 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71702640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f6c15d060 0x7f5f6c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f72704640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d440 0x7f5f6c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 -- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f6c15d060 msgr2=0x7f5f6c153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f6c15d060 0x7f5f6c153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 -- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d440 msgr2=0x7f5f6c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d440 0x7f5f6c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:35.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 -- 172.21.15.82:0/2509157825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68009a70 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.896+0000 7f5f71f03640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009d90 tx=0x7f5f680196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68009450 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f680adbd0 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c15bd80 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f680b8420 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c152b20 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c152d10 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5f680b8580 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 0x7f5f50068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f5f6811f900 con 0x7f5f6c0c86d0 2023-07-20T11:05:35.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f71702640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 0x7f5f50068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.900+0000 7f5f71702640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 0x7f5f50068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c06c330 tx=0x7f5f5c009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:35.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:35.904+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f680ecc80 con 0x7f5f6c0c86d0 2023-07-20T11:05:36.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f6c04da30 con 0x7f5f6c0c86d0 2023-07-20T11:05:36.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f627fc640 1 -- 172.21.15.82:0/2509157825 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f5f680b2de0 con 0x7f5f6c0c86d0 2023-07-20T11:05:36.064 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:36.065 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3072939279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3072939279},{"type":"v1","addr":"172.21.15.183:6835","nonce":3072939279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/3354559455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3354559455},{"type":"v1","addr":"172.21.15.183:6834","nonce":3354559455}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":8994,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2294574059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2294574059},{"type":"v1","addr":"172.21.15.82:6836","nonce":2294574059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61},{"gid":9489,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1643157906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1643157906},{"type":"v1","addr":"172.21.15.82:6837","nonce":1643157906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68}],"filesystems":[]} 2023-07-20T11:05:36.065 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 68 2023-07-20T11:05:36.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 msgr2=0x7f5f50068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 0x7f5f50068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c06c330 tx=0x7f5f5c009040 comp rx=0 tx=0).stop 2023-07-20T11:05:36.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 msgr2=0x7f5f6c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009d90 tx=0x7f5f680196c0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 shutdown_connections 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5f500663a0 0x7f5f50068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f6c15d440 0x7f5f6c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f6c15d060 0x7f5f6c153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 --2- 172.21.15.82:0/2509157825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f6c0c86d0 0x7f5f6c1588a0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 >> 172.21.15.82:0/2509157825 conn(0x7f5f6c0ce080 msgr2=0x7f5f6c1542a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 shutdown_connections 2023-07-20T11:05:36.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.084+0000 7f5f72f05640 1 -- 172.21.15.82:0/2509157825 wait complete. 2023-07-20T11:05:36.086 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T11:05:36.086 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T11:05:36.086 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T11:05:36.087 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:05:36.087 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T11:05:36.087 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T11:05:36.087 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T11:05:36.087 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:05:36.088 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T11:05:36.088 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T11:05:36.088 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T11:05:36.088 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:05:36.089 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T11:05:36.089 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T11:05:36.089 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T11:05:36.089 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:05:36.099 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T11:05:36.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T11:05:36.100 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T11:05:36.101 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T11:05:36.104 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T11:05:36.104 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T11:05:36.105 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T11:05:36.106 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T11:05:36.145 INFO:tasks.ceph.mds.a:Started 2023-07-20T11:05:36.146 DEBUG:teuthology.parallel:result is None 2023-07-20T11:05:36.147 INFO:tasks.ceph.mds.c:Started 2023-07-20T11:05:36.148 DEBUG:teuthology.parallel:result is None 2023-07-20T11:05:36.155 INFO:tasks.ceph.mds.b:Started 2023-07-20T11:05:36.156 DEBUG:teuthology.parallel:result is None 2023-07-20T11:05:36.158 INFO:tasks.ceph.mds.d:Started 2023-07-20T11:05:36.159 DEBUG:teuthology.parallel:result is None 2023-07-20T11:05:36.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T11:05:36.236 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T11:05:36.236 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:05:36.249 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T11:05:36.249 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T11:05:36.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 Processor -- start 2023-07-20T11:05:36.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 -- start start 2023-07-20T11:05:36.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13d80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f13d80d0d10 0x7f13d80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80d16b0 con 0x7f13d80cf110 2023-07-20T11:05:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80d31c0 con 0x7f13d80d0d10 2023-07-20T11:05:36.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13dd9ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80b3520 con 0x7f13d815cab0 2023-07-20T11:05:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.328+0000 7f13d77fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f13d80cf110 0x7f13d80cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55630/0 (socket says 172.21.15.82:55630) 2023-07-20T11:05:36.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d77fe640 1 -- 172.21.15.82:0/1156163764 learned_addr learned my addr 172.21.15.82:0/1156163764 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1156163764 >> v2:172.21.15.183:3300/0 conn(0x7f13d80d0d10 0x7f13d80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13d80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196680317 0 0) 0x7f13d80d16b0 con 0x7f13d80cf110 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c4003530 con 0x7f13d80cf110 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1569635264 0 0) 0x7f13c4003530 con 0x7f13d80cf110 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 msgr2=0x7f13d80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13d80d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 >> v2:172.21.15.183:3300/0 conn(0x7f13d80d0d10 msgr2=0x7f13d80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 --2- 172.21.15.82:0/1156163764 >> v2:172.21.15.183:3300/0 conn(0x7f13d80d0d10 0x7f13d80d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d80b2910 con 0x7f13d80cf110 2023-07-20T11:05:36.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f13d0001680 con 0x7f13d80cf110 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 >> v1:172.21.15.82:6789/0 conn(0x7f13d80cf110 legacy=0x7f13d80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c40047d0 0x7f13c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80b3520 con 0x7f13c40047d0 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c400b990 con 0x7f13c4003980 2023-07-20T11:05:36.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c400bad0 con 0x7f13d815cab0 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1156163764 >> v2:172.21.15.183:3300/0 conn(0x7f13d80d0d10 0x7f13d80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d77fe640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c40047d0 0x7f13c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 -- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 msgr2=0x7f13c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d815cab0 0x7f13c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 -- 172.21.15.82:0/1156163764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c40047d0 msgr2=0x7f13c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:36.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c40047d0 0x7f13c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13d6ffd640 1 -- 172.21.15.82:0/1156163764 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c4003530 con 0x7f13c4003980 2023-07-20T11:05:36.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.332+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13c40047d0 0x7f13c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13c4003da0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009fc0 tx=0x7f13c801cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d404bf6bb7570330 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80a5b90 con 0x7f13c4003980 2023-07-20T11:05:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800f040 con 0x7f13c4003980 2023-07-20T11:05:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13d67fc640 1 -- 172.21.15.82:0/1156163764 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ad440 con 0x7f13c4003980 2023-07-20T11:05:36.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 msgr2=0x7f13c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1156163764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13c4003da0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009fc0 tx=0x7f13c801cc60 comp rx=0 tx=0).stop 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13d77fe640 1 -- 172.21.15.82:0/1156163764 reap_dead start 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1156163764 shutdown_connections 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1156163764 >> 172.21.15.82:0/1156163764 conn(0x7f13d808c120 msgr2=0x7f13d809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1156163764 shutdown_connections 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1156163764 wait complete. 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 Processor -- start 2023-07-20T11:05:36.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.336+0000 7f13dd9ba640 1 -- start start 2023-07-20T11:05:36.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13d815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d81e53f0 0x7f13d81e5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d815d8d0 con 0x7f13d815cf30 2023-07-20T11:05:36.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81e6d00 con 0x7f13c4003980 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81e6180 con 0x7f13d81e53f0 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34168/0 (socket says 172.21.15.82:34168) 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 -- 172.21.15.82:0/1828344258 learned_addr learned my addr 172.21.15.82:0/1828344258 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13d815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d77fe640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d81e53f0 0x7f13d81e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 -- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d81e53f0 msgr2=0x7f13d81e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d81e53f0 0x7f13d81e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 -- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 msgr2=0x7f13d815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13d815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 -- 172.21.15.82:0/1828344258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d81e6460 con 0x7f13d815cf30 2023-07-20T11:05:36.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13ce7fc640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006d50 tx=0x7f13c000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011ed0 con 0x7f13d815cf30 2023-07-20T11:05:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000fe40 con 0x7f13d815cf30 2023-07-20T11:05:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d81e6740 con 0x7f13d815cf30 2023-07-20T11:05:36.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0014680 con 0x7f13d815cf30 2023-07-20T11:05:36.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d815fd60 con 0x7f13d815cf30 2023-07-20T11:05:36.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d80c6700 con 0x7f13d815cf30 2023-07-20T11:05:36.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.340+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f13c00147e0 con 0x7f13d815cf30 2023-07-20T11:05:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.344+0000 7f13d4ff9640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 0x7f13b8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.344+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f13c0084920 con 0x7f13d815cf30 2023-07-20T11:05:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.344+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 0x7f13b8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:36.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.344+0000 7f13d6ffd640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 0x7f13b8068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13c80af000 tx=0x7f13c8004ac0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:36.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.348+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13d80c6700 con 0x7f13d815cf30 2023-07-20T11:05:36.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:36.504+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13d80c6700 con 0x7f13d815cf30 2023-07-20T11:05:38.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.096+0000 7f13d4ff9640 1 -- 172.21.15.82:0/1828344258 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13d80c6700 con 0x7f13d815cf30 2023-07-20T11:05:38.077 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T11:05:38.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 msgr2=0x7f13b8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 0x7f13b8068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13c80af000 tx=0x7f13c8004ac0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 msgr2=0x7f13d815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f13c0006d50 tx=0x7f13c000f610 comp rx=0 tx=0).stop 2023-07-20T11:05:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 shutdown_connections 2023-07-20T11:05:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f13b80663d0 0x7f13b8068890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f13d81e53f0 0x7f13d81e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13d815cf30 0x7f13d815d390 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 --2- 172.21.15.82:0/1828344258 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f13c4003980 0x7f13d815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 >> 172.21.15.82:0/1828344258 conn(0x7f13d808c120 msgr2=0x7f13d80cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 shutdown_connections 2023-07-20T11:05:38.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.100+0000 7f13dd9ba640 1 -- 172.21.15.82:0/1828344258 wait complete. 2023-07-20T11:05:38.103 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T11:05:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 Processor -- start 2023-07-20T11:05:38.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 -- start start 2023-07-20T11:05:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f37880d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37880ce4c0 0x7f37880d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880d16b0 con 0x7f37880d0d10 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37880d31c0 con 0x7f37880ce4c0 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378ffd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37880b3520 con 0x7f378815cab0 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378e56f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37880ce4c0 0x7f37880d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378d56d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f37880d0d10 0x7f37880cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55638/0 (socket says 172.21.15.82:55638) 2023-07-20T11:05:38.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378d56d640 1 -- 172.21.15.82:0/1757040089 learned_addr learned my addr 172.21.15.82:0/1757040089 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:38.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378dd6e640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f37880d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378e56f640 1 -- 172.21.15.82:0/1757040089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 msgr2=0x7f37880d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:38.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378e56f640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f37880d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378e56f640 1 -- 172.21.15.82:0/1757040089 >> v1:172.21.15.82:6789/0 conn(0x7f37880d0d10 legacy=0x7f37880cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378e56f640 1 -- 172.21.15.82:0/1757040089 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880b2910 con 0x7f37880ce4c0 2023-07-20T11:05:38.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.268+0000 7f378cd6c640 1 -- 172.21.15.82:0/1757040089 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980501104 0 0) 0x7f37880d16b0 con 0x7f37880d0d10 2023-07-20T11:05:38.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378e56f640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880d1170 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f3780009d90 tx=0x7f378001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6654b7bef17194 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378cd6c640 1 -- 172.21.15.82:0/1757040089 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800a5900 con 0x7f37880ce4c0 2023-07-20T11:05:38.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378cd6c640 1 -- 172.21.15.82:0/1757040089 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37800a5a60 con 0x7f37880ce4c0 2023-07-20T11:05:38.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378cd6c640 1 -- 172.21.15.82:0/1757040089 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37800a5df0 con 0x7f37880ce4c0 2023-07-20T11:05:38.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 -- 172.21.15.82:0/1757040089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 msgr2=0x7f37880d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880d1170 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f3780009d90 tx=0x7f378001c920 comp rx=0 tx=0).stop 2023-07-20T11:05:38.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 -- 172.21.15.82:0/1757040089 shutdown_connections 2023-07-20T11:05:38.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880d1170 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 --2- 172.21.15.82:0/1757040089 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f37880d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 -- 172.21.15.82:0/1757040089 >> 172.21.15.82:0/1757040089 conn(0x7f378808c120 msgr2=0x7f378809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 -- 172.21.15.82:0/1757040089 shutdown_connections 2023-07-20T11:05:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.272+0000 7f378ffd2640 1 -- 172.21.15.82:0/1757040089 wait complete. 2023-07-20T11:05:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 Processor -- start 2023-07-20T11:05:38.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- start start 2023-07-20T11:05:38.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37880d0d10 0x7f3788157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f378806b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880b67d0 con 0x7f37880ce4c0 2023-07-20T11:05:38.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378815dd90 con 0x7f37880d0d10 2023-07-20T11:05:38.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3788158990 con 0x7f378815cab0 2023-07-20T11:05:38.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34190/0 (socket says 172.21.15.82:34190) 2023-07-20T11:05:38.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 -- 172.21.15.82:0/531402088 learned_addr learned my addr 172.21.15.82:0/531402088 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 -- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 msgr2=0x7f378806b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f378806b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 -- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37880d0d10 msgr2=0x7f3788157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37880d0d10 0x7f3788157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 -- 172.21.15.82:0/531402088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009a70 con 0x7f37880ce4c0 2023-07-20T11:05:38.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378dd6e640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f378400d800 tx=0x7f378400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400b6c0 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400b820 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400bbb0 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3788158c70 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.276+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3788158460 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378815dbf0 con 0x7f37880ce4c0 2023-07-20T11:05:38.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f378400bd10 con 0x7f37880ce4c0 2023-07-20T11:05:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f377e7fc640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f37840840b0 con 0x7f37880ce4c0 2023-07-20T11:05:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f378d56d640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.280+0000 7f378d56d640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 0x7f376c068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37780011f0 tx=0x7f3778007930 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.284+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f378815dbf0 con 0x7f37880ce4c0 2023-07-20T11:05:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.480+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f378815dbf0 con 0x7f37880ce4c0 2023-07-20T11:05:38.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.480+0000 7f377e7fc640 1 -- 172.21.15.82:0/531402088 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f378815dbf0 con 0x7f37880ce4c0 2023-07-20T11:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:38.463 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:05:38.464 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T11:05:38.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.464 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T11:05:38.464 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T11:05:38.465 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.465 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.465 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:05:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:05:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:05:38.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T11:05:38.468 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.469 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.472 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T11:05:38.474 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T11:05:38.475 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.478 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.479 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T11:05:38.479 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T11:05:38.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:05:38.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T11:05:38.483 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.484 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:05:38.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T11:05:38.488 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T11:05:38.489 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:05:38.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 msgr2=0x7f376c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 0x7f376c068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37780011f0 tx=0x7f3778007930 comp rx=0 tx=0).stop 2023-07-20T11:05:38.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 msgr2=0x7f37880c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f378400d800 tx=0x7f378400dcc0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 shutdown_connections 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f376c0663a0 0x7f376c068860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f378815cab0 0x7f378806b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f37880d0d10 0x7f3788157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 --2- 172.21.15.82:0/531402088 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37880ce4c0 0x7f37880c8d40 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 >> 172.21.15.82:0/531402088 conn(0x7f378808c120 msgr2=0x7f37880d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 shutdown_connections 2023-07-20T11:05:38.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.484+0000 7f378ffd2640 1 -- 172.21.15.82:0/531402088 wait complete. 2023-07-20T11:05:38.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 Processor -- start 2023-07-20T11:05:38.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 -- start start 2023-07-20T11:05:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f005815c590 0x7f00580cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00580cd730 0x7f00580cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580cf880 con 0x7f00580d0d00 2023-07-20T11:05:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580cd2a0 con 0x7f00580cd730 2023-07-20T11:05:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f005d29c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b4f50 con 0x7f005815c590 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00577fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00580cd730 0x7f00580cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00567fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00580d0d00 0x7f00580b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55640/0 (socket says 172.21.15.82:55640) 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00567fc640 1 -- 172.21.15.82:0/4242910932 learned_addr learned my addr 172.21.15.82:0/4242910932 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f0056ffd640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f005815c590 0x7f00580cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00577fe640 1 -- 172.21.15.82:0/4242910932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f005815c590 msgr2=0x7f00580cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00577fe640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f005815c590 0x7f00580cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00577fe640 1 -- 172.21.15.82:0/4242910932 >> v1:172.21.15.82:6789/0 conn(0x7f00580d0d00 legacy=0x7f00580b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f00577fe640 1 -- 172.21.15.82:0/4242910932 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580cfab0 con 0x7f00580cd730 2023-07-20T11:05:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.651+0000 7f0055ffb640 1 -- 172.21.15.82:0/4242910932 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528666430 0 0) 0x7f00580cf880 con 0x7f00580d0d00 2023-07-20T11:05:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f00577fe640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f00580cdba0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0050009d90 tx=0x7f005001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fede9a9b972b7d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f0055ffb640 1 -- 172.21.15.82:0/4242910932 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00500a5950 con 0x7f00580cd730 2023-07-20T11:05:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f0055ffb640 1 -- 172.21.15.82:0/4242910932 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00500a5ab0 con 0x7f00580cd730 2023-07-20T11:05:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f0055ffb640 1 -- 172.21.15.82:0/4242910932 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00500a5e40 con 0x7f00580cd730 2023-07-20T11:05:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 -- 172.21.15.82:0/4242910932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 msgr2=0x7f00580cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f00580cdba0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0050009d90 tx=0x7f005001c890 comp rx=0 tx=0).stop 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 -- 172.21.15.82:0/4242910932 shutdown_connections 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f00580cdba0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 --2- 172.21.15.82:0/4242910932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f005815c590 0x7f00580cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 -- 172.21.15.82:0/4242910932 >> 172.21.15.82:0/4242910932 conn(0x7f00580654e0 msgr2=0x7f00580658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 -- 172.21.15.82:0/4242910932 shutdown_connections 2023-07-20T11:05:38.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.655+0000 7f005d29c640 1 -- 172.21.15.82:0/4242910932 wait complete. 2023-07-20T11:05:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 Processor -- start 2023-07-20T11:05:38.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- start start 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00580d0d00 0x7f0058150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f005815c590 0x7f005814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058150b60 con 0x7f00580cd730 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005814f580 con 0x7f005815c590 2023-07-20T11:05:38.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005814f860 con 0x7f00580d0d00 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34196/0 (socket says 172.21.15.82:34196) 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 -- 172.21.15.82:0/1709971289 learned_addr learned my addr 172.21.15.82:0/1709971289 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f00567fc640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00580d0d00 0x7f0058150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f00577fe640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f005815c590 0x7f005814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 -- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00580d0d00 msgr2=0x7f0058150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00580d0d00 0x7f0058150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 -- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f005815c590 msgr2=0x7f005814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f005815c590 0x7f005814cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 -- 172.21.15.82:0/1709971289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009a70 con 0x7f00580cd730 2023-07-20T11:05:38.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f0056ffd640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f004000d5f0 tx=0x7f004000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00400125f0 con 0x7f00580cd730 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040012750 con 0x7f00580cd730 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005814fb40 con 0x7f00580cd730 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040012ae0 con 0x7f00580cd730 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.659+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0058150100 con 0x7f00580cd730 2023-07-20T11:05:38.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005804da30 con 0x7f00580cd730 2023-07-20T11:05:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0040012c40 con 0x7f00580cd730 2023-07-20T11:05:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f004f7fe640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 0x7f0038068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f0040084090 con 0x7f00580cd730 2023-07-20T11:05:38.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f00567fc640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 0x7f0038068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.663+0000 7f00567fc640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 0x7f0038068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00580c53f0 tx=0x7f0048009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.667+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00400516f0 con 0x7f00580cd730 2023-07-20T11:05:38.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.815+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00580b3110 con 0x7f00580cd730 2023-07-20T11:05:38.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f004f7fe640 1 -- 172.21.15.82:0/1709971289 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+14740 (secure 0 0 0) 0x7f0040054d10 con 0x7f00580cd730 2023-07-20T11:05:38.800 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:38.800 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":154,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:38.088254+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:38.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 msgr2=0x7f0038068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 0x7f0038068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00580c53f0 tx=0x7f0048009040 comp rx=0 tx=0).stop 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 msgr2=0x7f005814ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f004000d5f0 tx=0x7f004000dab0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 shutdown_connections 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00380663a0 0x7f0038068860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f005815c590 0x7f005814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00580d0d00 0x7f0058150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 --2- 172.21.15.82:0/1709971289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00580cd730 0x7f005814ec80 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 >> 172.21.15.82:0/1709971289 conn(0x7f00580654e0 msgr2=0x7f00580b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 shutdown_connections 2023-07-20T11:05:38.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.819+0000 7f005d29c640 1 -- 172.21.15.82:0/1709971289 wait complete. 2023-07-20T11:05:38.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:05:38.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:05:38.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.991+0000 7f9a98f59640 1 Processor -- start 2023-07-20T11:05:38.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.991+0000 7f9a98f59640 1 -- start start 2023-07-20T11:05:38.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a98f59640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a9406f710 0x7f9a9406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a98f59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a9415a6f0 0x7f9a9415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a98f59640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a94070030 con 0x7f9a940ca5a0 2023-07-20T11:05:38.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a98f59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9415bad0 con 0x7f9a9415a6f0 2023-07-20T11:05:38.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a98f59640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a94071950 con 0x7f9a9406f710 2023-07-20T11:05:38.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a9415a6f0 0x7f9a9415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a9415a6f0 0x7f9a9415ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34200/0 (socket says 172.21.15.82:34200) 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 -- 172.21.15.82:0/2551430325 learned_addr learned my addr 172.21.15.82:0/2551430325 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a9259c640 1 --2- 172.21.15.82:0/2551430325 >> v2:172.21.15.183:3300/0 conn(0x7f9a9406f710 0x7f9a9406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 -- 172.21.15.82:0/2551430325 >> v2:172.21.15.183:3300/0 conn(0x7f9a9406f710 msgr2=0x7f9a9406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 --2- 172.21.15.82:0/2551430325 >> v2:172.21.15.183:3300/0 conn(0x7f9a9406f710 0x7f9a9406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 -- 172.21.15.82:0/2551430325 >> v1:172.21.15.183:6789/0 conn(0x7f9a940ca5a0 legacy=0x7f9a9415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:38.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 -- 172.21.15.82:0/2551430325 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9415b230 con 0x7f9a9415a6f0 2023-07-20T11:05:38.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.995+0000 7f9a92d9d640 1 --2- 172.21.15.82:0/2551430325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9415a6f0 0x7f9a9415ab40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ce230 tx=0x7f9a8c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30914d8264df765 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a9159a640 1 -- 172.21.15.82:0/2551430325 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a5740 con 0x7f9a9415a6f0 2023-07-20T11:05:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a9159a640 1 -- 172.21.15.82:0/2551430325 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0a58a0 con 0x7f9a9415a6f0 2023-07-20T11:05:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a9159a640 1 -- 172.21.15.82:0/2551430325 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c0a5c30 con 0x7f9a9415a6f0 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- 172.21.15.82:0/2551430325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9415a6f0 msgr2=0x7f9a9415ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- 172.21.15.82:0/2551430325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9415a6f0 0x7f9a9415ab40 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ce230 tx=0x7f9a8c01c990 comp rx=0 tx=0).stop 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- 172.21.15.82:0/2551430325 shutdown_connections 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- 172.21.15.82:0/2551430325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9415a6f0 0x7f9a9415ab40 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- 172.21.15.82:0/2551430325 >> v2:172.21.15.183:3300/0 conn(0x7f9a9406f710 0x7f9a9406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- 172.21.15.82:0/2551430325 >> 172.21.15.82:0/2551430325 conn(0x7f9a940cad50 msgr2=0x7f9a940cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- 172.21.15.82:0/2551430325 shutdown_connections 2023-07-20T11:05:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- 172.21.15.82:0/2551430325 wait complete. 2023-07-20T11:05:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 Processor -- start 2023-07-20T11:05:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- start start 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a940ca5a0 0x7f9a940c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 0x7f9a940c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a940c7520 con 0x7f9a9406f710 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a941467d0 con 0x7f9a9415a6f0 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a98f59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a94146010 con 0x7f9a940ca5a0 2023-07-20T11:05:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:38.999+0000 7f9a9259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34214/0 (socket says 172.21.15.82:34214) 2023-07-20T11:05:38.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 -- 172.21.15.82:0/1053482650 learned_addr learned my addr 172.21.15.82:0/1053482650 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:38.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a91d9b640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a940ca5a0 0x7f9a940c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a92d9d640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 0x7f9a940c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 -- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a940ca5a0 msgr2=0x7f9a940c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a940ca5a0 0x7f9a940c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 -- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 msgr2=0x7f9a940c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 0x7f9a940c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 -- 172.21.15.82:0/1053482650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009b30 con 0x7f9a9406f710 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a92d9d640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 0x7f9a940c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a9259c640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400d830 tx=0x7f9a8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400b660 con 0x7f9a9406f710 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8400b7c0 con 0x7f9a9406f710 2023-07-20T11:05:38.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8400bb30 con 0x7f9a9406f710 2023-07-20T11:05:38.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a941464a0 con 0x7f9a9406f710 2023-07-20T11:05:38.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a940c7240 con 0x7f9a9406f710 2023-07-20T11:05:38.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94146300 con 0x7f9a9406f710 2023-07-20T11:05:38.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9a8401e460 con 0x7f9a9406f710 2023-07-20T11:05:38.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.003+0000 7f9a8affd640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 0x7f9a74068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:38.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.007+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f9a84084320 con 0x7f9a9406f710 2023-07-20T11:05:38.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.007+0000 7f9a91d9b640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 0x7f9a74068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:38.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.007+0000 7f9a91d9b640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 0x7f9a74068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a9415d950 tx=0x7f9a7c007e40 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:38.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.007+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a94146300 con 0x7f9a9406f710 2023-07-20T11:05:39.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.163+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a94146300 con 0x7f9a9406f710 2023-07-20T11:05:39.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a8affd640 1 -- 172.21.15.82:0/1053482650 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a94146300 con 0x7f9a9406f710 2023-07-20T11:05:39.148 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:05:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 msgr2=0x7f9a74068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 0x7f9a74068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a9415d950 tx=0x7f9a7c007e40 comp rx=0 tx=0).stop 2023-07-20T11:05:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 msgr2=0x7f9a94145ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400d830 tx=0x7f9a8400dcf0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 shutdown_connections 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9a740663a0 0x7f9a74068860 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a9415a6f0 0x7f9a940c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a940ca5a0 0x7f9a940c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 --2- 172.21.15.82:0/1053482650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a9406f710 0x7f9a94145ad0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 >> 172.21.15.82:0/1053482650 conn(0x7f9a940cad50 msgr2=0x7f9a940c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 shutdown_connections 2023-07-20T11:05:39.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.167+0000 7f9a98f59640 1 -- 172.21.15.82:0/1053482650 wait complete. 2023-07-20T11:05:39.168 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:05:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.327+0000 7f4402367640 1 Processor -- start 2023-07-20T11:05:39.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4402367640 1 -- start start 2023-07-20T11:05:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4402367640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f43fc0afd50 0x7f43fc0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4402367640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc0b06b0 con 0x7f43fc159450 2023-07-20T11:05:39.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4402367640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc0cc8d0 con 0x7f43fc159830 2023-07-20T11:05:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4402367640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc0cce90 con 0x7f43fc0afd50 2023-07-20T11:05:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f43fbfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f43fc159450 0x7f43fc15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55654/0 (socket says 172.21.15.82:55654) 2023-07-20T11:05:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f43fbfff640 1 -- 172.21.15.82:0/4182503927 learned_addr learned my addr 172.21.15.82:0/4182503927 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:39.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4400904640 1 --2- 172.21.15.82:0/4182503927 >> v2:172.21.15.82:3300/0 conn(0x7f43fc0afd50 0x7f43fc0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f43faffd640 1 -- 172.21.15.82:0/4182503927 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452718323 0 0) 0x7f43fc0b06b0 con 0x7f43fc159450 2023-07-20T11:05:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f43faffd640 1 -- 172.21.15.82:0/4182503927 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43e4003530 con 0x7f43fc159450 2023-07-20T11:05:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4400904640 1 -- 172.21.15.82:0/4182503927 >> v1:172.21.15.183:6789/0 conn(0x7f43fc159830 legacy=0x7f43fc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4400904640 1 -- 172.21.15.82:0/4182503927 >> v1:172.21.15.82:6789/0 conn(0x7f43fc159450 legacy=0x7f43fc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.331+0000 7f4400904640 1 -- 172.21.15.82:0/4182503927 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc0ccbb0 con 0x7f43fc0afd50 2023-07-20T11:05:39.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4400904640 1 --2- 172.21.15.82:0/4182503927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0b0170 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009d90 tx=0x7f43f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618d75c7962de25 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f43faffd640 1 -- 172.21.15.82:0/4182503927 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40a59e0 con 0x7f43fc0afd50 2023-07-20T11:05:39.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f43faffd640 1 -- 172.21.15.82:0/4182503927 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f40a5b40 con 0x7f43fc0afd50 2023-07-20T11:05:39.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f43faffd640 1 -- 172.21.15.82:0/4182503927 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f40ad440 con 0x7f43fc0afd50 2023-07-20T11:05:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- 172.21.15.82:0/4182503927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 msgr2=0x7f43fc0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 --2- 172.21.15.82:0/4182503927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0b0170 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009d90 tx=0x7f43f401c920 comp rx=0 tx=0).stop 2023-07-20T11:05:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- 172.21.15.82:0/4182503927 shutdown_connections 2023-07-20T11:05:39.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 --2- 172.21.15.82:0/4182503927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0b0170 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- 172.21.15.82:0/4182503927 >> 172.21.15.82:0/4182503927 conn(0x7f43fc0cad50 msgr2=0x7f43fc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- 172.21.15.82:0/4182503927 shutdown_connections 2023-07-20T11:05:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- 172.21.15.82:0/4182503927 wait complete. 2023-07-20T11:05:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 Processor -- start 2023-07-20T11:05:39.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.335+0000 7f4402367640 1 -- start start 2023-07-20T11:05:39.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43fc159450 0x7f43fc0c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 0x7f43fc0c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0c82f0 con 0x7f43fc0afd50 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0c5d60 con 0x7f43fc0c2170 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0c2b40 con 0x7f43fc159450 2023-07-20T11:05:39.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34230/0 (socket says 172.21.15.82:34230) 2023-07-20T11:05:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 -- 172.21.15.82:0/2691101056 learned_addr learned my addr 172.21.15.82:0/2691101056 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4400904640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 0x7f43fc0c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fb7fe640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43fc159450 0x7f43fc0c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 -- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43fc159450 msgr2=0x7f43fc0c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43fc159450 0x7f43fc0c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 -- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 msgr2=0x7f43fc0c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 0x7f43fc0c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 -- 172.21.15.82:0/2691101056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f4009a70 con 0x7f43fc0afd50 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4400904640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 0x7f43fc0c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43fbfff640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00c4d0 tx=0x7f43ec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec005cf0 con 0x7f43fc0afd50 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec005e50 con 0x7f43fc0afd50 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec007270 con 0x7f43fc0afd50 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc0c7d30 con 0x7f43fc0afd50 2023-07-20T11:05:39.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc0c5f50 con 0x7f43fc0afd50 2023-07-20T11:05:39.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc04da30 con 0x7f43fc0afd50 2023-07-20T11:05:39.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.339+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43ec0073d0 con 0x7f43fc0afd50 2023-07-20T11:05:39.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.343+0000 7f43f8ff9640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 0x7f43e8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.343+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f43ec083050 con 0x7f43fc0afd50 2023-07-20T11:05:39.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.343+0000 7f43fb7fe640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 0x7f43e8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.343+0000 7f43fb7fe640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 0x7f43e8068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0c3800 tx=0x7f43f0009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.347+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43ec050770 con 0x7f43fc0afd50 2023-07-20T11:05:39.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.491+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43fc0ca5f0 con 0x7f43fc0afd50 2023-07-20T11:05:39.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f43f8ff9640 1 -- 172.21.15.82:0/2691101056 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43ec053d90 con 0x7f43fc0afd50 2023-07-20T11:05:39.476 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:05:39.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 msgr2=0x7f43e8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 0x7f43e8068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0c3800 tx=0x7f43f0009040 comp rx=0 tx=0).stop 2023-07-20T11:05:39.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 msgr2=0x7f43fc0c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00c4d0 tx=0x7f43ec00c990 comp rx=0 tx=0).stop 2023-07-20T11:05:39.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 shutdown_connections 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f43e80663a0 0x7f43e8068860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43fc0c2170 0x7f43fc0c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f43fc159450 0x7f43fc0c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 --2- 172.21.15.82:0/2691101056 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f43fc0afd50 0x7f43fc0c73c0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 >> 172.21.15.82:0/2691101056 conn(0x7f43fc0cad50 msgr2=0x7f43fc0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 shutdown_connections 2023-07-20T11:05:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.495+0000 7f4402367640 1 -- 172.21.15.82:0/2691101056 wait complete. 2023-07-20T11:05:39.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T11:05:39.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 Processor -- start 2023-07-20T11:05:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 -- start start 2023-07-20T11:05:39.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa54015cab0 0x7fa5400d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5400ce4c0 0x7fa5400d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400d16b0 con 0x7fa5400d0d10 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400d31c0 con 0x7fa5400ce4c0 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa545137640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400b3520 con 0x7fa54015cab0 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa5400d0d10 0x7fa5400cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55662/0 (socket says 172.21.15.82:55662) 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa5400ce4c0 0x7fa5400d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53e59c640 1 -- 172.21.15.82:0/4143499768 learned_addr learned my addr 172.21.15.82:0/4143499768 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:39.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53ed9d640 1 --2- 172.21.15.82:0/4143499768 >> v2:172.21.15.183:3300/0 conn(0x7fa54015cab0 0x7fa5400d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53f59e640 1 -- 172.21.15.82:0/4143499768 >> v2:172.21.15.183:3300/0 conn(0x7fa54015cab0 msgr2=0x7fa5400d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:39.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53f59e640 1 --2- 172.21.15.82:0/4143499768 >> v2:172.21.15.183:3300/0 conn(0x7fa54015cab0 0x7fa5400d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53f59e640 1 -- 172.21.15.82:0/4143499768 >> v1:172.21.15.82:6789/0 conn(0x7fa5400d0d10 legacy=0x7fa5400cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53f59e640 1 -- 172.21.15.82:0/4143499768 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400b2910 con 0x7fa5400ce4c0 2023-07-20T11:05:39.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.655+0000 7fa53dd9b640 1 -- 172.21.15.82:0/4143499768 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195527659 0 0) 0x7fa5400d16b0 con 0x7fa5400d0d10 2023-07-20T11:05:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa53f59e640 1 --2- 172.21.15.82:0/4143499768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400d1170 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa54006a660 tx=0x7fa53801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e5615d0b2478cf server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa53dd9b640 1 -- 172.21.15.82:0/4143499768 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380a58c0 con 0x7fa5400ce4c0 2023-07-20T11:05:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa53dd9b640 1 -- 172.21.15.82:0/4143499768 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5380a5a20 con 0x7fa5400ce4c0 2023-07-20T11:05:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa53dd9b640 1 -- 172.21.15.82:0/4143499768 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380a5db0 con 0x7fa5400ce4c0 2023-07-20T11:05:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 -- 172.21.15.82:0/4143499768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 msgr2=0x7fa5400d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 --2- 172.21.15.82:0/4143499768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400d1170 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa54006a660 tx=0x7fa53801c8e0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 -- 172.21.15.82:0/4143499768 shutdown_connections 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 --2- 172.21.15.82:0/4143499768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400d1170 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 --2- 172.21.15.82:0/4143499768 >> v2:172.21.15.183:3300/0 conn(0x7fa54015cab0 0x7fa5400d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 -- 172.21.15.82:0/4143499768 >> 172.21.15.82:0/4143499768 conn(0x7fa54008c120 msgr2=0x7fa54009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 -- 172.21.15.82:0/4143499768 shutdown_connections 2023-07-20T11:05:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.659+0000 7fa545137640 1 -- 172.21.15.82:0/4143499768 wait complete. 2023-07-20T11:05:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 Processor -- start 2023-07-20T11:05:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- start start 2023-07-20T11:05:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400d0d10 0x7fa540156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 0x7fa540156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b5320 con 0x7fa5400ce4c0 2023-07-20T11:05:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b5600 con 0x7fa54015cab0 2023-07-20T11:05:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b58e0 con 0x7fa5400d0d10 2023-07-20T11:05:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34250/0 (socket says 172.21.15.82:34250) 2023-07-20T11:05:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 -- 172.21.15.82:0/412884096 learned_addr learned my addr 172.21.15.82:0/412884096 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 -- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400d0d10 msgr2=0x7fa540156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400d0d10 0x7fa540156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 -- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 msgr2=0x7fa540156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53f59e640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 0x7fa540156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 0x7fa540156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 -- 172.21.15.82:0/412884096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009a70 con 0x7fa5400ce4c0 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53f59e640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 0x7fa540156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa53ed9d640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e930 tx=0x7fa53000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530009690 con 0x7fa5400ce4c0 2023-07-20T11:05:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53000ca00 con 0x7fa5400ce4c0 2023-07-20T11:05:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000cd70 con 0x7fa5400ce4c0 2023-07-20T11:05:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400b7a50 con 0x7fa5400ce4c0 2023-07-20T11:05:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5400b8010 con 0x7fa5400ce4c0 2023-07-20T11:05:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.663+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5400b7880 con 0x7fa5400ce4c0 2023-07-20T11:05:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.667+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa530013470 con 0x7fa5400ce4c0 2023-07-20T11:05:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.667+0000 7fa5277fe640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 0x7fa52c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.667+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fa530083ee0 con 0x7fa5400ce4c0 2023-07-20T11:05:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.667+0000 7fa53e59c640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 0x7fa52c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.667+0000 7fa53e59c640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 0x7fa52c068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5340011f0 tx=0x7fa534007930 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.671+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa530051570 con 0x7fa5400ce4c0 2023-07-20T11:05:39.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.823+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa540073c70 con 0x7fa5400ce4c0 2023-07-20T11:05:39.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.823+0000 7fa5277fe640 1 -- 172.21.15.82:0/412884096 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa530054b90 con 0x7fa5400ce4c0 2023-07-20T11:05:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:39.806 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:05:39.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T11:05:39.807 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:39.808 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:05:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 msgr2=0x7fa52c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 0x7fa52c068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa5340011f0 tx=0x7fa534007930 comp rx=0 tx=0).stop 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 msgr2=0x7fa5400cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e930 tx=0x7fa53000edf0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 shutdown_connections 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fa52c0663a0 0x7fa52c068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa54015cab0 0x7fa540156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa5400d0d10 0x7fa540156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 --2- 172.21.15.82:0/412884096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa5400ce4c0 0x7fa5400cc300 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 >> 172.21.15.82:0/412884096 conn(0x7fa54008c120 msgr2=0x7fa5400b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 shutdown_connections 2023-07-20T11:05:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.827+0000 7fa545137640 1 -- 172.21.15.82:0/412884096 wait complete. 2023-07-20T11:05:39.827 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T11:05:39.827 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T11:05:39.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 Processor -- start 2023-07-20T11:05:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 -- start start 2023-07-20T11:05:39.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9bac0afd50 0x7f9bac0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0cc8d0 con 0x7f9bac159830 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0cce90 con 0x7f9bac0afd50 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9bb0fd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0b0700 con 0x7f9bac159450 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9baad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9bac0afd50 0x7f9bac0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9ba1d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9bac159830 0x7f9bac0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55668/0 (socket says 172.21.15.82:55668) 2023-07-20T11:05:39.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9ba1d9b640 1 -- 172.21.15.82:0/3280632557 learned_addr learned my addr 172.21.15.82:0/3280632557 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:39.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.987+0000 7f9baa59c640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9baad9d640 1 -- 172.21.15.82:0/3280632557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 msgr2=0x7f9bac15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:39.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9baad9d640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9baad9d640 1 -- 172.21.15.82:0/3280632557 >> v1:172.21.15.82:6789/0 conn(0x7f9bac159830 legacy=0x7f9bac0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9baad9d640 1 -- 172.21.15.82:0/3280632557 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0ccbb0 con 0x7f9bac0afd50 2023-07-20T11:05:39.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9ba9d9b640 1 -- 172.21.15.82:0/3280632557 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140053829 0 0) 0x7f9bac0cc8d0 con 0x7f9bac159830 2023-07-20T11:05:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9baad9d640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0b01c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009dc0 tx=0x7f9ba401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491eb39d58ca93fb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9ba9d9b640 1 -- 172.21.15.82:0/3280632557 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40a59c0 con 0x7f9bac0afd50 2023-07-20T11:05:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9ba9d9b640 1 -- 172.21.15.82:0/3280632557 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba40a5b20 con 0x7f9bac0afd50 2023-07-20T11:05:39.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9ba9d9b640 1 -- 172.21.15.82:0/3280632557 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40ad440 con 0x7f9bac0afd50 2023-07-20T11:05:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/3280632557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 msgr2=0x7f9bac0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.991+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0b01c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009dc0 tx=0x7f9ba401c900 comp rx=0 tx=0).stop 2023-07-20T11:05:39.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/3280632557 shutdown_connections 2023-07-20T11:05:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0b01c0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/3280632557 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/3280632557 >> 172.21.15.82:0/3280632557 conn(0x7f9bac0cad50 msgr2=0x7f9bac0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/3280632557 shutdown_connections 2023-07-20T11:05:39.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/3280632557 wait complete. 2023-07-20T11:05:39.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 Processor -- start 2023-07-20T11:05:39.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- start start 2023-07-20T11:05:39.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bac0c6b20 0x7f9bac152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c6150 con 0x7f9bac0afd50 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c3030 con 0x7f9bac0c6b20 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9bb0fd2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0c5540 con 0x7f9bac159450 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34254/0 (socket says 172.21.15.82:34254) 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 -- 172.21.15.82:0/4131419592 learned_addr learned my addr 172.21.15.82:0/4131419592 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:39.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9ba1d9b640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baad9d640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bac0c6b20 0x7f9bac152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 -- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 msgr2=0x7f9bac0c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac0c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 -- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bac0c6b20 msgr2=0x7f9bac152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bac0c6b20 0x7f9bac152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.995+0000 7f9baa59c640 1 -- 172.21.15.82:0/4131419592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009a70 con 0x7f9bac0afd50 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9baa59c640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00e930 tx=0x7f9b9c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c009690 con 0x7f9bac0afd50 2023-07-20T11:05:39.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c00ca00 con 0x7f9bac0afd50 2023-07-20T11:05:39.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0c5820 con 0x7f9bac0afd50 2023-07-20T11:05:39.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00cd70 con 0x7f9bac0afd50 2023-07-20T11:05:39.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac0c5de0 con 0x7f9bac0afd50 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac04da30 con 0x7f9bac0afd50 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9b9c013470 con 0x7f9bac0afd50 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 0x7f9b8c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f9b9c083e70 con 0x7f9bac0afd50 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:39.999+0000 7f9ba1d9b640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 0x7f9b8c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:39.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.003+0000 7f9ba1d9b640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 0x7f9b8c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0c83a0 tx=0x7f9b94007c10 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:39.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.003+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b9c051500 con 0x7f9bac0afd50 2023-07-20T11:05:40.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.151+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9bac0cbbf0 con 0x7f9bac0afd50 2023-07-20T11:05:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9ba37fe640 1 -- 172.21.15.82:0/4131419592 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9b9c0170b0 con 0x7f9bac0afd50 2023-07-20T11:05:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T11:05:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 msgr2=0x7f9b8c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 0x7f9b8c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0c83a0 tx=0x7f9b94007c10 comp rx=0 tx=0).stop 2023-07-20T11:05:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 msgr2=0x7f9bac0c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00e930 tx=0x7f9b9c00edf0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 shutdown_connections 2023-07-20T11:05:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9b8c0663a0 0x7f9b8c068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bac0c6b20 0x7f9bac152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bac159450 0x7f9bac0c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 --2- 172.21.15.82:0/4131419592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bac0afd50 0x7f9bac0c78d0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.215+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 >> 172.21.15.82:0/4131419592 conn(0x7f9bac0cad50 msgr2=0x7f9bac0710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.219+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 shutdown_connections 2023-07-20T11:05:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.219+0000 7f9bb0fd2640 1 -- 172.21.15.82:0/4131419592 wait complete. 2023-07-20T11:05:40.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T11:05:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 Processor -- start 2023-07-20T11:05:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 -- start start 2023-07-20T11:05:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f640015c6e0 0x7f64000cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64000cdb40 con 0x7f640015cac0 2023-07-20T11:05:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000d07a0 con 0x7f640015c6e0 2023-07-20T11:05:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f64057fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000cd4f0 con 0x7f64000d3200 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f63feffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f640015c6e0 0x7f64000cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f63feffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f640015c6e0 0x7f64000cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34266/0 (socket says 172.21.15.82:34266) 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.383+0000 7f63feffd640 1 -- 172.21.15.82:0/2742231749 learned_addr learned my addr 172.21.15.82:0/2742231749 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63f7fff640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63feffd640 1 -- 172.21.15.82:0/2742231749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 msgr2=0x7f64000cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63feffd640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63feffd640 1 -- 172.21.15.82:0/2742231749 >> v1:172.21.15.183:6789/0 conn(0x7f640015cac0 legacy=0x7f64000d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63feffd640 1 -- 172.21.15.82:0/2742231749 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64000cd7d0 con 0x7f640015c6e0 2023-07-20T11:05:40.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63feffd640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64000cf640 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9c097551f3962b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:40.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63fe7fc640 1 -- 172.21.15.82:0/2742231749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ad680 con 0x7f640015c6e0 2023-07-20T11:05:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63fe7fc640 1 -- 172.21.15.82:0/2742231749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00ad7e0 con 0x7f640015c6e0 2023-07-20T11:05:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.387+0000 7f63fe7fc640 1 -- 172.21.15.82:0/2742231749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00adb70 con 0x7f640015c6e0 2023-07-20T11:05:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- 172.21.15.82:0/2742231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 msgr2=0x7f64000cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64000cf640 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009870 tx=0x7f63f001c3e0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- 172.21.15.82:0/2742231749 shutdown_connections 2023-07-20T11:05:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 --2- 172.21.15.82:0/2742231749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64000cf640 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- 172.21.15.82:0/2742231749 >> 172.21.15.82:0/2742231749 conn(0x7f64000d2600 msgr2=0x7f64000d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- 172.21.15.82:0/2742231749 shutdown_connections 2023-07-20T11:05:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- 172.21.15.82:0/2742231749 wait complete. 2023-07-20T11:05:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 Processor -- start 2023-07-20T11:05:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 -- start start 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.391+0000 7f64057fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 0x7f64000c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6400155e20 con 0x7f640015c6e0 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64000b64f0 con 0x7f640015cac0 2023-07-20T11:05:40.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64000b67d0 con 0x7f64000d3200 2023-07-20T11:05:40.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34274/0 (socket says 172.21.15.82:34274) 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 -- 172.21.15.82:0/3284147552 learned_addr learned my addr 172.21.15.82:0/3284147552 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63feffd640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63ff7fe640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 0x7f64000c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 -- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 msgr2=0x7f64000c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 -- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 msgr2=0x7f64000c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:40.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 0x7f64000c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:40.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 -- 172.21.15.82:0/3284147552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00094d0 con 0x7f640015c6e0 2023-07-20T11:05:40.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63ff7fe640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 0x7f64000c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:40.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f7fff640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f63e800d7d0 tx=0x7f63e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:40.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800b6c0 con 0x7f640015c6e0 2023-07-20T11:05:40.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e800b820 con 0x7f640015c6e0 2023-07-20T11:05:40.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800bbb0 con 0x7f640015c6e0 2023-07-20T11:05:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64000b6ab0 con 0x7f640015c6e0 2023-07-20T11:05:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64000b7070 con 0x7f640015c6e0 2023-07-20T11:05:40.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.395+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000b7230 con 0x7f640015c6e0 2023-07-20T11:05:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.399+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f63e800bd10 con 0x7f640015c6e0 2023-07-20T11:05:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.399+0000 7f63f77fe640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 0x7f63e00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.399+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5652+0+0 (secure 0 0 0) 0x7f63e8084b00 con 0x7f640015c6e0 2023-07-20T11:05:40.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.399+0000 7f63feffd640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 0x7f63e00688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:40.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.399+0000 7f63feffd640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 0x7f63e00688e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63f00af000 tx=0x7f63f00a7000 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:40.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.403+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63e80520f0 con 0x7f640015c6e0 2023-07-20T11:05:40.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:40.551+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f640004da30 con 0x7f640015c6e0 2023-07-20T11:05:40.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:05:40.808 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:05:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.227+0000 7f63f77fe640 1 -- 172.21.15.82:0/3284147552 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7f63e8055710 con 0x7f640015c6e0 2023-07-20T11:05:41.208 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T11:05:41.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.235+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 msgr2=0x7f63e00688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.235+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 0x7f63e00688e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63f00af000 tx=0x7f63f00a7000 comp rx=0 tx=0).stop 2023-07-20T11:05:41.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.235+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 msgr2=0x7f64001558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.235+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f63e800d7d0 tx=0x7f63e800dc90 comp rx=0 tx=0).stop 2023-07-20T11:05:41.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.239+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 shutdown_connections 2023-07-20T11:05:41.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.239+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f63e0066420 0x7f63e00688e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.239+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f640015cac0 0x7f64000c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.239+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f640015c6e0 0x7f64001558e0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.243+0000 7f64057fa640 1 --2- 172.21.15.82:0/3284147552 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f64000d3200 0x7f64000c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.243+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 >> 172.21.15.82:0/3284147552 conn(0x7f64000d2600 msgr2=0x7f64000af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:41.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.243+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 shutdown_connections 2023-07-20T11:05:41.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.243+0000 7f64057fa640 1 -- 172.21.15.82:0/3284147552 wait complete. 2023-07-20T11:05:41.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T11:05:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 Processor -- start 2023-07-20T11:05:41.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 -- start start 2023-07-20T11:05:41.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf1815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf18071950 con 0x7fcf1806f710 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1815b230 con 0x7fcf1815ec90 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1f174640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1815bad0 con 0x7fcf180ca5a0 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1cf10640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf1806f710 0x7fcf1806faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55684/0 (socket says 172.21.15.82:55684) 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf1cf10640 1 -- 172.21.15.82:0/3070529844 learned_addr learned my addr 172.21.15.82:0/3070529844 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:41.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.407+0000 7fcf0ffff640 1 --2- 172.21.15.82:0/3070529844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf1815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264707487 0 0) 0x7fcf18071950 con 0x7fcf1806f710 2023-07-20T11:05:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf00003530 con 0x7fcf1806f710 2023-07-20T11:05:41.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291911533 0 0) 0x7fcf1815b230 con 0x7fcf1815ec90 2023-07-20T11:05:41.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf18071950 con 0x7fcf1815ec90 2023-07-20T11:05:41.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0ffff640 1 -- 172.21.15.82:0/3070529844 >> v1:172.21.15.183:6789/0 conn(0x7fcf1815ec90 legacy=0x7fcf1815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0ffff640 1 -- 172.21.15.82:0/3070529844 >> v1:172.21.15.82:6789/0 conn(0x7fcf1806f710 legacy=0x7fcf1806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294694611 0 0) 0x7fcf00003530 con 0x7fcf1806f710 2023-07-20T11:05:41.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0ffff640 1 -- 172.21.15.82:0/3070529844 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1815b510 con 0x7fcf180ca5a0 2023-07-20T11:05:41.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0ffff640 1 --2- 172.21.15.82:0/3070529844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf1815e750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf080097f0 tx=0x7fcf0801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594092dd57d32ead server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:41.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14001680 con 0x7fcf180ca5a0 2023-07-20T11:05:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf080a7050 con 0x7fcf180ca5a0 2023-07-20T11:05:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.411+0000 7fcf0f7fe640 1 -- 172.21.15.82:0/3070529844 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080ab600 con 0x7fcf180ca5a0 2023-07-20T11:05:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- 172.21.15.82:0/3070529844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 msgr2=0x7fcf1815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 --2- 172.21.15.82:0/3070529844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf1815e750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf080097f0 tx=0x7fcf0801c3b0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- 172.21.15.82:0/3070529844 shutdown_connections 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 --2- 172.21.15.82:0/3070529844 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf1815e750 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- 172.21.15.82:0/3070529844 >> 172.21.15.82:0/3070529844 conn(0x7fcf180cad50 msgr2=0x7fcf180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- 172.21.15.82:0/3070529844 shutdown_connections 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- 172.21.15.82:0/3070529844 wait complete. 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 Processor -- start 2023-07-20T11:05:41.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- start start 2023-07-20T11:05:41.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:41.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf180b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:41.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 0x7fcf1814e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:41.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf18150390 con 0x7fcf1806f710 2023-07-20T11:05:41.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180b3bf0 con 0x7fcf1815ec90 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1f174640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1814f4a0 con 0x7fcf180ca5a0 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1cf10640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1cf10640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34288/0 (socket says 172.21.15.82:34288) 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.415+0000 7fcf1cf10640 1 -- 172.21.15.82:0/1660920914 learned_addr learned my addr 172.21.15.82:0/1660920914 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0ffff640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf180b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1d711640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 0x7fcf1814e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 -- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 msgr2=0x7fcf180b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf180b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 -- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 msgr2=0x7fcf1814e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 0x7fcf1814e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 -- 172.21.15.82:0/1660920914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf08009420 con 0x7fcf1806f710 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1d711640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 0x7fcf1814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1cf10640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400c780 tx=0x7fcf1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14005cf0 con 0x7fcf1806f710 2023-07-20T11:05:41.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1814f780 con 0x7fcf1806f710 2023-07-20T11:05:41.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1814fd40 con 0x7fcf1806f710 2023-07-20T11:05:41.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14005e50 con 0x7fcf1806f710 2023-07-20T11:05:41.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14007270 con 0x7fcf1806f710 2023-07-20T11:05:41.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8005260 con 0x7fcf1806f710 2023-07-20T11:05:41.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf140073d0 con 0x7fcf1806f710 2023-07-20T11:05:41.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 0x7fcf04068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:41.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.419+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fcf140835c0 con 0x7fcf1806f710 2023-07-20T11:05:41.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.423+0000 7fcf0ffff640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 0x7fcf04068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:41.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.423+0000 7fcf0ffff640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 0x7fcf04068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf080ad000 tx=0x7fcf080a6000 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:41.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.427+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf140508d0 con 0x7fcf1806f710 2023-07-20T11:05:41.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:41.603+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcef80057e0 con 0x7fcf1806f710 2023-07-20T11:05:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.223+0000 7fcf0d7fa640 1 -- 172.21.15.82:0/1660920914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcf14053ef0 con 0x7fcf1806f710 2023-07-20T11:05:42.206 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 19 and data pool 20 2023-07-20T11:05:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.227+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 msgr2=0x7fcf04068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.227+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 0x7fcf04068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcf080ad000 tx=0x7fcf080a6000 comp rx=0 tx=0).stop 2023-07-20T11:05:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 msgr2=0x7fcf18150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400c780 tx=0x7fcf1400cc40 comp rx=0 tx=0).stop 2023-07-20T11:05:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 shutdown_connections 2023-07-20T11:05:42.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcf040663a0 0x7fcf04068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1815ec90 0x7fcf1814e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf180ca5a0 0x7fcf180b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 --2- 172.21.15.82:0/1660920914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1806f710 0x7fcf18150820 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 >> 172.21.15.82:0/1660920914 conn(0x7fcf180cad50 msgr2=0x7fcf180aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 shutdown_connections 2023-07-20T11:05:42.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.231+0000 7fcf1f174640 1 -- 172.21.15.82:0/1660920914 wait complete. 2023-07-20T11:05:42.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:42.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.391+0000 7f4ae2c96640 1 Processor -- start 2023-07-20T11:05:42.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.391+0000 7f4ae2c96640 1 -- start start 2023-07-20T11:05:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae2c96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4adc0ad720 0x7f4adc0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae2c96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0cdd60 con 0x7f4adc0b04b0 2023-07-20T11:05:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae2c96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc0b20a0 con 0x7f4adc0b1cc0 2023-07-20T11:05:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae2c96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc0cd430 con 0x7f4adc0ad720 2023-07-20T11:05:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4adbfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4adc0b04b0 0x7f4adc160660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55700/0 (socket says 172.21.15.82:55700) 2023-07-20T11:05:42.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4adbfff640 1 -- 172.21.15.82:0/814965465 learned_addr learned my addr 172.21.15.82:0/814965465 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae1233640 1 --2- 172.21.15.82:0/814965465 >> v2:172.21.15.82:3300/0 conn(0x7f4adc0ad720 0x7f4adc0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4adb7fe640 1 -- 172.21.15.82:0/814965465 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498919084 0 0) 0x7f4adc0cdd60 con 0x7f4adc0b04b0 2023-07-20T11:05:42.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae1233640 1 -- 172.21.15.82:0/814965465 >> v1:172.21.15.183:6789/0 conn(0x7f4adc0b1cc0 legacy=0x7f4adc0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae1233640 1 -- 172.21.15.82:0/814965465 >> v1:172.21.15.82:6789/0 conn(0x7f4adc0b04b0 legacy=0x7f4adc160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.395+0000 7f4ae1233640 1 -- 172.21.15.82:0/814965465 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0cd710 con 0x7f4adc0ad720 2023-07-20T11:05:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae1233640 1 --2- 172.21.15.82:0/814965465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc0b2a30 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009d90 tx=0x7f4ad401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b93e961e958e7d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4adb7fe640 1 -- 172.21.15.82:0/814965465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40a5970 con 0x7f4adc0ad720 2023-07-20T11:05:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4adb7fe640 1 -- 172.21.15.82:0/814965465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad40a5ad0 con 0x7f4adc0ad720 2023-07-20T11:05:42.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4adb7fe640 1 -- 172.21.15.82:0/814965465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40a5e60 con 0x7f4adc0ad720 2023-07-20T11:05:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- 172.21.15.82:0/814965465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 msgr2=0x7f4adc0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/814965465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc0b2a30 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009d90 tx=0x7f4ad401c890 comp rx=0 tx=0).stop 2023-07-20T11:05:42.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- 172.21.15.82:0/814965465 shutdown_connections 2023-07-20T11:05:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/814965465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc0b2a30 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- 172.21.15.82:0/814965465 >> 172.21.15.82:0/814965465 conn(0x7f4adc0cada0 msgr2=0x7f4adc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- 172.21.15.82:0/814965465 shutdown_connections 2023-07-20T11:05:42.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- 172.21.15.82:0/814965465 wait complete. 2023-07-20T11:05:42.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 Processor -- start 2023-07-20T11:05:42.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- start start 2023-07-20T11:05:42.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4adc0b04b0 0x7f4adc0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4adc0b1cc0 0x7f4adc158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0ab8a0 con 0x7f4adc0ad720 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0ac420 con 0x7f4adc0b1cc0 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.399+0000 7f4ae2c96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0abaf0 con 0x7f4adc0b04b0 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34310/0 (socket says 172.21.15.82:34310) 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 -- 172.21.15.82:0/436147172 learned_addr learned my addr 172.21.15.82:0/436147172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 -- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4adc0b04b0 msgr2=0x7f4adc0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4adc0b04b0 0x7f4adc0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 -- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4adc0b1cc0 msgr2=0x7f4adc158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4adc0b1cc0 0x7f4adc158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 -- 172.21.15.82:0/436147172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4009a70 con 0x7f4adc0ad720 2023-07-20T11:05:42.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae0a32640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c450 tx=0x7f4ad000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad00052d0 con 0x7f4adc0ad720 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0005430 con 0x7f4adc0ad720 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc0b12f0 con 0x7f4adc0ad720 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0007260 con 0x7f4adc0ad720 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc0ac0b0 con 0x7f4adc0ad720 2023-07-20T11:05:42.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc073c70 con 0x7f4adc0ad720 2023-07-20T11:05:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4ad00073c0 con 0x7f4adc0ad720 2023-07-20T11:05:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 0x7f4ac0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.403+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4ad00837a0 con 0x7f4adc0ad720 2023-07-20T11:05:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.407+0000 7f4adbfff640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 0x7f4ac0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.407+0000 7f4adbfff640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 0x7f4ac0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c10 tx=0x7f4ac80079d0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.411+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ad0050b50 con 0x7f4adc0ad720 2023-07-20T11:05:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.559+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4adc0cbb40 con 0x7f4adc0ad720 2023-07-20T11:05:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ad97fa640 1 -- 172.21.15.82:0/436147172 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18413 (secure 0 0 0) 0x7f4ad0054170 con 0x7f4adc0ad720 2023-07-20T11:05:42.543 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:42.543 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":157,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:41.606540+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 msgr2=0x7f4ac0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 0x7f4ac0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8000c10 tx=0x7f4ac80079d0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 msgr2=0x7f4adc154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000c450 tx=0x7f4ad000c910 comp rx=0 tx=0).stop 2023-07-20T11:05:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 shutdown_connections 2023-07-20T11:05:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f4ac00663a0 0x7f4ac0068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4adc0b1cc0 0x7f4adc158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4adc0b04b0 0x7f4adc0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 --2- 172.21.15.82:0/436147172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4adc0ad720 0x7f4adc154b00 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 >> 172.21.15.82:0/436147172 conn(0x7f4adc0cada0 msgr2=0x7f4adc0ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:42.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 shutdown_connections 2023-07-20T11:05:42.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.563+0000 7f4ae2c96640 1 -- 172.21.15.82:0/436147172 wait complete. 2023-07-20T11:05:42.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:42.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 Processor -- start 2023-07-20T11:05:42.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 -- start start 2023-07-20T11:05:42.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f98900afda0 0x7f98900ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98900b2060 0x7f98900b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98900b06c0 con 0x7f989015a8e0 2023-07-20T11:05:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98900b3160 con 0x7f98900b2060 2023-07-20T11:05:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f9895167640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98900b12a0 con 0x7f98900afda0 2023-07-20T11:05:42.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f98900b2060 0x7f98900b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f989015a8e0 0x7f98900b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55716/0 (socket says 172.21.15.82:55716) 2023-07-20T11:05:42.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988659c640 1 -- 172.21.15.82:0/720578595 learned_addr learned my addr 172.21.15.82:0/720578595 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:42.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988ed9d640 1 --2- 172.21.15.82:0/720578595 >> v2:172.21.15.183:3300/0 conn(0x7f98900afda0 0x7f98900ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988f59e640 1 -- 172.21.15.82:0/720578595 >> v2:172.21.15.183:3300/0 conn(0x7f98900afda0 msgr2=0x7f98900ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988f59e640 1 --2- 172.21.15.82:0/720578595 >> v2:172.21.15.183:3300/0 conn(0x7f98900afda0 0x7f98900ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988f59e640 1 -- 172.21.15.82:0/720578595 >> v1:172.21.15.82:6789/0 conn(0x7f989015a8e0 legacy=0x7f98900b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988f59e640 1 -- 172.21.15.82:0/720578595 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900b1580 con 0x7f98900b2060 2023-07-20T11:05:42.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.723+0000 7f988e59c640 1 -- 172.21.15.82:0/720578595 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403269096 0 0) 0x7f98900b06c0 con 0x7f989015a8e0 2023-07-20T11:05:42.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f988f59e640 1 --2- 172.21.15.82:0/720578595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900b2060 0x7f98900b0180 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f98900b0b40 tx=0x7f988801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e426d0abd02940f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f988e59c640 1 -- 172.21.15.82:0/720578595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880ac640 con 0x7f98900b2060 2023-07-20T11:05:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f988e59c640 1 -- 172.21.15.82:0/720578595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98880ac7a0 con 0x7f98900b2060 2023-07-20T11:05:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f988e59c640 1 -- 172.21.15.82:0/720578595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98880acb30 con 0x7f98900b2060 2023-07-20T11:05:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 -- 172.21.15.82:0/720578595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900b2060 msgr2=0x7f98900b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 --2- 172.21.15.82:0/720578595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900b2060 0x7f98900b0180 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f98900b0b40 tx=0x7f988801c310 comp rx=0 tx=0).stop 2023-07-20T11:05:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 -- 172.21.15.82:0/720578595 shutdown_connections 2023-07-20T11:05:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 --2- 172.21.15.82:0/720578595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900b2060 0x7f98900b0180 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 --2- 172.21.15.82:0/720578595 >> v2:172.21.15.183:3300/0 conn(0x7f98900afda0 0x7f98900ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 -- 172.21.15.82:0/720578595 >> 172.21.15.82:0/720578595 conn(0x7f98900cada0 msgr2=0x7f98900cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:42.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 -- 172.21.15.82:0/720578595 shutdown_connections 2023-07-20T11:05:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.727+0000 7f9895167640 1 -- 172.21.15.82:0/720578595 wait complete. 2023-07-20T11:05:42.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 Processor -- start 2023-07-20T11:05:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- start start 2023-07-20T11:05:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 0x7f989015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f989015a8e0 0x7f98900c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989015c280 con 0x7f98900afda0 2023-07-20T11:05:42.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989015c520 con 0x7f989015a8e0 2023-07-20T11:05:42.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989015c800 con 0x7f98900b2060 2023-07-20T11:05:42.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34318/0 (socket says 172.21.15.82:34318) 2023-07-20T11:05:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 -- 172.21.15.82:0/3572967726 learned_addr learned my addr 172.21.15.82:0/3572967726 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988f59e640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f989015a8e0 0x7f98900c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988659c640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 0x7f989015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 -- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 msgr2=0x7f989015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 0x7f989015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 -- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f989015a8e0 msgr2=0x7f98900c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f989015a8e0 0x7f98900c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 -- 172.21.15.82:0/3572967726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888009420 con 0x7f98900afda0 2023-07-20T11:05:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988659c640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 0x7f989015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f988ed9d640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f9880007ef0 tx=0x7f988000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880014620 con 0x7f98900afda0 2023-07-20T11:05:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880014780 con 0x7f98900afda0 2023-07-20T11:05:42.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880014b30 con 0x7f98900afda0 2023-07-20T11:05:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989015cae0 con 0x7f98900afda0 2023-07-20T11:05:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.731+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98901569e0 con 0x7f98900afda0 2023-07-20T11:05:42.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890156b70 con 0x7f98900afda0 2023-07-20T11:05:42.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9880014c90 con 0x7f98900afda0 2023-07-20T11:05:42.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f9887fff640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 0x7f9870068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f98800848e0 con 0x7f98900afda0 2023-07-20T11:05:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f988659c640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 0x7f9870068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.735+0000 7f988659c640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 0x7f9870068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f989009c110 tx=0x7f9878007cd0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:42.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.739+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9880051b60 con 0x7f98900afda0 2023-07-20T11:05:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9890073c70 con 0x7f98900afda0 2023-07-20T11:05:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9887fff640 1 -- 172.21.15.82:0/3572967726 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18413 (secure 0 0 0) 0x7f9880055180 con 0x7f98900afda0 2023-07-20T11:05:42.873 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:42.873 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":157,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:41.606540+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 msgr2=0x7f9870068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 0x7f9870068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f989009c110 tx=0x7f9878007cd0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 msgr2=0x7f98901564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f9880007ef0 tx=0x7f988000e4b0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 shutdown_connections 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f98700663a0 0x7f9870068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f989015a8e0 0x7f98900c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f98900b2060 0x7f989015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 --2- 172.21.15.82:0/3572967726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98900afda0 0x7f98901564a0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 >> 172.21.15.82:0/3572967726 conn(0x7f98900cada0 msgr2=0x7f9890071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 shutdown_connections 2023-07-20T11:05:42.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:42.891+0000 7f9895167640 1 -- 172.21.15.82:0/3572967726 wait complete. 2023-07-20T11:05:42.895 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T11:05:43.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.055+0000 7fd9e5bf3640 1 Processor -- start 2023-07-20T11:05:43.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.055+0000 7fd9e5bf3640 1 -- start start 2023-07-20T11:05:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.055+0000 7fd9e5bf3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9e01602b0 0x7fd9e0160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9e5bf3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9e006ab10 0x7fd9e006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9e5bf3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e00ce4f0 con 0x7fd9e006c120 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9e5bf3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00d0970 con 0x7fd9e006ab10 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9e5bf3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e0160e20 con 0x7fd9e01602b0 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9e006ab10 0x7fd9e006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9e006ab10 0x7fd9e006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34328/0 (socket says 172.21.15.82:34328) 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 -- 172.21.15.82:0/3696457907 learned_addr learned my addr 172.21.15.82:0/3696457907 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:43.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9deffd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9e01602b0 0x7fd9e0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 -- 172.21.15.82:0/3696457907 >> v2:172.21.15.183:3300/0 conn(0x7fd9e01602b0 msgr2=0x7fd9e0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:43.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 --2- 172.21.15.82:0/3696457907 >> v2:172.21.15.183:3300/0 conn(0x7fd9e01602b0 0x7fd9e0160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:43.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 -- 172.21.15.82:0/3696457907 >> v1:172.21.15.183:6789/0 conn(0x7fd9e006c120 legacy=0x7fd9e00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:43.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9dffff640 1 -- 172.21.15.82:0/3696457907 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e00cd300 con 0x7fd9e006ab10 2023-07-20T11:05:43.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.059+0000 7fd9de7fc640 1 -- 172.21.15.82:0/3696457907 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126525487 0 0) 0x7fd9e00ce4f0 con 0x7fd9e006c120 2023-07-20T11:05:43.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9dffff640 1 --2- 172.21.15.82:0/3696457907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e006ab10 0x7fd9e006af10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fd9e008ca40 tx=0x7fd9d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a46339084ae35df server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:43.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9de7fc640 1 -- 172.21.15.82:0/3696457907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80a57d0 con 0x7fd9e006ab10 2023-07-20T11:05:43.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9de7fc640 1 -- 172.21.15.82:0/3696457907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d80a5930 con 0x7fd9e006ab10 2023-07-20T11:05:43.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9de7fc640 1 -- 172.21.15.82:0/3696457907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80a5cc0 con 0x7fd9e006ab10 2023-07-20T11:05:43.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/3696457907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e006ab10 msgr2=0x7fd9e006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/3696457907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e006ab10 0x7fd9e006af10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fd9e008ca40 tx=0x7fd9d801c910 comp rx=0 tx=0).stop 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/3696457907 shutdown_connections 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/3696457907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e006ab10 0x7fd9e006af10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/3696457907 >> v2:172.21.15.183:3300/0 conn(0x7fd9e01602b0 0x7fd9e0160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/3696457907 >> 172.21.15.82:0/3696457907 conn(0x7fd9e008c0a0 msgr2=0x7fd9e009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/3696457907 shutdown_connections 2023-07-20T11:05:43.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/3696457907 wait complete. 2023-07-20T11:05:43.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.063+0000 7fd9e5bf3640 1 Processor -- start 2023-07-20T11:05:43.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- start start 2023-07-20T11:05:43.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9e006ab10 0x7fd9e00c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9e006c120 0x7fd9e014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0151840 con 0x7fd9e01602b0 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e014b560 con 0x7fd9e006ab10 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0151a90 con 0x7fd9e006c120 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34342/0 (socket says 172.21.15.82:34342) 2023-07-20T11:05:43.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 -- 172.21.15.82:0/1667933114 learned_addr learned my addr 172.21.15.82:0/1667933114 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:43.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9df7fe640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9e006ab10 0x7fd9e00c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9deffd640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9e006c120 0x7fd9e014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 -- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9e006c120 msgr2=0x7fd9e014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9e006c120 0x7fd9e014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 -- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9e006ab10 msgr2=0x7fd9e00c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9e006ab10 0x7fd9e00c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 -- 172.21.15.82:0/1667933114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d8009b30 con 0x7fd9e01602b0 2023-07-20T11:05:43.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9dffff640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8019520 tx=0x7fd9d80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80b8670 con 0x7fd9e01602b0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d80b87d0 con 0x7fd9e01602b0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80b8b80 con 0x7fd9e01602b0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e0151d70 con 0x7fd9e01602b0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.067+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e0152330 con 0x7fd9e01602b0 2023-07-20T11:05:43.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.071+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e004da30 con 0x7fd9e01602b0 2023-07-20T11:05:43.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.075+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd9d80b8ce0 con 0x7fd9e01602b0 2023-07-20T11:05:43.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.075+0000 7fd9c7fff640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 0x7fd9cc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.075+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd9d811ff90 con 0x7fd9e01602b0 2023-07-20T11:05:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.075+0000 7fd9df7fe640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 0x7fd9cc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:43.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.075+0000 7fd9df7fe640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 0x7fd9cc068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0000f70 tx=0x7fd9d0009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:43.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.079+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9d80ed3d0 con 0x7fd9e01602b0 2023-07-20T11:05:43.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:43.259+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9e00cc850 con 0x7fd9e01602b0 2023-07-20T11:05:44.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.239+0000 7fd9c7fff640 1 -- 172.21.15.82:0/1667933114 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9d80f09f0 con 0x7fd9e01602b0 2023-07-20T11:05:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.239+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 msgr2=0x7fd9cc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.239+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 0x7fd9cc068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0000f70 tx=0x7fd9d0009040 comp rx=0 tx=0).stop 2023-07-20T11:05:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.239+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 msgr2=0x7fd9e00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.239+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8019520 tx=0x7fd9d80196b0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 shutdown_connections 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd9cc0663a0 0x7fd9cc068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e01602b0 0x7fd9e00afbe0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9e006c120 0x7fd9e014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 --2- 172.21.15.82:0/1667933114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9e006ab10 0x7fd9e00c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 >> 172.21.15.82:0/1667933114 conn(0x7fd9e008c0a0 msgr2=0x7fd9e009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 shutdown_connections 2023-07-20T11:05:44.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.243+0000 7fd9e5bf3640 1 -- 172.21.15.82:0/1667933114 wait complete. 2023-07-20T11:05:44.246 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T11:05:44.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T11:05:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.411+0000 7f00d812c640 1 Processor -- start 2023-07-20T11:05:44.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 -- start start 2023-07-20T11:05:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00d006f710 0x7f00d006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d015a6f0 0x7f00d015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d0070030 con 0x7f00d00ca5a0 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d015bad0 con 0x7f00d006f710 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d812c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0071950 con 0x7f00d015a6f0 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00d006f710 0x7f00d006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00d006f710 0x7f00d006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35240/0 (socket says 172.21.15.82:35240) 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 -- 172.21.15.82:0/2473823501 learned_addr learned my addr 172.21.15.82:0/2473823501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:44.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d66c9640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d015a6f0 0x7f00d015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 -- 172.21.15.82:0/2473823501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d015a6f0 msgr2=0x7f00d015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d015a6f0 0x7f00d015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 -- 172.21.15.82:0/2473823501 >> v1:172.21.15.183:6789/0 conn(0x7f00d00ca5a0 legacy=0x7f00d015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.415+0000 7f00d5ec8640 1 -- 172.21.15.82:0/2473823501 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d015b230 con 0x7f00d006f710 2023-07-20T11:05:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d5ec8640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d006faf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009870 tx=0x7f00cc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed73d3a2e8d141c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:44.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d4ec6640 1 -- 172.21.15.82:0/2473823501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0aa670 con 0x7f00d006f710 2023-07-20T11:05:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d4ec6640 1 -- 172.21.15.82:0/2473823501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0aa7d0 con 0x7f00d006f710 2023-07-20T11:05:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d4ec6640 1 -- 172.21.15.82:0/2473823501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0aab60 con 0x7f00d006f710 2023-07-20T11:05:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- 172.21.15.82:0/2473823501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 msgr2=0x7f00d006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d006faf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009870 tx=0x7f00cc01c510 comp rx=0 tx=0).stop 2023-07-20T11:05:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- 172.21.15.82:0/2473823501 shutdown_connections 2023-07-20T11:05:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d015a6f0 0x7f00d015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 --2- 172.21.15.82:0/2473823501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d006faf0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- 172.21.15.82:0/2473823501 >> 172.21.15.82:0/2473823501 conn(0x7f00d00cad50 msgr2=0x7f00d00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:44.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- 172.21.15.82:0/2473823501 shutdown_connections 2023-07-20T11:05:44.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- 172.21.15.82:0/2473823501 wait complete. 2023-07-20T11:05:44.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 Processor -- start 2023-07-20T11:05:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.419+0000 7f00d812c640 1 -- start start 2023-07-20T11:05:44.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d00ca5a0 0x7f00d00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d015a6f0 0x7f00d00b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d013dbf0 con 0x7f00d006f710 2023-07-20T11:05:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d013d830 con 0x7f00d015a6f0 2023-07-20T11:05:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00b3890 con 0x7f00d00ca5a0 2023-07-20T11:05:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35252/0 (socket says 172.21.15.82:35252) 2023-07-20T11:05:44.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 -- 172.21.15.82:0/3182372183 learned_addr learned my addr 172.21.15.82:0/3182372183 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:44.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d66c9640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d015a6f0 0x7f00d00b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d56c7640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d00ca5a0 0x7f00d00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 -- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d00ca5a0 msgr2=0x7f00d00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d00ca5a0 0x7f00d00ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 -- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d015a6f0 msgr2=0x7f00d00b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:44.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d015a6f0 0x7f00d00b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 -- 172.21.15.82:0/3182372183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc0094d0 con 0x7f00d006f710 2023-07-20T11:05:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d5ec8640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0ac040 tx=0x7f00cc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:44.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b3800 con 0x7f00d006f710 2023-07-20T11:05:44.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0b3980 con 0x7f00d006f710 2023-07-20T11:05:44.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0b3d30 con 0x7f00d006f710 2023-07-20T11:05:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d00b3b70 con 0x7f00d006f710 2023-07-20T11:05:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00b3030 con 0x7f00d006f710 2023-07-20T11:05:44.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d004da30 con 0x7f00d006f710 2023-07-20T11:05:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.423+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f00cc0b2380 con 0x7f00d006f710 2023-07-20T11:05:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.427+0000 7f00c67fc640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 0x7f00b4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.427+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f00cc11e850 con 0x7f00d006f710 2023-07-20T11:05:44.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.427+0000 7f00d56c7640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 0x7f00b4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.427+0000 7f00d56c7640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 0x7f00b4068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00d015eac0 tx=0x7f00c0009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:44.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.431+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00cc0ebb10 con 0x7f00d006f710 2023-07-20T11:05:44.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:44.611+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f00d015d7d0 con 0x7f00d006f710 2023-07-20T11:05:45.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.255+0000 7f00c67fc640 1 -- 172.21.15.82:0/3182372183 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f00cc0ef130 con 0x7f00d006f710 2023-07-20T11:05:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 msgr2=0x7f00b4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 0x7f00b4068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00d015eac0 tx=0x7f00c0009040 comp rx=0 tx=0).stop 2023-07-20T11:05:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 msgr2=0x7f00d00ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f00cc0ac040 tx=0x7f00cc01ad50 comp rx=0 tx=0).stop 2023-07-20T11:05:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 shutdown_connections 2023-07-20T11:05:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f00b40663a0 0x7f00b4068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d015a6f0 0x7f00d00b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00d00ca5a0 0x7f00d00ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 --2- 172.21.15.82:0/3182372183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00d006f710 0x7f00d00ce2b0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 >> 172.21.15.82:0/3182372183 conn(0x7f00d00cad50 msgr2=0x7f00d00b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 shutdown_connections 2023-07-20T11:05:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.259+0000 7f00d812c640 1 -- 172.21.15.82:0/3182372183 wait complete. 2023-07-20T11:05:45.259 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T11:05:45.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:45.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 Processor -- start 2023-07-20T11:05:45.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 -- start start 2023-07-20T11:05:45.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 0x7f7fc80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fc80cd4b0 0x7f7fc80cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc80d16b0 con 0x7f7fc815cab0 2023-07-20T11:05:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80d31c0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fcd89c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc80b3520 con 0x7f7fc80d0d10 2023-07-20T11:05:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fc80cd4b0 0x7f7fc80cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fc80cd4b0 0x7f7fc80cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35266/0 (socket says 172.21.15.82:35266) 2023-07-20T11:05:45.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 -- 172.21.15.82:0/2617425468 learned_addr learned my addr 172.21.15.82:0/2617425468 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:45.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fbe7fc640 1 --2- 172.21.15.82:0/2617425468 >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 0x7f7fc80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 -- 172.21.15.82:0/2617425468 >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 msgr2=0x7f7fc80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:45.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 --2- 172.21.15.82:0/2617425468 >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 0x7f7fc80d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 -- 172.21.15.82:0/2617425468 >> v1:172.21.15.183:6789/0 conn(0x7f7fc815cab0 legacy=0x7f7fc80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:45.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fc77fe640 1 -- 172.21.15.82:0/2617425468 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80d0a10 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.419+0000 7f7fbe7fc640 1 --2- 172.21.15.82:0/2617425468 >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 0x7f7fc80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:45.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fc77fe640 1 --2- 172.21.15.82:0/2617425468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc80cd920 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80d0190 tx=0x7f7fc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7b9c7388cd0ff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fc67fc640 1 -- 172.21.15.82:0/2617425468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00aa5f0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fc67fc640 1 -- 172.21.15.82:0/2617425468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc00aa750 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fc67fc640 1 -- 172.21.15.82:0/2617425468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc00aaae0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 -- 172.21.15.82:0/2617425468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 msgr2=0x7f7fc80cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/2617425468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc80cd920 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80d0190 tx=0x7f7fc001c490 comp rx=0 tx=0).stop 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 -- 172.21.15.82:0/2617425468 shutdown_connections 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/2617425468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc80cd920 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/2617425468 >> v2:172.21.15.183:3300/0 conn(0x7f7fc80d0d10 0x7f7fc80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 -- 172.21.15.82:0/2617425468 >> 172.21.15.82:0/2617425468 conn(0x7f7fc808c120 msgr2=0x7f7fc809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:45.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 -- 172.21.15.82:0/2617425468 shutdown_connections 2023-07-20T11:05:45.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.423+0000 7f7fcd89c640 1 -- 172.21.15.82:0/2617425468 wait complete. 2023-07-20T11:05:45.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 Processor -- start 2023-07-20T11:05:45.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- start start 2023-07-20T11:05:45.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc80d0d10 0x7f7fc81548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc815cab0 0x7f7fc806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814a8c0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc814aa50 con 0x7f7fc815cab0 2023-07-20T11:05:45.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc80c8610 con 0x7f7fc80d0d10 2023-07-20T11:05:45.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35268/0 (socket says 172.21.15.82:35268) 2023-07-20T11:05:45.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/3871504278 learned_addr learned my addr 172.21.15.82:0/3871504278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:45.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fbe7fc640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc80d0d10 0x7f7fc81548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc77fe640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc815cab0 0x7f7fc806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc80d0d10 msgr2=0x7f7fc81548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc80d0d10 0x7f7fc81548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc815cab0 msgr2=0x7f7fc806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc815cab0 0x7f7fc806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/3871504278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00094d0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc6ffd640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b410 tx=0x7f7fb800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8004020 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8004180 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc80c88f0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8011630 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.427+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc80c8eb0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8073c70 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fb8011790 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fc4ff9640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 0x7f7fa8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7fb8083b40 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fbe7fc640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 0x7f7fa8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.431+0000 7f7fbe7fc640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 0x7f7fa8068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0007510 tx=0x7f7fb00074a0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.435+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fb8050ef0 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.611+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fc8155b50 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fc4ff9640 1 -- 172.21.15.82:0/3871504278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f7fb8054510 con 0x7f7fc80cd4b0 2023-07-20T11:05:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:45.596 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:05:45.596 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 msgr2=0x7f7fa8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 0x7f7fa8068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0007510 tx=0x7f7fb00074a0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 msgr2=0x7f7fc815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800b410 tx=0x7f7fb800b8d0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 shutdown_connections 2023-07-20T11:05:45.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7fa80663a0 0x7f7fa8068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc815cab0 0x7f7fc806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fc80d0d10 0x7f7fc81548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 --2- 172.21.15.82:0/3871504278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fc80cd4b0 0x7f7fc815b8c0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 >> 172.21.15.82:0/3871504278 conn(0x7f7fc808c120 msgr2=0x7f7fc815be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 shutdown_connections 2023-07-20T11:05:45.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.615+0000 7f7fcd89c640 1 -- 172.21.15.82:0/3871504278 wait complete. 2023-07-20T11:05:45.616 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:05:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 Processor -- start 2023-07-20T11:05:45.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 -- start start 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf1415cab0 0x7fcf140d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcf140ce4c0 0x7fcf140d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf140d16b0 con 0x7fcf140d0d10 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140d31c0 con 0x7fcf1415cab0 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1c488640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140b3520 con 0x7fcf140ce4c0 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1a224640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcf1415cab0 0x7fcf140d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf19a23640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf140d0d10 0x7fcf140cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47452/0 (socket says 172.21.15.82:47452) 2023-07-20T11:05:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf19a23640 1 -- 172.21.15.82:0/3769012871 learned_addr learned my addr 172.21.15.82:0/3769012871 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1aa25640 1 --2- 172.21.15.82:0/3769012871 >> v2:172.21.15.183:3300/0 conn(0x7fcf140ce4c0 0x7fcf140d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1a224640 1 -- 172.21.15.82:0/3769012871 >> v2:172.21.15.183:3300/0 conn(0x7fcf140ce4c0 msgr2=0x7fcf140d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3769012871 >> v2:172.21.15.183:3300/0 conn(0x7fcf140ce4c0 0x7fcf140d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1a224640 1 -- 172.21.15.82:0/3769012871 >> v1:172.21.15.82:6789/0 conn(0x7fcf140d0d10 legacy=0x7fcf140cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf1a224640 1 -- 172.21.15.82:0/3769012871 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140b2910 con 0x7fcf1415cab0 2023-07-20T11:05:45.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.775+0000 7fcf19222640 1 -- 172.21.15.82:0/3769012871 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550782383 0 0) 0x7fcf140d16b0 con 0x7fcf140d0d10 2023-07-20T11:05:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3769012871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1415cab0 0x7fcf140d0300 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fcf14071cd0 tx=0x7fcf1001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b2253b868df291 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf19222640 1 -- 172.21.15.82:0/3769012871 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10004230 con 0x7fcf1415cab0 2023-07-20T11:05:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf19222640 1 -- 172.21.15.82:0/3769012871 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf100a7050 con 0x7fcf1415cab0 2023-07-20T11:05:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf19222640 1 -- 172.21.15.82:0/3769012871 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003620 con 0x7fcf1415cab0 2023-07-20T11:05:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 -- 172.21.15.82:0/3769012871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1415cab0 msgr2=0x7fcf140d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3769012871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1415cab0 0x7fcf140d0300 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fcf14071cd0 tx=0x7fcf1001c430 comp rx=0 tx=0).stop 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 -- 172.21.15.82:0/3769012871 shutdown_connections 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3769012871 >> v2:172.21.15.183:3300/0 conn(0x7fcf140ce4c0 0x7fcf140d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3769012871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf1415cab0 0x7fcf140d0300 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 -- 172.21.15.82:0/3769012871 >> 172.21.15.82:0/3769012871 conn(0x7fcf1408c120 msgr2=0x7fcf1409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 -- 172.21.15.82:0/3769012871 shutdown_connections 2023-07-20T11:05:45.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.779+0000 7fcf1c488640 1 -- 172.21.15.82:0/3769012871 wait complete. 2023-07-20T11:05:45.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 Processor -- start 2023-07-20T11:05:45.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- start start 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 0x7fcf1415f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1415cab0 0x7fcf14157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141576b0 con 0x7fcf140d0d10 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf141578f0 con 0x7fcf1415cab0 2023-07-20T11:05:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf14157bd0 con 0x7fcf140ce4c0 2023-07-20T11:05:45.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35282/0 (socket says 172.21.15.82:35282) 2023-07-20T11:05:45.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 -- 172.21.15.82:0/3563742781 learned_addr learned my addr 172.21.15.82:0/3563742781 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:45.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1aa25640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1415cab0 0x7fcf14157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 0x7fcf1415f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 -- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 msgr2=0x7fcf1415f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 0x7fcf1415f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 -- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1415cab0 msgr2=0x7fcf14157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1415cab0 0x7fcf14157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 -- 172.21.15.82:0/3563742781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009420 con 0x7fcf140d0d10 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 0x7fcf1415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:45.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf19a23640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fcf040011f0 tx=0x7fcf0400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf040074e0 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04007640 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04004a10 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf14157eb0 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf140cabd0 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.783+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf14073c70 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.787+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf04004b70 con 0x7fcf140d0d10 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.787+0000 7fcf0affd640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 0x7fcef8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:45.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.787+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fcf04083090 con 0x7fcf140d0d10 2023-07-20T11:05:45.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.787+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 0x7fcef8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:45.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.787+0000 7fcf1a224640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 0x7fcef8068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf100ad000 tx=0x7fcf10008040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:45.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.791+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf040503c0 con 0x7fcf140d0d10 2023-07-20T11:05:45.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.939+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf140b1100 con 0x7fcf140d0d10 2023-07-20T11:05:45.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.939+0000 7fcf0affd640 1 -- 172.21.15.82:0/3563742781 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+18400 (secure 0 0 0) 0x7fcf04018090 con 0x7fcf140d0d10 2023-07-20T11:05:45.923 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:45.923 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":158,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:43.069175+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 msgr2=0x7fcef8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 0x7fcef8068890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf100ad000 tx=0x7fcf10008040 comp rx=0 tx=0).stop 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 msgr2=0x7fcf14156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fcf040011f0 tx=0x7fcf0400c9b0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 shutdown_connections 2023-07-20T11:05:45.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fcef80663d0 0x7fcef8068890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf1415cab0 0x7fcf14157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf140d0d10 0x7fcf14156c30 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 --2- 172.21.15.82:0/3563742781 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf140ce4c0 0x7fcf1415f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 >> 172.21.15.82:0/3563742781 conn(0x7fcf1408c120 msgr2=0x7fcf140b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 shutdown_connections 2023-07-20T11:05:45.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:45.943+0000 7fcf1c488640 1 -- 172.21.15.82:0/3563742781 wait complete. 2023-07-20T11:05:45.944 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T11:05:45.945 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:05:46.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 Processor -- start 2023-07-20T11:05:46.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 -- start start 2023-07-20T11:05:46.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 0x7fdda40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdda40ce4c0 0x7fdda40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40d16b0 con 0x7fdda40d0d10 2023-07-20T11:05:46.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40d31c0 con 0x7fdda40ce4c0 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda9f96640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40b3520 con 0x7fdda415cab0 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdd9bfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdda40d0d10 0x7fdda40cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47458/0 (socket says 172.21.15.82:47458) 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdda40ce4c0 0x7fdda40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdd9bfff640 1 -- 172.21.15.82:0/4005657828 learned_addr learned my addr 172.21.15.82:0/4005657828 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda37fe640 1 --2- 172.21.15.82:0/4005657828 >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 0x7fdda40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda3fff640 1 -- 172.21.15.82:0/4005657828 >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 msgr2=0x7fdda40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda3fff640 1 --2- 172.21.15.82:0/4005657828 >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 0x7fdda40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda3fff640 1 -- 172.21.15.82:0/4005657828 >> v1:172.21.15.82:6789/0 conn(0x7fdda40d0d10 legacy=0x7fdda40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda3fff640 1 -- 172.21.15.82:0/4005657828 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40b2910 con 0x7fdda40ce4c0 2023-07-20T11:05:46.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda2ffd640 1 -- 172.21.15.82:0/4005657828 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255230681 0 0) 0x7fdda40d16b0 con 0x7fdda40d0d10 2023-07-20T11:05:46.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.103+0000 7fdda37fe640 1 --2- 172.21.15.82:0/4005657828 >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 0x7fdda40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda3fff640 1 --2- 172.21.15.82:0/4005657828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40d1170 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdda406a660 tx=0x7fdd9c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9de75b0708b188c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda2ffd640 1 -- 172.21.15.82:0/4005657828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0a58c0 con 0x7fdda40ce4c0 2023-07-20T11:05:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda2ffd640 1 -- 172.21.15.82:0/4005657828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0a5a20 con 0x7fdda40ce4c0 2023-07-20T11:05:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda2ffd640 1 -- 172.21.15.82:0/4005657828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0a5db0 con 0x7fdda40ce4c0 2023-07-20T11:05:46.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 -- 172.21.15.82:0/4005657828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 msgr2=0x7fdda40d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 --2- 172.21.15.82:0/4005657828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40d1170 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fdda406a660 tx=0x7fdd9c01c8e0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 -- 172.21.15.82:0/4005657828 shutdown_connections 2023-07-20T11:05:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 --2- 172.21.15.82:0/4005657828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40d1170 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 --2- 172.21.15.82:0/4005657828 >> v2:172.21.15.183:3300/0 conn(0x7fdda415cab0 0x7fdda40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 -- 172.21.15.82:0/4005657828 >> 172.21.15.82:0/4005657828 conn(0x7fdda408c120 msgr2=0x7fdda409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 -- 172.21.15.82:0/4005657828 shutdown_connections 2023-07-20T11:05:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.107+0000 7fdda9f96640 1 -- 172.21.15.82:0/4005657828 wait complete. 2023-07-20T11:05:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 Processor -- start 2023-07-20T11:05:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- start start 2023-07-20T11:05:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda40d0d10 0x7fdda4156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda415cab0 0x7fdda4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40b5320 con 0x7fdda40ce4c0 2023-07-20T11:05:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40b5600 con 0x7fdda40d0d10 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40b58e0 con 0x7fdda415cab0 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35296/0 (socket says 172.21.15.82:35296) 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 -- 172.21.15.82:0/3091860488 learned_addr learned my addr 172.21.15.82:0/3091860488 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdd9bfff640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda40d0d10 0x7fdda4156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda3fff640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda415cab0 0x7fdda4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 -- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda415cab0 msgr2=0x7fdda4156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda415cab0 0x7fdda4156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 -- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda40d0d10 msgr2=0x7fdda4156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda40d0d10 0x7fdda4156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 -- 172.21.15.82:0/3091860488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009a70 con 0x7fdda40ce4c0 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda37fe640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c7c0 tx=0x7fdd9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94007a30 con 0x7fdda40ce4c0 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94007b90 con 0x7fdda40ce4c0 2023-07-20T11:05:46.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40b7a50 con 0x7fdda40ce4c0 2023-07-20T11:05:46.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400ce70 con 0x7fdda40ce4c0 2023-07-20T11:05:46.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.111+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40b8010 con 0x7fdda40ce4c0 2023-07-20T11:05:46.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40b8230 con 0x7fdda40ce4c0 2023-07-20T11:05:46.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd940113f0 con 0x7fdda40ce4c0 2023-07-20T11:05:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdda0ff9640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 0x7fdd84068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fdd94084540 con 0x7fdda40ce4c0 2023-07-20T11:05:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdd9bfff640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 0x7fdd84068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.115+0000 7fdd9bfff640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 0x7fdd84068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdda40c9920 tx=0x7fdd8c007b60 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.119+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd940516b0 con 0x7fdda40ce4c0 2023-07-20T11:05:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.267+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdda40b25c0 con 0x7fdd840663a0 2023-07-20T11:05:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.275+0000 7fdda0ff9640 1 -- 172.21.15.82:0/3091860488 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299489 (secure 0 0 0) 0x7fdd8c0071f0 con 0x7fdd840663a0 2023-07-20T11:05:46.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:05:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 msgr2=0x7fdd84068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 0x7fdd84068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdda40c9920 tx=0x7fdd8c007b60 comp rx=0 tx=0).stop 2023-07-20T11:05:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 msgr2=0x7fdda40cc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400c7c0 tx=0x7fdd9400cc80 comp rx=0 tx=0).stop 2023-07-20T11:05:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 shutdown_connections 2023-07-20T11:05:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fdd840663a0 0x7fdd84068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdda415cab0 0x7fdda4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdda40d0d10 0x7fdda4156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 --2- 172.21.15.82:0/3091860488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdda40ce4c0 0x7fdda40cc300 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 >> 172.21.15.82:0/3091860488 conn(0x7fdda408c120 msgr2=0x7fdda40b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 shutdown_connections 2023-07-20T11:05:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.279+0000 7fdda9f96640 1 -- 172.21.15.82:0/3091860488 wait complete. 2023-07-20T11:05:46.281 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T11:05:45.144049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":370124,"kb_used_data":16220,"kb_used_omap":13,"kb_used_meta":353778,"kb_avail":754604596,"statfs":{"total":773094113280,"available":772715106304,"internally_reserved":0,"allocated":16609280,"data_stored":9009878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":362268760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929455"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220384+0000","last_change":"2023-07-20T11:05:40.220384+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220384+0000","last_undegraded":"2023-07-20T11:05:40.220384+0000","last_fullsized":"2023-07-20T11:05:40.220384+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220737+0000","last_change":"2023-07-20T11:05:40.220737+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220737+0000","last_undegraded":"2023-07-20T11:05:40.220737+0000","last_fullsized":"2023-07-20T11:05:40.220737+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396584+0000","last_change":"2023-07-20T11:05:40.396584+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396584+0000","last_undegraded":"2023-07-20T11:05:40.396584+0000","last_fullsized":"2023-07-20T11:05:40.396584+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396619+0000","last_change":"2023-07-20T11:05:40.396619+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396619+0000","last_undegraded":"2023-07-20T11:05:40.396619+0000","last_fullsized":"2023-07-20T11:05:40.396619+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217731+0000","last_change":"2023-07-20T11:05:40.217731+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217731+0000","last_undegraded":"2023-07-20T11:05:40.217731+0000","last_fullsized":"2023-07-20T11:05:40.217731+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220621+0000","last_change":"2023-07-20T11:05:40.220621+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220621+0000","last_undegraded":"2023-07-20T11:05:40.220621+0000","last_fullsized":"2023-07-20T11:05:40.220621+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396519+0000","last_change":"2023-07-20T11:05:40.396519+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396519+0000","last_undegraded":"2023-07-20T11:05:40.396519+0000","last_fullsized":"2023-07-20T11:05:40.396519+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220310+0000","last_change":"2023-07-20T11:05:40.220310+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220310+0000","last_undegraded":"2023-07-20T11:05:40.220310+0000","last_fullsized":"2023-07-20T11:05:40.220310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217083+0000","last_change":"2023-07-20T11:05:40.217083+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217083+0000","last_undegraded":"2023-07-20T11:05:40.217083+0000","last_fullsized":"2023-07-20T11:05:40.217083+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220377+0000","last_change":"2023-07-20T11:05:40.220377+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220377+0000","last_undegraded":"2023-07-20T11:05:40.220377+0000","last_fullsized":"2023-07-20T11:05:40.220377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395966+0000","last_change":"2023-07-20T11:05:40.395966+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395966+0000","last_undegraded":"2023-07-20T11:05:40.395966+0000","last_fullsized":"2023-07-20T11:05:40.395966+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220610+0000","last_change":"2023-07-20T11:05:40.220610+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220610+0000","last_undegraded":"2023-07-20T11:05:40.220610+0000","last_fullsized":"2023-07-20T11:05:40.220610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217104+0000","last_change":"2023-07-20T11:05:40.217104+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217104+0000","last_undegraded":"2023-07-20T11:05:40.217104+0000","last_fullsized":"2023-07-20T11:05:40.217104+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217463+0000","last_change":"2023-07-20T11:05:40.217463+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217463+0000","last_undegraded":"2023-07-20T11:05:40.217463+0000","last_fullsized":"2023-07-20T11:05:40.217463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395930+0000","last_change":"2023-07-20T11:05:40.395930+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395930+0000","last_undegraded":"2023-07-20T11:05:40.395930+0000","last_fullsized":"2023-07-20T11:05:40.395930+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396039+0000","last_change":"2023-07-20T11:05:40.396039+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396039+0000","last_undegraded":"2023-07-20T11:05:40.396039+0000","last_fullsized":"2023-07-20T11:05:40.396039+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217460+0000","last_change":"2023-07-20T11:05:40.217460+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217460+0000","last_undegraded":"2023-07-20T11:05:40.217460+0000","last_fullsized":"2023-07-20T11:05:40.217460+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217122+0000","last_change":"2023-07-20T11:05:40.217122+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217122+0000","last_undegraded":"2023-07-20T11:05:40.217122+0000","last_fullsized":"2023-07-20T11:05:40.217122+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217415+0000","last_change":"2023-07-20T11:05:40.217415+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217415+0000","last_undegraded":"2023-07-20T11:05:40.217415+0000","last_fullsized":"2023-07-20T11:05:40.217415+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396049+0000","last_change":"2023-07-20T11:05:40.396049+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396049+0000","last_undegraded":"2023-07-20T11:05:40.396049+0000","last_fullsized":"2023-07-20T11:05:40.396049+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217130+0000","last_change":"2023-07-20T11:05:40.217130+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217130+0000","last_undegraded":"2023-07-20T11:05:40.217130+0000","last_fullsized":"2023-07-20T11:05:40.217130+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395792+0000","last_change":"2023-07-20T11:05:40.395792+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395792+0000","last_undegraded":"2023-07-20T11:05:40.395792+0000","last_fullsized":"2023-07-20T11:05:40.395792+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396025+0000","last_change":"2023-07-20T11:05:40.396025+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396025+0000","last_undegraded":"2023-07-20T11:05:40.396025+0000","last_fullsized":"2023-07-20T11:05:40.396025+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220682+0000","last_change":"2023-07-20T11:05:40.220682+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220682+0000","last_undegraded":"2023-07-20T11:05:40.220682+0000","last_fullsized":"2023-07-20T11:05:40.220682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396345+0000","last_change":"2023-07-20T11:05:40.396345+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396345+0000","last_undegraded":"2023-07-20T11:05:40.396345+0000","last_fullsized":"2023-07-20T11:05:40.396345+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'249","reported_seq":904,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397566+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:05:40.397566+0000","last_peered":"2023-07-20T11:05:40.397566+0000","last_clean":"2023-07-20T11:05:40.397566+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:05:40.397566+0000","last_undegraded":"2023-07-20T11:05:40.397566+0000","last_fullsized":"2023-07-20T11:05:40.397566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:37.369439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218997+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:05:40.218997+0000","last_peered":"2023-07-20T11:05:40.218997+0000","last_clean":"2023-07-20T11:05:40.218997+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:05:40.218997+0000","last_undegraded":"2023-07-20T11:05:40.218997+0000","last_fullsized":"2023-07-20T11:05:40.218997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:18:18.418307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220396+0000","last_change":"2023-07-20T11:05:40.220396+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220396+0000","last_undegraded":"2023-07-20T11:05:40.220396+0000","last_fullsized":"2023-07-20T11:05:40.220396+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":280,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397500+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:05:40.397500+0000","last_peered":"2023-07-20T11:05:40.397500+0000","last_clean":"2023-07-20T11:05:40.397500+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:05:40.397500+0000","last_undegraded":"2023-07-20T11:05:40.397500+0000","last_fullsized":"2023-07-20T11:05:40.397500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:49.793982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396640+0000","last_change":"2023-07-20T11:05:40.396640+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396640+0000","last_undegraded":"2023-07-20T11:05:40.396640+0000","last_fullsized":"2023-07-20T11:05:40.396640+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":305,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.215929+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:05:40.215929+0000","last_peered":"2023-07-20T11:05:40.215929+0000","last_clean":"2023-07-20T11:05:40.215929+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:05:40.215929+0000","last_undegraded":"2023-07-20T11:05:40.215929+0000","last_fullsized":"2023-07-20T11:05:40.215929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:24:25.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217471+0000","last_change":"2023-07-20T11:05:40.217471+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217471+0000","last_undegraded":"2023-07-20T11:05:40.217471+0000","last_fullsized":"2023-07-20T11:05:40.217471+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218768+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:05:40.218768+0000","last_peered":"2023-07-20T11:05:40.218768+0000","last_clean":"2023-07-20T11:05:40.218768+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:05:40.218768+0000","last_undegraded":"2023-07-20T11:05:40.218768+0000","last_fullsized":"2023-07-20T11:05:40.218768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:25.267191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395909+0000","last_change":"2023-07-20T11:05:40.395909+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395909+0000","last_undegraded":"2023-07-20T11:05:40.395909+0000","last_fullsized":"2023-07-20T11:05:40.395909+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":275,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397318+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:05:40.397318+0000","last_peered":"2023-07-20T11:05:40.397318+0000","last_clean":"2023-07-20T11:05:40.397318+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:05:40.397318+0000","last_undegraded":"2023-07-20T11:05:40.397318+0000","last_fullsized":"2023-07-20T11:05:40.397318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:18.804091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395908+0000","last_change":"2023-07-20T11:05:40.395908+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395908+0000","last_undegraded":"2023-07-20T11:05:40.395908+0000","last_fullsized":"2023-07-20T11:05:40.395908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397742+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:05:40.397742+0000","last_peered":"2023-07-20T11:05:40.397742+0000","last_clean":"2023-07-20T11:05:40.397742+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:05:40.397742+0000","last_undegraded":"2023-07-20T11:05:40.397742+0000","last_fullsized":"2023-07-20T11:05:40.397742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:52:48.700219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.218288+0000","last_change":"2023-07-20T11:05:40.218288+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.218288+0000","last_undegraded":"2023-07-20T11:05:40.218288+0000","last_fullsized":"2023-07-20T11:05:40.218288+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397344+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:05:40.397344+0000","last_peered":"2023-07-20T11:05:40.397344+0000","last_clean":"2023-07-20T11:05:40.397344+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:05:40.397344+0000","last_undegraded":"2023-07-20T11:05:40.397344+0000","last_fullsized":"2023-07-20T11:05:40.397344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:53.428992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217425+0000","last_change":"2023-07-20T11:05:40.217425+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217425+0000","last_undegraded":"2023-07-20T11:05:40.217425+0000","last_fullsized":"2023-07-20T11:05:40.217425+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.222236+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:05:40.222236+0000","last_peered":"2023-07-20T11:05:40.222236+0000","last_clean":"2023-07-20T11:05:40.222236+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:05:40.222236+0000","last_undegraded":"2023-07-20T11:05:40.222236+0000","last_fullsized":"2023-07-20T11:05:40.222236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:08:20.115694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575748,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.78800000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80400000000000005,"15min":0.77600000000000002},"min":{"1min":0.58199999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.754},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.433},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79100000000000004,"15min":0.76900000000000002},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.49099999999999999},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.54100000000000004,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.40699999999999997},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1916928,"data_stored":973181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.879},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575747,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.40500000000000003,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.05},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.115},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0529999999999999,"5min":1.1919999999999999,"15min":1.202},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0149999999999999,"5min":1.093,"15min":1.266},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.53600000000000003},"max":{"1min":1.099,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.67200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3,"15min":1.3},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.83699999999999997},"min":{"1min":0.64600000000000002,"5min":0.59499999999999997,"15min":0.55200000000000005},"max":{"1min":1.0800000000000001,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.60599999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.3129999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82999999999999996},"min":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"max":{"1min":1.0389999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66000000000000003,"5min":0.74199999999999999,"15min":0.82999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.86699999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.84799999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.51400000000000001,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":0.79900000000000004,"15min":0.92500000000000004},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79000000000000004,"15min":0.79300000000000004},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.304},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.53000000000000003},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.3129999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.66900000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1259999999999999,"5min":1.179,"15min":1.2749999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.123,"5min":1.163,"15min":1.173},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41780,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330060,"statfs":{"total":96636764160,"available":96593981440,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.746},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.88700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:05:46.288 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:05:46.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 Processor -- start 2023-07-20T11:05:46.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 -- start start 2023-07-20T11:05:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9db00d0d10 0x7f9db00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9db00d16b0 con 0x7f9db00cf110 2023-07-20T11:05:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9db00d31c0 con 0x7f9db00d0d10 2023-07-20T11:05:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db7767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db00b3520 con 0x7f9db015cab0 2023-07-20T11:05:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db5503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db4d02640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9db00d0d10 0x7f9db00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db5503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56362/0 (socket says 172.21.15.82:56362) 2023-07-20T11:05:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db5503640 1 -- 172.21.15.82:0/3225520489 learned_addr learned my addr 172.21.15.82:0/3225520489 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db4d02640 1 -- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 msgr2=0x7f9db00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db4d02640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db4d02640 1 -- 172.21.15.82:0/3225520489 >> v1:172.21.15.183:6789/0 conn(0x7f9db00cf110 legacy=0x7f9db00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db4d02640 1 -- 172.21.15.82:0/3225520489 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00b2910 con 0x7f9db00d0d10 2023-07-20T11:05:46.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.479+0000 7f9db5503640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db4d02640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db00d0d10 0x7f9db00d1170 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9da00097c0 tx=0x7f9da001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=917046e7febf97ca server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9da7fff640 1 -- 172.21.15.82:0/3225520489 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00ab650 con 0x7f9db00d0d10 2023-07-20T11:05:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9da7fff640 1 -- 172.21.15.82:0/3225520489 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da00ab7b0 con 0x7f9db00d0d10 2023-07-20T11:05:46.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9da7fff640 1 -- 172.21.15.82:0/3225520489 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00abb40 con 0x7f9db00d0d10 2023-07-20T11:05:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 -- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db00d0d10 msgr2=0x7f9db00d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db00d0d10 0x7f9db00d1170 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9da00097c0 tx=0x7f9da001c450 comp rx=0 tx=0).stop 2023-07-20T11:05:46.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 -- 172.21.15.82:0/3225520489 shutdown_connections 2023-07-20T11:05:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db00d0d10 0x7f9db00d1170 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 --2- 172.21.15.82:0/3225520489 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db015cab0 0x7f9db00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 -- 172.21.15.82:0/3225520489 >> 172.21.15.82:0/3225520489 conn(0x7f9db008c120 msgr2=0x7f9db009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 -- 172.21.15.82:0/3225520489 shutdown_connections 2023-07-20T11:05:46.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.483+0000 7f9db7767640 1 -- 172.21.15.82:0/3225520489 wait complete. 2023-07-20T11:05:46.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 Processor -- start 2023-07-20T11:05:46.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- start start 2023-07-20T11:05:46.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db00cf110 0x7f9db0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db015cab0 0x7f9db0151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db014c630 con 0x7f9db00d0d10 2023-07-20T11:05:46.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0153e10 con 0x7f9db015cab0 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db014c8c0 con 0x7f9db00cf110 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35302/0 (socket says 172.21.15.82:35302) 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 -- 172.21.15.82:0/1678200302 learned_addr learned my addr 172.21.15.82:0/1678200302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db5d04640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db015cab0 0x7f9db0151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db5503640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db00cf110 0x7f9db0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 -- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db00cf110 msgr2=0x7f9db0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db00cf110 0x7f9db0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 -- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db015cab0 msgr2=0x7f9db0151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db015cab0 0x7f9db0151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 -- 172.21.15.82:0/1678200302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0094d0 con 0x7f9db00d0d10 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db4d02640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9da00ad040 tx=0x7f9da001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00bf610 con 0x7f9db00d0d10 2023-07-20T11:05:46.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da00bf790 con 0x7f9db00d0d10 2023-07-20T11:05:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0009420 con 0x7f9db00d0d10 2023-07-20T11:05:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da00bfb40 con 0x7f9db00d0d10 2023-07-20T11:05:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.487+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db014ce40 con 0x7f9db00d0d10 2023-07-20T11:05:46.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db00ccb40 con 0x7f9db00d0d10 2023-07-20T11:05:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9da00b5400 con 0x7f9db00d0d10 2023-07-20T11:05:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9da5ffb640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 0x7f9d94068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f9da011ec40 con 0x7f9db00d0d10 2023-07-20T11:05:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9db5503640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 0x7f9d94068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.491+0000 7f9db5503640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 0x7f9d94068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9db006bdf0 tx=0x7f9dac009240 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.495+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9da00ec090 con 0x7f9db00d0d10 2023-07-20T11:05:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.639+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9db00b31b0 con 0x7f9d940663d0 2023-07-20T11:05:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.647+0000 7f9da5ffb640 1 -- 172.21.15.82:0/1678200302 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299489 (secure 0 0 0) 0x7f9dac009980 con 0x7f9d940663d0 2023-07-20T11:05:46.632 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:05:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 msgr2=0x7f9d94068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 0x7f9d94068890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9db006bdf0 tx=0x7f9dac009240 comp rx=0 tx=0).stop 2023-07-20T11:05:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 msgr2=0x7f9db014c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9da00ad040 tx=0x7f9da001ac90 comp rx=0 tx=0).stop 2023-07-20T11:05:46.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 shutdown_connections 2023-07-20T11:05:46.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f9d940663d0 0x7f9d94068890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9db015cab0 0x7f9db0151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9db00d0d10 0x7f9db014c0f0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 --2- 172.21.15.82:0/1678200302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9db00cf110 0x7f9db0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 >> 172.21.15.82:0/1678200302 conn(0x7f9db008c120 msgr2=0x7f9db006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 shutdown_connections 2023-07-20T11:05:46.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.651+0000 7f9db7767640 1 -- 172.21.15.82:0/1678200302 wait complete. 2023-07-20T11:05:46.652 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T11:05:45.144049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":370124,"kb_used_data":16220,"kb_used_omap":13,"kb_used_meta":353778,"kb_avail":754604596,"statfs":{"total":773094113280,"available":772715106304,"internally_reserved":0,"allocated":16609280,"data_stored":9009878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":362268760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929455"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220384+0000","last_change":"2023-07-20T11:05:40.220384+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220384+0000","last_undegraded":"2023-07-20T11:05:40.220384+0000","last_fullsized":"2023-07-20T11:05:40.220384+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220737+0000","last_change":"2023-07-20T11:05:40.220737+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220737+0000","last_undegraded":"2023-07-20T11:05:40.220737+0000","last_fullsized":"2023-07-20T11:05:40.220737+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396584+0000","last_change":"2023-07-20T11:05:40.396584+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396584+0000","last_undegraded":"2023-07-20T11:05:40.396584+0000","last_fullsized":"2023-07-20T11:05:40.396584+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396619+0000","last_change":"2023-07-20T11:05:40.396619+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396619+0000","last_undegraded":"2023-07-20T11:05:40.396619+0000","last_fullsized":"2023-07-20T11:05:40.396619+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217731+0000","last_change":"2023-07-20T11:05:40.217731+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217731+0000","last_undegraded":"2023-07-20T11:05:40.217731+0000","last_fullsized":"2023-07-20T11:05:40.217731+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220621+0000","last_change":"2023-07-20T11:05:40.220621+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220621+0000","last_undegraded":"2023-07-20T11:05:40.220621+0000","last_fullsized":"2023-07-20T11:05:40.220621+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396519+0000","last_change":"2023-07-20T11:05:40.396519+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396519+0000","last_undegraded":"2023-07-20T11:05:40.396519+0000","last_fullsized":"2023-07-20T11:05:40.396519+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220310+0000","last_change":"2023-07-20T11:05:40.220310+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220310+0000","last_undegraded":"2023-07-20T11:05:40.220310+0000","last_fullsized":"2023-07-20T11:05:40.220310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217083+0000","last_change":"2023-07-20T11:05:40.217083+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217083+0000","last_undegraded":"2023-07-20T11:05:40.217083+0000","last_fullsized":"2023-07-20T11:05:40.217083+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220377+0000","last_change":"2023-07-20T11:05:40.220377+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220377+0000","last_undegraded":"2023-07-20T11:05:40.220377+0000","last_fullsized":"2023-07-20T11:05:40.220377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395966+0000","last_change":"2023-07-20T11:05:40.395966+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395966+0000","last_undegraded":"2023-07-20T11:05:40.395966+0000","last_fullsized":"2023-07-20T11:05:40.395966+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220610+0000","last_change":"2023-07-20T11:05:40.220610+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220610+0000","last_undegraded":"2023-07-20T11:05:40.220610+0000","last_fullsized":"2023-07-20T11:05:40.220610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217104+0000","last_change":"2023-07-20T11:05:40.217104+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217104+0000","last_undegraded":"2023-07-20T11:05:40.217104+0000","last_fullsized":"2023-07-20T11:05:40.217104+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217463+0000","last_change":"2023-07-20T11:05:40.217463+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217463+0000","last_undegraded":"2023-07-20T11:05:40.217463+0000","last_fullsized":"2023-07-20T11:05:40.217463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395930+0000","last_change":"2023-07-20T11:05:40.395930+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395930+0000","last_undegraded":"2023-07-20T11:05:40.395930+0000","last_fullsized":"2023-07-20T11:05:40.395930+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396039+0000","last_change":"2023-07-20T11:05:40.396039+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396039+0000","last_undegraded":"2023-07-20T11:05:40.396039+0000","last_fullsized":"2023-07-20T11:05:40.396039+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217460+0000","last_change":"2023-07-20T11:05:40.217460+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217460+0000","last_undegraded":"2023-07-20T11:05:40.217460+0000","last_fullsized":"2023-07-20T11:05:40.217460+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217122+0000","last_change":"2023-07-20T11:05:40.217122+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217122+0000","last_undegraded":"2023-07-20T11:05:40.217122+0000","last_fullsized":"2023-07-20T11:05:40.217122+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217415+0000","last_change":"2023-07-20T11:05:40.217415+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217415+0000","last_undegraded":"2023-07-20T11:05:40.217415+0000","last_fullsized":"2023-07-20T11:05:40.217415+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396049+0000","last_change":"2023-07-20T11:05:40.396049+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396049+0000","last_undegraded":"2023-07-20T11:05:40.396049+0000","last_fullsized":"2023-07-20T11:05:40.396049+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217130+0000","last_change":"2023-07-20T11:05:40.217130+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217130+0000","last_undegraded":"2023-07-20T11:05:40.217130+0000","last_fullsized":"2023-07-20T11:05:40.217130+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395792+0000","last_change":"2023-07-20T11:05:40.395792+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395792+0000","last_undegraded":"2023-07-20T11:05:40.395792+0000","last_fullsized":"2023-07-20T11:05:40.395792+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396025+0000","last_change":"2023-07-20T11:05:40.396025+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396025+0000","last_undegraded":"2023-07-20T11:05:40.396025+0000","last_fullsized":"2023-07-20T11:05:40.396025+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220682+0000","last_change":"2023-07-20T11:05:40.220682+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220682+0000","last_undegraded":"2023-07-20T11:05:40.220682+0000","last_fullsized":"2023-07-20T11:05:40.220682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396345+0000","last_change":"2023-07-20T11:05:40.396345+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396345+0000","last_undegraded":"2023-07-20T11:05:40.396345+0000","last_fullsized":"2023-07-20T11:05:40.396345+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'249","reported_seq":904,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397566+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:05:40.397566+0000","last_peered":"2023-07-20T11:05:40.397566+0000","last_clean":"2023-07-20T11:05:40.397566+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:05:40.397566+0000","last_undegraded":"2023-07-20T11:05:40.397566+0000","last_fullsized":"2023-07-20T11:05:40.397566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:37.369439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218997+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:05:40.218997+0000","last_peered":"2023-07-20T11:05:40.218997+0000","last_clean":"2023-07-20T11:05:40.218997+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:05:40.218997+0000","last_undegraded":"2023-07-20T11:05:40.218997+0000","last_fullsized":"2023-07-20T11:05:40.218997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:18:18.418307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220396+0000","last_change":"2023-07-20T11:05:40.220396+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220396+0000","last_undegraded":"2023-07-20T11:05:40.220396+0000","last_fullsized":"2023-07-20T11:05:40.220396+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":280,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397500+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:05:40.397500+0000","last_peered":"2023-07-20T11:05:40.397500+0000","last_clean":"2023-07-20T11:05:40.397500+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:05:40.397500+0000","last_undegraded":"2023-07-20T11:05:40.397500+0000","last_fullsized":"2023-07-20T11:05:40.397500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:49.793982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396640+0000","last_change":"2023-07-20T11:05:40.396640+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396640+0000","last_undegraded":"2023-07-20T11:05:40.396640+0000","last_fullsized":"2023-07-20T11:05:40.396640+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":305,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.215929+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:05:40.215929+0000","last_peered":"2023-07-20T11:05:40.215929+0000","last_clean":"2023-07-20T11:05:40.215929+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:05:40.215929+0000","last_undegraded":"2023-07-20T11:05:40.215929+0000","last_fullsized":"2023-07-20T11:05:40.215929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:24:25.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217471+0000","last_change":"2023-07-20T11:05:40.217471+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217471+0000","last_undegraded":"2023-07-20T11:05:40.217471+0000","last_fullsized":"2023-07-20T11:05:40.217471+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218768+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:05:40.218768+0000","last_peered":"2023-07-20T11:05:40.218768+0000","last_clean":"2023-07-20T11:05:40.218768+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:05:40.218768+0000","last_undegraded":"2023-07-20T11:05:40.218768+0000","last_fullsized":"2023-07-20T11:05:40.218768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:25.267191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395909+0000","last_change":"2023-07-20T11:05:40.395909+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395909+0000","last_undegraded":"2023-07-20T11:05:40.395909+0000","last_fullsized":"2023-07-20T11:05:40.395909+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":275,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397318+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:05:40.397318+0000","last_peered":"2023-07-20T11:05:40.397318+0000","last_clean":"2023-07-20T11:05:40.397318+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:05:40.397318+0000","last_undegraded":"2023-07-20T11:05:40.397318+0000","last_fullsized":"2023-07-20T11:05:40.397318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:18.804091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395908+0000","last_change":"2023-07-20T11:05:40.395908+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395908+0000","last_undegraded":"2023-07-20T11:05:40.395908+0000","last_fullsized":"2023-07-20T11:05:40.395908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397742+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:05:40.397742+0000","last_peered":"2023-07-20T11:05:40.397742+0000","last_clean":"2023-07-20T11:05:40.397742+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:05:40.397742+0000","last_undegraded":"2023-07-20T11:05:40.397742+0000","last_fullsized":"2023-07-20T11:05:40.397742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:52:48.700219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.218288+0000","last_change":"2023-07-20T11:05:40.218288+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.218288+0000","last_undegraded":"2023-07-20T11:05:40.218288+0000","last_fullsized":"2023-07-20T11:05:40.218288+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397344+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:05:40.397344+0000","last_peered":"2023-07-20T11:05:40.397344+0000","last_clean":"2023-07-20T11:05:40.397344+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:05:40.397344+0000","last_undegraded":"2023-07-20T11:05:40.397344+0000","last_fullsized":"2023-07-20T11:05:40.397344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:53.428992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217425+0000","last_change":"2023-07-20T11:05:40.217425+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217425+0000","last_undegraded":"2023-07-20T11:05:40.217425+0000","last_fullsized":"2023-07-20T11:05:40.217425+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.222236+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:05:40.222236+0000","last_peered":"2023-07-20T11:05:40.222236+0000","last_clean":"2023-07-20T11:05:40.222236+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:05:40.222236+0000","last_undegraded":"2023-07-20T11:05:40.222236+0000","last_fullsized":"2023-07-20T11:05:40.222236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:08:20.115694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575748,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.78800000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80400000000000005,"15min":0.77600000000000002},"min":{"1min":0.58199999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.754},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.433},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79100000000000004,"15min":0.76900000000000002},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.49099999999999999},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.54100000000000004,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.40699999999999997},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1916928,"data_stored":973181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.879},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575747,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.40500000000000003,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.05},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.115},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0529999999999999,"5min":1.1919999999999999,"15min":1.202},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0149999999999999,"5min":1.093,"15min":1.266},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.53600000000000003},"max":{"1min":1.099,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.67200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3,"15min":1.3},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.83699999999999997},"min":{"1min":0.64600000000000002,"5min":0.59499999999999997,"15min":0.55200000000000005},"max":{"1min":1.0800000000000001,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.60599999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.3129999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82999999999999996},"min":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"max":{"1min":1.0389999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66000000000000003,"5min":0.74199999999999999,"15min":0.82999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.86699999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.84799999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.51400000000000001,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":0.79900000000000004,"15min":0.92500000000000004},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79000000000000004,"15min":0.79300000000000004},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.304},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.53000000000000003},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.3129999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.66900000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1259999999999999,"5min":1.179,"15min":1.2749999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.123,"5min":1.163,"15min":1.173},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41780,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330060,"statfs":{"total":96636764160,"available":96593981440,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.746},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.88700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:05:46.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:05:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 Processor -- start 2023-07-20T11:05:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 -- start start 2023-07-20T11:05:46.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0cd4b0 0x7f7c0c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0c0d16b0 con 0x7f7c0c15cab0 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0c0d31c0 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c13d03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0b3520 con 0x7f7c0c0cd4b0 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35312/0 (socket says 172.21.15.82:35312) 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 -- 172.21.15.82:0/1433031562 learned_addr learned my addr 172.21.15.82:0/1433031562 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:46.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c122a0640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0cd4b0 0x7f7c0c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 -- 172.21.15.82:0/1433031562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0cd4b0 msgr2=0x7f7c0c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:46.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0cd4b0 0x7f7c0c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 -- 172.21.15.82:0/1433031562 >> v1:172.21.15.183:6789/0 conn(0x7f7c0c15cab0 legacy=0x7f7c0c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.851+0000 7f7c1129e640 1 -- 172.21.15.82:0/1433031562 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c0d0a10 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c1129e640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009870 tx=0x7f7bfc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4b17cde4e6bf07 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c10a9d640 1 -- 172.21.15.82:0/1433031562 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0aa670 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c10a9d640 1 -- 172.21.15.82:0/1433031562 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0aa7d0 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c10a9d640 1 -- 172.21.15.82:0/1433031562 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0aab60 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 -- 172.21.15.82:0/1433031562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c0d0d10 msgr2=0x7f7c0c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc009870 tx=0x7f7bfc01c510 comp rx=0 tx=0).stop 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 -- 172.21.15.82:0/1433031562 shutdown_connections 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0cd4b0 0x7f7c0c0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1433031562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c0d0d10 0x7f7c0c0d1170 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 -- 172.21.15.82:0/1433031562 >> 172.21.15.82:0/1433031562 conn(0x7f7c0c08c120 msgr2=0x7f7c0c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 -- 172.21.15.82:0/1433031562 shutdown_connections 2023-07-20T11:05:46.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.855+0000 7f7c13d03640 1 -- 172.21.15.82:0/1433031562 wait complete. 2023-07-20T11:05:46.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 Processor -- start 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- start start 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c0c0cd4b0 0x7f7c0c149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0d0d10 0x7f7c0c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c14a210 con 0x7f7c0c15cab0 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15f140 con 0x7f7c0c0cd4b0 2023-07-20T11:05:46.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c15f420 con 0x7f7c0c0d0d10 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35326/0 (socket says 172.21.15.82:35326) 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 -- 172.21.15.82:0/1833619837 learned_addr learned my addr 172.21.15.82:0/1833619837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c1129e640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0d0d10 0x7f7c0c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c11a9f640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c0c0cd4b0 0x7f7c0c149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 -- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0d0d10 msgr2=0x7f7c0c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0d0d10 0x7f7c0c159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 -- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c0c0cd4b0 msgr2=0x7f7c0c149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c0c0cd4b0 0x7f7c0c149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 -- 172.21.15.82:0/1833619837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0094d0 con 0x7f7c0c15cab0 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c122a0640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7c04007e60 tx=0x7f7c0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04014420 con 0x7f7c0c15cab0 2023-07-20T11:05:46.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040145a0 con 0x7f7c0c15cab0 2023-07-20T11:05:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c15f700 con 0x7f7c0c15cab0 2023-07-20T11:05:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04014950 con 0x7f7c0c15cab0 2023-07-20T11:05:46.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.859+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c15edf0 con 0x7f7c0c15cab0 2023-07-20T11:05:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c073c70 con 0x7f7c0c15cab0 2023-07-20T11:05:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c04014ab0 con 0x7f7c0c15cab0 2023-07-20T11:05:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c027fc640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 0x7f7bf0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:46.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7c04084620 con 0x7f7c0c15cab0 2023-07-20T11:05:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c11a9f640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 0x7f7bf0068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:46.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.863+0000 7f7c11a9f640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 0x7f7bf0068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c153110 tx=0x7f7c08009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:46.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:46.867+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c04055470 con 0x7f7c0c15cab0 2023-07-20T11:05:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.011+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c0c15f2b0 con 0x7f7bf00663d0 2023-07-20T11:05:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.019+0000 7f7c027fc640 1 -- 172.21.15.82:0/1833619837 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299489 (secure 0 0 0) 0x7f7c0c15f2b0 con 0x7f7bf00663d0 2023-07-20T11:05:47.003 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:05:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 msgr2=0x7f7bf0068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 0x7f7bf0068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c153110 tx=0x7f7c08009040 comp rx=0 tx=0).stop 2023-07-20T11:05:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 msgr2=0x7f7c0c159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7c04007e60 tx=0x7f7c0400e4b0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 shutdown_connections 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f7bf00663d0 0x7f7bf0068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c0c15cab0 0x7f7c0c159660 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7c0c0d0d10 0x7f7c0c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 --2- 172.21.15.82:0/1833619837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7c0c0cd4b0 0x7f7c0c149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 >> 172.21.15.82:0/1833619837 conn(0x7f7c0c08c120 msgr2=0x7f7c0c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 shutdown_connections 2023-07-20T11:05:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.023+0000 7f7c13d03640 1 -- 172.21.15.82:0/1833619837 wait complete. 2023-07-20T11:05:47.022 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T11:05:45.144049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":370124,"kb_used_data":16220,"kb_used_omap":13,"kb_used_meta":353778,"kb_avail":754604596,"statfs":{"total":773094113280,"available":772715106304,"internally_reserved":0,"allocated":16609280,"data_stored":9009878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":362268760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.929455"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220384+0000","last_change":"2023-07-20T11:05:40.220384+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220384+0000","last_undegraded":"2023-07-20T11:05:40.220384+0000","last_fullsized":"2023-07-20T11:05:40.220384+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220737+0000","last_change":"2023-07-20T11:05:40.220737+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220737+0000","last_undegraded":"2023-07-20T11:05:40.220737+0000","last_fullsized":"2023-07-20T11:05:40.220737+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396584+0000","last_change":"2023-07-20T11:05:40.396584+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396584+0000","last_undegraded":"2023-07-20T11:05:40.396584+0000","last_fullsized":"2023-07-20T11:05:40.396584+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396619+0000","last_change":"2023-07-20T11:05:40.396619+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396619+0000","last_undegraded":"2023-07-20T11:05:40.396619+0000","last_fullsized":"2023-07-20T11:05:40.396619+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217731+0000","last_change":"2023-07-20T11:05:40.217731+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217731+0000","last_undegraded":"2023-07-20T11:05:40.217731+0000","last_fullsized":"2023-07-20T11:05:40.217731+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220621+0000","last_change":"2023-07-20T11:05:40.220621+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220621+0000","last_undegraded":"2023-07-20T11:05:40.220621+0000","last_fullsized":"2023-07-20T11:05:40.220621+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396519+0000","last_change":"2023-07-20T11:05:40.396519+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396519+0000","last_undegraded":"2023-07-20T11:05:40.396519+0000","last_fullsized":"2023-07-20T11:05:40.396519+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220310+0000","last_change":"2023-07-20T11:05:40.220310+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220310+0000","last_undegraded":"2023-07-20T11:05:40.220310+0000","last_fullsized":"2023-07-20T11:05:40.220310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217083+0000","last_change":"2023-07-20T11:05:40.217083+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217083+0000","last_undegraded":"2023-07-20T11:05:40.217083+0000","last_fullsized":"2023-07-20T11:05:40.217083+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220377+0000","last_change":"2023-07-20T11:05:40.220377+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220377+0000","last_undegraded":"2023-07-20T11:05:40.220377+0000","last_fullsized":"2023-07-20T11:05:40.220377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395966+0000","last_change":"2023-07-20T11:05:40.395966+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395966+0000","last_undegraded":"2023-07-20T11:05:40.395966+0000","last_fullsized":"2023-07-20T11:05:40.395966+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220610+0000","last_change":"2023-07-20T11:05:40.220610+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220610+0000","last_undegraded":"2023-07-20T11:05:40.220610+0000","last_fullsized":"2023-07-20T11:05:40.220610+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217104+0000","last_change":"2023-07-20T11:05:40.217104+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217104+0000","last_undegraded":"2023-07-20T11:05:40.217104+0000","last_fullsized":"2023-07-20T11:05:40.217104+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217463+0000","last_change":"2023-07-20T11:05:40.217463+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217463+0000","last_undegraded":"2023-07-20T11:05:40.217463+0000","last_fullsized":"2023-07-20T11:05:40.217463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395930+0000","last_change":"2023-07-20T11:05:40.395930+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395930+0000","last_undegraded":"2023-07-20T11:05:40.395930+0000","last_fullsized":"2023-07-20T11:05:40.395930+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396039+0000","last_change":"2023-07-20T11:05:40.396039+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396039+0000","last_undegraded":"2023-07-20T11:05:40.396039+0000","last_fullsized":"2023-07-20T11:05:40.396039+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217460+0000","last_change":"2023-07-20T11:05:40.217460+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217460+0000","last_undegraded":"2023-07-20T11:05:40.217460+0000","last_fullsized":"2023-07-20T11:05:40.217460+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217122+0000","last_change":"2023-07-20T11:05:40.217122+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217122+0000","last_undegraded":"2023-07-20T11:05:40.217122+0000","last_fullsized":"2023-07-20T11:05:40.217122+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217415+0000","last_change":"2023-07-20T11:05:40.217415+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217415+0000","last_undegraded":"2023-07-20T11:05:40.217415+0000","last_fullsized":"2023-07-20T11:05:40.217415+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396049+0000","last_change":"2023-07-20T11:05:40.396049+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396049+0000","last_undegraded":"2023-07-20T11:05:40.396049+0000","last_fullsized":"2023-07-20T11:05:40.396049+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217130+0000","last_change":"2023-07-20T11:05:40.217130+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217130+0000","last_undegraded":"2023-07-20T11:05:40.217130+0000","last_fullsized":"2023-07-20T11:05:40.217130+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395792+0000","last_change":"2023-07-20T11:05:40.395792+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395792+0000","last_undegraded":"2023-07-20T11:05:40.395792+0000","last_fullsized":"2023-07-20T11:05:40.395792+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396025+0000","last_change":"2023-07-20T11:05:40.396025+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396025+0000","last_undegraded":"2023-07-20T11:05:40.396025+0000","last_fullsized":"2023-07-20T11:05:40.396025+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220682+0000","last_change":"2023-07-20T11:05:40.220682+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220682+0000","last_undegraded":"2023-07-20T11:05:40.220682+0000","last_fullsized":"2023-07-20T11:05:40.220682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396345+0000","last_change":"2023-07-20T11:05:40.396345+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396345+0000","last_undegraded":"2023-07-20T11:05:40.396345+0000","last_fullsized":"2023-07-20T11:05:40.396345+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'249","reported_seq":904,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397566+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:05:40.397566+0000","last_peered":"2023-07-20T11:05:40.397566+0000","last_clean":"2023-07-20T11:05:40.397566+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:05:40.397566+0000","last_undegraded":"2023-07-20T11:05:40.397566+0000","last_fullsized":"2023-07-20T11:05:40.397566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:37.369439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218997+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:05:40.218997+0000","last_peered":"2023-07-20T11:05:40.218997+0000","last_clean":"2023-07-20T11:05:40.218997+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:05:40.218997+0000","last_undegraded":"2023-07-20T11:05:40.218997+0000","last_fullsized":"2023-07-20T11:05:40.218997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:18:18.418307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.220396+0000","last_change":"2023-07-20T11:05:40.220396+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.220396+0000","last_undegraded":"2023-07-20T11:05:40.220396+0000","last_fullsized":"2023-07-20T11:05:40.220396+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":280,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397500+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:05:40.397500+0000","last_peered":"2023-07-20T11:05:40.397500+0000","last_clean":"2023-07-20T11:05:40.397500+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:05:40.397500+0000","last_undegraded":"2023-07-20T11:05:40.397500+0000","last_fullsized":"2023-07-20T11:05:40.397500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:49.793982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.396640+0000","last_change":"2023-07-20T11:05:40.396640+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.396640+0000","last_undegraded":"2023-07-20T11:05:40.396640+0000","last_fullsized":"2023-07-20T11:05:40.396640+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":305,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.215929+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:05:40.215929+0000","last_peered":"2023-07-20T11:05:40.215929+0000","last_clean":"2023-07-20T11:05:40.215929+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:05:40.215929+0000","last_undegraded":"2023-07-20T11:05:40.215929+0000","last_fullsized":"2023-07-20T11:05:40.215929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:24:25.063306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217471+0000","last_change":"2023-07-20T11:05:40.217471+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217471+0000","last_undegraded":"2023-07-20T11:05:40.217471+0000","last_fullsized":"2023-07-20T11:05:40.217471+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":311,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.218768+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:05:40.218768+0000","last_peered":"2023-07-20T11:05:40.218768+0000","last_clean":"2023-07-20T11:05:40.218768+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:05:40.218768+0000","last_undegraded":"2023-07-20T11:05:40.218768+0000","last_fullsized":"2023-07-20T11:05:40.218768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:25.267191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395909+0000","last_change":"2023-07-20T11:05:40.395909+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395909+0000","last_undegraded":"2023-07-20T11:05:40.395909+0000","last_fullsized":"2023-07-20T11:05:40.395909+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":275,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397318+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:05:40.397318+0000","last_peered":"2023-07-20T11:05:40.397318+0000","last_clean":"2023-07-20T11:05:40.397318+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:05:40.397318+0000","last_undegraded":"2023-07-20T11:05:40.397318+0000","last_fullsized":"2023-07-20T11:05:40.397318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:18.804091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.395908+0000","last_change":"2023-07-20T11:05:40.395908+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.395908+0000","last_undegraded":"2023-07-20T11:05:40.395908+0000","last_fullsized":"2023-07-20T11:05:40.395908+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":278,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397742+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:05:40.397742+0000","last_peered":"2023-07-20T11:05:40.397742+0000","last_clean":"2023-07-20T11:05:40.397742+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:05:40.397742+0000","last_undegraded":"2023-07-20T11:05:40.397742+0000","last_fullsized":"2023-07-20T11:05:40.397742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:52:48.700219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.218288+0000","last_change":"2023-07-20T11:05:40.218288+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.218288+0000","last_undegraded":"2023-07-20T11:05:40.218288+0000","last_fullsized":"2023-07-20T11:05:40.218288+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.397344+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:05:40.397344+0000","last_peered":"2023-07-20T11:05:40.397344+0000","last_clean":"2023-07-20T11:05:40.397344+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:05:40.397344+0000","last_undegraded":"2023-07-20T11:05:40.397344+0000","last_fullsized":"2023-07-20T11:05:40.397344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:53.428992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:05:41.214341+0000","last_change":"2023-07-20T11:05:41.214341+0000","last_active":"2023-07-20T11:05:41.214341+0000","last_peered":"2023-07-20T11:05:41.214341+0000","last_clean":"2023-07-20T11:05:41.214341+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:41.214341+0000","last_undegraded":"2023-07-20T11:05:41.214341+0000","last_fullsized":"2023-07-20T11:05:41.214341+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-20T11:05:40.217425+0000","last_change":"2023-07-20T11:05:40.217425+0000","last_active":"2023-07-20T11:05:40.206511+0000","last_peered":"2023-07-20T11:05:40.206511+0000","last_clean":"2023-07-20T11:05:40.206511+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:05:40.217425+0000","last_undegraded":"2023-07-20T11:05:40.217425+0000","last_fullsized":"2023-07-20T11:05:40.217425+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":273,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-20T11:05:40.222236+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:05:40.222236+0000","last_peered":"2023-07-20T11:05:40.222236+0000","last_clean":"2023-07-20T11:05:40.222236+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:05:40.222236+0000","last_undegraded":"2023-07-20T11:05:40.222236+0000","last_fullsized":"2023-07-20T11:05:40.222236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:08:20.115694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575748,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47536,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324304,"statfs":{"total":96636764160,"available":96588087296,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.78800000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80400000000000005,"15min":0.77600000000000002},"min":{"1min":0.58199999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.754},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.433},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79100000000000004,"15min":0.76900000000000002},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.49099999999999999},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.67300000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.54100000000000004,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.40699999999999997},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.53900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41192,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330648,"statfs":{"total":96636764160,"available":96594583552,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.93200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.78400000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.88500000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575748,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.71999999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.745}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1916928,"data_stored":973181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.55200000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55144,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316696,"statfs":{"total":96636764160,"available":96580296704,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.879},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575747,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59240,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312600,"statfs":{"total":96636764160,"available":96576102400,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.40500000000000003,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.05},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.115},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0529999999999999,"5min":1.1919999999999999,"15min":1.202},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0149999999999999,"5min":1.093,"15min":1.266},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.53600000000000003},"max":{"1min":1.099,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.67200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3,"15min":1.3},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.83699999999999997},"min":{"1min":0.64600000000000002,"5min":0.59499999999999997,"15min":0.55200000000000005},"max":{"1min":1.0800000000000001,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.60599999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.3129999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82999999999999996},"min":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"max":{"1min":1.0389999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575748,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33004,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338836,"statfs":{"total":96636764160,"available":96602968064,"internally_reserved":0,"allocated":1929216,"data_stored":979423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.498,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.66000000000000003,"5min":0.74199999999999999,"15min":0.82999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.80000000000000004,"15min":0.86699999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.33400000000000002},"max":{"1min":0.68999999999999995,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.38300000000000001,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.84799999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.51400000000000001,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.71699999999999997,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.504},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.55200000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.72499999999999998,"5min":0.79900000000000004,"15min":0.92500000000000004},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79000000000000004,"15min":0.79300000000000004},"min":{"1min":0.59799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.304},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.623,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.628},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.82999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.53000000000000003},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.3129999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.82699999999999996,"15min":0.83899999999999997},"min":{"1min":0.66900000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.1259999999999999,"5min":1.179,"15min":1.2749999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.123,"5min":1.163,"15min":1.173},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575748,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41780,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330060,"statfs":{"total":96636764160,"available":96593981440,"internally_reserved":0,"allocated":2523136,"data_stored":1569791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.746},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.82399999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.90600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.88700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:05:47.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-07-20T11:05:47.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-07-20T11:05:47.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-07-20T11:05:47.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-07-20T11:05:47.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-07-20T11:05:47.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-07-20T11:05:47.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-07-20T11:05:47.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-07-20T11:05:47.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-07-20T11:05:47.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-07-20T11:05:47.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-07-20T11:05:47.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-07-20T11:05:47.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-07-20T11:05:47.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-07-20T11:05:47.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-07-20T11:05:47.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-07-20T11:05:47.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-07-20T11:05:47.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-07-20T11:05:47.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-07-20T11:05:47.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-07-20T11:05:47.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-07-20T11:05:47.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-07-20T11:05:47.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-07-20T11:05:47.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-07-20T11:05:47.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-07-20T11:05:47.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-07-20T11:05:47.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-07-20T11:05:47.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-07-20T11:05:47.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-07-20T11:05:47.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-07-20T11:05:47.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-07-20T11:05:47.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-07-20T11:05:47.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-07-20T11:05:47.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-07-20T11:05:47.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220384+0000', 'last_change': '2023-07-20T11:05:40.220384+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220384+0000', 'last_undegraded': '2023-07-20T11:05:40.220384+0000', 'last_fullsized': '2023-07-20T11:05:40.220384+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:05:47.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-07-20T11:05:47.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-07-20T11:05:47.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220737+0000', 'last_change': '2023-07-20T11:05:40.220737+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220737+0000', 'last_undegraded': '2023-07-20T11:05:40.220737+0000', 'last_fullsized': '2023-07-20T11:05:40.220737+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:05:47.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-07-20T11:05:47.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-07-20T11:05:47.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396584+0000', 'last_change': '2023-07-20T11:05:40.396584+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396584+0000', 'last_undegraded': '2023-07-20T11:05:40.396584+0000', 'last_fullsized': '2023-07-20T11:05:40.396584+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-07-20T11:05:47.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-07-20T11:05:47.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396619+0000', 'last_change': '2023-07-20T11:05:40.396619+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396619+0000', 'last_undegraded': '2023-07-20T11:05:40.396619+0000', 'last_fullsized': '2023-07-20T11:05:40.396619+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-07-20T11:05:47.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-07-20T11:05:47.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217731+0000', 'last_change': '2023-07-20T11:05:40.217731+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217731+0000', 'last_undegraded': '2023-07-20T11:05:40.217731+0000', 'last_fullsized': '2023-07-20T11:05:40.217731+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:05:47.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-07-20T11:05:47.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-07-20T11:05:47.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220621+0000', 'last_change': '2023-07-20T11:05:40.220621+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220621+0000', 'last_undegraded': '2023-07-20T11:05:40.220621+0000', 'last_fullsized': '2023-07-20T11:05:40.220621+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:05:47.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-07-20T11:05:47.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2023-07-20T11:05:47.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396519+0000', 'last_change': '2023-07-20T11:05:40.396519+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396519+0000', 'last_undegraded': '2023-07-20T11:05:40.396519+0000', 'last_fullsized': '2023-07-20T11:05:40.396519+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-07-20T11:05:47.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-07-20T11:05:47.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220310+0000', 'last_change': '2023-07-20T11:05:40.220310+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220310+0000', 'last_undegraded': '2023-07-20T11:05:40.220310+0000', 'last_fullsized': '2023-07-20T11:05:40.220310+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:05:47.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-07-20T11:05:47.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-07-20T11:05:47.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217083+0000', 'last_change': '2023-07-20T11:05:40.217083+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217083+0000', 'last_undegraded': '2023-07-20T11:05:40.217083+0000', 'last_fullsized': '2023-07-20T11:05:40.217083+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:05:47.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-07-20T11:05:47.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-07-20T11:05:47.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220377+0000', 'last_change': '2023-07-20T11:05:40.220377+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220377+0000', 'last_undegraded': '2023-07-20T11:05:40.220377+0000', 'last_fullsized': '2023-07-20T11:05:40.220377+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:05:47.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-07-20T11:05:47.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2023-07-20T11:05:47.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.395966+0000', 'last_change': '2023-07-20T11:05:40.395966+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.395966+0000', 'last_undegraded': '2023-07-20T11:05:40.395966+0000', 'last_fullsized': '2023-07-20T11:05:40.395966+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-07-20T11:05:47.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2023-07-20T11:05:47.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220610+0000', 'last_change': '2023-07-20T11:05:40.220610+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220610+0000', 'last_undegraded': '2023-07-20T11:05:40.220610+0000', 'last_fullsized': '2023-07-20T11:05:40.220610+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:05:47.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-07-20T11:05:47.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-07-20T11:05:47.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217104+0000', 'last_change': '2023-07-20T11:05:40.217104+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217104+0000', 'last_undegraded': '2023-07-20T11:05:40.217104+0000', 'last_fullsized': '2023-07-20T11:05:40.217104+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:05:47.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-07-20T11:05:47.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2023-07-20T11:05:47.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217463+0000', 'last_change': '2023-07-20T11:05:40.217463+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217463+0000', 'last_undegraded': '2023-07-20T11:05:40.217463+0000', 'last_fullsized': '2023-07-20T11:05:40.217463+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:05:47.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-07-20T11:05:47.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-07-20T11:05:47.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.395930+0000', 'last_change': '2023-07-20T11:05:40.395930+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.395930+0000', 'last_undegraded': '2023-07-20T11:05:40.395930+0000', 'last_fullsized': '2023-07-20T11:05:40.395930+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-07-20T11:05:47.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-07-20T11:05:47.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396039+0000', 'last_change': '2023-07-20T11:05:40.396039+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396039+0000', 'last_undegraded': '2023-07-20T11:05:40.396039+0000', 'last_fullsized': '2023-07-20T11:05:40.396039+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-07-20T11:05:47.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2023-07-20T11:05:47.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217460+0000', 'last_change': '2023-07-20T11:05:40.217460+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217460+0000', 'last_undegraded': '2023-07-20T11:05:40.217460+0000', 'last_fullsized': '2023-07-20T11:05:40.217460+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:05:47.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-07-20T11:05:47.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-07-20T11:05:47.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217122+0000', 'last_change': '2023-07-20T11:05:40.217122+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217122+0000', 'last_undegraded': '2023-07-20T11:05:40.217122+0000', 'last_fullsized': '2023-07-20T11:05:40.217122+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:05:47.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-07-20T11:05:47.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-07-20T11:05:47.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217415+0000', 'last_change': '2023-07-20T11:05:40.217415+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217415+0000', 'last_undegraded': '2023-07-20T11:05:40.217415+0000', 'last_fullsized': '2023-07-20T11:05:40.217415+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:05:47.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-07-20T11:05:47.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-07-20T11:05:47.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396049+0000', 'last_change': '2023-07-20T11:05:40.396049+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396049+0000', 'last_undegraded': '2023-07-20T11:05:40.396049+0000', 'last_fullsized': '2023-07-20T11:05:40.396049+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-07-20T11:05:47.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-07-20T11:05:47.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217130+0000', 'last_change': '2023-07-20T11:05:40.217130+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217130+0000', 'last_undegraded': '2023-07-20T11:05:40.217130+0000', 'last_fullsized': '2023-07-20T11:05:40.217130+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:05:47.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-07-20T11:05:47.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-07-20T11:05:47.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.395792+0000', 'last_change': '2023-07-20T11:05:40.395792+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.395792+0000', 'last_undegraded': '2023-07-20T11:05:40.395792+0000', 'last_fullsized': '2023-07-20T11:05:40.395792+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-07-20T11:05:47.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-07-20T11:05:47.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396025+0000', 'last_change': '2023-07-20T11:05:40.396025+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396025+0000', 'last_undegraded': '2023-07-20T11:05:40.396025+0000', 'last_fullsized': '2023-07-20T11:05:40.396025+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-07-20T11:05:47.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-07-20T11:05:47.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220682+0000', 'last_change': '2023-07-20T11:05:40.220682+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220682+0000', 'last_undegraded': '2023-07-20T11:05:40.220682+0000', 'last_fullsized': '2023-07-20T11:05:40.220682+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:05:47.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-07-20T11:05:47.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-07-20T11:05:47.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396345+0000', 'last_change': '2023-07-20T11:05:40.396345+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396345+0000', 'last_undegraded': '2023-07-20T11:05:40.396345+0000', 'last_fullsized': '2023-07-20T11:05:40.396345+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-07-20T11:05:47.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-07-20T11:05:47.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.220396+0000', 'last_change': '2023-07-20T11:05:40.220396+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.220396+0000', 'last_undegraded': '2023-07-20T11:05:40.220396+0000', 'last_fullsized': '2023-07-20T11:05:40.220396+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:05:47.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-07-20T11:05:47.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-07-20T11:05:47.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.396640+0000', 'last_change': '2023-07-20T11:05:40.396640+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.396640+0000', 'last_undegraded': '2023-07-20T11:05:40.396640+0000', 'last_fullsized': '2023-07-20T11:05:40.396640+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:05:47.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-07-20T11:05:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-07-20T11:05:47.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217471+0000', 'last_change': '2023-07-20T11:05:40.217471+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217471+0000', 'last_undegraded': '2023-07-20T11:05:40.217471+0000', 'last_fullsized': '2023-07-20T11:05:40.217471+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:05:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-07-20T11:05:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-07-20T11:05:47.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.395909+0000', 'last_change': '2023-07-20T11:05:40.395909+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.395909+0000', 'last_undegraded': '2023-07-20T11:05:40.395909+0000', 'last_fullsized': '2023-07-20T11:05:40.395909+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-07-20T11:05:47.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-07-20T11:05:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.395908+0000', 'last_change': '2023-07-20T11:05:40.395908+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.395908+0000', 'last_undegraded': '2023-07-20T11:05:40.395908+0000', 'last_fullsized': '2023-07-20T11:05:40.395908+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:05:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-07-20T11:05:47.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-07-20T11:05:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.218288+0000', 'last_change': '2023-07-20T11:05:40.218288+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.218288+0000', 'last_undegraded': '2023-07-20T11:05:40.218288+0000', 'last_fullsized': '2023-07-20T11:05:40.218288+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:05:47.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-07-20T11:05:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:05:41.214341+0000', 'last_change': '2023-07-20T11:05:41.214341+0000', 'last_active': '2023-07-20T11:05:41.214341+0000', 'last_peered': '2023-07-20T11:05:41.214341+0000', 'last_clean': '2023-07-20T11:05:41.214341+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:41.214341+0000', 'last_undegraded': '2023-07-20T11:05:41.214341+0000', 'last_fullsized': '2023-07-20T11:05:41.214341+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:41.214341+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:05:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2023-07-20T11:05:47.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:05:40.217425+0000', 'last_change': '2023-07-20T11:05:40.217425+0000', 'last_active': '2023-07-20T11:05:40.206511+0000', 'last_peered': '2023-07-20T11:05:40.206511+0000', 'last_clean': '2023-07-20T11:05:40.206511+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:05:40.217425+0000', 'last_undegraded': '2023-07-20T11:05:40.217425+0000', 'last_fullsized': '2023-07-20T11:05:40.217425+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'last_clean_scrub_stamp': '2023-07-20T11:05:40.206511+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:05:47.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T11:05:47.184 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T11:05:47.203+0000 7f3a89177640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:05:47.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 Processor -- start 2023-07-20T11:05:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 -- start start 2023-07-20T11:05:47.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb280d0d10 0x7feb280d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 0x7feb280cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280d16b0 con 0x7feb2815cab0 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280d31c0 con 0x7feb280d0d10 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2e996640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280b3520 con 0x7feb280cd4b0 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb277fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb280d0d10 0x7feb280d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb27fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feb2815cab0 0x7feb280d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47470/0 (socket says 172.21.15.82:47470) 2023-07-20T11:05:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb27fff640 1 -- 172.21.15.82:0/4109137635 learned_addr learned my addr 172.21.15.82:0/4109137635 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb277fe640 1 -- 172.21.15.82:0/4109137635 >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 msgr2=0x7feb280cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2cf33640 1 --2- 172.21.15.82:0/4109137635 >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 0x7feb280cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb26ffd640 1 -- 172.21.15.82:0/4109137635 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159329780 0 0) 0x7feb280d16b0 con 0x7feb2815cab0 2023-07-20T11:05:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb277fe640 1 --2- 172.21.15.82:0/4109137635 >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 0x7feb280cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb277fe640 1 -- 172.21.15.82:0/4109137635 >> v1:172.21.15.82:6789/0 conn(0x7feb2815cab0 legacy=0x7feb280d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb277fe640 1 -- 172.21.15.82:0/4109137635 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280d0a10 con 0x7feb280d0d10 2023-07-20T11:05:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.255+0000 7feb2cf33640 1 --2- 172.21.15.82:0/4109137635 >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 0x7feb280cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb277fe640 1 --2- 172.21.15.82:0/4109137635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d1170 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7feb28071cd0 tx=0x7feb1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb9ff1c5b51afa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb26ffd640 1 -- 172.21.15.82:0/4109137635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0a7070 con 0x7feb280d0d10 2023-07-20T11:05:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb26ffd640 1 -- 172.21.15.82:0/4109137635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c0ab430 con 0x7feb280d0d10 2023-07-20T11:05:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb26ffd640 1 -- 172.21.15.82:0/4109137635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0ab7c0 con 0x7feb280d0d10 2023-07-20T11:05:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 -- 172.21.15.82:0/4109137635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 msgr2=0x7feb280d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 --2- 172.21.15.82:0/4109137635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d1170 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7feb28071cd0 tx=0x7feb1c01c430 comp rx=0 tx=0).stop 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 -- 172.21.15.82:0/4109137635 shutdown_connections 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 --2- 172.21.15.82:0/4109137635 >> v2:172.21.15.183:3300/0 conn(0x7feb280cd4b0 0x7feb280cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 --2- 172.21.15.82:0/4109137635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d1170 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 -- 172.21.15.82:0/4109137635 >> 172.21.15.82:0/4109137635 conn(0x7feb2808c120 msgr2=0x7feb2809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 -- 172.21.15.82:0/4109137635 shutdown_connections 2023-07-20T11:05:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.259+0000 7feb2e996640 1 -- 172.21.15.82:0/4109137635 wait complete. 2023-07-20T11:05:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 Processor -- start 2023-07-20T11:05:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- start start 2023-07-20T11:05:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb280cd4b0 0x7feb280d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 0x7feb281573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2815ebf0 con 0x7feb280d0d10 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2815eed0 con 0x7feb2815cab0 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2815f1b0 con 0x7feb280cd4b0 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35350/0 (socket says 172.21.15.82:35350) 2023-07-20T11:05:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 -- 172.21.15.82:0/2848107281 learned_addr learned my addr 172.21.15.82:0/2848107281 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2cf33640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 0x7feb281573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb27fff640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb280cd4b0 0x7feb280d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 -- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb280cd4b0 msgr2=0x7feb280d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb280cd4b0 0x7feb280d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 -- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 msgr2=0x7feb281573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 0x7feb281573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 -- 172.21.15.82:0/2848107281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c009420 con 0x7feb280d0d10 2023-07-20T11:05:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2cf33640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 0x7feb281573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb277fe640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0ad040 tx=0x7feb1c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0b5810 con 0x7feb280d0d10 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1c0abe90 con 0x7feb280d0d10 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0b5bd0 con 0x7feb280d0d10 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2815f490 con 0x7feb280d0d10 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.263+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2815e780 con 0x7feb280d0d10 2023-07-20T11:05:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2815e970 con 0x7feb280d0d10 2023-07-20T11:05:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb1c0b5d30 con 0x7feb280d0d10 2023-07-20T11:05:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb24ff9640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 0x7feb14068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7feb1c11e840 con 0x7feb280d0d10 2023-07-20T11:05:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb27fff640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 0x7feb14068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.267+0000 7feb27fff640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 0x7feb14068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb18000f70 tx=0x7feb18007c10 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.271+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb1c0eba60 con 0x7feb280d0d10 2023-07-20T11:05:47.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.471+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feb28073c70 con 0x7feb280d0d10 2023-07-20T11:05:47.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.471+0000 7feb24ff9640 1 -- 172.21.15.82:0/2848107281 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1112 (secure 0 0 0) 0x7feb1c0ef080 con 0x7feb280d0d10 2023-07-20T11:05:47.454 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:47.454 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4546,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":379006976,"bytes_avail":772715106304,"bytes_total":773094113280,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":74,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9579}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-20T10:55:43.575257+0000","services":{}},"progress_events":{}} 2023-07-20T11:05:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 msgr2=0x7feb14068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 0x7feb14068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb18000f70 tx=0x7feb18007c10 comp rx=0 tx=0).stop 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 msgr2=0x7feb280d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0ad040 tx=0x7feb1c01ac70 comp rx=0 tx=0).stop 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 shutdown_connections 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7feb140663a0 0x7feb14068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb2815cab0 0x7feb281573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb280d0d10 0x7feb280d2a60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 --2- 172.21.15.82:0/2848107281 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb280cd4b0 0x7feb280d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 >> 172.21.15.82:0/2848107281 conn(0x7feb2808c120 msgr2=0x7feb280b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 shutdown_connections 2023-07-20T11:05:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.475+0000 7feb2e996640 1 -- 172.21.15.82:0/2848107281 wait complete. 2023-07-20T11:05:47.474 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T11:05:47.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 Processor -- start 2023-07-20T11:05:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 -- start start 2023-07-20T11:05:47.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21880afda0 0x7f21880ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880b12a0 con 0x7f21880b2060 2023-07-20T11:05:47.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21880b1580 con 0x7f218815a8e0 2023-07-20T11:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f218d856640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21880b3160 con 0x7f21880afda0 2023-07-20T11:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f21877fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21880b2060 0x7f21880b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47482/0 (socket says 172.21.15.82:47482) 2023-07-20T11:05:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f21877fe640 1 -- 172.21.15.82:0/2138881465 learned_addr learned my addr 172.21.15.82:0/2138881465 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f2186ffd640 1 --2- 172.21.15.82:0/2138881465 >> v2:172.21.15.82:3300/0 conn(0x7f21880afda0 0x7f21880ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f21867fc640 1 -- 172.21.15.82:0/2138881465 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128717949 0 0) 0x7f21880b12a0 con 0x7f21880b2060 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f21867fc640 1 -- 172.21.15.82:0/2138881465 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2174003530 con 0x7f21880b2060 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f2186ffd640 1 -- 172.21.15.82:0/2138881465 >> v1:172.21.15.183:6789/0 conn(0x7f218815a8e0 legacy=0x7f21880b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f2186ffd640 1 -- 172.21.15.82:0/2138881465 >> v1:172.21.15.82:6789/0 conn(0x7f21880b2060 legacy=0x7f21880b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.631+0000 7f2186ffd640 1 -- 172.21.15.82:0/2138881465 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21880b1860 con 0x7f21880afda0 2023-07-20T11:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f2186ffd640 1 --2- 172.21.15.82:0/2138881465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880afda0 0x7f21880ca6b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f21780097c0 tx=0x7f217801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91faaae7f7ec8058 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f21867fc640 1 -- 172.21.15.82:0/2138881465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21780ab600 con 0x7f21880afda0 2023-07-20T11:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f21867fc640 1 -- 172.21.15.82:0/2138881465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21780a7050 con 0x7f21880afda0 2023-07-20T11:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f21867fc640 1 -- 172.21.15.82:0/2138881465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21780ab980 con 0x7f21880afda0 2023-07-20T11:05:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 -- 172.21.15.82:0/2138881465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880afda0 msgr2=0x7f21880ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 --2- 172.21.15.82:0/2138881465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880afda0 0x7f21880ca6b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f21780097c0 tx=0x7f217801c2f0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 -- 172.21.15.82:0/2138881465 shutdown_connections 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 --2- 172.21.15.82:0/2138881465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21880afda0 0x7f21880ca6b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 -- 172.21.15.82:0/2138881465 >> 172.21.15.82:0/2138881465 conn(0x7f21880cada0 msgr2=0x7f21880cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 -- 172.21.15.82:0/2138881465 shutdown_connections 2023-07-20T11:05:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.635+0000 7f218d856640 1 -- 172.21.15.82:0/2138881465 wait complete. 2023-07-20T11:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 Processor -- start 2023-07-20T11:05:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- start start 2023-07-20T11:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21880afda0 0x7f2188148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21880b2060 0x7f21880c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188150fd0 con 0x7f218815a8e0 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2188151220 con 0x7f21880afda0 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2188151500 con 0x7f21880b2060 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35374/0 (socket says 172.21.15.82:35374) 2023-07-20T11:05:47.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 -- 172.21.15.82:0/497128979 learned_addr learned my addr 172.21.15.82:0/497128979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 -- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21880b2060 msgr2=0x7f21880c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21880b2060 0x7f21880c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 -- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21880afda0 msgr2=0x7f2188148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21880afda0 0x7f2188148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 -- 172.21.15.82:0/497128979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2178009420 con 0x7f218815a8e0 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f21877fe640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f218000c3c0 tx=0x7f218000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180005cf0 con 0x7f218815a8e0 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2180005e50 con 0x7f218815a8e0 2023-07-20T11:05:47.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2180007310 con 0x7f218815a8e0 2023-07-20T11:05:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21881517e0 con 0x7f218815a8e0 2023-07-20T11:05:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.639+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2188071830 con 0x7f218815a8e0 2023-07-20T11:05:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2188073c70 con 0x7f218815a8e0 2023-07-20T11:05:47.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2180007470 con 0x7f218815a8e0 2023-07-20T11:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f2184ff9640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 0x7f2168068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f21800831e0 con 0x7f218815a8e0 2023-07-20T11:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f2186ffd640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 0x7f2168068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:47.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.643+0000 7f2186ffd640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 0x7f2168068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21780ad000 tx=0x7f2178008040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:47.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.647+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2180050460 con 0x7f218815a8e0 2023-07-20T11:05:47.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.791+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2188151d00 con 0x7f21680663a0 2023-07-20T11:05:47.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.799+0000 7f2184ff9640 1 -- 172.21.15.82:0/497128979 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311892 (secure 0 0 0) 0x7f2188151d00 con 0x7f21680663a0 2023-07-20T11:05:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:47.786 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:05:47.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 msgr2=0x7f2168068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 0x7f2168068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21780ad000 tx=0x7f2178008040 comp rx=0 tx=0).stop 2023-07-20T11:05:47.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 msgr2=0x7f21880aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:47.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f218000c3c0 tx=0x7f218000c880 comp rx=0 tx=0).stop 2023-07-20T11:05:47.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 shutdown_connections 2023-07-20T11:05:47.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f21680663a0 0x7f2168068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f218815a8e0 0x7f21880aee20 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21880b2060 0x7f21880c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 --2- 172.21.15.82:0/497128979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21880afda0 0x7f2188148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:47.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 >> 172.21.15.82:0/497128979 conn(0x7f21880cada0 msgr2=0x7f21880701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:47.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 shutdown_connections 2023-07-20T11:05:47.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:47.803+0000 7f218d856640 1 -- 172.21.15.82:0/497128979 wait complete. 2023-07-20T11:05:47.803 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T11:05:47.144558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":374592,"kb_used_data":16584,"kb_used_omap":13,"kb_used_meta":357874,"kb_avail":754600128,"statfs":{"total":773094113280,"available":772710531072,"internally_reserved":0,"allocated":16982016,"data_stored":9185780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":366463064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001306"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074482+0000","last_change":"2023-07-20T11:05:42.089075+0000","last_active":"2023-07-20T11:05:43.074482+0000","last_peered":"2023-07-20T11:05:43.074482+0000","last_clean":"2023-07-20T11:05:43.074482+0000","last_became_active":"2023-07-20T11:05:42.088739+0000","last_became_peered":"2023-07-20T11:05:42.088739+0000","last_unstale":"2023-07-20T11:05:43.074482+0000","last_undegraded":"2023-07-20T11:05:43.074482+0000","last_fullsized":"2023-07-20T11:05:43.074482+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:21.589283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469006+0000","last_change":"2023-07-20T11:05:42.088173+0000","last_active":"2023-07-20T11:05:44.469006+0000","last_peered":"2023-07-20T11:05:44.469006+0000","last_clean":"2023-07-20T11:05:44.469006+0000","last_became_active":"2023-07-20T11:05:42.087878+0000","last_became_peered":"2023-07-20T11:05:42.087878+0000","last_unstale":"2023-07-20T11:05:44.469006+0000","last_undegraded":"2023-07-20T11:05:44.469006+0000","last_fullsized":"2023-07-20T11:05:44.469006+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:47:10.679153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075364+0000","last_change":"2023-07-20T11:05:42.088592+0000","last_active":"2023-07-20T11:05:43.075364+0000","last_peered":"2023-07-20T11:05:43.075364+0000","last_clean":"2023-07-20T11:05:43.075364+0000","last_became_active":"2023-07-20T11:05:42.088267+0000","last_became_peered":"2023-07-20T11:05:42.088267+0000","last_unstale":"2023-07-20T11:05:43.075364+0000","last_undegraded":"2023-07-20T11:05:43.075364+0000","last_fullsized":"2023-07-20T11:05:43.075364+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:52.534288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468933+0000","last_change":"2023-07-20T11:05:42.091140+0000","last_active":"2023-07-20T11:05:44.468933+0000","last_peered":"2023-07-20T11:05:44.468933+0000","last_clean":"2023-07-20T11:05:44.468933+0000","last_became_active":"2023-07-20T11:05:42.090781+0000","last_became_peered":"2023-07-20T11:05:42.090781+0000","last_unstale":"2023-07-20T11:05:44.468933+0000","last_undegraded":"2023-07-20T11:05:44.468933+0000","last_fullsized":"2023-07-20T11:05:44.468933+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:27:07.432777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469032+0000","last_change":"2023-07-20T11:05:42.088479+0000","last_active":"2023-07-20T11:05:44.469032+0000","last_peered":"2023-07-20T11:05:44.469032+0000","last_clean":"2023-07-20T11:05:44.469032+0000","last_became_active":"2023-07-20T11:05:42.088150+0000","last_became_peered":"2023-07-20T11:05:42.088150+0000","last_unstale":"2023-07-20T11:05:44.469032+0000","last_undegraded":"2023-07-20T11:05:44.469032+0000","last_fullsized":"2023-07-20T11:05:44.469032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:43:11.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469255+0000","last_change":"2023-07-20T11:05:42.099483+0000","last_active":"2023-07-20T11:05:44.469255+0000","last_peered":"2023-07-20T11:05:44.469255+0000","last_clean":"2023-07-20T11:05:44.469255+0000","last_became_active":"2023-07-20T11:05:42.099222+0000","last_became_peered":"2023-07-20T11:05:42.099222+0000","last_unstale":"2023-07-20T11:05:44.469255+0000","last_undegraded":"2023-07-20T11:05:44.469255+0000","last_fullsized":"2023-07-20T11:05:44.469255+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:46:20.927113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506413+0000","last_change":"2023-07-20T11:05:42.098789+0000","last_active":"2023-07-20T11:05:43.506413+0000","last_peered":"2023-07-20T11:05:43.506413+0000","last_clean":"2023-07-20T11:05:43.506413+0000","last_became_active":"2023-07-20T11:05:42.098467+0000","last_became_peered":"2023-07-20T11:05:42.098467+0000","last_unstale":"2023-07-20T11:05:43.506413+0000","last_undegraded":"2023-07-20T11:05:43.506413+0000","last_fullsized":"2023-07-20T11:05:43.506413+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:02.575928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967892+0000","last_change":"2023-07-20T11:05:42.094603+0000","last_active":"2023-07-20T11:05:43.967892+0000","last_peered":"2023-07-20T11:05:43.967892+0000","last_clean":"2023-07-20T11:05:43.967892+0000","last_became_active":"2023-07-20T11:05:42.094183+0000","last_became_peered":"2023-07-20T11:05:42.094183+0000","last_unstale":"2023-07-20T11:05:43.967892+0000","last_undegraded":"2023-07-20T11:05:43.967892+0000","last_fullsized":"2023-07-20T11:05:43.967892+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:50:34.938333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469878+0000","last_change":"2023-07-20T11:05:42.098092+0000","last_active":"2023-07-20T11:05:44.469878+0000","last_peered":"2023-07-20T11:05:44.469878+0000","last_clean":"2023-07-20T11:05:44.469878+0000","last_became_active":"2023-07-20T11:05:42.097694+0000","last_became_peered":"2023-07-20T11:05:42.097694+0000","last_unstale":"2023-07-20T11:05:44.469878+0000","last_undegraded":"2023-07-20T11:05:44.469878+0000","last_fullsized":"2023-07-20T11:05:44.469878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:17.915835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075467+0000","last_change":"2023-07-20T11:05:42.096804+0000","last_active":"2023-07-20T11:05:43.075467+0000","last_peered":"2023-07-20T11:05:43.075467+0000","last_clean":"2023-07-20T11:05:43.075467+0000","last_became_active":"2023-07-20T11:05:42.096508+0000","last_became_peered":"2023-07-20T11:05:42.096508+0000","last_unstale":"2023-07-20T11:05:43.075467+0000","last_undegraded":"2023-07-20T11:05:43.075467+0000","last_fullsized":"2023-07-20T11:05:43.075467+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:09.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469057+0000","last_change":"2023-07-20T11:05:42.098680+0000","last_active":"2023-07-20T11:05:44.469057+0000","last_peered":"2023-07-20T11:05:44.469057+0000","last_clean":"2023-07-20T11:05:44.469057+0000","last_became_active":"2023-07-20T11:05:42.098178+0000","last_became_peered":"2023-07-20T11:05:42.098178+0000","last_unstale":"2023-07-20T11:05:44.469057+0000","last_undegraded":"2023-07-20T11:05:44.469057+0000","last_fullsized":"2023-07-20T11:05:44.469057+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:44:07.863262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074823+0000","last_change":"2023-07-20T11:05:42.079823+0000","last_active":"2023-07-20T11:05:43.074823+0000","last_peered":"2023-07-20T11:05:43.074823+0000","last_clean":"2023-07-20T11:05:43.074823+0000","last_became_active":"2023-07-20T11:05:42.079435+0000","last_became_peered":"2023-07-20T11:05:42.079435+0000","last_unstale":"2023-07-20T11:05:43.074823+0000","last_undegraded":"2023-07-20T11:05:43.074823+0000","last_fullsized":"2023-07-20T11:05:43.074823+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:51:51.301751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469583+0000","last_change":"2023-07-20T11:05:42.099497+0000","last_active":"2023-07-20T11:05:44.469583+0000","last_peered":"2023-07-20T11:05:44.469583+0000","last_clean":"2023-07-20T11:05:44.469583+0000","last_became_active":"2023-07-20T11:05:42.099184+0000","last_became_peered":"2023-07-20T11:05:42.099184+0000","last_unstale":"2023-07-20T11:05:44.469583+0000","last_undegraded":"2023-07-20T11:05:44.469583+0000","last_fullsized":"2023-07-20T11:05:44.469583+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:27:08.749940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074593+0000","last_change":"2023-07-20T11:05:42.103808+0000","last_active":"2023-07-20T11:05:43.074593+0000","last_peered":"2023-07-20T11:05:43.074593+0000","last_clean":"2023-07-20T11:05:43.074593+0000","last_became_active":"2023-07-20T11:05:42.103468+0000","last_became_peered":"2023-07-20T11:05:42.103468+0000","last_unstale":"2023-07-20T11:05:43.074593+0000","last_undegraded":"2023-07-20T11:05:43.074593+0000","last_fullsized":"2023-07-20T11:05:43.074593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:11.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074255+0000","last_change":"2023-07-20T11:05:42.094620+0000","last_active":"2023-07-20T11:05:43.074255+0000","last_peered":"2023-07-20T11:05:43.074255+0000","last_clean":"2023-07-20T11:05:43.074255+0000","last_became_active":"2023-07-20T11:05:42.094343+0000","last_became_peered":"2023-07-20T11:05:42.094343+0000","last_unstale":"2023-07-20T11:05:43.074255+0000","last_undegraded":"2023-07-20T11:05:43.074255+0000","last_fullsized":"2023-07-20T11:05:43.074255+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:08:15.900817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469524+0000","last_change":"2023-07-20T11:05:42.097055+0000","last_active":"2023-07-20T11:05:44.469524+0000","last_peered":"2023-07-20T11:05:44.469524+0000","last_clean":"2023-07-20T11:05:44.469524+0000","last_became_active":"2023-07-20T11:05:42.096783+0000","last_became_peered":"2023-07-20T11:05:42.096783+0000","last_unstale":"2023-07-20T11:05:44.469524+0000","last_undegraded":"2023-07-20T11:05:44.469524+0000","last_fullsized":"2023-07-20T11:05:44.469524+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:54:49.697595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469999+0000","last_change":"2023-07-20T11:05:42.092744+0000","last_active":"2023-07-20T11:05:44.469999+0000","last_peered":"2023-07-20T11:05:44.469999+0000","last_clean":"2023-07-20T11:05:44.469999+0000","last_became_active":"2023-07-20T11:05:42.092391+0000","last_became_peered":"2023-07-20T11:05:42.092391+0000","last_unstale":"2023-07-20T11:05:44.469999+0000","last_undegraded":"2023-07-20T11:05:44.469999+0000","last_fullsized":"2023-07-20T11:05:44.469999+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:27:44.861618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469735+0000","last_change":"2023-07-20T11:05:42.088567+0000","last_active":"2023-07-20T11:05:44.469735+0000","last_peered":"2023-07-20T11:05:44.469735+0000","last_clean":"2023-07-20T11:05:44.469735+0000","last_became_active":"2023-07-20T11:05:42.088284+0000","last_became_peered":"2023-07-20T11:05:42.088284+0000","last_unstale":"2023-07-20T11:05:44.469735+0000","last_undegraded":"2023-07-20T11:05:44.469735+0000","last_fullsized":"2023-07-20T11:05:44.469735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:23.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506863+0000","last_change":"2023-07-20T11:05:42.097882+0000","last_active":"2023-07-20T11:05:43.506863+0000","last_peered":"2023-07-20T11:05:43.506863+0000","last_clean":"2023-07-20T11:05:43.506863+0000","last_became_active":"2023-07-20T11:05:42.096403+0000","last_became_peered":"2023-07-20T11:05:42.096403+0000","last_unstale":"2023-07-20T11:05:43.506863+0000","last_undegraded":"2023-07-20T11:05:43.506863+0000","last_fullsized":"2023-07-20T11:05:43.506863+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:51:13.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469203+0000","last_change":"2023-07-20T11:05:42.093987+0000","last_active":"2023-07-20T11:05:44.469203+0000","last_peered":"2023-07-20T11:05:44.469203+0000","last_clean":"2023-07-20T11:05:44.469203+0000","last_became_active":"2023-07-20T11:05:42.093719+0000","last_became_peered":"2023-07-20T11:05:42.093719+0000","last_unstale":"2023-07-20T11:05:44.469203+0000","last_undegraded":"2023-07-20T11:05:44.469203+0000","last_fullsized":"2023-07-20T11:05:44.469203+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:13.276168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468781+0000","last_change":"2023-07-20T11:05:42.090666+0000","last_active":"2023-07-20T11:05:44.468781+0000","last_peered":"2023-07-20T11:05:44.468781+0000","last_clean":"2023-07-20T11:05:44.468781+0000","last_became_active":"2023-07-20T11:05:42.090337+0000","last_became_peered":"2023-07-20T11:05:42.090337+0000","last_unstale":"2023-07-20T11:05:44.468781+0000","last_undegraded":"2023-07-20T11:05:44.468781+0000","last_fullsized":"2023-07-20T11:05:44.468781+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:07.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074472+0000","last_change":"2023-07-20T11:05:42.082384+0000","last_active":"2023-07-20T11:05:43.074472+0000","last_peered":"2023-07-20T11:05:43.074472+0000","last_clean":"2023-07-20T11:05:43.074472+0000","last_became_active":"2023-07-20T11:05:42.082094+0000","last_became_peered":"2023-07-20T11:05:42.082094+0000","last_unstale":"2023-07-20T11:05:43.074472+0000","last_undegraded":"2023-07-20T11:05:43.074472+0000","last_fullsized":"2023-07-20T11:05:43.074472+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:42:32.127680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468732+0000","last_change":"2023-07-20T11:05:42.094000+0000","last_active":"2023-07-20T11:05:44.468732+0000","last_peered":"2023-07-20T11:05:44.468732+0000","last_clean":"2023-07-20T11:05:44.468732+0000","last_became_active":"2023-07-20T11:05:42.093675+0000","last_became_peered":"2023-07-20T11:05:42.093675+0000","last_unstale":"2023-07-20T11:05:44.468732+0000","last_undegraded":"2023-07-20T11:05:44.468732+0000","last_fullsized":"2023-07-20T11:05:44.468732+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:26.881705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469553+0000","last_change":"2023-07-20T11:05:42.098189+0000","last_active":"2023-07-20T11:05:44.469553+0000","last_peered":"2023-07-20T11:05:44.469553+0000","last_clean":"2023-07-20T11:05:44.469553+0000","last_became_active":"2023-07-20T11:05:42.097933+0000","last_became_peered":"2023-07-20T11:05:42.097933+0000","last_unstale":"2023-07-20T11:05:44.469553+0000","last_undegraded":"2023-07-20T11:05:44.469553+0000","last_fullsized":"2023-07-20T11:05:44.469553+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:39.909040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075622+0000","last_change":"2023-07-20T11:05:42.089114+0000","last_active":"2023-07-20T11:05:43.075622+0000","last_peered":"2023-07-20T11:05:43.075622+0000","last_clean":"2023-07-20T11:05:43.075622+0000","last_became_active":"2023-07-20T11:05:42.088823+0000","last_became_peered":"2023-07-20T11:05:42.088823+0000","last_unstale":"2023-07-20T11:05:43.075622+0000","last_undegraded":"2023-07-20T11:05:43.075622+0000","last_fullsized":"2023-07-20T11:05:43.075622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:56.240988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075432+0000","last_change":"2023-07-20T11:05:42.101173+0000","last_active":"2023-07-20T11:05:43.075432+0000","last_peered":"2023-07-20T11:05:43.075432+0000","last_clean":"2023-07-20T11:05:43.075432+0000","last_became_active":"2023-07-20T11:05:42.100900+0000","last_became_peered":"2023-07-20T11:05:42.100900+0000","last_unstale":"2023-07-20T11:05:43.075432+0000","last_undegraded":"2023-07-20T11:05:43.075432+0000","last_fullsized":"2023-07-20T11:05:43.075432+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:50.274668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506893+0000","last_change":"2023-07-20T11:05:42.100781+0000","last_active":"2023-07-20T11:05:43.506893+0000","last_peered":"2023-07-20T11:05:43.506893+0000","last_clean":"2023-07-20T11:05:43.506893+0000","last_became_active":"2023-07-20T11:05:42.100478+0000","last_became_peered":"2023-07-20T11:05:42.100478+0000","last_unstale":"2023-07-20T11:05:43.506893+0000","last_undegraded":"2023-07-20T11:05:43.506893+0000","last_fullsized":"2023-07-20T11:05:43.506893+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:51:51.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075391+0000","last_change":"2023-07-20T11:05:42.099553+0000","last_active":"2023-07-20T11:05:43.075391+0000","last_peered":"2023-07-20T11:05:43.075391+0000","last_clean":"2023-07-20T11:05:43.075391+0000","last_became_active":"2023-07-20T11:05:42.099108+0000","last_became_peered":"2023-07-20T11:05:42.099108+0000","last_unstale":"2023-07-20T11:05:43.075391+0000","last_undegraded":"2023-07-20T11:05:43.075391+0000","last_fullsized":"2023-07-20T11:05:43.075391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:58:13.286074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075197+0000","last_change":"2023-07-20T11:05:42.091842+0000","last_active":"2023-07-20T11:05:43.075197+0000","last_peered":"2023-07-20T11:05:43.075197+0000","last_clean":"2023-07-20T11:05:43.075197+0000","last_became_active":"2023-07-20T11:05:42.089828+0000","last_became_peered":"2023-07-20T11:05:42.089828+0000","last_unstale":"2023-07-20T11:05:43.075197+0000","last_undegraded":"2023-07-20T11:05:43.075197+0000","last_fullsized":"2023-07-20T11:05:43.075197+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:05:31.336434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075058+0000","last_change":"2023-07-20T11:05:42.096128+0000","last_active":"2023-07-20T11:05:43.075058+0000","last_peered":"2023-07-20T11:05:43.075058+0000","last_clean":"2023-07-20T11:05:43.075058+0000","last_became_active":"2023-07-20T11:05:42.095779+0000","last_became_peered":"2023-07-20T11:05:42.095779+0000","last_unstale":"2023-07-20T11:05:43.075058+0000","last_undegraded":"2023-07-20T11:05:43.075058+0000","last_fullsized":"2023-07-20T11:05:43.075058+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:10.262566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967907+0000","last_change":"2023-07-20T11:05:42.093611+0000","last_active":"2023-07-20T11:05:43.967907+0000","last_peered":"2023-07-20T11:05:43.967907+0000","last_clean":"2023-07-20T11:05:43.967907+0000","last_became_active":"2023-07-20T11:05:42.093301+0000","last_became_peered":"2023-07-20T11:05:42.093301+0000","last_unstale":"2023-07-20T11:05:43.967907+0000","last_undegraded":"2023-07-20T11:05:43.967907+0000","last_fullsized":"2023-07-20T11:05:43.967907+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:42.599906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075068+0000","last_change":"2023-07-20T11:05:42.099833+0000","last_active":"2023-07-20T11:05:43.075068+0000","last_peered":"2023-07-20T11:05:43.075068+0000","last_clean":"2023-07-20T11:05:43.075068+0000","last_became_active":"2023-07-20T11:05:42.099537+0000","last_became_peered":"2023-07-20T11:05:42.099537+0000","last_unstale":"2023-07-20T11:05:43.075068+0000","last_undegraded":"2023-07-20T11:05:43.075068+0000","last_fullsized":"2023-07-20T11:05:43.075068+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:32.786160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967935+0000","last_change":"2023-07-20T11:05:42.101156+0000","last_active":"2023-07-20T11:05:43.967935+0000","last_peered":"2023-07-20T11:05:43.967935+0000","last_clean":"2023-07-20T11:05:43.967935+0000","last_became_active":"2023-07-20T11:05:42.100884+0000","last_became_peered":"2023-07-20T11:05:42.100884+0000","last_unstale":"2023-07-20T11:05:43.967935+0000","last_undegraded":"2023-07-20T11:05:43.967935+0000","last_fullsized":"2023-07-20T11:05:43.967935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:56.253772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075730+0000","last_change":"2023-07-20T11:05:41.244924+0000","last_active":"2023-07-20T11:05:43.075730+0000","last_peered":"2023-07-20T11:05:43.075730+0000","last_clean":"2023-07-20T11:05:43.075730+0000","last_became_active":"2023-07-20T11:05:41.244629+0000","last_became_peered":"2023-07-20T11:05:41.244629+0000","last_unstale":"2023-07-20T11:05:43.075730+0000","last_undegraded":"2023-07-20T11:05:43.075730+0000","last_fullsized":"2023-07-20T11:05:43.075730+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:43.495374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074318+0000","last_change":"2023-07-20T11:05:42.082315+0000","last_active":"2023-07-20T11:05:43.074318+0000","last_peered":"2023-07-20T11:05:43.074318+0000","last_clean":"2023-07-20T11:05:43.074318+0000","last_became_active":"2023-07-20T11:05:42.082000+0000","last_became_peered":"2023-07-20T11:05:42.082000+0000","last_unstale":"2023-07-20T11:05:43.074318+0000","last_undegraded":"2023-07-20T11:05:43.074318+0000","last_fullsized":"2023-07-20T11:05:43.074318+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:29.090260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469926+0000","last_change":"2023-07-20T11:05:41.238014+0000","last_active":"2023-07-20T11:05:44.469926+0000","last_peered":"2023-07-20T11:05:44.469926+0000","last_clean":"2023-07-20T11:05:44.469926+0000","last_became_active":"2023-07-20T11:05:41.237760+0000","last_became_peered":"2023-07-20T11:05:41.237760+0000","last_unstale":"2023-07-20T11:05:44.469926+0000","last_undegraded":"2023-07-20T11:05:44.469926+0000","last_fullsized":"2023-07-20T11:05:44.469926+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:13:34.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468917+0000","last_change":"2023-07-20T11:05:42.094040+0000","last_active":"2023-07-20T11:05:44.468917+0000","last_peered":"2023-07-20T11:05:44.468917+0000","last_clean":"2023-07-20T11:05:44.468917+0000","last_became_active":"2023-07-20T11:05:42.093706+0000","last_became_peered":"2023-07-20T11:05:42.093706+0000","last_unstale":"2023-07-20T11:05:44.468917+0000","last_undegraded":"2023-07-20T11:05:44.468917+0000","last_fullsized":"2023-07-20T11:05:44.468917+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:49.488711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506986+0000","last_change":"2023-07-20T11:05:41.244435+0000","last_active":"2023-07-20T11:05:43.506986+0000","last_peered":"2023-07-20T11:05:43.506986+0000","last_clean":"2023-07-20T11:05:43.506986+0000","last_became_active":"2023-07-20T11:05:41.244134+0000","last_became_peered":"2023-07-20T11:05:41.244134+0000","last_unstale":"2023-07-20T11:05:43.506986+0000","last_undegraded":"2023-07-20T11:05:43.506986+0000","last_fullsized":"2023-07-20T11:05:43.506986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:10:32.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074521+0000","last_change":"2023-07-20T11:05:42.094504+0000","last_active":"2023-07-20T11:05:43.074521+0000","last_peered":"2023-07-20T11:05:43.074521+0000","last_clean":"2023-07-20T11:05:43.074521+0000","last_became_active":"2023-07-20T11:05:42.094204+0000","last_became_peered":"2023-07-20T11:05:42.094204+0000","last_unstale":"2023-07-20T11:05:43.074521+0000","last_undegraded":"2023-07-20T11:05:43.074521+0000","last_fullsized":"2023-07-20T11:05:43.074521+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:25:01.704144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506625+0000","last_change":"2023-07-20T11:05:41.236452+0000","last_active":"2023-07-20T11:05:43.506625+0000","last_peered":"2023-07-20T11:05:43.506625+0000","last_clean":"2023-07-20T11:05:43.506625+0000","last_became_active":"2023-07-20T11:05:41.236158+0000","last_became_peered":"2023-07-20T11:05:41.236158+0000","last_unstale":"2023-07-20T11:05:43.506625+0000","last_undegraded":"2023-07-20T11:05:43.506625+0000","last_fullsized":"2023-07-20T11:05:43.506625+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:57:18.585742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968266+0000","last_change":"2023-07-20T11:05:42.096092+0000","last_active":"2023-07-20T11:05:43.968266+0000","last_peered":"2023-07-20T11:05:43.968266+0000","last_clean":"2023-07-20T11:05:43.968266+0000","last_became_active":"2023-07-20T11:05:42.095815+0000","last_became_peered":"2023-07-20T11:05:42.095815+0000","last_unstale":"2023-07-20T11:05:43.968266+0000","last_undegraded":"2023-07-20T11:05:43.968266+0000","last_fullsized":"2023-07-20T11:05:43.968266+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:57.460266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968146+0000","last_change":"2023-07-20T11:05:41.237900+0000","last_active":"2023-07-20T11:05:43.968146+0000","last_peered":"2023-07-20T11:05:43.968146+0000","last_clean":"2023-07-20T11:05:43.968146+0000","last_became_active":"2023-07-20T11:05:41.237605+0000","last_became_peered":"2023-07-20T11:05:41.237605+0000","last_unstale":"2023-07-20T11:05:43.968146+0000","last_undegraded":"2023-07-20T11:05:43.968146+0000","last_fullsized":"2023-07-20T11:05:43.968146+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:06:38.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968256+0000","last_change":"2023-07-20T11:05:42.093962+0000","last_active":"2023-07-20T11:05:43.968256+0000","last_peered":"2023-07-20T11:05:43.968256+0000","last_clean":"2023-07-20T11:05:43.968256+0000","last_became_active":"2023-07-20T11:05:42.093683+0000","last_became_peered":"2023-07-20T11:05:42.093683+0000","last_unstale":"2023-07-20T11:05:43.968256+0000","last_undegraded":"2023-07-20T11:05:43.968256+0000","last_fullsized":"2023-07-20T11:05:43.968256+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:25.290635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468835+0000","last_change":"2023-07-20T11:05:41.235435+0000","last_active":"2023-07-20T11:05:44.468835+0000","last_peered":"2023-07-20T11:05:44.468835+0000","last_clean":"2023-07-20T11:05:44.468835+0000","last_became_active":"2023-07-20T11:05:41.235154+0000","last_became_peered":"2023-07-20T11:05:41.235154+0000","last_unstale":"2023-07-20T11:05:44.468835+0000","last_undegraded":"2023-07-20T11:05:44.468835+0000","last_fullsized":"2023-07-20T11:05:44.468835+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:09.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469848+0000","last_change":"2023-07-20T11:05:42.094735+0000","last_active":"2023-07-20T11:05:44.469848+0000","last_peered":"2023-07-20T11:05:44.469848+0000","last_clean":"2023-07-20T11:05:44.469848+0000","last_became_active":"2023-07-20T11:05:42.094446+0000","last_became_peered":"2023-07-20T11:05:42.094446+0000","last_unstale":"2023-07-20T11:05:44.469848+0000","last_undegraded":"2023-07-20T11:05:44.469848+0000","last_fullsized":"2023-07-20T11:05:44.469848+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:02:36.357612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469253+0000","last_change":"2023-07-20T11:05:41.243421+0000","last_active":"2023-07-20T11:05:44.469253+0000","last_peered":"2023-07-20T11:05:44.469253+0000","last_clean":"2023-07-20T11:05:44.469253+0000","last_became_active":"2023-07-20T11:05:41.243088+0000","last_became_peered":"2023-07-20T11:05:41.243088+0000","last_unstale":"2023-07-20T11:05:44.469253+0000","last_undegraded":"2023-07-20T11:05:44.469253+0000","last_fullsized":"2023-07-20T11:05:44.469253+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:35.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507091+0000","last_change":"2023-07-20T11:05:42.100642+0000","last_active":"2023-07-20T11:05:43.507091+0000","last_peered":"2023-07-20T11:05:43.507091+0000","last_clean":"2023-07-20T11:05:43.507091+0000","last_became_active":"2023-07-20T11:05:42.100355+0000","last_became_peered":"2023-07-20T11:05:42.100355+0000","last_unstale":"2023-07-20T11:05:43.507091+0000","last_undegraded":"2023-07-20T11:05:43.507091+0000","last_fullsized":"2023-07-20T11:05:43.507091+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:09:17.237250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074801+0000","last_change":"2023-07-20T11:05:41.243651+0000","last_active":"2023-07-20T11:05:43.074801+0000","last_peered":"2023-07-20T11:05:43.074801+0000","last_clean":"2023-07-20T11:05:43.074801+0000","last_became_active":"2023-07-20T11:05:41.243148+0000","last_became_peered":"2023-07-20T11:05:41.243148+0000","last_unstale":"2023-07-20T11:05:43.074801+0000","last_undegraded":"2023-07-20T11:05:43.074801+0000","last_fullsized":"2023-07-20T11:05:43.074801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:53:00.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074842+0000","last_change":"2023-07-20T11:05:42.088799+0000","last_active":"2023-07-20T11:05:43.074842+0000","last_peered":"2023-07-20T11:05:43.074842+0000","last_clean":"2023-07-20T11:05:43.074842+0000","last_became_active":"2023-07-20T11:05:42.088394+0000","last_became_peered":"2023-07-20T11:05:42.088394+0000","last_unstale":"2023-07-20T11:05:43.074842+0000","last_undegraded":"2023-07-20T11:05:43.074842+0000","last_fullsized":"2023-07-20T11:05:43.074842+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:10.470998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469159+0000","last_change":"2023-07-20T11:05:41.243162+0000","last_active":"2023-07-20T11:05:44.469159+0000","last_peered":"2023-07-20T11:05:44.469159+0000","last_clean":"2023-07-20T11:05:44.469159+0000","last_became_active":"2023-07-20T11:05:41.242535+0000","last_became_peered":"2023-07-20T11:05:41.242535+0000","last_unstale":"2023-07-20T11:05:44.469159+0000","last_undegraded":"2023-07-20T11:05:44.469159+0000","last_fullsized":"2023-07-20T11:05:44.469159+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:41.458043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506534+0000","last_change":"2023-07-20T11:05:42.093217+0000","last_active":"2023-07-20T11:05:43.506534+0000","last_peered":"2023-07-20T11:05:43.506534+0000","last_clean":"2023-07-20T11:05:43.506534+0000","last_became_active":"2023-07-20T11:05:42.092852+0000","last_became_peered":"2023-07-20T11:05:42.092852+0000","last_unstale":"2023-07-20T11:05:43.506534+0000","last_undegraded":"2023-07-20T11:05:43.506534+0000","last_fullsized":"2023-07-20T11:05:43.506534+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:50.054744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075457+0000","last_change":"2023-07-20T11:05:41.245079+0000","last_active":"2023-07-20T11:05:43.075457+0000","last_peered":"2023-07-20T11:05:43.075457+0000","last_clean":"2023-07-20T11:05:43.075457+0000","last_became_active":"2023-07-20T11:05:41.244795+0000","last_became_peered":"2023-07-20T11:05:41.244795+0000","last_unstale":"2023-07-20T11:05:43.075457+0000","last_undegraded":"2023-07-20T11:05:43.075457+0000","last_fullsized":"2023-07-20T11:05:43.075457+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:16:17.117905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506698+0000","last_change":"2023-07-20T11:05:42.101027+0000","last_active":"2023-07-20T11:05:43.506698+0000","last_peered":"2023-07-20T11:05:43.506698+0000","last_clean":"2023-07-20T11:05:43.506698+0000","last_became_active":"2023-07-20T11:05:42.100693+0000","last_became_peered":"2023-07-20T11:05:42.100693+0000","last_unstale":"2023-07-20T11:05:43.506698+0000","last_undegraded":"2023-07-20T11:05:43.506698+0000","last_fullsized":"2023-07-20T11:05:43.506698+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:56.868527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470065+0000","last_change":"2023-07-20T11:05:41.243741+0000","last_active":"2023-07-20T11:05:44.470065+0000","last_peered":"2023-07-20T11:05:44.470065+0000","last_clean":"2023-07-20T11:05:44.470065+0000","last_became_active":"2023-07-20T11:05:41.243446+0000","last_became_peered":"2023-07-20T11:05:41.243446+0000","last_unstale":"2023-07-20T11:05:44.470065+0000","last_undegraded":"2023-07-20T11:05:44.470065+0000","last_fullsized":"2023-07-20T11:05:44.470065+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:25.690086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075263+0000","last_change":"2023-07-20T11:05:42.099139+0000","last_active":"2023-07-20T11:05:43.075263+0000","last_peered":"2023-07-20T11:05:43.075263+0000","last_clean":"2023-07-20T11:05:43.075263+0000","last_became_active":"2023-07-20T11:05:42.098792+0000","last_became_peered":"2023-07-20T11:05:42.098792+0000","last_unstale":"2023-07-20T11:05:43.075263+0000","last_undegraded":"2023-07-20T11:05:43.075263+0000","last_fullsized":"2023-07-20T11:05:43.075263+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:10.630515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469308+0000","last_change":"2023-07-20T11:05:41.243157+0000","last_active":"2023-07-20T11:05:44.469308+0000","last_peered":"2023-07-20T11:05:44.469308+0000","last_clean":"2023-07-20T11:05:44.469308+0000","last_became_active":"2023-07-20T11:05:41.242873+0000","last_became_peered":"2023-07-20T11:05:41.242873+0000","last_unstale":"2023-07-20T11:05:44.469308+0000","last_undegraded":"2023-07-20T11:05:44.469308+0000","last_fullsized":"2023-07-20T11:05:44.469308+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:32:42.441860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469268+0000","last_change":"2023-07-20T11:05:42.079924+0000","last_active":"2023-07-20T11:05:44.469268+0000","last_peered":"2023-07-20T11:05:44.469268+0000","last_clean":"2023-07-20T11:05:44.469268+0000","last_became_active":"2023-07-20T11:05:42.079590+0000","last_became_peered":"2023-07-20T11:05:42.079590+0000","last_unstale":"2023-07-20T11:05:44.469268+0000","last_undegraded":"2023-07-20T11:05:44.469268+0000","last_fullsized":"2023-07-20T11:05:44.469268+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:44:45.637852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968132+0000","last_change":"2023-07-20T11:05:41.246812+0000","last_active":"2023-07-20T11:05:43.968132+0000","last_peered":"2023-07-20T11:05:43.968132+0000","last_clean":"2023-07-20T11:05:43.968132+0000","last_became_active":"2023-07-20T11:05:41.246042+0000","last_became_peered":"2023-07-20T11:05:41.246042+0000","last_unstale":"2023-07-20T11:05:43.968132+0000","last_undegraded":"2023-07-20T11:05:43.968132+0000","last_fullsized":"2023-07-20T11:05:43.968132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:35:19.137130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074877+0000","last_change":"2023-07-20T11:05:42.094440+0000","last_active":"2023-07-20T11:05:43.074877+0000","last_peered":"2023-07-20T11:05:43.074877+0000","last_clean":"2023-07-20T11:05:43.074877+0000","last_became_active":"2023-07-20T11:05:42.094149+0000","last_became_peered":"2023-07-20T11:05:42.094149+0000","last_unstale":"2023-07-20T11:05:43.074877+0000","last_undegraded":"2023-07-20T11:05:43.074877+0000","last_fullsized":"2023-07-20T11:05:43.074877+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:09.032554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074667+0000","last_change":"2023-07-20T11:05:41.244475+0000","last_active":"2023-07-20T11:05:43.074667+0000","last_peered":"2023-07-20T11:05:43.074667+0000","last_clean":"2023-07-20T11:05:43.074667+0000","last_became_active":"2023-07-20T11:05:41.244096+0000","last_became_peered":"2023-07-20T11:05:41.244096+0000","last_unstale":"2023-07-20T11:05:43.074667+0000","last_undegraded":"2023-07-20T11:05:43.074667+0000","last_fullsized":"2023-07-20T11:05:43.074667+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:19:38.818594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469921+0000","last_change":"2023-07-20T11:05:42.091176+0000","last_active":"2023-07-20T11:05:44.469921+0000","last_peered":"2023-07-20T11:05:44.469921+0000","last_clean":"2023-07-20T11:05:44.469921+0000","last_became_active":"2023-07-20T11:05:42.090892+0000","last_became_peered":"2023-07-20T11:05:42.090892+0000","last_unstale":"2023-07-20T11:05:44.469921+0000","last_undegraded":"2023-07-20T11:05:44.469921+0000","last_fullsized":"2023-07-20T11:05:44.469921+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:36.535936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506624+0000","last_change":"2023-07-20T11:05:41.242840+0000","last_active":"2023-07-20T11:05:43.506624+0000","last_peered":"2023-07-20T11:05:43.506624+0000","last_clean":"2023-07-20T11:05:43.506624+0000","last_became_active":"2023-07-20T11:05:41.242517+0000","last_became_peered":"2023-07-20T11:05:41.242517+0000","last_unstale":"2023-07-20T11:05:43.506624+0000","last_undegraded":"2023-07-20T11:05:43.506624+0000","last_fullsized":"2023-07-20T11:05:43.506624+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:43.123728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469098+0000","last_change":"2023-07-20T11:05:42.089272+0000","last_active":"2023-07-20T11:05:44.469098+0000","last_peered":"2023-07-20T11:05:44.469098+0000","last_clean":"2023-07-20T11:05:44.469098+0000","last_became_active":"2023-07-20T11:05:42.088996+0000","last_became_peered":"2023-07-20T11:05:42.088996+0000","last_unstale":"2023-07-20T11:05:44.469098+0000","last_undegraded":"2023-07-20T11:05:44.469098+0000","last_fullsized":"2023-07-20T11:05:44.469098+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:16:54.579922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469651+0000","last_change":"2023-07-20T11:05:41.245733+0000","last_active":"2023-07-20T11:05:44.469651+0000","last_peered":"2023-07-20T11:05:44.469651+0000","last_clean":"2023-07-20T11:05:44.469651+0000","last_became_active":"2023-07-20T11:05:41.245489+0000","last_became_peered":"2023-07-20T11:05:41.245489+0000","last_unstale":"2023-07-20T11:05:44.469651+0000","last_undegraded":"2023-07-20T11:05:44.469651+0000","last_fullsized":"2023-07-20T11:05:44.469651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:37:38.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468956+0000","last_change":"2023-07-20T11:05:42.094015+0000","last_active":"2023-07-20T11:05:44.468956+0000","last_peered":"2023-07-20T11:05:44.468956+0000","last_clean":"2023-07-20T11:05:44.468956+0000","last_became_active":"2023-07-20T11:05:42.093750+0000","last_became_peered":"2023-07-20T11:05:42.093750+0000","last_unstale":"2023-07-20T11:05:44.468956+0000","last_undegraded":"2023-07-20T11:05:44.468956+0000","last_fullsized":"2023-07-20T11:05:44.468956+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:52.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075554+0000","last_change":"2023-07-20T11:05:41.245894+0000","last_active":"2023-07-20T11:05:43.075554+0000","last_peered":"2023-07-20T11:05:43.075554+0000","last_clean":"2023-07-20T11:05:43.075554+0000","last_became_active":"2023-07-20T11:05:41.245576+0000","last_became_peered":"2023-07-20T11:05:41.245576+0000","last_unstale":"2023-07-20T11:05:43.075554+0000","last_undegraded":"2023-07-20T11:05:43.075554+0000","last_fullsized":"2023-07-20T11:05:43.075554+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:12:21.048503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074776+0000","last_change":"2023-07-20T11:05:42.091961+0000","last_active":"2023-07-20T11:05:43.074776+0000","last_peered":"2023-07-20T11:05:43.074776+0000","last_clean":"2023-07-20T11:05:43.074776+0000","last_became_active":"2023-07-20T11:05:42.091322+0000","last_became_peered":"2023-07-20T11:05:42.091322+0000","last_unstale":"2023-07-20T11:05:43.074776+0000","last_undegraded":"2023-07-20T11:05:43.074776+0000","last_fullsized":"2023-07-20T11:05:43.074776+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:04:53.132594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968360+0000","last_change":"2023-07-20T11:05:41.237859+0000","last_active":"2023-07-20T11:05:43.968360+0000","last_peered":"2023-07-20T11:05:43.968360+0000","last_clean":"2023-07-20T11:05:43.968360+0000","last_became_active":"2023-07-20T11:05:41.237566+0000","last_became_peered":"2023-07-20T11:05:41.237566+0000","last_unstale":"2023-07-20T11:05:43.968360+0000","last_undegraded":"2023-07-20T11:05:43.968360+0000","last_fullsized":"2023-07-20T11:05:43.968360+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:56:23.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506467+0000","last_change":"2023-07-20T11:05:42.103757+0000","last_active":"2023-07-20T11:05:43.506467+0000","last_peered":"2023-07-20T11:05:43.506467+0000","last_clean":"2023-07-20T11:05:43.506467+0000","last_became_active":"2023-07-20T11:05:42.103436+0000","last_became_peered":"2023-07-20T11:05:42.103436+0000","last_unstale":"2023-07-20T11:05:43.506467+0000","last_undegraded":"2023-07-20T11:05:43.506467+0000","last_fullsized":"2023-07-20T11:05:43.506467+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:34:47.001913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968287+0000","last_change":"2023-07-20T11:05:41.242994+0000","last_active":"2023-07-20T11:05:43.968287+0000","last_peered":"2023-07-20T11:05:43.968287+0000","last_clean":"2023-07-20T11:05:43.968287+0000","last_became_active":"2023-07-20T11:05:41.242672+0000","last_became_peered":"2023-07-20T11:05:41.242672+0000","last_unstale":"2023-07-20T11:05:43.968287+0000","last_undegraded":"2023-07-20T11:05:43.968287+0000","last_fullsized":"2023-07-20T11:05:43.968287+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:59.996275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075306+0000","last_change":"2023-07-20T11:05:42.096820+0000","last_active":"2023-07-20T11:05:43.075306+0000","last_peered":"2023-07-20T11:05:43.075306+0000","last_clean":"2023-07-20T11:05:43.075306+0000","last_became_active":"2023-07-20T11:05:42.096533+0000","last_became_peered":"2023-07-20T11:05:42.096533+0000","last_unstale":"2023-07-20T11:05:43.075306+0000","last_undegraded":"2023-07-20T11:05:43.075306+0000","last_fullsized":"2023-07-20T11:05:43.075306+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:48:11.497091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470120+0000","last_change":"2023-07-20T11:05:41.245589+0000","last_active":"2023-07-20T11:05:44.470120+0000","last_peered":"2023-07-20T11:05:44.470120+0000","last_clean":"2023-07-20T11:05:44.470120+0000","last_became_active":"2023-07-20T11:05:41.245054+0000","last_became_peered":"2023-07-20T11:05:41.245054+0000","last_unstale":"2023-07-20T11:05:44.470120+0000","last_undegraded":"2023-07-20T11:05:44.470120+0000","last_fullsized":"2023-07-20T11:05:44.470120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:17.463553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470164+0000","last_change":"2023-07-20T11:05:42.091869+0000","last_active":"2023-07-20T11:05:44.470164+0000","last_peered":"2023-07-20T11:05:44.470164+0000","last_clean":"2023-07-20T11:05:44.470164+0000","last_became_active":"2023-07-20T11:05:42.091610+0000","last_became_peered":"2023-07-20T11:05:42.091610+0000","last_unstale":"2023-07-20T11:05:44.470164+0000","last_undegraded":"2023-07-20T11:05:44.470164+0000","last_fullsized":"2023-07-20T11:05:44.470164+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:24.220607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468906+0000","last_change":"2023-07-20T11:05:41.244635+0000","last_active":"2023-07-20T11:05:44.468906+0000","last_peered":"2023-07-20T11:05:44.468906+0000","last_clean":"2023-07-20T11:05:44.468906+0000","last_became_active":"2023-07-20T11:05:41.244366+0000","last_became_peered":"2023-07-20T11:05:41.244366+0000","last_unstale":"2023-07-20T11:05:44.468906+0000","last_undegraded":"2023-07-20T11:05:44.468906+0000","last_fullsized":"2023-07-20T11:05:44.468906+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:19:01.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469974+0000","last_change":"2023-07-20T11:05:42.090185+0000","last_active":"2023-07-20T11:05:44.469974+0000","last_peered":"2023-07-20T11:05:44.469974+0000","last_clean":"2023-07-20T11:05:44.469974+0000","last_became_active":"2023-07-20T11:05:42.089902+0000","last_became_peered":"2023-07-20T11:05:42.089902+0000","last_unstale":"2023-07-20T11:05:44.469974+0000","last_undegraded":"2023-07-20T11:05:44.469974+0000","last_fullsized":"2023-07-20T11:05:44.469974+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:12:16.659140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506707+0000","last_change":"2023-07-20T11:05:41.238771+0000","last_active":"2023-07-20T11:05:43.506707+0000","last_peered":"2023-07-20T11:05:43.506707+0000","last_clean":"2023-07-20T11:05:43.506707+0000","last_became_active":"2023-07-20T11:05:41.238497+0000","last_became_peered":"2023-07-20T11:05:41.238497+0000","last_unstale":"2023-07-20T11:05:43.506707+0000","last_undegraded":"2023-07-20T11:05:43.506707+0000","last_fullsized":"2023-07-20T11:05:43.506707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:01:44.172290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469725+0000","last_change":"2023-07-20T11:05:42.103610+0000","last_active":"2023-07-20T11:05:44.469725+0000","last_peered":"2023-07-20T11:05:44.469725+0000","last_clean":"2023-07-20T11:05:44.469725+0000","last_became_active":"2023-07-20T11:05:42.103342+0000","last_became_peered":"2023-07-20T11:05:42.103342+0000","last_unstale":"2023-07-20T11:05:44.469725+0000","last_undegraded":"2023-07-20T11:05:44.469725+0000","last_fullsized":"2023-07-20T11:05:44.469725+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:46.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469497+0000","last_change":"2023-07-20T11:05:41.245714+0000","last_active":"2023-07-20T11:05:44.469497+0000","last_peered":"2023-07-20T11:05:44.469497+0000","last_clean":"2023-07-20T11:05:44.469497+0000","last_became_active":"2023-07-20T11:05:41.245371+0000","last_became_peered":"2023-07-20T11:05:41.245371+0000","last_unstale":"2023-07-20T11:05:44.469497+0000","last_undegraded":"2023-07-20T11:05:44.469497+0000","last_fullsized":"2023-07-20T11:05:44.469497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:12.252482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507094+0000","last_change":"2023-07-20T11:05:42.101193+0000","last_active":"2023-07-20T11:05:43.507094+0000","last_peered":"2023-07-20T11:05:43.507094+0000","last_clean":"2023-07-20T11:05:43.507094+0000","last_became_active":"2023-07-20T11:05:42.100896+0000","last_became_peered":"2023-07-20T11:05:42.100896+0000","last_unstale":"2023-07-20T11:05:43.507094+0000","last_undegraded":"2023-07-20T11:05:43.507094+0000","last_fullsized":"2023-07-20T11:05:43.507094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:19:49.695250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469043+0000","last_change":"2023-07-20T11:05:41.243514+0000","last_active":"2023-07-20T11:05:44.469043+0000","last_peered":"2023-07-20T11:05:44.469043+0000","last_clean":"2023-07-20T11:05:44.469043+0000","last_became_active":"2023-07-20T11:05:41.243235+0000","last_became_peered":"2023-07-20T11:05:41.243235+0000","last_unstale":"2023-07-20T11:05:44.469043+0000","last_undegraded":"2023-07-20T11:05:44.469043+0000","last_fullsized":"2023-07-20T11:05:44.469043+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:11:43.464076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075369+0000","last_change":"2023-07-20T11:05:42.083540+0000","last_active":"2023-07-20T11:05:43.075369+0000","last_peered":"2023-07-20T11:05:43.075369+0000","last_clean":"2023-07-20T11:05:43.075369+0000","last_became_active":"2023-07-20T11:05:42.083222+0000","last_became_peered":"2023-07-20T11:05:42.083222+0000","last_unstale":"2023-07-20T11:05:43.075369+0000","last_undegraded":"2023-07-20T11:05:43.075369+0000","last_fullsized":"2023-07-20T11:05:43.075369+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:24.470718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506577+0000","last_change":"2023-07-20T11:05:41.246371+0000","last_active":"2023-07-20T11:05:43.506577+0000","last_peered":"2023-07-20T11:05:43.506577+0000","last_clean":"2023-07-20T11:05:43.506577+0000","last_became_active":"2023-07-20T11:05:41.244769+0000","last_became_peered":"2023-07-20T11:05:41.244769+0000","last_unstale":"2023-07-20T11:05:43.506577+0000","last_undegraded":"2023-07-20T11:05:43.506577+0000","last_fullsized":"2023-07-20T11:05:43.506577+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:20:44.306105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'249","reported_seq":910,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506079+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:05:43.506079+0000","last_peered":"2023-07-20T11:05:43.506079+0000","last_clean":"2023-07-20T11:05:43.506079+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:05:43.506079+0000","last_undegraded":"2023-07-20T11:05:43.506079+0000","last_fullsized":"2023-07-20T11:05:43.506079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:09:48.445365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":317,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468944+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:05:44.468944+0000","last_peered":"2023-07-20T11:05:44.468944+0000","last_clean":"2023-07-20T11:05:44.468944+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:05:44.468944+0000","last_undegraded":"2023-07-20T11:05:44.468944+0000","last_fullsized":"2023-07-20T11:05:44.468944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:41:47.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507150+0000","last_change":"2023-07-20T11:05:42.101744+0000","last_active":"2023-07-20T11:05:43.507150+0000","last_peered":"2023-07-20T11:05:43.507150+0000","last_clean":"2023-07-20T11:05:43.507150+0000","last_became_active":"2023-07-20T11:05:42.101202+0000","last_became_peered":"2023-07-20T11:05:42.101202+0000","last_unstale":"2023-07-20T11:05:43.507150+0000","last_undegraded":"2023-07-20T11:05:43.507150+0000","last_fullsized":"2023-07-20T11:05:43.507150+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:54:03.826186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074777+0000","last_change":"2023-07-20T11:05:41.243591+0000","last_active":"2023-07-20T11:05:43.074777+0000","last_peered":"2023-07-20T11:05:43.074777+0000","last_clean":"2023-07-20T11:05:43.074777+0000","last_became_active":"2023-07-20T11:05:41.243311+0000","last_became_peered":"2023-07-20T11:05:41.243311+0000","last_unstale":"2023-07-20T11:05:43.074777+0000","last_undegraded":"2023-07-20T11:05:43.074777+0000","last_fullsized":"2023-07-20T11:05:43.074777+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:55:00.985488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506324+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:05:43.506324+0000","last_peered":"2023-07-20T11:05:43.506324+0000","last_clean":"2023-07-20T11:05:43.506324+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:05:43.506324+0000","last_undegraded":"2023-07-20T11:05:43.506324+0000","last_fullsized":"2023-07-20T11:05:43.506324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:05:30.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470083+0000","last_change":"2023-07-20T11:05:42.096962+0000","last_active":"2023-07-20T11:05:44.470083+0000","last_peered":"2023-07-20T11:05:44.470083+0000","last_clean":"2023-07-20T11:05:44.470083+0000","last_became_active":"2023-07-20T11:05:42.096714+0000","last_became_peered":"2023-07-20T11:05:42.096714+0000","last_unstale":"2023-07-20T11:05:44.470083+0000","last_undegraded":"2023-07-20T11:05:44.470083+0000","last_fullsized":"2023-07-20T11:05:44.470083+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:26.785309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":21,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469615+0000","last_change":"2023-07-20T11:05:41.246598+0000","last_active":"2023-07-20T11:05:44.469615+0000","last_peered":"2023-07-20T11:05:44.469615+0000","last_clean":"2023-07-20T11:05:44.469615+0000","last_became_active":"2023-07-20T11:05:41.246323+0000","last_became_peered":"2023-07-20T11:05:41.246323+0000","last_unstale":"2023-07-20T11:05:44.469615+0000","last_undegraded":"2023-07-20T11:05:44.469615+0000","last_fullsized":"2023-07-20T11:05:44.469615+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:15.860051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":311,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074333+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:05:43.074333+0000","last_peered":"2023-07-20T11:05:43.074333+0000","last_clean":"2023-07-20T11:05:43.074333+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:05:43.074333+0000","last_undegraded":"2023-07-20T11:05:43.074333+0000","last_fullsized":"2023-07-20T11:05:43.074333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:47.894119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075437+0000","last_change":"2023-07-20T11:05:42.091831+0000","last_active":"2023-07-20T11:05:43.075437+0000","last_peered":"2023-07-20T11:05:43.075437+0000","last_clean":"2023-07-20T11:05:43.075437+0000","last_became_active":"2023-07-20T11:05:42.091441+0000","last_became_peered":"2023-07-20T11:05:42.091441+0000","last_unstale":"2023-07-20T11:05:43.075437+0000","last_undegraded":"2023-07-20T11:05:43.075437+0000","last_fullsized":"2023-07-20T11:05:43.075437+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:59:21.868365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074500+0000","last_change":"2023-07-20T11:05:41.245070+0000","last_active":"2023-07-20T11:05:43.074500+0000","last_peered":"2023-07-20T11:05:43.074500+0000","last_clean":"2023-07-20T11:05:43.074500+0000","last_became_active":"2023-07-20T11:05:41.244815+0000","last_became_peered":"2023-07-20T11:05:41.244815+0000","last_unstale":"2023-07-20T11:05:43.074500+0000","last_undegraded":"2023-07-20T11:05:43.074500+0000","last_fullsized":"2023-07-20T11:05:43.074500+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:35.859010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":317,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469058+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:05:44.469058+0000","last_peered":"2023-07-20T11:05:44.469058+0000","last_clean":"2023-07-20T11:05:44.469058+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:05:44.469058+0000","last_undegraded":"2023-07-20T11:05:44.469058+0000","last_fullsized":"2023-07-20T11:05:44.469058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:24.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074971+0000","last_change":"2023-07-20T11:05:42.084869+0000","last_active":"2023-07-20T11:05:43.074971+0000","last_peered":"2023-07-20T11:05:43.074971+0000","last_clean":"2023-07-20T11:05:43.074971+0000","last_became_active":"2023-07-20T11:05:42.084583+0000","last_became_peered":"2023-07-20T11:05:42.084583+0000","last_unstale":"2023-07-20T11:05:43.074971+0000","last_undegraded":"2023-07-20T11:05:43.074971+0000","last_fullsized":"2023-07-20T11:05:43.074971+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:00.027852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507018+0000","last_change":"2023-07-20T11:05:41.247028+0000","last_active":"2023-07-20T11:05:43.507018+0000","last_peered":"2023-07-20T11:05:43.507018+0000","last_clean":"2023-07-20T11:05:43.507018+0000","last_became_active":"2023-07-20T11:05:41.246761+0000","last_became_peered":"2023-07-20T11:05:41.246761+0000","last_unstale":"2023-07-20T11:05:43.507018+0000","last_undegraded":"2023-07-20T11:05:43.507018+0000","last_fullsized":"2023-07-20T11:05:43.507018+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:13.182589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":281,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470184+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:05:44.470184+0000","last_peered":"2023-07-20T11:05:44.470184+0000","last_clean":"2023-07-20T11:05:44.470184+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:05:44.470184+0000","last_undegraded":"2023-07-20T11:05:44.470184+0000","last_fullsized":"2023-07-20T11:05:44.470184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:42.399171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075198+0000","last_change":"2023-07-20T11:05:42.092195+0000","last_active":"2023-07-20T11:05:43.075198+0000","last_peered":"2023-07-20T11:05:43.075198+0000","last_clean":"2023-07-20T11:05:43.075198+0000","last_became_active":"2023-07-20T11:05:42.091755+0000","last_became_peered":"2023-07-20T11:05:42.091755+0000","last_unstale":"2023-07-20T11:05:43.075198+0000","last_undegraded":"2023-07-20T11:05:43.075198+0000","last_fullsized":"2023-07-20T11:05:43.075198+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:44:10.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":19,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506769+0000","last_change":"2023-07-20T11:05:41.242739+0000","last_active":"2023-07-20T11:05:43.506769+0000","last_peered":"2023-07-20T11:05:43.506769+0000","last_clean":"2023-07-20T11:05:43.506769+0000","last_became_active":"2023-07-20T11:05:41.242451+0000","last_became_peered":"2023-07-20T11:05:41.242451+0000","last_unstale":"2023-07-20T11:05:43.506769+0000","last_undegraded":"2023-07-20T11:05:43.506769+0000","last_fullsized":"2023-07-20T11:05:43.506769+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:10:50.848842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507151+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:05:43.507151+0000","last_peered":"2023-07-20T11:05:43.507151+0000","last_clean":"2023-07-20T11:05:43.507151+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:05:43.507151+0000","last_undegraded":"2023-07-20T11:05:43.507151+0000","last_fullsized":"2023-07-20T11:05:43.507151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:31.448023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074251+0000","last_change":"2023-07-20T11:05:42.089639+0000","last_active":"2023-07-20T11:05:43.074251+0000","last_peered":"2023-07-20T11:05:43.074251+0000","last_clean":"2023-07-20T11:05:43.074251+0000","last_became_active":"2023-07-20T11:05:42.089378+0000","last_became_peered":"2023-07-20T11:05:42.089378+0000","last_unstale":"2023-07-20T11:05:43.074251+0000","last_undegraded":"2023-07-20T11:05:43.074251+0000","last_fullsized":"2023-07-20T11:05:43.074251+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:56:32.193649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469037+0000","last_change":"2023-07-20T11:05:41.241181+0000","last_active":"2023-07-20T11:05:44.469037+0000","last_peered":"2023-07-20T11:05:44.469037+0000","last_clean":"2023-07-20T11:05:44.469037+0000","last_became_active":"2023-07-20T11:05:41.240899+0000","last_became_peered":"2023-07-20T11:05:41.240899+0000","last_unstale":"2023-07-20T11:05:44.469037+0000","last_undegraded":"2023-07-20T11:05:44.469037+0000","last_fullsized":"2023-07-20T11:05:44.469037+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:05.430433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":279,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469801+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:05:44.469801+0000","last_peered":"2023-07-20T11:05:44.469801+0000","last_clean":"2023-07-20T11:05:44.469801+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:05:44.469801+0000","last_undegraded":"2023-07-20T11:05:44.469801+0000","last_fullsized":"2023-07-20T11:05:44.469801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:20:25.266457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469413+0000","last_change":"2023-07-20T11:05:42.097781+0000","last_active":"2023-07-20T11:05:44.469413+0000","last_peered":"2023-07-20T11:05:44.469413+0000","last_clean":"2023-07-20T11:05:44.469413+0000","last_became_active":"2023-07-20T11:05:42.097494+0000","last_became_peered":"2023-07-20T11:05:42.097494+0000","last_unstale":"2023-07-20T11:05:44.469413+0000","last_undegraded":"2023-07-20T11:05:44.469413+0000","last_fullsized":"2023-07-20T11:05:44.469413+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:51.745131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075072+0000","last_change":"2023-07-20T11:05:41.245147+0000","last_active":"2023-07-20T11:05:43.075072+0000","last_peered":"2023-07-20T11:05:43.075072+0000","last_clean":"2023-07-20T11:05:43.075072+0000","last_became_active":"2023-07-20T11:05:41.244866+0000","last_became_peered":"2023-07-20T11:05:41.244866+0000","last_unstale":"2023-07-20T11:05:43.075072+0000","last_undegraded":"2023-07-20T11:05:43.075072+0000","last_fullsized":"2023-07-20T11:05:43.075072+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:35.961601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075678+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:05:43.075678+0000","last_peered":"2023-07-20T11:05:43.075678+0000","last_clean":"2023-07-20T11:05:43.075678+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:05:43.075678+0000","last_undegraded":"2023-07-20T11:05:43.075678+0000","last_fullsized":"2023-07-20T11:05:43.075678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:28.815119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47588,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324252,"statfs":{"total":96636764160,"available":96588034048,"internally_reserved":0,"allocated":2576384,"data_stored":1592062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.78800000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80400000000000005,"15min":0.77600000000000002},"min":{"1min":0.58199999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.62}]},{"osd":1,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.754},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.433},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.753},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79100000000000004,"15min":0.76900000000000002},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.49099999999999999},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.54100000000000004,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.40699999999999997},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41240,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330600,"statfs":{"total":96636764160,"available":96594534400,"internally_reserved":0,"allocated":1974272,"data_stored":1000712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55184,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316656,"statfs":{"total":96636764160,"available":96580255744,"internally_reserved":0,"allocated":1970176,"data_stored":1000062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.622},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.443}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":1966080,"data_stored":1000040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55196,"kb_used_data":1936,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316644,"statfs":{"total":96636764160,"available":96580243456,"internally_reserved":0,"allocated":1982464,"data_stored":1001674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.374}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.499},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.749},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575748,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312556,"statfs":{"total":96636764160,"available":96576057344,"internally_reserved":0,"allocated":1974272,"data_stored":1000656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.40500000000000003,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.05},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.115},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0529999999999999,"5min":1.1919999999999999,"15min":1.202},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0149999999999999,"5min":1.093,"15min":1.266},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.53600000000000003},"max":{"1min":1.099,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.67200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3,"15min":1.3},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.83699999999999997},"min":{"1min":0.64600000000000002,"5min":0.59499999999999997,"15min":0.55200000000000005},"max":{"1min":1.0800000000000001,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.60599999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.3129999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82999999999999996},"min":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"max":{"1min":1.0389999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575749,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1970176,"data_stored":1000110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575749,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41824,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330016,"statfs":{"total":96636764160,"available":96593936384,"internally_reserved":0,"allocated":2568192,"data_stored":1590464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.626}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:05:50.812 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:05:50.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 Processor -- start 2023-07-20T11:05:50.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 -- start start 2023-07-20T11:05:50.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 0x7f5ea80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ea80d16b0 con 0x7f5ea80d0d10 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80d31c0 con 0x7f5ea815cab0 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5eae137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80b3520 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea77fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 0x7f5ea80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56414/0 (socket says 172.21.15.82:56414) 2023-07-20T11:05:50.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 -- 172.21.15.82:0/638361198 learned_addr learned my addr 172.21.15.82:0/638361198 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:50.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 -- 172.21.15.82:0/638361198 >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 msgr2=0x7f5ea80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:50.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 --2- 172.21.15.82:0/638361198 >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 0x7f5ea80d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:50.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 -- 172.21.15.82:0/638361198 >> v1:172.21.15.183:6789/0 conn(0x7f5ea80d0d10 legacy=0x7f5ea80cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:50.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea7fff640 1 -- 172.21.15.82:0/638361198 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80b2910 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.979+0000 7f5ea77fe640 1 --2- 172.21.15.82:0/638361198 >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 0x7f5ea80d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5ea7fff640 1 --2- 172.21.15.82:0/638361198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009870 tx=0x7f5ea001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ee66b9657aa84f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5ea6ffd640 1 -- 172.21.15.82:0/638361198 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00a7070 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5ea6ffd640 1 -- 172.21.15.82:0/638361198 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea00ab430 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5ea6ffd640 1 -- 172.21.15.82:0/638361198 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00ab7c0 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 -- 172.21.15.82:0/638361198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 msgr2=0x7f5ea80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 --2- 172.21.15.82:0/638361198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009870 tx=0x7f5ea001c510 comp rx=0 tx=0).stop 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 -- 172.21.15.82:0/638361198 shutdown_connections 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 --2- 172.21.15.82:0/638361198 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea80d1170 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 --2- 172.21.15.82:0/638361198 >> v2:172.21.15.183:3300/0 conn(0x7f5ea815cab0 0x7f5ea80d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 -- 172.21.15.82:0/638361198 >> 172.21.15.82:0/638361198 conn(0x7f5ea808c120 msgr2=0x7f5ea809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:50.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 -- 172.21.15.82:0/638361198 shutdown_connections 2023-07-20T11:05:50.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.983+0000 7f5eae137640 1 -- 172.21.15.82:0/638361198 wait complete. 2023-07-20T11:05:50.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 Processor -- start 2023-07-20T11:05:50.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- start start 2023-07-20T11:05:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 0x7f5ea80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80cabd0 con 0x7f5ea815cab0 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80caeb0 con 0x7f5ea80d0d10 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80cb190 con 0x7f5ea80ce4c0 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35376/0 (socket says 172.21.15.82:35376) 2023-07-20T11:05:50.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 -- 172.21.15.82:0/242929565 learned_addr learned my addr 172.21.15.82:0/242929565 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:50.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5e9effd640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 0x7f5ea80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea77fe640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 -- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 msgr2=0x7f5ea815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 -- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 msgr2=0x7f5ea80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:50.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 0x7f5ea80c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:50.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 -- 172.21.15.82:0/242929565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009420 con 0x7f5ea815cab0 2023-07-20T11:05:50.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5e9effd640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 0x7f5ea80c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea77fe640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea7fff640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00ad040 tx=0x7f5ea00192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00ba070 con 0x7f5ea815cab0 2023-07-20T11:05:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea00b4420 con 0x7f5ea815cab0 2023-07-20T11:05:50.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea00b47d0 con 0x7f5ea815cab0 2023-07-20T11:05:50.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea00094d0 con 0x7f5ea815cab0 2023-07-20T11:05:50.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.987+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea80cb750 con 0x7f5ea815cab0 2023-07-20T11:05:50.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80b25a0 con 0x7f5ea815cab0 2023-07-20T11:05:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ea00b4930 con 0x7f5ea815cab0 2023-07-20T11:05:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5ea4ff9640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 0x7f5e88068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f5ea011d920 con 0x7f5ea815cab0 2023-07-20T11:05:50.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5ea77fe640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 0x7f5e88068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.991+0000 7f5ea77fe640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 0x7f5e88068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009c70 tx=0x7f5e98008040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:50.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:50.995+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ea80b25a0 con 0x7f5ea815cab0 2023-07-20T11:05:51.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.139+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ea80b31b0 con 0x7f5e880663a0 2023-07-20T11:05:51.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.147+0000 7f5ea4ff9640 1 -- 172.21.15.82:0/242929565 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311892 (secure 0 0 0) 0x7f5e98010e20 con 0x7f5e880663a0 2023-07-20T11:05:51.133 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:51.134 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:05:51.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 msgr2=0x7f5e88068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 0x7f5e88068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009c70 tx=0x7f5e98008040 comp rx=0 tx=0).stop 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 msgr2=0x7f5ea80b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5ea00ad040 tx=0x7f5ea00192b0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 shutdown_connections 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f5e880663a0 0x7f5e88068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ea815cab0 0x7f5ea80b5320 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ea80d0d10 0x7f5ea80c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 --2- 172.21.15.82:0/242929565 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5ea80ce4c0 0x7f5ea815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 >> 172.21.15.82:0/242929565 conn(0x7f5ea808c120 msgr2=0x7f5ea8158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 shutdown_connections 2023-07-20T11:05:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.151+0000 7f5eae137640 1 -- 172.21.15.82:0/242929565 wait complete. 2023-07-20T11:05:51.154 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T11:05:49.145083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":374592,"kb_used_data":16584,"kb_used_omap":13,"kb_used_meta":357874,"kb_avail":754600128,"statfs":{"total":773094113280,"available":772710531072,"internally_reserved":0,"allocated":16982016,"data_stored":9185780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":366463064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.919486"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074482+0000","last_change":"2023-07-20T11:05:42.089075+0000","last_active":"2023-07-20T11:05:43.074482+0000","last_peered":"2023-07-20T11:05:43.074482+0000","last_clean":"2023-07-20T11:05:43.074482+0000","last_became_active":"2023-07-20T11:05:42.088739+0000","last_became_peered":"2023-07-20T11:05:42.088739+0000","last_unstale":"2023-07-20T11:05:43.074482+0000","last_undegraded":"2023-07-20T11:05:43.074482+0000","last_fullsized":"2023-07-20T11:05:43.074482+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:21.589283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469006+0000","last_change":"2023-07-20T11:05:42.088173+0000","last_active":"2023-07-20T11:05:44.469006+0000","last_peered":"2023-07-20T11:05:44.469006+0000","last_clean":"2023-07-20T11:05:44.469006+0000","last_became_active":"2023-07-20T11:05:42.087878+0000","last_became_peered":"2023-07-20T11:05:42.087878+0000","last_unstale":"2023-07-20T11:05:44.469006+0000","last_undegraded":"2023-07-20T11:05:44.469006+0000","last_fullsized":"2023-07-20T11:05:44.469006+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:47:10.679153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075364+0000","last_change":"2023-07-20T11:05:42.088592+0000","last_active":"2023-07-20T11:05:43.075364+0000","last_peered":"2023-07-20T11:05:43.075364+0000","last_clean":"2023-07-20T11:05:43.075364+0000","last_became_active":"2023-07-20T11:05:42.088267+0000","last_became_peered":"2023-07-20T11:05:42.088267+0000","last_unstale":"2023-07-20T11:05:43.075364+0000","last_undegraded":"2023-07-20T11:05:43.075364+0000","last_fullsized":"2023-07-20T11:05:43.075364+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:52.534288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468933+0000","last_change":"2023-07-20T11:05:42.091140+0000","last_active":"2023-07-20T11:05:44.468933+0000","last_peered":"2023-07-20T11:05:44.468933+0000","last_clean":"2023-07-20T11:05:44.468933+0000","last_became_active":"2023-07-20T11:05:42.090781+0000","last_became_peered":"2023-07-20T11:05:42.090781+0000","last_unstale":"2023-07-20T11:05:44.468933+0000","last_undegraded":"2023-07-20T11:05:44.468933+0000","last_fullsized":"2023-07-20T11:05:44.468933+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:27:07.432777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469032+0000","last_change":"2023-07-20T11:05:42.088479+0000","last_active":"2023-07-20T11:05:44.469032+0000","last_peered":"2023-07-20T11:05:44.469032+0000","last_clean":"2023-07-20T11:05:44.469032+0000","last_became_active":"2023-07-20T11:05:42.088150+0000","last_became_peered":"2023-07-20T11:05:42.088150+0000","last_unstale":"2023-07-20T11:05:44.469032+0000","last_undegraded":"2023-07-20T11:05:44.469032+0000","last_fullsized":"2023-07-20T11:05:44.469032+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:43:11.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469255+0000","last_change":"2023-07-20T11:05:42.099483+0000","last_active":"2023-07-20T11:05:44.469255+0000","last_peered":"2023-07-20T11:05:44.469255+0000","last_clean":"2023-07-20T11:05:44.469255+0000","last_became_active":"2023-07-20T11:05:42.099222+0000","last_became_peered":"2023-07-20T11:05:42.099222+0000","last_unstale":"2023-07-20T11:05:44.469255+0000","last_undegraded":"2023-07-20T11:05:44.469255+0000","last_fullsized":"2023-07-20T11:05:44.469255+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:46:20.927113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506413+0000","last_change":"2023-07-20T11:05:42.098789+0000","last_active":"2023-07-20T11:05:43.506413+0000","last_peered":"2023-07-20T11:05:43.506413+0000","last_clean":"2023-07-20T11:05:43.506413+0000","last_became_active":"2023-07-20T11:05:42.098467+0000","last_became_peered":"2023-07-20T11:05:42.098467+0000","last_unstale":"2023-07-20T11:05:43.506413+0000","last_undegraded":"2023-07-20T11:05:43.506413+0000","last_fullsized":"2023-07-20T11:05:43.506413+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:58:02.575928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967892+0000","last_change":"2023-07-20T11:05:42.094603+0000","last_active":"2023-07-20T11:05:43.967892+0000","last_peered":"2023-07-20T11:05:43.967892+0000","last_clean":"2023-07-20T11:05:43.967892+0000","last_became_active":"2023-07-20T11:05:42.094183+0000","last_became_peered":"2023-07-20T11:05:42.094183+0000","last_unstale":"2023-07-20T11:05:43.967892+0000","last_undegraded":"2023-07-20T11:05:43.967892+0000","last_fullsized":"2023-07-20T11:05:43.967892+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:50:34.938333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469878+0000","last_change":"2023-07-20T11:05:42.098092+0000","last_active":"2023-07-20T11:05:44.469878+0000","last_peered":"2023-07-20T11:05:44.469878+0000","last_clean":"2023-07-20T11:05:44.469878+0000","last_became_active":"2023-07-20T11:05:42.097694+0000","last_became_peered":"2023-07-20T11:05:42.097694+0000","last_unstale":"2023-07-20T11:05:44.469878+0000","last_undegraded":"2023-07-20T11:05:44.469878+0000","last_fullsized":"2023-07-20T11:05:44.469878+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:17.915835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075467+0000","last_change":"2023-07-20T11:05:42.096804+0000","last_active":"2023-07-20T11:05:43.075467+0000","last_peered":"2023-07-20T11:05:43.075467+0000","last_clean":"2023-07-20T11:05:43.075467+0000","last_became_active":"2023-07-20T11:05:42.096508+0000","last_became_peered":"2023-07-20T11:05:42.096508+0000","last_unstale":"2023-07-20T11:05:43.075467+0000","last_undegraded":"2023-07-20T11:05:43.075467+0000","last_fullsized":"2023-07-20T11:05:43.075467+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:11:09.023729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469057+0000","last_change":"2023-07-20T11:05:42.098680+0000","last_active":"2023-07-20T11:05:44.469057+0000","last_peered":"2023-07-20T11:05:44.469057+0000","last_clean":"2023-07-20T11:05:44.469057+0000","last_became_active":"2023-07-20T11:05:42.098178+0000","last_became_peered":"2023-07-20T11:05:42.098178+0000","last_unstale":"2023-07-20T11:05:44.469057+0000","last_undegraded":"2023-07-20T11:05:44.469057+0000","last_fullsized":"2023-07-20T11:05:44.469057+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:44:07.863262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074823+0000","last_change":"2023-07-20T11:05:42.079823+0000","last_active":"2023-07-20T11:05:43.074823+0000","last_peered":"2023-07-20T11:05:43.074823+0000","last_clean":"2023-07-20T11:05:43.074823+0000","last_became_active":"2023-07-20T11:05:42.079435+0000","last_became_peered":"2023-07-20T11:05:42.079435+0000","last_unstale":"2023-07-20T11:05:43.074823+0000","last_undegraded":"2023-07-20T11:05:43.074823+0000","last_fullsized":"2023-07-20T11:05:43.074823+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:51:51.301751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469583+0000","last_change":"2023-07-20T11:05:42.099497+0000","last_active":"2023-07-20T11:05:44.469583+0000","last_peered":"2023-07-20T11:05:44.469583+0000","last_clean":"2023-07-20T11:05:44.469583+0000","last_became_active":"2023-07-20T11:05:42.099184+0000","last_became_peered":"2023-07-20T11:05:42.099184+0000","last_unstale":"2023-07-20T11:05:44.469583+0000","last_undegraded":"2023-07-20T11:05:44.469583+0000","last_fullsized":"2023-07-20T11:05:44.469583+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:27:08.749940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074593+0000","last_change":"2023-07-20T11:05:42.103808+0000","last_active":"2023-07-20T11:05:43.074593+0000","last_peered":"2023-07-20T11:05:43.074593+0000","last_clean":"2023-07-20T11:05:43.074593+0000","last_became_active":"2023-07-20T11:05:42.103468+0000","last_became_peered":"2023-07-20T11:05:42.103468+0000","last_unstale":"2023-07-20T11:05:43.074593+0000","last_undegraded":"2023-07-20T11:05:43.074593+0000","last_fullsized":"2023-07-20T11:05:43.074593+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:11.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074255+0000","last_change":"2023-07-20T11:05:42.094620+0000","last_active":"2023-07-20T11:05:43.074255+0000","last_peered":"2023-07-20T11:05:43.074255+0000","last_clean":"2023-07-20T11:05:43.074255+0000","last_became_active":"2023-07-20T11:05:42.094343+0000","last_became_peered":"2023-07-20T11:05:42.094343+0000","last_unstale":"2023-07-20T11:05:43.074255+0000","last_undegraded":"2023-07-20T11:05:43.074255+0000","last_fullsized":"2023-07-20T11:05:43.074255+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:08:15.900817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469524+0000","last_change":"2023-07-20T11:05:42.097055+0000","last_active":"2023-07-20T11:05:44.469524+0000","last_peered":"2023-07-20T11:05:44.469524+0000","last_clean":"2023-07-20T11:05:44.469524+0000","last_became_active":"2023-07-20T11:05:42.096783+0000","last_became_peered":"2023-07-20T11:05:42.096783+0000","last_unstale":"2023-07-20T11:05:44.469524+0000","last_undegraded":"2023-07-20T11:05:44.469524+0000","last_fullsized":"2023-07-20T11:05:44.469524+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:54:49.697595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469999+0000","last_change":"2023-07-20T11:05:42.092744+0000","last_active":"2023-07-20T11:05:44.469999+0000","last_peered":"2023-07-20T11:05:44.469999+0000","last_clean":"2023-07-20T11:05:44.469999+0000","last_became_active":"2023-07-20T11:05:42.092391+0000","last_became_peered":"2023-07-20T11:05:42.092391+0000","last_unstale":"2023-07-20T11:05:44.469999+0000","last_undegraded":"2023-07-20T11:05:44.469999+0000","last_fullsized":"2023-07-20T11:05:44.469999+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:27:44.861618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469735+0000","last_change":"2023-07-20T11:05:42.088567+0000","last_active":"2023-07-20T11:05:44.469735+0000","last_peered":"2023-07-20T11:05:44.469735+0000","last_clean":"2023-07-20T11:05:44.469735+0000","last_became_active":"2023-07-20T11:05:42.088284+0000","last_became_peered":"2023-07-20T11:05:42.088284+0000","last_unstale":"2023-07-20T11:05:44.469735+0000","last_undegraded":"2023-07-20T11:05:44.469735+0000","last_fullsized":"2023-07-20T11:05:44.469735+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:23.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506863+0000","last_change":"2023-07-20T11:05:42.097882+0000","last_active":"2023-07-20T11:05:43.506863+0000","last_peered":"2023-07-20T11:05:43.506863+0000","last_clean":"2023-07-20T11:05:43.506863+0000","last_became_active":"2023-07-20T11:05:42.096403+0000","last_became_peered":"2023-07-20T11:05:42.096403+0000","last_unstale":"2023-07-20T11:05:43.506863+0000","last_undegraded":"2023-07-20T11:05:43.506863+0000","last_fullsized":"2023-07-20T11:05:43.506863+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:51:13.792188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469203+0000","last_change":"2023-07-20T11:05:42.093987+0000","last_active":"2023-07-20T11:05:44.469203+0000","last_peered":"2023-07-20T11:05:44.469203+0000","last_clean":"2023-07-20T11:05:44.469203+0000","last_became_active":"2023-07-20T11:05:42.093719+0000","last_became_peered":"2023-07-20T11:05:42.093719+0000","last_unstale":"2023-07-20T11:05:44.469203+0000","last_undegraded":"2023-07-20T11:05:44.469203+0000","last_fullsized":"2023-07-20T11:05:44.469203+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:06:13.276168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468781+0000","last_change":"2023-07-20T11:05:42.090666+0000","last_active":"2023-07-20T11:05:44.468781+0000","last_peered":"2023-07-20T11:05:44.468781+0000","last_clean":"2023-07-20T11:05:44.468781+0000","last_became_active":"2023-07-20T11:05:42.090337+0000","last_became_peered":"2023-07-20T11:05:42.090337+0000","last_unstale":"2023-07-20T11:05:44.468781+0000","last_undegraded":"2023-07-20T11:05:44.468781+0000","last_fullsized":"2023-07-20T11:05:44.468781+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:07.704756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074472+0000","last_change":"2023-07-20T11:05:42.082384+0000","last_active":"2023-07-20T11:05:43.074472+0000","last_peered":"2023-07-20T11:05:43.074472+0000","last_clean":"2023-07-20T11:05:43.074472+0000","last_became_active":"2023-07-20T11:05:42.082094+0000","last_became_peered":"2023-07-20T11:05:42.082094+0000","last_unstale":"2023-07-20T11:05:43.074472+0000","last_undegraded":"2023-07-20T11:05:43.074472+0000","last_fullsized":"2023-07-20T11:05:43.074472+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:42:32.127680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468732+0000","last_change":"2023-07-20T11:05:42.094000+0000","last_active":"2023-07-20T11:05:44.468732+0000","last_peered":"2023-07-20T11:05:44.468732+0000","last_clean":"2023-07-20T11:05:44.468732+0000","last_became_active":"2023-07-20T11:05:42.093675+0000","last_became_peered":"2023-07-20T11:05:42.093675+0000","last_unstale":"2023-07-20T11:05:44.468732+0000","last_undegraded":"2023-07-20T11:05:44.468732+0000","last_fullsized":"2023-07-20T11:05:44.468732+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:17:26.881705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469553+0000","last_change":"2023-07-20T11:05:42.098189+0000","last_active":"2023-07-20T11:05:44.469553+0000","last_peered":"2023-07-20T11:05:44.469553+0000","last_clean":"2023-07-20T11:05:44.469553+0000","last_became_active":"2023-07-20T11:05:42.097933+0000","last_became_peered":"2023-07-20T11:05:42.097933+0000","last_unstale":"2023-07-20T11:05:44.469553+0000","last_undegraded":"2023-07-20T11:05:44.469553+0000","last_fullsized":"2023-07-20T11:05:44.469553+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:49:39.909040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075622+0000","last_change":"2023-07-20T11:05:42.089114+0000","last_active":"2023-07-20T11:05:43.075622+0000","last_peered":"2023-07-20T11:05:43.075622+0000","last_clean":"2023-07-20T11:05:43.075622+0000","last_became_active":"2023-07-20T11:05:42.088823+0000","last_became_peered":"2023-07-20T11:05:42.088823+0000","last_unstale":"2023-07-20T11:05:43.075622+0000","last_undegraded":"2023-07-20T11:05:43.075622+0000","last_fullsized":"2023-07-20T11:05:43.075622+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:13:56.240988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075432+0000","last_change":"2023-07-20T11:05:42.101173+0000","last_active":"2023-07-20T11:05:43.075432+0000","last_peered":"2023-07-20T11:05:43.075432+0000","last_clean":"2023-07-20T11:05:43.075432+0000","last_became_active":"2023-07-20T11:05:42.100900+0000","last_became_peered":"2023-07-20T11:05:42.100900+0000","last_unstale":"2023-07-20T11:05:43.075432+0000","last_undegraded":"2023-07-20T11:05:43.075432+0000","last_fullsized":"2023-07-20T11:05:43.075432+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:15:50.274668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506893+0000","last_change":"2023-07-20T11:05:42.100781+0000","last_active":"2023-07-20T11:05:43.506893+0000","last_peered":"2023-07-20T11:05:43.506893+0000","last_clean":"2023-07-20T11:05:43.506893+0000","last_became_active":"2023-07-20T11:05:42.100478+0000","last_became_peered":"2023-07-20T11:05:42.100478+0000","last_unstale":"2023-07-20T11:05:43.506893+0000","last_undegraded":"2023-07-20T11:05:43.506893+0000","last_fullsized":"2023-07-20T11:05:43.506893+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:51:51.883750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075391+0000","last_change":"2023-07-20T11:05:42.099553+0000","last_active":"2023-07-20T11:05:43.075391+0000","last_peered":"2023-07-20T11:05:43.075391+0000","last_clean":"2023-07-20T11:05:43.075391+0000","last_became_active":"2023-07-20T11:05:42.099108+0000","last_became_peered":"2023-07-20T11:05:42.099108+0000","last_unstale":"2023-07-20T11:05:43.075391+0000","last_undegraded":"2023-07-20T11:05:43.075391+0000","last_fullsized":"2023-07-20T11:05:43.075391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:58:13.286074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075197+0000","last_change":"2023-07-20T11:05:42.091842+0000","last_active":"2023-07-20T11:05:43.075197+0000","last_peered":"2023-07-20T11:05:43.075197+0000","last_clean":"2023-07-20T11:05:43.075197+0000","last_became_active":"2023-07-20T11:05:42.089828+0000","last_became_peered":"2023-07-20T11:05:42.089828+0000","last_unstale":"2023-07-20T11:05:43.075197+0000","last_undegraded":"2023-07-20T11:05:43.075197+0000","last_fullsized":"2023-07-20T11:05:43.075197+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:05:31.336434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075058+0000","last_change":"2023-07-20T11:05:42.096128+0000","last_active":"2023-07-20T11:05:43.075058+0000","last_peered":"2023-07-20T11:05:43.075058+0000","last_clean":"2023-07-20T11:05:43.075058+0000","last_became_active":"2023-07-20T11:05:42.095779+0000","last_became_peered":"2023-07-20T11:05:42.095779+0000","last_unstale":"2023-07-20T11:05:43.075058+0000","last_undegraded":"2023-07-20T11:05:43.075058+0000","last_fullsized":"2023-07-20T11:05:43.075058+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:10.262566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967907+0000","last_change":"2023-07-20T11:05:42.093611+0000","last_active":"2023-07-20T11:05:43.967907+0000","last_peered":"2023-07-20T11:05:43.967907+0000","last_clean":"2023-07-20T11:05:43.967907+0000","last_became_active":"2023-07-20T11:05:42.093301+0000","last_became_peered":"2023-07-20T11:05:42.093301+0000","last_unstale":"2023-07-20T11:05:43.967907+0000","last_undegraded":"2023-07-20T11:05:43.967907+0000","last_fullsized":"2023-07-20T11:05:43.967907+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:40:42.599906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075068+0000","last_change":"2023-07-20T11:05:42.099833+0000","last_active":"2023-07-20T11:05:43.075068+0000","last_peered":"2023-07-20T11:05:43.075068+0000","last_clean":"2023-07-20T11:05:43.075068+0000","last_became_active":"2023-07-20T11:05:42.099537+0000","last_became_peered":"2023-07-20T11:05:42.099537+0000","last_unstale":"2023-07-20T11:05:43.075068+0000","last_undegraded":"2023-07-20T11:05:43.075068+0000","last_fullsized":"2023-07-20T11:05:43.075068+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:03:32.786160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.967935+0000","last_change":"2023-07-20T11:05:42.101156+0000","last_active":"2023-07-20T11:05:43.967935+0000","last_peered":"2023-07-20T11:05:43.967935+0000","last_clean":"2023-07-20T11:05:43.967935+0000","last_became_active":"2023-07-20T11:05:42.100884+0000","last_became_peered":"2023-07-20T11:05:42.100884+0000","last_unstale":"2023-07-20T11:05:43.967935+0000","last_undegraded":"2023-07-20T11:05:43.967935+0000","last_fullsized":"2023-07-20T11:05:43.967935+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:56.253772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075730+0000","last_change":"2023-07-20T11:05:41.244924+0000","last_active":"2023-07-20T11:05:43.075730+0000","last_peered":"2023-07-20T11:05:43.075730+0000","last_clean":"2023-07-20T11:05:43.075730+0000","last_became_active":"2023-07-20T11:05:41.244629+0000","last_became_peered":"2023-07-20T11:05:41.244629+0000","last_unstale":"2023-07-20T11:05:43.075730+0000","last_undegraded":"2023-07-20T11:05:43.075730+0000","last_fullsized":"2023-07-20T11:05:43.075730+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:43.495374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074318+0000","last_change":"2023-07-20T11:05:42.082315+0000","last_active":"2023-07-20T11:05:43.074318+0000","last_peered":"2023-07-20T11:05:43.074318+0000","last_clean":"2023-07-20T11:05:43.074318+0000","last_became_active":"2023-07-20T11:05:42.082000+0000","last_became_peered":"2023-07-20T11:05:42.082000+0000","last_unstale":"2023-07-20T11:05:43.074318+0000","last_undegraded":"2023-07-20T11:05:43.074318+0000","last_fullsized":"2023-07-20T11:05:43.074318+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:29.090260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469926+0000","last_change":"2023-07-20T11:05:41.238014+0000","last_active":"2023-07-20T11:05:44.469926+0000","last_peered":"2023-07-20T11:05:44.469926+0000","last_clean":"2023-07-20T11:05:44.469926+0000","last_became_active":"2023-07-20T11:05:41.237760+0000","last_became_peered":"2023-07-20T11:05:41.237760+0000","last_unstale":"2023-07-20T11:05:44.469926+0000","last_undegraded":"2023-07-20T11:05:44.469926+0000","last_fullsized":"2023-07-20T11:05:44.469926+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:13:34.126570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468917+0000","last_change":"2023-07-20T11:05:42.094040+0000","last_active":"2023-07-20T11:05:44.468917+0000","last_peered":"2023-07-20T11:05:44.468917+0000","last_clean":"2023-07-20T11:05:44.468917+0000","last_became_active":"2023-07-20T11:05:42.093706+0000","last_became_peered":"2023-07-20T11:05:42.093706+0000","last_unstale":"2023-07-20T11:05:44.468917+0000","last_undegraded":"2023-07-20T11:05:44.468917+0000","last_fullsized":"2023-07-20T11:05:44.468917+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:05:49.488711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506986+0000","last_change":"2023-07-20T11:05:41.244435+0000","last_active":"2023-07-20T11:05:43.506986+0000","last_peered":"2023-07-20T11:05:43.506986+0000","last_clean":"2023-07-20T11:05:43.506986+0000","last_became_active":"2023-07-20T11:05:41.244134+0000","last_became_peered":"2023-07-20T11:05:41.244134+0000","last_unstale":"2023-07-20T11:05:43.506986+0000","last_undegraded":"2023-07-20T11:05:43.506986+0000","last_fullsized":"2023-07-20T11:05:43.506986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:10:32.384134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074521+0000","last_change":"2023-07-20T11:05:42.094504+0000","last_active":"2023-07-20T11:05:43.074521+0000","last_peered":"2023-07-20T11:05:43.074521+0000","last_clean":"2023-07-20T11:05:43.074521+0000","last_became_active":"2023-07-20T11:05:42.094204+0000","last_became_peered":"2023-07-20T11:05:42.094204+0000","last_unstale":"2023-07-20T11:05:43.074521+0000","last_undegraded":"2023-07-20T11:05:43.074521+0000","last_fullsized":"2023-07-20T11:05:43.074521+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:25:01.704144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506625+0000","last_change":"2023-07-20T11:05:41.236452+0000","last_active":"2023-07-20T11:05:43.506625+0000","last_peered":"2023-07-20T11:05:43.506625+0000","last_clean":"2023-07-20T11:05:43.506625+0000","last_became_active":"2023-07-20T11:05:41.236158+0000","last_became_peered":"2023-07-20T11:05:41.236158+0000","last_unstale":"2023-07-20T11:05:43.506625+0000","last_undegraded":"2023-07-20T11:05:43.506625+0000","last_fullsized":"2023-07-20T11:05:43.506625+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:57:18.585742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968266+0000","last_change":"2023-07-20T11:05:42.096092+0000","last_active":"2023-07-20T11:05:43.968266+0000","last_peered":"2023-07-20T11:05:43.968266+0000","last_clean":"2023-07-20T11:05:43.968266+0000","last_became_active":"2023-07-20T11:05:42.095815+0000","last_became_peered":"2023-07-20T11:05:42.095815+0000","last_unstale":"2023-07-20T11:05:43.968266+0000","last_undegraded":"2023-07-20T11:05:43.968266+0000","last_fullsized":"2023-07-20T11:05:43.968266+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:57.460266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968146+0000","last_change":"2023-07-20T11:05:41.237900+0000","last_active":"2023-07-20T11:05:43.968146+0000","last_peered":"2023-07-20T11:05:43.968146+0000","last_clean":"2023-07-20T11:05:43.968146+0000","last_became_active":"2023-07-20T11:05:41.237605+0000","last_became_peered":"2023-07-20T11:05:41.237605+0000","last_unstale":"2023-07-20T11:05:43.968146+0000","last_undegraded":"2023-07-20T11:05:43.968146+0000","last_fullsized":"2023-07-20T11:05:43.968146+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:06:38.777365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968256+0000","last_change":"2023-07-20T11:05:42.093962+0000","last_active":"2023-07-20T11:05:43.968256+0000","last_peered":"2023-07-20T11:05:43.968256+0000","last_clean":"2023-07-20T11:05:43.968256+0000","last_became_active":"2023-07-20T11:05:42.093683+0000","last_became_peered":"2023-07-20T11:05:42.093683+0000","last_unstale":"2023-07-20T11:05:43.968256+0000","last_undegraded":"2023-07-20T11:05:43.968256+0000","last_fullsized":"2023-07-20T11:05:43.968256+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:25.290635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468835+0000","last_change":"2023-07-20T11:05:41.235435+0000","last_active":"2023-07-20T11:05:44.468835+0000","last_peered":"2023-07-20T11:05:44.468835+0000","last_clean":"2023-07-20T11:05:44.468835+0000","last_became_active":"2023-07-20T11:05:41.235154+0000","last_became_peered":"2023-07-20T11:05:41.235154+0000","last_unstale":"2023-07-20T11:05:44.468835+0000","last_undegraded":"2023-07-20T11:05:44.468835+0000","last_fullsized":"2023-07-20T11:05:44.468835+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:09.358260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469848+0000","last_change":"2023-07-20T11:05:42.094735+0000","last_active":"2023-07-20T11:05:44.469848+0000","last_peered":"2023-07-20T11:05:44.469848+0000","last_clean":"2023-07-20T11:05:44.469848+0000","last_became_active":"2023-07-20T11:05:42.094446+0000","last_became_peered":"2023-07-20T11:05:42.094446+0000","last_unstale":"2023-07-20T11:05:44.469848+0000","last_undegraded":"2023-07-20T11:05:44.469848+0000","last_fullsized":"2023-07-20T11:05:44.469848+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:02:36.357612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469253+0000","last_change":"2023-07-20T11:05:41.243421+0000","last_active":"2023-07-20T11:05:44.469253+0000","last_peered":"2023-07-20T11:05:44.469253+0000","last_clean":"2023-07-20T11:05:44.469253+0000","last_became_active":"2023-07-20T11:05:41.243088+0000","last_became_peered":"2023-07-20T11:05:41.243088+0000","last_unstale":"2023-07-20T11:05:44.469253+0000","last_undegraded":"2023-07-20T11:05:44.469253+0000","last_fullsized":"2023-07-20T11:05:44.469253+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:18:35.858732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507091+0000","last_change":"2023-07-20T11:05:42.100642+0000","last_active":"2023-07-20T11:05:43.507091+0000","last_peered":"2023-07-20T11:05:43.507091+0000","last_clean":"2023-07-20T11:05:43.507091+0000","last_became_active":"2023-07-20T11:05:42.100355+0000","last_became_peered":"2023-07-20T11:05:42.100355+0000","last_unstale":"2023-07-20T11:05:43.507091+0000","last_undegraded":"2023-07-20T11:05:43.507091+0000","last_fullsized":"2023-07-20T11:05:43.507091+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:09:17.237250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074801+0000","last_change":"2023-07-20T11:05:41.243651+0000","last_active":"2023-07-20T11:05:43.074801+0000","last_peered":"2023-07-20T11:05:43.074801+0000","last_clean":"2023-07-20T11:05:43.074801+0000","last_became_active":"2023-07-20T11:05:41.243148+0000","last_became_peered":"2023-07-20T11:05:41.243148+0000","last_unstale":"2023-07-20T11:05:43.074801+0000","last_undegraded":"2023-07-20T11:05:43.074801+0000","last_fullsized":"2023-07-20T11:05:43.074801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:53:00.421210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074842+0000","last_change":"2023-07-20T11:05:42.088799+0000","last_active":"2023-07-20T11:05:43.074842+0000","last_peered":"2023-07-20T11:05:43.074842+0000","last_clean":"2023-07-20T11:05:43.074842+0000","last_became_active":"2023-07-20T11:05:42.088394+0000","last_became_peered":"2023-07-20T11:05:42.088394+0000","last_unstale":"2023-07-20T11:05:43.074842+0000","last_undegraded":"2023-07-20T11:05:43.074842+0000","last_fullsized":"2023-07-20T11:05:43.074842+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:17:10.470998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469159+0000","last_change":"2023-07-20T11:05:41.243162+0000","last_active":"2023-07-20T11:05:44.469159+0000","last_peered":"2023-07-20T11:05:44.469159+0000","last_clean":"2023-07-20T11:05:44.469159+0000","last_became_active":"2023-07-20T11:05:41.242535+0000","last_became_peered":"2023-07-20T11:05:41.242535+0000","last_unstale":"2023-07-20T11:05:44.469159+0000","last_undegraded":"2023-07-20T11:05:44.469159+0000","last_fullsized":"2023-07-20T11:05:44.469159+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:13:41.458043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506534+0000","last_change":"2023-07-20T11:05:42.093217+0000","last_active":"2023-07-20T11:05:43.506534+0000","last_peered":"2023-07-20T11:05:43.506534+0000","last_clean":"2023-07-20T11:05:43.506534+0000","last_became_active":"2023-07-20T11:05:42.092852+0000","last_became_peered":"2023-07-20T11:05:42.092852+0000","last_unstale":"2023-07-20T11:05:43.506534+0000","last_undegraded":"2023-07-20T11:05:43.506534+0000","last_fullsized":"2023-07-20T11:05:43.506534+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:59:50.054744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075457+0000","last_change":"2023-07-20T11:05:41.245079+0000","last_active":"2023-07-20T11:05:43.075457+0000","last_peered":"2023-07-20T11:05:43.075457+0000","last_clean":"2023-07-20T11:05:43.075457+0000","last_became_active":"2023-07-20T11:05:41.244795+0000","last_became_peered":"2023-07-20T11:05:41.244795+0000","last_unstale":"2023-07-20T11:05:43.075457+0000","last_undegraded":"2023-07-20T11:05:43.075457+0000","last_fullsized":"2023-07-20T11:05:43.075457+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:16:17.117905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506698+0000","last_change":"2023-07-20T11:05:42.101027+0000","last_active":"2023-07-20T11:05:43.506698+0000","last_peered":"2023-07-20T11:05:43.506698+0000","last_clean":"2023-07-20T11:05:43.506698+0000","last_became_active":"2023-07-20T11:05:42.100693+0000","last_became_peered":"2023-07-20T11:05:42.100693+0000","last_unstale":"2023-07-20T11:05:43.506698+0000","last_undegraded":"2023-07-20T11:05:43.506698+0000","last_fullsized":"2023-07-20T11:05:43.506698+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:41:56.868527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470065+0000","last_change":"2023-07-20T11:05:41.243741+0000","last_active":"2023-07-20T11:05:44.470065+0000","last_peered":"2023-07-20T11:05:44.470065+0000","last_clean":"2023-07-20T11:05:44.470065+0000","last_became_active":"2023-07-20T11:05:41.243446+0000","last_became_peered":"2023-07-20T11:05:41.243446+0000","last_unstale":"2023-07-20T11:05:44.470065+0000","last_undegraded":"2023-07-20T11:05:44.470065+0000","last_fullsized":"2023-07-20T11:05:44.470065+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:19:25.690086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075263+0000","last_change":"2023-07-20T11:05:42.099139+0000","last_active":"2023-07-20T11:05:43.075263+0000","last_peered":"2023-07-20T11:05:43.075263+0000","last_clean":"2023-07-20T11:05:43.075263+0000","last_became_active":"2023-07-20T11:05:42.098792+0000","last_became_peered":"2023-07-20T11:05:42.098792+0000","last_unstale":"2023-07-20T11:05:43.075263+0000","last_undegraded":"2023-07-20T11:05:43.075263+0000","last_fullsized":"2023-07-20T11:05:43.075263+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:01:10.630515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469308+0000","last_change":"2023-07-20T11:05:41.243157+0000","last_active":"2023-07-20T11:05:44.469308+0000","last_peered":"2023-07-20T11:05:44.469308+0000","last_clean":"2023-07-20T11:05:44.469308+0000","last_became_active":"2023-07-20T11:05:41.242873+0000","last_became_peered":"2023-07-20T11:05:41.242873+0000","last_unstale":"2023-07-20T11:05:44.469308+0000","last_undegraded":"2023-07-20T11:05:44.469308+0000","last_fullsized":"2023-07-20T11:05:44.469308+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:32:42.441860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469268+0000","last_change":"2023-07-20T11:05:42.079924+0000","last_active":"2023-07-20T11:05:44.469268+0000","last_peered":"2023-07-20T11:05:44.469268+0000","last_clean":"2023-07-20T11:05:44.469268+0000","last_became_active":"2023-07-20T11:05:42.079590+0000","last_became_peered":"2023-07-20T11:05:42.079590+0000","last_unstale":"2023-07-20T11:05:44.469268+0000","last_undegraded":"2023-07-20T11:05:44.469268+0000","last_fullsized":"2023-07-20T11:05:44.469268+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:44:45.637852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968132+0000","last_change":"2023-07-20T11:05:41.246812+0000","last_active":"2023-07-20T11:05:43.968132+0000","last_peered":"2023-07-20T11:05:43.968132+0000","last_clean":"2023-07-20T11:05:43.968132+0000","last_became_active":"2023-07-20T11:05:41.246042+0000","last_became_peered":"2023-07-20T11:05:41.246042+0000","last_unstale":"2023-07-20T11:05:43.968132+0000","last_undegraded":"2023-07-20T11:05:43.968132+0000","last_fullsized":"2023-07-20T11:05:43.968132+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:35:19.137130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074877+0000","last_change":"2023-07-20T11:05:42.094440+0000","last_active":"2023-07-20T11:05:43.074877+0000","last_peered":"2023-07-20T11:05:43.074877+0000","last_clean":"2023-07-20T11:05:43.074877+0000","last_became_active":"2023-07-20T11:05:42.094149+0000","last_became_peered":"2023-07-20T11:05:42.094149+0000","last_unstale":"2023-07-20T11:05:43.074877+0000","last_undegraded":"2023-07-20T11:05:43.074877+0000","last_fullsized":"2023-07-20T11:05:43.074877+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:09.032554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074667+0000","last_change":"2023-07-20T11:05:41.244475+0000","last_active":"2023-07-20T11:05:43.074667+0000","last_peered":"2023-07-20T11:05:43.074667+0000","last_clean":"2023-07-20T11:05:43.074667+0000","last_became_active":"2023-07-20T11:05:41.244096+0000","last_became_peered":"2023-07-20T11:05:41.244096+0000","last_unstale":"2023-07-20T11:05:43.074667+0000","last_undegraded":"2023-07-20T11:05:43.074667+0000","last_fullsized":"2023-07-20T11:05:43.074667+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:19:38.818594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469921+0000","last_change":"2023-07-20T11:05:42.091176+0000","last_active":"2023-07-20T11:05:44.469921+0000","last_peered":"2023-07-20T11:05:44.469921+0000","last_clean":"2023-07-20T11:05:44.469921+0000","last_became_active":"2023-07-20T11:05:42.090892+0000","last_became_peered":"2023-07-20T11:05:42.090892+0000","last_unstale":"2023-07-20T11:05:44.469921+0000","last_undegraded":"2023-07-20T11:05:44.469921+0000","last_fullsized":"2023-07-20T11:05:44.469921+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:36.535936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506624+0000","last_change":"2023-07-20T11:05:41.242840+0000","last_active":"2023-07-20T11:05:43.506624+0000","last_peered":"2023-07-20T11:05:43.506624+0000","last_clean":"2023-07-20T11:05:43.506624+0000","last_became_active":"2023-07-20T11:05:41.242517+0000","last_became_peered":"2023-07-20T11:05:41.242517+0000","last_unstale":"2023-07-20T11:05:43.506624+0000","last_undegraded":"2023-07-20T11:05:43.506624+0000","last_fullsized":"2023-07-20T11:05:43.506624+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:18:43.123728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469098+0000","last_change":"2023-07-20T11:05:42.089272+0000","last_active":"2023-07-20T11:05:44.469098+0000","last_peered":"2023-07-20T11:05:44.469098+0000","last_clean":"2023-07-20T11:05:44.469098+0000","last_became_active":"2023-07-20T11:05:42.088996+0000","last_became_peered":"2023-07-20T11:05:42.088996+0000","last_unstale":"2023-07-20T11:05:44.469098+0000","last_undegraded":"2023-07-20T11:05:44.469098+0000","last_fullsized":"2023-07-20T11:05:44.469098+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:16:54.579922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469651+0000","last_change":"2023-07-20T11:05:41.245733+0000","last_active":"2023-07-20T11:05:44.469651+0000","last_peered":"2023-07-20T11:05:44.469651+0000","last_clean":"2023-07-20T11:05:44.469651+0000","last_became_active":"2023-07-20T11:05:41.245489+0000","last_became_peered":"2023-07-20T11:05:41.245489+0000","last_unstale":"2023-07-20T11:05:44.469651+0000","last_undegraded":"2023-07-20T11:05:44.469651+0000","last_fullsized":"2023-07-20T11:05:44.469651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:37:38.408654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468956+0000","last_change":"2023-07-20T11:05:42.094015+0000","last_active":"2023-07-20T11:05:44.468956+0000","last_peered":"2023-07-20T11:05:44.468956+0000","last_clean":"2023-07-20T11:05:44.468956+0000","last_became_active":"2023-07-20T11:05:42.093750+0000","last_became_peered":"2023-07-20T11:05:42.093750+0000","last_unstale":"2023-07-20T11:05:44.468956+0000","last_undegraded":"2023-07-20T11:05:44.468956+0000","last_fullsized":"2023-07-20T11:05:44.468956+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:52.220152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075554+0000","last_change":"2023-07-20T11:05:41.245894+0000","last_active":"2023-07-20T11:05:43.075554+0000","last_peered":"2023-07-20T11:05:43.075554+0000","last_clean":"2023-07-20T11:05:43.075554+0000","last_became_active":"2023-07-20T11:05:41.245576+0000","last_became_peered":"2023-07-20T11:05:41.245576+0000","last_unstale":"2023-07-20T11:05:43.075554+0000","last_undegraded":"2023-07-20T11:05:43.075554+0000","last_fullsized":"2023-07-20T11:05:43.075554+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:12:21.048503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074776+0000","last_change":"2023-07-20T11:05:42.091961+0000","last_active":"2023-07-20T11:05:43.074776+0000","last_peered":"2023-07-20T11:05:43.074776+0000","last_clean":"2023-07-20T11:05:43.074776+0000","last_became_active":"2023-07-20T11:05:42.091322+0000","last_became_peered":"2023-07-20T11:05:42.091322+0000","last_unstale":"2023-07-20T11:05:43.074776+0000","last_undegraded":"2023-07-20T11:05:43.074776+0000","last_fullsized":"2023-07-20T11:05:43.074776+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:04:53.132594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968360+0000","last_change":"2023-07-20T11:05:41.237859+0000","last_active":"2023-07-20T11:05:43.968360+0000","last_peered":"2023-07-20T11:05:43.968360+0000","last_clean":"2023-07-20T11:05:43.968360+0000","last_became_active":"2023-07-20T11:05:41.237566+0000","last_became_peered":"2023-07-20T11:05:41.237566+0000","last_unstale":"2023-07-20T11:05:43.968360+0000","last_undegraded":"2023-07-20T11:05:43.968360+0000","last_fullsized":"2023-07-20T11:05:43.968360+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:56:23.328595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506467+0000","last_change":"2023-07-20T11:05:42.103757+0000","last_active":"2023-07-20T11:05:43.506467+0000","last_peered":"2023-07-20T11:05:43.506467+0000","last_clean":"2023-07-20T11:05:43.506467+0000","last_became_active":"2023-07-20T11:05:42.103436+0000","last_became_peered":"2023-07-20T11:05:42.103436+0000","last_unstale":"2023-07-20T11:05:43.506467+0000","last_undegraded":"2023-07-20T11:05:43.506467+0000","last_fullsized":"2023-07-20T11:05:43.506467+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:34:47.001913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.968287+0000","last_change":"2023-07-20T11:05:41.242994+0000","last_active":"2023-07-20T11:05:43.968287+0000","last_peered":"2023-07-20T11:05:43.968287+0000","last_clean":"2023-07-20T11:05:43.968287+0000","last_became_active":"2023-07-20T11:05:41.242672+0000","last_became_peered":"2023-07-20T11:05:41.242672+0000","last_unstale":"2023-07-20T11:05:43.968287+0000","last_undegraded":"2023-07-20T11:05:43.968287+0000","last_fullsized":"2023-07-20T11:05:43.968287+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:59.996275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075306+0000","last_change":"2023-07-20T11:05:42.096820+0000","last_active":"2023-07-20T11:05:43.075306+0000","last_peered":"2023-07-20T11:05:43.075306+0000","last_clean":"2023-07-20T11:05:43.075306+0000","last_became_active":"2023-07-20T11:05:42.096533+0000","last_became_peered":"2023-07-20T11:05:42.096533+0000","last_unstale":"2023-07-20T11:05:43.075306+0000","last_undegraded":"2023-07-20T11:05:43.075306+0000","last_fullsized":"2023-07-20T11:05:43.075306+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:48:11.497091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470120+0000","last_change":"2023-07-20T11:05:41.245589+0000","last_active":"2023-07-20T11:05:44.470120+0000","last_peered":"2023-07-20T11:05:44.470120+0000","last_clean":"2023-07-20T11:05:44.470120+0000","last_became_active":"2023-07-20T11:05:41.245054+0000","last_became_peered":"2023-07-20T11:05:41.245054+0000","last_unstale":"2023-07-20T11:05:44.470120+0000","last_undegraded":"2023-07-20T11:05:44.470120+0000","last_fullsized":"2023-07-20T11:05:44.470120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:17.463553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470164+0000","last_change":"2023-07-20T11:05:42.091869+0000","last_active":"2023-07-20T11:05:44.470164+0000","last_peered":"2023-07-20T11:05:44.470164+0000","last_clean":"2023-07-20T11:05:44.470164+0000","last_became_active":"2023-07-20T11:05:42.091610+0000","last_became_peered":"2023-07-20T11:05:42.091610+0000","last_unstale":"2023-07-20T11:05:44.470164+0000","last_undegraded":"2023-07-20T11:05:44.470164+0000","last_fullsized":"2023-07-20T11:05:44.470164+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:13:24.220607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468906+0000","last_change":"2023-07-20T11:05:41.244635+0000","last_active":"2023-07-20T11:05:44.468906+0000","last_peered":"2023-07-20T11:05:44.468906+0000","last_clean":"2023-07-20T11:05:44.468906+0000","last_became_active":"2023-07-20T11:05:41.244366+0000","last_became_peered":"2023-07-20T11:05:41.244366+0000","last_unstale":"2023-07-20T11:05:44.468906+0000","last_undegraded":"2023-07-20T11:05:44.468906+0000","last_fullsized":"2023-07-20T11:05:44.468906+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:19:01.912367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469974+0000","last_change":"2023-07-20T11:05:42.090185+0000","last_active":"2023-07-20T11:05:44.469974+0000","last_peered":"2023-07-20T11:05:44.469974+0000","last_clean":"2023-07-20T11:05:44.469974+0000","last_became_active":"2023-07-20T11:05:42.089902+0000","last_became_peered":"2023-07-20T11:05:42.089902+0000","last_unstale":"2023-07-20T11:05:44.469974+0000","last_undegraded":"2023-07-20T11:05:44.469974+0000","last_fullsized":"2023-07-20T11:05:44.469974+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:12:16.659140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506707+0000","last_change":"2023-07-20T11:05:41.238771+0000","last_active":"2023-07-20T11:05:43.506707+0000","last_peered":"2023-07-20T11:05:43.506707+0000","last_clean":"2023-07-20T11:05:43.506707+0000","last_became_active":"2023-07-20T11:05:41.238497+0000","last_became_peered":"2023-07-20T11:05:41.238497+0000","last_unstale":"2023-07-20T11:05:43.506707+0000","last_undegraded":"2023-07-20T11:05:43.506707+0000","last_fullsized":"2023-07-20T11:05:43.506707+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:01:44.172290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469725+0000","last_change":"2023-07-20T11:05:42.103610+0000","last_active":"2023-07-20T11:05:44.469725+0000","last_peered":"2023-07-20T11:05:44.469725+0000","last_clean":"2023-07-20T11:05:44.469725+0000","last_became_active":"2023-07-20T11:05:42.103342+0000","last_became_peered":"2023-07-20T11:05:42.103342+0000","last_unstale":"2023-07-20T11:05:44.469725+0000","last_undegraded":"2023-07-20T11:05:44.469725+0000","last_fullsized":"2023-07-20T11:05:44.469725+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:20:46.918610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469497+0000","last_change":"2023-07-20T11:05:41.245714+0000","last_active":"2023-07-20T11:05:44.469497+0000","last_peered":"2023-07-20T11:05:44.469497+0000","last_clean":"2023-07-20T11:05:44.469497+0000","last_became_active":"2023-07-20T11:05:41.245371+0000","last_became_peered":"2023-07-20T11:05:41.245371+0000","last_unstale":"2023-07-20T11:05:44.469497+0000","last_undegraded":"2023-07-20T11:05:44.469497+0000","last_fullsized":"2023-07-20T11:05:44.469497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:12.252482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507094+0000","last_change":"2023-07-20T11:05:42.101193+0000","last_active":"2023-07-20T11:05:43.507094+0000","last_peered":"2023-07-20T11:05:43.507094+0000","last_clean":"2023-07-20T11:05:43.507094+0000","last_became_active":"2023-07-20T11:05:42.100896+0000","last_became_peered":"2023-07-20T11:05:42.100896+0000","last_unstale":"2023-07-20T11:05:43.507094+0000","last_undegraded":"2023-07-20T11:05:43.507094+0000","last_fullsized":"2023-07-20T11:05:43.507094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:19:49.695250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469043+0000","last_change":"2023-07-20T11:05:41.243514+0000","last_active":"2023-07-20T11:05:44.469043+0000","last_peered":"2023-07-20T11:05:44.469043+0000","last_clean":"2023-07-20T11:05:44.469043+0000","last_became_active":"2023-07-20T11:05:41.243235+0000","last_became_peered":"2023-07-20T11:05:41.243235+0000","last_unstale":"2023-07-20T11:05:44.469043+0000","last_undegraded":"2023-07-20T11:05:44.469043+0000","last_fullsized":"2023-07-20T11:05:44.469043+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:11:43.464076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075369+0000","last_change":"2023-07-20T11:05:42.083540+0000","last_active":"2023-07-20T11:05:43.075369+0000","last_peered":"2023-07-20T11:05:43.075369+0000","last_clean":"2023-07-20T11:05:43.075369+0000","last_became_active":"2023-07-20T11:05:42.083222+0000","last_became_peered":"2023-07-20T11:05:42.083222+0000","last_unstale":"2023-07-20T11:05:43.075369+0000","last_undegraded":"2023-07-20T11:05:43.075369+0000","last_fullsized":"2023-07-20T11:05:43.075369+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:16:24.470718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506577+0000","last_change":"2023-07-20T11:05:41.246371+0000","last_active":"2023-07-20T11:05:43.506577+0000","last_peered":"2023-07-20T11:05:43.506577+0000","last_clean":"2023-07-20T11:05:43.506577+0000","last_became_active":"2023-07-20T11:05:41.244769+0000","last_became_peered":"2023-07-20T11:05:41.244769+0000","last_unstale":"2023-07-20T11:05:43.506577+0000","last_undegraded":"2023-07-20T11:05:43.506577+0000","last_fullsized":"2023-07-20T11:05:43.506577+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:20:44.306105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'249","reported_seq":910,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506079+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:05:43.506079+0000","last_peered":"2023-07-20T11:05:43.506079+0000","last_clean":"2023-07-20T11:05:43.506079+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:05:43.506079+0000","last_undegraded":"2023-07-20T11:05:43.506079+0000","last_fullsized":"2023-07-20T11:05:43.506079+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:09:48.445365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":317,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.468944+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:05:44.468944+0000","last_peered":"2023-07-20T11:05:44.468944+0000","last_clean":"2023-07-20T11:05:44.468944+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:05:44.468944+0000","last_undegraded":"2023-07-20T11:05:44.468944+0000","last_fullsized":"2023-07-20T11:05:44.468944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:41:47.453887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507150+0000","last_change":"2023-07-20T11:05:42.101744+0000","last_active":"2023-07-20T11:05:43.507150+0000","last_peered":"2023-07-20T11:05:43.507150+0000","last_clean":"2023-07-20T11:05:43.507150+0000","last_became_active":"2023-07-20T11:05:42.101202+0000","last_became_peered":"2023-07-20T11:05:42.101202+0000","last_unstale":"2023-07-20T11:05:43.507150+0000","last_undegraded":"2023-07-20T11:05:43.507150+0000","last_fullsized":"2023-07-20T11:05:43.507150+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:54:03.826186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074777+0000","last_change":"2023-07-20T11:05:41.243591+0000","last_active":"2023-07-20T11:05:43.074777+0000","last_peered":"2023-07-20T11:05:43.074777+0000","last_clean":"2023-07-20T11:05:43.074777+0000","last_became_active":"2023-07-20T11:05:41.243311+0000","last_became_peered":"2023-07-20T11:05:41.243311+0000","last_unstale":"2023-07-20T11:05:43.074777+0000","last_undegraded":"2023-07-20T11:05:43.074777+0000","last_fullsized":"2023-07-20T11:05:43.074777+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:55:00.985488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506324+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:05:43.506324+0000","last_peered":"2023-07-20T11:05:43.506324+0000","last_clean":"2023-07-20T11:05:43.506324+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:05:43.506324+0000","last_undegraded":"2023-07-20T11:05:43.506324+0000","last_fullsized":"2023-07-20T11:05:43.506324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:05:30.342938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470083+0000","last_change":"2023-07-20T11:05:42.096962+0000","last_active":"2023-07-20T11:05:44.470083+0000","last_peered":"2023-07-20T11:05:44.470083+0000","last_clean":"2023-07-20T11:05:44.470083+0000","last_became_active":"2023-07-20T11:05:42.096714+0000","last_became_peered":"2023-07-20T11:05:42.096714+0000","last_unstale":"2023-07-20T11:05:44.470083+0000","last_undegraded":"2023-07-20T11:05:44.470083+0000","last_fullsized":"2023-07-20T11:05:44.470083+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:26.785309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":21,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469615+0000","last_change":"2023-07-20T11:05:41.246598+0000","last_active":"2023-07-20T11:05:44.469615+0000","last_peered":"2023-07-20T11:05:44.469615+0000","last_clean":"2023-07-20T11:05:44.469615+0000","last_became_active":"2023-07-20T11:05:41.246323+0000","last_became_peered":"2023-07-20T11:05:41.246323+0000","last_unstale":"2023-07-20T11:05:44.469615+0000","last_undegraded":"2023-07-20T11:05:44.469615+0000","last_fullsized":"2023-07-20T11:05:44.469615+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:15.860051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":311,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074333+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:05:43.074333+0000","last_peered":"2023-07-20T11:05:43.074333+0000","last_clean":"2023-07-20T11:05:43.074333+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:05:43.074333+0000","last_undegraded":"2023-07-20T11:05:43.074333+0000","last_fullsized":"2023-07-20T11:05:43.074333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:38:47.894119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075437+0000","last_change":"2023-07-20T11:05:42.091831+0000","last_active":"2023-07-20T11:05:43.075437+0000","last_peered":"2023-07-20T11:05:43.075437+0000","last_clean":"2023-07-20T11:05:43.075437+0000","last_became_active":"2023-07-20T11:05:42.091441+0000","last_became_peered":"2023-07-20T11:05:42.091441+0000","last_unstale":"2023-07-20T11:05:43.075437+0000","last_undegraded":"2023-07-20T11:05:43.075437+0000","last_fullsized":"2023-07-20T11:05:43.075437+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:59:21.868365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074500+0000","last_change":"2023-07-20T11:05:41.245070+0000","last_active":"2023-07-20T11:05:43.074500+0000","last_peered":"2023-07-20T11:05:43.074500+0000","last_clean":"2023-07-20T11:05:43.074500+0000","last_became_active":"2023-07-20T11:05:41.244815+0000","last_became_peered":"2023-07-20T11:05:41.244815+0000","last_unstale":"2023-07-20T11:05:43.074500+0000","last_undegraded":"2023-07-20T11:05:43.074500+0000","last_fullsized":"2023-07-20T11:05:43.074500+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:35.859010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":317,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469058+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:05:44.469058+0000","last_peered":"2023-07-20T11:05:44.469058+0000","last_clean":"2023-07-20T11:05:44.469058+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:05:44.469058+0000","last_undegraded":"2023-07-20T11:05:44.469058+0000","last_fullsized":"2023-07-20T11:05:44.469058+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:51:24.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074971+0000","last_change":"2023-07-20T11:05:42.084869+0000","last_active":"2023-07-20T11:05:43.074971+0000","last_peered":"2023-07-20T11:05:43.074971+0000","last_clean":"2023-07-20T11:05:43.074971+0000","last_became_active":"2023-07-20T11:05:42.084583+0000","last_became_peered":"2023-07-20T11:05:42.084583+0000","last_unstale":"2023-07-20T11:05:43.074971+0000","last_undegraded":"2023-07-20T11:05:43.074971+0000","last_fullsized":"2023-07-20T11:05:43.074971+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:00.027852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507018+0000","last_change":"2023-07-20T11:05:41.247028+0000","last_active":"2023-07-20T11:05:43.507018+0000","last_peered":"2023-07-20T11:05:43.507018+0000","last_clean":"2023-07-20T11:05:43.507018+0000","last_became_active":"2023-07-20T11:05:41.246761+0000","last_became_peered":"2023-07-20T11:05:41.246761+0000","last_unstale":"2023-07-20T11:05:43.507018+0000","last_undegraded":"2023-07-20T11:05:43.507018+0000","last_fullsized":"2023-07-20T11:05:43.507018+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:13.182589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":281,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.470184+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:05:44.470184+0000","last_peered":"2023-07-20T11:05:44.470184+0000","last_clean":"2023-07-20T11:05:44.470184+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:05:44.470184+0000","last_undegraded":"2023-07-20T11:05:44.470184+0000","last_fullsized":"2023-07-20T11:05:44.470184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:21:42.399171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075198+0000","last_change":"2023-07-20T11:05:42.092195+0000","last_active":"2023-07-20T11:05:43.075198+0000","last_peered":"2023-07-20T11:05:43.075198+0000","last_clean":"2023-07-20T11:05:43.075198+0000","last_became_active":"2023-07-20T11:05:42.091755+0000","last_became_peered":"2023-07-20T11:05:42.091755+0000","last_unstale":"2023-07-20T11:05:43.075198+0000","last_undegraded":"2023-07-20T11:05:43.075198+0000","last_fullsized":"2023-07-20T11:05:43.075198+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:44:10.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":19,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.506769+0000","last_change":"2023-07-20T11:05:41.242739+0000","last_active":"2023-07-20T11:05:43.506769+0000","last_peered":"2023-07-20T11:05:43.506769+0000","last_clean":"2023-07-20T11:05:43.506769+0000","last_became_active":"2023-07-20T11:05:41.242451+0000","last_became_peered":"2023-07-20T11:05:41.242451+0000","last_unstale":"2023-07-20T11:05:43.506769+0000","last_undegraded":"2023-07-20T11:05:43.506769+0000","last_fullsized":"2023-07-20T11:05:43.506769+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:10:50.848842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":284,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.507151+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:05:43.507151+0000","last_peered":"2023-07-20T11:05:43.507151+0000","last_clean":"2023-07-20T11:05:43.507151+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:05:43.507151+0000","last_undegraded":"2023-07-20T11:05:43.507151+0000","last_fullsized":"2023-07-20T11:05:43.507151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:31.448023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.074251+0000","last_change":"2023-07-20T11:05:42.089639+0000","last_active":"2023-07-20T11:05:43.074251+0000","last_peered":"2023-07-20T11:05:43.074251+0000","last_clean":"2023-07-20T11:05:43.074251+0000","last_became_active":"2023-07-20T11:05:42.089378+0000","last_became_peered":"2023-07-20T11:05:42.089378+0000","last_unstale":"2023-07-20T11:05:43.074251+0000","last_undegraded":"2023-07-20T11:05:43.074251+0000","last_fullsized":"2023-07-20T11:05:43.074251+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:56:32.193649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469037+0000","last_change":"2023-07-20T11:05:41.241181+0000","last_active":"2023-07-20T11:05:44.469037+0000","last_peered":"2023-07-20T11:05:44.469037+0000","last_clean":"2023-07-20T11:05:44.469037+0000","last_became_active":"2023-07-20T11:05:41.240899+0000","last_became_peered":"2023-07-20T11:05:41.240899+0000","last_unstale":"2023-07-20T11:05:44.469037+0000","last_undegraded":"2023-07-20T11:05:44.469037+0000","last_fullsized":"2023-07-20T11:05:44.469037+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:25:05.430433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":279,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469801+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:05:44.469801+0000","last_peered":"2023-07-20T11:05:44.469801+0000","last_clean":"2023-07-20T11:05:44.469801+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:05:44.469801+0000","last_undegraded":"2023-07-20T11:05:44.469801+0000","last_fullsized":"2023-07-20T11:05:44.469801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:20:25.266457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:44.469413+0000","last_change":"2023-07-20T11:05:42.097781+0000","last_active":"2023-07-20T11:05:44.469413+0000","last_peered":"2023-07-20T11:05:44.469413+0000","last_clean":"2023-07-20T11:05:44.469413+0000","last_became_active":"2023-07-20T11:05:42.097494+0000","last_became_peered":"2023-07-20T11:05:42.097494+0000","last_unstale":"2023-07-20T11:05:44.469413+0000","last_undegraded":"2023-07-20T11:05:44.469413+0000","last_fullsized":"2023-07-20T11:05:44.469413+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:41.214341+0000","last_clean_scrub_stamp":"2023-07-20T11:05:41.214341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:02:51.745131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075072+0000","last_change":"2023-07-20T11:05:41.245147+0000","last_active":"2023-07-20T11:05:43.075072+0000","last_peered":"2023-07-20T11:05:43.075072+0000","last_clean":"2023-07-20T11:05:43.075072+0000","last_became_active":"2023-07-20T11:05:41.244866+0000","last_became_peered":"2023-07-20T11:05:41.244866+0000","last_unstale":"2023-07-20T11:05:43.075072+0000","last_undegraded":"2023-07-20T11:05:43.075072+0000","last_fullsized":"2023-07-20T11:05:43.075072+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:05:40.206511+0000","last_clean_scrub_stamp":"2023-07-20T11:05:40.206511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:35.961601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-20T11:05:43.075678+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:05:43.075678+0000","last_peered":"2023-07-20T11:05:43.075678+0000","last_clean":"2023-07-20T11:05:43.075678+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:05:43.075678+0000","last_undegraded":"2023-07-20T11:05:43.075678+0000","last_fullsized":"2023-07-20T11:05:43.075678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:37:28.815119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575749,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47588,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324252,"statfs":{"total":96636764160,"available":96588034048,"internally_reserved":0,"allocated":2576384,"data_stored":1592062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.80900000000000005,"15min":0.78800000000000003},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80400000000000005,"15min":0.77600000000000002},"min":{"1min":0.58199999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.62}]},{"osd":1,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78900000000000003,"15min":0.754},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77100000000000002,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.433},"max":{"1min":2.306,"5min":2.306,"15min":2.306},"last":0.753},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.79100000000000004,"15min":0.76900000000000002},"min":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.49099999999999999},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.59599999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.51700000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81000000000000005,"15min":0.78000000000000003},"min":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.47399999999999998},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.57199999999999995,"15min":0.55400000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.34999999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.54100000000000004,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.625,"15min":0.61899999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.379},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.68999999999999995,"15min":0.67900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.40699999999999997},"max":{"1min":2.0339999999999998,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72999999999999998,"15min":0.70599999999999996},"min":{"1min":0.52500000000000002,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.70899999999999996,"15min":0.68799999999999994},"min":{"1min":0.48299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.878}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41240,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330600,"statfs":{"total":96636764160,"available":96594534400,"internally_reserved":0,"allocated":1974272,"data_stored":1000712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575749,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55184,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316656,"statfs":{"total":96636764160,"available":96580255744,"internally_reserved":0,"allocated":1970176,"data_stored":1000062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.622},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.56000000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.71799999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.443}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.67200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575749,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37140,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334700,"statfs":{"total":96636764160,"available":96598732800,"internally_reserved":0,"allocated":1966080,"data_stored":1000040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.86599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575748,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55196,"kb_used_data":1936,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316644,"statfs":{"total":96636764160,"available":96580243456,"internally_reserved":0,"allocated":1982464,"data_stored":1001674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.374}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.499},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.749},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.83999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575748,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312556,"statfs":{"total":96636764160,"available":96576057344,"internally_reserved":0,"allocated":1974272,"data_stored":1000656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.35699999999999998,"5min":0.32000000000000001,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.34499999999999997,"15min":0.31},"max":{"1min":0.755,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39600000000000002,"5min":0.33800000000000002,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.371},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57299999999999995,"15min":0.57399999999999995},"min":{"1min":0.48299999999999998,"5min":0.40500000000000003,"15min":0.373},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.05},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.58899999999999997},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":1.115},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47299999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.81799999999999995},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0529999999999999,"5min":1.1919999999999999,"15min":1.202},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0149999999999999,"5min":1.093,"15min":1.266},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83799999999999997,"15min":0.82799999999999996},"min":{"1min":0.64200000000000002,"5min":0.61899999999999999,"15min":0.53600000000000003},"max":{"1min":1.099,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.84099999999999997,"15min":0.83299999999999996},"min":{"1min":0.67200000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0609999999999999,"5min":1.3,"15min":1.3},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84999999999999998,"15min":0.83699999999999997},"min":{"1min":0.64600000000000002,"5min":0.59499999999999997,"15min":0.55200000000000005},"max":{"1min":1.0800000000000001,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.86299999999999999,"15min":0.85099999999999998},"min":{"1min":0.64500000000000002,"5min":0.63500000000000001,"15min":0.60599999999999998},"max":{"1min":1.0169999999999999,"5min":1.177,"15min":1.3129999999999999},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82899999999999996,"15min":0.82999999999999996},"min":{"1min":0.70299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.98599999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.871,"15min":0.85599999999999998},"min":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58399999999999996},"max":{"1min":1.0389999999999999,"5min":1.272,"15min":1.272},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575749,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1924,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1970176,"data_stored":1000110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.80700000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575749,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41824,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330016,"statfs":{"total":96636764160,"available":96593936384,"internally_reserved":0,"allocated":2568192,"data_stored":1590464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.626}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:05:51.161 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T11:05:51.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T11:05:51.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 Processor -- start 2023-07-20T11:05:51.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 -- start start 2023-07-20T11:05:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0270159830 0x7f02700cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700cc8d0 con 0x7f02700cc3e0 2023-07-20T11:05:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700ccbb0 con 0x7f0270159450 2023-07-20T11:05:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f0275627640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02700cce90 con 0x7f0270159830 2023-07-20T11:05:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02700cc3e0 0x7f02700afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47488/0 (socket says 172.21.15.82:47488) 2023-07-20T11:05:51.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026f7fe640 1 -- 172.21.15.82:0/233682108 learned_addr learned my addr 172.21.15.82:0/233682108 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f02667fc640 1 --2- 172.21.15.82:0/233682108 >> v2:172.21.15.183:3300/0 conn(0x7f0270159830 0x7f02700cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634782803 0 0) 0x7f02700cc8d0 con 0x7f02700cc3e0 2023-07-20T11:05:51.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f025c003530 con 0x7f02700cc3e0 2023-07-20T11:05:51.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371895425 0 0) 0x7f025c003530 con 0x7f02700cc3e0 2023-07-20T11:05:51.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 >> v2:172.21.15.183:3300/0 conn(0x7f0270159830 msgr2=0x7f02700cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:51.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 --2- 172.21.15.82:0/233682108 >> v2:172.21.15.183:3300/0 conn(0x7f0270159830 0x7f02700cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 >> v1:172.21.15.183:6789/0 conn(0x7f0270159450 legacy=0x7f027015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270159cc0 con 0x7f02700cc3e0 2023-07-20T11:05:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f0268001a00 con 0x7f02700cc3e0 2023-07-20T11:05:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 >> v1:172.21.15.82:6789/0 conn(0x7f02700cc3e0 legacy=0x7f02700afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 0x7f025c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f025c0047d0 0x7f025c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c005190 0x7f025c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700cce90 con 0x7f025c0039f0 2023-07-20T11:05:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c00e2d0 con 0x7f025c005190 2023-07-20T11:05:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c00e490 con 0x7f025c0047d0 2023-07-20T11:05:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026effd640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 0x7f025c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f02667fc640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f025c0047d0 0x7f025c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.359+0000 7f026f7fe640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c005190 0x7f025c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 -- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f025c0047d0 msgr2=0x7f025c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f025c0047d0 0x7f025c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 -- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c005190 msgr2=0x7f025c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c005190 0x7f025c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 -- 172.21.15.82:0/233682108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c003530 con 0x7f025c0039f0 2023-07-20T11:05:51.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026f7fe640 1 -- 172.21.15.82:0/233682108 reap_dead start 2023-07-20T11:05:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026effd640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 0x7f025c003e10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f0260001780 tx=0x7f026001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c9e8e8948d0627 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600052d0 con 0x7f025c0039f0 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02600a7050 con 0x7f025c0039f0 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f026e7fc640 1 -- 172.21.15.82:0/233682108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260003600 con 0x7f025c0039f0 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 -- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 msgr2=0x7f025c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 0x7f025c003e10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f0260001780 tx=0x7f026001c3b0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 -- 172.21.15.82:0/233682108 shutdown_connections 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 --2- 172.21.15.82:0/233682108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025c0039f0 0x7f025c003e10 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 -- 172.21.15.82:0/233682108 >> 172.21.15.82:0/233682108 conn(0x7f02700cad50 msgr2=0x7f02700cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 -- 172.21.15.82:0/233682108 shutdown_connections 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.363+0000 7f0275627640 1 -- 172.21.15.82:0/233682108 wait complete. 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 Processor -- start 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 -- start start 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 0x7f02701549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02700b1c40 0x7f02700c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b2600 con 0x7f02700b17c0 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b28e0 con 0x7f025c0039f0 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0275627640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b2bc0 con 0x7f02700b1c40 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35384/0 (socket says 172.21.15.82:35384) 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 -- 172.21.15.82:0/4284968427 learned_addr learned my addr 172.21.15.82:0/4284968427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f026f7fe640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02700b1c40 0x7f02700c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f026effd640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 0x7f02701549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 -- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02700b1c40 msgr2=0x7f02700c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02700b1c40 0x7f02700c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 -- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 msgr2=0x7f02701549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 0x7f02701549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 -- 172.21.15.82:0/4284968427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700c2530 con 0x7f02700b17c0 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f026effd640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 0x7f02701549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f02667fc640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f0258011900 tx=0x7f0258011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.367+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02580095b0 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258004240 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800f820 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02700c21e0 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02700ab890 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700c26c0 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f025800f980 con 0x7f02700b17c0 2023-07-20T11:05:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0267fff640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 0x7f0250068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f0258084430 con 0x7f02700b17c0 2023-07-20T11:05:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.371+0000 7f026effd640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 0x7f0250068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.375+0000 7f026effd640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 0x7f0250068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0260001750 tx=0x7f02600011a0 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.375+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0258055140 con 0x7f02700b17c0 2023-07-20T11:05:51.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.575+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f027004da30 con 0x7f02700b17c0 2023-07-20T11:05:51.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.579+0000 7f0267fff640 1 -- 172.21.15.82:0/4284968427 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v40) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0258006c40 con 0x7f02700b17c0 2023-07-20T11:05:51.561 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T11:05:51.562 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T11:05:51.562 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T11:05:51.562 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T11:05:51.562 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T11:05:51.562 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T11:05:51.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 msgr2=0x7f0250068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 0x7f0250068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0260001750 tx=0x7f02600011a0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 msgr2=0x7f02700c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f0258011900 tx=0x7f0258011d00 comp rx=0 tx=0).stop 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 shutdown_connections 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f02500663a0 0x7f0250068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02700b1c40 0x7f02700c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02700b17c0 0x7f02700c73b0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 --2- 172.21.15.82:0/4284968427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f025c0039f0 0x7f02701549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 >> 172.21.15.82:0/4284968427 conn(0x7f02700cad50 msgr2=0x7f02700714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:51.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 shutdown_connections 2023-07-20T11:05:51.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.583+0000 7f0275627640 1 -- 172.21.15.82:0/4284968427 wait complete. 2023-07-20T11:05:51.582 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:05:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 Processor -- start 2023-07-20T11:05:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 -- start start 2023-07-20T11:05:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f815015c590 0x7f81500cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81500cf880 con 0x7f81500d0d00 2023-07-20T11:05:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81500cd2a0 con 0x7f815015c590 2023-07-20T11:05:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f815526a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81500b4f50 con 0x7f81500cd730 2023-07-20T11:05:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.739+0000 7f814effd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f815015c590 0x7f81500cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56456/0 (socket says 172.21.15.82:56456) 2023-07-20T11:05:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814f7fe640 1 -- 172.21.15.82:0/1468562363 learned_addr learned my addr 172.21.15.82:0/1468562363 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814dffb640 1 -- 172.21.15.82:0/1468562363 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360741986 0 0) 0x7f81500cf880 con 0x7f81500d0d00 2023-07-20T11:05:51.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814dffb640 1 -- 172.21.15.82:0/1468562363 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8138003530 con 0x7f81500d0d00 2023-07-20T11:05:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814effd640 1 -- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 msgr2=0x7f81500cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814effd640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814effd640 1 -- 172.21.15.82:0/1468562363 >> v1:172.21.15.183:6789/0 conn(0x7f81500d0d00 legacy=0x7f81500b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814effd640 1 -- 172.21.15.82:0/1468562363 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81500cfab0 con 0x7f815015c590 2023-07-20T11:05:51.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814f7fe640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:05:51.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814effd640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500cf340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8140009d90 tx=0x7f814001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736634212839b327 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814dffb640 1 -- 172.21.15.82:0/1468562363 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400a59e0 con 0x7f815015c590 2023-07-20T11:05:51.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814dffb640 1 -- 172.21.15.82:0/1468562363 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81400a5b40 con 0x7f815015c590 2023-07-20T11:05:51.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.743+0000 7f814dffb640 1 -- 172.21.15.82:0/1468562363 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400ad440 con 0x7f815015c590 2023-07-20T11:05:51.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 msgr2=0x7f81500cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500cf340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8140009d90 tx=0x7f814001c920 comp rx=0 tx=0).stop 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- 172.21.15.82:0/1468562363 shutdown_connections 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500cd730 0x7f81500cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- 172.21.15.82:0/1468562363 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500cf340 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- 172.21.15.82:0/1468562363 >> 172.21.15.82:0/1468562363 conn(0x7f81500654e0 msgr2=0x7f81500658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- 172.21.15.82:0/1468562363 shutdown_connections 2023-07-20T11:05:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- 172.21.15.82:0/1468562363 wait complete. 2023-07-20T11:05:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 Processor -- start 2023-07-20T11:05:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- start start 2023-07-20T11:05:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500d0d00 0x7f81500c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500ca7b0 con 0x7f81500cd730 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81500c8800 con 0x7f815015c590 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f815526a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81500c8ae0 con 0x7f81500d0d00 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f814effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f814effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35396/0 (socket says 172.21.15.82:35396) 2023-07-20T11:05:51.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f814effd640 1 -- 172.21.15.82:0/4132794507 learned_addr learned my addr 172.21.15.82:0/4132794507 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.747+0000 7f814e7fc640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500d0d00 0x7f81500c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814f7fe640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 -- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500d0d00 msgr2=0x7f81500c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500d0d00 0x7f81500c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 -- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 msgr2=0x7f81500c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 -- 172.21.15.82:0/4132794507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81480094d0 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f814effd640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f814001a550 tx=0x7f81400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400add00 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81400ade60 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8140009a70 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81400b7630 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81500c90a0 con 0x7f81500cd730 2023-07-20T11:05:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815004da30 con 0x7f81500cd730 2023-07-20T11:05:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81400b4050 con 0x7f81500cd730 2023-07-20T11:05:51.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 0x7f813c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.751+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f814011ee90 con 0x7f81500cd730 2023-07-20T11:05:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.755+0000 7f814e7fc640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 0x7f813c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.755+0000 7f814e7fc640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 0x7f813c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81500b4530 tx=0x7f8144009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:51.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.755+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81400ec260 con 0x7f81500cd730 2023-07-20T11:05:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81500b3220 con 0x7f81500cd730 2023-07-20T11:05:51.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f81377fe640 1 -- 172.21.15.82:0/4132794507 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f81400b2020 con 0x7f81500cd730 2023-07-20T11:05:51.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:05:51.917 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:05:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:05:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 msgr2=0x7f813c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 0x7f813c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81500b4530 tx=0x7f8144009040 comp rx=0 tx=0).stop 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 msgr2=0x7f81500c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f814001a550 tx=0x7f81400196c0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 shutdown_connections 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f813c0663a0 0x7f813c068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f815015c590 0x7f81500c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81500d0d00 0x7f81500c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 --2- 172.21.15.82:0/4132794507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81500cd730 0x7f81500c7fd0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 >> 172.21.15.82:0/4132794507 conn(0x7f81500654e0 msgr2=0x7f81500b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 shutdown_connections 2023-07-20T11:05:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:51.935+0000 7f815526a640 1 -- 172.21.15.82:0/4132794507 wait complete. 2023-07-20T11:05:52.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T11:05:41.606881+0000', 'modified': '2023-07-20T11:05:45.247381+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9579}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9579': {'gid': 9579, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2913878511', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 2913878511}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2913878511}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T11:05:52.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T11:05:52.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T11:05:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.499+0000 7f2325167640 1 Processor -- start 2023-07-20T11:05:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.499+0000 7f2325167640 1 -- start start 2023-07-20T11:05:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f2325167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 0x7f23200ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f2325167640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200b2060 0x7f23200b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f2325167640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200b06c0 con 0x7f23200afda0 2023-07-20T11:05:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f2325167640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200b3160 con 0x7f23200b2060 2023-07-20T11:05:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f2325167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200b12a0 con 0x7f232015a8e0 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200b2060 0x7f23200b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231ed9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f23200afda0 0x7f23200b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47500/0 (socket says 172.21.15.82:47500) 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231ed9d640 1 -- 172.21.15.82:0/3217891920 learned_addr learned my addr 172.21.15.82:0/3217891920 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f23200b2060 0x7f23200b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35400/0 (socket says 172.21.15.82:35400) 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231659c640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 0x7f23200ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 -- 172.21.15.82:0/3217891920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 msgr2=0x7f23200ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 0x7f23200ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 -- 172.21.15.82:0/3217891920 >> v1:172.21.15.82:6789/0 conn(0x7f23200afda0 legacy=0x7f23200b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 -- 172.21.15.82:0/3217891920 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200b1580 con 0x7f23200b2060 2023-07-20T11:05:52.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231e59c640 1 -- 172.21.15.82:0/3217891920 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370177920 0 0) 0x7f23200b06c0 con 0x7f23200afda0 2023-07-20T11:05:52.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231659c640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 0x7f23200ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:52.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.503+0000 7f231f59e640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f23200b0180 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35da12ab2897a0f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f231e59c640 1 -- 172.21.15.82:0/3217891920 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a58c0 con 0x7f23200b2060 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f231e59c640 1 -- 172.21.15.82:0/3217891920 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180a5a20 con 0x7f23200b2060 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f231e59c640 1 -- 172.21.15.82:0/3217891920 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5db0 con 0x7f23200b2060 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- 172.21.15.82:0/3217891920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 msgr2=0x7f23200b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f23200b0180 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f231801c800 comp rx=0 tx=0).stop 2023-07-20T11:05:52.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- 172.21.15.82:0/3217891920 shutdown_connections 2023-07-20T11:05:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f23200b0180 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- 172.21.15.82:0/3217891920 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f232015a8e0 0x7f23200ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- 172.21.15.82:0/3217891920 >> 172.21.15.82:0/3217891920 conn(0x7f23200cada0 msgr2=0x7f23200cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- 172.21.15.82:0/3217891920 shutdown_connections 2023-07-20T11:05:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- 172.21.15.82:0/3217891920 wait complete. 2023-07-20T11:05:52.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 Processor -- start 2023-07-20T11:05:52.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- start start 2023-07-20T11:05:52.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200afda0 0x7f23200ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015a8e0 0x7f2320152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200ab030 con 0x7f23200b2060 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200ab310 con 0x7f232015a8e0 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.507+0000 7f2325167640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200ab5f0 con 0x7f23200afda0 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35416/0 (socket says 172.21.15.82:35416) 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 -- 172.21.15.82:0/1575347024 learned_addr learned my addr 172.21.15.82:0/1575347024 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231f59e640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015a8e0 0x7f2320152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200afda0 0x7f23200ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 -- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200afda0 msgr2=0x7f23200ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200afda0 0x7f23200ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 -- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015a8e0 msgr2=0x7f2320152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015a8e0 0x7f2320152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 -- 172.21.15.82:0/1575347024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318009a70 con 0x7f23200b2060 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f231659c640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f230800c7f0 tx=0x7f230800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.494 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f2317fff640 1 -- 172.21.15.82:0/1575347024 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308007820 con 0x7f23200b2060 2023-07-20T11:05:52.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f2317fff640 1 -- 172.21.15.82:0/1575347024 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308007980 con 0x7f23200b2060 2023-07-20T11:05:52.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f2317fff640 1 -- 172.21.15.82:0/1575347024 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308007d30 con 0x7f23200b2060 2023-07-20T11:05:52.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200ab8d0 con 0x7f23200b2060 2023-07-20T11:05:52.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.511+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200cd450 con 0x7f23200b2060 2023-07-20T11:05:52.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f2317fff640 1 -- 172.21.15.82:0/1575347024 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23080113f0 con 0x7f23200b2060 2023-07-20T11:05:52.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f2317fff640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 0x7f2304068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f2317fff640 1 -- 172.21.15.82:0/1575347024 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f23080842b0 con 0x7f23200b2060 2023-07-20T11:05:52.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 0x7f2304068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 Processor -- start 2023-07-20T11:05:52.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 -- start start 2023-07-20T11:05:52.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 0x7f2304068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f70 tx=0x7f2310007b60 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973c3ad20 0x55a973c3b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973bf0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973ab80a0 con 0x55a973bf0e90 2023-07-20T11:05:52.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973a46e40 con 0x55a973c3b640 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a973a44370 con 0x55a973c3ad20 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35424/0 (socket says 172.21.15.82:35424) 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 -- 172.21.15.82:0/3615197702 learned_addr learned my addr 172.21.15.82:0/3615197702 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231ed9d640 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973c3ad20 0x55a973c3b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231659c640 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973bf0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 -- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973c3ad20 msgr2=0x55a973c3b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973c3ad20 0x55a973c3b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 -- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 msgr2=0x55a973bf0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973bf0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 -- 172.21.15.82:0/3615197702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a97373b890 con 0x55a973bf0e90 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.515+0000 7f231f59e640 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f2318004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84684e45a67285b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f2314d99640 1 -- 172.21.15.82:0/3615197702 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180a5e10 con 0x55a973bf0e90 2023-07-20T11:05:52.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f2314d99640 1 -- 172.21.15.82:0/3615197702 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180ad440 con 0x55a973bf0e90 2023-07-20T11:05:52.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f2314d99640 1 -- 172.21.15.82:0/3615197702 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180ad7d0 con 0x55a973bf0e90 2023-07-20T11:05:52.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- 172.21.15.82:0/3615197702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 msgr2=0x55a973bf1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f2318009d90 tx=0x7f2318004ac0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- 172.21.15.82:0/3615197702 shutdown_connections 2023-07-20T11:05:52.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973bf0e90 0x55a973bf1270 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973bf0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- 172.21.15.82:0/3615197702 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973c3ad20 0x55a973c3b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- 172.21.15.82:0/3615197702 >> 172.21.15.82:0/3615197702 conn(0x55a973be8200 msgr2=0x55a973bef230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- 172.21.15.82:0/3615197702 shutdown_connections 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- 172.21.15.82:0/3615197702 wait complete. 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- start start 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 Processor -- start 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973bfbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973bfc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973a3fc60 con 0x55a973c3b640 2023-07-20T11:05:52.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9739fbae0 con 0x55a973c3ad20 2023-07-20T11:05:52.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9739fb780 con 0x55a973bf0e90 2023-07-20T11:05:52.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f23284d5000 10 client.0 _ll_register_callbacks cb 0x55a973bdc820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35438/0 (socket says 172.21.15.82:35438) 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 -- 172.21.15.82:0/229340892 learned_addr learned my addr 172.21.15.82:0/229340892 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231659c640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973bfc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 -- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 msgr2=0x55a973bfbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231ed9d640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973bfbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973bfbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 -- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 msgr2=0x55a973bfc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973bfc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 -- 172.21.15.82:0/229340892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200b1580 con 0x55a973c3b640 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231ed9d640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973bfbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:05:52.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f231f59e640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f231801aeb0 tx=0x7f231801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01fd388b274c0ce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.519+0000 7f230dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318003d20 con 0x55a973c3b640 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9739fffb0 con 0x55a973c3b640 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f2318004040 con 0x55a973c3b640 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2318003e80 con 0x55a973c3b640 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 10 client.9771 fetch_fsmap learned FSMap version 74 2023-07-20T11:05:52.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a973a03d10 con 0x55a973c3b640 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9739fffb0 con 0x55a973c3b640 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 74) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2318004200 con 0x55a973c3b640 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 10 client.9771 fetch_fsmap finished waiting for FSMap version 74 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 10 client.9771 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 20 client.9771 populate_metadata read hostname 'smithi082' 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973bfd210 0x55a973c4c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 4 client.9771 mds_command: new command op to 9579 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T11:05:52.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 --> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a973a6e410 con 0x55a973bfd210 2023-07-20T11:05:52.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f231ed9d640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973bfd210 0x55a973c4c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 10 client.9771 ms_handle_connect on v2:172.21.15.82:6835/2913878511 2023-07-20T11:05:52.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f231ed9d640 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973bfd210 0x55a973c4c290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=524c281f428d129f server_cookie=ac06fa22cc06b31e in_seq=0 out_seq=0 2023-07-20T11:05:52.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 1 -- 172.21.15.82:0/229340892 <== mds.0 v2:172.21.15.82:6835/2913878511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55a973a6e410 con 0x55a973bfd210 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 10 client.9771 handle_command_reply: tid=0 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 client.9771 shutdown 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 msgr2=0x55a973bfc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f231801aeb0 tx=0x7f231801b040 comp rx=0 tx=0).stop 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 shutdown_connections 2023-07-20T11:05:52.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973bfd210 0x55a973c4c290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973bfc940 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973bfc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 --2- 172.21.15.82:0/229340892 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973bfbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f230dffb640 0 client.9771 ms_handle_reset on v2:172.21.15.82:6835/2913878511 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 >> 172.21.15.82:0/229340892 conn(0x55a973be8200 msgr2=0x55a973bef230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 shutdown_connections 2023-07-20T11:05:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 1 -- 172.21.15.82:0/229340892 wait complete. 2023-07-20T11:05:52.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.523+0000 7f23284d5000 20 client.9771 trim_cache size 0 max 16384 2023-07-20T11:05:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 Processor -- start 2023-07-20T11:05:52.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 -- start start 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973c94630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9736fc940 con 0x55a973c3b640 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973bfc140 con 0x55a973c3ad20 2023-07-20T11:05:52.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a973a43c60 con 0x55a973bf0e90 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35442/0 (socket says 172.21.15.82:35442) 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 -- 172.21.15.82:0/3943963238 learned_addr learned my addr 172.21.15.82:0/3943963238 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231659c640 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973c94630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231ed9d640 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 -- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 msgr2=0x55a973c940f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c940f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 -- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 msgr2=0x55a973c94630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973c94630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 -- 172.21.15.82:0/3943963238 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9739e9fa0 con 0x55a973c3b640 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231f59e640 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f2318000f90 tx=0x7f23180c4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f302189ad1363935 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231559a640 1 -- 172.21.15.82:0/3943963238 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318004710 con 0x55a973c3b640 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231559a640 1 -- 172.21.15.82:0/3943963238 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23180ad440 con 0x55a973c3b640 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.539+0000 7f231559a640 1 -- 172.21.15.82:0/3943963238 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180ad930 con 0x55a973c3b640 2023-07-20T11:05:52.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/3943963238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 msgr2=0x55a973c94b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f2318000f90 tx=0x7f23180c4040 comp rx=0 tx=0).stop 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/3943963238 shutdown_connections 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3b640 0x55a973c94b70 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3ad20 0x55a973c94630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- 172.21.15.82:0/3943963238 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c940f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/3943963238 >> 172.21.15.82:0/3943963238 conn(0x55a973be8200 msgr2=0x55a973bf5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/3943963238 shutdown_connections 2023-07-20T11:05:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/3943963238 wait complete. 2023-07-20T11:05:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- start start 2023-07-20T11:05:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 Processor -- start 2023-07-20T11:05:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c4c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973c4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a973a00ad0 con 0x55a973c3ad20 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9736fc940 con 0x55a973c3b640 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a973a34290 con 0x55a973bf0e90 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 10 client.0 _ll_register_callbacks cb 0x55a973ab7ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35452/0 (socket says 172.21.15.82:35452) 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 -- 172.21.15.82:0/1900779145 learned_addr learned my addr 172.21.15.82:0/1900779145 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c4c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231f59e640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973c4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 -- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 msgr2=0x55a973c4c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c4c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 -- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 msgr2=0x55a973c4cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973c4cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 -- 172.21.15.82:0/1900779145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a973a03d10 con 0x55a973c3ad20 2023-07-20T11:05:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f231659c640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f2308007410 tx=0x7f23080590a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa679881653d354 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:05:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308051180 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f23080512e0 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a973bf0d20 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23080730a0 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 10 client.9777 fetch_fsmap learned FSMap version 74 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a97373bcc0 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a973bf0d20 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 74) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f230806cab0 con 0x55a973c3ad20 2023-07-20T11:05:52.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 10 client.9777 fetch_fsmap finished waiting for FSMap version 74 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 10 client.9777 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 20 client.9777 populate_metadata read hostname 'smithi082' 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973c4d510 0x55a973c4d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 4 client.9777 mds_command: new command op to 9579 tid=0[{"prefix": "status"}] 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.543+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 --> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a973a06a20 con 0x55a973c4d510 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973c4d510 0x55a973c4d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f231ed9d640 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973c4d510 0x55a973c4d8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eba63c7b2f043068 server_cookie=857d7e82ce05adb1 in_seq=0 out_seq=0 2023-07-20T11:05:52.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f230dffb640 10 client.9777 ms_handle_connect on v2:172.21.15.82:6835/2913878511 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f230dffb640 1 -- 172.21.15.82:0/1900779145 <== mds.0 v2:172.21.15.82:6835/2913878511 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55a973a06a20 con 0x55a973c4d510 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f230dffb640 10 client.9777 handle_command_reply: tid=0 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 client.9777 shutdown 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 msgr2=0x55a973c4ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f2308007410 tx=0x7f23080590a0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 shutdown_connections 2023-07-20T11:05:52.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:6835/2913878511,v1:172.21.15.82:6837/2913878511] conn(0x55a973c4d510 0x55a973c4d8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a973c3b640 0x55a973c4cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a973c3ad20 0x55a973c4ca90 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f230dffb640 0 client.9777 ms_handle_reset on v2:172.21.15.82:6835/2913878511 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 --2- 172.21.15.82:0/1900779145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55a973bf0e90 0x55a973c4c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 >> 172.21.15.82:0/1900779145 conn(0x55a973be8200 msgr2=0x55a973c397d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 shutdown_connections 2023-07-20T11:05:52.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 1 -- 172.21.15.82:0/1900779145 wait complete. 2023-07-20T11:05:52.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f23284d5000 20 client.9777 trim_cache size 0 max 16384 2023-07-20T11:05:52.538 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:05:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T11:05:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T11:05:52.538 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 9579, 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.323754466, 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 74, 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 158, 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 158, 2023-07-20T11:05:52.539 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.287118731 2023-07-20T11:05:52.540 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:05:52.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 msgr2=0x7f2304068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 0x7f2304068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2310000f70 tx=0x7f2310007b60 comp rx=0 tx=0).stop 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 msgr2=0x7f2320152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f230800c7f0 tx=0x7f230800ccb0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 shutdown_connections 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f23040663d0 0x7f2304068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f232015a8e0 0x7f2320152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23200b2060 0x7f2320152670 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 --2- 172.21.15.82:0/1575347024 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f23200afda0 0x7f23200ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 >> 172.21.15.82:0/1575347024 conn(0x7f23200cada0 msgr2=0x7f2320071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 shutdown_connections 2023-07-20T11:05:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.547+0000 7f2325167640 1 -- 172.21.15.82:0/1575347024 wait complete. 2023-07-20T11:05:52.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T11:05:52.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.703+0000 7fc52b552640 1 Processor -- start 2023-07-20T11:05:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.703+0000 7fc52b552640 1 -- start start 2023-07-20T11:05:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc52b552640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc5240ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc52b552640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc5240b2060 0x7fc5240b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc52b552640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240b06c0 con 0x7fc52415a8e0 2023-07-20T11:05:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc52b552640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240b3160 con 0x7fc5240b2060 2023-07-20T11:05:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc52b552640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240b12a0 con 0x7fc5240afda0 2023-07-20T11:05:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc528aed640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc52415a8e0 0x7fc5240b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47510/0 (socket says 172.21.15.82:47510) 2023-07-20T11:05:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc528aed640 1 -- 172.21.15.82:0/322650848 learned_addr learned my addr 172.21.15.82:0/322650848 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc529aef640 1 --2- 172.21.15.82:0/322650848 >> v2:172.21.15.82:3300/0 conn(0x7fc5240b2060 0x7fc5240b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc5292ee640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc5240ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc51bfff640 1 -- 172.21.15.82:0/322650848 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133900869 0 0) 0x7fc5240b06c0 con 0x7fc52415a8e0 2023-07-20T11:05:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc529aef640 1 -- 172.21.15.82:0/322650848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 msgr2=0x7fc5240ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc529aef640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc5240ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc529aef640 1 -- 172.21.15.82:0/322650848 >> v1:172.21.15.82:6789/0 conn(0x7fc52415a8e0 legacy=0x7fc5240b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.707+0000 7fc529aef640 1 -- 172.21.15.82:0/322650848 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240b1580 con 0x7fc5240b2060 2023-07-20T11:05:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc529aef640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240b0180 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009d90 tx=0x7fc51c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14df01e1266d0519 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc51bfff640 1 -- 172.21.15.82:0/322650848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0a58c0 con 0x7fc5240b2060 2023-07-20T11:05:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc51bfff640 1 -- 172.21.15.82:0/322650848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c0a5a20 con 0x7fc5240b2060 2023-07-20T11:05:52.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc51bfff640 1 -- 172.21.15.82:0/322650848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c0a5db0 con 0x7fc5240b2060 2023-07-20T11:05:52.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- 172.21.15.82:0/322650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 msgr2=0x7fc5240b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240b0180 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009d90 tx=0x7fc51c01c800 comp rx=0 tx=0).stop 2023-07-20T11:05:52.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- 172.21.15.82:0/322650848 shutdown_connections 2023-07-20T11:05:52.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240b0180 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 --2- 172.21.15.82:0/322650848 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc5240ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- 172.21.15.82:0/322650848 >> 172.21.15.82:0/322650848 conn(0x7fc5240cada0 msgr2=0x7fc5240cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- 172.21.15.82:0/322650848 shutdown_connections 2023-07-20T11:05:52.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- 172.21.15.82:0/322650848 wait complete. 2023-07-20T11:05:52.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 Processor -- start 2023-07-20T11:05:52.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.711+0000 7fc52b552640 1 -- start start 2023-07-20T11:05:52.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc524151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 0x7fc5241594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52415b720 con 0x7fc5240b2060 2023-07-20T11:05:52.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240c4c30 con 0x7fc52415a8e0 2023-07-20T11:05:52.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52415ad80 con 0x7fc5240afda0 2023-07-20T11:05:52.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35474/0 (socket says 172.21.15.82:35474) 2023-07-20T11:05:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 -- 172.21.15.82:0/2735502337 learned_addr learned my addr 172.21.15.82:0/2735502337 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc5292ee640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc524151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc529aef640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 0x7fc5241594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 -- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 msgr2=0x7fc524151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc524151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 -- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 msgr2=0x7fc5241594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 0x7fc5241594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 -- 172.21.15.82:0/2735502337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c009a70 con 0x7fc5240b2060 2023-07-20T11:05:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc529aef640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 0x7fc5241594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:52.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc528aed640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c480 tx=0x7fc51400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5140074e0 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514007660 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514004a30 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52415b060 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc524151e80 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc524073c70 con 0x7fc5240b2060 2023-07-20T11:05:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.715+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc514004b90 con 0x7fc5240b2060 2023-07-20T11:05:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.719+0000 7fc519ffb640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 0x7fc508068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.719+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fc514082ff0 con 0x7fc5240b2060 2023-07-20T11:05:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.719+0000 7fc5292ee640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 0x7fc508068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.719+0000 7fc5292ee640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 0x7fc508068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc520007a60 tx=0x7fc520008040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.723+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc514053e40 con 0x7fc5240b2060 2023-07-20T11:05:52.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.903+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5240c9ac0 con 0x7fc5240b2060 2023-07-20T11:05:52.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.903+0000 7fc519ffb640 1 -- 172.21.15.82:0/2735502337 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc514018020 con 0x7fc5240b2060 2023-07-20T11:05:52.885 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T11:05:52.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 msgr2=0x7fc508068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 0x7fc508068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc520007a60 tx=0x7fc520008040 comp rx=0 tx=0).stop 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 msgr2=0x7fc5240c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc51400c480 tx=0x7fc51400c940 comp rx=0 tx=0).stop 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 shutdown_connections 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fc5080663a0 0x7fc508068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc52415a8e0 0x7fc5241594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5240b2060 0x7fc5240c41e0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 --2- 172.21.15.82:0/2735502337 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc5240afda0 0x7fc524151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:52.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 >> 172.21.15.82:0/2735502337 conn(0x7fc5240cada0 msgr2=0x7fc5240700c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:52.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 shutdown_connections 2023-07-20T11:05:52.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:52.907+0000 7fc52b552640 1 -- 172.21.15.82:0/2735502337 wait complete. 2023-07-20T11:05:52.907 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T11:05:52.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T11:05:52.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T11:05:52.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T11:05:52.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T11:05:52.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T11:05:52.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T11:05:52.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T11:05:52.910 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:05:52.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:52.911 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T11:05:52.921 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.922 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:05:52.923 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.923 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T11:05:52.923 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:05:52.923 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.923 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T11:05:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:05:52.924 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.924 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T11:05:52.924 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.924 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 37848sec preferred_lft 37848sec 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T11:05:52.925 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.926 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:05:52.927 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T11:05:52.927 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T11:05:52.927 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.928 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:05:52.928 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T11:05:52.928 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T11:05:52.928 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:05:52.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:52.929 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T11:05:52.982 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T11:05:52.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:52.984 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T11:05:53.038 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T11:05:53.038 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T11:05:53.038 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T11:05:53.039 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T11:05:53.039 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T11:05:53.039 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T11:05:53.039 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:05:53.040 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:05:53.040 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:05:53.040 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T11:05:53.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.041 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T11:05:53.041 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T11:05:53.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T11:05:53.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T11:05:53.042 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T11:05:53.043 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T11:05:53.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.132 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:05:53.142 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T11:05:53.142 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T11:05:53.143 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:05:53.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T11:05:53.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:05:53.212 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T11:05:53.264 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:05:53.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:05:53.265 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:05:53.315 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T11:05:53.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:05:53.409 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:05:53.410 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:05:53.410 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:05:53.425 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:05:53.425 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:05:53.425 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:05:53.426 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:05:53.426 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:05:53.434 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:05:53.434 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T11:05:53.435 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T11:05:53.439 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T11:05:53.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:05:53.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:53.461 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T11:05:53.519 INFO:teuthology.orchestra.run.smithi082.stdout:client8911 2023-07-20T11:05:53.519 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:05:53.520 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:05:53.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T11:05:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 Processor -- start 2023-07-20T11:05:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 -- start start 2023-07-20T11:05:53.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85a0160fa0 0x7f85a00c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a00c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00cc560 con 0x7f85a0160bc0 2023-07-20T11:05:53.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a00ad7e0 con 0x7f85a0160fa0 2023-07-20T11:05:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a75e8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00cc790 con 0x7f85a00cd830 2023-07-20T11:05:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85a0160fa0 0x7f85a00c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f85a0160fa0 0x7f85a00c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50540/0 (socket says 172.21.15.82:50540) 2023-07-20T11:05:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 -- 172.21.15.82:0/820169838 learned_addr learned my addr 172.21.15.82:0/820169838 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:53.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a5b85640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a00c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 -- 172.21.15.82:0/820169838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 msgr2=0x7f85a00c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a00c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 -- 172.21.15.82:0/820169838 >> v1:172.21.15.183:6789/0 conn(0x7f85a0160bc0 legacy=0x7f85a006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.771+0000 7f85a4b83640 1 -- 172.21.15.82:0/820169838 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00cca70 con 0x7f85a0160fa0 2023-07-20T11:05:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a4b83640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160fa0 0x7f85a00c12f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f8590009870 tx=0x7f859001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790d4db24c9c9183 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f8597fff640 1 -- 172.21.15.82:0/820169838 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900aa670 con 0x7f85a0160fa0 2023-07-20T11:05:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f8597fff640 1 -- 172.21.15.82:0/820169838 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900aa7d0 con 0x7f85a0160fa0 2023-07-20T11:05:53.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f8597fff640 1 -- 172.21.15.82:0/820169838 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900aab60 con 0x7f85a0160fa0 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 -- 172.21.15.82:0/820169838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160fa0 msgr2=0x7f85a00c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160fa0 0x7f85a00c12f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f8590009870 tx=0x7f859001c510 comp rx=0 tx=0).stop 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 -- 172.21.15.82:0/820169838 shutdown_connections 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a00c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 --2- 172.21.15.82:0/820169838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160fa0 0x7f85a00c12f0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 -- 172.21.15.82:0/820169838 >> 172.21.15.82:0/820169838 conn(0x7f85a00cada0 msgr2=0x7f85a00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:53.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 -- 172.21.15.82:0/820169838 shutdown_connections 2023-07-20T11:05:53.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.775+0000 7f85a75e8640 1 -- 172.21.15.82:0/820169838 wait complete. 2023-07-20T11:05:53.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 Processor -- start 2023-07-20T11:05:53.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 -- start start 2023-07-20T11:05:53.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 0x7f85a015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c2370 con 0x7f85a0160bc0 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c2650 con 0x7f85a0160fa0 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00c2930 con 0x7f85a00cd830 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50548/0 (socket says 172.21.15.82:50548) 2023-07-20T11:05:53.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 -- 172.21.15.82:0/1972703394 learned_addr learned my addr 172.21.15.82:0/1972703394 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a5384640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a5b85640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 0x7f85a015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 -- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 msgr2=0x7f85a0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a0158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 -- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 msgr2=0x7f85a015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 0x7f85a015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 -- 172.21.15.82:0/1972703394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900094d0 con 0x7f85a0160bc0 2023-07-20T11:05:53.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a5b85640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 0x7f85a015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:05:53.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a4b83640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f859001a140 tx=0x7f859001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900b3800 con 0x7f85a0160bc0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900b3980 con 0x7f85a0160bc0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a00c2c10 con 0x7f85a0160bc0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.779+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900b3d30 con 0x7f85a0160bc0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a01592c0 con 0x7f85a0160bc0 2023-07-20T11:05:53.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a00c3130 con 0x7f85a0160bc0 2023-07-20T11:05:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85900c6390 con 0x7f85a0160bc0 2023-07-20T11:05:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f8595ffb640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 0x7f8584068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f859011eb70 con 0x7f85a0160bc0 2023-07-20T11:05:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f85a5384640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 0x7f8584068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:53.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.783+0000 7f85a5384640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 0x7f8584068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f859c007fd0 tx=0x7f859c009040 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.787+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85a00c3130 con 0x7f85a0160bc0 2023-07-20T11:05:53.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.955+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f85a00c27c0 con 0x7f85840663a0 2023-07-20T11:05:53.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.955+0000 7f8595ffb640 1 -- 172.21.15.82:0/1972703394 <== mgr.9318 v2:172.21.15.82:6832/2615753715 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f85a00c27c0 con 0x7f85840663a0 2023-07-20T11:05:53.938 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:05:53.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:05:53.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T11:05:53.938 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:05:53.938 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:05:53.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 msgr2=0x7f8584068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 0x7f8584068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f859c007fd0 tx=0x7f859c009040 comp rx=0 tx=0).stop 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 msgr2=0x7f85a01595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f859001a140 tx=0x7f859001ad50 comp rx=0 tx=0).stop 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 shutdown_connections 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f85840663a0 0x7f8584068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f85a0160fa0 0x7f85a015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85a0160bc0 0x7f85a01595e0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 --2- 172.21.15.82:0/1972703394 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85a00cd830 0x7f85a0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:53.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 >> 172.21.15.82:0/1972703394 conn(0x7f85a00cada0 msgr2=0x7f85a0070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:53.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 shutdown_connections 2023-07-20T11:05:53.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:53.959+0000 7f85a75e8640 1 -- 172.21.15.82:0/1972703394 wait complete. 2023-07-20T11:05:53.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T11:05:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 Processor -- start 2023-07-20T11:05:54.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 -- start start 2023-07-20T11:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd858161de0 0x7fd8580afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd8580cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8580b06e0 con 0x7fd858160ba0 2023-07-20T11:05:54.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8580c9650 con 0x7fd858161de0 2023-07-20T11:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85f6bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8581619c0 con 0x7fd8580b0290 2023-07-20T11:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85d459640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd858160ba0 0x7fd8580c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40938/0 (socket says 172.21.15.82:40938) 2023-07-20T11:05:54.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85d459640 1 -- 172.21.15.82:0/2479278885 learned_addr learned my addr 172.21.15.82:0/2479278885 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:54.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578026538 0 0) 0x7fd854001120 con 0x7fd858160ba0 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2479278885 >> v2:172.21.15.183:3300/0 conn(0x7fd858161de0 0x7fd8580afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85dc5a640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd8580cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003530 con 0x7fd858160ba0 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273384820 0 0) 0x7fd844003530 con 0x7fd858160ba0 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 msgr2=0x7fd8580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:54.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd8580cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 >> v2:172.21.15.183:3300/0 conn(0x7fd858161de0 msgr2=0x7fd8580afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 --2- 172.21.15.82:0/2479278885 >> v2:172.21.15.183:3300/0 conn(0x7fd858161de0 0x7fd8580afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580c9370 con 0x7fd858160ba0 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd854001810 con 0x7fd858160ba0 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 >> v1:172.21.15.82:6789/0 conn(0x7fd858160ba0 legacy=0x7fd8580c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8440039f0 0x7fd844003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8440047d0 0x7fd844004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd844005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580c9650 con 0x7fd8440047d0 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8581619c0 con 0x7fd8440039f0 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400b9c0 con 0x7fd8580b0290 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8440047d0 0x7fd844004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85d459640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8440039f0 0x7fd844003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85dc5a640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd844005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 -- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 msgr2=0x7fd844005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8580b0290 0x7fd844005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 -- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8440039f0 msgr2=0x7fd844003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8440039f0 0x7fd844003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.119+0000 7fd85cc58640 1 -- 172.21.15.82:0/2479278885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003530 con 0x7fd8440047d0 2023-07-20T11:05:54.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8440047d0 0x7fd844004c50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd848009ae0 tx=0x7fd84801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7014f62722a0d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480a55a0 con 0x7fd8440047d0 2023-07-20T11:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8480a5700 con 0x7fd8440047d0 2023-07-20T11:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd84ffff640 1 -- 172.21.15.82:0/2479278885 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480a5ab0 con 0x7fd8440047d0 2023-07-20T11:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2479278885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8440047d0 msgr2=0x7fd844004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:54.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2479278885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8440047d0 0x7fd844004c50 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fd848009ae0 tx=0x7fd84801ca90 comp rx=0 tx=0).stop 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85dc5a640 1 -- 172.21.15.82:0/2479278885 reap_dead start 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2479278885 shutdown_connections 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2479278885 >> 172.21.15.82:0/2479278885 conn(0x7fd8580cad50 msgr2=0x7fd8580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2479278885 shutdown_connections 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.123+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2479278885 wait complete. 2023-07-20T11:05:54.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 Processor -- start 2023-07-20T11:05:54.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 -- start start 2023-07-20T11:05:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8440047d0 0x7fd858152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8580bee00 0x7fd8580bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580bf7c0 con 0x7fd85815f660 2023-07-20T11:05:54.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580c12b0 con 0x7fd8580bee00 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8580c6330 con 0x7fd8440047d0 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50566/0 (socket says 172.21.15.82:50566) 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 -- 172.21.15.82:0/2530027372 learned_addr learned my addr 172.21.15.82:0/2530027372 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85d459640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8440047d0 0x7fd858152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85dc5a640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8580bee00 0x7fd8580bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 -- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8440047d0 msgr2=0x7fd858152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8440047d0 0x7fd858152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 -- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8580bee00 msgr2=0x7fd8580bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:54.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8580bee00 0x7fd8580bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:54.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 -- 172.21.15.82:0/2530027372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580c5d60 con 0x7fd85815f660 2023-07-20T11:05:54.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85cc58640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd84801c8c0 tx=0x7fd844005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:54.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8480be070 con 0x7fd85815f660 2023-07-20T11:05:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84800f0c0 con 0x7fd85815f660 2023-07-20T11:05:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8580c6d00 con 0x7fd85815f660 2023-07-20T11:05:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.127+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd848004220 con 0x7fd85815f660 2023-07-20T11:05:54.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8580c8450 con 0x7fd85815f660 2023-07-20T11:05:54.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8580c8640 con 0x7fd85815f660 2023-07-20T11:05:54.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 83) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8480b4040 con 0x7fd85815f660 2023-07-20T11:05:54.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd84dffb640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 0x7fd83c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:54.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd84811def0 con 0x7fd85815f660 2023-07-20T11:05:54.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd85d459640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 0x7fd83c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:54.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.131+0000 7fd85d459640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 0x7fd83c068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd854001d90 tx=0x7fd854007980 comp rx=0 tx=0).ready entity=mgr.9318 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:54.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.135+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8480eb220 con 0x7fd85815f660 2023-07-20T11:05:54.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:54.323+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd85804da30 con 0x7fd85815f660 2023-07-20T11:05:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.227+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 84) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd848004380 con 0x7fd85815f660 2023-07-20T11:05:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.227+0000 7fd84dffb640 1 -- 172.21.15.82:0/2530027372 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v84) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd8480bb670 con 0x7fd85815f660 2023-07-20T11:05:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 msgr2=0x7fd83c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 0x7fd83c068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd854001d90 tx=0x7fd854007980 comp rx=0 tx=0).stop 2023-07-20T11:05:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 msgr2=0x7fd8580c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fd84801c8c0 tx=0x7fd844005800 comp rx=0 tx=0).stop 2023-07-20T11:05:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 shutdown_connections 2023-07-20T11:05:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fd83c0663a0 0x7fd83c068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd8580bee00 0x7fd8580bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd85815f660 0x7fd8580c67c0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 --2- 172.21.15.82:0/2530027372 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd8440047d0 0x7fd858152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 >> 172.21.15.82:0/2530027372 conn(0x7fd8580cad50 msgr2=0x7fd85806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 shutdown_connections 2023-07-20T11:05:55.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.231+0000 7fd85f6bd640 1 -- 172.21.15.82:0/2530027372 wait complete. 2023-07-20T11:05:55.235 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T11:05:55.377 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:55.392+0000 7fbaf6055180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:05:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 Processor -- start 2023-07-20T11:05:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 -- start start 2023-07-20T11:05:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb4c406c120 0x7fb4c40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4c406b220 0x7fb4c4160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c40d0970 con 0x7fb4c41602b0 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c4160e20 con 0x7fb4c406b220 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c9b2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c40cd300 con 0x7fb4c406c120 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4c406b220 0x7fb4c4160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb4c406b220 0x7fb4c4160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50580/0 (socket says 172.21.15.82:50580) 2023-07-20T11:05:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 -- 172.21.15.82:0/2180746013 learned_addr learned my addr 172.21.15.82:0/2180746013 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c37fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb4c406c120 0x7fb4c40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 -- 172.21.15.82:0/2180746013 >> v2:172.21.15.183:3300/0 conn(0x7fb4c406c120 msgr2=0x7fb4c40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 --2- 172.21.15.82:0/2180746013 >> v2:172.21.15.183:3300/0 conn(0x7fb4c406c120 0x7fb4c40cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 -- 172.21.15.82:0/2180746013 >> v1:172.21.15.183:6789/0 conn(0x7fb4c41602b0 legacy=0x7fb4c406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.403+0000 7fb4c3fff640 1 -- 172.21.15.82:0/2180746013 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40cd5e0 con 0x7fb4c406b220 2023-07-20T11:05:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c3fff640 1 --2- 172.21.15.82:0/2180746013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406b220 0x7fb4c4160740 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40d00e0 tx=0x7fb4bc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58203247f335d6c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c27fc640 1 -- 172.21.15.82:0/2180746013 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a5760 con 0x7fb4c406b220 2023-07-20T11:05:55.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c27fc640 1 -- 172.21.15.82:0/2180746013 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc0a58c0 con 0x7fb4c406b220 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c27fc640 1 -- 172.21.15.82:0/2180746013 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a5c50 con 0x7fb4c406b220 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2180746013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406b220 msgr2=0x7fb4c4160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2180746013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406b220 0x7fb4c4160740 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fb4c40d00e0 tx=0x7fb4bc01c880 comp rx=0 tx=0).stop 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2180746013 shutdown_connections 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2180746013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406b220 0x7fb4c4160740 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2180746013 >> v2:172.21.15.183:3300/0 conn(0x7fb4c406c120 0x7fb4c40cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2180746013 >> 172.21.15.82:0/2180746013 conn(0x7fb4c408c0a0 msgr2=0x7fb4c409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2180746013 shutdown_connections 2023-07-20T11:05:55.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2180746013 wait complete. 2023-07-20T11:05:55.393 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:55.407+0000 7fced6716180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:05:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 Processor -- start 2023-07-20T11:05:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- start start 2023-07-20T11:05:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 0x7fb4c415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 0x7fb4c40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c41602b0 0x7fb4c4154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40c8750 con 0x7fb4c406c120 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4156e00 con 0x7fb4c406b220 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40c9f10 con 0x7fb4c41602b0 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 0x7fb4c40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 0x7fb4c415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 0x7fb4c40ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50584/0 (socket says 172.21.15.82:50584) 2023-07-20T11:05:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c2ffd640 1 -- 172.21.15.82:0/2673117182 learned_addr learned my addr 172.21.15.82:0/2673117182 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c3fff640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c41602b0 0x7fb4c4154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 -- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c41602b0 msgr2=0x7fb4c4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c41602b0 0x7fb4c4154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 -- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 msgr2=0x7fb4c40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 0x7fb4c40ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 -- 172.21.15.82:0/2673117182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009b30 con 0x7fb4c406b220 2023-07-20T11:05:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c37fe640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 0x7fb4c415ebd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400e870 tx=0x7fb4b400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b40095d0 con 0x7fb4c406b220 2023-07-20T11:05:55.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400c8e0 con 0x7fb4c406b220 2023-07-20T11:05:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400cc50 con 0x7fb4c406b220 2023-07-20T11:05:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c415f110 con 0x7fb4c406b220 2023-07-20T11:05:55.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.411+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c40c98c0 con 0x7fb4c406b220 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c40c9700 con 0x7fb4c406b220 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 84) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb4b4013470 con 0x7fb4c406b220 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4abfff640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 0x7fb4b00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fb4b4083f50 con 0x7fb4c406b220 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4c2ffd640 1 -- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 msgr2=0x7fb4b00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:55.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.415+0000 7fb4c2ffd640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 0x7fb4b00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:55.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.419+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4b40513b0 con 0x7fb4c406b220 2023-07-20T11:05:55.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.571+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb4c415f2a0 con 0x7fb4c406b220 2023-07-20T11:05:55.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4abfff640 1 -- 172.21.15.82:0/2673117182 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4b40170d0 con 0x7fb4c406b220 2023-07-20T11:05:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 msgr2=0x7fb4b00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 0x7fb4b00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 msgr2=0x7fb4c415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 0x7fb4c415ebd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400e870 tx=0x7fb4b400ed30 comp rx=0 tx=0).stop 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 shutdown_connections 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7fb4b0066420 0x7fb4b00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4c41602b0 0x7fb4c4154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4c406c120 0x7fb4c40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 --2- 172.21.15.82:0/2673117182 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4c406b220 0x7fb4c415ebd0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 >> 172.21.15.82:0/2673117182 conn(0x7fb4c408c0a0 msgr2=0x7fb4c406ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 shutdown_connections 2023-07-20T11:05:55.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.583+0000 7fb4c9b2c640 1 -- 172.21.15.82:0/2673117182 wait complete. 2023-07-20T11:05:55.586 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T11:05:55.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 Processor -- start 2023-07-20T11:05:55.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 -- start start 2023-07-20T11:05:55.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f727c06f710 0x7f727c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f727c0ca5a0 0x7f727c15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c070030 con 0x7f727c15ec90 2023-07-20T11:05:55.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c15bad0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.747+0000 7f7280b40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c071950 con 0x7f727c06f710 2023-07-20T11:05:55.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f727c0ca5a0 0x7f727c15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f727c0ca5a0 0x7f727c15e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50586/0 (socket says 172.21.15.82:50586) 2023-07-20T11:05:55.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 -- 172.21.15.82:0/893835970 learned_addr learned my addr 172.21.15.82:0/893835970 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:55.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f727a59c640 1 --2- 172.21.15.82:0/893835970 >> v2:172.21.15.183:3300/0 conn(0x7f727c06f710 0x7f727c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 -- 172.21.15.82:0/893835970 >> v2:172.21.15.183:3300/0 conn(0x7f727c06f710 msgr2=0x7f727c06faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:05:55.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 --2- 172.21.15.82:0/893835970 >> v2:172.21.15.183:3300/0 conn(0x7f727c06f710 0x7f727c06faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 -- 172.21.15.82:0/893835970 >> v1:172.21.15.183:6789/0 conn(0x7f727c15ec90 legacy=0x7f727c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 -- 172.21.15.82:0/893835970 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c15b230 con 0x7f727c0ca5a0 2023-07-20T11:05:55.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7273fff640 1 --2- 172.21.15.82:0/893835970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c0ca5a0 0x7f727c15e750 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ce230 tx=0x7f726401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22934a9fddc3d75e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:55.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7279d9b640 1 -- 172.21.15.82:0/893835970 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640ac640 con 0x7f727c0ca5a0 2023-07-20T11:05:55.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7279d9b640 1 -- 172.21.15.82:0/893835970 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640ac7a0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.751+0000 7f7279d9b640 1 -- 172.21.15.82:0/893835970 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640acb30 con 0x7f727c0ca5a0 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- 172.21.15.82:0/893835970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c0ca5a0 msgr2=0x7f727c15e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- 172.21.15.82:0/893835970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c0ca5a0 0x7f727c15e750 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ce230 tx=0x7f726401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- 172.21.15.82:0/893835970 shutdown_connections 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- 172.21.15.82:0/893835970 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c0ca5a0 0x7f727c15e750 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- 172.21.15.82:0/893835970 >> v2:172.21.15.183:3300/0 conn(0x7f727c06f710 0x7f727c06faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- 172.21.15.82:0/893835970 >> 172.21.15.82:0/893835970 conn(0x7f727c0cad50 msgr2=0x7f727c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:55.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- 172.21.15.82:0/893835970 shutdown_connections 2023-07-20T11:05:55.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- 172.21.15.82:0/893835970 wait complete. 2023-07-20T11:05:55.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 Processor -- start 2023-07-20T11:05:55.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- start start 2023-07-20T11:05:55.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f727c06f710 0x7f727c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c15ec90 0x7f727c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0cc500 con 0x7f727c15ec90 2023-07-20T11:05:55.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c15bc10 con 0x7f727c06f710 2023-07-20T11:05:55.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7280b40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0cc750 con 0x7f727c0ca5a0 2023-07-20T11:05:55.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f727ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c15ec90 0x7f727c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7273fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f727a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f727c06f710 0x7f727c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7273fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:60030/0 (socket says 172.21.15.82:60030) 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.755+0000 7f7273fff640 1 -- 172.21.15.82:0/2381246252 learned_addr learned my addr 172.21.15.82:0/2381246252 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 -- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f727c06f710 msgr2=0x7f727c1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f727c06f710 0x7f727c1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 -- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c15ec90 msgr2=0x7f727c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c15ec90 0x7f727c158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 -- 172.21.15.82:0/2381246252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72640094d0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7273fff640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f72640190e0 tx=0x7f7264019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b5640 con 0x7f727c0ca5a0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640b57a0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72640b5b10 con 0x7f727c0ca5a0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0cca30 con 0x7f727c0ca5a0 2023-07-20T11:05:55.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c1520c0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c04da30 con 0x7f727c0ca5a0 2023-07-20T11:05:55.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.759+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 84) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f72640b3070 con 0x7f727c0ca5a0 2023-07-20T11:05:55.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.763+0000 7f7272ffd640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 0x7f725c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:55.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.763+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f726411e110 con 0x7f727c0ca5a0 2023-07-20T11:05:55.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.763+0000 7f727a59c640 1 -- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 msgr2=0x7f725c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:55.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.763+0000 7f727a59c640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 0x7f725c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:55.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.767+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72640eb4d0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.791 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:55.808+0000 7fbaf6055180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:05:55.823 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:55.839+0000 7fced6716180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:05:55.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.919+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f727c15c030 con 0x7f727c0ca5a0 2023-07-20T11:05:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7272ffd640 1 -- 172.21.15.82:0/2381246252 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f72640eeaf0 con 0x7f727c0ca5a0 2023-07-20T11:05:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 msgr2=0x7f725c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 0x7f725c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 msgr2=0x7f727c151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f72640190e0 tx=0x7f7264019270 comp rx=0 tx=0).stop 2023-07-20T11:05:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 shutdown_connections 2023-07-20T11:05:55.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f725c066420 0x7f725c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f727c15ec90 0x7f727c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f727c0ca5a0 0x7f727c151b40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 --2- 172.21.15.82:0/2381246252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f727c06f710 0x7f727c1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:55.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 >> 172.21.15.82:0/2381246252 conn(0x7f727c0cad50 msgr2=0x7f727c0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:55.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 shutdown_connections 2023-07-20T11:05:55.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:55.927+0000 7f7280b40640 1 -- 172.21.15.82:0/2381246252 wait complete. 2023-07-20T11:05:55.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:05:55.930 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T11:05:55.942 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:55.960+0000 7fbaf6055180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:05:55.945 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-07-20T11:05:55.977 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:55.995+0000 7fced6716180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:05:56.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.139+0000 7f0e87c6a640 1 Processor -- start 2023-07-20T11:05:56.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.139+0000 7f0e87c6a640 1 -- start start 2023-07-20T11:05:56.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e87c6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0e801602b0 0x7f0e80160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e87c6a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800ce4f0 con 0x7f0e8006c120 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e87c6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800d0970 con 0x7f0e8006ab10 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e87c6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e80160e20 con 0x7f0e801602b0 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85a06640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0e8006c120 0x7f0e800cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40954/0 (socket says 172.21.15.82:40954) 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85a06640 1 -- 172.21.15.82:0/837023529 learned_addr learned my addr 172.21.15.82:0/837023529 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:05:56.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85205640 1 --2- 172.21.15.82:0/837023529 >> v2:172.21.15.183:3300/0 conn(0x7f0e801602b0 0x7f0e80160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:56.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462914960 0 0) 0x7f0e800ce4f0 con 0x7f0e8006c120 2023-07-20T11:05:56.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6c003530 con 0x7f0e8006c120 2023-07-20T11:05:56.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783213946 0 0) 0x7f0e800d0970 con 0x7f0e8006ab10 2023-07-20T11:05:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e800ce4f0 con 0x7f0e8006ab10 2023-07-20T11:05:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4472428 0 0) 0x7f0e6c003530 con 0x7f0e8006c120 2023-07-20T11:05:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85205640 1 -- 172.21.15.82:0/837023529 >> v1:172.21.15.183:6789/0 conn(0x7f0e8006ab10 legacy=0x7f0e8006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85205640 1 -- 172.21.15.82:0/837023529 >> v1:172.21.15.82:6789/0 conn(0x7f0e8006c120 legacy=0x7f0e800cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.143+0000 7f0e85205640 1 -- 172.21.15.82:0/837023529 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800cd300 con 0x7f0e801602b0 2023-07-20T11:05:56.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e85205640 1 --2- 172.21.15.82:0/837023529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e801602b0 0x7f0e80160740 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0e700097c0 tx=0x7f0e7001c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa7959dd0013e3f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:56.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c001680 con 0x7f0e801602b0 2023-07-20T11:05:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700a7050 con 0x7f0e801602b0 2023-07-20T11:05:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e84a04640 1 -- 172.21.15.82:0/837023529 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700ab600 con 0x7f0e801602b0 2023-07-20T11:05:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- 172.21.15.82:0/837023529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e801602b0 msgr2=0x7f0e80160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:56.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 --2- 172.21.15.82:0/837023529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e801602b0 0x7f0e80160740 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0e700097c0 tx=0x7f0e7001c250 comp rx=0 tx=0).stop 2023-07-20T11:05:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- 172.21.15.82:0/837023529 shutdown_connections 2023-07-20T11:05:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 --2- 172.21.15.82:0/837023529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e801602b0 0x7f0e80160740 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:56.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- 172.21.15.82:0/837023529 >> 172.21.15.82:0/837023529 conn(0x7f0e8008c0a0 msgr2=0x7f0e8009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:05:56.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- 172.21.15.82:0/837023529 shutdown_connections 2023-07-20T11:05:56.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- 172.21.15.82:0/837023529 wait complete. 2023-07-20T11:05:56.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 Processor -- start 2023-07-20T11:05:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 -- start start 2023-07-20T11:05:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e8006ab10 0x7f0e800c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.147+0000 7f0e87c6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e8006c120 0x7f0e800c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:56.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 0x7f0e800b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800b70b0 con 0x7f0e801602b0 2023-07-20T11:05:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c9080 con 0x7f0e8006c120 2023-07-20T11:05:56.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e80155d10 con 0x7f0e8006ab10 2023-07-20T11:05:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 0x7f0e800b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 0x7f0e800b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50606/0 (socket says 172.21.15.82:50606) 2023-07-20T11:05:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 -- 172.21.15.82:0/1267467540 learned_addr learned my addr 172.21.15.82:0/1267467540 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:05:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e8006ab10 0x7f0e800c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:56.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e85205640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e8006c120 0x7f0e800c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e8006ab10 msgr2=0x7f0e800c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0e8006ab10 0x7f0e800c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e8006c120 msgr2=0x7f0e800c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:05:56.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0e8006c120 0x7f0e800c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:56.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009420 con 0x7f0e801602b0 2023-07-20T11:05:56.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e86207640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 0x7f0e800b0600 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800c790 tx=0x7f0e7800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:05:56.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800cea0 con 0x7f0e801602b0 2023-07-20T11:05:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78003b80 con 0x7f0e801602b0 2023-07-20T11:05:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e800b6710 con 0x7f0e801602b0 2023-07-20T11:05:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800a850 con 0x7f0e801602b0 2023-07-20T11:05:56.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800b6cd0 con 0x7f0e801602b0 2023-07-20T11:05:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8004da30 con 0x7f0e801602b0 2023-07-20T11:05:56.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.151+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 84) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0e7800a9b0 con 0x7f0e801602b0 2023-07-20T11:05:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.155+0000 7f0e767fc640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.155+0000 7f0e85a06640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 msgr2=0x7f0e640688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.155+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f0e78083cd0 con 0x7f0e801602b0 2023-07-20T11:05:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.155+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:05:56.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.159+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0e78051090 con 0x7f0e801602b0 2023-07-20T11:05:56.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.327+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e800b6500 con 0x7f0e640663f0 2023-07-20T11:05:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.359+0000 7f0e85a06640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 msgr2=0x7f0e640688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:56.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.359+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T11:05:56.423 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.440+0000 7fbaf6055180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:56.468 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.487+0000 7fced6716180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:56.480 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.496+0000 7fbaf6055180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:05:56.527 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.543+0000 7fced6716180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:05:56.535 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.552+0000 7fbaf6055180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:05:56.583 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.599+0000 7fced6716180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:05:56.621 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.636+0000 7fbaf6055180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:05:56.668 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.687+0000 7fced6716180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:05:56.677 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.696+0000 7fbaf6055180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:05:56.727 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.743+0000 7fced6716180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:05:56.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.763+0000 7f0e85a06640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 msgr2=0x7f0e640688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:56.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:56.763+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T11:05:56.761 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.776+0000 7fbaf6055180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:05:56.810 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.827+0000 7fced6716180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:05:56.817 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.836+0000 7fbaf6055180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:05:56.867 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:56.887+0000 7fced6716180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:05:56.958 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:56.976+0000 7fbaf6055180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:05:57.009 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.027+0000 7fced6716180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:05:57.017 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.036+0000 7fbaf6055180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:05:57.068 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.087+0000 7fced6716180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:05:57.259 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:05:57.260 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:05:57.260 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:05:57.268 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.284+0000 7fbaf6055180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:05:57.311 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:05:57.311 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:05:57.311 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:05:57.319 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.335+0000 7fced6716180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:05:57.400 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.416+0000 7fbaf6055180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:57.453 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.471+0000 7fced6716180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:57.523 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.540+0000 7fbaf6055180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:57.567+0000 7f0e85a06640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 msgr2=0x7f0e640688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2615753715 2023-07-20T11:05:57.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:57.567+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T11:05:57.578 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.595+0000 7fced6716180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:05:57.594 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.612+0000 7fbaf6055180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:05:57.648 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.667+0000 7fced6716180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:05:57.728 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:57.744+0000 7fbaf6055180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:57.783 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:57.799+0000 7fced6716180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:05:58.266 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.284+0000 7fbaf6055180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:05:58.330 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.347+0000 7fced6716180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:05:58.351 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.368+0000 7fbaf6055180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:05:58.413 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.431+0000 7fced6716180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:05:58.498 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.516+0000 7fbaf6055180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:05:58.561 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.579+0000 7fced6716180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:05:58.581 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.596+0000 7fbaf6055180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:05:58.644 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.663+0000 7fced6716180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:05:58.849 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.864+0000 7fbaf6055180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:05:58.908 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:05:58.924+0000 7fbaf6055180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:05:58.914 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.931+0000 7fced6716180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:05:58.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:58.987+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 85) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0e78051460 con 0x7f0e801602b0 2023-07-20T11:05:58.977 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:58.995+0000 7fced6716180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:05:58.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:59.007+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 86) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f0e78081c20 con 0x7f0e801602b0 2023-07-20T11:05:58.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:59.007+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 msgr2=0x7f0e640688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:05:58.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:05:59.007+0000 7f0e767fc640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/2615753715,v1:172.21.15.82:6833/2615753715] conn(0x7f0e640663f0 0x7f0e640688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:05:59.105 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce59941640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.106 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce59941640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.106 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce59941640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.106 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce59941640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.107 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce59941640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.107 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce5c947640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.107 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce5c947640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce5c947640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce5c947640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.108 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:05:59.123+0000 7fce5c947640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:05:59.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.011+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mon.0 v2:172.21.15.82:3300/0 9 ==== mgrmap(e 87) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0e78051d30 con 0x7f0e801602b0 2023-07-20T11:05:59.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.011+0000 7f0e767fc640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e64034090 0x7f0e640709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:05:59.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.011+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 --> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e800b6500 con 0x7f0e64034090 2023-07-20T11:05:59.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.015+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e64034090 0x7f0e640709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:05:59.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.015+0000 7f0e85a06640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e64034090 0x7f0e640709c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c001ec0 tx=0x7f0e7c001680 comp rx=0 tx=0).ready entity=mgr.9810 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e767fc640 1 -- 172.21.15.82:0/1267467540 <== mgr.9810 v2:172.21.15.82:6832/1398603107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0e800b6500 con 0x7f0e64034090 2023-07-20T11:06:00.060 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T11:06:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e64034090 msgr2=0x7f0e640709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e64034090 0x7f0e640709c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c001ec0 tx=0x7f0e7c001680 comp rx=0 tx=0).stop 2023-07-20T11:06:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 msgr2=0x7f0e800b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 --2- 172.21.15.82:0/1267467540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e801602b0 0x7f0e800b0600 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800c790 tx=0x7f0e7800cc50 comp rx=0 tx=0).stop 2023-07-20T11:06:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e86207640 1 -- 172.21.15.82:0/1267467540 reap_dead start 2023-07-20T11:06:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 shutdown_connections 2023-07-20T11:06:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 >> 172.21.15.82:0/1267467540 conn(0x7f0e8008c0a0 msgr2=0x7f0e800b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 shutdown_connections 2023-07-20T11:06:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.079+0000 7f0e87c6a640 1 -- 172.21.15.82:0/1267467540 wait complete. 2023-07-20T11:06:00.081 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T11:06:00.081 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-20T11:06:00.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 Processor -- start 2023-07-20T11:06:00.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 -- start start 2023-07-20T11:06:00.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90006f710 0x7fe90006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9000ca5a0 0x7fe90015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe90015ec90 0x7fe90015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90015bad0 con 0x7fe90006f710 2023-07-20T11:06:00.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe900070030 con 0x7fe90015ec90 2023-07-20T11:06:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe906407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900071950 con 0x7fe9000ca5a0 2023-07-20T11:06:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90006f710 0x7fe90006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe90006f710 0x7fe90006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50738/0 (socket says 172.21.15.82:50738) 2023-07-20T11:06:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 -- 172.21.15.82:0/1713814583 learned_addr learned my addr 172.21.15.82:0/1713814583 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8ff7fe640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9000ca5a0 0x7fe90015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe9049a4640 1 --2- 172.21.15.82:0/1713814583 >> v2:172.21.15.183:3300/0 conn(0x7fe90015ec90 0x7fe90015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 -- 172.21.15.82:0/1713814583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9000ca5a0 msgr2=0x7fe90015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9000ca5a0 0x7fe90015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 -- 172.21.15.82:0/1713814583 >> v2:172.21.15.183:3300/0 conn(0x7fe90015ec90 msgr2=0x7fe90015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 --2- 172.21.15.82:0/1713814583 >> v2:172.21.15.183:3300/0 conn(0x7fe90015ec90 0x7fe90015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.243+0000 7fe8fffff640 1 -- 172.21.15.82:0/1713814583 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90015b230 con 0x7fe90006f710 2023-07-20T11:06:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe8fffff640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006f710 0x7fe90006faf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe9000702d0 tx=0x7fe8f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6254ce265202b617 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe8feffd640 1 -- 172.21.15.82:0/1713814583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00ac600 con 0x7fe90006f710 2023-07-20T11:06:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe8feffd640 1 -- 172.21.15.82:0/1713814583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00a8050 con 0x7fe90006f710 2023-07-20T11:06:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe8feffd640 1 -- 172.21.15.82:0/1713814583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00ac980 con 0x7fe90006f710 2023-07-20T11:06:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 -- 172.21.15.82:0/1713814583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006f710 msgr2=0x7fe90006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006f710 0x7fe90006faf0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe9000702d0 tx=0x7fe8f001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 -- 172.21.15.82:0/1713814583 shutdown_connections 2023-07-20T11:06:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 --2- 172.21.15.82:0/1713814583 >> v2:172.21.15.183:3300/0 conn(0x7fe90015ec90 0x7fe90015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe9000ca5a0 0x7fe90015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 --2- 172.21.15.82:0/1713814583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe90006f710 0x7fe90006faf0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 -- 172.21.15.82:0/1713814583 >> 172.21.15.82:0/1713814583 conn(0x7fe9000cad50 msgr2=0x7fe9000cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 -- 172.21.15.82:0/1713814583 shutdown_connections 2023-07-20T11:06:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.247+0000 7fe906407640 1 -- 172.21.15.82:0/1713814583 wait complete. 2023-07-20T11:06:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 Processor -- start 2023-07-20T11:06:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- start start 2023-07-20T11:06:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 0x7fe90014d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe90015ec90 0x7fe90014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001538e0 con 0x7fe9000ca5a0 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900153bc0 con 0x7fe90006f710 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900153ea0 con 0x7fe90015ec90 2023-07-20T11:06:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50752/0 (socket says 172.21.15.82:50752) 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 -- 172.21.15.82:0/3771119416 learned_addr learned my addr 172.21.15.82:0/3771119416 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8fffff640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 0x7fe90014d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe9049a4640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe90015ec90 0x7fe90014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 -- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe90015ec90 msgr2=0x7fe90014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe90015ec90 0x7fe90014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 -- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 msgr2=0x7fe90014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 0x7fe90014d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 -- 172.21.15.82:0/3771119416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00094d0 con 0x7fe9000ca5a0 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8fffff640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 0x7fe90014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8ff7fe640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400e8b0 tx=0x7fe8f400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400c940 con 0x7fe9000ca5a0 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f400caa0 con 0x7fe9000ca5a0 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe900154180 con 0x7fe9000ca5a0 2023-07-20T11:06:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f400ce30 con 0x7fe9000ca5a0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.251+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe900154740 con 0x7fe9000ca5a0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90004da30 con 0x7fe9000ca5a0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 87) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fe8f4013470 con 0x7fe9000ca5a0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe8fcff9640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 0x7fe8ec0685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fe8f4083c40 con 0x7fe9000ca5a0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe8fffff640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 0x7fe8ec0685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.255+0000 7fe8fffff640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 0x7fe8ec0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00ae000 tx=0x7fe8f00a7000 comp rx=0 tx=0).ready entity=mgr.9810 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.259+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8f4089020 con 0x7fe9000ca5a0 2023-07-20T11:06:00.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.427+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 --> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe90015e230 con 0x7fe8ec066120 2023-07-20T11:06:00.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe8fcff9640 1 -- 172.21.15.82:0/3771119416 <== mgr.9810 v2:172.21.15.82:6832/1398603107 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe8f00aca70 con 0x7fe8ec066120 2023-07-20T11:06:00.472 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path snap_test_dir1 2023-07-20T11:06:00.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 msgr2=0x7fe8ec0685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 0x7fe8ec0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00ae000 tx=0x7fe8f00a7000 comp rx=0 tx=0).stop 2023-07-20T11:06:00.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 msgr2=0x7fe9000c7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe8f400e8b0 tx=0x7fe8f400ed70 comp rx=0 tx=0).stop 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 shutdown_connections 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe90015ec90 0x7fe90014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9000ca5a0 0x7fe9000c7130 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe8ec066120 0x7fe8ec0685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 --2- 172.21.15.82:0/3771119416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe90006f710 0x7fe90014d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 >> 172.21.15.82:0/3771119416 conn(0x7fe9000cad50 msgr2=0x7fe90006bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 shutdown_connections 2023-07-20T11:06:00.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.491+0000 7fe906407640 1 -- 172.21.15.82:0/3771119416 wait complete. 2023-07-20T11:06:00.492 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-20T11:06:00.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-20T11:06:00.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.651+0000 7fb513911640 1 Processor -- start 2023-07-20T11:06:00.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb513911640 1 -- start start 2023-07-20T11:06:00.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb513911640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb50c06f710 0x7fb50c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb513911640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c070030 con 0x7fb50c15a6f0 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb513911640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c071950 con 0x7fb50c0ca5a0 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb513911640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c15bad0 con 0x7fb50c06f710 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb50c06f710 0x7fb50c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb50c06f710 0x7fb50c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50758/0 (socket says 172.21.15.82:50758) 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 -- 172.21.15.82:0/2635379790 learned_addr learned my addr 172.21.15.82:0/2635379790 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:00.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb511eae640 1 --1- 172.21.15.82:0/2635379790 >> v1:172.21.15.82:6789/0 conn(0x7fb50c15a6f0 0x7fb50c0c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40960/0 (socket says 172.21.15.82:40960) 2023-07-20T11:06:00.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 -- 172.21.15.82:0/2635379790 >> v1:172.21.15.183:6789/0 conn(0x7fb50c0ca5a0 legacy=0x7fb50c15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 -- 172.21.15.82:0/2635379790 >> v1:172.21.15.82:6789/0 conn(0x7fb50c15a6f0 legacy=0x7fb50c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.655+0000 7fb5116ad640 1 -- 172.21.15.82:0/2635379790 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c15b230 con 0x7fb50c06f710 2023-07-20T11:06:00.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb5116ad640 1 --2- 172.21.15.82:0/2635379790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c06f710 0x7fb50c06faf0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bcbc531cf0b731 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb503fff640 1 -- 172.21.15.82:0/2635379790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080aa670 con 0x7fb50c06f710 2023-07-20T11:06:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb503fff640 1 -- 172.21.15.82:0/2635379790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080aa7d0 con 0x7fb50c06f710 2023-07-20T11:06:00.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb503fff640 1 -- 172.21.15.82:0/2635379790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080aab60 con 0x7fb50c06f710 2023-07-20T11:06:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- 172.21.15.82:0/2635379790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c06f710 msgr2=0x7fb50c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 --2- 172.21.15.82:0/2635379790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c06f710 0x7fb50c06faf0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb508009870 tx=0x7fb50801c510 comp rx=0 tx=0).stop 2023-07-20T11:06:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- 172.21.15.82:0/2635379790 shutdown_connections 2023-07-20T11:06:00.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 --2- 172.21.15.82:0/2635379790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c06f710 0x7fb50c06faf0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- 172.21.15.82:0/2635379790 >> 172.21.15.82:0/2635379790 conn(0x7fb50c0cad50 msgr2=0x7fb50c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- 172.21.15.82:0/2635379790 shutdown_connections 2023-07-20T11:06:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- 172.21.15.82:0/2635379790 wait complete. 2023-07-20T11:06:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 Processor -- start 2023-07-20T11:06:00.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.659+0000 7fb513911640 1 -- start start 2023-07-20T11:06:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c06f710 0x7fb50c0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c0ca5a0 0x7fb50c0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c15a6f0 0x7fb50c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c5870 con 0x7fb50c15a6f0 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c5b30 con 0x7fb50c0ca5a0 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c5e10 con 0x7fb50c06f710 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c15a6f0 0x7fb50c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c15a6f0 0x7fb50c0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50760/0 (socket says 172.21.15.82:50760) 2023-07-20T11:06:00.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 -- 172.21.15.82:0/610715213 learned_addr learned my addr 172.21.15.82:0/610715213 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb5116ad640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c06f710 0x7fb50c0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb510eac640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c0ca5a0 0x7fb50c0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 -- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c06f710 msgr2=0x7fb50c0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb50c06f710 0x7fb50c0ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 -- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c0ca5a0 msgr2=0x7fb50c0ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c0ca5a0 0x7fb50c0ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:00.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 -- 172.21.15.82:0/610715213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080094d0 con 0x7fb50c15a6f0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb510eac640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb50c0ca5a0 0x7fb50c0ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb511eae640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb50c15a6f0 0x7fb50c0ce7f0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fb50400c7a0 tx=0x7fb50400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400a640 con 0x7fb50c15a6f0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400a7a0 con 0x7fb50c15a6f0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400ab10 con 0x7fb50c15a6f0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- 172.21.15.82:0/610715213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0c60f0 con 0x7fb50c15a6f0 2023-07-20T11:06:00.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- 172.21.15.82:0/610715213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0c68f0 con 0x7fb50c15a6f0 2023-07-20T11:06:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb513911640 1 -- 172.21.15.82:0/610715213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c0c6610 con 0x7fb50c15a6f0 2023-07-20T11:06:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.663+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 87) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb50400ac70 con 0x7fb50c15a6f0 2023-07-20T11:06:00.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.667+0000 7fb501ffb640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fb4f0066150 0x7fb4f0068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.667+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fb5040833b0 con 0x7fb50c15a6f0 2023-07-20T11:06:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.667+0000 7fb5116ad640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fb4f0066150 0x7fb4f0068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:00.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.667+0000 7fb5116ad640 1 --2- 172.21.15.82:0/610715213 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fb4f0066150 0x7fb4f0068610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ae000 tx=0x7fb5080a7000 comp rx=0 tx=0).ready entity=mgr.9810 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:00.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.671+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb50c0c6610 con 0x7fb50c15a6f0 2023-07-20T11:06:00.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.835+0000 7fb513911640 1 -- 172.21.15.82:0/610715213 --> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb50c0c5ca0 con 0x7fb4f0066150 2023-07-20T11:06:00.822 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:00.839+0000 7fce63955640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-20T11:06:00.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:00.839+0000 7fb501ffb640 1 -- 172.21.15.82:0/610715213 <== mgr.9810 v2:172.21.15.82:6832/1398603107 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb50c0c5ca0 con 0x7fb4f0066150 2023-07-20T11:06:00.823 INFO:teuthology.orchestra.run.smithi082.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-20T11:06:00.831 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-20T11:06:00.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:00.832 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T11:06:00.843 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T11:06:01.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.059+0000 7f9d05334640 1 Processor -- start 2023-07-20T11:06:01.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.059+0000 7f9d05334640 1 -- start start 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d05334640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9d000d0970 0x7f9d001671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d05334640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0015ff50 con 0x7f9d0015fb70 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d05334640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000d0f90 con 0x7f9d000b46a0 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d05334640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000d0d80 con 0x7f9d000d0970 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cfffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9d0015fb70 0x7f9d000b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40974/0 (socket says 172.21.15.82:40974) 2023-07-20T11:06:01.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cfffff640 1 -- 172.21.15.82:0/3221072525 learned_addr learned my addr 172.21.15.82:0/3221072525 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d04b33640 1 --2- 172.21.15.82:0/3221072525 >> v2:172.21.15.183:3300/0 conn(0x7f9d000d0970 0x7f9d001671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:01.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234209011 0 0) 0x7f9d0015ff50 con 0x7f9d0015fb70 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cec003530 con 0x7f9d0015fb70 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384355837 0 0) 0x7f9d000d0f90 con 0x7f9d000b46a0 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d0015ff50 con 0x7f9d000b46a0 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d04b33640 1 -- 172.21.15.82:0/3221072525 >> v1:172.21.15.183:6789/0 conn(0x7f9d000b46a0 legacy=0x7f9d000d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d04b33640 1 -- 172.21.15.82:0/3221072525 >> v1:172.21.15.82:6789/0 conn(0x7f9d0015fb70 legacy=0x7f9d000b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:01.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.063+0000 7f9d04b33640 1 -- 172.21.15.82:0/3221072525 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000cd190 con 0x7f9d000d0970 2023-07-20T11:06:01.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d04b33640 1 --2- 172.21.15.82:0/3221072525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d000d0970 0x7f9d001671b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009d90 tx=0x7f9cf801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442ba8c98bff3345 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a58c0 con 0x7f9d000d0970 2023-07-20T11:06:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf80a5a20 con 0x7f9d000d0970 2023-07-20T11:06:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9cff7fe640 1 -- 172.21.15.82:0/3221072525 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a5db0 con 0x7f9d000d0970 2023-07-20T11:06:01.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 -- 172.21.15.82:0/3221072525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d000d0970 msgr2=0x7f9d001671b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 --2- 172.21.15.82:0/3221072525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d000d0970 0x7f9d001671b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009d90 tx=0x7f9cf801c800 comp rx=0 tx=0).stop 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 -- 172.21.15.82:0/3221072525 shutdown_connections 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 --2- 172.21.15.82:0/3221072525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d000d0970 0x7f9d001671b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 -- 172.21.15.82:0/3221072525 >> 172.21.15.82:0/3221072525 conn(0x7f9d00065710 msgr2=0x7f9d00065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 -- 172.21.15.82:0/3221072525 shutdown_connections 2023-07-20T11:06:01.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.067+0000 7f9d05334640 1 -- 172.21.15.82:0/3221072525 wait complete. 2023-07-20T11:06:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 Processor -- start 2023-07-20T11:06:01.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- start start 2023-07-20T11:06:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d000b46a0 0x7f9d000b6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d0015fb70 0x7f9d00142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:01.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00156a70 con 0x7f9d000d0970 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0015c470 con 0x7f9d0015fb70 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0015d740 con 0x7f9d000b46a0 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50798/0 (socket says 172.21.15.82:50798) 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 -- 172.21.15.82:0/1410857716 learned_addr learned my addr 172.21.15.82:0/1410857716 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d04b33640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d0015fb70 0x7f9d00142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cfffff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d000b46a0 0x7f9d000b6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:01.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 -- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d000b46a0 msgr2=0x7f9d000b6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d000b46a0 0x7f9d000b6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 -- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d0015fb70 msgr2=0x7f9d00142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d0015fb70 0x7f9d00142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 -- 172.21.15.82:0/1410857716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8009a70 con 0x7f9d000d0970 2023-07-20T11:06:01.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cf7fff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c460 tx=0x7f9ce800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80052d0 con 0x7f9d000d0970 2023-07-20T11:06:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8005450 con 0x7f9d000d0970 2023-07-20T11:06:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0015c6a0 con 0x7f9d000d0970 2023-07-20T11:06:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8012870 con 0x7f9d000d0970 2023-07-20T11:06:01.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0015cf40 con 0x7f9d000d0970 2023-07-20T11:06:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.071+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0004da30 con 0x7f9d000d0970 2023-07-20T11:06:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.075+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 88) v1 ==== 85778+0+0 (secure 0 0 0) 0x7f9ce80129d0 con 0x7f9d000d0970 2023-07-20T11:06:01.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.075+0000 7f9cfd7fa640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 0x7f9ce00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.075+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f9ce8083a90 con 0x7f9d000d0970 2023-07-20T11:06:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.075+0000 7f9cfffff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 0x7f9ce00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:01.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.075+0000 7f9cfffff640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 0x7f9ce00688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00011f0 tx=0x7f9cf0007d40 comp rx=0 tx=0).ready entity=mgr.9810 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:01.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.079+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ce8050d10 con 0x7f9d000d0970 2023-07-20T11:06:01.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:01.263+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9d000c8a70 con 0x7f9d000d0970 2023-07-20T11:06:02.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.035+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f9ce8081cb0 con 0x7f9d000d0970 2023-07-20T11:06:02.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.035+0000 7f9cfd7fa640 1 -- 172.21.15.82:0/1410857716 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v89) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9ce806fac0 con 0x7f9d000d0970 2023-07-20T11:06:02.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 msgr2=0x7f9ce00688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 0x7f9ce00688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00011f0 tx=0x7f9cf0007d40 comp rx=0 tx=0).stop 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 msgr2=0x7f9d0015ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c460 tx=0x7f9ce800c920 comp rx=0 tx=0).stop 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 shutdown_connections 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f9ce00663f0 0x7f9ce00688b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9d0015fb70 0x7f9d00142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d000d0970 0x7f9d0015ac70 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 --2- 172.21.15.82:0/1410857716 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9d000b46a0 0x7f9d000b6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 >> 172.21.15.82:0/1410857716 conn(0x7f9d00065710 msgr2=0x7f9d000b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 shutdown_connections 2023-07-20T11:06:02.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.039+0000 7f9d05334640 1 -- 172.21.15.82:0/1410857716 wait complete. 2023-07-20T11:06:02.048 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:06:02.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:06:02.122 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:06:02.184 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:06:02.185 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:02.186 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:02.186 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:02.200+0000 7fef67efd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:06:02.195 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:02.195 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:02.204 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:02.223+0000 7feff6c3a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:06:02.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:02.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.411+0000 7fd961ee5640 1 Processor -- start 2023-07-20T11:06:02.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 -- start start 2023-07-20T11:06:02.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd95c0ce4c0 0x7fd95c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0d16b0 con 0x7fd95c0d0d10 2023-07-20T11:06:02.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0d31c0 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd961ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0b3520 con 0x7fd95c15cab0 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd953fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd95c0d0d10 0x7fd95c0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41000/0 (socket says 172.21.15.82:41000) 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd953fff640 1 -- 172.21.15.82:0/3855826595 learned_addr learned my addr 172.21.15.82:0/3855826595 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95bfff640 1 --2- 172.21.15.82:0/3855826595 >> v2:172.21.15.82:3300/0 conn(0x7fd95c0ce4c0 0x7fd95c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95b7fe640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95affd640 1 -- 172.21.15.82:0/3855826595 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432363389 0 0) 0x7fd95c0d16b0 con 0x7fd95c0d0d10 2023-07-20T11:06:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95affd640 1 -- 172.21.15.82:0/3855826595 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd948003530 con 0x7fd95c0d0d10 2023-07-20T11:06:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95bfff640 1 -- 172.21.15.82:0/3855826595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 msgr2=0x7fd95c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95bfff640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95bfff640 1 -- 172.21.15.82:0/3855826595 >> v1:172.21.15.82:6789/0 conn(0x7fd95c0d0d10 legacy=0x7fd95c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.415+0000 7fd95bfff640 1 -- 172.21.15.82:0/3855826595 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0b2910 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd95bfff640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0d1170 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fd954009d90 tx=0x7fd95401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f9805a3ecf78e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd95affd640 1 -- 172.21.15.82:0/3855826595 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540a5900 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd95affd640 1 -- 172.21.15.82:0/3855826595 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9540a5a60 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd95affd640 1 -- 172.21.15.82:0/3855826595 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9540a5df0 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd961ee5640 1 -- 172.21.15.82:0/3855826595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 msgr2=0x7fd95c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.419+0000 7fd961ee5640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0d1170 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fd954009d90 tx=0x7fd95401c920 comp rx=0 tx=0).stop 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- 172.21.15.82:0/3855826595 shutdown_connections 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0d1170 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 --2- 172.21.15.82:0/3855826595 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- 172.21.15.82:0/3855826595 >> 172.21.15.82:0/3855826595 conn(0x7fd95c08c120 msgr2=0x7fd95c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- 172.21.15.82:0/3855826595 shutdown_connections 2023-07-20T11:06:02.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- 172.21.15.82:0/3855826595 wait complete. 2023-07-20T11:06:02.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 Processor -- start 2023-07-20T11:06:02.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- start start 2023-07-20T11:06:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 0x7fd95c144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c145540 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cb9d0 con 0x7fd95c0d0d10 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd961ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0cbcb0 con 0x7fd95c15cab0 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50820/0 (socket says 172.21.15.82:50820) 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2639580381 learned_addr learned my addr 172.21.15.82:0/2639580381 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95bfff640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd953fff640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 0x7fd95c144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 msgr2=0x7fd95c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 msgr2=0x7fd95c144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 0x7fd95c144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 -- 172.21.15.82:0/2639580381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009a70 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd953fff640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 0x7fd95c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.423+0000 7fd95b7fe640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00e930 tx=0x7fd94c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c009690 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00ca00 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c0cbf90 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00cd70 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c1576a0 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c0cbb10 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fd94c013470 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 0x7fd93c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd953fff640 1 -- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 msgr2=0x7fd93c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fd94c084790 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.427+0000 7fd953fff640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 0x7fd93c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:02.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.431+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd94c051bb0 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd95c0cbb10 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd958ff9640 1 -- 172.21.15.82:0/2639580381 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18899 (secure 0 0 0) 0x7fd95c0cbb10 con 0x7fd95c0ce4c0 2023-07-20T11:06:02.565 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:02.566 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":159,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:59.000425+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:6832/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/3836891304":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/139796629":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1111634489":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/4005336874":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1368641827":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/166062347":"2023-07-21T11:05:59.000377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 msgr2=0x7fd93c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 0x7fd93c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 msgr2=0x7fd95c0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00e930 tx=0x7fd94c00edf0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 shutdown_connections 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd95c15cab0 0x7fd95c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fd93c0663a0 0x7fd93c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd95c0d0d10 0x7fd95c144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 --2- 172.21.15.82:0/2639580381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd95c0ce4c0 0x7fd95c0c5be0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.583+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 >> 172.21.15.82:0/2639580381 conn(0x7fd95c08c120 msgr2=0x7fd95c0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:02.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.587+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 shutdown_connections 2023-07-20T11:06:02.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.587+0000 7fd961ee5640 1 -- 172.21.15.82:0/2639580381 wait complete. 2023-07-20T11:06:02.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:05:40.201167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:05:40.599132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:06:02.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:06:02.596 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:02.612+0000 7fef67efd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:06:02.639 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:02.659+0000 7feff6c3a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:06:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 Processor -- start 2023-07-20T11:06:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 -- start start 2023-07-20T11:06:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74841602b0 0x7f7484160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f748406ab10 0x7f748406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840ce4f0 con 0x7f748406c120 2023-07-20T11:06:02.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748406b4c0 con 0x7f748406ab10 2023-07-20T11:06:02.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748b0bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74840d0970 con 0x7f74841602b0 2023-07-20T11:06:02.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f748406ab10 0x7f748406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f748406ab10 0x7f748406af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50832/0 (socket says 172.21.15.82:50832) 2023-07-20T11:06:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 -- 172.21.15.82:0/4233457587 learned_addr learned my addr 172.21.15.82:0/4233457587 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f7488e59640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f748406c120 0x7f74840cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41004/0 (socket says 172.21.15.82:41004) 2023-07-20T11:06:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f7483fff640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74841602b0 0x7f7484160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 -- 172.21.15.82:0/4233457587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74841602b0 msgr2=0x7f7484160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74841602b0 0x7f7484160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 -- 172.21.15.82:0/4233457587 >> v1:172.21.15.82:6789/0 conn(0x7f748406c120 legacy=0x7f74840cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.755+0000 7f748965a640 1 -- 172.21.15.82:0/4233457587 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484160e20 con 0x7f748406ab10 2023-07-20T11:06:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748965a640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f748406af80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f747c009e50 tx=0x7f747c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae311aaf7adf9a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f74837fe640 1 -- 172.21.15.82:0/4233457587 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0a5730 con 0x7f748406ab10 2023-07-20T11:06:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f74837fe640 1 -- 172.21.15.82:0/4233457587 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c0a5890 con 0x7f748406ab10 2023-07-20T11:06:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f74837fe640 1 -- 172.21.15.82:0/4233457587 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0a5c20 con 0x7f748406ab10 2023-07-20T11:06:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 -- 172.21.15.82:0/4233457587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 msgr2=0x7f748406af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f748406af80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f747c009e50 tx=0x7f747c01c980 comp rx=0 tx=0).stop 2023-07-20T11:06:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 -- 172.21.15.82:0/4233457587 shutdown_connections 2023-07-20T11:06:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f748406af80 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 --2- 172.21.15.82:0/4233457587 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74841602b0 0x7f7484160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 -- 172.21.15.82:0/4233457587 >> 172.21.15.82:0/4233457587 conn(0x7f748408c0a0 msgr2=0x7f748409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 -- 172.21.15.82:0/4233457587 shutdown_connections 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.759+0000 7f748b0bd640 1 -- 172.21.15.82:0/4233457587 wait complete. 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 Processor -- start 2023-07-20T11:06:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- start start 2023-07-20T11:06:02.747 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:02.764+0000 7fef67efd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 0x7f748414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74841602b0 0x7f7484154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484150080 con 0x7f748406ab10 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748414b0a0 con 0x7f74841602b0 2023-07-20T11:06:02.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7484153e30 con 0x7f748406c120 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7488e59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7488e59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50838/0 (socket says 172.21.15.82:50838) 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 0x7f748414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748965a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74841602b0 0x7f7484154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7488e59640 1 -- 172.21.15.82:0/3697165 learned_addr learned my addr 172.21.15.82:0/3697165 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 -- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74841602b0 msgr2=0x7f7484154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74841602b0 0x7f7484154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 -- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 msgr2=0x7f74840c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 -- 172.21.15.82:0/3697165 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c009b30 con 0x7f748406c120 2023-07-20T11:06:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7488e59640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:02.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f7483fff640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 0x7f748414ab60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f747000e870 tx=0x7f747000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:02.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000ee60 con 0x7f748406c120 2023-07-20T11:06:02.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747000c940 con 0x7f748406c120 2023-07-20T11:06:02.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74841502d0 con 0x7f748406c120 2023-07-20T11:06:02.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747000ccd0 con 0x7f748406c120 2023-07-20T11:06:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7484150890 con 0x7f748406c120 2023-07-20T11:06:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.763+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748404da30 con 0x7f748406c120 2023-07-20T11:06:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.767+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f7470013470 con 0x7f748406c120 2023-07-20T11:06:02.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.767+0000 7f74817fa640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 0x7f7468068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.767+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f74700840c0 con 0x7f748406c120 2023-07-20T11:06:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.767+0000 7f7488e59640 1 -- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 msgr2=0x7f7468068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.767+0000 7f7488e59640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 0x7f7468068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:02.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.771+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74700512a0 con 0x7f748406c120 2023-07-20T11:06:02.796 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:02.815+0000 7feff6c3a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:06:02.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74840cee40 con 0x7f748406c120 2023-07-20T11:06:02.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f74817fa640 1 -- 172.21.15.82:0/3697165 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74700548c0 con 0x7f748406c120 2023-07-20T11:06:02.905 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:06:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 msgr2=0x7f7468068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 0x7f7468068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 msgr2=0x7f748414ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 0x7f748414ab60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f747000e870 tx=0x7f747000ed30 comp rx=0 tx=0).stop 2023-07-20T11:06:02.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 shutdown_connections 2023-07-20T11:06:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f74680663a0 0x7f7468068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74841602b0 0x7f7484154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748406c120 0x7f748414ab60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 --2- 172.21.15.82:0/3697165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748406ab10 0x7f74840c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:02.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.923+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 >> 172.21.15.82:0/3697165 conn(0x7f748408c0a0 msgr2=0x7f748415f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.927+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 shutdown_connections 2023-07-20T11:06:02.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:02.927+0000 7f748b0bd640 1 -- 172.21.15.82:0/3697165 wait complete. 2023-07-20T11:06:02.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:06:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.091+0000 7fc24b46d640 1 Processor -- start 2023-07-20T11:06:03.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.091+0000 7fc24b46d640 1 -- start start 2023-07-20T11:06:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc24b46d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc24406b220 0x7fc244160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc24b46d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440ce4f0 con 0x7fc2441602b0 2023-07-20T11:06:03.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc24b46d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440d0970 con 0x7fc24406c120 2023-07-20T11:06:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc24b46d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc244160e20 con 0x7fc24406b220 2023-07-20T11:06:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc249a0a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc24406b220 0x7fc244160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc248a08640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc2441602b0 0x7fc24406ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41016/0 (socket says 172.21.15.82:41016) 2023-07-20T11:06:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc248a08640 1 -- 172.21.15.82:0/3857639313 learned_addr learned my addr 172.21.15.82:0/3857639313 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc249a0a640 1 -- 172.21.15.82:0/3857639313 >> v1:172.21.15.183:6789/0 conn(0x7fc24406c120 legacy=0x7fc2440cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc249a0a640 1 -- 172.21.15.82:0/3857639313 >> v1:172.21.15.82:6789/0 conn(0x7fc2441602b0 legacy=0x7fc24406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc249a0a640 1 -- 172.21.15.82:0/3857639313 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440cd300 con 0x7fc24406b220 2023-07-20T11:06:03.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.095+0000 7fc23bfff640 1 -- 172.21.15.82:0/3857639313 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754192377 0 0) 0x7fc2440ce4f0 con 0x7fc2441602b0 2023-07-20T11:06:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc249a0a640 1 --2- 172.21.15.82:0/3857639313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24406b220 0x7fc244160740 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009d90 tx=0x7fc23c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bea90e67a1a9b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc23bfff640 1 -- 172.21.15.82:0/3857639313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a58c0 con 0x7fc24406b220 2023-07-20T11:06:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc23bfff640 1 -- 172.21.15.82:0/3857639313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0a5a20 con 0x7fc24406b220 2023-07-20T11:06:03.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc23bfff640 1 -- 172.21.15.82:0/3857639313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a5db0 con 0x7fc24406b220 2023-07-20T11:06:03.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- 172.21.15.82:0/3857639313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24406b220 msgr2=0x7fc244160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 --2- 172.21.15.82:0/3857639313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24406b220 0x7fc244160740 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009d90 tx=0x7fc23c01c800 comp rx=0 tx=0).stop 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- 172.21.15.82:0/3857639313 shutdown_connections 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 --2- 172.21.15.82:0/3857639313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc24406b220 0x7fc244160740 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- 172.21.15.82:0/3857639313 >> 172.21.15.82:0/3857639313 conn(0x7fc24408c0a0 msgr2=0x7fc24409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- 172.21.15.82:0/3857639313 shutdown_connections 2023-07-20T11:06:03.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- 172.21.15.82:0/3857639313 wait complete. 2023-07-20T11:06:03.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 Processor -- start 2023-07-20T11:06:03.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.099+0000 7fc24b46d640 1 -- start start 2023-07-20T11:06:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc24406b220 0x7fc2441519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 0x7fc2440cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440ca8f0 con 0x7fc2441602b0 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c72e0 con 0x7fc24406c120 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c75c0 con 0x7fc24406b220 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc249a0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc249a0a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50860/0 (socket says 172.21.15.82:50860) 2023-07-20T11:06:03.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 0x7fc2440cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc249a0a640 1 -- 172.21.15.82:0/1599393561 learned_addr learned my addr 172.21.15.82:0/1599393561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:03.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc249209640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc24406b220 0x7fc2441519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 -- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc24406b220 msgr2=0x7fc2441519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc24406b220 0x7fc2441519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 -- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 msgr2=0x7fc2440cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 -- 172.21.15.82:0/1599393561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009a70 con 0x7fc24406c120 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc249a0a640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc248a08640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 0x7fc2440cc120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c3e0 tx=0x7fc23400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340074e0 con 0x7fc24406c120 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234007640 con 0x7fc24406c120 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234004a30 con 0x7fc24406c120 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440c78a0 con 0x7fc24406c120 2023-07-20T11:06:03.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244151ee0 con 0x7fc24406c120 2023-07-20T11:06:03.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.103+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24404da30 con 0x7fc24406c120 2023-07-20T11:06:03.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.107+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fc234004b90 con 0x7fc24406c120 2023-07-20T11:06:03.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.107+0000 7fc239ffb640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 0x7fc228068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.107+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fc234083cd0 con 0x7fc24406c120 2023-07-20T11:06:03.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.107+0000 7fc249209640 1 -- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 msgr2=0x7fc228068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:03.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.107+0000 7fc249209640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 0x7fc228068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:03.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.111+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc234050eb0 con 0x7fc24406c120 2023-07-20T11:06:03.225 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.240+0000 7fef67efd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:03.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.259+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2440cee40 con 0x7fc24406c120 2023-07-20T11:06:03.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.263+0000 7fc239ffb640 1 -- 172.21.15.82:0/1599393561 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc234001070 con 0x7fc24406c120 2023-07-20T11:06:03.244 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:06:03.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.263+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 msgr2=0x7fc228068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:03.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.263+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 0x7fc228068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.263+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 msgr2=0x7fc2440cc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.263+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 0x7fc2440cc120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc23400c3e0 tx=0x7fc23400c8a0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 shutdown_connections 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2441602b0 0x7fc2440cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fc2280663d0 0x7fc228068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc24406c120 0x7fc2440cc120 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 --2- 172.21.15.82:0/1599393561 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc24406b220 0x7fc2441519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 >> 172.21.15.82:0/1599393561 conn(0x7fc24408c0a0 msgr2=0x7fc24406ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 shutdown_connections 2023-07-20T11:06:03.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.267+0000 7fc24b46d640 1 -- 172.21.15.82:0/1599393561 wait complete. 2023-07-20T11:06:03.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:06:03.284 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.300+0000 7fef67efd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:06:03.308 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.327+0000 7feff6c3a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:03.338 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.356+0000 7fef67efd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:06:03.368 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.387+0000 7feff6c3a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:06:03.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 Processor -- start 2023-07-20T11:06:03.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 -- start start 2023-07-20T11:06:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefd806c120 0x7fefd80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fefd81602b0 0x7fefd8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd80d0970 con 0x7fefd806ab10 2023-07-20T11:06:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd8160e20 con 0x7fefd806c120 2023-07-20T11:06:03.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefdce6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd80cd300 con 0x7fefd81602b0 2023-07-20T11:06:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fefd806c120 0x7fefd80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd6d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fefd806ab10 0x7fefd806af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60890/0 (socket says 172.21.15.82:60890) 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd6d9d640 1 -- 172.21.15.82:0/1219273211 learned_addr learned my addr 172.21.15.82:0/1219273211 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefcffff640 1 --2- 172.21.15.82:0/1219273211 >> v2:172.21.15.183:3300/0 conn(0x7fefd81602b0 0x7fefd8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd659c640 1 -- 172.21.15.82:0/1219273211 >> v2:172.21.15.183:3300/0 conn(0x7fefd81602b0 msgr2=0x7fefd8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd659c640 1 --2- 172.21.15.82:0/1219273211 >> v2:172.21.15.183:3300/0 conn(0x7fefd81602b0 0x7fefd8160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd659c640 1 -- 172.21.15.82:0/1219273211 >> v1:172.21.15.82:6789/0 conn(0x7fefd806ab10 legacy=0x7fefd806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd659c640 1 -- 172.21.15.82:0/1219273211 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80cd5e0 con 0x7fefd806c120 2023-07-20T11:06:03.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.439+0000 7fefd5d9b640 1 -- 172.21.15.82:0/1219273211 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600261016 0 0) 0x7fefd80d0970 con 0x7fefd806ab10 2023-07-20T11:06:03.424 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.440+0000 7fef67efd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:06:03.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefd659c640 1 --2- 172.21.15.82:0/1219273211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd806c120 0x7fefd80cdde0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fefd808ca40 tx=0x7fefc801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277235c858898f92 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefd5d9b640 1 -- 172.21.15.82:0/1219273211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80ab600 con 0x7fefd806c120 2023-07-20T11:06:03.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefd5d9b640 1 -- 172.21.15.82:0/1219273211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc80a7050 con 0x7fefd806c120 2023-07-20T11:06:03.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefd5d9b640 1 -- 172.21.15.82:0/1219273211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80ab980 con 0x7fefd806c120 2023-07-20T11:06:03.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 -- 172.21.15.82:0/1219273211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd806c120 msgr2=0x7fefd80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 --2- 172.21.15.82:0/1219273211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd806c120 0x7fefd80cdde0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fefd808ca40 tx=0x7fefc801c310 comp rx=0 tx=0).stop 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 -- 172.21.15.82:0/1219273211 shutdown_connections 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 --2- 172.21.15.82:0/1219273211 >> v2:172.21.15.183:3300/0 conn(0x7fefd81602b0 0x7fefd8160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 --2- 172.21.15.82:0/1219273211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd806c120 0x7fefd80cdde0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 -- 172.21.15.82:0/1219273211 >> 172.21.15.82:0/1219273211 conn(0x7fefd808c0a0 msgr2=0x7fefd809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 -- 172.21.15.82:0/1219273211 shutdown_connections 2023-07-20T11:06:03.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.443+0000 7fefdce6d640 1 -- 172.21.15.82:0/1219273211 wait complete. 2023-07-20T11:06:03.428 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.447+0000 7feff6c3a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:06:03.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 Processor -- start 2023-07-20T11:06:03.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- start start 2023-07-20T11:06:03.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefd806ab10 0x7fefd80c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 0x7fefd80b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 0x7fefd8156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80b65c0 con 0x7fefd81602b0 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80b68a0 con 0x7fefd806c120 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80b6b80 con 0x7fefd806ab10 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefd6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 0x7fefd8156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefd6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 0x7fefd8156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58186/0 (socket says 172.21.15.82:58186) 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 0x7fefd80b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefd6d9d640 1 -- 172.21.15.82:0/2426160860 learned_addr learned my addr 172.21.15.82:0/2426160860 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefd659c640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefd806ab10 0x7fefd80c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 -- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefd806ab10 msgr2=0x7fefd80c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefd806ab10 0x7fefd80c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 -- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 msgr2=0x7fefd8156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 0x7fefd8156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 -- 172.21.15.82:0/2426160860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8009420 con 0x7fefd806c120 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefcffff640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 0x7fefd80b7380 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fefc000e870 tx=0x7fefc000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000ee60 con 0x7fefd806c120 2023-07-20T11:06:03.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc000c940 con 0x7fefd806c120 2023-07-20T11:06:03.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc000ccd0 con 0x7fefd806c120 2023-07-20T11:06:03.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80b6e60 con 0x7fefd806c120 2023-07-20T11:06:03.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.447+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd80b78c0 con 0x7fefd806c120 2023-07-20T11:06:03.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80b7080 con 0x7fefd806c120 2023-07-20T11:06:03.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fefc0013470 con 0x7fefd806c120 2023-07-20T11:06:03.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefceffd640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 0x7fefb8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fefc0084020 con 0x7fefd806c120 2023-07-20T11:06:03.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefd659c640 1 -- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 msgr2=0x7fefb8068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:03.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.451+0000 7fefd659c640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 0x7fefb8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:03.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.455+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefc00512a0 con 0x7fefd806c120 2023-07-20T11:06:03.480 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.496+0000 7fef67efd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:06:03.519 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.535+0000 7feff6c3a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:06:03.566 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.584+0000 7fef67efd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:06:03.576 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.595+0000 7feff6c3a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:06:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.607+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefd804da30 con 0x7fefd806c120 2023-07-20T11:06:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.607+0000 7fefceffd640 1 -- 172.21.15.82:0/2426160860 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefc00548c0 con 0x7fefd806c120 2023-07-20T11:06:03.590 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:06:03.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 msgr2=0x7fefb8068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 0x7fefb8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 msgr2=0x7fefd80b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 0x7fefd80b7380 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fefc000e870 tx=0x7fefc000ed30 comp rx=0 tx=0).stop 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 shutdown_connections 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefd81602b0 0x7fefd8156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fefb80663a0 0x7fefb8068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fefd806c120 0x7fefd80b7380 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 --2- 172.21.15.82:0/2426160860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fefd806ab10 0x7fefd80c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 >> 172.21.15.82:0/2426160860 conn(0x7fefd808c0a0 msgr2=0x7fefd806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 shutdown_connections 2023-07-20T11:06:03.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.611+0000 7fefdce6d640 1 -- 172.21.15.82:0/2426160860 wait complete. 2023-07-20T11:06:03.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:06:03.622 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.640+0000 7fef67efd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:06:03.662 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.679+0000 7feff6c3a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:06:03.721 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.739+0000 7feff6c3a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:06:03.762 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.780+0000 7fef67efd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:06:03.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.815+0000 7fa308261640 1 Processor -- start 2023-07-20T11:06:03.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.815+0000 7fa308261640 1 -- start start 2023-07-20T11:06:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa308261640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa300159450 0x7fa30015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa308261640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa3000afd50 0x7fa3000b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa308261640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000b06b0 con 0x7fa300159830 2023-07-20T11:06:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa308261640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000cce90 con 0x7fa300159450 2023-07-20T11:06:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa308261640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000cc8d0 con 0x7fa3000afd50 2023-07-20T11:06:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa300159450 0x7fa30015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa300159450 0x7fa30015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58194/0 (socket says 172.21.15.82:58194) 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 -- 172.21.15.82:0/1014975167 learned_addr learned my addr 172.21.15.82:0/1014975167 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa3057fc640 1 --1- 172.21.15.82:0/1014975167 >> v1:172.21.15.82:6789/0 conn(0x7fa300159830 0x7fa3000cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60906/0 (socket says 172.21.15.82:60906) 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa3067fe640 1 --2- 172.21.15.82:0/1014975167 >> v2:172.21.15.183:3300/0 conn(0x7fa3000afd50 0x7fa3000b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 -- 172.21.15.82:0/1014975167 >> v2:172.21.15.183:3300/0 conn(0x7fa3000afd50 msgr2=0x7fa3000b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 --2- 172.21.15.82:0/1014975167 >> v2:172.21.15.183:3300/0 conn(0x7fa3000afd50 0x7fa3000b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 -- 172.21.15.82:0/1014975167 >> v1:172.21.15.82:6789/0 conn(0x7fa300159830 legacy=0x7fa3000cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa305ffd640 1 -- 172.21.15.82:0/1014975167 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000ccbb0 con 0x7fa300159450 2023-07-20T11:06:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.819+0000 7fa304ffb640 1 -- 172.21.15.82:0/1014975167 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072915165 0 0) 0x7fa3000b06b0 con 0x7fa300159830 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa305ffd640 1 --2- 172.21.15.82:0/1014975167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa300159450 0x7fa30015a4c0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa3000c1da0 tx=0x7fa2fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93afbd8f9f0470a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa304ffb640 1 -- 172.21.15.82:0/1014975167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0aa430 con 0x7fa300159450 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa304ffb640 1 -- 172.21.15.82:0/1014975167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0aa590 con 0x7fa300159450 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa304ffb640 1 -- 172.21.15.82:0/1014975167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0aa920 con 0x7fa300159450 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- 172.21.15.82:0/1014975167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa300159450 msgr2=0x7fa30015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 --2- 172.21.15.82:0/1014975167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa300159450 0x7fa30015a4c0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa3000c1da0 tx=0x7fa2fc01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- 172.21.15.82:0/1014975167 shutdown_connections 2023-07-20T11:06:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 --2- 172.21.15.82:0/1014975167 >> v2:172.21.15.183:3300/0 conn(0x7fa3000afd50 0x7fa3000b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 --2- 172.21.15.82:0/1014975167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa300159450 0x7fa30015a4c0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- 172.21.15.82:0/1014975167 >> 172.21.15.82:0/1014975167 conn(0x7fa3000cad50 msgr2=0x7fa3000cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- 172.21.15.82:0/1014975167 shutdown_connections 2023-07-20T11:06:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- 172.21.15.82:0/1014975167 wait complete. 2023-07-20T11:06:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 Processor -- start 2023-07-20T11:06:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.823+0000 7fa308261640 1 -- start start 2023-07-20T11:06:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa300159450 0x7fa3001f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa300153120 0x7fa3001f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300158c20 con 0x7fa3000afd50 2023-07-20T11:06:03.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b3ae0 con 0x7fa300153120 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b3da0 con 0x7fa300159450 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58204/0 (socket says 172.21.15.82:58204) 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 -- 172.21.15.82:0/3226633159 learned_addr learned my addr 172.21.15.82:0/3226633159 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa3067fe640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa300153120 0x7fa3001f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa3057fc640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa300159450 0x7fa3001f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 -- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa300159450 msgr2=0x7fa3001f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa300159450 0x7fa3001f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 -- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa300153120 msgr2=0x7fa3001f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa300153120 0x7fa3001f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 -- 172.21.15.82:0/3226633159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc0094d0 con 0x7fa3000afd50 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa305ffd640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0190e0 tx=0x7fa2fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0aa430 con 0x7fa3000afd50 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0b3800 con 0x7fa3000afd50 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0b3bb0 con 0x7fa3000afd50 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3001585d0 con 0x7fa3000afd50 2023-07-20T11:06:03.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa300153c50 con 0x7fa3000afd50 2023-07-20T11:06:03.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30004da30 con 0x7fa3000afd50 2023-07-20T11:06:03.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.827+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fa2fc0b3d10 con 0x7fa3000afd50 2023-07-20T11:06:03.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.831+0000 7fa2f67fc640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 0x7fa2e4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:03.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.831+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fa2fc11e600 con 0x7fa3000afd50 2023-07-20T11:06:03.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.831+0000 7fa3057fc640 1 -- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 msgr2=0x7fa2e4068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:03.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.831+0000 7fa3057fc640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 0x7fa2e4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:03.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.835+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2fc0eb6d0 con 0x7fa3000afd50 2023-07-20T11:06:03.822 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:03.840+0000 7fef67efd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:06:03.882 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.899+0000 7feff6c3a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:06:03.942 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:03.959+0000 7feff6c3a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:06:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.995+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa300072e00 con 0x7fa3000afd50 2023-07-20T11:06:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.995+0000 7fa2f67fc640 1 -- 172.21.15.82:0/3226633159 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2fc0eecf0 con 0x7fa3000afd50 2023-07-20T11:06:03.978 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:06:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 msgr2=0x7fa2e4068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 0x7fa2e4068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 msgr2=0x7fa3000c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0190e0 tx=0x7fa2fc01ad10 comp rx=0 tx=0).stop 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 shutdown_connections 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fa2e40663a0 0x7fa2e4068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa300153120 0x7fa3001f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa300159450 0x7fa3001f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 --2- 172.21.15.82:0/3226633159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3000afd50 0x7fa3000c37c0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 >> 172.21.15.82:0/3226633159 conn(0x7fa3000cad50 msgr2=0x7fa30015c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 shutdown_connections 2023-07-20T11:06:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:03.999+0000 7fa308261640 1 -- 172.21.15.82:0/3226633159 wait complete. 2023-07-20T11:06:04.001 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T11:06:04.061 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:06:04.061 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:06:04.062 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:06:04.069 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:04.088+0000 7fef67efd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:06:04.193 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:06:04.194 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:06:04.194 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:06:04.202 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:04.219+0000 7feff6c3a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:06:04.202 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:04.220+0000 7fef67efd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:04.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 Processor -- start 2023-07-20T11:06:04.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 -- start start 2023-07-20T11:06:04.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22140cd4b0 0x7f22140cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140d16b0 con 0x7f221415cab0 2023-07-20T11:06:04.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140d31c0 con 0x7f22140cd4b0 2023-07-20T11:06:04.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221bf37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b3520 con 0x7f22140d0d10 2023-07-20T11:06:04.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f22194d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221a4d4640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22140cd4b0 0x7f22140cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f22194d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:41064/0 (socket says 172.21.15.82:41064) 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f22194d2640 1 -- 172.21.15.82:0/2056807378 learned_addr learned my addr 172.21.15.82:0/2056807378 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221a4d4640 1 -- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 msgr2=0x7f22140d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221a4d4640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221a4d4640 1 -- 172.21.15.82:0/2056807378 >> v1:172.21.15.183:6789/0 conn(0x7f221415cab0 legacy=0x7f22140d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f221a4d4640 1 -- 172.21.15.82:0/2056807378 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140d0a10 con 0x7f22140cd4b0 2023-07-20T11:06:04.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.239+0000 7f22194d2640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:04.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f221a4d4640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22140cd4b0 0x7f22140cd940 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f220c009d90 tx=0x7f220c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1ec70274be3bf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:04.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f2218cd1640 1 -- 172.21.15.82:0/2056807378 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0a59e0 con 0x7f22140cd4b0 2023-07-20T11:06:04.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f2218cd1640 1 -- 172.21.15.82:0/2056807378 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c0a5b40 con 0x7f22140cd4b0 2023-07-20T11:06:04.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f2218cd1640 1 -- 172.21.15.82:0/2056807378 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0ad440 con 0x7f22140cd4b0 2023-07-20T11:06:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f221bf37640 1 -- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22140cd4b0 msgr2=0x7f22140cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f221bf37640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22140cd4b0 0x7f22140cd940 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f220c009d90 tx=0x7f220c01c920 comp rx=0 tx=0).stop 2023-07-20T11:06:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.243+0000 7f221bf37640 1 -- 172.21.15.82:0/2056807378 shutdown_connections 2023-07-20T11:06:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22140cd4b0 0x7f22140cd940 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 --2- 172.21.15.82:0/2056807378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140d0d10 0x7f22140d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- 172.21.15.82:0/2056807378 >> 172.21.15.82:0/2056807378 conn(0x7f221408c120 msgr2=0x7f221409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- 172.21.15.82:0/2056807378 shutdown_connections 2023-07-20T11:06:04.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- 172.21.15.82:0/2056807378 wait complete. 2023-07-20T11:06:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 Processor -- start 2023-07-20T11:06:04.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- start start 2023-07-20T11:06:04.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140cd4b0 0x7f221414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221415cab0 0x7f2214154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214153780 con 0x7f22140d0d10 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140cc1c0 con 0x7f221415cab0 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221bf37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221415bd90 con 0x7f22140cd4b0 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f22194d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f22194d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58206/0 (socket says 172.21.15.82:58206) 2023-07-20T11:06:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f22194d2640 1 -- 172.21.15.82:0/3155563711 learned_addr learned my addr 172.21.15.82:0/3155563711 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f2219cd3640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140cd4b0 0x7f221414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.247+0000 7f221a4d4640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221415cab0 0x7f2214154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 -- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140cd4b0 msgr2=0x7f221414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140cd4b0 0x7f221414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 -- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221415cab0 msgr2=0x7f2214154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221415cab0 0x7f2214154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 -- 172.21.15.82:0/3155563711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040094d0 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f22194d2640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f220400e960 tx=0x7f220400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400c9a0 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220400cb00 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220400ce70 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220c009a70 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221415a610 con 0x7f22140d0d10 2023-07-20T11:06:04.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2214073c70 con 0x7f22140d0d10 2023-07-20T11:06:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f2204013470 con 0x7f22140d0d10 2023-07-20T11:06:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 0x7f21f8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.251+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f22040841b0 con 0x7f22140d0d10 2023-07-20T11:06:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.255+0000 7f2219cd3640 1 -- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 msgr2=0x7f21f8068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:04.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.255+0000 7f2219cd3640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 0x7f21f8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:04.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.255+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2204051420 con 0x7f22140d0d10 2023-07-20T11:06:04.330 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:04.348+0000 7fef67efd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:04.342 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:04.359+0000 7feff6c3a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:04.400 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:04.416+0000 7fef67efd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:06:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f221415bfe0 con 0x7f22140d0d10 2023-07-20T11:06:04.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f220a7fc640 1 -- 172.21.15.82:0/3155563711 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v159) v1 ==== 80+0+468 (secure 0 0 0) 0x7f2204054a40 con 0x7f22140d0d10 2023-07-20T11:06:04.401 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/2615753715 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.401 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/2615753715 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.402 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3836891304 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.402 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/139796629 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.402 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1111634489 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.402 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4005336874 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.402 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1368641827 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.403 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/166062347 2023-07-21T11:05:59.000377+0000 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 msgr2=0x7f21f8068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 0x7f21f8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 msgr2=0x7f2214153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f220400e960 tx=0x7f220400ee20 comp rx=0 tx=0).stop 2023-07-20T11:06:04.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 shutdown_connections 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f21f80663a0 0x7f21f8068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f221415cab0 0x7f2214154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22140d0d10 0x7f2214153240 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 --2- 172.21.15.82:0/3155563711 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22140cd4b0 0x7f221414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 >> 172.21.15.82:0/3155563711 conn(0x7f221408c120 msgr2=0x7f22140af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 shutdown_connections 2023-07-20T11:06:04.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.419+0000 7f221bf37640 1 -- 172.21.15.82:0/3155563711 wait complete. 2023-07-20T11:06:04.422 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T11:06:04.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:04.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T11:06:04.475 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:04.491+0000 7feff6c3a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:04.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:06:04.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:04.481 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T11:06:04.490 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:06:04.491 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:04.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:06:04.501 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:04.501 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:04.535 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:04.552+0000 7fef67efd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:04.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:06:04.540 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:06:04.540 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:04.547 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:04.567+0000 7feff6c3a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:06:04.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:06:04.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:04.686 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:04.703+0000 7feff6c3a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:04.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.707+0000 7f0ec05ba640 1 Processor -- start 2023-07-20T11:06:04.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.707+0000 7f0ec05ba640 1 -- start start 2023-07-20T11:06:04.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ec05ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eb815cab0 0x7f0eb80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ec05ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0eb80d0d10 0x7f0eb80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ec05ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80d16b0 con 0x7f0eb80cf110 2023-07-20T11:06:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ec05ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80d31c0 con 0x7f0eb815cab0 2023-07-20T11:06:04.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ec05ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80b3520 con 0x7f0eb80d0d10 2023-07-20T11:06:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eb815cab0 0x7f0eb80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0eb815cab0 0x7f0eb80d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58220/0 (socket says 172.21.15.82:58220) 2023-07-20T11:06:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 -- 172.21.15.82:0/2135054589 learned_addr learned my addr 172.21.15.82:0/2135054589 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:04.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebdb55640 1 --2- 172.21.15.82:0/2135054589 >> v2:172.21.15.183:3300/0 conn(0x7f0eb80d0d10 0x7f0eb80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 -- 172.21.15.82:0/2135054589 >> v2:172.21.15.183:3300/0 conn(0x7f0eb80d0d10 msgr2=0x7f0eb80d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:04.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 --2- 172.21.15.82:0/2135054589 >> v2:172.21.15.183:3300/0 conn(0x7f0eb80d0d10 0x7f0eb80d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 -- 172.21.15.82:0/2135054589 >> v1:172.21.15.183:6789/0 conn(0x7f0eb80cf110 legacy=0x7f0eb80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.711+0000 7f0ebe356640 1 -- 172.21.15.82:0/2135054589 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80b2910 con 0x7f0eb815cab0 2023-07-20T11:06:04.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ebe356640 1 --2- 172.21.15.82:0/2135054589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb815cab0 0x7f0eb80d0300 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80d0190 tx=0x7f0eb401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e178e6e80b27a6e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:04.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ebd354640 1 -- 172.21.15.82:0/2135054589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40aa430 con 0x7f0eb815cab0 2023-07-20T11:06:04.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ebd354640 1 -- 172.21.15.82:0/2135054589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb40aa590 con 0x7f0eb815cab0 2023-07-20T11:06:04.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ebd354640 1 -- 172.21.15.82:0/2135054589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40aa920 con 0x7f0eb815cab0 2023-07-20T11:06:04.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2135054589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb815cab0 msgr2=0x7f0eb80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2135054589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb815cab0 0x7f0eb80d0300 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80d0190 tx=0x7f0eb401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2135054589 shutdown_connections 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2135054589 >> v2:172.21.15.183:3300/0 conn(0x7f0eb80d0d10 0x7f0eb80d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2135054589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb815cab0 0x7f0eb80d0300 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2135054589 >> 172.21.15.82:0/2135054589 conn(0x7f0eb808c120 msgr2=0x7f0eb809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2135054589 shutdown_connections 2023-07-20T11:06:04.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2135054589 wait complete. 2023-07-20T11:06:04.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 Processor -- start 2023-07-20T11:06:04.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.715+0000 7f0ec05ba640 1 -- start start 2023-07-20T11:06:04.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 0x7f0eb80cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0eb815cab0 0x7f0eb80cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80caf30 con 0x7f0eb80cf110 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80ca2b0 con 0x7f0eb815cab0 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80ca590 con 0x7f0eb80d0d10 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58232/0 (socket says 172.21.15.82:58232) 2023-07-20T11:06:04.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 -- 172.21.15.82:0/2772937011 learned_addr learned my addr 172.21.15.82:0/2772937011 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:04.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebdb55640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 0x7f0eb80cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebeb57640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0eb815cab0 0x7f0eb80cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:04.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 -- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 msgr2=0x7f0eb80cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 0x7f0eb80cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 -- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0eb815cab0 msgr2=0x7f0eb80cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0eb815cab0 0x7f0eb80cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 -- 172.21.15.82:0/2772937011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40094d0 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebdb55640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 0x7f0eb80cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ebe356640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40190e0 tx=0x7f0eb401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40aa430 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb40b3800 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80ca870 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40b3b90 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb81563b0 con 0x7f0eb80cf110 2023-07-20T11:06:04.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb80cb070 con 0x7f0eb80cf110 2023-07-20T11:06:04.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.719+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f0eb40b3cf0 con 0x7f0eb80cf110 2023-07-20T11:06:04.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.723+0000 7f0eaeffd640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 0x7f0e9c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:04.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.723+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f0eb411e990 con 0x7f0eb80cf110 2023-07-20T11:06:04.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.723+0000 7f0ebdb55640 1 -- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 msgr2=0x7f0e9c068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:04.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.723+0000 7f0ebdb55640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 0x7f0e9c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:04.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.727+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0eb80cb070 con 0x7f0eb80cf110 2023-07-20T11:06:04.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eb80cb070 con 0x7f0eb80cf110 2023-07-20T11:06:04.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0eaeffd640 1 -- 172.21.15.82:0/2772937011 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f0eb80cb070 con 0x7f0eb80cf110 2023-07-20T11:06:04.889 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:04.889 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:06:04.890 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:06:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 msgr2=0x7f0e9c068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 0x7f0e9c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 msgr2=0x7f0eb8155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:04.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40190e0 tx=0x7f0eb401ad10 comp rx=0 tx=0).stop 2023-07-20T11:06:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 shutdown_connections 2023-07-20T11:06:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7f0e9c0663d0 0x7f0e9c068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0eb815cab0 0x7f0eb80cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0eb80d0d10 0x7f0eb80cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.907+0000 7f0ec05ba640 1 --2- 172.21.15.82:0/2772937011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0eb80cf110 0x7f0eb8155e70 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:04.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.911+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 >> 172.21.15.82:0/2772937011 conn(0x7f0eb808c120 msgr2=0x7f0eb80b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:04.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.911+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 shutdown_connections 2023-07-20T11:06:04.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:04.911+0000 7f0ec05ba640 1 -- 172.21.15.82:0/2772937011 wait complete. 2023-07-20T11:06:04.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:05.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.071+0000 7fbb18061640 1 Processor -- start 2023-07-20T11:06:05.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 -- start start 2023-07-20T11:06:05.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbb1015a8e0 0x7fbb100ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb100b2060 0x7fbb100b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb100b06c0 con 0x7fbb100afda0 2023-07-20T11:06:05.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb100b3160 con 0x7fbb100b2060 2023-07-20T11:06:05.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb18061640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb100b12a0 con 0x7fbb1015a8e0 2023-07-20T11:06:05.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb100b2060 0x7fbb100b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbb100b2060 0x7fbb100b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58234/0 (socket says 172.21.15.82:58234) 2023-07-20T11:06:05.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 -- 172.21.15.82:0/4288226653 learned_addr learned my addr 172.21.15.82:0/4288226653 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:05.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb155fc640 1 --2- 172.21.15.82:0/4288226653 >> v2:172.21.15.183:3300/0 conn(0x7fbb1015a8e0 0x7fbb100ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 -- 172.21.15.82:0/4288226653 >> v2:172.21.15.183:3300/0 conn(0x7fbb1015a8e0 msgr2=0x7fbb100ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:05.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 --2- 172.21.15.82:0/4288226653 >> v2:172.21.15.183:3300/0 conn(0x7fbb1015a8e0 0x7fbb100ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 -- 172.21.15.82:0/4288226653 >> v1:172.21.15.183:6789/0 conn(0x7fbb100afda0 legacy=0x7fbb100b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.075+0000 7fbb165fe640 1 -- 172.21.15.82:0/4288226653 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb100b1580 con 0x7fbb100b2060 2023-07-20T11:06:05.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb165fe640 1 --2- 172.21.15.82:0/4288226653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100b2060 0x7fbb100b0180 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fbb100b0f10 tx=0x7fbb0801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61b0f3d5ca25ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb14dfb640 1 -- 172.21.15.82:0/4288226653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080a5740 con 0x7fbb100b2060 2023-07-20T11:06:05.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb14dfb640 1 -- 172.21.15.82:0/4288226653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080a58a0 con 0x7fbb100b2060 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb14dfb640 1 -- 172.21.15.82:0/4288226653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080a5c30 con 0x7fbb100b2060 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 -- 172.21.15.82:0/4288226653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100b2060 msgr2=0x7fbb100b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 --2- 172.21.15.82:0/4288226653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100b2060 0x7fbb100b0180 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fbb100b0f10 tx=0x7fbb0801c880 comp rx=0 tx=0).stop 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 -- 172.21.15.82:0/4288226653 shutdown_connections 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 --2- 172.21.15.82:0/4288226653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100b2060 0x7fbb100b0180 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 --2- 172.21.15.82:0/4288226653 >> v2:172.21.15.183:3300/0 conn(0x7fbb1015a8e0 0x7fbb100ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 -- 172.21.15.82:0/4288226653 >> 172.21.15.82:0/4288226653 conn(0x7fbb100cada0 msgr2=0x7fbb100cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 -- 172.21.15.82:0/4288226653 shutdown_connections 2023-07-20T11:06:05.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 -- 172.21.15.82:0/4288226653 wait complete. 2023-07-20T11:06:05.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.079+0000 7fbb18061640 1 Processor -- start 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- start start 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 0x7fbb10145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb1015a8e0 0x7fbb100aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1015b230 con 0x7fbb100afda0 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb100c5710 con 0x7fbb1015a8e0 2023-07-20T11:06:05.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1015db40 con 0x7fbb100b2060 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58240/0 (socket says 172.21.15.82:58240) 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 -- 172.21.15.82:0/1638471321 learned_addr learned my addr 172.21.15.82:0/1638471321 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb165fe640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb1015a8e0 0x7fbb100aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb155fc640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 0x7fbb10145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 -- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 msgr2=0x7fbb10145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 0x7fbb10145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 -- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb1015a8e0 msgr2=0x7fbb100aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb1015a8e0 0x7fbb100aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 -- 172.21.15.82:0/1638471321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009b30 con 0x7fbb100afda0 2023-07-20T11:06:05.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb155fc640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 0x7fbb10145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:05.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb15dfd640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c500 tx=0x7fbb0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c005220 con 0x7fbb100afda0 2023-07-20T11:06:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c005380 con 0x7fbb100afda0 2023-07-20T11:06:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb100c7da0 con 0x7fbb100afda0 2023-07-20T11:06:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c007270 con 0x7fbb100afda0 2023-07-20T11:06:05.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1015aec0 con 0x7fbb100afda0 2023-07-20T11:06:05.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.083+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb100c82c0 con 0x7fbb100afda0 2023-07-20T11:06:05.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.087+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fbb0c0073d0 con 0x7fbb100afda0 2023-07-20T11:06:05.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.087+0000 7fbb067fc640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 0x7fbaf4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.087+0000 7fbb155fc640 1 -- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 msgr2=0x7fbaf4068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.087+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fbb0c0838f0 con 0x7fbb100afda0 2023-07-20T11:06:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.087+0000 7fbb155fc640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 0x7fbaf4068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:05.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.091+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb100c82c0 con 0x7fbb100afda0 2023-07-20T11:06:05.076 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.092+0000 7fef67efd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:06:05.162 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.180+0000 7fef67efd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:06:05.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb1015ad20 con 0x7fbb100afda0 2023-07-20T11:06:05.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb067fc640 1 -- 172.21.15.82:0/1638471321 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18899 (secure 0 0 0) 0x7fbb1015ad20 con 0x7fbb100afda0 2023-07-20T11:06:05.229 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:05.230 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":159,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:05:59.000425+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:6832/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/3836891304":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/139796629":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1111634489":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/4005336874":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1368641827":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/166062347":"2023-07-21T11:05:59.000377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:05.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 msgr2=0x7fbaf4068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 0x7fbaf4068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 msgr2=0x7fbb1015d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c500 tx=0x7fbb0c00c9c0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 shutdown_connections 2023-07-20T11:06:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fbaf40663d0 0x7fbaf4068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbb1015a8e0 0x7fbb100aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbb100b2060 0x7fbb10145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 --2- 172.21.15.82:0/1638471321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb100afda0 0x7fbb1015d600 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 >> 172.21.15.82:0/1638471321 conn(0x7fbb100cada0 msgr2=0x7fbb10159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 shutdown_connections 2023-07-20T11:06:05.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.247+0000 7fbb18061640 1 -- 172.21.15.82:0/1638471321 wait complete. 2023-07-20T11:06:05.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:05:40.201167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:05:40.599132+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:06:05.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:06:05.252 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.267+0000 7feff6c3a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:06:05.310 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.328+0000 7fef67efd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:06:05.338 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.355+0000 7feff6c3a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:06:05.393 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.408+0000 7fef67efd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:06:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 Processor -- start 2023-07-20T11:06:05.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 -- start start 2023-07-20T11:06:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff30c06b220 0x7ff30c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c0ce4f0 con 0x7ff30c1602b0 2023-07-20T11:06:05.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30c0d0970 con 0x7ff30c06c120 2023-07-20T11:06:05.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff31478f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff30c160e20 con 0x7ff30c06b220 2023-07-20T11:06:05.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311d2a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff30c1602b0 0x7ff30c06ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60912/0 (socket says 172.21.15.82:60912) 2023-07-20T11:06:05.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311d2a640 1 -- 172.21.15.82:0/241018943 learned_addr learned my addr 172.21.15.82:0/241018943 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:05.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff312d2c640 1 --2- 172.21.15.82:0/241018943 >> v2:172.21.15.183:3300/0 conn(0x7ff30c06b220 0x7ff30c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754468964 0 0) 0x7ff30c0ce4f0 con 0x7ff30c1602b0 2023-07-20T11:06:05.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f8003530 con 0x7ff30c1602b0 2023-07-20T11:06:05.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555539308 0 0) 0x7ff30c0d0970 con 0x7ff30c06c120 2023-07-20T11:06:05.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff30c0ce4f0 con 0x7ff30c06c120 2023-07-20T11:06:05.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff312d2c640 1 -- 172.21.15.82:0/241018943 >> v1:172.21.15.183:6789/0 conn(0x7ff30c06c120 legacy=0x7ff30c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff312d2c640 1 -- 172.21.15.82:0/241018943 >> v1:172.21.15.82:6789/0 conn(0x7ff30c1602b0 legacy=0x7ff30c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.415+0000 7ff312d2c640 1 -- 172.21.15.82:0/241018943 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c0cd300 con 0x7ff30c06b220 2023-07-20T11:06:05.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff312d2c640 1 --2- 172.21.15.82:0/241018943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c160740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff30401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47c8b996f6ff3ae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040a58c0 con 0x7ff30c06b220 2023-07-20T11:06:05.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3040a5a20 con 0x7ff30c06b220 2023-07-20T11:06:05.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff311529640 1 -- 172.21.15.82:0/241018943 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040a5db0 con 0x7ff30c06b220 2023-07-20T11:06:05.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 -- 172.21.15.82:0/241018943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 msgr2=0x7ff30c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 --2- 172.21.15.82:0/241018943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c160740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff304009d90 tx=0x7ff30401c800 comp rx=0 tx=0).stop 2023-07-20T11:06:05.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 -- 172.21.15.82:0/241018943 shutdown_connections 2023-07-20T11:06:05.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 --2- 172.21.15.82:0/241018943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c160740 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 -- 172.21.15.82:0/241018943 >> 172.21.15.82:0/241018943 conn(0x7ff30c08c0a0 msgr2=0x7ff30c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 -- 172.21.15.82:0/241018943 shutdown_connections 2023-07-20T11:06:05.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.419+0000 7ff31478f640 1 -- 172.21.15.82:0/241018943 wait complete. 2023-07-20T11:06:05.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 Processor -- start 2023-07-20T11:06:05.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- start start 2023-07-20T11:06:05.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30c1602b0 0x7ff30c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c141e50 con 0x7ff30c06c120 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0b61f0 con 0x7ff30c06b220 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c0c7d60 con 0x7ff30c1602b0 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31252b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58252/0 (socket says 172.21.15.82:58252) 2023-07-20T11:06:05.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 -- 172.21.15.82:0/3273985128 learned_addr learned my addr 172.21.15.82:0/3273985128 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:05.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff312d2c640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30c1602b0 0x7ff30c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 -- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30c1602b0 msgr2=0x7ff30c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30c1602b0 0x7ff30c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 -- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 msgr2=0x7ff30c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 -- 172.21.15.82:0/3273985128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009a70 con 0x7ff30c06c120 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff311d2a640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c420 tx=0x7ff2fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc005cf0 con 0x7ff30c06c120 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc005e50 con 0x7ff30c06c120 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0072d0 con 0x7ff30c06c120 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c0b55e0 con 0x7ff30c06c120 2023-07-20T11:06:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.423+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c0b5ba0 con 0x7ff30c06c120 2023-07-20T11:06:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c0b6380 con 0x7ff30c06c120 2023-07-20T11:06:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7ff2fc007430 con 0x7ff30c06c120 2023-07-20T11:06:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff302ffd640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 0x7ff2f0068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff31252b640 1 -- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 msgr2=0x7ff2f0068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:05.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7ff2fc0835e0 con 0x7ff30c06c120 2023-07-20T11:06:05.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.427+0000 7ff31252b640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 0x7ff2f0068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.435+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2fc0507c0 con 0x7ff30c06c120 2023-07-20T11:06:05.495 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.511+0000 7feff6c3a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:06:05.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff30c04da30 con 0x7ff30c06c120 2023-07-20T11:06:05.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff302ffd640 1 -- 172.21.15.82:0/3273985128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2fc053de0 con 0x7ff30c06c120 2023-07-20T11:06:05.569 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:06:05.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 msgr2=0x7ff2f0068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 0x7ff2f0068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 msgr2=0x7ff30c156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c420 tx=0x7ff2fc00c8e0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 shutdown_connections 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff30c1602b0 0x7ff30c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff30c06c120 0x7ff30c156620 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7ff2f00663d0 0x7ff2f0068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 --2- 172.21.15.82:0/3273985128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff30c06b220 0x7ff30c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 >> 172.21.15.82:0/3273985128 conn(0x7ff30c08c0a0 msgr2=0x7ff30c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 shutdown_connections 2023-07-20T11:06:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.587+0000 7ff31478f640 1 -- 172.21.15.82:0/3273985128 wait complete. 2023-07-20T11:06:05.582 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.599+0000 7feff6c3a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:06:05.590 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:06:05.664 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.680+0000 7fef67efd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:06:05.723 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:05.740+0000 7fef67efd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:06:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.751+0000 7fe5edf58640 1 Processor -- start 2023-07-20T11:06:05.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.751+0000 7fe5edf58640 1 -- start start 2023-07-20T11:06:05.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5edf58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 0x7fe5e80cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5edf58640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80d1040 con 0x7fe5e80cf820 2023-07-20T11:06:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5edf58640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80d1320 con 0x7fe5e815c870 2023-07-20T11:06:05.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5edf58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80cfcb0 con 0x7fe5e80d20e0 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5ed757640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5e80cf820 0x7fe5e80b5610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60922/0 (socket says 172.21.15.82:60922) 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5ed757640 1 -- 172.21.15.82:0/3706047579 learned_addr learned my addr 172.21.15.82:0/3706047579 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5e7fff640 1 --2- 172.21.15.82:0/3706047579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 0x7fe5e80cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5e77fe640 1 -- 172.21.15.82:0/3706047579 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449501842 0 0) 0x7fe5e80d1040 con 0x7fe5e80cf820 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5e7fff640 1 -- 172.21.15.82:0/3706047579 >> v1:172.21.15.183:6789/0 conn(0x7fe5e815c870 legacy=0x7fe5e80d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5e7fff640 1 -- 172.21.15.82:0/3706047579 >> v1:172.21.15.82:6789/0 conn(0x7fe5e80cf820 legacy=0x7fe5e80b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.755+0000 7fe5e7fff640 1 -- 172.21.15.82:0/3706047579 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80d1600 con 0x7fe5e80d20e0 2023-07-20T11:06:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5e7fff640 1 --2- 172.21.15.82:0/3706047579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 0x7fe5e80cf2e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009770 tx=0x7fe5d401c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f5a1273a77c19f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5e77fe640 1 -- 172.21.15.82:0/3706047579 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40ab600 con 0x7fe5e80d20e0 2023-07-20T11:06:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5e77fe640 1 -- 172.21.15.82:0/3706047579 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d40a7050 con 0x7fe5e80d20e0 2023-07-20T11:06:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5e77fe640 1 -- 172.21.15.82:0/3706047579 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40ab980 con 0x7fe5e80d20e0 2023-07-20T11:06:05.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- 172.21.15.82:0/3706047579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 msgr2=0x7fe5e80cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 --2- 172.21.15.82:0/3706047579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 0x7fe5e80cf2e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009770 tx=0x7fe5d401c2f0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- 172.21.15.82:0/3706047579 shutdown_connections 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 --2- 172.21.15.82:0/3706047579 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e80d20e0 0x7fe5e80cf2e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- 172.21.15.82:0/3706047579 >> 172.21.15.82:0/3706047579 conn(0x7fe5e80654e0 msgr2=0x7fe5e80658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- 172.21.15.82:0/3706047579 shutdown_connections 2023-07-20T11:06:05.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- 172.21.15.82:0/3706047579 wait complete. 2023-07-20T11:06:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 Processor -- start 2023-07-20T11:06:05.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.759+0000 7fe5edf58640 1 -- start start 2023-07-20T11:06:05.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5e80cf820 0x7fe5e8145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e815c870 0x7fe5e8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80c7860 con 0x7fe5e80d20e0 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80c6a00 con 0x7fe5e80cf820 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80cb570 con 0x7fe5e815c870 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58260/0 (socket says 172.21.15.82:58260) 2023-07-20T11:06:05.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 -- 172.21.15.82:0/4103267240 learned_addr learned my addr 172.21.15.82:0/4103267240 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:05.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5ed757640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e815c870 0x7fe5e8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5ecf56640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5e80cf820 0x7fe5e8145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 -- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e815c870 msgr2=0x7fe5e8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e815c870 0x7fe5e8153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 -- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5e80cf820 msgr2=0x7fe5e8145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5e80cf820 0x7fe5e8145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 -- 172.21.15.82:0/4103267240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d4009420 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e7fff640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ae040 tx=0x7fe5d4019090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40b4610 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d40abe90 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40b49d0 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e80c6c50 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e80c7210 con 0x7fe5e80d20e0 2023-07-20T11:06:05.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e80c7a10 con 0x7fe5e80d20e0 2023-07-20T11:06:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.763+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 89) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fe5d40b2040 con 0x7fe5e80d20e0 2023-07-20T11:06:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.767+0000 7fe5e57fa640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 0x7fe5cc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.767+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fe5d411e0e0 con 0x7fe5e80d20e0 2023-07-20T11:06:05.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.767+0000 7fe5ecf56640 1 -- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 msgr2=0x7fe5cc068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1398603107 2023-07-20T11:06:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.767+0000 7fe5ecf56640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 0x7fe5cc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:05.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.775+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5e80c7a10 con 0x7fe5e80d20e0 2023-07-20T11:06:05.867 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.887+0000 7feff6c3a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:06:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5e80c7a10 con 0x7fe5e80d20e0 2023-07-20T11:06:05.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5e57fa640 1 -- 172.21.15.82:0/4103267240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5e80c7a10 con 0x7fe5e80d20e0 2023-07-20T11:06:05.905 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:06:05.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 msgr2=0x7fe5cc068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 0x7fe5cc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 msgr2=0x7fe5e80cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40ae040 tx=0x7fe5d4019090 comp rx=0 tx=0).stop 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 shutdown_connections 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5e815c870 0x7fe5e8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5e80d20e0 0x7fe5e80cbcf0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.82:6832/1398603107,v1:172.21.15.82:6833/1398603107] conn(0x7fe5cc0663a0 0x7fe5cc068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 --2- 172.21.15.82:0/4103267240 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5e80cf820 0x7fe5e8145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:05.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 >> 172.21.15.82:0/4103267240 conn(0x7fe5e80654e0 msgr2=0x7fe5e8154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 shutdown_connections 2023-07-20T11:06:05.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:05.923+0000 7fe5edf58640 1 -- 172.21.15.82:0/4103267240 wait complete. 2023-07-20T11:06:05.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:06:05.931 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:05.947+0000 7feff6c3a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.095+0000 7f01afd8f640 1 Processor -- start 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.095+0000 7f01afd8f640 1 -- start start 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01afd8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 0x7f01a81693b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01afd8f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a806db50 con 0x7f01a806d520 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01afd8f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a806dda0 con 0x7f01a80b08e0 2023-07-20T11:06:06.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01afd8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81698f0 con 0x7f01a8089890 2023-07-20T11:06:06.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ad32a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f01a806d520 0x7f01a8172260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60934/0 (socket says 172.21.15.82:60934) 2023-07-20T11:06:06.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ad32a640 1 -- 172.21.15.82:0/1491257510 learned_addr learned my addr 172.21.15.82:0/1491257510 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:06.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ae32c640 1 --2- 172.21.15.82:0/1491257510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 0x7f01a81693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ae32c640 1 -- 172.21.15.82:0/1491257510 >> v1:172.21.15.183:6789/0 conn(0x7f01a80b08e0 legacy=0x7f01a806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:06.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ae32c640 1 -- 172.21.15.82:0/1491257510 >> v1:172.21.15.82:6789/0 conn(0x7f01a806d520 legacy=0x7f01a8172260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.099+0000 7f01ae32c640 1 -- 172.21.15.82:0/1491257510 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a806e080 con 0x7f01a8089890 2023-07-20T11:06:06.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.103+0000 7f01ae32c640 1 --2- 172.21.15.82:0/1491257510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 0x7f01a81693b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f019801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c720335d09b5781 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01acb29640 1 -- 172.21.15.82:0/1491257510 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980ad660 con 0x7f01a8089890 2023-07-20T11:06:06.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01acb29640 1 -- 172.21.15.82:0/1491257510 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01980ad7c0 con 0x7f01a8089890 2023-07-20T11:06:06.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01acb29640 1 -- 172.21.15.82:0/1491257510 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980adb50 con 0x7f01a8089890 2023-07-20T11:06:06.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01afd8f640 1 -- 172.21.15.82:0/1491257510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 msgr2=0x7f01a81693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01afd8f640 1 --2- 172.21.15.82:0/1491257510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 0x7f01a81693b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f01980097f0 tx=0x7f019801c450 comp rx=0 tx=0).stop 2023-07-20T11:06:06.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01afd8f640 1 -- 172.21.15.82:0/1491257510 shutdown_connections 2023-07-20T11:06:06.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01afd8f640 1 --2- 172.21.15.82:0/1491257510 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a8089890 0x7f01a81693b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.107+0000 7f01afd8f640 1 -- 172.21.15.82:0/1491257510 >> 172.21.15.82:0/1491257510 conn(0x7f01a80afdc0 msgr2=0x7f01a80b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- 172.21.15.82:0/1491257510 shutdown_connections 2023-07-20T11:06:06.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- 172.21.15.82:0/1491257510 wait complete. 2023-07-20T11:06:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 Processor -- start 2023-07-20T11:06:06.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- start start 2023-07-20T11:06:06.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a806d520 0x7f01a8161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a80b08e0 0x7f01a80bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c0360 con 0x7f01a8089890 2023-07-20T11:06:06.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8161870 con 0x7f01a80b08e0 2023-07-20T11:06:06.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01afd8f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c05a0 con 0x7f01a806d520 2023-07-20T11:06:06.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01adb2b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a806d520 0x7f01a8161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58284/0 (socket says 172.21.15.82:58284) 2023-07-20T11:06:06.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 -- 172.21.15.82:0/2163921435 learned_addr learned my addr 172.21.15.82:0/2163921435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:06.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ae32c640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a80b08e0 0x7f01a80bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 -- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a806d520 msgr2=0x7f01a8161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a806d520 0x7f01a8161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 -- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a80b08e0 msgr2=0x7f01a80bfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a80b08e0 0x7f01a80bfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.111+0000 7f01ad32a640 1 -- 172.21.15.82:0/2163921435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009420 con 0x7f01a8089890 2023-07-20T11:06:06.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f01ad32a640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f01a000cbc0 tx=0x7f01a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000ad40 con 0x7f01a8089890 2023-07-20T11:06:06.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0012400 con 0x7f01a8089890 2023-07-20T11:06:06.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80c0880 con 0x7f01a8089890 2023-07-20T11:06:06.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000aea0 con 0x7f01a8089890 2023-07-20T11:06:06.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a80c0e40 con 0x7f01a8089890 2023-07-20T11:06:06.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a804da30 con 0x7f01a8089890 2023-07-20T11:06:06.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.115+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 90) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f01a00127b0 con 0x7f01a8089890 2023-07-20T11:06:06.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.119+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f01a0083980 con 0x7f01a8089890 2023-07-20T11:06:06.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.123+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01a0051000 con 0x7f01a8089890 2023-07-20T11:06:06.136 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef82e76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef82e76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef82e76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef82e76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.137 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef82e76640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.139 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef7fe70640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.139 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef7fe70640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.139 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef7fe70640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.139 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef7fe70640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.139 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:06.155+0000 7fef7fe70640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:06.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.279+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01a80b4250 con 0x7f01a8089890 2023-07-20T11:06:06.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.279+0000 7f019e7fc640 1 -- 172.21.15.82:0/2163921435 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01a0054620 con 0x7f01a8089890 2023-07-20T11:06:06.263 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:06:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 msgr2=0x7f01a80bf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f01a000cbc0 tx=0x7f01a000a430 comp rx=0 tx=0).stop 2023-07-20T11:06:06.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 shutdown_connections 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f01a80b08e0 0x7f01a80bfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01a8089890 0x7f01a80bf8e0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 --2- 172.21.15.82:0/2163921435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f01a806d520 0x7f01a8161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 >> 172.21.15.82:0/2163921435 conn(0x7f01a80afdc0 msgr2=0x7f01a81644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 shutdown_connections 2023-07-20T11:06:06.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.283+0000 7f01afd8f640 1 -- 172.21.15.82:0/2163921435 wait complete. 2023-07-20T11:06:06.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:06:06.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 Processor -- start 2023-07-20T11:06:06.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 -- start start 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22f8158ce0 0x7f22f80c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f8070970 0x7f22f8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f80c95d0 con 0x7f22f806b620 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f80c9fa0 con 0x7f22f8070970 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22fc8bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f81590c0 con 0x7f22f8158ce0 2023-07-20T11:06:06.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f8070970 0x7f22f8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f8070970 0x7f22f8070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58372/0 (socket says 172.21.15.82:58372) 2023-07-20T11:06:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 -- 172.21.15.82:0/2835089327 learned_addr learned my addr 172.21.15.82:0/2835089327 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:06.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f659c640 1 --2- 172.21.15.82:0/2835089327 >> v2:172.21.15.183:3300/0 conn(0x7f22f8158ce0 0x7f22f80c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 -- 172.21.15.82:0/2835089327 >> v2:172.21.15.183:3300/0 conn(0x7f22f8158ce0 msgr2=0x7f22f80c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 --2- 172.21.15.82:0/2835089327 >> v2:172.21.15.183:3300/0 conn(0x7f22f8158ce0 0x7f22f80c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 -- 172.21.15.82:0/2835089327 >> v1:172.21.15.82:6789/0 conn(0x7f22f806b620 legacy=0x7f22f80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.443+0000 7f22f5d9b640 1 -- 172.21.15.82:0/2835089327 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80c89c0 con 0x7f22f8070970 2023-07-20T11:06:06.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22f5d9b640 1 --2- 172.21.15.82:0/2835089327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f8070e00 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f22f806a6c0 tx=0x7f22ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea95da927e34103 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22f559a640 1 -- 172.21.15.82:0/2835089327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0ab600 con 0x7f22f8070970 2023-07-20T11:06:06.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22f559a640 1 -- 172.21.15.82:0/2835089327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec0a7050 con 0x7f22f8070970 2023-07-20T11:06:06.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22f559a640 1 -- 172.21.15.82:0/2835089327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0ab980 con 0x7f22f8070970 2023-07-20T11:06:06.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 -- 172.21.15.82:0/2835089327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 msgr2=0x7f22f8070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/2835089327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f8070e00 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f22f806a6c0 tx=0x7f22ec01c500 comp rx=0 tx=0).stop 2023-07-20T11:06:06.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 -- 172.21.15.82:0/2835089327 shutdown_connections 2023-07-20T11:06:06.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/2835089327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f8070e00 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/2835089327 >> v2:172.21.15.183:3300/0 conn(0x7f22f8158ce0 0x7f22f80c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 -- 172.21.15.82:0/2835089327 >> 172.21.15.82:0/2835089327 conn(0x7f22f80cad50 msgr2=0x7f22f80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 -- 172.21.15.82:0/2835089327 shutdown_connections 2023-07-20T11:06:06.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.447+0000 7f22fc8bd640 1 -- 172.21.15.82:0/2835089327 wait complete. 2023-07-20T11:06:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 Processor -- start 2023-07-20T11:06:06.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- start start 2023-07-20T11:06:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f806b620 0x7f22f8159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f8158ce0 0x7f22f81f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80b3e60 con 0x7f22f8070970 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8159740 con 0x7f22f806b620 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8150a20 con 0x7f22f8158ce0 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58386/0 (socket says 172.21.15.82:58386) 2023-07-20T11:06:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 -- 172.21.15.82:0/3867747769 learned_addr learned my addr 172.21.15.82:0/3867747769 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f659c640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f806b620 0x7f22f8159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f6d9d640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f8158ce0 0x7f22f81f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 -- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f8158ce0 msgr2=0x7f22f81f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f8158ce0 0x7f22f81f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 -- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f806b620 msgr2=0x7f22f8159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f806b620 0x7f22f8159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 -- 172.21.15.82:0/3867747769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0094d0 con 0x7f22f8070970 2023-07-20T11:06:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22f5d9b640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0ae040 tx=0x7f22ec01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0b6420 con 0x7f22f8070970 2023-07-20T11:06:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec0b65a0 con 0x7f22f8070970 2023-07-20T11:06:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec0b6950 con 0x7f22f8070970 2023-07-20T11:06:06.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f815c110 con 0x7f22f8070970 2023-07-20T11:06:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80b30a0 con 0x7f22f8070970 2023-07-20T11:06:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.451+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f80b3290 con 0x7f22f8070970 2023-07-20T11:06:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.455+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 90) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f22ec0b2040 con 0x7f22f8070970 2023-07-20T11:06:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.455+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f22ec11def0 con 0x7f22f8070970 2023-07-20T11:06:06.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.459+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22ec0eb3d0 con 0x7f22f8070970 2023-07-20T11:06:06.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.603+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22f804da30 con 0x7f22f8070970 2023-07-20T11:06:06.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.603+0000 7f22e6ffd640 1 -- 172.21.15.82:0/3867747769 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22ec0ee9f0 con 0x7f22f8070970 2023-07-20T11:06:06.587 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:06:06.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 msgr2=0x7f22f81504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0ae040 tx=0x7f22ec01ad40 comp rx=0 tx=0).stop 2023-07-20T11:06:06.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 shutdown_connections 2023-07-20T11:06:06.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f8158ce0 0x7f22f81f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f8070970 0x7f22f81504e0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 --2- 172.21.15.82:0/3867747769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f806b620 0x7f22f8159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 >> 172.21.15.82:0/3867747769 conn(0x7f22f80cad50 msgr2=0x7f22f80cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 shutdown_connections 2023-07-20T11:06:06.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.607+0000 7f22fc8bd640 1 -- 172.21.15.82:0/3867747769 wait complete. 2023-07-20T11:06:06.607 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.763+0000 7fba611f3640 1 Processor -- start 2023-07-20T11:06:06.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.763+0000 7fba611f3640 1 -- start start 2023-07-20T11:06:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba611f3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fba5c0afda0 0x7fba5c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba611f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0b12a0 con 0x7fba5c15a8e0 2023-07-20T11:06:06.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba611f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0b1580 con 0x7fba5c0b2060 2023-07-20T11:06:06.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba611f3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0b3160 con 0x7fba5c0afda0 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5259c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba5c15a8e0 0x7fba5c0b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60954/0 (socket says 172.21.15.82:60954) 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5259c640 1 -- 172.21.15.82:0/234495084 learned_addr learned my addr 172.21.15.82:0/234495084 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5ad9d640 1 --2- 172.21.15.82:0/234495084 >> v2:172.21.15.183:3300/0 conn(0x7fba5c0afda0 0x7fba5c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896358867 0 0) 0x7fba5c0b12a0 con 0x7fba5c15a8e0 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba48003530 con 0x7fba5c15a8e0 2023-07-20T11:06:06.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543529985 0 0) 0x7fba5c0b1580 con 0x7fba5c0b2060 2023-07-20T11:06:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0b12a0 con 0x7fba5c0b2060 2023-07-20T11:06:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5ad9d640 1 -- 172.21.15.82:0/234495084 >> v1:172.21.15.183:6789/0 conn(0x7fba5c0b2060 legacy=0x7fba5c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5ad9d640 1 -- 172.21.15.82:0/234495084 >> v1:172.21.15.82:6789/0 conn(0x7fba5c15a8e0 legacy=0x7fba5c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.767+0000 7fba5ad9d640 1 -- 172.21.15.82:0/234495084 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0b1860 con 0x7fba5c0afda0 2023-07-20T11:06:06.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba5ad9d640 1 --2- 172.21.15.82:0/234495084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c0afda0 0x7fba5c0ca6b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009d90 tx=0x7fba4c01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6dfb22c94d9b342 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a57d0 con 0x7fba5c0afda0 2023-07-20T11:06:06.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0a5930 con 0x7fba5c0afda0 2023-07-20T11:06:06.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba5a59c640 1 -- 172.21.15.82:0/234495084 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a5cc0 con 0x7fba5c0afda0 2023-07-20T11:06:06.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- 172.21.15.82:0/234495084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c0afda0 msgr2=0x7fba5c0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 --2- 172.21.15.82:0/234495084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c0afda0 0x7fba5c0ca6b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009d90 tx=0x7fba4c01c800 comp rx=0 tx=0).stop 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- 172.21.15.82:0/234495084 shutdown_connections 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 --2- 172.21.15.82:0/234495084 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c0afda0 0x7fba5c0ca6b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- 172.21.15.82:0/234495084 >> 172.21.15.82:0/234495084 conn(0x7fba5c0cada0 msgr2=0x7fba5c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- 172.21.15.82:0/234495084 shutdown_connections 2023-07-20T11:06:06.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- 172.21.15.82:0/234495084 wait complete. 2023-07-20T11:06:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 Processor -- start 2023-07-20T11:06:06.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- start start 2023-07-20T11:06:06.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 0x7fba5c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 0x7fba5c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15bdf0 con 0x7fba5c0afda0 2023-07-20T11:06:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15c6d0 con 0x7fba5c15a8e0 2023-07-20T11:06:06.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.771+0000 7fba611f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15c9b0 con 0x7fba5c0b2060 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58392/0 (socket says 172.21.15.82:58392) 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 -- 172.21.15.82:0/2073050680 learned_addr learned my addr 172.21.15.82:0/2073050680 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5259c640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 0x7fba5c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 -- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 msgr2=0x7fba5c0ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5b59e640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 0x7fba5c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 0x7fba5c0ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 -- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 msgr2=0x7fba5c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 0x7fba5c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 -- 172.21.15.82:0/2073050680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c009a70 con 0x7fba5c0afda0 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5259c640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 0x7fba5c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5b59e640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 0x7fba5c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:06.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba5ad9d640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0b0040 tx=0x7fba4c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:06.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b9650 con 0x7fba5c0afda0 2023-07-20T11:06:06.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0b97b0 con 0x7fba5c0afda0 2023-07-20T11:06:06.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b9b20 con 0x7fba5c0afda0 2023-07-20T11:06:06.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c15cc90 con 0x7fba5c0afda0 2023-07-20T11:06:06.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c15c0d0 con 0x7fba5c0afda0 2023-07-20T11:06:06.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c073c70 con 0x7fba5c0afda0 2023-07-20T11:06:06.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.775+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 90) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fba4c0b9c80 con 0x7fba5c0afda0 2023-07-20T11:06:06.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.779+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fba4c11ed10 con 0x7fba5c0afda0 2023-07-20T11:06:06.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.783+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba4c124020 con 0x7fba5c0afda0 2023-07-20T11:06:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba5c0cb990 con 0x7fba5c0afda0 2023-07-20T11:06:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba53fff640 1 -- 172.21.15.82:0/2073050680 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fba4c0ec310 con 0x7fba5c0afda0 2023-07-20T11:06:06.941 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:06.941 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:06:06.941 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:06:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 msgr2=0x7fba5c15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:06.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0b0040 tx=0x7fba4c0195a0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 shutdown_connections 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba5c15a8e0 0x7fba5c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba5c0b2060 0x7fba5c0ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 --2- 172.21.15.82:0/2073050680 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba5c0afda0 0x7fba5c15b730 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 >> 172.21.15.82:0/2073050680 conn(0x7fba5c0cada0 msgr2=0x7fba5c159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 shutdown_connections 2023-07-20T11:06:06.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:06.959+0000 7fba611f3640 1 -- 172.21.15.82:0/2073050680 wait complete. 2023-07-20T11:06:06.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 Processor -- start 2023-07-20T11:06:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 -- start start 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5c6c0ceb70 0x7f5c6c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c0b7c20 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6c15c9d0 con 0x7f5c6c15c5f0 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c7152d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6c0b4980 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c6b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5c6c0ccfb0 0x7f5c6c0ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60960/0 (socket says 172.21.15.82:60960) 2023-07-20T11:06:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.127+0000 7f5c6b7fe640 1 -- 172.21.15.82:0/2803102615 learned_addr learned my addr 172.21.15.82:0/2803102615 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c70d2c640 1 --2- 172.21.15.82:0/2803102615 >> v2:172.21.15.183:3300/0 conn(0x7f5c6c0ceb70 0x7f5c6c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c6affd640 1 -- 172.21.15.82:0/2803102615 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347313422 0 0) 0x7f5c6c0b7c20 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c6affd640 1 -- 172.21.15.82:0/2803102615 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c54003530 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c70d2c640 1 -- 172.21.15.82:0/2803102615 >> v1:172.21.15.183:6789/0 conn(0x7f5c6c15c5f0 legacy=0x7f5c6c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c70d2c640 1 -- 172.21.15.82:0/2803102615 >> v1:172.21.15.82:6789/0 conn(0x7f5c6c0ccfb0 legacy=0x7f5c6c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c70d2c640 1 -- 172.21.15.82:0/2803102615 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c0ce030 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c70d2c640 1 --2- 172.21.15.82:0/2803102615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c0ceb70 0x7f5c6c0b0f70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009d90 tx=0x7f5c6401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b347cb2b924c87 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c6affd640 1 -- 172.21.15.82:0/2803102615 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640af600 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c6affd640 1 -- 172.21.15.82:0/2803102615 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640ab050 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.131+0000 7f5c6affd640 1 -- 172.21.15.82:0/2803102615 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640af980 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- 172.21.15.82:0/2803102615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c0ceb70 msgr2=0x7f5c6c0b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 --2- 172.21.15.82:0/2803102615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c0ceb70 0x7f5c6c0b0f70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009d90 tx=0x7f5c6401f130 comp rx=0 tx=0).stop 2023-07-20T11:06:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- 172.21.15.82:0/2803102615 shutdown_connections 2023-07-20T11:06:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 --2- 172.21.15.82:0/2803102615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c0ceb70 0x7f5c6c0b0f70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- 172.21.15.82:0/2803102615 >> 172.21.15.82:0/2803102615 conn(0x7f5c6c065710 msgr2=0x7f5c6c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- 172.21.15.82:0/2803102615 shutdown_connections 2023-07-20T11:06:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- 172.21.15.82:0/2803102615 wait complete. 2023-07-20T11:06:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 Processor -- start 2023-07-20T11:06:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- start start 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c6c0ceb70 0x7f5c6c1f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c15c5f0 0x7f5c6c1f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c14b400 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c14bf30 con 0x7f5c6c15c5f0 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c7152d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6c14c3c0 con 0x7f5c6c0ceb70 2023-07-20T11:06:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58402/0 (socket says 172.21.15.82:58402) 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c6bfff640 1 -- 172.21.15.82:0/3255451560 learned_addr learned my addr 172.21.15.82:0/3255451560 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c70d2c640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c15c5f0 0x7f5c6c1f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.135+0000 7f5c6b7fe640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c6c0ceb70 0x7f5c6c1f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 -- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c6c0ceb70 msgr2=0x7f5c6c1f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c6c0ceb70 0x7f5c6c1f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 -- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c15c5f0 msgr2=0x7f5c6c1f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c15c5f0 0x7f5c6c1f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 -- 172.21.15.82:0/3255451560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c64009a70 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c6bfff640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c3c0 tx=0x7f5c5c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0052d0 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c005430 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c003840 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6c14b600 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6c14bbc0 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6c04da30 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 91) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5c5c0039a0 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 0x7f5c58068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.139+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f5c5c082f20 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.143+0000 7f5c6b7fe640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 0x7f5c58068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.143+0000 7f5c6b7fe640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 0x7f5c58068590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c159400 tx=0x7f5c60007d40 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.143+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c5c050490 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.291+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c6c0b6f40 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c68ff9640 1 -- 172.21.15.82:0/3255451560 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+19400 (secure 0 0 0) 0x7f5c5c017090 con 0x7f5c6c0ccfb0 2023-07-20T11:06:07.276 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:07.276 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":160,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:05.953611+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4275433715":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/1017650147":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/4277405881":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/719079176":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2554583811":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6832/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2944636111":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/3836891304":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/139796629":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1111634489":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/4005336874":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1368641827":"2023-07-21T11:05:59.000377+0000","172.21.15.82:6832/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/166062347":"2023-07-21T11:05:59.000377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 msgr2=0x7f5c58068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 0x7f5c58068590 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c159400 tx=0x7f5c60007d40 comp rx=0 tx=0).stop 2023-07-20T11:06:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 msgr2=0x7f5c6c0cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00c3c0 tx=0x7f5c5c00c880 comp rx=0 tx=0).stop 2023-07-20T11:06:07.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 shutdown_connections 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5c580660d0 0x7f5c58068590 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5c6c15c5f0 0x7f5c6c1f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5c6c0ceb70 0x7f5c6c1f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 --2- 172.21.15.82:0/3255451560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c6c0ccfb0 0x7f5c6c0cb850 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 >> 172.21.15.82:0/3255451560 conn(0x7f5c6c065710 msgr2=0x7f5c6c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 shutdown_connections 2023-07-20T11:06:07.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.295+0000 7f5c7152d640 1 -- 172.21.15.82:0/3255451560 wait complete. 2023-07-20T11:06:07.297 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:06:07.298 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 Processor -- start 2023-07-20T11:06:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 -- start start 2023-07-20T11:06:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95600ccfb0 0x7f95600ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95600b7c20 con 0x7f956015c5f0 2023-07-20T11:06:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956015c9d0 con 0x7f95600ce9a0 2023-07-20T11:06:07.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955f59e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600b4980 con 0x7f95600ccfb0 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f956015c5f0 0x7f95600b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60972/0 (socket says 172.21.15.82:60972) 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955e59c640 1 -- 172.21.15.82:0/775350200 learned_addr learned my addr 172.21.15.82:0/775350200 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955dd9b640 1 --2- 172.21.15.82:0/775350200 >> v2:172.21.15.183:3300/0 conn(0x7f95600ccfb0 0x7f95600ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207263291 0 0) 0x7f95600b7c20 con 0x7f956015c5f0 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9548003530 con 0x7f956015c5f0 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352660916 0 0) 0x7f95580014a0 con 0x7f95600ce9a0 2023-07-20T11:06:07.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95600b7c20 con 0x7f95600ce9a0 2023-07-20T11:06:07.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956218855 0 0) 0x7f9548003530 con 0x7f956015c5f0 2023-07-20T11:06:07.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955dd9b640 1 -- 172.21.15.82:0/775350200 >> v1:172.21.15.183:6789/0 conn(0x7f95600ce9a0 legacy=0x7f95600b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955dd9b640 1 -- 172.21.15.82:0/775350200 >> v1:172.21.15.82:6789/0 conn(0x7f956015c5f0 legacy=0x7f95600b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.455+0000 7f955dd9b640 1 -- 172.21.15.82:0/775350200 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600ce030 con 0x7f95600ccfb0 2023-07-20T11:06:07.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955dd9b640 1 --2- 172.21.15.82:0/775350200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f95600ce460 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f95540097c0 tx=0x7f955401eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a55ebda94c1d13 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550001680 con 0x7f95600ccfb0 2023-07-20T11:06:07.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540a8610 con 0x7f95600ccfb0 2023-07-20T11:06:07.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955d59a640 1 -- 172.21.15.82:0/775350200 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540a89a0 con 0x7f95600ccfb0 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 -- 172.21.15.82:0/775350200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 msgr2=0x7f95600ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 --2- 172.21.15.82:0/775350200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f95600ce460 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f95540097c0 tx=0x7f955401eb90 comp rx=0 tx=0).stop 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 -- 172.21.15.82:0/775350200 shutdown_connections 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 --2- 172.21.15.82:0/775350200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f95600ce460 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 -- 172.21.15.82:0/775350200 >> 172.21.15.82:0/775350200 conn(0x7f9560065710 msgr2=0x7f9560065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 -- 172.21.15.82:0/775350200 shutdown_connections 2023-07-20T11:06:07.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.459+0000 7f955f59e640 1 -- 172.21.15.82:0/775350200 wait complete. 2023-07-20T11:06:07.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 Processor -- start 2023-07-20T11:06:07.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- start start 2023-07-20T11:06:07.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f956014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 0x7f95601f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956014d230 con 0x7f95600ce9a0 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956014e150 con 0x7f95600ccfb0 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956014e430 con 0x7f956015c5f0 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58410/0 (socket says 172.21.15.82:58410) 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 -- 172.21.15.82:0/228726211 learned_addr learned my addr 172.21.15.82:0/228726211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955e59c640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f956014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 -- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 msgr2=0x7f95601f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955ed9d640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 0x7f95601f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 0x7f95601f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 -- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 msgr2=0x7f956014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f956014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 -- 172.21.15.82:0/228726211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009420 con 0x7f95600ce9a0 2023-07-20T11:06:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955e59c640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f956014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955ed9d640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 0x7f95601f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:07.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955dd9b640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f95540b3040 tx=0x7f955401b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540bf070 con 0x7f95600ce9a0 2023-07-20T11:06:07.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9554006e20 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956014e710 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95540b0870 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.463+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956014ecd0 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956004da30 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 91) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f95540b7040 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f954effd640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 0x7f9540068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f9554120aa0 con 0x7f95600ce9a0 2023-07-20T11:06:07.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f955e59c640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 0x7f9540068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.467+0000 7f955e59c640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 0x7f9540068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9550001350 tx=0x7f9550009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.471+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95540ede90 con 0x7f95600ce9a0 2023-07-20T11:06:07.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.647+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95600b8250 con 0x7f95600ce9a0 2023-07-20T11:06:07.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f954effd640 1 -- 172.21.15.82:0/228726211 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f95540b5090 con 0x7f95600ce9a0 2023-07-20T11:06:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:07.632 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:06:07.632 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:06:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 msgr2=0x7f9540068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 0x7f9540068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9550001350 tx=0x7f9550009040 comp rx=0 tx=0).stop 2023-07-20T11:06:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 msgr2=0x7f956014d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f95540b3040 tx=0x7f955401b930 comp rx=0 tx=0).stop 2023-07-20T11:06:07.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 shutdown_connections 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f95400660d0 0x7f9540068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f956015c5f0 0x7f95601f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95600ce9a0 0x7f956014d6d0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 --2- 172.21.15.82:0/228726211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95600ccfb0 0x7f956014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 >> 172.21.15.82:0/228726211 conn(0x7f9560065710 msgr2=0x7f95600cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 shutdown_connections 2023-07-20T11:06:07.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.651+0000 7f955f59e640 1 -- 172.21.15.82:0/228726211 wait complete. 2023-07-20T11:06:07.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:07.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.807+0000 7fe99db03640 1 Processor -- start 2023-07-20T11:06:07.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.807+0000 7fe99db03640 1 -- start start 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe99db03640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 0x7fe9980ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe99db03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe99815a8e0 0x7fe9980b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe99db03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980b2ee0 con 0x7fe9980b2060 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe99db03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980b3160 con 0x7fe99815a8e0 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe99db03640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980b12a0 con 0x7fe9980afda0 2023-07-20T11:06:07.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe99815a8e0 0x7fe9980b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe997fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe9980b2060 0x7fe9980b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60986/0 (socket says 172.21.15.82:60986) 2023-07-20T11:06:07.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe99815a8e0 0x7fe9980b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58422/0 (socket says 172.21.15.82:58422) 2023-07-20T11:06:07.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe997fff640 1 -- 172.21.15.82:0/3004690410 learned_addr learned my addr 172.21.15.82:0/3004690410 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:07.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe9977fe640 1 --2- 172.21.15.82:0/3004690410 >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 0x7fe9980ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 -- 172.21.15.82:0/3004690410 >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 msgr2=0x7fe9980ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:07.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 --2- 172.21.15.82:0/3004690410 >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 0x7fe9980ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 -- 172.21.15.82:0/3004690410 >> v1:172.21.15.82:6789/0 conn(0x7fe9980b2060 legacy=0x7fe9980b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe98effd640 1 -- 172.21.15.82:0/3004690410 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980b1580 con 0x7fe99815a8e0 2023-07-20T11:06:07.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe9977fe640 1 --2- 172.21.15.82:0/3004690410 >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 0x7fe9980ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:07.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.811+0000 7fe996ffd640 1 -- 172.21.15.82:0/3004690410 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806283860 0 0) 0x7fe9980b2ee0 con 0x7fe9980b2060 2023-07-20T11:06:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe98effd640 1 --2- 172.21.15.82:0/3004690410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99815a8e0 0x7fe9980b29a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b0b40 tx=0x7fe98001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa6117660f17457 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe996ffd640 1 -- 172.21.15.82:0/3004690410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800ac640 con 0x7fe99815a8e0 2023-07-20T11:06:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe996ffd640 1 -- 172.21.15.82:0/3004690410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9800ac7a0 con 0x7fe99815a8e0 2023-07-20T11:06:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe996ffd640 1 -- 172.21.15.82:0/3004690410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800acb30 con 0x7fe99815a8e0 2023-07-20T11:06:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- 172.21.15.82:0/3004690410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99815a8e0 msgr2=0x7fe9980b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- 172.21.15.82:0/3004690410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99815a8e0 0x7fe9980b29a0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b0b40 tx=0x7fe98001c310 comp rx=0 tx=0).stop 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- 172.21.15.82:0/3004690410 shutdown_connections 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- 172.21.15.82:0/3004690410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe99815a8e0 0x7fe9980b29a0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- 172.21.15.82:0/3004690410 >> v2:172.21.15.183:3300/0 conn(0x7fe9980afda0 0x7fe9980ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- 172.21.15.82:0/3004690410 >> 172.21.15.82:0/3004690410 conn(0x7fe9980cada0 msgr2=0x7fe9980cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- 172.21.15.82:0/3004690410 shutdown_connections 2023-07-20T11:06:07.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- 172.21.15.82:0/3004690410 wait complete. 2023-07-20T11:06:07.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 Processor -- start 2023-07-20T11:06:07.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- start start 2023-07-20T11:06:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 0x7fe998152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 0x7fe9981588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815b5f0 con 0x7fe9980afda0 2023-07-20T11:06:07.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815d670 con 0x7fe9980b2060 2023-07-20T11:06:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.815+0000 7fe99db03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99815db00 con 0x7fe99815a8e0 2023-07-20T11:06:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58430/0 (socket says 172.21.15.82:58430) 2023-07-20T11:06:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 -- 172.21.15.82:0/3888544331 learned_addr learned my addr 172.21.15.82:0/3888544331 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe98effd640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 0x7fe998152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe997fff640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 0x7fe9981588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 -- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 msgr2=0x7fe9981588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 0x7fe9981588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 -- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 msgr2=0x7fe998152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 0x7fe998152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 -- 172.21.15.82:0/3888544331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980009420 con 0x7fe9980afda0 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe997fff640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 0x7fe9981588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe98effd640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 0x7fe998152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:07.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe9977fe640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d800 tx=0x7fe98800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880096c0 con 0x7fe9980afda0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988009820 con 0x7fe9980afda0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99815cd40 con 0x7fe9980afda0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988009bd0 con 0x7fe9980afda0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99815d300 con 0x7fe9980afda0 2023-07-20T11:06:07.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998073c70 con 0x7fe9980afda0 2023-07-20T11:06:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 91) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe988009d30 con 0x7fe9980afda0 2023-07-20T11:06:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.819+0000 7fe994ff9640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 0x7fe978068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.823+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fe9880843e0 con 0x7fe9980afda0 2023-07-20T11:06:07.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.823+0000 7fe98effd640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 0x7fe978068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:07.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.823+0000 7fe98effd640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 0x7fe978068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae000 tx=0x7fe9800a6070 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:07.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:07.823+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9880518a0 con 0x7fe9980afda0 2023-07-20T11:06:07.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.003+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9980cb990 con 0x7fe9980afda0 2023-07-20T11:06:07.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.003+0000 7fe994ff9640 1 -- 172.21.15.82:0/3888544331 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fe988054ec0 con 0x7fe9980afda0 2023-07-20T11:06:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:07.986 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:05:41.606881+0000","modified":"2023-07-20T11:05:45.247381+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9579},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9579":{"gid":9579,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2913878511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2913878511},{"type":"v1","addr":"172.21.15.82:6837","nonce":2913878511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-20T11:06:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 74 2023-07-20T11:06:07.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 msgr2=0x7fe978068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 0x7fe978068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9800ae000 tx=0x7fe9800a6070 comp rx=0 tx=0).stop 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 msgr2=0x7fe99815acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fe98800d800 tx=0x7fe98800dcc0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 shutdown_connections 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe9780660d0 0x7fe978068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe99815a8e0 0x7fe9981588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe9980b2060 0x7fe998152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 --2- 172.21.15.82:0/3888544331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9980afda0 0x7fe99815acf0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:07.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 >> 172.21.15.82:0/3888544331 conn(0x7fe9980cada0 msgr2=0x7fe998072820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:07.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 shutdown_connections 2023-07-20T11:06:07.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.007+0000 7fe99db03640 1 -- 172.21.15.82:0/3888544331 wait complete. 2023-07-20T11:06:08.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:08.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 Processor -- start 2023-07-20T11:06:08.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 -- start start 2023-07-20T11:06:08.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9ff40ccfb0 0x7f9ff40ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40b7c20 con 0x7f9ff415c5f0 2023-07-20T11:06:08.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff415c9d0 con 0x7f9ff40ce9a0 2023-07-20T11:06:08.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff8eca640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40b4980 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9ff415c5f0 0x7f9ff40b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:60996/0 (socket says 172.21.15.82:60996) 2023-07-20T11:06:08.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff37fe640 1 -- 172.21.15.82:0/770466506 learned_addr learned my addr 172.21.15.82:0/770466506 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:08.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff2ffd640 1 --2- 172.21.15.82:0/770466506 >> v2:172.21.15.183:3300/0 conn(0x7f9ff40ccfb0 0x7f9ff40ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff27fc640 1 -- 172.21.15.82:0/770466506 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949383434 0 0) 0x7f9ff40b7c20 con 0x7f9ff415c5f0 2023-07-20T11:06:08.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff27fc640 1 -- 172.21.15.82:0/770466506 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fdc003530 con 0x7f9ff415c5f0 2023-07-20T11:06:08.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/770466506 >> v1:172.21.15.183:6789/0 conn(0x7f9ff40ce9a0 legacy=0x7f9ff40b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/770466506 >> v1:172.21.15.82:6789/0 conn(0x7f9ff415c5f0 legacy=0x7f9ff40b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.175+0000 7f9ff2ffd640 1 -- 172.21.15.82:0/770466506 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40ce030 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff2ffd640 1 --2- 172.21.15.82:0/770466506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff40ce460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097c0 tx=0x7f9fe801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d7099c0c13aa50d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff27fc640 1 -- 172.21.15.82:0/770466506 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80a8970 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff27fc640 1 -- 172.21.15.82:0/770466506 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80a8ad0 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff27fc640 1 -- 172.21.15.82:0/770466506 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80a8e40 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 -- 172.21.15.82:0/770466506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 msgr2=0x7f9ff40ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/770466506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff40ce460 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097c0 tx=0x7f9fe801ec70 comp rx=0 tx=0).stop 2023-07-20T11:06:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 -- 172.21.15.82:0/770466506 shutdown_connections 2023-07-20T11:06:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/770466506 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff40ce460 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 -- 172.21.15.82:0/770466506 >> 172.21.15.82:0/770466506 conn(0x7f9ff4065710 msgr2=0x7f9ff4065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 -- 172.21.15.82:0/770466506 shutdown_connections 2023-07-20T11:06:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.179+0000 7f9ff8eca640 1 -- 172.21.15.82:0/770466506 wait complete. 2023-07-20T11:06:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 Processor -- start 2023-07-20T11:06:08.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- start start 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff41f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ff40ce9a0 0x7f9ff414c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff41496d0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff414c610 con 0x7f9ff40ccfb0 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40b3fd0 con 0x7f9ff40ce9a0 2023-07-20T11:06:08.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58462/0 (socket says 172.21.15.82:58462) 2023-07-20T11:06:08.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 -- 172.21.15.82:0/3663958435 learned_addr learned my addr 172.21.15.82:0/3663958435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:08.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff37fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff41f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff2ffd640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ff40ce9a0 0x7f9ff414c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 -- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ff40ce9a0 msgr2=0x7f9ff414c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ff40ce9a0 0x7f9ff414c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 -- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 msgr2=0x7f9ff41f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff41f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 -- 172.21.15.82:0/3663958435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8009420 con 0x7f9ff415c5f0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff3fff640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c770 tx=0x7f9fec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec003b80 con 0x7f9ff415c5f0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec003ce0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff41f21f0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec00aa90 con 0x7f9ff415c5f0 2023-07-20T11:06:08.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff41f27b0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.183+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff41498a0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.187+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 92) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f9fec00abf0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.187+0000 7f9fdbfff640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 0x7f9fe00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.187+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f9fec083c80 con 0x7f9ff415c5f0 2023-07-20T11:06:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.187+0000 7f9ff37fe640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 0x7f9fe00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.187+0000 7f9ff37fe640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 0x7f9fe00687d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40011f0 tx=0x7f9fe4007d40 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.191+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ff41498a0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.339+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ff415c9d0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9fdbfff640 1 -- 172.21.15.82:0/3663958435 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+19400 (secure 0 0 0) 0x7f9ff415c9d0 con 0x7f9ff415c5f0 2023-07-20T11:06:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:08.324 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":160,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:05.953611+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:05:40.201167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-20T11:05:40.599132+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/4275433715":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/1017650147":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/4277405881":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/719079176":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2554583811":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6832/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2944636111":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/3836891304":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/139796629":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1111634489":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/4005336874":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1368641827":"2023-07-21T11:05:59.000377+0000","172.21.15.82:6832/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/166062347":"2023-07-21T11:05:59.000377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:08.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 msgr2=0x7f9fe00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 0x7f9fe00687d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fe40011f0 tx=0x7f9fe4007d40 comp rx=0 tx=0).stop 2023-07-20T11:06:08.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 msgr2=0x7f9ff40b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00c770 tx=0x7f9fec00cc30 comp rx=0 tx=0).stop 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 shutdown_connections 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9fe0066310 0x7f9fe00687d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ff415c5f0 0x7f9ff40b3a90 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9ff40ce9a0 0x7f9ff414c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 --2- 172.21.15.82:0/3663958435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9ff40ccfb0 0x7f9ff41f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 >> 172.21.15.82:0/3663958435 conn(0x7f9ff4065710 msgr2=0x7f9ff40d0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:08.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 shutdown_connections 2023-07-20T11:06:08.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.343+0000 7f9ff8eca640 1 -- 172.21.15.82:0/3663958435 wait complete. 2023-07-20T11:06:08.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T11:06:08.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 Processor -- start 2023-07-20T11:06:08.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 -- start start 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b4160bc0 0x7f47b406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b40c1a00 0x7f47b40aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b40cc560 con 0x7f47b4160fa0 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b40ad7e0 con 0x7f47b4160bc0 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47bbd40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b40cc790 con 0x7f47b40c1a00 2023-07-20T11:06:08.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47b9adc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b4160bc0 0x7f47b406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47b9adc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f47b4160bc0 0x7f47b406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58464/0 (socket says 172.21.15.82:58464) 2023-07-20T11:06:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.503+0000 7f47b9adc640 1 -- 172.21.15.82:0/485208147 learned_addr learned my addr 172.21.15.82:0/485208147 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:08.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47ba2dd640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b40c1a00 0x7f47b40aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b9adc640 1 -- 172.21.15.82:0/485208147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b40c1a00 msgr2=0x7f47b40aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b9adc640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b40c1a00 0x7f47b40aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b9adc640 1 -- 172.21.15.82:0/485208147 >> v1:172.21.15.183:6789/0 conn(0x7f47b4160fa0 legacy=0x7f47b40c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b9adc640 1 -- 172.21.15.82:0/485208147 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b40cca70 con 0x7f47b4160bc0 2023-07-20T11:06:08.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b9adc640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160bc0 0x7f47b406c1c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8121bc961743955c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b8ada640 1 -- 172.21.15.82:0/485208147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00aa670 con 0x7f47b4160bc0 2023-07-20T11:06:08.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b8ada640 1 -- 172.21.15.82:0/485208147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00aa7d0 con 0x7f47b4160bc0 2023-07-20T11:06:08.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47b8ada640 1 -- 172.21.15.82:0/485208147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b00aab60 con 0x7f47b4160bc0 2023-07-20T11:06:08.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47bbd40640 1 -- 172.21.15.82:0/485208147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160bc0 msgr2=0x7f47b406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.507+0000 7f47bbd40640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160bc0 0x7f47b406c1c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009870 tx=0x7f47b001c510 comp rx=0 tx=0).stop 2023-07-20T11:06:08.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- 172.21.15.82:0/485208147 shutdown_connections 2023-07-20T11:06:08.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b40c1a00 0x7f47b40aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 --2- 172.21.15.82:0/485208147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160bc0 0x7f47b406c1c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- 172.21.15.82:0/485208147 >> 172.21.15.82:0/485208147 conn(0x7f47b40cada0 msgr2=0x7f47b40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:08.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- 172.21.15.82:0/485208147 shutdown_connections 2023-07-20T11:06:08.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- 172.21.15.82:0/485208147 wait complete. 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 Processor -- start 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- start start 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b40c1a00 0x7f47b4145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b4160bc0 0x7f47b4158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b415c170 con 0x7f47b4160fa0 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b41596b0 con 0x7f47b40c1a00 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47bbd40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b415e510 con 0x7f47b4160bc0 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58478/0 (socket says 172.21.15.82:58478) 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 -- 172.21.15.82:0/955935484 learned_addr learned my addr 172.21.15.82:0/955935484 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47b9adc640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b40c1a00 0x7f47b4145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47b92db640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b4160bc0 0x7f47b4158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 -- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b4160bc0 msgr2=0x7f47b4158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b4160bc0 0x7f47b4158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 -- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b40c1a00 msgr2=0x7f47b4145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b40c1a00 0x7f47b4145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 -- 172.21.15.82:0/955935484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00094d0 con 0x7f47b4160fa0 2023-07-20T11:06:08.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.511+0000 7f47ba2dd640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007e70 tx=0x7f47ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac014620 con 0x7f47b4160fa0 2023-07-20T11:06:08.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac0147a0 con 0x7f47b4160fa0 2023-07-20T11:06:08.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac014b50 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b415f090 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b415ea40 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b415f220 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 92) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f47ac014cb0 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 0x7f47980687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f47ac084860 con 0x7f47b4160fa0 2023-07-20T11:06:08.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47b9adc640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 0x7f47980687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.515+0000 7f47b9adc640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 0x7f47980687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ae000 tx=0x7f47b00b5040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.519+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47ac0555c0 con 0x7f47b4160fa0 2023-07-20T11:06:08.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.699+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f47b4073c70 con 0x7f47b4160fa0 2023-07-20T11:06:08.680 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T11:06:08.699+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T11:06:08.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47aa7fc640 1 -- 172.21.15.82:0/955935484 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f47ac055150 con 0x7f47b4160fa0 2023-07-20T11:06:08.689 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T11:06:08.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 msgr2=0x7f47980687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 0x7f47980687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f47b00ae000 tx=0x7f47b00b5040 comp rx=0 tx=0).stop 2023-07-20T11:06:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 msgr2=0x7f47b415bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007e70 tx=0x7f47ac00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 shutdown_connections 2023-07-20T11:06:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4798066310 0x7f47980687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f47b4160fa0 0x7f47b415bc30 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47b4160bc0 0x7f47b4158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 --2- 172.21.15.82:0/955935484 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f47b40c1a00 0x7f47b4145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 >> 172.21.15.82:0/955935484 conn(0x7f47b40cada0 msgr2=0x7f47b406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:08.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 shutdown_connections 2023-07-20T11:06:08.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.707+0000 7f47bbd40640 1 -- 172.21.15.82:0/955935484 wait complete. 2023-07-20T11:06:08.696 INFO:tasks.ceph.mds.c.smithi082.stderr: -3996> 2023-07-20T11:05:47.203+0000 7f3a89177640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:06:08.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T11:06:08.747 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:06:08.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 Processor -- start 2023-07-20T11:06:08.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 -- start start 2023-07-20T11:06:08.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00cc159450 0x7f00cc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0cc8d0 con 0x7f00cc0afd50 2023-07-20T11:06:08.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0ccbb0 con 0x7f00cc159830 2023-07-20T11:06:08.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d2f67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc0cce90 con 0x7f00cc159450 2023-07-20T11:06:08.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d0d03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00cc159450 0x7f00cc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d1504640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f00cc0afd50 0x7f00cc0b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:32790/0 (socket says 172.21.15.82:32790) 2023-07-20T11:06:08.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d1504640 1 -- 172.21.15.82:0/3263761563 learned_addr learned my addr 172.21.15.82:0/3263761563 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:08.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d0d03640 1 -- 172.21.15.82:0/3263761563 >> v1:172.21.15.183:6789/0 conn(0x7f00cc159830 legacy=0x7f00cc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d0d03640 1 -- 172.21.15.82:0/3263761563 >> v1:172.21.15.82:6789/0 conn(0x7f00cc0afd50 legacy=0x7f00cc0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00d0d03640 1 -- 172.21.15.82:0/3263761563 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc159cc0 con 0x7f00cc159450 2023-07-20T11:06:08.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.875+0000 7f00c37fe640 1 -- 172.21.15.82:0/3263761563 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323801779 0 0) 0x7f00cc0cc8d0 con 0x7f00cc0afd50 2023-07-20T11:06:08.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d0d03640 1 --2- 172.21.15.82:0/3263761563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc159450 0x7f00cc15a4c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f00c80097c0 tx=0x7f00c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43857ad2d2a492e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00c37fe640 1 -- 172.21.15.82:0/3263761563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a7070 con 0x7f00cc159450 2023-07-20T11:06:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00c37fe640 1 -- 172.21.15.82:0/3263761563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c80ab430 con 0x7f00cc159450 2023-07-20T11:06:08.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00c37fe640 1 -- 172.21.15.82:0/3263761563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80ab7c0 con 0x7f00cc159450 2023-07-20T11:06:08.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 -- 172.21.15.82:0/3263761563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc159450 msgr2=0x7f00cc15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3263761563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc159450 0x7f00cc15a4c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f00c80097c0 tx=0x7f00c801c450 comp rx=0 tx=0).stop 2023-07-20T11:06:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 -- 172.21.15.82:0/3263761563 shutdown_connections 2023-07-20T11:06:08.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3263761563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc159450 0x7f00cc15a4c0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 -- 172.21.15.82:0/3263761563 >> 172.21.15.82:0/3263761563 conn(0x7f00cc0cad50 msgr2=0x7f00cc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 -- 172.21.15.82:0/3263761563 shutdown_connections 2023-07-20T11:06:08.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.879+0000 7f00d2f67640 1 -- 172.21.15.82:0/3263761563 wait complete. 2023-07-20T11:06:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 Processor -- start 2023-07-20T11:06:08.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 -- start start 2023-07-20T11:06:08.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc159450 0x7f00cc14c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc0c1dd0 0x7f00cc06b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc0c2390 con 0x7f00cc0afd50 2023-07-20T11:06:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc15bcf0 con 0x7f00cc0c1dd0 2023-07-20T11:06:08.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc15b400 con 0x7f00cc159450 2023-07-20T11:06:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58512/0 (socket says 172.21.15.82:58512) 2023-07-20T11:06:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 -- 172.21.15.82:0/3218023231 learned_addr learned my addr 172.21.15.82:0/3218023231 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:08.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 -- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc159450 msgr2=0x7f00cc14c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc159450 0x7f00cc14c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 -- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc0c1dd0 msgr2=0x7f00cc06b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc0c1dd0 0x7f00cc06b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:08.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 -- 172.21.15.82:0/3218023231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8009420 con 0x7f00cc0afd50 2023-07-20T11:06:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d0d03640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f00c8019060 tx=0x7f00c801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b5810 con 0x7f00cc0afd50 2023-07-20T11:06:08.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c80b5990 con 0x7f00cc0afd50 2023-07-20T11:06:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b5d40 con 0x7f00cc0afd50 2023-07-20T11:06:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.883+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc15b6a0 con 0x7f00cc0afd50 2023-07-20T11:06:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc14e5f0 con 0x7f00cc0afd50 2023-07-20T11:06:08.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc04da30 con 0x7f00cc0afd50 2023-07-20T11:06:08.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 92) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f00c80b4390 con 0x7f00cc0afd50 2023-07-20T11:06:08.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00c17fa640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 0x7f00b80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:08.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f00c811ec10 con 0x7f00cc0afd50 2023-07-20T11:06:08.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00c3fff640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 0x7f00b80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:08.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.887+0000 7f00c3fff640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 0x7f00b80687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000f70 tx=0x7f00bc0079c0 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:08.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:08.891+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00c80ebd00 con 0x7f00cc0afd50 2023-07-20T11:06:09.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.067+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f00cc0cbbf0 con 0x7f00cc0afd50 2023-07-20T11:06:09.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00c17fa640 1 -- 172.21.15.82:0/3218023231 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00c80ef320 con 0x7f00cc0afd50 2023-07-20T11:06:09.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 msgr2=0x7f00b80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 0x7f00b80687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f00bc000f70 tx=0x7f00bc0079c0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 msgr2=0x7f00cc0c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:09.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f00c8019060 tx=0x7f00c801ac90 comp rx=0 tx=0).stop 2023-07-20T11:06:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 shutdown_connections 2023-07-20T11:06:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f00b8066310 0x7f00b80687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00cc0c1dd0 0x7f00cc06b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00cc159450 0x7f00cc14c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 --2- 172.21.15.82:0/3218023231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00cc0afd50 0x7f00cc0c4990 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 >> 172.21.15.82:0/3218023231 conn(0x7f00cc0cad50 msgr2=0x7f00cc0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 shutdown_connections 2023-07-20T11:06:09.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.707+0000 7f00d2f67640 1 -- 172.21.15.82:0/3218023231 wait complete. 2023-07-20T11:06:09.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T11:06:09.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.919+0000 7fcc4e567640 1 Processor -- start 2023-07-20T11:06:09.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.919+0000 7fcc4e567640 1 -- start start 2023-07-20T11:06:09.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 0x7fcc4815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc48159830 0x7fcc480cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 0x7fcc480afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480cce90 con 0x7fcc48159830 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480cc8d0 con 0x7fcc48159450 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4e567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480ccbb0 con 0x7fcc480cc3e0 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc48159830 0x7fcc480cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc48159830 0x7fcc480cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58518/0 (socket says 172.21.15.82:58518) 2023-07-20T11:06:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 -- 172.21.15.82:0/3164103613 learned_addr learned my addr 172.21.15.82:0/3164103613 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc47fff640 1 --2- 172.21.15.82:0/3164103613 >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 0x7fcc4815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4cb04640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 0x7fcc480afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 -- 172.21.15.82:0/3164103613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 msgr2=0x7fcc480afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 0x7fcc480afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 -- 172.21.15.82:0/3164103613 >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 msgr2=0x7fcc4815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 --2- 172.21.15.82:0/3164103613 >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 0x7fcc4815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 -- 172.21.15.82:0/3164103613 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48159cc0 con 0x7fcc48159830 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc47fff640 1 --2- 172.21.15.82:0/3164103613 >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 0x7fcc4815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:09.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc4cb04640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 0x7fcc480afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.923+0000 7fcc477fe640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48159830 0x7fcc480cbea0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806a6c0 tx=0x7fcc3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb000e2d354880b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc46ffd640 1 -- 172.21.15.82:0/3164103613 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0ac600 con 0x7fcc48159830 2023-07-20T11:06:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc46ffd640 1 -- 172.21.15.82:0/3164103613 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0a8050 con 0x7fcc48159830 2023-07-20T11:06:09.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc46ffd640 1 -- 172.21.15.82:0/3164103613 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c0ac980 con 0x7fcc48159830 2023-07-20T11:06:09.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- 172.21.15.82:0/3164103613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48159830 msgr2=0x7fcc480cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:09.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48159830 0x7fcc480cbea0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fcc4806a6c0 tx=0x7fcc3c01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- 172.21.15.82:0/3164103613 shutdown_connections 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc480cc3e0 0x7fcc480afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- 172.21.15.82:0/3164103613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc48159830 0x7fcc480cbea0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- 172.21.15.82:0/3164103613 >> v2:172.21.15.183:3300/0 conn(0x7fcc48159450 0x7fcc4815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- 172.21.15.82:0/3164103613 >> 172.21.15.82:0/3164103613 conn(0x7fcc480cad50 msgr2=0x7fcc480cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- 172.21.15.82:0/3164103613 shutdown_connections 2023-07-20T11:06:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- 172.21.15.82:0/3164103613 wait complete. 2023-07-20T11:06:09.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 Processor -- start 2023-07-20T11:06:09.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- start start 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 0x7fcc48155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 0x7fcc48155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480b0e40 con 0x7fcc480cc3e0 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480b10e0 con 0x7fcc480b2180 2023-07-20T11:06:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc4e567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc480b13c0 con 0x7fcc48159450 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc47fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58528/0 (socket says 172.21.15.82:58528) 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.927+0000 7fcc47fff640 1 -- 172.21.15.82:0/1439021216 learned_addr learned my addr 172.21.15.82:0/1439021216 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc4cb04640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 0x7fcc48155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc477fe640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 0x7fcc48155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 -- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 msgr2=0x7fcc48155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 0x7fcc48155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 -- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 msgr2=0x7fcc48155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 0x7fcc48155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 -- 172.21.15.82:0/1439021216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0094d0 con 0x7fcc480cc3e0 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc4cb04640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 0x7fcc48155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc477fe640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 0x7fcc48155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc47fff640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c7c0 tx=0x7fcc3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38007a30 con 0x7fcc480cc3e0 2023-07-20T11:06:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38007b90 con 0x7fcc480cc3e0 2023-07-20T11:06:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800ce70 con 0x7fcc480cc3e0 2023-07-20T11:06:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc480b16a0 con 0x7fcc480cc3e0 2023-07-20T11:06:09.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc480b1c60 con 0x7fcc480cc3e0 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4804da30 con 0x7fcc480cc3e0 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 92) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fcc380113f0 con 0x7fcc480cc3e0 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 0x7fcc34068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fcc38084750 con 0x7fcc480cc3e0 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.931+0000 7fcc477fe640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 0x7fcc34068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:09.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.935+0000 7fcc477fe640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 0x7fcc34068800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0ae000 tx=0x7fcc3c008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:09.935+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc38051680 con 0x7fcc480cc3e0 2023-07-20T11:06:10.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.087+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc480cbbf0 con 0x7fcc480cc3e0 2023-07-20T11:06:10.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.723+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcc38051a50 con 0x7fcc480cc3e0 2023-07-20T11:06:10.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.727+0000 7fcc44ff9640 1 -- 172.21.15.82:0/1439021216 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v162) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc3804d780 con 0x7fcc480cc3e0 2023-07-20T11:06:10.708 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T11:06:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 msgr2=0x7fcc34068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 0x7fcc34068800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c0ae000 tx=0x7fcc3c008040 comp rx=0 tx=0).stop 2023-07-20T11:06:10.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 msgr2=0x7fcc4814e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c7c0 tx=0x7fcc3800cc80 comp rx=0 tx=0).stop 2023-07-20T11:06:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 shutdown_connections 2023-07-20T11:06:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fcc34066340 0x7fcc34068800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc480b2180 0x7fcc48155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc48159450 0x7fcc48155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 --2- 172.21.15.82:0/1439021216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc480cc3e0 0x7fcc4814e310 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 >> 172.21.15.82:0/1439021216 conn(0x7fcc480cad50 msgr2=0x7fcc4806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:10.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 shutdown_connections 2023-07-20T11:06:10.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.731+0000 7fcc4e567640 1 -- 172.21.15.82:0/1439021216 wait complete. 2023-07-20T11:06:10.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T11:06:10.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 Processor -- start 2023-07-20T11:06:10.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 -- start start 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e2c159450 0x7f5e2c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159830 0x7f5e2c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2c0cc8d0 con 0x7f5e2c0cc3e0 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2c0cce90 con 0x7f5e2c159450 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e30c48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0ccbb0 con 0x7f5e2c159830 2023-07-20T11:06:10.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e2c159450 0x7f5e2c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e2c159450 0x7f5e2c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58538/0 (socket says 172.21.15.82:58538) 2023-07-20T11:06:10.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 -- 172.21.15.82:0/1715041767 learned_addr learned my addr 172.21.15.82:0/1715041767 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e21d9b640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159830 0x7f5e2c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 -- 172.21.15.82:0/1715041767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159830 msgr2=0x7f5e2c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159830 0x7f5e2c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 -- 172.21.15.82:0/1715041767 >> v1:172.21.15.183:6789/0 conn(0x7f5e2c0cc3e0 legacy=0x7f5e2c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e29d9b640 1 -- 172.21.15.82:0/1715041767 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315977499 0 0) 0x7f5e2c0cc8d0 con 0x7f5e2c0cc3e0 2023-07-20T11:06:10.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.895+0000 7f5e2a59c640 1 -- 172.21.15.82:0/1715041767 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c159cc0 con 0x7f5e2c159450 2023-07-20T11:06:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e2a59c640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c159450 0x7f5e2c15a4c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009870 tx=0x7f5e1c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed98ad85cf2b338 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e29d9b640 1 -- 172.21.15.82:0/1715041767 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0aa650 con 0x7f5e2c159450 2023-07-20T11:06:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e29d9b640 1 -- 172.21.15.82:0/1715041767 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c0aa7b0 con 0x7f5e2c159450 2023-07-20T11:06:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e29d9b640 1 -- 172.21.15.82:0/1715041767 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0aab40 con 0x7f5e2c159450 2023-07-20T11:06:10.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 -- 172.21.15.82:0/1715041767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c159450 msgr2=0x7f5e2c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c159450 0x7f5e2c15a4c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c009870 tx=0x7f5e1c01c510 comp rx=0 tx=0).stop 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 -- 172.21.15.82:0/1715041767 shutdown_connections 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159830 0x7f5e2c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1715041767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c159450 0x7f5e2c15a4c0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 -- 172.21.15.82:0/1715041767 >> 172.21.15.82:0/1715041767 conn(0x7f5e2c0cad50 msgr2=0x7f5e2c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:10.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 -- 172.21.15.82:0/1715041767 shutdown_connections 2023-07-20T11:06:10.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.899+0000 7f5e30c48640 1 -- 172.21.15.82:0/1715041767 wait complete. 2023-07-20T11:06:10.884 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:06:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 Processor -- start 2023-07-20T11:06:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- start start 2023-07-20T11:06:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 0x7f5e2c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159450 0x7f5e2c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c152d70 con 0x7f5e2c0c6500 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0c6990 con 0x7f5e2c0cc3e0 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2c0ae360 con 0x7f5e2c159450 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2a59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 0x7f5e2c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e21d9b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159450 0x7f5e2c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58554/0 (socket says 172.21.15.82:58554) 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 -- 172.21.15.82:0/1380266883 learned_addr learned my addr 172.21.15.82:0/1380266883 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 -- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159450 msgr2=0x7f5e2c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159450 0x7f5e2c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 -- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 msgr2=0x7f5e2c152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 0x7f5e2c152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 -- 172.21.15.82:0/1380266883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0094d0 con 0x7f5e2c0c6500 2023-07-20T11:06:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2a59c640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 0x7f5e2c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e2ad9d640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c7c0 tx=0x7f5e2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:10.889 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:06:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e24003ba0 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e24003d00 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2400aa30 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2c0af1c0 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.903+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c0ae890 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2c04da30 con 0x7f5e2c0c6500 2023-07-20T11:06:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e2400ab90 con 0x7f5e2c0c6500 2023-07-20T11:06:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e237fe640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 0x7f5e0c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6470+0+0 (secure 0 0 0) 0x7f5e24083e00 con 0x7f5e2c0c6500 2023-07-20T11:06:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e2a59c640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 0x7f5e0c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:10.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.907+0000 7f5e2a59c640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 0x7f5e0c068860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0ae000 tx=0x7f5e1c0b5040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:10.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:10.911+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e24050fe0 con 0x7f5e2c0c6500 2023-07-20T11:06:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.059+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5e2c0cbbf0 con 0x7f5e2c0c6500 2023-07-20T11:06:11.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.723+0000 7f5e237fe640 1 -- 172.21.15.82:0/1380266883 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v163) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5e24054600 con 0x7f5e2c0c6500 2023-07-20T11:06:11.705 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T11:06:11.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 msgr2=0x7f5e0c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 0x7f5e0c068860 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0ae000 tx=0x7f5e1c0b5040 comp rx=0 tx=0).stop 2023-07-20T11:06:11.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 msgr2=0x7f5e2c0c1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c7c0 tx=0x7f5e2400cc80 comp rx=0 tx=0).stop 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 shutdown_connections 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5e0c0663a0 0x7f5e0c068860 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e2c0c6500 0x7f5e2c0c1fb0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e2c159450 0x7f5e2c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 --2- 172.21.15.82:0/1380266883 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e2c0cc3e0 0x7f5e2c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 >> 172.21.15.82:0/1380266883 conn(0x7f5e2c0cad50 msgr2=0x7f5e2c0711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:11.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 shutdown_connections 2023-07-20T11:06:11.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.727+0000 7f5e30c48640 1 -- 172.21.15.82:0/1380266883 wait complete. 2023-07-20T11:06:11.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T11:06:11.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.939+0000 7fb6b4d96640 1 Processor -- start 2023-07-20T11:06:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.939+0000 7fb6b4d96640 1 -- start start 2023-07-20T11:06:11.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6b4d96640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6b0159830 0x7fb6b00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6b4d96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b00cc8d0 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6b4d96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b00ccbb0 con 0x7fb6b0159450 2023-07-20T11:06:11.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6b4d96640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b00cce90 con 0x7fb6b0159830 2023-07-20T11:06:11.925 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6aed9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb6b00cc3e0 0x7fb6b00afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:32800/0 (socket says 172.21.15.82:32800) 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6aed9d640 1 -- 172.21.15.82:0/1310881078 learned_addr learned my addr 172.21.15.82:0/1310881078 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331887538 0 0) 0x7fb6b00cc8d0 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6a5d9b640 1 --2- 172.21.15.82:0/1310881078 >> v2:172.21.15.183:3300/0 conn(0x7fb6b0159830 0x7fb6b00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb69c003530 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350751464 0 0) 0x7fb69c003530 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 >> v2:172.21.15.183:3300/0 conn(0x7fb6b0159830 msgr2=0x7fb6b00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 --2- 172.21.15.82:0/1310881078 >> v2:172.21.15.183:3300/0 conn(0x7fb6b0159830 0x7fb6b00cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 >> v1:172.21.15.183:6789/0 conn(0x7fb6b0159450 legacy=0x7fb6b015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b0159cc0 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fb6a8001a00 con 0x7fb6b00cc3e0 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 >> v1:172.21.15.82:6789/0 conn(0x7fb6b00cc3e0 legacy=0x7fb6b00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 0x7fb69c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69c0047d0 0x7fb69c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c0051e0 0x7fb69c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00cce90 con 0x7fb69c003a40 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c00c110 con 0x7fb69c0051e0 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c00c2d0 con 0x7fb69c0047d0 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 0x7fb69c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6a5d9b640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69c0047d0 0x7fb69c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6aed9d640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c0051e0 0x7fb69c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 -- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69c0047d0 msgr2=0x7fb69c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb69c0047d0 0x7fb69c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 -- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c0051e0 msgr2=0x7fb69c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c0051e0 0x7fb69c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6ae59c640 1 -- 172.21.15.82:0/1310881078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c003530 con 0x7fb69c003a40 2023-07-20T11:06:11.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.943+0000 7fb6aed9d640 1 -- 172.21.15.82:0/1310881078 reap_dead start 2023-07-20T11:06:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 0x7fb69c003e60 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001780 tx=0x7fb6a001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d42c28efeddc6c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00052d0 con 0x7fb69c003a40 2023-07-20T11:06:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a00a7050 con 0x7fb69c003a40 2023-07-20T11:06:11.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6add9b640 1 -- 172.21.15.82:0/1310881078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0003600 con 0x7fb69c003a40 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 -- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 msgr2=0x7fb69c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 0x7fb69c003e60 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001780 tx=0x7fb6a001c3b0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 -- 172.21.15.82:0/1310881078 shutdown_connections 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/1310881078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb69c003a40 0x7fb69c003e60 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 -- 172.21.15.82:0/1310881078 >> 172.21.15.82:0/1310881078 conn(0x7fb6b00cad50 msgr2=0x7fb6b00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 -- 172.21.15.82:0/1310881078 shutdown_connections 2023-07-20T11:06:11.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.947+0000 7fb6b4d96640 1 -- 172.21.15.82:0/1310881078 wait complete. 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 Processor -- start 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- start start 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c003a40 0x7fb6b01f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6b0152570 0x7fb6b00c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c8000 con 0x7fb6b00c7b80 2023-07-20T11:06:11.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c5b50 con 0x7fb69c003a40 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00c5520 con 0x7fb6b0152570 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58572/0 (socket says 172.21.15.82:58572) 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 -- 172.21.15.82:0/3844751299 learned_addr learned my addr 172.21.15.82:0/3844751299 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c003a40 0x7fb6b01f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6a5d9b640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6b0152570 0x7fb6b00c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 -- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6b0152570 msgr2=0x7fb6b00c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6b0152570 0x7fb6b00c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 -- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c003a40 msgr2=0x7fb6b01f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c003a40 0x7fb6b01f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:11.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 -- 172.21.15.82:0/3844751299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b01f1fb0 con 0x7fb6b00c7b80 2023-07-20T11:06:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6aed9d640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fb6b015abd0 tx=0x7fb6a8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a800ea40 con 0x7fb6b00c7b80 2023-07-20T11:06:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a800eba0 con 0x7fb6b00c7b80 2023-07-20T11:06:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b00c57e0 con 0x7fb6b00c7b80 2023-07-20T11:06:11.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8013420 con 0x7fb6b00c7b80 2023-07-20T11:06:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b01f1750 con 0x7fb6b00c7b80 2023-07-20T11:06:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.951+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b004da30 con 0x7fb6b00c7b80 2023-07-20T11:06:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.955+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6a8013580 con 0x7fb6b00c7b80 2023-07-20T11:06:11.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.955+0000 7fb6a77fe640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 0x7fb690068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.955+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fb6a8084240 con 0x7fb6b00c7b80 2023-07-20T11:06:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.955+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 0x7fb690068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:11.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.955+0000 7fb6ae59c640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 0x7fb690068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001750 tx=0x7fb6a00011a0 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:11.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:11.959+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6a80515c0 con 0x7fb6b00c7b80 2023-07-20T11:06:12.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.107+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fb6b00c8690 con 0x7fb6b00c7b80 2023-07-20T11:06:12.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.111+0000 7fb6a77fe640 1 -- 172.21.15.82:0/3844751299 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v55) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb6a8054be0 con 0x7fb6b00c7b80 2023-07-20T11:06:12.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 msgr2=0x7fb690068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 0x7fb690068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0001750 tx=0x7fb6a00011a0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 msgr2=0x7fb6b01f1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fb6b015abd0 tx=0x7fb6a8007b00 comp rx=0 tx=0).stop 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 shutdown_connections 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fb6900663d0 0x7fb690068890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6b00c7b80 0x7fb6b01f1210 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6b0152570 0x7fb6b00c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 --2- 172.21.15.82:0/3844751299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb69c003a40 0x7fb6b01f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 >> 172.21.15.82:0/3844751299 conn(0x7fb6b00cad50 msgr2=0x7fb6b00ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 shutdown_connections 2023-07-20T11:06:12.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.115+0000 7fb6b4d96640 1 -- 172.21.15.82:0/3844751299 wait complete. 2023-07-20T11:06:12.117 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T11:06:12.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 Processor -- start 2023-07-20T11:06:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 -- start start 2023-07-20T11:06:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9aec06c120 0x7f9aec0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aec0d0970 con 0x7f9aec1602b0 2023-07-20T11:06:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aec160e20 con 0x7f9aec06b220 2023-07-20T11:06:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af326a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aec0cd300 con 0x7f9aec06c120 2023-07-20T11:06:12.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af1807640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af1807640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58586/0 (socket says 172.21.15.82:58586) 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af1807640 1 -- 172.21.15.82:0/29304241 learned_addr learned my addr 172.21.15.82:0/29304241 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.279+0000 7f9af1006640 1 --2- 172.21.15.82:0/29304241 >> v2:172.21.15.183:3300/0 conn(0x7f9aec06c120 0x7f9aec0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9af1006640 1 -- 172.21.15.82:0/29304241 >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 msgr2=0x7f9aec160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9af1006640 1 --2- 172.21.15.82:0/29304241 >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9af1006640 1 -- 172.21.15.82:0/29304241 >> v1:172.21.15.183:6789/0 conn(0x7f9aec1602b0 legacy=0x7f9aec06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9af1006640 1 -- 172.21.15.82:0/29304241 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec0cd5e0 con 0x7f9aec06c120 2023-07-20T11:06:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9ae3fff640 1 -- 172.21.15.82:0/29304241 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430529730 0 0) 0x7f9aec0d0970 con 0x7f9aec1602b0 2023-07-20T11:06:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.283+0000 7f9af1807640 1 --2- 172.21.15.82:0/29304241 >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:12.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af1006640 1 --2- 172.21.15.82:0/29304241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0cdde0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0d00e0 tx=0x7f9ae801c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6918f2b225a2212 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9ae3fff640 1 -- 172.21.15.82:0/29304241 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80ab600 con 0x7f9aec06c120 2023-07-20T11:06:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9ae3fff640 1 -- 172.21.15.82:0/29304241 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80a7050 con 0x7f9aec06c120 2023-07-20T11:06:12.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9ae3fff640 1 -- 172.21.15.82:0/29304241 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80ab980 con 0x7f9aec06c120 2023-07-20T11:06:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- 172.21.15.82:0/29304241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 msgr2=0x7f9aec0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 --2- 172.21.15.82:0/29304241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0cdde0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0d00e0 tx=0x7f9ae801c310 comp rx=0 tx=0).stop 2023-07-20T11:06:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- 172.21.15.82:0/29304241 shutdown_connections 2023-07-20T11:06:12.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 --2- 172.21.15.82:0/29304241 >> v2:172.21.15.82:3300/0 conn(0x7f9aec06b220 0x7f9aec160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 --2- 172.21.15.82:0/29304241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0cdde0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- 172.21.15.82:0/29304241 >> 172.21.15.82:0/29304241 conn(0x7f9aec08c0a0 msgr2=0x7f9aec09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- 172.21.15.82:0/29304241 shutdown_connections 2023-07-20T11:06:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- 172.21.15.82:0/29304241 wait complete. 2023-07-20T11:06:12.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 Processor -- start 2023-07-20T11:06:12.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.287+0000 7f9af326a640 1 -- start start 2023-07-20T11:06:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aec06b220 0x7f9aec15cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec15ea60 con 0x7f9aec1602b0 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0c82a0 con 0x7f9aec06c120 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aec0c7690 con 0x7f9aec06b220 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58592/0 (socket says 172.21.15.82:58592) 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 -- 172.21.15.82:0/1469865138 learned_addr learned my addr 172.21.15.82:0/1469865138 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:12.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1006640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aec06b220 0x7f9aec15cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af0805640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 -- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aec06b220 msgr2=0x7f9aec15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aec06b220 0x7f9aec15cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 -- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 msgr2=0x7f9aec0c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 -- 172.21.15.82:0/1469865138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae4009b30 con 0x7f9aec1602b0 2023-07-20T11:06:12.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af1807640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400efc0 tx=0x7f9ae400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4018070 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae400f040 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae400ce00 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae8009420 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aec0c7c50 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aec0c8410 con 0x7f9aec1602b0 2023-07-20T11:06:12.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.291+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ae4014480 con 0x7f9aec1602b0 2023-07-20T11:06:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.295+0000 7f9ae1ffb640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 0x7f9ad0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.295+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f9ae4084200 con 0x7f9aec1602b0 2023-07-20T11:06:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.295+0000 7f9af1006640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 0x7f9ad0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.295+0000 7f9af1006640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 0x7f9ad0068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80ad000 tx=0x7f9ae80a6000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.299+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ae4054f90 con 0x7f9aec1602b0 2023-07-20T11:06:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.447+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9aec0cee40 con 0x7f9aec1602b0 2023-07-20T11:06:12.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.451+0000 7f9ae1ffb640 1 -- 172.21.15.82:0/1469865138 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9ae4054b20 con 0x7f9aec1602b0 2023-07-20T11:06:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 msgr2=0x7f9ad0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 0x7f9ad0068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80ad000 tx=0x7f9ae80a6000 comp rx=0 tx=0).stop 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 msgr2=0x7f9aec0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400efc0 tx=0x7f9ae400c490 comp rx=0 tx=0).stop 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 shutdown_connections 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9ad00663a0 0x7f9ad0068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9aec1602b0 0x7f9aec0c9c60 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9aec06c120 0x7f9aec0c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 --2- 172.21.15.82:0/1469865138 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9aec06b220 0x7f9aec15cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 >> 172.21.15.82:0/1469865138 conn(0x7f9aec08c0a0 msgr2=0x7f9aec06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 shutdown_connections 2023-07-20T11:06:12.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.455+0000 7f9af326a640 1 -- 172.21.15.82:0/1469865138 wait complete. 2023-07-20T11:06:12.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T11:06:12.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 Processor -- start 2023-07-20T11:06:12.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 -- start start 2023-07-20T11:06:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594159450 0x7ff59415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5940afd50 0x7ff5940b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5940cc8d0 con 0x7ff594159830 2023-07-20T11:06:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940cce90 con 0x7ff5940afd50 2023-07-20T11:06:12.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff59b511640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940b0700 con 0x7ff594159450 2023-07-20T11:06:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5940afd50 0x7ff5940b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff598aac640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff594159830 0x7ff5940cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:32808/0 (socket says 172.21.15.82:32808) 2023-07-20T11:06:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff598aac640 1 -- 172.21.15.82:0/1583397758 learned_addr learned my addr 172.21.15.82:0/1583397758 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5940afd50 0x7ff5940b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58596/0 (socket says 172.21.15.82:58596) 2023-07-20T11:06:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff5992ad640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594159450 0x7ff59415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 -- 172.21.15.82:0/1583397758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594159450 msgr2=0x7ff59415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594159450 0x7ff59415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 -- 172.21.15.82:0/1583397758 >> v1:172.21.15.82:6789/0 conn(0x7ff594159830 legacy=0x7ff5940cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff599aae640 1 -- 172.21.15.82:0/1583397758 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940ccbb0 con 0x7ff5940afd50 2023-07-20T11:06:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.615+0000 7ff58bfff640 1 -- 172.21.15.82:0/1583397758 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728749113 0 0) 0x7ff5940cc8d0 con 0x7ff594159830 2023-07-20T11:06:12.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff599aae640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940b01c0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009dc0 tx=0x7ff58c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8191510550794ae4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff58bfff640 1 -- 172.21.15.82:0/1583397758 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0a59c0 con 0x7ff5940afd50 2023-07-20T11:06:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff58bfff640 1 -- 172.21.15.82:0/1583397758 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c0a5b20 con 0x7ff5940afd50 2023-07-20T11:06:12.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff58bfff640 1 -- 172.21.15.82:0/1583397758 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0ad440 con 0x7ff5940afd50 2023-07-20T11:06:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 -- 172.21.15.82:0/1583397758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 msgr2=0x7ff5940b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940b01c0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009dc0 tx=0x7ff58c01c900 comp rx=0 tx=0).stop 2023-07-20T11:06:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 -- 172.21.15.82:0/1583397758 shutdown_connections 2023-07-20T11:06:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940b01c0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 --2- 172.21.15.82:0/1583397758 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594159450 0x7ff59415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 -- 172.21.15.82:0/1583397758 >> 172.21.15.82:0/1583397758 conn(0x7ff5940cad50 msgr2=0x7ff5940cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 -- 172.21.15.82:0/1583397758 shutdown_connections 2023-07-20T11:06:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.619+0000 7ff59b511640 1 -- 172.21.15.82:0/1583397758 wait complete. 2023-07-20T11:06:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 Processor -- start 2023-07-20T11:06:12.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- start start 2023-07-20T11:06:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff594159450 0x7ff5941475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594154770 0x7ff5940c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940c34c0 con 0x7ff5940afd50 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940c36a0 con 0x7ff594159450 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5940c3980 con 0x7ff594154770 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58612/0 (socket says 172.21.15.82:58612) 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 -- 172.21.15.82:0/1160564659 learned_addr learned my addr 172.21.15.82:0/1160564659 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:12.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 -- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594154770 msgr2=0x7ff5940c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594154770 0x7ff5940c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 -- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff594159450 msgr2=0x7ff5941475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff594159450 0x7ff5941475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 -- 172.21.15.82:0/1160564659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009a70 con 0x7ff5940afd50 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff5992ad640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff59000d800 tx=0x7ff59000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000b6c0 con 0x7ff5940afd50 2023-07-20T11:06:12.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000b820 con 0x7ff5940afd50 2023-07-20T11:06:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000bb90 con 0x7ff5940afd50 2023-07-20T11:06:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5940c3c60 con 0x7ff5940afd50 2023-07-20T11:06:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.623+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5940c4220 con 0x7ff5940afd50 2023-07-20T11:06:12.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59404da30 con 0x7ff5940afd50 2023-07-20T11:06:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff59000bcf0 con 0x7ff5940afd50 2023-07-20T11:06:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff589ffb640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 0x7ff578068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7ff590084440 con 0x7ff5940afd50 2023-07-20T11:06:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff598aac640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 0x7ff578068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.627+0000 7ff598aac640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 0x7ff578068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5940c5a30 tx=0x7ff584007970 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.631+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff590055230 con 0x7ff5940afd50 2023-07-20T11:06:12.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.791+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff5940cbbf0 con 0x7ff5940afd50 2023-07-20T11:06:12.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff589ffb640 1 -- 172.21.15.82:0/1160564659 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff590054dc0 con 0x7ff5940afd50 2023-07-20T11:06:12.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 msgr2=0x7ff578068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 0x7ff578068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5940c5a30 tx=0x7ff584007970 comp rx=0 tx=0).stop 2023-07-20T11:06:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 msgr2=0x7ff5940c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff59000d800 tx=0x7ff59000dcc0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 shutdown_connections 2023-07-20T11:06:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5780663a0 0x7ff578068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff594154770 0x7ff5940c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff594159450 0x7ff5941475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 --2- 172.21.15.82:0/1160564659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5940afd50 0x7ff5940c2810 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 >> 172.21.15.82:0/1160564659 conn(0x7ff5940cad50 msgr2=0x7ff594158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 shutdown_connections 2023-07-20T11:06:12.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.799+0000 7ff59b511640 1 -- 172.21.15.82:0/1160564659 wait complete. 2023-07-20T11:06:12.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-20T11:06:12.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 Processor -- start 2023-07-20T11:06:12.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 -- start start 2023-07-20T11:06:12.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 0x7fe7b00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 0x7fe7b00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b00d16b0 con 0x7fe7b00d0d10 2023-07-20T11:06:12.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b00d31c0 con 0x7fe7b00ce4c0 2023-07-20T11:06:12.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7b4c6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00b3520 con 0x7fe7b015cab0 2023-07-20T11:06:12.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7a5d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe7b00d0d10 0x7fe7b00cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:32818/0 (socket says 172.21.15.82:32818) 2023-07-20T11:06:12.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7a5d9b640 1 -- 172.21.15.82:0/134632687 learned_addr learned my addr 172.21.15.82:0/134632687 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/134632687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 0x7fe7b00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7aed9d640 1 --2- 172.21.15.82:0/134632687 >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 0x7fe7b00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063618996 0 0) 0x7fe7b00d16b0 con 0x7fe7b00d0d10 2023-07-20T11:06:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe79c003530 con 0x7fe7b00d0d10 2023-07-20T11:06:12.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 352952155 0 0) 0x7fe79c003530 con 0x7fe7b00d0d10 2023-07-20T11:06:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7ae59c640 1 -- 172.21.15.82:0/134632687 >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 msgr2=0x7fe7b00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/134632687 >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 0x7fe7b00d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7ae59c640 1 -- 172.21.15.82:0/134632687 >> v1:172.21.15.82:6789/0 conn(0x7fe7b00d0d10 legacy=0x7fe7b00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7ae59c640 1 -- 172.21.15.82:0/134632687 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b00b2910 con 0x7fe7b015cab0 2023-07-20T11:06:12.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.959+0000 7fe7aed9d640 1 --2- 172.21.15.82:0/134632687 >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 0x7fe7b00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:12.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/134632687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 0x7fe7b00d0300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00097c0 tx=0x7fe7a001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=340af6b5276aa800 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798001680 con 0x7fe7b015cab0 2023-07-20T11:06:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a00a7050 con 0x7fe7b015cab0 2023-07-20T11:06:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7add9b640 1 -- 172.21.15.82:0/134632687 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00ab620 con 0x7fe7b015cab0 2023-07-20T11:06:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/134632687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 msgr2=0x7fe7b00d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/134632687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 0x7fe7b00d0300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00097c0 tx=0x7fe7a001c370 comp rx=0 tx=0).stop 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/134632687 shutdown_connections 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/134632687 >> v2:172.21.15.183:3300/0 conn(0x7fe7b00ce4c0 0x7fe7b00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/134632687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b015cab0 0x7fe7b00d0300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/134632687 >> 172.21.15.82:0/134632687 conn(0x7fe7b008c120 msgr2=0x7fe7b009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/134632687 shutdown_connections 2023-07-20T11:06:12.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.963+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/134632687 wait complete. 2023-07-20T11:06:12.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 Processor -- start 2023-07-20T11:06:12.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- start start 2023-07-20T11:06:12.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 0x7fe7b00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 0x7fe7b0155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0156180 con 0x7fe7b015cab0 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00b6700 con 0x7fe7b00d0d10 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01f8f60 con 0x7fe7b00ce4c0 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58614/0 (socket says 172.21.15.82:58614) 2023-07-20T11:06:12.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 -- 172.21.15.82:0/2229453456 learned_addr learned my addr 172.21.15.82:0/2229453456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:12.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7a5d9b640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 0x7fe7b0155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 0x7fe7b00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 -- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 msgr2=0x7fe7b00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 0x7fe7b00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 -- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 msgr2=0x7fe7b0155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:12.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 0x7fe7b0155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:12.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 -- 172.21.15.82:0/2229453456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009a70 con 0x7fe7b015cab0 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7a5d9b640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 0x7fe7b0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 0x7fe7b00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7aed9d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800efb0 tx=0x7fe7a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8014480 con 0x7fe7b015cab0 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800f040 con 0x7fe7b015cab0 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0009420 con 0x7fe7b015cab0 2023-07-20T11:06:12.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8014800 con 0x7fe7b015cab0 2023-07-20T11:06:12.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.967+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00b6bb0 con 0x7fe7b015cab0 2023-07-20T11:06:12.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b0073c70 con 0x7fe7b015cab0 2023-07-20T11:06:12.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe7a8014960 con 0x7fe7b015cab0 2023-07-20T11:06:12.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7a77fe640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 0x7fe790068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:12.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fe7a8084f80 con 0x7fe7b015cab0 2023-07-20T11:06:12.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 0x7fe790068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:12.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.971+0000 7fe7ae59c640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 0x7fe790068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00ad000 tx=0x7fe7a0008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:12.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:12.975+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7a80b5700 con 0x7fe7b015cab0 2023-07-20T11:06:13.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.175+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fe7b006aa60 con 0x7fe7b015cab0 2023-07-20T11:06:13.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.731+0000 7fe7a77fe640 1 -- 172.21.15.82:0/2229453456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2469) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe7a8018070 con 0x7fe7b015cab0 2023-07-20T11:06:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 msgr2=0x7fe790068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 0x7fe790068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00ad000 tx=0x7fe7a0008040 comp rx=0 tx=0).stop 2023-07-20T11:06:13.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 msgr2=0x7fe7b01f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800efb0 tx=0x7fe7a800c490 comp rx=0 tx=0).stop 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 shutdown_connections 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe7900663a0 0x7fe790068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7b015cab0 0x7fe7b01f8a20 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7b00d0d10 0x7fe7b0155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 --2- 172.21.15.82:0/2229453456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7b00ce4c0 0x7fe7b00cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 >> 172.21.15.82:0/2229453456 conn(0x7fe7b008c120 msgr2=0x7fe7b00af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:13.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 shutdown_connections 2023-07-20T11:06:13.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.735+0000 7fe7b4c6d640 1 -- 172.21.15.82:0/2229453456 wait complete. 2023-07-20T11:06:13.738 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-07-20T11:06:13.739 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-07-20T11:06:13.739 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T11:06:13.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-20T11:06:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 Processor -- start 2023-07-20T11:06:13.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 -- start start 2023-07-20T11:06:13.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f900d0d10 0x7f7f900d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 0x7f7f900cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900d16b0 con 0x7f7f9015cab0 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900d31c0 con 0x7f7f900d0d10 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f96396640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900b3520 con 0x7f7f900cd4b0 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f900d0d10 0x7f7f900d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7f900d0d10 0x7f7f900d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58292/0 (socket says 172.21.15.82:58292) 2023-07-20T11:06:13.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 -- 172.21.15.82:0/650522616 learned_addr learned my addr 172.21.15.82:0/650522616 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:13.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f94933640 1 --2- 172.21.15.82:0/650522616 >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 0x7f7f900cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 -- 172.21.15.82:0/650522616 >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 msgr2=0x7f7f900cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:13.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 --2- 172.21.15.82:0/650522616 >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 0x7f7f900cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 -- 172.21.15.82:0/650522616 >> v1:172.21.15.183:6789/0 conn(0x7f7f9015cab0 legacy=0x7f7f900d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f8f7fe640 1 -- 172.21.15.82:0/650522616 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900d0a10 con 0x7f7f900d0d10 2023-07-20T11:06:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.899+0000 7f7f94933640 1 --2- 172.21.15.82:0/650522616 >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 0x7f7f900cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f8f7fe640 1 --2- 172.21.15.82:0/650522616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900d0d10 0x7f7f900d1170 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7f90071cd0 tx=0x7f7f8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d443fe4fa6cd9bb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f8effd640 1 -- 172.21.15.82:0/650522616 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840aa430 con 0x7f7f900d0d10 2023-07-20T11:06:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f8effd640 1 -- 172.21.15.82:0/650522616 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f840aa590 con 0x7f7f900d0d10 2023-07-20T11:06:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f8effd640 1 -- 172.21.15.82:0/650522616 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840aa920 con 0x7f7f900d0d10 2023-07-20T11:06:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 -- 172.21.15.82:0/650522616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900d0d10 msgr2=0x7f7f900d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 --2- 172.21.15.82:0/650522616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900d0d10 0x7f7f900d1170 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7f90071cd0 tx=0x7f7f8401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 -- 172.21.15.82:0/650522616 shutdown_connections 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 --2- 172.21.15.82:0/650522616 >> v2:172.21.15.183:3300/0 conn(0x7f7f900cd4b0 0x7f7f900cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 --2- 172.21.15.82:0/650522616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900d0d10 0x7f7f900d1170 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 -- 172.21.15.82:0/650522616 >> 172.21.15.82:0/650522616 conn(0x7f7f9008c120 msgr2=0x7f7f9009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 -- 172.21.15.82:0/650522616 shutdown_connections 2023-07-20T11:06:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.903+0000 7f7f96396640 1 -- 172.21.15.82:0/650522616 wait complete. 2023-07-20T11:06:13.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 Processor -- start 2023-07-20T11:06:13.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- start start 2023-07-20T11:06:13.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f900d0d10 0x7f7f9014b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f9015cab0 0x7f7f900c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9015b420 con 0x7f7f900cd4b0 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900c90c0 con 0x7f7f900d0d10 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9014b870 con 0x7f7f9015cab0 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58302/0 (socket says 172.21.15.82:58302) 2023-07-20T11:06:13.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 -- 172.21.15.82:0/2795556971 learned_addr learned my addr 172.21.15.82:0/2795556971 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8f7fe640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f900d0d10 0x7f7f9014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f94933640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f9015cab0 0x7f7f900c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 -- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f9015cab0 msgr2=0x7f7f900c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f9015cab0 0x7f7f900c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 -- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f900d0d10 msgr2=0x7f7f9014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f900d0d10 0x7f7f9014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 -- 172.21.15.82:0/2795556971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f840094d0 con 0x7f7f900cd4b0 2023-07-20T11:06:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8ffff640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000c3c0 tx=0x7f7f8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f800052d0 con 0x7f7f900cd4b0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80005430 con 0x7f7f900cd4b0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9006bf50 con 0x7f7f900cd4b0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80003840 con 0x7f7f900cd4b0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.907+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9015add0 con 0x7f7f900cd4b0 2023-07-20T11:06:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f90073c70 con 0x7f7f900cd4b0 2023-07-20T11:06:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f800039a0 con 0x7f7f900cd4b0 2023-07-20T11:06:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f8cff9640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 0x7f7f7c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f7f80083380 con 0x7f7f900cd4b0 2023-07-20T11:06:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f8f7fe640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 0x7f7f7c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.911+0000 7f7f8f7fe640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 0x7f7f7c068890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ae000 tx=0x7f7f840b5040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:13.915+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f80050700 con 0x7f7f900cd4b0 2023-07-20T11:06:14.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.115+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f7f900b4950 con 0x7f7f900cd4b0 2023-07-20T11:06:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.739+0000 7f7f8cff9640 1 -- 172.21.15.82:0/2795556971 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2470) v1 ==== 168+0+0 (secure 0 0 0) 0x7f7f80053d20 con 0x7f7f900cd4b0 2023-07-20T11:06:14.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 msgr2=0x7f7f7c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 0x7f7f7c068890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7f840ae000 tx=0x7f7f840b5040 comp rx=0 tx=0).stop 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 msgr2=0x7f7f900c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000c3c0 tx=0x7f7f8000c880 comp rx=0 tx=0).stop 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 shutdown_connections 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7f7c0663d0 0x7f7f7c068890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f9015cab0 0x7f7f900c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f900d0d10 0x7f7f9014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 --2- 172.21.15.82:0/2795556971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f900cd4b0 0x7f7f900c8b80 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 >> 172.21.15.82:0/2795556971 conn(0x7f7f9008c120 msgr2=0x7f7f900af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 shutdown_connections 2023-07-20T11:06:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.743+0000 7f7f96396640 1 -- 172.21.15.82:0/2795556971 wait complete. 2023-07-20T11:06:14.745 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:14.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 Processor -- start 2023-07-20T11:06:14.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 -- start start 2023-07-20T11:06:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e080b2060 0x7f9e080b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080b06c0 con 0x7f9e0815a8e0 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080b3160 con 0x7f9e080b2060 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.907+0000 7f9e0d182640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080b12a0 con 0x7f9e080afda0 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e080b2060 0x7f9e080b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9e080b2060 0x7f9e080b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58312/0 (socket says 172.21.15.82:58312) 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 -- 172.21.15.82:0/2989424546 learned_addr learned my addr 172.21.15.82:0/2989424546 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 -- 172.21.15.82:0/2989424546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 msgr2=0x7f9e080ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 -- 172.21.15.82:0/2989424546 >> v1:172.21.15.183:6789/0 conn(0x7f9e0815a8e0 legacy=0x7f9e080b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:14.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 -- 172.21.15.82:0/2989424546 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080b1580 con 0x7f9e080b2060 2023-07-20T11:06:14.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0759e640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080b0180 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009e50 tx=0x7f9e0001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53c6827ccc55aa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0659c640 1 -- 172.21.15.82:0/2989424546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000a5700 con 0x7f9e080b2060 2023-07-20T11:06:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0659c640 1 -- 172.21.15.82:0/2989424546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000a5860 con 0x7f9e080b2060 2023-07-20T11:06:14.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.911+0000 7f9e0659c640 1 -- 172.21.15.82:0/2989424546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000a5bf0 con 0x7f9e080b2060 2023-07-20T11:06:14.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- 172.21.15.82:0/2989424546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 msgr2=0x7f9e080b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:14.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080b0180 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009e50 tx=0x7f9e0001c880 comp rx=0 tx=0).stop 2023-07-20T11:06:14.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- 172.21.15.82:0/2989424546 shutdown_connections 2023-07-20T11:06:14.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080b0180 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2989424546 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- 172.21.15.82:0/2989424546 >> 172.21.15.82:0/2989424546 conn(0x7f9e080cada0 msgr2=0x7f9e080cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- 172.21.15.82:0/2989424546 shutdown_connections 2023-07-20T11:06:14.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- 172.21.15.82:0/2989424546 wait complete. 2023-07-20T11:06:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 Processor -- start 2023-07-20T11:06:14.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- start start 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e0815a8e0 0x7f9e08158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080c2ab0 con 0x7f9e080b2060 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080c4df0 con 0x7f9e0815a8e0 2023-07-20T11:06:14.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9e0d182640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080ac450 con 0x7f9e080afda0 2023-07-20T11:06:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9dfe59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9dfe59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58322/0 (socket says 172.21.15.82:58322) 2023-07-20T11:06:14.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.915+0000 7f9dfe59c640 1 -- 172.21.15.82:0/2128703828 learned_addr learned my addr 172.21.15.82:0/2128703828 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e0759e640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e0815a8e0 0x7f9e08158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 -- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 msgr2=0x7f9e080c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 -- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e0815a8e0 msgr2=0x7f9e08158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e0815a8e0 0x7f9e08158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 -- 172.21.15.82:0/2128703828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009b30 con 0x7f9e080b2060 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfe59c640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f9df000b410 tx=0x7f9df000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0004020 con 0x7f9e080b2060 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0004180 con 0x7f9e080b2060 2023-07-20T11:06:14.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0011630 con 0x7f9e080b2060 2023-07-20T11:06:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e080ac730 con 0x7f9e080b2060 2023-07-20T11:06:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e080accf0 con 0x7f9e080b2060 2023-07-20T11:06:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08073c70 con 0x7f9e080b2060 2023-07-20T11:06:14.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.919+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9df0011790 con 0x7f9e080b2060 2023-07-20T11:06:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.923+0000 7f9dfffff640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 0x7f9de806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.923+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f9df0083b90 con 0x7f9e080b2060 2023-07-20T11:06:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.923+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 0x7f9de806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:14.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.923+0000 7f9e06d9d640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 0x7f9de806cca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9df8007a70 tx=0x7f9df8008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:14.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:14.927+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9df0050ef0 con 0x7f9e080b2060 2023-07-20T11:06:15.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e080cb990 con 0x7f9e080b2060 2023-07-20T11:06:15.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9dfffff640 1 -- 172.21.15.82:0/2128703828 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+15870 (secure 0 0 0) 0x7f9df0015090 con 0x7f9e080b2060 2023-07-20T11:06:15.057 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:15.057 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":163,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:11.717188+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/2913878511":"2023-07-21T11:06:08.700943+0000","172.21.15.82:6835/2913878511":"2023-07-21T11:06:08.700943+0000","172.21.15.82:0/4275433715":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/1017650147":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/4277405881":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/719079176":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6833/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2554583811":"2023-07-21T11:06:05.953573+0000","172.21.15.82:6832/2615753715":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/2944636111":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/3836891304":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/139796629":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1111634489":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/4005336874":"2023-07-21T11:05:59.000377+0000","172.21.15.82:0/1368641827":"2023-07-21T11:05:59.000377+0000","172.21.15.82:6832/1398603107":"2023-07-21T11:06:05.953573+0000","172.21.15.82:0/166062347":"2023-07-21T11:05:59.000377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 msgr2=0x7f9de806cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 0x7f9de806cca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9df8007a70 tx=0x7f9df8008040 comp rx=0 tx=0).stop 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 msgr2=0x7f9e080c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f9df000b410 tx=0x7f9df000b8d0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 shutdown_connections 2023-07-20T11:06:15.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9de806a7e0 0x7f9de806cca0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e0815a8e0 0x7f9e08158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e080b2060 0x7f9e080c48b0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 --2- 172.21.15.82:0/2128703828 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e080afda0 0x7f9e080c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 >> 172.21.15.82:0/2128703828 conn(0x7f9e080cada0 msgr2=0x7f9e08159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 shutdown_connections 2023-07-20T11:06:15.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.075+0000 7f9e0d182640 1 -- 172.21.15.82:0/2128703828 wait complete. 2023-07-20T11:06:15.078 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:06:15.079 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:06:15.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 Processor -- start 2023-07-20T11:06:15.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 -- start start 2023-07-20T11:06:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa524161de0 0x7fa5240afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240b06e0 con 0x7fa5240b0290 2023-07-20T11:06:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5240c9370 con 0x7fa524160ba0 2023-07-20T11:06:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa52be9c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5240c9650 con 0x7fa524161de0 2023-07-20T11:06:15.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa524161de0 0x7fa5240afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa524161de0 0x7fa5240afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58330/0 (socket says 172.21.15.82:58330) 2023-07-20T11:06:15.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 -- 172.21.15.82:0/370728632 learned_addr learned my addr 172.21.15.82:0/370728632 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:15.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 -- 172.21.15.82:0/370728632 >> v1:172.21.15.183:6789/0 conn(0x7fa524160ba0 legacy=0x7fa5240c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 -- 172.21.15.82:0/370728632 >> v1:172.21.15.82:6789/0 conn(0x7fa5240b0290 legacy=0x7fa5240cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.239+0000 7fa529437640 1 -- 172.21.15.82:0/370728632 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524161300 con 0x7fa524161de0 2023-07-20T11:06:15.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa529437640 1 --2- 172.21.15.82:0/370728632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524161de0 0x7fa5240afd50 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa514009870 tx=0x7fa51401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce0f08a541dbcfe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa528c36640 1 -- 172.21.15.82:0/370728632 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5140a6040 con 0x7fa524161de0 2023-07-20T11:06:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa528c36640 1 -- 172.21.15.82:0/370728632 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140aa600 con 0x7fa524161de0 2023-07-20T11:06:15.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa528c36640 1 -- 172.21.15.82:0/370728632 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5140aa990 con 0x7fa524161de0 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 -- 172.21.15.82:0/370728632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524161de0 msgr2=0x7fa5240afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 --2- 172.21.15.82:0/370728632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524161de0 0x7fa5240afd50 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa514009870 tx=0x7fa51401c510 comp rx=0 tx=0).stop 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 -- 172.21.15.82:0/370728632 shutdown_connections 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 --2- 172.21.15.82:0/370728632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524161de0 0x7fa5240afd50 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 -- 172.21.15.82:0/370728632 >> 172.21.15.82:0/370728632 conn(0x7fa5240cad50 msgr2=0x7fa5240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 -- 172.21.15.82:0/370728632 shutdown_connections 2023-07-20T11:06:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.243+0000 7fa52be9c640 1 -- 172.21.15.82:0/370728632 wait complete. 2023-07-20T11:06:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 Processor -- start 2023-07-20T11:06:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- start start 2023-07-20T11:06:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5240b0290 0x7fa5240c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa524161de0 0x7fa52415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241619c0 con 0x7fa524160ba0 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c2900 con 0x7fa5240b0290 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240c4040 con 0x7fa524161de0 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58338/0 (socket says 172.21.15.82:58338) 2023-07-20T11:06:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 -- 172.21.15.82:0/3546048041 learned_addr learned my addr 172.21.15.82:0/3546048041 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529c38640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5240b0290 0x7fa5240c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52a439640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa524161de0 0x7fa52415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 -- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa524161de0 msgr2=0x7fa52415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa524161de0 0x7fa52415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 -- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5240b0290 msgr2=0x7fa5240c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5240b0290 0x7fa5240c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 -- 172.21.15.82:0/3546048041 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5140094d0 con 0x7fa524160ba0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa529437640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa51401a140 tx=0x7fa51401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5140b3800 con 0x7fa524160ba0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5140b3960 con 0x7fa524160ba0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5140b3d10 con 0x7fa524160ba0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5240c4320 con 0x7fa524160ba0 2023-07-20T11:06:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.247+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5240b2980 con 0x7fa524160ba0 2023-07-20T11:06:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52404da30 con 0x7fa524160ba0 2023-07-20T11:06:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa5140bc3e0 con 0x7fa524160ba0 2023-07-20T11:06:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa51a7fc640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 0x7fa508068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fa51411dff0 con 0x7fa524160ba0 2023-07-20T11:06:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa529c38640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 0x7fa508068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.251+0000 7fa529c38640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 0x7fa508068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa520007fd0 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.255+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5140eb260 con 0x7fa524160ba0 2023-07-20T11:06:15.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.403+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5240b4250 con 0x7fa524160ba0 2023-07-20T11:06:15.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.403+0000 7fa51a7fc640 1 -- 172.21.15.82:0/3546048041 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5140c20a0 con 0x7fa524160ba0 2023-07-20T11:06:15.386 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:06:15.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 msgr2=0x7fa508068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 0x7fa508068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa520007fd0 tx=0x7fa520009040 comp rx=0 tx=0).stop 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 msgr2=0x7fa5240c23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7fa51401a140 tx=0x7fa51401ad50 comp rx=0 tx=0).stop 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 shutdown_connections 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa5080663d0 0x7fa508068890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa524161de0 0x7fa52415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa524160ba0 0x7fa5240c23c0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 --2- 172.21.15.82:0/3546048041 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5240b0290 0x7fa5240c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 >> 172.21.15.82:0/3546048041 conn(0x7fa5240cad50 msgr2=0x7fa5240aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 shutdown_connections 2023-07-20T11:06:15.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.407+0000 7fa52be9c640 1 -- 172.21.15.82:0/3546048041 wait complete. 2023-07-20T11:06:15.407 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:06:15.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 Processor -- start 2023-07-20T11:06:15.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 -- start start 2023-07-20T11:06:15.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65d8159450 0x7f65d815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159830 0x7f65d80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 0x7f65d80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80cce90 con 0x7f65d8159450 2023-07-20T11:06:15.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d80cc8d0 con 0x7f65d80cc3e0 2023-07-20T11:06:15.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.567+0000 7f65dc8e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d80ccbb0 con 0x7f65d8159830 2023-07-20T11:06:15.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65d8159450 0x7f65d815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f65d8159450 0x7f65d815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58344/0 (socket says 172.21.15.82:58344) 2023-07-20T11:06:15.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 -- 172.21.15.82:0/1126462703 learned_addr learned my addr 172.21.15.82:0/1126462703 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65cdd9b640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159830 0x7f65d80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d6d9d640 1 --2- 172.21.15.82:0/1126462703 >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 0x7f65d80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 -- 172.21.15.82:0/1126462703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159830 msgr2=0x7f65d80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159830 0x7f65d80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 -- 172.21.15.82:0/1126462703 >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 msgr2=0x7f65d80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:15.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 --2- 172.21.15.82:0/1126462703 >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 0x7f65d80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 -- 172.21.15.82:0/1126462703 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8159cc0 con 0x7f65d8159450 2023-07-20T11:06:15.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d6d9d640 1 --2- 172.21.15.82:0/1126462703 >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 0x7f65d80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:15.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d659c640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d8159450 0x7f65d815a4c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ce1b0 tx=0x7f65c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c99b71a2d223e9f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.571+0000 7f65d5d9b640 1 -- 172.21.15.82:0/1126462703 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c80ac600 con 0x7f65d8159450 2023-07-20T11:06:15.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65d5d9b640 1 -- 172.21.15.82:0/1126462703 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c80a8050 con 0x7f65d8159450 2023-07-20T11:06:15.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65d5d9b640 1 -- 172.21.15.82:0/1126462703 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c80ac980 con 0x7f65d8159450 2023-07-20T11:06:15.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- 172.21.15.82:0/1126462703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d8159450 msgr2=0x7f65d815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d8159450 0x7f65d815a4c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f65d80ce1b0 tx=0x7f65c801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- 172.21.15.82:0/1126462703 shutdown_connections 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/1126462703 >> v2:172.21.15.183:3300/0 conn(0x7f65d80cc3e0 0x7f65d80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159830 0x7f65d80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/1126462703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d8159450 0x7f65d815a4c0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- 172.21.15.82:0/1126462703 >> 172.21.15.82:0/1126462703 conn(0x7f65d80cad50 msgr2=0x7f65d80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- 172.21.15.82:0/1126462703 shutdown_connections 2023-07-20T11:06:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- 172.21.15.82:0/1126462703 wait complete. 2023-07-20T11:06:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 Processor -- start 2023-07-20T11:06:15.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- start start 2023-07-20T11:06:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 0x7f65d8153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159450 0x7f65d815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d81544a0 con 0x7f65d815bb60 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d8154780 con 0x7f65d80cc3e0 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.575+0000 7f65dc8e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d815c000 con 0x7f65d8159450 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58356/0 (socket says 172.21.15.82:58356) 2023-07-20T11:06:15.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 -- 172.21.15.82:0/659112532 learned_addr learned my addr 172.21.15.82:0/659112532 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d659c640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 0x7f65d8153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65cdd9b640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159450 0x7f65d815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 -- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159450 msgr2=0x7f65d815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159450 0x7f65d815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 -- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 msgr2=0x7f65d8153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 0x7f65d8153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 -- 172.21.15.82:0/659112532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80094d0 con 0x7f65d815bb60 2023-07-20T11:06:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d659c640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 0x7f65d8153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:15.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65d6d9d640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007e20 tx=0x7f65d000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0015600 con 0x7f65d815bb60 2023-07-20T11:06:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000f040 con 0x7f65d815bb60 2023-07-20T11:06:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d00159c0 con 0x7f65d815bb60 2023-07-20T11:06:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d815c2e0 con 0x7f65d815bb60 2023-07-20T11:06:15.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d8153e80 con 0x7f65d815bb60 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d804da30 con 0x7f65d815bb60 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.579+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65d001e3b0 con 0x7f65d815bb60 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.583+0000 7f65cf7fe640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 0x7f65b8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.583+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f65d00841e0 con 0x7f65d815bb60 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.583+0000 7f65d659c640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 0x7f65b8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.583+0000 7f65d659c640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 0x7f65b8068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65c80ae000 tx=0x7f65c80a7000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.587+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65d0051580 con 0x7f65d815bb60 2023-07-20T11:06:15.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.731+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65d81548c0 con 0x7f65d815bb60 2023-07-20T11:06:15.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.731+0000 7f65cf7fe640 1 -- 172.21.15.82:0/659112532 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65d001a020 con 0x7f65d815bb60 2023-07-20T11:06:15.715 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:06:15.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 msgr2=0x7f65b8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 0x7f65b8068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f65c80ae000 tx=0x7f65c80a7000 comp rx=0 tx=0).stop 2023-07-20T11:06:15.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 msgr2=0x7f65d80c2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007e20 tx=0x7f65d000d4a0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 shutdown_connections 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65b80663a0 0x7f65b8068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65d815bb60 0x7f65d80c2300 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65d8159450 0x7f65d815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 --2- 172.21.15.82:0/659112532 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f65d80cc3e0 0x7f65d8153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 >> 172.21.15.82:0/659112532 conn(0x7f65d80cad50 msgr2=0x7f65d80cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 shutdown_connections 2023-07-20T11:06:15.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.735+0000 7f65dc8e5640 1 -- 172.21.15.82:0/659112532 wait complete. 2023-07-20T11:06:15.737 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T11:06:15.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.895+0000 7fba3e72d640 1 Processor -- start 2023-07-20T11:06:15.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.895+0000 7fba3e72d640 1 -- start start 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3e72d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fba3806be30 0x7fba380cc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3e72d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380c86d0 con 0x7fba38071740 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3e72d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba380c9530 con 0x7fba380c1680 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3e72d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba38071b20 con 0x7fba3806be30 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3d72b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fba38071740 0x7fba3806f540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33388/0 (socket says 172.21.15.82:33388) 2023-07-20T11:06:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3d72b640 1 -- 172.21.15.82:0/3228810771 learned_addr learned my addr 172.21.15.82:0/3228810771 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700613174 0 0) 0x7fba380c86d0 con 0x7fba38071740 2023-07-20T11:06:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 --2- 172.21.15.82:0/3228810771 >> v2:172.21.15.183:3300/0 conn(0x7fba3806be30 0x7fba380cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba24003530 con 0x7fba38071740 2023-07-20T11:06:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351701369 0 0) 0x7fba24003530 con 0x7fba38071740 2023-07-20T11:06:15.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 >> v2:172.21.15.183:3300/0 conn(0x7fba3806be30 msgr2=0x7fba380cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 --2- 172.21.15.82:0/3228810771 >> v2:172.21.15.183:3300/0 conn(0x7fba3806be30 0x7fba380cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 >> v1:172.21.15.183:6789/0 conn(0x7fba380c1680 legacy=0x7fba3806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380cee30 con 0x7fba38071740 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fba34001680 con 0x7fba38071740 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 >> v1:172.21.15.82:6789/0 conn(0x7fba38071740 legacy=0x7fba3806f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba24003a40 0x7fba24003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba240047d0 0x7fba24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 0x7fba2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba38071b20 con 0x7fba240051e0 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2400c0f0 con 0x7fba240047d0 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2400c2b0 con 0x7fba24003a40 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 0x7fba2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3cf2a640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba240047d0 0x7fba24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3d72b640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba24003a40 0x7fba24003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 -- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba24003a40 msgr2=0x7fba24003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba24003a40 0x7fba24003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 -- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba240047d0 msgr2=0x7fba24004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba240047d0 0x7fba24004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.899+0000 7fba3df2c640 1 -- 172.21.15.82:0/3228810771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24003530 con 0x7fba240051e0 2023-07-20T11:06:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3df2c640 1 -- 172.21.15.82:0/3228810771 reap_dead start 2023-07-20T11:06:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3df2c640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 0x7fba2400b990 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fba30009f90 tx=0x7fba3001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c16e0ccd3b875d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300a5c70 con 0x7fba240051e0 2023-07-20T11:06:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3000f040 con 0x7fba240051e0 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba2ffff640 1 -- 172.21.15.82:0/3228810771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300039a0 con 0x7fba240051e0 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 -- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 msgr2=0x7fba2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 0x7fba2400b990 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fba30009f90 tx=0x7fba3001cc60 comp rx=0 tx=0).stop 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 -- 172.21.15.82:0/3228810771 shutdown_connections 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 --2- 172.21.15.82:0/3228810771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba240051e0 0x7fba2400b990 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 -- 172.21.15.82:0/3228810771 >> 172.21.15.82:0/3228810771 conn(0x7fba380ce080 msgr2=0x7fba380ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 -- 172.21.15.82:0/3228810771 shutdown_connections 2023-07-20T11:06:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.903+0000 7fba3e72d640 1 -- 172.21.15.82:0/3228810771 wait complete. 2023-07-20T11:06:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 Processor -- start 2023-07-20T11:06:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- start start 2023-07-20T11:06:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba240051e0 0x7fba380c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba380b0ca0 0x7fba380b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3815d670 con 0x7fba380c6640 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba380c6b40 con 0x7fba380b0ca0 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba380c6e20 con 0x7fba240051e0 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58374/0 (socket says 172.21.15.82:58374) 2023-07-20T11:06:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3d72b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba240051e0 0x7fba380c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 -- 172.21.15.82:0/1372266515 learned_addr learned my addr 172.21.15.82:0/1372266515 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3df2c640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba380b0ca0 0x7fba380b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 -- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba240051e0 msgr2=0x7fba380c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba240051e0 0x7fba380c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 -- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba380b0ca0 msgr2=0x7fba380b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba380b0ca0 0x7fba380b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 -- 172.21.15.82:0/1372266515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba380c7100 con 0x7fba380c6640 2023-07-20T11:06:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3cf2a640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fba2800f540 tx=0x7fba2800f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280052e0 con 0x7fba380c6640 2023-07-20T11:06:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba28005440 con 0x7fba380c6640 2023-07-20T11:06:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28003840 con 0x7fba380c6640 2023-07-20T11:06:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba380c73e0 con 0x7fba380c6640 2023-07-20T11:06:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba38163810 con 0x7fba380c6640 2023-07-20T11:06:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.907+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba380ccc60 con 0x7fba380c6640 2023-07-20T11:06:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.911+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba280039a0 con 0x7fba380c6640 2023-07-20T11:06:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.911+0000 7fba2dffb640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 0x7fba1c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:15.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.911+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fba28083c50 con 0x7fba380c6640 2023-07-20T11:06:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.911+0000 7fba3d72b640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 0x7fba1c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:15.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.911+0000 7fba3d72b640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 0x7fba1c068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba34000c10 tx=0x7fba34000f60 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:15.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:15.915+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba28050fb0 con 0x7fba380c6640 2023-07-20T11:06:16.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.063+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fba3804da30 con 0x7fba380c6640 2023-07-20T11:06:16.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.067+0000 7fba2dffb640 1 -- 172.21.15.82:0/1372266515 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba280545d0 con 0x7fba380c6640 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 msgr2=0x7fba1c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 0x7fba1c068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba34000c10 tx=0x7fba34000f60 comp rx=0 tx=0).stop 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 msgr2=0x7fba381632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fba2800f540 tx=0x7fba2800f940 comp rx=0 tx=0).stop 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 shutdown_connections 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fba1c0663a0 0x7fba1c068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba380b0ca0 0x7fba380b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba380c6640 0x7fba381632d0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 --2- 172.21.15.82:0/1372266515 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fba240051e0 0x7fba380c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 >> 172.21.15.82:0/1372266515 conn(0x7fba380ce080 msgr2=0x7fba380aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:16.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 shutdown_connections 2023-07-20T11:06:16.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.071+0000 7fba3e72d640 1 -- 172.21.15.82:0/1372266515 wait complete. 2023-07-20T11:06:16.071 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:06:16.071 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:06:16.134 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:06:16.196 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:06:16.197 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:16.197 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:16.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:06:16.207 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:06:16.207 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:16.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:06:16.218 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:16.218 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:16.255 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:06:16.255 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:06:16.256 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:16.269 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:06:16.269 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T11:06:16.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:16.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 Processor -- start 2023-07-20T11:06:16.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 -- start start 2023-07-20T11:06:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 0x7f9df00d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df00d16b0 con 0x7f9df015cab0 2023-07-20T11:06:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00d31c0 con 0x7f9df00d0d10 2023-07-20T11:06:16.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df792c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00b3520 con 0x7f9df00cd4b0 2023-07-20T11:06:16.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df5ec9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df4ec7640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 0x7f9df00d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df5ec9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56174/0 (socket says 172.21.15.82:56174) 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.455+0000 7f9df5ec9640 1 -- 172.21.15.82:0/3118711648 learned_addr learned my addr 172.21.15.82:0/3118711648 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df5ec9640 1 -- 172.21.15.82:0/3118711648 >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 msgr2=0x7f9df00d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df5ec9640 1 --2- 172.21.15.82:0/3118711648 >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 0x7f9df00d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df5ec9640 1 -- 172.21.15.82:0/3118711648 >> v1:172.21.15.183:6789/0 conn(0x7f9df015cab0 legacy=0x7f9df00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df5ec9640 1 -- 172.21.15.82:0/3118711648 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00d0a10 con 0x7f9df00cd4b0 2023-07-20T11:06:16.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df4ec7640 1 --2- 172.21.15.82:0/3118711648 >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 0x7f9df00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:16.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9de7fff640 1 -- 172.21.15.82:0/3118711648 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495945201 0 0) 0x7f9df00d16b0 con 0x7f9df015cab0 2023-07-20T11:06:16.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df5ec9640 1 --2- 172.21.15.82:0/3118711648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009e50 tx=0x7f9de801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5763b0df46909f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9de7fff640 1 -- 172.21.15.82:0/3118711648 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de80a58a0 con 0x7f9df00cd4b0 2023-07-20T11:06:16.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9de7fff640 1 -- 172.21.15.82:0/3118711648 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de80a5a00 con 0x7f9df00cd4b0 2023-07-20T11:06:16.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9de7fff640 1 -- 172.21.15.82:0/3118711648 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de80a5d90 con 0x7f9df00cd4b0 2023-07-20T11:06:16.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 -- 172.21.15.82:0/3118711648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 msgr2=0x7f9df00cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 --2- 172.21.15.82:0/3118711648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9de8009e50 tx=0x7f9de801c9e0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 -- 172.21.15.82:0/3118711648 shutdown_connections 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 --2- 172.21.15.82:0/3118711648 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df00cd4b0 0x7f9df00cd940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 --2- 172.21.15.82:0/3118711648 >> v2:172.21.15.183:3300/0 conn(0x7f9df00d0d10 0x7f9df00d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.459+0000 7f9df792c640 1 -- 172.21.15.82:0/3118711648 >> 172.21.15.82:0/3118711648 conn(0x7f9df008c120 msgr2=0x7f9df009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- 172.21.15.82:0/3118711648 shutdown_connections 2023-07-20T11:06:16.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- 172.21.15.82:0/3118711648 wait complete. 2023-07-20T11:06:16.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 Processor -- start 2023-07-20T11:06:16.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- start start 2023-07-20T11:06:16.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9df00cd4b0 0x7f9df015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df015cab0 0x7f9df015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00c9800 con 0x7f9df00d0d10 2023-07-20T11:06:16.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df015f950 con 0x7f9df00cd4b0 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df792c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df015fc30 con 0x7f9df015cab0 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58388/0 (socket says 172.21.15.82:58388) 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 -- 172.21.15.82:0/2906892037 learned_addr learned my addr 172.21.15.82:0/2906892037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df5ec9640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df015cab0 0x7f9df015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df56c8640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9df00cd4b0 0x7f9df015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 -- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df015cab0 msgr2=0x7f9df015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df015cab0 0x7f9df015ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 -- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9df00cd4b0 msgr2=0x7f9df015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9df00cd4b0 0x7f9df015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 -- 172.21.15.82:0/2906892037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0009420 con 0x7f9df00d0d10 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9df4ec7640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e980 tx=0x7f9de000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000ca00 con 0x7f9df00d0d10 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000cb60 con 0x7f9df00d0d10 2023-07-20T11:06:16.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.463+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0013470 con 0x7f9df00d0d10 2023-07-20T11:06:16.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de8009b30 con 0x7f9df00d0d10 2023-07-20T11:06:16.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0154400 con 0x7f9df00d0d10 2023-07-20T11:06:16.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df0073c70 con 0x7f9df00d0d10 2023-07-20T11:06:16.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9de00135d0 con 0x7f9df00d0d10 2023-07-20T11:06:16.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9de5ffb640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 0x7f9dd4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f9de0083fe0 con 0x7f9df00d0d10 2023-07-20T11:06:16.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.467+0000 7f9df56c8640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 0x7f9dd4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.471+0000 7f9df56c8640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 0x7f9dd4068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.471+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9de00513f0 con 0x7f9df00d0d10 2023-07-20T11:06:16.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.647+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9df015fda0 con 0x7f9df00d0d10 2023-07-20T11:06:16.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.647+0000 7f9de5ffb640 1 -- 172.21.15.82:0/2906892037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3533 (secure 0 0 0) 0x7f9de0017de0 con 0x7f9df00d0d10 2023-07-20T11:06:16.631 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:16.632 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7877,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/204875557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":204875557},{"type":"v1","addr":"172.21.15.183:6835","nonce":204875557}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8782,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1446485873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1446485873},{"type":"v1","addr":"172.21.15.183:6834","nonce":1446485873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":9576,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/2229133600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":2229133600},{"type":"v1","addr":"172.21.15.82:6836","nonce":2229133600}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":10071,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/3963108085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":3963108085},{"type":"v1","addr":"172.21.15.82:6837","nonce":3963108085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[]} 2023-07-20T11:06:16.632 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 76 2023-07-20T11:06:16.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 msgr2=0x7f9dd4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 0x7f9dd4068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9dec007fd0 tx=0x7f9dec009040 comp rx=0 tx=0).stop 2023-07-20T11:06:16.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 msgr2=0x7f9df0153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f9de000e980 tx=0x7f9de000ee40 comp rx=0 tx=0).stop 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 shutdown_connections 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9dd40663d0 0x7f9dd4068890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9df015cab0 0x7f9df015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9df00d0d10 0x7f9df0153ec0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 --2- 172.21.15.82:0/2906892037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9df00cd4b0 0x7f9df015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 >> 172.21.15.82:0/2906892037 conn(0x7f9df008c120 msgr2=0x7f9df00d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:16.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 shutdown_connections 2023-07-20T11:06:16.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.651+0000 7f9df792c640 1 -- 172.21.15.82:0/2906892037 wait complete. 2023-07-20T11:06:16.652 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T11:06:16.653 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T11:06:16.653 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T11:06:16.653 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:06:16.654 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T11:06:16.654 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T11:06:16.654 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T11:06:16.654 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:06:16.654 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T11:06:16.655 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T11:06:16.655 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T11:06:16.655 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:06:16.655 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T11:06:16.656 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T11:06:16.656 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T11:06:16.656 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:06:16.669 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T11:06:16.670 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T11:06:16.670 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T11:06:16.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T11:06:16.672 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T11:06:16.672 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T11:06:16.673 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T11:06:16.673 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T11:06:16.717 INFO:tasks.ceph.mds.b:Started 2023-07-20T11:06:16.717 DEBUG:teuthology.parallel:result is None 2023-07-20T11:06:16.718 INFO:tasks.ceph.mds.a:Started 2023-07-20T11:06:16.718 DEBUG:teuthology.parallel:result is None 2023-07-20T11:06:16.719 INFO:tasks.ceph.mds.d:Started 2023-07-20T11:06:16.720 DEBUG:teuthology.parallel:result is None 2023-07-20T11:06:16.720 INFO:tasks.ceph.mds.c:Started 2023-07-20T11:06:16.721 DEBUG:teuthology.parallel:result is None 2023-07-20T11:06:16.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T11:06:16.808 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T11:06:16.809 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:06:16.810 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T11:06:16.811 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T11:06:16.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 Processor -- start 2023-07-20T11:06:16.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 -- start start 2023-07-20T11:06:16.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a5815cab0 0x7f0a580d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 0x7f0a580d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a580d16b0 con 0x7f0a580d0d10 2023-07-20T11:06:16.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580d31c0 con 0x7f0a5815cab0 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5d026640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580b3520 con 0x7f0a580ce4c0 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a5815cab0 0x7f0a580d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a5815cab0 0x7f0a580d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58432/0 (socket says 172.21.15.82:58432) 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 -- 172.21.15.82:0/3965944040 learned_addr learned my addr 172.21.15.82:0/3965944040 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a4e59c640 1 --1- 172.21.15.82:0/3965944040 >> v1:172.21.15.82:6789/0 conn(0x7f0a580d0d10 0x7f0a580cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33402/0 (socket says 172.21.15.82:33402) 2023-07-20T11:06:16.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5759e640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 0x7f0a580d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 -- 172.21.15.82:0/3965944040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 msgr2=0x7f0a580d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:16.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 0x7f0a580d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 -- 172.21.15.82:0/3965944040 >> v1:172.21.15.82:6789/0 conn(0x7f0a580d0d10 legacy=0x7f0a580cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a56d9d640 1 -- 172.21.15.82:0/3965944040 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580b2910 con 0x7f0a5815cab0 2023-07-20T11:06:16.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5659c640 1 -- 172.21.15.82:0/3965944040 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905053172 0 0) 0x7f0a580d16b0 con 0x7f0a580d0d10 2023-07-20T11:06:16.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.887+0000 7f0a5759e640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 0x7f0a580d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a56d9d640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a580d0300 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009870 tx=0x7f0a4801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf79e6821a6c537 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5659c640 1 -- 172.21.15.82:0/3965944040 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480a7070 con 0x7f0a5815cab0 2023-07-20T11:06:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5659c640 1 -- 172.21.15.82:0/3965944040 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480ab430 con 0x7f0a5815cab0 2023-07-20T11:06:16.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5659c640 1 -- 172.21.15.82:0/3965944040 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480ab7c0 con 0x7f0a5815cab0 2023-07-20T11:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 -- 172.21.15.82:0/3965944040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 msgr2=0x7f0a580d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a580d0300 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009870 tx=0x7f0a4801c510 comp rx=0 tx=0).stop 2023-07-20T11:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 -- 172.21.15.82:0/3965944040 shutdown_connections 2023-07-20T11:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580ce4c0 0x7f0a580d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 --2- 172.21.15.82:0/3965944040 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a580d0300 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 -- 172.21.15.82:0/3965944040 >> 172.21.15.82:0/3965944040 conn(0x7f0a5808c120 msgr2=0x7f0a5809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 -- 172.21.15.82:0/3965944040 shutdown_connections 2023-07-20T11:06:16.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.891+0000 7f0a5d026640 1 -- 172.21.15.82:0/3965944040 wait complete. 2023-07-20T11:06:16.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 Processor -- start 2023-07-20T11:06:16.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 -- start start 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 0x7f0a581f9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580d0d10 0x7f0a581467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815edd0 con 0x7f0a5815cab0 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580cb100 con 0x7f0a580ce4c0 2023-07-20T11:06:16.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580cb3e0 con 0x7f0a580d0d10 2023-07-20T11:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 0x7f0a581f9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5759e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58448/0 (socket says 172.21.15.82:58448) 2023-07-20T11:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5759e640 1 -- 172.21.15.82:0/132323508 learned_addr learned my addr 172.21.15.82:0/132323508 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:16.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a4e59c640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580d0d10 0x7f0a581467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 -- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580d0d10 msgr2=0x7f0a581467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580d0d10 0x7f0a581467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 -- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 msgr2=0x7f0a5806b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 -- 172.21.15.82:0/132323508 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480094d0 con 0x7f0a580ce4c0 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5759e640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a56d9d640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 0x7f0a581f9ca0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0a480ac000 tx=0x7f0a480192b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480b4830 con 0x7f0a580ce4c0 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480b49b0 con 0x7f0a580ce4c0 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580cb6c0 con 0x7f0a580ce4c0 2023-07-20T11:06:16.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.895+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a480b4d60 con 0x7f0a580ce4c0 2023-07-20T11:06:16.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580cad20 con 0x7f0a580ce4c0 2023-07-20T11:06:16.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a580cb900 con 0x7f0a580ce4c0 2023-07-20T11:06:16.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0a480c03f0 con 0x7f0a580ce4c0 2023-07-20T11:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a4ffff640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 0x7f0a38068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f0a4811d4d0 con 0x7f0a580ce4c0 2023-07-20T11:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a4e59c640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 0x7f0a38068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:16.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.899+0000 7f0a4e59c640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 0x7f0a38068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a580b85c0 tx=0x7f0a40007d60 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:16.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:16.903+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a480ea740 con 0x7f0a580ce4c0 2023-07-20T11:06:17.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:17.063+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0a58073c70 con 0x7f0a580ce4c0 2023-07-20T11:06:18.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a4ffff640 1 -- 172.21.15.82:0/132323508 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v168) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0a480edd60 con 0x7f0a580ce4c0 2023-07-20T11:06:18.088 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T11:06:18.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 msgr2=0x7f0a38068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 0x7f0a38068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a580b85c0 tx=0x7f0a40007d60 comp rx=0 tx=0).stop 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 msgr2=0x7f0a581f9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 0x7f0a581f9ca0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0a480ac000 tx=0x7f0a480192b0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 shutdown_connections 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0a380663a0 0x7f0a38068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a5815cab0 0x7f0a5806b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a580d0d10 0x7f0a581467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 --2- 172.21.15.82:0/132323508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a580ce4c0 0x7f0a581f9ca0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 >> 172.21.15.82:0/132323508 conn(0x7f0a5808c120 msgr2=0x7f0a580af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 shutdown_connections 2023-07-20T11:06:18.091 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.107+0000 7f0a5d026640 1 -- 172.21.15.82:0/132323508 wait complete. 2023-07-20T11:06:18.110 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T11:06:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.267+0000 7f8ef4540640 1 Processor -- start 2023-07-20T11:06:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef4540640 1 -- start start 2023-07-20T11:06:18.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef4540640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 0x7f8eec15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef4540640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec0ccd60 con 0x7f8eec0cc900 2023-07-20T11:06:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef4540640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec0ad810 con 0x7f8eec0b2a90 2023-07-20T11:06:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef4540640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec15d0d0 con 0x7f8eec1596b0 2023-07-20T11:06:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef1adb640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8eec0cc900 0x7f8eec0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33404/0 (socket says 172.21.15.82:33404) 2023-07-20T11:06:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef1adb640 1 -- 172.21.15.82:0/3336215043 learned_addr learned my addr 172.21.15.82:0/3336215043 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:18.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef22dc640 1 --2- 172.21.15.82:0/3336215043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 0x7f8eec15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815670771 0 0) 0x7f8eec0ccd60 con 0x7f8eec0cc900 2023-07-20T11:06:18.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ed8003530 con 0x7f8eec0cc900 2023-07-20T11:06:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022445302 0 0) 0x7f8eec0ad810 con 0x7f8eec0b2a90 2023-07-20T11:06:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eec0ccd60 con 0x7f8eec0b2a90 2023-07-20T11:06:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef22dc640 1 -- 172.21.15.82:0/3336215043 >> v1:172.21.15.183:6789/0 conn(0x7f8eec0b2a90 legacy=0x7f8eec0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef22dc640 1 -- 172.21.15.82:0/3336215043 >> v1:172.21.15.82:6789/0 conn(0x7f8eec0cc900 legacy=0x7f8eec0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.271+0000 7f8ef22dc640 1 -- 172.21.15.82:0/3336215043 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec15d3b0 con 0x7f8eec1596b0 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef22dc640 1 --2- 172.21.15.82:0/3336215043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 0x7f8eec15dbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097f0 tx=0x7f8ee801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f02ef58e753eaf32 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80a7070 con 0x7f8eec1596b0 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee80ab430 con 0x7f8eec1596b0 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef12da640 1 -- 172.21.15.82:0/3336215043 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80ab7c0 con 0x7f8eec1596b0 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 -- 172.21.15.82:0/3336215043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 msgr2=0x7f8eec15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 --2- 172.21.15.82:0/3336215043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 0x7f8eec15dbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097f0 tx=0x7f8ee801c490 comp rx=0 tx=0).stop 2023-07-20T11:06:18.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 -- 172.21.15.82:0/3336215043 shutdown_connections 2023-07-20T11:06:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 --2- 172.21.15.82:0/3336215043 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec1596b0 0x7f8eec15dbb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 -- 172.21.15.82:0/3336215043 >> 172.21.15.82:0/3336215043 conn(0x7f8eec0cada0 msgr2=0x7f8eec0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 -- 172.21.15.82:0/3336215043 shutdown_connections 2023-07-20T11:06:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 -- 172.21.15.82:0/3336215043 wait complete. 2023-07-20T11:06:18.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.275+0000 7f8ef4540640 1 Processor -- start 2023-07-20T11:06:18.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- start start 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec0b2a90 0x7f8eec1fa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0cc900 0x7f8eec1fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0c2cd0 con 0x7f8eec1596b0 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0c2ff0 con 0x7f8eec0cc900 2023-07-20T11:06:18.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0c32d0 con 0x7f8eec0b2a90 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef22dc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec0b2a90 0x7f8eec1fa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58460/0 (socket says 172.21.15.82:58460) 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 -- 172.21.15.82:0/930051670 learned_addr learned my addr 172.21.15.82:0/930051670 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef1adb640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0cc900 0x7f8eec1fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 -- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec0b2a90 msgr2=0x7f8eec1fa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec0b2a90 0x7f8eec1fa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 -- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0cc900 msgr2=0x7f8eec1fbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0cc900 0x7f8eec1fbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 -- 172.21.15.82:0/930051670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8009420 con 0x7f8eec1596b0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef2add640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c790 tx=0x7f8ee400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400cea0 con 0x7f8eec1596b0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4003b80 con 0x7f8eec1596b0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400a850 con 0x7f8eec1596b0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec0c35b0 con 0x7f8eec1596b0 2023-07-20T11:06:18.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec1fc500 con 0x7f8eec1596b0 2023-07-20T11:06:18.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.279+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec073c70 con 0x7f8eec1596b0 2023-07-20T11:06:18.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.283+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8ee400a9b0 con 0x7f8eec1596b0 2023-07-20T11:06:18.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.283+0000 7f8ee2ffd640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 0x7f8ed0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.283+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f8ee4083950 con 0x7f8eec1596b0 2023-07-20T11:06:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.283+0000 7f8ef22dc640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 0x7f8ed0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.283+0000 7f8ef22dc640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 0x7f8ed0068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80af000 tx=0x7f8ee80b6040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.287+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ee4051060 con 0x7f8eec1596b0 2023-07-20T11:06:18.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.483+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8eec0c3a60 con 0x7f8eec1596b0 2023-07-20T11:06:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.483+0000 7f8ee2ffd640 1 -- 172.21.15.82:0/930051670 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8ee4054680 con 0x7f8eec1596b0 2023-07-20T11:06:18.466 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.467 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T11:06:18.468 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:06:18.470 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.471 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T11:06:18.472 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.473 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.476 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.477 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.478 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T11:06:18.479 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.480 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:06:18.483 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.484 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T11:06:18.485 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:06:18.487 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:06:18.488 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:06:18.489 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T11:06:18.490 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:06:18.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 msgr2=0x7f8ed0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 0x7f8ed0068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80af000 tx=0x7f8ee80b6040 comp rx=0 tx=0).stop 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 msgr2=0x7f8eec0ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c790 tx=0x7f8ee400cc50 comp rx=0 tx=0).stop 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 shutdown_connections 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f8ed00663a0 0x7f8ed0068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec1596b0 0x7f8eec0ac240 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0cc900 0x7f8eec1fbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 --2- 172.21.15.82:0/930051670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec0b2a90 0x7f8eec1fa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 >> 172.21.15.82:0/930051670 conn(0x7f8eec0cada0 msgr2=0x7f8eec06b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 shutdown_connections 2023-07-20T11:06:18.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.487+0000 7f8ef4540640 1 -- 172.21.15.82:0/930051670 wait complete. 2023-07-20T11:06:18.493 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:18.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 Processor -- start 2023-07-20T11:06:18.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 -- start start 2023-07-20T11:06:18.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 0x7fd9680d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9680cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9680d16b0 con 0x7fd96815cab0 2023-07-20T11:06:18.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9680d31c0 con 0x7fd9680d0d10 2023-07-20T11:06:18.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd96d2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680b3520 con 0x7fd9680cd4b0 2023-07-20T11:06:18.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd966ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd96815cab0 0x7fd9680d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33408/0 (socket says 172.21.15.82:33408) 2023-07-20T11:06:18.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd966ffd640 1 -- 172.21.15.82:0/1211050369 learned_addr learned my addr 172.21.15.82:0/1211050369 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:18.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9677fe640 1 --2- 172.21.15.82:0/1211050369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9680cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd95e7fc640 1 --2- 172.21.15.82:0/1211050369 >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 0x7fd9680d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9667fc640 1 -- 172.21.15.82:0/1211050369 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556849872 0 0) 0x7fd9680d16b0 con 0x7fd96815cab0 2023-07-20T11:06:18.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9667fc640 1 -- 172.21.15.82:0/1211050369 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd954003530 con 0x7fd96815cab0 2023-07-20T11:06:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9677fe640 1 -- 172.21.15.82:0/1211050369 >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 msgr2=0x7fd9680d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9677fe640 1 --2- 172.21.15.82:0/1211050369 >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 0x7fd9680d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9677fe640 1 -- 172.21.15.82:0/1211050369 >> v1:172.21.15.82:6789/0 conn(0x7fd96815cab0 legacy=0x7fd9680d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd9677fe640 1 -- 172.21.15.82:0/1211050369 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9680d0a10 con 0x7fd9680cd4b0 2023-07-20T11:06:18.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.651+0000 7fd95e7fc640 1 --2- 172.21.15.82:0/1211050369 >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 0x7fd9680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd9677fe640 1 --2- 172.21.15.82:0/1211050369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9680cd940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd96001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cabd98cda07e91 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd9667fc640 1 -- 172.21.15.82:0/1211050369 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600a59e0 con 0x7fd9680cd4b0 2023-07-20T11:06:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd9667fc640 1 -- 172.21.15.82:0/1211050369 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9600a5b40 con 0x7fd9680cd4b0 2023-07-20T11:06:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd9667fc640 1 -- 172.21.15.82:0/1211050369 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600ad440 con 0x7fd9680cd4b0 2023-07-20T11:06:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 -- 172.21.15.82:0/1211050369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 msgr2=0x7fd9680cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/1211050369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9680cd940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd960009d90 tx=0x7fd96001c920 comp rx=0 tx=0).stop 2023-07-20T11:06:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 -- 172.21.15.82:0/1211050369 shutdown_connections 2023-07-20T11:06:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/1211050369 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9680cd940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/1211050369 >> v2:172.21.15.183:3300/0 conn(0x7fd9680d0d10 0x7fd9680d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 -- 172.21.15.82:0/1211050369 >> 172.21.15.82:0/1211050369 conn(0x7fd96808c120 msgr2=0x7fd96809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 -- 172.21.15.82:0/1211050369 shutdown_connections 2023-07-20T11:06:18.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.655+0000 7fd96d2cb640 1 -- 172.21.15.82:0/1211050369 wait complete. 2023-07-20T11:06:18.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 Processor -- start 2023-07-20T11:06:18.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- start start 2023-07-20T11:06:18.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9681581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9680d0d10 0x7fd9680cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680cbbf0 con 0x7fd96815cab0 2023-07-20T11:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680cbed0 con 0x7fd9680d0d10 2023-07-20T11:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9680cc1b0 con 0x7fd9680cd4b0 2023-07-20T11:06:18.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd966ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9681581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd966ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9681581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:56264/0 (socket says 172.21.15.82:56264) 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58466/0 (socket says 172.21.15.82:58466) 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd966ffd640 1 -- 172.21.15.82:0/563746059 learned_addr learned my addr 172.21.15.82:0/563746059 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd95e7fc640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9680d0d10 0x7fd9680cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 -- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 msgr2=0x7fd9681581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9681581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 -- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9680d0d10 msgr2=0x7fd9680cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9680d0d10 0x7fd9680cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 -- 172.21.15.82:0/563746059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958009420 con 0x7fd96815cab0 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd9677fe640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ac000 tx=0x7fd9600196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600add20 con 0x7fd96815cab0 2023-07-20T11:06:18.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9600ade80 con 0x7fd96815cab0 2023-07-20T11:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600b9690 con 0x7fd96815cab0 2023-07-20T11:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd960009a70 con 0x7fd96815cab0 2023-07-20T11:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.659+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9680cc770 con 0x7fd96815cab0 2023-07-20T11:06:18.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9680cc960 con 0x7fd96815cab0 2023-07-20T11:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd9680ce690 con 0x7fd96815cab0 2023-07-20T11:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd95ffff640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 0x7fd948068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fd96011e180 con 0x7fd96815cab0 2023-07-20T11:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd966ffd640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 0x7fd948068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.663+0000 7fd966ffd640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 0x7fd948068890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9500011f0 tx=0x7fd950009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.667+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9600eb800 con 0x7fd96815cab0 2023-07-20T11:06:18.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.815+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd968073c70 con 0x7fd96815cab0 2023-07-20T11:06:18.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.815+0000 7fd95ffff640 1 -- 172.21.15.82:0/563746059 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+14740 (secure 0 0 0) 0x7fd960009450 con 0x7fd96815cab0 2023-07-20T11:06:18.800 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:18.800 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":168,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:18.102594+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:18.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 msgr2=0x7fd948068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 0x7fd948068890 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd9500011f0 tx=0x7fd950009040 comp rx=0 tx=0).stop 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 msgr2=0x7fd9680b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ac000 tx=0x7fd9600196c0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 shutdown_connections 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd9480663d0 0x7fd948068890 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd96815cab0 0x7fd9680b7aa0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9680d0d10 0x7fd9680cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 --2- 172.21.15.82:0/563746059 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9680cd4b0 0x7fd9681581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 >> 172.21.15.82:0/563746059 conn(0x7fd96808c120 msgr2=0x7fd9680af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 shutdown_connections 2023-07-20T11:06:18.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.819+0000 7fd96d2cb640 1 -- 172.21.15.82:0/563746059 wait complete. 2023-07-20T11:06:18.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:06:18.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:06:18.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 Processor -- start 2023-07-20T11:06:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 -- start start 2023-07-20T11:06:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9e3815c6e0 0x7f9e380cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e380d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380cdb40 con 0x7f9e380d3200 2023-07-20T11:06:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e380d07a0 con 0x7f9e3815c6e0 2023-07-20T11:06:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e3d4f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cd4f0 con 0x7f9e3815cac0 2023-07-20T11:06:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e2e7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9e380d3200 0x7f9e380cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33416/0 (socket says 172.21.15.82:33416) 2023-07-20T11:06:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e2e7fc640 1 -- 172.21.15.82:0/324037529 learned_addr learned my addr 172.21.15.82:0/324037529 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444346279 0 0) 0x7f9e380cdb40 con 0x7f9e380d3200 2023-07-20T11:06:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003530 con 0x7f9e380d3200 2023-07-20T11:06:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e377fe640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e380d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.983+0000 7f9e36ffd640 1 --2- 172.21.15.82:0/324037529 >> v2:172.21.15.183:3300/0 conn(0x7f9e3815c6e0 0x7f9e380cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 877546485 0 0) 0x7f9e24003530 con 0x7f9e380d3200 2023-07-20T11:06:18.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 msgr2=0x7f9e380d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e380d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 >> v2:172.21.15.183:3300/0 conn(0x7f9e3815c6e0 msgr2=0x7f9e380cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 --2- 172.21.15.82:0/324037529 >> v2:172.21.15.183:3300/0 conn(0x7f9e3815c6e0 0x7f9e380cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cd7d0 con 0x7f9e380d3200 2023-07-20T11:06:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f9e20001a00 con 0x7f9e380d3200 2023-07-20T11:06:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 >> v1:172.21.15.82:6789/0 conn(0x7f9e380d3200 legacy=0x7f9e380cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e240039f0 0x7f9e24003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24004d10 0x7f9e24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380d07a0 con 0x7f9e24004d10 2023-07-20T11:06:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cd4f0 con 0x7f9e240039f0 2023-07-20T11:06:18.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400ba90 con 0x7f9e3815cac0 2023-07-20T11:06:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24004d10 0x7f9e24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e36ffd640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e240039f0 0x7f9e24003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e2e7fc640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 -- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 msgr2=0x7f9e240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e3815cac0 0x7f9e240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 -- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e240039f0 msgr2=0x7f9e24003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e240039f0 0x7f9e24003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 -- 172.21.15.82:0/324037529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24003530 con 0x7f9e24004d10 2023-07-20T11:06:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e377fe640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24004d10 0x7f9e24005190 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009b10 tx=0x7f9e3001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a7f53b9f0c073e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.987+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300a5530 con 0x7f9e24004d10 2023-07-20T11:06:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e300a5690 con 0x7f9e24004d10 2023-07-20T11:06:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e367fc640 1 -- 172.21.15.82:0/324037529 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300a5a40 con 0x7f9e24004d10 2023-07-20T11:06:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/324037529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24004d10 msgr2=0x7f9e24005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/324037529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e24004d10 0x7f9e24005190 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009b10 tx=0x7f9e3001ca50 comp rx=0 tx=0).stop 2023-07-20T11:06:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e377fe640 1 -- 172.21.15.82:0/324037529 reap_dead start 2023-07-20T11:06:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/324037529 shutdown_connections 2023-07-20T11:06:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/324037529 >> 172.21.15.82:0/324037529 conn(0x7f9e380d2600 msgr2=0x7f9e380d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/324037529 shutdown_connections 2023-07-20T11:06:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/324037529 wait complete. 2023-07-20T11:06:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 Processor -- start 2023-07-20T11:06:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- start start 2023-07-20T11:06:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e24004d10 0x7f9e380b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e38157270 0x7f9e38157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38157c60 con 0x7f9e380c6110 2023-07-20T11:06:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c66d0 con 0x7f9e38157270 2023-07-20T11:06:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e3d4f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c69b0 con 0x7f9e24004d10 2023-07-20T11:06:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e2e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e2e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58482/0 (socket says 172.21.15.82:58482) 2023-07-20T11:06:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e2e7fc640 1 -- 172.21.15.82:0/1557571640 learned_addr learned my addr 172.21.15.82:0/1557571640 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.991+0000 7f9e377fe640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e38157270 0x7f9e38157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e36ffd640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e24004d10 0x7f9e380b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 -- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e24004d10 msgr2=0x7f9e380b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e24004d10 0x7f9e380b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 -- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e38157270 msgr2=0x7f9e38157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e38157270 0x7f9e38157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 -- 172.21.15.82:0/1557571640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380c6c90 con 0x7f9e380c6110 2023-07-20T11:06:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2e7fc640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f9e20001b30 tx=0x7f9e20007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000acd0 con 0x7f9e380c6110 2023-07-20T11:06:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2000ae50 con 0x7f9e380c6110 2023-07-20T11:06:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e20013630 con 0x7f9e380c6110 2023-07-20T11:06:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380c6f70 con 0x7f9e380c6110 2023-07-20T11:06:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e380b7f40 con 0x7f9e380c6110 2023-07-20T11:06:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3804da30 con 0x7f9e380c6110 2023-07-20T11:06:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e20013790 con 0x7f9e380c6110 2023-07-20T11:06:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.995+0000 7f9e2ffff640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 0x7f9e18068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.999+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f9e20084850 con 0x7f9e380c6110 2023-07-20T11:06:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.999+0000 7f9e36ffd640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 0x7f9e18068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:18.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.999+0000 7f9e36ffd640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 0x7f9e18068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009b20 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:18.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:18.999+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e20051e20 con 0x7f9e380c6110 2023-07-20T11:06:19.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.151+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e380c7420 con 0x7f9e380c6110 2023-07-20T11:06:19.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.151+0000 7f9e2ffff640 1 -- 172.21.15.82:0/1557571640 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v168) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e200170a0 con 0x7f9e380c6110 2023-07-20T11:06:19.135 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:06:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 msgr2=0x7f9e18068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 0x7f9e18068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e28009b20 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2023-07-20T11:06:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 msgr2=0x7f9e381568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f9e20001b30 tx=0x7f9e20007b80 comp rx=0 tx=0).stop 2023-07-20T11:06:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 shutdown_connections 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f9e180663a0 0x7f9e18068860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9e38157270 0x7f9e38157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e380c6110 0x7f9e381568a0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 --2- 172.21.15.82:0/1557571640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9e24004d10 0x7f9e380b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 >> 172.21.15.82:0/1557571640 conn(0x7f9e380d2600 msgr2=0x7f9e38072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 shutdown_connections 2023-07-20T11:06:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.155+0000 7f9e3d4f9640 1 -- 172.21.15.82:0/1557571640 wait complete. 2023-07-20T11:06:19.156 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:06:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.315+0000 7fd2f14bd640 1 Processor -- start 2023-07-20T11:06:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.315+0000 7fd2f14bd640 1 -- start start 2023-07-20T11:06:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd2ec1591d0 0x7fd2ec0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec0cd800 0x7fd2ec070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c8c00 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0b04c0 con 0x7fd2ec1591d0 2023-07-20T11:06:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2f14bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0c9690 con 0x7fd2ec0cd800 2023-07-20T11:06:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58498/0 (socket says 172.21.15.82:58498) 2023-07-20T11:06:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 -- 172.21.15.82:0/1630901626 learned_addr learned my addr 172.21.15.82:0/1630901626 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2ea7fc640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec0cd800 0x7fd2ec070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eaffd640 1 --2- 172.21.15.82:0/1630901626 >> v2:172.21.15.183:3300/0 conn(0x7fd2ec1591d0 0x7fd2ec0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 -- 172.21.15.82:0/1630901626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec0cd800 msgr2=0x7fd2ec070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec0cd800 0x7fd2ec070430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 -- 172.21.15.82:0/1630901626 >> v2:172.21.15.183:3300/0 conn(0x7fd2ec1591d0 msgr2=0x7fd2ec0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 --2- 172.21.15.82:0/1630901626 >> v2:172.21.15.183:3300/0 conn(0x7fd2ec1591d0 0x7fd2ec0c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.319+0000 7fd2eb7fe640 1 -- 172.21.15.82:0/1630901626 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0ca520 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2eb7fe640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0662c0 tx=0x7fd2e401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8794bbf54d2f0a6f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2e9ffb640 1 -- 172.21.15.82:0/1630901626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40a7ba0 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2e9ffb640 1 -- 172.21.15.82:0/1630901626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e40a7d00 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2e9ffb640 1 -- 172.21.15.82:0/1630901626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40af660 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- 172.21.15.82:0/1630901626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 msgr2=0x7fd2ec0aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0662c0 tx=0x7fd2e401eb10 comp rx=0 tx=0).stop 2023-07-20T11:06:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- 172.21.15.82:0/1630901626 shutdown_connections 2023-07-20T11:06:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec0aff80 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/1630901626 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec0cd800 0x7fd2ec070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/1630901626 >> v2:172.21.15.183:3300/0 conn(0x7fd2ec1591d0 0x7fd2ec0c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- 172.21.15.82:0/1630901626 >> 172.21.15.82:0/1630901626 conn(0x7fd2ec0caaf0 msgr2=0x7fd2ec0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- 172.21.15.82:0/1630901626 shutdown_connections 2023-07-20T11:06:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- 172.21.15.82:0/1630901626 wait complete. 2023-07-20T11:06:19.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 Processor -- start 2023-07-20T11:06:19.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.323+0000 7fd2f14bd640 1 -- start start 2023-07-20T11:06:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 0x7fd2ec157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec1591d0 0x7fd2ec1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec15a390 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec15a670 con 0x7fd2ec0cd800 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec15a950 con 0x7fd2ec1591d0 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58514/0 (socket says 172.21.15.82:58514) 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 -- 172.21.15.82:0/2245546678 learned_addr learned my addr 172.21.15.82:0/2245546678 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2ea7fc640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 0x7fd2ec157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eb7fe640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec1591d0 0x7fd2ec1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 -- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec1591d0 msgr2=0x7fd2ec1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec1591d0 0x7fd2ec1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 -- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 msgr2=0x7fd2ec157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 0x7fd2ec157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 -- 172.21.15.82:0/2245546678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e400b770 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2ea7fc640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 0x7fd2ec157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:19.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2eaffd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d5f0 tx=0x7fd2dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0125f0 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2dc012750 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc012ae0 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec15ac30 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec151610 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec04da30 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.327+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2dc012c40 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.331+0000 7fd2d37fe640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 0x7fd2d8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.331+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fd2dc084110 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.331+0000 7fd2ea7fc640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 0x7fd2d8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.331+0000 7fd2ea7fc640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 0x7fd2d8068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0003fd0 tx=0x7fd2e0003a00 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.335+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2dc0516e0 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.479+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2ec0b3ff0 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2d37fe640 1 -- 172.21.15.82:0/2245546678 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v168) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd2dc007380 con 0x7fd2ec0afaf0 2023-07-20T11:06:19.464 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:06:19.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 msgr2=0x7fd2d8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 0x7fd2d8068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0003fd0 tx=0x7fd2e0003a00 comp rx=0 tx=0).stop 2023-07-20T11:06:19.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 msgr2=0x7fd2ec1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d5f0 tx=0x7fd2dc00dab0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 shutdown_connections 2023-07-20T11:06:19.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd2d80663a0 0x7fd2d8068860 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd2ec1591d0 0x7fd2ec1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd2ec0cd800 0x7fd2ec157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 --2- 172.21.15.82:0/2245546678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2ec0afaf0 0x7fd2ec1510d0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 >> 172.21.15.82:0/2245546678 conn(0x7fd2ec0caaf0 msgr2=0x7fd2ec0c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 shutdown_connections 2023-07-20T11:06:19.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.483+0000 7fd2f14bd640 1 -- 172.21.15.82:0/2245546678 wait complete. 2023-07-20T11:06:19.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T11:06:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 Processor -- start 2023-07-20T11:06:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 -- start start 2023-07-20T11:06:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff54815cab0 0x7ff5480d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5480d0d10 0x7ff5480d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5480d16b0 con 0x7ff5480cf110 2023-07-20T11:06:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480d31c0 con 0x7ff54815cab0 2023-07-20T11:06:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff54e09c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480b3520 con 0x7ff5480d0d10 2023-07-20T11:06:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff5477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff54815cab0 0x7ff5480d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff547fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff5480cf110 0x7ff5480cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33424/0 (socket says 172.21.15.82:33424) 2023-07-20T11:06:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff547fff640 1 -- 172.21.15.82:0/3172746841 learned_addr learned my addr 172.21.15.82:0/3172746841 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff546ffd640 1 --2- 172.21.15.82:0/3172746841 >> v2:172.21.15.183:3300/0 conn(0x7ff5480d0d10 0x7ff5480d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff5477fe640 1 -- 172.21.15.82:0/3172746841 >> v2:172.21.15.183:3300/0 conn(0x7ff5480d0d10 msgr2=0x7ff5480d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff5477fe640 1 --2- 172.21.15.82:0/3172746841 >> v2:172.21.15.183:3300/0 conn(0x7ff5480d0d10 0x7ff5480d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff5477fe640 1 -- 172.21.15.82:0/3172746841 >> v1:172.21.15.82:6789/0 conn(0x7ff5480cf110 legacy=0x7ff5480cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.643+0000 7ff5477fe640 1 -- 172.21.15.82:0/3172746841 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480b2910 con 0x7ff54815cab0 2023-07-20T11:06:19.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff5477fe640 1 --2- 172.21.15.82:0/3172746841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480d0300 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ff5480d0190 tx=0x7ff53801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a323386a2e1047d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff5467fc640 1 -- 172.21.15.82:0/3172746841 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380a7070 con 0x7ff54815cab0 2023-07-20T11:06:19.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff5467fc640 1 -- 172.21.15.82:0/3172746841 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5380ab430 con 0x7ff54815cab0 2023-07-20T11:06:19.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff5467fc640 1 -- 172.21.15.82:0/3172746841 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5380ab7c0 con 0x7ff54815cab0 2023-07-20T11:06:19.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 -- 172.21.15.82:0/3172746841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 msgr2=0x7ff5480d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3172746841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480d0300 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7ff5480d0190 tx=0x7ff53801c430 comp rx=0 tx=0).stop 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 -- 172.21.15.82:0/3172746841 shutdown_connections 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3172746841 >> v2:172.21.15.183:3300/0 conn(0x7ff5480d0d10 0x7ff5480d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3172746841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480d0300 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 -- 172.21.15.82:0/3172746841 >> 172.21.15.82:0/3172746841 conn(0x7ff54808c120 msgr2=0x7ff54809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 -- 172.21.15.82:0/3172746841 shutdown_connections 2023-07-20T11:06:19.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 -- 172.21.15.82:0/3172746841 wait complete. 2023-07-20T11:06:19.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.647+0000 7ff54e09c640 1 Processor -- start 2023-07-20T11:06:19.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- start start 2023-07-20T11:06:19.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5480cf110 0x7ff548155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5480d0d10 0x7ff5480cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480caf30 con 0x7ff54815cab0 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480ca2b0 con 0x7ff5480cf110 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480ca590 con 0x7ff5480d0d10 2023-07-20T11:06:19.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58536/0 (socket says 172.21.15.82:58536) 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 -- 172.21.15.82:0/3276777039 learned_addr learned my addr 172.21.15.82:0/3276777039 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff5477fe640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5480cf110 0x7ff548155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff546ffd640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5480d0d10 0x7ff5480cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 -- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5480d0d10 msgr2=0x7ff5480cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5480d0d10 0x7ff5480cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 -- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5480cf110 msgr2=0x7ff548155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5480cf110 0x7ff548155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 -- 172.21.15.82:0/3276777039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538009420 con 0x7ff54815cab0 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff547fff640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7ff54000ca80 tx=0x7ff54000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54000ac30 con 0x7ff54815cab0 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54000ad90 con 0x7ff54815cab0 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff540012600 con 0x7ff54815cab0 2023-07-20T11:06:19.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5480ca870 con 0x7ff54815cab0 2023-07-20T11:06:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5481563b0 con 0x7ff54815cab0 2023-07-20T11:06:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.651+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5480cb070 con 0x7ff54815cab0 2023-07-20T11:06:19.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.655+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff540007070 con 0x7ff54815cab0 2023-07-20T11:06:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.655+0000 7ff52ffff640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 0x7ff534068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.655+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7ff540083990 con 0x7ff54815cab0 2023-07-20T11:06:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.655+0000 7ff5477fe640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 0x7ff534068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.655+0000 7ff5477fe640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 0x7ff534068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5380af000 tx=0x7ff5380a7000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.659+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5480cb070 con 0x7ff54815cab0 2023-07-20T11:06:19.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.807+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5480cb070 con 0x7ff54815cab0 2023-07-20T11:06:19.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.807+0000 7ff52ffff640 1 -- 172.21.15.82:0/3276777039 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v168) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff5480cb070 con 0x7ff54815cab0 2023-07-20T11:06:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:19.790 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:06:19.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T11:06:19.791 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:19.792 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:06:19.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 msgr2=0x7ff534068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 0x7ff534068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5380af000 tx=0x7ff5380a7000 comp rx=0 tx=0).stop 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 msgr2=0x7ff5480cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7ff54000ca80 tx=0x7ff54000cf40 comp rx=0 tx=0).stop 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 shutdown_connections 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff5340663d0 0x7ff534068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff54815cab0 0x7ff5480cbee0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5480d0d10 0x7ff5480cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 --2- 172.21.15.82:0/3276777039 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5480cf110 0x7ff548155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 >> 172.21.15.82:0/3276777039 conn(0x7ff54808c120 msgr2=0x7ff5480b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 shutdown_connections 2023-07-20T11:06:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.811+0000 7ff54e09c640 1 -- 172.21.15.82:0/3276777039 wait complete. 2023-07-20T11:06:19.811 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T11:06:19.811 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T11:06:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.971+0000 7fd0675fa640 1 Processor -- start 2023-07-20T11:06:19.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.971+0000 7fd0675fa640 1 -- start start 2023-07-20T11:06:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.971+0000 7fd0675fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd06006f710 0x7fd06006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd0675fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd06015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd0675fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd060070030 con 0x7fd06015ec90 2023-07-20T11:06:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd0675fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06015bad0 con 0x7fd06006f710 2023-07-20T11:06:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd0675fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd060071950 con 0x7fd0600ca5a0 2023-07-20T11:06:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd06015ec90 0x7fd06015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33436/0 (socket says 172.21.15.82:33436) 2023-07-20T11:06:19.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 -- 172.21.15.82:0/1384755296 learned_addr learned my addr 172.21.15.82:0/1384755296 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872772128 0 0) 0x7fd060070030 con 0x7fd06015ec90 2023-07-20T11:06:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c003530 con 0x7fd06015ec90 2023-07-20T11:06:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065396640 1 --2- 172.21.15.82:0/1384755296 >> v2:172.21.15.183:3300/0 conn(0x7fd06006f710 0x7fd06006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd064b95640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd06015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576071748 0 0) 0x7fd04c003530 con 0x7fd06015ec90 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 msgr2=0x7fd06015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd06015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 >> v2:172.21.15.183:3300/0 conn(0x7fd06006f710 msgr2=0x7fd06006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 --2- 172.21.15.82:0/1384755296 >> v2:172.21.15.183:3300/0 conn(0x7fd06006f710 0x7fd06006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06015b230 con 0x7fd06015ec90 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fd058001a00 con 0x7fd06015ec90 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065396640 1 --2- 172.21.15.82:0/1384755296 >> v2:172.21.15.183:3300/0 conn(0x7fd06006f710 0x7fd06006faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:19.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 >> v1:172.21.15.82:6789/0 conn(0x7fd06015ec90 legacy=0x7fd06015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd04c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd04c004020 0x7fd04c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd04c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06015bad0 con 0x7fd04c004d10 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd060071950 con 0x7fd04c004020 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c00bb20 con 0x7fd0600ca5a0 2023-07-20T11:06:19.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd04c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065396640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd04c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd064b95640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd04c004020 0x7fd04c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 -- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 msgr2=0x7fd04c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0600ca5a0 0x7fd04c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 -- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd04c004020 msgr2=0x7fd04c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd04c004020 0x7fd04c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.975+0000 7fd065b97640 1 -- 172.21.15.82:0/1384755296 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c003530 con 0x7fd04c004d10 2023-07-20T11:06:19.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd065b97640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd04c005190 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fd05800a830 tx=0x7fd05801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbad726d41bd87b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ad630 con 0x7fd04c004d10 2023-07-20T11:06:19.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0580a8070 con 0x7fd04c004d10 2023-07-20T11:06:19.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd057fff640 1 -- 172.21.15.82:0/1384755296 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0580ada30 con 0x7fd04c004d10 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- 172.21.15.82:0/1384755296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 msgr2=0x7fd04c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1384755296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd04c005190 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fd05800a830 tx=0x7fd05801d340 comp rx=0 tx=0).stop 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd065b97640 1 -- 172.21.15.82:0/1384755296 reap_dead start 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- 172.21.15.82:0/1384755296 shutdown_connections 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- 172.21.15.82:0/1384755296 >> 172.21.15.82:0/1384755296 conn(0x7fd0600cad50 msgr2=0x7fd0600cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- 172.21.15.82:0/1384755296 shutdown_connections 2023-07-20T11:06:19.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- 172.21.15.82:0/1384755296 wait complete. 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 Processor -- start 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.979+0000 7fd0675fa640 1 -- start start 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 0x7fd0601f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 0x7fd0600af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014c620 con 0x7fd04c004d10 2023-07-20T11:06:19.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0601f2480 con 0x7fd0601f2000 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014cf80 con 0x7fd0601496a0 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58560/0 (socket says 172.21.15.82:58560) 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 -- 172.21.15.82:0/1707057754 learned_addr learned my addr 172.21.15.82:0/1707057754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065b97640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 0x7fd0600af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd064b95640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 0x7fd0601f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 -- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 msgr2=0x7fd0601f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 0x7fd0601f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 -- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 msgr2=0x7fd0600af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 0x7fd0600af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 -- 172.21.15.82:0/1707057754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06014bff0 con 0x7fd04c004d10 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd064b95640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 0x7fd0601f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065b97640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 0x7fd0600af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd065396640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0107b0 tx=0x7fd05c010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00eb00 con 0x7fd04c004d10 2023-07-20T11:06:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00ec60 con 0x7fd04c004d10 2023-07-20T11:06:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c010e60 con 0x7fd04c004d10 2023-07-20T11:06:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0601f2680 con 0x7fd04c004d10 2023-07-20T11:06:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06014c240 con 0x7fd04c004d10 2023-07-20T11:06:19.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06004da30 con 0x7fd04c004d10 2023-07-20T11:06:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.983+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd05c015470 con 0x7fd04c004d10 2023-07-20T11:06:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.987+0000 7fd055ffb640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 0x7fd044068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.987+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fd05c084630 con 0x7fd04c004d10 2023-07-20T11:06:19.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.987+0000 7fd064b95640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 0x7fd044068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.987+0000 7fd064b95640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 0x7fd044068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd06015c2a0 tx=0x7fd050008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:19.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:19.991+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd05c051c90 con 0x7fd04c004d10 2023-07-20T11:06:20.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:20.139+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd0600cb940 con 0x7fd04c004d10 2023-07-20T11:06:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.127+0000 7fd055ffb640 1 -- 172.21.15.82:0/1707057754 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v169) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd05c0552b0 con 0x7fd04c004d10 2023-07-20T11:06:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T11:06:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 msgr2=0x7fd044068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 0x7fd044068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd06015c2a0 tx=0x7fd050008040 comp rx=0 tx=0).stop 2023-07-20T11:06:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 msgr2=0x7fd06014ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0107b0 tx=0x7fd05c010c70 comp rx=0 tx=0).stop 2023-07-20T11:06:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 shutdown_connections 2023-07-20T11:06:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fd0440663a0 0x7fd044068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd0601f2000 0x7fd0600af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd0601496a0 0x7fd0601f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 --2- 172.21.15.82:0/1707057754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd04c004d10 0x7fd06014ca40 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 >> 172.21.15.82:0/1707057754 conn(0x7fd0600cad50 msgr2=0x7fd06015a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:21.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 shutdown_connections 2023-07-20T11:06:21.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.131+0000 7fd0675fa640 1 -- 172.21.15.82:0/1707057754 wait complete. 2023-07-20T11:06:21.138 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T11:06:21.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 Processor -- start 2023-07-20T11:06:21.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 -- start start 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6815a6f0 0x7f0b6815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b68071950 con 0x7f0b680ca5a0 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6815b230 con 0x7f0b6806f710 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6e434640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6815bad0 con 0x7f0b6815a6f0 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6815a6f0 0x7f0b6815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0b6815a6f0 0x7f0b6815ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58566/0 (socket says 172.21.15.82:58566) 2023-07-20T11:06:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 -- 172.21.15.82:0/2531973561 learned_addr learned my addr 172.21.15.82:0/2531973561 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b677fe640 1 --1- 172.21.15.82:0/2531973561 >> v1:172.21.15.82:6789/0 conn(0x7f0b680ca5a0 0x7f0b6815e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33448/0 (socket says 172.21.15.82:33448) 2023-07-20T11:06:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 -- 172.21.15.82:0/2531973561 >> v1:172.21.15.183:6789/0 conn(0x7f0b6806f710 legacy=0x7f0b6806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 -- 172.21.15.82:0/2531973561 >> v1:172.21.15.82:6789/0 conn(0x7f0b680ca5a0 legacy=0x7f0b6815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b6c9d1640 1 -- 172.21.15.82:0/2531973561 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6815b510 con 0x7f0b6815a6f0 2023-07-20T11:06:21.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.307+0000 7f0b66ffd640 1 -- 172.21.15.82:0/2531973561 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352785304 0 0) 0x7f0b68071950 con 0x7f0b680ca5a0 2023-07-20T11:06:21.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6c9d1640 1 --2- 172.21.15.82:0/2531973561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6815a6f0 0x7f0b6815ab60 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009e80 tx=0x7f0b6001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9358c2838333e732 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:21.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b66ffd640 1 -- 172.21.15.82:0/2531973561 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a5880 con 0x7f0b6815a6f0 2023-07-20T11:06:21.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b66ffd640 1 -- 172.21.15.82:0/2531973561 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b600a59e0 con 0x7f0b6815a6f0 2023-07-20T11:06:21.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b66ffd640 1 -- 172.21.15.82:0/2531973561 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b600a5d70 con 0x7f0b6815a6f0 2023-07-20T11:06:21.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- 172.21.15.82:0/2531973561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6815a6f0 msgr2=0x7f0b6815ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 --2- 172.21.15.82:0/2531973561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6815a6f0 0x7f0b6815ab60 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009e80 tx=0x7f0b6001c9c0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- 172.21.15.82:0/2531973561 shutdown_connections 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 --2- 172.21.15.82:0/2531973561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b6815a6f0 0x7f0b6815ab60 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- 172.21.15.82:0/2531973561 >> 172.21.15.82:0/2531973561 conn(0x7f0b680cad50 msgr2=0x7f0b680cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- 172.21.15.82:0/2531973561 shutdown_connections 2023-07-20T11:06:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- 172.21.15.82:0/2531973561 wait complete. 2023-07-20T11:06:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 Processor -- start 2023-07-20T11:06:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.311+0000 7f0b6e434640 1 -- start start 2023-07-20T11:06:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b6806f710 0x7f0b680ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 0x7f0b680ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68146020 con 0x7f0b680ca5a0 2023-07-20T11:06:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814d090 con 0x7f0b6806f710 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68154c90 con 0x7f0b6815a6f0 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58580/0 (socket says 172.21.15.82:58580) 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 -- 172.21.15.82:0/3849702456 learned_addr learned my addr 172.21.15.82:0/3849702456 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b67fff640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b6806f710 0x7f0b680ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6c9d1640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 0x7f0b680ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 -- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 msgr2=0x7f0b680ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 0x7f0b680ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 -- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b6806f710 msgr2=0x7f0b680ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b6806f710 0x7f0b680ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 -- 172.21.15.82:0/3849702456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009b30 con 0x7f0b680ca5a0 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6c9d1640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 0x7f0b680ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b677fe640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c480 tx=0x7f0b5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0074e0 con 0x7f0b680ca5a0 2023-07-20T11:06:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c007640 con 0x7f0b680ca5a0 2023-07-20T11:06:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c004a10 con 0x7f0b680ca5a0 2023-07-20T11:06:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6814cd60 con 0x7f0b680ca5a0 2023-07-20T11:06:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6815cb00 con 0x7f0b680ca5a0 2023-07-20T11:06:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.315+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6814d200 con 0x7f0b680ca5a0 2023-07-20T11:06:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.319+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b5c004b70 con 0x7f0b680ca5a0 2023-07-20T11:06:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.319+0000 7f0b64ff9640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 0x7f0b54068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.319+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5652+0+0 (secure 0 0 0) 0x7f0b5c082f20 con 0x7f0b680ca5a0 2023-07-20T11:06:21.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.319+0000 7f0b67fff640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 0x7f0b54068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:21.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.319+0000 7f0b67fff640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 0x7f0b54068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0b58000f70 tx=0x7f0b58009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.323+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b5c0504c0 con 0x7f0b680ca5a0 2023-07-20T11:06:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:21.471+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0b6804da30 con 0x7f0b680ca5a0 2023-07-20T11:06:22.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.139+0000 7f0b64ff9640 1 -- 172.21.15.82:0/3849702456 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v170) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0b5c018070 con 0x7f0b680ca5a0 2023-07-20T11:06:22.123 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T11:06:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.147+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 msgr2=0x7f0b54068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.147+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 0x7f0b54068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0b58000f70 tx=0x7f0b58009040 comp rx=0 tx=0).stop 2023-07-20T11:06:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.147+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 msgr2=0x7f0b680addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.147+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c480 tx=0x7f0b5c00c940 comp rx=0 tx=0).stop 2023-07-20T11:06:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 shutdown_connections 2023-07-20T11:06:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f0b540663a0 0x7f0b54068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0b6815a6f0 0x7f0b680ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b680ca5a0 0x7f0b680addc0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 --2- 172.21.15.82:0/3849702456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0b6806f710 0x7f0b680ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 >> 172.21.15.82:0/3849702456 conn(0x7f0b680cad50 msgr2=0x7f0b6815d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 shutdown_connections 2023-07-20T11:06:22.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.151+0000 7f0b6e434640 1 -- 172.21.15.82:0/3849702456 wait complete. 2023-07-20T11:06:22.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T11:06:22.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.323+0000 7f7897269640 1 Processor -- start 2023-07-20T11:06:22.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.323+0000 7f7897269640 1 -- start start 2023-07-20T11:06:22.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7897269640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f78900c9f70 0x7f789006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:22.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7897269640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7890159670 con 0x7f7890159290 2023-07-20T11:06:22.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7897269640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789015d1f0 con 0x7f7890070450 2023-07-20T11:06:22.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7897269640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789015d4d0 con 0x7f78900c9f70 2023-07-20T11:06:22.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896267640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7890159290 0x7f78900cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:33458/0 (socket says 172.21.15.82:33458) 2023-07-20T11:06:22.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896267640 1 -- 172.21.15.82:0/1007720818 learned_addr learned my addr 172.21.15.82:0/1007720818 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:22.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896a68640 1 --2- 172.21.15.82:0/1007720818 >> v2:172.21.15.183:3300/0 conn(0x7f78900c9f70 0x7f789006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:22.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7895265640 1 -- 172.21.15.82:0/1007720818 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897758597 0 0) 0x7f7890159670 con 0x7f7890159290 2023-07-20T11:06:22.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7895265640 1 -- 172.21.15.82:0/1007720818 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f787c005740 con 0x7f7890159290 2023-07-20T11:06:22.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896a68640 1 -- 172.21.15.82:0/1007720818 >> v1:172.21.15.183:6789/0 conn(0x7f7890070450 legacy=0x7f78900c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896a68640 1 -- 172.21.15.82:0/1007720818 >> v1:172.21.15.82:6789/0 conn(0x7f7890159290 legacy=0x7f78900cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.327+0000 7f7896a68640 1 -- 172.21.15.82:0/1007720818 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789015d7b0 con 0x7f78900c9f70 2023-07-20T11:06:22.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7896a68640 1 --2- 172.21.15.82:0/1007720818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78900c9f70 0x7f789006ba50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7888009dc0 tx=0x7f788801d240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbe016ac7a98f83 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:22.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7895265640 1 -- 172.21.15.82:0/1007720818 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880a58c0 con 0x7f78900c9f70 2023-07-20T11:06:22.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7895265640 1 -- 172.21.15.82:0/1007720818 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78880a5a20 con 0x7f78900c9f70 2023-07-20T11:06:22.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7895265640 1 -- 172.21.15.82:0/1007720818 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78880a5db0 con 0x7f78900c9f70 2023-07-20T11:06:22.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- 172.21.15.82:0/1007720818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78900c9f70 msgr2=0x7f789006ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 --2- 172.21.15.82:0/1007720818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78900c9f70 0x7f789006ba50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7888009dc0 tx=0x7f788801d240 comp rx=0 tx=0).stop 2023-07-20T11:06:22.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- 172.21.15.82:0/1007720818 shutdown_connections 2023-07-20T11:06:22.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 --2- 172.21.15.82:0/1007720818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f78900c9f70 0x7f789006ba50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- 172.21.15.82:0/1007720818 >> 172.21.15.82:0/1007720818 conn(0x7f78900ce080 msgr2=0x7f78900ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:22.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- 172.21.15.82:0/1007720818 shutdown_connections 2023-07-20T11:06:22.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- 172.21.15.82:0/1007720818 wait complete. 2023-07-20T11:06:22.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 Processor -- start 2023-07-20T11:06:22.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.331+0000 7f7897269640 1 -- start start 2023-07-20T11:06:22.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 0x7f789014a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 0x7f78900c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b3930 con 0x7f78900c9f70 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b2d20 con 0x7f7890159290 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b3000 con 0x7f7890070450 2023-07-20T11:06:22.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58582/0 (socket says 172.21.15.82:58582) 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 -- 172.21.15.82:0/2315621277 learned_addr learned my addr 172.21.15.82:0/2315621277 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 -- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 msgr2=0x7f789014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7896267640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 0x7f789014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 0x7f789014a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7896a68640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 0x7f78900c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:22.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 -- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 msgr2=0x7f78900c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:22.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 0x7f78900c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:22.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 -- 172.21.15.82:0/2315621277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888009a70 con 0x7f78900c9f70 2023-07-20T11:06:22.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7896267640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 0x7f789014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:22.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7896a68640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 0x7f78900c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:22.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7895a66640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f788000c390 tx=0x7f788000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:22.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78800052d0 con 0x7f78900c9f70 2023-07-20T11:06:22.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7880005430 con 0x7f78900c9f70 2023-07-20T11:06:22.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900709b0 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880003820 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78900b35c0 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789004da30 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.335+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7880003980 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.339+0000 7f7886ffd640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 0x7f7874068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.339+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f78800833c0 con 0x7f78900c9f70 2023-07-20T11:06:22.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.339+0000 7f7896267640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 0x7f7874068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:22.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.339+0000 7f7896267640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 0x7f7874068890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f788c0011f0 tx=0x7f788c009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:22.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.343+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7880050720 con 0x7f78900c9f70 2023-07-20T11:06:22.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:22.519+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78900b4000 con 0x7f78900c9f70 2023-07-20T11:06:23.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.143+0000 7f7886ffd640 1 -- 172.21.15.82:0/2315621277 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v78) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7880053d40 con 0x7f78900c9f70 2023-07-20T11:06:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 21 and data pool 22 2023-07-20T11:06:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.155+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 msgr2=0x7f7874068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.155+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 0x7f7874068890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f788c0011f0 tx=0x7f788c009040 comp rx=0 tx=0).stop 2023-07-20T11:06:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.159+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 msgr2=0x7f78900b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.159+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f788000c390 tx=0x7f788000c850 comp rx=0 tx=0).stop 2023-07-20T11:06:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 shutdown_connections 2023-07-20T11:06:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f78740663d0 0x7f7874068890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7890159290 0x7f78900c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78900c9f70 0x7f78900b1420 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 --2- 172.21.15.82:0/2315621277 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7890070450 0x7f789014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 >> 172.21.15.82:0/2315621277 conn(0x7f78900ce080 msgr2=0x7f78900ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 shutdown_connections 2023-07-20T11:06:23.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.163+0000 7f7897269640 1 -- 172.21.15.82:0/2315621277 wait complete. 2023-07-20T11:06:23.172 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:23.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 Processor -- start 2023-07-20T11:06:23.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 -- start start 2023-07-20T11:06:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be80b12a0 con 0x7f5be80b2060 2023-07-20T11:06:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be80b1580 con 0x7f5be80afda0 2023-07-20T11:06:23.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bee0f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80b3160 con 0x7f5be815a8e0 2023-07-20T11:06:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be7fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5be80b2060 0x7f5be80b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48976/0 (socket says 172.21.15.82:48976) 2023-07-20T11:06:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be7fff640 1 -- 172.21.15.82:0/2763647326 learned_addr learned my addr 172.21.15.82:0/2763647326 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/2763647326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044139806 0 0) 0x7f5be80b12a0 con 0x7f5be80b2060 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd4003530 con 0x7f5be80b2060 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213832986 0 0) 0x7f5be80b1580 con 0x7f5be80afda0 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be80b12a0 con 0x7f5be80afda0 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bdeffd640 1 -- 172.21.15.82:0/2763647326 >> v1:172.21.15.183:6789/0 conn(0x7f5be80afda0 legacy=0x7f5be80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bdeffd640 1 -- 172.21.15.82:0/2763647326 >> v1:172.21.15.82:6789/0 conn(0x7f5be80b2060 legacy=0x7f5be80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038898511 0 0) 0x7f5bd4003530 con 0x7f5be80b2060 2023-07-20T11:06:23.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.331+0000 7f5bdeffd640 1 -- 172.21.15.82:0/2763647326 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80b1860 con 0x7f5be815a8e0 2023-07-20T11:06:23.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/2763647326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80ca6b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009df0 tx=0x7f5bd001c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac406d08c291410 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0001680 con 0x7f5be815a8e0 2023-07-20T11:06:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd00a5550 con 0x7f5be815a8e0 2023-07-20T11:06:23.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5be6ffd640 1 -- 172.21.15.82:0/2763647326 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00a58c0 con 0x7f5be815a8e0 2023-07-20T11:06:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 -- 172.21.15.82:0/2763647326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 msgr2=0x7f5be80ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/2763647326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80ca6b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009df0 tx=0x7f5bd001c740 comp rx=0 tx=0).stop 2023-07-20T11:06:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 -- 172.21.15.82:0/2763647326 shutdown_connections 2023-07-20T11:06:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/2763647326 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80ca6b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 -- 172.21.15.82:0/2763647326 >> 172.21.15.82:0/2763647326 conn(0x7f5be80cada0 msgr2=0x7f5be80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 -- 172.21.15.82:0/2763647326 shutdown_connections 2023-07-20T11:06:23.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.335+0000 7f5bee0f9640 1 -- 172.21.15.82:0/2763647326 wait complete. 2023-07-20T11:06:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 Processor -- start 2023-07-20T11:06:23.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 -- start start 2023-07-20T11:06:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 0x7f5be81482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be81487e0 con 0x7f5be80afda0 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be80abe50 con 0x7f5be80b2060 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bee0f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be815bd10 con 0x7f5be815a8e0 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47540/0 (socket says 172.21.15.82:47540) 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 -- 172.21.15.82:0/1994703211 learned_addr learned my addr 172.21.15.82:0/1994703211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 0x7f5be81482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be7fff640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 -- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 msgr2=0x7f5be80aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 -- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 msgr2=0x7f5be81482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 0x7f5be81482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 -- 172.21.15.82:0/1994703211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0009a70 con 0x7f5be80afda0 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be7fff640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 0x7f5be81482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.339+0000 7f5be77fe640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c430 tx=0x7f5bd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80052d0 con 0x7f5be80afda0 2023-07-20T11:06:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8005450 con 0x7f5be80afda0 2023-07-20T11:06:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8003840 con 0x7f5be80afda0 2023-07-20T11:06:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be815bff0 con 0x7f5be80afda0 2023-07-20T11:06:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be815dab0 con 0x7f5be80afda0 2023-07-20T11:06:23.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8073c70 con 0x7f5be80afda0 2023-07-20T11:06:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5bd80039a0 con 0x7f5be80afda0 2023-07-20T11:06:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 0x7f5bc8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f5bd80834d0 con 0x7f5be80afda0 2023-07-20T11:06:23.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.343+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 0x7f5bc8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.347+0000 7f5bdeffd640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 0x7f5bc8068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00af000 tx=0x7f5bd00a7070 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.347+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bd80507e0 con 0x7f5be80afda0 2023-07-20T11:06:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.495+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5be8148ee0 con 0x7f5be80afda0 2023-07-20T11:06:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5be4ff9640 1 -- 172.21.15.82:0/1994703211 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18405 (secure 0 0 0) 0x7f5bd8053e00 con 0x7f5be80afda0 2023-07-20T11:06:23.480 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:23.481 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":171,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:22.522548+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 msgr2=0x7f5bc8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 0x7f5bc8068890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00af000 tx=0x7f5bd00a7070 comp rx=0 tx=0).stop 2023-07-20T11:06:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 msgr2=0x7f5be815b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800c430 tx=0x7f5bd800c8f0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 shutdown_connections 2023-07-20T11:06:23.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f5bc80663d0 0x7f5bc8068890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5be815a8e0 0x7f5be80aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5be80b2060 0x7f5be81482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 --2- 172.21.15.82:0/1994703211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5be80afda0 0x7f5be815b730 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 >> 172.21.15.82:0/1994703211 conn(0x7f5be80cada0 msgr2=0x7f5be8152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 shutdown_connections 2023-07-20T11:06:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.499+0000 7f5bee0f9640 1 -- 172.21.15.82:0/1994703211 wait complete. 2023-07-20T11:06:23.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 Processor -- start 2023-07-20T11:06:23.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 -- start start 2023-07-20T11:06:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f081c0b2180 0x7f081c163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c0cde70 con 0x7f081c0ca040 2023-07-20T11:06:23.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c0cbef0 con 0x7f081c0ad060 2023-07-20T11:06:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f08220cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c15d730 con 0x7f081c0b2180 2023-07-20T11:06:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f081b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f081c0ca040 0x7f081c15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48988/0 (socket says 172.21.15.82:48988) 2023-07-20T11:06:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f081b7fe640 1 -- 172.21.15.82:0/664582175 learned_addr learned my addr 172.21.15.82:0/664582175 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:23.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.659+0000 7f081bfff640 1 --2- 172.21.15.82:0/664582175 >> v2:172.21.15.183:3300/0 conn(0x7f081c0b2180 0x7f081c163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081a7fc640 1 -- 172.21.15.82:0/664582175 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156772715 0 0) 0x7f081c0cde70 con 0x7f081c0ca040 2023-07-20T11:06:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081a7fc640 1 -- 172.21.15.82:0/664582175 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0804003530 con 0x7f081c0ca040 2023-07-20T11:06:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081bfff640 1 -- 172.21.15.82:0/664582175 >> v1:172.21.15.183:6789/0 conn(0x7f081c0ad060 legacy=0x7f081c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081bfff640 1 -- 172.21.15.82:0/664582175 >> v1:172.21.15.82:6789/0 conn(0x7f081c0ca040 legacy=0x7f081c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081bfff640 1 -- 172.21.15.82:0/664582175 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c0ca420 con 0x7f081c0b2180 2023-07-20T11:06:23.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081bfff640 1 --2- 172.21.15.82:0/664582175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c163c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f081400aea0 tx=0x7f081401da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e59e9a7d88ea9e72 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081a7fc640 1 -- 172.21.15.82:0/664582175 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400a2d0 con 0x7f081c0b2180 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081a7fc640 1 -- 172.21.15.82:0/664582175 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08140a66b0 con 0x7f081c0b2180 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.663+0000 7f081a7fc640 1 -- 172.21.15.82:0/664582175 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140a6a40 con 0x7f081c0b2180 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- 172.21.15.82:0/664582175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 msgr2=0x7f081c163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 --2- 172.21.15.82:0/664582175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c163c40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f081400aea0 tx=0x7f081401da50 comp rx=0 tx=0).stop 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- 172.21.15.82:0/664582175 shutdown_connections 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 --2- 172.21.15.82:0/664582175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c163c40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- 172.21.15.82:0/664582175 >> 172.21.15.82:0/664582175 conn(0x7f081c0cada0 msgr2=0x7f081c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- 172.21.15.82:0/664582175 shutdown_connections 2023-07-20T11:06:23.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- 172.21.15.82:0/664582175 wait complete. 2023-07-20T11:06:23.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 Processor -- start 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- start start 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f081c0ad060 0x7f081c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c1627b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c163840 con 0x7f081c0ca040 2023-07-20T11:06:23.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c163b20 con 0x7f081c0b2180 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f08220cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c163e00 con 0x7f081c0ad060 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47548/0 (socket says 172.21.15.82:47548) 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 -- 172.21.15.82:0/1381007590 learned_addr learned my addr 172.21.15.82:0/1381007590 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081b7fe640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f081c0ad060 0x7f081c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081affd640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c1627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 -- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f081c0ad060 msgr2=0x7f081c155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f081c0ad060 0x7f081c155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 -- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 msgr2=0x7f081c1627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c1627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 -- 172.21.15.82:0/1381007590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081400ab80 con 0x7f081c0ca040 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.667+0000 7f081bfff640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f081401a660 tx=0x7f081401a7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140b7680 con 0x7f081c0ca040 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08140b77e0 con 0x7f081c0ca040 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08140b7b90 con 0x7f081c0ca040 2023-07-20T11:06:23.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c15ade0 con 0x7f081c0ca040 2023-07-20T11:06:23.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c162cf0 con 0x7f081c0ca040 2023-07-20T11:06:23.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c073c70 con 0x7f081c0ca040 2023-07-20T11:06:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f08140b7cf0 con 0x7f081c0ca040 2023-07-20T11:06:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 0x7f0808068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f081411f1c0 con 0x7f081c0ca040 2023-07-20T11:06:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.671+0000 7f081b7fe640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 0x7f0808068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.675+0000 7f081b7fe640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 0x7f0808068890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f080c0011f0 tx=0x7f080c009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.675+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08140ec440 con 0x7f081c0ca040 2023-07-20T11:06:23.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.823+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f081c163f40 con 0x7f081c0ca040 2023-07-20T11:06:23.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f0803fff640 1 -- 172.21.15.82:0/1381007590 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+18405 (secure 0 0 0) 0x7f081c163f40 con 0x7f081c0ca040 2023-07-20T11:06:23.808 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:23.809 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":171,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:22.522548+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 msgr2=0x7f0808068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 0x7f0808068890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f080c0011f0 tx=0x7f080c009040 comp rx=0 tx=0).stop 2023-07-20T11:06:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 msgr2=0x7f081c156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f081401a660 tx=0x7f081401a7f0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 shutdown_connections 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f08080663d0 0x7f0808068890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f081c0ca040 0x7f081c156500 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f081c0b2180 0x7f081c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 --2- 172.21.15.82:0/1381007590 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f081c0ad060 0x7f081c155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 >> 172.21.15.82:0/1381007590 conn(0x7f081c0cada0 msgr2=0x7f081c070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 shutdown_connections 2023-07-20T11:06:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.827+0000 7f08220cb640 1 -- 172.21.15.82:0/1381007590 wait complete. 2023-07-20T11:06:23.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T11:06:23.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 Processor -- start 2023-07-20T11:06:23.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 -- start start 2023-07-20T11:06:23.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0dc159830 0x7fe0dc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0cc8d0 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0dc0ccbb0 con 0x7fe0dc159450 2023-07-20T11:06:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e2834640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0dc0cce90 con 0x7fe0dc159830 2023-07-20T11:06:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e0dd1640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0dc0cc3e0 0x7fe0dc0afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48994/0 (socket says 172.21.15.82:48994) 2023-07-20T11:06:23.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e0dd1640 1 -- 172.21.15.82:0/2642681653 learned_addr learned my addr 172.21.15.82:0/2642681653 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2642681653 >> v2:172.21.15.183:3300/0 conn(0x7fe0dc159830 0x7fe0dc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587356423 0 0) 0x7fe0dc0cc8d0 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c4003530 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30812235 0 0) 0x7fe0c4003530 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 >> v2:172.21.15.183:3300/0 conn(0x7fe0dc159830 msgr2=0x7fe0dc0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 --2- 172.21.15.82:0/2642681653 >> v2:172.21.15.183:3300/0 conn(0x7fe0dc159830 0x7fe0dc0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 >> v1:172.21.15.183:6789/0 conn(0x7fe0dc159450 legacy=0x7fe0dc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc159cc0 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fe0d4001a00 con 0x7fe0dc0cc3e0 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 >> v1:172.21.15.82:6789/0 conn(0x7fe0dc0cc3e0 legacy=0x7fe0dc0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 0x7fe0c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c4005190 0x7fe0c400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0cce90 con 0x7fe0c40039f0 2023-07-20T11:06:23.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c400e2d0 con 0x7fe0c4005190 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c400e490 con 0x7fe0c40047d0 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 0x7fe0c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e0dd1640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c4005190 0x7fe0c400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 -- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c40047d0 msgr2=0x7fe0c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 -- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c4005190 msgr2=0x7fe0c400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:23.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c4005190 0x7fe0c400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0dbfff640 1 -- 172.21.15.82:0/2642681653 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4003530 con 0x7fe0c40039f0 2023-07-20T11:06:23.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0e0dd1640 1 -- 172.21.15.82:0/2642681653 reap_dead start 2023-07-20T11:06:23.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.991+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0c40047d0 0x7fe0c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:23.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 0x7fe0c4003e10 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001780 tx=0x7fe0cc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb805b2d01c5c33d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0052d0 con 0x7fe0c40039f0 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc0a7050 con 0x7fe0c40039f0 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0daffd640 1 -- 172.21.15.82:0/2642681653 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc003600 con 0x7fe0c40039f0 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 -- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 msgr2=0x7fe0c4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 0x7fe0c4003e10 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001780 tx=0x7fe0cc01c3b0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 -- 172.21.15.82:0/2642681653 shutdown_connections 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2642681653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0c40039f0 0x7fe0c4003e10 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 -- 172.21.15.82:0/2642681653 >> 172.21.15.82:0/2642681653 conn(0x7fe0dc0cad50 msgr2=0x7fe0dc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 -- 172.21.15.82:0/2642681653 shutdown_connections 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.995+0000 7fe0e2834640 1 -- 172.21.15.82:0/2642681653 wait complete. 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 Processor -- start 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 -- start start 2023-07-20T11:06:23.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c40039f0 0x7fe0dc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0dc0ac9d0 0x7fe0dc0ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0ab930 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0abc10 con 0x7fe0c40039f0 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0dc0abef0 con 0x7fe0dc0ac9d0 2023-07-20T11:06:23.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47572/0 (socket says 172.21.15.82:47572) 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 -- 172.21.15.82:0/2830200435 learned_addr learned my addr 172.21.15.82:0/2830200435 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c40039f0 0x7fe0dc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e0dd1640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0dc0ac9d0 0x7fe0dc0ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 -- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0dc0ac9d0 msgr2=0x7fe0dc0ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0dc0ac9d0 0x7fe0dc0ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 -- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c40039f0 msgr2=0x7fe0dc0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c40039f0 0x7fe0dc0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 -- 172.21.15.82:0/2830200435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0ac1d0 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0db7fe640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0011510 tx=0x7fe0d00119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0004220 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0004380 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0015890 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:23.999+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc0ac4b0 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc0c4b70 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0dc0ac640 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0d00159f0 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0d8ff9640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 0x7fe0c8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:23.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe0d0084190 con 0x7fe0dc0c4d30 2023-07-20T11:06:23.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 0x7fe0c8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:23.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.003+0000 7fe0dbfff640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 0x7fe0c8068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001750 tx=0x7fe0cc0011a0 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:23.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.007+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0d0051410 con 0x7fe0dc0c4d30 2023-07-20T11:06:24.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:24.191+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe0dc0c4b70 con 0x7fe0dc0c4d30 2023-07-20T11:06:25.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.167+0000 7fe0d8ff9640 1 -- 172.21.15.82:0/2830200435 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0dc0c4b70 con 0x7fe0dc0c4d30 2023-07-20T11:06:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 msgr2=0x7fe0c8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 0x7fe0c8068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc001750 tx=0x7fe0cc0011a0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 msgr2=0x7fe0dc152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0011510 tx=0x7fe0d00119d0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 shutdown_connections 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fe0c80663d0 0x7fe0c8068890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0dc0ac9d0 0x7fe0dc0ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0dc0c4d30 0x7fe0dc152930 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 --2- 172.21.15.82:0/2830200435 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0c40039f0 0x7fe0dc0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 >> 172.21.15.82:0/2830200435 conn(0x7fe0dc0cad50 msgr2=0x7fe0dc0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 shutdown_connections 2023-07-20T11:06:25.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.171+0000 7fe0e2834640 1 -- 172.21.15.82:0/2830200435 wait complete. 2023-07-20T11:06:25.174 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T11:06:25.175 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T11:06:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.334+0000 7f4fdc834640 1 Processor -- start 2023-07-20T11:06:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.334+0000 7f4fdc834640 1 -- start start 2023-07-20T11:06:25.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fdc834640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4fd8159450 0x7f4fd815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fdc834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd8159830 0x7f4fd80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fdc834640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80cc8d0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fdc834640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80cce90 con 0x7f4fd8159450 2023-07-20T11:06:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fdc834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80ccbb0 con 0x7f4fd8159830 2023-07-20T11:06:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4fd8159450 0x7f4fd815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd6d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4fd80cc3e0 0x7f4fd80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:48996/0 (socket says 172.21.15.82:48996) 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4fd8159450 0x7f4fd815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47576/0 (socket says 172.21.15.82:47576) 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd6d9d640 1 -- 172.21.15.82:0/1434228303 learned_addr learned my addr 172.21.15.82:0/1434228303 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fcdd9b640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd8159830 0x7f4fd80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 -- 172.21.15.82:0/1434228303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd8159830 msgr2=0x7f4fd80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd8159830 0x7f4fd80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 -- 172.21.15.82:0/1434228303 >> v1:172.21.15.82:6789/0 conn(0x7f4fd80cc3e0 legacy=0x7f4fd80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.338+0000 7f4fd659c640 1 -- 172.21.15.82:0/1434228303 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8159cc0 con 0x7f4fd8159450 2023-07-20T11:06:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fd659c640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8159450 0x7f4fd815a4c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800ba60 tx=0x7f4fc801eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d225b4dd0a76c6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fd5d9b640 1 -- 172.21.15.82:0/1434228303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80a7bd0 con 0x7f4fd8159450 2023-07-20T11:06:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fd5d9b640 1 -- 172.21.15.82:0/1434228303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc80a7d30 con 0x7f4fd8159450 2023-07-20T11:06:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fd5d9b640 1 -- 172.21.15.82:0/1434228303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80a7ea0 con 0x7f4fd8159450 2023-07-20T11:06:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- 172.21.15.82:0/1434228303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8159450 msgr2=0x7f4fd815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8159450 0x7f4fd815a4c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800ba60 tx=0x7f4fc801eb20 comp rx=0 tx=0).stop 2023-07-20T11:06:25.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- 172.21.15.82:0/1434228303 shutdown_connections 2023-07-20T11:06:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd8159830 0x7f4fd80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 --2- 172.21.15.82:0/1434228303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd8159450 0x7f4fd815a4c0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- 172.21.15.82:0/1434228303 >> 172.21.15.82:0/1434228303 conn(0x7f4fd80cad50 msgr2=0x7f4fd80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- 172.21.15.82:0/1434228303 shutdown_connections 2023-07-20T11:06:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- 172.21.15.82:0/1434228303 wait complete. 2023-07-20T11:06:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 Processor -- start 2023-07-20T11:06:25.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.342+0000 7f4fdc834640 1 -- start start 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 0x7f4fd81554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 0x7f4fd80b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b39d0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b0cd0 con 0x7f4fd8159450 2023-07-20T11:06:25.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b0fb0 con 0x7f4fd815c560 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47592/0 (socket says 172.21.15.82:47592) 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 -- 172.21.15.82:0/901866037 learned_addr learned my addr 172.21.15.82:0/901866037 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcdd9b640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 0x7f4fd81554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd6d9d640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 0x7f4fd80b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 -- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 msgr2=0x7f4fd80b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 0x7f4fd80b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 -- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 msgr2=0x7f4fd81554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 0x7f4fd81554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 -- 172.21.15.82:0/901866037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc800b6c0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcdd9b640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 0x7f4fd81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd6d9d640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 0x7f4fd80b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fd659c640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b2040 tx=0x7f4fc801b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80a7ea0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc80afe60 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80ba6b0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd80b1290 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd81559e0 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd804da30 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.346+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4fc80b6070 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.350+0000 7f4fcf7fe640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 0x7f4fb8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:25.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.350+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4fc811f210 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.350+0000 7f4fcdd9b640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 0x7f4fb8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:25.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.350+0000 7f4fcdd9b640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 0x7f4fb8068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80ad8f0 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:25.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.354+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fc80ec520 con 0x7f4fd80cc3e0 2023-07-20T11:06:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:25.530+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4fd80cbbf0 con 0x7f4fd80cc3e0 2023-07-20T11:06:26.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fcf7fe640 1 -- 172.21.15.82:0/901866037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4fc80efb40 con 0x7f4fd80cc3e0 2023-07-20T11:06:26.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 msgr2=0x7f4fb8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 0x7f4fb8068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80ad8f0 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2023-07-20T11:06:26.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 msgr2=0x7f4fd80b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80b2040 tx=0x7f4fc801b8c0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 shutdown_connections 2023-07-20T11:06:26.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f4fb80663a0 0x7f4fb8068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4fd815c560 0x7f4fd80b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4fd8159450 0x7f4fd81554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 --2- 172.21.15.82:0/901866037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fd80cc3e0 0x7f4fd80b1a90 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 >> 172.21.15.82:0/901866037 conn(0x7f4fd80cad50 msgr2=0x7f4fd80711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 shutdown_connections 2023-07-20T11:06:26.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.178+0000 7f4fdc834640 1 -- 172.21.15.82:0/901866037 wait complete. 2023-07-20T11:06:26.183 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T11:06:26.183 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 Processor -- start 2023-07-20T11:06:26.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 -- start start 2023-07-20T11:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ab00afda0 0x7f7ab00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00b2060 0x7f7ab00b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab00b06c0 con 0x7f7ab015a8e0 2023-07-20T11:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00b3160 con 0x7f7ab00afda0 2023-07-20T11:06:26.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7ab578f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00b12a0 con 0x7f7ab00b2060 2023-07-20T11:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aaeffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7ab00afda0 0x7f7ab00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aae7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7ab015a8e0 0x7f7ab00b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49004/0 (socket says 172.21.15.82:49004) 2023-07-20T11:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aae7fc640 1 -- 172.21.15.82:0/584715993 learned_addr learned my addr 172.21.15.82:0/584715993 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:26.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aaeffd640 1 -- 172.21.15.82:0/584715993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00b2060 msgr2=0x7f7ab00b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aaeffd640 1 --2- 172.21.15.82:0/584715993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00b2060 0x7f7ab00b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aaeffd640 1 -- 172.21.15.82:0/584715993 >> v1:172.21.15.82:6789/0 conn(0x7f7ab015a8e0 legacy=0x7f7ab00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aadffb640 1 -- 172.21.15.82:0/584715993 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458181118 0 0) 0x7f7ab00b06c0 con 0x7f7ab015a8e0 2023-07-20T11:06:26.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.342+0000 7f7aaeffd640 1 -- 172.21.15.82:0/584715993 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00b1580 con 0x7f7ab00afda0 2023-07-20T11:06:26.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7aaeffd640 1 --2- 172.21.15.82:0/584715993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00afda0 0x7f7ab00ca6b0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00097c0 tx=0x7f7aa001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e055c23ebbba3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7aadffb640 1 -- 172.21.15.82:0/584715993 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00ab600 con 0x7f7ab00afda0 2023-07-20T11:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7aadffb640 1 -- 172.21.15.82:0/584715993 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa00a7050 con 0x7f7ab00afda0 2023-07-20T11:06:26.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7aadffb640 1 -- 172.21.15.82:0/584715993 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00ab980 con 0x7f7ab00afda0 2023-07-20T11:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 -- 172.21.15.82:0/584715993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00afda0 msgr2=0x7f7ab00ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 --2- 172.21.15.82:0/584715993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00afda0 0x7f7ab00ca6b0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00097c0 tx=0x7f7aa001c330 comp rx=0 tx=0).stop 2023-07-20T11:06:26.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 -- 172.21.15.82:0/584715993 shutdown_connections 2023-07-20T11:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 --2- 172.21.15.82:0/584715993 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00b2060 0x7f7ab00b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 --2- 172.21.15.82:0/584715993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00afda0 0x7f7ab00ca6b0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 -- 172.21.15.82:0/584715993 >> 172.21.15.82:0/584715993 conn(0x7f7ab00cada0 msgr2=0x7f7ab00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 -- 172.21.15.82:0/584715993 shutdown_connections 2023-07-20T11:06:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.346+0000 7f7ab578f640 1 -- 172.21.15.82:0/584715993 wait complete. 2023-07-20T11:06:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 Processor -- start 2023-07-20T11:06:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- start start 2023-07-20T11:06:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00afda0 0x7f7ab015c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ab015a8e0 0x7f7ab0159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0153d20 con 0x7f7ab00b2060 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab015b3c0 con 0x7f7ab015a8e0 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab015b6a0 con 0x7f7ab00afda0 2023-07-20T11:06:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47614/0 (socket says 172.21.15.82:47614) 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 -- 172.21.15.82:0/1564562193 learned_addr learned my addr 172.21.15.82:0/1564562193 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aaeffd640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00afda0 0x7f7ab015c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aaf7fe640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ab015a8e0 0x7f7ab0159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 -- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00afda0 msgr2=0x7f7ab015c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00afda0 0x7f7ab015c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 -- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ab015a8e0 msgr2=0x7f7ab0159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ab015a8e0 0x7f7ab0159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 -- 172.21.15.82:0/1564562193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa0009420 con 0x7f7ab00b2060 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7aae7fc640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c4b0 tx=0x7f7aa400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40074e0 con 0x7f7ab00b2060 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa4007660 con 0x7f7ab00b2060 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4004a30 con 0x7f7ab00b2060 2023-07-20T11:06:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab015b980 con 0x7f7ab00b2060 2023-07-20T11:06:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab015bf40 con 0x7f7ab00b2060 2023-07-20T11:06:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.350+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab0073c70 con 0x7f7ab00b2060 2023-07-20T11:06:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.354+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7aa4004b90 con 0x7f7ab00b2060 2023-07-20T11:06:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.354+0000 7f7a977fe640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 0x7f7a9c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.354+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7aa4083280 con 0x7f7ab00b2060 2023-07-20T11:06:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.354+0000 7f7aaeffd640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 0x7f7a9c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.354+0000 7f7aaeffd640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 0x7f7a9c068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00ad000 tx=0x7f7aa00a6000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.358+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7aa4050530 con 0x7f7ab00b2060 2023-07-20T11:06:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.534+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ab00cb990 con 0x7f7ab00b2060 2023-07-20T11:06:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.534+0000 7f7a977fe640 1 -- 172.21.15.82:0/1564562193 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f7aa4018020 con 0x7f7ab00b2060 2023-07-20T11:06:26.519 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:26.519 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:06:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:06:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 msgr2=0x7f7a9c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 0x7f7a9c068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00ad000 tx=0x7f7aa00a6000 comp rx=0 tx=0).stop 2023-07-20T11:06:26.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 msgr2=0x7f7ab01537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400c4b0 tx=0x7f7aa400c970 comp rx=0 tx=0).stop 2023-07-20T11:06:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 shutdown_connections 2023-07-20T11:06:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7a9c0663a0 0x7f7a9c068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7ab015a8e0 0x7f7ab0159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ab00b2060 0x7f7ab01537e0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 --2- 172.21.15.82:0/1564562193 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7ab00afda0 0x7f7ab015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 >> 172.21.15.82:0/1564562193 conn(0x7f7ab00cada0 msgr2=0x7f7ab00acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 shutdown_connections 2023-07-20T11:06:26.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.538+0000 7f7ab578f640 1 -- 172.21.15.82:0/1564562193 wait complete. 2023-07-20T11:06:26.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:06:26.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.694+0000 7ff69b98f640 1 Processor -- start 2023-07-20T11:06:26.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.694+0000 7ff69b98f640 1 -- start start 2023-07-20T11:06:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69b98f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6940ca040 0x7ff6940ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69b98f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff69415d4a0 0x7ff6940b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69b98f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6940cde70 con 0x7ff69415c910 2023-07-20T11:06:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69b98f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940cbef0 con 0x7ff6940ca040 2023-07-20T11:06:26.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69b98f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6940ca420 con 0x7ff69415d4a0 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6940ca040 0x7ff6940ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff6940ca040 0x7ff6940ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47618/0 (socket says 172.21.15.82:47618) 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 -- 172.21.15.82:0/1963908668 learned_addr learned my addr 172.21.15.82:0/1963908668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff699f2c640 1 --2- 172.21.15.82:0/1963908668 >> v2:172.21.15.183:3300/0 conn(0x7ff69415d4a0 0x7ff6940b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 -- 172.21.15.82:0/1963908668 >> v2:172.21.15.183:3300/0 conn(0x7ff69415d4a0 msgr2=0x7ff6940b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 --2- 172.21.15.82:0/1963908668 >> v2:172.21.15.183:3300/0 conn(0x7ff69415d4a0 0x7ff6940b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 -- 172.21.15.82:0/1963908668 >> v1:172.21.15.183:6789/0 conn(0x7ff69415c910 legacy=0x7ff69415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:26.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.698+0000 7ff69972b640 1 -- 172.21.15.82:0/1963908668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6940cdb40 con 0x7ff6940ca040 2023-07-20T11:06:26.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69972b640 1 --2- 172.21.15.82:0/1963908668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6940ca040 0x7ff6940ad060 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7ff69415c850 tx=0x7ff69001d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec8b4029a22f9b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff68bfff640 1 -- 172.21.15.82:0/1963908668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900aa610 con 0x7ff6940ca040 2023-07-20T11:06:26.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff68bfff640 1 -- 172.21.15.82:0/1963908668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6900aa770 con 0x7ff6940ca040 2023-07-20T11:06:26.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff68bfff640 1 -- 172.21.15.82:0/1963908668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6900aab00 con 0x7ff6940ca040 2023-07-20T11:06:26.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- 172.21.15.82:0/1963908668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6940ca040 msgr2=0x7ff6940ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 --2- 172.21.15.82:0/1963908668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6940ca040 0x7ff6940ad060 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7ff69415c850 tx=0x7ff69001d5a0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- 172.21.15.82:0/1963908668 shutdown_connections 2023-07-20T11:06:26.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 --2- 172.21.15.82:0/1963908668 >> v2:172.21.15.183:3300/0 conn(0x7ff69415d4a0 0x7ff6940b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 --2- 172.21.15.82:0/1963908668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6940ca040 0x7ff6940ad060 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- 172.21.15.82:0/1963908668 >> 172.21.15.82:0/1963908668 conn(0x7ff6940cada0 msgr2=0x7ff6940cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:26.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- 172.21.15.82:0/1963908668 shutdown_connections 2023-07-20T11:06:26.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- 172.21.15.82:0/1963908668 wait complete. 2023-07-20T11:06:26.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 Processor -- start 2023-07-20T11:06:26.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.702+0000 7ff69b98f640 1 -- start start 2023-07-20T11:06:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6940ca040 0x7ff694163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff69415d4a0 0x7ff694156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f9280 con 0x7ff69415c910 2023-07-20T11:06:26.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff694163a50 con 0x7ff6940ca040 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6941f8600 con 0x7ff69415d4a0 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47624/0 (socket says 172.21.15.82:47624) 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 -- 172.21.15.82:0/670286797 learned_addr learned my addr 172.21.15.82:0/670286797 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69972b640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6940ca040 0x7ff694163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff699f2c640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff69415d4a0 0x7ff694156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 -- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff69415d4a0 msgr2=0x7ff694156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff69415d4a0 0x7ff694156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 -- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6940ca040 msgr2=0x7ff694163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6940ca040 0x7ff694163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 -- 172.21.15.82:0/670286797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900094d0 con 0x7ff69415c910 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff698f2a640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c450 tx=0x7ff68400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684012830 con 0x7ff69415c910 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6840129b0 con 0x7ff69415c910 2023-07-20T11:06:26.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684012d60 con 0x7ff69415c910 2023-07-20T11:06:26.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6941f88e0 con 0x7ff69415c910 2023-07-20T11:06:26.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6941f8ea0 con 0x7ff69415c910 2023-07-20T11:06:26.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff694073c70 con 0x7ff69415c910 2023-07-20T11:06:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.706+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff68401c460 con 0x7ff69415c910 2023-07-20T11:06:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.710+0000 7ff689ffb640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 0x7ff678068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.710+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7ff684083c80 con 0x7ff69415c910 2023-07-20T11:06:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.710+0000 7ff69972b640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 0x7ff678068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.710+0000 7ff69972b640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 0x7ff678068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6900af000 tx=0x7ff690008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:26.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.714+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff684050fb0 con 0x7ff69415c910 2023-07-20T11:06:26.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.862+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6940cbbd0 con 0x7ff69415c910 2023-07-20T11:06:26.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.862+0000 7ff689ffb640 1 -- 172.21.15.82:0/670286797 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+18392 (secure 0 0 0) 0x7ff6840545d0 con 0x7ff69415c910 2023-07-20T11:06:26.846 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:26.846 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":172,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:06:24.135535+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:06:26.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 msgr2=0x7ff678068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 0x7ff678068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6900af000 tx=0x7ff690008040 comp rx=0 tx=0).stop 2023-07-20T11:06:26.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 msgr2=0x7ff694158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:26.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c450 tx=0x7ff68400c910 comp rx=0 tx=0).stop 2023-07-20T11:06:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 shutdown_connections 2023-07-20T11:06:26.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff6780663a0 0x7ff678068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff69415d4a0 0x7ff694156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff69415c910 0x7ff694158600 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 --2- 172.21.15.82:0/670286797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff6940ca040 0x7ff694163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 >> 172.21.15.82:0/670286797 conn(0x7ff6940cada0 msgr2=0x7ff6940705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 shutdown_connections 2023-07-20T11:06:26.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:26.866+0000 7ff69b98f640 1 -- 172.21.15.82:0/670286797 wait complete. 2023-07-20T11:06:26.867 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T11:06:26.868 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:06:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.022+0000 7f7fd3a6a640 1 Processor -- start 2023-07-20T11:06:27.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.022+0000 7f7fd3a6a640 1 -- start start 2023-07-20T11:06:27.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd3a6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fcc0ad060 0x7f7fcc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd3a6a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7fcc0b0290 0x7f7fcc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd3a6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fcc0cde70 con 0x7f7fcc0afe10 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd3a6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0ad440 con 0x7f7fcc0ad060 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd3a6a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fcc0cbef0 con 0x7f7fcc0b0290 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fcc0ad060 0x7f7fcc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fcc0ad060 0x7f7fcc0ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47628/0 (socket says 172.21.15.82:47628) 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 -- 172.21.15.82:0/1417080782 learned_addr learned my addr 172.21.15.82:0/1417080782 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:27.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd2007640 1 --2- 172.21.15.82:0/1417080782 >> v2:172.21.15.183:3300/0 conn(0x7f7fcc0b0290 0x7f7fcc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 -- 172.21.15.82:0/1417080782 >> v2:172.21.15.183:3300/0 conn(0x7f7fcc0b0290 msgr2=0x7f7fcc15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:27.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 --2- 172.21.15.82:0/1417080782 >> v2:172.21.15.183:3300/0 conn(0x7f7fcc0b0290 0x7f7fcc15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 -- 172.21.15.82:0/1417080782 >> v1:172.21.15.183:6789/0 conn(0x7f7fcc0afe10 legacy=0x7f7fcc15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.026+0000 7f7fd1806640 1 -- 172.21.15.82:0/1417080782 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc0cdb40 con 0x7f7fcc0ad060 2023-07-20T11:06:27.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd1806640 1 --2- 172.21.15.82:0/1417080782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc0ca040 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0c8900 tx=0x7f7fc801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937edf168ed762d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd0804640 1 -- 172.21.15.82:0/1417080782 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80aa650 con 0x7f7fcc0ad060 2023-07-20T11:06:27.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd0804640 1 -- 172.21.15.82:0/1417080782 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80aa7b0 con 0x7f7fcc0ad060 2023-07-20T11:06:27.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd0804640 1 -- 172.21.15.82:0/1417080782 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80aab40 con 0x7f7fcc0ad060 2023-07-20T11:06:27.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/1417080782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 msgr2=0x7f7fcc0ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/1417080782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc0ca040 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0c8900 tx=0x7f7fc801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/1417080782 shutdown_connections 2023-07-20T11:06:27.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/1417080782 >> v2:172.21.15.183:3300/0 conn(0x7f7fcc0b0290 0x7f7fcc15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/1417080782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc0ca040 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/1417080782 >> 172.21.15.82:0/1417080782 conn(0x7f7fcc0cada0 msgr2=0x7f7fcc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/1417080782 shutdown_connections 2023-07-20T11:06:27.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/1417080782 wait complete. 2023-07-20T11:06:27.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 Processor -- start 2023-07-20T11:06:27.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.030+0000 7f7fd3a6a640 1 -- start start 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fcc0afe10 0x7f7fcc0ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fcc0b0290 0x7f7fcc070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc15b950 con 0x7f7fcc0ad060 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc15b0b0 con 0x7f7fcc0b0290 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc15b390 con 0x7f7fcc0afe10 2023-07-20T11:06:27.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47636/0 (socket says 172.21.15.82:47636) 2023-07-20T11:06:27.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 -- 172.21.15.82:0/3275814109 learned_addr learned my addr 172.21.15.82:0/3275814109 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:27.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1005640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fcc0afe10 0x7f7fcc0ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd2007640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fcc0b0290 0x7f7fcc070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 -- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fcc0afe10 msgr2=0x7f7fcc0ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fcc0afe10 0x7f7fcc0ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 -- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fcc0b0290 msgr2=0x7f7fcc070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fcc0b0290 0x7f7fcc070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 -- 172.21.15.82:0/3275814109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc80094d0 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd1806640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80ac040 tx=0x7f7fc801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80b3800 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80b3960 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80b3cd0 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fcc15b670 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fcc155bb0 con 0x7f7fcc0ad060 2023-07-20T11:06:27.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fcc073c70 con 0x7f7fcc0ad060 2023-07-20T11:06:27.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.034+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fc80b2380 con 0x7f7fcc0ad060 2023-07-20T11:06:27.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.038+0000 7f7fc27fc640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 0x7f7fb0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.038+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7fc811e850 con 0x7f7fcc0ad060 2023-07-20T11:06:27.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.038+0000 7f7fd1005640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 0x7f7fb0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.038+0000 7f7fd1005640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 0x7f7fb0068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc156180 tx=0x7f7fbc009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.042+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fc80ebb00 con 0x7f7fcc0ad060 2023-07-20T11:06:27.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.190+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fcc0b2280 con 0x7f7fb00663a0 2023-07-20T11:06:27.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.198+0000 7f7fc27fc640 1 -- 172.21.15.82:0/3275814109 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299638 (secure 0 0 0) 0x7f7fbc0014f0 con 0x7f7fb00663a0 2023-07-20T11:06:27.185 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:06:27.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 msgr2=0x7f7fb0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 0x7f7fb0068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc156180 tx=0x7f7fbc009040 comp rx=0 tx=0).stop 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 msgr2=0x7f7fcc155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f7fc80ac040 tx=0x7f7fc801ad10 comp rx=0 tx=0).stop 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 shutdown_connections 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f7fb00663a0 0x7f7fb0068860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fcc0b0290 0x7f7fcc070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fcc0afe10 0x7f7fcc0ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 --2- 172.21.15.82:0/3275814109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fcc0ad060 0x7f7fcc155670 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 >> 172.21.15.82:0/3275814109 conn(0x7f7fcc0cada0 msgr2=0x7f7fcc163390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 shutdown_connections 2023-07-20T11:06:27.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.202+0000 7f7fd3a6a640 1 -- 172.21.15.82:0/3275814109 wait complete. 2023-07-20T11:06:27.205 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:06:25.979267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379724,"kb_used_data":17640,"kb_used_omap":13,"kb_used_meta":361970,"kb_avail":754594996,"statfs":{"total":773094113280,"available":772705275904,"internally_reserved":0,"allocated":18063360,"data_stored":9763088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":370657368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.852918"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129628+0000","last_change":"2023-07-20T11:06:21.129628+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129628+0000","last_undegraded":"2023-07-20T11:06:21.129628+0000","last_fullsized":"2023-07-20T11:06:21.129628+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135849+0000","last_change":"2023-07-20T11:06:21.135849+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135849+0000","last_undegraded":"2023-07-20T11:06:21.135849+0000","last_fullsized":"2023-07-20T11:06:21.135849+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135226+0000","last_change":"2023-07-20T11:06:21.135226+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135226+0000","last_undegraded":"2023-07-20T11:06:21.135226+0000","last_fullsized":"2023-07-20T11:06:21.135226+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132444+0000","last_change":"2023-07-20T11:06:21.132444+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132444+0000","last_undegraded":"2023-07-20T11:06:21.132444+0000","last_fullsized":"2023-07-20T11:06:21.132444+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134381+0000","last_change":"2023-07-20T11:06:21.134381+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134381+0000","last_undegraded":"2023-07-20T11:06:21.134381+0000","last_fullsized":"2023-07-20T11:06:21.134381+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129600+0000","last_change":"2023-07-20T11:06:21.129600+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129600+0000","last_undegraded":"2023-07-20T11:06:21.129600+0000","last_fullsized":"2023-07-20T11:06:21.129600+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131965+0000","last_change":"2023-07-20T11:06:21.131965+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131965+0000","last_undegraded":"2023-07-20T11:06:21.131965+0000","last_fullsized":"2023-07-20T11:06:21.131965+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.130259+0000","last_change":"2023-07-20T11:06:21.130259+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.130259+0000","last_undegraded":"2023-07-20T11:06:21.130259+0000","last_fullsized":"2023-07-20T11:06:21.130259+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134713+0000","last_change":"2023-07-20T11:06:21.134713+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134713+0000","last_undegraded":"2023-07-20T11:06:21.134713+0000","last_fullsized":"2023-07-20T11:06:21.134713+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135402+0000","last_change":"2023-07-20T11:06:21.135402+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135402+0000","last_undegraded":"2023-07-20T11:06:21.135402+0000","last_fullsized":"2023-07-20T11:06:21.135402+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133522+0000","last_change":"2023-07-20T11:06:21.133522+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133522+0000","last_undegraded":"2023-07-20T11:06:21.133522+0000","last_fullsized":"2023-07-20T11:06:21.133522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133181+0000","last_change":"2023-07-20T11:06:21.133181+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133181+0000","last_undegraded":"2023-07-20T11:06:21.133181+0000","last_fullsized":"2023-07-20T11:06:21.133181+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132231+0000","last_change":"2023-07-20T11:06:21.132231+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132231+0000","last_undegraded":"2023-07-20T11:06:21.132231+0000","last_fullsized":"2023-07-20T11:06:21.132231+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134847+0000","last_change":"2023-07-20T11:06:21.134847+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134847+0000","last_undegraded":"2023-07-20T11:06:21.134847+0000","last_fullsized":"2023-07-20T11:06:21.134847+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132134+0000","last_change":"2023-07-20T11:06:21.132134+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132134+0000","last_undegraded":"2023-07-20T11:06:21.132134+0000","last_fullsized":"2023-07-20T11:06:21.132134+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133013+0000","last_change":"2023-07-20T11:06:21.133013+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133013+0000","last_undegraded":"2023-07-20T11:06:21.133013+0000","last_fullsized":"2023-07-20T11:06:21.133013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133830+0000","last_change":"2023-07-20T11:06:21.133830+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133830+0000","last_undegraded":"2023-07-20T11:06:21.133830+0000","last_fullsized":"2023-07-20T11:06:21.133830+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131282+0000","last_change":"2023-07-20T11:06:21.131282+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131282+0000","last_undegraded":"2023-07-20T11:06:21.131282+0000","last_fullsized":"2023-07-20T11:06:21.131282+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133011+0000","last_change":"2023-07-20T11:06:21.133011+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133011+0000","last_undegraded":"2023-07-20T11:06:21.133011+0000","last_fullsized":"2023-07-20T11:06:21.133011+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129567+0000","last_change":"2023-07-20T11:06:21.129567+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129567+0000","last_undegraded":"2023-07-20T11:06:21.129567+0000","last_fullsized":"2023-07-20T11:06:21.129567+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131435+0000","last_change":"2023-07-20T11:06:21.131435+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131435+0000","last_undegraded":"2023-07-20T11:06:21.131435+0000","last_fullsized":"2023-07-20T11:06:21.131435+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134695+0000","last_change":"2023-07-20T11:06:21.134695+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134695+0000","last_undegraded":"2023-07-20T11:06:21.134695+0000","last_fullsized":"2023-07-20T11:06:21.134695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131302+0000","last_change":"2023-07-20T11:06:21.131302+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131302+0000","last_undegraded":"2023-07-20T11:06:21.131302+0000","last_fullsized":"2023-07-20T11:06:21.131302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135391+0000","last_change":"2023-07-20T11:06:21.135391+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135391+0000","last_undegraded":"2023-07-20T11:06:21.135391+0000","last_fullsized":"2023-07-20T11:06:21.135391+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132189+0000","last_change":"2023-07-20T11:06:21.132189+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132189+0000","last_undegraded":"2023-07-20T11:06:21.132189+0000","last_fullsized":"2023-07-20T11:06:21.132189+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'271","reported_seq":1006,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136782+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:06:21.136782+0000","last_peered":"2023-07-20T11:06:21.136782+0000","last_clean":"2023-07-20T11:06:21.136782+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:06:21.136782+0000","last_undegraded":"2023-07-20T11:06:21.136782+0000","last_fullsized":"2023-07-20T11:06:21.136782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:01:06.082773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132794+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:06:21.132794+0000","last_peered":"2023-07-20T11:06:21.132794+0000","last_clean":"2023-07-20T11:06:21.132794+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:06:21.132794+0000","last_undegraded":"2023-07-20T11:06:21.132794+0000","last_fullsized":"2023-07-20T11:06:21.132794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:34.584817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135233+0000","last_change":"2023-07-20T11:06:21.135233+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135233+0000","last_undegraded":"2023-07-20T11:06:21.135233+0000","last_fullsized":"2023-07-20T11:06:21.135233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136642+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:06:21.136642+0000","last_peered":"2023-07-20T11:06:21.136642+0000","last_clean":"2023-07-20T11:06:21.136642+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:06:21.136642+0000","last_undegraded":"2023-07-20T11:06:21.136642+0000","last_fullsized":"2023-07-20T11:06:21.136642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:21:35.340645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131835+0000","last_change":"2023-07-20T11:06:21.131835+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131835+0000","last_undegraded":"2023-07-20T11:06:21.131835+0000","last_fullsized":"2023-07-20T11:06:21.131835+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":331,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134430+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:06:21.134430+0000","last_peered":"2023-07-20T11:06:21.134430+0000","last_clean":"2023-07-20T11:06:21.134430+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:06:21.134430+0000","last_undegraded":"2023-07-20T11:06:21.134430+0000","last_fullsized":"2023-07-20T11:06:21.134430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:20.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134610+0000","last_change":"2023-07-20T11:06:21.134610+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134610+0000","last_undegraded":"2023-07-20T11:06:21.134610+0000","last_fullsized":"2023-07-20T11:06:21.134610+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132419+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:06:21.132419+0000","last_peered":"2023-07-20T11:06:21.132419+0000","last_clean":"2023-07-20T11:06:21.132419+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:06:21.132419+0000","last_undegraded":"2023-07-20T11:06:21.132419+0000","last_fullsized":"2023-07-20T11:06:21.132419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:31.448023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129524+0000","last_change":"2023-07-20T11:06:21.129524+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129524+0000","last_undegraded":"2023-07-20T11:06:21.129524+0000","last_fullsized":"2023-07-20T11:06:21.129524+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133479+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:06:21.133479+0000","last_peered":"2023-07-20T11:06:21.133479+0000","last_clean":"2023-07-20T11:06:21.133479+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:06:21.133479+0000","last_undegraded":"2023-07-20T11:06:21.133479+0000","last_fullsized":"2023-07-20T11:06:21.133479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:03.798695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133501+0000","last_change":"2023-07-20T11:06:21.133501+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133501+0000","last_undegraded":"2023-07-20T11:06:21.133501+0000","last_fullsized":"2023-07-20T11:06:21.133501+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":303,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136710+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:06:21.136710+0000","last_peered":"2023-07-20T11:06:21.136710+0000","last_clean":"2023-07-20T11:06:21.136710+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:06:21.136710+0000","last_undegraded":"2023-07-20T11:06:21.136710+0000","last_fullsized":"2023-07-20T11:06:21.136710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:00.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132848+0000","last_change":"2023-07-20T11:06:21.132848+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132848+0000","last_undegraded":"2023-07-20T11:06:21.132848+0000","last_fullsized":"2023-07-20T11:06:21.132848+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133500+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:06:21.133500+0000","last_peered":"2023-07-20T11:06:21.133500+0000","last_clean":"2023-07-20T11:06:21.133500+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:06:21.133500+0000","last_undegraded":"2023-07-20T11:06:21.133500+0000","last_fullsized":"2023-07-20T11:06:21.133500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:11.432015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131265+0000","last_change":"2023-07-20T11:06:21.131265+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131265+0000","last_undegraded":"2023-07-20T11:06:21.131265+0000","last_fullsized":"2023-07-20T11:06:21.131265+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":298,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134701+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:06:21.134701+0000","last_peered":"2023-07-20T11:06:21.134701+0000","last_clean":"2023-07-20T11:06:21.134701+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:06:21.134701+0000","last_undegraded":"2023-07-20T11:06:21.134701+0000","last_fullsized":"2023-07-20T11:06:21.134701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:23.945075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95399999999999996,"5min":1.425,"15min":1.425},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"max":{"1min":0.87,"5min":2.306,"15min":2.306},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":2.169,"15min":2.169},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.87,"5min":2.141,"15min":2.141},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.379},"max":{"1min":0.879,"5min":2.206,"15min":2.206},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.60099999999999998,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.93899999999999995,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.98099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41368,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330472,"statfs":{"total":96636764160,"available":96594403328,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.746}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575755,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55320,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316520,"statfs":{"total":96636764160,"available":96580116480,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.63}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59420,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312420,"statfs":{"total":96636764160,"available":96575918080,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.755,"5min":0.89400000000000002,"15min":1.05},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":1.115},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.1919999999999999,"15min":1.202},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.266},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83899999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.052,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.60599999999999998},"max":{"1min":1.0880000000000001,"5min":1.139,"15min":1.3129999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57299999999999995},"max":{"1min":1.147,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.58399999999999996},"max":{"1min":1.048,"5min":1.272,"15min":1.272},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.44}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834575755,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:06:27.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:06:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 Processor -- start 2023-07-20T11:06:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 -- start start 2023-07-20T11:06:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81c006f350 0x7f81c006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 0x7f81c015c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c00cf4a0 con 0x7f81c006b970 2023-07-20T11:06:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c006ea80 con 0x7f81c006f350 2023-07-20T11:06:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c6967640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c00ce890 con 0x7f81c00b2640 2023-07-20T11:06:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81c006f350 0x7f81c006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f81c006f350 0x7f81c006b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47644/0 (socket says 172.21.15.82:47644) 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bf7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f81c006b970 0x7f81c00b1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49006/0 (socket says 172.21.15.82:49006) 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 -- 172.21.15.82:0/264591062 learned_addr learned my addr 172.21.15.82:0/264591062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 -- 172.21.15.82:0/264591062 >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 msgr2=0x7f81c015c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c4f04640 1 --2- 172.21.15.82:0/264591062 >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 0x7f81c015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 --2- 172.21.15.82:0/264591062 >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 0x7f81c015c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81beffd640 1 -- 172.21.15.82:0/264591062 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256060340 0 0) 0x7f81c00cf4a0 con 0x7f81c006b970 2023-07-20T11:06:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 -- 172.21.15.82:0/264591062 >> v1:172.21.15.82:6789/0 conn(0x7f81c006b970 legacy=0x7f81c00b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81bffff640 1 -- 172.21.15.82:0/264591062 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c00ceb70 con 0x7f81c006f350 2023-07-20T11:06:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.402+0000 7f81c4f04640 1 --2- 172.21.15.82:0/264591062 >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 0x7f81c015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81bffff640 1 --2- 172.21.15.82:0/264591062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c006f350 0x7f81c006b430 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f81c00afea0 tx=0x7f81b001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f90fdd991f4171 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81beffd640 1 -- 172.21.15.82:0/264591062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00ab640 con 0x7f81c006f350 2023-07-20T11:06:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81beffd640 1 -- 172.21.15.82:0/264591062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00a7070 con 0x7f81c006f350 2023-07-20T11:06:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81beffd640 1 -- 172.21.15.82:0/264591062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b00ab9c0 con 0x7f81c006f350 2023-07-20T11:06:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 -- 172.21.15.82:0/264591062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c006f350 msgr2=0x7f81c006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 --2- 172.21.15.82:0/264591062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c006f350 0x7f81c006b430 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f81c00afea0 tx=0x7f81b001c440 comp rx=0 tx=0).stop 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 -- 172.21.15.82:0/264591062 shutdown_connections 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 --2- 172.21.15.82:0/264591062 >> v2:172.21.15.183:3300/0 conn(0x7f81c00b2640 0x7f81c015c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 --2- 172.21.15.82:0/264591062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c006f350 0x7f81c006b430 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 -- 172.21.15.82:0/264591062 >> 172.21.15.82:0/264591062 conn(0x7f81c0089fa0 msgr2=0x7f81c00d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 -- 172.21.15.82:0/264591062 shutdown_connections 2023-07-20T11:06:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.406+0000 7f81c6967640 1 -- 172.21.15.82:0/264591062 wait complete. 2023-07-20T11:06:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 Processor -- start 2023-07-20T11:06:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 -- start start 2023-07-20T11:06:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c006b970 0x7f81c0153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c006f350 0x7f81c0158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c0153f40 con 0x7f81c00b2640 2023-07-20T11:06:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c01f5700 con 0x7f81c006f350 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c01f59e0 con 0x7f81c006b970 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47658/0 (socket says 172.21.15.82:47658) 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 -- 172.21.15.82:0/2354464120 learned_addr learned my addr 172.21.15.82:0/2354464120 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81bffff640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c006b970 0x7f81c0153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81bf7fe640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c006f350 0x7f81c0158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 -- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c006b970 msgr2=0x7f81c0153a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c006b970 0x7f81c0153a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 -- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c006f350 msgr2=0x7f81c0158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c006f350 0x7f81c0158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 -- 172.21.15.82:0/2354464120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00094d0 con 0x7f81c00b2640 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c4f04640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f81b800cd50 tx=0x7f81b800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800f680 con 0x7f81c00b2640 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b800f800 con 0x7f81c00b2640 2023-07-20T11:06:27.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b800fbb0 con 0x7f81c00b2640 2023-07-20T11:06:27.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.410+0000 7f81c6967640 1 -- 172.21.15.82:0/2354464120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00cfab0 con 0x7f81c00b2640 2023-07-20T11:06:27.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81c6967640 1 -- 172.21.15.82:0/2354464120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00cc590 con 0x7f81c00b2640 2023-07-20T11:06:27.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c00cf910 con 0x7f81c00b2640 2023-07-20T11:06:27.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81b800b040 con 0x7f81c00b2640 2023-07-20T11:06:27.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81bcff9640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 0x7f81ac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f81b8084920 con 0x7f81c00b2640 2023-07-20T11:06:27.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.414+0000 7f81bffff640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 0x7f81ac068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.418+0000 7f81bffff640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 0x7f81ac068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81b00af000 tx=0x7f81b00b6040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.418+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81c00cf910 con 0x7f81c00b2640 2023-07-20T11:06:27.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.562+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81c006f730 con 0x7f81ac0663a0 2023-07-20T11:06:27.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.570+0000 7f81bcff9640 1 -- 172.21.15.82:0/2354464120 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299638 (secure 0 0 0) 0x7f81b00ab800 con 0x7f81ac0663a0 2023-07-20T11:06:27.557 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:06:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 msgr2=0x7f81ac068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 0x7f81ac068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81b00af000 tx=0x7f81b00b6040 comp rx=0 tx=0).stop 2023-07-20T11:06:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 msgr2=0x7f81c01f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f81b800cd50 tx=0x7f81b800a650 comp rx=0 tx=0).stop 2023-07-20T11:06:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 shutdown_connections 2023-07-20T11:06:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f81ac0663a0 0x7f81ac068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81c00b2640 0x7f81c01f4b90 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81c006f350 0x7f81c0158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 --2- 172.21.15.82:0/2354464120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f81c006b970 0x7f81c0153a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 >> 172.21.15.82:0/2354464120 conn(0x7f81c0089fa0 msgr2=0x7f81c015bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 shutdown_connections 2023-07-20T11:06:27.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.574+0000 7f81a67fc640 1 -- 172.21.15.82:0/2354464120 wait complete. 2023-07-20T11:06:27.579 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:06:25.979267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379724,"kb_used_data":17640,"kb_used_omap":13,"kb_used_meta":361970,"kb_avail":754594996,"statfs":{"total":773094113280,"available":772705275904,"internally_reserved":0,"allocated":18063360,"data_stored":9763088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":370657368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.852918"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129628+0000","last_change":"2023-07-20T11:06:21.129628+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129628+0000","last_undegraded":"2023-07-20T11:06:21.129628+0000","last_fullsized":"2023-07-20T11:06:21.129628+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135849+0000","last_change":"2023-07-20T11:06:21.135849+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135849+0000","last_undegraded":"2023-07-20T11:06:21.135849+0000","last_fullsized":"2023-07-20T11:06:21.135849+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135226+0000","last_change":"2023-07-20T11:06:21.135226+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135226+0000","last_undegraded":"2023-07-20T11:06:21.135226+0000","last_fullsized":"2023-07-20T11:06:21.135226+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132444+0000","last_change":"2023-07-20T11:06:21.132444+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132444+0000","last_undegraded":"2023-07-20T11:06:21.132444+0000","last_fullsized":"2023-07-20T11:06:21.132444+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134381+0000","last_change":"2023-07-20T11:06:21.134381+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134381+0000","last_undegraded":"2023-07-20T11:06:21.134381+0000","last_fullsized":"2023-07-20T11:06:21.134381+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129600+0000","last_change":"2023-07-20T11:06:21.129600+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129600+0000","last_undegraded":"2023-07-20T11:06:21.129600+0000","last_fullsized":"2023-07-20T11:06:21.129600+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131965+0000","last_change":"2023-07-20T11:06:21.131965+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131965+0000","last_undegraded":"2023-07-20T11:06:21.131965+0000","last_fullsized":"2023-07-20T11:06:21.131965+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.130259+0000","last_change":"2023-07-20T11:06:21.130259+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.130259+0000","last_undegraded":"2023-07-20T11:06:21.130259+0000","last_fullsized":"2023-07-20T11:06:21.130259+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134713+0000","last_change":"2023-07-20T11:06:21.134713+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134713+0000","last_undegraded":"2023-07-20T11:06:21.134713+0000","last_fullsized":"2023-07-20T11:06:21.134713+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135402+0000","last_change":"2023-07-20T11:06:21.135402+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135402+0000","last_undegraded":"2023-07-20T11:06:21.135402+0000","last_fullsized":"2023-07-20T11:06:21.135402+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133522+0000","last_change":"2023-07-20T11:06:21.133522+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133522+0000","last_undegraded":"2023-07-20T11:06:21.133522+0000","last_fullsized":"2023-07-20T11:06:21.133522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133181+0000","last_change":"2023-07-20T11:06:21.133181+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133181+0000","last_undegraded":"2023-07-20T11:06:21.133181+0000","last_fullsized":"2023-07-20T11:06:21.133181+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132231+0000","last_change":"2023-07-20T11:06:21.132231+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132231+0000","last_undegraded":"2023-07-20T11:06:21.132231+0000","last_fullsized":"2023-07-20T11:06:21.132231+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134847+0000","last_change":"2023-07-20T11:06:21.134847+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134847+0000","last_undegraded":"2023-07-20T11:06:21.134847+0000","last_fullsized":"2023-07-20T11:06:21.134847+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132134+0000","last_change":"2023-07-20T11:06:21.132134+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132134+0000","last_undegraded":"2023-07-20T11:06:21.132134+0000","last_fullsized":"2023-07-20T11:06:21.132134+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133013+0000","last_change":"2023-07-20T11:06:21.133013+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133013+0000","last_undegraded":"2023-07-20T11:06:21.133013+0000","last_fullsized":"2023-07-20T11:06:21.133013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133830+0000","last_change":"2023-07-20T11:06:21.133830+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133830+0000","last_undegraded":"2023-07-20T11:06:21.133830+0000","last_fullsized":"2023-07-20T11:06:21.133830+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131282+0000","last_change":"2023-07-20T11:06:21.131282+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131282+0000","last_undegraded":"2023-07-20T11:06:21.131282+0000","last_fullsized":"2023-07-20T11:06:21.131282+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133011+0000","last_change":"2023-07-20T11:06:21.133011+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133011+0000","last_undegraded":"2023-07-20T11:06:21.133011+0000","last_fullsized":"2023-07-20T11:06:21.133011+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129567+0000","last_change":"2023-07-20T11:06:21.129567+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129567+0000","last_undegraded":"2023-07-20T11:06:21.129567+0000","last_fullsized":"2023-07-20T11:06:21.129567+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131435+0000","last_change":"2023-07-20T11:06:21.131435+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131435+0000","last_undegraded":"2023-07-20T11:06:21.131435+0000","last_fullsized":"2023-07-20T11:06:21.131435+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134695+0000","last_change":"2023-07-20T11:06:21.134695+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134695+0000","last_undegraded":"2023-07-20T11:06:21.134695+0000","last_fullsized":"2023-07-20T11:06:21.134695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131302+0000","last_change":"2023-07-20T11:06:21.131302+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131302+0000","last_undegraded":"2023-07-20T11:06:21.131302+0000","last_fullsized":"2023-07-20T11:06:21.131302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135391+0000","last_change":"2023-07-20T11:06:21.135391+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135391+0000","last_undegraded":"2023-07-20T11:06:21.135391+0000","last_fullsized":"2023-07-20T11:06:21.135391+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132189+0000","last_change":"2023-07-20T11:06:21.132189+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132189+0000","last_undegraded":"2023-07-20T11:06:21.132189+0000","last_fullsized":"2023-07-20T11:06:21.132189+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'271","reported_seq":1006,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136782+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:06:21.136782+0000","last_peered":"2023-07-20T11:06:21.136782+0000","last_clean":"2023-07-20T11:06:21.136782+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:06:21.136782+0000","last_undegraded":"2023-07-20T11:06:21.136782+0000","last_fullsized":"2023-07-20T11:06:21.136782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:01:06.082773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132794+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:06:21.132794+0000","last_peered":"2023-07-20T11:06:21.132794+0000","last_clean":"2023-07-20T11:06:21.132794+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:06:21.132794+0000","last_undegraded":"2023-07-20T11:06:21.132794+0000","last_fullsized":"2023-07-20T11:06:21.132794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:34.584817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135233+0000","last_change":"2023-07-20T11:06:21.135233+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135233+0000","last_undegraded":"2023-07-20T11:06:21.135233+0000","last_fullsized":"2023-07-20T11:06:21.135233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136642+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:06:21.136642+0000","last_peered":"2023-07-20T11:06:21.136642+0000","last_clean":"2023-07-20T11:06:21.136642+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:06:21.136642+0000","last_undegraded":"2023-07-20T11:06:21.136642+0000","last_fullsized":"2023-07-20T11:06:21.136642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:21:35.340645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131835+0000","last_change":"2023-07-20T11:06:21.131835+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131835+0000","last_undegraded":"2023-07-20T11:06:21.131835+0000","last_fullsized":"2023-07-20T11:06:21.131835+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":331,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134430+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:06:21.134430+0000","last_peered":"2023-07-20T11:06:21.134430+0000","last_clean":"2023-07-20T11:06:21.134430+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:06:21.134430+0000","last_undegraded":"2023-07-20T11:06:21.134430+0000","last_fullsized":"2023-07-20T11:06:21.134430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:20.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134610+0000","last_change":"2023-07-20T11:06:21.134610+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134610+0000","last_undegraded":"2023-07-20T11:06:21.134610+0000","last_fullsized":"2023-07-20T11:06:21.134610+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132419+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:06:21.132419+0000","last_peered":"2023-07-20T11:06:21.132419+0000","last_clean":"2023-07-20T11:06:21.132419+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:06:21.132419+0000","last_undegraded":"2023-07-20T11:06:21.132419+0000","last_fullsized":"2023-07-20T11:06:21.132419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:31.448023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129524+0000","last_change":"2023-07-20T11:06:21.129524+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129524+0000","last_undegraded":"2023-07-20T11:06:21.129524+0000","last_fullsized":"2023-07-20T11:06:21.129524+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133479+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:06:21.133479+0000","last_peered":"2023-07-20T11:06:21.133479+0000","last_clean":"2023-07-20T11:06:21.133479+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:06:21.133479+0000","last_undegraded":"2023-07-20T11:06:21.133479+0000","last_fullsized":"2023-07-20T11:06:21.133479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:03.798695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133501+0000","last_change":"2023-07-20T11:06:21.133501+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133501+0000","last_undegraded":"2023-07-20T11:06:21.133501+0000","last_fullsized":"2023-07-20T11:06:21.133501+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":303,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136710+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:06:21.136710+0000","last_peered":"2023-07-20T11:06:21.136710+0000","last_clean":"2023-07-20T11:06:21.136710+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:06:21.136710+0000","last_undegraded":"2023-07-20T11:06:21.136710+0000","last_fullsized":"2023-07-20T11:06:21.136710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:00.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132848+0000","last_change":"2023-07-20T11:06:21.132848+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132848+0000","last_undegraded":"2023-07-20T11:06:21.132848+0000","last_fullsized":"2023-07-20T11:06:21.132848+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133500+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:06:21.133500+0000","last_peered":"2023-07-20T11:06:21.133500+0000","last_clean":"2023-07-20T11:06:21.133500+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:06:21.133500+0000","last_undegraded":"2023-07-20T11:06:21.133500+0000","last_fullsized":"2023-07-20T11:06:21.133500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:11.432015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131265+0000","last_change":"2023-07-20T11:06:21.131265+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131265+0000","last_undegraded":"2023-07-20T11:06:21.131265+0000","last_fullsized":"2023-07-20T11:06:21.131265+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":298,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134701+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:06:21.134701+0000","last_peered":"2023-07-20T11:06:21.134701+0000","last_clean":"2023-07-20T11:06:21.134701+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:06:21.134701+0000","last_undegraded":"2023-07-20T11:06:21.134701+0000","last_fullsized":"2023-07-20T11:06:21.134701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:23.945075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95399999999999996,"5min":1.425,"15min":1.425},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"max":{"1min":0.87,"5min":2.306,"15min":2.306},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":2.169,"15min":2.169},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.87,"5min":2.141,"15min":2.141},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.379},"max":{"1min":0.879,"5min":2.206,"15min":2.206},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.60099999999999998,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.93899999999999995,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.98099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41368,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330472,"statfs":{"total":96636764160,"available":96594403328,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.746}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575755,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55320,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316520,"statfs":{"total":96636764160,"available":96580116480,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.63}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59420,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312420,"statfs":{"total":96636764160,"available":96575918080,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.755,"5min":0.89400000000000002,"15min":1.05},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":1.115},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.1919999999999999,"15min":1.202},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.266},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83899999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.052,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.60599999999999998},"max":{"1min":1.0880000000000001,"5min":1.139,"15min":1.3129999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57299999999999995},"max":{"1min":1.147,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.58399999999999996},"max":{"1min":1.048,"5min":1.272,"15min":1.272},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.44}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834575755,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:06:27.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:06:27.735 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T11:06:27.750+0000 7f66bee37640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:06:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 Processor -- start 2023-07-20T11:06:27.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 -- start start 2023-07-20T11:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6eb4160fa0 0x7f6eb40c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40cc560 con 0x7f6eb4160bc0 2023-07-20T11:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40ad7e0 con 0x7f6eb40cd830 2023-07-20T11:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6ebbce5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40cc790 con 0x7f6eb4160fa0 2023-07-20T11:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6eb9a81640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f6eb4160bc0 0x7f6eb406c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49008/0 (socket says 172.21.15.82:49008) 2023-07-20T11:06:27.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6eb9a81640 1 -- 172.21.15.82:0/4005396807 learned_addr learned my addr 172.21.15.82:0/4005396807 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:27.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6eb9280640 1 --2- 172.21.15.82:0/4005396807 >> v2:172.21.15.183:3300/0 conn(0x7f6eb4160fa0 0x7f6eb40c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574529532 0 0) 0x7f6eb40cc560 con 0x7f6eb4160bc0 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.774+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea0003530 con 0x7f6eb4160bc0 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3541017541 0 0) 0x7f6ea0003530 con 0x7f6eb4160bc0 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 >> v2:172.21.15.183:3300/0 conn(0x7f6eb4160fa0 msgr2=0x7f6eb40c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 --2- 172.21.15.82:0/4005396807 >> v2:172.21.15.183:3300/0 conn(0x7f6eb4160fa0 0x7f6eb40c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 >> v1:172.21.15.183:6789/0 conn(0x7f6eb40cd830 legacy=0x7f6eb40aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40cca70 con 0x7f6eb4160bc0 2023-07-20T11:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f6eb0001a00 con 0x7f6eb4160bc0 2023-07-20T11:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 >> v1:172.21.15.82:6789/0 conn(0x7f6eb4160bc0 legacy=0x7f6eb406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ea0003980 0x7f6ea0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0004380 0x7f6ea0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 0x7f6ea000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40cc790 con 0x7f6ea0005050 2023-07-20T11:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea000bfb0 con 0x7f6ea0004380 2023-07-20T11:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea000c170 con 0x7f6ea0003980 2023-07-20T11:06:27.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 0x7f6ea000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb9a81640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ea0003980 0x7f6ea0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb9280640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0004380 0x7f6ea0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 -- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ea0003980 msgr2=0x7f6ea0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6ea0003980 0x7f6ea0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 -- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0004380 msgr2=0x7f6ea0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0004380 0x7f6ea0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 -- 172.21.15.82:0/4005396807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0003530 con 0x7f6ea0005050 2023-07-20T11:06:27.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 -- 172.21.15.82:0/4005396807 reap_dead start 2023-07-20T11:06:27.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eba282640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 0x7f6ea000b990 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6eac001910 tx=0x7f6eac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cf0eb638657181 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.778+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0052d0 con 0x7f6ea0005050 2023-07-20T11:06:27.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0a7050 con 0x7f6ea0005050 2023-07-20T11:06:27.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6eb8a7f640 1 -- 172.21.15.82:0/4005396807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac003600 con 0x7f6ea0005050 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 msgr2=0x7f6ea000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 0x7f6ea000b990 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6eac001910 tx=0x7f6eac01c540 comp rx=0 tx=0).stop 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- 172.21.15.82:0/4005396807 shutdown_connections 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/4005396807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ea0005050 0x7f6ea000b990 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- 172.21.15.82:0/4005396807 >> 172.21.15.82:0/4005396807 conn(0x7f6eb40cada0 msgr2=0x7f6eb40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- 172.21.15.82:0/4005396807 shutdown_connections 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- 172.21.15.82:0/4005396807 wait complete. 2023-07-20T11:06:27.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 Processor -- start 2023-07-20T11:06:27.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- start start 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0005050 0x7f6eb4150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 0x7f6eb40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb41614b0 con 0x7f6eb415b430 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb415c720 con 0x7f6ea0005050 2023-07-20T11:06:27.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6ebbce5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb415be80 con 0x7f6eb415b8b0 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6eb9280640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6eb9280640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47676/0 (socket says 172.21.15.82:47676) 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.782+0000 7f6eb9280640 1 -- 172.21.15.82:0/3827904992 learned_addr learned my addr 172.21.15.82:0/3827904992 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9a81640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0005050 0x7f6eb4150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eba282640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 0x7f6eb40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 -- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 msgr2=0x7f6eb40703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 0x7f6eb40703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 -- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0005050 msgr2=0x7f6eb4150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0005050 0x7f6eb4150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 -- 172.21.15.82:0/3827904992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb415c160 con 0x7f6eb415b430 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eba282640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 0x7f6eb40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9280640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4011960 tx=0x7f6ea4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400faf0 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400fc50 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb415c440 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4014440 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4099f00 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb4073c70 con 0x7f6eb415b430 2023-07-20T11:06:27.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ea40145a0 con 0x7f6eb415b430 2023-07-20T11:06:27.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 0x7f6e98068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:27.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f6ea40847e0 con 0x7f6eb415b430 2023-07-20T11:06:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.786+0000 7f6eb9a81640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 0x7f6e98068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.790+0000 7f6eb9a81640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 0x7f6e98068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00013e0 tx=0x7f6eb0001f60 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:27.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.790+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ea4051a60 con 0x7f6eb415b430 2023-07-20T11:06:27.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.934+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6eb415ccf0 con 0x7f6e980663a0 2023-07-20T11:06:27.926 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.942+0000 7f6eaa7fc640 1 -- 172.21.15.82:0/3827904992 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299638 (secure 0 0 0) 0x7f6eb0006d50 con 0x7f6e980663a0 2023-07-20T11:06:27.929 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:27.930 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:06:27.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 msgr2=0x7f6e98068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 0x7f6e98068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00013e0 tx=0x7f6eb0001f60 comp rx=0 tx=0).stop 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 msgr2=0x7f6eb406feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4011960 tx=0x7f6ea4011e20 comp rx=0 tx=0).stop 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 shutdown_connections 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f6e980663a0 0x7f6e98068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6eb415b8b0 0x7f6eb40703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb415b430 0x7f6eb406feb0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 --2- 172.21.15.82:0/3827904992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6ea0005050 0x7f6eb4150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:27.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 >> 172.21.15.82:0/3827904992 conn(0x7f6eb40cada0 msgr2=0x7f6eb406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:27.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 shutdown_connections 2023-07-20T11:06:27.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:27.946+0000 7f6ebbce5640 1 -- 172.21.15.82:0/3827904992 wait complete. 2023-07-20T11:06:27.950 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:06:25.979267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":379724,"kb_used_data":17640,"kb_used_omap":13,"kb_used_meta":361970,"kb_avail":754594996,"statfs":{"total":773094113280,"available":772705275904,"internally_reserved":0,"allocated":18063360,"data_stored":9763088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":370657368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.852918"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129628+0000","last_change":"2023-07-20T11:06:21.129628+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129628+0000","last_undegraded":"2023-07-20T11:06:21.129628+0000","last_fullsized":"2023-07-20T11:06:21.129628+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135849+0000","last_change":"2023-07-20T11:06:21.135849+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135849+0000","last_undegraded":"2023-07-20T11:06:21.135849+0000","last_fullsized":"2023-07-20T11:06:21.135849+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135226+0000","last_change":"2023-07-20T11:06:21.135226+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135226+0000","last_undegraded":"2023-07-20T11:06:21.135226+0000","last_fullsized":"2023-07-20T11:06:21.135226+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132444+0000","last_change":"2023-07-20T11:06:21.132444+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132444+0000","last_undegraded":"2023-07-20T11:06:21.132444+0000","last_fullsized":"2023-07-20T11:06:21.132444+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134381+0000","last_change":"2023-07-20T11:06:21.134381+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134381+0000","last_undegraded":"2023-07-20T11:06:21.134381+0000","last_fullsized":"2023-07-20T11:06:21.134381+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129600+0000","last_change":"2023-07-20T11:06:21.129600+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129600+0000","last_undegraded":"2023-07-20T11:06:21.129600+0000","last_fullsized":"2023-07-20T11:06:21.129600+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131965+0000","last_change":"2023-07-20T11:06:21.131965+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131965+0000","last_undegraded":"2023-07-20T11:06:21.131965+0000","last_fullsized":"2023-07-20T11:06:21.131965+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.130259+0000","last_change":"2023-07-20T11:06:21.130259+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.130259+0000","last_undegraded":"2023-07-20T11:06:21.130259+0000","last_fullsized":"2023-07-20T11:06:21.130259+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134713+0000","last_change":"2023-07-20T11:06:21.134713+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134713+0000","last_undegraded":"2023-07-20T11:06:21.134713+0000","last_fullsized":"2023-07-20T11:06:21.134713+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135402+0000","last_change":"2023-07-20T11:06:21.135402+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135402+0000","last_undegraded":"2023-07-20T11:06:21.135402+0000","last_fullsized":"2023-07-20T11:06:21.135402+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133522+0000","last_change":"2023-07-20T11:06:21.133522+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133522+0000","last_undegraded":"2023-07-20T11:06:21.133522+0000","last_fullsized":"2023-07-20T11:06:21.133522+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133181+0000","last_change":"2023-07-20T11:06:21.133181+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133181+0000","last_undegraded":"2023-07-20T11:06:21.133181+0000","last_fullsized":"2023-07-20T11:06:21.133181+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132231+0000","last_change":"2023-07-20T11:06:21.132231+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132231+0000","last_undegraded":"2023-07-20T11:06:21.132231+0000","last_fullsized":"2023-07-20T11:06:21.132231+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134847+0000","last_change":"2023-07-20T11:06:21.134847+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134847+0000","last_undegraded":"2023-07-20T11:06:21.134847+0000","last_fullsized":"2023-07-20T11:06:21.134847+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132134+0000","last_change":"2023-07-20T11:06:21.132134+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132134+0000","last_undegraded":"2023-07-20T11:06:21.132134+0000","last_fullsized":"2023-07-20T11:06:21.132134+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133013+0000","last_change":"2023-07-20T11:06:21.133013+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133013+0000","last_undegraded":"2023-07-20T11:06:21.133013+0000","last_fullsized":"2023-07-20T11:06:21.133013+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133830+0000","last_change":"2023-07-20T11:06:21.133830+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133830+0000","last_undegraded":"2023-07-20T11:06:21.133830+0000","last_fullsized":"2023-07-20T11:06:21.133830+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131282+0000","last_change":"2023-07-20T11:06:21.131282+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131282+0000","last_undegraded":"2023-07-20T11:06:21.131282+0000","last_fullsized":"2023-07-20T11:06:21.131282+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133011+0000","last_change":"2023-07-20T11:06:21.133011+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133011+0000","last_undegraded":"2023-07-20T11:06:21.133011+0000","last_fullsized":"2023-07-20T11:06:21.133011+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129567+0000","last_change":"2023-07-20T11:06:21.129567+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129567+0000","last_undegraded":"2023-07-20T11:06:21.129567+0000","last_fullsized":"2023-07-20T11:06:21.129567+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131435+0000","last_change":"2023-07-20T11:06:21.131435+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131435+0000","last_undegraded":"2023-07-20T11:06:21.131435+0000","last_fullsized":"2023-07-20T11:06:21.131435+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134695+0000","last_change":"2023-07-20T11:06:21.134695+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134695+0000","last_undegraded":"2023-07-20T11:06:21.134695+0000","last_fullsized":"2023-07-20T11:06:21.134695+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131302+0000","last_change":"2023-07-20T11:06:21.131302+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131302+0000","last_undegraded":"2023-07-20T11:06:21.131302+0000","last_fullsized":"2023-07-20T11:06:21.131302+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135391+0000","last_change":"2023-07-20T11:06:21.135391+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135391+0000","last_undegraded":"2023-07-20T11:06:21.135391+0000","last_fullsized":"2023-07-20T11:06:21.135391+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132189+0000","last_change":"2023-07-20T11:06:21.132189+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132189+0000","last_undegraded":"2023-07-20T11:06:21.132189+0000","last_fullsized":"2023-07-20T11:06:21.132189+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'271","reported_seq":1006,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136782+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:06:21.136782+0000","last_peered":"2023-07-20T11:06:21.136782+0000","last_clean":"2023-07-20T11:06:21.136782+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:06:21.136782+0000","last_undegraded":"2023-07-20T11:06:21.136782+0000","last_fullsized":"2023-07-20T11:06:21.136782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:01:06.082773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132794+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:06:21.132794+0000","last_peered":"2023-07-20T11:06:21.132794+0000","last_clean":"2023-07-20T11:06:21.132794+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:06:21.132794+0000","last_undegraded":"2023-07-20T11:06:21.132794+0000","last_fullsized":"2023-07-20T11:06:21.132794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:34.584817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.135233+0000","last_change":"2023-07-20T11:06:21.135233+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.135233+0000","last_undegraded":"2023-07-20T11:06:21.135233+0000","last_fullsized":"2023-07-20T11:06:21.135233+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":304,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136642+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:06:21.136642+0000","last_peered":"2023-07-20T11:06:21.136642+0000","last_clean":"2023-07-20T11:06:21.136642+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:06:21.136642+0000","last_undegraded":"2023-07-20T11:06:21.136642+0000","last_fullsized":"2023-07-20T11:06:21.136642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:21:35.340645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131835+0000","last_change":"2023-07-20T11:06:21.131835+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131835+0000","last_undegraded":"2023-07-20T11:06:21.131835+0000","last_fullsized":"2023-07-20T11:06:21.131835+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":331,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134430+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:06:21.134430+0000","last_peered":"2023-07-20T11:06:21.134430+0000","last_clean":"2023-07-20T11:06:21.134430+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:06:21.134430+0000","last_undegraded":"2023-07-20T11:06:21.134430+0000","last_fullsized":"2023-07-20T11:06:21.134430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:20.032083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.134610+0000","last_change":"2023-07-20T11:06:21.134610+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.134610+0000","last_undegraded":"2023-07-20T11:06:21.134610+0000","last_fullsized":"2023-07-20T11:06:21.134610+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":339,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.132419+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:06:21.132419+0000","last_peered":"2023-07-20T11:06:21.132419+0000","last_clean":"2023-07-20T11:06:21.132419+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:06:21.132419+0000","last_undegraded":"2023-07-20T11:06:21.132419+0000","last_fullsized":"2023-07-20T11:06:21.132419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:31.448023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.129524+0000","last_change":"2023-07-20T11:06:21.129524+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.129524+0000","last_undegraded":"2023-07-20T11:06:21.129524+0000","last_fullsized":"2023-07-20T11:06:21.129524+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":301,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133479+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:06:21.133479+0000","last_peered":"2023-07-20T11:06:21.133479+0000","last_clean":"2023-07-20T11:06:21.133479+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:06:21.133479+0000","last_undegraded":"2023-07-20T11:06:21.133479+0000","last_fullsized":"2023-07-20T11:06:21.133479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:08:03.798695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.133501+0000","last_change":"2023-07-20T11:06:21.133501+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.133501+0000","last_undegraded":"2023-07-20T11:06:21.133501+0000","last_fullsized":"2023-07-20T11:06:21.133501+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":303,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.136710+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:06:21.136710+0000","last_peered":"2023-07-20T11:06:21.136710+0000","last_clean":"2023-07-20T11:06:21.136710+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:06:21.136710+0000","last_undegraded":"2023-07-20T11:06:21.136710+0000","last_fullsized":"2023-07-20T11:06:21.136710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:25:00.967602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.132848+0000","last_change":"2023-07-20T11:06:21.132848+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.132848+0000","last_undegraded":"2023-07-20T11:06:21.132848+0000","last_fullsized":"2023-07-20T11:06:21.132848+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":300,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.133500+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:06:21.133500+0000","last_peered":"2023-07-20T11:06:21.133500+0000","last_clean":"2023-07-20T11:06:21.133500+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:06:21.133500+0000","last_undegraded":"2023-07-20T11:06:21.133500+0000","last_fullsized":"2023-07-20T11:06:21.133500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:11.432015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:06:22.125957+0000","last_change":"2023-07-20T11:06:22.125957+0000","last_active":"2023-07-20T11:06:22.125957+0000","last_peered":"2023-07-20T11:06:22.125957+0000","last_clean":"2023-07-20T11:06:22.125957+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:22.125957+0000","last_undegraded":"2023-07-20T11:06:22.125957+0000","last_fullsized":"2023-07-20T11:06:22.125957+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":169,"state":"creating+peering","last_fresh":"2023-07-20T11:06:21.131265+0000","last_change":"2023-07-20T11:06:21.131265+0000","last_active":"2023-07-20T11:06:21.114074+0000","last_peered":"2023-07-20T11:06:21.114074+0000","last_clean":"2023-07-20T11:06:21.114074+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:06:21.131265+0000","last_undegraded":"2023-07-20T11:06:21.131265+0000","last_fullsized":"2023-07-20T11:06:21.131265+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":298,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-07-20T11:06:21.134701+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:06:21.134701+0000","last_peered":"2023-07-20T11:06:21.134701+0000","last_clean":"2023-07-20T11:06:21.134701+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:06:21.134701+0000","last_undegraded":"2023-07-20T11:06:21.134701+0000","last_fullsized":"2023-07-20T11:06:21.134701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:23.945075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47708,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324132,"statfs":{"total":96636764160,"available":96587911168,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95399999999999996,"5min":1.425,"15min":1.425},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"max":{"1min":0.87,"5min":2.306,"15min":2.306},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":2.169,"15min":2.169},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.87,"5min":2.141,"15min":2.141},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.93799999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.379},"max":{"1min":0.879,"5min":2.206,"15min":2.206},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.88600000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.60099999999999998,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.93899999999999995,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.98099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575757,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41368,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330472,"statfs":{"total":96636764160,"available":96594403328,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.746}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.71699999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575755,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55320,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316520,"statfs":{"total":96636764160,"available":96580116480,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.63}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.95899999999999996}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.76800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575754,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59420,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312420,"statfs":{"total":96636764160,"available":96575918080,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.47899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.34000000000000002},"max":{"1min":0.69099999999999995,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.502,"15min":0.496},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.72399999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.436},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72599999999999998,"5min":0.93100000000000005,"15min":0.93500000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60699999999999998,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.432,"15min":0.40999999999999998},"max":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86699999999999999},"last":0.90200000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.45800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.456},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.68300000000000005,"5min":0.60899999999999999,"15min":0.56999999999999995},"max":{"1min":1.105,"5min":1.1479999999999999,"15min":1.2989999999999999},"last":0.73799999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.83899999999999997,"15min":0.83799999999999997},"min":{"1min":0.628,"5min":0.61399999999999999,"15min":0.57599999999999996},"max":{"1min":1.0780000000000001,"5min":1.137,"15min":1.381},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.83299999999999996,"15min":0.83799999999999997},"min":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.56499999999999995},"max":{"1min":0.99399999999999999,"5min":1.266,"15min":1.3540000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83899999999999997},"min":{"1min":0.69999999999999996,"5min":0.58099999999999996,"15min":0.54400000000000004},"max":{"1min":1.0860000000000001,"5min":1.2010000000000001,"15min":1.3169999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.55900000000000005},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.202},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84699999999999998,"15min":0.84999999999999998},"min":{"1min":0.70099999999999996,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.0229999999999999,"5min":1.173,"15min":1.4219999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.84499999999999997,"15min":0.84999999999999998},"min":{"1min":0.75600000000000001,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.129,"5min":1.222,"15min":1.246},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59416,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312424,"statfs":{"total":96636764160,"available":96575922176,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.755,"5min":0.89400000000000002,"15min":1.05},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":1.115},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.1919999999999999,"15min":1.202},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.266},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.746},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.3,"15min":1.3},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83899999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.052,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.60599999999999998},"max":{"1min":1.0880000000000001,"5min":1.139,"15min":1.3129999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57299999999999995},"max":{"1min":1.147,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.58399999999999996},"max":{"1min":1.048,"5min":1.272,"15min":1.272},"last":0.61599999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575755,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37272,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334568,"statfs":{"total":96636764160,"available":96598597632,"internally_reserved":0,"allocated":2109440,"data_stored":1072794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.378},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.44}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834575755,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41948,"kb_used_data":2640,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329892,"statfs":{"total":96636764160,"available":96593809408,"internally_reserved":0,"allocated":2703360,"data_stored":1663162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.628,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75800000000000001,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56100000000000005,"15min":0.55400000000000005},"min":{"1min":0.437,"5min":0.41499999999999998,"15min":0.35699999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.33200000000000002},"max":{"1min":0.72399999999999998,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.88300000000000001},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78500000000000003,"15min":0.79600000000000004},"min":{"1min":0.51500000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.304},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.048,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.81200000000000006,"15min":0.81000000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.56999999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.296},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.81399999999999995,"15min":0.83299999999999996},"min":{"1min":0.627,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.141,"5min":1.147,"15min":1.242},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.81699999999999995,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.381},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.155,"5min":1.1970000000000001,"15min":1.306},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.56499999999999995},"max":{"1min":1.1930000000000001,"5min":1.196,"15min":1.2350000000000001},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:06:27.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-07-20T11:06:27.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-07-20T11:06:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-07-20T11:06:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-07-20T11:06:27.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-07-20T11:06:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-07-20T11:06:27.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-07-20T11:06:27.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-07-20T11:06:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-07-20T11:06:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-07-20T11:06:27.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-07-20T11:06:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-07-20T11:06:27.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-07-20T11:06:27.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-07-20T11:06:27.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-07-20T11:06:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-07-20T11:06:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-07-20T11:06:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-07-20T11:06:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-07-20T11:06:27.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-07-20T11:06:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-07-20T11:06:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-07-20T11:06:27.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-07-20T11:06:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-07-20T11:06:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-07-20T11:06:27.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-07-20T11:06:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-07-20T11:06:27.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-07-20T11:06:27.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-07-20T11:06:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-07-20T11:06:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-07-20T11:06:27.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-07-20T11:06:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-07-20T11:06:27.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-07-20T11:06:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.129628+0000', 'last_change': '2023-07-20T11:06:21.129628+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.129628+0000', 'last_undegraded': '2023-07-20T11:06:21.129628+0000', 'last_fullsized': '2023-07-20T11:06:21.129628+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:06:27.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-07-20T11:06:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-07-20T11:06:27.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.135849+0000', 'last_change': '2023-07-20T11:06:21.135849+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.135849+0000', 'last_undegraded': '2023-07-20T11:06:21.135849+0000', 'last_fullsized': '2023-07-20T11:06:21.135849+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:06:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-07-20T11:06:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-07-20T11:06:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.135226+0000', 'last_change': '2023-07-20T11:06:21.135226+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.135226+0000', 'last_undegraded': '2023-07-20T11:06:21.135226+0000', 'last_fullsized': '2023-07-20T11:06:21.135226+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:06:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-07-20T11:06:27.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-07-20T11:06:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.132444+0000', 'last_change': '2023-07-20T11:06:21.132444+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.132444+0000', 'last_undegraded': '2023-07-20T11:06:21.132444+0000', 'last_fullsized': '2023-07-20T11:06:21.132444+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:06:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-07-20T11:06:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-07-20T11:06:27.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.134381+0000', 'last_change': '2023-07-20T11:06:21.134381+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.134381+0000', 'last_undegraded': '2023-07-20T11:06:21.134381+0000', 'last_fullsized': '2023-07-20T11:06:21.134381+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:06:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-07-20T11:06:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-07-20T11:06:27.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.129600+0000', 'last_change': '2023-07-20T11:06:21.129600+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.129600+0000', 'last_undegraded': '2023-07-20T11:06:21.129600+0000', 'last_fullsized': '2023-07-20T11:06:21.129600+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:06:27.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-07-20T11:06:27.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-07-20T11:06:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131965+0000', 'last_change': '2023-07-20T11:06:21.131965+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131965+0000', 'last_undegraded': '2023-07-20T11:06:21.131965+0000', 'last_fullsized': '2023-07-20T11:06:21.131965+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:27.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-07-20T11:06:27.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-07-20T11:06:27.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.130259+0000', 'last_change': '2023-07-20T11:06:21.130259+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.130259+0000', 'last_undegraded': '2023-07-20T11:06:21.130259+0000', 'last_fullsized': '2023-07-20T11:06:21.130259+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:06:27.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-07-20T11:06:27.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-07-20T11:06:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.134713+0000', 'last_change': '2023-07-20T11:06:21.134713+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.134713+0000', 'last_undegraded': '2023-07-20T11:06:21.134713+0000', 'last_fullsized': '2023-07-20T11:06:21.134713+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:06:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-07-20T11:06:27.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-07-20T11:06:27.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.135402+0000', 'last_change': '2023-07-20T11:06:21.135402+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.135402+0000', 'last_undegraded': '2023-07-20T11:06:21.135402+0000', 'last_fullsized': '2023-07-20T11:06:21.135402+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:06:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-07-20T11:06:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-07-20T11:06:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133522+0000', 'last_change': '2023-07-20T11:06:21.133522+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133522+0000', 'last_undegraded': '2023-07-20T11:06:21.133522+0000', 'last_fullsized': '2023-07-20T11:06:21.133522+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:06:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-07-20T11:06:27.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-07-20T11:06:27.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133181+0000', 'last_change': '2023-07-20T11:06:21.133181+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133181+0000', 'last_undegraded': '2023-07-20T11:06:21.133181+0000', 'last_fullsized': '2023-07-20T11:06:21.133181+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:06:27.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-07-20T11:06:27.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-07-20T11:06:27.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.132231+0000', 'last_change': '2023-07-20T11:06:21.132231+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.132231+0000', 'last_undegraded': '2023-07-20T11:06:21.132231+0000', 'last_fullsized': '2023-07-20T11:06:21.132231+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:06:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-07-20T11:06:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-07-20T11:06:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.134847+0000', 'last_change': '2023-07-20T11:06:21.134847+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.134847+0000', 'last_undegraded': '2023-07-20T11:06:21.134847+0000', 'last_fullsized': '2023-07-20T11:06:21.134847+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:06:27.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-07-20T11:06:27.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-07-20T11:06:27.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.132134+0000', 'last_change': '2023-07-20T11:06:21.132134+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.132134+0000', 'last_undegraded': '2023-07-20T11:06:21.132134+0000', 'last_fullsized': '2023-07-20T11:06:21.132134+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:06:27.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-07-20T11:06:27.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:27.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-07-20T11:06:27.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133013+0000', 'last_change': '2023-07-20T11:06:21.133013+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133013+0000', 'last_undegraded': '2023-07-20T11:06:21.133013+0000', 'last_fullsized': '2023-07-20T11:06:21.133013+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:06:28.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-07-20T11:06:28.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-07-20T11:06:28.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133830+0000', 'last_change': '2023-07-20T11:06:21.133830+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133830+0000', 'last_undegraded': '2023-07-20T11:06:21.133830+0000', 'last_fullsized': '2023-07-20T11:06:21.133830+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:06:28.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-07-20T11:06:28.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-07-20T11:06:28.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131282+0000', 'last_change': '2023-07-20T11:06:21.131282+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131282+0000', 'last_undegraded': '2023-07-20T11:06:21.131282+0000', 'last_fullsized': '2023-07-20T11:06:21.131282+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:28.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-07-20T11:06:28.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-07-20T11:06:28.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133011+0000', 'last_change': '2023-07-20T11:06:21.133011+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133011+0000', 'last_undegraded': '2023-07-20T11:06:21.133011+0000', 'last_fullsized': '2023-07-20T11:06:21.133011+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:06:28.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-07-20T11:06:28.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-07-20T11:06:28.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.129567+0000', 'last_change': '2023-07-20T11:06:21.129567+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.129567+0000', 'last_undegraded': '2023-07-20T11:06:21.129567+0000', 'last_fullsized': '2023-07-20T11:06:21.129567+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:06:28.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-07-20T11:06:28.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-07-20T11:06:28.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131435+0000', 'last_change': '2023-07-20T11:06:21.131435+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131435+0000', 'last_undegraded': '2023-07-20T11:06:21.131435+0000', 'last_fullsized': '2023-07-20T11:06:21.131435+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:28.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-07-20T11:06:28.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-07-20T11:06:28.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.134695+0000', 'last_change': '2023-07-20T11:06:21.134695+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.134695+0000', 'last_undegraded': '2023-07-20T11:06:21.134695+0000', 'last_fullsized': '2023-07-20T11:06:21.134695+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:06:28.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-07-20T11:06:28.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-07-20T11:06:28.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131302+0000', 'last_change': '2023-07-20T11:06:21.131302+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131302+0000', 'last_undegraded': '2023-07-20T11:06:21.131302+0000', 'last_fullsized': '2023-07-20T11:06:21.131302+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:28.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-07-20T11:06:28.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-07-20T11:06:28.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.135391+0000', 'last_change': '2023-07-20T11:06:21.135391+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.135391+0000', 'last_undegraded': '2023-07-20T11:06:21.135391+0000', 'last_fullsized': '2023-07-20T11:06:21.135391+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:06:28.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-07-20T11:06:28.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-07-20T11:06:28.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.132189+0000', 'last_change': '2023-07-20T11:06:21.132189+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.132189+0000', 'last_undegraded': '2023-07-20T11:06:21.132189+0000', 'last_fullsized': '2023-07-20T11:06:21.132189+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:06:28.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-07-20T11:06:28.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-07-20T11:06:28.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.135233+0000', 'last_change': '2023-07-20T11:06:21.135233+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.135233+0000', 'last_undegraded': '2023-07-20T11:06:21.135233+0000', 'last_fullsized': '2023-07-20T11:06:21.135233+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:06:28.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-07-20T11:06:28.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-07-20T11:06:28.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131835+0000', 'last_change': '2023-07-20T11:06:21.131835+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131835+0000', 'last_undegraded': '2023-07-20T11:06:21.131835+0000', 'last_fullsized': '2023-07-20T11:06:21.131835+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:28.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-07-20T11:06:28.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-07-20T11:06:28.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.134610+0000', 'last_change': '2023-07-20T11:06:21.134610+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.134610+0000', 'last_undegraded': '2023-07-20T11:06:21.134610+0000', 'last_fullsized': '2023-07-20T11:06:21.134610+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:06:28.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-07-20T11:06:28.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-07-20T11:06:28.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.129524+0000', 'last_change': '2023-07-20T11:06:21.129524+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.129524+0000', 'last_undegraded': '2023-07-20T11:06:21.129524+0000', 'last_fullsized': '2023-07-20T11:06:21.129524+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:06:28.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-07-20T11:06:28.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-07-20T11:06:28.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.133501+0000', 'last_change': '2023-07-20T11:06:21.133501+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.133501+0000', 'last_undegraded': '2023-07-20T11:06:21.133501+0000', 'last_fullsized': '2023-07-20T11:06:21.133501+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:06:28.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-07-20T11:06:28.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-07-20T11:06:28.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.132848+0000', 'last_change': '2023-07-20T11:06:21.132848+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.132848+0000', 'last_undegraded': '2023-07-20T11:06:21.132848+0000', 'last_fullsized': '2023-07-20T11:06:21.132848+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-20T11:06:28.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-07-20T11:06:28.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:06:22.125957+0000', 'last_change': '2023-07-20T11:06:22.125957+0000', 'last_active': '2023-07-20T11:06:22.125957+0000', 'last_peered': '2023-07-20T11:06:22.125957+0000', 'last_clean': '2023-07-20T11:06:22.125957+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:22.125957+0000', 'last_undegraded': '2023-07-20T11:06:22.125957+0000', 'last_fullsized': '2023-07-20T11:06:22.125957+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:22.125957+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:06:28.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-07-20T11:06:28.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 169, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:06:21.131265+0000', 'last_change': '2023-07-20T11:06:21.131265+0000', 'last_active': '2023-07-20T11:06:21.114074+0000', 'last_peered': '2023-07-20T11:06:21.114074+0000', 'last_clean': '2023-07-20T11:06:21.114074+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:06:21.131265+0000', 'last_undegraded': '2023-07-20T11:06:21.131265+0000', 'last_fullsized': '2023-07-20T11:06:21.131265+0000', 'mapping_epoch': 169, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 169, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'last_clean_scrub_stamp': '2023-07-20T11:06:21.114074+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:06:28.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T11:06:28.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.178+0000 7fabdf096640 1 Processor -- start 2023-07-20T11:06:28.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.178+0000 7fabdf096640 1 -- start start 2023-07-20T11:06:28.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdf096640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabd80d0d10 0x7fabd80d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdf096640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd80d16b0 con 0x7fabd80cd4b0 2023-07-20T11:06:28.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdf096640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd80b3520 con 0x7fabd815cab0 2023-07-20T11:06:28.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdf096640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80d31c0 con 0x7fabd80d0d10 2023-07-20T11:06:28.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fabd80d0d10 0x7fabd80d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdd633640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fabd80cd4b0 0x7fabd80cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49024/0 (socket says 172.21.15.82:49024) 2023-07-20T11:06:28.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabdd633640 1 -- 172.21.15.82:0/1859974644 learned_addr learned my addr 172.21.15.82:0/1859974644 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:28.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcffff640 1 -- 172.21.15.82:0/1859974644 >> v1:172.21.15.183:6789/0 conn(0x7fabd815cab0 legacy=0x7fabd80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcffff640 1 -- 172.21.15.82:0/1859974644 >> v1:172.21.15.82:6789/0 conn(0x7fabd80cd4b0 legacy=0x7fabd80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcf7fe640 1 -- 172.21.15.82:0/1859974644 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999676182 0 0) 0x7fabd80d16b0 con 0x7fabd80cd4b0 2023-07-20T11:06:28.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcffff640 1 -- 172.21.15.82:0/1859974644 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80d0a10 con 0x7fabd80d0d10 2023-07-20T11:06:28.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.182+0000 7fabcffff640 1 --2- 172.21.15.82:0/1859974644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd80d0d10 0x7fabd80d1170 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fabc80097c0 tx=0x7fabc801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be799c67ca333ea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabcf7fe640 1 -- 172.21.15.82:0/1859974644 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8004230 con 0x7fabd80d0d10 2023-07-20T11:06:28.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabcf7fe640 1 -- 172.21.15.82:0/1859974644 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc80a7050 con 0x7fabd80d0d10 2023-07-20T11:06:28.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabcf7fe640 1 -- 172.21.15.82:0/1859974644 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8003620 con 0x7fabd80d0d10 2023-07-20T11:06:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- 172.21.15.82:0/1859974644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd80d0d10 msgr2=0x7fabd80d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 --2- 172.21.15.82:0/1859974644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd80d0d10 0x7fabd80d1170 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fabc80097c0 tx=0x7fabc801c450 comp rx=0 tx=0).stop 2023-07-20T11:06:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- 172.21.15.82:0/1859974644 shutdown_connections 2023-07-20T11:06:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 --2- 172.21.15.82:0/1859974644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd80d0d10 0x7fabd80d1170 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- 172.21.15.82:0/1859974644 >> 172.21.15.82:0/1859974644 conn(0x7fabd808c120 msgr2=0x7fabd809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- 172.21.15.82:0/1859974644 shutdown_connections 2023-07-20T11:06:28.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- 172.21.15.82:0/1859974644 wait complete. 2023-07-20T11:06:28.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 Processor -- start 2023-07-20T11:06:28.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.186+0000 7fabdf096640 1 -- start start 2023-07-20T11:06:28.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd80cd4b0 0x7fabd80c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd80d0d10 0x7fabd815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b69c0 con 0x7fabd815cab0 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80c77f0 con 0x7fabd80cd4b0 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80c7a70 con 0x7fabd80d0d10 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47700/0 (socket says 172.21.15.82:47700) 2023-07-20T11:06:28.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 -- 172.21.15.82:0/1608582016 learned_addr learned my addr 172.21.15.82:0/1608582016 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabcffff640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd80d0d10 0x7fabd815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdce32640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd80cd4b0 0x7fabd80c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 -- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd80d0d10 msgr2=0x7fabd815f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd80d0d10 0x7fabd815f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 -- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd80cd4b0 msgr2=0x7fabd80c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd80cd4b0 0x7fabd80c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 -- 172.21.15.82:0/1608582016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009420 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdd633640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c3c0 tx=0x7fabd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00074e0 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0007640 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0004a30 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd80c7d50 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd80b6bd0 con 0x7fabd815cab0 2023-07-20T11:06:28.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.190+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd80c8270 con 0x7fabd815cab0 2023-07-20T11:06:28.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.194+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fabd0004b90 con 0x7fabd815cab0 2023-07-20T11:06:28.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.194+0000 7fabcd7fa640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 0x7fabc4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.194+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fabd0083b10 con 0x7fabd815cab0 2023-07-20T11:06:28.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.194+0000 7fabdce32640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 0x7fabc4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.194+0000 7fabdce32640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 0x7fabc4068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabd40012f0 tx=0x7fabd4009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.198+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabd80c8270 con 0x7fabd815cab0 2023-07-20T11:06:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.398+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fabd80c8270 con 0x7fabd815cab0 2023-07-20T11:06:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.398+0000 7fabcd7fa640 1 -- 172.21.15.82:0/1608582016 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7fabd80c8270 con 0x7fabd815cab0 2023-07-20T11:06:28.382 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:28.382 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4587,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":172,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":389201920,"bytes_avail":772704911360,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":82,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":10167}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-20T10:55:43.575257+0000","services":{}},"progress_events":{}} 2023-07-20T11:06:28.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 msgr2=0x7fabc4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 0x7fabc4068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabd40012f0 tx=0x7fabd4009040 comp rx=0 tx=0).stop 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 msgr2=0x7fabd80b70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c3c0 tx=0x7fabd000c880 comp rx=0 tx=0).stop 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 shutdown_connections 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fabc40663d0 0x7fabc4068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabd815cab0 0x7fabd80b70f0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fabd80d0d10 0x7fabd815f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 --2- 172.21.15.82:0/1608582016 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd80cd4b0 0x7fabd80c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 >> 172.21.15.82:0/1608582016 conn(0x7fabd808c120 msgr2=0x7fabd80af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 shutdown_connections 2023-07-20T11:06:28.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.402+0000 7fabdf096640 1 -- 172.21.15.82:0/1608582016 wait complete. 2023-07-20T11:06:28.404 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T11:06:28.404 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:06:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.558+0000 7f65782ec640 1 Processor -- start 2023-07-20T11:06:28.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.558+0000 7f65782ec640 1 -- start start 2023-07-20T11:06:28.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f65782ec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f657015a8e0 0x7f65700ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f65782ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700b12a0 con 0x7f65700afda0 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f65782ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65700b1580 con 0x7f65700b2060 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f65782ec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65700b3160 con 0x7f657015a8e0 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f657015a8e0 0x7f65700ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f657015a8e0 0x7f65700ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47702/0 (socket says 172.21.15.82:47702) 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 -- 172.21.15.82:0/2975288619 learned_addr learned my addr 172.21.15.82:0/2975288619 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:28.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 -- 172.21.15.82:0/2975288619 >> v1:172.21.15.183:6789/0 conn(0x7f65700b2060 legacy=0x7f65700b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:28.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 -- 172.21.15.82:0/2975288619 >> v1:172.21.15.82:6789/0 conn(0x7f65700afda0 legacy=0x7f65700b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575887640 1 -- 172.21.15.82:0/2975288619 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65700b1860 con 0x7f657015a8e0 2023-07-20T11:06:28.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.562+0000 7f6575086640 1 -- 172.21.15.82:0/2975288619 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054029654 0 0) 0x7f65700b12a0 con 0x7f65700afda0 2023-07-20T11:06:28.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f6575887640 1 --2- 172.21.15.82:0/2975288619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f657015a8e0 0x7f65700ca6b0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f6560009870 tx=0x7f656001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f24bc81ed19900 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f6575086640 1 -- 172.21.15.82:0/2975288619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600ab600 con 0x7f657015a8e0 2023-07-20T11:06:28.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f6575086640 1 -- 172.21.15.82:0/2975288619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65600a7050 con 0x7f657015a8e0 2023-07-20T11:06:28.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f6575086640 1 -- 172.21.15.82:0/2975288619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600ab980 con 0x7f657015a8e0 2023-07-20T11:06:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- 172.21.15.82:0/2975288619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f657015a8e0 msgr2=0x7f65700ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 --2- 172.21.15.82:0/2975288619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f657015a8e0 0x7f65700ca6b0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f6560009870 tx=0x7f656001c3f0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- 172.21.15.82:0/2975288619 shutdown_connections 2023-07-20T11:06:28.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 --2- 172.21.15.82:0/2975288619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f657015a8e0 0x7f65700ca6b0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- 172.21.15.82:0/2975288619 >> 172.21.15.82:0/2975288619 conn(0x7f65700cada0 msgr2=0x7f65700cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- 172.21.15.82:0/2975288619 shutdown_connections 2023-07-20T11:06:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- 172.21.15.82:0/2975288619 wait complete. 2023-07-20T11:06:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 Processor -- start 2023-07-20T11:06:28.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.566+0000 7f65782ec640 1 -- start start 2023-07-20T11:06:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 0x7f657009ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f657015a8e0 0x7f65701f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65701552e0 con 0x7f65700b2060 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657015db20 con 0x7f657015a8e0 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657009b370 con 0x7f65700afda0 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47716/0 (socket says 172.21.15.82:47716) 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 -- 172.21.15.82:0/2825861907 learned_addr learned my addr 172.21.15.82:0/2825861907 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6576889640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f657015a8e0 0x7f65701f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6576088640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 0x7f657009ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 -- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 msgr2=0x7f657009ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 0x7f657009ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 -- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f657015a8e0 msgr2=0x7f65701f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f657015a8e0 0x7f65701f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 -- 172.21.15.82:0/2825861907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65600094d0 con 0x7f65700b2060 2023-07-20T11:06:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6576088640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 0x7f657009ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6575887640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f65600ae040 tx=0x7f6560019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600b6620 con 0x7f65700b2060 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65600b6780 con 0x7f65700b2060 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65600b6b30 con 0x7f65700b2060 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65700c6a40 con 0x7f65700b2060 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65700c7000 con 0x7f65700b2060 2023-07-20T11:06:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6570073c70 con 0x7f65700b2060 2023-07-20T11:06:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.570+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65600b2040 con 0x7f65700b2060 2023-07-20T11:06:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.574+0000 7f6566ffd640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 0x7f6554068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.574+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f656011e330 con 0x7f65700b2060 2023-07-20T11:06:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.574+0000 7f6576088640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 0x7f6554068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.574+0000 7f6576088640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 0x7f6554068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f656c000f70 tx=0x7f656c009040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.578+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65600eb660 con 0x7f65700b2060 2023-07-20T11:06:28.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.718+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65700cb990 con 0x7f65540663a0 2023-07-20T11:06:28.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.726+0000 7f6566ffd640 1 -- 172.21.15.82:0/2825861907 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311752 (secure 0 0 0) 0x7f65700cb990 con 0x7f65540663a0 2023-07-20T11:06:28.714 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:06:28.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 msgr2=0x7f6554068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 0x7f6554068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f656c000f70 tx=0x7f656c009040 comp rx=0 tx=0).stop 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 msgr2=0x7f65700c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f65600ae040 tx=0x7f6560019190 comp rx=0 tx=0).stop 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 shutdown_connections 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f65540663a0 0x7f6554068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f657015a8e0 0x7f65701f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65700b2060 0x7f65700c7ae0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 --2- 172.21.15.82:0/2825861907 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f65700afda0 0x7f657009ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:28.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 >> 172.21.15.82:0/2825861907 conn(0x7f65700cada0 msgr2=0x7f6570072790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:28.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 shutdown_connections 2023-07-20T11:06:28.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:28.730+0000 7f65782ec640 1 -- 172.21.15.82:0/2825861907 wait complete. 2023-07-20T11:06:28.733 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T11:06:27.979778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":380080,"kb_used_data":17992,"kb_used_omap":13,"kb_used_meta":361970,"kb_avail":754594640,"statfs":{"total":773094113280,"available":772704911360,"internally_reserved":0,"allocated":18423808,"data_stored":9932812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":370657368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001278"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143697+0000","last_change":"2023-07-20T11:06:23.168082+0000","last_active":"2023-07-20T11:06:24.143697+0000","last_peered":"2023-07-20T11:06:24.143697+0000","last_clean":"2023-07-20T11:06:24.143697+0000","last_became_active":"2023-07-20T11:06:23.167754+0000","last_became_peered":"2023-07-20T11:06:23.167754+0000","last_unstale":"2023-07-20T11:06:24.143697+0000","last_undegraded":"2023-07-20T11:06:24.143697+0000","last_fullsized":"2023-07-20T11:06:24.143697+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:51.346919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825512+0000","last_change":"2023-07-20T11:06:23.162569+0000","last_active":"2023-07-20T11:06:25.825512+0000","last_peered":"2023-07-20T11:06:25.825512+0000","last_clean":"2023-07-20T11:06:25.825512+0000","last_became_active":"2023-07-20T11:06:23.162067+0000","last_became_peered":"2023-07-20T11:06:23.162067+0000","last_unstale":"2023-07-20T11:06:25.825512+0000","last_undegraded":"2023-07-20T11:06:25.825512+0000","last_fullsized":"2023-07-20T11:06:25.825512+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:22:45.865668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825252+0000","last_change":"2023-07-20T11:06:23.168445+0000","last_active":"2023-07-20T11:06:25.825252+0000","last_peered":"2023-07-20T11:06:25.825252+0000","last_clean":"2023-07-20T11:06:25.825252+0000","last_became_active":"2023-07-20T11:06:23.168174+0000","last_became_peered":"2023-07-20T11:06:23.168174+0000","last_unstale":"2023-07-20T11:06:25.825252+0000","last_undegraded":"2023-07-20T11:06:25.825252+0000","last_fullsized":"2023-07-20T11:06:25.825252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:42:00.363758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942869+0000","last_change":"2023-07-20T11:06:23.153389+0000","last_active":"2023-07-20T11:06:24.942869+0000","last_peered":"2023-07-20T11:06:24.942869+0000","last_clean":"2023-07-20T11:06:24.942869+0000","last_became_active":"2023-07-20T11:06:23.153046+0000","last_became_peered":"2023-07-20T11:06:23.153046+0000","last_unstale":"2023-07-20T11:06:24.942869+0000","last_undegraded":"2023-07-20T11:06:24.942869+0000","last_fullsized":"2023-07-20T11:06:24.942869+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:24:17.618719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140590+0000","last_change":"2023-07-20T11:06:23.148064+0000","last_active":"2023-07-20T11:06:24.140590+0000","last_peered":"2023-07-20T11:06:24.140590+0000","last_clean":"2023-07-20T11:06:24.140590+0000","last_became_active":"2023-07-20T11:06:23.147812+0000","last_became_peered":"2023-07-20T11:06:23.147812+0000","last_unstale":"2023-07-20T11:06:24.140590+0000","last_undegraded":"2023-07-20T11:06:24.140590+0000","last_fullsized":"2023-07-20T11:06:24.140590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:46.663875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140730+0000","last_change":"2023-07-20T11:06:23.146803+0000","last_active":"2023-07-20T11:06:24.140730+0000","last_peered":"2023-07-20T11:06:24.140730+0000","last_clean":"2023-07-20T11:06:24.140730+0000","last_became_active":"2023-07-20T11:06:23.146525+0000","last_became_peered":"2023-07-20T11:06:23.146525+0000","last_unstale":"2023-07-20T11:06:24.140730+0000","last_undegraded":"2023-07-20T11:06:24.140730+0000","last_fullsized":"2023-07-20T11:06:24.140730+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:19:17.778177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143484+0000","last_change":"2023-07-20T11:06:23.151734+0000","last_active":"2023-07-20T11:06:24.143484+0000","last_peered":"2023-07-20T11:06:24.143484+0000","last_clean":"2023-07-20T11:06:24.143484+0000","last_became_active":"2023-07-20T11:06:23.151403+0000","last_became_peered":"2023-07-20T11:06:23.151403+0000","last_unstale":"2023-07-20T11:06:24.143484+0000","last_undegraded":"2023-07-20T11:06:24.143484+0000","last_fullsized":"2023-07-20T11:06:24.143484+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:54.246475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143549+0000","last_change":"2023-07-20T11:06:23.174196+0000","last_active":"2023-07-20T11:06:24.143549+0000","last_peered":"2023-07-20T11:06:24.143549+0000","last_clean":"2023-07-20T11:06:24.143549+0000","last_became_active":"2023-07-20T11:06:23.173805+0000","last_became_peered":"2023-07-20T11:06:23.173805+0000","last_unstale":"2023-07-20T11:06:24.143549+0000","last_undegraded":"2023-07-20T11:06:24.143549+0000","last_fullsized":"2023-07-20T11:06:24.143549+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:08:17.447552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140345+0000","last_change":"2023-07-20T11:06:23.158491+0000","last_active":"2023-07-20T11:06:24.140345+0000","last_peered":"2023-07-20T11:06:24.140345+0000","last_clean":"2023-07-20T11:06:24.140345+0000","last_became_active":"2023-07-20T11:06:23.158188+0000","last_became_peered":"2023-07-20T11:06:23.158188+0000","last_unstale":"2023-07-20T11:06:24.140345+0000","last_undegraded":"2023-07-20T11:06:24.140345+0000","last_fullsized":"2023-07-20T11:06:24.140345+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:24.209289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140750+0000","last_change":"2023-07-20T11:06:23.146577+0000","last_active":"2023-07-20T11:06:24.140750+0000","last_peered":"2023-07-20T11:06:24.140750+0000","last_clean":"2023-07-20T11:06:24.140750+0000","last_became_active":"2023-07-20T11:06:23.146285+0000","last_became_peered":"2023-07-20T11:06:23.146285+0000","last_unstale":"2023-07-20T11:06:24.140750+0000","last_undegraded":"2023-07-20T11:06:24.140750+0000","last_fullsized":"2023-07-20T11:06:24.140750+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:03:32.656748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824735+0000","last_change":"2023-07-20T11:06:23.165743+0000","last_active":"2023-07-20T11:06:25.824735+0000","last_peered":"2023-07-20T11:06:25.824735+0000","last_clean":"2023-07-20T11:06:25.824735+0000","last_became_active":"2023-07-20T11:06:23.165472+0000","last_became_peered":"2023-07-20T11:06:23.165472+0000","last_unstale":"2023-07-20T11:06:25.824735+0000","last_undegraded":"2023-07-20T11:06:25.824735+0000","last_fullsized":"2023-07-20T11:06:25.824735+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:07:32.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942925+0000","last_change":"2023-07-20T11:06:23.169657+0000","last_active":"2023-07-20T11:06:24.942925+0000","last_peered":"2023-07-20T11:06:24.942925+0000","last_clean":"2023-07-20T11:06:24.942925+0000","last_became_active":"2023-07-20T11:06:23.169316+0000","last_became_peered":"2023-07-20T11:06:23.169316+0000","last_unstale":"2023-07-20T11:06:24.942925+0000","last_undegraded":"2023-07-20T11:06:24.942925+0000","last_fullsized":"2023-07-20T11:06:24.942925+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:25:18.583338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140452+0000","last_change":"2023-07-20T11:06:23.148006+0000","last_active":"2023-07-20T11:06:24.140452+0000","last_peered":"2023-07-20T11:06:24.140452+0000","last_clean":"2023-07-20T11:06:24.140452+0000","last_became_active":"2023-07-20T11:06:23.147507+0000","last_became_peered":"2023-07-20T11:06:23.147507+0000","last_unstale":"2023-07-20T11:06:24.140452+0000","last_undegraded":"2023-07-20T11:06:24.140452+0000","last_fullsized":"2023-07-20T11:06:24.140452+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:13:30.493056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942737+0000","last_change":"2023-07-20T11:06:23.170578+0000","last_active":"2023-07-20T11:06:24.942737+0000","last_peered":"2023-07-20T11:06:24.942737+0000","last_clean":"2023-07-20T11:06:24.942737+0000","last_became_active":"2023-07-20T11:06:23.170252+0000","last_became_peered":"2023-07-20T11:06:23.170252+0000","last_unstale":"2023-07-20T11:06:24.942737+0000","last_undegraded":"2023-07-20T11:06:24.942737+0000","last_fullsized":"2023-07-20T11:06:24.942737+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:05:45.725065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824611+0000","last_change":"2023-07-20T11:06:23.167189+0000","last_active":"2023-07-20T11:06:25.824611+0000","last_peered":"2023-07-20T11:06:25.824611+0000","last_clean":"2023-07-20T11:06:25.824611+0000","last_became_active":"2023-07-20T11:06:23.166931+0000","last_became_peered":"2023-07-20T11:06:23.166931+0000","last_unstale":"2023-07-20T11:06:25.824611+0000","last_undegraded":"2023-07-20T11:06:25.824611+0000","last_fullsized":"2023-07-20T11:06:25.824611+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:06:03.661250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140098+0000","last_change":"2023-07-20T11:06:23.175410+0000","last_active":"2023-07-20T11:06:24.140098+0000","last_peered":"2023-07-20T11:06:24.140098+0000","last_clean":"2023-07-20T11:06:24.140098+0000","last_became_active":"2023-07-20T11:06:23.175100+0000","last_became_peered":"2023-07-20T11:06:23.175100+0000","last_unstale":"2023-07-20T11:06:24.140098+0000","last_undegraded":"2023-07-20T11:06:24.140098+0000","last_fullsized":"2023-07-20T11:06:24.140098+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:23:58.717427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943215+0000","last_change":"2023-07-20T11:06:23.152701+0000","last_active":"2023-07-20T11:06:24.943215+0000","last_peered":"2023-07-20T11:06:24.943215+0000","last_clean":"2023-07-20T11:06:24.943215+0000","last_became_active":"2023-07-20T11:06:23.152421+0000","last_became_peered":"2023-07-20T11:06:23.152421+0000","last_unstale":"2023-07-20T11:06:24.943215+0000","last_undegraded":"2023-07-20T11:06:24.943215+0000","last_fullsized":"2023-07-20T11:06:24.943215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:42:54.581410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824995+0000","last_change":"2023-07-20T11:06:23.156733+0000","last_active":"2023-07-20T11:06:25.824995+0000","last_peered":"2023-07-20T11:06:25.824995+0000","last_clean":"2023-07-20T11:06:25.824995+0000","last_became_active":"2023-07-20T11:06:23.156290+0000","last_became_peered":"2023-07-20T11:06:23.156290+0000","last_unstale":"2023-07-20T11:06:25.824995+0000","last_undegraded":"2023-07-20T11:06:25.824995+0000","last_fullsized":"2023-07-20T11:06:25.824995+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:12:33.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351700+0000","last_change":"2023-07-20T11:06:23.175694+0000","last_active":"2023-07-20T11:06:24.351700+0000","last_peered":"2023-07-20T11:06:24.351700+0000","last_clean":"2023-07-20T11:06:24.351700+0000","last_became_active":"2023-07-20T11:06:23.175137+0000","last_became_peered":"2023-07-20T11:06:23.175137+0000","last_unstale":"2023-07-20T11:06:24.351700+0000","last_undegraded":"2023-07-20T11:06:24.351700+0000","last_fullsized":"2023-07-20T11:06:24.351700+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:11:35.071244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824646+0000","last_change":"2023-07-20T11:06:23.164097+0000","last_active":"2023-07-20T11:06:25.824646+0000","last_peered":"2023-07-20T11:06:25.824646+0000","last_clean":"2023-07-20T11:06:25.824646+0000","last_became_active":"2023-07-20T11:06:23.163805+0000","last_became_peered":"2023-07-20T11:06:23.163805+0000","last_unstale":"2023-07-20T11:06:25.824646+0000","last_undegraded":"2023-07-20T11:06:25.824646+0000","last_fullsized":"2023-07-20T11:06:25.824646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:47:31.148967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140542+0000","last_change":"2023-07-20T11:06:23.159905+0000","last_active":"2023-07-20T11:06:24.140542+0000","last_peered":"2023-07-20T11:06:24.140542+0000","last_clean":"2023-07-20T11:06:24.140542+0000","last_became_active":"2023-07-20T11:06:23.159646+0000","last_became_peered":"2023-07-20T11:06:23.159646+0000","last_unstale":"2023-07-20T11:06:24.140542+0000","last_undegraded":"2023-07-20T11:06:24.140542+0000","last_fullsized":"2023-07-20T11:06:24.140542+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:04.916599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143690+0000","last_change":"2023-07-20T11:06:23.151330+0000","last_active":"2023-07-20T11:06:24.143690+0000","last_peered":"2023-07-20T11:06:24.143690+0000","last_clean":"2023-07-20T11:06:24.143690+0000","last_became_active":"2023-07-20T11:06:23.151026+0000","last_became_peered":"2023-07-20T11:06:23.151026+0000","last_unstale":"2023-07-20T11:06:24.143690+0000","last_undegraded":"2023-07-20T11:06:24.143690+0000","last_fullsized":"2023-07-20T11:06:24.143690+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:14.555703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144263+0000","last_change":"2023-07-20T11:06:23.170024+0000","last_active":"2023-07-20T11:06:24.144263+0000","last_peered":"2023-07-20T11:06:24.144263+0000","last_clean":"2023-07-20T11:06:24.144263+0000","last_became_active":"2023-07-20T11:06:23.169683+0000","last_became_peered":"2023-07-20T11:06:23.169683+0000","last_unstale":"2023-07-20T11:06:24.144263+0000","last_undegraded":"2023-07-20T11:06:24.144263+0000","last_fullsized":"2023-07-20T11:06:24.144263+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:12.859226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824246+0000","last_change":"2023-07-20T11:06:23.165896+0000","last_active":"2023-07-20T11:06:25.824246+0000","last_peered":"2023-07-20T11:06:25.824246+0000","last_clean":"2023-07-20T11:06:25.824246+0000","last_became_active":"2023-07-20T11:06:23.165593+0000","last_became_peered":"2023-07-20T11:06:23.165593+0000","last_unstale":"2023-07-20T11:06:25.824246+0000","last_undegraded":"2023-07-20T11:06:25.824246+0000","last_fullsized":"2023-07-20T11:06:25.824246+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:56.231773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144498+0000","last_change":"2023-07-20T11:06:23.149148+0000","last_active":"2023-07-20T11:06:24.144498+0000","last_peered":"2023-07-20T11:06:24.144498+0000","last_clean":"2023-07-20T11:06:24.144498+0000","last_became_active":"2023-07-20T11:06:23.148841+0000","last_became_peered":"2023-07-20T11:06:23.148841+0000","last_unstale":"2023-07-20T11:06:24.144498+0000","last_undegraded":"2023-07-20T11:06:24.144498+0000","last_fullsized":"2023-07-20T11:06:24.144498+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:15.357594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144252+0000","last_change":"2023-07-20T11:06:23.151972+0000","last_active":"2023-07-20T11:06:24.144252+0000","last_peered":"2023-07-20T11:06:24.144252+0000","last_clean":"2023-07-20T11:06:24.144252+0000","last_became_active":"2023-07-20T11:06:23.151635+0000","last_became_peered":"2023-07-20T11:06:23.151635+0000","last_unstale":"2023-07-20T11:06:24.144252+0000","last_undegraded":"2023-07-20T11:06:24.144252+0000","last_fullsized":"2023-07-20T11:06:24.144252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:12.023783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140634+0000","last_change":"2023-07-20T11:06:23.158753+0000","last_active":"2023-07-20T11:06:24.140634+0000","last_peered":"2023-07-20T11:06:24.140634+0000","last_clean":"2023-07-20T11:06:24.140634+0000","last_became_active":"2023-07-20T11:06:23.158473+0000","last_became_peered":"2023-07-20T11:06:23.158473+0000","last_unstale":"2023-07-20T11:06:24.140634+0000","last_undegraded":"2023-07-20T11:06:24.140634+0000","last_fullsized":"2023-07-20T11:06:24.140634+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:37:12.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824515+0000","last_change":"2023-07-20T11:06:23.155472+0000","last_active":"2023-07-20T11:06:25.824515+0000","last_peered":"2023-07-20T11:06:25.824515+0000","last_clean":"2023-07-20T11:06:25.824515+0000","last_became_active":"2023-07-20T11:06:23.155143+0000","last_became_peered":"2023-07-20T11:06:23.155143+0000","last_unstale":"2023-07-20T11:06:25.824515+0000","last_undegraded":"2023-07-20T11:06:25.824515+0000","last_fullsized":"2023-07-20T11:06:25.824515+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:56.394136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144848+0000","last_change":"2023-07-20T11:06:23.172784+0000","last_active":"2023-07-20T11:06:24.144848+0000","last_peered":"2023-07-20T11:06:24.144848+0000","last_clean":"2023-07-20T11:06:24.144848+0000","last_became_active":"2023-07-20T11:06:23.172409+0000","last_became_peered":"2023-07-20T11:06:23.172409+0000","last_unstale":"2023-07-20T11:06:24.144848+0000","last_undegraded":"2023-07-20T11:06:24.144848+0000","last_fullsized":"2023-07-20T11:06:24.144848+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:46:49.168324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824475+0000","last_change":"2023-07-20T11:06:23.153459+0000","last_active":"2023-07-20T11:06:25.824475+0000","last_peered":"2023-07-20T11:06:25.824475+0000","last_clean":"2023-07-20T11:06:25.824475+0000","last_became_active":"2023-07-20T11:06:23.153175+0000","last_became_peered":"2023-07-20T11:06:23.153175+0000","last_unstale":"2023-07-20T11:06:25.824475+0000","last_undegraded":"2023-07-20T11:06:25.824475+0000","last_fullsized":"2023-07-20T11:06:25.824475+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:49:43.181973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140129+0000","last_change":"2023-07-20T11:06:23.167270+0000","last_active":"2023-07-20T11:06:24.140129+0000","last_peered":"2023-07-20T11:06:24.140129+0000","last_clean":"2023-07-20T11:06:24.140129+0000","last_became_active":"2023-07-20T11:06:23.166949+0000","last_became_peered":"2023-07-20T11:06:23.166949+0000","last_unstale":"2023-07-20T11:06:24.140129+0000","last_undegraded":"2023-07-20T11:06:24.140129+0000","last_fullsized":"2023-07-20T11:06:24.140129+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:52:39.697599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143679+0000","last_change":"2023-07-20T11:06:23.169540+0000","last_active":"2023-07-20T11:06:24.143679+0000","last_peered":"2023-07-20T11:06:24.143679+0000","last_clean":"2023-07-20T11:06:24.143679+0000","last_became_active":"2023-07-20T11:06:23.165178+0000","last_became_peered":"2023-07-20T11:06:23.165178+0000","last_unstale":"2023-07-20T11:06:24.143679+0000","last_undegraded":"2023-07-20T11:06:24.143679+0000","last_fullsized":"2023-07-20T11:06:24.143679+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:14:16.046016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825176+0000","last_change":"2023-07-20T11:06:23.165935+0000","last_active":"2023-07-20T11:06:25.825176+0000","last_peered":"2023-07-20T11:06:25.825176+0000","last_clean":"2023-07-20T11:06:25.825176+0000","last_became_active":"2023-07-20T11:06:23.165633+0000","last_became_peered":"2023-07-20T11:06:23.165633+0000","last_unstale":"2023-07-20T11:06:25.825176+0000","last_undegraded":"2023-07-20T11:06:25.825176+0000","last_fullsized":"2023-07-20T11:06:25.825176+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:24.768945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140580+0000","last_change":"2023-07-20T11:06:22.152923+0000","last_active":"2023-07-20T11:06:24.140580+0000","last_peered":"2023-07-20T11:06:24.140580+0000","last_clean":"2023-07-20T11:06:24.140580+0000","last_became_active":"2023-07-20T11:06:22.152666+0000","last_became_peered":"2023-07-20T11:06:22.152666+0000","last_unstale":"2023-07-20T11:06:24.140580+0000","last_undegraded":"2023-07-20T11:06:24.140580+0000","last_fullsized":"2023-07-20T11:06:24.140580+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:06:26.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825337+0000","last_change":"2023-07-20T11:06:23.162984+0000","last_active":"2023-07-20T11:06:25.825337+0000","last_peered":"2023-07-20T11:06:25.825337+0000","last_clean":"2023-07-20T11:06:25.825337+0000","last_became_active":"2023-07-20T11:06:23.162688+0000","last_became_peered":"2023-07-20T11:06:23.162688+0000","last_unstale":"2023-07-20T11:06:25.825337+0000","last_undegraded":"2023-07-20T11:06:25.825337+0000","last_fullsized":"2023-07-20T11:06:25.825337+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:28.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351414+0000","last_change":"2023-07-20T11:06:22.166871+0000","last_active":"2023-07-20T11:06:24.351414+0000","last_peered":"2023-07-20T11:06:24.351414+0000","last_clean":"2023-07-20T11:06:24.351414+0000","last_became_active":"2023-07-20T11:06:22.166392+0000","last_became_peered":"2023-07-20T11:06:22.166392+0000","last_unstale":"2023-07-20T11:06:24.351414+0000","last_undegraded":"2023-07-20T11:06:24.351414+0000","last_fullsized":"2023-07-20T11:06:24.351414+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:51:43.230220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145065+0000","last_change":"2023-07-20T11:06:23.170796+0000","last_active":"2023-07-20T11:06:24.145065+0000","last_peered":"2023-07-20T11:06:24.145065+0000","last_clean":"2023-07-20T11:06:24.145065+0000","last_became_active":"2023-07-20T11:06:23.165227+0000","last_became_peered":"2023-07-20T11:06:23.165227+0000","last_unstale":"2023-07-20T11:06:24.145065+0000","last_undegraded":"2023-07-20T11:06:24.145065+0000","last_fullsized":"2023-07-20T11:06:24.145065+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:46:04.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351664+0000","last_change":"2023-07-20T11:06:22.168648+0000","last_active":"2023-07-20T11:06:24.351664+0000","last_peered":"2023-07-20T11:06:24.351664+0000","last_clean":"2023-07-20T11:06:24.351664+0000","last_became_active":"2023-07-20T11:06:22.167647+0000","last_became_peered":"2023-07-20T11:06:22.167647+0000","last_unstale":"2023-07-20T11:06:24.351664+0000","last_undegraded":"2023-07-20T11:06:24.351664+0000","last_fullsized":"2023-07-20T11:06:24.351664+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:08.951777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351531+0000","last_change":"2023-07-20T11:06:23.159585+0000","last_active":"2023-07-20T11:06:24.351531+0000","last_peered":"2023-07-20T11:06:24.351531+0000","last_clean":"2023-07-20T11:06:24.351531+0000","last_became_active":"2023-07-20T11:06:23.156720+0000","last_became_peered":"2023-07-20T11:06:23.156720+0000","last_unstale":"2023-07-20T11:06:24.351531+0000","last_undegraded":"2023-07-20T11:06:24.351531+0000","last_fullsized":"2023-07-20T11:06:24.351531+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:34:45.441675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825239+0000","last_change":"2023-07-20T11:06:22.169809+0000","last_active":"2023-07-20T11:06:25.825239+0000","last_peered":"2023-07-20T11:06:25.825239+0000","last_clean":"2023-07-20T11:06:25.825239+0000","last_became_active":"2023-07-20T11:06:22.169478+0000","last_became_peered":"2023-07-20T11:06:22.169478+0000","last_unstale":"2023-07-20T11:06:25.825239+0000","last_undegraded":"2023-07-20T11:06:25.825239+0000","last_fullsized":"2023-07-20T11:06:25.825239+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:13:53.849210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824573+0000","last_change":"2023-07-20T11:06:23.148501+0000","last_active":"2023-07-20T11:06:25.824573+0000","last_peered":"2023-07-20T11:06:25.824573+0000","last_clean":"2023-07-20T11:06:25.824573+0000","last_became_active":"2023-07-20T11:06:23.148151+0000","last_became_peered":"2023-07-20T11:06:23.148151+0000","last_unstale":"2023-07-20T11:06:25.824573+0000","last_undegraded":"2023-07-20T11:06:25.824573+0000","last_fullsized":"2023-07-20T11:06:25.824573+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:39.246204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144925+0000","last_change":"2023-07-20T11:06:22.172794+0000","last_active":"2023-07-20T11:06:24.144925+0000","last_peered":"2023-07-20T11:06:24.144925+0000","last_clean":"2023-07-20T11:06:24.144925+0000","last_became_active":"2023-07-20T11:06:22.172527+0000","last_became_peered":"2023-07-20T11:06:22.172527+0000","last_unstale":"2023-07-20T11:06:24.144925+0000","last_undegraded":"2023-07-20T11:06:24.144925+0000","last_fullsized":"2023-07-20T11:06:24.144925+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:10:42.394903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943011+0000","last_change":"2023-07-20T11:06:23.163720+0000","last_active":"2023-07-20T11:06:24.943011+0000","last_peered":"2023-07-20T11:06:24.943011+0000","last_clean":"2023-07-20T11:06:24.943011+0000","last_became_active":"2023-07-20T11:06:23.163155+0000","last_became_peered":"2023-07-20T11:06:23.163155+0000","last_unstale":"2023-07-20T11:06:24.943011+0000","last_undegraded":"2023-07-20T11:06:24.943011+0000","last_fullsized":"2023-07-20T11:06:24.943011+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:50.960460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140513+0000","last_change":"2023-07-20T11:06:22.157450+0000","last_active":"2023-07-20T11:06:24.140513+0000","last_peered":"2023-07-20T11:06:24.140513+0000","last_clean":"2023-07-20T11:06:24.140513+0000","last_became_active":"2023-07-20T11:06:22.157178+0000","last_became_peered":"2023-07-20T11:06:22.157178+0000","last_unstale":"2023-07-20T11:06:24.140513+0000","last_undegraded":"2023-07-20T11:06:24.140513+0000","last_fullsized":"2023-07-20T11:06:24.140513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:12.649055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824478+0000","last_change":"2023-07-20T11:06:23.165451+0000","last_active":"2023-07-20T11:06:25.824478+0000","last_peered":"2023-07-20T11:06:25.824478+0000","last_clean":"2023-07-20T11:06:25.824478+0000","last_became_active":"2023-07-20T11:06:23.165179+0000","last_became_peered":"2023-07-20T11:06:23.165179+0000","last_unstale":"2023-07-20T11:06:25.824478+0000","last_undegraded":"2023-07-20T11:06:25.824478+0000","last_fullsized":"2023-07-20T11:06:25.824478+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:39.049638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143596+0000","last_change":"2023-07-20T11:06:22.160798+0000","last_active":"2023-07-20T11:06:24.143596+0000","last_peered":"2023-07-20T11:06:24.143596+0000","last_clean":"2023-07-20T11:06:24.143596+0000","last_became_active":"2023-07-20T11:06:22.160411+0000","last_became_peered":"2023-07-20T11:06:22.160411+0000","last_unstale":"2023-07-20T11:06:24.143596+0000","last_undegraded":"2023-07-20T11:06:24.143596+0000","last_fullsized":"2023-07-20T11:06:24.143596+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:35.608914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143719+0000","last_change":"2023-07-20T11:06:23.167772+0000","last_active":"2023-07-20T11:06:24.143719+0000","last_peered":"2023-07-20T11:06:24.143719+0000","last_clean":"2023-07-20T11:06:24.143719+0000","last_became_active":"2023-07-20T11:06:23.167425+0000","last_became_peered":"2023-07-20T11:06:23.167425+0000","last_unstale":"2023-07-20T11:06:24.143719+0000","last_undegraded":"2023-07-20T11:06:24.143719+0000","last_fullsized":"2023-07-20T11:06:24.143719+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:27.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140285+0000","last_change":"2023-07-20T11:06:22.160767+0000","last_active":"2023-07-20T11:06:24.140285+0000","last_peered":"2023-07-20T11:06:24.140285+0000","last_clean":"2023-07-20T11:06:24.140285+0000","last_became_active":"2023-07-20T11:06:22.160460+0000","last_became_peered":"2023-07-20T11:06:22.160460+0000","last_unstale":"2023-07-20T11:06:24.140285+0000","last_undegraded":"2023-07-20T11:06:24.140285+0000","last_fullsized":"2023-07-20T11:06:24.140285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:55.189409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351317+0000","last_change":"2023-07-20T11:06:23.169783+0000","last_active":"2023-07-20T11:06:24.351317+0000","last_peered":"2023-07-20T11:06:24.351317+0000","last_clean":"2023-07-20T11:06:24.351317+0000","last_became_active":"2023-07-20T11:06:23.169514+0000","last_became_peered":"2023-07-20T11:06:23.169514+0000","last_unstale":"2023-07-20T11:06:24.351317+0000","last_undegraded":"2023-07-20T11:06:24.351317+0000","last_fullsized":"2023-07-20T11:06:24.351317+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:25.028213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825080+0000","last_change":"2023-07-20T11:06:22.164768+0000","last_active":"2023-07-20T11:06:25.825080+0000","last_peered":"2023-07-20T11:06:25.825080+0000","last_clean":"2023-07-20T11:06:25.825080+0000","last_became_active":"2023-07-20T11:06:22.164414+0000","last_became_peered":"2023-07-20T11:06:22.164414+0000","last_unstale":"2023-07-20T11:06:25.825080+0000","last_undegraded":"2023-07-20T11:06:25.825080+0000","last_fullsized":"2023-07-20T11:06:25.825080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:51:11.541791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351600+0000","last_change":"2023-07-20T11:06:23.175427+0000","last_active":"2023-07-20T11:06:24.351600+0000","last_peered":"2023-07-20T11:06:24.351600+0000","last_clean":"2023-07-20T11:06:24.351600+0000","last_became_active":"2023-07-20T11:06:23.174740+0000","last_became_peered":"2023-07-20T11:06:23.174740+0000","last_unstale":"2023-07-20T11:06:24.351600+0000","last_undegraded":"2023-07-20T11:06:24.351600+0000","last_fullsized":"2023-07-20T11:06:24.351600+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:28.626084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351466+0000","last_change":"2023-07-20T11:06:22.166651+0000","last_active":"2023-07-20T11:06:24.351466+0000","last_peered":"2023-07-20T11:06:24.351466+0000","last_clean":"2023-07-20T11:06:24.351466+0000","last_became_active":"2023-07-20T11:06:22.166060+0000","last_became_peered":"2023-07-20T11:06:22.166060+0000","last_unstale":"2023-07-20T11:06:24.351466+0000","last_undegraded":"2023-07-20T11:06:24.351466+0000","last_fullsized":"2023-07-20T11:06:24.351466+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:38.758915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144398+0000","last_change":"2023-07-20T11:06:23.157042+0000","last_active":"2023-07-20T11:06:24.144398+0000","last_peered":"2023-07-20T11:06:24.144398+0000","last_clean":"2023-07-20T11:06:24.144398+0000","last_became_active":"2023-07-20T11:06:23.156764+0000","last_became_peered":"2023-07-20T11:06:23.156764+0000","last_unstale":"2023-07-20T11:06:24.144398+0000","last_undegraded":"2023-07-20T11:06:24.144398+0000","last_fullsized":"2023-07-20T11:06:24.144398+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:23.560264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825339+0000","last_change":"2023-07-20T11:06:22.157550+0000","last_active":"2023-07-20T11:06:25.825339+0000","last_peered":"2023-07-20T11:06:25.825339+0000","last_clean":"2023-07-20T11:06:25.825339+0000","last_became_active":"2023-07-20T11:06:22.157229+0000","last_became_peered":"2023-07-20T11:06:22.157229+0000","last_unstale":"2023-07-20T11:06:25.825339+0000","last_undegraded":"2023-07-20T11:06:25.825339+0000","last_fullsized":"2023-07-20T11:06:25.825339+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:20:16.477712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144477+0000","last_change":"2023-07-20T11:06:23.159274+0000","last_active":"2023-07-20T11:06:24.144477+0000","last_peered":"2023-07-20T11:06:24.144477+0000","last_clean":"2023-07-20T11:06:24.144477+0000","last_became_active":"2023-07-20T11:06:23.159006+0000","last_became_peered":"2023-07-20T11:06:23.159006+0000","last_unstale":"2023-07-20T11:06:24.144477+0000","last_undegraded":"2023-07-20T11:06:24.144477+0000","last_fullsized":"2023-07-20T11:06:24.144477+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:03.836394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943164+0000","last_change":"2023-07-20T11:06:22.173766+0000","last_active":"2023-07-20T11:06:24.943164+0000","last_peered":"2023-07-20T11:06:24.943164+0000","last_clean":"2023-07-20T11:06:24.943164+0000","last_became_active":"2023-07-20T11:06:22.173484+0000","last_became_peered":"2023-07-20T11:06:22.173484+0000","last_unstale":"2023-07-20T11:06:24.943164+0000","last_undegraded":"2023-07-20T11:06:24.943164+0000","last_fullsized":"2023-07-20T11:06:24.943164+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:48.762428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351352+0000","last_change":"2023-07-20T11:06:23.175629+0000","last_active":"2023-07-20T11:06:24.351352+0000","last_peered":"2023-07-20T11:06:24.351352+0000","last_clean":"2023-07-20T11:06:24.351352+0000","last_became_active":"2023-07-20T11:06:23.175334+0000","last_became_peered":"2023-07-20T11:06:23.175334+0000","last_unstale":"2023-07-20T11:06:24.351352+0000","last_undegraded":"2023-07-20T11:06:24.351352+0000","last_fullsized":"2023-07-20T11:06:24.351352+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:58:44.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824951+0000","last_change":"2023-07-20T11:06:22.170026+0000","last_active":"2023-07-20T11:06:25.824951+0000","last_peered":"2023-07-20T11:06:25.824951+0000","last_clean":"2023-07-20T11:06:25.824951+0000","last_became_active":"2023-07-20T11:06:22.169730+0000","last_became_peered":"2023-07-20T11:06:22.169730+0000","last_unstale":"2023-07-20T11:06:25.824951+0000","last_undegraded":"2023-07-20T11:06:25.824951+0000","last_fullsized":"2023-07-20T11:06:25.824951+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:16:33.062985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824848+0000","last_change":"2023-07-20T11:06:23.163524+0000","last_active":"2023-07-20T11:06:25.824848+0000","last_peered":"2023-07-20T11:06:25.824848+0000","last_clean":"2023-07-20T11:06:25.824848+0000","last_became_active":"2023-07-20T11:06:23.163248+0000","last_became_peered":"2023-07-20T11:06:23.163248+0000","last_unstale":"2023-07-20T11:06:25.824848+0000","last_undegraded":"2023-07-20T11:06:25.824848+0000","last_fullsized":"2023-07-20T11:06:25.824848+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:34:19.937457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144234+0000","last_change":"2023-07-20T11:06:22.165707+0000","last_active":"2023-07-20T11:06:24.144234+0000","last_peered":"2023-07-20T11:06:24.144234+0000","last_clean":"2023-07-20T11:06:24.144234+0000","last_became_active":"2023-07-20T11:06:22.164486+0000","last_became_peered":"2023-07-20T11:06:22.164486+0000","last_unstale":"2023-07-20T11:06:24.144234+0000","last_undegraded":"2023-07-20T11:06:24.144234+0000","last_fullsized":"2023-07-20T11:06:24.144234+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:17:20.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351379+0000","last_change":"2023-07-20T11:06:23.162545+0000","last_active":"2023-07-20T11:06:24.351379+0000","last_peered":"2023-07-20T11:06:24.351379+0000","last_clean":"2023-07-20T11:06:24.351379+0000","last_became_active":"2023-07-20T11:06:23.161908+0000","last_became_peered":"2023-07-20T11:06:23.161908+0000","last_unstale":"2023-07-20T11:06:24.351379+0000","last_undegraded":"2023-07-20T11:06:24.351379+0000","last_fullsized":"2023-07-20T11:06:24.351379+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:04.446712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824712+0000","last_change":"2023-07-20T11:06:22.169997+0000","last_active":"2023-07-20T11:06:25.824712+0000","last_peered":"2023-07-20T11:06:25.824712+0000","last_clean":"2023-07-20T11:06:25.824712+0000","last_became_active":"2023-07-20T11:06:22.169639+0000","last_became_peered":"2023-07-20T11:06:22.169639+0000","last_unstale":"2023-07-20T11:06:25.824712+0000","last_undegraded":"2023-07-20T11:06:25.824712+0000","last_fullsized":"2023-07-20T11:06:25.824712+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:45:41.509780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825101+0000","last_change":"2023-07-20T11:06:23.162425+0000","last_active":"2023-07-20T11:06:25.825101+0000","last_peered":"2023-07-20T11:06:25.825101+0000","last_clean":"2023-07-20T11:06:25.825101+0000","last_became_active":"2023-07-20T11:06:23.162085+0000","last_became_peered":"2023-07-20T11:06:23.162085+0000","last_unstale":"2023-07-20T11:06:25.825101+0000","last_undegraded":"2023-07-20T11:06:25.825101+0000","last_fullsized":"2023-07-20T11:06:25.825101+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:42:11.761745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143943+0000","last_change":"2023-07-20T11:06:22.169177+0000","last_active":"2023-07-20T11:06:24.143943+0000","last_peered":"2023-07-20T11:06:24.143943+0000","last_clean":"2023-07-20T11:06:24.143943+0000","last_became_active":"2023-07-20T11:06:22.168892+0000","last_became_peered":"2023-07-20T11:06:22.168892+0000","last_unstale":"2023-07-20T11:06:24.143943+0000","last_undegraded":"2023-07-20T11:06:24.143943+0000","last_fullsized":"2023-07-20T11:06:24.143943+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:36:04.067690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140418+0000","last_change":"2023-07-20T11:06:23.147658+0000","last_active":"2023-07-20T11:06:24.140418+0000","last_peered":"2023-07-20T11:06:24.140418+0000","last_clean":"2023-07-20T11:06:24.140418+0000","last_became_active":"2023-07-20T11:06:23.147402+0000","last_became_peered":"2023-07-20T11:06:23.147402+0000","last_unstale":"2023-07-20T11:06:24.140418+0000","last_undegraded":"2023-07-20T11:06:24.140418+0000","last_fullsized":"2023-07-20T11:06:24.140418+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:59.381040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943244+0000","last_change":"2023-07-20T11:06:22.170338+0000","last_active":"2023-07-20T11:06:24.943244+0000","last_peered":"2023-07-20T11:06:24.943244+0000","last_clean":"2023-07-20T11:06:24.943244+0000","last_became_active":"2023-07-20T11:06:22.169556+0000","last_became_peered":"2023-07-20T11:06:22.169556+0000","last_unstale":"2023-07-20T11:06:24.943244+0000","last_undegraded":"2023-07-20T11:06:24.943244+0000","last_fullsized":"2023-07-20T11:06:24.943244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:12.404957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942881+0000","last_change":"2023-07-20T11:06:23.169920+0000","last_active":"2023-07-20T11:06:24.942881+0000","last_peered":"2023-07-20T11:06:24.942881+0000","last_clean":"2023-07-20T11:06:24.942881+0000","last_became_active":"2023-07-20T11:06:23.169385+0000","last_became_peered":"2023-07-20T11:06:23.169385+0000","last_unstale":"2023-07-20T11:06:24.942881+0000","last_undegraded":"2023-07-20T11:06:24.942881+0000","last_fullsized":"2023-07-20T11:06:24.942881+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:17.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"172'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144564+0000","last_change":"2023-07-20T11:06:22.166388+0000","last_active":"2023-07-20T11:06:24.144564+0000","last_peered":"2023-07-20T11:06:24.144564+0000","last_clean":"2023-07-20T11:06:24.144564+0000","last_became_active":"2023-07-20T11:06:22.166099+0000","last_became_peered":"2023-07-20T11:06:22.166099+0000","last_unstale":"2023-07-20T11:06:24.144564+0000","last_undegraded":"2023-07-20T11:06:24.144564+0000","last_fullsized":"2023-07-20T11:06:24.144564+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:00.424695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144410+0000","last_change":"2023-07-20T11:06:23.167829+0000","last_active":"2023-07-20T11:06:24.144410+0000","last_peered":"2023-07-20T11:06:24.144410+0000","last_clean":"2023-07-20T11:06:24.144410+0000","last_became_active":"2023-07-20T11:06:23.167501+0000","last_became_peered":"2023-07-20T11:06:23.167501+0000","last_unstale":"2023-07-20T11:06:24.144410+0000","last_undegraded":"2023-07-20T11:06:24.144410+0000","last_fullsized":"2023-07-20T11:06:24.144410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:04.562198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825424+0000","last_change":"2023-07-20T11:06:22.169867+0000","last_active":"2023-07-20T11:06:25.825424+0000","last_peered":"2023-07-20T11:06:25.825424+0000","last_clean":"2023-07-20T11:06:25.825424+0000","last_became_active":"2023-07-20T11:06:22.169464+0000","last_became_peered":"2023-07-20T11:06:22.169464+0000","last_unstale":"2023-07-20T11:06:25.825424+0000","last_undegraded":"2023-07-20T11:06:25.825424+0000","last_fullsized":"2023-07-20T11:06:25.825424+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:57.132384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140488+0000","last_change":"2023-07-20T11:06:23.158665+0000","last_active":"2023-07-20T11:06:24.140488+0000","last_peered":"2023-07-20T11:06:24.140488+0000","last_clean":"2023-07-20T11:06:24.140488+0000","last_became_active":"2023-07-20T11:06:23.158368+0000","last_became_peered":"2023-07-20T11:06:23.158368+0000","last_unstale":"2023-07-20T11:06:24.140488+0000","last_undegraded":"2023-07-20T11:06:24.140488+0000","last_fullsized":"2023-07-20T11:06:24.140488+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:28.047284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140599+0000","last_change":"2023-07-20T11:06:22.170832+0000","last_active":"2023-07-20T11:06:24.140599+0000","last_peered":"2023-07-20T11:06:24.140599+0000","last_clean":"2023-07-20T11:06:24.140599+0000","last_became_active":"2023-07-20T11:06:22.170536+0000","last_became_peered":"2023-07-20T11:06:22.170536+0000","last_unstale":"2023-07-20T11:06:24.140599+0000","last_undegraded":"2023-07-20T11:06:24.140599+0000","last_fullsized":"2023-07-20T11:06:24.140599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:57:18.756859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143964+0000","last_change":"2023-07-20T11:06:23.161057+0000","last_active":"2023-07-20T11:06:24.143964+0000","last_peered":"2023-07-20T11:06:24.143964+0000","last_clean":"2023-07-20T11:06:24.143964+0000","last_became_active":"2023-07-20T11:06:23.160774+0000","last_became_peered":"2023-07-20T11:06:23.160774+0000","last_unstale":"2023-07-20T11:06:24.143964+0000","last_undegraded":"2023-07-20T11:06:24.143964+0000","last_fullsized":"2023-07-20T11:06:24.143964+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:13.702546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143840+0000","last_change":"2023-07-20T11:06:22.166459+0000","last_active":"2023-07-20T11:06:24.143840+0000","last_peered":"2023-07-20T11:06:24.143840+0000","last_clean":"2023-07-20T11:06:24.143840+0000","last_became_active":"2023-07-20T11:06:22.166163+0000","last_became_peered":"2023-07-20T11:06:22.166163+0000","last_unstale":"2023-07-20T11:06:24.143840+0000","last_undegraded":"2023-07-20T11:06:24.143840+0000","last_fullsized":"2023-07-20T11:06:24.143840+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:29:40.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943281+0000","last_change":"2023-07-20T11:06:23.166887+0000","last_active":"2023-07-20T11:06:24.943281+0000","last_peered":"2023-07-20T11:06:24.943281+0000","last_clean":"2023-07-20T11:06:24.943281+0000","last_became_active":"2023-07-20T11:06:23.166333+0000","last_became_peered":"2023-07-20T11:06:23.166333+0000","last_unstale":"2023-07-20T11:06:24.943281+0000","last_undegraded":"2023-07-20T11:06:24.943281+0000","last_fullsized":"2023-07-20T11:06:24.943281+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:25.860909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824558+0000","last_change":"2023-07-20T11:06:22.170664+0000","last_active":"2023-07-20T11:06:25.824558+0000","last_peered":"2023-07-20T11:06:25.824558+0000","last_clean":"2023-07-20T11:06:25.824558+0000","last_became_active":"2023-07-20T11:06:22.170382+0000","last_became_peered":"2023-07-20T11:06:22.170382+0000","last_unstale":"2023-07-20T11:06:25.824558+0000","last_undegraded":"2023-07-20T11:06:25.824558+0000","last_fullsized":"2023-07-20T11:06:25.824558+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:27:20.091859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824602+0000","last_change":"2023-07-20T11:06:23.173688+0000","last_active":"2023-07-20T11:06:25.824602+0000","last_peered":"2023-07-20T11:06:25.824602+0000","last_clean":"2023-07-20T11:06:25.824602+0000","last_became_active":"2023-07-20T11:06:23.173254+0000","last_became_peered":"2023-07-20T11:06:23.173254+0000","last_unstale":"2023-07-20T11:06:25.824602+0000","last_undegraded":"2023-07-20T11:06:25.824602+0000","last_fullsized":"2023-07-20T11:06:25.824602+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:28.829587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143745+0000","last_change":"2023-07-20T11:06:22.160342+0000","last_active":"2023-07-20T11:06:24.143745+0000","last_peered":"2023-07-20T11:06:24.143745+0000","last_clean":"2023-07-20T11:06:24.143745+0000","last_became_active":"2023-07-20T11:06:22.160034+0000","last_became_peered":"2023-07-20T11:06:22.160034+0000","last_unstale":"2023-07-20T11:06:24.143745+0000","last_undegraded":"2023-07-20T11:06:24.143745+0000","last_fullsized":"2023-07-20T11:06:24.143745+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:07.234502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144802+0000","last_change":"2023-07-20T11:06:23.173357+0000","last_active":"2023-07-20T11:06:24.144802+0000","last_peered":"2023-07-20T11:06:24.144802+0000","last_clean":"2023-07-20T11:06:24.144802+0000","last_became_active":"2023-07-20T11:06:23.173015+0000","last_became_peered":"2023-07-20T11:06:23.173015+0000","last_unstale":"2023-07-20T11:06:24.144802+0000","last_undegraded":"2023-07-20T11:06:24.144802+0000","last_fullsized":"2023-07-20T11:06:24.144802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:35.108715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351133+0000","last_change":"2023-07-20T11:06:22.165584+0000","last_active":"2023-07-20T11:06:24.351133+0000","last_peered":"2023-07-20T11:06:24.351133+0000","last_clean":"2023-07-20T11:06:24.351133+0000","last_became_active":"2023-07-20T11:06:22.165280+0000","last_became_peered":"2023-07-20T11:06:22.165280+0000","last_unstale":"2023-07-20T11:06:24.351133+0000","last_undegraded":"2023-07-20T11:06:24.351133+0000","last_fullsized":"2023-07-20T11:06:24.351133+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:48:21.450388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145238+0000","last_change":"2023-07-20T11:06:23.170848+0000","last_active":"2023-07-20T11:06:24.145238+0000","last_peered":"2023-07-20T11:06:24.145238+0000","last_clean":"2023-07-20T11:06:24.145238+0000","last_became_active":"2023-07-20T11:06:23.170488+0000","last_became_peered":"2023-07-20T11:06:23.170488+0000","last_unstale":"2023-07-20T11:06:24.145238+0000","last_undegraded":"2023-07-20T11:06:24.145238+0000","last_fullsized":"2023-07-20T11:06:24.145238+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:49:00.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824466+0000","last_change":"2023-07-20T11:06:22.170114+0000","last_active":"2023-07-20T11:06:25.824466+0000","last_peered":"2023-07-20T11:06:25.824466+0000","last_clean":"2023-07-20T11:06:25.824466+0000","last_became_active":"2023-07-20T11:06:22.169907+0000","last_became_peered":"2023-07-20T11:06:22.169907+0000","last_unstale":"2023-07-20T11:06:25.824466+0000","last_undegraded":"2023-07-20T11:06:25.824466+0000","last_fullsized":"2023-07-20T11:06:25.824466+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:19.434735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'271","reported_seq":1012,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351447+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:06:24.351447+0000","last_peered":"2023-07-20T11:06:24.351447+0000","last_clean":"2023-07-20T11:06:24.351447+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:06:24.351447+0000","last_undegraded":"2023-07-20T11:06:24.351447+0000","last_fullsized":"2023-07-20T11:06:24.351447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:08:56.967294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":345,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143927+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:06:24.143927+0000","last_peered":"2023-07-20T11:06:24.143927+0000","last_clean":"2023-07-20T11:06:24.143927+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:06:24.143927+0000","last_undegraded":"2023-07-20T11:06:24.143927+0000","last_fullsized":"2023-07-20T11:06:24.143927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:52.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145139+0000","last_change":"2023-07-20T11:06:23.164214+0000","last_active":"2023-07-20T11:06:24.145139+0000","last_peered":"2023-07-20T11:06:24.145139+0000","last_clean":"2023-07-20T11:06:24.145139+0000","last_became_active":"2023-07-20T11:06:23.163927+0000","last_became_peered":"2023-07-20T11:06:23.163927+0000","last_unstale":"2023-07-20T11:06:24.145139+0000","last_undegraded":"2023-07-20T11:06:24.145139+0000","last_fullsized":"2023-07-20T11:06:24.145139+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:28:11.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351632+0000","last_change":"2023-07-20T11:06:22.165378+0000","last_active":"2023-07-20T11:06:24.351632+0000","last_peered":"2023-07-20T11:06:24.351632+0000","last_clean":"2023-07-20T11:06:24.351632+0000","last_became_active":"2023-07-20T11:06:22.165116+0000","last_became_peered":"2023-07-20T11:06:22.165116+0000","last_unstale":"2023-07-20T11:06:24.351632+0000","last_undegraded":"2023-07-20T11:06:24.351632+0000","last_fullsized":"2023-07-20T11:06:24.351632+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:47.046634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351361+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:06:24.351361+0000","last_peered":"2023-07-20T11:06:24.351361+0000","last_clean":"2023-07-20T11:06:24.351361+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:06:24.351361+0000","last_undegraded":"2023-07-20T11:06:24.351361+0000","last_fullsized":"2023-07-20T11:06:24.351361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:13:12.542064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824857+0000","last_change":"2023-07-20T11:06:23.161925+0000","last_active":"2023-07-20T11:06:25.824857+0000","last_peered":"2023-07-20T11:06:25.824857+0000","last_clean":"2023-07-20T11:06:25.824857+0000","last_became_active":"2023-07-20T11:06:23.161577+0000","last_became_peered":"2023-07-20T11:06:23.161577+0000","last_unstale":"2023-07-20T11:06:25.824857+0000","last_undegraded":"2023-07-20T11:06:25.824857+0000","last_fullsized":"2023-07-20T11:06:25.824857+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:12.845716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144526+0000","last_change":"2023-07-20T11:06:22.160281+0000","last_active":"2023-07-20T11:06:24.144526+0000","last_peered":"2023-07-20T11:06:24.144526+0000","last_clean":"2023-07-20T11:06:24.144526+0000","last_became_active":"2023-07-20T11:06:22.159991+0000","last_became_peered":"2023-07-20T11:06:22.159991+0000","last_unstale":"2023-07-20T11:06:24.144526+0000","last_undegraded":"2023-07-20T11:06:24.144526+0000","last_fullsized":"2023-07-20T11:06:24.144526+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:34.778622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824186+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:06:25.824186+0000","last_peered":"2023-07-20T11:06:25.824186+0000","last_clean":"2023-07-20T11:06:25.824186+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:06:25.824186+0000","last_undegraded":"2023-07-20T11:06:25.824186+0000","last_fullsized":"2023-07-20T11:06:25.824186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:35:28.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825117+0000","last_change":"2023-07-20T11:06:23.156572+0000","last_active":"2023-07-20T11:06:25.825117+0000","last_peered":"2023-07-20T11:06:25.825117+0000","last_clean":"2023-07-20T11:06:25.825117+0000","last_became_active":"2023-07-20T11:06:23.155889+0000","last_became_peered":"2023-07-20T11:06:23.155889+0000","last_unstale":"2023-07-20T11:06:25.825117+0000","last_undegraded":"2023-07-20T11:06:25.825117+0000","last_fullsized":"2023-07-20T11:06:25.825117+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:05:18.380971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824939+0000","last_change":"2023-07-20T11:06:22.151477+0000","last_active":"2023-07-20T11:06:25.824939+0000","last_peered":"2023-07-20T11:06:25.824939+0000","last_clean":"2023-07-20T11:06:25.824939+0000","last_became_active":"2023-07-20T11:06:22.151131+0000","last_became_peered":"2023-07-20T11:06:22.151131+0000","last_unstale":"2023-07-20T11:06:25.824939+0000","last_undegraded":"2023-07-20T11:06:25.824939+0000","last_fullsized":"2023-07-20T11:06:25.824939+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:41:14.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":345,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143792+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:06:24.143792+0000","last_peered":"2023-07-20T11:06:24.143792+0000","last_clean":"2023-07-20T11:06:24.143792+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:06:24.143792+0000","last_undegraded":"2023-07-20T11:06:24.143792+0000","last_fullsized":"2023-07-20T11:06:24.143792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:50:52.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143815+0000","last_change":"2023-07-20T11:06:23.168975+0000","last_active":"2023-07-20T11:06:24.143815+0000","last_peered":"2023-07-20T11:06:24.143815+0000","last_clean":"2023-07-20T11:06:24.143815+0000","last_became_active":"2023-07-20T11:06:23.164834+0000","last_became_peered":"2023-07-20T11:06:23.164834+0000","last_unstale":"2023-07-20T11:06:24.143815+0000","last_undegraded":"2023-07-20T11:06:24.143815+0000","last_fullsized":"2023-07-20T11:06:24.143815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:07.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140629+0000","last_change":"2023-07-20T11:06:22.155150+0000","last_active":"2023-07-20T11:06:24.140629+0000","last_peered":"2023-07-20T11:06:24.140629+0000","last_clean":"2023-07-20T11:06:24.140629+0000","last_became_active":"2023-07-20T11:06:22.154891+0000","last_became_peered":"2023-07-20T11:06:22.154891+0000","last_unstale":"2023-07-20T11:06:24.140629+0000","last_undegraded":"2023-07-20T11:06:24.140629+0000","last_fullsized":"2023-07-20T11:06:24.140629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:00.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825342+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:06:25.825342+0000","last_peered":"2023-07-20T11:06:25.825342+0000","last_clean":"2023-07-20T11:06:25.825342+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:06:25.825342+0000","last_undegraded":"2023-07-20T11:06:25.825342+0000","last_fullsized":"2023-07-20T11:06:25.825342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:03.163880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824733+0000","last_change":"2023-07-20T11:06:23.162479+0000","last_active":"2023-07-20T11:06:25.824733+0000","last_peered":"2023-07-20T11:06:25.824733+0000","last_clean":"2023-07-20T11:06:25.824733+0000","last_became_active":"2023-07-20T11:06:23.162173+0000","last_became_peered":"2023-07-20T11:06:23.162173+0000","last_unstale":"2023-07-20T11:06:25.824733+0000","last_undegraded":"2023-07-20T11:06:25.824733+0000","last_fullsized":"2023-07-20T11:06:25.824733+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:22.524188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942949+0000","last_change":"2023-07-20T11:06:22.174226+0000","last_active":"2023-07-20T11:06:24.942949+0000","last_peered":"2023-07-20T11:06:24.942949+0000","last_clean":"2023-07-20T11:06:24.942949+0000","last_became_active":"2023-07-20T11:06:22.173929+0000","last_became_peered":"2023-07-20T11:06:22.173929+0000","last_unstale":"2023-07-20T11:06:24.942949+0000","last_undegraded":"2023-07-20T11:06:24.942949+0000","last_fullsized":"2023-07-20T11:06:24.942949+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:57.181727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":309,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351747+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:06:24.351747+0000","last_peered":"2023-07-20T11:06:24.351747+0000","last_clean":"2023-07-20T11:06:24.351747+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:06:24.351747+0000","last_undegraded":"2023-07-20T11:06:24.351747+0000","last_fullsized":"2023-07-20T11:06:24.351747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:26:23.982858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140424+0000","last_change":"2023-07-20T11:06:23.151648+0000","last_active":"2023-07-20T11:06:24.140424+0000","last_peered":"2023-07-20T11:06:24.140424+0000","last_clean":"2023-07-20T11:06:24.140424+0000","last_became_active":"2023-07-20T11:06:23.151348+0000","last_became_peered":"2023-07-20T11:06:23.151348+0000","last_unstale":"2023-07-20T11:06:24.140424+0000","last_undegraded":"2023-07-20T11:06:24.140424+0000","last_fullsized":"2023-07-20T11:06:24.140424+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:01:27.903304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943150+0000","last_change":"2023-07-20T11:06:22.158522+0000","last_active":"2023-07-20T11:06:24.943150+0000","last_peered":"2023-07-20T11:06:24.943150+0000","last_clean":"2023-07-20T11:06:24.943150+0000","last_became_active":"2023-07-20T11:06:22.157878+0000","last_became_peered":"2023-07-20T11:06:22.157878+0000","last_unstale":"2023-07-20T11:06:24.943150+0000","last_undegraded":"2023-07-20T11:06:24.943150+0000","last_fullsized":"2023-07-20T11:06:24.943150+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:05:19.581459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825456+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:06:25.825456+0000","last_peered":"2023-07-20T11:06:25.825456+0000","last_clean":"2023-07-20T11:06:25.825456+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:06:25.825456+0000","last_undegraded":"2023-07-20T11:06:25.825456+0000","last_fullsized":"2023-07-20T11:06:25.825456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:26.249680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824984+0000","last_change":"2023-07-20T11:06:23.169998+0000","last_active":"2023-07-20T11:06:25.824984+0000","last_peered":"2023-07-20T11:06:25.824984+0000","last_clean":"2023-07-20T11:06:25.824984+0000","last_became_active":"2023-07-20T11:06:23.169736+0000","last_became_peered":"2023-07-20T11:06:23.169736+0000","last_unstale":"2023-07-20T11:06:25.824984+0000","last_undegraded":"2023-07-20T11:06:25.824984+0000","last_fullsized":"2023-07-20T11:06:25.824984+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:05.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"171'8","reported_seq":21,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143368+0000","last_change":"2023-07-20T11:06:22.162999+0000","last_active":"2023-07-20T11:06:24.143368+0000","last_peered":"2023-07-20T11:06:24.143368+0000","last_clean":"2023-07-20T11:06:24.143368+0000","last_became_active":"2023-07-20T11:06:22.162693+0000","last_became_peered":"2023-07-20T11:06:22.162693+0000","last_unstale":"2023-07-20T11:06:24.143368+0000","last_undegraded":"2023-07-20T11:06:24.143368+0000","last_fullsized":"2023-07-20T11:06:24.143368+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:05:55.871470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943284+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:06:24.943284+0000","last_peered":"2023-07-20T11:06:24.943284+0000","last_clean":"2023-07-20T11:06:24.943284+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:06:24.943284+0000","last_undegraded":"2023-07-20T11:06:24.943284+0000","last_fullsized":"2023-07-20T11:06:24.943284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:45:00.824060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575756,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47748,"kb_used_data":2680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324092,"statfs":{"total":96636764160,"available":96587870208,"internally_reserved":0,"allocated":2744320,"data_stored":1683809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95399999999999996,"5min":1.425,"15min":1.425},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"max":{"1min":0.87,"5min":2.306,"15min":2.306},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":2.169,"15min":2.169},"last":0.997}]},{"osd":4,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.87,"5min":2.141,"15min":2.141},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.379},"max":{"1min":0.879,"5min":2.206,"15min":2.206},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.60099999999999998,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.93899999999999995,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575758,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41408,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330432,"statfs":{"total":96636764160,"available":96594362368,"internally_reserved":0,"allocated":2150400,"data_stored":1093489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.752},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55356,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316484,"statfs":{"total":96636764160,"available":96580079616,"internally_reserved":0,"allocated":2146304,"data_stored":1093419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.621}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.88200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2158592,"data_stored":1094983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.376},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.495},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":2154496,"data_stored":1094035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59099999999999997,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.89300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56100000000000005,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.65000000000000002,"5min":0.79200000000000004,"15min":0.93500000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.0209999999999999,"5min":1.1100000000000001,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.262},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"max":{"1min":0.96499999999999997,"5min":1.137,"15min":1.381},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93300000000000005,"5min":1.266,"15min":1.2729999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.83399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.04,"5min":1.2010000000000001,"15min":1.298},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0029999999999999,"5min":1.1140000000000001,"15min":1.202},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93999999999999995,"5min":1.173,"15min":1.4219999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.222},"last":0.84499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575755,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59460,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312380,"statfs":{"total":96636764160,"available":96575877120,"internally_reserved":0,"allocated":2154496,"data_stored":1093531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.755,"5min":0.89400000000000002,"15min":1.05},"last":0.502}]},{"osd":3,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":1.115},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.1919999999999999,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.266},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.3,"15min":1.3},"last":0.747}]},{"osd":6,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83899999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.052,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.60599999999999998},"max":{"1min":1.0880000000000001,"5min":1.139,"15min":1.3129999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57299999999999995},"max":{"1min":1.147,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.58399999999999996},"max":{"1min":1.048,"5min":1.272,"15min":1.272},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":2150400,"data_stored":1093489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.624}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42008,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329832,"statfs":{"total":96636764160,"available":96593747968,"internally_reserved":0,"allocated":2764800,"data_stored":1686057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27500000000000002},"max":{"1min":0.59499999999999997,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.58799999999999997,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64200000000000002,"5min":0.78700000000000003,"15min":0.85799999999999998},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.2350000000000001,"15min":1.304},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.98199999999999998,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.58099999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.93100000000000005,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0229999999999999,"5min":1.1910000000000001,"15min":1.296},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0429999999999999,"5min":1.147,"15min":1.242},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97999999999999998,"5min":1.2170000000000001,"15min":1.381},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.306},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.89400000000000002,"5min":1.196,"15min":1.2350000000000001},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:06:31.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:06:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 Processor -- start 2023-07-20T11:06:31.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 -- start start 2023-07-20T11:06:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff82c0afda0 0x7ff82c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff82c15a8e0 0x7ff82c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0b2ee0 con 0x7ff82c0b2060 2023-07-20T11:06:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0b3160 con 0x7ff82c15a8e0 2023-07-20T11:06:31.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff832e07640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0b12a0 con 0x7ff82c0afda0 2023-07-20T11:06:31.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff82c15a8e0 0x7ff82c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff82c15a8e0 0x7ff82c0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47726/0 (socket says 172.21.15.82:47726) 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 -- 172.21.15.82:0/525488742 learned_addr learned my addr 172.21.15.82:0/525488742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff830ba3640 1 --2- 172.21.15.82:0/525488742 >> v2:172.21.15.183:3300/0 conn(0x7ff82c0afda0 0x7ff82c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 -- 172.21.15.82:0/525488742 >> v2:172.21.15.183:3300/0 conn(0x7ff82c0afda0 msgr2=0x7ff82c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 --2- 172.21.15.82:0/525488742 >> v2:172.21.15.183:3300/0 conn(0x7ff82c0afda0 0x7ff82c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 -- 172.21.15.82:0/525488742 >> v1:172.21.15.82:6789/0 conn(0x7ff82c0b2060 legacy=0x7ff82c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:31.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.910+0000 7ff82bfff640 1 -- 172.21.15.82:0/525488742 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0b1580 con 0x7ff82c15a8e0 2023-07-20T11:06:31.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff82bfff640 1 --2- 172.21.15.82:0/525488742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0b29a0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0b0b40 tx=0x7ff81801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6424c93fc59f59d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff82b7fe640 1 -- 172.21.15.82:0/525488742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180ac410 con 0x7ff82c15a8e0 2023-07-20T11:06:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff82b7fe640 1 -- 172.21.15.82:0/525488742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8180ac570 con 0x7ff82c15a8e0 2023-07-20T11:06:31.897 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff82b7fe640 1 -- 172.21.15.82:0/525488742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8180ac900 con 0x7ff82c15a8e0 2023-07-20T11:06:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 -- 172.21.15.82:0/525488742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c15a8e0 msgr2=0x7ff82c0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 --2- 172.21.15.82:0/525488742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0b29a0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0b0b40 tx=0x7ff81801c3b0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 -- 172.21.15.82:0/525488742 shutdown_connections 2023-07-20T11:06:31.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 --2- 172.21.15.82:0/525488742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0b29a0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 --2- 172.21.15.82:0/525488742 >> v2:172.21.15.183:3300/0 conn(0x7ff82c0afda0 0x7ff82c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 -- 172.21.15.82:0/525488742 >> 172.21.15.82:0/525488742 conn(0x7ff82c0cada0 msgr2=0x7ff82c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 -- 172.21.15.82:0/525488742 shutdown_connections 2023-07-20T11:06:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.914+0000 7ff832e07640 1 -- 172.21.15.82:0/525488742 wait complete. 2023-07-20T11:06:31.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 Processor -- start 2023-07-20T11:06:31.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- start start 2023-07-20T11:06:31.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff82c0b2060 0x7ff82c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c15bd50 con 0x7ff82c0afda0 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c153b00 con 0x7ff82c15a8e0 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c155ff0 con 0x7ff82c0b2060 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47734/0 (socket says 172.21.15.82:47734) 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 -- 172.21.15.82:0/3072503809 learned_addr learned my addr 172.21.15.82:0/3072503809 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff8313a4640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff82bfff640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff82c0b2060 0x7ff82c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 -- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff82c0b2060 msgr2=0x7ff82c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff82c0b2060 0x7ff82c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 -- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 msgr2=0x7ff82c0abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:31.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 -- 172.21.15.82:0/3072503809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180094d0 con 0x7ff82c0afda0 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff8313a4640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff830ba3640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d830 tx=0x7ff82000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b6c0 con 0x7ff82c0afda0 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b820 con 0x7ff82c0afda0 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000bb90 con 0x7ff82c0afda0 2023-07-20T11:06:31.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c155470 con 0x7ff82c0afda0 2023-07-20T11:06:31.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c155a30 con 0x7ff82c0afda0 2023-07-20T11:06:31.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.918+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c073c70 con 0x7ff82c0afda0 2023-07-20T11:06:31.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.922+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff82001e460 con 0x7ff82c0afda0 2023-07-20T11:06:31.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.922+0000 7ff8297fa640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 0x7ff810068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:31.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.922+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7ff820084790 con 0x7ff82c0afda0 2023-07-20T11:06:31.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.922+0000 7ff82bfff640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 0x7ff810068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:31.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.922+0000 7ff82bfff640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 0x7ff810068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8180ae000 tx=0x7ff8180a6040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:31.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:31.926+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff820051a10 con 0x7ff82c0afda0 2023-07-20T11:06:32.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.074+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff82c06bfc0 con 0x7ff8100663a0 2023-07-20T11:06:32.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.078+0000 7ff8297fa640 1 -- 172.21.15.82:0/3072503809 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311752 (secure 0 0 0) 0x7ff8180ac760 con 0x7ff8100663a0 2023-07-20T11:06:32.066 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:06:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.082+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 msgr2=0x7ff810068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.082+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 0x7ff810068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8180ae000 tx=0x7ff8180a6040 comp rx=0 tx=0).stop 2023-07-20T11:06:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.082+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 msgr2=0x7ff82c15b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.082+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d830 tx=0x7ff82000dcf0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 shutdown_connections 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7ff8100663a0 0x7ff810068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff82c15a8e0 0x7ff82c0abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff82c0b2060 0x7ff82c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 --2- 172.21.15.82:0/3072503809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff82c0afda0 0x7ff82c15b810 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 >> 172.21.15.82:0/3072503809 conn(0x7ff82c0cada0 msgr2=0x7ff82c070610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 shutdown_connections 2023-07-20T11:06:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.086+0000 7ff832e07640 1 -- 172.21.15.82:0/3072503809 wait complete. 2023-07-20T11:06:32.087 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T11:06:31.980659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":380080,"kb_used_data":17992,"kb_used_omap":13,"kb_used_meta":361970,"kb_avail":754594640,"statfs":{"total":773094113280,"available":772704911360,"internally_reserved":0,"allocated":18423808,"data_stored":9932812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":370657368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.843702"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143697+0000","last_change":"2023-07-20T11:06:23.168082+0000","last_active":"2023-07-20T11:06:24.143697+0000","last_peered":"2023-07-20T11:06:24.143697+0000","last_clean":"2023-07-20T11:06:24.143697+0000","last_became_active":"2023-07-20T11:06:23.167754+0000","last_became_peered":"2023-07-20T11:06:23.167754+0000","last_unstale":"2023-07-20T11:06:24.143697+0000","last_undegraded":"2023-07-20T11:06:24.143697+0000","last_fullsized":"2023-07-20T11:06:24.143697+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:40:51.346919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825512+0000","last_change":"2023-07-20T11:06:23.162569+0000","last_active":"2023-07-20T11:06:25.825512+0000","last_peered":"2023-07-20T11:06:25.825512+0000","last_clean":"2023-07-20T11:06:25.825512+0000","last_became_active":"2023-07-20T11:06:23.162067+0000","last_became_peered":"2023-07-20T11:06:23.162067+0000","last_unstale":"2023-07-20T11:06:25.825512+0000","last_undegraded":"2023-07-20T11:06:25.825512+0000","last_fullsized":"2023-07-20T11:06:25.825512+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:22:45.865668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825252+0000","last_change":"2023-07-20T11:06:23.168445+0000","last_active":"2023-07-20T11:06:25.825252+0000","last_peered":"2023-07-20T11:06:25.825252+0000","last_clean":"2023-07-20T11:06:25.825252+0000","last_became_active":"2023-07-20T11:06:23.168174+0000","last_became_peered":"2023-07-20T11:06:23.168174+0000","last_unstale":"2023-07-20T11:06:25.825252+0000","last_undegraded":"2023-07-20T11:06:25.825252+0000","last_fullsized":"2023-07-20T11:06:25.825252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:42:00.363758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942869+0000","last_change":"2023-07-20T11:06:23.153389+0000","last_active":"2023-07-20T11:06:24.942869+0000","last_peered":"2023-07-20T11:06:24.942869+0000","last_clean":"2023-07-20T11:06:24.942869+0000","last_became_active":"2023-07-20T11:06:23.153046+0000","last_became_peered":"2023-07-20T11:06:23.153046+0000","last_unstale":"2023-07-20T11:06:24.942869+0000","last_undegraded":"2023-07-20T11:06:24.942869+0000","last_fullsized":"2023-07-20T11:06:24.942869+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:24:17.618719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140590+0000","last_change":"2023-07-20T11:06:23.148064+0000","last_active":"2023-07-20T11:06:24.140590+0000","last_peered":"2023-07-20T11:06:24.140590+0000","last_clean":"2023-07-20T11:06:24.140590+0000","last_became_active":"2023-07-20T11:06:23.147812+0000","last_became_peered":"2023-07-20T11:06:23.147812+0000","last_unstale":"2023-07-20T11:06:24.140590+0000","last_undegraded":"2023-07-20T11:06:24.140590+0000","last_fullsized":"2023-07-20T11:06:24.140590+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:13:46.663875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140730+0000","last_change":"2023-07-20T11:06:23.146803+0000","last_active":"2023-07-20T11:06:24.140730+0000","last_peered":"2023-07-20T11:06:24.140730+0000","last_clean":"2023-07-20T11:06:24.140730+0000","last_became_active":"2023-07-20T11:06:23.146525+0000","last_became_peered":"2023-07-20T11:06:23.146525+0000","last_unstale":"2023-07-20T11:06:24.140730+0000","last_undegraded":"2023-07-20T11:06:24.140730+0000","last_fullsized":"2023-07-20T11:06:24.140730+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:19:17.778177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143484+0000","last_change":"2023-07-20T11:06:23.151734+0000","last_active":"2023-07-20T11:06:24.143484+0000","last_peered":"2023-07-20T11:06:24.143484+0000","last_clean":"2023-07-20T11:06:24.143484+0000","last_became_active":"2023-07-20T11:06:23.151403+0000","last_became_peered":"2023-07-20T11:06:23.151403+0000","last_unstale":"2023-07-20T11:06:24.143484+0000","last_undegraded":"2023-07-20T11:06:24.143484+0000","last_fullsized":"2023-07-20T11:06:24.143484+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:54.246475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143549+0000","last_change":"2023-07-20T11:06:23.174196+0000","last_active":"2023-07-20T11:06:24.143549+0000","last_peered":"2023-07-20T11:06:24.143549+0000","last_clean":"2023-07-20T11:06:24.143549+0000","last_became_active":"2023-07-20T11:06:23.173805+0000","last_became_peered":"2023-07-20T11:06:23.173805+0000","last_unstale":"2023-07-20T11:06:24.143549+0000","last_undegraded":"2023-07-20T11:06:24.143549+0000","last_fullsized":"2023-07-20T11:06:24.143549+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:08:17.447552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140345+0000","last_change":"2023-07-20T11:06:23.158491+0000","last_active":"2023-07-20T11:06:24.140345+0000","last_peered":"2023-07-20T11:06:24.140345+0000","last_clean":"2023-07-20T11:06:24.140345+0000","last_became_active":"2023-07-20T11:06:23.158188+0000","last_became_peered":"2023-07-20T11:06:23.158188+0000","last_unstale":"2023-07-20T11:06:24.140345+0000","last_undegraded":"2023-07-20T11:06:24.140345+0000","last_fullsized":"2023-07-20T11:06:24.140345+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:22:24.209289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140750+0000","last_change":"2023-07-20T11:06:23.146577+0000","last_active":"2023-07-20T11:06:24.140750+0000","last_peered":"2023-07-20T11:06:24.140750+0000","last_clean":"2023-07-20T11:06:24.140750+0000","last_became_active":"2023-07-20T11:06:23.146285+0000","last_became_peered":"2023-07-20T11:06:23.146285+0000","last_unstale":"2023-07-20T11:06:24.140750+0000","last_undegraded":"2023-07-20T11:06:24.140750+0000","last_fullsized":"2023-07-20T11:06:24.140750+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:03:32.656748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824735+0000","last_change":"2023-07-20T11:06:23.165743+0000","last_active":"2023-07-20T11:06:25.824735+0000","last_peered":"2023-07-20T11:06:25.824735+0000","last_clean":"2023-07-20T11:06:25.824735+0000","last_became_active":"2023-07-20T11:06:23.165472+0000","last_became_peered":"2023-07-20T11:06:23.165472+0000","last_unstale":"2023-07-20T11:06:25.824735+0000","last_undegraded":"2023-07-20T11:06:25.824735+0000","last_fullsized":"2023-07-20T11:06:25.824735+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:07:32.657397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942925+0000","last_change":"2023-07-20T11:06:23.169657+0000","last_active":"2023-07-20T11:06:24.942925+0000","last_peered":"2023-07-20T11:06:24.942925+0000","last_clean":"2023-07-20T11:06:24.942925+0000","last_became_active":"2023-07-20T11:06:23.169316+0000","last_became_peered":"2023-07-20T11:06:23.169316+0000","last_unstale":"2023-07-20T11:06:24.942925+0000","last_undegraded":"2023-07-20T11:06:24.942925+0000","last_fullsized":"2023-07-20T11:06:24.942925+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:25:18.583338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140452+0000","last_change":"2023-07-20T11:06:23.148006+0000","last_active":"2023-07-20T11:06:24.140452+0000","last_peered":"2023-07-20T11:06:24.140452+0000","last_clean":"2023-07-20T11:06:24.140452+0000","last_became_active":"2023-07-20T11:06:23.147507+0000","last_became_peered":"2023-07-20T11:06:23.147507+0000","last_unstale":"2023-07-20T11:06:24.140452+0000","last_undegraded":"2023-07-20T11:06:24.140452+0000","last_fullsized":"2023-07-20T11:06:24.140452+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:13:30.493056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942737+0000","last_change":"2023-07-20T11:06:23.170578+0000","last_active":"2023-07-20T11:06:24.942737+0000","last_peered":"2023-07-20T11:06:24.942737+0000","last_clean":"2023-07-20T11:06:24.942737+0000","last_became_active":"2023-07-20T11:06:23.170252+0000","last_became_peered":"2023-07-20T11:06:23.170252+0000","last_unstale":"2023-07-20T11:06:24.942737+0000","last_undegraded":"2023-07-20T11:06:24.942737+0000","last_fullsized":"2023-07-20T11:06:24.942737+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:05:45.725065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824611+0000","last_change":"2023-07-20T11:06:23.167189+0000","last_active":"2023-07-20T11:06:25.824611+0000","last_peered":"2023-07-20T11:06:25.824611+0000","last_clean":"2023-07-20T11:06:25.824611+0000","last_became_active":"2023-07-20T11:06:23.166931+0000","last_became_peered":"2023-07-20T11:06:23.166931+0000","last_unstale":"2023-07-20T11:06:25.824611+0000","last_undegraded":"2023-07-20T11:06:25.824611+0000","last_fullsized":"2023-07-20T11:06:25.824611+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:06:03.661250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140098+0000","last_change":"2023-07-20T11:06:23.175410+0000","last_active":"2023-07-20T11:06:24.140098+0000","last_peered":"2023-07-20T11:06:24.140098+0000","last_clean":"2023-07-20T11:06:24.140098+0000","last_became_active":"2023-07-20T11:06:23.175100+0000","last_became_peered":"2023-07-20T11:06:23.175100+0000","last_unstale":"2023-07-20T11:06:24.140098+0000","last_undegraded":"2023-07-20T11:06:24.140098+0000","last_fullsized":"2023-07-20T11:06:24.140098+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:23:58.717427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943215+0000","last_change":"2023-07-20T11:06:23.152701+0000","last_active":"2023-07-20T11:06:24.943215+0000","last_peered":"2023-07-20T11:06:24.943215+0000","last_clean":"2023-07-20T11:06:24.943215+0000","last_became_active":"2023-07-20T11:06:23.152421+0000","last_became_peered":"2023-07-20T11:06:23.152421+0000","last_unstale":"2023-07-20T11:06:24.943215+0000","last_undegraded":"2023-07-20T11:06:24.943215+0000","last_fullsized":"2023-07-20T11:06:24.943215+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:42:54.581410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824995+0000","last_change":"2023-07-20T11:06:23.156733+0000","last_active":"2023-07-20T11:06:25.824995+0000","last_peered":"2023-07-20T11:06:25.824995+0000","last_clean":"2023-07-20T11:06:25.824995+0000","last_became_active":"2023-07-20T11:06:23.156290+0000","last_became_peered":"2023-07-20T11:06:23.156290+0000","last_unstale":"2023-07-20T11:06:25.824995+0000","last_undegraded":"2023-07-20T11:06:25.824995+0000","last_fullsized":"2023-07-20T11:06:25.824995+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:12:33.452769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351700+0000","last_change":"2023-07-20T11:06:23.175694+0000","last_active":"2023-07-20T11:06:24.351700+0000","last_peered":"2023-07-20T11:06:24.351700+0000","last_clean":"2023-07-20T11:06:24.351700+0000","last_became_active":"2023-07-20T11:06:23.175137+0000","last_became_peered":"2023-07-20T11:06:23.175137+0000","last_unstale":"2023-07-20T11:06:24.351700+0000","last_undegraded":"2023-07-20T11:06:24.351700+0000","last_fullsized":"2023-07-20T11:06:24.351700+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:11:35.071244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824646+0000","last_change":"2023-07-20T11:06:23.164097+0000","last_active":"2023-07-20T11:06:25.824646+0000","last_peered":"2023-07-20T11:06:25.824646+0000","last_clean":"2023-07-20T11:06:25.824646+0000","last_became_active":"2023-07-20T11:06:23.163805+0000","last_became_peered":"2023-07-20T11:06:23.163805+0000","last_unstale":"2023-07-20T11:06:25.824646+0000","last_undegraded":"2023-07-20T11:06:25.824646+0000","last_fullsized":"2023-07-20T11:06:25.824646+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:47:31.148967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140542+0000","last_change":"2023-07-20T11:06:23.159905+0000","last_active":"2023-07-20T11:06:24.140542+0000","last_peered":"2023-07-20T11:06:24.140542+0000","last_clean":"2023-07-20T11:06:24.140542+0000","last_became_active":"2023-07-20T11:06:23.159646+0000","last_became_peered":"2023-07-20T11:06:23.159646+0000","last_unstale":"2023-07-20T11:06:24.140542+0000","last_undegraded":"2023-07-20T11:06:24.140542+0000","last_fullsized":"2023-07-20T11:06:24.140542+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:07:04.916599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143690+0000","last_change":"2023-07-20T11:06:23.151330+0000","last_active":"2023-07-20T11:06:24.143690+0000","last_peered":"2023-07-20T11:06:24.143690+0000","last_clean":"2023-07-20T11:06:24.143690+0000","last_became_active":"2023-07-20T11:06:23.151026+0000","last_became_peered":"2023-07-20T11:06:23.151026+0000","last_unstale":"2023-07-20T11:06:24.143690+0000","last_undegraded":"2023-07-20T11:06:24.143690+0000","last_fullsized":"2023-07-20T11:06:24.143690+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:14.555703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144263+0000","last_change":"2023-07-20T11:06:23.170024+0000","last_active":"2023-07-20T11:06:24.144263+0000","last_peered":"2023-07-20T11:06:24.144263+0000","last_clean":"2023-07-20T11:06:24.144263+0000","last_became_active":"2023-07-20T11:06:23.169683+0000","last_became_peered":"2023-07-20T11:06:23.169683+0000","last_unstale":"2023-07-20T11:06:24.144263+0000","last_undegraded":"2023-07-20T11:06:24.144263+0000","last_fullsized":"2023-07-20T11:06:24.144263+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:12.859226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824246+0000","last_change":"2023-07-20T11:06:23.165896+0000","last_active":"2023-07-20T11:06:25.824246+0000","last_peered":"2023-07-20T11:06:25.824246+0000","last_clean":"2023-07-20T11:06:25.824246+0000","last_became_active":"2023-07-20T11:06:23.165593+0000","last_became_peered":"2023-07-20T11:06:23.165593+0000","last_unstale":"2023-07-20T11:06:25.824246+0000","last_undegraded":"2023-07-20T11:06:25.824246+0000","last_fullsized":"2023-07-20T11:06:25.824246+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:51:56.231773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144498+0000","last_change":"2023-07-20T11:06:23.149148+0000","last_active":"2023-07-20T11:06:24.144498+0000","last_peered":"2023-07-20T11:06:24.144498+0000","last_clean":"2023-07-20T11:06:24.144498+0000","last_became_active":"2023-07-20T11:06:23.148841+0000","last_became_peered":"2023-07-20T11:06:23.148841+0000","last_unstale":"2023-07-20T11:06:24.144498+0000","last_undegraded":"2023-07-20T11:06:24.144498+0000","last_fullsized":"2023-07-20T11:06:24.144498+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:30:15.357594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144252+0000","last_change":"2023-07-20T11:06:23.151972+0000","last_active":"2023-07-20T11:06:24.144252+0000","last_peered":"2023-07-20T11:06:24.144252+0000","last_clean":"2023-07-20T11:06:24.144252+0000","last_became_active":"2023-07-20T11:06:23.151635+0000","last_became_peered":"2023-07-20T11:06:23.151635+0000","last_unstale":"2023-07-20T11:06:24.144252+0000","last_undegraded":"2023-07-20T11:06:24.144252+0000","last_fullsized":"2023-07-20T11:06:24.144252+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:12.023783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140634+0000","last_change":"2023-07-20T11:06:23.158753+0000","last_active":"2023-07-20T11:06:24.140634+0000","last_peered":"2023-07-20T11:06:24.140634+0000","last_clean":"2023-07-20T11:06:24.140634+0000","last_became_active":"2023-07-20T11:06:23.158473+0000","last_became_peered":"2023-07-20T11:06:23.158473+0000","last_unstale":"2023-07-20T11:06:24.140634+0000","last_undegraded":"2023-07-20T11:06:24.140634+0000","last_fullsized":"2023-07-20T11:06:24.140634+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:37:12.140903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824515+0000","last_change":"2023-07-20T11:06:23.155472+0000","last_active":"2023-07-20T11:06:25.824515+0000","last_peered":"2023-07-20T11:06:25.824515+0000","last_clean":"2023-07-20T11:06:25.824515+0000","last_became_active":"2023-07-20T11:06:23.155143+0000","last_became_peered":"2023-07-20T11:06:23.155143+0000","last_unstale":"2023-07-20T11:06:25.824515+0000","last_undegraded":"2023-07-20T11:06:25.824515+0000","last_fullsized":"2023-07-20T11:06:25.824515+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:56.394136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144848+0000","last_change":"2023-07-20T11:06:23.172784+0000","last_active":"2023-07-20T11:06:24.144848+0000","last_peered":"2023-07-20T11:06:24.144848+0000","last_clean":"2023-07-20T11:06:24.144848+0000","last_became_active":"2023-07-20T11:06:23.172409+0000","last_became_peered":"2023-07-20T11:06:23.172409+0000","last_unstale":"2023-07-20T11:06:24.144848+0000","last_undegraded":"2023-07-20T11:06:24.144848+0000","last_fullsized":"2023-07-20T11:06:24.144848+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:46:49.168324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824475+0000","last_change":"2023-07-20T11:06:23.153459+0000","last_active":"2023-07-20T11:06:25.824475+0000","last_peered":"2023-07-20T11:06:25.824475+0000","last_clean":"2023-07-20T11:06:25.824475+0000","last_became_active":"2023-07-20T11:06:23.153175+0000","last_became_peered":"2023-07-20T11:06:23.153175+0000","last_unstale":"2023-07-20T11:06:25.824475+0000","last_undegraded":"2023-07-20T11:06:25.824475+0000","last_fullsized":"2023-07-20T11:06:25.824475+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:49:43.181973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140129+0000","last_change":"2023-07-20T11:06:23.167270+0000","last_active":"2023-07-20T11:06:24.140129+0000","last_peered":"2023-07-20T11:06:24.140129+0000","last_clean":"2023-07-20T11:06:24.140129+0000","last_became_active":"2023-07-20T11:06:23.166949+0000","last_became_peered":"2023-07-20T11:06:23.166949+0000","last_unstale":"2023-07-20T11:06:24.140129+0000","last_undegraded":"2023-07-20T11:06:24.140129+0000","last_fullsized":"2023-07-20T11:06:24.140129+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:52:39.697599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143679+0000","last_change":"2023-07-20T11:06:23.169540+0000","last_active":"2023-07-20T11:06:24.143679+0000","last_peered":"2023-07-20T11:06:24.143679+0000","last_clean":"2023-07-20T11:06:24.143679+0000","last_became_active":"2023-07-20T11:06:23.165178+0000","last_became_peered":"2023-07-20T11:06:23.165178+0000","last_unstale":"2023-07-20T11:06:24.143679+0000","last_undegraded":"2023-07-20T11:06:24.143679+0000","last_fullsized":"2023-07-20T11:06:24.143679+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:14:16.046016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825176+0000","last_change":"2023-07-20T11:06:23.165935+0000","last_active":"2023-07-20T11:06:25.825176+0000","last_peered":"2023-07-20T11:06:25.825176+0000","last_clean":"2023-07-20T11:06:25.825176+0000","last_became_active":"2023-07-20T11:06:23.165633+0000","last_became_peered":"2023-07-20T11:06:23.165633+0000","last_unstale":"2023-07-20T11:06:25.825176+0000","last_undegraded":"2023-07-20T11:06:25.825176+0000","last_fullsized":"2023-07-20T11:06:25.825176+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:24.768945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"171'4","reported_seq":17,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140580+0000","last_change":"2023-07-20T11:06:22.152923+0000","last_active":"2023-07-20T11:06:24.140580+0000","last_peered":"2023-07-20T11:06:24.140580+0000","last_clean":"2023-07-20T11:06:24.140580+0000","last_became_active":"2023-07-20T11:06:22.152666+0000","last_became_peered":"2023-07-20T11:06:22.152666+0000","last_unstale":"2023-07-20T11:06:24.140580+0000","last_undegraded":"2023-07-20T11:06:24.140580+0000","last_fullsized":"2023-07-20T11:06:24.140580+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:06:26.969300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825337+0000","last_change":"2023-07-20T11:06:23.162984+0000","last_active":"2023-07-20T11:06:25.825337+0000","last_peered":"2023-07-20T11:06:25.825337+0000","last_clean":"2023-07-20T11:06:25.825337+0000","last_became_active":"2023-07-20T11:06:23.162688+0000","last_became_peered":"2023-07-20T11:06:23.162688+0000","last_unstale":"2023-07-20T11:06:25.825337+0000","last_undegraded":"2023-07-20T11:06:25.825337+0000","last_fullsized":"2023-07-20T11:06:25.825337+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:28.674430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351414+0000","last_change":"2023-07-20T11:06:22.166871+0000","last_active":"2023-07-20T11:06:24.351414+0000","last_peered":"2023-07-20T11:06:24.351414+0000","last_clean":"2023-07-20T11:06:24.351414+0000","last_became_active":"2023-07-20T11:06:22.166392+0000","last_became_peered":"2023-07-20T11:06:22.166392+0000","last_unstale":"2023-07-20T11:06:24.351414+0000","last_undegraded":"2023-07-20T11:06:24.351414+0000","last_fullsized":"2023-07-20T11:06:24.351414+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:51:43.230220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145065+0000","last_change":"2023-07-20T11:06:23.170796+0000","last_active":"2023-07-20T11:06:24.145065+0000","last_peered":"2023-07-20T11:06:24.145065+0000","last_clean":"2023-07-20T11:06:24.145065+0000","last_became_active":"2023-07-20T11:06:23.165227+0000","last_became_peered":"2023-07-20T11:06:23.165227+0000","last_unstale":"2023-07-20T11:06:24.145065+0000","last_undegraded":"2023-07-20T11:06:24.145065+0000","last_fullsized":"2023-07-20T11:06:24.145065+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:46:04.461739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351664+0000","last_change":"2023-07-20T11:06:22.168648+0000","last_active":"2023-07-20T11:06:24.351664+0000","last_peered":"2023-07-20T11:06:24.351664+0000","last_clean":"2023-07-20T11:06:24.351664+0000","last_became_active":"2023-07-20T11:06:22.167647+0000","last_became_peered":"2023-07-20T11:06:22.167647+0000","last_unstale":"2023-07-20T11:06:24.351664+0000","last_undegraded":"2023-07-20T11:06:24.351664+0000","last_fullsized":"2023-07-20T11:06:24.351664+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:16:08.951777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351531+0000","last_change":"2023-07-20T11:06:23.159585+0000","last_active":"2023-07-20T11:06:24.351531+0000","last_peered":"2023-07-20T11:06:24.351531+0000","last_clean":"2023-07-20T11:06:24.351531+0000","last_became_active":"2023-07-20T11:06:23.156720+0000","last_became_peered":"2023-07-20T11:06:23.156720+0000","last_unstale":"2023-07-20T11:06:24.351531+0000","last_undegraded":"2023-07-20T11:06:24.351531+0000","last_fullsized":"2023-07-20T11:06:24.351531+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:34:45.441675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825239+0000","last_change":"2023-07-20T11:06:22.169809+0000","last_active":"2023-07-20T11:06:25.825239+0000","last_peered":"2023-07-20T11:06:25.825239+0000","last_clean":"2023-07-20T11:06:25.825239+0000","last_became_active":"2023-07-20T11:06:22.169478+0000","last_became_peered":"2023-07-20T11:06:22.169478+0000","last_unstale":"2023-07-20T11:06:25.825239+0000","last_undegraded":"2023-07-20T11:06:25.825239+0000","last_fullsized":"2023-07-20T11:06:25.825239+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:13:53.849210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824573+0000","last_change":"2023-07-20T11:06:23.148501+0000","last_active":"2023-07-20T11:06:25.824573+0000","last_peered":"2023-07-20T11:06:25.824573+0000","last_clean":"2023-07-20T11:06:25.824573+0000","last_became_active":"2023-07-20T11:06:23.148151+0000","last_became_peered":"2023-07-20T11:06:23.148151+0000","last_unstale":"2023-07-20T11:06:25.824573+0000","last_undegraded":"2023-07-20T11:06:25.824573+0000","last_fullsized":"2023-07-20T11:06:25.824573+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:39:39.246204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144925+0000","last_change":"2023-07-20T11:06:22.172794+0000","last_active":"2023-07-20T11:06:24.144925+0000","last_peered":"2023-07-20T11:06:24.144925+0000","last_clean":"2023-07-20T11:06:24.144925+0000","last_became_active":"2023-07-20T11:06:22.172527+0000","last_became_peered":"2023-07-20T11:06:22.172527+0000","last_unstale":"2023-07-20T11:06:24.144925+0000","last_undegraded":"2023-07-20T11:06:24.144925+0000","last_fullsized":"2023-07-20T11:06:24.144925+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:10:42.394903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943011+0000","last_change":"2023-07-20T11:06:23.163720+0000","last_active":"2023-07-20T11:06:24.943011+0000","last_peered":"2023-07-20T11:06:24.943011+0000","last_clean":"2023-07-20T11:06:24.943011+0000","last_became_active":"2023-07-20T11:06:23.163155+0000","last_became_peered":"2023-07-20T11:06:23.163155+0000","last_unstale":"2023-07-20T11:06:24.943011+0000","last_undegraded":"2023-07-20T11:06:24.943011+0000","last_fullsized":"2023-07-20T11:06:24.943011+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:50.960460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140513+0000","last_change":"2023-07-20T11:06:22.157450+0000","last_active":"2023-07-20T11:06:24.140513+0000","last_peered":"2023-07-20T11:06:24.140513+0000","last_clean":"2023-07-20T11:06:24.140513+0000","last_became_active":"2023-07-20T11:06:22.157178+0000","last_became_peered":"2023-07-20T11:06:22.157178+0000","last_unstale":"2023-07-20T11:06:24.140513+0000","last_undegraded":"2023-07-20T11:06:24.140513+0000","last_fullsized":"2023-07-20T11:06:24.140513+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:12.649055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824478+0000","last_change":"2023-07-20T11:06:23.165451+0000","last_active":"2023-07-20T11:06:25.824478+0000","last_peered":"2023-07-20T11:06:25.824478+0000","last_clean":"2023-07-20T11:06:25.824478+0000","last_became_active":"2023-07-20T11:06:23.165179+0000","last_became_peered":"2023-07-20T11:06:23.165179+0000","last_unstale":"2023-07-20T11:06:25.824478+0000","last_undegraded":"2023-07-20T11:06:25.824478+0000","last_fullsized":"2023-07-20T11:06:25.824478+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:39.049638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143596+0000","last_change":"2023-07-20T11:06:22.160798+0000","last_active":"2023-07-20T11:06:24.143596+0000","last_peered":"2023-07-20T11:06:24.143596+0000","last_clean":"2023-07-20T11:06:24.143596+0000","last_became_active":"2023-07-20T11:06:22.160411+0000","last_became_peered":"2023-07-20T11:06:22.160411+0000","last_unstale":"2023-07-20T11:06:24.143596+0000","last_undegraded":"2023-07-20T11:06:24.143596+0000","last_fullsized":"2023-07-20T11:06:24.143596+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:35.608914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143719+0000","last_change":"2023-07-20T11:06:23.167772+0000","last_active":"2023-07-20T11:06:24.143719+0000","last_peered":"2023-07-20T11:06:24.143719+0000","last_clean":"2023-07-20T11:06:24.143719+0000","last_became_active":"2023-07-20T11:06:23.167425+0000","last_became_peered":"2023-07-20T11:06:23.167425+0000","last_unstale":"2023-07-20T11:06:24.143719+0000","last_undegraded":"2023-07-20T11:06:24.143719+0000","last_fullsized":"2023-07-20T11:06:24.143719+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:03:27.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140285+0000","last_change":"2023-07-20T11:06:22.160767+0000","last_active":"2023-07-20T11:06:24.140285+0000","last_peered":"2023-07-20T11:06:24.140285+0000","last_clean":"2023-07-20T11:06:24.140285+0000","last_became_active":"2023-07-20T11:06:22.160460+0000","last_became_peered":"2023-07-20T11:06:22.160460+0000","last_unstale":"2023-07-20T11:06:24.140285+0000","last_undegraded":"2023-07-20T11:06:24.140285+0000","last_fullsized":"2023-07-20T11:06:24.140285+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:55.189409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351317+0000","last_change":"2023-07-20T11:06:23.169783+0000","last_active":"2023-07-20T11:06:24.351317+0000","last_peered":"2023-07-20T11:06:24.351317+0000","last_clean":"2023-07-20T11:06:24.351317+0000","last_became_active":"2023-07-20T11:06:23.169514+0000","last_became_peered":"2023-07-20T11:06:23.169514+0000","last_unstale":"2023-07-20T11:06:24.351317+0000","last_undegraded":"2023-07-20T11:06:24.351317+0000","last_fullsized":"2023-07-20T11:06:24.351317+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:25.028213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825080+0000","last_change":"2023-07-20T11:06:22.164768+0000","last_active":"2023-07-20T11:06:25.825080+0000","last_peered":"2023-07-20T11:06:25.825080+0000","last_clean":"2023-07-20T11:06:25.825080+0000","last_became_active":"2023-07-20T11:06:22.164414+0000","last_became_peered":"2023-07-20T11:06:22.164414+0000","last_unstale":"2023-07-20T11:06:25.825080+0000","last_undegraded":"2023-07-20T11:06:25.825080+0000","last_fullsized":"2023-07-20T11:06:25.825080+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:51:11.541791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351600+0000","last_change":"2023-07-20T11:06:23.175427+0000","last_active":"2023-07-20T11:06:24.351600+0000","last_peered":"2023-07-20T11:06:24.351600+0000","last_clean":"2023-07-20T11:06:24.351600+0000","last_became_active":"2023-07-20T11:06:23.174740+0000","last_became_peered":"2023-07-20T11:06:23.174740+0000","last_unstale":"2023-07-20T11:06:24.351600+0000","last_undegraded":"2023-07-20T11:06:24.351600+0000","last_fullsized":"2023-07-20T11:06:24.351600+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:50:28.626084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351466+0000","last_change":"2023-07-20T11:06:22.166651+0000","last_active":"2023-07-20T11:06:24.351466+0000","last_peered":"2023-07-20T11:06:24.351466+0000","last_clean":"2023-07-20T11:06:24.351466+0000","last_became_active":"2023-07-20T11:06:22.166060+0000","last_became_peered":"2023-07-20T11:06:22.166060+0000","last_unstale":"2023-07-20T11:06:24.351466+0000","last_undegraded":"2023-07-20T11:06:24.351466+0000","last_fullsized":"2023-07-20T11:06:24.351466+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:45:38.758915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144398+0000","last_change":"2023-07-20T11:06:23.157042+0000","last_active":"2023-07-20T11:06:24.144398+0000","last_peered":"2023-07-20T11:06:24.144398+0000","last_clean":"2023-07-20T11:06:24.144398+0000","last_became_active":"2023-07-20T11:06:23.156764+0000","last_became_peered":"2023-07-20T11:06:23.156764+0000","last_unstale":"2023-07-20T11:06:24.144398+0000","last_undegraded":"2023-07-20T11:06:24.144398+0000","last_fullsized":"2023-07-20T11:06:24.144398+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:52:23.560264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"171'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825339+0000","last_change":"2023-07-20T11:06:22.157550+0000","last_active":"2023-07-20T11:06:25.825339+0000","last_peered":"2023-07-20T11:06:25.825339+0000","last_clean":"2023-07-20T11:06:25.825339+0000","last_became_active":"2023-07-20T11:06:22.157229+0000","last_became_peered":"2023-07-20T11:06:22.157229+0000","last_unstale":"2023-07-20T11:06:25.825339+0000","last_undegraded":"2023-07-20T11:06:25.825339+0000","last_fullsized":"2023-07-20T11:06:25.825339+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:20:16.477712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144477+0000","last_change":"2023-07-20T11:06:23.159274+0000","last_active":"2023-07-20T11:06:24.144477+0000","last_peered":"2023-07-20T11:06:24.144477+0000","last_clean":"2023-07-20T11:06:24.144477+0000","last_became_active":"2023-07-20T11:06:23.159006+0000","last_became_peered":"2023-07-20T11:06:23.159006+0000","last_unstale":"2023-07-20T11:06:24.144477+0000","last_undegraded":"2023-07-20T11:06:24.144477+0000","last_fullsized":"2023-07-20T11:06:24.144477+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:03.836394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943164+0000","last_change":"2023-07-20T11:06:22.173766+0000","last_active":"2023-07-20T11:06:24.943164+0000","last_peered":"2023-07-20T11:06:24.943164+0000","last_clean":"2023-07-20T11:06:24.943164+0000","last_became_active":"2023-07-20T11:06:22.173484+0000","last_became_peered":"2023-07-20T11:06:22.173484+0000","last_unstale":"2023-07-20T11:06:24.943164+0000","last_undegraded":"2023-07-20T11:06:24.943164+0000","last_fullsized":"2023-07-20T11:06:24.943164+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:46:48.762428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351352+0000","last_change":"2023-07-20T11:06:23.175629+0000","last_active":"2023-07-20T11:06:24.351352+0000","last_peered":"2023-07-20T11:06:24.351352+0000","last_clean":"2023-07-20T11:06:24.351352+0000","last_became_active":"2023-07-20T11:06:23.175334+0000","last_became_peered":"2023-07-20T11:06:23.175334+0000","last_unstale":"2023-07-20T11:06:24.351352+0000","last_undegraded":"2023-07-20T11:06:24.351352+0000","last_fullsized":"2023-07-20T11:06:24.351352+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:58:44.362905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824951+0000","last_change":"2023-07-20T11:06:22.170026+0000","last_active":"2023-07-20T11:06:25.824951+0000","last_peered":"2023-07-20T11:06:25.824951+0000","last_clean":"2023-07-20T11:06:25.824951+0000","last_became_active":"2023-07-20T11:06:22.169730+0000","last_became_peered":"2023-07-20T11:06:22.169730+0000","last_unstale":"2023-07-20T11:06:25.824951+0000","last_undegraded":"2023-07-20T11:06:25.824951+0000","last_fullsized":"2023-07-20T11:06:25.824951+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:16:33.062985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824848+0000","last_change":"2023-07-20T11:06:23.163524+0000","last_active":"2023-07-20T11:06:25.824848+0000","last_peered":"2023-07-20T11:06:25.824848+0000","last_clean":"2023-07-20T11:06:25.824848+0000","last_became_active":"2023-07-20T11:06:23.163248+0000","last_became_peered":"2023-07-20T11:06:23.163248+0000","last_unstale":"2023-07-20T11:06:25.824848+0000","last_undegraded":"2023-07-20T11:06:25.824848+0000","last_fullsized":"2023-07-20T11:06:25.824848+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:34:19.937457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144234+0000","last_change":"2023-07-20T11:06:22.165707+0000","last_active":"2023-07-20T11:06:24.144234+0000","last_peered":"2023-07-20T11:06:24.144234+0000","last_clean":"2023-07-20T11:06:24.144234+0000","last_became_active":"2023-07-20T11:06:22.164486+0000","last_became_peered":"2023-07-20T11:06:22.164486+0000","last_unstale":"2023-07-20T11:06:24.144234+0000","last_undegraded":"2023-07-20T11:06:24.144234+0000","last_fullsized":"2023-07-20T11:06:24.144234+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:17:20.605440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351379+0000","last_change":"2023-07-20T11:06:23.162545+0000","last_active":"2023-07-20T11:06:24.351379+0000","last_peered":"2023-07-20T11:06:24.351379+0000","last_clean":"2023-07-20T11:06:24.351379+0000","last_became_active":"2023-07-20T11:06:23.161908+0000","last_became_peered":"2023-07-20T11:06:23.161908+0000","last_unstale":"2023-07-20T11:06:24.351379+0000","last_undegraded":"2023-07-20T11:06:24.351379+0000","last_fullsized":"2023-07-20T11:06:24.351379+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:04.446712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824712+0000","last_change":"2023-07-20T11:06:22.169997+0000","last_active":"2023-07-20T11:06:25.824712+0000","last_peered":"2023-07-20T11:06:25.824712+0000","last_clean":"2023-07-20T11:06:25.824712+0000","last_became_active":"2023-07-20T11:06:22.169639+0000","last_became_peered":"2023-07-20T11:06:22.169639+0000","last_unstale":"2023-07-20T11:06:25.824712+0000","last_undegraded":"2023-07-20T11:06:25.824712+0000","last_fullsized":"2023-07-20T11:06:25.824712+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:45:41.509780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825101+0000","last_change":"2023-07-20T11:06:23.162425+0000","last_active":"2023-07-20T11:06:25.825101+0000","last_peered":"2023-07-20T11:06:25.825101+0000","last_clean":"2023-07-20T11:06:25.825101+0000","last_became_active":"2023-07-20T11:06:23.162085+0000","last_became_peered":"2023-07-20T11:06:23.162085+0000","last_unstale":"2023-07-20T11:06:25.825101+0000","last_undegraded":"2023-07-20T11:06:25.825101+0000","last_fullsized":"2023-07-20T11:06:25.825101+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:42:11.761745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143943+0000","last_change":"2023-07-20T11:06:22.169177+0000","last_active":"2023-07-20T11:06:24.143943+0000","last_peered":"2023-07-20T11:06:24.143943+0000","last_clean":"2023-07-20T11:06:24.143943+0000","last_became_active":"2023-07-20T11:06:22.168892+0000","last_became_peered":"2023-07-20T11:06:22.168892+0000","last_unstale":"2023-07-20T11:06:24.143943+0000","last_undegraded":"2023-07-20T11:06:24.143943+0000","last_fullsized":"2023-07-20T11:06:24.143943+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:36:04.067690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140418+0000","last_change":"2023-07-20T11:06:23.147658+0000","last_active":"2023-07-20T11:06:24.140418+0000","last_peered":"2023-07-20T11:06:24.140418+0000","last_clean":"2023-07-20T11:06:24.140418+0000","last_became_active":"2023-07-20T11:06:23.147402+0000","last_became_peered":"2023-07-20T11:06:23.147402+0000","last_unstale":"2023-07-20T11:06:24.140418+0000","last_undegraded":"2023-07-20T11:06:24.140418+0000","last_fullsized":"2023-07-20T11:06:24.140418+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:34:59.381040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943244+0000","last_change":"2023-07-20T11:06:22.170338+0000","last_active":"2023-07-20T11:06:24.943244+0000","last_peered":"2023-07-20T11:06:24.943244+0000","last_clean":"2023-07-20T11:06:24.943244+0000","last_became_active":"2023-07-20T11:06:22.169556+0000","last_became_peered":"2023-07-20T11:06:22.169556+0000","last_unstale":"2023-07-20T11:06:24.943244+0000","last_undegraded":"2023-07-20T11:06:24.943244+0000","last_fullsized":"2023-07-20T11:06:24.943244+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:07:12.404957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942881+0000","last_change":"2023-07-20T11:06:23.169920+0000","last_active":"2023-07-20T11:06:24.942881+0000","last_peered":"2023-07-20T11:06:24.942881+0000","last_clean":"2023-07-20T11:06:24.942881+0000","last_became_active":"2023-07-20T11:06:23.169385+0000","last_became_peered":"2023-07-20T11:06:23.169385+0000","last_unstale":"2023-07-20T11:06:24.942881+0000","last_undegraded":"2023-07-20T11:06:24.942881+0000","last_fullsized":"2023-07-20T11:06:24.942881+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:02:17.494864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"172'1","reported_seq":14,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144564+0000","last_change":"2023-07-20T11:06:22.166388+0000","last_active":"2023-07-20T11:06:24.144564+0000","last_peered":"2023-07-20T11:06:24.144564+0000","last_clean":"2023-07-20T11:06:24.144564+0000","last_became_active":"2023-07-20T11:06:22.166099+0000","last_became_peered":"2023-07-20T11:06:22.166099+0000","last_unstale":"2023-07-20T11:06:24.144564+0000","last_undegraded":"2023-07-20T11:06:24.144564+0000","last_fullsized":"2023-07-20T11:06:24.144564+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:19:00.424695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144410+0000","last_change":"2023-07-20T11:06:23.167829+0000","last_active":"2023-07-20T11:06:24.144410+0000","last_peered":"2023-07-20T11:06:24.144410+0000","last_clean":"2023-07-20T11:06:24.144410+0000","last_became_active":"2023-07-20T11:06:23.167501+0000","last_became_peered":"2023-07-20T11:06:23.167501+0000","last_unstale":"2023-07-20T11:06:24.144410+0000","last_undegraded":"2023-07-20T11:06:24.144410+0000","last_fullsized":"2023-07-20T11:06:24.144410+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:04.562198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825424+0000","last_change":"2023-07-20T11:06:22.169867+0000","last_active":"2023-07-20T11:06:25.825424+0000","last_peered":"2023-07-20T11:06:25.825424+0000","last_clean":"2023-07-20T11:06:25.825424+0000","last_became_active":"2023-07-20T11:06:22.169464+0000","last_became_peered":"2023-07-20T11:06:22.169464+0000","last_unstale":"2023-07-20T11:06:25.825424+0000","last_undegraded":"2023-07-20T11:06:25.825424+0000","last_fullsized":"2023-07-20T11:06:25.825424+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:57.132384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140488+0000","last_change":"2023-07-20T11:06:23.158665+0000","last_active":"2023-07-20T11:06:24.140488+0000","last_peered":"2023-07-20T11:06:24.140488+0000","last_clean":"2023-07-20T11:06:24.140488+0000","last_became_active":"2023-07-20T11:06:23.158368+0000","last_became_peered":"2023-07-20T11:06:23.158368+0000","last_unstale":"2023-07-20T11:06:24.140488+0000","last_undegraded":"2023-07-20T11:06:24.140488+0000","last_fullsized":"2023-07-20T11:06:24.140488+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:15:28.047284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140599+0000","last_change":"2023-07-20T11:06:22.170832+0000","last_active":"2023-07-20T11:06:24.140599+0000","last_peered":"2023-07-20T11:06:24.140599+0000","last_clean":"2023-07-20T11:06:24.140599+0000","last_became_active":"2023-07-20T11:06:22.170536+0000","last_became_peered":"2023-07-20T11:06:22.170536+0000","last_unstale":"2023-07-20T11:06:24.140599+0000","last_undegraded":"2023-07-20T11:06:24.140599+0000","last_fullsized":"2023-07-20T11:06:24.140599+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:57:18.756859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143964+0000","last_change":"2023-07-20T11:06:23.161057+0000","last_active":"2023-07-20T11:06:24.143964+0000","last_peered":"2023-07-20T11:06:24.143964+0000","last_clean":"2023-07-20T11:06:24.143964+0000","last_became_active":"2023-07-20T11:06:23.160774+0000","last_became_peered":"2023-07-20T11:06:23.160774+0000","last_unstale":"2023-07-20T11:06:24.143964+0000","last_undegraded":"2023-07-20T11:06:24.143964+0000","last_fullsized":"2023-07-20T11:06:24.143964+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:13.702546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143840+0000","last_change":"2023-07-20T11:06:22.166459+0000","last_active":"2023-07-20T11:06:24.143840+0000","last_peered":"2023-07-20T11:06:24.143840+0000","last_clean":"2023-07-20T11:06:24.143840+0000","last_became_active":"2023-07-20T11:06:22.166163+0000","last_became_peered":"2023-07-20T11:06:22.166163+0000","last_unstale":"2023-07-20T11:06:24.143840+0000","last_undegraded":"2023-07-20T11:06:24.143840+0000","last_fullsized":"2023-07-20T11:06:24.143840+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:29:40.769844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943281+0000","last_change":"2023-07-20T11:06:23.166887+0000","last_active":"2023-07-20T11:06:24.943281+0000","last_peered":"2023-07-20T11:06:24.943281+0000","last_clean":"2023-07-20T11:06:24.943281+0000","last_became_active":"2023-07-20T11:06:23.166333+0000","last_became_peered":"2023-07-20T11:06:23.166333+0000","last_unstale":"2023-07-20T11:06:24.943281+0000","last_undegraded":"2023-07-20T11:06:24.943281+0000","last_fullsized":"2023-07-20T11:06:24.943281+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:51:25.860909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824558+0000","last_change":"2023-07-20T11:06:22.170664+0000","last_active":"2023-07-20T11:06:25.824558+0000","last_peered":"2023-07-20T11:06:25.824558+0000","last_clean":"2023-07-20T11:06:25.824558+0000","last_became_active":"2023-07-20T11:06:22.170382+0000","last_became_peered":"2023-07-20T11:06:22.170382+0000","last_unstale":"2023-07-20T11:06:25.824558+0000","last_undegraded":"2023-07-20T11:06:25.824558+0000","last_fullsized":"2023-07-20T11:06:25.824558+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:27:20.091859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824602+0000","last_change":"2023-07-20T11:06:23.173688+0000","last_active":"2023-07-20T11:06:25.824602+0000","last_peered":"2023-07-20T11:06:25.824602+0000","last_clean":"2023-07-20T11:06:25.824602+0000","last_became_active":"2023-07-20T11:06:23.173254+0000","last_became_peered":"2023-07-20T11:06:23.173254+0000","last_unstale":"2023-07-20T11:06:25.824602+0000","last_undegraded":"2023-07-20T11:06:25.824602+0000","last_fullsized":"2023-07-20T11:06:25.824602+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:56:28.829587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143745+0000","last_change":"2023-07-20T11:06:22.160342+0000","last_active":"2023-07-20T11:06:24.143745+0000","last_peered":"2023-07-20T11:06:24.143745+0000","last_clean":"2023-07-20T11:06:24.143745+0000","last_became_active":"2023-07-20T11:06:22.160034+0000","last_became_peered":"2023-07-20T11:06:22.160034+0000","last_unstale":"2023-07-20T11:06:24.143745+0000","last_undegraded":"2023-07-20T11:06:24.143745+0000","last_fullsized":"2023-07-20T11:06:24.143745+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:07.234502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144802+0000","last_change":"2023-07-20T11:06:23.173357+0000","last_active":"2023-07-20T11:06:24.144802+0000","last_peered":"2023-07-20T11:06:24.144802+0000","last_clean":"2023-07-20T11:06:24.144802+0000","last_became_active":"2023-07-20T11:06:23.173015+0000","last_became_peered":"2023-07-20T11:06:23.173015+0000","last_unstale":"2023-07-20T11:06:24.144802+0000","last_undegraded":"2023-07-20T11:06:24.144802+0000","last_fullsized":"2023-07-20T11:06:24.144802+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:57:35.108715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351133+0000","last_change":"2023-07-20T11:06:22.165584+0000","last_active":"2023-07-20T11:06:24.351133+0000","last_peered":"2023-07-20T11:06:24.351133+0000","last_clean":"2023-07-20T11:06:24.351133+0000","last_became_active":"2023-07-20T11:06:22.165280+0000","last_became_peered":"2023-07-20T11:06:22.165280+0000","last_unstale":"2023-07-20T11:06:24.351133+0000","last_undegraded":"2023-07-20T11:06:24.351133+0000","last_fullsized":"2023-07-20T11:06:24.351133+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:48:21.450388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145238+0000","last_change":"2023-07-20T11:06:23.170848+0000","last_active":"2023-07-20T11:06:24.145238+0000","last_peered":"2023-07-20T11:06:24.145238+0000","last_clean":"2023-07-20T11:06:24.145238+0000","last_became_active":"2023-07-20T11:06:23.170488+0000","last_became_peered":"2023-07-20T11:06:23.170488+0000","last_unstale":"2023-07-20T11:06:24.145238+0000","last_undegraded":"2023-07-20T11:06:24.145238+0000","last_fullsized":"2023-07-20T11:06:24.145238+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:49:00.216599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"171'6","reported_seq":19,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824466+0000","last_change":"2023-07-20T11:06:22.170114+0000","last_active":"2023-07-20T11:06:25.824466+0000","last_peered":"2023-07-20T11:06:25.824466+0000","last_clean":"2023-07-20T11:06:25.824466+0000","last_became_active":"2023-07-20T11:06:22.169907+0000","last_became_peered":"2023-07-20T11:06:22.169907+0000","last_unstale":"2023-07-20T11:06:25.824466+0000","last_undegraded":"2023-07-20T11:06:25.824466+0000","last_fullsized":"2023-07-20T11:06:25.824466+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:14:19.434735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"160'271","reported_seq":1012,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351447+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:06:24.351447+0000","last_peered":"2023-07-20T11:06:24.351447+0000","last_clean":"2023-07-20T11:06:24.351447+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:06:24.351447+0000","last_undegraded":"2023-07-20T11:06:24.351447+0000","last_fullsized":"2023-07-20T11:06:24.351447+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:08:56.967294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":345,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143927+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:06:24.143927+0000","last_peered":"2023-07-20T11:06:24.143927+0000","last_clean":"2023-07-20T11:06:24.143927+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:06:24.143927+0000","last_undegraded":"2023-07-20T11:06:24.143927+0000","last_fullsized":"2023-07-20T11:06:24.143927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:52.893647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.145139+0000","last_change":"2023-07-20T11:06:23.164214+0000","last_active":"2023-07-20T11:06:24.145139+0000","last_peered":"2023-07-20T11:06:24.145139+0000","last_clean":"2023-07-20T11:06:24.145139+0000","last_became_active":"2023-07-20T11:06:23.163927+0000","last_became_peered":"2023-07-20T11:06:23.163927+0000","last_unstale":"2023-07-20T11:06:24.145139+0000","last_undegraded":"2023-07-20T11:06:24.145139+0000","last_fullsized":"2023-07-20T11:06:24.145139+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:28:11.607305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351632+0000","last_change":"2023-07-20T11:06:22.165378+0000","last_active":"2023-07-20T11:06:24.351632+0000","last_peered":"2023-07-20T11:06:24.351632+0000","last_clean":"2023-07-20T11:06:24.351632+0000","last_became_active":"2023-07-20T11:06:22.165116+0000","last_became_peered":"2023-07-20T11:06:22.165116+0000","last_unstale":"2023-07-20T11:06:24.351632+0000","last_undegraded":"2023-07-20T11:06:24.351632+0000","last_fullsized":"2023-07-20T11:06:24.351632+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:28:47.046634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":310,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351361+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:06:24.351361+0000","last_peered":"2023-07-20T11:06:24.351361+0000","last_clean":"2023-07-20T11:06:24.351361+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:06:24.351361+0000","last_undegraded":"2023-07-20T11:06:24.351361+0000","last_fullsized":"2023-07-20T11:06:24.351361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:13:12.542064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824857+0000","last_change":"2023-07-20T11:06:23.161925+0000","last_active":"2023-07-20T11:06:25.824857+0000","last_peered":"2023-07-20T11:06:25.824857+0000","last_clean":"2023-07-20T11:06:25.824857+0000","last_became_active":"2023-07-20T11:06:23.161577+0000","last_became_peered":"2023-07-20T11:06:23.161577+0000","last_unstale":"2023-07-20T11:06:25.824857+0000","last_undegraded":"2023-07-20T11:06:25.824857+0000","last_fullsized":"2023-07-20T11:06:25.824857+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:24:12.845716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.144526+0000","last_change":"2023-07-20T11:06:22.160281+0000","last_active":"2023-07-20T11:06:24.144526+0000","last_peered":"2023-07-20T11:06:24.144526+0000","last_clean":"2023-07-20T11:06:24.144526+0000","last_became_active":"2023-07-20T11:06:22.159991+0000","last_became_peered":"2023-07-20T11:06:22.159991+0000","last_unstale":"2023-07-20T11:06:24.144526+0000","last_undegraded":"2023-07-20T11:06:24.144526+0000","last_fullsized":"2023-07-20T11:06:24.144526+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:34.778622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824186+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:06:25.824186+0000","last_peered":"2023-07-20T11:06:25.824186+0000","last_clean":"2023-07-20T11:06:25.824186+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:06:25.824186+0000","last_undegraded":"2023-07-20T11:06:25.824186+0000","last_fullsized":"2023-07-20T11:06:25.824186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:35:28.262797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825117+0000","last_change":"2023-07-20T11:06:23.156572+0000","last_active":"2023-07-20T11:06:25.825117+0000","last_peered":"2023-07-20T11:06:25.825117+0000","last_clean":"2023-07-20T11:06:25.825117+0000","last_became_active":"2023-07-20T11:06:23.155889+0000","last_became_peered":"2023-07-20T11:06:23.155889+0000","last_unstale":"2023-07-20T11:06:25.825117+0000","last_undegraded":"2023-07-20T11:06:25.825117+0000","last_fullsized":"2023-07-20T11:06:25.825117+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:05:18.380971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"171'3","reported_seq":16,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824939+0000","last_change":"2023-07-20T11:06:22.151477+0000","last_active":"2023-07-20T11:06:25.824939+0000","last_peered":"2023-07-20T11:06:25.824939+0000","last_clean":"2023-07-20T11:06:25.824939+0000","last_became_active":"2023-07-20T11:06:22.151131+0000","last_became_peered":"2023-07-20T11:06:22.151131+0000","last_unstale":"2023-07-20T11:06:25.824939+0000","last_undegraded":"2023-07-20T11:06:25.824939+0000","last_fullsized":"2023-07-20T11:06:25.824939+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:41:14.200320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":345,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143792+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:06:24.143792+0000","last_peered":"2023-07-20T11:06:24.143792+0000","last_clean":"2023-07-20T11:06:24.143792+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:06:24.143792+0000","last_undegraded":"2023-07-20T11:06:24.143792+0000","last_fullsized":"2023-07-20T11:06:24.143792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:50:52.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143815+0000","last_change":"2023-07-20T11:06:23.168975+0000","last_active":"2023-07-20T11:06:24.143815+0000","last_peered":"2023-07-20T11:06:24.143815+0000","last_clean":"2023-07-20T11:06:24.143815+0000","last_became_active":"2023-07-20T11:06:23.164834+0000","last_became_peered":"2023-07-20T11:06:23.164834+0000","last_unstale":"2023-07-20T11:06:24.143815+0000","last_undegraded":"2023-07-20T11:06:24.143815+0000","last_fullsized":"2023-07-20T11:06:24.143815+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:48:07.696925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"171'2","reported_seq":15,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140629+0000","last_change":"2023-07-20T11:06:22.155150+0000","last_active":"2023-07-20T11:06:24.140629+0000","last_peered":"2023-07-20T11:06:24.140629+0000","last_clean":"2023-07-20T11:06:24.140629+0000","last_became_active":"2023-07-20T11:06:22.154891+0000","last_became_peered":"2023-07-20T11:06:22.154891+0000","last_unstale":"2023-07-20T11:06:24.140629+0000","last_undegraded":"2023-07-20T11:06:24.140629+0000","last_fullsized":"2023-07-20T11:06:24.140629+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:47:00.826847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":307,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825342+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:06:25.825342+0000","last_peered":"2023-07-20T11:06:25.825342+0000","last_clean":"2023-07-20T11:06:25.825342+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:06:25.825342+0000","last_undegraded":"2023-07-20T11:06:25.825342+0000","last_fullsized":"2023-07-20T11:06:25.825342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:03.163880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824733+0000","last_change":"2023-07-20T11:06:23.162479+0000","last_active":"2023-07-20T11:06:25.824733+0000","last_peered":"2023-07-20T11:06:25.824733+0000","last_clean":"2023-07-20T11:06:25.824733+0000","last_became_active":"2023-07-20T11:06:23.162173+0000","last_became_peered":"2023-07-20T11:06:23.162173+0000","last_unstale":"2023-07-20T11:06:25.824733+0000","last_undegraded":"2023-07-20T11:06:25.824733+0000","last_fullsized":"2023-07-20T11:06:25.824733+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:33:22.524188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.942949+0000","last_change":"2023-07-20T11:06:22.174226+0000","last_active":"2023-07-20T11:06:24.942949+0000","last_peered":"2023-07-20T11:06:24.942949+0000","last_clean":"2023-07-20T11:06:24.942949+0000","last_became_active":"2023-07-20T11:06:22.173929+0000","last_became_peered":"2023-07-20T11:06:22.173929+0000","last_unstale":"2023-07-20T11:06:24.942949+0000","last_undegraded":"2023-07-20T11:06:24.942949+0000","last_fullsized":"2023-07-20T11:06:24.942949+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:57.181727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":309,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.351747+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:06:24.351747+0000","last_peered":"2023-07-20T11:06:24.351747+0000","last_clean":"2023-07-20T11:06:24.351747+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:06:24.351747+0000","last_undegraded":"2023-07-20T11:06:24.351747+0000","last_fullsized":"2023-07-20T11:06:24.351747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:26:23.982858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.140424+0000","last_change":"2023-07-20T11:06:23.151648+0000","last_active":"2023-07-20T11:06:24.140424+0000","last_peered":"2023-07-20T11:06:24.140424+0000","last_clean":"2023-07-20T11:06:24.140424+0000","last_became_active":"2023-07-20T11:06:23.151348+0000","last_became_peered":"2023-07-20T11:06:23.151348+0000","last_unstale":"2023-07-20T11:06:24.140424+0000","last_undegraded":"2023-07-20T11:06:24.140424+0000","last_fullsized":"2023-07-20T11:06:24.140424+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:01:27.903304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943150+0000","last_change":"2023-07-20T11:06:22.158522+0000","last_active":"2023-07-20T11:06:24.943150+0000","last_peered":"2023-07-20T11:06:24.943150+0000","last_clean":"2023-07-20T11:06:24.943150+0000","last_became_active":"2023-07-20T11:06:22.157878+0000","last_became_peered":"2023-07-20T11:06:22.157878+0000","last_unstale":"2023-07-20T11:06:24.943150+0000","last_undegraded":"2023-07-20T11:06:24.943150+0000","last_fullsized":"2023-07-20T11:06:24.943150+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:05:19.581459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":306,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.825456+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:06:25.825456+0000","last_peered":"2023-07-20T11:06:25.825456+0000","last_clean":"2023-07-20T11:06:25.825456+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:06:25.825456+0000","last_undegraded":"2023-07-20T11:06:25.825456+0000","last_fullsized":"2023-07-20T11:06:25.825456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:58:26.249680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:25.824984+0000","last_change":"2023-07-20T11:06:23.169998+0000","last_active":"2023-07-20T11:06:25.824984+0000","last_peered":"2023-07-20T11:06:25.824984+0000","last_clean":"2023-07-20T11:06:25.824984+0000","last_became_active":"2023-07-20T11:06:23.169736+0000","last_became_peered":"2023-07-20T11:06:23.169736+0000","last_unstale":"2023-07-20T11:06:25.824984+0000","last_undegraded":"2023-07-20T11:06:25.824984+0000","last_fullsized":"2023-07-20T11:06:25.824984+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":170,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:22.125957+0000","last_clean_scrub_stamp":"2023-07-20T11:06:22.125957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:05.971244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"171'8","reported_seq":21,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.143368+0000","last_change":"2023-07-20T11:06:22.162999+0000","last_active":"2023-07-20T11:06:24.143368+0000","last_peered":"2023-07-20T11:06:24.143368+0000","last_clean":"2023-07-20T11:06:24.143368+0000","last_became_active":"2023-07-20T11:06:22.162693+0000","last_became_peered":"2023-07-20T11:06:22.162693+0000","last_unstale":"2023-07-20T11:06:24.143368+0000","last_undegraded":"2023-07-20T11:06:24.143368+0000","last_fullsized":"2023-07-20T11:06:24.143368+0000","mapping_epoch":169,"log_start":"0'0","ondisk_log_start":"0'0","created":169,"last_epoch_clean":170,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:06:21.114074+0000","last_clean_scrub_stamp":"2023-07-20T11:06:21.114074+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:05:55.871470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-20T11:06:24.943284+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:06:24.943284+0000","last_peered":"2023-07-20T11:06:24.943284+0000","last_clean":"2023-07-20T11:06:24.943284+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:06:24.943284+0000","last_undegraded":"2023-07-20T11:06:24.943284+0000","last_fullsized":"2023-07-20T11:06:24.943284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:45:00.824060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575756,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47748,"kb_used_data":2680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324092,"statfs":{"total":96636764160,"available":96587870208,"internally_reserved":0,"allocated":2744320,"data_stored":1683809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.79700000000000004,"15min":0.78500000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95399999999999996,"5min":1.425,"15min":1.425},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.53000000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.79900000000000004,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.754,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.433},"max":{"1min":0.87,"5min":2.306,"15min":2.306},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78000000000000003,"15min":0.76400000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.042,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.754,"15min":0.74199999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50700000000000001},"max":{"1min":0.81899999999999995,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79300000000000004,"15min":0.77500000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94399999999999995,"5min":2.169,"15min":2.169},"last":0.997}]},{"osd":4,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.54900000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.34999999999999998},"max":{"1min":0.87,"5min":2.141,"15min":2.141},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67300000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.46500000000000002,"15min":0.38700000000000001},"max":{"1min":0.90300000000000002,"5min":2.2789999999999999,"15min":2.2789999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.624,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.379},"max":{"1min":0.879,"5min":2.206,"15min":2.206},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":1.0149999999999999,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.81899999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:05:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73099999999999998,"15min":0.70799999999999996},"min":{"1min":0.60099999999999998,"5min":0.50800000000000001,"15min":0.48499999999999999},"max":{"1min":0.97899999999999998,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70499999999999996,"15min":0.69099999999999995},"min":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.93899999999999995,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.64300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575758,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41408,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330432,"statfs":{"total":96636764160,"available":96594362368,"internally_reserved":0,"allocated":2150400,"data_stored":1093489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76600000000000001,"15min":0.76100000000000001},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.41699999999999998},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0449999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.46100000000000002},"max":{"1min":0.93200000000000005,"5min":0.98499999999999999,"15min":1.0229999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51300000000000001,"5min":0.48299999999999998,"15min":0.36599999999999999},"max":{"1min":0.84799999999999998,"5min":0.98099999999999998,"15min":1.006},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.73599999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.86199999999999999,"5min":0.95099999999999996,"15min":1.022},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":1.0229999999999999,"15min":1.0389999999999999},"last":0.752},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.497},"max":{"1min":0.87,"5min":1.014,"15min":1.014},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.755,"15min":0.751},"min":{"1min":0.53000000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.90000000000000002,"5min":0.96899999999999997,"15min":0.996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.55200000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.88700000000000001,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.501,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.61199999999999999,"15min":0.60499999999999998},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.98799999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.96299999999999997},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:05:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.90600000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.63300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55356,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94316484,"statfs":{"total":96636764160,"available":96580079616,"internally_reserved":0,"allocated":2146304,"data_stored":1093419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54524171},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.71799999999999997},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.996,"15min":1.171},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":1.028},"last":0.67000000000000004}]},{"osd":1,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75600000000000001,"15min":0.73499999999999999},"min":{"1min":0.57199999999999995,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.754},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.73099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":1.117},"last":0.85899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.755},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93200000000000005,"5min":1.012,"15min":1.0429999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.59599999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95999999999999996,"5min":0.96499999999999997,"15min":1.081},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79100000000000004,"15min":0.77100000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.98499999999999999,"5min":1.0389999999999999,"15min":1.196},"last":0.80400000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":1.0169999999999999,"15min":1.0449999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.87,"5min":0.93100000000000005,"15min":1.147},"last":0.621}]},{"osd":6,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41299999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.262},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.65600000000000003},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.44500000000000001},"max":{"1min":0.94899999999999995,"5min":0.96499999999999997,"15min":1.2270000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:05:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.55700000000000005,"5min":0.47599999999999998,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":1.2410000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.3129999999999999},"last":0.88200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575756,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37320,"kb_used_data":2108,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334520,"statfs":{"total":96636764160,"available":96598548480,"internally_reserved":0,"allocated":2158592,"data_stored":1094983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.92700000000000005,"15min":1.056},"last":0.376},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.58799999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95199999999999996,"5min":1.071,"15min":1.149},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.034},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.79900000000000004,"15min":0.79000000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.495},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.81499999999999995,"15min":0.82599999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.91700000000000004,"5min":1.115,"15min":1.115},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.52300000000000002,"15min":0.52000000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.0680000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77000000000000002},"min":{"1min":0.60799999999999998,"5min":0.52000000000000002,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.125},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85799999999999998,"5min":0.97399999999999998,"15min":1.077},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.70499999999999996},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.376},"max":{"1min":0.93600000000000005,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.77000000000000002,"15min":0.76100000000000001},"min":{"1min":0.64300000000000002,"5min":0.51900000000000002,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":1.048,"15min":1.125},"last":0.69599999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:05:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66600000000000004,"15min":0.65700000000000003},"min":{"1min":0.51400000000000001,"5min":0.43099999999999999,"15min":0.42299999999999999},"max":{"1min":0.90700000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.995,"5min":1.0629999999999999,"15min":1.0800000000000001},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":2154496,"data_stored":1094035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28699999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76300000000000001,"5min":0.81200000000000006,"15min":0.81499999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.59099999999999997,"5min":0.86899999999999999,"15min":0.98699999999999999},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.65900000000000003,"5min":0.72399999999999998,"15min":0.89300000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35199999999999998},"max":{"1min":0.70299999999999996,"5min":0.80100000000000005,"15min":0.89800000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.56100000000000005,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.37,"15min":0.37},"max":{"1min":0.65000000000000002,"5min":0.79200000000000004,"15min":0.93500000000000005},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.45800000000000002},"max":{"1min":1.0209999999999999,"5min":1.1100000000000001,"15min":1.456},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93600000000000005,"5min":1.1479999999999999,"15min":1.262},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.57599999999999996},"max":{"1min":0.96499999999999997,"5min":1.137,"15min":1.381},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.81599999999999995,"15min":0.82899999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93300000000000005,"5min":1.266,"15min":1.2729999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.83399999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.04,"5min":1.2010000000000001,"15min":1.298},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.80900000000000005,"15min":0.81100000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0029999999999999,"5min":1.1140000000000001,"15min":1.202},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:06:26 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93999999999999995,"5min":1.173,"15min":1.4219999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.83099999999999996,"15min":0.84299999999999997},"min":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.57699999999999996},"max":{"1min":1.0069999999999999,"5min":1.129,"15min":1.222},"last":0.84499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575755,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59460,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312380,"statfs":{"total":96636764160,"available":96575877120,"internally_reserved":0,"allocated":2154496,"data_stored":1093531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46800000000000003,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.82899999999999996,"15min":0.98599999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.78900000000000003,"15min":1.0109999999999999},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.755,"5min":0.89400000000000002,"15min":1.05},"last":0.502}]},{"osd":3,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58499999999999996,"15min":0.58699999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.373},"max":{"1min":0.755,"5min":0.82899999999999996,"15min":1.115},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.40400000000000003,"5min":0.39300000000000002,"15min":0.38400000000000001},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.70999999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57299999999999995,"5min":0.53200000000000003,"15min":0.51600000000000001},"max":{"1min":1.0880000000000001,"5min":1.1919999999999999,"15min":1.202},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81699999999999995,"15min":0.82299999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.54600000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.266},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.127,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.83999999999999997,"15min":0.83299999999999996},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1040000000000001,"5min":1.3,"15min":1.3},"last":0.747}]},{"osd":6,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.83899999999999997,"15min":0.83999999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.052,"5min":1.2230000000000001,"15min":1.2609999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.85299999999999998,"15min":0.85099999999999998},"min":{"1min":0.623,"5min":0.623,"15min":0.60599999999999998},"max":{"1min":1.0880000000000001,"5min":1.139,"15min":1.3129999999999999},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.57299999999999995},"max":{"1min":1.147,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.85999999999999999,"15min":0.85599999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.58399999999999996},"max":{"1min":1.048,"5min":1.272,"15min":1.272},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575756,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37312,"kb_used_data":2100,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334528,"statfs":{"total":96636764160,"available":96598556672,"internally_reserved":0,"allocated":2150400,"data_stored":1093489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.498},"min":{"1min":0.318,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.82999999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.30499999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.66600000000000004,"5min":0.79800000000000004,"15min":0.82999999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.37},"max":{"1min":0.751,"5min":0.76200000000000001,"15min":0.84799999999999998},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.42499999999999999},"max":{"1min":0.79000000000000004,"5min":0.81499999999999995,"15min":0.89100000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80900000000000005},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77500000000000002,"15min":0.79000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.163,"15min":1.304},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0269999999999999,"5min":1.1419999999999999,"15min":1.2010000000000001},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1160000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0169999999999999,"5min":1.355,"15min":1.355},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81899999999999995,"15min":0.83399999999999996},"min":{"1min":0.55800000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1639999999999999,"5min":1.232,"15min":1.3129999999999999},"last":0.624}]},{"osd":7,"last update":"Thu Jul 20 11:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81000000000000005,"15min":0.83399999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.179,"15min":1.2749999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.82799999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.048,"5min":1.163,"15min":1.173},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42008,"kb_used_data":2700,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94329832,"statfs":{"total":96636764160,"available":96593747968,"internally_reserved":0,"allocated":2764800,"data_stored":1686057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.443,"15min":0.45000000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.27500000000000002},"max":{"1min":0.59499999999999997,"5min":0.76900000000000002,"15min":0.77400000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.33300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66900000000000004,"5min":0.78100000000000003,"15min":0.78500000000000003},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.318},"max":{"1min":0.72399999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.35699999999999998},"max":{"1min":0.73499999999999999,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.51800000000000002,"15min":0.52200000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.58799999999999997,"5min":0.80800000000000005,"15min":0.85399999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.64200000000000002,"5min":0.78700000000000003,"15min":0.85799999999999998},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":0.79400000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.49299999999999999},"max":{"1min":1.0469999999999999,"5min":1.2350000000000001,"15min":1.304},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.98199999999999998,"5min":1.0920000000000001,"15min":1.2729999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.58099999999999996,"5min":0.495,"15min":0.495},"max":{"1min":0.93100000000000005,"5min":1.0840000000000001,"15min":1.2190000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.0229999999999999,"5min":1.1910000000000001,"15min":1.296},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.80700000000000005,"15min":0.82799999999999996},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0429999999999999,"5min":1.147,"15min":1.242},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80500000000000005,"15min":0.80800000000000005},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97999999999999998,"5min":1.2170000000000001,"15min":1.381},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82699999999999996,"15min":0.84599999999999997},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.05,"5min":1.1970000000000001,"15min":1.306},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.89400000000000002,"5min":1.196,"15min":1.2350000000000001},"last":0.67900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:06:32.098 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T11:06:32.099 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T11:06:32.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 Processor -- start 2023-07-20T11:06:32.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 -- start start 2023-07-20T11:06:32.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7facb00ca5a0 0x7facb015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb0071950 con 0x7facb006f710 2023-07-20T11:06:32.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb015b230 con 0x7facb015ec90 2023-07-20T11:06:32.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.294+0000 7facb8537640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb015bad0 con 0x7facb00ca5a0 2023-07-20T11:06:32.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7facb006f710 0x7facb006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:49056/0 (socket says 172.21.15.82:49056) 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 -- 172.21.15.82:0/2210864734 learned_addr learned my addr 172.21.15.82:0/2210864734 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb5ad2640 1 --2- 172.21.15.82:0/2210864734 >> v2:172.21.15.183:3300/0 conn(0x7facb00ca5a0 0x7facb015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137239027 0 0) 0x7facb0071950 con 0x7facb006f710 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac9c003530 con 0x7facb006f710 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964780779 0 0) 0x7facb015b230 con 0x7facb015ec90 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb0071950 con 0x7facb015ec90 2023-07-20T11:06:32.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3089747675 0 0) 0x7fac9c003530 con 0x7facb006f710 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 >> v2:172.21.15.183:3300/0 conn(0x7facb00ca5a0 msgr2=0x7facb015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 --2- 172.21.15.82:0/2210864734 >> v2:172.21.15.183:3300/0 conn(0x7facb00ca5a0 0x7facb015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 >> v1:172.21.15.183:6789/0 conn(0x7facb015ec90 legacy=0x7facb015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb015b510 con 0x7facb006f710 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7facac001600 con 0x7facb006f710 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 >> v1:172.21.15.82:6789/0 conn(0x7facb006f710 legacy=0x7facb006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7fac9c004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac9c0047d0 0x7fac9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac9c0051e0 0x7fac9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb015bad0 con 0x7fac9c003c00 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00c110 con 0x7fac9c0047d0 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c00c2d0 con 0x7fac9c0051e0 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7fac9c004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb5ad2640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac9c0047d0 0x7fac9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb6ad4640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac9c0051e0 0x7fac9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 -- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac9c0051e0 msgr2=0x7fac9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac9c0051e0 0x7fac9c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 -- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac9c0047d0 msgr2=0x7fac9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac9c0047d0 0x7fac9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb62d3640 1 -- 172.21.15.82:0/2210864734 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c003530 con 0x7fac9c003c00 2023-07-20T11:06:32.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.298+0000 7facb6ad4640 1 -- 172.21.15.82:0/2210864734 reap_dead start 2023-07-20T11:06:32.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb62d3640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7fac9c004000 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7facac007f50 tx=0x7facac01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311d27851da7311f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac005ba0 con 0x7fac9c003c00 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac005d20 con 0x7fac9c003c00 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb52d1640 1 -- 172.21.15.82:0/2210864734 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0072b0 con 0x7fac9c003c00 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 msgr2=0x7fac9c004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7fac9c004000 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7facac007f50 tx=0x7facac01ca70 comp rx=0 tx=0).stop 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- 172.21.15.82:0/2210864734 shutdown_connections 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 --2- 172.21.15.82:0/2210864734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7fac9c004000 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- 172.21.15.82:0/2210864734 >> 172.21.15.82:0/2210864734 conn(0x7facb00cad50 msgr2=0x7facb00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:32.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- 172.21.15.82:0/2210864734 shutdown_connections 2023-07-20T11:06:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- 172.21.15.82:0/2210864734 wait complete. 2023-07-20T11:06:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 Processor -- start 2023-07-20T11:06:32.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.302+0000 7facb8537640 1 -- start start 2023-07-20T11:06:32.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb00b2b50 0x7facb01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 0x7facb00c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb01f55c0 con 0x7fac9c003c00 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00c76b0 con 0x7facb00b2b50 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0156e00 con 0x7facb00c6d30 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47758/0 (socket says 172.21.15.82:47758) 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 -- 172.21.15.82:0/231183521 learned_addr learned my addr 172.21.15.82:0/231183521 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb5ad2640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb00b2b50 0x7facb01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb6ad4640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 0x7facb00c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 -- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 msgr2=0x7facb00c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 0x7facb00c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 -- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb00b2b50 msgr2=0x7facb01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb00b2b50 0x7facb01568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 -- 172.21.15.82:0/231183521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00ab890 con 0x7fac9c003c00 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb6ad4640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 0x7facb00c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb62d3640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7facac007f50 tx=0x7fac9c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0b4070 con 0x7fac9c003c00 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac005e90 con 0x7fac9c003c00 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac007070 con 0x7fac9c003c00 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb00b3330 con 0x7fac9c003c00 2023-07-20T11:06:32.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb00b38f0 con 0x7fac9c003c00 2023-07-20T11:06:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb004da30 con 0x7fac9c003c00 2023-07-20T11:06:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.306+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7facac0071d0 con 0x7fac9c003c00 2023-07-20T11:06:32.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.310+0000 7faca6ffd640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 0x7fac94068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.310+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7facac11d8c0 con 0x7fac9c003c00 2023-07-20T11:06:32.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.310+0000 7facb5ad2640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 0x7fac94068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.310+0000 7facb5ad2640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 0x7fac94068890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb00b3c60 tx=0x7faca0009190 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.314+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facac0eab40 con 0x7fac9c003c00 2023-07-20T11:06:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.510+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7facb00c1540 con 0x7fac9c003c00 2023-07-20T11:06:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7faca6ffd640 1 -- 172.21.15.82:0/231183521 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+147 (secure 0 0 0) 0x7facac0ee160 con 0x7fac9c003c00 2023-07-20T11:06:32.501 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T11:06:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T11:06:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T11:06:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T11:06:32.501 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T11:06:32.502 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T11:06:32.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 msgr2=0x7fac94068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 0x7fac94068890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7facb00b3c60 tx=0x7faca0009190 comp rx=0 tx=0).stop 2023-07-20T11:06:32.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 msgr2=0x7facb00cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7facac007f50 tx=0x7fac9c005800 comp rx=0 tx=0).stop 2023-07-20T11:06:32.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 shutdown_connections 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fac940663d0 0x7fac94068890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7facb00c6d30 0x7facb00c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7facb00b2b50 0x7facb01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 --2- 172.21.15.82:0/231183521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac9c003c00 0x7facb00cdac0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 >> 172.21.15.82:0/231183521 conn(0x7facb00cad50 msgr2=0x7facb00af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 shutdown_connections 2023-07-20T11:06:32.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.518+0000 7facb8537640 1 -- 172.21.15.82:0/231183521 wait complete. 2023-07-20T11:06:32.521 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:06:32.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 Processor -- start 2023-07-20T11:06:32.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 -- start start 2023-07-20T11:06:32.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 0x7f35c40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40d16b0 con 0x7f35c40d0d10 2023-07-20T11:06:32.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40d31c0 con 0x7f35c40ce4c0 2023-07-20T11:06:32.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35cabba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40b3520 con 0x7f35c415cab0 2023-07-20T11:06:32.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c9157640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 0x7f35c40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c8956640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35bbfff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f35c40d0d10 0x7f35c40cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:33380/0 (socket says 172.21.15.82:33380) 2023-07-20T11:06:32.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35bbfff640 1 -- 172.21.15.82:0/466161423 learned_addr learned my addr 172.21.15.82:0/466161423 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c8956640 1 -- 172.21.15.82:0/466161423 >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 msgr2=0x7f35c40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c8956640 1 --2- 172.21.15.82:0/466161423 >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 0x7f35c40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c8956640 1 -- 172.21.15.82:0/466161423 >> v1:172.21.15.183:6789/0 conn(0x7f35c40d0d10 legacy=0x7f35c40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c8956640 1 -- 172.21.15.82:0/466161423 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40b2910 con 0x7f35c415cab0 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35bb7fe640 1 -- 172.21.15.82:0/466161423 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704468136 0 0) 0x7f35c40d16b0 con 0x7f35c40d0d10 2023-07-20T11:06:32.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.678+0000 7f35c9157640 1 --2- 172.21.15.82:0/466161423 >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 0x7f35c40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:32.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35c8956640 1 --2- 172.21.15.82:0/466161423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c40d0300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097c0 tx=0x7f35c001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b606bb648fd96074 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35bb7fe640 1 -- 172.21.15.82:0/466161423 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00ab600 con 0x7f35c415cab0 2023-07-20T11:06:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35bb7fe640 1 -- 172.21.15.82:0/466161423 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00a7050 con 0x7f35c415cab0 2023-07-20T11:06:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35bb7fe640 1 -- 172.21.15.82:0/466161423 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00ab980 con 0x7f35c415cab0 2023-07-20T11:06:32.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 -- 172.21.15.82:0/466161423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 msgr2=0x7f35c40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 --2- 172.21.15.82:0/466161423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c40d0300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35c00097c0 tx=0x7f35c001c450 comp rx=0 tx=0).stop 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 -- 172.21.15.82:0/466161423 shutdown_connections 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 --2- 172.21.15.82:0/466161423 >> v2:172.21.15.183:3300/0 conn(0x7f35c40ce4c0 0x7f35c40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 --2- 172.21.15.82:0/466161423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c40d0300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 -- 172.21.15.82:0/466161423 >> 172.21.15.82:0/466161423 conn(0x7f35c408c120 msgr2=0x7f35c409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 -- 172.21.15.82:0/466161423 shutdown_connections 2023-07-20T11:06:32.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.682+0000 7f35cabba640 1 -- 172.21.15.82:0/466161423 wait complete. 2023-07-20T11:06:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 Processor -- start 2023-07-20T11:06:32.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 -- start start 2023-07-20T11:06:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35c40d0d10 0x7f35c40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40ca710 con 0x7f35c40ce4c0 2023-07-20T11:06:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c7ea0 con 0x7f35c40d0d10 2023-07-20T11:06:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35cabba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40c8120 con 0x7f35c415cab0 2023-07-20T11:06:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47772/0 (socket says 172.21.15.82:47772) 2023-07-20T11:06:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 -- 172.21.15.82:0/3623187683 learned_addr learned my addr 172.21.15.82:0/3623187683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c9157640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35bbfff640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35c40d0d10 0x7f35c40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 -- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 msgr2=0x7f35c4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 -- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35c40d0d10 msgr2=0x7f35c40c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35c40d0d10 0x7f35c40c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 -- 172.21.15.82:0/3623187683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc009a70 con 0x7f35c40ce4c0 2023-07-20T11:06:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.686+0000 7f35c8956640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f35c001ab00 tx=0x7f35c00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0006e20 con 0x7f35c40ce4c0 2023-07-20T11:06:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0004030 con 0x7f35c40ce4c0 2023-07-20T11:06:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00043a0 con 0x7f35c40ce4c0 2023-07-20T11:06:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c0009420 con 0x7f35c40ce4c0 2023-07-20T11:06:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40c86e0 con 0x7f35c40ce4c0 2023-07-20T11:06:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c4073c70 con 0x7f35c40ce4c0 2023-07-20T11:06:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f35c00b2040 con 0x7f35c40ce4c0 2023-07-20T11:06:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 0x7f35b0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:32.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f35c011d2e0 con 0x7f35c40ce4c0 2023-07-20T11:06:32.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35bbfff640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 0x7f35b0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:32.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.690+0000 7f35bbfff640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 0x7f35b0068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35c41587e0 tx=0x7f35b4007c10 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:32.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.694+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35c00ea450 con 0x7f35c40ce4c0 2023-07-20T11:06:32.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.874+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35c40d14f0 con 0x7f35c40ce4c0 2023-07-20T11:06:32.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.874+0000 7f35b97fa640 1 -- 172.21.15.82:0/3623187683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f35c00eda70 con 0x7f35c40ce4c0 2023-07-20T11:06:32.859 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:06:32.860 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:06:32.860 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:06:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 msgr2=0x7f35b0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 0x7f35b0068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f35c41587e0 tx=0x7f35b4007c10 comp rx=0 tx=0).stop 2023-07-20T11:06:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 msgr2=0x7f35c40b6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f35c001ab00 tx=0x7f35c00191f0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 shutdown_connections 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f35b00663a0 0x7f35b0068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f35c415cab0 0x7f35c4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35c40d0d10 0x7f35c40c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 --2- 172.21.15.82:0/3623187683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35c40ce4c0 0x7f35c40b6ed0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 >> 172.21.15.82:0/3623187683 conn(0x7f35c408c120 msgr2=0x7f35c40af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 shutdown_connections 2023-07-20T11:06:32.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:32.878+0000 7f35cabba640 1 -- 172.21.15.82:0/3623187683 wait complete. 2023-07-20T11:06:33.282 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T11:06:22.522877+0000', 'modified': '2023-07-20T11:06:26.168802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10167': {'gid': 10167, 'name': 'c', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/1027853129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 1027853129}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 1027853129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T11:06:33.282 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T11:06:33.283 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T11:06:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 Processor -- start 2023-07-20T11:06:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 -- start start 2023-07-20T11:06:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87201596b0 0x7f872015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f87200cc900 0x7f87200ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87200ccd90 con 0x7f87200b2380 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200ad600 con 0x7f87201596b0 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8725bba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87200ad810 con 0x7f87200cc900 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f87201596b0 0x7f872015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871ffff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f87200b2380 0x7f87200c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39664/0 (socket says 172.21.15.82:39664) 2023-07-20T11:06:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871ffff640 1 -- 172.21.15.82:0/911171567 learned_addr learned my addr 172.21.15.82:0/911171567 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:33.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f8717fff640 1 --2- 172.21.15.82:0/911171567 >> v2:172.21.15.183:3300/0 conn(0x7f87200cc900 0x7f87200ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871effd640 1 -- 172.21.15.82:0/911171567 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691387395 0 0) 0x7f87200ccd90 con 0x7f87200b2380 2023-07-20T11:06:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871effd640 1 -- 172.21.15.82:0/911171567 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f870c003530 con 0x7f87200b2380 2023-07-20T11:06:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871f7fe640 1 -- 172.21.15.82:0/911171567 >> v2:172.21.15.183:3300/0 conn(0x7f87200cc900 msgr2=0x7f87200ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871f7fe640 1 --2- 172.21.15.82:0/911171567 >> v2:172.21.15.183:3300/0 conn(0x7f87200cc900 0x7f87200ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871f7fe640 1 -- 172.21.15.82:0/911171567 >> v1:172.21.15.82:6789/0 conn(0x7f87200b2380 legacy=0x7f87200c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.442+0000 7f871f7fe640 1 -- 172.21.15.82:0/911171567 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872015d0d0 con 0x7f87201596b0 2023-07-20T11:06:33.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f871f7fe640 1 --2- 172.21.15.82:0/911171567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87201596b0 0x7f872015dbb0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f871001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49303d03d72bbf2e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f871effd640 1 -- 172.21.15.82:0/911171567 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100ab610 con 0x7f87201596b0 2023-07-20T11:06:33.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f871effd640 1 -- 172.21.15.82:0/911171567 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87100ab770 con 0x7f87201596b0 2023-07-20T11:06:33.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f871effd640 1 -- 172.21.15.82:0/911171567 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100abb00 con 0x7f87201596b0 2023-07-20T11:06:33.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 -- 172.21.15.82:0/911171567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87201596b0 msgr2=0x7f872015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 --2- 172.21.15.82:0/911171567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87201596b0 0x7f872015dbb0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f871001c410 comp rx=0 tx=0).stop 2023-07-20T11:06:33.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 -- 172.21.15.82:0/911171567 shutdown_connections 2023-07-20T11:06:33.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 --2- 172.21.15.82:0/911171567 >> v2:172.21.15.183:3300/0 conn(0x7f87200cc900 0x7f87200ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 --2- 172.21.15.82:0/911171567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87201596b0 0x7f872015dbb0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.446+0000 7f8725bba640 1 -- 172.21.15.82:0/911171567 >> 172.21.15.82:0/911171567 conn(0x7f87200cada0 msgr2=0x7f87200cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- 172.21.15.82:0/911171567 shutdown_connections 2023-07-20T11:06:33.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- 172.21.15.82:0/911171567 wait complete. 2023-07-20T11:06:33.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 Processor -- start 2023-07-20T11:06:33.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- start start 2023-07-20T11:06:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87200b2380 0x7f87200c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 0x7f87200c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720151a70 con 0x7f87200cc900 2023-07-20T11:06:33.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8720153a00 con 0x7f87200b2380 2023-07-20T11:06:33.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8725bba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8720155790 con 0x7f87201596b0 2023-07-20T11:06:33.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59416/0 (socket says 172.21.15.82:59416) 2023-07-20T11:06:33.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 -- 172.21.15.82:0/2991013582 learned_addr learned my addr 172.21.15.82:0/2991013582 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f871f7fe640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87200b2380 0x7f87200c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f871ffff640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 0x7f87200c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 -- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 msgr2=0x7f87200c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 0x7f87200c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 -- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87200b2380 msgr2=0x7f87200c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87200b2380 0x7f87200c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 -- 172.21.15.82:0/2991013582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009420 con 0x7f87200cc900 2023-07-20T11:06:33.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f871ffff640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 0x7f87200c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.450+0000 7f8717fff640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f870800d620 tx=0x7f870800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 -- 172.21.15.82:0/2991013582 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800b620 con 0x7f87200cc900 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 -- 172.21.15.82:0/2991013582 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800b780 con 0x7f87200cc900 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 -- 172.21.15.82:0/2991013582 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800bb10 con 0x7f87200cc900 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87200b2d20 con 0x7f87200cc900 2023-07-20T11:06:33.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87201554b0 con 0x7f87200cc900 2023-07-20T11:06:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 -- 172.21.15.82:0/2991013582 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f870800bc70 con 0x7f87200cc900 2023-07-20T11:06:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 0x7f8700068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871cff9640 1 -- 172.21.15.82:0/2991013582 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8708084420 con 0x7f87200cc900 2023-07-20T11:06:33.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f871f7fe640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 0x7f8700068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f8728f12000 1 Processor -- start 2023-07-20T11:06:33.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.454+0000 7f8728f12000 1 -- start start 2023-07-20T11:06:33.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f871f7fe640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 0x7f8700068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87100af000 tx=0x7f87100a7000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745403d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x557453ff3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453eba0a0 con 0x55745403d640 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453e48e40 con 0x557453ff2e90 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557453e46370 con 0x55745403cd20 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59420/0 (socket says 172.21.15.82:59420) 2023-07-20T11:06:33.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 -- 172.21.15.82:0/420110625 learned_addr learned my addr 172.21.15.82:0/420110625 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f871ffff640 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x557453ff3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f871f7fe640 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745403d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 -- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 msgr2=0x55745403d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745403d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 -- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 msgr2=0x557453ff3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x557453ff3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 -- 172.21.15.82:0/420110625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557453b3d890 con 0x55745403d640 2023-07-20T11:06:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8717fff640 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f870805d210 tx=0x7f870805d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c46015d3ef1053f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f87157fa640 1 -- 172.21.15.82:0/420110625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708053850 con 0x55745403d640 2023-07-20T11:06:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f87157fa640 1 -- 172.21.15.82:0/420110625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708059170 con 0x55745403d640 2023-07-20T11:06:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f87157fa640 1 -- 172.21.15.82:0/420110625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708051b00 con 0x55745403d640 2023-07-20T11:06:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- 172.21.15.82:0/420110625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 msgr2=0x557453ff2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f870805d210 tx=0x7f870805d740 comp rx=0 tx=0).stop 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- 172.21.15.82:0/420110625 shutdown_connections 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x557453ff3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x557453ff2950 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 --2- 172.21.15.82:0/420110625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745403d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- 172.21.15.82:0/420110625 >> 172.21.15.82:0/420110625 conn(0x557453fea200 msgr2=0x557453ff1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- 172.21.15.82:0/420110625 shutdown_connections 2023-07-20T11:06:33.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- 172.21.15.82:0/420110625 wait complete. 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 -- start start 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.458+0000 7f8728f12000 1 Processor -- start 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x557453ffe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x557453ffe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453e41c60 con 0x557453ff2e90 2023-07-20T11:06:33.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453dfdae0 con 0x55745403d640 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557453dfd780 con 0x55745403cd20 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 10 client.0 _ll_register_callbacks cb 0x557453fde820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59434/0 (socket says 172.21.15.82:59434) 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 -- 172.21.15.82:0/3970747171 learned_addr learned my addr 172.21.15.82:0/3970747171 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8717fff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x557453ffe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871ffff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x557453ffe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 -- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 msgr2=0x557453ffe400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x557453ffe400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 -- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 msgr2=0x557453ffe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x557453ffe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 -- 172.21.15.82:0/3970747171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87201554b0 con 0x557453ff2e90 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871ffff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x557453ffe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8717fff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x557453ffe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:33.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f871f7fe640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8710097ee0 tx=0x7f871001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709c9bf5b1157138 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100c2b70 con 0x557453ff2e90 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557453e01fb0 con 0x557453ff2e90 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f87100c2cd0 con 0x557453ff2e90 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87100c2e90 con 0x557453ff2e90 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 10 client.10350 fetch_fsmap learned FSMap version 82 2023-07-20T11:06:33.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x557453e05d10 con 0x557453ff2e90 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557453e01fb0 con 0x557453ff2e90 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 82) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f87100059a0 con 0x557453ff2e90 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 10 client.10350 fetch_fsmap finished waiting for FSMap version 82 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 10 client.10350 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 20 client.10350 populate_metadata read hostname 'smithi082' 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x557453fff210 0x55745404e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 4 client.10350 mds_command: new command op to 10167 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T11:06:33.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 --> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557453e70410 con 0x557453fff210 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8717fff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x557453fff210 0x55745404e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f8717fff640 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x557453fff210 0x55745404e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ca7f4bd3ae7524 server_cookie=cf2c2258f858ddb9 in_seq=0 out_seq=0 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.462+0000 7f86fe7fc640 10 client.10350 ms_handle_connect on v2:172.21.15.82:6835/1027853129 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f86fe7fc640 1 -- 172.21.15.82:0/3970747171 <== mds.0 v2:172.21.15.82:6835/1027853129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x557453e70410 con 0x557453fff210 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f86fe7fc640 10 client.10350 handle_command_reply: tid=0 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 client.10350 shutdown 2023-07-20T11:06:33.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 msgr2=0x557453ffdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f8710097ee0 tx=0x7f871001ac50 comp rx=0 tx=0).stop 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 shutdown_connections 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x557453fff210 0x55745404e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x557453ffe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x557453ffe400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f86fe7fc640 0 client.10350 ms_handle_reset on v2:172.21.15.82:6835/1027853129 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 --2- 172.21.15.82:0/3970747171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557453ff2e90 0x557453ffdec0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 >> 172.21.15.82:0/3970747171 conn(0x557453fea200 msgr2=0x557453ff1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 shutdown_connections 2023-07-20T11:06:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 1 -- 172.21.15.82:0/3970747171 wait complete. 2023-07-20T11:06:33.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.466+0000 7f8728f12000 20 client.10350 trim_cache size 0 max 16384 2023-07-20T11:06:33.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.478+0000 7f8728f12000 1 Processor -- start 2023-07-20T11:06:33.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.478+0000 7f8728f12000 1 -- start start 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 0x557453ff4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x55745403c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453afe940 con 0x55745403cd20 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453ffe7c0 con 0x55745403d640 2023-07-20T11:06:33.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557453e83e60 con 0x557453ff2e90 2023-07-20T11:06:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59448/0 (socket says 172.21.15.82:59448) 2023-07-20T11:06:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 -- 172.21.15.82:0/449327556 learned_addr learned my addr 172.21.15.82:0/449327556 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f871ffff640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x55745403c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f871f7fe640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 0x557453ff4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 -- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 msgr2=0x557453ff4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 0x557453ff4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 -- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 msgr2=0x55745403c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x55745403c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 -- 172.21.15.82:0/449327556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557453debfa0 con 0x55745403cd20 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f871f7fe640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 0x557453ff4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8717fff640 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f87080550f0 tx=0x7f8708084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431e1fd450fffab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8715ffb640 1 -- 172.21.15.82:0/449327556 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708059170 con 0x55745403cd20 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8715ffb640 1 -- 172.21.15.82:0/449327556 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870805b0e0 con 0x55745403cd20 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8715ffb640 1 -- 172.21.15.82:0/449327556 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870805b250 con 0x55745403cd20 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- 172.21.15.82:0/449327556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 msgr2=0x55745403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f87080550f0 tx=0x7f8708084050 comp rx=0 tx=0).stop 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- 172.21.15.82:0/449327556 shutdown_connections 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55745403d640 0x55745403c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403cd20 0x55745403bee0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 --2- 172.21.15.82:0/449327556 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x557453ff2e90 0x557453ff4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- 172.21.15.82:0/449327556 >> 172.21.15.82:0/449327556 conn(0x557453fea200 msgr2=0x55745403b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- 172.21.15.82:0/449327556 shutdown_connections 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- 172.21.15.82:0/449327556 wait complete. 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 -- start start 2023-07-20T11:06:33.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.482+0000 7f8728f12000 1 Processor -- start 2023-07-20T11:06:33.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x55745409ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745404ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453e07fe0 con 0x55745403d640 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x557453e45c60 con 0x557453ff2e90 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x557453ddea80 con 0x55745403cd20 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 10 client.0 _ll_register_callbacks cb 0x557453eb9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:06:33.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59450/0 (socket says 172.21.15.82:59450) 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871f7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x55745409ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 -- 172.21.15.82:0/525146591 learned_addr learned my addr 172.21.15.82:0/525146591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8717fff640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745404ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 -- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 msgr2=0x55745404ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745404ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 -- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 msgr2=0x55745409ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x55745409ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 -- 172.21.15.82:0/525146591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557453b3d890 con 0x55745403d640 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8717fff640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745404ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871ffff640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f87180073c0 tx=0x7f8718007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117d9480514e996 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718007ad0 con 0x55745403d640 2023-07-20T11:06:33.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8718013ac0 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557453ff2d20 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8718013c80 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 10 client.10356 fetch_fsmap learned FSMap version 82 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) v3 -- 0x557453b3dcc0 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557453ff2d20 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 82) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8718016450 con 0x55745403d640 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 10 client.10356 fetch_fsmap finished waiting for FSMap version 82 2023-07-20T11:06:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 10 client.10356 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 20 client.10356 populate_metadata read hostname 'smithi082' 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x55745404f4e0 0x55745404f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 4 client.10356 mds_command: new command op to 10167 tid=0[{"prefix": "status"}] 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 --> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557453e08a20 con 0x55745404f4e0 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871f7fe640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x55745404f4e0 0x55745404f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f871f7fe640 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x55745404f4e0 0x55745404f8c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77a353aca90979f9 server_cookie=3b588fe5f93d0aa8 in_seq=0 out_seq=0 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 10 client.10356 ms_handle_connect on v2:172.21.15.82:6835/1027853129 2023-07-20T11:06:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 1 -- 172.21.15.82:0/525146591 <== mds.0 v2:172.21.15.82:6835/1027853129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x557453e08a20 con 0x55745404f4e0 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 10 client.10356 handle_command_reply: tid=0 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 client.10356 shutdown 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 msgr2=0x55745404efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f87180073c0 tx=0x7f8718007880 comp rx=0 tx=0).stop 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 shutdown_connections 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:6835/1027853129,v1:172.21.15.82:6837/1027853129] conn(0x55745404f4e0 0x55745404f8c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55745403d640 0x55745404efa0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55745403cd20 0x55745404ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f86fe7fc640 0 client.10356 ms_handle_reset on v2:172.21.15.82:6835/1027853129 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 --2- 172.21.15.82:0/525146591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557453ff2e90 0x55745409ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 >> 172.21.15.82:0/525146591 conn(0x557453fea200 msgr2=0x557453ff7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 shutdown_connections 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 1 -- 172.21.15.82:0/525146591 wait complete. 2023-07-20T11:06:33.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8728f12000 20 client.10356 trim_cache size 0 max 16384 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 10167, 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T11:06:33.479 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.354480409000001, 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 82, 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 172, 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 172, 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.656935293 2023-07-20T11:06:33.480 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:06:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 msgr2=0x7f8700068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 0x7f8700068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87100af000 tx=0x7f87100a7000 comp rx=0 tx=0).stop 2023-07-20T11:06:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 msgr2=0x7f8720156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.486+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f870800d620 tx=0x7f870800dae0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 shutdown_connections 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f87000663a0 0x7f8700068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f87201596b0 0x7f87200c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87200cc900 0x7f8720156b00 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 --2- 172.21.15.82:0/2991013582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f87200b2380 0x7f87200c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 >> 172.21.15.82:0/2991013582 conn(0x7f87200cada0 msgr2=0x7f87200b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 shutdown_connections 2023-07-20T11:06:33.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.490+0000 7f8725bba640 1 -- 172.21.15.82:0/2991013582 wait complete. 2023-07-20T11:06:33.489 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T11:06:33.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 Processor -- start 2023-07-20T11:06:33.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 -- start start 2023-07-20T11:06:33.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b23c0 0x7fa18415c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1840cf4a0 con 0x7fa1840b1f30 2023-07-20T11:06:33.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18406ea80 con 0x7fa18406f350 2023-07-20T11:06:33.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa188ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840ce890 con 0x7fa1840b23c0 2023-07-20T11:06:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa179d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa1840b1f30 0x7fa18415c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39668/0 (socket says 172.21.15.82:39668) 2023-07-20T11:06:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa179d9b640 1 -- 172.21.15.82:0/1660352098 learned_addr learned my addr 172.21.15.82:0/1660352098 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa182d9d640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b23c0 0x7fa18415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580804438 0 0) 0x7fa1840cf4a0 con 0x7fa1840b1f30 2023-07-20T11:06:33.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa170003530 con 0x7fa1840b1f30 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652244805 0 0) 0x7fa18406ea80 con 0x7fa18406f350 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1840cf4a0 con 0x7fa18406f350 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 120884447 0 0) 0x7fa170003530 con 0x7fa1840b1f30 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b23c0 msgr2=0x7fa18415c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b23c0 0x7fa18415c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 >> v1:172.21.15.183:6789/0 conn(0x7fa18406f350 legacy=0x7fa18406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840ceb70 con 0x7fa1840b1f30 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fa16c001a00 con 0x7fa1840b1f30 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 >> v1:172.21.15.82:6789/0 conn(0x7fa1840b1f30 legacy=0x7fa18415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa170003b40 0x7fa170003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1700047d0 0x7fa170004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa17000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840ce890 con 0x7fa170005190 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17000c000 con 0x7fa1700047d0 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17000c1c0 con 0x7fa170003b40 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa182d9d640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa17000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa18259c640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa170003b40 0x7fa170003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.646+0000 7fa179d9b640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1700047d0 0x7fa170004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 -- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa170003b40 msgr2=0x7fa170003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa170003b40 0x7fa170003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 -- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1700047d0 msgr2=0x7fa170004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:33.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1700047d0 0x7fa170004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 -- 172.21.15.82:0/1660352098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa170003530 con 0x7fa170005190 2023-07-20T11:06:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa17000b990 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fa1840b27a0 tx=0x7fa17c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38fbef47647158d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0a5520 con 0x7fa170005190 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0a5680 con 0x7fa170005190 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa181d9b640 1 -- 172.21.15.82:0/1660352098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0a5a30 con 0x7fa170005190 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 -- 172.21.15.82:0/1660352098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 msgr2=0x7fa17000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 --2- 172.21.15.82:0/1660352098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa17000b990 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fa1840b27a0 tx=0x7fa17c01c930 comp rx=0 tx=0).stop 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa182d9d640 1 -- 172.21.15.82:0/1660352098 reap_dead start 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 -- 172.21.15.82:0/1660352098 shutdown_connections 2023-07-20T11:06:33.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 -- 172.21.15.82:0/1660352098 >> 172.21.15.82:0/1660352098 conn(0x7fa184089fa0 msgr2=0x7fa1840d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 -- 172.21.15.82:0/1660352098 shutdown_connections 2023-07-20T11:06:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.650+0000 7fa188ee5640 1 -- 172.21.15.82:0/1660352098 wait complete. 2023-07-20T11:06:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 Processor -- start 2023-07-20T11:06:33.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 -- start start 2023-07-20T11:06:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b3610 0x7fa1841f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1841f27b0 0x7fa184151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840b5810 con 0x7fa170005190 2023-07-20T11:06:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840b3a90 con 0x7fa1841f27b0 2023-07-20T11:06:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840b5c30 con 0x7fa1840b3610 2023-07-20T11:06:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59472/0 (socket says 172.21.15.82:59472) 2023-07-20T11:06:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 -- 172.21.15.82:0/2455905674 learned_addr learned my addr 172.21.15.82:0/2455905674 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 -- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b3610 msgr2=0x7fa1841f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b3610 0x7fa1841f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 -- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1841f27b0 msgr2=0x7fa184151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1841f27b0 0x7fa184151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 -- 172.21.15.82:0/2455905674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1840b4b90 con 0x7fa170005190 2023-07-20T11:06:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa18259c640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fa174012860 tx=0x7fa174012d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174007060 con 0x7fa170005190 2023-07-20T11:06:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa174010b10 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1840b4e70 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.654+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174010ec0 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1840b5430 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa184073c70 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa174016480 con 0x7fa170005190 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa17b7fe640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 0x7fa164068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa174087730 con 0x7fa170005190 2023-07-20T11:06:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa179d9b640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 0x7fa164068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.658+0000 7fa179d9b640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 0x7fa164068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa16c001570 tx=0x7fa16c001700 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.662+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa174054a50 con 0x7fa170005190 2023-07-20T11:06:33.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa184151f60 con 0x7fa170005190 2023-07-20T11:06:33.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa17b7fe640 1 -- 172.21.15.82:0/2455905674 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa174058070 con 0x7fa170005190 2023-07-20T11:06:33.825 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T11:06:33.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 msgr2=0x7fa164068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 0x7fa164068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa16c001570 tx=0x7fa16c001700 comp rx=0 tx=0).stop 2023-07-20T11:06:33.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 msgr2=0x7fa1840b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:33.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fa174012860 tx=0x7fa174012d20 comp rx=0 tx=0).stop 2023-07-20T11:06:33.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 shutdown_connections 2023-07-20T11:06:33.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fa1640663d0 0x7fa164068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa1841f27b0 0x7fa184151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa1840b3610 0x7fa1841f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 --2- 172.21.15.82:0/2455905674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa170005190 0x7fa1840b30d0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:33.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 >> 172.21.15.82:0/2455905674 conn(0x7fa184089fa0 msgr2=0x7fa1840ad360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:33.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 shutdown_connections 2023-07-20T11:06:33.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:33.842+0000 7fa188ee5640 1 -- 172.21.15.82:0/2455905674 wait complete. 2023-07-20T11:06:33.845 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T11:06:33.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T11:06:33.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T11:06:33.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T11:06:33.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T11:06:33.847 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T11:06:33.847 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T11:06:33.847 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T11:06:33.847 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:06:33.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:33.848 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T11:06:33.858 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T11:06:33.858 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T11:06:33.858 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T11:06:33.859 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T11:06:33.860 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 37807sec preferred_lft 37807sec 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.861 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T11:06:33.862 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T11:06:33.863 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.863 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:06:33.863 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T11:06:33.863 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T11:06:33.863 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:06:33.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:33.865 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T11:06:33.926 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T11:06:33.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:33.928 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T11:06:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T11:06:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T11:06:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T11:06:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T11:06:33.983 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T11:06:33.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:33.985 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T11:06:33.985 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T11:06:33.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T11:06:33.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T11:06:33.986 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T11:06:33.987 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T11:06:34.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:34.080 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:06:34.089 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T11:06:34.089 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T11:06:34.090 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:06:34.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:34.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T11:06:34.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:06:34.153 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T11:06:34.203 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:06:34.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:06:34.205 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:06:34.254 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T11:06:34.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:34.255 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:06:34.349 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:06:34.350 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:06:34.350 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:06:34.365 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:06:34.365 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:06:34.365 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:06:34.365 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:06:34.366 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:06:34.375 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:06:34.375 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:06:34.375 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:06:34.376 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:06:34.376 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:06:34.376 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T11:06:34.376 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T11:06:34.376 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T11:06:34.379 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T11:06:34.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:34.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:06:34.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:34.402 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T11:06:34.463 INFO:teuthology.orchestra.run.smithi082.stdout:client10365 2023-07-20T11:06:34.463 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:06:34.464 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:06:34.515 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T11:06:34.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 Processor -- start 2023-07-20T11:06:34.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 -- start start 2023-07-20T11:06:34.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd6415c5f0 0x7fdd640b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd640ccfb0 0x7fdd640ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdd640ce9a0 0x7fdd640b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640cee50 con 0x7fdd6415c5f0 2023-07-20T11:06:34.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640b7c20 con 0x7fdd640ce9a0 2023-07-20T11:06:34.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6415c9d0 con 0x7fdd640ccfb0 2023-07-20T11:06:34.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd6415c5f0 0x7fdd640b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdd6415c5f0 0x7fdd640b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59476/0 (socket says 172.21.15.82:59476) 2023-07-20T11:06:34.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 -- 172.21.15.82:0/59042858 learned_addr learned my addr 172.21.15.82:0/59042858 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:34.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd61d9b640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd640ccfb0 0x7fdd640ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd62d9d640 1 --2- 172.21.15.82:0/59042858 >> v2:172.21.15.183:3300/0 conn(0x7fdd640ce9a0 0x7fdd640b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 -- 172.21.15.82:0/59042858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd640ccfb0 msgr2=0x7fdd640ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:34.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd640ccfb0 0x7fdd640ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 -- 172.21.15.82:0/59042858 >> v2:172.21.15.183:3300/0 conn(0x7fdd640ce9a0 msgr2=0x7fdd640b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:34.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 --2- 172.21.15.82:0/59042858 >> v2:172.21.15.183:3300/0 conn(0x7fdd640ce9a0 0x7fdd640b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.714+0000 7fdd6259c640 1 -- 172.21.15.82:0/59042858 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640ce030 con 0x7fdd6415c5f0 2023-07-20T11:06:34.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6259c640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6415c5f0 0x7fdd640b4270 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fdd640b5460 tx=0x7fdd5401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23762877b6e1598 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:34.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6159a640 1 -- 172.21.15.82:0/59042858 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540af400 con 0x7fdd6415c5f0 2023-07-20T11:06:34.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6159a640 1 -- 172.21.15.82:0/59042858 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd540ab050 con 0x7fdd6415c5f0 2023-07-20T11:06:34.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6159a640 1 -- 172.21.15.82:0/59042858 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd540af780 con 0x7fdd6415c5f0 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 -- 172.21.15.82:0/59042858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6415c5f0 msgr2=0x7fdd640b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6415c5f0 0x7fdd640b4270 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fdd640b5460 tx=0x7fdd5401f1c0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 -- 172.21.15.82:0/59042858 shutdown_connections 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 --2- 172.21.15.82:0/59042858 >> v2:172.21.15.183:3300/0 conn(0x7fdd640ce9a0 0x7fdd640b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd640ccfb0 0x7fdd640ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 --2- 172.21.15.82:0/59042858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd6415c5f0 0x7fdd640b4270 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 -- 172.21.15.82:0/59042858 >> 172.21.15.82:0/59042858 conn(0x7fdd64065710 msgr2=0x7fdd64065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:34.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 -- 172.21.15.82:0/59042858 shutdown_connections 2023-07-20T11:06:34.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.718+0000 7fdd6359e640 1 -- 172.21.15.82:0/59042858 wait complete. 2023-07-20T11:06:34.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 Processor -- start 2023-07-20T11:06:34.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- start start 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd640ccfb0 0x7fdd640a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6415c5f0 0x7fdd640c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64158cc0 con 0x7fdd640ce9a0 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640c8cf0 con 0x7fdd640ccfb0 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64158040 con 0x7fdd6415c5f0 2023-07-20T11:06:34.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59490/0 (socket says 172.21.15.82:59490) 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 -- 172.21.15.82:0/2643971034 learned_addr learned my addr 172.21.15.82:0/2643971034 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd62d9d640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6415c5f0 0x7fdd640c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6259c640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd640ccfb0 0x7fdd640a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 -- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6415c5f0 msgr2=0x7fdd640c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6415c5f0 0x7fdd640c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 -- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd640ccfb0 msgr2=0x7fdd640a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd640ccfb0 0x7fdd640a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 -- 172.21.15.82:0/2643971034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54009b30 con 0x7fdd640ce9a0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd61d9b640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d800 tx=0x7fdd5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd580096a0 con 0x7fdd640ce9a0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58009800 con 0x7fdd640ce9a0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd64158320 con 0x7fdd640ce9a0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58009b70 con 0x7fdd640ce9a0 2023-07-20T11:06:34.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.722+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd641588e0 con 0x7fdd640ce9a0 2023-07-20T11:06:34.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64158e00 con 0x7fdd640ce9a0 2023-07-20T11:06:34.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd58009cd0 con 0x7fdd640ce9a0 2023-07-20T11:06:34.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd52ffd640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 0x7fdd44068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:34.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fdd58084610 con 0x7fdd640ce9a0 2023-07-20T11:06:34.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd6259c640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 0x7fdd44068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:34.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.726+0000 7fdd6259c640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 0x7fdd44068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd540b1000 tx=0x7fdd540aa000 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:34.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.730+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd64158e00 con 0x7fdd640ce9a0 2023-07-20T11:06:34.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.898+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd640cd790 con 0x7fdd440663a0 2023-07-20T11:06:34.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.898+0000 7fdd52ffd640 1 -- 172.21.15.82:0/2643971034 <== mgr.9903 v2:172.21.15.82:6832/919074132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdd54009250 con 0x7fdd440663a0 2023-07-20T11:06:34.882 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:06:34.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:06:34.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T11:06:34.883 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:06:34.884 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:06:34.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 msgr2=0x7fdd44068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:34.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 0x7fdd44068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd540b1000 tx=0x7fdd540aa000 comp rx=0 tx=0).stop 2023-07-20T11:06:34.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 msgr2=0x7fdd641590e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:34.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800d800 tx=0x7fdd5800dcc0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 shutdown_connections 2023-07-20T11:06:34.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fdd440663a0 0x7fdd44068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd6415c5f0 0x7fdd640c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd640ce9a0 0x7fdd641590e0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 --2- 172.21.15.82:0/2643971034 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd640ccfb0 0x7fdd640a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:34.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 >> 172.21.15.82:0/2643971034 conn(0x7fdd64065710 msgr2=0x7fdd64065af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:34.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 shutdown_connections 2023-07-20T11:06:34.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:34.902+0000 7fdd6359e640 1 -- 172.21.15.82:0/2643971034 wait complete. 2023-07-20T11:06:34.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T11:06:35.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.058+0000 7fbeb129c640 1 Processor -- start 2023-07-20T11:06:35.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeb129c640 1 -- start start 2023-07-20T11:06:35.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeb129c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbeac0ccf10 0x7fbeac160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:35.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeb129c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06a1d0 con 0x7fbeac06e4d0 2023-07-20T11:06:35.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeb129c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac06a4b0 con 0x7fbeac069750 2023-07-20T11:06:35.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeb129c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac1601b0 con 0x7fbeac0ccf10 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeab7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbeac06e4d0 0x7fbeac15cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39672/0 (socket says 172.21.15.82:39672) 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeab7fe640 1 -- 172.21.15.82:0/2681751797 learned_addr learned my addr 172.21.15.82:0/2681751797 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeaaffd640 1 --2- 172.21.15.82:0/2681751797 >> v2:172.21.15.183:3300/0 conn(0x7fbeac0ccf10 0x7fbeac160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012651938 0 0) 0x7fbeac06a1d0 con 0x7fbeac06e4d0 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe98003530 con 0x7fbeac06e4d0 2023-07-20T11:06:35.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570559445 0 0) 0x7fbeac06a4b0 con 0x7fbeac069750 2023-07-20T11:06:35.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeac06a1d0 con 0x7fbeac069750 2023-07-20T11:06:35.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeaaffd640 1 -- 172.21.15.82:0/2681751797 >> v1:172.21.15.183:6789/0 conn(0x7fbeac069750 legacy=0x7fbeac06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:35.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeaaffd640 1 -- 172.21.15.82:0/2681751797 >> v1:172.21.15.82:6789/0 conn(0x7fbeac06e4d0 legacy=0x7fbeac15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:35.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.062+0000 7fbeaaffd640 1 -- 172.21.15.82:0/2681751797 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac1603c0 con 0x7fbeac0ccf10 2023-07-20T11:06:35.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeaaffd640 1 --2- 172.21.15.82:0/2681751797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac0ccf10 0x7fbeac160bc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097c0 tx=0x7fbe9401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9192ac0622aaecb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940ab600 con 0x7fbeac0ccf10 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe940a7050 con 0x7fbeac0ccf10 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbea9ffb640 1 -- 172.21.15.82:0/2681751797 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe940ab960 con 0x7fbeac0ccf10 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 -- 172.21.15.82:0/2681751797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac0ccf10 msgr2=0x7fbeac160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2681751797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac0ccf10 0x7fbeac160bc0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097c0 tx=0x7fbe9401c480 comp rx=0 tx=0).stop 2023-07-20T11:06:35.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 -- 172.21.15.82:0/2681751797 shutdown_connections 2023-07-20T11:06:35.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2681751797 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac0ccf10 0x7fbeac160bc0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:35.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 -- 172.21.15.82:0/2681751797 >> 172.21.15.82:0/2681751797 conn(0x7fbeac0cf070 msgr2=0x7fbeac0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:35.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 -- 172.21.15.82:0/2681751797 shutdown_connections 2023-07-20T11:06:35.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.066+0000 7fbeb129c640 1 -- 172.21.15.82:0/2681751797 wait complete. 2023-07-20T11:06:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 Processor -- start 2023-07-20T11:06:35.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- start start 2023-07-20T11:06:35.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac069750 0x7fbeac15b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:35.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbeac06e4d0 0x7fbeac0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0ca750 con 0x7fbeac0ccf10 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0caa30 con 0x7fbeac069750 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac0cad10 con 0x7fbeac06e4d0 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59494/0 (socket says 172.21.15.82:59494) 2023-07-20T11:06:35.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 -- 172.21.15.82:0/2115567891 learned_addr learned my addr 172.21.15.82:0/2115567891 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeaaffd640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac069750 0x7fbeac15b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeaa7fc640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbeac06e4d0 0x7fbeac0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 -- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbeac06e4d0 msgr2=0x7fbeac0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbeac06e4d0 0x7fbeac0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 -- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac069750 msgr2=0x7fbeac15b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac069750 0x7fbeac15b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:35.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 -- 172.21.15.82:0/2115567891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94009420 con 0x7fbeac0ccf10 2023-07-20T11:06:35.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeab7fe640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fbea400cba0 tx=0x7fbea400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:35.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea400ace0 con 0x7fbeac0ccf10 2023-07-20T11:06:35.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea400ae40 con 0x7fbeac0ccf10 2023-07-20T11:06:35.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac0c7640 con 0x7fbeac0ccf10 2023-07-20T11:06:35.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4012620 con 0x7fbeac0ccf10 2023-07-20T11:06:35.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac15b790 con 0x7fbeac0ccf10 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.070+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac04da30 con 0x7fbeac0ccf10 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.074+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 93) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbea4007070 con 0x7fbeac0ccf10 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.074+0000 7fbea37fe640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 0x7fbe8c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.074+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbea4083ea0 con 0x7fbeac0ccf10 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.074+0000 7fbeaaffd640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 0x7fbe8c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:35.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.074+0000 7fbeaaffd640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 0x7fbe8c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe940ad000 tx=0x7fbe94008040 comp rx=0 tx=0).ready entity=mgr.9903 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:35.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.078+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbea4054cf0 con 0x7fbeac0ccf10 2023-07-20T11:06:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:35.262+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbeac0c7af0 con 0x7fbeac0ccf10 2023-07-20T11:06:36.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.114+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 94) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fbea4051630 con 0x7fbeac0ccf10 2023-07-20T11:06:36.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbea37fe640 1 -- 172.21.15.82:0/2115567891 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v94) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbea40718c0 con 0x7fbeac0ccf10 2023-07-20T11:06:36.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 msgr2=0x7fbe8c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 0x7fbe8c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe940ad000 tx=0x7fbe94008040 comp rx=0 tx=0).stop 2023-07-20T11:06:36.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 msgr2=0x7fbeac15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fbea400cba0 tx=0x7fbea400a430 comp rx=0 tx=0).stop 2023-07-20T11:06:36.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 shutdown_connections 2023-07-20T11:06:36.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fbe8c0663a0 0x7fbe8c068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeac0ccf10 0x7fbeac15ba90 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbeac06e4d0 0x7fbeac0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 --2- 172.21.15.82:0/2115567891 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeac069750 0x7fbeac15b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 >> 172.21.15.82:0/2115567891 conn(0x7fbeac0cf070 msgr2=0x7fbeac15c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:36.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 shutdown_connections 2023-07-20T11:06:36.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.118+0000 7fbeb129c640 1 -- 172.21.15.82:0/2115567891 wait complete. 2023-07-20T11:06:36.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T11:06:36.266 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:36.283+0000 7fa7b9006180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:06:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 Processor -- start 2023-07-20T11:06:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 -- start start 2023-07-20T11:06:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 0x7fc3a015df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 0x7fc3a00ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a0160170 con 0x7fc3a0160370 2023-07-20T11:06:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a01572d0 con 0x7fc3a00ce060 2023-07-20T11:06:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a6861640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00ce9f0 con 0x7fc3a015fd90 2023-07-20T11:06:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc3a0160370 0x7fc3a015d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:39694/0 (socket says 172.21.15.82:39694) 2023-07-20T11:06:36.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39f7fe640 1 -- 172.21.15.82:0/3694575627 learned_addr learned my addr 172.21.15.82:0/3694575627 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39ffff640 1 --2- 172.21.15.82:0/3694575627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 0x7fc3a015df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a4dfe640 1 --2- 172.21.15.82:0/3694575627 >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 0x7fc3a00ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39effd640 1 -- 172.21.15.82:0/3694575627 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591250202 0 0) 0x7fc3a0160170 con 0x7fc3a0160370 2023-07-20T11:06:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39effd640 1 -- 172.21.15.82:0/3694575627 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc388003530 con 0x7fc3a0160370 2023-07-20T11:06:36.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39ffff640 1 -- 172.21.15.82:0/3694575627 >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 msgr2=0x7fc3a00ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39ffff640 1 --2- 172.21.15.82:0/3694575627 >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 0x7fc3a00ce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39ffff640 1 -- 172.21.15.82:0/3694575627 >> v1:172.21.15.82:6789/0 conn(0x7fc3a0160370 legacy=0x7fc3a015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc39ffff640 1 -- 172.21.15.82:0/3694575627 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a006c5f0 con 0x7fc3a015fd90 2023-07-20T11:06:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.294+0000 7fc3a4dfe640 1 --2- 172.21.15.82:0/3694575627 >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 0x7fc3a00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:36.280 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:36.298+0000 7f5b31b99180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:06:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc39ffff640 1 --2- 172.21.15.82:0/3694575627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 0x7fc3a015df40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc3900097a0 tx=0x7fc39001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379e5ae01c47a119 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc39effd640 1 -- 172.21.15.82:0/3694575627 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390004230 con 0x7fc3a015fd90 2023-07-20T11:06:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc39effd640 1 -- 172.21.15.82:0/3694575627 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900a7050 con 0x7fc3a015fd90 2023-07-20T11:06:36.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc39effd640 1 -- 172.21.15.82:0/3694575627 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390003620 con 0x7fc3a015fd90 2023-07-20T11:06:36.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 -- 172.21.15.82:0/3694575627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 msgr2=0x7fc3a015df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3694575627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 0x7fc3a015df40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc3900097a0 tx=0x7fc39001c460 comp rx=0 tx=0).stop 2023-07-20T11:06:36.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 -- 172.21.15.82:0/3694575627 shutdown_connections 2023-07-20T11:06:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3694575627 >> v2:172.21.15.183:3300/0 conn(0x7fc3a00ce060 0x7fc3a00ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3694575627 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a015fd90 0x7fc3a015df40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 -- 172.21.15.82:0/3694575627 >> 172.21.15.82:0/3694575627 conn(0x7fc3a0065310 msgr2=0x7fc3a0065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 -- 172.21.15.82:0/3694575627 shutdown_connections 2023-07-20T11:06:36.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.298+0000 7fc3a6861640 1 -- 172.21.15.82:0/3694575627 wait complete. 2023-07-20T11:06:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 Processor -- start 2023-07-20T11:06:36.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- start start 2023-07-20T11:06:36.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a00ce060 0x7fc3a014b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a0160370 0x7fc3a00ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00acd70 con 0x7fc3a015fd90 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a0152730 con 0x7fc3a00ce060 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a014cfd0 con 0x7fc3a0160370 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59528/0 (socket says 172.21.15.82:59528) 2023-07-20T11:06:36.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 -- 172.21.15.82:0/3605994570 learned_addr learned my addr 172.21.15.82:0/3605994570 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:36.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39ffff640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a00ce060 0x7fc3a014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a4dfe640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a0160370 0x7fc3a00ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 -- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a0160370 msgr2=0x7fc3a00ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a0160370 0x7fc3a00ad190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 -- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a00ce060 msgr2=0x7fc3a014b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a00ce060 0x7fc3a014b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 -- 172.21.15.82:0/3605994570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc398009a70 con 0x7fc3a015fd90 2023-07-20T11:06:36.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39f7fe640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c450 tx=0x7fc39400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394005cf0 con 0x7fc3a015fd90 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394005e50 con 0x7fc3a015fd90 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3900093b0 con 0x7fc3a015fd90 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940072d0 con 0x7fc3a015fd90 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.302+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a0152960 con 0x7fc3a015fd90 2023-07-20T11:06:36.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a00aceb0 con 0x7fc3a015fd90 2023-07-20T11:06:36.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 94) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc394007430 con 0x7fc3a015fd90 2023-07-20T11:06:36.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc39cff9640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 0x7fc38c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc39ffff640 1 -- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 msgr2=0x7fc38c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:36.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fc3940833f0 con 0x7fc3a015fd90 2023-07-20T11:06:36.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.306+0000 7fc39ffff640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 0x7fc38c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:36.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.310+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3a00aceb0 con 0x7fc3a015fd90 2023-07-20T11:06:36.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.462+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc3a00aceb0 con 0x7fc3a015fd90 2023-07-20T11:06:36.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.466+0000 7fc39cff9640 1 -- 172.21.15.82:0/3605994570 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc3a00aceb0 con 0x7fc3a015fd90 2023-07-20T11:06:36.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 msgr2=0x7fc38c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 0x7fc38c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 msgr2=0x7fc3a0153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fc39400c450 tx=0x7fc39400c850 comp rx=0 tx=0).stop 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 shutdown_connections 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7fc38c0663f0 0x7fc38c0688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc3a0160370 0x7fc3a00ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc3a015fd90 0x7fc3a0153100 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 --2- 172.21.15.82:0/3605994570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc3a00ce060 0x7fc3a014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 >> 172.21.15.82:0/3605994570 conn(0x7fc3a0065310 msgr2=0x7fc3a015e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 shutdown_connections 2023-07-20T11:06:36.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.470+0000 7fc3a6861640 1 -- 172.21.15.82:0/3605994570 wait complete. 2023-07-20T11:06:36.473 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T11:06:36.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.634+0000 7f307b834640 1 Processor -- start 2023-07-20T11:06:36.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.634+0000 7f307b834640 1 -- start start 2023-07-20T11:06:36.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f307406c120 0x7f30740cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f30741602b0 0x7f3074160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f307406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307406b4a0 con 0x7f307406c120 2023-07-20T11:06:36.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740d0970 con 0x7f30741602b0 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f307b834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3074160e20 con 0x7f307406ab10 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f307406c120 0x7f30740cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f307406c120 0x7f30740cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59534/0 (socket says 172.21.15.82:59534) 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 -- 172.21.15.82:0/1207181547 learned_addr learned my addr 172.21.15.82:0/1207181547 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f3079dd1640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f307406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f3078dcf640 1 --2- 172.21.15.82:0/1207181547 >> v2:172.21.15.183:3300/0 conn(0x7f30741602b0 0x7f3074160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 -- 172.21.15.82:0/1207181547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 msgr2=0x7f307406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:36.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f307406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 -- 172.21.15.82:0/1207181547 >> v2:172.21.15.183:3300/0 conn(0x7f30741602b0 msgr2=0x7f3074160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:36.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 --2- 172.21.15.82:0/1207181547 >> v2:172.21.15.183:3300/0 conn(0x7f30741602b0 0x7f3074160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 -- 172.21.15.82:0/1207181547 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740cd300 con 0x7f307406c120 2023-07-20T11:06:36.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.638+0000 7f30795d0640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307406c120 0x7f30740cdde0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f307408ca40 tx=0x7f307001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8badae6ec0795242 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:36.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f306bfff640 1 -- 172.21.15.82:0/1207181547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700ab600 con 0x7f307406c120 2023-07-20T11:06:36.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f306bfff640 1 -- 172.21.15.82:0/1207181547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30700ab760 con 0x7f307406c120 2023-07-20T11:06:36.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f306bfff640 1 -- 172.21.15.82:0/1207181547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700abaf0 con 0x7f307406c120 2023-07-20T11:06:36.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- 172.21.15.82:0/1207181547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307406c120 msgr2=0x7f30740cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307406c120 0x7f30740cdde0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f307408ca40 tx=0x7f307001c440 comp rx=0 tx=0).stop 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- 172.21.15.82:0/1207181547 shutdown_connections 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- 172.21.15.82:0/1207181547 >> v2:172.21.15.183:3300/0 conn(0x7f30741602b0 0x7f3074160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f307406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- 172.21.15.82:0/1207181547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f307406c120 0x7f30740cdde0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- 172.21.15.82:0/1207181547 >> 172.21.15.82:0/1207181547 conn(0x7f307408c0a0 msgr2=0x7f307409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:36.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- 172.21.15.82:0/1207181547 shutdown_connections 2023-07-20T11:06:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- 172.21.15.82:0/1207181547 wait complete. 2023-07-20T11:06:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 Processor -- start 2023-07-20T11:06:36.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- start start 2023-07-20T11:06:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f3074156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f307406c120 0x7f30740cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740cae20 con 0x7f30741602b0 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740cb630 con 0x7f307406c120 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.642+0000 7f307b834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30740cb070 con 0x7f307406ab10 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f30795d0640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f3074156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3078dcf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f307406c120 0x7f30740cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59540/0 (socket says 172.21.15.82:59540) 2023-07-20T11:06:36.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 -- 172.21.15.82:0/259347424 learned_addr learned my addr 172.21.15.82:0/259347424 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:36.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 -- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 msgr2=0x7f3074156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f3074156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 -- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f307406c120 msgr2=0x7f30740cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f307406c120 0x7f30740cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 -- 172.21.15.82:0/259347424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30700094d0 con 0x7f30741602b0 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3079dd1640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f306c007e60 tx=0x7f306c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c014620 con 0x7f30741602b0 2023-07-20T11:06:36.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00ee90 con 0x7f30741602b0 2023-07-20T11:06:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0149e0 con 0x7f30741602b0 2023-07-20T11:06:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30740cb350 con 0x7f30741602b0 2023-07-20T11:06:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30740c6fa0 con 0x7f30741602b0 2023-07-20T11:06:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.646+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307404da30 con 0x7f30741602b0 2023-07-20T11:06:36.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.650+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 94) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f306c014b40 con 0x7f30741602b0 2023-07-20T11:06:36.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.650+0000 7f3069ffb640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 0x7f30580688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:36.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.650+0000 7f30795d0640 1 -- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 msgr2=0x7f30580688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:36.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.650+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f306c0846b0 con 0x7f30741602b0 2023-07-20T11:06:36.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.650+0000 7f30795d0640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 0x7f30580688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:36.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.654+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f306c051b10 con 0x7f30741602b0 2023-07-20T11:06:36.683 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:36.699+0000 7fa7b9006180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:06:36.713 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:36.730+0000 7f5b31b99180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:06:36.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.806+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f30740cee40 con 0x7f30741602b0 2023-07-20T11:06:36.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.810+0000 7f3069ffb640 1 -- 172.21.15.82:0/259347424 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f306c055130 con 0x7f30741602b0 2023-07-20T11:06:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 msgr2=0x7f30580688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 0x7f30580688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 msgr2=0x7f30740b5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f306c007e60 tx=0x7f306c00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 shutdown_connections 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7f30580663f0 0x7f30580688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30741602b0 0x7f30740b5400 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f307406c120 0x7f30740cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 --2- 172.21.15.82:0/259347424 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f307406ab10 0x7f3074156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 >> 172.21.15.82:0/259347424 conn(0x7f307408c0a0 msgr2=0x7f30740af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 shutdown_connections 2023-07-20T11:06:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:36.814+0000 7f307b834640 1 -- 172.21.15.82:0/259347424 wait complete. 2023-07-20T11:06:36.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:36.817 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T11:06:36.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:06:36.830 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-07-20T11:06:36.835 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:36.851+0000 7fa7b9006180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:06:36.869 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:36.886+0000 7f5b31b99180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:06:36.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-20T11:06:37.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 Processor -- start 2023-07-20T11:06:37.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 -- start start 2023-07-20T11:06:37.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fead415c7e0 0x7fead406cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fead40b2230 0x7fead4160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead40c9190 con 0x7fead40caf00 2023-07-20T11:06:37.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40b26a0 con 0x7fead40b2230 2023-07-20T11:06:37.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead991e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead415cbc0 con 0x7fead415c7e0 2023-07-20T11:06:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7feacbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fead40b2230 0x7fead4160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7feacbfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fead40b2230 0x7fead4160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59552/0 (socket says 172.21.15.82:59552) 2023-07-20T11:06:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7feacbfff640 1 -- 172.21.15.82:0/508888351 learned_addr learned my addr 172.21.15.82:0/508888351 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:37.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7fead2ffd640 1 --2- 172.21.15.82:0/508888351 >> v2:172.21.15.183:3300/0 conn(0x7fead415c7e0 0x7fead406cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.086+0000 7feacbfff640 1 -- 172.21.15.82:0/508888351 >> v2:172.21.15.183:3300/0 conn(0x7fead415c7e0 msgr2=0x7fead406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7feacbfff640 1 --2- 172.21.15.82:0/508888351 >> v2:172.21.15.183:3300/0 conn(0x7fead415c7e0 0x7fead406cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7feacbfff640 1 -- 172.21.15.82:0/508888351 >> v1:172.21.15.183:6789/0 conn(0x7fead40caf00 legacy=0x7fead40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:37.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7feacbfff640 1 -- 172.21.15.82:0/508888351 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4160ba0 con 0x7fead40b2230 2023-07-20T11:06:37.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7feacbfff640 1 --2- 172.21.15.82:0/508888351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead40b2230 0x7fead4160370 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fead40cbc20 tx=0x7feabc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6bc4f1daf28bad server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:37.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7fead27fc640 1 -- 172.21.15.82:0/508888351 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0aa430 con 0x7fead40b2230 2023-07-20T11:06:37.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7fead27fc640 1 -- 172.21.15.82:0/508888351 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feabc0aa590 con 0x7fead40b2230 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7fead27fc640 1 -- 172.21.15.82:0/508888351 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0aa920 con 0x7fead40b2230 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7fead991e640 1 -- 172.21.15.82:0/508888351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead40b2230 msgr2=0x7fead4160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.090+0000 7fead991e640 1 --2- 172.21.15.82:0/508888351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead40b2230 0x7fead4160370 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7fead40cbc20 tx=0x7feabc01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 -- 172.21.15.82:0/508888351 shutdown_connections 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 --2- 172.21.15.82:0/508888351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead40b2230 0x7fead4160370 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 --2- 172.21.15.82:0/508888351 >> v2:172.21.15.183:3300/0 conn(0x7fead415c7e0 0x7fead406cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 -- 172.21.15.82:0/508888351 >> 172.21.15.82:0/508888351 conn(0x7fead4065710 msgr2=0x7fead4069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:37.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 -- 172.21.15.82:0/508888351 shutdown_connections 2023-07-20T11:06:37.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 -- 172.21.15.82:0/508888351 wait complete. 2023-07-20T11:06:37.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 Processor -- start 2023-07-20T11:06:37.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.094+0000 7fead991e640 1 -- start start 2023-07-20T11:06:37.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead40b2230 0x7fead415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead40caf00 0x7fead41543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 0x7fead414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead41553e0 con 0x7fead415c7e0 2023-07-20T11:06:37.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4154910 con 0x7fead40caf00 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c68d0 con 0x7fead40b2230 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 0x7fead414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7feacbfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead40caf00 0x7fead41543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead2ffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead40b2230 0x7fead415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 0x7fead414d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59556/0 (socket says 172.21.15.82:59556) 2023-07-20T11:06:37.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 -- 172.21.15.82:0/1852421410 learned_addr learned my addr 172.21.15.82:0/1852421410 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:37.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead40b2230 msgr2=0x7fead415f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:37.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fead40b2230 0x7fead415f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead40caf00 msgr2=0x7fead41543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fead40caf00 0x7fead41543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc0094d0 con 0x7fead415c7e0 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead37fe640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 0x7fead414d080 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7feacc00c770 tx=0x7feacc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc003b80 con 0x7fead415c7e0 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc003ce0 con 0x7fead415c7e0 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00aa90 con 0x7fead415c7e0 2023-07-20T11:06:37.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead40c65a0 con 0x7fead415c7e0 2023-07-20T11:06:37.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4154e20 con 0x7fead415c7e0 2023-07-20T11:06:37.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40c6a40 con 0x7fead415c7e0 2023-07-20T11:06:37.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.098+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 94) v1 ==== 85777+0+0 (secure 0 0 0) 0x7feacc00abf0 con 0x7fead415c7e0 2023-07-20T11:06:37.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.102+0000 7fead0ff9640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:37.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.102+0000 7fead2ffd640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 msgr2=0x7feab40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:37.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.102+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6134+0+0 (secure 0 0 0) 0x7feacc083d00 con 0x7fead415c7e0 2023-07-20T11:06:37.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.102+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:06:37.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.106+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feacc051030 con 0x7fead415c7e0 2023-07-20T11:06:37.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.278+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fead40c93e0 con 0x7feab40663f0 2023-07-20T11:06:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.306+0000 7fead2ffd640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 msgr2=0x7feab40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:37.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.306+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T11:06:37.316 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.331+0000 7fa7b9006180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:37.359 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.378+0000 7f5b31b99180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:37.374 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.391+0000 7fa7b9006180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:06:37.418 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.434+0000 7f5b31b99180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:06:37.429 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.443+0000 7fa7b9006180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:06:37.473 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.490+0000 7f5b31b99180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:06:37.513 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.531+0000 7fa7b9006180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:06:37.558 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.574+0000 7f5b31b99180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:06:37.570 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.587+0000 7fa7b9006180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:06:37.616 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.634+0000 7f5b31b99180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:06:37.654 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.671+0000 7fa7b9006180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:06:37.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.710+0000 7fead2ffd640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 msgr2=0x7feab40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:37.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:37.710+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T11:06:37.700 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.718+0000 7f5b31b99180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:06:37.709 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.727+0000 7fa7b9006180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:06:37.756 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.774+0000 7f5b31b99180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:06:37.851 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.867+0000 7fa7b9006180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:06:37.898 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.914+0000 7f5b31b99180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:06:37.909 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:37.927+0000 7fa7b9006180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:06:37.957 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:37.974+0000 7f5b31b99180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:06:38.150 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:06:38.150 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:06:38.150 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:06:38.159 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:38.175+0000 7fa7b9006180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:06:38.198 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:06:38.198 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:06:38.198 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:06:38.206 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:38.222+0000 7f5b31b99180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:06:38.292 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:38.307+0000 7fa7b9006180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:38.340 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:38.358+0000 7f5b31b99180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:38.416 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:38.431+0000 7fa7b9006180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:38.465 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:38.482+0000 7f5b31b99180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:06:38.486 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:38.503+0000 7fa7b9006180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:06:38.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:38.514+0000 7fead2ffd640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 msgr2=0x7feab40688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/919074132 2023-07-20T11:06:38.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:38.514+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T11:06:38.535 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:38.550+0000 7f5b31b99180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:06:38.620 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:38.635+0000 7fa7b9006180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:38.668 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:38.686+0000 7f5b31b99180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:06:39.160 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.175+0000 7fa7b9006180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:06:39.208 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.226+0000 7f5b31b99180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:06:39.245 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.259+0000 7fa7b9006180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:06:39.291 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.306+0000 7f5b31b99180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:06:39.392 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.407+0000 7fa7b9006180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:06:39.438 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.454+0000 7f5b31b99180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:06:39.475 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.491+0000 7fa7b9006180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:06:39.521 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.538+0000 7f5b31b99180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:06:39.743 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.759+0000 7fa7b9006180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:06:39.788 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.806+0000 7f5b31b99180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:06:39.802 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:06:39.819+0000 7fa7b9006180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:06:39.848 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.866+0000 7f5b31b99180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:06:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:39.874+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 95) v1 ==== 85386+0+0 (secure 0 0 0) 0x7feacc051400 con 0x7fead415c7e0 2023-07-20T11:06:39.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:39.878+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 msgr2=0x7feab40688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:06:39.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:39.878+0000 7fead0ff9640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/919074132,v1:172.21.15.82:6833/919074132] conn(0x7feab40663f0 0x7feab40688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:39.979 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab4cd2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.979 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab4cd2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.979 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab4cd2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.979 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab7cd8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.979 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab7cd8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.980 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab7cd8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.980 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab7cd8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.980 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab7cd8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.980 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab4cd2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:39.980 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:06:39.994+0000 7f5ab4cd2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:06:40.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.898+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 96) v1 ==== 85513+0+0 (secure 0 0 0) 0x7feacc081fd0 con 0x7fead415c7e0 2023-07-20T11:06:40.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.902+0000 7fead0ff9640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7feab4034090 0x7feab40709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:40.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.902+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 --> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7feab4070f00 con 0x7feab4034090 2023-07-20T11:06:40.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.902+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7feab4034090 0x7feab40709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:40.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.906+0000 7fead2ffd640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7feab4034090 0x7feab40709c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feac4009600 tx=0x7feac4009190 comp rx=0 tx=0).ready entity=mgr.9466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:40.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead0ff9640 1 -- 172.21.15.82:0/1852421410 <== mgr.9466 v2:172.21.15.82:6832/957767149 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7feab4070f00 con 0x7feab4034090 2023-07-20T11:06:40.952 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-07-20T11:06:40.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7feab4034090 msgr2=0x7feab40709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:40.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7feab4034090 0x7feab40709c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feac4009600 tx=0x7feac4009190 comp rx=0 tx=0).stop 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 msgr2=0x7fead414d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 --2- 172.21.15.82:0/1852421410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fead415c7e0 0x7fead414d080 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7feacc00c770 tx=0x7feacc00cc30 comp rx=0 tx=0).stop 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead37fe640 1 -- 172.21.15.82:0/1852421410 reap_dead start 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 shutdown_connections 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 >> 172.21.15.82:0/1852421410 conn(0x7fead4065710 msgr2=0x7fead40cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 shutdown_connections 2023-07-20T11:06:40.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:40.970+0000 7fead991e640 1 -- 172.21.15.82:0/1852421410 wait complete. 2023-07-20T11:06:40.975 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-07-20T11:06:40.976 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-20T11:06:41.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:06:41.101 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:06:41.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 Processor -- start 2023-07-20T11:06:41.124 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 -- start start 2023-07-20T11:06:41.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff0580ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0580b0e80 0x7ff0580b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.126 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0580b1810 con 0x7ff05806ccc0 2023-07-20T11:06:41.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05806d7b0 con 0x7ff0580b0e80 2023-07-20T11:06:41.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05ff96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580caae0 con 0x7ff058070820 2023-07-20T11:06:41.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05e533640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0580b0e80 0x7ff0580b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05dd32640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7ff05806ccc0 0x7ff05806d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:43138/0 (socket says 172.21.15.82:43138) 2023-07-20T11:06:41.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05dd32640 1 -- 172.21.15.82:0/3427816754 learned_addr learned my addr 172.21.15.82:0/3427816754 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:06:41.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05d531640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff0580ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05e533640 1 -- 172.21.15.82:0/3427816754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 msgr2=0x7ff0580ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:06:41.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05e533640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff0580ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05cd30640 1 -- 172.21.15.82:0/3427816754 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182889472 0 0) 0x7ff054001120 con 0x7ff05806ccc0 2023-07-20T11:06:41.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05e533640 1 -- 172.21.15.82:0/3427816754 >> v1:172.21.15.183:6789/0 conn(0x7ff05806ccc0 legacy=0x7ff05806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.142+0000 7ff05e533640 1 -- 172.21.15.82:0/3427816754 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058070e70 con 0x7ff0580b0e80 2023-07-20T11:06:41.129 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05e533640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0580b12d0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7ff050009d90 tx=0x7ff05001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e982878acb1acf31 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:41.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05cd30640 1 -- 172.21.15.82:0/3427816754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500a7b20 con 0x7ff0580b0e80 2023-07-20T11:06:41.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05cd30640 1 -- 172.21.15.82:0/3427816754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500a7c80 con 0x7ff0580b0e80 2023-07-20T11:06:41.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05cd30640 1 -- 172.21.15.82:0/3427816754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500af440 con 0x7ff0580b0e80 2023-07-20T11:06:41.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 -- 172.21.15.82:0/3427816754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 msgr2=0x7ff0580b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0580b12d0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7ff050009d90 tx=0x7ff05001eb60 comp rx=0 tx=0).stop 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 -- 172.21.15.82:0/3427816754 shutdown_connections 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0580b12d0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 --2- 172.21.15.82:0/3427816754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff0580ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 -- 172.21.15.82:0/3427816754 >> 172.21.15.82:0/3427816754 conn(0x7ff0580cbe80 msgr2=0x7ff0580cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:41.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 -- 172.21.15.82:0/3427816754 shutdown_connections 2023-07-20T11:06:41.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.146+0000 7ff05ff96640 1 -- 172.21.15.82:0/3427816754 wait complete. 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 Processor -- start 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- start start 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 0x7ff0580c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff058155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b2020 con 0x7ff0580b0e80 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b2300 con 0x7ff05806ccc0 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b25e0 con 0x7ff058070820 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05dd32640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 0x7ff0580c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59706/0 (socket says 172.21.15.82:59706) 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 -- 172.21.15.82:0/1123755965 learned_addr learned my addr 172.21.15.82:0/1123755965 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:06:41.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05d531640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff058155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 -- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 msgr2=0x7ff058155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff058155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 -- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 msgr2=0x7ff0580c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 0x7ff0580c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 -- 172.21.15.82:0/1123755965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009a70 con 0x7ff0580b0e80 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05dd32640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 0x7ff0580c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:06:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05e533640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff0500b2040 tx=0x7ff05001b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050009450 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0500a7920 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500afd30 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0580b28c0 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0580b2e80 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.150+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0580b3070 con 0x7ff0580b0e80 2023-07-20T11:06:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.154+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 96) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff0500b6070 con 0x7ff0580b0e80 2023-07-20T11:06:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.154+0000 7ff04e7fc640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:06:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.154+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6478+0+0 (secure 0 0 0) 0x7ff05011ecc0 con 0x7ff0580b0e80 2023-07-20T11:06:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.154+0000 7ff05dd32640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:06:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.154+0000 7ff05dd32640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 0x7ff03c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff054000f70 tx=0x7ff054007ba0 comp rx=0 tx=0).ready entity=mgr.9466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:06:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.158+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff050125080 con 0x7ff0580b0e80 2023-07-20T11:06:41.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.326+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 --> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff058071710 con 0x7ff03c066120 2023-07-20T11:06:41.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.370+0000 7ff04e7fc640 1 -- 172.21.15.82:0/1123755965 <== mgr.9466 v2:172.21.15.82:6832/957767149 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7ff054001920 con 0x7ff03c066120 2023-07-20T11:06:41.354 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-07-20T11:06:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 msgr2=0x7ff03c0685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 0x7ff03c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff054000f70 tx=0x7ff054007ba0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 msgr2=0x7ff0581f8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:06:41.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7ff0500b2040 tx=0x7ff05001b900 comp rx=0 tx=0).stop 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 shutdown_connections 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7ff03c066120 0x7ff03c0685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0580b0e80 0x7ff0581f8330 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff058070820 0x7ff058155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 --2- 172.21.15.82:0/1123755965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff05806ccc0 0x7ff0580c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 >> 172.21.15.82:0/1123755965 conn(0x7ff0580cbe80 msgr2=0x7ff0580ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 shutdown_connections 2023-07-20T11:06:41.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:06:41.374+0000 7ff05ff96640 1 -- 172.21.15.82:0/1123755965 wait complete. 2023-07-20T11:06:41.375 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-07-20T11:07:00.367 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:07:00.382+0000 7f5aa6cb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:07:00.367 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:07:00.382+0000 7f5aa6cb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:07:00.367 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:07:00.382+0000 7f5aa6cb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:07:00.367 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:07:00.382+0000 7f5aa6cb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:07:00.368 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:07:00.382+0000 7f5aa6cb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:07:11.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:07:11.158 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:07:41.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:07:41.241 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:08:11.395 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:08:11.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:08:41.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:08:41.454 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:09:11.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:09:11.589 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:09:41.932 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:09:41.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:10:12.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:10:12.096 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:10:42.153 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:10:42.157 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:11:12.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:11:12.232 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:11:42.292 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:11:42.295 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:12:12.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:12:12.427 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:12:42.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:12:42.505 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:13:12.820 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:13:12.824 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:13:42.949 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:13:42.953 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:14:13.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:14:13.011 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:14:43.108 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:14:43.113 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:15:13.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:15:13.223 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:15:43.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:15:43.561 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:16:13.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:16:13.633 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:16:43.729 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:16:43.733 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:17:14.005 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:17:14.010 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:17:16.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:17:16.377 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-20T11:17:16.389 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_07_00_UTC 2023-07-20T11:17:16.389 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_08_00_UTC 2023-07-20T11:17:16.389 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_09_00_UTC 2023-07-20T11:17:16.389 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_10_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_11_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_12_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_13_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_14_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_15_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_16_00_UTC 2023-07-20T11:17:16.390 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_17_00_UTC 2023-07-20T11:17:16.391 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-11_07_00_UTC', 'scheduled-2023-07-20-11_08_00_UTC', 'scheduled-2023-07-20-11_09_00_UTC', 'scheduled-2023-07-20-11_10_00_UTC', 'scheduled-2023-07-20-11_11_00_UTC', 'scheduled-2023-07-20-11_12_00_UTC', 'scheduled-2023-07-20-11_13_00_UTC', 'scheduled-2023-07-20-11_14_00_UTC', 'scheduled-2023-07-20-11_15_00_UTC', 'scheduled-2023-07-20-11_16_00_UTC', 'scheduled-2023-07-20-11_17_00_UTC'] 2023-07-20T11:17:16.392 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-20T11:17:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.597+0000 7fc1ed26d640 1 Processor -- start 2023-07-20T11:17:16.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.597+0000 7fc1ed26d640 1 -- start start 2023-07-20T11:17:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1ed26d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e806bd30 0x7fc1e8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1ed26d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e80c95d0 con 0x7fc1e8158ce0 2023-07-20T11:17:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1ed26d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e81590c0 con 0x7fc1e8070970 2023-07-20T11:17:16.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1ed26d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e80c89c0 con 0x7fc1e806bd30 2023-07-20T11:17:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e806bd30 0x7fc1e8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1e806bd30 0x7fc1e8070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37112/0 (socket says 172.21.15.82:37112) 2023-07-20T11:17:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc1e8158ce0 0x7fc1e80c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50948/0 (socket says 172.21.15.82:50948) 2023-07-20T11:17:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2829937637 learned_addr learned my addr 172.21.15.82:0/2829937637 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:17:16.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2829937637 >> v1:172.21.15.183:6789/0 conn(0x7fc1e8070970 legacy=0x7fc1e806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:17:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2829937637 >> v1:172.21.15.82:6789/0 conn(0x7fc1e8158ce0 legacy=0x7fc1e80c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.601+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2829937637 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80c8ca0 con 0x7fc1e806bd30 2023-07-20T11:17:16.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1e77fe640 1 --2- 172.21.15.82:0/2829937637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e806bd30 0x7fc1e8070e00 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009870 tx=0x7fc1e001d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfe6bfc48d0dea3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1e67fc640 1 -- 172.21.15.82:0/2829937637 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00ac670 con 0x7fc1e806bd30 2023-07-20T11:17:16.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1e67fc640 1 -- 172.21.15.82:0/2829937637 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e00ac7d0 con 0x7fc1e806bd30 2023-07-20T11:17:16.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1e67fc640 1 -- 172.21.15.82:0/2829937637 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00acb60 con 0x7fc1e806bd30 2023-07-20T11:17:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2829937637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e806bd30 msgr2=0x7fc1e8070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2829937637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e806bd30 0x7fc1e8070e00 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009870 tx=0x7fc1e001d610 comp rx=0 tx=0).stop 2023-07-20T11:17:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2829937637 shutdown_connections 2023-07-20T11:17:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2829937637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e806bd30 0x7fc1e8070e00 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2829937637 >> 172.21.15.82:0/2829937637 conn(0x7fc1e80cad50 msgr2=0x7fc1e80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:17:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2829937637 shutdown_connections 2023-07-20T11:17:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2829937637 wait complete. 2023-07-20T11:17:16.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 Processor -- start 2023-07-20T11:17:16.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.605+0000 7fc1ed26d640 1 -- start start 2023-07-20T11:17:16.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e806bd30 0x7fc1e8149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e8070970 0x7fc1e814f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e81f86d0 con 0x7fc1e8158ce0 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e81f94f0 con 0x7fc1e806bd30 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80c2910 con 0x7fc1e8070970 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37124/0 (socket says 172.21.15.82:37124) 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2823748692 learned_addr learned my addr 172.21.15.82:0/2823748692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e6ffd640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e806bd30 0x7fc1e8149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1de7fc640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e8070970 0x7fc1e814f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e8070970 msgr2=0x7fc1e814f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e8070970 0x7fc1e814f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e806bd30 msgr2=0x7fc1e8149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e806bd30 0x7fc1e8149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 -- 172.21.15.82:0/2823748692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00094d0 con 0x7fc1e8158ce0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1e77fe640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00ae040 tx=0x7fc1e001a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00b5830 con 0x7fc1e8158ce0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e00b5990 con 0x7fc1e8158ce0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e81f88e0 con 0x7fc1e8158ce0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00b5d20 con 0x7fc1e8158ce0 2023-07-20T11:17:16.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e81f8ea0 con 0x7fc1e8158ce0 2023-07-20T11:17:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e804da30 con 0x7fc1e8158ce0 2023-07-20T11:17:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.609+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 100) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fc1e00c1460 con 0x7fc1e8158ce0 2023-07-20T11:17:16.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.613+0000 7fc1dffff640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 0x7fc1c80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.613+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fc1e011ea70 con 0x7fc1e8158ce0 2023-07-20T11:17:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.613+0000 7fc1e6ffd640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 0x7fc1c80688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.613+0000 7fc1e6ffd640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 0x7fc1c80688b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8005ba0 comp rx=0 tx=0).ready entity=mgr.9466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.617+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1e00ebb90 con 0x7fc1e8158ce0 2023-07-20T11:17:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.781+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 --> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1e80719b0 con 0x7fc1c80663f0 2023-07-20T11:17:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1dffff640 1 -- 172.21.15.82:0/2823748692 <== mgr.9466 v2:172.21.15.82:6832/957767149 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fc1d8005d90 con 0x7fc1c80663f0 2023-07-20T11:17:16.776 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:17:16.776 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T11:06:40", "first": "2023-07-20T11:07:00", "last": "2023-07-20T11:17:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-20T11:17:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 msgr2=0x7fc1c80688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 0x7fc1c80688b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005fd0 tx=0x7fc1d8005ba0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 msgr2=0x7fc1e814fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00ae040 tx=0x7fc1e001a3b0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 shutdown_connections 2023-07-20T11:17:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fc1c80663f0 0x7fc1c80688b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e8158ce0 0x7fc1e814fa80 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e8070970 0x7fc1e814f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 --2- 172.21.15.82:0/2823748692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e806bd30 0x7fc1e8149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.789+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 >> 172.21.15.82:0/2823748692 conn(0x7fc1e80cad50 msgr2=0x7fc1e80aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:17:16.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.793+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 shutdown_connections 2023-07-20T11:17:16.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.793+0000 7fc1ed26d640 1 -- 172.21.15.82:0/2823748692 wait complete. 2023-07-20T11:17:16.797 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T11:06:40", "first": "2023-07-20T11:07:00", "last": "2023-07-20T11:17:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-20T11:17:16.798 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T11:06:40', 'first': '2023-07-20T11:07:00', 'last': '2023-07-20T11:17:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-07-20T11:17:16.798 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-07-20T11:17:16.798 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-07-20T11:17:16.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-20T11:17:16.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.949+0000 7fee11137640 1 Processor -- start 2023-07-20T11:17:16.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee11137640 1 -- start start 2023-07-20T11:17:16.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee11137640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fee0c15a8e0 0x7fee0c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee11137640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0b12a0 con 0x7fee0c0b2060 2023-07-20T11:17:16.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee11137640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0b1580 con 0x7fee0c0afda0 2023-07-20T11:17:16.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee11137640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c0b3160 con 0x7fee0c15a8e0 2023-07-20T11:17:16.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0b59e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fee0c0b2060 0x7fee0c0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:50954/0 (socket says 172.21.15.82:50954) 2023-07-20T11:17:16.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0b59e640 1 -- 172.21.15.82:0/2602324471 learned_addr learned my addr 172.21.15.82:0/2602324471 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:17:16.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0259c640 1 --2- 172.21.15.82:0/2602324471 >> v2:172.21.15.183:3300/0 conn(0x7fee0c15a8e0 0x7fee0c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990980507 0 0) 0x7fee0c0b12a0 con 0x7fee0c0b2060 2023-07-20T11:17:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf8003530 con 0x7fee0c0b2060 2023-07-20T11:17:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2087838731 0 0) 0x7fedf8003530 con 0x7fee0c0b2060 2023-07-20T11:17:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 >> v2:172.21.15.183:3300/0 conn(0x7fee0c15a8e0 msgr2=0x7fee0c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:17:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 --2- 172.21.15.82:0/2602324471 >> v2:172.21.15.183:3300/0 conn(0x7fee0c15a8e0 0x7fee0c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 >> v1:172.21.15.183:6789/0 conn(0x7fee0c0afda0 legacy=0x7fee0c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0b1860 con 0x7fee0c0b2060 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fee04001a00 con 0x7fee0c0b2060 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 >> v1:172.21.15.82:6789/0 conn(0x7fee0c0b2060 legacy=0x7fee0c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fedf8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedf80047d0 0x7fedf8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedf80052b0 0x7fedf800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0b3160 con 0x7fedf80039d0 2023-07-20T11:17:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf800c1b0 con 0x7fedf80052b0 2023-07-20T11:17:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf800c370 con 0x7fedf80047d0 2023-07-20T11:17:16.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fedf8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0259c640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedf80047d0 0x7fedf8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0b59e640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedf80052b0 0x7fedf800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 -- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedf80047d0 msgr2=0x7fedf8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fedf80047d0 0x7fedf8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 -- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedf80052b0 msgr2=0x7fedf800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:17:16.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedf80052b0 0x7fedf800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0ad9d640 1 -- 172.21.15.82:0/2602324471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8003530 con 0x7fedf80039d0 2023-07-20T11:17:16.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0b59e640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fedf80052b0 0x7fedf800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:17:16.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.953+0000 7fee0b59e640 1 -- 172.21.15.82:0/2602324471 reap_dead start 2023-07-20T11:17:16.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fedf8003df0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001780 tx=0x7fedfc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8088c7f7263257 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0052d0 con 0x7fedf80039d0 2023-07-20T11:17:16.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0a7050 con 0x7fedf80039d0 2023-07-20T11:17:16.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee0a59c640 1 -- 172.21.15.82:0/2602324471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc003600 con 0x7fedf80039d0 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 -- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 msgr2=0x7fedf8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fedf8003df0 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fedfc001780 tx=0x7fedfc01c3b0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 -- 172.21.15.82:0/2602324471 shutdown_connections 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 --2- 172.21.15.82:0/2602324471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fedf8003df0 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 -- 172.21.15.82:0/2602324471 >> 172.21.15.82:0/2602324471 conn(0x7fee0c0cada0 msgr2=0x7fee0c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 -- 172.21.15.82:0/2602324471 shutdown_connections 2023-07-20T11:17:16.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.957+0000 7fee11137640 1 -- 172.21.15.82:0/2602324471 wait complete. 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 Processor -- start 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- start start 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee0c15cd10 0x7fee0c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 0x7fee0c1f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c099410 con 0x7fedf80039d0 2023-07-20T11:17:16.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0acb70 con 0x7fee0c0ac6f0 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c098ab0 con 0x7fee0c15cd10 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37140/0 (socket says 172.21.15.82:37140) 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 -- 172.21.15.82:0/212941123 learned_addr learned my addr 172.21.15.82:0/212941123 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 -- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee0c15cd10 msgr2=0x7fee0c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee0c15cd10 0x7fee0c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 -- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 msgr2=0x7fee0c1f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:16.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0b59e640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 0x7fee0c1f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 0x7fee0c1f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 -- 172.21.15.82:0/212941123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0b2f30 con 0x7fedf80039d0 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0b59e640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 0x7fee0c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee0ad9d640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01c1e0 tx=0x7fedf8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0ba070 con 0x7fedf80039d0 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc007140 con 0x7fedf80039d0 2023-07-20T11:17:16.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0072d0 con 0x7fedf80039d0 2023-07-20T11:17:16.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c098d50 con 0x7fedf80039d0 2023-07-20T11:17:16.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.961+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c15d190 con 0x7fedf80039d0 2023-07-20T11:17:16.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c099680 con 0x7fedf80039d0 2023-07-20T11:17:16.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 100) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fedfc007430 con 0x7fedf80039d0 2023-07-20T11:17:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee03fff640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 0x7fedec0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:17:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fedfc11dac0 con 0x7fedf80039d0 2023-07-20T11:17:16.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee0259c640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 0x7fedec0688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:17:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.965+0000 7fee0259c640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 0x7fedec0688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedf4006e90 tx=0x7fedf4006e00 comp rx=0 tx=0).ready entity=mgr.9466 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:17:16.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:16.969+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedfc0eaab0 con 0x7fedf80039d0 2023-07-20T11:17:17.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.149+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee0c073c70 con 0x7fedf80039d0 2023-07-20T11:17:17.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.153+0000 7fee03fff640 1 -- 172.21.15.82:0/212941123 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v100) v1 ==== 74+0+164447 (secure 0 0 0) 0x7fedfc0ee0d0 con 0x7fedf80039d0 2023-07-20T11:17:17.142 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:17:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 msgr2=0x7fedec0688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 0x7fedec0688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedf4006e90 tx=0x7fedf4006e00 comp rx=0 tx=0).stop 2023-07-20T11:17:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 msgr2=0x7fee0c15ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:17:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fedfc01c1e0 tx=0x7fedf8005800 comp rx=0 tx=0).stop 2023-07-20T11:17:17.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 shutdown_connections 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:6832/957767149,v1:172.21.15.82:6833/957767149] conn(0x7fedec0663f0 0x7fedec0688b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fee0c0ac6f0 0x7fee0c1f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fee0c15cd10 0x7fee0c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 --2- 172.21.15.82:0/212941123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fedf80039d0 0x7fee0c15ba40 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 >> 172.21.15.82:0/212941123 conn(0x7fee0c0cada0 msgr2=0x7fee0c0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 shutdown_connections 2023-07-20T11:17:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:17:17.157+0000 7fee11137640 1 -- 172.21.15.82:0/212941123 wait complete. 2023-07-20T11:17:17.161 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":100,"active_gid":9466,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":957767149},{"type":"v1","addr":"172.21.15.82:6833","nonce":957767149}]},"active_addr":"172.21.15.82:6833/957767149","active_change":"2023-07-20T11:06:39.872236+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":8363,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":173,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1005282252}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2227667398}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3354238649}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2638908174}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1510409822}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1357101313}]}]} 2023-07-20T11:17:17.166 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-07-20T11:17:17.167 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-20T11:17:17.167 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-07-20T11:17:17.167 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-20T11:17:17.168 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:17:17.227 INFO:tasks.ceph.mgr.y:Stopped 2023-07-20T11:17:17.227 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-20T11:17:17.231 INFO:tasks.ceph.mgr.y:Started 2023-07-20T11:17:17.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:17.421+0000 7f6c04246180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:17:17.824 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:17.837+0000 7f6c04246180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:17:17.973 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:17.985+0000 7f6c04246180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:17:18.455 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.469+0000 7f6c04246180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:17:18.514 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.525+0000 7f6c04246180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:17:18.569 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.581+0000 7f6c04246180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:17:18.656 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.669+0000 7f6c04246180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:17:18.713 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.725+0000 7f6c04246180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:17:18.797 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.809+0000 7f6c04246180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:17:18.854 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:18.869+0000 7f6c04246180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:17:18.999 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.009+0000 7f6c04246180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:17:19.056 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.069+0000 7f6c04246180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:17:19.301 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:17:19.301 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:17:19.301 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:17:19.309 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.321+0000 7f6c04246180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:17:19.444 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.457+0000 7f6c04246180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:17:19.571 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.585+0000 7f6c04246180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:17:19.642 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.657+0000 7f6c04246180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:17:19.778 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:19.793+0000 7f6c04246180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:17:20.322 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.333+0000 7f6c04246180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:17:20.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.421+0000 7f6c04246180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:17:20.555 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.569+0000 7f6c04246180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:17:20.639 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.653+0000 7f6c04246180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:17:20.909 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.921+0000 7f6c04246180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:17:20.969 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:20.981+0000 7f6c04246180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:17:21.122 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b856d0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b856d0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b856d0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b856d0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b856d0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b88ed7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b88ed7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.123 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b88ed7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.124 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b88ed7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:21.124 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:17:21.137+0000 7f6b88ed7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:17:44.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:17:44.083 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:18:00.120 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:18:00.132+0000 7f6b90ee7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:18:00.120 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:18:00.132+0000 7f6b90ee7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:18:00.120 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:18:00.132+0000 7f6b90ee7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:18:00.120 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:18:00.132+0000 7f6b90ee7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:18:00.121 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:18:00.132+0000 7f6b90ee7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:18:14.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:18:14.145 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:18:44.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:18:44.276 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:19:14.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:19:14.348 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:19:44.415 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:19:44.419 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:20:14.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:20:14.650 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:20:44.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:20:44.706 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:21:14.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:21:14.786 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:21:44.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:21:44.846 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:22:14.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:22:14.910 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:22:17.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-20T11:22:17.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 Processor -- start 2023-07-20T11:22:17.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 -- start start 2023-07-20T11:22:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa9140ceff0 0x7fa9140d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa9140cd1f0 0x7fa9140d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9140d0220 con 0x7fa91415c8e0 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91406b200 con 0x7fa9140cd1f0 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91c11e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140d16c0 con 0x7fa9140ceff0 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa919eba640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa91415c8e0 0x7fa91406aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38752/0 (socket says 172.21.15.82:38752) 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa919eba640 1 -- 172.21.15.82:0/141863807 learned_addr learned my addr 172.21.15.82:0/141863807 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:17.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91a6bb640 1 --2- 172.21.15.82:0/141863807 >> v2:172.21.15.82:3300/0 conn(0x7fa9140cd1f0 0x7fa9140d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa9196b9640 1 --2- 172.21.15.82:0/141863807 >> v2:172.21.15.183:3300/0 conn(0x7fa9140ceff0 0x7fa9140d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa918eb8640 1 -- 172.21.15.82:0/141863807 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198560894 0 0) 0x7fa9140d0220 con 0x7fa91415c8e0 2023-07-20T11:22:17.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa918eb8640 1 -- 172.21.15.82:0/141863807 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa900003530 con 0x7fa91415c8e0 2023-07-20T11:22:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91a6bb640 1 -- 172.21.15.82:0/141863807 >> v2:172.21.15.183:3300/0 conn(0x7fa9140ceff0 msgr2=0x7fa9140d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91a6bb640 1 --2- 172.21.15.82:0/141863807 >> v2:172.21.15.183:3300/0 conn(0x7fa9140ceff0 0x7fa9140d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91a6bb640 1 -- 172.21.15.82:0/141863807 >> v1:172.21.15.82:6789/0 conn(0x7fa91415c8e0 legacy=0x7fa91406aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.399+0000 7fa91a6bb640 1 -- 172.21.15.82:0/141863807 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91415ccc0 con 0x7fa9140cd1f0 2023-07-20T11:22:17.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91a6bb640 1 --2- 172.21.15.82:0/141863807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140cd1f0 0x7fa9140d2b20 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fa91408c9f0 tx=0x7fa90c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19815fa99359bf4f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa918eb8640 1 -- 172.21.15.82:0/141863807 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0a5910 con 0x7fa9140cd1f0 2023-07-20T11:22:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa918eb8640 1 -- 172.21.15.82:0/141863807 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c0a5a70 con 0x7fa9140cd1f0 2023-07-20T11:22:17.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa918eb8640 1 -- 172.21.15.82:0/141863807 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c0a5e00 con 0x7fa9140cd1f0 2023-07-20T11:22:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 -- 172.21.15.82:0/141863807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140cd1f0 msgr2=0x7fa9140d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 --2- 172.21.15.82:0/141863807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140cd1f0 0x7fa9140d2b20 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7fa91408c9f0 tx=0x7fa90c01c850 comp rx=0 tx=0).stop 2023-07-20T11:22:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 -- 172.21.15.82:0/141863807 shutdown_connections 2023-07-20T11:22:17.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 --2- 172.21.15.82:0/141863807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140cd1f0 0x7fa9140d2b20 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 --2- 172.21.15.82:0/141863807 >> v2:172.21.15.183:3300/0 conn(0x7fa9140ceff0 0x7fa9140d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 -- 172.21.15.82:0/141863807 >> 172.21.15.82:0/141863807 conn(0x7fa91408c0a0 msgr2=0x7fa91409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:17.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 -- 172.21.15.82:0/141863807 shutdown_connections 2023-07-20T11:22:17.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.403+0000 7fa91c11e640 1 -- 172.21.15.82:0/141863807 wait complete. 2023-07-20T11:22:17.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 Processor -- start 2023-07-20T11:22:17.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- start start 2023-07-20T11:22:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9140cd1f0 0x7fa914158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 0x7fa9140b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91415cff0 con 0x7fa9140ceff0 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91415fc50 con 0x7fa9140cd1f0 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9140b3ae0 con 0x7fa91415c8e0 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57046/0 (socket says 172.21.15.82:57046) 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 -- 172.21.15.82:0/2330925640 learned_addr learned my addr 172.21.15.82:0/2330925640 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa919eba640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9140cd1f0 0x7fa914158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91a6bb640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 0x7fa9140b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 -- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 msgr2=0x7fa9140b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 0x7fa9140b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 -- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9140cd1f0 msgr2=0x7fa914158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9140cd1f0 0x7fa914158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 -- 172.21.15.82:0/2330925640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c009a70 con 0x7fa9140ceff0 2023-07-20T11:22:17.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91a6bb640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 0x7fa9140b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:17.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa9196b9640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e930 tx=0x7fa90400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904009690 con 0x7fa9140ceff0 2023-07-20T11:22:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400ca00 con 0x7fa9140ceff0 2023-07-20T11:22:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400cd70 con 0x7fa9140ceff0 2023-07-20T11:22:17.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9140b3dc0 con 0x7fa9140ceff0 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9140b4380 con 0x7fa9140ceff0 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.407+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91406c1b0 con 0x7fa9140ceff0 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.411+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 106) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fa904013470 con 0x7fa9140ceff0 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.411+0000 7fa90a7fc640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 0x7fa8f80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.411+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fa904084420 con 0x7fa9140ceff0 2023-07-20T11:22:17.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.411+0000 7fa919eba640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 0x7fa8f80688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.411+0000 7fa919eba640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 0x7fa8f80688b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9100010f0 tx=0x7fa910007bf0 comp rx=0 tx=0).ready entity=mgr.10488 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.415+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9040515e0 con 0x7fa9140ceff0 2023-07-20T11:22:17.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.579+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 --> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa91406bd00 con 0x7fa8f80663f0 2023-07-20T11:22:17.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa90a7fc640 1 -- 172.21.15.82:0/2330925640 <== mgr.10488 v2:172.21.15.82:6832/3419453693 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7fa9100071c0 con 0x7fa8f80663f0 2023-07-20T11:22:17.636 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-20T11:22:17.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 msgr2=0x7fa8f80688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 0x7fa8f80688b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa9100010f0 tx=0x7fa910007bf0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 msgr2=0x7fa9140b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7fa90400e930 tx=0x7fa90400edf0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 shutdown_connections 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fa8f80663f0 0x7fa8f80688b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa91415c8e0 0x7fa9140b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9140ceff0 0x7fa9140b3020 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 --2- 172.21.15.82:0/2330925640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9140cd1f0 0x7fa914158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 >> 172.21.15.82:0/2330925640 conn(0x7fa91408c0a0 msgr2=0x7fa91415bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 shutdown_connections 2023-07-20T11:22:17.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.647+0000 7fa91c11e640 1 -- 172.21.15.82:0/2330925640 wait complete. 2023-07-20T11:22:17.656 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-20T11:22:17.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:17.658 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-20T11:22:17.667 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_07_00_UTC 2023-07-20T11:22:17.667 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_08_00_UTC 2023-07-20T11:22:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_09_00_UTC 2023-07-20T11:22:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_10_00_UTC 2023-07-20T11:22:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_11_00_UTC 2023-07-20T11:22:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_12_00_UTC 2023-07-20T11:22:17.668 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_13_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_14_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_15_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_16_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_17_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_18_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_19_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_20_00_UTC 2023-07-20T11:22:17.669 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_21_00_UTC 2023-07-20T11:22:17.670 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_22_00_UTC 2023-07-20T11:22:17.670 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-20-11_07_00_UTC', 'scheduled-2023-07-20-11_08_00_UTC', 'scheduled-2023-07-20-11_09_00_UTC', 'scheduled-2023-07-20-11_10_00_UTC', 'scheduled-2023-07-20-11_11_00_UTC', 'scheduled-2023-07-20-11_12_00_UTC', 'scheduled-2023-07-20-11_13_00_UTC', 'scheduled-2023-07-20-11_14_00_UTC', 'scheduled-2023-07-20-11_15_00_UTC', 'scheduled-2023-07-20-11_16_00_UTC', 'scheduled-2023-07-20-11_17_00_UTC', 'scheduled-2023-07-20-11_18_00_UTC', 'scheduled-2023-07-20-11_19_00_UTC', 'scheduled-2023-07-20-11_20_00_UTC', 'scheduled-2023-07-20-11_21_00_UTC', 'scheduled-2023-07-20-11_22_00_UTC'] 2023-07-20T11:22:17.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-20T11:22:17.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 Processor -- start 2023-07-20T11:22:17.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 -- start start 2023-07-20T11:22:17.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406c120 0x7fe0a40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a41602b0 0x7fe0a4160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 0x7fe0a406af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a406b4c0 con 0x7fe0a41602b0 2023-07-20T11:22:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a40d0970 con 0x7fe0a406ab10 2023-07-20T11:22:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a9796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4160e20 con 0x7fe0a406c120 2023-07-20T11:22:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a41602b0 0x7fe0a4160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe0a41602b0 0x7fe0a4160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57050/0 (socket says 172.21.15.82:57050) 2023-07-20T11:22:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 -- 172.21.15.82:0/2778656465 learned_addr learned my addr 172.21.15.82:0/2778656465 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a2ffd640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406c120 0x7fe0a40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a37fe640 1 --2- 172.21.15.82:0/2778656465 >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 0x7fe0a406af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 -- 172.21.15.82:0/2778656465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406c120 msgr2=0x7fe0a40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:17.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406c120 0x7fe0a40cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 -- 172.21.15.82:0/2778656465 >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 msgr2=0x7fe0a406af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 --2- 172.21.15.82:0/2778656465 >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 0x7fe0a406af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a27fc640 1 -- 172.21.15.82:0/2778656465 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40cd300 con 0x7fe0a41602b0 2023-07-20T11:22:17.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.867+0000 7fe0a37fe640 1 --2- 172.21.15.82:0/2778656465 >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 0x7fe0a406af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a27fc640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a4160710 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe0a408b920 tx=0x7fe09801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b476d20a77d6dcd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a1ffb640 1 -- 172.21.15.82:0/2778656465 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a56b0 con 0x7fe0a41602b0 2023-07-20T11:22:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a1ffb640 1 -- 172.21.15.82:0/2778656465 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980a5810 con 0x7fe0a41602b0 2023-07-20T11:22:17.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a1ffb640 1 -- 172.21.15.82:0/2778656465 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980a5ba0 con 0x7fe0a41602b0 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 -- 172.21.15.82:0/2778656465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 msgr2=0x7fe0a4160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a4160710 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7fe0a408b920 tx=0x7fe09801c940 comp rx=0 tx=0).stop 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 -- 172.21.15.82:0/2778656465 shutdown_connections 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 --2- 172.21.15.82:0/2778656465 >> v2:172.21.15.183:3300/0 conn(0x7fe0a406ab10 0x7fe0a406af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a4160710 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 --2- 172.21.15.82:0/2778656465 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406c120 0x7fe0a40cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 -- 172.21.15.82:0/2778656465 >> 172.21.15.82:0/2778656465 conn(0x7fe0a408c0a0 msgr2=0x7fe0a409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 -- 172.21.15.82:0/2778656465 shutdown_connections 2023-07-20T11:22:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.871+0000 7fe0a9796640 1 -- 172.21.15.82:0/2778656465 wait complete. 2023-07-20T11:22:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 Processor -- start 2023-07-20T11:22:17.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- start start 2023-07-20T11:22:17.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 0x7fe0a4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a406c120 0x7fe0a40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c80e0 con 0x7fe0a41602b0 2023-07-20T11:22:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c83c0 con 0x7fe0a406c120 2023-07-20T11:22:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40c86a0 con 0x7fe0a406ab10 2023-07-20T11:22:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57062/0 (socket says 172.21.15.82:57062) 2023-07-20T11:22:17.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 -- 172.21.15.82:0/416565713 learned_addr learned my addr 172.21.15.82:0/416565713 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:17.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a2ffd640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 0x7fe0a4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a27fc640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a406c120 0x7fe0a40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 -- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 msgr2=0x7fe0a4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 0x7fe0a4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 -- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a406c120 msgr2=0x7fe0a40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a406c120 0x7fe0a40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:17.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 -- 172.21.15.82:0/416565713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009b30 con 0x7fe0a41602b0 2023-07-20T11:22:17.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a2ffd640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 0x7fe0a4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:17.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a37fe640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d5d0 tx=0x7fe09c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c004030 con 0x7fe0a41602b0 2023-07-20T11:22:17.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c004190 con 0x7fe0a41602b0 2023-07-20T11:22:17.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c003620 con 0x7fe0a41602b0 2023-07-20T11:22:17.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a40c8980 con 0x7fe0a41602b0 2023-07-20T11:22:17.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.875+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a4158200 con 0x7fe0a41602b0 2023-07-20T11:22:17.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a404da30 con 0x7fe0a41602b0 2023-07-20T11:22:17.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 106) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fe09c003780 con 0x7fe0a41602b0 2023-07-20T11:22:17.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe08b7fe640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 0x7fe0900688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:17.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fe09c084950 con 0x7fe0a41602b0 2023-07-20T11:22:17.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe0a2ffd640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 0x7fe0900688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:17.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.879+0000 7fe0a2ffd640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 0x7fe0900688b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe094009bb0 tx=0x7fe094008040 comp rx=0 tx=0).ready entity=mgr.10488 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:17.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:17.883+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe09c051910 con 0x7fe0a41602b0 2023-07-20T11:22:18.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.047+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 --> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0a40c8530 con 0x7fe0900663f0 2023-07-20T11:22:18.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.055+0000 7fe08b7fe640 1 -- 172.21.15.82:0/416565713 <== mgr.10488 v2:172.21.15.82:6832/3419453693 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7fe0a40c8530 con 0x7fe0900663f0 2023-07-20T11:22:18.053 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:18.053 INFO:teuthology.orchestra.run.smithi082.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T11:06:40", "first": "2023-07-20T11:07:00", "last": "2023-07-20T11:22:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-20T11:22:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 msgr2=0x7fe0900688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 0x7fe0900688b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe094009bb0 tx=0x7fe094008040 comp rx=0 tx=0).stop 2023-07-20T11:22:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 msgr2=0x7fe0a40cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00d5d0 tx=0x7fe09c00da90 comp rx=0 tx=0).stop 2023-07-20T11:22:18.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 shutdown_connections 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe0900663f0 0x7fe0900688b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0a41602b0 0x7fe0a40cb3a0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0a406c120 0x7fe0a40b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 --2- 172.21.15.82:0/416565713 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0a406ab10 0x7fe0a4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 >> 172.21.15.82:0/416565713 conn(0x7fe0a408c0a0 msgr2=0x7fe0a415baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 shutdown_connections 2023-07-20T11:22:18.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.059+0000 7fe0a9796640 1 -- 172.21.15.82:0/416565713 wait complete. 2023-07-20T11:22:18.067 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-20T00:00:00", "created": "2023-07-20T11:06:40", "first": "2023-07-20T11:07:00", "last": "2023-07-20T11:22:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-20T11:22:18.067 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-20T00:00:00', 'created': '2023-07-20T11:06:40', 'first': '2023-07-20T11:07:00', 'last': '2023-07-20T11:22:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-07-20T11:22:18.068 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-07-20T11:22:18.068 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-07-20T11:22:18.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-20T11:22:18.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 Processor -- start 2023-07-20T11:22:18.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 -- start start 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4b3406c120 0x7f4b340cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 0x7f4b34160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b3406af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3406b4a0 con 0x7f4b3406c120 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b340d0970 con 0x7f4b341602b0 2023-07-20T11:22:18.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b3986d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34160e20 con 0x7f4b3406ab10 2023-07-20T11:22:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4b3406c120 0x7f4b340cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4b3406c120 0x7f4b340cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57078/0 (socket says 172.21.15.82:57078) 2023-07-20T11:22:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 -- 172.21.15.82:0/3858037570 learned_addr learned my addr 172.21.15.82:0/3858037570 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:18.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b337fe640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b3406af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b327fc640 1 --2- 172.21.15.82:0/3858037570 >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 0x7f4b34160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 -- 172.21.15.82:0/3858037570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 msgr2=0x7f4b3406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:18.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b3406af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 -- 172.21.15.82:0/3858037570 >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 msgr2=0x7f4b34160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/3858037570 >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 0x7f4b34160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b32ffd640 1 -- 172.21.15.82:0/3858037570 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b340cd300 con 0x7f4b3406c120 2023-07-20T11:22:18.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.223+0000 7f4b327fc640 1 --2- 172.21.15.82:0/3858037570 >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 0x7f4b34160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:18.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b3406c120 0x7f4b340cdde0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f4b3408ca40 tx=0x7f4b2401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa2d053f5ada3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b31ffb640 1 -- 172.21.15.82:0/3858037570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240ab600 con 0x7f4b3406c120 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b31ffb640 1 -- 172.21.15.82:0/3858037570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b240ab760 con 0x7f4b3406c120 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b31ffb640 1 -- 172.21.15.82:0/3858037570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240abaf0 con 0x7f4b3406c120 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 -- 172.21.15.82:0/3858037570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b3406c120 msgr2=0x7f4b340cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b3406c120 0x7f4b340cdde0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f4b3408ca40 tx=0x7f4b2401c440 comp rx=0 tx=0).stop 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 -- 172.21.15.82:0/3858037570 shutdown_connections 2023-07-20T11:22:18.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 --2- 172.21.15.82:0/3858037570 >> v2:172.21.15.183:3300/0 conn(0x7f4b341602b0 0x7f4b34160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b3406af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 --2- 172.21.15.82:0/3858037570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b3406c120 0x7f4b340cdde0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 -- 172.21.15.82:0/3858037570 >> 172.21.15.82:0/3858037570 conn(0x7f4b3408c0a0 msgr2=0x7f4b3409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 -- 172.21.15.82:0/3858037570 shutdown_connections 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 -- 172.21.15.82:0/3858037570 wait complete. 2023-07-20T11:22:18.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.227+0000 7f4b3986d640 1 Processor -- start 2023-07-20T11:22:18.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- start start 2023-07-20T11:22:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b340cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b3406c120 0x7f4b340d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b34157e10 con 0x7f4b341602b0 2023-07-20T11:22:18.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c8090 con 0x7f4b3406c120 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340c7db0 con 0x7f4b3406ab10 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57088/0 (socket says 172.21.15.82:57088) 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 -- 172.21.15.82:0/1833042855 learned_addr learned my addr 172.21.15.82:0/1833042855 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b327fc640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b3406c120 0x7f4b340d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b340cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 -- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 msgr2=0x7f4b340cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b340cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 -- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b3406c120 msgr2=0x7f4b340d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b3406c120 0x7f4b340d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 -- 172.21.15.82:0/1833042855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240094d0 con 0x7f4b341602b0 2023-07-20T11:22:18.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b337fe640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007e60 tx=0x7f4b2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c014620 con 0x7f4b341602b0 2023-07-20T11:22:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00ee90 con 0x7f4b341602b0 2023-07-20T11:22:18.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0149e0 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340caec0 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340cb480 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.231+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3404da30 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.235+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 106) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f4b2c014b40 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.235+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 0x7f4b200688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.235+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f4b2c084a10 con 0x7f4b341602b0 2023-07-20T11:22:18.225 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.235+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 0x7f4b200688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:18.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.235+0000 7f4b32ffd640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 0x7f4b200688e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b240af000 tx=0x7f4b240b6040 comp rx=0 tx=0).ready entity=mgr.10488 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:18.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.239+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b2c051b10 con 0x7f4b341602b0 2023-07-20T11:22:18.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.407+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 --> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b34161100 con 0x7f4b20066420 2023-07-20T11:22:18.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1833042855 <== mgr.10488 v2:172.21.15.82:6832/3419453693 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f4b240ab8d0 con 0x7f4b20066420 2023-07-20T11:22:18.464 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-07-20T11:22:18.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 msgr2=0x7f4b200688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 0x7f4b200688e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b240af000 tx=0x7f4b240b6040 comp rx=0 tx=0).stop 2023-07-20T11:22:18.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 msgr2=0x7f4b340c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007e60 tx=0x7f4b2c00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 shutdown_connections 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f4b20066420 0x7f4b200688e0 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4b240af000 tx=0x7f4b240b6040 comp rx=0 tx=0).stop 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b341602b0 0x7f4b340c71d0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b3406c120 0x7f4b340d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 --2- 172.21.15.82:0/1833042855 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b3406ab10 0x7f4b340cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:18.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 >> 172.21.15.82:0/1833042855 conn(0x7f4b3408c0a0 msgr2=0x7f4b340af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:18.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 shutdown_connections 2023-07-20T11:22:18.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:18.475+0000 7f4b3986d640 1 -- 172.21.15.82:0/1833042855 wait complete. 2023-07-20T11:22:18.484 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-07-20T11:22:18.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.485 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-20T11:22:18.494 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_07_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_08_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_09_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_10_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_11_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_12_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_13_00_UTC 2023-07-20T11:22:18.495 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_14_00_UTC 2023-07-20T11:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_15_00_UTC 2023-07-20T11:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_16_00_UTC 2023-07-20T11:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_17_00_UTC 2023-07-20T11:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_18_00_UTC 2023-07-20T11:22:18.496 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_19_00_UTC 2023-07-20T11:22:18.497 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_20_00_UTC 2023-07-20T11:22:18.497 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_21_00_UTC 2023-07-20T11:22:18.497 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_22_00_UTC 2023-07-20T11:22:18.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_07_00_UTC 2023-07-20T11:22:18.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.499 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_07_00_UTC) 2023-07-20T11:22:18.552 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_08_00_UTC 2023-07-20T11:22:18.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.553 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_08_00_UTC) 2023-07-20T11:22:18.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_09_00_UTC 2023-07-20T11:22:18.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.609 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_09_00_UTC) 2023-07-20T11:22:18.664 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_10_00_UTC 2023-07-20T11:22:18.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.665 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_10_00_UTC) 2023-07-20T11:22:18.722 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_11_00_UTC 2023-07-20T11:22:18.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.723 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_11_00_UTC) 2023-07-20T11:22:18.780 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_12_00_UTC 2023-07-20T11:22:18.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.782 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_12_00_UTC) 2023-07-20T11:22:18.841 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_13_00_UTC 2023-07-20T11:22:18.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.841 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_13_00_UTC) 2023-07-20T11:22:18.901 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_14_00_UTC 2023-07-20T11:22:18.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.902 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_14_00_UTC) 2023-07-20T11:22:18.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_15_00_UTC 2023-07-20T11:22:18.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:18.958 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_15_00_UTC) 2023-07-20T11:22:19.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_16_00_UTC 2023-07-20T11:22:19.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.013 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_16_00_UTC) 2023-07-20T11:22:19.069 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_17_00_UTC 2023-07-20T11:22:19.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.070 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_17_00_UTC) 2023-07-20T11:22:19.125 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_18_00_UTC 2023-07-20T11:22:19.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.126 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_18_00_UTC) 2023-07-20T11:22:19.180 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_19_00_UTC 2023-07-20T11:22:19.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.181 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_19_00_UTC) 2023-07-20T11:22:19.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_20_00_UTC 2023-07-20T11:22:19.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.237 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_20_00_UTC) 2023-07-20T11:22:19.293 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_21_00_UTC 2023-07-20T11:22:19.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.294 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_21_00_UTC) 2023-07-20T11:22:19.349 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_22_00_UTC 2023-07-20T11:22:19.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.350 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-20-11_22_00_UTC) 2023-07-20T11:22:19.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:19.410 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-07-20T11:22:19.463 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T11:22:19.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 Processor -- start 2023-07-20T11:22:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 -- start start 2023-07-20T11:22:19.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f880c159830 0x7f880c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c0cc8d0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880c0ccbb0 con 0x7f880c159450 2023-07-20T11:22:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f8814407640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880c0cce90 con 0x7f880c159830 2023-07-20T11:22:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88129a4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f880c0cc3e0 0x7f880c0afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38760/0 (socket says 172.21.15.82:38760) 2023-07-20T11:22:19.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88129a4640 1 -- 172.21.15.82:0/1341711859 learned_addr learned my addr 172.21.15.82:0/1341711859 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:19.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88119a2640 1 --2- 172.21.15.82:0/1341711859 >> v2:172.21.15.183:3300/0 conn(0x7f880c159830 0x7f880c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:19.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444821337 0 0) 0x7f880c0cc8d0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f8003530 con 0x7f880c0cc3e0 2023-07-20T11:22:19.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820345375 0 0) 0x7f880c0ccbb0 con 0x7f880c159450 2023-07-20T11:22:19.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880c0cc8d0 con 0x7f880c159450 2023-07-20T11:22:19.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88119a2640 1 -- 172.21.15.82:0/1341711859 >> v1:172.21.15.183:6789/0 conn(0x7f880c159450 legacy=0x7f880c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:19.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88119a2640 1 -- 172.21.15.82:0/1341711859 >> v1:172.21.15.82:6789/0 conn(0x7f880c0cc3e0 legacy=0x7f880c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:19.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678059130 0 0) 0x7f87f8003530 con 0x7f880c0cc3e0 2023-07-20T11:22:19.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.659+0000 7f88119a2640 1 -- 172.21.15.82:0/1341711859 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c159cc0 con 0x7f880c159830 2023-07-20T11:22:19.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f88119a2640 1 --2- 172.21.15.82:0/1341711859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c159830 0x7f880c0cbea0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0097c0 tx=0x7f87fc01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c75d3c7059a03a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:19.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804001a00 con 0x7f880c159830 2023-07-20T11:22:19.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc0a7050 con 0x7f880c159830 2023-07-20T11:22:19.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f88111a1640 1 -- 172.21.15.82:0/1341711859 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0ab620 con 0x7f880c159830 2023-07-20T11:22:19.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 -- 172.21.15.82:0/1341711859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c159830 msgr2=0x7f880c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:19.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 --2- 172.21.15.82:0/1341711859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c159830 0x7f880c0cbea0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0097c0 tx=0x7f87fc01c370 comp rx=0 tx=0).stop 2023-07-20T11:22:19.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 -- 172.21.15.82:0/1341711859 shutdown_connections 2023-07-20T11:22:19.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 --2- 172.21.15.82:0/1341711859 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c159830 0x7f880c0cbea0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:19.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 -- 172.21.15.82:0/1341711859 >> 172.21.15.82:0/1341711859 conn(0x7f880c0cad50 msgr2=0x7f880c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:19.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 -- 172.21.15.82:0/1341711859 shutdown_connections 2023-07-20T11:22:19.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.663+0000 7f8814407640 1 -- 172.21.15.82:0/1341711859 wait complete. 2023-07-20T11:22:19.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 Processor -- start 2023-07-20T11:22:19.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- start start 2023-07-20T11:22:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f880c159450 0x7f880c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c0b1200 0x7f880c144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:19.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1f9130 con 0x7f880c0cc3e0 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1f84b0 con 0x7f880c0b1200 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1f8790 con 0x7f880c159450 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57102/0 (socket says 172.21.15.82:57102) 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 -- 172.21.15.82:0/1625616503 learned_addr learned my addr 172.21.15.82:0/1625616503 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88119a2640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f880c159450 0x7f880c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:19.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88129a4640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c0b1200 0x7f880c144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 -- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f880c159450 msgr2=0x7f880c0b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f880c159450 0x7f880c0b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 -- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c0b1200 msgr2=0x7f880c144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c0b1200 0x7f880c144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 -- 172.21.15.82:0/1625616503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc009420 con 0x7f880c0cc3e0 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f88121a3640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f880800c490 tx=0x7f880800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:19.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88080052d0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8808005430 con 0x7f880c0cc3e0 2023-07-20T11:22:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808012870 con 0x7f880c0cc3e0 2023-07-20T11:22:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c1f8a70 con 0x7f880c0cc3e0 2023-07-20T11:22:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.667+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c14aec0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c14b0b0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 106) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f88080129d0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f8802ffd640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 0x7f87f00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:19.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f8808083dd0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f88119a2640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 0x7f87f00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:19.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.671+0000 7f88119a2640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 0x7f87f00688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0ad000 tx=0x7f87fc008040 comp rx=0 tx=0).ready entity=mgr.10488 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:19.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.675+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f880c14b0b0 con 0x7f880c0cc3e0 2023-07-20T11:22:19.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:19.859+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f880c1f9270 con 0x7f880c0cc3e0 2023-07-20T11:22:20.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.411+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f880808a080 con 0x7f880c0cc3e0 2023-07-20T11:22:20.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.411+0000 7f8802ffd640 1 -- 172.21.15.82:0/1625616503 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v107) v1 ==== 93+0+0 (secure 0 0 0) 0x7f880806c420 con 0x7f880c0cc3e0 2023-07-20T11:22:20.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 msgr2=0x7f87f00688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 0x7f87f00688b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0ad000 tx=0x7f87fc008040 comp rx=0 tx=0).stop 2023-07-20T11:22:20.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 msgr2=0x7f880c0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f880800c490 tx=0x7f880800c950 comp rx=0 tx=0).stop 2023-07-20T11:22:20.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 shutdown_connections 2023-07-20T11:22:20.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f87f00663f0 0x7f87f00688b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f880c0b1200 0x7f880c144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f880c159450 0x7f880c0b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 --2- 172.21.15.82:0/1625616503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f880c0cc3e0 0x7f880c0af7f0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 >> 172.21.15.82:0/1625616503 conn(0x7f880c0cad50 msgr2=0x7f880c15af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 shutdown_connections 2023-07-20T11:22:20.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.415+0000 7f8814407640 1 -- 172.21.15.82:0/1625616503 wait complete. 2023-07-20T11:22:20.425 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:22:20.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:22:20.486 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:22:20.552 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:22:20.553 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:20.553 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:20.562 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:20.562 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:20.576 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:20.585+0000 7f8272846180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:22:20.576 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:20.587+0000 7f1733b77180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:22:20.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:20.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.775+0000 7f83a8888640 1 Processor -- start 2023-07-20T11:22:20.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 -- start start 2023-07-20T11:22:20.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40d0d10 0x7f83a40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f83a40cd4b0 0x7f83a40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40d16b0 con 0x7f83a415cab0 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40d31c0 con 0x7f83a40cd4b0 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a8888640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40b3520 con 0x7f83a40d0d10 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f83a40cd4b0 0x7f83a40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:20.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f83a40cd4b0 0x7f83a40cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57126/0 (socket says 172.21.15.82:57126) 2023-07-20T11:22:20.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 -- 172.21.15.82:0/115322025 learned_addr learned my addr 172.21.15.82:0/115322025 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:20.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f839bfff640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40d0d10 0x7f83a40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:20.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 -- 172.21.15.82:0/115322025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40d0d10 msgr2=0x7f83a40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40d0d10 0x7f83a40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 -- 172.21.15.82:0/115322025 >> v1:172.21.15.183:6789/0 conn(0x7f83a415cab0 legacy=0x7f83a40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.779+0000 7f83a2d9d640 1 -- 172.21.15.82:0/115322025 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40d0a10 con 0x7f83a40cd4b0 2023-07-20T11:22:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a2d9d640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40cd4b0 0x7f83a40cd940 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f839c009e50 tx=0x7f839c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2448c313b90f0ec server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:20.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a1d9b640 1 -- 172.21.15.82:0/115322025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0a58a0 con 0x7f83a40cd4b0 2023-07-20T11:22:20.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a1d9b640 1 -- 172.21.15.82:0/115322025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c0a5a00 con 0x7f83a40cd4b0 2023-07-20T11:22:20.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a1d9b640 1 -- 172.21.15.82:0/115322025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0a5d90 con 0x7f83a40cd4b0 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 -- 172.21.15.82:0/115322025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40cd4b0 msgr2=0x7f83a40cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40cd4b0 0x7f83a40cd940 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f839c009e50 tx=0x7f839c01c9e0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 -- 172.21.15.82:0/115322025 shutdown_connections 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a40cd4b0 0x7f83a40cd940 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 --2- 172.21.15.82:0/115322025 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40d0d10 0x7f83a40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 -- 172.21.15.82:0/115322025 >> 172.21.15.82:0/115322025 conn(0x7f83a408c120 msgr2=0x7f83a409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:20.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 -- 172.21.15.82:0/115322025 shutdown_connections 2023-07-20T11:22:20.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.783+0000 7f83a8888640 1 -- 172.21.15.82:0/115322025 wait complete. 2023-07-20T11:22:20.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 Processor -- start 2023-07-20T11:22:20.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- start start 2023-07-20T11:22:20.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40cd4b0 0x7f83a415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83a40d0d10 0x7f83a415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a415e200 con 0x7f83a415cab0 2023-07-20T11:22:20.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a415df20 con 0x7f83a40d0d10 2023-07-20T11:22:20.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a415eac0 con 0x7f83a40cd4b0 2023-07-20T11:22:20.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:20.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57140/0 (socket says 172.21.15.82:57140) 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 -- 172.21.15.82:0/692943035 learned_addr learned my addr 172.21.15.82:0/692943035 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f839bfff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83a40d0d10 0x7f83a415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a259c640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40cd4b0 0x7f83a415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 -- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40cd4b0 msgr2=0x7f83a415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40cd4b0 0x7f83a415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 -- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83a40d0d10 msgr2=0x7f83a415c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83a40d0d10 0x7f83a415c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 -- 172.21.15.82:0/692943035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009b30 con 0x7f83a415cab0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a2d9d640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f839c0af040 tx=0x7f839c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0b8670 con 0x7f83a415cab0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c0b87f0 con 0x7f83a415cab0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c0b8ba0 con 0x7f83a415cab0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a415eda0 con 0x7f83a415cab0 2023-07-20T11:22:20.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4154aa0 con 0x7f83a415cab0 2023-07-20T11:22:20.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.787+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a4073c70 con 0x7f83a415cab0 2023-07-20T11:22:20.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.791+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f83a40ce690 con 0x7f83a415cab0 2023-07-20T11:22:20.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.791+0000 7f839affd640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 0x7f8384068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:20.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.791+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f839c11f500 con 0x7f83a415cab0 2023-07-20T11:22:20.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.791+0000 7f83a259c640 1 -- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 msgr2=0x7f8384068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:20.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.791+0000 7f83a259c640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 0x7f8384068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:20.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.795+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f839c0ec710 con 0x7f83a415cab0 2023-07-20T11:22:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.947+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83a40b2590 con 0x7f83a415cab0 2023-07-20T11:22:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.947+0000 7f839affd640 1 -- 172.21.15.82:0/692943035 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+19548 (secure 0 0 0) 0x7f839c0efd30 con 0x7f83a415cab0 2023-07-20T11:22:20.937 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:20.938 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":176,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:17:20.989205+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.37","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1005282252":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2227667398":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/3354238649":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2638908174":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1357101313":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1631845088":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/2423893973":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1823256241":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/619909040":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1537887134":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1510409822":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1993560711":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6833/919074132":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/919074132":"2023-07-21T11:06:39.872076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 msgr2=0x7f8384068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 0x7f8384068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 msgr2=0x7f83a4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f839c0af040 tx=0x7f839c019780 comp rx=0 tx=0).stop 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 shutdown_connections 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f83840663a0 0x7f8384068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83a415cab0 0x7f83a4154000 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83a40d0d10 0x7f83a415c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 --2- 172.21.15.82:0/692943035 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f83a40cd4b0 0x7f83a415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:20.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 >> 172.21.15.82:0/692943035 conn(0x7f83a408c120 msgr2=0x7f83a40af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:20.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 shutdown_connections 2023-07-20T11:22:20.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:20.951+0000 7f83a8888640 1 -- 172.21.15.82:0/692943035 wait complete. 2023-07-20T11:22:20.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:06:20.190093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:06:21.518753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:22:20.960 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:22:20.995 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.005+0000 7f8272846180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:22:21.007 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.015+0000 7f1733b77180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:22:21.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.115+0000 7fc12b26d640 1 Processor -- start 2023-07-20T11:22:21.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.115+0000 7fc12b26d640 1 -- start start 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12b26d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc124161de0 0x7fc1240afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12b26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1240b0290 0x7fc1240cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12b26d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1240b06e0 con 0x7fc124160ba0 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12b26d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1240c9650 con 0x7fc124161de0 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12b26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1241619c0 con 0x7fc1240b0290 2023-07-20T11:22:21.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc124161de0 0x7fc1240afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc124161de0 0x7fc1240afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57142/0 (socket says 172.21.15.82:57142) 2023-07-20T11:22:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 -- 172.21.15.82:0/2836333820 learned_addr learned my addr 172.21.15.82:0/2836333820 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc12980a640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1240b0290 0x7fc1240cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 -- 172.21.15.82:0/2836333820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1240b0290 msgr2=0x7fc1240cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:21.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1240b0290 0x7fc1240cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 -- 172.21.15.82:0/2836333820 >> v1:172.21.15.183:6789/0 conn(0x7fc124160ba0 legacy=0x7fc1240c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.119+0000 7fc128808640 1 -- 172.21.15.82:0/2836333820 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1240c9370 con 0x7fc124161de0 2023-07-20T11:22:21.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc128808640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc124161de0 0x7fc1240afd50 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc114009870 tx=0x7fc11401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c44b14c92ba50 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc11bfff640 1 -- 172.21.15.82:0/2836333820 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140aa670 con 0x7fc124161de0 2023-07-20T11:22:21.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc11bfff640 1 -- 172.21.15.82:0/2836333820 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140aa7d0 con 0x7fc124161de0 2023-07-20T11:22:21.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc11bfff640 1 -- 172.21.15.82:0/2836333820 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140aab60 con 0x7fc124161de0 2023-07-20T11:22:21.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- 172.21.15.82:0/2836333820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc124161de0 msgr2=0x7fc1240afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc124161de0 0x7fc1240afd50 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fc114009870 tx=0x7fc11401c510 comp rx=0 tx=0).stop 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- 172.21.15.82:0/2836333820 shutdown_connections 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1240b0290 0x7fc1240cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 --2- 172.21.15.82:0/2836333820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc124161de0 0x7fc1240afd50 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- 172.21.15.82:0/2836333820 >> 172.21.15.82:0/2836333820 conn(0x7fc1240cad50 msgr2=0x7fc1240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- 172.21.15.82:0/2836333820 shutdown_connections 2023-07-20T11:22:21.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- 172.21.15.82:0/2836333820 wait complete. 2023-07-20T11:22:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 Processor -- start 2023-07-20T11:22:21.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.123+0000 7fc12b26d640 1 -- start start 2023-07-20T11:22:21.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc124160ba0 0x7fc1240b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc124161de0 0x7fc1240c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415db10 con 0x7fc1240b0290 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12415d370 con 0x7fc124161de0 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1240c3d90 con 0x7fc124160ba0 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57154/0 (socket says 172.21.15.82:57154) 2023-07-20T11:22:21.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 -- 172.21.15.82:0/713893293 learned_addr learned my addr 172.21.15.82:0/713893293 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:21.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc128808640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc124160ba0 0x7fc1240b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12980a640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc124161de0 0x7fc1240c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 -- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc124160ba0 msgr2=0x7fc1240b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc124160ba0 0x7fc1240b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 -- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc124161de0 msgr2=0x7fc1240c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc124161de0 0x7fc1240c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 -- 172.21.15.82:0/713893293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1140094d0 con 0x7fc1240b0290 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc129009640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c530 tx=0x7fc12000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120005220 con 0x7fc1240b0290 2023-07-20T11:22:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120005380 con 0x7fc1240b0290 2023-07-20T11:22:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120007270 con 0x7fc1240b0290 2023-07-20T11:22:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12415c760 con 0x7fc1240b0290 2023-07-20T11:22:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12415cd20 con 0x7fc1240b0290 2023-07-20T11:22:21.119 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12404da30 con 0x7fc1240b0290 2023-07-20T11:22:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.127+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc1200073d0 con 0x7fc1240b0290 2023-07-20T11:22:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.131+0000 7fc119ffb640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 0x7fc108068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.131+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fc120083800 con 0x7fc1240b0290 2023-07-20T11:22:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.131+0000 7fc128808640 1 -- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 msgr2=0x7fc108068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:21.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.131+0000 7fc128808640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 0x7fc108068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:21.123 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.135+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc120050900 con 0x7fc1240b0290 2023-07-20T11:22:21.148 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.157+0000 7f8272846180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:22:21.164 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.175+0000 7f1733b77180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:22:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.283+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1240b06e0 con 0x7fc1240b0290 2023-07-20T11:22:21.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.283+0000 7fc119ffb640 1 -- 172.21.15.82:0/713893293 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1240b06e0 con 0x7fc1240b0290 2023-07-20T11:22:21.275 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 msgr2=0x7fc108068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 0x7fc108068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 msgr2=0x7fc1240c3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7fc12000c530 tx=0x7fc12000c9f0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 shutdown_connections 2023-07-20T11:22:21.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fc1080663d0 0x7fc108068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc124161de0 0x7fc1240c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc124160ba0 0x7fc1240b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 --2- 172.21.15.82:0/713893293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1240b0290 0x7fc1240c3850 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 >> 172.21.15.82:0/713893293 conn(0x7fc1240cad50 msgr2=0x7fc124070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 shutdown_connections 2023-07-20T11:22:21.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.287+0000 7fc12b26d640 1 -- 172.21.15.82:0/713893293 wait complete. 2023-07-20T11:22:21.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:22:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 Processor -- start 2023-07-20T11:22:21.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 -- start start 2023-07-20T11:22:21.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 0x7ff66415df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66415e480 con 0x7ff6640ce060 2023-07-20T11:22:21.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff664160100 con 0x7ff664160370 2023-07-20T11:22:21.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66be6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641572d0 con 0x7ff66415fd20 2023-07-20T11:22:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66a40a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff6640ce060 0x7ff66406af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38762/0 (socket says 172.21.15.82:38762) 2023-07-20T11:22:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff66a40a640 1 -- 172.21.15.82:0/1752690878 learned_addr learned my addr 172.21.15.82:0/1752690878 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff669c09640 1 --2- 172.21.15.82:0/1752690878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 0x7ff66415df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962923096 0 0) 0x7ff664160100 con 0x7ff664160370 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650003530 con 0x7ff664160370 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457481863 0 0) 0x7ff66415e480 con 0x7ff6640ce060 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff664160100 con 0x7ff6640ce060 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff669c09640 1 -- 172.21.15.82:0/1752690878 >> v1:172.21.15.183:6789/0 conn(0x7ff664160370 legacy=0x7ff66415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff669c09640 1 -- 172.21.15.82:0/1752690878 >> v1:172.21.15.82:6789/0 conn(0x7ff6640ce060 legacy=0x7ff66406af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.451+0000 7ff669c09640 1 -- 172.21.15.82:0/1752690878 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664160930 con 0x7ff66415fd20 2023-07-20T11:22:21.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff669c09640 1 --2- 172.21.15.82:0/1752690878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 0x7ff66415df40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097d0 tx=0x7ff66001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b09c128ceaa2e3d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600aa5f0 con 0x7ff66415fd20 2023-07-20T11:22:21.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600aa750 con 0x7ff66415fd20 2023-07-20T11:22:21.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff668c07640 1 -- 172.21.15.82:0/1752690878 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600aaae0 con 0x7ff66415fd20 2023-07-20T11:22:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- 172.21.15.82:0/1752690878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 msgr2=0x7ff66415df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 --2- 172.21.15.82:0/1752690878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 0x7ff66415df40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6600097d0 tx=0x7ff66001c470 comp rx=0 tx=0).stop 2023-07-20T11:22:21.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- 172.21.15.82:0/1752690878 shutdown_connections 2023-07-20T11:22:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 --2- 172.21.15.82:0/1752690878 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff66415fd20 0x7ff66415df40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- 172.21.15.82:0/1752690878 >> 172.21.15.82:0/1752690878 conn(0x7ff664065310 msgr2=0x7ff664065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- 172.21.15.82:0/1752690878 shutdown_connections 2023-07-20T11:22:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- 172.21.15.82:0/1752690878 wait complete. 2023-07-20T11:22:21.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 Processor -- start 2023-07-20T11:22:21.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.459+0000 7ff66be6d640 1 -- start start 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66415fd20 0x7ff66414b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff664160370 0x7ff66414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640b5810 con 0x7ff6640ce060 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641495e0 con 0x7ff66415fd20 2023-07-20T11:22:21.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6640b4f70 con 0x7ff664160370 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57156/0 (socket says 172.21.15.82:57156) 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 -- 172.21.15.82:0/623303743 learned_addr learned my addr 172.21.15.82:0/623303743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66a40a640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff664160370 0x7ff66414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669408640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66415fd20 0x7ff66414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 -- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff664160370 msgr2=0x7ff66414dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff664160370 0x7ff66414dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 -- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66415fd20 msgr2=0x7ff66414b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66415fd20 0x7ff66414b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 -- 172.21.15.82:0/623303743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600093b0 con 0x7ff6640ce060 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff669c09640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7ff660019080 tx=0x7ff66001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600be610 con 0x7ff6640ce060 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6600be770 con 0x7ff6640ce060 2023-07-20T11:22:21.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600beb00 con 0x7ff6640ce060 2023-07-20T11:22:21.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6640b5250 con 0x7ff6640ce060 2023-07-20T11:22:21.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.463+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66414e0f0 con 0x7ff6640ce060 2023-07-20T11:22:21.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6641493b0 con 0x7ff6640ce060 2023-07-20T11:22:21.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff6600bec60 con 0x7ff6640ce060 2023-07-20T11:22:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff65a7fc640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 0x7ff648068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff669408640 1 -- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 msgr2=0x7ff648068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:21.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7ff6600a7070 con 0x7ff6640ce060 2023-07-20T11:22:21.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.467+0000 7ff669408640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 0x7ff648068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:21.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.471+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6641493b0 con 0x7ff6640ce060 2023-07-20T11:22:21.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6641493b0 con 0x7ff6640ce060 2023-07-20T11:22:21.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff65a7fc640 1 -- 172.21.15.82:0/623303743 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6641493b0 con 0x7ff6640ce060 2023-07-20T11:22:21.613 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:22:21.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 msgr2=0x7ff648068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 0x7ff648068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 msgr2=0x7ff6640b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7ff660019080 tx=0x7ff66001acb0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 shutdown_connections 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff6480663d0 0x7ff648068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff664160370 0x7ff66414dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff66415fd20 0x7ff66414b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 --2- 172.21.15.82:0/623303743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6640ce060 0x7ff6640b4990 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 >> 172.21.15.82:0/623303743 conn(0x7ff664065310 msgr2=0x7ff6640cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 shutdown_connections 2023-07-20T11:22:21.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.623+0000 7ff66be6d640 1 -- 172.21.15.82:0/623303743 wait complete. 2023-07-20T11:22:21.633 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.645+0000 7f8272846180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:21.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:22:21.672 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.683+0000 7f1733b77180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:21.692 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.701+0000 7f8272846180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:22:21.732 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.743+0000 7f1733b77180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:22:21.748 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.757+0000 7f8272846180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:22:21.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 Processor -- start 2023-07-20T11:22:21.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 -- start start 2023-07-20T11:22:21.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f885c1602b0 0x7f885c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0ce4f0 con 0x7f885c06c120 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0d0970 con 0x7f885c06ab10 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8863f60640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c160e20 con 0x7f885c1602b0 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8861cfc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f885c06c120 0x7f885c0cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38772/0 (socket says 172.21.15.82:38772) 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8861cfc640 1 -- 172.21.15.82:0/1450720102 learned_addr learned my addr 172.21.15.82:0/1450720102 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:21.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f88614fb640 1 --2- 172.21.15.82:0/1450720102 >> v2:172.21.15.82:3300/0 conn(0x7f885c1602b0 0x7f885c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8860cfa640 1 -- 172.21.15.82:0/1450720102 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509011469 0 0) 0x7f885c0ce4f0 con 0x7f885c06c120 2023-07-20T11:22:21.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f8860cfa640 1 -- 172.21.15.82:0/1450720102 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8848003530 con 0x7f885c06c120 2023-07-20T11:22:21.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f88614fb640 1 -- 172.21.15.82:0/1450720102 >> v1:172.21.15.183:6789/0 conn(0x7f885c06ab10 legacy=0x7f885c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f88614fb640 1 -- 172.21.15.82:0/1450720102 >> v1:172.21.15.82:6789/0 conn(0x7f885c06c120 legacy=0x7f885c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.791+0000 7f88614fb640 1 -- 172.21.15.82:0/1450720102 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0cd300 con 0x7f885c1602b0 2023-07-20T11:22:21.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f88614fb640 1 --2- 172.21.15.82:0/1450720102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1602b0 0x7f885c160740 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f884c0097c0 tx=0x7f884c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7464695586eef2d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8860cfa640 1 -- 172.21.15.82:0/1450720102 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ab600 con 0x7f885c1602b0 2023-07-20T11:22:21.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8860cfa640 1 -- 172.21.15.82:0/1450720102 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c0a7050 con 0x7f885c1602b0 2023-07-20T11:22:21.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8860cfa640 1 -- 172.21.15.82:0/1450720102 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ab960 con 0x7f885c1602b0 2023-07-20T11:22:21.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 -- 172.21.15.82:0/1450720102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1602b0 msgr2=0x7f885c160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 --2- 172.21.15.82:0/1450720102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1602b0 0x7f885c160740 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f884c0097c0 tx=0x7f884c01c330 comp rx=0 tx=0).stop 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 -- 172.21.15.82:0/1450720102 shutdown_connections 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 --2- 172.21.15.82:0/1450720102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c1602b0 0x7f885c160740 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 -- 172.21.15.82:0/1450720102 >> 172.21.15.82:0/1450720102 conn(0x7f885c08c0a0 msgr2=0x7f885c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 -- 172.21.15.82:0/1450720102 shutdown_connections 2023-07-20T11:22:21.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.795+0000 7f8863f60640 1 -- 172.21.15.82:0/1450720102 wait complete. 2023-07-20T11:22:21.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 Processor -- start 2023-07-20T11:22:21.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- start start 2023-07-20T11:22:21.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f885c06c120 0x7f885c0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f885c1602b0 0x7f885c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c70a0 con 0x7f885c06ab10 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c7ea0 con 0x7f885c06c120 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0c7290 con 0x7f885c1602b0 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f88614fb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f885c06c120 0x7f885c0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57180/0 (socket says 172.21.15.82:57180) 2023-07-20T11:22:21.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 -- 172.21.15.82:0/3382954234 learned_addr learned my addr 172.21.15.82:0/3382954234 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:21.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f88624fd640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f885c1602b0 0x7f885c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:21.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 -- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f885c1602b0 msgr2=0x7f885c151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f885c1602b0 0x7f885c151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 -- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f885c06c120 msgr2=0x7f885c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f885c06c120 0x7f885c0c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 -- 172.21.15.82:0/3382954234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c009420 con 0x7f885c06ab10 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8861cfc640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f885800c500 tx=0x7f885800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:21.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858005cf0 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8858005e50 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580072f0 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0c7570 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.799+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0c7b30 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c04da30 con 0x7f885c06ab10 2023-07-20T11:22:21.793 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f1733b77180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:22:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8858007450 con 0x7f885c06ab10 2023-07-20T11:22:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f88527fc640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 0x7f8840068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:21.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f8858083bd0 con 0x7f885c06ab10 2023-07-20T11:22:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f88614fb640 1 -- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 msgr2=0x7f8840068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:21.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.803+0000 7f88614fb640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 0x7f8840068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:21.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.807+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8858050d50 con 0x7f885c06ab10 2023-07-20T11:22:21.835 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.845+0000 7f8272846180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:22:21.883 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.895+0000 7f1733b77180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:22:21.895 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.905+0000 7f8272846180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:22:21.941 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:21.951+0000 7f1733b77180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:22:21.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f885c06a8f0 con 0x7f885c06ab10 2023-07-20T11:22:21.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f88527fc640 1 -- 172.21.15.82:0/3382954234 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v176) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88580210a0 con 0x7f885c06ab10 2023-07-20T11:22:21.952 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 msgr2=0x7f8840068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 0x7f8840068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 msgr2=0x7f885c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f885800c500 tx=0x7f885800c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 shutdown_connections 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f88400663a0 0x7f8840068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f885c1602b0 0x7f885c151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f885c06c120 0x7f885c0c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 --2- 172.21.15.82:0/3382954234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f885c06ab10 0x7f885c0cc1c0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:21.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 >> 172.21.15.82:0/3382954234 conn(0x7f885c08c0a0 msgr2=0x7f885c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:21.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 shutdown_connections 2023-07-20T11:22:21.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:21.963+0000 7f8863f60640 1 -- 172.21.15.82:0/3382954234 wait complete. 2023-07-20T11:22:21.974 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:22:21.979 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:21.989+0000 7f8272846180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:22:22.030 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.039+0000 7f1733b77180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:22:22.036 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.045+0000 7f8272846180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:22:22.089 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.099+0000 7f1733b77180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:22:22.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 Processor -- start 2023-07-20T11:22:22.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 -- start start 2023-07-20T11:22:22.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f006c120 0x7ff9f00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f01602b0 0x7ff9f0160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f00d0970 con 0x7ff9f006ab10 2023-07-20T11:22:22.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f0160e20 con 0x7ff9f006c120 2023-07-20T11:22:22.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f680b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00cd300 con 0x7ff9f01602b0 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f006c120 0x7ff9f00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff9f006c120 0x7ff9f00cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57188/0 (socket says 172.21.15.82:57188) 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 -- 172.21.15.82:0/2036500151 learned_addr learned my addr 172.21.15.82:0/2036500151 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9f4da8640 1 --1- 172.21.15.82:0/2036500151 >> v1:172.21.15.82:6789/0 conn(0x7ff9f006ab10 0x7ff9f006af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38782/0 (socket says 172.21.15.82:38782) 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9ef7fe640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f01602b0 0x7ff9f0160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 -- 172.21.15.82:0/2036500151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f01602b0 msgr2=0x7ff9f0160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:22.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f01602b0 0x7ff9f0160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 -- 172.21.15.82:0/2036500151 >> v1:172.21.15.82:6789/0 conn(0x7ff9f006ab10 legacy=0x7ff9f006af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.171+0000 7ff9effff640 1 -- 172.21.15.82:0/2036500151 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00cd5e0 con 0x7ff9f006c120 2023-07-20T11:22:22.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9effff640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006c120 0x7ff9f00cdde0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e757503f0d512ea5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:22.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9eeffd640 1 -- 172.21.15.82:0/2036500151 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00ac620 con 0x7ff9f006c120 2023-07-20T11:22:22.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9eeffd640 1 -- 172.21.15.82:0/2036500151 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e00ac780 con 0x7ff9f006c120 2023-07-20T11:22:22.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9eeffd640 1 -- 172.21.15.82:0/2036500151 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00acb10 con 0x7ff9f006c120 2023-07-20T11:22:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 -- 172.21.15.82:0/2036500151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006c120 msgr2=0x7ff9f00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006c120 0x7ff9f00cdde0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009870 tx=0x7ff9e001c4b0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 -- 172.21.15.82:0/2036500151 shutdown_connections 2023-07-20T11:22:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f01602b0 0x7ff9f0160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 --2- 172.21.15.82:0/2036500151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006c120 0x7ff9f00cdde0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 -- 172.21.15.82:0/2036500151 >> 172.21.15.82:0/2036500151 conn(0x7ff9f008c0a0 msgr2=0x7ff9f009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 -- 172.21.15.82:0/2036500151 shutdown_connections 2023-07-20T11:22:22.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.175+0000 7ff9f680b640 1 -- 172.21.15.82:0/2036500151 wait complete. 2023-07-20T11:22:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 Processor -- start 2023-07-20T11:22:22.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- start start 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 0x7ff9f014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01602b0 0x7ff9f00af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00b0b50 con 0x7ff9f006ab10 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f0155a40 con 0x7ff9f01602b0 2023-07-20T11:22:22.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f014dfc0 con 0x7ff9f006c120 2023-07-20T11:22:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57192/0 (socket says 172.21.15.82:57192) 2023-07-20T11:22:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 -- 172.21.15.82:0/3033339964 learned_addr learned my addr 172.21.15.82:0/3033339964 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f4da8640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01602b0 0x7ff9f00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9ef7fe640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 0x7ff9f014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 -- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 msgr2=0x7ff9f014d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 0x7ff9f014d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 -- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01602b0 msgr2=0x7ff9f00af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01602b0 0x7ff9f00af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 -- 172.21.15.82:0/3033339964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00094d0 con 0x7ff9f006ab10 2023-07-20T11:22:22.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9ef7fe640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 0x7ff9f014d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:22.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9effff640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00af040 tx=0x7ff9e001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:22.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00b7420 con 0x7ff9f006ab10 2023-07-20T11:22:22.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e00b7580 con 0x7ff9f006ab10 2023-07-20T11:22:22.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f0155d00 con 0x7ff9f006ab10 2023-07-20T11:22:22.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00b7930 con 0x7ff9f006ab10 2023-07-20T11:22:22.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.179+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f014db70 con 0x7ff9f006ab10 2023-07-20T11:22:22.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f004da30 con 0x7ff9f006ab10 2023-07-20T11:22:22.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff9e00b3040 con 0x7ff9f006ab10 2023-07-20T11:22:22.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9ecff9640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 0x7ff9dc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9ef7fe640 1 -- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 msgr2=0x7ff9dc068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:22.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6880+0+0 (secure 0 0 0) 0x7ff9e011e620 con 0x7ff9f006ab10 2023-07-20T11:22:22.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.183+0000 7ff9ef7fe640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 0x7ff9dc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:22.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.187+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9e00eb5e0 con 0x7ff9f006ab10 2023-07-20T11:22:22.180 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.189+0000 7f8272846180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:22:22.238 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.247+0000 7f1733b77180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:22:22.240 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.249+0000 7f8272846180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:22:22.297 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.307+0000 7f1733b77180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:22:22.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.335+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9f01561b0 con 0x7ff9f006ab10 2023-07-20T11:22:22.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.335+0000 7ff9ecff9640 1 -- 172.21.15.82:0/3033339964 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v176) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9e00eec00 con 0x7ff9f006ab10 2023-07-20T11:22:22.327 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:22:22.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 msgr2=0x7ff9dc068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 0x7ff9dc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 msgr2=0x7ff9f014d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00af040 tx=0x7ff9e001acf0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 shutdown_connections 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7ff9dc0663a0 0x7ff9dc068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff9f01602b0 0x7ff9f00af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff9f006c120 0x7ff9f014d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 --2- 172.21.15.82:0/3033339964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9f006ab10 0x7ff9f014d0f0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 >> 172.21.15.82:0/3033339964 conn(0x7ff9f008c0a0 msgr2=0x7ff9f00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 shutdown_connections 2023-07-20T11:22:22.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.339+0000 7ff9f680b640 1 -- 172.21.15.82:0/3033339964 wait complete. 2023-07-20T11:22:22.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T11:22:22.528 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:22:22.529 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:22:22.529 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:22:22.549 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.561+0000 7f8272846180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:22:22.641 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:22:22.641 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:22:22.641 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:22:22.650 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.659+0000 7f1733b77180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:22:22.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.683+0000 7f5771737640 1 Processor -- start 2023-07-20T11:22:22.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.683+0000 7f5771737640 1 -- start start 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f5771737640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f576c0d1170 0x7f576c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f5771737640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0b3520 con 0x7f576c0d0d10 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f5771737640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576c0d0a10 con 0x7f576c15cab0 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f5771737640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576c0d31c0 con 0x7f576c0d1170 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f576c0d1170 0x7f576c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f576c0d1170 0x7f576c0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57202/0 (socket says 172.21.15.82:57202) 2023-07-20T11:22:22.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 -- 172.21.15.82:0/3437585744 learned_addr learned my addr 172.21.15.82:0/3437585744 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:22.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576a7fc640 1 --1- 172.21.15.82:0/3437585744 >> v1:172.21.15.82:6789/0 conn(0x7f576c0d0d10 0x7f576c0cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:38790/0 (socket says 172.21.15.82:38790) 2023-07-20T11:22:22.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 -- 172.21.15.82:0/3437585744 >> v1:172.21.15.183:6789/0 conn(0x7f576c15cab0 legacy=0x7f576c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 -- 172.21.15.82:0/3437585744 >> v1:172.21.15.82:6789/0 conn(0x7f576c0d0d10 legacy=0x7f576c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.687+0000 7f576b7fe640 1 -- 172.21.15.82:0/3437585744 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c0b2910 con 0x7f576c0d1170 2023-07-20T11:22:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f576b7fe640 1 --2- 172.21.15.82:0/3437585744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0cdbc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f5764009e50 tx=0x7f576401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54005a8b7670eb96 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5769ffb640 1 -- 172.21.15.82:0/3437585744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640a5800 con 0x7f576c0d1170 2023-07-20T11:22:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5769ffb640 1 -- 172.21.15.82:0/3437585744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57640a5960 con 0x7f576c0d1170 2023-07-20T11:22:22.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5769ffb640 1 -- 172.21.15.82:0/3437585744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640a5cf0 con 0x7f576c0d1170 2023-07-20T11:22:22.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- 172.21.15.82:0/3437585744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 msgr2=0x7f576c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 --2- 172.21.15.82:0/3437585744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0cdbc0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f5764009e50 tx=0x7f576401c9b0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- 172.21.15.82:0/3437585744 shutdown_connections 2023-07-20T11:22:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 --2- 172.21.15.82:0/3437585744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0cdbc0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- 172.21.15.82:0/3437585744 >> 172.21.15.82:0/3437585744 conn(0x7f576c08c120 msgr2=0x7f576c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- 172.21.15.82:0/3437585744 shutdown_connections 2023-07-20T11:22:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- 172.21.15.82:0/3437585744 wait complete. 2023-07-20T11:22:22.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 Processor -- start 2023-07-20T11:22:22.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 -- start start 2023-07-20T11:22:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 0x7f576c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.691+0000 7f5771737640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576c15cab0 0x7f576c0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c0c9090 con 0x7f576c0d1170 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576c144330 con 0x7f576c15cab0 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576c1418c0 con 0x7f576c0d0d10 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57210/0 (socket says 172.21.15.82:57210) 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 -- 172.21.15.82:0/2484557766 learned_addr learned my addr 172.21.15.82:0/2484557766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:22.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576b7fe640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576c15cab0 0x7f576c0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576affd640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 0x7f576c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 -- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 msgr2=0x7f576c0c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 0x7f576c0c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 -- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576c15cab0 msgr2=0x7f576c0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576c15cab0 0x7f576c0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 -- 172.21.15.82:0/2484557766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764009b30 con 0x7f576c0d1170 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576affd640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 0x7f576c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:22.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f576a7fc640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f576000c430 tx=0x7f576000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600074e0 con 0x7f576c0d1170 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760007640 con 0x7f576c0d1170 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576c141ba0 con 0x7f576c0d1170 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760004a10 con 0x7f576c0d1170 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576c142160 con 0x7f576c0d1170 2023-07-20T11:22:22.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576c073c70 con 0x7f576c0d1170 2023-07-20T11:22:22.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.695+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f5760004b70 con 0x7f576c0d1170 2023-07-20T11:22:22.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.699+0000 7f57537fe640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 0x7f5758068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:22.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.699+0000 7f576affd640 1 -- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 msgr2=0x7f5758068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:22.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.699+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6968+0+0 (secure 0 0 0) 0x7f5760083bb0 con 0x7f576c0d1170 2023-07-20T11:22:22.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.699+0000 7f576affd640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 0x7f5758068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:22.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.703+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5760050b80 con 0x7f576c0d1170 2023-07-20T11:22:22.732 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.741+0000 7f8272846180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:22.790 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.799+0000 7f1733b77180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:22.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f576c0b3180 con 0x7f576c0d1170 2023-07-20T11:22:22.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f57537fe640 1 -- 172.21.15.82:0/2484557766 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v177) v1 ==== 81+0+935 (secure 0 0 0) 0x7f57600541a0 con 0x7f576c0d1170 2023-07-20T11:22:22.853 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/957767149 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.853 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1005282252 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.853 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2227667398 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.854 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3354238649 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.854 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2638908174 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.854 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1357101313 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.855 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1631845088 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.855 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2423893973 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.855 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1823256241 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.855 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/619909040 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.856 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/957767149 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.856 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1537887134 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.856 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1510409822 2023-07-21T11:17:20.989166+0000 2023-07-20T11:22:22.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1993560711 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/919074132 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.857 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/919074132 2023-07-21T11:06:39.872076+0000 2023-07-20T11:22:22.858 INFO:teuthology.orchestra.run.smithi082.stderr:listed 16 entries 2023-07-20T11:22:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 msgr2=0x7f5758068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 0x7f5758068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 msgr2=0x7f576c0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:22.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f576000c430 tx=0x7f576000c8f0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 shutdown_connections 2023-07-20T11:22:22.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f57580663d0 0x7f5758068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f576c15cab0 0x7f576c0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f576c0d1170 0x7f576c0b5a40 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 --2- 172.21.15.82:0/2484557766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f576c0d0d10 0x7f576c0c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:22.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 >> 172.21.15.82:0/2484557766 conn(0x7f576c08c120 msgr2=0x7f576c0af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:22.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 shutdown_connections 2023-07-20T11:22:22.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:22.863+0000 7f5771737640 1 -- 172.21.15.82:0/2484557766 wait complete. 2023-07-20T11:22:22.862 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.869+0000 7f8272846180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:22.873 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T11:22:22.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:22.874 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T11:22:22.921 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:22.931+0000 7f1733b77180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:22.929 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:22.941+0000 7f8272846180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:22:22.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:22:22.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:22.953 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T11:22:22.994 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:23.003+0000 7f1733b77180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:22:23.003 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:22:23.003 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:23.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:22:23.013 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:23.013 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:23.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:22:23.060 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:22:23.060 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:23.065 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:23.077+0000 7f8272846180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:23.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:22:23.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:23.130 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:23.139+0000 7f1733b77180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.255+0000 7fe7606cb640 1 Processor -- start 2023-07-20T11:22:23.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.255+0000 7fe7606cb640 1 -- start start 2023-07-20T11:22:23.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe7606cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 0x7fe7580d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe7606cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7580ce4c0 0x7fe7580d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe7606cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7580d16b0 con 0x7fe7580d0d10 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe7606cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7580d31c0 con 0x7fe7580ce4c0 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe7606cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580b3520 con 0x7fe75815cab0 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7580ce4c0 0x7fe7580d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe7580ce4c0 0x7fe7580d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37126/0 (socket says 172.21.15.82:37126) 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 -- 172.21.15.82:0/948955379 learned_addr learned my addr 172.21.15.82:0/948955379 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:23.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75e467640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 0x7fe7580d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 -- 172.21.15.82:0/948955379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 msgr2=0x7fe7580d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:23.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 0x7fe7580d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 -- 172.21.15.82:0/948955379 >> v1:172.21.15.183:6789/0 conn(0x7fe7580d0d10 legacy=0x7fe7580cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 -- 172.21.15.82:0/948955379 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580b2910 con 0x7fe7580ce4c0 2023-07-20T11:22:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75e467640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 0x7fe7580d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:23.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75ec68640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580ce4c0 0x7fe7580d1170 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a80997537eb9fe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75d465640 1 -- 172.21.15.82:0/948955379 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a57c0 con 0x7fe7580ce4c0 2023-07-20T11:22:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75d465640 1 -- 172.21.15.82:0/948955379 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500a5920 con 0x7fe7580ce4c0 2023-07-20T11:22:23.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.259+0000 7fe75d465640 1 -- 172.21.15.82:0/948955379 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5cb0 con 0x7fe7580ce4c0 2023-07-20T11:22:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- 172.21.15.82:0/948955379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580ce4c0 msgr2=0x7fe7580d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580ce4c0 0x7fe7580d1170 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c9e0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- 172.21.15.82:0/948955379 shutdown_connections 2023-07-20T11:22:23.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7580ce4c0 0x7fe7580d1170 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- 172.21.15.82:0/948955379 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe75815cab0 0x7fe7580d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- 172.21.15.82:0/948955379 >> 172.21.15.82:0/948955379 conn(0x7fe75808c120 msgr2=0x7fe75809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- 172.21.15.82:0/948955379 shutdown_connections 2023-07-20T11:22:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- 172.21.15.82:0/948955379 wait complete. 2023-07-20T11:22:23.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 Processor -- start 2023-07-20T11:22:23.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- start start 2023-07-20T11:22:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 0x7fe758145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580d0d10 0x7fe758157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75815d2e0 con 0x7fe75815cab0 2023-07-20T11:22:23.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe758156970 con 0x7fe7580ce4c0 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe7606cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7581457d0 con 0x7fe7580d0d10 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe75ec68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.263+0000 7fe75e467640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 0x7fe758145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37138/0 (socket says 172.21.15.82:37138) 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 -- 172.21.15.82:0/782484932 learned_addr learned my addr 172.21.15.82:0/782484932 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:23.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75dc66640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580d0d10 0x7fe758157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 -- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580d0d10 msgr2=0x7fe758157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580d0d10 0x7fe758157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 -- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 msgr2=0x7fe758145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 0x7fe758145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 -- 172.21.15.82:0/782484932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750009b30 con 0x7fe75815cab0 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75e467640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 0x7fe758145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe75ec68640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fe75001a610 tx=0x7fe750019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:23.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b8670 con 0x7fe75815cab0 2023-07-20T11:22:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7500b87d0 con 0x7fe75815cab0 2023-07-20T11:22:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7580b8390 con 0x7fe75815cab0 2023-07-20T11:22:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7500b8b60 con 0x7fe75815cab0 2023-07-20T11:22:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe758156f10 con 0x7fe75815cab0 2023-07-20T11:22:23.259 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe758073c70 con 0x7fe75815cab0 2023-07-20T11:22:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.267+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe7500b8cc0 con 0x7fe75815cab0 2023-07-20T11:22:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.271+0000 7fe74effd640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 0x7fe73c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.271+0000 7fe75e467640 1 -- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 msgr2=0x7fe73c068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:23.260 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.271+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6968+0+0 (secure 0 0 0) 0x7fe75011f120 con 0x7fe75815cab0 2023-07-20T11:22:23.261 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.271+0000 7fe75e467640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 0x7fe73c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:23.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.271+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7500ec230 con 0x7fe75815cab0 2023-07-20T11:22:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe75806b0c0 con 0x7fe75815cab0 2023-07-20T11:22:23.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe74effd640 1 -- 172.21.15.82:0/782484932 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fe7500ef850 con 0x7fe75815cab0 2023-07-20T11:22:23.461 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:23.461 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:22:23.461 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:22:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 msgr2=0x7fe73c068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:23.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 0x7fe73c068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 msgr2=0x7fe75815fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fe75001a610 tx=0x7fe750019780 comp rx=0 tx=0).stop 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 shutdown_connections 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7fe73c0663d0 0x7fe73c068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe75815cab0 0x7fe75815fb70 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe7580d0d10 0x7fe758157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 --2- 172.21.15.82:0/782484932 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7580ce4c0 0x7fe758145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 >> 172.21.15.82:0/782484932 conn(0x7fe75808c120 msgr2=0x7fe7580b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 shutdown_connections 2023-07-20T11:22:23.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.471+0000 7fe7606cb640 1 -- 172.21.15.82:0/782484932 wait complete. 2023-07-20T11:22:23.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:23.619 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:23.629+0000 7f8272846180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:22:23.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 Processor -- start 2023-07-20T11:22:23.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 -- start start 2023-07-20T11:22:23.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b900b1f30 0x7f9b900b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b9015c120 0x7f9b9015c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b900cf4a0 con 0x7f9b9006f350 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b900b2900 con 0x7f9b9015c120 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b9586d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9006ea80 con 0x7f9b900b1f30 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b9015c120 0x7f9b9015c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f9b9006f350 0x7f9b9006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41048/0 (socket says 172.21.15.82:41048) 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b9015c120 0x7f9b9015c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37142/0 (socket says 172.21.15.82:37142) 2023-07-20T11:22:23.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8effd640 1 -- 172.21.15.82:0/2614306509 learned_addr learned my addr 172.21.15.82:0/2614306509 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b867fc640 1 --2- 172.21.15.82:0/2614306509 >> v2:172.21.15.183:3300/0 conn(0x7f9b900b1f30 0x7f9b900b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 -- 172.21.15.82:0/2614306509 >> v2:172.21.15.183:3300/0 conn(0x7f9b900b1f30 msgr2=0x7f9b900b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 --2- 172.21.15.82:0/2614306509 >> v2:172.21.15.183:3300/0 conn(0x7f9b900b1f30 0x7f9b900b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 -- 172.21.15.82:0/2614306509 >> v1:172.21.15.82:6789/0 conn(0x7f9b9006f350 legacy=0x7f9b9006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8f7fe640 1 -- 172.21.15.82:0/2614306509 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900ce890 con 0x7f9b9015c120 2023-07-20T11:22:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.679+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/2614306509 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726783925 0 0) 0x7f9b900cf4a0 con 0x7f9b9006f350 2023-07-20T11:22:23.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b8f7fe640 1 --2- 172.21.15.82:0/2614306509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9015c120 0x7f9b9015c530 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9b900cfe50 tx=0x7f9b8801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ea0a7211020e3a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:23.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/2614306509 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880a5820 con 0x7f9b9015c120 2023-07-20T11:22:23.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/2614306509 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b880a5980 con 0x7f9b9015c120 2023-07-20T11:22:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b8e7fc640 1 -- 172.21.15.82:0/2614306509 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b880a5d10 con 0x7f9b9015c120 2023-07-20T11:22:23.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 -- 172.21.15.82:0/2614306509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9015c120 msgr2=0x7f9b9015c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2614306509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9015c120 0x7f9b9015c530 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f9b900cfe50 tx=0x7f9b8801c850 comp rx=0 tx=0).stop 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 -- 172.21.15.82:0/2614306509 shutdown_connections 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2614306509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9015c120 0x7f9b9015c530 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2614306509 >> v2:172.21.15.183:3300/0 conn(0x7f9b900b1f30 0x7f9b900b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 -- 172.21.15.82:0/2614306509 >> 172.21.15.82:0/2614306509 conn(0x7f9b90089fa0 msgr2=0x7f9b900d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:23.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 -- 172.21.15.82:0/2614306509 shutdown_connections 2023-07-20T11:22:23.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.683+0000 7f9b9586d640 1 -- 172.21.15.82:0/2614306509 wait complete. 2023-07-20T11:22:23.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 Processor -- start 2023-07-20T11:22:23.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- start start 2023-07-20T11:22:23.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 0x7f9b900c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9015c120 0x7f9b900c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900ca390 con 0x7f9b9006f350 2023-07-20T11:22:23.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900c44c0 con 0x7f9b900b1f30 2023-07-20T11:22:23.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900c47a0 con 0x7f9b9015c120 2023-07-20T11:22:23.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37148/0 (socket says 172.21.15.82:37148) 2023-07-20T11:22:23.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 -- 172.21.15.82:0/2262643981 learned_addr learned my addr 172.21.15.82:0/2262643981 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:23.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b867fc640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 0x7f9b900c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8f7fe640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9015c120 0x7f9b900c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:23.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 -- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9015c120 msgr2=0x7f9b900c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9015c120 0x7f9b900c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 -- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 msgr2=0x7f9b900c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 0x7f9b900c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 -- 172.21.15.82:0/2262643981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88009a70 con 0x7f9b9006f350 2023-07-20T11:22:23.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b867fc640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 0x7f9b900c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:23.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8effd640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9b800011f0 tx=0x7f9b8000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:23.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800074e0 con 0x7f9b9006f350 2023-07-20T11:22:23.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b80007640 con 0x7f9b9006f350 2023-07-20T11:22:23.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b900cfab0 con 0x7f9b9006f350 2023-07-20T11:22:23.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004a10 con 0x7f9b9006f350 2023-07-20T11:22:23.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.687+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b900c4d60 con 0x7f9b9006f350 2023-07-20T11:22:23.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b900cf910 con 0x7f9b9006f350 2023-07-20T11:22:23.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f9b80004b70 con 0x7f9b9006f350 2023-07-20T11:22:23.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b8cff9640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 0x7f9b70068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:23.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f9b800833e0 con 0x7f9b9006f350 2023-07-20T11:22:23.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b867fc640 1 -- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 msgr2=0x7f9b70068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:23.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.691+0000 7f9b867fc640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 0x7f9b70068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:23.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.699+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b900cf910 con 0x7f9b9006f350 2023-07-20T11:22:23.704 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:23.717+0000 7f8272846180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:22:23.712 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:23.723+0000 7f1733b77180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:22:23.797 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:23.807+0000 7f1733b77180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:22:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.847+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b900cf910 con 0x7f9b9006f350 2023-07-20T11:22:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b8cff9640 1 -- 172.21.15.82:0/2262643981 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+19687 (secure 0 0 0) 0x7f9b900cf910 con 0x7f9b9006f350 2023-07-20T11:22:23.841 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:23.841 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":178,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:23.424014+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":178,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.37","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1005282252":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2227667398":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/3354238649":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2638908174":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1357101313":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1631845088":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/2423893973":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1823256241":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/619909040":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1537887134":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1510409822":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1993560711":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6833/919074132":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/919074132":"2023-07-21T11:06:39.872076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 msgr2=0x7f9b70068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 0x7f9b70068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 msgr2=0x7f9b9014d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f9b800011f0 tx=0x7f9b8000c9b0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 shutdown_connections 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b700663a0 0x7f9b70068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b9015c120 0x7f9b900c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b900b1f30 0x7f9b900c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 --2- 172.21.15.82:0/2262643981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b9006f350 0x7f9b9014d290 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.851+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 >> 172.21.15.82:0/2262643981 conn(0x7f9b90089fa0 msgr2=0x7f9b901572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.855+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 shutdown_connections 2023-07-20T11:22:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:23.855+0000 7f9b9586d640 1 -- 172.21.15.82:0/2262643981 wait complete. 2023-07-20T11:22:23.851 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:23.861+0000 7f8272846180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:22:23.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:06:20.190093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '171', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:06:21.518753+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 178, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:22:23.863 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:22:23.935 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:23.945+0000 7f8272846180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:22:23.950 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:23.959+0000 7f1733b77180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:22:24.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 Processor -- start 2023-07-20T11:22:24.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 -- start start 2023-07-20T11:22:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9b1806c120 0x7f9b180cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b1806ab10 0x7f9b1806af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1806b4a0 con 0x7f9b181602b0 2023-07-20T11:22:24.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b180d0970 con 0x7f9b1806c120 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1e607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18160e20 con 0x7f9b1806ab10 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b177fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b177fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37150/0 (socket says 172.21.15.82:37150) 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b177fe640 1 -- 172.21.15.82:0/1402283924 learned_addr learned my addr 172.21.15.82:0/1402283924 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 --2- 172.21.15.82:0/1402283924 >> v2:172.21.15.183:3300/0 conn(0x7f9b1806c120 0x7f9b180cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b1cba4640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b1806ab10 0x7f9b1806af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 -- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b1806ab10 msgr2=0x7f9b1806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b1806ab10 0x7f9b1806af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 -- 172.21.15.82:0/1402283924 >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 msgr2=0x7f9b18160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 --2- 172.21.15.82:0/1402283924 >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b17fff640 1 -- 172.21.15.82:0/1402283924 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180cd300 con 0x7f9b1806c120 2023-07-20T11:22:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.019+0000 7f9b177fe640 1 --2- 172.21.15.82:0/1402283924 >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:24.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b17fff640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b180cdde0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9b180d00e0 tx=0x7f9b0801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d824a5eb3be20b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b16ffd640 1 -- 172.21.15.82:0/1402283924 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080ad660 con 0x7f9b1806c120 2023-07-20T11:22:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b16ffd640 1 -- 172.21.15.82:0/1402283924 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b080ad7c0 con 0x7f9b1806c120 2023-07-20T11:22:24.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b16ffd640 1 -- 172.21.15.82:0/1402283924 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080adb50 con 0x7f9b1806c120 2023-07-20T11:22:24.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 -- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 msgr2=0x7f9b180cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b180cdde0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9b180d00e0 tx=0x7f9b0801c3a0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 -- 172.21.15.82:0/1402283924 shutdown_connections 2023-07-20T11:22:24.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b1806ab10 0x7f9b1806af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 --2- 172.21.15.82:0/1402283924 >> v2:172.21.15.82:3300/0 conn(0x7f9b181602b0 0x7f9b18160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 --2- 172.21.15.82:0/1402283924 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b180cdde0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 -- 172.21.15.82:0/1402283924 >> 172.21.15.82:0/1402283924 conn(0x7f9b1808c0a0 msgr2=0x7f9b1809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 -- 172.21.15.82:0/1402283924 shutdown_connections 2023-07-20T11:22:24.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.023+0000 7f9b1e607640 1 -- 172.21.15.82:0/1402283924 wait complete. 2023-07-20T11:22:24.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 Processor -- start 2023-07-20T11:22:24.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- start start 2023-07-20T11:22:24.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 0x7f9b180c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b1814c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b181602b0 0x7f9b180c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c8990 con 0x7f9b1806ab10 2023-07-20T11:22:24.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1815c6e0 con 0x7f9b1806c120 2023-07-20T11:22:24.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c8be0 con 0x7f9b181602b0 2023-07-20T11:22:24.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b17fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 0x7f9b180c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b17fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 0x7f9b180c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37152/0 (socket says 172.21.15.82:37152) 2023-07-20T11:22:24.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b17fff640 1 -- 172.21.15.82:0/4157785017 learned_addr learned my addr 172.21.15.82:0/4157785017 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b1814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1cba4640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b181602b0 0x7f9b180c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 -- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b181602b0 msgr2=0x7f9b180c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b181602b0 0x7f9b180c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 -- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 msgr2=0x7f9b180c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 0x7f9b180c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 -- 172.21.15.82:0/4157785017 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c0094d0 con 0x7f9b1806c120 2023-07-20T11:22:24.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b177fe640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b1814c980 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e8b0 tx=0x7f9b0c00ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c004030 con 0x7f9b1806c120 2023-07-20T11:22:24.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0c004190 con 0x7f9b1806c120 2023-07-20T11:22:24.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b08009420 con 0x7f9b1806c120 2023-07-20T11:22:24.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c004520 con 0x7f9b1806c120 2023-07-20T11:22:24.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.027+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1815c090 con 0x7f9b1806c120 2023-07-20T11:22:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b180c9700 con 0x7f9b1806c120 2023-07-20T11:22:24.023 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f9b0c00c940 con 0x7f9b1806c120 2023-07-20T11:22:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b14ff9640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 0x7f9b04068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f9b0c084150 con 0x7f9b1806c120 2023-07-20T11:22:24.024 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b17fff640 1 -- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 msgr2=0x7f9b04068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:24.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.031+0000 7f9b17fff640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 0x7f9b04068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:24.026 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.035+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9b0c051150 con 0x7f9b1806c120 2023-07-20T11:22:24.037 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.047+0000 7f1733b77180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:22:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.195+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b1804da30 con 0x7f9b1806c120 2023-07-20T11:22:24.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.195+0000 7f9b14ff9640 1 -- 172.21.15.82:0/4157785017 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v178) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b0c054770 con 0x7f9b1806c120 2023-07-20T11:22:24.186 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:22:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 msgr2=0x7f9b04068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 0x7f9b04068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 msgr2=0x7f9b1814c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b1814c980 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e8b0 tx=0x7f9b0c00ed70 comp rx=0 tx=0).stop 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 shutdown_connections 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f9b040663d0 0x7f9b04068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9b181602b0 0x7f9b180c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9b1806c120 0x7f9b1814c980 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 --2- 172.21.15.82:0/4157785017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b1806ab10 0x7f9b180c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 >> 172.21.15.82:0/4157785017 conn(0x7f9b1808c0a0 msgr2=0x7f9b180b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 shutdown_connections 2023-07-20T11:22:24.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.199+0000 7f9b1e607640 1 -- 172.21.15.82:0/4157785017 wait complete. 2023-07-20T11:22:24.207 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:22:24.214 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:24.225+0000 7f8272846180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:22:24.276 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:24.285+0000 7f8272846180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:22:24.324 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.335+0000 7f1733b77180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:22:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.363+0000 7f7b243fa640 1 Processor -- start 2023-07-20T11:22:24.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.363+0000 7f7b243fa640 1 -- start start 2023-07-20T11:22:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.363+0000 7f7b243fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b1c159830 0x7f7b1c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b243fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7b1c0cc3e0 0x7f7b1c0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b243fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b1c0cc8d0 con 0x7f7b1c159450 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b243fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0cce90 con 0x7f7b1c159830 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b243fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1c0ccbb0 con 0x7f7b1c0cc3e0 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b1c159830 0x7f7b1c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7b1c159830 0x7f7b1c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37162/0 (socket says 172.21.15.82:37162) 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 -- 172.21.15.82:0/3763731766 learned_addr learned my addr 172.21.15.82:0/3763731766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b22997640 1 --2- 172.21.15.82:0/3763731766 >> v2:172.21.15.183:3300/0 conn(0x7f7b1c0cc3e0 0x7f7b1c0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 -- 172.21.15.82:0/3763731766 >> v2:172.21.15.183:3300/0 conn(0x7f7b1c0cc3e0 msgr2=0x7f7b1c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 --2- 172.21.15.82:0/3763731766 >> v2:172.21.15.183:3300/0 conn(0x7f7b1c0cc3e0 0x7f7b1c0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 -- 172.21.15.82:0/3763731766 >> v1:172.21.15.183:6789/0 conn(0x7f7b1c159450 legacy=0x7f7b1c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 -- 172.21.15.82:0/3763731766 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c159cc0 con 0x7f7b1c159830 2023-07-20T11:22:24.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.367+0000 7f7b21995640 1 --2- 172.21.15.82:0/3763731766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c159830 0x7f7b1c0cbea0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0c1da0 tx=0x7f7b0c01e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7dae342a79fd1a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b21194640 1 -- 172.21.15.82:0/3763731766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0aa620 con 0x7f7b1c159830 2023-07-20T11:22:24.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b21194640 1 -- 172.21.15.82:0/3763731766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0aa780 con 0x7f7b1c159830 2023-07-20T11:22:24.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b21194640 1 -- 172.21.15.82:0/3763731766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0aab10 con 0x7f7b1c159830 2023-07-20T11:22:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- 172.21.15.82:0/3763731766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c159830 msgr2=0x7f7b1c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3763731766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c159830 0x7f7b1c0cbea0 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0c1da0 tx=0x7f7b0c01e6e0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- 172.21.15.82:0/3763731766 shutdown_connections 2023-07-20T11:22:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3763731766 >> v2:172.21.15.183:3300/0 conn(0x7f7b1c0cc3e0 0x7f7b1c0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3763731766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c159830 0x7f7b1c0cbea0 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- 172.21.15.82:0/3763731766 >> 172.21.15.82:0/3763731766 conn(0x7f7b1c0cad50 msgr2=0x7f7b1c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- 172.21.15.82:0/3763731766 shutdown_connections 2023-07-20T11:22:24.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- 172.21.15.82:0/3763731766 wait complete. 2023-07-20T11:22:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 Processor -- start 2023-07-20T11:22:24.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- start start 2023-07-20T11:22:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1c0cc3e0 0x7f7b1c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1c159450 0x7f7b1c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b30c0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0b33a0 con 0x7f7b1c0cc3e0 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.371+0000 7f7b243fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c0c2a50 con 0x7f7b1c159450 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37178/0 (socket says 172.21.15.82:37178) 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 -- 172.21.15.82:0/3466953982 learned_addr learned my addr 172.21.15.82:0/3466953982 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22196640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1c0cc3e0 0x7f7b1c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b21995640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1c159450 0x7f7b1c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 -- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1c159450 msgr2=0x7f7b1c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1c159450 0x7f7b1c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 -- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1c0cc3e0 msgr2=0x7f7b1c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1c0cc3e0 0x7f7b1c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 -- 172.21.15.82:0/3466953982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c0094d0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b22997640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400efc0 tx=0x7f7b1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14009ca0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400f040 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b140146c0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c0c2d30 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c0c6560 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.375+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1c15cac0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 107) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f7b14014820 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b12ffd640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 0x7f7b00068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f7b140856f0 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b22196640 1 -- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 msgr2=0x7f7b00068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3419453693 2023-07-20T11:22:24.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b22196640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 0x7f7b00068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:24.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.379+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b14052660 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.388 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.399+0000 7f1733b77180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:22:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.411+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 108) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7b14052a30 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.411+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 msgr2=0x7f7b00068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:24.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.411+0000 7f7b12ffd640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 0x7f7b00068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.466 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.475+0000 7f16c03b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.466 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.475+0000 7f16c03b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.467 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.475+0000 7f16c03b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.467 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.475+0000 7f16c03b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.467 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.475+0000 7f16c03b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.467 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.479+0000 7f16bcbaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.468 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.479+0000 7f16bcbaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.468 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.479+0000 7f16bcbaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.468 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.479+0000 7f16bcbaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.468 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:24.479+0000 7f16bcbaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.551+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b1c0b3560 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.551+0000 7f7b12ffd640 1 -- 172.21.15.82:0/3466953982 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v179) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b14042c30 con 0x7f7b1c0b2b40 2023-07-20T11:22:24.543 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:22:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 msgr2=0x7f7b1c1f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400efc0 tx=0x7f7b1400c490 comp rx=0 tx=0).stop 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 shutdown_connections 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:6832/3419453693,v1:172.21.15.82:6833/3419453693] conn(0x7f7b000663a0 0x7f7b00068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b1c0b2b40 0x7f7b1c1f4cd0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7b1c159450 0x7f7b1c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 --2- 172.21.15.82:0/3466953982 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b1c0cc3e0 0x7f7b1c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 >> 172.21.15.82:0/3466953982 conn(0x7f7b1c0cad50 msgr2=0x7f7b1c162c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 shutdown_connections 2023-07-20T11:22:24.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.555+0000 7f7b243fa640 1 -- 172.21.15.82:0/3466953982 wait complete. 2023-07-20T11:22:24.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:22:24.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 Processor -- start 2023-07-20T11:22:24.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 -- start start 2023-07-20T11:22:24.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ff5bc161de0 0x7ff5bc0afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc0b06e0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc0c9650 con 0x7ff5bc0b0290 2023-07-20T11:22:24.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c32ec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc1619c0 con 0x7ff5bc161de0 2023-07-20T11:22:24.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c1889640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c1889640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37298/0 (socket says 172.21.15.82:37298) 2023-07-20T11:22:24.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c1889640 1 -- 172.21.15.82:0/3438073576 learned_addr learned my addr 172.21.15.82:0/3438073576 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.715+0000 7ff5c0887640 1 --2- 172.21.15.82:0/3438073576 >> v2:172.21.15.183:3300/0 conn(0x7ff5bc161de0 0x7ff5bc0afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c1889640 1 -- 172.21.15.82:0/3438073576 >> v2:172.21.15.183:3300/0 conn(0x7ff5bc161de0 msgr2=0x7ff5bc0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:24.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c1889640 1 --2- 172.21.15.82:0/3438073576 >> v2:172.21.15.183:3300/0 conn(0x7ff5bc161de0 0x7ff5bc0afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c1889640 1 -- 172.21.15.82:0/3438073576 >> v1:172.21.15.82:6789/0 conn(0x7ff5bc160ba0 legacy=0x7ff5bc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c1889640 1 -- 172.21.15.82:0/3438073576 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0c9370 con 0x7ff5bc0b0290 2023-07-20T11:22:24.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5b3fff640 1 -- 172.21.15.82:0/3438073576 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774831144 0 0) 0x7ff5b8001120 con 0x7ff5bc160ba0 2023-07-20T11:22:24.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c1889640 1 --2- 172.21.15.82:0/3438073576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0b0ea0 tx=0x7ff5b401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a5276bbaeb691d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5b3fff640 1 -- 172.21.15.82:0/3438073576 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a5860 con 0x7ff5bc0b0290 2023-07-20T11:22:24.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5b3fff640 1 -- 172.21.15.82:0/3438073576 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40a59c0 con 0x7ff5bc0b0290 2023-07-20T11:22:24.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5b3fff640 1 -- 172.21.15.82:0/3438073576 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a5d50 con 0x7ff5bc0b0290 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3438073576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc0b0290 msgr2=0x7ff5bc0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3438073576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0b0ea0 tx=0x7ff5b401c9a0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3438073576 shutdown_connections 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3438073576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc0b0290 0x7ff5bc0cbea0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3438073576 >> v2:172.21.15.183:3300/0 conn(0x7ff5bc161de0 0x7ff5bc0afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.719+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3438073576 >> 172.21.15.82:0/3438073576 conn(0x7ff5bc0cad50 msgr2=0x7ff5bc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3438073576 shutdown_connections 2023-07-20T11:22:24.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3438073576 wait complete. 2023-07-20T11:22:24.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 Processor -- start 2023-07-20T11:22:24.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- start start 2023-07-20T11:22:24.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5bc0b0290 0x7ff5bc0c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5bc161de0 0x7ff5bc1fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc15bc80 con 0x7ff5bc160ba0 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b0de0 con 0x7ff5bc161de0 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c32ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0b10c0 con 0x7ff5bc0b0290 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37304/0 (socket says 172.21.15.82:37304) 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 -- 172.21.15.82:0/3891351007 learned_addr learned my addr 172.21.15.82:0/3891351007 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c1889640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5bc161de0 0x7ff5bc1fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c1088640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5bc0b0290 0x7ff5bc0c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 -- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5bc0b0290 msgr2=0x7ff5bc0c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5bc0b0290 0x7ff5bc0c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 -- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5bc161de0 msgr2=0x7ff5bc1fcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5bc161de0 0x7ff5bc1fcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 -- 172.21.15.82:0/3891351007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009b30 con 0x7ff5bc160ba0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.723+0000 7ff5c0887640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00d5f0 tx=0x7ff5ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0125f0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac012750 con 0x7ff5bc160ba0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac012ae0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc0b13a0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc0b1960 con 0x7ff5bc160ba0 2023-07-20T11:22:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc0b1b20 con 0x7ff5bc160ba0 2023-07-20T11:22:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 108) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ff5ac012c40 con 0x7ff5bc160ba0 2023-07-20T11:22:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.727+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7ff5ac083fe0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.731+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5ac0514b0 con 0x7ff5bc160ba0 2023-07-20T11:22:24.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.875+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5bc04da30 con 0x7ff5bc160ba0 2023-07-20T11:22:24.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5b1ffb640 1 -- 172.21.15.82:0/3891351007 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v179) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5ac007380 con 0x7ff5bc160ba0 2023-07-20T11:22:24.868 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:22:24.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 msgr2=0x7ff5bc1fc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:24.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00d5f0 tx=0x7ff5ac00dab0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 shutdown_connections 2023-07-20T11:22:24.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff5bc161de0 0x7ff5bc1fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5bc160ba0 0x7ff5bc1fc620 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 --2- 172.21.15.82:0/3891351007 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff5bc0b0290 0x7ff5bc0c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 >> 172.21.15.82:0/3891351007 conn(0x7ff5bc0cad50 msgr2=0x7ff5bc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 shutdown_connections 2023-07-20T11:22:24.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:24.879+0000 7ff5c32ec640 1 -- 172.21.15.82:0/3891351007 wait complete. 2023-07-20T11:22:24.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:22:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 Processor -- start 2023-07-20T11:22:25.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 -- start start 2023-07-20T11:22:25.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67b00b0460 0x7f67b00cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00c9370 con 0x7f67b0161de0 2023-07-20T11:22:25.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b0161300 con 0x7f67b0160ba0 2023-07-20T11:22:25.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b73f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b00c9650 con 0x7f67b00b0460 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b5990640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f67b00b0460 0x7f67b00cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b498e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f67b0161de0 0x7f67b00afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41062/0 (socket says 172.21.15.82:41062) 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b498e640 1 -- 172.21.15.82:0/813657487 learned_addr learned my addr 172.21.15.82:0/813657487 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b5990640 1 -- 172.21.15.82:0/813657487 >> v1:172.21.15.183:6789/0 conn(0x7f67b0160ba0 legacy=0x7f67b00c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b5990640 1 -- 172.21.15.82:0/813657487 >> v1:172.21.15.82:6789/0 conn(0x7f67b0161de0 legacy=0x7f67b00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67b5990640 1 -- 172.21.15.82:0/813657487 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b01615e0 con 0x7f67b00b0460 2023-07-20T11:22:25.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.043+0000 7f67a7fff640 1 -- 172.21.15.82:0/813657487 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310076432 0 0) 0x7f67b00c9370 con 0x7f67b0161de0 2023-07-20T11:22:25.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b5990640 1 --2- 172.21.15.82:0/813657487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b00b0460 0x7f67b00cbea0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009d90 tx=0x7f67a801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d4e38e5dfc7049 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67a7fff640 1 -- 172.21.15.82:0/813657487 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80a59a0 con 0x7f67b00b0460 2023-07-20T11:22:25.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67a7fff640 1 -- 172.21.15.82:0/813657487 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a80a5b00 con 0x7f67b00b0460 2023-07-20T11:22:25.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67a7fff640 1 -- 172.21.15.82:0/813657487 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80a5e90 con 0x7f67b00b0460 2023-07-20T11:22:25.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 -- 172.21.15.82:0/813657487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b00b0460 msgr2=0x7f67b00cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 --2- 172.21.15.82:0/813657487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b00b0460 0x7f67b00cbea0 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009d90 tx=0x7f67a801c8c0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 -- 172.21.15.82:0/813657487 shutdown_connections 2023-07-20T11:22:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 --2- 172.21.15.82:0/813657487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b00b0460 0x7f67b00cbea0 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 -- 172.21.15.82:0/813657487 >> 172.21.15.82:0/813657487 conn(0x7f67b00cad50 msgr2=0x7f67b00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 -- 172.21.15.82:0/813657487 shutdown_connections 2023-07-20T11:22:25.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.047+0000 7f67b73f3640 1 -- 172.21.15.82:0/813657487 wait complete. 2023-07-20T11:22:25.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 Processor -- start 2023-07-20T11:22:25.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- start start 2023-07-20T11:22:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b00b0460 0x7f67b015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0160ba0 0x7f67b00c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01619c0 con 0x7f67b0161de0 2023-07-20T11:22:25.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b015b010 con 0x7f67b00b0460 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b015b2f0 con 0x7f67b0160ba0 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37320/0 (socket says 172.21.15.82:37320) 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 -- 172.21.15.82:0/2383331941 learned_addr learned my addr 172.21.15.82:0/2383331941 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b518f640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b00b0460 0x7f67b015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b498e640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0160ba0 0x7f67b00c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 -- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0160ba0 msgr2=0x7f67b00c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0160ba0 0x7f67b00c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 -- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b00b0460 msgr2=0x7f67b015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b00b0460 0x7f67b015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 -- 172.21.15.82:0/2383331941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a8009a70 con 0x7f67b0161de0 2023-07-20T11:22:25.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b5990640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f67a801a4f0 tx=0x7f67a8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80ade40 con 0x7f67b0161de0 2023-07-20T11:22:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a80b9450 con 0x7f67b0161de0 2023-07-20T11:22:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b015b5d0 con 0x7f67b0161de0 2023-07-20T11:22:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a80b97e0 con 0x7f67b0161de0 2023-07-20T11:22:25.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b015bb90 con 0x7f67b0161de0 2023-07-20T11:22:25.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.051+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b015b430 con 0x7f67b0161de0 2023-07-20T11:22:25.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.055+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 108) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f67b00ccbf0 con 0x7f67b0161de0 2023-07-20T11:22:25.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.055+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7f67a811f1e0 con 0x7f67b0161de0 2023-07-20T11:22:25.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.059+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67b015b430 con 0x7f67b0161de0 2023-07-20T11:22:25.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.203+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67b015b430 con 0x7f67b0161de0 2023-07-20T11:22:25.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.203+0000 7f67a5ffb640 1 -- 172.21.15.82:0/2383331941 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v179) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67b015b430 con 0x7f67b0161de0 2023-07-20T11:22:25.195 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:22:25.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 msgr2=0x7f67b01634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f67a801a4f0 tx=0x7f67a8019660 comp rx=0 tx=0).stop 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 shutdown_connections 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f67b0161de0 0x7f67b01634e0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f67b0160ba0 0x7f67b00c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 --2- 172.21.15.82:0/2383331941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67b00b0460 0x7f67b015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 >> 172.21.15.82:0/2383331941 conn(0x7f67b00cad50 msgr2=0x7f67b0070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 shutdown_connections 2023-07-20T11:22:25.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.207+0000 7f67b73f3640 1 -- 172.21.15.82:0/2383331941 wait complete. 2023-07-20T11:22:25.216 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:25.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.363+0000 7fd9dbae5640 1 Processor -- start 2023-07-20T11:22:25.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.363+0000 7fd9dbae5640 1 -- start start 2023-07-20T11:22:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9dbae5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9d40ca040 0x7fd9d40ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9dbae5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9d415d4a0 0x7fd9d40b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9dbae5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40cde70 con 0x7fd9d415c910 2023-07-20T11:22:25.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9dbae5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40cbef0 con 0x7fd9d40ca040 2023-07-20T11:22:25.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9dbae5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d40ca420 con 0x7fd9d415d4a0 2023-07-20T11:22:25.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9d40ca040 0x7fd9d40ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd9d40ca040 0x7fd9d40ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37328/0 (socket says 172.21.15.82:37328) 2023-07-20T11:22:25.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 -- 172.21.15.82:0/2816818410 learned_addr learned my addr 172.21.15.82:0/2816818410 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:25.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 -- 172.21.15.82:0/2816818410 >> v2:172.21.15.183:3300/0 conn(0x7fd9d415d4a0 msgr2=0x7fd9d40b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:25.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 --2- 172.21.15.82:0/2816818410 >> v2:172.21.15.183:3300/0 conn(0x7fd9d415d4a0 0x7fd9d40b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 -- 172.21.15.82:0/2816818410 >> v1:172.21.15.183:6789/0 conn(0x7fd9d415c910 legacy=0x7fd9d415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:25.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.367+0000 7fd9d9881640 1 -- 172.21.15.82:0/2816818410 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d40cdb40 con 0x7fd9d40ca040 2023-07-20T11:22:25.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9d9881640 1 --2- 172.21.15.82:0/2816818410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d40ca040 0x7fd9d40ad060 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fd9d415c850 tx=0x7fd9d001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e169f9c266a90f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9d887f640 1 -- 172.21.15.82:0/2816818410 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00a7070 con 0x7fd9d40ca040 2023-07-20T11:22:25.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9d887f640 1 -- 172.21.15.82:0/2816818410 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d00ab430 con 0x7fd9d40ca040 2023-07-20T11:22:25.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9d887f640 1 -- 172.21.15.82:0/2816818410 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d00ab7c0 con 0x7fd9d40ca040 2023-07-20T11:22:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- 172.21.15.82:0/2816818410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d40ca040 msgr2=0x7fd9d40ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/2816818410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d40ca040 0x7fd9d40ad060 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fd9d415c850 tx=0x7fd9d001c490 comp rx=0 tx=0).stop 2023-07-20T11:22:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- 172.21.15.82:0/2816818410 shutdown_connections 2023-07-20T11:22:25.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/2816818410 >> v2:172.21.15.183:3300/0 conn(0x7fd9d415d4a0 0x7fd9d40b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/2816818410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d40ca040 0x7fd9d40ad060 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- 172.21.15.82:0/2816818410 >> 172.21.15.82:0/2816818410 conn(0x7fd9d40cada0 msgr2=0x7fd9d40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- 172.21.15.82:0/2816818410 shutdown_connections 2023-07-20T11:22:25.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- 172.21.15.82:0/2816818410 wait complete. 2023-07-20T11:22:25.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 Processor -- start 2023-07-20T11:22:25.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.371+0000 7fd9dbae5640 1 -- start start 2023-07-20T11:22:25.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9d40ca040 0x7fd9d40c17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9d415c910 0x7fd9d415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d415b290 con 0x7fd9d415d4a0 2023-07-20T11:22:25.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d415b560 con 0x7fd9d40ca040 2023-07-20T11:22:25.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d415b840 con 0x7fd9d415c910 2023-07-20T11:22:25.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37336/0 (socket says 172.21.15.82:37336) 2023-07-20T11:22:25.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 -- 172.21.15.82:0/1592875731 learned_addr learned my addr 172.21.15.82:0/1592875731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:25.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9d9881640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9d40ca040 0x7fd9d40c17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9d9080640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9d415c910 0x7fd9d415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 -- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9d415c910 msgr2=0x7fd9d415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9d415c910 0x7fd9d415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 -- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9d40ca040 msgr2=0x7fd9d40c17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9d40ca040 0x7fd9d40c17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 -- 172.21.15.82:0/1592875731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00094d0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9da082640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00b970 tx=0x7fd9cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00cb40 con 0x7fd9d415d4a0 2023-07-20T11:22:25.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00ccc0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d415bb20 con 0x7fd9d415d4a0 2023-07-20T11:22:25.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc014680 con 0x7fd9d415d4a0 2023-07-20T11:22:25.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d415c0e0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d4073c70 con 0x7fd9d415d4a0 2023-07-20T11:22:25.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.375+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 108) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fd9cc01d3b0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.379+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7fd9cc083b80 con 0x7fd9d415d4a0 2023-07-20T11:22:25.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.383+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9cc051050 con 0x7fd9d415d4a0 2023-07-20T11:22:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.443+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 109) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd9cc050b00 con 0x7fd9d415d4a0 2023-07-20T11:22:25.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.447+0000 7fd9ca7fc640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 0x7fd9b806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.447+0000 7fd9d9881640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 0x7fd9b806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.447+0000 7fd9d9881640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 0x7fd9b806e8e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00af000 tx=0x7fd9d0008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.567+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9d40cbbd0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.567+0000 7fd9ca7fc640 1 -- 172.21.15.82:0/1592875731 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fd9cc0819e0 con 0x7fd9d415d4a0 2023-07-20T11:22:25.559 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:25.559 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:22:25.559 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:22:25.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 msgr2=0x7fd9b806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 0x7fd9b806e8e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00af000 tx=0x7fd9d0008040 comp rx=0 tx=0).stop 2023-07-20T11:22:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 msgr2=0x7fd9d41583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00b970 tx=0x7fd9cc00be30 comp rx=0 tx=0).stop 2023-07-20T11:22:25.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 shutdown_connections 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd9b806c4f0 0x7fd9b806e8e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9d415d4a0 0x7fd9d41583b0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd9d415c910 0x7fd9d415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 --2- 172.21.15.82:0/1592875731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9d40ca040 0x7fd9d40c17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 >> 172.21.15.82:0/1592875731 conn(0x7fd9d40cada0 msgr2=0x7fd9d40b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 shutdown_connections 2023-07-20T11:22:25.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.571+0000 7fd9dbae5640 1 -- 172.21.15.82:0/1592875731 wait complete. 2023-07-20T11:22:25.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:25.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 Processor -- start 2023-07-20T11:22:25.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 -- start start 2023-07-20T11:22:25.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbed415dbb0 0x7fbed40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed40ad810 con 0x7fbed40b2a90 2023-07-20T11:22:25.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed415d0d0 con 0x7fbed41596b0 2023-07-20T11:22:25.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbedbd03640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed415e000 con 0x7fbed415dbb0 2023-07-20T11:22:25.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbeda2a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbed415dbb0 0x7fbed40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbeda2a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fbed415dbb0 0x7fbed40cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37350/0 (socket says 172.21.15.82:37350) 2023-07-20T11:22:25.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.727+0000 7fbeda2a0640 1 -- 172.21.15.82:0/3703746671 learned_addr learned my addr 172.21.15.82:0/3703746671 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:25.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbeda2a0640 1 -- 172.21.15.82:0/3703746671 >> v1:172.21.15.183:6789/0 conn(0x7fbed41596b0 legacy=0x7fbed40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbeda2a0640 1 -- 172.21.15.82:0/3703746671 >> v1:172.21.15.82:6789/0 conn(0x7fbed40b2a90 legacy=0x7fbed40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbeda2a0640 1 -- 172.21.15.82:0/3703746671 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed415d3b0 con 0x7fbed415dbb0 2023-07-20T11:22:25.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbeda2a0640 1 --2- 172.21.15.82:0/3703746671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed415dbb0 0x7fbed40cc900 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e80 tx=0x7fbecc01ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f66374661dc1aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbed8a9d640 1 -- 172.21.15.82:0/3703746671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0a7a40 con 0x7fbed415dbb0 2023-07-20T11:22:25.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbed8a9d640 1 -- 172.21.15.82:0/3703746671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc0a7ba0 con 0x7fbed415dbb0 2023-07-20T11:22:25.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbed8a9d640 1 -- 172.21.15.82:0/3703746671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc0af3f0 con 0x7fbed415dbb0 2023-07-20T11:22:25.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbedbd03640 1 -- 172.21.15.82:0/3703746671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed415dbb0 msgr2=0x7fbed40cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3703746671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed415dbb0 0x7fbed40cc900 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009e80 tx=0x7fbecc01ebd0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbedbd03640 1 -- 172.21.15.82:0/3703746671 shutdown_connections 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3703746671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed415dbb0 0x7fbed40cc900 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.731+0000 7fbedbd03640 1 -- 172.21.15.82:0/3703746671 >> 172.21.15.82:0/3703746671 conn(0x7fbed40cada0 msgr2=0x7fbed40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- 172.21.15.82:0/3703746671 shutdown_connections 2023-07-20T11:22:25.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- 172.21.15.82:0/3703746671 wait complete. 2023-07-20T11:22:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 Processor -- start 2023-07-20T11:22:25.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- start start 2023-07-20T11:22:25.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 0x7fbed415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed415dbb0 0x7fbed414bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40cce40 con 0x7fbed41596b0 2023-07-20T11:22:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed415a540 con 0x7fbed40b2a90 2023-07-20T11:22:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbedbd03640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed415c8a0 con 0x7fbed415dbb0 2023-07-20T11:22:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37364/0 (socket says 172.21.15.82:37364) 2023-07-20T11:22:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 -- 172.21.15.82:0/3012749397 learned_addr learned my addr 172.21.15.82:0/3012749397 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed9a9f640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 0x7fbed415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbeda2a0640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed415dbb0 0x7fbed414bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 -- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed415dbb0 msgr2=0x7fbed414bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed415dbb0 0x7fbed414bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 -- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 msgr2=0x7fbed415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 0x7fbed415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 -- 172.21.15.82:0/3012749397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009b30 con 0x7fbed41596b0 2023-07-20T11:22:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed9a9f640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 0x7fbed415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.735+0000 7fbed929e640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c500 tx=0x7fbec400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4005220 con 0x7fbed41596b0 2023-07-20T11:22:25.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4005380 con 0x7fbed41596b0 2023-07-20T11:22:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4007270 con 0x7fbed41596b0 2023-07-20T11:22:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed415a7e0 con 0x7fbed41596b0 2023-07-20T11:22:25.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed415ada0 con 0x7fbed41596b0 2023-07-20T11:22:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed4073c70 con 0x7fbed41596b0 2023-07-20T11:22:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 109) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbec40073d0 con 0x7fbed41596b0 2023-07-20T11:22:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 0x7fbeb80685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:25.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7fbec40837a0 con 0x7fbed41596b0 2023-07-20T11:22:25.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbed9a9f640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 0x7fbeb80685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:25.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.739+0000 7fbed9a9f640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 0x7fbeb80685c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbed415a470 tx=0x7fbed0009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:25.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.743+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbec40509f0 con 0x7fbed41596b0 2023-07-20T11:22:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.891+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbed40ca3a0 con 0x7fbed41596b0 2023-07-20T11:22:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.891+0000 7fbeca7fc640 1 -- 172.21.15.82:0/3012749397 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+20118 (secure 0 0 0) 0x7fbec4054010 con 0x7fbed41596b0 2023-07-20T11:22:25.882 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:25.882 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":179,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:24.403114+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":178,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.37","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/4046327288":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/228016562":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/123409211":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6833/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1005282252":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2227667398":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/3354238649":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2638908174":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1963263671":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1357101313":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1631845088":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/2423893973":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1623200444":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1823256241":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/619909040":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1569167348":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1537887134":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1510409822":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1993560711":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6833/919074132":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/919074132":"2023-07-21T11:06:39.872076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 msgr2=0x7fbeb80685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 0x7fbeb80685c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbed415a470 tx=0x7fbed0009040 comp rx=0 tx=0).stop 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 msgr2=0x7fbed414b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fbec400c500 tx=0x7fbec400c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 shutdown_connections 2023-07-20T11:22:25.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed415dbb0 0x7fbed414bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbeb8066100 0x7fbeb80685c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed41596b0 0x7fbed414b5d0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 --2- 172.21.15.82:0/3012749397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40b2a90 0x7fbed415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 >> 172.21.15.82:0/3012749397 conn(0x7fbed40cada0 msgr2=0x7fbed40aae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 shutdown_connections 2023-07-20T11:22:25.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:25.895+0000 7fbedbd03640 1 -- 172.21.15.82:0/3012749397 wait complete. 2023-07-20T11:22:25.903 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:22:25.904 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:26.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.051+0000 7f7f26767640 1 Processor -- start 2023-07-20T11:22:26.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.051+0000 7f7f26767640 1 -- start start 2023-07-20T11:22:26.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f26767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7f201596b0 0x7f7f2015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f26767640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200ccd90 con 0x7f7f200b2a90 2023-07-20T11:22:26.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f26767640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200ad810 con 0x7f7f200cc900 2023-07-20T11:22:26.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f26767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2015d0d0 con 0x7f7f201596b0 2023-07-20T11:22:26.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f24d04640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7f200b2a90 0x7f7f200c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41080/0 (socket says 172.21.15.82:41080) 2023-07-20T11:22:26.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f24d04640 1 -- 172.21.15.82:0/858077683 learned_addr learned my addr 172.21.15.82:0/858077683 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:26.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/858077683 >> v2:172.21.15.183:3300/0 conn(0x7f7f201596b0 0x7f7f2015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1effd640 1 -- 172.21.15.82:0/858077683 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371575187 0 0) 0x7f7f200ccd90 con 0x7f7f200b2a90 2023-07-20T11:22:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1effd640 1 -- 172.21.15.82:0/858077683 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f08003530 con 0x7f7f200b2a90 2023-07-20T11:22:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1ffff640 1 -- 172.21.15.82:0/858077683 >> v1:172.21.15.183:6789/0 conn(0x7f7f200cc900 legacy=0x7f7f200b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1ffff640 1 -- 172.21.15.82:0/858077683 >> v1:172.21.15.82:6789/0 conn(0x7f7f200b2a90 legacy=0x7f7f200c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.055+0000 7f7f1ffff640 1 -- 172.21.15.82:0/858077683 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2015d3b0 con 0x7f7f201596b0 2023-07-20T11:22:26.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/858077683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f2015dbb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f100097f0 tx=0x7f7f1001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edb6ffb95bc59e18 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f1effd640 1 -- 172.21.15.82:0/858077683 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100ab5f0 con 0x7f7f201596b0 2023-07-20T11:22:26.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f1effd640 1 -- 172.21.15.82:0/858077683 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f100ab750 con 0x7f7f201596b0 2023-07-20T11:22:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f1effd640 1 -- 172.21.15.82:0/858077683 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f100abae0 con 0x7f7f201596b0 2023-07-20T11:22:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- 172.21.15.82:0/858077683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 msgr2=0x7f7f2015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 --2- 172.21.15.82:0/858077683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f2015dbb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f100097f0 tx=0x7f7f1001c450 comp rx=0 tx=0).stop 2023-07-20T11:22:26.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- 172.21.15.82:0/858077683 shutdown_connections 2023-07-20T11:22:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 --2- 172.21.15.82:0/858077683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f2015dbb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- 172.21.15.82:0/858077683 >> 172.21.15.82:0/858077683 conn(0x7f7f200cada0 msgr2=0x7f7f200cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- 172.21.15.82:0/858077683 shutdown_connections 2023-07-20T11:22:26.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- 172.21.15.82:0/858077683 wait complete. 2023-07-20T11:22:26.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 Processor -- start 2023-07-20T11:22:26.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.059+0000 7f7f26767640 1 -- start start 2023-07-20T11:22:26.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 0x7f7f2015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f20152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f20159a90 con 0x7f7f200cc900 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b0bf0 con 0x7f7f201596b0 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200ade20 con 0x7f7f200b2a90 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37368/0 (socket says 172.21.15.82:37368) 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 -- 172.21.15.82:0/3860107771 learned_addr learned my addr 172.21.15.82:0/3860107771 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f24d04640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f20152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 -- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 msgr2=0x7f7f2015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 0x7f7f2015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 0x7f7f2015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 -- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 msgr2=0x7f7f20152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f20152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 -- 172.21.15.82:0/3860107771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10009420 con 0x7f7f200cc900 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f24d04640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f20152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 0x7f7f2015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1f7fe640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c500 tx=0x7f7f1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14005220 con 0x7f7f200cc900 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f14005380 con 0x7f7f200cc900 2023-07-20T11:22:26.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f200ae100 con 0x7f7f200cc900 2023-07-20T11:22:26.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14007270 con 0x7f7f200cc900 2023-07-20T11:22:26.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2015c820 con 0x7f7f200cc900 2023-07-20T11:22:26.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.063+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f20073c70 con 0x7f7f200cc900 2023-07-20T11:22:26.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.067+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 109) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f7f140073d0 con 0x7f7f200cc900 2023-07-20T11:22:26.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.067+0000 7f7f1cff9640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 0x7f7f0c0685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.067+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7f7f14083800 con 0x7f7f200cc900 2023-07-20T11:22:26.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.067+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 0x7f7f0c0685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.067+0000 7f7f1ffff640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 0x7f7f0c0685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f100af000 tx=0x7f7f10008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.071+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f140509c0 con 0x7f7f200cc900 2023-07-20T11:22:26.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f200cdb00 con 0x7f7f200cc900 2023-07-20T11:22:26.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f1cff9640 1 -- 172.21.15.82:0/3860107771 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f7f14053fe0 con 0x7f7f200cc900 2023-07-20T11:22:26.241 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:26.241 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:22:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:22:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 msgr2=0x7f7f0c0685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 0x7f7f0c0685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f100af000 tx=0x7f7f10008040 comp rx=0 tx=0).stop 2023-07-20T11:22:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 msgr2=0x7f7f200b06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400c500 tx=0x7f7f1400c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 shutdown_connections 2023-07-20T11:22:26.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f201596b0 0x7f7f20152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7f0c066100 0x7f7f0c0685c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f200cc900 0x7f7f200b06b0 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 --2- 172.21.15.82:0/3860107771 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7f200b2a90 0x7f7f2015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 >> 172.21.15.82:0/3860107771 conn(0x7f7f200cada0 msgr2=0x7f7f200aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 shutdown_connections 2023-07-20T11:22:26.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.251+0000 7f7f26767640 1 -- 172.21.15.82:0/3860107771 wait complete. 2023-07-20T11:22:26.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.407+0000 7fb7fa6ec640 1 Processor -- start 2023-07-20T11:22:26.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7fa6ec640 1 -- start start 2023-07-20T11:22:26.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7fa6ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7f40ca6b0 0x7fb7f40b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7fa6ec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b06c0 con 0x7fb7f415a8e0 2023-07-20T11:22:26.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7fa6ec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f40b12a0 con 0x7fb7f40afda0 2023-07-20T11:22:26.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7fa6ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40b3160 con 0x7fb7f40ca6b0 2023-07-20T11:22:26.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb7f415a8e0 0x7fb7f40b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41090/0 (socket says 172.21.15.82:41090) 2023-07-20T11:22:26.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f37fe640 1 -- 172.21.15.82:0/991850916 learned_addr learned my addr 172.21.15.82:0/991850916 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7f40ca6b0 0x7fb7f40b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228261373 0 0) 0x7fb7f40b06c0 con 0x7fb7f415a8e0 2023-07-20T11:22:26.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc003530 con 0x7fb7f415a8e0 2023-07-20T11:22:26.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901111470 0 0) 0x7fb7f40b12a0 con 0x7fb7f40afda0 2023-07-20T11:22:26.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f40b06c0 con 0x7fb7f40afda0 2023-07-20T11:22:26.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338130203 0 0) 0x7fb7dc003530 con 0x7fb7f415a8e0 2023-07-20T11:22:26.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7f40ca6b0 msgr2=0x7fb7f40b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7f40ca6b0 0x7fb7f40b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 >> v1:172.21.15.183:6789/0 conn(0x7fb7f40afda0 legacy=0x7fb7f40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40b1580 con 0x7fb7f415a8e0 2023-07-20T11:22:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fb7e8001680 con 0x7fb7f415a8e0 2023-07-20T11:22:26.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 >> v1:172.21.15.82:6789/0 conn(0x7fb7f415a8e0 legacy=0x7fb7f40b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc003b40 0x7fb7dc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7dc0047d0 0x7fb7dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7dc005190 0x7fb7dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40b3160 con 0x7fb7dc005190 2023-07-20T11:22:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc00c000 con 0x7fb7dc0047d0 2023-07-20T11:22:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc00c1c0 con 0x7fb7dc003b40 2023-07-20T11:22:26.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7dc005190 0x7fb7dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f37fe640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7dc0047d0 0x7fb7dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f3fff640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc003b40 0x7fb7dc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 -- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc003b40 msgr2=0x7fb7dc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc003b40 0x7fb7dc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 -- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7dc0047d0 msgr2=0x7fb7dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7dc0047d0 0x7fb7dc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.411+0000 7fb7f8c89640 1 -- 172.21.15.82:0/991850916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc003530 con 0x7fb7dc005190 2023-07-20T11:22:26.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7dc005190 0x7fb7dc00b990 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009f00 tx=0x7fb7ec01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb767bbb319438b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a5bf0 con 0x7fb7dc005190 2023-07-20T11:22:26.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00f040 con 0x7fb7dc005190 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7f2ffd640 1 -- 172.21.15.82:0/991850916 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0ad440 con 0x7fb7dc005190 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/991850916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7dc005190 msgr2=0x7fb7dc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/991850916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7dc005190 0x7fb7dc00b990 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009f00 tx=0x7fb7ec01cba0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7f8c89640 1 -- 172.21.15.82:0/991850916 reap_dead start 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/991850916 shutdown_connections 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/991850916 >> 172.21.15.82:0/991850916 conn(0x7fb7f40cada0 msgr2=0x7fb7f40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/991850916 shutdown_connections 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.415+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/991850916 wait complete. 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 Processor -- start 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- start start 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc005190 0x7fb7f41ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7f4099a90 0x7fb7f415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415bbb0 con 0x7fb7f4155ae0 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f41ef8f0 con 0x7fb7f4099a90 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f415d200 con 0x7fb7dc005190 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc005190 0x7fb7f41ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37388/0 (socket says 172.21.15.82:37388) 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 -- 172.21.15.82:0/3001249312 learned_addr learned my addr 172.21.15.82:0/3001249312 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:26.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f37fe640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7f4099a90 0x7fb7f415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 -- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc005190 msgr2=0x7fb7f41ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc005190 0x7fb7f41ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 -- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7f4099a90 msgr2=0x7fb7f415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7f4099a90 0x7fb7f415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 -- 172.21.15.82:0/3001249312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f415cc40 con 0x7fb7f4155ae0 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f8c89640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b0040 tx=0x7fb7ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0ad850 con 0x7fb7f4155ae0 2023-07-20T11:22:26.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0ad9b0 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0add40 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f415cf20 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.419+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f415da70 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f415d340 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 109) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb7ec0b4040 con 0x7fb7f4155ae0 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7f0ff9640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 0x7fb7e0068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7fb7ec11e4d0 con 0x7fb7f4155ae0 2023-07-20T11:22:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7f3fff640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 0x7fb7e0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.423+0000 7fb7f3fff640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 0x7fb7e0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4007af0 tx=0x7fb7e4007290 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.427+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7ec0eb920 con 0x7fb7f4155ae0 2023-07-20T11:22:26.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.455+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 110) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fb7ec0ebcf0 con 0x7fb7f4155ae0 2023-07-20T11:22:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.615+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7f4073c70 con 0x7fb7f4155ae0 2023-07-20T11:22:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.615+0000 7fb7f0ff9640 1 -- 172.21.15.82:0/3001249312 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+4685 (secure 0 0 0) 0x7fb7ec0b8070 con 0x7fb7f4155ae0 2023-07-20T11:22:26.606 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:26.607 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:06:22.522877+0000","modified":"2023-07-20T11:06:26.168802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10167":{"gid":10167,"name":"c","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/1027853129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1027853129},{"type":"v1","addr":"172.21.15.82:6837","nonce":1027853129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 82 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 msgr2=0x7fb7e0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 0x7fb7e0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4007af0 tx=0x7fb7e4007290 comp rx=0 tx=0).stop 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 msgr2=0x7fb7f415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0b0040 tx=0x7fb7ec009750 comp rx=0 tx=0).stop 2023-07-20T11:22:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 shutdown_connections 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb7e00660d0 0x7fb7e0068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7f4155ae0 0x7fb7f415bfd0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7f4099a90 0x7fb7f415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 --2- 172.21.15.82:0/3001249312 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb7dc005190 0x7fb7f41ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 >> 172.21.15.82:0/3001249312 conn(0x7fb7f40cada0 msgr2=0x7fb7f40acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 shutdown_connections 2023-07-20T11:22:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.619+0000 7fb7fa6ec640 1 -- 172.21.15.82:0/3001249312 wait complete. 2023-07-20T11:22:26.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 Processor -- start 2023-07-20T11:22:26.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 -- start start 2023-07-20T11:22:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c0afda0 0x7f605c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f605c15a8e0 0x7f605c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c0b2ee0 con 0x7f605c0b2060 2023-07-20T11:22:26.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c0b3160 con 0x7f605c15a8e0 2023-07-20T11:22:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.775+0000 7f6061ae5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0b12a0 con 0x7f605c0afda0 2023-07-20T11:22:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f605c15a8e0 0x7f605c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f605c15a8e0 0x7f605c0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37422/0 (socket says 172.21.15.82:37422) 2023-07-20T11:22:26.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 -- 172.21.15.82:0/2359870977 learned_addr learned my addr 172.21.15.82:0/2359870977 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f605b7fe640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c0afda0 0x7f605c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 -- 172.21.15.82:0/2359870977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c0afda0 msgr2=0x7f605c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:26.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c0afda0 0x7f605c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 -- 172.21.15.82:0/2359870977 >> v1:172.21.15.183:6789/0 conn(0x7f605c0b2060 legacy=0x7f605c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 -- 172.21.15.82:0/2359870977 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0b1580 con 0x7f605c15a8e0 2023-07-20T11:22:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f6052ffd640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c15a8e0 0x7f605c0b29a0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f6044009e80 tx=0x7f604401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f530ec8eec887c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f605affd640 1 -- 172.21.15.82:0/2359870977 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440a5760 con 0x7f605c15a8e0 2023-07-20T11:22:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f605affd640 1 -- 172.21.15.82:0/2359870977 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60440a58c0 con 0x7f605c15a8e0 2023-07-20T11:22:26.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.779+0000 7f605affd640 1 -- 172.21.15.82:0/2359870977 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440a5c50 con 0x7f605c15a8e0 2023-07-20T11:22:26.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- 172.21.15.82:0/2359870977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c15a8e0 msgr2=0x7f605c0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c15a8e0 0x7f605c0b29a0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7f6044009e80 tx=0x7f604401c8a0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- 172.21.15.82:0/2359870977 shutdown_connections 2023-07-20T11:22:26.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c15a8e0 0x7f605c0b29a0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- 172.21.15.82:0/2359870977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c0afda0 0x7f605c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- 172.21.15.82:0/2359870977 >> 172.21.15.82:0/2359870977 conn(0x7f605c0cada0 msgr2=0x7f605c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- 172.21.15.82:0/2359870977 shutdown_connections 2023-07-20T11:22:26.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- 172.21.15.82:0/2359870977 wait complete. 2023-07-20T11:22:26.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 Processor -- start 2023-07-20T11:22:26.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- start start 2023-07-20T11:22:26.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f605c0afda0 0x7f605c15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c15a8e0 0x7f605c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0c53f0 con 0x7f605c0b2060 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0c5640 con 0x7f605c0afda0 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6061ae5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0c5920 con 0x7f605c15a8e0 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6052ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6052ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37428/0 (socket says 172.21.15.82:37428) 2023-07-20T11:22:26.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f6052ffd640 1 -- 172.21.15.82:0/3394555358 learned_addr learned my addr 172.21.15.82:0/3394555358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:26.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f605b7fe640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f605c0afda0 0x7f605c15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.783+0000 7f605bfff640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c15a8e0 0x7f605c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 -- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c15a8e0 msgr2=0x7f605c0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c15a8e0 0x7f605c0c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 -- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f605c0afda0 msgr2=0x7f605c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f605c0afda0 0x7f605c15d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 -- 172.21.15.82:0/3394555358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6044009b30 con 0x7f605c0b2060 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6052ffd640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f604401a4d0 tx=0x7f6044019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440b8640 con 0x7f605c0b2060 2023-07-20T11:22:26.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60440b87a0 con 0x7f605c0b2060 2023-07-20T11:22:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c0c5c00 con 0x7f605c0b2060 2023-07-20T11:22:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60440b8b50 con 0x7f605c0b2060 2023-07-20T11:22:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c155740 con 0x7f605c0b2060 2023-07-20T11:22:26.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c155930 con 0x7f605c0b2060 2023-07-20T11:22:26.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 110) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f60440b8cb0 con 0x7f605c0b2060 2023-07-20T11:22:26.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.787+0000 7f6058ff9640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 0x7f603c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:26.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.791+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7f604411f5a0 con 0x7f605c0b2060 2023-07-20T11:22:26.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.791+0000 7f605b7fe640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 0x7f603c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:26.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.791+0000 7f605b7fe640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 0x7f603c0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f604c007a60 tx=0x7f604c008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:26.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.795+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f605c155930 con 0x7f605c0b2060 2023-07-20T11:22:26.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f605c155930 con 0x7f605c0b2060 2023-07-20T11:22:26.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6058ff9640 1 -- 172.21.15.82:0/3394555358 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+20118 (secure 0 0 0) 0x7f605c155930 con 0x7f605c0b2060 2023-07-20T11:22:26.933 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:26.934 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":179,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:24.403114+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:06:20.190093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-20T11:06:21.518753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":178,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.37","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/4046327288":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/228016562":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/123409211":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6833/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1005282252":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2227667398":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/3354238649":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2638908174":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1963263671":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1357101313":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1631845088":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/2423893973":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1623200444":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1823256241":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/619909040":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1569167348":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1537887134":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1510409822":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1993560711":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6833/919074132":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/919074132":"2023-07-21T11:06:39.872076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 msgr2=0x7f603c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 0x7f603c0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f604c007a60 tx=0x7f604c008040 comp rx=0 tx=0).stop 2023-07-20T11:22:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 msgr2=0x7f605c0ac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f604401a4d0 tx=0x7f6044019640 comp rx=0 tx=0).stop 2023-07-20T11:22:26.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 shutdown_connections 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f605c15a8e0 0x7f605c0c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f603c066310 0x7f603c0687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f605c0b2060 0x7f605c0ac140 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 --2- 172.21.15.82:0/3394555358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f605c0afda0 0x7f605c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 >> 172.21.15.82:0/3394555358 conn(0x7f605c0cada0 msgr2=0x7f605c070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.943+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 shutdown_connections 2023-07-20T11:22:26.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:26.947+0000 7f6061ae5640 1 -- 172.21.15.82:0/3394555358 wait complete. 2023-07-20T11:22:26.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T11:22:27.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.103+0000 7f1ba7d40640 1 Processor -- start 2023-07-20T11:22:27.094 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.103+0000 7f1ba7d40640 1 -- start start 2023-07-20T11:22:27.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba7d40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 0x7f1ba006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba7d40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba0160fa0 0x7f1ba00c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.095 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba7d40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba00cc560 con 0x7f1ba006c700 2023-07-20T11:22:27.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba7d40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00ad7e0 con 0x7f1ba0160fa0 2023-07-20T11:22:27.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba7d40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00cc790 con 0x7f1ba0160bc0 2023-07-20T11:22:27.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba0160fa0 0x7f1ba00c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba0160fa0 0x7f1ba00c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37434/0 (socket says 172.21.15.82:37434) 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 -- 172.21.15.82:0/2911997927 learned_addr learned my addr 172.21.15.82:0/2911997927 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 -- 172.21.15.82:0/2911997927 >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 msgr2=0x7f1ba006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/2911997927 >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 0x7f1ba006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 --2- 172.21.15.82:0/2911997927 >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 0x7f1ba006c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 -- 172.21.15.82:0/2911997927 >> v1:172.21.15.82:6789/0 conn(0x7f1ba006c700 legacy=0x7f1ba00aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 -- 172.21.15.82:0/2911997927 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba00cca70 con 0x7f1ba0160fa0 2023-07-20T11:22:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/2911997927 >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 0x7f1ba006c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba4ada640 1 -- 172.21.15.82:0/2911997927 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352799254 0 0) 0x7f1ba00cc560 con 0x7f1ba006c700 2023-07-20T11:22:27.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba52db640 1 --2- 172.21.15.82:0/2911997927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160fa0 0x7f1ba00c12f0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00cf420 tx=0x7f1b9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2226504f7d0494 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba4ada640 1 -- 172.21.15.82:0/2911997927 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900aa430 con 0x7f1ba0160fa0 2023-07-20T11:22:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba4ada640 1 -- 172.21.15.82:0/2911997927 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900aa590 con 0x7f1ba0160fa0 2023-07-20T11:22:27.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.107+0000 7f1ba4ada640 1 -- 172.21.15.82:0/2911997927 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900aa920 con 0x7f1ba0160fa0 2023-07-20T11:22:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- 172.21.15.82:0/2911997927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160fa0 msgr2=0x7f1ba00c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/2911997927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160fa0 0x7f1ba00c12f0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00cf420 tx=0x7f1b9001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- 172.21.15.82:0/2911997927 shutdown_connections 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/2911997927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160fa0 0x7f1ba00c12f0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/2911997927 >> v2:172.21.15.183:3300/0 conn(0x7f1ba0160bc0 0x7f1ba006c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- 172.21.15.82:0/2911997927 >> 172.21.15.82:0/2911997927 conn(0x7f1ba00cada0 msgr2=0x7f1ba00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- 172.21.15.82:0/2911997927 shutdown_connections 2023-07-20T11:22:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- 172.21.15.82:0/2911997927 wait complete. 2023-07-20T11:22:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 Processor -- start 2023-07-20T11:22:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- start start 2023-07-20T11:22:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 0x7f1ba00aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 0x7f1ba0155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00c32d0 con 0x7f1ba0160bc0 2023-07-20T11:22:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0156b70 con 0x7f1ba006c700 2023-07-20T11:22:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba7d40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00c3520 con 0x7f1ba0160fa0 2023-07-20T11:22:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37450/0 (socket says 172.21.15.82:37450) 2023-07-20T11:22:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 -- 172.21.15.82:0/3854389523 learned_addr learned my addr 172.21.15.82:0/3854389523 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 0x7f1ba00aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 -- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 msgr2=0x7f1ba0155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba62dd640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 0x7f1ba0155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 0x7f1ba0155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 -- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 msgr2=0x7f1ba00aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.111+0000 7f1ba52db640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 0x7f1ba00aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba52db640 1 -- 172.21.15.82:0/3854389523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094d0 con 0x7f1ba0160bc0 2023-07-20T11:22:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 0x7f1ba00aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba62dd640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 0x7f1ba0155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:27.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba52db640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f1b900190e0 tx=0x7f1b9001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b3800 con 0x7f1ba0160bc0 2023-07-20T11:22:27.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900b3980 con 0x7f1ba0160bc0 2023-07-20T11:22:27.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b3d30 con 0x7f1ba0160bc0 2023-07-20T11:22:27.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba00c3800 con 0x7f1ba0160bc0 2023-07-20T11:22:27.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba00c3dc0 con 0x7f1ba0160bc0 2023-07-20T11:22:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba0073c70 con 0x7f1ba0160bc0 2023-07-20T11:22:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 110) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f1b900c6440 con 0x7f1ba0160bc0 2023-07-20T11:22:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 0x7f1b840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.115+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7252+0+0 (secure 0 0 0) 0x7f1b9011ed20 con 0x7f1ba0160bc0 2023-07-20T11:22:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.119+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 0x7f1b840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.119+0000 7f1ba5adc640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 0x7f1b840687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00c52a0 tx=0x7f1b9c008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.119+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b900ebc80 con 0x7f1ba0160bc0 2023-07-20T11:22:27.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.299+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ba009bff0 con 0x7f1ba0160bc0 2023-07-20T11:22:27.290 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T11:22:27.299+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T11:22:27.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1b967fc640 1 -- 172.21.15.82:0/3854389523 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1b900ef2a0 con 0x7f1ba0160bc0 2023-07-20T11:22:27.297 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T11:22:27.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 msgr2=0x7f1b840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 0x7f1b840687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00c52a0 tx=0x7f1b9c008040 comp rx=0 tx=0).stop 2023-07-20T11:22:27.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 msgr2=0x7f1ba00c45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f1b900190e0 tx=0x7f1b9001ad10 comp rx=0 tx=0).stop 2023-07-20T11:22:27.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 shutdown_connections 2023-07-20T11:22:27.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba0160fa0 0x7f1ba0155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1b84066310 0x7f1b840687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba0160bc0 0x7f1ba00c45c0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 --2- 172.21.15.82:0/3854389523 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba006c700 0x7f1ba00aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 >> 172.21.15.82:0/3854389523 conn(0x7f1ba00cada0 msgr2=0x7f1ba00ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:27.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 shutdown_connections 2023-07-20T11:22:27.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.307+0000 7f1ba7d40640 1 -- 172.21.15.82:0/3854389523 wait complete. 2023-07-20T11:22:27.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T11:22:27.360 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:22:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.475+0000 7f6def688640 1 Processor -- start 2023-07-20T11:22:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.475+0000 7f6def688640 1 -- start start 2023-07-20T11:22:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.475+0000 7f6def688640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6de80ca5a0 0x7f6de815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6def688640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6de815ec90 0x7f6de815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6def688640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de8071950 con 0x7f6de806f710 2023-07-20T11:22:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6def688640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de815bad0 con 0x7f6de815ec90 2023-07-20T11:22:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6def688640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de815b230 con 0x7f6de80ca5a0 2023-07-20T11:22:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6de815ec90 0x7f6de815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6de815ec90 0x7f6de815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37472/0 (socket says 172.21.15.82:37472) 2023-07-20T11:22:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 -- 172.21.15.82:0/788165142 learned_addr learned my addr 172.21.15.82:0/788165142 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6decc23640 1 --2- 172.21.15.82:0/788165142 >> v2:172.21.15.183:3300/0 conn(0x7f6de80ca5a0 0x7f6de815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 -- 172.21.15.82:0/788165142 >> v2:172.21.15.183:3300/0 conn(0x7f6de80ca5a0 msgr2=0x7f6de815e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 --2- 172.21.15.82:0/788165142 >> v2:172.21.15.183:3300/0 conn(0x7f6de80ca5a0 0x7f6de815e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 -- 172.21.15.82:0/788165142 >> v1:172.21.15.183:6789/0 conn(0x7f6de806f710 legacy=0x7f6de806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 -- 172.21.15.82:0/788165142 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de815b510 con 0x7f6de815ec90 2023-07-20T11:22:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6dedc25640 1 --2- 172.21.15.82:0/788165142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de815ec90 0x7f6de815a6f0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ece750aedd21e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6ddffff640 1 -- 172.21.15.82:0/788165142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00a5770 con 0x7f6de815ec90 2023-07-20T11:22:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6ddffff640 1 -- 172.21.15.82:0/788165142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de00a58d0 con 0x7f6de815ec90 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.479+0000 7f6ddffff640 1 -- 172.21.15.82:0/788165142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00a5c60 con 0x7f6de815ec90 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- 172.21.15.82:0/788165142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de815ec90 msgr2=0x7f6de815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- 172.21.15.82:0/788165142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de815ec90 0x7f6de815a6f0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de001c9a0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- 172.21.15.82:0/788165142 shutdown_connections 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- 172.21.15.82:0/788165142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de815ec90 0x7f6de815a6f0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- 172.21.15.82:0/788165142 >> v2:172.21.15.183:3300/0 conn(0x7f6de80ca5a0 0x7f6de815e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- 172.21.15.82:0/788165142 >> 172.21.15.82:0/788165142 conn(0x7f6de80cad50 msgr2=0x7f6de80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- 172.21.15.82:0/788165142 shutdown_connections 2023-07-20T11:22:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- 172.21.15.82:0/788165142 wait complete. 2023-07-20T11:22:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 Processor -- start 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- start start 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 0x7f6de81495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6de815ec90 0x7f6de815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81f93b0 con 0x7f6de80ca5a0 2023-07-20T11:22:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81f8830 con 0x7f6de815ec90 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6def688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de81f8b10 con 0x7f6de806f710 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6decc23640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6decc23640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37486/0 (socket says 172.21.15.82:37486) 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6decc23640 1 -- 172.21.15.82:0/2429462519 learned_addr learned my addr 172.21.15.82:0/2429462519 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6ded424640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 0x7f6de81495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.483+0000 7f6dedc25640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6de815ec90 0x7f6de815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 -- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 msgr2=0x7f6de81495e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 0x7f6de81495e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 -- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6de815ec90 msgr2=0x7f6de815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6de815ec90 0x7f6de815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 -- 172.21.15.82:0/2429462519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de0009b30 con 0x7f6de80ca5a0 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6ded424640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 0x7f6de81495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6decc23640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800e980 tx=0x7f6dd800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8009670 con 0x7f6de80ca5a0 2023-07-20T11:22:27.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd800ca00 con 0x7f6de80ca5a0 2023-07-20T11:22:27.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd800cd90 con 0x7f6de80ca5a0 2023-07-20T11:22:27.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de81f8df0 con 0x7f6de80ca5a0 2023-07-20T11:22:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de81f84e0 con 0x7f6de80ca5a0 2023-07-20T11:22:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de80cbea0 con 0x7f6de80ca5a0 2023-07-20T11:22:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.487+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 110) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f6dd8013470 con 0x7f6de80ca5a0 2023-07-20T11:22:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.491+0000 7f6dddffb640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 0x7f6dcc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.491+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7338+0+0 (secure 0 0 0) 0x7f6dd8083e30 con 0x7f6de80ca5a0 2023-07-20T11:22:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.491+0000 7f6ded424640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 0x7f6dcc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.491+0000 7f6ded424640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 0x7f6dcc0687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000f70 tx=0x7f6de4009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:27.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.495+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6de80cbea0 con 0x7f6de80ca5a0 2023-07-20T11:22:27.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:27.671+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6de80cbea0 con 0x7f6de80ca5a0 2023-07-20T11:22:28.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.307+0000 7f6dddffb640 1 -- 172.21.15.82:0/2429462519 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6de80cbea0 con 0x7f6de80ca5a0 2023-07-20T11:22:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 msgr2=0x7f6dcc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 0x7f6dcc0687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000f70 tx=0x7f6de4009040 comp rx=0 tx=0).stop 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 msgr2=0x7f6de815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f6dd800e980 tx=0x7f6dd800ee40 comp rx=0 tx=0).stop 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 shutdown_connections 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6de815ec90 0x7f6de815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f6dcc066310 0x7f6dcc0687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6de80ca5a0 0x7f6de815c900 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 --2- 172.21.15.82:0/2429462519 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6de806f710 0x7f6de81495e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 >> 172.21.15.82:0/2429462519 conn(0x7f6de80cad50 msgr2=0x7f6de80c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 shutdown_connections 2023-07-20T11:22:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.311+0000 7f6def688640 1 -- 172.21.15.82:0/2429462519 wait complete. 2023-07-20T11:22:28.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T11:22:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 Processor -- start 2023-07-20T11:22:28.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 -- start start 2023-07-20T11:22:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fbeec159450 0x7fbeec15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0cc8d0 con 0x7fbeec159830 2023-07-20T11:22:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0ccbb0 con 0x7fbeec0afd50 2023-07-20T11:22:28.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbef2234640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0cce90 con 0x7fbeec159450 2023-07-20T11:22:28.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeeaffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fbeec159830 0x7fbeec0cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41132/0 (socket says 172.21.15.82:41132) 2023-07-20T11:22:28.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeeaffd640 1 -- 172.21.15.82:0/3577915944 learned_addr learned my addr 172.21.15.82:0/3577915944 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:28.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeeb7fe640 1 --2- 172.21.15.82:0/3577915944 >> v2:172.21.15.183:3300/0 conn(0x7fbeec159450 0x7fbeec15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737963300 0 0) 0x7fbeec0cc8d0 con 0x7fbeec159830 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed4003530 con 0x7fbeec159830 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3808997340 0 0) 0x7fbed4003530 con 0x7fbeec159830 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 >> v2:172.21.15.183:3300/0 conn(0x7fbeec159450 msgr2=0x7fbeec15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 --2- 172.21.15.82:0/3577915944 >> v2:172.21.15.183:3300/0 conn(0x7fbeec159450 0x7fbeec15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 >> v1:172.21.15.183:6789/0 conn(0x7fbeec0afd50 legacy=0x7fbeec0b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec159cc0 con 0x7fbeec159830 2023-07-20T11:22:28.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fbee0001680 con 0x7fbeec159830 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 >> v1:172.21.15.82:6789/0 conn(0x7fbeec159830 legacy=0x7fbeec0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed40039f0 0x7fbed4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40047d0 0x7fbed4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 0x7fbed400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0cce90 con 0x7fbed4005190 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed400e2d0 con 0x7fbed40047d0 2023-07-20T11:22:28.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed400e490 con 0x7fbed40039f0 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeebfff640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 0x7fbed400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeeb7fe640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed40039f0 0x7fbed4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.523+0000 7fbeeaffd640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40047d0 0x7fbed4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 -- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed40039f0 msgr2=0x7fbed4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed40039f0 0x7fbed4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 -- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40047d0 msgr2=0x7fbed4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbed40047d0 0x7fbed4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 -- 172.21.15.82:0/3577915944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4003530 con 0x7fbed4005190 2023-07-20T11:22:28.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 -- 172.21.15.82:0/3577915944 reap_dead start 2023-07-20T11:22:28.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeebfff640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 0x7fbed400dba0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fbee4001e70 tx=0x7fbee401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0a3f730f6f9439 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:28.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4003b80 con 0x7fbed4005190 2023-07-20T11:22:28.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4003d20 con 0x7fbed4005190 2023-07-20T11:22:28.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbeea7fc640 1 -- 172.21.15.82:0/3577915944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4005260 con 0x7fbed4005190 2023-07-20T11:22:28.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 -- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 msgr2=0x7fbed400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 0x7fbed400dba0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fbee4001e70 tx=0x7fbee401c760 comp rx=0 tx=0).stop 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 -- 172.21.15.82:0/3577915944 shutdown_connections 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 --2- 172.21.15.82:0/3577915944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbed4005190 0x7fbed400dba0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 -- 172.21.15.82:0/3577915944 >> 172.21.15.82:0/3577915944 conn(0x7fbeec0cad50 msgr2=0x7fbeec0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 -- 172.21.15.82:0/3577915944 shutdown_connections 2023-07-20T11:22:28.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.527+0000 7fbef2234640 1 -- 172.21.15.82:0/3577915944 wait complete. 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 Processor -- start 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- start start 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed4005190 0x7fbeec0c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 0x7fbeec0ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c80b0 con 0x7fbeec156620 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c3cb0 con 0x7fbeec0c3680 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0c1dd0 con 0x7fbed4005190 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37514/0 (socket says 172.21.15.82:37514) 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 -- 172.21.15.82:0/2928371423 learned_addr learned my addr 172.21.15.82:0/2928371423 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeebfff640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 0x7fbeec0ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeb7fe640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed4005190 0x7fbeec0c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 -- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed4005190 msgr2=0x7fbeec0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed4005190 0x7fbeec0c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 -- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 msgr2=0x7fbeec0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 0x7fbeec0ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 -- 172.21.15.82:0/2928371423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0c20b0 con 0x7fbeec156620 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeebfff640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 0x7fbeec0ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:28.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbeeaffd640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fbee00072c0 tx=0x7fbee00076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000f940 con 0x7fbeec156620 2023-07-20T11:22:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000fae0 con 0x7fbeec156620 2023-07-20T11:22:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec0c2390 con 0x7fbeec156620 2023-07-20T11:22:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000fe90 con 0x7fbeec156620 2023-07-20T11:22:28.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.531+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec156a80 con 0x7fbeec156620 2023-07-20T11:22:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec156ca0 con 0x7fbeec156620 2023-07-20T11:22:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 110) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fbee001d460 con 0x7fbeec156620 2023-07-20T11:22:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbed3fff640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 0x7fbed80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7338+0+0 (secure 0 0 0) 0x7fbee00845c0 con 0x7fbeec156620 2023-07-20T11:22:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbeeb7fe640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 0x7fbed80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.535+0000 7fbeeb7fe640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 0x7fbed80687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009aa0 tx=0x7fbedc008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.539+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbeec156ca0 con 0x7fbeec156620 2023-07-20T11:22:28.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:28.687+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbeec156ca0 con 0x7fbeec156620 2023-07-20T11:22:29.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.319+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbee0051820 con 0x7fbeec156620 2023-07-20T11:22:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.459+0000 7fbed3fff640 1 -- 172.21.15.82:0/2928371423 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbee006d870 con 0x7fbeec156620 2023-07-20T11:22:29.449 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 msgr2=0x7fbed80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 0x7fbed80687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbedc009aa0 tx=0x7fbedc008040 comp rx=0 tx=0).stop 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 msgr2=0x7fbeec0c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fbee00072c0 tx=0x7fbee00076c0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 shutdown_connections 2023-07-20T11:22:29.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbeec0c3680 0x7fbeec0ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fbed8066310 0x7fbed80687d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbeec156620 0x7fbeec0c3140 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 --2- 172.21.15.82:0/2928371423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fbed4005190 0x7fbeec0c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 >> 172.21.15.82:0/2928371423 conn(0x7fbeec0cad50 msgr2=0x7fbeec0cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 shutdown_connections 2023-07-20T11:22:29.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.463+0000 7fbef2234640 1 -- 172.21.15.82:0/2928371423 wait complete. 2023-07-20T11:22:29.476 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T11:22:29.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 Processor -- start 2023-07-20T11:22:29.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 -- start start 2023-07-20T11:22:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd48070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdd4806b620 0x7fdd4806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480c95d0 con 0x7fdd48158ce0 2023-07-20T11:22:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48071310 con 0x7fdd4806b620 2023-07-20T11:22:29.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd4d6cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4806bff0 con 0x7fdd48070970 2023-07-20T11:22:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd46ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdd48158ce0 0x7fdd480c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41146/0 (socket says 172.21.15.82:41146) 2023-07-20T11:22:29.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd46ffd640 1 -- 172.21.15.82:0/864727314 learned_addr learned my addr 172.21.15.82:0/864727314 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:29.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd48070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd477fe640 1 --2- 172.21.15.82:0/864727314 >> v2:172.21.15.183:3300/0 conn(0x7fdd4806b620 0x7fdd4806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008017552 0 0) 0x7fdd480c95d0 con 0x7fdd48158ce0 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd30003530 con 0x7fdd48158ce0 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720414378 0 0) 0x7fdd30003530 con 0x7fdd48158ce0 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 msgr2=0x7fdd48070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd48070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 >> v2:172.21.15.183:3300/0 conn(0x7fdd4806b620 msgr2=0x7fdd4806bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:29.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 --2- 172.21.15.82:0/864727314 >> v2:172.21.15.183:3300/0 conn(0x7fdd4806b620 0x7fdd4806bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd481590c0 con 0x7fdd48158ce0 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fdd38001680 con 0x7fdd48158ce0 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 >> v1:172.21.15.82:6789/0 conn(0x7fdd48158ce0 legacy=0x7fdd480c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd300039f0 0x7fdd30003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd300047d0 0x7fdd30004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd30005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd48071310 con 0x7fdd300047d0 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4806bff0 con 0x7fdd300039f0 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3000b990 con 0x7fdd48070970 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd300047d0 0x7fdd30004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd46ffd640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd300039f0 0x7fdd30003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd477fe640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd30005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 -- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 msgr2=0x7fdd30005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd48070970 0x7fdd30005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 -- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd300039f0 msgr2=0x7fdd30003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:29.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd300039f0 0x7fdd30003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.635+0000 7fdd467fc640 1 -- 172.21.15.82:0/864727314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30003530 con 0x7fdd300047d0 2023-07-20T11:22:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd467fc640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd300047d0 0x7fdd30004c50 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009b10 tx=0x7fdd3c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fe6f40e67abfe6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a6460 con 0x7fdd300047d0 2023-07-20T11:22:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0a65c0 con 0x7fdd300047d0 2023-07-20T11:22:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd45ffb640 1 -- 172.21.15.82:0/864727314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a6970 con 0x7fdd300047d0 2023-07-20T11:22:29.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/864727314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd300047d0 msgr2=0x7fdd30004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/864727314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd300047d0 0x7fdd30004c50 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009b10 tx=0x7fdd3c01ca50 comp rx=0 tx=0).stop 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd477fe640 1 -- 172.21.15.82:0/864727314 reap_dead start 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/864727314 shutdown_connections 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/864727314 >> 172.21.15.82:0/864727314 conn(0x7fdd480cad50 msgr2=0x7fdd480cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/864727314 shutdown_connections 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.639+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/864727314 wait complete. 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 Processor -- start 2023-07-20T11:22:29.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- start start 2023-07-20T11:22:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd300047d0 0x7fdd481f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 0x7fdd480b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480b1710 con 0x7fdd481f6150 2023-07-20T11:22:29.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480b3ed0 con 0x7fdd480b0d20 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480b2b90 con 0x7fdd300047d0 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37530/0 (socket says 172.21.15.82:37530) 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 -- 172.21.15.82:0/369761765 learned_addr learned my addr 172.21.15.82:0/369761765 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd46ffd640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd300047d0 0x7fdd481f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd477fe640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 0x7fdd480b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 -- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd300047d0 msgr2=0x7fdd481f4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd300047d0 0x7fdd481f4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 -- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 msgr2=0x7fdd480b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 0x7fdd480b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 -- 172.21.15.82:0/369761765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd480b2e30 con 0x7fdd481f6150 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd477fe640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 0x7fdd480b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd467fc640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c880 tx=0x7fdd30005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a7440 con 0x7fdd481f6150 2023-07-20T11:22:29.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0a75a0 con 0x7fdd481f6150 2023-07-20T11:22:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0a7950 con 0x7fdd481f6150 2023-07-20T11:22:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd480b3110 con 0x7fdd481f6150 2023-07-20T11:22:29.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.643+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd480b36d0 con 0x7fdd481f6150 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4804da30 con 0x7fdd481f6150 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd3c0a7ab0 con 0x7fdd481f6150 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd2f7fe640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 0x7fdd34068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6872+0+0 (secure 0 0 0) 0x7fdd3c11dfa0 con 0x7fdd481f6150 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd46ffd640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 0x7fdd34068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:29.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.647+0000 7fdd46ffd640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 0x7fdd34068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd380018f0 tx=0x7fdd38001440 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:29.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.651+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd3c0eaf70 con 0x7fdd481f6150 2023-07-20T11:22:29.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:29.803+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd480b4250 con 0x7fdd481f6150 2023-07-20T11:22:30.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.479+0000 7fdd2f7fe640 1 -- 172.21.15.82:0/369761765 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdd3c0be020 con 0x7fdd481f6150 2023-07-20T11:22:30.468 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T11:22:30.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 msgr2=0x7fdd34068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 0x7fdd34068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdd380018f0 tx=0x7fdd38001440 comp rx=0 tx=0).stop 2023-07-20T11:22:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 msgr2=0x7fdd48153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c880 tx=0x7fdd30005800 comp rx=0 tx=0).stop 2023-07-20T11:22:30.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 shutdown_connections 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdd480b0d20 0x7fdd480b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdd340663d0 0x7fdd34068890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd481f6150 0x7fdd48153010 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 --2- 172.21.15.82:0/369761765 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdd300047d0 0x7fdd481f4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 >> 172.21.15.82:0/369761765 conn(0x7fdd480cad50 msgr2=0x7fdd4806fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:30.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 shutdown_connections 2023-07-20T11:22:30.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.483+0000 7fdd4d6cb640 1 -- 172.21.15.82:0/369761765 wait complete. 2023-07-20T11:22:30.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T11:22:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 Processor -- start 2023-07-20T11:22:30.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 -- start start 2023-07-20T11:22:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feb14159450 0x7feb1415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb14159830 0x7feb140cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb140afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140cce90 con 0x7feb14159830 2023-07-20T11:22:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb140cc8d0 con 0x7feb14159450 2023-07-20T11:22:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb19696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140ccbb0 con 0x7feb140cc3e0 2023-07-20T11:22:30.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb14159830 0x7feb140cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feb14159830 0x7feb140cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37546/0 (socket says 172.21.15.82:37546) 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 -- 172.21.15.82:0/2688757605 learned_addr learned my addr 172.21.15.82:0/2688757605 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb137fe640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb140afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb12ffd640 1 --2- 172.21.15.82:0/2688757605 >> v2:172.21.15.183:3300/0 conn(0x7feb14159450 0x7feb1415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 -- 172.21.15.82:0/2688757605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 msgr2=0x7feb140afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb140afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 -- 172.21.15.82:0/2688757605 >> v2:172.21.15.183:3300/0 conn(0x7feb14159450 msgr2=0x7feb1415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 --2- 172.21.15.82:0/2688757605 >> v2:172.21.15.183:3300/0 conn(0x7feb14159450 0x7feb1415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.651+0000 7feb0a7fc640 1 -- 172.21.15.82:0/2688757605 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14159cc0 con 0x7feb14159830 2023-07-20T11:22:30.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb0a7fc640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb14159830 0x7feb140cbea0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7feb1406a6c0 tx=0x7feafc01e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2f145c730aa98e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb127fc640 1 -- 172.21.15.82:0/2688757605 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0ab680 con 0x7feb14159830 2023-07-20T11:22:30.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb127fc640 1 -- 172.21.15.82:0/2688757605 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc0ab7e0 con 0x7feb14159830 2023-07-20T11:22:30.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb127fc640 1 -- 172.21.15.82:0/2688757605 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc0abb70 con 0x7feb14159830 2023-07-20T11:22:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 -- 172.21.15.82:0/2688757605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb14159830 msgr2=0x7feb140cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb14159830 0x7feb140cbea0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7feb1406a6c0 tx=0x7feafc01e6e0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 -- 172.21.15.82:0/2688757605 shutdown_connections 2023-07-20T11:22:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb140afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 --2- 172.21.15.82:0/2688757605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb14159830 0x7feb140cbea0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 --2- 172.21.15.82:0/2688757605 >> v2:172.21.15.183:3300/0 conn(0x7feb14159450 0x7feb1415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 -- 172.21.15.82:0/2688757605 >> 172.21.15.82:0/2688757605 conn(0x7feb140cad50 msgr2=0x7feb140cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 -- 172.21.15.82:0/2688757605 shutdown_connections 2023-07-20T11:22:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.655+0000 7feb19696640 1 -- 172.21.15.82:0/2688757605 wait complete. 2023-07-20T11:22:30.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 Processor -- start 2023-07-20T11:22:30.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- start start 2023-07-20T11:22:30.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb1415b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb14159450 0x7feb1415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c7d50 con 0x7feb141f4a90 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c73b0 con 0x7feb14159450 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140c7690 con 0x7feb140cc3e0 2023-07-20T11:22:30.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37548/0 (socket says 172.21.15.82:37548) 2023-07-20T11:22:30.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 -- 172.21.15.82:0/1877582882 learned_addr learned my addr 172.21.15.82:0/1877582882 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb12ffd640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb1415b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb0a7fc640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb14159450 0x7feb1415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 -- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 msgr2=0x7feb1415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb1415b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 -- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb14159450 msgr2=0x7feb1415b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb14159450 0x7feb1415b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 -- 172.21.15.82:0/1877582882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0094d0 con 0x7feb141f4a90 2023-07-20T11:22:30.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb137fe640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7feb0c007e30 tx=0x7feb0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c014420 con 0x7feb141f4a90 2023-07-20T11:22:30.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c014580 con 0x7feb141f4a90 2023-07-20T11:22:30.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140c7970 con 0x7feb141f4a90 2023-07-20T11:22:30.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c014930 con 0x7feb141f4a90 2023-07-20T11:22:30.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140c8170 con 0x7feb141f4a90 2023-07-20T11:22:30.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.659+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb140c7e90 con 0x7feb141f4a90 2023-07-20T11:22:30.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.663+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb0c014a90 con 0x7feb141f4a90 2023-07-20T11:22:30.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.663+0000 7feb0bfff640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 0x7feaf4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.663+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7feb0c084830 con 0x7feb141f4a90 2023-07-20T11:22:30.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.663+0000 7feb12ffd640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 0x7feaf4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.663+0000 7feb12ffd640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 0x7feaf4068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb140c1720 tx=0x7feb04008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.667+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb140c7e90 con 0x7feb141f4a90 2023-07-20T11:22:30.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.815+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7feb140c7e90 con 0x7feb141f4a90 2023-07-20T11:22:30.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.819+0000 7feb0bfff640 1 -- 172.21.15.82:0/1877582882 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v61) v1 ==== 115+0+0 (secure 0 0 0) 0x7feb140c7e90 con 0x7feb141f4a90 2023-07-20T11:22:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 msgr2=0x7feaf4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 0x7feaf4068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feb140c1720 tx=0x7feb04008040 comp rx=0 tx=0).stop 2023-07-20T11:22:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 msgr2=0x7feb141f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7feb0c007e30 tx=0x7feb0c00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 shutdown_connections 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7feaf40663a0 0x7feaf4068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb141f4a90 0x7feb141f5000 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feb14159450 0x7feb1415b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 --2- 172.21.15.82:0/1877582882 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feb140cc3e0 0x7feb1415b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 >> 172.21.15.82:0/1877582882 conn(0x7feb140cad50 msgr2=0x7feb14071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 shutdown_connections 2023-07-20T11:22:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.823+0000 7feb19696640 1 -- 172.21.15.82:0/1877582882 wait complete. 2023-07-20T11:22:30.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T11:22:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 Processor -- start 2023-07-20T11:22:30.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 -- start start 2023-07-20T11:22:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf3015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf30071950 con 0x7fcf3006f710 2023-07-20T11:22:30.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3015b230 con 0x7fcf300ca5a0 2023-07-20T11:22:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf36ef9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3015bad0 con 0x7fcf3015a6f0 2023-07-20T11:22:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf34c95640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcf3006f710 0x7fcf3006faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41158/0 (socket says 172.21.15.82:41158) 2023-07-20T11:22:30.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf34c95640 1 -- 172.21.15.82:0/3009868378 learned_addr learned my addr 172.21.15.82:0/3009868378 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf3015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652865762 0 0) 0x7fcf30071950 con 0x7fcf3006f710 2023-07-20T11:22:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf18003530 con 0x7fcf3006f710 2023-07-20T11:22:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814179835 0 0) 0x7fcf3015b230 con 0x7fcf300ca5a0 2023-07-20T11:22:30.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30071950 con 0x7fcf300ca5a0 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1888335803 0 0) 0x7fcf18003530 con 0x7fcf3006f710 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 msgr2=0x7fcf3015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf3015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 >> v1:172.21.15.183:6789/0 conn(0x7fcf300ca5a0 legacy=0x7fcf3015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3015b510 con 0x7fcf3006f710 2023-07-20T11:22:30.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fcf2c001a00 con 0x7fcf3006f710 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 >> v1:172.21.15.82:6789/0 conn(0x7fcf3006f710 legacy=0x7fcf3006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18003bb0 0x7fcf18003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf18004d10 0x7fcf18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3015bad0 con 0x7fcf18004d10 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1800ba70 con 0x7fcf18003bb0 2023-07-20T11:22:30.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1800bc30 con 0x7fcf3015a6f0 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf18004d10 0x7fcf18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf27fff640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf34c95640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18003bb0 0x7fcf18003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 -- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 msgr2=0x7fcf180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 -- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18003bb0 msgr2=0x7fcf18003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:30.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18003bb0 0x7fcf18003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf35496640 1 -- 172.21.15.82:0/3009868378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18003530 con 0x7fcf18004d10 2023-07-20T11:22:30.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf27fff640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf3015a6f0 0x7fcf180047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:30.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.983+0000 7fcf34c95640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf18003bb0 0x7fcf18003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:30.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf35496640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf18004d10 0x7fcf18005190 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009ab0 tx=0x7fcf2801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0b33826a9c1f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280a5510 con 0x7fcf18004d10 2023-07-20T11:22:30.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf280a5670 con 0x7fcf18004d10 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf277fe640 1 -- 172.21.15.82:0/3009868378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280a5a20 con 0x7fcf18004d10 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 -- 172.21.15.82:0/3009868378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf18004d10 msgr2=0x7fcf18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/3009868378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf18004d10 0x7fcf18005190 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009ab0 tx=0x7fcf2801ca30 comp rx=0 tx=0).stop 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf35496640 1 -- 172.21.15.82:0/3009868378 reap_dead start 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 -- 172.21.15.82:0/3009868378 shutdown_connections 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 -- 172.21.15.82:0/3009868378 >> 172.21.15.82:0/3009868378 conn(0x7fcf300cad50 msgr2=0x7fcf300cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 -- 172.21.15.82:0/3009868378 shutdown_connections 2023-07-20T11:22:30.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.987+0000 7fcf36ef9640 1 -- 172.21.15.82:0/3009868378 wait complete. 2023-07-20T11:22:30.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 Processor -- start 2023-07-20T11:22:30.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- start start 2023-07-20T11:22:30.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf18004d10 0x7fcf301f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 0x7fcf300cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b3960 con 0x7fcf300b16d0 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf301f1d30 con 0x7fcf300b1b50 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b2d50 con 0x7fcf18004d10 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37568/0 (socket says 172.21.15.82:37568) 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 -- 172.21.15.82:0/1075697690 learned_addr learned my addr 172.21.15.82:0/1075697690 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf35496640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 0x7fcf300cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf34c95640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf18004d10 0x7fcf301f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 -- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf18004d10 msgr2=0x7fcf301f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf18004d10 0x7fcf301f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 -- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 msgr2=0x7fcf300cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 0x7fcf300cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:30.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 -- 172.21.15.82:0/1075697690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300b3030 con 0x7fcf300b16d0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf35496640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 0x7fcf300cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf27fff640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e780 tx=0x7fcf2000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20017070 con 0x7fcf300b16d0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200050d0 con 0x7fcf300b16d0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf300b3310 con 0x7fcf300b16d0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20005240 con 0x7fcf300b16d0 2023-07-20T11:22:30.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.991+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf300b29e0 con 0x7fcf300b16d0 2023-07-20T11:22:30.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3004da30 con 0x7fcf300b16d0 2023-07-20T11:22:30.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcf20007020 con 0x7fcf300b16d0 2023-07-20T11:22:30.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf257fa640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 0x7fcf1c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:30.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fcf20083960 con 0x7fcf300b16d0 2023-07-20T11:22:30.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf34c95640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 0x7fcf1c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:30.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.995+0000 7fcf34c95640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 0x7fcf1c068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f90 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:30.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:30.999+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf20050b00 con 0x7fcf300b16d0 2023-07-20T11:22:31.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.147+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fcf300cb940 con 0x7fcf300b16d0 2023-07-20T11:22:31.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.151+0000 7fcf257fa640 1 -- 172.21.15.82:0/1075697690 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7fcf20054120 con 0x7fcf300b16d0 2023-07-20T11:22:31.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 msgr2=0x7fcf1c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 0x7fcf1c068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f90 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 msgr2=0x7fcf300ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000e780 tx=0x7fcf2000ec40 comp rx=0 tx=0).stop 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 shutdown_connections 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf300b1b50 0x7fcf300cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcf1c0663a0 0x7fcf1c068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf300b16d0 0x7fcf300ccef0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 --2- 172.21.15.82:0/1075697690 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcf18004d10 0x7fcf301f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 >> 172.21.15.82:0/1075697690 conn(0x7fcf300cad50 msgr2=0x7fcf300c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:31.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 shutdown_connections 2023-07-20T11:22:31.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.155+0000 7fcf36ef9640 1 -- 172.21.15.82:0/1075697690 wait complete. 2023-07-20T11:22:31.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T11:22:31.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.323+0000 7f0426434640 1 Processor -- start 2023-07-20T11:22:31.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.323+0000 7f0426434640 1 -- start start 2023-07-20T11:22:31.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f0426434640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f04200ca5a0 0x7f042015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f0426434640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f042015ec90 0x7f042015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f0426434640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420071950 con 0x7f042006f710 2023-07-20T11:22:31.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f0426434640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042015bad0 con 0x7f042015ec90 2023-07-20T11:22:31.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f0426434640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042015b230 con 0x7f04200ca5a0 2023-07-20T11:22:31.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f042015ec90 0x7f042015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f042015ec90 0x7f042015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37576/0 (socket says 172.21.15.82:37576) 2023-07-20T11:22:31.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 -- 172.21.15.82:0/3844972989 learned_addr learned my addr 172.21.15.82:0/3844972989 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f041f7fe640 1 --2- 172.21.15.82:0/3844972989 >> v2:172.21.15.183:3300/0 conn(0x7f04200ca5a0 0x7f042015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 -- 172.21.15.82:0/3844972989 >> v2:172.21.15.183:3300/0 conn(0x7f04200ca5a0 msgr2=0x7f042015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 --2- 172.21.15.82:0/3844972989 >> v2:172.21.15.183:3300/0 conn(0x7f04200ca5a0 0x7f042015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 -- 172.21.15.82:0/3844972989 >> v1:172.21.15.82:6789/0 conn(0x7f042006f710 legacy=0x7f042006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f04249d1640 1 -- 172.21.15.82:0/3844972989 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042015b510 con 0x7f042015ec90 2023-07-20T11:22:31.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.327+0000 7f041effd640 1 -- 172.21.15.82:0/3844972989 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046407360 0 0) 0x7f0420071950 con 0x7f042006f710 2023-07-20T11:22:31.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f04249d1640 1 --2- 172.21.15.82:0/3844972989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f042015a6f0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e50 tx=0x7f041801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee173acab5d06464 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f041effd640 1 -- 172.21.15.82:0/3844972989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180a5770 con 0x7f042015ec90 2023-07-20T11:22:31.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f041effd640 1 -- 172.21.15.82:0/3844972989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180a58d0 con 0x7f042015ec90 2023-07-20T11:22:31.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f041effd640 1 -- 172.21.15.82:0/3844972989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180a5c60 con 0x7f042015ec90 2023-07-20T11:22:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- 172.21.15.82:0/3844972989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 msgr2=0x7f042015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 --2- 172.21.15.82:0/3844972989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f042015a6f0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e50 tx=0x7f041801c9a0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- 172.21.15.82:0/3844972989 shutdown_connections 2023-07-20T11:22:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 --2- 172.21.15.82:0/3844972989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f042015a6f0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 --2- 172.21.15.82:0/3844972989 >> v2:172.21.15.183:3300/0 conn(0x7f04200ca5a0 0x7f042015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- 172.21.15.82:0/3844972989 >> 172.21.15.82:0/3844972989 conn(0x7f04200cad50 msgr2=0x7f04200cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- 172.21.15.82:0/3844972989 shutdown_connections 2023-07-20T11:22:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- 172.21.15.82:0/3844972989 wait complete. 2023-07-20T11:22:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 Processor -- start 2023-07-20T11:22:31.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.331+0000 7f0426434640 1 -- start start 2023-07-20T11:22:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f042006f710 0x7f042015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04200ca5a0 0x7f0420158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0420150c90 con 0x7f042015ec90 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201595d0 con 0x7f042006f710 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04201598b0 con 0x7f04200ca5a0 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37588/0 (socket says 172.21.15.82:37588) 2023-07-20T11:22:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 -- 172.21.15.82:0/3598407798 learned_addr learned my addr 172.21.15.82:0/3598407798 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041f7fe640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04200ca5a0 0x7f0420158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041ffff640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f042006f710 0x7f042015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 -- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04200ca5a0 msgr2=0x7f0420158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04200ca5a0 0x7f0420158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 -- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f042006f710 msgr2=0x7f042015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f042006f710 0x7f042015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 -- 172.21.15.82:0/3598407798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009b30 con 0x7f042015ec90 2023-07-20T11:22:31.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f04249d1640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f04180af040 tx=0x7f0418019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180b8670 con 0x7f042015ec90 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180b87d0 con 0x7f042015ec90 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180b8b80 con 0x7f042015ec90 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0420159b90 con 0x7f042015ec90 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042015ca20 con 0x7f042015ec90 2023-07-20T11:22:31.327 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420150e00 con 0x7f042015ec90 2023-07-20T11:22:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.335+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04180b8ce0 con 0x7f042015ec90 2023-07-20T11:22:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.339+0000 7f041cff9640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 0x7f040c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.339+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f041811f4c0 con 0x7f042015ec90 2023-07-20T11:22:31.328 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.339+0000 7f041ffff640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 0x7f040c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.329 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.339+0000 7f041ffff640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 0x7f040c068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.343+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04180ec7a0 con 0x7f042015ec90 2023-07-20T11:22:31.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.491+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f042004da30 con 0x7f042015ec90 2023-07-20T11:22:31.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.495+0000 7f041cff9640 1 -- 172.21.15.82:0/3598407798 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04180efdc0 con 0x7f042015ec90 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 msgr2=0x7f040c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 0x7f040c068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0410007fd0 tx=0x7f0410009040 comp rx=0 tx=0).stop 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 msgr2=0x7f0420158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f04180af040 tx=0x7f0418019740 comp rx=0 tx=0).stop 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 shutdown_connections 2023-07-20T11:22:31.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f040c0663a0 0x7f040c068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f042015ec90 0x7f0420158fc0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f04200ca5a0 0x7f0420158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 --2- 172.21.15.82:0/3598407798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f042006f710 0x7f042015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 >> 172.21.15.82:0/3598407798 conn(0x7f04200cad50 msgr2=0x7f04200afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 shutdown_connections 2023-07-20T11:22:31.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.499+0000 7f0426434640 1 -- 172.21.15.82:0/3598407798 wait complete. 2023-07-20T11:22:31.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-20T11:22:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 Processor -- start 2023-07-20T11:22:31.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 -- start start 2023-07-20T11:22:31.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c0b7c20 con 0x7f2b6c0ce9a0 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c0cee50 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b7149e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c15c9d0 con 0x7f2b6c15c5f0 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37596/0 (socket says 172.21.15.82:37596) 2023-07-20T11:22:31.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 -- 172.21.15.82:0/3454982358 learned_addr learned my addr 172.21.15.82:0/3454982358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b70c9d640 1 --1- 172.21.15.82:0/3454982358 >> v1:172.21.15.82:6789/0 conn(0x7f2b6c0ce9a0 0x7f2b6c0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41176/0 (socket says 172.21.15.82:41176) 2023-07-20T11:22:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6bfff640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 -- 172.21.15.82:0/3454982358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c15c5f0 msgr2=0x7f2b6c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:31.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 -- 172.21.15.82:0/3454982358 >> v1:172.21.15.82:6789/0 conn(0x7f2b6c0ce9a0 legacy=0x7f2b6c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6b7fe640 1 -- 172.21.15.82:0/3454982358 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c0ce030 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.659+0000 7f2b6affd640 1 -- 172.21.15.82:0/3454982358 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379515685 0 0) 0x7f2b6c0b7c20 con 0x7f2b6c0ce9a0 2023-07-20T11:22:31.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009870 tx=0x7f2b6001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157dd95d9c9c0539 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b6affd640 1 -- 172.21.15.82:0/3454982358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600a8a30 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b6affd640 1 -- 172.21.15.82:0/3454982358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b600a8b90 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b6affd640 1 -- 172.21.15.82:0/3454982358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600b0440 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 -- 172.21.15.82:0/3454982358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 msgr2=0x7f2b6c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009870 tx=0x7f2b6001ed30 comp rx=0 tx=0).stop 2023-07-20T11:22:31.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 -- 172.21.15.82:0/3454982358 shutdown_connections 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ce460 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 --2- 172.21.15.82:0/3454982358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 -- 172.21.15.82:0/3454982358 >> 172.21.15.82:0/3454982358 conn(0x7f2b6c065710 msgr2=0x7f2b6c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 -- 172.21.15.82:0/3454982358 shutdown_connections 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.663+0000 7f2b7149e640 1 -- 172.21.15.82:0/3454982358 wait complete. 2023-07-20T11:22:31.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 Processor -- start 2023-07-20T11:22:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- start start 2023-07-20T11:22:31.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 0x7f2b6c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c150be0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c14e210 con 0x7f2b6c15c5f0 2023-07-20T11:22:31.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c14ffd0 con 0x7f2b6c0ce9a0 2023-07-20T11:22:31.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37598/0 (socket says 172.21.15.82:37598) 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 -- 172.21.15.82:0/1610404568 learned_addr learned my addr 172.21.15.82:0/1610404568 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b70c9d640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 0x7f2b6c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 -- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 msgr2=0x7f2b6c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 0x7f2b6c151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 -- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 msgr2=0x7f2b6c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 -- 172.21.15.82:0/1610404568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600094d0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b70c9d640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 0x7f2b6c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b6bfff640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00d5f0 tx=0x7f2b5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c0125f0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c012750 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c1502b0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c012ae0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c150870 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.667+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c04da30 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.671+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2b5c012c40 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.671+0000 7f2b68ff9640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 0x7f2b58068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:31.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.671+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f2b5c0844c0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.671+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 0x7f2b58068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:31.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.671+0000 7f2b6b7fe640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 0x7f2b58068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b600b2000 tx=0x7f2b600aa070 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:31.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.675+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b5c0516e0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:31.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:31.879+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f2b6c0cf6d0 con 0x7f2b6c0ccfb0 2023-07-20T11:22:32.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.479+0000 7f2b68ff9640 1 -- 172.21.15.82:0/1610404568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2980) v1 ==== 165+0+0 (secure 0 0 0) 0x7f2b5c007380 con 0x7f2b6c0ccfb0 2023-07-20T11:22:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 msgr2=0x7f2b58068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 0x7f2b58068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b600b2000 tx=0x7f2b600aa070 comp rx=0 tx=0).stop 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 msgr2=0x7f2b6c0ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00d5f0 tx=0x7f2b5c00dab0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 shutdown_connections 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b6c15c5f0 0x7f2b6c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b6c0ce9a0 0x7f2b6c151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2b580663a0 0x7f2b58068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 --2- 172.21.15.82:0/1610404568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6c0ccfb0 0x7f2b6c0ae9d0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 >> 172.21.15.82:0/1610404568 conn(0x7f2b6c065710 msgr2=0x7f2b6c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:32.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 shutdown_connections 2023-07-20T11:22:32.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.483+0000 7f2b7149e640 1 -- 172.21.15.82:0/1610404568 wait complete. 2023-07-20T11:22:32.493 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-07-20T11:22:32.494 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-07-20T11:22:32.495 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-20T11:22:32.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-20T11:22:32.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 Processor -- start 2023-07-20T11:22:32.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 -- start start 2023-07-20T11:22:32.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f443c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f443c0cd4b0 0x7f443c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0d16b0 con 0x7f443c15cab0 2023-07-20T11:22:32.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0d31c0 con 0x7f443c0cd4b0 2023-07-20T11:22:32.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44419ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0b3520 con 0x7f443c0d0d10 2023-07-20T11:22:32.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f443c15cab0 0x7f443c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:41184/0 (socket says 172.21.15.82:41184) 2023-07-20T11:22:32.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443affd640 1 -- 172.21.15.82:0/3938849246 learned_addr learned my addr 172.21.15.82:0/3938849246 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f44327fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f443c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474805739 0 0) 0x7f443c0d16b0 con 0x7f443c15cab0 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443b7fe640 1 --2- 172.21.15.82:0/3938849246 >> v2:172.21.15.183:3300/0 conn(0x7f443c0cd4b0 0x7f443c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4428003530 con 0x7f443c15cab0 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445505548 0 0) 0x7f4428003530 con 0x7f443c15cab0 2023-07-20T11:22:32.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 msgr2=0x7f443c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f443c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 >> v2:172.21.15.183:3300/0 conn(0x7f443c0cd4b0 msgr2=0x7f443c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 --2- 172.21.15.82:0/3938849246 >> v2:172.21.15.183:3300/0 conn(0x7f443c0cd4b0 0x7f443c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0d0a10 con 0x7f443c15cab0 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f442c001680 con 0x7f443c15cab0 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 >> v1:172.21.15.82:6789/0 conn(0x7f443c15cab0 legacy=0x7f443c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f4428003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428003f50 0x7f44280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428004d10 0x7f4428005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0b3520 con 0x7f4428003f50 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442800b990 con 0x7f4428004d10 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.647+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442800bad0 con 0x7f443c0d0d10 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428003f50 0x7f44280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443b7fe640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428004d10 0x7f4428005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443affd640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f4428003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 -- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 msgr2=0x7f4428003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c0d0d10 0x7f4428003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 -- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428004d10 msgr2=0x7f4428005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428004d10 0x7f4428005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 -- 172.21.15.82:0/3938849246 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428003530 con 0x7f4428003f50 2023-07-20T11:22:32.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443b7fe640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428004d10 0x7f4428005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:32.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f44327fc640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428003f50 0x7f44280047d0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f442400e170 tx=0x7f442401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788c69df32c5bd01 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240a5c50 con 0x7f4428003f50 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442400f040 con 0x7f4428003f50 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.651+0000 7f443a7fc640 1 -- 172.21.15.82:0/3938849246 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240ad440 con 0x7f4428003f50 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- 172.21.15.82:0/3938849246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428003f50 msgr2=0x7f44280047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 --2- 172.21.15.82:0/3938849246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4428003f50 0x7f44280047d0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f442400e170 tx=0x7f442401cc40 comp rx=0 tx=0).stop 2023-07-20T11:22:32.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f443b7fe640 1 -- 172.21.15.82:0/3938849246 reap_dead start 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- 172.21.15.82:0/3938849246 shutdown_connections 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- 172.21.15.82:0/3938849246 >> 172.21.15.82:0/3938849246 conn(0x7f443c08c120 msgr2=0x7f443c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- 172.21.15.82:0/3938849246 shutdown_connections 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- 172.21.15.82:0/3938849246 wait complete. 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 Processor -- start 2023-07-20T11:22:32.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- start start 2023-07-20T11:22:32.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428003f50 0x7f443c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c1459d0 0x7f443c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c145e60 con 0x7f443c155570 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c7f00 con 0x7f4428003f50 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44419ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c81e0 con 0x7f443c1459d0 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37612/0 (socket says 172.21.15.82:37612) 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 -- 172.21.15.82:0/3251260425 learned_addr learned my addr 172.21.15.82:0/3251260425 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f443affd640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428003f50 0x7f443c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 -- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c1459d0 msgr2=0x7f443c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c1459d0 0x7f443c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 -- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428003f50 msgr2=0x7f443c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428003f50 0x7f443c155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:32.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.655+0000 7f44327fc640 1 -- 172.21.15.82:0/3251260425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0c84c0 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f44327fc640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f44240b0040 tx=0x7f4424009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240ad9d0 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44240adb70 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240b6410 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0c87a0 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c0c77f0 con 0x7f443c155570 2023-07-20T11:22:32.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c145e00 con 0x7f443c155570 2023-07-20T11:22:32.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44240b4040 con 0x7f443c155570 2023-07-20T11:22:32.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 0x7f441c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:32.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f442411e7e0 con 0x7f443c155570 2023-07-20T11:22:32.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.659+0000 7f443affd640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 0x7f441c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:32.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.663+0000 7f443affd640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 0x7f441c068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c10 tx=0x7f442c000f80 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:32.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.663+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44240ebbb0 con 0x7f443c155570 2023-07-20T11:22:32.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:32.859+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f443c073c70 con 0x7f443c155570 2023-07-20T11:22:33.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f4438ff9640 1 -- 172.21.15.82:0/3251260425 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2981) v1 ==== 166+0+0 (secure 0 0 0) 0x7f44240ef1d0 con 0x7f443c155570 2023-07-20T11:22:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 msgr2=0x7f441c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 0x7f441c068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f442c000c10 tx=0x7f442c000f80 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 msgr2=0x7f443c145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f44240b0040 tx=0x7f4424009750 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 shutdown_connections 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f443c1459d0 0x7f443c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f441c0663a0 0x7f441c068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f443c155570 0x7f443c145490 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 --2- 172.21.15.82:0/3251260425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4428003f50 0x7f443c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 >> 172.21.15.82:0/3251260425 conn(0x7f443c08c120 msgr2=0x7f443c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.483+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 shutdown_connections 2023-07-20T11:22:33.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.487+0000 7f44419ba640 1 -- 172.21.15.82:0/3251260425 wait complete. 2023-07-20T11:22:33.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 Processor -- start 2023-07-20T11:22:33.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 -- start start 2023-07-20T11:22:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd015dbb0 0x7f7fd00cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd00ad810 con 0x7f7fd01596b0 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd015d0d0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd8696640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd015e000 con 0x7f7fd015dbb0 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6c33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd015dbb0 0x7f7fd00cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6432640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7fd01596b0 0x7f7fd00b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53392/0 (socket says 172.21.15.82:53392) 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6c33640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f7fd015dbb0 0x7f7fd00cc900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41804/0 (socket says 172.21.15.82:41804) 2023-07-20T11:22:33.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6432640 1 -- 172.21.15.82:0/2849813812 learned_addr learned my addr 172.21.15.82:0/2849813812 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6c33640 1 -- 172.21.15.82:0/2849813812 >> v1:172.21.15.183:6789/0 conn(0x7f7fd00b2a90 legacy=0x7f7fd00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6c33640 1 -- 172.21.15.82:0/2849813812 >> v1:172.21.15.82:6789/0 conn(0x7f7fd01596b0 legacy=0x7f7fd00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd6c33640 1 -- 172.21.15.82:0/2849813812 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd015d3b0 con 0x7f7fd015dbb0 2023-07-20T11:22:33.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.651+0000 7f7fd5430640 1 -- 172.21.15.82:0/2849813812 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082409544 0 0) 0x7f7fd00ad810 con 0x7f7fd01596b0 2023-07-20T11:22:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd6c33640 1 --2- 172.21.15.82:0/2849813812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd015dbb0 0x7f7fd00cc900 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009dc0 tx=0x7f7fc801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc528369491d201 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd5430640 1 -- 172.21.15.82:0/2849813812 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80a5960 con 0x7f7fd015dbb0 2023-07-20T11:22:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd5430640 1 -- 172.21.15.82:0/2849813812 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc80a5ac0 con 0x7f7fd015dbb0 2023-07-20T11:22:33.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd5430640 1 -- 172.21.15.82:0/2849813812 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80a5e50 con 0x7f7fd015dbb0 2023-07-20T11:22:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 -- 172.21.15.82:0/2849813812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd015dbb0 msgr2=0x7f7fd00cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 --2- 172.21.15.82:0/2849813812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd015dbb0 0x7f7fd00cc900 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009dc0 tx=0x7f7fc801c900 comp rx=0 tx=0).stop 2023-07-20T11:22:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 -- 172.21.15.82:0/2849813812 shutdown_connections 2023-07-20T11:22:33.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 --2- 172.21.15.82:0/2849813812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd015dbb0 0x7f7fd00cc900 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 -- 172.21.15.82:0/2849813812 >> 172.21.15.82:0/2849813812 conn(0x7f7fd00cada0 msgr2=0x7f7fd00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 -- 172.21.15.82:0/2849813812 shutdown_connections 2023-07-20T11:22:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.655+0000 7f7fd8696640 1 -- 172.21.15.82:0/2849813812 wait complete. 2023-07-20T11:22:33.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 Processor -- start 2023-07-20T11:22:33.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- start start 2023-07-20T11:22:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 0x7f7fd00b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd015dbb0 0x7f7fd0158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00cce40 con 0x7f7fd00b2a90 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd00b03d0 con 0x7f7fd015dbb0 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0150620 con 0x7f7fd01596b0 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41812/0 (socket says 172.21.15.82:41812) 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 -- 172.21.15.82:0/597077799 learned_addr learned my addr 172.21.15.82:0/597077799 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:33.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd5c31640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 0x7f7fd00b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6c33640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd015dbb0 0x7f7fd0158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 -- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 msgr2=0x7f7fd00b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 0x7f7fd00b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 -- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd015dbb0 msgr2=0x7f7fd0158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd015dbb0 0x7f7fd0158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 -- 172.21.15.82:0/597077799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8009a70 con 0x7f7fd00b2a90 2023-07-20T11:22:33.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd5c31640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 0x7f7fd00b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd6432640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c4d0 tx=0x7f7fcc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0074e0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc007640 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd0158eb0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc004a30 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.659+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd00afd80 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd0073c70 con 0x7f7fd00b2a90 2023-07-20T11:22:33.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fcc004b90 con 0x7f7fd00b2a90 2023-07-20T11:22:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fc6ffd640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 0x7f7fb4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f7fcc0834f0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fd5c31640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 0x7f7fb4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.663+0000 7f7fd5c31640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 0x7f7fb4068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c4090 tx=0x7f7fc0009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.667+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fcc050690 con 0x7f7fd00b2a90 2023-07-20T11:22:33.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.815+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fd00cbbd0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fc6ffd640 1 -- 172.21.15.82:0/597077799 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+16368 (secure 0 0 0) 0x7f7fcc053cb0 con 0x7f7fd00b2a90 2023-07-20T11:22:33.809 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:33.809 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":183,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:30.469977+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/4046327288":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/228016562":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/3419453693":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/123409211":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6833/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1005282252":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2227667398":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/3354238649":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/2638908174":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1963263671":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1357101313":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1631845088":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/2423893973":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1623200444":"2023-07-21T11:22:24.403076+0000","172.21.15.82:0/1823256241":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/619909040":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6835/1027853129":"2023-07-21T11:22:27.302915+0000","172.21.15.82:0/1569167348":"2023-07-21T11:22:24.403076+0000","172.21.15.82:6832/957767149":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1537887134":"2023-07-21T11:06:39.872076+0000","172.21.15.82:0/1510409822":"2023-07-21T11:17:20.989166+0000","172.21.15.82:0/1993560711":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6837/1027853129":"2023-07-21T11:22:27.302915+0000","172.21.15.82:6833/919074132":"2023-07-21T11:06:39.872076+0000","172.21.15.82:6832/919074132":"2023-07-21T11:06:39.872076+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 msgr2=0x7f7fb4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 0x7f7fb4068890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00c4090 tx=0x7f7fc0009040 comp rx=0 tx=0).stop 2023-07-20T11:22:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 msgr2=0x7f7fd00aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c4d0 tx=0x7f7fcc00c990 comp rx=0 tx=0).stop 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 shutdown_connections 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fd015dbb0 0x7f7fd0158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7fd01596b0 0x7f7fd00b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7fb40663d0 0x7f7fb4068890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 --2- 172.21.15.82:0/597077799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7fd00b2a90 0x7f7fd00aded0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 >> 172.21.15.82:0/597077799 conn(0x7f7fd00cada0 msgr2=0x7f7fd00ac870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 shutdown_connections 2023-07-20T11:22:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.819+0000 7f7fd8696640 1 -- 172.21.15.82:0/597077799 wait complete. 2023-07-20T11:22:33.829 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:22:33.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:22:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 Processor -- start 2023-07-20T11:22:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 -- start start 2023-07-20T11:22:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb098159450 0x7fb09815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0980afd50 0x7fb0980b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980cc8d0 con 0x7fb098159830 2023-07-20T11:22:33.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980cce90 con 0x7fb0980afd50 2023-07-20T11:22:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09e407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980b0700 con 0x7fb098159450 2023-07-20T11:22:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0980afd50 0x7fb0980b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb0980afd50 0x7fb0980b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41818/0 (socket says 172.21.15.82:41818) 2023-07-20T11:22:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 -- 172.21.15.82:0/3172801105 learned_addr learned my addr 172.21.15.82:0/3172801105 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb097fff640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb098159450 0x7fb09815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 -- 172.21.15.82:0/3172801105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb098159450 msgr2=0x7fb09815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb098159450 0x7fb09815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 -- 172.21.15.82:0/3172801105 >> v1:172.21.15.183:6789/0 conn(0x7fb098159830 legacy=0x7fb0980cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.983+0000 7fb09c9a4640 1 -- 172.21.15.82:0/3172801105 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980ccbb0 con 0x7fb0980afd50 2023-07-20T11:22:33.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09c9a4640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb0980b01c0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb090009e80 tx=0x7fb09001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32613e02530134a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb096ffd640 1 -- 172.21.15.82:0/3172801105 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5880 con 0x7fb0980afd50 2023-07-20T11:22:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb096ffd640 1 -- 172.21.15.82:0/3172801105 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900a59e0 con 0x7fb0980afd50 2023-07-20T11:22:33.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb096ffd640 1 -- 172.21.15.82:0/3172801105 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5d70 con 0x7fb0980afd50 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 -- 172.21.15.82:0/3172801105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 msgr2=0x7fb0980b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb0980b01c0 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7fb090009e80 tx=0x7fb09001c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 -- 172.21.15.82:0/3172801105 shutdown_connections 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb0980b01c0 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 --2- 172.21.15.82:0/3172801105 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb098159450 0x7fb09815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 -- 172.21.15.82:0/3172801105 >> 172.21.15.82:0/3172801105 conn(0x7fb0980cad50 msgr2=0x7fb0980cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:33.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 -- 172.21.15.82:0/3172801105 shutdown_connections 2023-07-20T11:22:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 -- 172.21.15.82:0/3172801105 wait complete. 2023-07-20T11:22:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.987+0000 7fb09e407640 1 Processor -- start 2023-07-20T11:22:33.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- start start 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb098159450 0x7fb0980c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 0x7fb0981583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb098151620 con 0x7fb0980afd50 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c3700 con 0x7fb098159450 2023-07-20T11:22:33.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980c39e0 con 0x7fb0980c30a0 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41824/0 (socket says 172.21.15.82:41824) 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 -- 172.21.15.82:0/2105200103 learned_addr learned my addr 172.21.15.82:0/2105200103 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09c9a4640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 0x7fb0981583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb0977fe640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb098159450 0x7fb0980c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 -- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 msgr2=0x7fb0981583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 0x7fb0981583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 -- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb098159450 msgr2=0x7fb0980c2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb098159450 0x7fb0980c2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 -- 172.21.15.82:0/2105200103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090009b30 con 0x7fb0980afd50 2023-07-20T11:22:33.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09c9a4640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 0x7fb0981583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb097fff640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e930 tx=0x7fb08800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088009690 con 0x7fb0980afd50 2023-07-20T11:22:33.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08800ca00 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0980c3cc0 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08800cd70 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb098150230 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.991+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0980c34b0 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.995+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb088013470 con 0x7fb0980afd50 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.995+0000 7fb094ff9640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 0x7fb084068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:33.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.995+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fb0880841d0 con 0x7fb0980afd50 2023-07-20T11:22:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.995+0000 7fb0977fe640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 0x7fb084068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:33.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.995+0000 7fb0977fe640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 0x7fb084068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0980afc90 tx=0x7fb08c009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:33.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:33.999+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb088051540 con 0x7fb0980afd50 2023-07-20T11:22:34.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.143+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb09804da30 con 0x7fb0980afd50 2023-07-20T11:22:34.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb094ff9640 1 -- 172.21.15.82:0/2105200103 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb088054b60 con 0x7fb0980afd50 2023-07-20T11:22:34.136 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:22:34.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 msgr2=0x7fb084068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 0x7fb084068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0980afc90 tx=0x7fb08c009040 comp rx=0 tx=0).stop 2023-07-20T11:22:34.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 msgr2=0x7fb09814f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7fb08800e930 tx=0x7fb08800edf0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 shutdown_connections 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb0980c30a0 0x7fb0981583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb098159450 0x7fb0980c2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb0840663a0 0x7fb084068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 --2- 172.21.15.82:0/2105200103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0980afd50 0x7fb09814f310 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 >> 172.21.15.82:0/2105200103 conn(0x7fb0980cad50 msgr2=0x7fb0980712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:34.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 shutdown_connections 2023-07-20T11:22:34.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.147+0000 7fb09e407640 1 -- 172.21.15.82:0/2105200103 wait complete. 2023-07-20T11:22:34.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:22:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 Processor -- start 2023-07-20T11:22:34.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 -- start start 2023-07-20T11:22:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 0x7f76880c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880c95d0 con 0x7f7688070970 2023-07-20T11:22:34.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76880c9fa0 con 0x7f768806bd30 2023-07-20T11:22:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ef40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76881590c0 con 0x7f7688158ce0 2023-07-20T11:22:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f7687fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f7688070970 0x7f768806b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53394/0 (socket says 172.21.15.82:53394) 2023-07-20T11:22:34.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f7687fff640 1 -- 172.21.15.82:0/2593123368 learned_addr learned my addr 172.21.15.82:0/2593123368 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ccdc640 1 --2- 172.21.15.82:0/2593123368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 0x7f76880c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f76877fe640 1 -- 172.21.15.82:0/2593123368 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413019603 0 0) 0x7f76880c95d0 con 0x7f7688070970 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f76877fe640 1 -- 172.21.15.82:0/2593123368 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7678003530 con 0x7f7688070970 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ccdc640 1 -- 172.21.15.82:0/2593123368 >> v1:172.21.15.183:6789/0 conn(0x7f768806bd30 legacy=0x7f76880cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ccdc640 1 -- 172.21.15.82:0/2593123368 >> v1:172.21.15.82:6789/0 conn(0x7f7688070970 legacy=0x7f768806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.311+0000 7f768ccdc640 1 -- 172.21.15.82:0/2593123368 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76880c89c0 con 0x7f7688158ce0 2023-07-20T11:22:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ccdc640 1 --2- 172.21.15.82:0/2593123368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 0x7f76880c9a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097f0 tx=0x7f767c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418930b32594f690 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f76877fe640 1 -- 172.21.15.82:0/2593123368 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0aa5f0 con 0x7f7688158ce0 2023-07-20T11:22:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f76877fe640 1 -- 172.21.15.82:0/2593123368 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c0aa750 con 0x7f7688158ce0 2023-07-20T11:22:34.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f76877fe640 1 -- 172.21.15.82:0/2593123368 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0aaae0 con 0x7f7688158ce0 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 -- 172.21.15.82:0/2593123368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 msgr2=0x7f76880c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 --2- 172.21.15.82:0/2593123368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 0x7f76880c9a60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f767c0097f0 tx=0x7f767c01c490 comp rx=0 tx=0).stop 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 -- 172.21.15.82:0/2593123368 shutdown_connections 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 --2- 172.21.15.82:0/2593123368 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7688158ce0 0x7f76880c9a60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 -- 172.21.15.82:0/2593123368 >> 172.21.15.82:0/2593123368 conn(0x7f76880cad50 msgr2=0x7f76880cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 -- 172.21.15.82:0/2593123368 shutdown_connections 2023-07-20T11:22:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.315+0000 7f768ef40640 1 -- 172.21.15.82:0/2593123368 wait complete. 2023-07-20T11:22:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 Processor -- start 2023-07-20T11:22:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- start start 2023-07-20T11:22:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768806bd30 0x7f7688157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688158ce0 0x7f768814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b1f20 con 0x7f7688070970 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76880b18d0 con 0x7f7688158ce0 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76880c5df0 con 0x7f768806bd30 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41834/0 (socket says 172.21.15.82:41834) 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 -- 172.21.15.82:0/3034515722 learned_addr learned my addr 172.21.15.82:0/3034515722 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ccdc640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768806bd30 0x7f7688157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768d4dd640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688158ce0 0x7f768814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 -- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768806bd30 msgr2=0x7f7688157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768806bd30 0x7f7688157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 -- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688158ce0 msgr2=0x7f768814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688158ce0 0x7f768814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 -- 172.21.15.82:0/3034515722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c009420 con 0x7f7688070970 2023-07-20T11:22:34.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f7687fff640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f767400c500 tx=0x7f767400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674005cf0 con 0x7f7688070970 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674005e50 con 0x7f7688070970 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76880b1b40 con 0x7f7688070970 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740072f0 con 0x7f7688070970 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.319+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76880c60d0 con 0x7f7688070970 2023-07-20T11:22:34.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76880b2060 con 0x7f7688070970 2023-07-20T11:22:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7674007450 con 0x7f7688070970 2023-07-20T11:22:34.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f76857fa640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 0x7f766c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f7674083550 con 0x7f7688070970 2023-07-20T11:22:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f768ccdc640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 0x7f766c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.323+0000 7f768ccdc640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 0x7f766c068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f767c0ae000 tx=0x7f767c0b5040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.327+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76880b2060 con 0x7f7688070970 2023-07-20T11:22:34.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.475+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76880b2060 con 0x7f7688070970 2023-07-20T11:22:34.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.475+0000 7f76857fa640 1 -- 172.21.15.82:0/3034515722 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76880b2060 con 0x7f7688070970 2023-07-20T11:22:34.467 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 msgr2=0x7f766c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 0x7f766c068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f767c0ae000 tx=0x7f767c0b5040 comp rx=0 tx=0).stop 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 msgr2=0x7f76880c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f767400c500 tx=0x7f767400c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 shutdown_connections 2023-07-20T11:22:34.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7688158ce0 0x7f768814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f766c0663a0 0x7f766c068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7688070970 0x7f76880c53a0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 --2- 172.21.15.82:0/3034515722 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f768806bd30 0x7f7688157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 >> 172.21.15.82:0/3034515722 conn(0x7f76880cad50 msgr2=0x7f76880cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 shutdown_connections 2023-07-20T11:22:34.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.479+0000 7f768ef40640 1 -- 172.21.15.82:0/3034515722 wait complete. 2023-07-20T11:22:34.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T11:22:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.639+0000 7feaf7303640 1 Processor -- start 2023-07-20T11:22:34.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 -- start start 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7feaf0159450 0x7feaf015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feaf00afd50 0x7feaf00b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf00b06b0 con 0x7feaf0159830 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00cce90 con 0x7feaf00afd50 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf7303640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00cc8d0 con 0x7feaf0159450 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf58a0640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7feaf00afd50 0x7feaf00b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf489e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7feaf0159830 0x7feaf00cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53410/0 (socket says 172.21.15.82:53410) 2023-07-20T11:22:34.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf489e640 1 -- 172.21.15.82:0/708741072 learned_addr learned my addr 172.21.15.82:0/708741072 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:34.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf509f640 1 --2- 172.21.15.82:0/708741072 >> v2:172.21.15.183:3300/0 conn(0x7feaf0159450 0x7feaf015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf58a0640 1 -- 172.21.15.82:0/708741072 >> v2:172.21.15.183:3300/0 conn(0x7feaf0159450 msgr2=0x7feaf015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:34.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf58a0640 1 --2- 172.21.15.82:0/708741072 >> v2:172.21.15.183:3300/0 conn(0x7feaf0159450 0x7feaf015a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf58a0640 1 -- 172.21.15.82:0/708741072 >> v1:172.21.15.82:6789/0 conn(0x7feaf0159830 legacy=0x7feaf00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feaf58a0640 1 -- 172.21.15.82:0/708741072 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf00ccbb0 con 0x7feaf00afd50 2023-07-20T11:22:34.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.643+0000 7feae7fff640 1 -- 172.21.15.82:0/708741072 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064598395 0 0) 0x7feaf00b06b0 con 0x7feaf0159830 2023-07-20T11:22:34.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf58a0640 1 --2- 172.21.15.82:0/708741072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf00afd50 0x7feaf00b0170 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7feaf006a6c0 tx=0x7feae801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8683d120562028c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feae7fff640 1 -- 172.21.15.82:0/708741072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80a59a0 con 0x7feaf00afd50 2023-07-20T11:22:34.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feae7fff640 1 -- 172.21.15.82:0/708741072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae80a5b00 con 0x7feaf00afd50 2023-07-20T11:22:34.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feae7fff640 1 -- 172.21.15.82:0/708741072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80a5e90 con 0x7feaf00afd50 2023-07-20T11:22:34.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- 172.21.15.82:0/708741072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf00afd50 msgr2=0x7feaf00b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 --2- 172.21.15.82:0/708741072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf00afd50 0x7feaf00b0170 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7feaf006a6c0 tx=0x7feae801c8e0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- 172.21.15.82:0/708741072 shutdown_connections 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 --2- 172.21.15.82:0/708741072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf00afd50 0x7feaf00b0170 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 --2- 172.21.15.82:0/708741072 >> v2:172.21.15.183:3300/0 conn(0x7feaf0159450 0x7feaf015a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- 172.21.15.82:0/708741072 >> 172.21.15.82:0/708741072 conn(0x7feaf00cad50 msgr2=0x7feaf00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- 172.21.15.82:0/708741072 shutdown_connections 2023-07-20T11:22:34.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- 172.21.15.82:0/708741072 wait complete. 2023-07-20T11:22:34.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 Processor -- start 2023-07-20T11:22:34.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.647+0000 7feaf7303640 1 -- start start 2023-07-20T11:22:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 0x7feaf01f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 0x7feaf0151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0151880 con 0x7feaf0162f10 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0163d80 con 0x7feaf00afd50 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf0163aa0 con 0x7feaf0159450 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41856/0 (socket says 172.21.15.82:41856) 2023-07-20T11:22:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 -- 172.21.15.82:0/2804201170 learned_addr learned my addr 172.21.15.82:0/2804201170 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 -- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 msgr2=0x7feaf0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf509f640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 0x7feaf01f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf489e640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 0x7feaf0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 0x7feaf0151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 -- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 msgr2=0x7feaf01f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 0x7feaf01f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 -- 172.21.15.82:0/2804201170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8009a70 con 0x7feaf0162f10 2023-07-20T11:22:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf509f640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 0x7feaf01f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf489e640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 0x7feaf0151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf58a0640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7feae80194f0 tx=0x7feae8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80add70 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8009450 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae80b9690 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf01f80d0 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf01f8690 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf01f8880 con 0x7feaf0162f10 2023-07-20T11:22:34.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.651+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feae80b97f0 con 0x7feaf0162f10 2023-07-20T11:22:34.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.655+0000 7feae5ffb640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 0x7fead4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:34.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.655+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7feae811f860 con 0x7feaf0162f10 2023-07-20T11:22:34.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.655+0000 7feaf509f640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 0x7fead4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:34.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.655+0000 7feaf509f640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 0x7fead4068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feaf01f7f90 tx=0x7feaec008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:34.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.659+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feae80ecba0 con 0x7feaf0162f10 2023-07-20T11:22:34.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.803+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feaf004da30 con 0x7feaf0162f10 2023-07-20T11:22:34.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feae5ffb640 1 -- 172.21.15.82:0/2804201170 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7feae80f01c0 con 0x7feaf0162f10 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 msgr2=0x7fead4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 0x7fead4068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feaf01f7f90 tx=0x7feaec008040 comp rx=0 tx=0).stop 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 msgr2=0x7feaf0155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7feae80194f0 tx=0x7feae8019680 comp rx=0 tx=0).stop 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 shutdown_connections 2023-07-20T11:22:34.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fead40663d0 0x7fead4068890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feaf0162f10 0x7feaf0155a70 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7feaf0159450 0x7feaf0151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 --2- 172.21.15.82:0/2804201170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7feaf00afd50 0x7feaf01f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 >> 172.21.15.82:0/2804201170 conn(0x7feaf00cad50 msgr2=0x7feaf00ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 shutdown_connections 2023-07-20T11:22:34.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:34.811+0000 7feaf7303640 1 -- 172.21.15.82:0/2804201170 wait complete. 2023-07-20T11:22:34.821 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:22:34.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:22:34.886 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:22:34.944 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:22:34.945 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:34.945 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:34.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:22:34.955 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:22:34.955 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:34.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:22:34.966 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:34.967 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:35.003 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:22:35.004 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:22:35.004 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:35.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:22:35.022 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T11:22:35.022 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:35.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 Processor -- start 2023-07-20T11:22:35.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 -- start start 2023-07-20T11:22:35.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 0x7f0c980d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c980d16b0 con 0x7f0c980cf110 2023-07-20T11:22:35.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c980d31c0 con 0x7f0c980d0d10 2023-07-20T11:22:35.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c9df2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980b3520 con 0x7f0c9815cab0 2023-07-20T11:22:35.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c8ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 0x7f0c980d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:58436/0 (socket says 172.21.15.82:58436) 2023-07-20T11:22:35.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c8ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 0x7f0c980d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:47488/0 (socket says 172.21.15.82:47488) 2023-07-20T11:22:35.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 -- 172.21.15.82:0/2181065574 learned_addr learned my addr 172.21.15.82:0/2181065574 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:35.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c97fff640 1 --1- 172.21.15.82:0/2181065574 >> v1:172.21.15.183:6789/0 conn(0x7f0c980cf110 0x7f0c980cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34144/0 (socket says 172.21.15.82:34144) 2023-07-20T11:22:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 -- 172.21.15.82:0/2181065574 >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 msgr2=0x7f0c980d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 --2- 172.21.15.82:0/2181065574 >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 0x7f0c980d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 -- 172.21.15.82:0/2181065574 >> v1:172.21.15.183:6789/0 conn(0x7f0c980cf110 legacy=0x7f0c980cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.195+0000 7f0c977fe640 1 -- 172.21.15.82:0/2181065574 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c980b2910 con 0x7f0c9815cab0 2023-07-20T11:22:35.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c977fe640 1 --2- 172.21.15.82:0/2181065574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009870 tx=0x7f0c8801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92af289f886dbe9c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c96ffd640 1 -- 172.21.15.82:0/2181065574 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880aa670 con 0x7f0c9815cab0 2023-07-20T11:22:35.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c96ffd640 1 -- 172.21.15.82:0/2181065574 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880aa7d0 con 0x7f0c9815cab0 2023-07-20T11:22:35.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c96ffd640 1 -- 172.21.15.82:0/2181065574 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880aab60 con 0x7f0c9815cab0 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 -- 172.21.15.82:0/2181065574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 msgr2=0x7f0c980d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/2181065574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009870 tx=0x7f0c8801c510 comp rx=0 tx=0).stop 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 -- 172.21.15.82:0/2181065574 shutdown_connections 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/2181065574 >> v2:172.21.15.183:3300/0 conn(0x7f0c980d0d10 0x7f0c980d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/2181065574 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d0300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 -- 172.21.15.82:0/2181065574 >> 172.21.15.82:0/2181065574 conn(0x7f0c9808c120 msgr2=0x7f0c9809ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:35.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 -- 172.21.15.82:0/2181065574 shutdown_connections 2023-07-20T11:22:35.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.199+0000 7f0c9df2c640 1 -- 172.21.15.82:0/2181065574 wait complete. 2023-07-20T11:22:35.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 Processor -- start 2023-07-20T11:22:35.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- start start 2023-07-20T11:22:35.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 0x7f0c980d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980cc160 con 0x7f0c980cf110 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980c80a0 con 0x7f0c980d0d10 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c980c8380 con 0x7f0c9815cab0 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41860/0 (socket says 172.21.15.82:41860) 2023-07-20T11:22:35.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 -- 172.21.15.82:0/3133407448 learned_addr learned my addr 172.21.15.82:0/3133407448 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c97fff640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c8ffff640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 0x7f0c980d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 -- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 msgr2=0x7f0c980d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 -- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 msgr2=0x7f0c980d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 0x7f0c980d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 -- 172.21.15.82:0/3133407448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c880094d0 con 0x7f0c980cf110 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c8ffff640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 0x7f0c980d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c977fe640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f0c880ac040 tx=0x7f0c8801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b3800 con 0x7f0c980cf110 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c880b3980 con 0x7f0c980cf110 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c980c8660 con 0x7f0c980cf110 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c880b3d30 con 0x7f0c980cf110 2023-07-20T11:22:35.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.203+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c98155ef0 con 0x7f0c980cf110 2023-07-20T11:22:35.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c98073c70 con 0x7f0c980cf110 2023-07-20T11:22:35.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c880c6390 con 0x7f0c980cf110 2023-07-20T11:22:35.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c94ff9640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 0x7f0c78068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f0c8811ebc0 con 0x7f0c980cf110 2023-07-20T11:22:35.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c8ffff640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 0x7f0c78068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.207+0000 7f0c8ffff640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 0x7f0c78068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c980c8f90 tx=0x7f0c80008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.211+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c880ebcd0 con 0x7f0c980cf110 2023-07-20T11:22:35.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c98156250 con 0x7f0c980cf110 2023-07-20T11:22:35.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c94ff9640 1 -- 172.21.15.82:0/3133407448 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+3537 (secure 0 0 0) 0x7f0c880aa630 con 0x7f0c980cf110 2023-07-20T11:22:35.381 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:35.382 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":84,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9283,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/1976444436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":1976444436},{"type":"v1","addr":"172.21.15.183:6834","nonce":1976444436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/1668503073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":1668503073},{"type":"v1","addr":"172.21.15.183:6835","nonce":1668503073}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/3073328147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3073328147},{"type":"v1","addr":"172.21.15.82:6836","nonce":3073328147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":10746,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1014720512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":1014720512},{"type":"v1","addr":"172.21.15.82:6837","nonce":1014720512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[]} 2023-07-20T11:22:35.382 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 84 2023-07-20T11:22:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 msgr2=0x7f0c78068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 0x7f0c78068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0c980c8f90 tx=0x7f0c80008040 comp rx=0 tx=0).stop 2023-07-20T11:22:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 msgr2=0x7f0c981559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f0c880ac040 tx=0x7f0c8801ad50 comp rx=0 tx=0).stop 2023-07-20T11:22:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 shutdown_connections 2023-07-20T11:22:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0c9815cab0 0x7f0c980d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0c980d0d10 0x7f0c980d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0c780663a0 0x7f0c78068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 --2- 172.21.15.82:0/3133407448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c980cf110 0x7f0c981559b0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 >> 172.21.15.82:0/3133407448 conn(0x7f0c9808c120 msgr2=0x7f0c980cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 shutdown_connections 2023-07-20T11:22:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.391+0000 7f0c9df2c640 1 -- 172.21.15.82:0/3133407448 wait complete. 2023-07-20T11:22:35.403 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T11:22:35.403 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T11:22:35.404 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T11:22:35.404 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:22:35.404 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T11:22:35.404 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T11:22:35.405 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T11:22:35.405 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:22:35.405 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T11:22:35.405 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T11:22:35.406 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T11:22:35.406 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:22:35.406 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T11:22:35.406 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T11:22:35.407 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T11:22:35.407 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:22:35.416 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T11:22:35.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T11:22:35.418 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T11:22:35.418 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T11:22:35.423 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T11:22:35.424 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T11:22:35.425 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T11:22:35.425 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T11:22:35.466 INFO:tasks.ceph.mds.a:Started 2023-07-20T11:22:35.467 DEBUG:teuthology.parallel:result is None 2023-07-20T11:22:35.468 INFO:tasks.ceph.mds.c:Started 2023-07-20T11:22:35.468 DEBUG:teuthology.parallel:result is None 2023-07-20T11:22:35.471 INFO:tasks.ceph.mds.b:Started 2023-07-20T11:22:35.471 DEBUG:teuthology.parallel:result is None 2023-07-20T11:22:35.474 INFO:tasks.ceph.mds.d:Started 2023-07-20T11:22:35.474 DEBUG:teuthology.parallel:result is None 2023-07-20T11:22:35.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T11:22:35.556 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T11:22:35.559 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:22:35.567 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T11:22:35.570 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T11:22:35.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.635+0000 7f0226096640 1 Processor -- start 2023-07-20T11:22:35.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.635+0000 7f0226096640 1 -- start start 2023-07-20T11:22:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.635+0000 7f0226096640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f022015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.635+0000 7f0226096640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 0x7f02200ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0226096640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200ccd90 con 0x7f02201596b0 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0226096640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200ad600 con 0x7f02200cc900 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0226096640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200ad810 con 0x7f02200b2a90 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f02201596b0 0x7f02200b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53446/0 (socket says 172.21.15.82:53446) 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021f7fe640 1 -- 172.21.15.82:0/598539073 learned_addr learned my addr 172.21.15.82:0/598539073 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021ffff640 1 --2- 172.21.15.82:0/598539073 >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 0x7f02200ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 --2- 172.21.15.82:0/598539073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f022015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021effd640 1 -- 172.21.15.82:0/598539073 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399915501 0 0) 0x7f02200ccd90 con 0x7f02201596b0 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021effd640 1 -- 172.21.15.82:0/598539073 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c003530 con 0x7f02201596b0 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 -- 172.21.15.82:0/598539073 >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 msgr2=0x7f02200ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 --2- 172.21.15.82:0/598539073 >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 0x7f02200ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 -- 172.21.15.82:0/598539073 >> v1:172.21.15.82:6789/0 conn(0x7f02201596b0 legacy=0x7f02200b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 -- 172.21.15.82:0/598539073 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022015d0d0 con 0x7f02200b2a90 2023-07-20T11:22:35.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f021ffff640 1 --2- 172.21.15.82:0/598539073 >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 0x7f02200ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.639+0000 7f0216ffd640 1 --2- 172.21.15.82:0/598539073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f022015dbb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0208009d90 tx=0x7f020801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92251a233b4dda1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f021effd640 1 -- 172.21.15.82:0/598539073 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080a59e0 con 0x7f02200b2a90 2023-07-20T11:22:35.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f021effd640 1 -- 172.21.15.82:0/598539073 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02080a5b40 con 0x7f02200b2a90 2023-07-20T11:22:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f021effd640 1 -- 172.21.15.82:0/598539073 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080ad440 con 0x7f02200b2a90 2023-07-20T11:22:35.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- 172.21.15.82:0/598539073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 msgr2=0x7f022015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- 172.21.15.82:0/598539073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f022015dbb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0208009d90 tx=0x7f020801c920 comp rx=0 tx=0).stop 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- 172.21.15.82:0/598539073 shutdown_connections 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- 172.21.15.82:0/598539073 >> v2:172.21.15.183:3300/0 conn(0x7f02200cc900 0x7f02200ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- 172.21.15.82:0/598539073 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f022015dbb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- 172.21.15.82:0/598539073 >> 172.21.15.82:0/598539073 conn(0x7f02200cada0 msgr2=0x7f02200cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- 172.21.15.82:0/598539073 shutdown_connections 2023-07-20T11:22:35.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- 172.21.15.82:0/598539073 wait complete. 2023-07-20T11:22:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 Processor -- start 2023-07-20T11:22:35.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- start start 2023-07-20T11:22:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f0220159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02201596b0 0x7f02200c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0220152dd0 con 0x7f02200cc900 2023-07-20T11:22:35.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201530b0 con 0x7f02201596b0 2023-07-20T11:22:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0226096640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220153390 con 0x7f02200b2a90 2023-07-20T11:22:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.643+0000 7f0216ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41892/0 (socket says 172.21.15.82:41892) 2023-07-20T11:22:35.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 -- 172.21.15.82:0/1495489578 learned_addr learned my addr 172.21.15.82:0/1495489578 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021f7fe640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f0220159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021ffff640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02201596b0 0x7f02200c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 -- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 msgr2=0x7f0220159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f0220159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 -- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02201596b0 msgr2=0x7f02200c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02201596b0 0x7f02200c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 -- 172.21.15.82:0/1495489578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009420 con 0x7f02200cc900 2023-07-20T11:22:35.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0216ffd640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f020801afd0 tx=0x7f02080196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208009450 con 0x7f02200cc900 2023-07-20T11:22:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02080adb40 con 0x7f02200cc900 2023-07-20T11:22:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02080b8420 con 0x7f02200cc900 2023-07-20T11:22:35.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0208009a70 con 0x7f02200cc900 2023-07-20T11:22:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220153950 con 0x7f02200cc900 2023-07-20T11:22:35.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220073c70 con 0x7f02200cc900 2023-07-20T11:22:35.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.647+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02080b8580 con 0x7f02200cc900 2023-07-20T11:22:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.651+0000 7f021cff9640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 0x7f0200068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.651+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f020811f360 con 0x7f02200cc900 2023-07-20T11:22:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.651+0000 7f021f7fe640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 0x7f0200068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:35.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.651+0000 7f021f7fe640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 0x7f0200068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0210005890 tx=0x7f0210009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:35.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.655+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02080ec590 con 0x7f02200cc900 2023-07-20T11:22:35.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:35.811+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02200cbbd0 con 0x7f02200cc900 2023-07-20T11:22:36.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.510+0000 7f021cff9640 1 -- 172.21.15.82:0/1495489578 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v185) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02080efbb0 con 0x7f02200cc900 2023-07-20T11:22:36.502 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T11:22:36.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 msgr2=0x7f0200068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 0x7f0200068890 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0210005890 tx=0x7f0210009040 comp rx=0 tx=0).stop 2023-07-20T11:22:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 msgr2=0x7f02200c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f020801afd0 tx=0x7f02080196c0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 shutdown_connections 2023-07-20T11:22:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f02201596b0 0x7f02200c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f02000663d0 0x7f0200068890 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02200cc900 0x7f02200c3f90 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 --2- 172.21.15.82:0/1495489578 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f02200b2a90 0x7f0220159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 >> 172.21.15.82:0/1495489578 conn(0x7f02200cada0 msgr2=0x7f022006d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:36.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 shutdown_connections 2023-07-20T11:22:36.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.514+0000 7f0226096640 1 -- 172.21.15.82:0/1495489578 wait complete. 2023-07-20T11:22:36.528 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T11:22:36.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.678+0000 7fb45406d640 1 Processor -- start 2023-07-20T11:22:36.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.678+0000 7fb45406d640 1 -- start start 2023-07-20T11:22:36.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45406d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb44c0afda0 0x7fb44c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45406d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0b12a0 con 0x7fb44c0b2060 2023-07-20T11:22:36.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45406d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0b1580 con 0x7fb44c15a8e0 2023-07-20T11:22:36.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45406d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c0b3160 con 0x7fb44c0afda0 2023-07-20T11:22:36.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45260a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb44c0b2060 0x7fb44c0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53454/0 (socket says 172.21.15.82:53454) 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45260a640 1 -- 172.21.15.82:0/1879374733 learned_addr learned my addr 172.21.15.82:0/1879374733 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451e09640 1 --2- 172.21.15.82:0/1879374733 >> v2:172.21.15.183:3300/0 conn(0x7fb44c0afda0 0x7fb44c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037717456 0 0) 0x7fb44c0b12a0 con 0x7fb44c0b2060 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb438003530 con 0x7fb44c0b2060 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440804214 0 0) 0x7fb438003530 con 0x7fb44c0b2060 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 >> v2:172.21.15.183:3300/0 conn(0x7fb44c0afda0 msgr2=0x7fb44c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:36.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 --2- 172.21.15.82:0/1879374733 >> v2:172.21.15.183:3300/0 conn(0x7fb44c0afda0 0x7fb44c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 >> v1:172.21.15.183:6789/0 conn(0x7fb44c15a8e0 legacy=0x7fb44c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0b1860 con 0x7fb44c0b2060 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fb444001a00 con 0x7fb44c0b2060 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 >> v1:172.21.15.82:6789/0 conn(0x7fb44c0b2060 legacy=0x7fb44c0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4380039d0 0x7fb438003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb438004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4380052b0 0x7fb43800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0b3160 con 0x7fb4380047d0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43800c1b0 con 0x7fb4380052b0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43800c370 con 0x7fb4380039d0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb438004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451e09640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4380039d0 0x7fb438003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45260a640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4380052b0 0x7fb43800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 -- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4380039d0 msgr2=0x7fb438003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:36.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb4380039d0 0x7fb438003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 -- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4380052b0 msgr2=0x7fb43800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:36.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb4380052b0 0x7fb43800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb451608640 1 -- 172.21.15.82:0/1879374733 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438003530 con 0x7fb4380047d0 2023-07-20T11:22:36.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.682+0000 7fb45260a640 1 -- 172.21.15.82:0/1879374733 reap_dead start 2023-07-20T11:22:36.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb451608640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb438004c50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fb43c001750 tx=0x7fb43c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40fbf369b68ef24 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:36.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0052d0 con 0x7fb4380047d0 2023-07-20T11:22:36.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0a7050 con 0x7fb4380047d0 2023-07-20T11:22:36.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb450e07640 1 -- 172.21.15.82:0/1879374733 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c003600 con 0x7fb4380047d0 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 msgr2=0x7fb438004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb438004c50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7fb43c001750 tx=0x7fb43c01c370 comp rx=0 tx=0).stop 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- 172.21.15.82:0/1879374733 shutdown_connections 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 --2- 172.21.15.82:0/1879374733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb438004c50 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- 172.21.15.82:0/1879374733 >> 172.21.15.82:0/1879374733 conn(0x7fb44c0cada0 msgr2=0x7fb44c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- 172.21.15.82:0/1879374733 shutdown_connections 2023-07-20T11:22:36.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- 172.21.15.82:0/1879374733 wait complete. 2023-07-20T11:22:36.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 Processor -- start 2023-07-20T11:22:36.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.686+0000 7fb45406d640 1 -- start start 2023-07-20T11:22:36.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb44c15c610 0x7fb44c15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb44c15b9d0 0x7fb44c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c70d0 con 0x7fb4380047d0 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c155e40 con 0x7fb44c15b9d0 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c15ad20 con 0x7fb44c15c610 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41922/0 (socket says 172.21.15.82:41922) 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 -- 172.21.15.82:0/1067532731 learned_addr learned my addr 172.21.15.82:0/1067532731 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 -- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb44c15c610 msgr2=0x7fb44c15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb44c15c610 0x7fb44c15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 -- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb44c15b9d0 msgr2=0x7fb44c15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb44c15b9d0 0x7fb44c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 -- 172.21.15.82:0/1067532731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0b2f30 con 0x7fb4380047d0 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb451e09640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fb448011900 tx=0x7fb448011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480095b0 con 0x7fb4380047d0 2023-07-20T11:22:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448004240 con 0x7fb4380047d0 2023-07-20T11:22:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800f860 con 0x7fb4380047d0 2023-07-20T11:22:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c1558f0 con 0x7fb4380047d0 2023-07-20T11:22:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c15d6a0 con 0x7fb4380047d0 2023-07-20T11:22:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c073c70 con 0x7fb4380047d0 2023-07-20T11:22:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.690+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb44800f9c0 con 0x7fb4380047d0 2023-07-20T11:22:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.694+0000 7fb4427fc640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 0x7fb430068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.694+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fb4480841b0 con 0x7fb4380047d0 2023-07-20T11:22:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.694+0000 7fb451608640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 0x7fb430068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:36.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.694+0000 7fb451608640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 0x7fb430068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb44c15acf0 tx=0x7fb43c001130 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:36.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.698+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb448051780 con 0x7fb4380047d0 2023-07-20T11:22:36.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.894+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb44c0cb990 con 0x7fb4380047d0 2023-07-20T11:22:36.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb4427fc640 1 -- 172.21.15.82:0/1067532731 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb448054da0 con 0x7fb4380047d0 2023-07-20T11:22:36.888 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:36.888 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:22:36.888 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:22:36.889 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.890 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T11:22:36.891 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:22:36.893 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.894 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T11:22:36.895 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T11:22:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.897 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.899 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.900 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.901 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.902 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T11:22:36.903 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.904 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:22:36.906 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:22:36.907 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T11:22:36.908 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:22:36.911 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:36.912 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T11:22:36.912 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:22:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 msgr2=0x7fb430068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 0x7fb430068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb44c15acf0 tx=0x7fb43c001130 comp rx=0 tx=0).stop 2023-07-20T11:22:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 msgr2=0x7fb44c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fb448011900 tx=0x7fb448011dc0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 shutdown_connections 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb44c15b9d0 0x7fb44c15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb44c15c610 0x7fb44c15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fb4300663d0 0x7fb430068890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 --2- 172.21.15.82:0/1067532731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb4380047d0 0x7fb44c1553b0 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 >> 172.21.15.82:0/1067532731 conn(0x7fb44c0cada0 msgr2=0x7fb44c0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 shutdown_connections 2023-07-20T11:22:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:36.898+0000 7fb45406d640 1 -- 172.21.15.82:0/1067532731 wait complete. 2023-07-20T11:22:36.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:37.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 Processor -- start 2023-07-20T11:22:37.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 -- start start 2023-07-20T11:22:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 0x7f177c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f177c06b970 0x7f177c0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0b28c0 con 0x7f177c06b970 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c0cf4a0 con 0x7f177c06f350 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1780940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0ce890 con 0x7f177c0b2470 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f177c06b970 0x7f177c0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f177c06b970 0x7f177c0b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41926/0 (socket says 172.21.15.82:41926) 2023-07-20T11:22:37.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 -- 172.21.15.82:0/2696428956 learned_addr learned my addr 172.21.15.82:0/2696428956 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f177a59c640 1 --2- 172.21.15.82:0/2696428956 >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 0x7f177c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f177ad9d640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 -- 172.21.15.82:0/2696428956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 msgr2=0x7f177c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 -- 172.21.15.82:0/2696428956 >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 msgr2=0x7f177c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 --2- 172.21.15.82:0/2696428956 >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 0x7f177c06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f1771d9b640 1 -- 172.21.15.82:0/2696428956 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c0ceb70 con 0x7f177c06b970 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f177ad9d640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:37.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.062+0000 7f177a59c640 1 --2- 172.21.15.82:0/2696428956 >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 0x7f177c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1771d9b640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06b970 0x7f177c0b1f30 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f177c08a560 tx=0x7f176401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e44380b6867df96 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1779d9b640 1 -- 172.21.15.82:0/2696428956 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a5790 con 0x7f177c06b970 2023-07-20T11:22:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1779d9b640 1 -- 172.21.15.82:0/2696428956 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640a58f0 con 0x7f177c06b970 2023-07-20T11:22:37.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1779d9b640 1 -- 172.21.15.82:0/2696428956 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a5c80 con 0x7f177c06b970 2023-07-20T11:22:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 -- 172.21.15.82:0/2696428956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06b970 msgr2=0x7f177c0b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06b970 0x7f177c0b1f30 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f177c08a560 tx=0x7f176401c910 comp rx=0 tx=0).stop 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 -- 172.21.15.82:0/2696428956 shutdown_connections 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 --2- 172.21.15.82:0/2696428956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06b970 0x7f177c0b1f30 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 --2- 172.21.15.82:0/2696428956 >> v2:172.21.15.183:3300/0 conn(0x7f177c06f350 0x7f177c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 -- 172.21.15.82:0/2696428956 >> 172.21.15.82:0/2696428956 conn(0x7f177c089fa0 msgr2=0x7f177c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 -- 172.21.15.82:0/2696428956 shutdown_connections 2023-07-20T11:22:37.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.066+0000 7f1780940640 1 -- 172.21.15.82:0/2696428956 wait complete. 2023-07-20T11:22:37.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 Processor -- start 2023-07-20T11:22:37.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- start start 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177c06b970 0x7f177c1f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c06da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0c5ad0 con 0x7f177c06f350 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0cd8f0 con 0x7f177c06b970 2023-07-20T11:22:37.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1f8f40 con 0x7f177c0b2470 2023-07-20T11:22:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41932/0 (socket says 172.21.15.82:41932) 2023-07-20T11:22:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 -- 172.21.15.82:0/1637968533 learned_addr learned my addr 172.21.15.82:0/1637968533 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f177a59c640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177c06b970 0x7f177c1f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f177ad9d640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c06da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 -- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 msgr2=0x7f177c06da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c06da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 -- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177c06b970 msgr2=0x7f177c1f8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177c06b970 0x7f177c1f8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 -- 172.21.15.82:0/1637968533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764009b30 con 0x7f177c06f350 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1771d9b640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f176401afc0 tx=0x7f17640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640b8880 con 0x7f177c06f350 2023-07-20T11:22:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640b8a00 con 0x7f177c06f350 2023-07-20T11:22:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640b8db0 con 0x7f177c06f350 2023-07-20T11:22:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c0ccb40 con 0x7f177c06f350 2023-07-20T11:22:37.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.070+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c0c5410 con 0x7f177c06f350 2023-07-20T11:22:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c0c5270 con 0x7f177c06f350 2023-07-20T11:22:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f17640b6440 con 0x7f177c06f350 2023-07-20T11:22:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f17737fe640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 0x7f175c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f176411f390 con 0x7f177c06f350 2023-07-20T11:22:37.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f177a59c640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 0x7f175c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.074+0000 7f177a59c640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 0x7f175c068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f176c006b20 tx=0x7f176c008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.078+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f177c0c5270 con 0x7f177c06f350 2023-07-20T11:22:37.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.226+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f177c0c5c10 con 0x7f177c06f350 2023-07-20T11:22:37.218 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.226+0000 7f17737fe640 1 -- 172.21.15.82:0/1637968533 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+14740 (secure 0 0 0) 0x7f177c0c5c10 con 0x7f177c06f350 2023-07-20T11:22:37.218 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:37.218 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":187,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:36.524435+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 msgr2=0x7f175c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 0x7f175c068890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f176c006b20 tx=0x7f176c008040 comp rx=0 tx=0).stop 2023-07-20T11:22:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 msgr2=0x7f177c153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f176401afc0 tx=0x7f17640196b0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 shutdown_connections 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f177c0b2470 0x7f177c06da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f175c0663d0 0x7f175c068890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f177c06f350 0x7f177c153740 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 --2- 172.21.15.82:0/1637968533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f177c06b970 0x7f177c1f8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 >> 172.21.15.82:0/1637968533 conn(0x7f177c089fa0 msgr2=0x7f177c15bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 shutdown_connections 2023-07-20T11:22:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.230+0000 7f1780940640 1 -- 172.21.15.82:0/1637968533 wait complete. 2023-07-20T11:22:37.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:22:37.240 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:22:37.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 Processor -- start 2023-07-20T11:22:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 -- start start 2023-07-20T11:22:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100806c120 0x7f10080cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10081602b0 0x7f1008160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10080d0970 con 0x7f100806ab10 2023-07-20T11:22:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1008160e20 con 0x7f100806c120 2023-07-20T11:22:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f100e418640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10080cd300 con 0x7f10081602b0 2023-07-20T11:22:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f1007fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100806c120 0x7f10080cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f1007fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f100806c120 0x7f10080cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41940/0 (socket says 172.21.15.82:41940) 2023-07-20T11:22:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.390+0000 7f1007fff640 1 -- 172.21.15.82:0/609914570 learned_addr learned my addr 172.21.15.82:0/609914570 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f10077fe640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10081602b0 0x7f1008160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1007fff640 1 -- 172.21.15.82:0/609914570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10081602b0 msgr2=0x7f1008160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1007fff640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10081602b0 0x7f1008160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1007fff640 1 -- 172.21.15.82:0/609914570 >> v1:172.21.15.183:6789/0 conn(0x7f100806ab10 legacy=0x7f100806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1007fff640 1 -- 172.21.15.82:0/609914570 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10080cd5e0 con 0x7f100806c120 2023-07-20T11:22:37.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1007fff640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100806c120 0x7f10080cdde0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6669f085d0b5887 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1006ffd640 1 -- 172.21.15.82:0/609914570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80ac620 con 0x7f100806c120 2023-07-20T11:22:37.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1006ffd640 1 -- 172.21.15.82:0/609914570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80ac780 con 0x7f100806c120 2023-07-20T11:22:37.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.394+0000 7f1006ffd640 1 -- 172.21.15.82:0/609914570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80acb10 con 0x7f100806c120 2023-07-20T11:22:37.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- 172.21.15.82:0/609914570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100806c120 msgr2=0x7f10080cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100806c120 0x7f10080cdde0 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8009870 tx=0x7f0ff801c4b0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- 172.21.15.82:0/609914570 shutdown_connections 2023-07-20T11:22:37.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f10081602b0 0x7f1008160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- 172.21.15.82:0/609914570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f100806c120 0x7f10080cdde0 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- 172.21.15.82:0/609914570 >> 172.21.15.82:0/609914570 conn(0x7f100808c0a0 msgr2=0x7f100809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- 172.21.15.82:0/609914570 shutdown_connections 2023-07-20T11:22:37.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- 172.21.15.82:0/609914570 wait complete. 2023-07-20T11:22:37.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 Processor -- start 2023-07-20T11:22:37.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- start start 2023-07-20T11:22:37.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f100806ab10 0x7f100814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f100806c120 0x7f100814d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10080b0b50 con 0x7f10081602b0 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008155a40 con 0x7f100806ab10 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100e418640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100814dfc0 con 0x7f100806c120 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f1007fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f100806ab10 0x7f100814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41954/0 (socket says 172.21.15.82:41954) 2023-07-20T11:22:37.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 -- 172.21.15.82:0/1331959393 learned_addr learned my addr 172.21.15.82:0/1331959393 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f10077fe640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f100806c120 0x7f100814d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 -- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f100806c120 msgr2=0x7f100814d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f100806c120 0x7f100814d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 -- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f100806ab10 msgr2=0x7f100814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f100806ab10 0x7f100814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.398+0000 7f100c9b5640 1 -- 172.21.15.82:0/1331959393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80094d0 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f100c9b5640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f100000c770 tx=0x7f100000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000003b80 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000003ce0 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100000aa90 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1008155d00 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100814db70 con 0x7f10081602b0 2023-07-20T11:22:37.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100814dd90 con 0x7f10081602b0 2023-07-20T11:22:37.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f100000abf0 con 0x7f10081602b0 2023-07-20T11:22:37.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 0x7f0ff4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f10000838d0 con 0x7f10081602b0 2023-07-20T11:22:37.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.402+0000 7f1007fff640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 0x7f0ff4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.406+0000 7f1007fff640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 0x7f0ff4068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ae000 tx=0x7f0ff80a7000 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.410+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1000050fe0 con 0x7f10081602b0 2023-07-20T11:22:37.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.562+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f100804da30 con 0x7f10081602b0 2023-07-20T11:22:37.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.562+0000 7f1004ff9640 1 -- 172.21.15.82:0/1331959393 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v187) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1000054600 con 0x7f10081602b0 2023-07-20T11:22:37.555 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:22:37.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 msgr2=0x7f0ff4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 0x7f0ff4068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80ae000 tx=0x7f0ff80a7000 comp rx=0 tx=0).stop 2023-07-20T11:22:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 msgr2=0x7f10080af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f100000c770 tx=0x7f100000cc30 comp rx=0 tx=0).stop 2023-07-20T11:22:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 shutdown_connections 2023-07-20T11:22:37.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ff40663a0 0x7f0ff4068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10081602b0 0x7f10080af220 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f100806c120 0x7f100814d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 --2- 172.21.15.82:0/1331959393 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f100806ab10 0x7f100814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 >> 172.21.15.82:0/1331959393 conn(0x7f100808c0a0 msgr2=0x7f10080b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 shutdown_connections 2023-07-20T11:22:37.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.566+0000 7f100e418640 1 -- 172.21.15.82:0/1331959393 wait complete. 2023-07-20T11:22:37.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:22:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 Processor -- start 2023-07-20T11:22:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 -- start start 2023-07-20T11:22:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 0x7f475406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 0x7f475415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754070030 con 0x7f47540ca5a0 2023-07-20T11:22:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475415bad0 con 0x7f475406f710 2023-07-20T11:22:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.726+0000 7f475bc6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4754071950 con 0x7f475415a6f0 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 0x7f475415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4759a09640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 0x7f475406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4759208640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f47540ca5a0 0x7f475415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34190/0 (socket says 172.21.15.82:34190) 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4759208640 1 -- 172.21.15.82:0/2289726229 learned_addr learned my addr 172.21.15.82:0/2289726229 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 -- 172.21.15.82:0/2289726229 >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 msgr2=0x7f475406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 --2- 172.21.15.82:0/2289726229 >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 0x7f475406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 -- 172.21.15.82:0/2289726229 >> v1:172.21.15.183:6789/0 conn(0x7f47540ca5a0 legacy=0x7f475415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 -- 172.21.15.82:0/2289726229 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475415b230 con 0x7f475415a6f0 2023-07-20T11:22:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4759a09640 1 --2- 172.21.15.82:0/2289726229 >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 0x7f475406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f475a20a640 1 --2- 172.21.15.82:0/2289726229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 0x7f475415ab80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097c0 tx=0x7f474c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9fb77a770ee18e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4758a07640 1 -- 172.21.15.82:0/2289726229 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0ab650 con 0x7f475415a6f0 2023-07-20T11:22:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4758a07640 1 -- 172.21.15.82:0/2289726229 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0ab7b0 con 0x7f475415a6f0 2023-07-20T11:22:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.730+0000 7f4758a07640 1 -- 172.21.15.82:0/2289726229 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0abb40 con 0x7f475415a6f0 2023-07-20T11:22:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- 172.21.15.82:0/2289726229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 msgr2=0x7f475415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- 172.21.15.82:0/2289726229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 0x7f475415ab80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f474c0097c0 tx=0x7f474c01c450 comp rx=0 tx=0).stop 2023-07-20T11:22:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- 172.21.15.82:0/2289726229 shutdown_connections 2023-07-20T11:22:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- 172.21.15.82:0/2289726229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f475415a6f0 0x7f475415ab80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- 172.21.15.82:0/2289726229 >> v2:172.21.15.183:3300/0 conn(0x7f475406f710 0x7f475406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- 172.21.15.82:0/2289726229 >> 172.21.15.82:0/2289726229 conn(0x7f47540cad50 msgr2=0x7f47540cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- 172.21.15.82:0/2289726229 shutdown_connections 2023-07-20T11:22:37.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- 172.21.15.82:0/2289726229 wait complete. 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 Processor -- start 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- start start 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475406f710 0x7f47540b0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47540ca5a0 0x7f4754151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4754154f70 con 0x7f475415a6f0 2023-07-20T11:22:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540c7ce0 con 0x7f475406f710 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475bc6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4754154640 con 0x7f47540ca5a0 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475a20a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475a20a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41966/0 (socket says 172.21.15.82:41966) 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f475a20a640 1 -- 172.21.15.82:0/3726200814 learned_addr learned my addr 172.21.15.82:0/3726200814 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f4759a09640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475406f710 0x7f47540b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.734+0000 7f4759208640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47540ca5a0 0x7f4754151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 -- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47540ca5a0 msgr2=0x7f4754151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47540ca5a0 0x7f4754151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 -- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475406f710 msgr2=0x7f47540b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475406f710 0x7f47540b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 -- 172.21.15.82:0/3726200814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009a70 con 0x7f475415a6f0 2023-07-20T11:22:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475a20a640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f474c01a080 tx=0x7f474c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0abd30 con 0x7f475415a6f0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0bf450 con 0x7f475415a6f0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474c009420 con 0x7f475415a6f0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0bf800 con 0x7f475415a6f0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4754154c00 con 0x7f475415a6f0 2023-07-20T11:22:37.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47541550e0 con 0x7f475415a6f0 2023-07-20T11:22:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f474c0bf960 con 0x7f475415a6f0 2023-07-20T11:22:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 0x7f4738068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f474c11e390 con 0x7f475415a6f0 2023-07-20T11:22:37.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.738+0000 7f4759a09640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 0x7f4738068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:37.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.742+0000 7f4759a09640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 0x7f4738068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fd0 tx=0x7f475000b040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:37.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.742+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f474c0eba10 con 0x7f475415a6f0 2023-07-20T11:22:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4754154780 con 0x7f475415a6f0 2023-07-20T11:22:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f474a7fc640 1 -- 172.21.15.82:0/3726200814 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v187) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4754154780 con 0x7f475415a6f0 2023-07-20T11:22:37.882 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:22:37.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 msgr2=0x7f4738068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 0x7f4738068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4750009fd0 tx=0x7f475000b040 comp rx=0 tx=0).stop 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 msgr2=0x7f4754155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.890+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f474c01a080 tx=0x7f474c0191f0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 shutdown_connections 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f47380663d0 0x7f4738068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f475415a6f0 0x7f4754155400 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f47540ca5a0 0x7f4754151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 --2- 172.21.15.82:0/3726200814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f475406f710 0x7f47540b0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 >> 172.21.15.82:0/3726200814 conn(0x7f47540cad50 msgr2=0x7f4754156550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 shutdown_connections 2023-07-20T11:22:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:37.894+0000 7f475bc6d640 1 -- 172.21.15.82:0/3726200814 wait complete. 2023-07-20T11:22:37.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T11:22:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 Processor -- start 2023-07-20T11:22:38.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 -- start start 2023-07-20T11:22:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cdc0b1170 0x7f8cdc0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0cde70 con 0x7f8cdc0ca040 2023-07-20T11:22:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0cbef0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce3f40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0ca420 con 0x7f8cdc0ad060 2023-07-20T11:22:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce14db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce24dd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8cdc0b1170 0x7f8cdc0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce14db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:58584/0 (socket says 172.21.15.82:58584) 2023-07-20T11:22:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.050+0000 7f8ce14db640 1 -- 172.21.15.82:0/2236372695 learned_addr learned my addr 172.21.15.82:0/2236372695 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce14db640 1 -- 172.21.15.82:0/2236372695 >> v2:172.21.15.183:3300/0 conn(0x7f8cdc0b1170 msgr2=0x7f8cdc0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce14db640 1 --2- 172.21.15.82:0/2236372695 >> v2:172.21.15.183:3300/0 conn(0x7f8cdc0b1170 0x7f8cdc0b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce14db640 1 -- 172.21.15.82:0/2236372695 >> v1:172.21.15.183:6789/0 conn(0x7f8cdc0ca040 legacy=0x7f8cdc15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce14db640 1 -- 172.21.15.82:0/2236372695 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0cdb40 con 0x7f8cdc0ad060 2023-07-20T11:22:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce14db640 1 --2- 172.21.15.82:0/2236372695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009870 tx=0x7f8ccc01e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4df6304503de9983 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce0cda640 1 -- 172.21.15.82:0/2236372695 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a8690 con 0x7f8cdc0ad060 2023-07-20T11:22:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce0cda640 1 -- 172.21.15.82:0/2236372695 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0a87f0 con 0x7f8cdc0ad060 2023-07-20T11:22:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.054+0000 7f8ce0cda640 1 -- 172.21.15.82:0/2236372695 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a8b80 con 0x7f8cdc0ad060 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- 172.21.15.82:0/2236372695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 msgr2=0x7f8cdc15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/2236372695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009870 tx=0x7f8ccc01e720 comp rx=0 tx=0).stop 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- 172.21.15.82:0/2236372695 shutdown_connections 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/2236372695 >> v2:172.21.15.183:3300/0 conn(0x7f8cdc0b1170 0x7f8cdc0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/2236372695 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ad060 0x7f8cdc15d020 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- 172.21.15.82:0/2236372695 >> 172.21.15.82:0/2236372695 conn(0x7f8cdc0cada0 msgr2=0x7f8cdc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- 172.21.15.82:0/2236372695 shutdown_connections 2023-07-20T11:22:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- 172.21.15.82:0/2236372695 wait complete. 2023-07-20T11:22:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 Processor -- start 2023-07-20T11:22:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- start start 2023-07-20T11:22:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cdc0ad060 0x7f8cdc153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ca040 0x7f8cdc1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc151de0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc150ae0 con 0x7f8cdc0ad060 2023-07-20T11:22:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce3f40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc150dc0 con 0x7f8cdc0ca040 2023-07-20T11:22:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41982/0 (socket says 172.21.15.82:41982) 2023-07-20T11:22:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 -- 172.21.15.82:0/424335374 learned_addr learned my addr 172.21.15.82:0/424335374 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce24dd640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ca040 0x7f8cdc1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce1cdc640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cdc0ad060 0x7f8cdc153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 -- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ca040 msgr2=0x7f8cdc1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ca040 0x7f8cdc1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 -- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cdc0ad060 msgr2=0x7f8cdc153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cdc0ad060 0x7f8cdc153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.058+0000 7f8ce14db640 1 -- 172.21.15.82:0/424335374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0094d0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8ce14db640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc01c350 tx=0x7f8ccc01b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a9880 con 0x7f8cdc0b1170 2023-07-20T11:22:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0a99e0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc1510a0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a9d70 con 0x7f8cdc0b1170 2023-07-20T11:22:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc150770 con 0x7f8cdc0b1170 2023-07-20T11:22:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc0b0fa0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8ccc0b3450 con 0x7f8cdc0b1170 2023-07-20T11:22:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 0x7f8cc0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f8ccc11fdb0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.062+0000 7f8ce1cdc640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 0x7f8cc0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.066+0000 7f8ce1cdc640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 0x7f8cc0068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc163c10 tx=0x7f8cd8009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.066+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ccc124070 con 0x7f8cdc0b1170 2023-07-20T11:22:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8cdc0cd1e0 con 0x7f8cdc0b1170 2023-07-20T11:22:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8cd27fc640 1 -- 172.21.15.82:0/424335374 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v187) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8ccc0ae020 con 0x7f8cdc0b1170 2023-07-20T11:22:38.209 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:38.210 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:22:38.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:38.210 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T11:22:38.210 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T11:22:38.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:22:38.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:38.211 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T11:22:38.211 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T11:22:38.212 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:38.212 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:22:38.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 msgr2=0x7f8cc0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 0x7f8cc0068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc163c10 tx=0x7f8cd8009040 comp rx=0 tx=0).stop 2023-07-20T11:22:38.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 msgr2=0x7f8cdc14c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc01c350 tx=0x7f8ccc01b4c0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 shutdown_connections 2023-07-20T11:22:38.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8cdc0ca040 0x7f8cdc1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8cc00663a0 0x7f8cc0068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cdc0b1170 0x7f8cdc14c830 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 --2- 172.21.15.82:0/424335374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8cdc0ad060 0x7f8cdc153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 >> 172.21.15.82:0/424335374 conn(0x7f8cdc0cada0 msgr2=0x7f8cdc0b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 shutdown_connections 2023-07-20T11:22:38.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.218+0000 7f8ce3f40640 1 -- 172.21.15.82:0/424335374 wait complete. 2023-07-20T11:22:38.232 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T11:22:38.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T11:22:38.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 Processor -- start 2023-07-20T11:22:38.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 -- start start 2023-07-20T11:22:38.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f722806faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72280ca5a0 0x7f722815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7228070030 con 0x7f722815ec90 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f722815bad0 con 0x7f72280ca5a0 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722f58f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7228071950 con 0x7f722806f710 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72280ca5a0 0x7f722815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f72280ca5a0 0x7f722815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41998/0 (socket says 172.21.15.82:41998) 2023-07-20T11:22:38.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 -- 172.21.15.82:0/2020675669 learned_addr learned my addr 172.21.15.82:0/2020675669 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 -- 172.21.15.82:0/2020675669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 msgr2=0x7f722806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 --2- 172.21.15.82:0/2020675669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f722806faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 -- 172.21.15.82:0/2020675669 >> v1:172.21.15.183:6789/0 conn(0x7f722815ec90 legacy=0x7f722815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:38.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.386+0000 7f722cb2a640 1 -- 172.21.15.82:0/2020675669 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722815b230 con 0x7f72280ca5a0 2023-07-20T11:22:38.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722cb2a640 1 --2- 172.21.15.82:0/2020675669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72280ca5a0 0x7f722815e750 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f7218009870 tx=0x7f721801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381d00bd8fc3ec22 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f721ffff640 1 -- 172.21.15.82:0/2020675669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180aa5f0 con 0x7f72280ca5a0 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f721ffff640 1 -- 172.21.15.82:0/2020675669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72180aa750 con 0x7f72280ca5a0 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f721ffff640 1 -- 172.21.15.82:0/2020675669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180aaae0 con 0x7f72280ca5a0 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 -- 172.21.15.82:0/2020675669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72280ca5a0 msgr2=0x7f722815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 --2- 172.21.15.82:0/2020675669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72280ca5a0 0x7f722815e750 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f7218009870 tx=0x7f721801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 -- 172.21.15.82:0/2020675669 shutdown_connections 2023-07-20T11:22:38.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 --2- 172.21.15.82:0/2020675669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72280ca5a0 0x7f722815e750 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 --2- 172.21.15.82:0/2020675669 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f722806faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 -- 172.21.15.82:0/2020675669 >> 172.21.15.82:0/2020675669 conn(0x7f72280cad50 msgr2=0x7f72280cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:38.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 -- 172.21.15.82:0/2020675669 shutdown_connections 2023-07-20T11:22:38.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.390+0000 7f722f58f640 1 -- 172.21.15.82:0/2020675669 wait complete. 2023-07-20T11:22:38.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 Processor -- start 2023-07-20T11:22:38.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- start start 2023-07-20T11:22:38.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f72280af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72280ca5a0 0x7f722814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722814f9b0 con 0x7f722815ec90 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c5740 con 0x7f72280ca5a0 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c5a20 con 0x7f722806f710 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42012/0 (socket says 172.21.15.82:42012) 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 -- 172.21.15.82:0/3515800228 learned_addr learned my addr 172.21.15.82:0/3515800228 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722d32b640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f72280af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722cb2a640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72280ca5a0 0x7f722814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 -- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 msgr2=0x7f72280af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f72280af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 -- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72280ca5a0 msgr2=0x7f722814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72280ca5a0 0x7f722814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:38.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 -- 172.21.15.82:0/3515800228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180094d0 con 0x7f722815ec90 2023-07-20T11:22:38.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722db2c640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f722000b990 tx=0x7f722000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722000cba0 con 0x7f722815ec90 2023-07-20T11:22:38.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722000cd00 con 0x7f722815ec90 2023-07-20T11:22:38.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72280c5d00 con 0x7f722815ec90 2023-07-20T11:22:38.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220014680 con 0x7f722815ec90 2023-07-20T11:22:38.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72280c62c0 con 0x7f722815ec90 2023-07-20T11:22:38.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.394+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722804da30 con 0x7f722815ec90 2023-07-20T11:22:38.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.398+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f722001d3b0 con 0x7f722815ec90 2023-07-20T11:22:38.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.398+0000 7f721dffb640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 0x7f720c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:38.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.398+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f7220083b20 con 0x7f722815ec90 2023-07-20T11:22:38.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.398+0000 7f722d32b640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 0x7f720c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:38.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.398+0000 7f722d32b640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 0x7f720c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7224009990 tx=0x7f7224009110 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:38.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.402+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72200511a0 con 0x7f722815ec90 2023-07-20T11:22:38.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:38.554+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f72280cb940 con 0x7f722815ec90 2023-07-20T11:22:39.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.526+0000 7f721dffb640 1 -- 172.21.15.82:0/3515800228 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v188) v1 ==== 138+0+0 (secure 0 0 0) 0x7f72200190b0 con 0x7f722815ec90 2023-07-20T11:22:39.519 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T11:22:39.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 msgr2=0x7f720c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 0x7f720c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7224009990 tx=0x7f7224009110 comp rx=0 tx=0).stop 2023-07-20T11:22:39.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 msgr2=0x7f7228151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.525 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f722000b990 tx=0x7f722000be50 comp rx=0 tx=0).stop 2023-07-20T11:22:39.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 shutdown_connections 2023-07-20T11:22:39.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f720c0663a0 0x7f720c068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722815ec90 0x7f7228151290 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f72280ca5a0 0x7f722814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 --2- 172.21.15.82:0/3515800228 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f722806f710 0x7f72280af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 >> 172.21.15.82:0/3515800228 conn(0x7f72280cad50 msgr2=0x7f72280cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:39.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 shutdown_connections 2023-07-20T11:22:39.527 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.534+0000 7f722f58f640 1 -- 172.21.15.82:0/3515800228 wait complete. 2023-07-20T11:22:39.550 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T11:22:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.706+0000 7f70ddfc5640 1 Processor -- start 2023-07-20T11:22:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.706+0000 7f70ddfc5640 1 -- start start 2023-07-20T11:22:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70ddfc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70d815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70ddfc5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80cc8d0 con 0x7f70d8159830 2023-07-20T11:22:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70ddfc5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80ccbb0 con 0x7f70d80afd50 2023-07-20T11:22:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70ddfc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80cce90 con 0x7f70d8159450 2023-07-20T11:22:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f70d8159830 0x7f70d80cbea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53464/0 (socket says 172.21.15.82:53464) 2023-07-20T11:22:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d6ffd640 1 -- 172.21.15.82:0/1528127070 learned_addr learned my addr 172.21.15.82:0/1528127070 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:39.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87450485 0 0) 0x7f70d80cc8d0 con 0x7f70d8159830 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c0005740 con 0x7f70d8159830 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70d815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 110055383 0 0) 0x7f70c0005740 con 0x7f70d8159830 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 msgr2=0x7f70d815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70d815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 >> v1:172.21.15.183:6789/0 conn(0x7f70d80afd50 legacy=0x7f70d815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8159cc0 con 0x7f70d8159830 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f70cc001680 con 0x7f70d8159830 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 >> v1:172.21.15.82:6789/0 conn(0x7f70d8159830 legacy=0x7f70d80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c0005c30 0x7f70c0006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c00069e0 0x7f70c0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70c00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80cce90 con 0x7f70c0005c30 2023-07-20T11:22:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c000dca0 con 0x7f70c00069e0 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c000de60 con 0x7f70d8159450 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c0005c30 0x7f70c0006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d6ffd640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c00069e0 0x7f70c0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d7fff640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70c00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 -- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 msgr2=0x7f70c00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70c00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 -- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c00069e0 msgr2=0x7f70c0006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c00069e0 0x7f70c0006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d77fe640 1 -- 172.21.15.82:0/1528127070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0005740 con 0x7f70c0005c30 2023-07-20T11:22:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.710+0000 7f70d7fff640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d8159450 0x7f70c00073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70d77fe640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c0005c30 0x7f70c0006050 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009ae0 tx=0x7f70c801d480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97454cc0305117db server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a6440 con 0x7f70c0005c30 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c80a65a0 con 0x7f70c0005c30 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70d67fc640 1 -- 172.21.15.82:0/1528127070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a6950 con 0x7f70c0005c30 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 -- 172.21.15.82:0/1528127070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c0005c30 msgr2=0x7f70c0006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/1528127070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70c0005c30 0x7f70c0006050 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009ae0 tx=0x7f70c801d480 comp rx=0 tx=0).stop 2023-07-20T11:22:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70d7fff640 1 -- 172.21.15.82:0/1528127070 reap_dead start 2023-07-20T11:22:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 -- 172.21.15.82:0/1528127070 shutdown_connections 2023-07-20T11:22:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 -- 172.21.15.82:0/1528127070 >> 172.21.15.82:0/1528127070 conn(0x7f70d80cad50 msgr2=0x7f70d80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 -- 172.21.15.82:0/1528127070 shutdown_connections 2023-07-20T11:22:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.714+0000 7f70ddfc5640 1 -- 172.21.15.82:0/1528127070 wait complete. 2023-07-20T11:22:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 Processor -- start 2023-07-20T11:22:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- start start 2023-07-20T11:22:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c0005c30 0x7f70d8155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d81f11e0 0x7f70d80ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d8156130 con 0x7f70d80b35b0 2023-07-20T11:22:39.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81f4bc0 con 0x7f70c0005c30 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d81f1aa0 con 0x7f70d81f11e0 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42044/0 (socket says 172.21.15.82:42044) 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 -- 172.21.15.82:0/3518035463 learned_addr learned my addr 172.21.15.82:0/3518035463 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d77fe640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c0005c30 0x7f70d8155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d7fff640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d81f11e0 0x7f70d80ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 -- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d81f11e0 msgr2=0x7f70d80ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d81f11e0 0x7f70d80ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 -- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c0005c30 msgr2=0x7f70d8155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c0005c30 0x7f70d8155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 -- 172.21.15.82:0/3518035463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80b06f0 con 0x7f70d80b35b0 2023-07-20T11:22:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70d6ffd640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0017b0 tx=0x7f70cc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00ee60 con 0x7f70d80b35b0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc00c870 con 0x7f70d80b35b0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00cc20 con 0x7f70d80b35b0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d81f1d80 con 0x7f70d80b35b0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.718+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d81f4850 con 0x7f70d80b35b0 2023-07-20T11:22:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.722+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d804da30 con 0x7f70d80b35b0 2023-07-20T11:22:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.722+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f70cc01d460 con 0x7f70d80b35b0 2023-07-20T11:22:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.722+0000 7f70bffff640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 0x7f70c4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.722+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5652+0+0 (secure 0 0 0) 0x7f70cc0845b0 con 0x7f70d80b35b0 2023-07-20T11:22:39.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.722+0000 7f70d77fe640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 0x7f70c4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.726+0000 7f70d77fe640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 0x7f70c4068890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f70c80ac000 tx=0x7f70c80b1040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.726+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70cc051b90 con 0x7f70d80b35b0 2023-07-20T11:22:39.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:39.874+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f70d81f4d00 con 0x7f70d80b35b0 2023-07-20T11:22:40.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.542+0000 7f70bffff640 1 -- 172.21.15.82:0/3518035463 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v189) v1 ==== 170+0+0 (secure 0 0 0) 0x7f70cc0551b0 con 0x7f70d80b35b0 2023-07-20T11:22:40.542 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T11:22:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 msgr2=0x7f70c4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 0x7f70c4068890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f70c80ac000 tx=0x7f70c80b1040 comp rx=0 tx=0).stop 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 msgr2=0x7f70d81f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0017b0 tx=0x7f70cc00ec10 comp rx=0 tx=0).stop 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 shutdown_connections 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f70d81f11e0 0x7f70d80ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f70c40663d0 0x7f70c4068890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70d80b35b0 0x7f70d81f5050 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 --2- 172.21.15.82:0/3518035463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70c0005c30 0x7f70d8155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 >> 172.21.15.82:0/3518035463 conn(0x7f70d80cad50 msgr2=0x7f70d806bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:40.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 shutdown_connections 2023-07-20T11:22:40.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.558+0000 7f70ddfc5640 1 -- 172.21.15.82:0/3518035463 wait complete. 2023-07-20T11:22:40.571 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T11:22:40.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 Processor -- start 2023-07-20T11:22:40.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 -- start start 2023-07-20T11:22:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8eec06f710 0x7f8eec06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8eec0ca5a0 0x7f8eec15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eec070030 con 0x7f8eec15ec90 2023-07-20T11:22:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eec15bad0 con 0x7f8eec06f710 2023-07-20T11:22:40.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ef1296640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eec071950 con 0x7f8eec0ca5a0 2023-07-20T11:22:40.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeaffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8eec06f710 0x7f8eec06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeb7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8eec15ec90 0x7f8eec15a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53470/0 (socket says 172.21.15.82:53470) 2023-07-20T11:22:40.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeb7fe640 1 -- 172.21.15.82:0/804035548 learned_addr learned my addr 172.21.15.82:0/804035548 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8ee27fc640 1 --2- 172.21.15.82:0/804035548 >> v2:172.21.15.183:3300/0 conn(0x7f8eec0ca5a0 0x7f8eec15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeaffd640 1 -- 172.21.15.82:0/804035548 >> v2:172.21.15.183:3300/0 conn(0x7f8eec0ca5a0 msgr2=0x7f8eec15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeaffd640 1 --2- 172.21.15.82:0/804035548 >> v2:172.21.15.183:3300/0 conn(0x7f8eec0ca5a0 0x7f8eec15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeaffd640 1 -- 172.21.15.82:0/804035548 >> v1:172.21.15.82:6789/0 conn(0x7f8eec15ec90 legacy=0x7f8eec15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eeaffd640 1 -- 172.21.15.82:0/804035548 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec15b230 con 0x7f8eec06f710 2023-07-20T11:22:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.722+0000 7f8eea7fc640 1 -- 172.21.15.82:0/804035548 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434682310 0 0) 0x7f8eec070030 con 0x7f8eec15ec90 2023-07-20T11:22:40.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8eeaffd640 1 --2- 172.21.15.82:0/804035548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec06faf0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0702d0 tx=0x7f8edc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc1a713087cc97b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8eea7fc640 1 -- 172.21.15.82:0/804035548 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0a58b0 con 0x7f8eec06f710 2023-07-20T11:22:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8eea7fc640 1 -- 172.21.15.82:0/804035548 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc0a5a10 con 0x7f8eec06f710 2023-07-20T11:22:40.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8eea7fc640 1 -- 172.21.15.82:0/804035548 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0a5da0 con 0x7f8eec06f710 2023-07-20T11:22:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 -- 172.21.15.82:0/804035548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 msgr2=0x7f8eec06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 --2- 172.21.15.82:0/804035548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec06faf0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0702d0 tx=0x7f8edc01c8e0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 -- 172.21.15.82:0/804035548 shutdown_connections 2023-07-20T11:22:40.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 --2- 172.21.15.82:0/804035548 >> v2:172.21.15.183:3300/0 conn(0x7f8eec0ca5a0 0x7f8eec15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 --2- 172.21.15.82:0/804035548 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec06faf0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 -- 172.21.15.82:0/804035548 >> 172.21.15.82:0/804035548 conn(0x7f8eec0cad50 msgr2=0x7f8eec0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 -- 172.21.15.82:0/804035548 shutdown_connections 2023-07-20T11:22:40.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.726+0000 7f8ef1296640 1 -- 172.21.15.82:0/804035548 wait complete. 2023-07-20T11:22:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 Processor -- start 2023-07-20T11:22:40.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- start start 2023-07-20T11:22:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0ca5a0 0x7f8eec1f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec15ec90 0x7f8eec1f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0cc060 con 0x7f8eec06f710 2023-07-20T11:22:40.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0cc340 con 0x7f8eec0ca5a0 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eec0cc620 con 0x7f8eec15ec90 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42050/0 (socket says 172.21.15.82:42050) 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 -- 172.21.15.82:0/4067837501 learned_addr learned my addr 172.21.15.82:0/4067837501 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeb7fe640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec15ec90 0x7f8eec1f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ee27fc640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0ca5a0 0x7f8eec1f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 -- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec15ec90 msgr2=0x7f8eec1f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec15ec90 0x7f8eec1f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 -- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0ca5a0 msgr2=0x7f8eec1f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0ca5a0 0x7f8eec1f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:40.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 -- 172.21.15.82:0/4067837501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc009a70 con 0x7f8eec06f710 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8eeaffd640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8edc000f90 tx=0x7f8edc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0a58b0 con 0x7f8eec06f710 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc0ad650 con 0x7f8eec06f710 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0ada00 con 0x7f8eec06f710 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec0cc900 con 0x7f8eec06f710 2023-07-20T11:22:40.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.730+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eec0c5e30 con 0x7f8eec06f710 2023-07-20T11:22:40.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eec04da30 con 0x7f8eec06f710 2023-07-20T11:22:40.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8edc0adb60 con 0x7f8eec06f710 2023-07-20T11:22:40.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ee3fff640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 0x7f8ecc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:40.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f8edc11f350 con 0x7f8eec06f710 2023-07-20T11:22:40.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ee27fc640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 0x7f8ecc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:40.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.734+0000 7f8ee27fc640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 0x7f8ecc068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8eec15da10 tx=0x7f8ed4008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:40.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.738+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8edc0ec840 con 0x7f8eec06f710 2023-07-20T11:22:40.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:40.914+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8eec0ccdb0 con 0x7f8eec06f710 2023-07-20T11:22:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.566+0000 7f8ee3fff640 1 -- 172.21.15.82:0/4067837501 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v87) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8edc0efe60 con 0x7f8eec06f710 2023-07-20T11:22:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 23 and data pool 24 2023-07-20T11:22:41.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.574+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 msgr2=0x7f8ecc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.574+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 0x7f8ecc068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8eec15da10 tx=0x7f8ed4008040 comp rx=0 tx=0).stop 2023-07-20T11:22:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 msgr2=0x7f8eec0c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8edc000f90 tx=0x7f8edc019680 comp rx=0 tx=0).stop 2023-07-20T11:22:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 shutdown_connections 2023-07-20T11:22:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8eec15ec90 0x7f8eec1f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8eec0ca5a0 0x7f8eec1f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f8ecc0663a0 0x7f8ecc068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 --2- 172.21.15.82:0/4067837501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eec06f710 0x7f8eec0c58f0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 >> 172.21.15.82:0/4067837501 conn(0x7f8eec0cad50 msgr2=0x7f8eec0ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:41.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 shutdown_connections 2023-07-20T11:22:41.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.578+0000 7f8ef1296640 1 -- 172.21.15.82:0/4067837501 wait complete. 2023-07-20T11:22:41.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:41.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.738+0000 7f11e3d40640 1 Processor -- start 2023-07-20T11:22:41.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.738+0000 7f11e3d40640 1 -- start start 2023-07-20T11:22:41.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e3d40640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11dc160bc0 0x7f11dc06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e3d40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e3d40640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc0cc560 con 0x7f11dc06c700 2023-07-20T11:22:41.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e3d40640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc0ad7e0 con 0x7f11dc160bc0 2023-07-20T11:22:41.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e3d40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0cc790 con 0x7f11dc160fa0 2023-07-20T11:22:41.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11dc160bc0 0x7f11dc06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f11dc160bc0 0x7f11dc06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42064/0 (socket says 172.21.15.82:42064) 2023-07-20T11:22:41.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 -- 172.21.15.82:0/1274406346 learned_addr learned my addr 172.21.15.82:0/1274406346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e12db640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 -- 172.21.15.82:0/1274406346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 msgr2=0x7f11dc0c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc0c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 -- 172.21.15.82:0/1274406346 >> v1:172.21.15.82:6789/0 conn(0x7f11dc06c700 legacy=0x7f11dc0aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e1adc640 1 -- 172.21.15.82:0/1274406346 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0cca70 con 0x7f11dc160bc0 2023-07-20T11:22:41.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.742+0000 7f11e0ada640 1 -- 172.21.15.82:0/1274406346 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119602312 0 0) 0x7f11dc0cc560 con 0x7f11dc06c700 2023-07-20T11:22:41.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e1adc640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc160bc0 0x7f11dc06c1c0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009870 tx=0x7f11d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56197da4eeab1f9c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e0ada640 1 -- 172.21.15.82:0/1274406346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80ab680 con 0x7f11dc160bc0 2023-07-20T11:22:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e0ada640 1 -- 172.21.15.82:0/1274406346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d80ab7e0 con 0x7f11dc160bc0 2023-07-20T11:22:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e0ada640 1 -- 172.21.15.82:0/1274406346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80abb70 con 0x7f11dc160bc0 2023-07-20T11:22:41.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- 172.21.15.82:0/1274406346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc160bc0 msgr2=0x7f11dc06c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc160bc0 0x7f11dc06c1c0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f11d8009870 tx=0x7f11d801c480 comp rx=0 tx=0).stop 2023-07-20T11:22:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- 172.21.15.82:0/1274406346 shutdown_connections 2023-07-20T11:22:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc0c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1274406346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc160bc0 0x7f11dc06c1c0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- 172.21.15.82:0/1274406346 >> 172.21.15.82:0/1274406346 conn(0x7f11dc0cada0 msgr2=0x7f11dc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- 172.21.15.82:0/1274406346 shutdown_connections 2023-07-20T11:22:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- 172.21.15.82:0/1274406346 wait complete. 2023-07-20T11:22:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 Processor -- start 2023-07-20T11:22:41.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 -- start start 2023-07-20T11:22:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.746+0000 7f11e3d40640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 0x7f11dc070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc156990 con 0x7f11dc06c700 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15f5c0 con 0x7f11dc160bc0 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc156be0 con 0x7f11dc160fa0 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42068/0 (socket says 172.21.15.82:42068) 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 -- 172.21.15.82:0/1929940097 learned_addr learned my addr 172.21.15.82:0/1929940097 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e12db640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 0x7f11dc070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e22dd640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 -- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 msgr2=0x7f11dc157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 -- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 msgr2=0x7f11dc070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 0x7f11dc070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 -- 172.21.15.82:0/1929940097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80094d0 con 0x7f11dc06c700 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e22dd640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e12db640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 0x7f11dc070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:41.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e1adc640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f11d801ab30 tx=0x7f11d801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:41.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80b4800 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d80b4980 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc156ec0 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80b4d30 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc157880 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc157100 con 0x7f11dc06c700 2023-07-20T11:22:41.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.750+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11d80c7390 con 0x7f11dc06c700 2023-07-20T11:22:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.754+0000 7f11d27fc640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 0x7f11c0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.754+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f11d811edb0 con 0x7f11dc06c700 2023-07-20T11:22:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.754+0000 7f11e12db640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 0x7f11c0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.754+0000 7f11e12db640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 0x7f11c0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f11dc15e5b0 tx=0x7f11cc008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:41.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.758+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11dc157100 con 0x7f11dc06c700 2023-07-20T11:22:41.895 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.902+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11dc157400 con 0x7f11dc06c700 2023-07-20T11:22:41.896 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11d27fc640 1 -- 172.21.15.82:0/1929940097 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18397 (secure 0 0 0) 0x7f11dc157400 con 0x7f11dc06c700 2023-07-20T11:22:41.897 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:41.897 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":190,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:40.919973+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:41.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 msgr2=0x7f11c0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 0x7f11c0068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f11dc15e5b0 tx=0x7f11cc008040 comp rx=0 tx=0).stop 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 msgr2=0x7f11dc154a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f11d801ab30 tx=0x7f11d801acc0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 shutdown_connections 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f11dc160fa0 0x7f11dc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11dc160bc0 0x7f11dc070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f11c00663a0 0x7f11c0068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 --2- 172.21.15.82:0/1929940097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f11dc06c700 0x7f11dc154a60 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 >> 172.21.15.82:0/1929940097 conn(0x7f11dc0cada0 msgr2=0x7f11dc15cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 shutdown_connections 2023-07-20T11:22:41.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:41.906+0000 7f11e3d40640 1 -- 172.21.15.82:0/1929940097 wait complete. 2023-07-20T11:22:41.917 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 Processor -- start 2023-07-20T11:22:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 -- start start 2023-07-20T11:22:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07c80cc900 0x7f07c80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c80ccd60 con 0x7f07c80b2380 2023-07-20T11:22:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c80ad600 con 0x7f07c80cc900 2023-07-20T11:22:42.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07ccd11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80ad810 con 0x7f07c81596b0 2023-07-20T11:22:42.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07c80cc900 0x7f07c80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f07c80cc900 0x7f07c80ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:47662/0 (socket says 172.21.15.82:47662) 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 -- 172.21.15.82:0/120512304 learned_addr learned my addr 172.21.15.82:0/120512304 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c659c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:58672/0 (socket says 172.21.15.82:58672) 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c6d9d640 1 --1- 172.21.15.82:0/120512304 >> v1:172.21.15.183:6789/0 conn(0x7f07c80b2380 0x7f07c80c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34220/0 (socket says 172.21.15.82:34220) 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 -- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 msgr2=0x7f07c815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 --2- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 -- 172.21.15.82:0/120512304 >> v1:172.21.15.183:6789/0 conn(0x7f07c80b2380 legacy=0x7f07c80c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c5d9b640 1 -- 172.21.15.82:0/120512304 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c815d0d0 con 0x7f07c80cc900 2023-07-20T11:22:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.066+0000 7f07c559a640 1 -- 172.21.15.82:0/120512304 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283961488 0 0) 0x7f07c80ccd60 con 0x7f07c80b2380 2023-07-20T11:22:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07c5d9b640 1 --2- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80cc900 0x7f07c80ad0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6849223d91ab117e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07c559a640 1 -- 172.21.15.82:0/120512304 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0aa670 con 0x7f07c80cc900 2023-07-20T11:22:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07c559a640 1 -- 172.21.15.82:0/120512304 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0aa7d0 con 0x7f07c80cc900 2023-07-20T11:22:42.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07c559a640 1 -- 172.21.15.82:0/120512304 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0aab60 con 0x7f07c80cc900 2023-07-20T11:22:42.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 -- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80cc900 msgr2=0x7f07c80ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 --2- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80cc900 0x7f07c80ad0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01c510 comp rx=0 tx=0).stop 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 -- 172.21.15.82:0/120512304 shutdown_connections 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 --2- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80cc900 0x7f07c80ad0c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 --2- 172.21.15.82:0/120512304 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 -- 172.21.15.82:0/120512304 >> 172.21.15.82:0/120512304 conn(0x7f07c80cada0 msgr2=0x7f07c80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 -- 172.21.15.82:0/120512304 shutdown_connections 2023-07-20T11:22:42.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.070+0000 7f07ccd11640 1 -- 172.21.15.82:0/120512304 wait complete. 2023-07-20T11:22:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 Processor -- start 2023-07-20T11:22:42.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- start start 2023-07-20T11:22:42.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80b2380 0x7f07c80c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c8162a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8152f10 con 0x7f07c80cc900 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80c4010 con 0x7f07c80b2380 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8070590 con 0x7f07c81596b0 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42072/0 (socket says 172.21.15.82:42072) 2023-07-20T11:22:42.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 -- 172.21.15.82:0/1315160495 learned_addr learned my addr 172.21.15.82:0/1315160495 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c659c640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80b2380 0x7f07c80c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c6d9d640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c8162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 -- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 msgr2=0x7f07c8162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c8162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 -- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80b2380 msgr2=0x7f07c80c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80b2380 0x7f07c80c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 -- 172.21.15.82:0/1315160495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0094d0 con 0x7f07c80cc900 2023-07-20T11:22:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c6d9d640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c8162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07c5d9b640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f07bc01a140 tx=0x7f07bc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0bd5f0 con 0x7f07c80cc900 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0bd770 con 0x7f07c80cc900 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0bdb20 con 0x7f07c80cc900 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c8070870 con 0x7f07c80cc900 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.074+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c806f860 con 0x7f07c80cc900 2023-07-20T11:22:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c8070d20 con 0x7f07c80cc900 2023-07-20T11:22:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f07bc0b3600 con 0x7f07c80cc900 2023-07-20T11:22:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07b6ffd640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 0x7f07a8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f07bc11efc0 con 0x7f07c80cc900 2023-07-20T11:22:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07c659c640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 0x7f07a8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.078+0000 7f07c659c640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 0x7f07a8068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009b60 tx=0x7f07b8009190 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.082+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07bc0ec280 con 0x7f07c80cc900 2023-07-20T11:22:42.222 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.230+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07c8073c70 con 0x7f07c80cc900 2023-07-20T11:22:42.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07b6ffd640 1 -- 172.21.15.82:0/1315160495 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18397 (secure 0 0 0) 0x7f07bc0ef8a0 con 0x7f07c80cc900 2023-07-20T11:22:42.224 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:42.224 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":190,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:40.919973+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 msgr2=0x7f07a8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 0x7f07a8068890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009b60 tx=0x7f07b8009190 comp rx=0 tx=0).stop 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 msgr2=0x7f07c8162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f07bc01a140 tx=0x7f07bc01ad50 comp rx=0 tx=0).stop 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 shutdown_connections 2023-07-20T11:22:42.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f07c81596b0 0x7f07c8162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f07a80663d0 0x7f07a8068890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07c80cc900 0x7f07c8162550 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 --2- 172.21.15.82:0/1315160495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c80b2380 0x7f07c80c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 >> 172.21.15.82:0/1315160495 conn(0x7f07c80cada0 msgr2=0x7f07c8155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 shutdown_connections 2023-07-20T11:22:42.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.234+0000 7f07ccd11640 1 -- 172.21.15.82:0/1315160495 wait complete. 2023-07-20T11:22:42.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T11:22:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 Processor -- start 2023-07-20T11:22:42.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 -- start start 2023-07-20T11:22:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcbdc15fb70 0x7fcbdc0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc15ff50 con 0x7fcbdc0b44d0 2023-07-20T11:22:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0d0f90 con 0x7fcbdc0d0970 2023-07-20T11:22:42.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe2341640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b4960 con 0x7fcbdc15fb70 2023-07-20T11:22:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe0b3e640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcbdc0b44d0 0x7fcbdc0d0260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:53482/0 (socket says 172.21.15.82:53482) 2023-07-20T11:22:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe0b3e640 1 -- 172.21.15.82:0/2067037207 learned_addr learned my addr 172.21.15.82:0/2067037207 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe133f640 1 --2- 172.21.15.82:0/2067037207 >> v2:172.21.15.183:3300/0 conn(0x7fcbdc15fb70 0x7fcbdc0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbd3fff640 1 -- 172.21.15.82:0/2067037207 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382737587 0 0) 0x7fcbdc15ff50 con 0x7fcbdc0b44d0 2023-07-20T11:22:42.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbd3fff640 1 -- 172.21.15.82:0/2067037207 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc8003530 con 0x7fcbdc0b44d0 2023-07-20T11:22:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe133f640 1 -- 172.21.15.82:0/2067037207 >> v1:172.21.15.183:6789/0 conn(0x7fcbdc0d0970 legacy=0x7fcbdc0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe133f640 1 -- 172.21.15.82:0/2067037207 >> v1:172.21.15.82:6789/0 conn(0x7fcbdc0b44d0 legacy=0x7fcbdc0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.398+0000 7fcbe133f640 1 -- 172.21.15.82:0/2067037207 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0cd190 con 0x7fcbdc15fb70 2023-07-20T11:22:42.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe133f640 1 --2- 172.21.15.82:0/2067037207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc0b3f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80097c0 tx=0x7fcbd801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26041d07180ba36 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbd3fff640 1 -- 172.21.15.82:0/2067037207 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80ab600 con 0x7fcbdc15fb70 2023-07-20T11:22:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbd3fff640 1 -- 172.21.15.82:0/2067037207 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80a7050 con 0x7fcbdc15fb70 2023-07-20T11:22:42.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbd3fff640 1 -- 172.21.15.82:0/2067037207 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80ab980 con 0x7fcbdc15fb70 2023-07-20T11:22:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 -- 172.21.15.82:0/2067037207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc15fb70 msgr2=0x7fcbdc0b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 --2- 172.21.15.82:0/2067037207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc0b3f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80097c0 tx=0x7fcbd801c360 comp rx=0 tx=0).stop 2023-07-20T11:22:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 -- 172.21.15.82:0/2067037207 shutdown_connections 2023-07-20T11:22:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 --2- 172.21.15.82:0/2067037207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc0b3f90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 -- 172.21.15.82:0/2067037207 >> 172.21.15.82:0/2067037207 conn(0x7fcbdc065710 msgr2=0x7fcbdc065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 -- 172.21.15.82:0/2067037207 shutdown_connections 2023-07-20T11:22:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.402+0000 7fcbe2341640 1 -- 172.21.15.82:0/2067037207 wait complete. 2023-07-20T11:22:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 Processor -- start 2023-07-20T11:22:42.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- start start 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc0b44d0 0x7fcbdc15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0d0970 0x7fcbdc0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c7850 con 0x7fcbdc15fb70 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c6f50 con 0x7fcbdc0b44d0 2023-07-20T11:22:42.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc15c4e0 con 0x7fcbdc0d0970 2023-07-20T11:22:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42084/0 (socket says 172.21.15.82:42084) 2023-07-20T11:22:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 -- 172.21.15.82:0/1724975835 learned_addr learned my addr 172.21.15.82:0/1724975835 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe133f640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc0b44d0 0x7fcbdc15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe0b3e640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0d0970 0x7fcbdc0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 -- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0d0970 msgr2=0x7fcbdc0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0d0970 0x7fcbdc0c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 -- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc0b44d0 msgr2=0x7fcbdc15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc0b44d0 0x7fcbdc15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 -- 172.21.15.82:0/1724975835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009420 con 0x7fcbdc15fb70 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe1b40640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c770 tx=0x7fcbd400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003b80 con 0x7fcbdc15fb70 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4003ce0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd400aa90 con 0x7fcbdc15fb70 2023-07-20T11:22:42.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc15c7c0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.406+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc15cd80 con 0x7fcbdc15fb70 2023-07-20T11:22:42.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc0c79c0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbd400abf0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbd1ffb640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 0x7fcbc0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:42.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fcbd4083cd0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbe133f640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 0x7fcbc0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:42.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.410+0000 7fcbe133f640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 0x7fcbc0068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ad000 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:42.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.414+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbd4050fe0 con 0x7fcbdc15fb70 2023-07-20T11:22:42.500 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T11:22:42.510+0000 7f877ed89640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:22:42.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:42.598+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcbdc15cf70 con 0x7fcbdc15fb70 2023-07-20T11:22:43.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbd1ffb640 1 -- 172.21.15.82:0/1724975835 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v89) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcbd4054600 con 0x7fcbdc15fb70 2023-07-20T11:22:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 msgr2=0x7fcbc0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 0x7fcbc0068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ad000 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 msgr2=0x7fcbdc157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fcbd400c770 tx=0x7fcbd400cc30 comp rx=0 tx=0).stop 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 shutdown_connections 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fcbc00663a0 0x7fcbc0068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc15fb70 0x7fcbdc157030 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0d0970 0x7fcbdc0c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 --2- 172.21.15.82:0/1724975835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc0b44d0 0x7fcbdc15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 >> 172.21.15.82:0/1724975835 conn(0x7fcbdc065710 msgr2=0x7fcbdc0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:43.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 shutdown_connections 2023-07-20T11:22:43.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.546+0000 7fcbe2341640 1 -- 172.21.15.82:0/1724975835 wait complete. 2023-07-20T11:22:43.561 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T11:22:43.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T11:22:43.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 Processor -- start 2023-07-20T11:22:43.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 -- start start 2023-07-20T11:22:43.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0608159830 0x7f06080cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06080cc3e0 0x7f06080afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06080cc8d0 con 0x7f0608159450 2023-07-20T11:22:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080cce90 con 0x7f06080cc3e0 2023-07-20T11:22:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060f3fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080ccbb0 con 0x7f0608159830 2023-07-20T11:22:43.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06080cc3e0 0x7f06080afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f06080cc3e0 0x7f06080afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60736/0 (socket says 172.21.15.82:60736) 2023-07-20T11:22:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 -- 172.21.15.82:0/2133509178 learned_addr learned my addr 172.21.15.82:0/2133509178 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:43.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060c995640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0608159830 0x7f06080cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 -- 172.21.15.82:0/2133509178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0608159830 msgr2=0x7f06080cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0608159830 0x7f06080cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 -- 172.21.15.82:0/2133509178 >> v1:172.21.15.82:6789/0 conn(0x7f0608159450 legacy=0x7f060815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.714+0000 7f060d997640 1 -- 172.21.15.82:0/2133509178 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608159cc0 con 0x7f06080cc3e0 2023-07-20T11:22:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060d997640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080afd50 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f060001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85337be159484636 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f05fbfff640 1 -- 172.21.15.82:0/2133509178 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000a57c0 con 0x7f06080cc3e0 2023-07-20T11:22:43.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f05fbfff640 1 -- 172.21.15.82:0/2133509178 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000a5920 con 0x7f06080cc3e0 2023-07-20T11:22:43.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f05fbfff640 1 -- 172.21.15.82:0/2133509178 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000a5cb0 con 0x7f06080cc3e0 2023-07-20T11:22:43.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 -- 172.21.15.82:0/2133509178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 msgr2=0x7f06080afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080afd50 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f0600009e50 tx=0x7f060001c9e0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 -- 172.21.15.82:0/2133509178 shutdown_connections 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080afd50 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 --2- 172.21.15.82:0/2133509178 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0608159830 0x7f06080cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 -- 172.21.15.82:0/2133509178 >> 172.21.15.82:0/2133509178 conn(0x7f06080cad50 msgr2=0x7f06080cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 -- 172.21.15.82:0/2133509178 shutdown_connections 2023-07-20T11:22:43.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.718+0000 7f060f3fa640 1 -- 172.21.15.82:0/2133509178 wait complete. 2023-07-20T11:22:43.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 Processor -- start 2023-07-20T11:22:43.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 -- start start 2023-07-20T11:22:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0608159450 0x7f0608149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f060814a180 0x7f06080ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608148510 con 0x7f06080cc3e0 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0608147900 con 0x7f0608159450 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0608147be0 con 0x7f060814a180 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60740/0 (socket says 172.21.15.82:60740) 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 -- 172.21.15.82:0/1642952650 learned_addr learned my addr 172.21.15.82:0/1642952650 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060c995640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0608159450 0x7f0608149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d997640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f060814a180 0x7f06080ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 -- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f060814a180 msgr2=0x7f06080ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f060814a180 0x7f06080ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 -- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0608159450 msgr2=0x7f0608149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0608159450 0x7f0608149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 -- 172.21.15.82:0/1642952650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009b30 con 0x7f06080cc3e0 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060d196640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c450 tx=0x7f05fc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0052d0 con 0x7f06080cc3e0 2023-07-20T11:22:43.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc005450 con 0x7f06080cc3e0 2023-07-20T11:22:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc012870 con 0x7f06080cc3e0 2023-07-20T11:22:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.722+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0608147ec0 con 0x7f06080cc3e0 2023-07-20T11:22:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06080c1e00 con 0x7f06080cc3e0 2023-07-20T11:22:43.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060804da30 con 0x7f06080cc3e0 2023-07-20T11:22:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05fc0129d0 con 0x7f06080cc3e0 2023-07-20T11:22:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f05f9ffb640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 0x7f05ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f05fc0838c0 con 0x7f06080cc3e0 2023-07-20T11:22:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f060c995640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 0x7f05ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:43.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.726+0000 7f060c995640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 0x7f05ec068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06081f84b0 tx=0x7f0604008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:43.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.730+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05fc050c90 con 0x7f06080cc3e0 2023-07-20T11:22:43.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:43.906+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f06080cbbf0 con 0x7f06080cc3e0 2023-07-20T11:22:44.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.558+0000 7f05f9ffb640 1 -- 172.21.15.82:0/1642952650 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v90) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05fc0542b0 con 0x7f06080cc3e0 2023-07-20T11:22:44.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 msgr2=0x7f05ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 0x7f05ec068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06081f84b0 tx=0x7f0604008040 comp rx=0 tx=0).stop 2023-07-20T11:22:44.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 msgr2=0x7f06080acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c450 tx=0x7f05fc00c910 comp rx=0 tx=0).stop 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 shutdown_connections 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f060814a180 0x7f06080ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0608159450 0x7f0608149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f05ec0663a0 0x7f05ec068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 --2- 172.21.15.82:0/1642952650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06080cc3e0 0x7f06080acd40 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 >> 172.21.15.82:0/1642952650 conn(0x7f06080cad50 msgr2=0x7f06080adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 shutdown_connections 2023-07-20T11:22:44.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.562+0000 7f060f3fa640 1 -- 172.21.15.82:0/1642952650 wait complete. 2023-07-20T11:22:44.574 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T11:22:44.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:44.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.722+0000 7f3675da3640 1 Processor -- start 2023-07-20T11:22:44.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.722+0000 7f3675da3640 1 -- start start 2023-07-20T11:22:44.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3675da3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f36700ca6b0 0x7f36700b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:44.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3675da3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700b06c0 con 0x7f367015a8e0 2023-07-20T11:22:44.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3675da3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700b12a0 con 0x7f36700afda0 2023-07-20T11:22:44.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3675da3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700b3160 con 0x7f36700ca6b0 2023-07-20T11:22:44.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3666ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f367015a8e0 0x7f36700b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51962/0 (socket says 172.21.15.82:51962) 2023-07-20T11:22:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f3666ffd640 1 -- 172.21.15.82:0/2918488804 learned_addr learned my addr 172.21.15.82:0/2918488804 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366ffff640 1 --2- 172.21.15.82:0/2918488804 >> v2:172.21.15.183:3300/0 conn(0x7f36700ca6b0 0x7f36700b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161693360 0 0) 0x7f36700b06c0 con 0x7f367015a8e0 2023-07-20T11:22:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f365c003530 con 0x7f367015a8e0 2023-07-20T11:22:44.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945671560 0 0) 0x7f365c003530 con 0x7f367015a8e0 2023-07-20T11:22:44.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366ffff640 1 -- 172.21.15.82:0/2918488804 >> v1:172.21.15.183:6789/0 conn(0x7f36700afda0 legacy=0x7f36700b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366ffff640 1 -- 172.21.15.82:0/2918488804 >> v1:172.21.15.82:6789/0 conn(0x7f367015a8e0 legacy=0x7f36700b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.726+0000 7f366ffff640 1 -- 172.21.15.82:0/2918488804 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700b1580 con 0x7f36700ca6b0 2023-07-20T11:22:44.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f366ffff640 1 --2- 172.21.15.82:0/2918488804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f36700b0180 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3668009d90 tx=0x7f366801c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3092ef043ac8d847 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:44.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660001680 con 0x7f36700ca6b0 2023-07-20T11:22:44.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680a5510 con 0x7f36700ca6b0 2023-07-20T11:22:44.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f366effd640 1 -- 172.21.15.82:0/2918488804 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680a58a0 con 0x7f36700ca6b0 2023-07-20T11:22:44.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- 172.21.15.82:0/2918488804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 msgr2=0x7f36700b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 --2- 172.21.15.82:0/2918488804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f36700b0180 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3668009d90 tx=0x7f366801c690 comp rx=0 tx=0).stop 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- 172.21.15.82:0/2918488804 shutdown_connections 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 --2- 172.21.15.82:0/2918488804 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f36700b0180 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- 172.21.15.82:0/2918488804 >> 172.21.15.82:0/2918488804 conn(0x7f36700cada0 msgr2=0x7f36700cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- 172.21.15.82:0/2918488804 shutdown_connections 2023-07-20T11:22:44.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- 172.21.15.82:0/2918488804 wait complete. 2023-07-20T11:22:44.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 Processor -- start 2023-07-20T11:22:44.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.730+0000 7f3675da3640 1 -- start start 2023-07-20T11:22:44.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f367006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 0x7f367015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36701583a0 con 0x7f36700afda0 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367015da40 con 0x7f36700ca6b0 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36700c53f0 con 0x7f367015a8e0 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:44.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60742/0 (socket says 172.21.15.82:60742) 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 -- 172.21.15.82:0/1626415284 learned_addr learned my addr 172.21.15.82:0/1626415284 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3666ffd640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f367006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366ffff640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 0x7f367015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 -- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 msgr2=0x7f367015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 0x7f367015ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 -- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 msgr2=0x7f367006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f367006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 -- 172.21.15.82:0/1626415284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009a70 con 0x7f36700afda0 2023-07-20T11:22:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366ffff640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 0x7f367015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:44.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366f7fe640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f365800c500 tx=0x7f365800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658003600 con 0x7f36700afda0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3658003760 con 0x7f36700afda0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3658003b10 con 0x7f36700afda0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36700c56d0 con 0x7f36700afda0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36700c5c90 con 0x7f36700afda0 2023-07-20T11:22:44.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.734+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36700c5ea0 con 0x7f36700afda0 2023-07-20T11:22:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.738+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3658003c70 con 0x7f36700afda0 2023-07-20T11:22:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.738+0000 7f366cff9640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 0x7f3650068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.738+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f36580834a0 con 0x7f36700afda0 2023-07-20T11:22:44.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.738+0000 7f3666ffd640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 0x7f3650068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:44.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.738+0000 7f3666ffd640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 0x7f3650068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f367015bd50 tx=0x7f3660001d70 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:44.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.742+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3658050900 con 0x7f36700afda0 2023-07-20T11:22:44.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.918+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3670073c70 con 0x7f36700afda0 2023-07-20T11:22:44.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.918+0000 7f366cff9640 1 -- 172.21.15.82:0/1626415284 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f3658053f20 con 0x7f36700afda0 2023-07-20T11:22:44.911 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:44.912 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:22:44.912 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:22:44.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 msgr2=0x7f3650068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 0x7f3650068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f367015bd50 tx=0x7f3660001d70 comp rx=0 tx=0).stop 2023-07-20T11:22:44.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 msgr2=0x7f367006c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f365800c500 tx=0x7f365800c9c0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 shutdown_connections 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f367015a8e0 0x7f367015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f36700ca6b0 0x7f367006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f36500663a0 0x7f3650068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 --2- 172.21.15.82:0/1626415284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36700afda0 0x7f367006c4d0 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 >> 172.21.15.82:0/1626415284 conn(0x7f36700cada0 msgr2=0x7f367006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 shutdown_connections 2023-07-20T11:22:44.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:44.922+0000 7f3675da3640 1 -- 172.21.15.82:0/1626415284 wait complete. 2023-07-20T11:22:44.932 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:22:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.078+0000 7f7e9ef37640 1 Processor -- start 2023-07-20T11:22:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 -- start start 2023-07-20T11:22:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e980ad060 0x7f7e9815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e980b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980cde70 con 0x7f7e980ca040 2023-07-20T11:22:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980cbef0 con 0x7f7e980ad060 2023-07-20T11:22:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9ef37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980ca420 con 0x7f7e980b1170 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e980ad060 0x7f7e9815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7e980ad060 0x7f7e9815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:59914/0 (socket says 172.21.15.82:59914) 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 -- 172.21.15.82:0/635078537 learned_addr learned my addr 172.21.15.82:0/635078537 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e9d4d4640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e980b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 -- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 msgr2=0x7f7e980b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e980b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 -- 172.21.15.82:0/635078537 >> v1:172.21.15.183:6789/0 conn(0x7f7e980ca040 legacy=0x7f7e9815c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.082+0000 7f7e8ffff640 1 -- 172.21.15.82:0/635078537 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980cdb40 con 0x7f7e980ad060 2023-07-20T11:22:45.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ad060 0x7f7e9815d020 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009870 tx=0x7f7e8801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7671a562674662 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e8f7fe640 1 -- 172.21.15.82:0/635078537 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880aa610 con 0x7f7e980ad060 2023-07-20T11:22:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e8f7fe640 1 -- 172.21.15.82:0/635078537 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880a6040 con 0x7f7e980ad060 2023-07-20T11:22:45.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e8f7fe640 1 -- 172.21.15.82:0/635078537 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880aa990 con 0x7f7e980ad060 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ad060 msgr2=0x7f7e9815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ad060 0x7f7e9815d020 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009870 tx=0x7f7e8801c510 comp rx=0 tx=0).stop 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- 172.21.15.82:0/635078537 shutdown_connections 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e980b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/635078537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ad060 0x7f7e9815d020 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- 172.21.15.82:0/635078537 >> 172.21.15.82:0/635078537 conn(0x7f7e980cada0 msgr2=0x7f7e980cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- 172.21.15.82:0/635078537 shutdown_connections 2023-07-20T11:22:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- 172.21.15.82:0/635078537 wait complete. 2023-07-20T11:22:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 Processor -- start 2023-07-20T11:22:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.086+0000 7f7e9ef37640 1 -- start start 2023-07-20T11:22:45.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e981653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ca040 0x7f7e980aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c7180 con 0x7f7e980ad060 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98159320 con 0x7f7e980ca040 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c6570 con 0x7f7e980b1170 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60746/0 (socket says 172.21.15.82:60746) 2023-07-20T11:22:45.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 -- 172.21.15.82:0/124177569 learned_addr learned my addr 172.21.15.82:0/124177569 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:45.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e981653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9d4d4640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ca040 0x7f7e980aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 -- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 msgr2=0x7f7e981653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e981653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 -- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ca040 msgr2=0x7f7e980aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ca040 0x7f7e980aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 -- 172.21.15.82:0/124177569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880094d0 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e981653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ccd3640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c3a0 tx=0x7f7e9400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e940052d0 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94005430 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c6850 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94007260 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c6e10 con 0x7f7e980ad060 2023-07-20T11:22:45.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.090+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e98073c70 con 0x7f7e980ad060 2023-07-20T11:22:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.094+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7e940073c0 con 0x7f7e980ad060 2023-07-20T11:22:45.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.094+0000 7f7e8d7fa640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 0x7f7e84068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.094+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7e94083200 con 0x7f7e980ad060 2023-07-20T11:22:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.094+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 0x7f7e84068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.094+0000 7f7e8ffff640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 0x7f7e84068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e880ae000 tx=0x7f7e880a7000 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.098+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e940505d0 con 0x7f7e980ad060 2023-07-20T11:22:45.206 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:22:45.209 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:22:45.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.246+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e98158fe0 con 0x7f7e980ad060 2023-07-20T11:22:45.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.246+0000 7f7e8d7fa640 1 -- 172.21.15.82:0/124177569 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18384 (secure 0 0 0) 0x7f7e94053bf0 con 0x7f7e980ad060 2023-07-20T11:22:45.240 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:45.240 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":191,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:42.537752+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:22:45.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 msgr2=0x7f7e84068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 0x7f7e84068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7e880ae000 tx=0x7f7e880a7000 comp rx=0 tx=0).stop 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 msgr2=0x7f7e98157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f7e9400c3a0 tx=0x7f7e9400c860 comp rx=0 tx=0).stop 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 shutdown_connections 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7e980ca040 0x7f7e980aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7e980b1170 0x7f7e981653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f7e840663a0 0x7f7e84068860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 --2- 172.21.15.82:0/124177569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e980ad060 0x7f7e98157f10 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 >> 172.21.15.82:0/124177569 conn(0x7f7e980cada0 msgr2=0x7f7e9806c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 shutdown_connections 2023-07-20T11:22:45.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.250+0000 7f7e9ef37640 1 -- 172.21.15.82:0/124177569 wait complete. 2023-07-20T11:22:45.261 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T11:22:45.261 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:22:45.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 Processor -- start 2023-07-20T11:22:45.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 -- start start 2023-07-20T11:22:45.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe0b40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0b40d0d10 0x7fe0b40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b40d16b0 con 0x7fe0b40cf110 2023-07-20T11:22:45.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b40d31c0 con 0x7fe0b40d0d10 2023-07-20T11:22:45.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b9337640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40b3520 con 0x7fe0b415cab0 2023-07-20T11:22:45.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0b40cf110 0x7fe0b40cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51978/0 (socket says 172.21.15.82:51978) 2023-07-20T11:22:45.447 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b37fe640 1 -- 172.21.15.82:0/1186825550 learned_addr learned my addr 172.21.15.82:0/1186825550 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:45.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b2ffd640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe0b40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/1186825550 >> v2:172.21.15.183:3300/0 conn(0x7fe0b40d0d10 0x7fe0b40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497855528 0 0) 0x7fe0b40d16b0 con 0x7fe0b40cf110 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe09c003530 con 0x7fe0b40cf110 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233063063 0 0) 0x7fe09c003530 con 0x7fe0b40cf110 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 msgr2=0x7fe0b40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe0b40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 >> v2:172.21.15.183:3300/0 conn(0x7fe0b40d0d10 msgr2=0x7fe0b40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 --2- 172.21.15.82:0/1186825550 >> v2:172.21.15.183:3300/0 conn(0x7fe0b40d0d10 0x7fe0b40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40b2910 con 0x7fe0b40cf110 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fe0ac001a00 con 0x7fe0b40cf110 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.454+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 >> v1:172.21.15.82:6789/0 conn(0x7fe0b40cf110 legacy=0x7fe0b40cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe09c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe09c003f00 0x7fe09c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe09c004d10 0x7fe09c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40b3520 con 0x7fe09c004d10 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00b990 con 0x7fe09c003f00 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c00bad0 con 0x7fe0b415cab0 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b2ffd640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe09c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe09c003f00 0x7fe09c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b37fe640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe09c004d10 0x7fe09c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 -- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 msgr2=0x7fe09c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0b415cab0 0x7fe09c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 -- 172.21.15.82:0/1186825550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe09c004d10 msgr2=0x7fe09c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe09c004d10 0x7fe09c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 -- 172.21.15.82:0/1186825550 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c003530 con 0x7fe09c003f00 2023-07-20T11:22:45.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b37fe640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe09c004d10 0x7fe09c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:45.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.458+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe09c003f00 0x7fe09c0047d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009ae0 tx=0x7fe0a801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ae854050a282be1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80a5680 con 0x7fe09c003f00 2023-07-20T11:22:45.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a80a57e0 con 0x7fe09c003f00 2023-07-20T11:22:45.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b1ffb640 1 -- 172.21.15.82:0/1186825550 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80a5b90 con 0x7fe09c003f00 2023-07-20T11:22:45.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe09c003f00 msgr2=0x7fe09c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 --2- 172.21.15.82:0/1186825550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe09c003f00 0x7fe09c0047d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009ae0 tx=0x7fe0a801ca30 comp rx=0 tx=0).stop 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b37fe640 1 -- 172.21.15.82:0/1186825550 reap_dead start 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- 172.21.15.82:0/1186825550 shutdown_connections 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- 172.21.15.82:0/1186825550 >> 172.21.15.82:0/1186825550 conn(0x7fe0b408c120 msgr2=0x7fe0b409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- 172.21.15.82:0/1186825550 shutdown_connections 2023-07-20T11:22:45.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- 172.21.15.82:0/1186825550 wait complete. 2023-07-20T11:22:45.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 Processor -- start 2023-07-20T11:22:45.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 -- start start 2023-07-20T11:22:45.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.462+0000 7fe0b9337640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe09c003f00 0x7fe0b40c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 0x7fe0b4145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4146090 con 0x7fe0b415d490 2023-07-20T11:22:45.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40cb750 con 0x7fe0b415d010 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40cabd0 con 0x7fe09c003f00 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60762/0 (socket says 172.21.15.82:60762) 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 -- 172.21.15.82:0/588793478 learned_addr learned my addr 172.21.15.82:0/588793478 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b2ffd640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe09c003f00 0x7fe0b40c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 0x7fe0b4145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 -- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe09c003f00 msgr2=0x7fe0b40c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe09c003f00 0x7fe0b40c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 -- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 msgr2=0x7fe0b4145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 0x7fe0b4145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 -- 172.21.15.82:0/588793478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b40caeb0 con 0x7fe0b415d490 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b27fc640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 0x7fe0b4145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:45.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b37fe640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4071e30 tx=0x7fe0ac007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac007ab0 con 0x7fe0b415d490 2023-07-20T11:22:45.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0133f0 con 0x7fe0b415d490 2023-07-20T11:22:45.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b40cb190 con 0x7fe0b415d490 2023-07-20T11:22:45.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0137a0 con 0x7fe0b415d490 2023-07-20T11:22:45.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b40c8d30 con 0x7fe0b415d490 2023-07-20T11:22:45.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b4073c70 con 0x7fe0b415d490 2023-07-20T11:22:45.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.466+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0ac013900 con 0x7fe0b415d490 2023-07-20T11:22:45.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.470+0000 7fe09b7fe640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 0x7fe0a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.470+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe0ac084580 con 0x7fe0b415d490 2023-07-20T11:22:45.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.470+0000 7fe0b2ffd640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 0x7fe0a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.470+0000 7fe0b2ffd640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 0x7fe0a0068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009a40 tx=0x7fe0a4008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.470+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0ac0518a0 con 0x7fe0b415d490 2023-07-20T11:22:45.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.618+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0b40b2ed0 con 0x7fe0a00663a0 2023-07-20T11:22:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.630+0000 7fe09b7fe640 1 -- 172.21.15.82:0/588793478 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299473 (secure 0 0 0) 0x7fe0a4014a90 con 0x7fe0a00663a0 2023-07-20T11:22:45.623 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:22:45.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 msgr2=0x7fe0a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 0x7fe0a0068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009a40 tx=0x7fe0a4008040 comp rx=0 tx=0).stop 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 msgr2=0x7fe0b4145b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4071e30 tx=0x7fe0ac007060 comp rx=0 tx=0).stop 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 shutdown_connections 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fe0a00663a0 0x7fe0a0068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0b415d490 0x7fe0b4145b50 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0b415d010 0x7fe0b4145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 --2- 172.21.15.82:0/588793478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe09c003f00 0x7fe0b40c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 >> 172.21.15.82:0/588793478 conn(0x7fe0b408c120 msgr2=0x7fe0b40cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 shutdown_connections 2023-07-20T11:22:45.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.634+0000 7fe0b9337640 1 -- 172.21.15.82:0/588793478 wait complete. 2023-07-20T11:22:45.643 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:22:44.427499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397992,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":378354,"kb_avail":754576728,"statfs":{"total":773094113280,"available":772686569472,"internally_reserved":0,"allocated":19996672,"data_stored":10819256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":387434584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899432"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530201+0000","last_change":"2023-07-20T11:22:39.530201+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530201+0000","last_undegraded":"2023-07-20T11:22:39.530201+0000","last_fullsized":"2023-07-20T11:22:39.530201+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533630+0000","last_change":"2023-07-20T11:22:39.533630+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533630+0000","last_undegraded":"2023-07-20T11:22:39.533630+0000","last_fullsized":"2023-07-20T11:22:39.533630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529251+0000","last_change":"2023-07-20T11:22:39.529251+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529251+0000","last_undegraded":"2023-07-20T11:22:39.529251+0000","last_fullsized":"2023-07-20T11:22:39.529251+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535495+0000","last_change":"2023-07-20T11:22:39.535495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535495+0000","last_undegraded":"2023-07-20T11:22:39.535495+0000","last_fullsized":"2023-07-20T11:22:39.535495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536989+0000","last_change":"2023-07-20T11:22:39.536989+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536989+0000","last_undegraded":"2023-07-20T11:22:39.536989+0000","last_fullsized":"2023-07-20T11:22:39.536989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533161+0000","last_change":"2023-07-20T11:22:39.533161+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533161+0000","last_undegraded":"2023-07-20T11:22:39.533161+0000","last_fullsized":"2023-07-20T11:22:39.533161+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535571+0000","last_change":"2023-07-20T11:22:39.535571+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535571+0000","last_undegraded":"2023-07-20T11:22:39.535571+0000","last_fullsized":"2023-07-20T11:22:39.535571+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535804+0000","last_change":"2023-07-20T11:22:39.535804+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535804+0000","last_undegraded":"2023-07-20T11:22:39.535804+0000","last_fullsized":"2023-07-20T11:22:39.535804+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532668+0000","last_change":"2023-07-20T11:22:39.532668+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532668+0000","last_undegraded":"2023-07-20T11:22:39.532668+0000","last_fullsized":"2023-07-20T11:22:39.532668+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536216+0000","last_change":"2023-07-20T11:22:39.536216+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536216+0000","last_undegraded":"2023-07-20T11:22:39.536216+0000","last_fullsized":"2023-07-20T11:22:39.536216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534946+0000","last_change":"2023-07-20T11:22:39.534946+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534946+0000","last_undegraded":"2023-07-20T11:22:39.534946+0000","last_fullsized":"2023-07-20T11:22:39.534946+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536572+0000","last_change":"2023-07-20T11:22:39.536572+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536572+0000","last_undegraded":"2023-07-20T11:22:39.536572+0000","last_fullsized":"2023-07-20T11:22:39.536572+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537456+0000","last_change":"2023-07-20T11:22:39.537456+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537456+0000","last_undegraded":"2023-07-20T11:22:39.537456+0000","last_fullsized":"2023-07-20T11:22:39.537456+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529238+0000","last_change":"2023-07-20T11:22:39.529238+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529238+0000","last_undegraded":"2023-07-20T11:22:39.529238+0000","last_fullsized":"2023-07-20T11:22:39.529238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532495+0000","last_change":"2023-07-20T11:22:39.532495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532495+0000","last_undegraded":"2023-07-20T11:22:39.532495+0000","last_fullsized":"2023-07-20T11:22:39.532495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535121+0000","last_change":"2023-07-20T11:22:39.535121+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535121+0000","last_undegraded":"2023-07-20T11:22:39.535121+0000","last_fullsized":"2023-07-20T11:22:39.535121+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535537+0000","last_change":"2023-07-20T11:22:39.535537+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535537+0000","last_undegraded":"2023-07-20T11:22:39.535537+0000","last_fullsized":"2023-07-20T11:22:39.535537+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533179+0000","last_change":"2023-07-20T11:22:39.533179+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533179+0000","last_undegraded":"2023-07-20T11:22:39.533179+0000","last_fullsized":"2023-07-20T11:22:39.533179+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532927+0000","last_change":"2023-07-20T11:22:39.532927+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532927+0000","last_undegraded":"2023-07-20T11:22:39.532927+0000","last_fullsized":"2023-07-20T11:22:39.532927+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532217+0000","last_change":"2023-07-20T11:22:39.532217+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532217+0000","last_undegraded":"2023-07-20T11:22:39.532217+0000","last_fullsized":"2023-07-20T11:22:39.532217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530176+0000","last_change":"2023-07-20T11:22:39.530176+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530176+0000","last_undegraded":"2023-07-20T11:22:39.530176+0000","last_fullsized":"2023-07-20T11:22:39.530176+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532539+0000","last_change":"2023-07-20T11:22:39.532539+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532539+0000","last_undegraded":"2023-07-20T11:22:39.532539+0000","last_fullsized":"2023-07-20T11:22:39.532539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529232+0000","last_change":"2023-07-20T11:22:39.529232+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529232+0000","last_undegraded":"2023-07-20T11:22:39.529232+0000","last_fullsized":"2023-07-20T11:22:39.529232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533465+0000","last_change":"2023-07-20T11:22:39.533465+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533465+0000","last_undegraded":"2023-07-20T11:22:39.533465+0000","last_fullsized":"2023-07-20T11:22:39.533465+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534419+0000","last_change":"2023-07-20T11:22:39.534419+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534419+0000","last_undegraded":"2023-07-20T11:22:39.534419+0000","last_fullsized":"2023-07-20T11:22:39.534419+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"179'304","reported_seq":1163,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536462+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:22:39.536462+0000","last_peered":"2023-07-20T11:22:39.536462+0000","last_clean":"2023-07-20T11:22:39.536462+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:22:39.536462+0000","last_undegraded":"2023-07-20T11:22:39.536462+0000","last_fullsized":"2023-07-20T11:22:39.536462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:33.931015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530507+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:22:39.530507+0000","last_peered":"2023-07-20T11:22:39.530507+0000","last_clean":"2023-07-20T11:22:39.530507+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:22:39.530507+0000","last_undegraded":"2023-07-20T11:22:39.530507+0000","last_fullsized":"2023-07-20T11:22:39.530507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:48:17.282930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530157+0000","last_change":"2023-07-20T11:22:39.530157+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530157+0000","last_undegraded":"2023-07-20T11:22:39.530157+0000","last_fullsized":"2023-07-20T11:22:39.530157+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":344,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536361+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:22:39.536361+0000","last_peered":"2023-07-20T11:22:39.536361+0000","last_clean":"2023-07-20T11:22:39.536361+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:22:39.536361+0000","last_undegraded":"2023-07-20T11:22:39.536361+0000","last_fullsized":"2023-07-20T11:22:39.536361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:30:49.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534203+0000","last_change":"2023-07-20T11:22:39.534203+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534203+0000","last_undegraded":"2023-07-20T11:22:39.534203+0000","last_fullsized":"2023-07-20T11:22:39.534203+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":373,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.531610+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:22:39.531610+0000","last_peered":"2023-07-20T11:22:39.531610+0000","last_clean":"2023-07-20T11:22:39.531610+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:22:39.531610+0000","last_undegraded":"2023-07-20T11:22:39.531610+0000","last_fullsized":"2023-07-20T11:22:39.531610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:35.749562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534757+0000","last_change":"2023-07-20T11:22:39.534757+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534757+0000","last_undegraded":"2023-07-20T11:22:39.534757+0000","last_fullsized":"2023-07-20T11:22:39.534757+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530864+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:22:39.530864+0000","last_peered":"2023-07-20T11:22:39.530864+0000","last_clean":"2023-07-20T11:22:39.530864+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:22:39.530864+0000","last_undegraded":"2023-07-20T11:22:39.530864+0000","last_fullsized":"2023-07-20T11:22:39.530864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:32.203141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529928+0000","last_change":"2023-07-20T11:22:39.529928+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529928+0000","last_undegraded":"2023-07-20T11:22:39.529928+0000","last_fullsized":"2023-07-20T11:22:39.529928+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":341,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538744+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:22:39.538744+0000","last_peered":"2023-07-20T11:22:39.538744+0000","last_clean":"2023-07-20T11:22:39.538744+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:22:39.538744+0000","last_undegraded":"2023-07-20T11:22:39.538744+0000","last_fullsized":"2023-07-20T11:22:39.538744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:28.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536426+0000","last_change":"2023-07-20T11:22:39.536426+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536426+0000","last_undegraded":"2023-07-20T11:22:39.536426+0000","last_fullsized":"2023-07-20T11:22:39.536426+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":342,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536518+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:22:39.536518+0000","last_peered":"2023-07-20T11:22:39.536518+0000","last_clean":"2023-07-20T11:22:39.536518+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:22:39.536518+0000","last_undegraded":"2023-07-20T11:22:39.536518+0000","last_fullsized":"2023-07-20T11:22:39.536518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:56.111564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537915+0000","last_change":"2023-07-20T11:22:39.537915+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537915+0000","last_undegraded":"2023-07-20T11:22:39.537915+0000","last_fullsized":"2023-07-20T11:22:39.537915+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.539487+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:22:39.539487+0000","last_peered":"2023-07-20T11:22:39.539487+0000","last_clean":"2023-07-20T11:22:39.539487+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:22:39.539487+0000","last_undegraded":"2023-07-20T11:22:39.539487+0000","last_fullsized":"2023-07-20T11:22:39.539487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:52.528048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534171+0000","last_change":"2023-07-20T11:22:39.534171+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534171+0000","last_undegraded":"2023-07-20T11:22:39.534171+0000","last_fullsized":"2023-07-20T11:22:39.534171+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538498+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:22:39.538498+0000","last_peered":"2023-07-20T11:22:39.538498+0000","last_clean":"2023-07-20T11:22:39.538498+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:22:39.538498+0000","last_undegraded":"2023-07-20T11:22:39.538498+0000","last_fullsized":"2023-07-20T11:22:39.538498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:12.359251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575949,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52040,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319800,"statfs":{"total":96636764160,"available":96583475200,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0629999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.996,"15min":1.1200000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.54000000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":1.081},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.0900000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0409999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0509999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.29899999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0349999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.0469999999999999},"last":0.876}]},{"osd":5,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96499999999999997,"5min":1.042,"15min":1.075},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0920000000000001},"last":0.81799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.623,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.077},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.95499999999999996,"15min":0.98499999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.49099999999999999},"max":{"1min":0.88,"5min":1.0389999999999999,"15min":1.1100000000000001},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.93899999999999995,"5min":1.0329999999999999,"15min":1.093},"last":0.755}]},{"osd":3,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.64600000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.02,"15min":1.0840000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.88900000000000001,"5min":0.97999999999999998,"15min":1.143},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.318},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.046},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.33600000000000002},"max":{"1min":0.89600000000000002,"5min":0.93999999999999995,"15min":1.0309999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.98999999999999999,"15min":1.0620000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.93400000000000005,"15min":1.0700000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38400000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.097},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.753},"min":{"1min":0.67100000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.48899999999999999,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.204},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.60799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.50800000000000001,"15min":0.505},"max":{"1min":0.93700000000000006,"5min":1.0169999999999999,"15min":1.071},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"max":{"1min":0.997,"5min":1.101,"15min":1.101},"last":0.752}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.036},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.85099999999999998,"5min":1,"15min":1},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":0.87,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.71299999999999997},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.39500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.1870000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.1419999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1060000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.2310000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0049999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.497,"15min":0.49399999999999999},"max":{"1min":1.026,"5min":1.034,"15min":1.1160000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":1.085,"15min":1.085},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.96799999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0720000000000001},"last":0.878}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.036},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.61599999999999999,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77100000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.498,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.313}]},{"osd":2,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74299999999999999,"5min":0.871,"15min":0.95099999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78400000000000003,"15min":0.80500000000000005},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.55800000000000005,"15min":0.503},"max":{"1min":1.194,"5min":1.242,"15min":1.369},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1779999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.68999999999999995,"5min":0.57399999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.127,"15min":1.3620000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0620000000000001,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.85699999999999998},"min":{"1min":0.70299999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.3999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.82699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.78500000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.01},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.54400000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.375},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.626,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.042,"5min":1.077,"15min":1.298},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.55100000000000005},"max":{"1min":1.131,"5min":1.131,"15min":1.2849999999999999},"last":0.745},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.044,"5min":1.179,"15min":1.476},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.503},"max":{"1min":1.1499999999999999,"5min":1.153,"15min":1.494},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82299999999999995,"15min":0.83699999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3440000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.72599999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.625},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.55400000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.4099999999999999},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37508,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334332,"statfs":{"total":96636764160,"available":96598355968,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.748},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.41999999999999998},"max":{"1min":0.68799999999999994,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.378,"5min":0.36199999999999999,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":0.753,"15min":0.753},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.83499999999999996},"last":0.434}]},{"osd":3,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":1.2050000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63700000000000001,"5min":0.72799999999999998,"15min":1.0109999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.51100000000000001,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.4790000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":0.96299999999999997,"5min":1.077,"15min":1.26},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.95299999999999996,"5min":1.1399999999999999,"15min":1.175},"last":0.755},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.4339999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.1910000000000001},"last":0.628},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.66500000000000004,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":1.0509999999999999,"5min":1.1100000000000001,"15min":1.3089999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.61599999999999999},"max":{"1min":1.002,"5min":1.1579999999999999,"15min":1.242},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.56200000000000006},"max":{"1min":0.98599999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46280,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94325560,"statfs":{"total":96636764160,"available":96589373440,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":44431627},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.254},"max":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.79900000000000004},"last":0.443},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.68000000000000005,"5min":0.79600000000000004,"15min":0.80500000000000005},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.85599999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79000000000000004},"last":1.282},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.36399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0069999999999999},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.54300000000000004,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.56699999999999995},"max":{"1min":0.96299999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84799999999999998,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.52600000000000002},"max":{"1min":1,"5min":1.379,"15min":1.379},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.84099999999999997},"min":{"1min":0.63,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1319999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.2509999999999999,"15min":1.3089999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1140000000000001,"5min":1.355,"15min":1.355},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0289999999999999,"5min":1.204,"15min":1.2589999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:22:45.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:22:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 Processor -- start 2023-07-20T11:22:45.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 -- start start 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f582015cab0 0x7f58200d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200ce4c0 0x7f58200d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58200d16b0 con 0x7f58200d0d10 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58200d31c0 con 0x7f582015cab0 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5827d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58200b3520 con 0x7f58200ce4c0 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f582015cab0 0x7f58200d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f582015cab0 0x7f58200d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:59950/0 (socket says 172.21.15.82:59950) 2023-07-20T11:22:45.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 -- 172.21.15.82:0/272804380 learned_addr learned my addr 172.21.15.82:0/272804380 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:45.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f582629d640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200ce4c0 0x7f58200d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 -- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200ce4c0 msgr2=0x7f58200d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:45.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200ce4c0 0x7f58200d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 -- 172.21.15.82:0/272804380 >> v1:172.21.15.183:6789/0 conn(0x7f58200d0d10 legacy=0x7f58200cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.834+0000 7f5825a9c640 1 -- 172.21.15.82:0/272804380 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200b2910 con 0x7f582015cab0 2023-07-20T11:22:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5825a9c640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582015cab0 0x7f58200d0300 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f581c009e50 tx=0x7f581c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d60d6a9cbd8d3fe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5824a9a640 1 -- 172.21.15.82:0/272804380 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0a57c0 con 0x7f582015cab0 2023-07-20T11:22:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5824a9a640 1 -- 172.21.15.82:0/272804380 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0a5920 con 0x7f582015cab0 2023-07-20T11:22:45.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5824a9a640 1 -- 172.21.15.82:0/272804380 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0a5cb0 con 0x7f582015cab0 2023-07-20T11:22:45.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 -- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582015cab0 msgr2=0x7f58200d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582015cab0 0x7f58200d0300 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f581c009e50 tx=0x7f581c01c9e0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 -- 172.21.15.82:0/272804380 shutdown_connections 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200ce4c0 0x7f58200d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 --2- 172.21.15.82:0/272804380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f582015cab0 0x7f58200d0300 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 -- 172.21.15.82:0/272804380 >> 172.21.15.82:0/272804380 conn(0x7f582008c120 msgr2=0x7f582009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 -- 172.21.15.82:0/272804380 shutdown_connections 2023-07-20T11:22:45.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.838+0000 7f5827d00640 1 -- 172.21.15.82:0/272804380 wait complete. 2023-07-20T11:22:45.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 Processor -- start 2023-07-20T11:22:45.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 -- start start 2023-07-20T11:22:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200d0d10 0x7f5820159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 0x7f582015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582015f980 con 0x7f582015cab0 2023-07-20T11:22:45.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5820155de0 con 0x7f58200ce4c0 2023-07-20T11:22:45.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5827d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58201f81c0 con 0x7f58200d0d10 2023-07-20T11:22:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f582629d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 0x7f582015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:59962/0 (socket says 172.21.15.82:59962) 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 -- 172.21.15.82:0/4107028869 learned_addr learned my addr 172.21.15.82:0/4107028869 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f582629d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 0x7f582015ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60770/0 (socket says 172.21.15.82:60770) 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f582529b640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200d0d10 0x7f5820159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 -- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200d0d10 msgr2=0x7f5820159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200d0d10 0x7f5820159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 -- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 msgr2=0x7f582015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 0x7f582015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 -- 172.21.15.82:0/4107028869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c009b30 con 0x7f58200ce4c0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.842+0000 7f5825a9c640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f581c01a610 tx=0x7f581c019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0bd070 con 0x7f58200ce4c0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0b8470 con 0x7f58200ce4c0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0b8840 con 0x7f58200ce4c0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58201f84a0 con 0x7f58200ce4c0 2023-07-20T11:22:45.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58201f8a60 con 0x7f58200ce4c0 2023-07-20T11:22:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820073c70 con 0x7f58200ce4c0 2023-07-20T11:22:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f581c0b89a0 con 0x7f58200ce4c0 2023-07-20T11:22:45.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 0x7f5804068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f581c11f400 con 0x7f58200ce4c0 2023-07-20T11:22:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f582529b640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 0x7f5804068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.846+0000 7f582529b640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 0x7f5804068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f582006abd0 tx=0x7f5810009040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.850+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f581c0ec8d0 con 0x7f58200ce4c0 2023-07-20T11:22:45.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:45.994+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58201f8330 con 0x7f58040663a0 2023-07-20T11:22:45.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.002+0000 7f58167fc640 1 -- 172.21.15.82:0/4107028869 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299473 (secure 0 0 0) 0x7f58201f8330 con 0x7f58040663a0 2023-07-20T11:22:45.997 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:45.998 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:22:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 msgr2=0x7f5804068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 0x7f5804068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f582006abd0 tx=0x7f5810009040 comp rx=0 tx=0).stop 2023-07-20T11:22:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 msgr2=0x7f5820159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f581c01a610 tx=0x7f581c019780 comp rx=0 tx=0).stop 2023-07-20T11:22:45.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 shutdown_connections 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f58040663a0 0x7f5804068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f582015cab0 0x7f582015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f58200d0d10 0x7f5820159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 --2- 172.21.15.82:0/4107028869 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58200ce4c0 0x7f5820159030 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 >> 172.21.15.82:0/4107028869 conn(0x7f582008c120 msgr2=0x7f58200af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 shutdown_connections 2023-07-20T11:22:46.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.006+0000 7f5827d00640 1 -- 172.21.15.82:0/4107028869 wait complete. 2023-07-20T11:22:46.016 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:22:44.427499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397992,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":378354,"kb_avail":754576728,"statfs":{"total":773094113280,"available":772686569472,"internally_reserved":0,"allocated":19996672,"data_stored":10819256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":387434584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899432"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530201+0000","last_change":"2023-07-20T11:22:39.530201+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530201+0000","last_undegraded":"2023-07-20T11:22:39.530201+0000","last_fullsized":"2023-07-20T11:22:39.530201+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533630+0000","last_change":"2023-07-20T11:22:39.533630+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533630+0000","last_undegraded":"2023-07-20T11:22:39.533630+0000","last_fullsized":"2023-07-20T11:22:39.533630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529251+0000","last_change":"2023-07-20T11:22:39.529251+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529251+0000","last_undegraded":"2023-07-20T11:22:39.529251+0000","last_fullsized":"2023-07-20T11:22:39.529251+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535495+0000","last_change":"2023-07-20T11:22:39.535495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535495+0000","last_undegraded":"2023-07-20T11:22:39.535495+0000","last_fullsized":"2023-07-20T11:22:39.535495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536989+0000","last_change":"2023-07-20T11:22:39.536989+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536989+0000","last_undegraded":"2023-07-20T11:22:39.536989+0000","last_fullsized":"2023-07-20T11:22:39.536989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533161+0000","last_change":"2023-07-20T11:22:39.533161+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533161+0000","last_undegraded":"2023-07-20T11:22:39.533161+0000","last_fullsized":"2023-07-20T11:22:39.533161+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535571+0000","last_change":"2023-07-20T11:22:39.535571+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535571+0000","last_undegraded":"2023-07-20T11:22:39.535571+0000","last_fullsized":"2023-07-20T11:22:39.535571+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535804+0000","last_change":"2023-07-20T11:22:39.535804+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535804+0000","last_undegraded":"2023-07-20T11:22:39.535804+0000","last_fullsized":"2023-07-20T11:22:39.535804+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532668+0000","last_change":"2023-07-20T11:22:39.532668+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532668+0000","last_undegraded":"2023-07-20T11:22:39.532668+0000","last_fullsized":"2023-07-20T11:22:39.532668+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536216+0000","last_change":"2023-07-20T11:22:39.536216+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536216+0000","last_undegraded":"2023-07-20T11:22:39.536216+0000","last_fullsized":"2023-07-20T11:22:39.536216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534946+0000","last_change":"2023-07-20T11:22:39.534946+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534946+0000","last_undegraded":"2023-07-20T11:22:39.534946+0000","last_fullsized":"2023-07-20T11:22:39.534946+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536572+0000","last_change":"2023-07-20T11:22:39.536572+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536572+0000","last_undegraded":"2023-07-20T11:22:39.536572+0000","last_fullsized":"2023-07-20T11:22:39.536572+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537456+0000","last_change":"2023-07-20T11:22:39.537456+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537456+0000","last_undegraded":"2023-07-20T11:22:39.537456+0000","last_fullsized":"2023-07-20T11:22:39.537456+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529238+0000","last_change":"2023-07-20T11:22:39.529238+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529238+0000","last_undegraded":"2023-07-20T11:22:39.529238+0000","last_fullsized":"2023-07-20T11:22:39.529238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532495+0000","last_change":"2023-07-20T11:22:39.532495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532495+0000","last_undegraded":"2023-07-20T11:22:39.532495+0000","last_fullsized":"2023-07-20T11:22:39.532495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535121+0000","last_change":"2023-07-20T11:22:39.535121+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535121+0000","last_undegraded":"2023-07-20T11:22:39.535121+0000","last_fullsized":"2023-07-20T11:22:39.535121+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535537+0000","last_change":"2023-07-20T11:22:39.535537+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535537+0000","last_undegraded":"2023-07-20T11:22:39.535537+0000","last_fullsized":"2023-07-20T11:22:39.535537+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533179+0000","last_change":"2023-07-20T11:22:39.533179+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533179+0000","last_undegraded":"2023-07-20T11:22:39.533179+0000","last_fullsized":"2023-07-20T11:22:39.533179+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532927+0000","last_change":"2023-07-20T11:22:39.532927+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532927+0000","last_undegraded":"2023-07-20T11:22:39.532927+0000","last_fullsized":"2023-07-20T11:22:39.532927+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532217+0000","last_change":"2023-07-20T11:22:39.532217+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532217+0000","last_undegraded":"2023-07-20T11:22:39.532217+0000","last_fullsized":"2023-07-20T11:22:39.532217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530176+0000","last_change":"2023-07-20T11:22:39.530176+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530176+0000","last_undegraded":"2023-07-20T11:22:39.530176+0000","last_fullsized":"2023-07-20T11:22:39.530176+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532539+0000","last_change":"2023-07-20T11:22:39.532539+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532539+0000","last_undegraded":"2023-07-20T11:22:39.532539+0000","last_fullsized":"2023-07-20T11:22:39.532539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529232+0000","last_change":"2023-07-20T11:22:39.529232+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529232+0000","last_undegraded":"2023-07-20T11:22:39.529232+0000","last_fullsized":"2023-07-20T11:22:39.529232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533465+0000","last_change":"2023-07-20T11:22:39.533465+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533465+0000","last_undegraded":"2023-07-20T11:22:39.533465+0000","last_fullsized":"2023-07-20T11:22:39.533465+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534419+0000","last_change":"2023-07-20T11:22:39.534419+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534419+0000","last_undegraded":"2023-07-20T11:22:39.534419+0000","last_fullsized":"2023-07-20T11:22:39.534419+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"179'304","reported_seq":1163,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536462+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:22:39.536462+0000","last_peered":"2023-07-20T11:22:39.536462+0000","last_clean":"2023-07-20T11:22:39.536462+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:22:39.536462+0000","last_undegraded":"2023-07-20T11:22:39.536462+0000","last_fullsized":"2023-07-20T11:22:39.536462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:33.931015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530507+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:22:39.530507+0000","last_peered":"2023-07-20T11:22:39.530507+0000","last_clean":"2023-07-20T11:22:39.530507+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:22:39.530507+0000","last_undegraded":"2023-07-20T11:22:39.530507+0000","last_fullsized":"2023-07-20T11:22:39.530507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:48:17.282930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530157+0000","last_change":"2023-07-20T11:22:39.530157+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530157+0000","last_undegraded":"2023-07-20T11:22:39.530157+0000","last_fullsized":"2023-07-20T11:22:39.530157+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":344,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536361+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:22:39.536361+0000","last_peered":"2023-07-20T11:22:39.536361+0000","last_clean":"2023-07-20T11:22:39.536361+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:22:39.536361+0000","last_undegraded":"2023-07-20T11:22:39.536361+0000","last_fullsized":"2023-07-20T11:22:39.536361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:30:49.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534203+0000","last_change":"2023-07-20T11:22:39.534203+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534203+0000","last_undegraded":"2023-07-20T11:22:39.534203+0000","last_fullsized":"2023-07-20T11:22:39.534203+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":373,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.531610+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:22:39.531610+0000","last_peered":"2023-07-20T11:22:39.531610+0000","last_clean":"2023-07-20T11:22:39.531610+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:22:39.531610+0000","last_undegraded":"2023-07-20T11:22:39.531610+0000","last_fullsized":"2023-07-20T11:22:39.531610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:35.749562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534757+0000","last_change":"2023-07-20T11:22:39.534757+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534757+0000","last_undegraded":"2023-07-20T11:22:39.534757+0000","last_fullsized":"2023-07-20T11:22:39.534757+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530864+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:22:39.530864+0000","last_peered":"2023-07-20T11:22:39.530864+0000","last_clean":"2023-07-20T11:22:39.530864+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:22:39.530864+0000","last_undegraded":"2023-07-20T11:22:39.530864+0000","last_fullsized":"2023-07-20T11:22:39.530864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:32.203141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529928+0000","last_change":"2023-07-20T11:22:39.529928+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529928+0000","last_undegraded":"2023-07-20T11:22:39.529928+0000","last_fullsized":"2023-07-20T11:22:39.529928+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":341,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538744+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:22:39.538744+0000","last_peered":"2023-07-20T11:22:39.538744+0000","last_clean":"2023-07-20T11:22:39.538744+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:22:39.538744+0000","last_undegraded":"2023-07-20T11:22:39.538744+0000","last_fullsized":"2023-07-20T11:22:39.538744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:28.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536426+0000","last_change":"2023-07-20T11:22:39.536426+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536426+0000","last_undegraded":"2023-07-20T11:22:39.536426+0000","last_fullsized":"2023-07-20T11:22:39.536426+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":342,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536518+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:22:39.536518+0000","last_peered":"2023-07-20T11:22:39.536518+0000","last_clean":"2023-07-20T11:22:39.536518+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:22:39.536518+0000","last_undegraded":"2023-07-20T11:22:39.536518+0000","last_fullsized":"2023-07-20T11:22:39.536518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:56.111564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537915+0000","last_change":"2023-07-20T11:22:39.537915+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537915+0000","last_undegraded":"2023-07-20T11:22:39.537915+0000","last_fullsized":"2023-07-20T11:22:39.537915+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.539487+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:22:39.539487+0000","last_peered":"2023-07-20T11:22:39.539487+0000","last_clean":"2023-07-20T11:22:39.539487+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:22:39.539487+0000","last_undegraded":"2023-07-20T11:22:39.539487+0000","last_fullsized":"2023-07-20T11:22:39.539487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:52.528048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534171+0000","last_change":"2023-07-20T11:22:39.534171+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534171+0000","last_undegraded":"2023-07-20T11:22:39.534171+0000","last_fullsized":"2023-07-20T11:22:39.534171+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538498+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:22:39.538498+0000","last_peered":"2023-07-20T11:22:39.538498+0000","last_clean":"2023-07-20T11:22:39.538498+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:22:39.538498+0000","last_undegraded":"2023-07-20T11:22:39.538498+0000","last_fullsized":"2023-07-20T11:22:39.538498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:12.359251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575949,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52040,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319800,"statfs":{"total":96636764160,"available":96583475200,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0629999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.996,"15min":1.1200000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.54000000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":1.081},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.0900000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0409999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0509999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.29899999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0349999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.0469999999999999},"last":0.876}]},{"osd":5,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96499999999999997,"5min":1.042,"15min":1.075},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0920000000000001},"last":0.81799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.623,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.077},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.95499999999999996,"15min":0.98499999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.49099999999999999},"max":{"1min":0.88,"5min":1.0389999999999999,"15min":1.1100000000000001},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.93899999999999995,"5min":1.0329999999999999,"15min":1.093},"last":0.755}]},{"osd":3,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.64600000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.02,"15min":1.0840000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.88900000000000001,"5min":0.97999999999999998,"15min":1.143},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.318},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.046},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.33600000000000002},"max":{"1min":0.89600000000000002,"5min":0.93999999999999995,"15min":1.0309999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.98999999999999999,"15min":1.0620000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.93400000000000005,"15min":1.0700000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38400000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.097},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.753},"min":{"1min":0.67100000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.48899999999999999,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.204},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.60799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.50800000000000001,"15min":0.505},"max":{"1min":0.93700000000000006,"5min":1.0169999999999999,"15min":1.071},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"max":{"1min":0.997,"5min":1.101,"15min":1.101},"last":0.752}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.036},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.85099999999999998,"5min":1,"15min":1},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":0.87,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.71299999999999997},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.39500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.1870000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.1419999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1060000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.2310000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0049999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.497,"15min":0.49399999999999999},"max":{"1min":1.026,"5min":1.034,"15min":1.1160000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":1.085,"15min":1.085},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.96799999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0720000000000001},"last":0.878}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.036},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.61599999999999999,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77100000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.498,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.313}]},{"osd":2,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74299999999999999,"5min":0.871,"15min":0.95099999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78400000000000003,"15min":0.80500000000000005},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.55800000000000005,"15min":0.503},"max":{"1min":1.194,"5min":1.242,"15min":1.369},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1779999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.68999999999999995,"5min":0.57399999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.127,"15min":1.3620000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0620000000000001,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.85699999999999998},"min":{"1min":0.70299999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.3999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.82699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.78500000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.01},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.54400000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.375},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.626,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.042,"5min":1.077,"15min":1.298},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.55100000000000005},"max":{"1min":1.131,"5min":1.131,"15min":1.2849999999999999},"last":0.745},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.044,"5min":1.179,"15min":1.476},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.503},"max":{"1min":1.1499999999999999,"5min":1.153,"15min":1.494},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82299999999999995,"15min":0.83699999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3440000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.72599999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.625},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.55400000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.4099999999999999},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37508,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334332,"statfs":{"total":96636764160,"available":96598355968,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.748},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.41999999999999998},"max":{"1min":0.68799999999999994,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.378,"5min":0.36199999999999999,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":0.753,"15min":0.753},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.83499999999999996},"last":0.434}]},{"osd":3,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":1.2050000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63700000000000001,"5min":0.72799999999999998,"15min":1.0109999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.51100000000000001,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.4790000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":0.96299999999999997,"5min":1.077,"15min":1.26},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.95299999999999996,"5min":1.1399999999999999,"15min":1.175},"last":0.755},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.4339999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.1910000000000001},"last":0.628},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.66500000000000004,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":1.0509999999999999,"5min":1.1100000000000001,"15min":1.3089999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.61599999999999999},"max":{"1min":1.002,"5min":1.1579999999999999,"15min":1.242},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.56200000000000006},"max":{"1min":0.98599999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46280,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94325560,"statfs":{"total":96636764160,"available":96589373440,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":44431627},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.254},"max":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.79900000000000004},"last":0.443},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.68000000000000005,"5min":0.79600000000000004,"15min":0.80500000000000005},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.85599999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79000000000000004},"last":1.282},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.36399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0069999999999999},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.54300000000000004,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.56699999999999995},"max":{"1min":0.96299999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84799999999999998,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.52600000000000002},"max":{"1min":1,"5min":1.379,"15min":1.379},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.84099999999999997},"min":{"1min":0.63,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1319999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.2509999999999999,"15min":1.3089999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1140000000000001,"5min":1.355,"15min":1.355},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0289999999999999,"5min":1.204,"15min":1.2589999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:22:46.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:22:46.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 Processor -- start 2023-07-20T11:22:46.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 -- start start 2023-07-20T11:22:46.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d04160bc0 0x7f1d0406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1d040c1a00 0x7f1d040aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040cc560 con 0x7f1d04160fa0 2023-07-20T11:22:46.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040ad7e0 con 0x7f1d04160bc0 2023-07-20T11:22:46.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0c49c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040cc790 con 0x7f1d040c1a00 2023-07-20T11:22:46.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0a238640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d04160bc0 0x7f1d0406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0a238640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1d04160bc0 0x7f1d0406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60774/0 (socket says 172.21.15.82:60774) 2023-07-20T11:22:46.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.206+0000 7f1d0a238640 1 -- 172.21.15.82:0/741682591 learned_addr learned my addr 172.21.15.82:0/741682591 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0aa39640 1 --2- 172.21.15.82:0/741682591 >> v2:172.21.15.183:3300/0 conn(0x7f1d040c1a00 0x7f1d040aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0a238640 1 -- 172.21.15.82:0/741682591 >> v2:172.21.15.183:3300/0 conn(0x7f1d040c1a00 msgr2=0x7f1d040aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0a238640 1 --2- 172.21.15.82:0/741682591 >> v2:172.21.15.183:3300/0 conn(0x7f1d040c1a00 0x7f1d040aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0a238640 1 -- 172.21.15.82:0/741682591 >> v1:172.21.15.82:6789/0 conn(0x7f1d04160fa0 legacy=0x7f1d040c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0a238640 1 -- 172.21.15.82:0/741682591 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040cca70 con 0x7f1d04160bc0 2023-07-20T11:22:46.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d09236640 1 -- 172.21.15.82:0/741682591 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650542809 0 0) 0x7f1d040cc560 con 0x7f1d04160fa0 2023-07-20T11:22:46.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0a238640 1 --2- 172.21.15.82:0/741682591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160bc0 0x7f1d0406c1c0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f1d040acef0 tx=0x7f1d0001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113f001c3944af6f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d09236640 1 -- 172.21.15.82:0/741682591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d000aa430 con 0x7f1d04160bc0 2023-07-20T11:22:46.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d09236640 1 -- 172.21.15.82:0/741682591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d000aa590 con 0x7f1d04160bc0 2023-07-20T11:22:46.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d09236640 1 -- 172.21.15.82:0/741682591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d000aa920 con 0x7f1d04160bc0 2023-07-20T11:22:46.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0c49c640 1 -- 172.21.15.82:0/741682591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160bc0 msgr2=0x7f1d0406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.210+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/741682591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160bc0 0x7f1d0406c1c0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f1d040acef0 tx=0x7f1d0001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- 172.21.15.82:0/741682591 shutdown_connections 2023-07-20T11:22:46.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/741682591 >> v2:172.21.15.183:3300/0 conn(0x7f1d040c1a00 0x7f1d040aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/741682591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160bc0 0x7f1d0406c1c0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- 172.21.15.82:0/741682591 >> 172.21.15.82:0/741682591 conn(0x7f1d040cada0 msgr2=0x7f1d040cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- 172.21.15.82:0/741682591 shutdown_connections 2023-07-20T11:22:46.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- 172.21.15.82:0/741682591 wait complete. 2023-07-20T11:22:46.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 Processor -- start 2023-07-20T11:22:46.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- start start 2023-07-20T11:22:46.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d040c1a00 0x7f1d040b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d04160bc0 0x7f1d040b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04099cc0 con 0x7f1d04160fa0 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04155430 con 0x7f1d040c1a00 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0c49c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b0be0 con 0x7f1d04160bc0 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60778/0 (socket says 172.21.15.82:60778) 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 -- 172.21.15.82:0/1251873085 learned_addr learned my addr 172.21.15.82:0/1251873085 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0a238640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d040c1a00 0x7f1d040b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d09a37640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d04160bc0 0x7f1d040b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 -- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d04160bc0 msgr2=0x7f1d040b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d04160bc0 0x7f1d040b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 -- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d040c1a00 msgr2=0x7f1d040b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d040c1a00 0x7f1d040b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.214+0000 7f1d0aa39640 1 -- 172.21.15.82:0/1251873085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000094d0 con 0x7f1d04160fa0 2023-07-20T11:22:46.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0aa39640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00efc0 tx=0x7f1cfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc014480 con 0x7f1d04160fa0 2023-07-20T11:22:46.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00f040 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d041556f0 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc014820 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d04155cb0 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04155ea0 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1cfc014980 con 0x7f1d04160fa0 2023-07-20T11:22:46.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 0x7f1ce8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f1cfc084b30 con 0x7f1d04160fa0 2023-07-20T11:22:46.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0a238640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 0x7f1ce8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.218+0000 7f1d0a238640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 0x7f1ce8068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ae000 tx=0x7f1d000b5040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.222+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1cfc051d40 con 0x7f1d04160fa0 2023-07-20T11:22:46.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.366+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d040abbe0 con 0x7f1ce80663d0 2023-07-20T11:22:46.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.374+0000 7f1cfaffd640 1 -- 172.21.15.82:0/1251873085 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299473 (secure 0 0 0) 0x7f1d000aa960 con 0x7f1ce80663d0 2023-07-20T11:22:46.370 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:46.371 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:22:46.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 msgr2=0x7f1ce8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 0x7f1ce8068890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d000ae000 tx=0x7f1d000b5040 comp rx=0 tx=0).stop 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 msgr2=0x7f1d041548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00efc0 tx=0x7f1cfc00c490 comp rx=0 tx=0).stop 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 shutdown_connections 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f1ce80663d0 0x7f1ce8068890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d04160fa0 0x7f1d041548c0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1d04160bc0 0x7f1d040b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 --2- 172.21.15.82:0/1251873085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1d040c1a00 0x7f1d040b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 >> 172.21.15.82:0/1251873085 conn(0x7f1d040cada0 msgr2=0x7f1d040cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 shutdown_connections 2023-07-20T11:22:46.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.378+0000 7f1d0c49c640 1 -- 172.21.15.82:0/1251873085 wait complete. 2023-07-20T11:22:46.390 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:22:44.427499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":397992,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":378354,"kb_avail":754576728,"statfs":{"total":773094113280,"available":772686569472,"internally_reserved":0,"allocated":19996672,"data_stored":10819256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":387434584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899432"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530201+0000","last_change":"2023-07-20T11:22:39.530201+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530201+0000","last_undegraded":"2023-07-20T11:22:39.530201+0000","last_fullsized":"2023-07-20T11:22:39.530201+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533630+0000","last_change":"2023-07-20T11:22:39.533630+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533630+0000","last_undegraded":"2023-07-20T11:22:39.533630+0000","last_fullsized":"2023-07-20T11:22:39.533630+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529251+0000","last_change":"2023-07-20T11:22:39.529251+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529251+0000","last_undegraded":"2023-07-20T11:22:39.529251+0000","last_fullsized":"2023-07-20T11:22:39.529251+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535495+0000","last_change":"2023-07-20T11:22:39.535495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535495+0000","last_undegraded":"2023-07-20T11:22:39.535495+0000","last_fullsized":"2023-07-20T11:22:39.535495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536989+0000","last_change":"2023-07-20T11:22:39.536989+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536989+0000","last_undegraded":"2023-07-20T11:22:39.536989+0000","last_fullsized":"2023-07-20T11:22:39.536989+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533161+0000","last_change":"2023-07-20T11:22:39.533161+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533161+0000","last_undegraded":"2023-07-20T11:22:39.533161+0000","last_fullsized":"2023-07-20T11:22:39.533161+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535571+0000","last_change":"2023-07-20T11:22:39.535571+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535571+0000","last_undegraded":"2023-07-20T11:22:39.535571+0000","last_fullsized":"2023-07-20T11:22:39.535571+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535804+0000","last_change":"2023-07-20T11:22:39.535804+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535804+0000","last_undegraded":"2023-07-20T11:22:39.535804+0000","last_fullsized":"2023-07-20T11:22:39.535804+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532668+0000","last_change":"2023-07-20T11:22:39.532668+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532668+0000","last_undegraded":"2023-07-20T11:22:39.532668+0000","last_fullsized":"2023-07-20T11:22:39.532668+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536216+0000","last_change":"2023-07-20T11:22:39.536216+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536216+0000","last_undegraded":"2023-07-20T11:22:39.536216+0000","last_fullsized":"2023-07-20T11:22:39.536216+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534946+0000","last_change":"2023-07-20T11:22:39.534946+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534946+0000","last_undegraded":"2023-07-20T11:22:39.534946+0000","last_fullsized":"2023-07-20T11:22:39.534946+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536572+0000","last_change":"2023-07-20T11:22:39.536572+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536572+0000","last_undegraded":"2023-07-20T11:22:39.536572+0000","last_fullsized":"2023-07-20T11:22:39.536572+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537456+0000","last_change":"2023-07-20T11:22:39.537456+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537456+0000","last_undegraded":"2023-07-20T11:22:39.537456+0000","last_fullsized":"2023-07-20T11:22:39.537456+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529238+0000","last_change":"2023-07-20T11:22:39.529238+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529238+0000","last_undegraded":"2023-07-20T11:22:39.529238+0000","last_fullsized":"2023-07-20T11:22:39.529238+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532495+0000","last_change":"2023-07-20T11:22:39.532495+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532495+0000","last_undegraded":"2023-07-20T11:22:39.532495+0000","last_fullsized":"2023-07-20T11:22:39.532495+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535121+0000","last_change":"2023-07-20T11:22:39.535121+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535121+0000","last_undegraded":"2023-07-20T11:22:39.535121+0000","last_fullsized":"2023-07-20T11:22:39.535121+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.535537+0000","last_change":"2023-07-20T11:22:39.535537+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.535537+0000","last_undegraded":"2023-07-20T11:22:39.535537+0000","last_fullsized":"2023-07-20T11:22:39.535537+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533179+0000","last_change":"2023-07-20T11:22:39.533179+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533179+0000","last_undegraded":"2023-07-20T11:22:39.533179+0000","last_fullsized":"2023-07-20T11:22:39.533179+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532927+0000","last_change":"2023-07-20T11:22:39.532927+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532927+0000","last_undegraded":"2023-07-20T11:22:39.532927+0000","last_fullsized":"2023-07-20T11:22:39.532927+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532217+0000","last_change":"2023-07-20T11:22:39.532217+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532217+0000","last_undegraded":"2023-07-20T11:22:39.532217+0000","last_fullsized":"2023-07-20T11:22:39.532217+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530176+0000","last_change":"2023-07-20T11:22:39.530176+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530176+0000","last_undegraded":"2023-07-20T11:22:39.530176+0000","last_fullsized":"2023-07-20T11:22:39.530176+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.532539+0000","last_change":"2023-07-20T11:22:39.532539+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.532539+0000","last_undegraded":"2023-07-20T11:22:39.532539+0000","last_fullsized":"2023-07-20T11:22:39.532539+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529232+0000","last_change":"2023-07-20T11:22:39.529232+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529232+0000","last_undegraded":"2023-07-20T11:22:39.529232+0000","last_fullsized":"2023-07-20T11:22:39.529232+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.533465+0000","last_change":"2023-07-20T11:22:39.533465+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.533465+0000","last_undegraded":"2023-07-20T11:22:39.533465+0000","last_fullsized":"2023-07-20T11:22:39.533465+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534419+0000","last_change":"2023-07-20T11:22:39.534419+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534419+0000","last_undegraded":"2023-07-20T11:22:39.534419+0000","last_fullsized":"2023-07-20T11:22:39.534419+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"179'304","reported_seq":1163,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536462+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:22:39.536462+0000","last_peered":"2023-07-20T11:22:39.536462+0000","last_clean":"2023-07-20T11:22:39.536462+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:22:39.536462+0000","last_undegraded":"2023-07-20T11:22:39.536462+0000","last_fullsized":"2023-07-20T11:22:39.536462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:33.931015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530507+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:22:39.530507+0000","last_peered":"2023-07-20T11:22:39.530507+0000","last_clean":"2023-07-20T11:22:39.530507+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:22:39.530507+0000","last_undegraded":"2023-07-20T11:22:39.530507+0000","last_fullsized":"2023-07-20T11:22:39.530507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:48:17.282930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.530157+0000","last_change":"2023-07-20T11:22:39.530157+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.530157+0000","last_undegraded":"2023-07-20T11:22:39.530157+0000","last_fullsized":"2023-07-20T11:22:39.530157+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":344,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536361+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:22:39.536361+0000","last_peered":"2023-07-20T11:22:39.536361+0000","last_clean":"2023-07-20T11:22:39.536361+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:22:39.536361+0000","last_undegraded":"2023-07-20T11:22:39.536361+0000","last_fullsized":"2023-07-20T11:22:39.536361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:30:49.309562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534203+0000","last_change":"2023-07-20T11:22:39.534203+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534203+0000","last_undegraded":"2023-07-20T11:22:39.534203+0000","last_fullsized":"2023-07-20T11:22:39.534203+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":373,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.531610+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:22:39.531610+0000","last_peered":"2023-07-20T11:22:39.531610+0000","last_clean":"2023-07-20T11:22:39.531610+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:22:39.531610+0000","last_undegraded":"2023-07-20T11:22:39.531610+0000","last_fullsized":"2023-07-20T11:22:39.531610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:35.749562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534757+0000","last_change":"2023-07-20T11:22:39.534757+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534757+0000","last_undegraded":"2023-07-20T11:22:39.534757+0000","last_fullsized":"2023-07-20T11:22:39.534757+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.530864+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:22:39.530864+0000","last_peered":"2023-07-20T11:22:39.530864+0000","last_clean":"2023-07-20T11:22:39.530864+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:22:39.530864+0000","last_undegraded":"2023-07-20T11:22:39.530864+0000","last_fullsized":"2023-07-20T11:22:39.530864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:27:32.203141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.529928+0000","last_change":"2023-07-20T11:22:39.529928+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.529928+0000","last_undegraded":"2023-07-20T11:22:39.529928+0000","last_fullsized":"2023-07-20T11:22:39.529928+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":341,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538744+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:22:39.538744+0000","last_peered":"2023-07-20T11:22:39.538744+0000","last_clean":"2023-07-20T11:22:39.538744+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:22:39.538744+0000","last_undegraded":"2023-07-20T11:22:39.538744+0000","last_fullsized":"2023-07-20T11:22:39.538744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:01:28.632891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.536426+0000","last_change":"2023-07-20T11:22:39.536426+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.536426+0000","last_undegraded":"2023-07-20T11:22:39.536426+0000","last_fullsized":"2023-07-20T11:22:39.536426+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":342,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.536518+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:22:39.536518+0000","last_peered":"2023-07-20T11:22:39.536518+0000","last_clean":"2023-07-20T11:22:39.536518+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:22:39.536518+0000","last_undegraded":"2023-07-20T11:22:39.536518+0000","last_fullsized":"2023-07-20T11:22:39.536518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:39:56.111564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.537915+0000","last_change":"2023-07-20T11:22:39.537915+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.537915+0000","last_undegraded":"2023-07-20T11:22:39.537915+0000","last_fullsized":"2023-07-20T11:22:39.537915+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":339,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.539487+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:22:39.539487+0000","last_peered":"2023-07-20T11:22:39.539487+0000","last_clean":"2023-07-20T11:22:39.539487+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:22:39.539487+0000","last_undegraded":"2023-07-20T11:22:39.539487+0000","last_fullsized":"2023-07-20T11:22:39.539487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:33:52.528048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:22:40.526003+0000","last_change":"2023-07-20T11:22:40.526003+0000","last_active":"2023-07-20T11:22:40.526003+0000","last_peered":"2023-07-20T11:22:40.526003+0000","last_clean":"2023-07-20T11:22:40.526003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:40.526003+0000","last_undegraded":"2023-07-20T11:22:40.526003+0000","last_fullsized":"2023-07-20T11:22:40.526003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":188,"state":"creating+peering","last_fresh":"2023-07-20T11:22:39.534171+0000","last_change":"2023-07-20T11:22:39.534171+0000","last_active":"2023-07-20T11:22:39.513848+0000","last_peered":"2023-07-20T11:22:39.513848+0000","last_clean":"2023-07-20T11:22:39.513848+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:22:39.534171+0000","last_undegraded":"2023-07-20T11:22:39.534171+0000","last_fullsized":"2023-07-20T11:22:39.534171+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-07-20T11:22:39.538498+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:22:39.538498+0000","last_peered":"2023-07-20T11:22:39.538498+0000","last_clean":"2023-07-20T11:22:39.538498+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:22:39.538498+0000","last_undegraded":"2023-07-20T11:22:39.538498+0000","last_fullsized":"2023-07-20T11:22:39.538498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:12.359251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575949,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52040,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319800,"statfs":{"total":96636764160,"available":96583475200,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0629999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.996,"15min":1.1200000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.54000000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":1.081},"last":0.72499999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.747},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.0900000000000001},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0409999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0509999999999999},"last":0.69699999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.29899999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0349999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.0469999999999999},"last":0.876}]},{"osd":5,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96499999999999997,"5min":1.042,"15min":1.075},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0920000000000001},"last":0.81799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.623,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.077},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.95499999999999996,"15min":0.98499999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.49099999999999999},"max":{"1min":0.88,"5min":1.0389999999999999,"15min":1.1100000000000001},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.93899999999999995,"5min":1.0329999999999999,"15min":1.093},"last":0.755}]},{"osd":3,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.64600000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.02,"15min":1.0840000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.88900000000000001,"5min":0.97999999999999998,"15min":1.143},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.318},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.046},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.33600000000000002},"max":{"1min":0.89600000000000002,"5min":0.93999999999999995,"15min":1.0309999999999999},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.98999999999999999,"15min":1.0620000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.93400000000000005,"15min":1.0700000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38400000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.097},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575949,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.753},"min":{"1min":0.67100000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.48899999999999999,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.204},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.60799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.56200000000000006}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.50800000000000001,"15min":0.505},"max":{"1min":0.93700000000000006,"5min":1.0169999999999999,"15min":1.071},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"max":{"1min":0.997,"5min":1.101,"15min":1.101},"last":0.752}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.036},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.85099999999999998,"5min":1,"15min":1},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":0.87,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83699999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.71299999999999997},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":1.038}]}]},{"osd":4,"up_from":13,"seq":55834575949,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41604,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330236,"statfs":{"total":96636764160,"available":96594161664,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.39500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.1870000000000001},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.1419999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1060000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.2310000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0049999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.497,"15min":0.49399999999999999},"max":{"1min":1.026,"5min":1.034,"15min":1.1160000000000001},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":1.085,"15min":1.085},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.96799999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0720000000000001},"last":0.878}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.036},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575948,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.61599999999999999,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77100000000000002},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.498,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.313}]},{"osd":2,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.96099999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74299999999999999,"5min":0.871,"15min":0.95099999999999996},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78400000000000003,"15min":0.80500000000000005},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.55800000000000005,"15min":0.503},"max":{"1min":1.194,"5min":1.242,"15min":1.369},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1779999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.68999999999999995,"5min":0.57399999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.127,"15min":1.3620000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0620000000000001,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.85699999999999998},"min":{"1min":0.70299999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.3999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59652,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312188,"statfs":{"total":96636764160,"available":96575680512,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.82699999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.78500000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.01},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.54400000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.375},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.626,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.042,"5min":1.077,"15min":1.298},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.55100000000000005},"max":{"1min":1.131,"5min":1.131,"15min":1.2849999999999999},"last":0.745},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.044,"5min":1.179,"15min":1.476},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.503},"max":{"1min":1.1499999999999999,"5min":1.153,"15min":1.494},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82299999999999995,"15min":0.83699999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3440000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.72599999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.625},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.55400000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.4099999999999999},"last":0.78300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575949,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37508,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334332,"statfs":{"total":96636764160,"available":96598355968,"internally_reserved":0,"allocated":2351104,"data_stored":1204815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.748},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.41999999999999998},"max":{"1min":0.68799999999999994,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.378,"5min":0.36199999999999999,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":0.753,"15min":0.753},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.83499999999999996},"last":0.434}]},{"osd":3,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":1.2050000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63700000000000001,"5min":0.72799999999999998,"15min":1.0109999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.51100000000000001,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.4790000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":0.96299999999999997,"5min":1.077,"15min":1.26},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.95299999999999996,"5min":1.1399999999999999,"15min":1.175},"last":0.755},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.4339999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.1910000000000001},"last":0.628},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.66500000000000004,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":1.0509999999999999,"5min":1.1100000000000001,"15min":1.3089999999999999},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.61599999999999999},"max":{"1min":1.002,"5min":1.1579999999999999,"15min":1.242},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.56200000000000006},"max":{"1min":0.98599999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.64800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575949,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46280,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94325560,"statfs":{"total":96636764160,"available":96589373440,"internally_reserved":0,"allocated":2945024,"data_stored":1795183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":44431627},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.254},"max":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.79900000000000004},"last":0.443},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.68000000000000005,"5min":0.79600000000000004,"15min":0.80500000000000005},"last":0.95799999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.85599999999999998},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79000000000000004},"last":1.282},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.36399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0069999999999999},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.54300000000000004,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.56699999999999995},"max":{"1min":0.96299999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84799999999999998,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.52600000000000002},"max":{"1min":1,"5min":1.379,"15min":1.379},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.84099999999999997},"min":{"1min":0.63,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1319999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.2509999999999999,"15min":1.3089999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1140000000000001,"5min":1.355,"15min":1.355},"last":0.92100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0289999999999999,"5min":1.204,"15min":1.2589999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:22:46.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-07-20T11:22:46.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-07-20T11:22:46.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-07-20T11:22:46.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-07-20T11:22:46.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-07-20T11:22:46.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-07-20T11:22:46.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-07-20T11:22:46.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-07-20T11:22:46.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-07-20T11:22:46.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-07-20T11:22:46.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-07-20T11:22:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-07-20T11:22:46.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-07-20T11:22:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-07-20T11:22:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-07-20T11:22:46.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-07-20T11:22:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-07-20T11:22:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-07-20T11:22:46.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-07-20T11:22:46.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-07-20T11:22:46.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-07-20T11:22:46.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-07-20T11:22:46.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-07-20T11:22:46.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-07-20T11:22:46.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-07-20T11:22:46.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-07-20T11:22:46.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-07-20T11:22:46.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-07-20T11:22:46.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-07-20T11:22:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-07-20T11:22:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-07-20T11:22:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-07-20T11:22:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-07-20T11:22:46.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2023-07-20T11:22:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.530201+0000', 'last_change': '2023-07-20T11:22:39.530201+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.530201+0000', 'last_undegraded': '2023-07-20T11:22:39.530201+0000', 'last_fullsized': '2023-07-20T11:22:39.530201+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:22:46.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-07-20T11:22:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1e is not active+clean 2023-07-20T11:22:46.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.533630+0000', 'last_change': '2023-07-20T11:22:39.533630+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.533630+0000', 'last_undegraded': '2023-07-20T11:22:39.533630+0000', 'last_fullsized': '2023-07-20T11:22:39.533630+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-07-20T11:22:46.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2023-07-20T11:22:46.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.529251+0000', 'last_change': '2023-07-20T11:22:39.529251+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.529251+0000', 'last_undegraded': '2023-07-20T11:22:39.529251+0000', 'last_fullsized': '2023-07-20T11:22:39.529251+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:22:46.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-07-20T11:22:46.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2023-07-20T11:22:46.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.535495+0000', 'last_change': '2023-07-20T11:22:39.535495+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.535495+0000', 'last_undegraded': '2023-07-20T11:22:39.535495+0000', 'last_fullsized': '2023-07-20T11:22:39.535495+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:22:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-07-20T11:22:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2023-07-20T11:22:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.536989+0000', 'last_change': '2023-07-20T11:22:39.536989+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.536989+0000', 'last_undegraded': '2023-07-20T11:22:39.536989+0000', 'last_fullsized': '2023-07-20T11:22:39.536989+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:22:46.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-07-20T11:22:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1a is not active+clean 2023-07-20T11:22:46.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.533161+0000', 'last_change': '2023-07-20T11:22:39.533161+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.533161+0000', 'last_undegraded': '2023-07-20T11:22:39.533161+0000', 'last_fullsized': '2023-07-20T11:22:39.533161+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-07-20T11:22:46.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2023-07-20T11:22:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.535571+0000', 'last_change': '2023-07-20T11:22:39.535571+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.535571+0000', 'last_undegraded': '2023-07-20T11:22:39.535571+0000', 'last_fullsized': '2023-07-20T11:22:39.535571+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:22:46.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-07-20T11:22:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2023-07-20T11:22:46.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.535804+0000', 'last_change': '2023-07-20T11:22:39.535804+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.535804+0000', 'last_undegraded': '2023-07-20T11:22:39.535804+0000', 'last_fullsized': '2023-07-20T11:22:39.535804+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:22:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-07-20T11:22:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2023-07-20T11:22:46.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.532668+0000', 'last_change': '2023-07-20T11:22:39.532668+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.532668+0000', 'last_undegraded': '2023-07-20T11:22:39.532668+0000', 'last_fullsized': '2023-07-20T11:22:39.532668+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-07-20T11:22:46.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2023-07-20T11:22:46.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.536216+0000', 'last_change': '2023-07-20T11:22:39.536216+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.536216+0000', 'last_undegraded': '2023-07-20T11:22:39.536216+0000', 'last_fullsized': '2023-07-20T11:22:39.536216+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:22:46.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-07-20T11:22:46.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.d is not active+clean 2023-07-20T11:22:46.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.534946+0000', 'last_change': '2023-07-20T11:22:39.534946+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.534946+0000', 'last_undegraded': '2023-07-20T11:22:39.534946+0000', 'last_fullsized': '2023-07-20T11:22:39.534946+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-07-20T11:22:46.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2023-07-20T11:22:46.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.536572+0000', 'last_change': '2023-07-20T11:22:39.536572+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.536572+0000', 'last_undegraded': '2023-07-20T11:22:39.536572+0000', 'last_fullsized': '2023-07-20T11:22:39.536572+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:22:46.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-07-20T11:22:46.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.b is not active+clean 2023-07-20T11:22:46.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.537456+0000', 'last_change': '2023-07-20T11:22:39.537456+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.537456+0000', 'last_undegraded': '2023-07-20T11:22:39.537456+0000', 'last_fullsized': '2023-07-20T11:22:39.537456+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-07-20T11:22:46.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2023-07-20T11:22:46.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.529238+0000', 'last_change': '2023-07-20T11:22:39.529238+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.529238+0000', 'last_undegraded': '2023-07-20T11:22:39.529238+0000', 'last_fullsized': '2023-07-20T11:22:39.529238+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:22:46.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-07-20T11:22:46.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2023-07-20T11:22:46.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.532495+0000', 'last_change': '2023-07-20T11:22:39.532495+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.532495+0000', 'last_undegraded': '2023-07-20T11:22:39.532495+0000', 'last_fullsized': '2023-07-20T11:22:39.532495+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:22:46.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-07-20T11:22:46.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2023-07-20T11:22:46.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.535121+0000', 'last_change': '2023-07-20T11:22:39.535121+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.535121+0000', 'last_undegraded': '2023-07-20T11:22:39.535121+0000', 'last_fullsized': '2023-07-20T11:22:39.535121+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-20T11:22:46.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-07-20T11:22:46.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.7 is not active+clean 2023-07-20T11:22:46.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.535537+0000', 'last_change': '2023-07-20T11:22:39.535537+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.535537+0000', 'last_undegraded': '2023-07-20T11:22:39.535537+0000', 'last_fullsized': '2023-07-20T11:22:39.535537+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-07-20T11:22:46.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2023-07-20T11:22:46.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.533179+0000', 'last_change': '2023-07-20T11:22:39.533179+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.533179+0000', 'last_undegraded': '2023-07-20T11:22:39.533179+0000', 'last_fullsized': '2023-07-20T11:22:39.533179+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-07-20T11:22:46.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2023-07-20T11:22:46.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.532927+0000', 'last_change': '2023-07-20T11:22:39.532927+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.532927+0000', 'last_undegraded': '2023-07-20T11:22:39.532927+0000', 'last_fullsized': '2023-07-20T11:22:39.532927+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-07-20T11:22:46.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2023-07-20T11:22:46.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.532217+0000', 'last_change': '2023-07-20T11:22:39.532217+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.532217+0000', 'last_undegraded': '2023-07-20T11:22:39.532217+0000', 'last_fullsized': '2023-07-20T11:22:39.532217+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-20T11:22:46.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-07-20T11:22:46.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2023-07-20T11:22:46.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.530176+0000', 'last_change': '2023-07-20T11:22:39.530176+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.530176+0000', 'last_undegraded': '2023-07-20T11:22:39.530176+0000', 'last_fullsized': '2023-07-20T11:22:39.530176+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:22:46.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-07-20T11:22:46.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2023-07-20T11:22:46.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.532539+0000', 'last_change': '2023-07-20T11:22:39.532539+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.532539+0000', 'last_undegraded': '2023-07-20T11:22:39.532539+0000', 'last_fullsized': '2023-07-20T11:22:39.532539+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-07-20T11:22:46.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2023-07-20T11:22:46.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.529232+0000', 'last_change': '2023-07-20T11:22:39.529232+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.529232+0000', 'last_undegraded': '2023-07-20T11:22:39.529232+0000', 'last_fullsized': '2023-07-20T11:22:39.529232+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:22:46.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-07-20T11:22:46.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.0 is not active+clean 2023-07-20T11:22:46.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.533465+0000', 'last_change': '2023-07-20T11:22:39.533465+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.533465+0000', 'last_undegraded': '2023-07-20T11:22:39.533465+0000', 'last_fullsized': '2023-07-20T11:22:39.533465+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-07-20T11:22:46.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2023-07-20T11:22:46.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.534419+0000', 'last_change': '2023-07-20T11:22:39.534419+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.534419+0000', 'last_undegraded': '2023-07-20T11:22:39.534419+0000', 'last_fullsized': '2023-07-20T11:22:39.534419+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-07-20T11:22:46.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2023-07-20T11:22:46.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.530157+0000', 'last_change': '2023-07-20T11:22:39.530157+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.530157+0000', 'last_undegraded': '2023-07-20T11:22:39.530157+0000', 'last_fullsized': '2023-07-20T11:22:39.530157+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-20T11:22:46.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-07-20T11:22:46.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2023-07-20T11:22:46.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.534203+0000', 'last_change': '2023-07-20T11:22:39.534203+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.534203+0000', 'last_undegraded': '2023-07-20T11:22:39.534203+0000', 'last_fullsized': '2023-07-20T11:22:39.534203+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-07-20T11:22:46.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2023-07-20T11:22:46.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.534757+0000', 'last_change': '2023-07-20T11:22:39.534757+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.534757+0000', 'last_undegraded': '2023-07-20T11:22:39.534757+0000', 'last_fullsized': '2023-07-20T11:22:39.534757+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-07-20T11:22:46.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2023-07-20T11:22:46.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.529928+0000', 'last_change': '2023-07-20T11:22:39.529928+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.529928+0000', 'last_undegraded': '2023-07-20T11:22:39.529928+0000', 'last_fullsized': '2023-07-20T11:22:39.529928+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-20T11:22:46.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-07-20T11:22:46.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2023-07-20T11:22:46.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.536426+0000', 'last_change': '2023-07-20T11:22:39.536426+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.536426+0000', 'last_undegraded': '2023-07-20T11:22:39.536426+0000', 'last_fullsized': '2023-07-20T11:22:39.536426+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-20T11:22:46.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-07-20T11:22:46.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.13 is not active+clean 2023-07-20T11:22:46.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.537915+0000', 'last_change': '2023-07-20T11:22:39.537915+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.537915+0000', 'last_undegraded': '2023-07-20T11:22:39.537915+0000', 'last_fullsized': '2023-07-20T11:22:39.537915+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-20T11:22:46.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-07-20T11:22:46.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-20T11:22:40.526003+0000', 'last_change': '2023-07-20T11:22:40.526003+0000', 'last_active': '2023-07-20T11:22:40.526003+0000', 'last_peered': '2023-07-20T11:22:40.526003+0000', 'last_clean': '2023-07-20T11:22:40.526003+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:40.526003+0000', 'last_undegraded': '2023-07-20T11:22:40.526003+0000', 'last_fullsized': '2023-07-20T11:22:40.526003+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:40.526003+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-20T11:22:46.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2023-07-20T11:22:46.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 188, 'state': 'creating+peering', 'last_fresh': '2023-07-20T11:22:39.534171+0000', 'last_change': '2023-07-20T11:22:39.534171+0000', 'last_active': '2023-07-20T11:22:39.513848+0000', 'last_peered': '2023-07-20T11:22:39.513848+0000', 'last_clean': '2023-07-20T11:22:39.513848+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-20T11:22:39.534171+0000', 'last_undegraded': '2023-07-20T11:22:39.534171+0000', 'last_fullsized': '2023-07-20T11:22:39.534171+0000', 'mapping_epoch': 188, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 188, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'last_clean_scrub_stamp': '2023-07-20T11:22:39.513848+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-20T11:22:46.472 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T11:22:46.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 Processor -- start 2023-07-20T11:22:46.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 -- start start 2023-07-20T11:22:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfd00b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdfd00b04b0 0x7fdfd0160660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd00cdd60 con 0x7fdfd00ad720 2023-07-20T11:22:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd00b20a0 con 0x7fdfd00b04b0 2023-07-20T11:22:46.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfd5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00cd430 con 0x7fdfd00b1cc0 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfd00ad720 0x7fdfd00afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52002/0 (socket says 172.21.15.82:52002) 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3481250230 learned_addr learned my addr 172.21.15.82:0/3481250230 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfceffd640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfd00b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcf7fe640 1 --2- 172.21.15.82:0/3481250230 >> v2:172.21.15.183:3300/0 conn(0x7fdfd00b04b0 0x7fdfd0160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816238587 0 0) 0x7fdfd00cdd60 con 0x7fdfd00ad720 2023-07-20T11:22:46.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb8003530 con 0x7fdfd00ad720 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192348015 0 0) 0x7fdfb8003530 con 0x7fdfd00ad720 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 msgr2=0x7fdfd00b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfd00b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 >> v2:172.21.15.183:3300/0 conn(0x7fdfd00b04b0 msgr2=0x7fdfd0160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 --2- 172.21.15.82:0/3481250230 >> v2:172.21.15.183:3300/0 conn(0x7fdfd00b04b0 0x7fdfd0160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00cd710 con 0x7fdfd00ad720 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fdfc4001a00 con 0x7fdfd00ad720 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 >> v1:172.21.15.82:6789/0 conn(0x7fdfd00ad720 legacy=0x7fdfd00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfb8003980 0x7fdfb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfb80047d0 0x7fdfb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00b20a0 con 0x7fdfb80047d0 2023-07-20T11:22:46.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00cd430 con 0x7fdfb8003980 2023-07-20T11:22:46.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb800b990 con 0x7fdfd00b1cc0 2023-07-20T11:22:46.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfb80047d0 0x7fdfb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfcf7fe640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfceffd640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfb8003980 0x7fdfb8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 msgr2=0x7fdfb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd00b1cc0 0x7fdfb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfb8003980 msgr2=0x7fdfb8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfb8003980 0x7fdfb8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3481250230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8003530 con 0x7fdfb80047d0 2023-07-20T11:22:46.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.622+0000 7fdfceffd640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfb8003980 0x7fdfb8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:46.621 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfb80047d0 0x7fdfb8004c50 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400a890 tx=0x7fdfc401d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6508731287556aba server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40ad630 con 0x7fdfb80047d0 2023-07-20T11:22:46.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40a8070 con 0x7fdfb80047d0 2023-07-20T11:22:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfcdffb640 1 -- 172.21.15.82:0/3481250230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40ad9f0 con 0x7fdfb80047d0 2023-07-20T11:22:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 -- 172.21.15.82:0/3481250230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfb80047d0 msgr2=0x7fdfb8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 --2- 172.21.15.82:0/3481250230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfb80047d0 0x7fdfb8004c50 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400a890 tx=0x7fdfc401d330 comp rx=0 tx=0).stop 2023-07-20T11:22:46.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfcf7fe640 1 -- 172.21.15.82:0/3481250230 reap_dead start 2023-07-20T11:22:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 -- 172.21.15.82:0/3481250230 shutdown_connections 2023-07-20T11:22:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 -- 172.21.15.82:0/3481250230 >> 172.21.15.82:0/3481250230 conn(0x7fdfd00cada0 msgr2=0x7fdfd00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 -- 172.21.15.82:0/3481250230 shutdown_connections 2023-07-20T11:22:46.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.626+0000 7fdfd5626640 1 -- 172.21.15.82:0/3481250230 wait complete. 2023-07-20T11:22:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 Processor -- start 2023-07-20T11:22:46.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 -- start start 2023-07-20T11:22:46.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfb80047d0 0x7fdfd0157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 0x7fdfd0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0156850 con 0x7fdfd009afb0 2023-07-20T11:22:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0157690 con 0x7fdfd0070c60 2023-07-20T11:22:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfd5626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00710e0 con 0x7fdfb80047d0 2023-07-20T11:22:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfceffd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfb80047d0 0x7fdfd0157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60792/0 (socket says 172.21.15.82:60792) 2023-07-20T11:22:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 -- 172.21.15.82:0/2891809427 learned_addr learned my addr 172.21.15.82:0/2891809427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 0x7fdfd0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 -- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfb80047d0 msgr2=0x7fdfd0157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfb80047d0 0x7fdfd0157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 -- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 msgr2=0x7fdfd0156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 0x7fdfd0156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 -- 172.21.15.82:0/2891809427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00b12f0 con 0x7fdfd009afb0 2023-07-20T11:22:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 0x7fdfd0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:46.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfcf7fe640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00b3340 tx=0x7fdfc8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.630+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8004240 con 0x7fdfd009afb0 2023-07-20T11:22:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80043a0 con 0x7fdfd009afb0 2023-07-20T11:22:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800f960 con 0x7fdfd009afb0 2023-07-20T11:22:46.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd0156a80 con 0x7fdfd009afb0 2023-07-20T11:22:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd0157040 con 0x7fdfd009afb0 2023-07-20T11:22:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd0073c70 con 0x7fdfd009afb0 2023-07-20T11:22:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfc800fac0 con 0x7fdfd009afb0 2023-07-20T11:22:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfb77fe640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 0x7fdfbc068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fdfc8084450 con 0x7fdfd009afb0 2023-07-20T11:22:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfceffd640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 0x7fdfbc068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.634+0000 7fdfceffd640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 0x7fdfbc068890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006f90 tx=0x7fdfc0008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.638+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfc8051760 con 0x7fdfd009afb0 2023-07-20T11:22:46.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdfd01577d0 con 0x7fdfd009afb0 2023-07-20T11:22:46.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfb77fe640 1 -- 172.21.15.82:0/2891809427 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7fdfc8054d80 con 0x7fdfd009afb0 2023-07-20T11:22:46.830 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:46.830 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5565,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":191,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":409640960,"bytes_avail":772684472320,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":90,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":10848}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-07-20T11:18:23.027140+0000","services":{}},"progress_events":{}} 2023-07-20T11:22:46.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 msgr2=0x7fdfbc068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 0x7fdfbc068890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0006f90 tx=0x7fdfc0008040 comp rx=0 tx=0).stop 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 msgr2=0x7fdfd00abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00b3340 tx=0x7fdfc8011cf0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 shutdown_connections 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fdfbc0663d0 0x7fdfbc068890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd009afb0 0x7fdfd00abbc0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd0070c60 0x7fdfd0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 --2- 172.21.15.82:0/2891809427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfb80047d0 0x7fdfd0157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.838+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 >> 172.21.15.82:0/2891809427 conn(0x7fdfd00cada0 msgr2=0x7fdfd00add80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.842+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 shutdown_connections 2023-07-20T11:22:46.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.842+0000 7fdfd5626640 1 -- 172.21.15.82:0/2891809427 wait complete. 2023-07-20T11:22:46.851 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T11:22:46.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:22:46.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 Processor -- start 2023-07-20T11:22:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 -- start start 2023-07-20T11:22:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f829015a8e0 0x7f82900ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 0x7f82900b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900b06c0 con 0x7f82900afda0 2023-07-20T11:22:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900b3160 con 0x7f829015a8e0 2023-07-20T11:22:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f8295333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b12a0 con 0x7f82900b2060 2023-07-20T11:22:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f828effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f82900afda0 0x7f82900b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52016/0 (socket says 172.21.15.82:52016) 2023-07-20T11:22:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f828effd640 1 -- 172.21.15.82:0/378439202 learned_addr learned my addr 172.21.15.82:0/378439202 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f828f7fe640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 0x7f82900b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f82867fc640 1 --2- 172.21.15.82:0/378439202 >> v2:172.21.15.183:3300/0 conn(0x7f829015a8e0 0x7f82900ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264432571 0 0) 0x7f82900b06c0 con 0x7f82900afda0 2023-07-20T11:22:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:46.998+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f827c003530 con 0x7f82900afda0 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f82867fc640 1 -- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 msgr2=0x7f82900b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f82867fc640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 0x7f82900b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f82867fc640 1 -- 172.21.15.82:0/378439202 >> v1:172.21.15.82:6789/0 conn(0x7f82900afda0 legacy=0x7f82900b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1448519559 0 0) 0x7f827c003530 con 0x7f82900afda0 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f82867fc640 1 -- 172.21.15.82:0/378439202 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900b1580 con 0x7f829015a8e0 2023-07-20T11:22:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f828f7fe640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 0x7f82900b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:46.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f82867fc640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f829015a8e0 0x7f82900ca6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f82780097c0 tx=0x7f827801c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d342b89835c4171 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280001680 con 0x7f829015a8e0 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780a7050 con 0x7f829015a8e0 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f828e7fc640 1 -- 172.21.15.82:0/378439202 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780ab600 con 0x7f829015a8e0 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f8295333640 1 -- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f829015a8e0 msgr2=0x7f82900ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.002+0000 7f8295333640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f829015a8e0 0x7f82900ca6b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f82780097c0 tx=0x7f827801c250 comp rx=0 tx=0).stop 2023-07-20T11:22:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- 172.21.15.82:0/378439202 shutdown_connections 2023-07-20T11:22:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f82900b2060 0x7f82900b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 --2- 172.21.15.82:0/378439202 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f829015a8e0 0x7f82900ca6b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- 172.21.15.82:0/378439202 >> 172.21.15.82:0/378439202 conn(0x7f82900cada0 msgr2=0x7f82900cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- 172.21.15.82:0/378439202 shutdown_connections 2023-07-20T11:22:46.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- 172.21.15.82:0/378439202 wait complete. 2023-07-20T11:22:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 Processor -- start 2023-07-20T11:22:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- start start 2023-07-20T11:22:46.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 0x7f82900abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:46.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f829015a8e0 0x7f82900aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82901592a0 con 0x7f82900afda0 2023-07-20T11:22:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8290158970 con 0x7f82900b2060 2023-07-20T11:22:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f8295333640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8290158c50 con 0x7f829015a8e0 2023-07-20T11:22:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60798/0 (socket says 172.21.15.82:60798) 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 -- 172.21.15.82:0/2916268547 learned_addr learned my addr 172.21.15.82:0/2916268547 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828f7fe640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f829015a8e0 0x7f82900aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f82867fc640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 0x7f82900abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 -- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f829015a8e0 msgr2=0x7f82900aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f829015a8e0 0x7f82900aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 -- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 msgr2=0x7f82900abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:47.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 0x7f82900abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f828effd640 1 -- 172.21.15.82:0/2916268547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009a70 con 0x7f82900afda0 2023-07-20T11:22:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.006+0000 7f82867fc640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 0x7f82900abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:47.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f828effd640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f828000c750 tx=0x7f828000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280005ae0 con 0x7f82900afda0 2023-07-20T11:22:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000ce90 con 0x7f82900afda0 2023-07-20T11:22:47.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280007070 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8278009420 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82900abfe0 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8290073c70 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f82800071d0 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 0x7f8270068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8280083580 con 0x7f82900afda0 2023-07-20T11:22:47.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.010+0000 7f82867fc640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 0x7f8270068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:47.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.014+0000 7f82867fc640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 0x7f8270068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82780ad000 tx=0x7f82780a6000 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:47.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.014+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82800508a0 con 0x7f82900afda0 2023-07-20T11:22:47.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.158+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f829006bfc0 con 0x7f82700663d0 2023-07-20T11:22:47.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.166+0000 7f8287fff640 1 -- 172.21.15.82:0/2916268547 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311909 (secure 0 0 0) 0x7f82780ba070 con 0x7f82700663d0 2023-07-20T11:22:47.161 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:47.162 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:22:47.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 msgr2=0x7f8270068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 0x7f8270068890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82780ad000 tx=0x7f82780a6000 comp rx=0 tx=0).stop 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 msgr2=0x7f82900cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f828000c750 tx=0x7f828000cb50 comp rx=0 tx=0).stop 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 shutdown_connections 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f829015a8e0 0x7f82900aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f82900b2060 0x7f82900abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f82700663d0 0x7f8270068890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 --2- 172.21.15.82:0/2916268547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82900afda0 0x7f82900cdb00 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 >> 172.21.15.82:0/2916268547 conn(0x7f82900cada0 msgr2=0x7f829006c380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 shutdown_connections 2023-07-20T11:22:47.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:47.170+0000 7f8295333640 1 -- 172.21.15.82:0/2916268547 wait complete. 2023-07-20T11:22:47.181 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-20T11:22:46.428043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":543,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400040,"kb_used_data":19880,"kb_used_omap":13,"kb_used_meta":380018,"kb_avail":754574680,"statfs":{"total":773094113280,"available":772684472320,"internally_reserved":0,"allocated":20357120,"data_stored":10988916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":389138520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001251"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375444+0000","last_change":"2023-07-20T11:22:41.562562+0000","last_active":"2023-07-20T11:22:43.375444+0000","last_peered":"2023-07-20T11:22:43.375444+0000","last_clean":"2023-07-20T11:22:43.375444+0000","last_became_active":"2023-07-20T11:22:41.562280+0000","last_became_peered":"2023-07-20T11:22:41.562280+0000","last_unstale":"2023-07-20T11:22:43.375444+0000","last_undegraded":"2023-07-20T11:22:43.375444+0000","last_fullsized":"2023-07-20T11:22:43.375444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:33:50.061829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375187+0000","last_change":"2023-07-20T11:22:41.565692+0000","last_active":"2023-07-20T11:22:43.375187+0000","last_peered":"2023-07-20T11:22:43.375187+0000","last_clean":"2023-07-20T11:22:43.375187+0000","last_became_active":"2023-07-20T11:22:41.565415+0000","last_became_peered":"2023-07-20T11:22:41.565415+0000","last_unstale":"2023-07-20T11:22:43.375187+0000","last_undegraded":"2023-07-20T11:22:43.375187+0000","last_fullsized":"2023-07-20T11:22:43.375187+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:39:46.895393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374865+0000","last_change":"2023-07-20T11:22:41.548864+0000","last_active":"2023-07-20T11:22:43.374865+0000","last_peered":"2023-07-20T11:22:43.374865+0000","last_clean":"2023-07-20T11:22:43.374865+0000","last_became_active":"2023-07-20T11:22:41.548490+0000","last_became_peered":"2023-07-20T11:22:41.548490+0000","last_unstale":"2023-07-20T11:22:43.374865+0000","last_undegraded":"2023-07-20T11:22:43.374865+0000","last_fullsized":"2023-07-20T11:22:43.374865+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:22:59.670640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375069+0000","last_change":"2023-07-20T11:22:41.551267+0000","last_active":"2023-07-20T11:22:43.375069+0000","last_peered":"2023-07-20T11:22:43.375069+0000","last_clean":"2023-07-20T11:22:43.375069+0000","last_became_active":"2023-07-20T11:22:41.550843+0000","last_became_peered":"2023-07-20T11:22:41.550843+0000","last_unstale":"2023-07-20T11:22:43.375069+0000","last_undegraded":"2023-07-20T11:22:43.375069+0000","last_fullsized":"2023-07-20T11:22:43.375069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:15:19.192138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373844+0000","last_change":"2023-07-20T11:22:41.555323+0000","last_active":"2023-07-20T11:22:43.373844+0000","last_peered":"2023-07-20T11:22:43.373844+0000","last_clean":"2023-07-20T11:22:43.373844+0000","last_became_active":"2023-07-20T11:22:41.555050+0000","last_became_peered":"2023-07-20T11:22:41.555050+0000","last_unstale":"2023-07-20T11:22:43.373844+0000","last_undegraded":"2023-07-20T11:22:43.373844+0000","last_fullsized":"2023-07-20T11:22:43.373844+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:59:28.660662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374558+0000","last_change":"2023-07-20T11:22:41.563919+0000","last_active":"2023-07-20T11:22:43.374558+0000","last_peered":"2023-07-20T11:22:43.374558+0000","last_clean":"2023-07-20T11:22:43.374558+0000","last_became_active":"2023-07-20T11:22:41.563597+0000","last_became_peered":"2023-07-20T11:22:41.563597+0000","last_unstale":"2023-07-20T11:22:43.374558+0000","last_undegraded":"2023-07-20T11:22:43.374558+0000","last_fullsized":"2023-07-20T11:22:43.374558+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:07.608809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547927+0000","last_change":"2023-07-20T11:22:41.561863+0000","last_active":"2023-07-20T11:22:42.547927+0000","last_peered":"2023-07-20T11:22:42.547927+0000","last_clean":"2023-07-20T11:22:42.547927+0000","last_became_active":"2023-07-20T11:22:41.561579+0000","last_became_peered":"2023-07-20T11:22:41.561579+0000","last_unstale":"2023-07-20T11:22:42.547927+0000","last_undegraded":"2023-07-20T11:22:42.547927+0000","last_fullsized":"2023-07-20T11:22:42.547927+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:03.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547207+0000","last_change":"2023-07-20T11:22:41.566969+0000","last_active":"2023-07-20T11:22:42.547207+0000","last_peered":"2023-07-20T11:22:42.547207+0000","last_clean":"2023-07-20T11:22:42.547207+0000","last_became_active":"2023-07-20T11:22:41.564951+0000","last_became_peered":"2023-07-20T11:22:41.564951+0000","last_unstale":"2023-07-20T11:22:42.547207+0000","last_undegraded":"2023-07-20T11:22:42.547207+0000","last_fullsized":"2023-07-20T11:22:42.547207+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:13:57.158706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547655+0000","last_change":"2023-07-20T11:22:41.566773+0000","last_active":"2023-07-20T11:22:42.547655+0000","last_peered":"2023-07-20T11:22:42.547655+0000","last_clean":"2023-07-20T11:22:42.547655+0000","last_became_active":"2023-07-20T11:22:41.566499+0000","last_became_peered":"2023-07-20T11:22:41.566499+0000","last_unstale":"2023-07-20T11:22:42.547655+0000","last_undegraded":"2023-07-20T11:22:42.547655+0000","last_fullsized":"2023-07-20T11:22:42.547655+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:50:10.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547815+0000","last_change":"2023-07-20T11:22:41.560701+0000","last_active":"2023-07-20T11:22:42.547815+0000","last_peered":"2023-07-20T11:22:42.547815+0000","last_clean":"2023-07-20T11:22:42.547815+0000","last_became_active":"2023-07-20T11:22:41.560447+0000","last_became_peered":"2023-07-20T11:22:41.560447+0000","last_unstale":"2023-07-20T11:22:42.547815+0000","last_undegraded":"2023-07-20T11:22:42.547815+0000","last_fullsized":"2023-07-20T11:22:42.547815+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:48:25.802399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548534+0000","last_change":"2023-07-20T11:22:41.557379+0000","last_active":"2023-07-20T11:22:42.548534+0000","last_peered":"2023-07-20T11:22:42.548534+0000","last_clean":"2023-07-20T11:22:42.548534+0000","last_became_active":"2023-07-20T11:22:41.557053+0000","last_became_peered":"2023-07-20T11:22:41.557053+0000","last_unstale":"2023-07-20T11:22:42.548534+0000","last_undegraded":"2023-07-20T11:22:42.548534+0000","last_fullsized":"2023-07-20T11:22:42.548534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:56:54.442182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374820+0000","last_change":"2023-07-20T11:22:41.564883+0000","last_active":"2023-07-20T11:22:43.374820+0000","last_peered":"2023-07-20T11:22:43.374820+0000","last_clean":"2023-07-20T11:22:43.374820+0000","last_became_active":"2023-07-20T11:22:41.563373+0000","last_became_peered":"2023-07-20T11:22:41.563373+0000","last_unstale":"2023-07-20T11:22:43.374820+0000","last_undegraded":"2023-07-20T11:22:43.374820+0000","last_fullsized":"2023-07-20T11:22:43.374820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:57:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180832+0000","last_change":"2023-07-20T11:22:41.563934+0000","last_active":"2023-07-20T11:22:43.180832+0000","last_peered":"2023-07-20T11:22:43.180832+0000","last_clean":"2023-07-20T11:22:43.180832+0000","last_became_active":"2023-07-20T11:22:41.563663+0000","last_became_peered":"2023-07-20T11:22:41.563663+0000","last_unstale":"2023-07-20T11:22:43.180832+0000","last_undegraded":"2023-07-20T11:22:43.180832+0000","last_fullsized":"2023-07-20T11:22:43.180832+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:07.682937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373649+0000","last_change":"2023-07-20T11:22:41.555926+0000","last_active":"2023-07-20T11:22:43.373649+0000","last_peered":"2023-07-20T11:22:43.373649+0000","last_clean":"2023-07-20T11:22:43.373649+0000","last_became_active":"2023-07-20T11:22:41.555630+0000","last_became_peered":"2023-07-20T11:22:41.555630+0000","last_unstale":"2023-07-20T11:22:43.373649+0000","last_undegraded":"2023-07-20T11:22:43.373649+0000","last_fullsized":"2023-07-20T11:22:43.373649+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:00.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548534+0000","last_change":"2023-07-20T11:22:41.559969+0000","last_active":"2023-07-20T11:22:42.548534+0000","last_peered":"2023-07-20T11:22:42.548534+0000","last_clean":"2023-07-20T11:22:42.548534+0000","last_became_active":"2023-07-20T11:22:41.559658+0000","last_became_peered":"2023-07-20T11:22:41.559658+0000","last_unstale":"2023-07-20T11:22:42.548534+0000","last_undegraded":"2023-07-20T11:22:42.548534+0000","last_fullsized":"2023-07-20T11:22:42.548534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:45:41.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374380+0000","last_change":"2023-07-20T11:22:41.551515+0000","last_active":"2023-07-20T11:22:43.374380+0000","last_peered":"2023-07-20T11:22:43.374380+0000","last_clean":"2023-07-20T11:22:43.374380+0000","last_became_active":"2023-07-20T11:22:41.551188+0000","last_became_peered":"2023-07-20T11:22:41.551188+0000","last_unstale":"2023-07-20T11:22:43.374380+0000","last_undegraded":"2023-07-20T11:22:43.374380+0000","last_fullsized":"2023-07-20T11:22:43.374380+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:19.108042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547786+0000","last_change":"2023-07-20T11:22:41.565999+0000","last_active":"2023-07-20T11:22:42.547786+0000","last_peered":"2023-07-20T11:22:42.547786+0000","last_clean":"2023-07-20T11:22:42.547786+0000","last_became_active":"2023-07-20T11:22:41.565711+0000","last_became_peered":"2023-07-20T11:22:41.565711+0000","last_unstale":"2023-07-20T11:22:42.547786+0000","last_undegraded":"2023-07-20T11:22:42.547786+0000","last_fullsized":"2023-07-20T11:22:42.547786+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:44:14.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095563+0000","last_change":"2023-07-20T11:22:41.568692+0000","last_active":"2023-07-20T11:22:43.095563+0000","last_peered":"2023-07-20T11:22:43.095563+0000","last_clean":"2023-07-20T11:22:43.095563+0000","last_became_active":"2023-07-20T11:22:41.568395+0000","last_became_peered":"2023-07-20T11:22:41.568395+0000","last_unstale":"2023-07-20T11:22:43.095563+0000","last_undegraded":"2023-07-20T11:22:43.095563+0000","last_fullsized":"2023-07-20T11:22:43.095563+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:47:50.213849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548812+0000","last_change":"2023-07-20T11:22:41.567661+0000","last_active":"2023-07-20T11:22:42.548812+0000","last_peered":"2023-07-20T11:22:42.548812+0000","last_clean":"2023-07-20T11:22:42.548812+0000","last_became_active":"2023-07-20T11:22:41.567337+0000","last_became_peered":"2023-07-20T11:22:41.567337+0000","last_unstale":"2023-07-20T11:22:42.548812+0000","last_undegraded":"2023-07-20T11:22:42.548812+0000","last_fullsized":"2023-07-20T11:22:42.548812+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:20.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546883+0000","last_change":"2023-07-20T11:22:41.557102+0000","last_active":"2023-07-20T11:22:42.546883+0000","last_peered":"2023-07-20T11:22:42.546883+0000","last_clean":"2023-07-20T11:22:42.546883+0000","last_became_active":"2023-07-20T11:22:41.556148+0000","last_became_peered":"2023-07-20T11:22:41.556148+0000","last_unstale":"2023-07-20T11:22:42.546883+0000","last_undegraded":"2023-07-20T11:22:42.546883+0000","last_fullsized":"2023-07-20T11:22:42.546883+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:09:50.796241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180934+0000","last_change":"2023-07-20T11:22:41.553254+0000","last_active":"2023-07-20T11:22:43.180934+0000","last_peered":"2023-07-20T11:22:43.180934+0000","last_clean":"2023-07-20T11:22:43.180934+0000","last_became_active":"2023-07-20T11:22:41.552006+0000","last_became_peered":"2023-07-20T11:22:41.552006+0000","last_unstale":"2023-07-20T11:22:43.180934+0000","last_undegraded":"2023-07-20T11:22:43.180934+0000","last_fullsized":"2023-07-20T11:22:43.180934+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:06.395820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374431+0000","last_change":"2023-07-20T11:22:41.567128+0000","last_active":"2023-07-20T11:22:43.374431+0000","last_peered":"2023-07-20T11:22:43.374431+0000","last_clean":"2023-07-20T11:22:43.374431+0000","last_became_active":"2023-07-20T11:22:41.566847+0000","last_became_peered":"2023-07-20T11:22:41.566847+0000","last_unstale":"2023-07-20T11:22:43.374431+0000","last_undegraded":"2023-07-20T11:22:43.374431+0000","last_fullsized":"2023-07-20T11:22:43.374431+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:15:31.821371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373589+0000","last_change":"2023-07-20T11:22:41.563182+0000","last_active":"2023-07-20T11:22:43.373589+0000","last_peered":"2023-07-20T11:22:43.373589+0000","last_clean":"2023-07-20T11:22:43.373589+0000","last_became_active":"2023-07-20T11:22:41.562912+0000","last_became_peered":"2023-07-20T11:22:41.562912+0000","last_unstale":"2023-07-20T11:22:43.373589+0000","last_undegraded":"2023-07-20T11:22:43.373589+0000","last_fullsized":"2023-07-20T11:22:43.373589+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:05:54.089855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374552+0000","last_change":"2023-07-20T11:22:41.551078+0000","last_active":"2023-07-20T11:22:43.374552+0000","last_peered":"2023-07-20T11:22:43.374552+0000","last_clean":"2023-07-20T11:22:43.374552+0000","last_became_active":"2023-07-20T11:22:41.550729+0000","last_became_peered":"2023-07-20T11:22:41.550729+0000","last_unstale":"2023-07-20T11:22:43.374552+0000","last_undegraded":"2023-07-20T11:22:43.374552+0000","last_fullsized":"2023-07-20T11:22:43.374552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:59:20.913546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180862+0000","last_change":"2023-07-20T11:22:41.551001+0000","last_active":"2023-07-20T11:22:43.180862+0000","last_peered":"2023-07-20T11:22:43.180862+0000","last_clean":"2023-07-20T11:22:43.180862+0000","last_became_active":"2023-07-20T11:22:41.550712+0000","last_became_peered":"2023-07-20T11:22:41.550712+0000","last_unstale":"2023-07-20T11:22:43.180862+0000","last_undegraded":"2023-07-20T11:22:43.180862+0000","last_fullsized":"2023-07-20T11:22:43.180862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:28.421601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546893+0000","last_change":"2023-07-20T11:22:41.552092+0000","last_active":"2023-07-20T11:22:42.546893+0000","last_peered":"2023-07-20T11:22:42.546893+0000","last_clean":"2023-07-20T11:22:42.546893+0000","last_became_active":"2023-07-20T11:22:41.551747+0000","last_became_peered":"2023-07-20T11:22:41.551747+0000","last_unstale":"2023-07-20T11:22:42.546893+0000","last_undegraded":"2023-07-20T11:22:42.546893+0000","last_fullsized":"2023-07-20T11:22:42.546893+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:03.179901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375158+0000","last_change":"2023-07-20T11:22:41.567240+0000","last_active":"2023-07-20T11:22:43.375158+0000","last_peered":"2023-07-20T11:22:43.375158+0000","last_clean":"2023-07-20T11:22:43.375158+0000","last_became_active":"2023-07-20T11:22:41.566557+0000","last_became_peered":"2023-07-20T11:22:41.566557+0000","last_unstale":"2023-07-20T11:22:43.375158+0000","last_undegraded":"2023-07-20T11:22:43.375158+0000","last_fullsized":"2023-07-20T11:22:43.375158+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:32:01.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180688+0000","last_change":"2023-07-20T11:22:41.554540+0000","last_active":"2023-07-20T11:22:43.180688+0000","last_peered":"2023-07-20T11:22:43.180688+0000","last_clean":"2023-07-20T11:22:43.180688+0000","last_became_active":"2023-07-20T11:22:41.554038+0000","last_became_peered":"2023-07-20T11:22:41.554038+0000","last_unstale":"2023-07-20T11:22:43.180688+0000","last_undegraded":"2023-07-20T11:22:43.180688+0000","last_fullsized":"2023-07-20T11:22:43.180688+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:29.914002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374515+0000","last_change":"2023-07-20T11:22:41.570510+0000","last_active":"2023-07-20T11:22:43.374515+0000","last_peered":"2023-07-20T11:22:43.374515+0000","last_clean":"2023-07-20T11:22:43.374515+0000","last_became_active":"2023-07-20T11:22:41.570236+0000","last_became_peered":"2023-07-20T11:22:41.570236+0000","last_unstale":"2023-07-20T11:22:43.374515+0000","last_undegraded":"2023-07-20T11:22:43.374515+0000","last_fullsized":"2023-07-20T11:22:43.374515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:52.996996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095515+0000","last_change":"2023-07-20T11:22:41.567843+0000","last_active":"2023-07-20T11:22:43.095515+0000","last_peered":"2023-07-20T11:22:43.095515+0000","last_clean":"2023-07-20T11:22:43.095515+0000","last_became_active":"2023-07-20T11:22:41.567495+0000","last_became_peered":"2023-07-20T11:22:41.567495+0000","last_unstale":"2023-07-20T11:22:43.095515+0000","last_undegraded":"2023-07-20T11:22:43.095515+0000","last_fullsized":"2023-07-20T11:22:43.095515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:34:33.553278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548358+0000","last_change":"2023-07-20T11:22:41.563856+0000","last_active":"2023-07-20T11:22:42.548358+0000","last_peered":"2023-07-20T11:22:42.548358+0000","last_clean":"2023-07-20T11:22:42.548358+0000","last_became_active":"2023-07-20T11:22:41.563412+0000","last_became_peered":"2023-07-20T11:22:41.563412+0000","last_unstale":"2023-07-20T11:22:42.548358+0000","last_undegraded":"2023-07-20T11:22:42.548358+0000","last_fullsized":"2023-07-20T11:22:42.548358+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:57.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095380+0000","last_change":"2023-07-20T11:22:41.570119+0000","last_active":"2023-07-20T11:22:43.095380+0000","last_peered":"2023-07-20T11:22:43.095380+0000","last_clean":"2023-07-20T11:22:43.095380+0000","last_became_active":"2023-07-20T11:22:41.569810+0000","last_became_peered":"2023-07-20T11:22:41.569810+0000","last_unstale":"2023-07-20T11:22:43.095380+0000","last_undegraded":"2023-07-20T11:22:43.095380+0000","last_fullsized":"2023-07-20T11:22:43.095380+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:33:29.347762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374510+0000","last_change":"2023-07-20T11:22:41.569514+0000","last_active":"2023-07-20T11:22:43.374510+0000","last_peered":"2023-07-20T11:22:43.374510+0000","last_clean":"2023-07-20T11:22:43.374510+0000","last_became_active":"2023-07-20T11:22:41.569070+0000","last_became_peered":"2023-07-20T11:22:41.569070+0000","last_unstale":"2023-07-20T11:22:43.374510+0000","last_undegraded":"2023-07-20T11:22:43.374510+0000","last_fullsized":"2023-07-20T11:22:43.374510+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:24.783721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375505+0000","last_change":"2023-07-20T11:22:40.559619+0000","last_active":"2023-07-20T11:22:43.375505+0000","last_peered":"2023-07-20T11:22:43.375505+0000","last_clean":"2023-07-20T11:22:43.375505+0000","last_became_active":"2023-07-20T11:22:40.559314+0000","last_became_peered":"2023-07-20T11:22:40.559314+0000","last_unstale":"2023-07-20T11:22:43.375505+0000","last_undegraded":"2023-07-20T11:22:43.375505+0000","last_fullsized":"2023-07-20T11:22:43.375505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:39:05.714617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180555+0000","last_change":"2023-07-20T11:22:41.563269+0000","last_active":"2023-07-20T11:22:43.180555+0000","last_peered":"2023-07-20T11:22:43.180555+0000","last_clean":"2023-07-20T11:22:43.180555+0000","last_became_active":"2023-07-20T11:22:41.562996+0000","last_became_peered":"2023-07-20T11:22:41.562996+0000","last_unstale":"2023-07-20T11:22:43.180555+0000","last_undegraded":"2023-07-20T11:22:43.180555+0000","last_fullsized":"2023-07-20T11:22:43.180555+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:58:59.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373935+0000","last_change":"2023-07-20T11:22:40.559063+0000","last_active":"2023-07-20T11:22:43.373935+0000","last_peered":"2023-07-20T11:22:43.373935+0000","last_clean":"2023-07-20T11:22:43.373935+0000","last_became_active":"2023-07-20T11:22:40.558758+0000","last_became_peered":"2023-07-20T11:22:40.558758+0000","last_unstale":"2023-07-20T11:22:43.373935+0000","last_undegraded":"2023-07-20T11:22:43.373935+0000","last_fullsized":"2023-07-20T11:22:43.373935+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:59.628861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373714+0000","last_change":"2023-07-20T11:22:41.553377+0000","last_active":"2023-07-20T11:22:43.373714+0000","last_peered":"2023-07-20T11:22:43.373714+0000","last_clean":"2023-07-20T11:22:43.373714+0000","last_became_active":"2023-07-20T11:22:41.553116+0000","last_became_peered":"2023-07-20T11:22:41.553116+0000","last_unstale":"2023-07-20T11:22:43.373714+0000","last_undegraded":"2023-07-20T11:22:43.373714+0000","last_fullsized":"2023-07-20T11:22:43.373714+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:21:13.969259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548658+0000","last_change":"2023-07-20T11:22:40.549010+0000","last_active":"2023-07-20T11:22:42.548658+0000","last_peered":"2023-07-20T11:22:42.548658+0000","last_clean":"2023-07-20T11:22:42.548658+0000","last_became_active":"2023-07-20T11:22:40.548728+0000","last_became_peered":"2023-07-20T11:22:40.548728+0000","last_unstale":"2023-07-20T11:22:42.548658+0000","last_undegraded":"2023-07-20T11:22:42.548658+0000","last_fullsized":"2023-07-20T11:22:42.548658+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:36:31.565617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374969+0000","last_change":"2023-07-20T11:22:41.567021+0000","last_active":"2023-07-20T11:22:43.374969+0000","last_peered":"2023-07-20T11:22:43.374969+0000","last_clean":"2023-07-20T11:22:43.374969+0000","last_became_active":"2023-07-20T11:22:41.566743+0000","last_became_peered":"2023-07-20T11:22:41.566743+0000","last_unstale":"2023-07-20T11:22:43.374969+0000","last_undegraded":"2023-07-20T11:22:43.374969+0000","last_fullsized":"2023-07-20T11:22:43.374969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:47.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546682+0000","last_change":"2023-07-20T11:22:40.551321+0000","last_active":"2023-07-20T11:22:42.546682+0000","last_peered":"2023-07-20T11:22:42.546682+0000","last_clean":"2023-07-20T11:22:42.546682+0000","last_became_active":"2023-07-20T11:22:40.551064+0000","last_became_peered":"2023-07-20T11:22:40.551064+0000","last_unstale":"2023-07-20T11:22:42.546682+0000","last_undegraded":"2023-07-20T11:22:42.546682+0000","last_fullsized":"2023-07-20T11:22:42.546682+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:47.872799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547488+0000","last_change":"2023-07-20T11:22:41.557278+0000","last_active":"2023-07-20T11:22:42.547488+0000","last_peered":"2023-07-20T11:22:42.547488+0000","last_clean":"2023-07-20T11:22:42.547488+0000","last_became_active":"2023-07-20T11:22:41.556989+0000","last_became_peered":"2023-07-20T11:22:41.556989+0000","last_unstale":"2023-07-20T11:22:42.547488+0000","last_undegraded":"2023-07-20T11:22:42.547488+0000","last_fullsized":"2023-07-20T11:22:42.547488+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:36.457083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547579+0000","last_change":"2023-07-20T11:22:40.557161+0000","last_active":"2023-07-20T11:22:42.547579+0000","last_peered":"2023-07-20T11:22:42.547579+0000","last_clean":"2023-07-20T11:22:42.547579+0000","last_became_active":"2023-07-20T11:22:40.556911+0000","last_became_peered":"2023-07-20T11:22:40.556911+0000","last_unstale":"2023-07-20T11:22:42.547579+0000","last_undegraded":"2023-07-20T11:22:42.547579+0000","last_fullsized":"2023-07-20T11:22:42.547579+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:51:18.112175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546614+0000","last_change":"2023-07-20T11:22:41.547304+0000","last_active":"2023-07-20T11:22:42.546614+0000","last_peered":"2023-07-20T11:22:42.546614+0000","last_clean":"2023-07-20T11:22:42.546614+0000","last_became_active":"2023-07-20T11:22:41.546997+0000","last_became_peered":"2023-07-20T11:22:41.546997+0000","last_unstale":"2023-07-20T11:22:42.546614+0000","last_undegraded":"2023-07-20T11:22:42.546614+0000","last_fullsized":"2023-07-20T11:22:42.546614+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:00:00.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373764+0000","last_change":"2023-07-20T11:22:40.561910+0000","last_active":"2023-07-20T11:22:43.373764+0000","last_peered":"2023-07-20T11:22:43.373764+0000","last_clean":"2023-07-20T11:22:43.373764+0000","last_became_active":"2023-07-20T11:22:40.561553+0000","last_became_peered":"2023-07-20T11:22:40.561553+0000","last_unstale":"2023-07-20T11:22:43.373764+0000","last_undegraded":"2023-07-20T11:22:43.373764+0000","last_fullsized":"2023-07-20T11:22:43.373764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:09:32.529464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546946+0000","last_change":"2023-07-20T11:22:41.563461+0000","last_active":"2023-07-20T11:22:42.546946+0000","last_peered":"2023-07-20T11:22:42.546946+0000","last_clean":"2023-07-20T11:22:42.546946+0000","last_became_active":"2023-07-20T11:22:41.563178+0000","last_became_peered":"2023-07-20T11:22:41.563178+0000","last_unstale":"2023-07-20T11:22:42.546946+0000","last_undegraded":"2023-07-20T11:22:42.546946+0000","last_fullsized":"2023-07-20T11:22:42.546946+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:26:34.465098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546233+0000","last_change":"2023-07-20T11:22:40.556159+0000","last_active":"2023-07-20T11:22:42.546233+0000","last_peered":"2023-07-20T11:22:42.546233+0000","last_clean":"2023-07-20T11:22:42.546233+0000","last_became_active":"2023-07-20T11:22:40.555525+0000","last_became_peered":"2023-07-20T11:22:40.555525+0000","last_unstale":"2023-07-20T11:22:42.546233+0000","last_undegraded":"2023-07-20T11:22:42.546233+0000","last_fullsized":"2023-07-20T11:22:42.546233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:53:08.070100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375499+0000","last_change":"2023-07-20T11:22:41.549225+0000","last_active":"2023-07-20T11:22:43.375499+0000","last_peered":"2023-07-20T11:22:43.375499+0000","last_clean":"2023-07-20T11:22:43.375499+0000","last_became_active":"2023-07-20T11:22:41.548891+0000","last_became_peered":"2023-07-20T11:22:41.548891+0000","last_unstale":"2023-07-20T11:22:43.375499+0000","last_undegraded":"2023-07-20T11:22:43.375499+0000","last_fullsized":"2023-07-20T11:22:43.375499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:54:38.898126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547359+0000","last_change":"2023-07-20T11:22:40.558492+0000","last_active":"2023-07-20T11:22:42.547359+0000","last_peered":"2023-07-20T11:22:42.547359+0000","last_clean":"2023-07-20T11:22:42.547359+0000","last_became_active":"2023-07-20T11:22:40.558183+0000","last_became_peered":"2023-07-20T11:22:40.558183+0000","last_unstale":"2023-07-20T11:22:42.547359+0000","last_undegraded":"2023-07-20T11:22:42.547359+0000","last_fullsized":"2023-07-20T11:22:42.547359+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:57:28.350454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547270+0000","last_change":"2023-07-20T11:22:41.562417+0000","last_active":"2023-07-20T11:22:42.547270+0000","last_peered":"2023-07-20T11:22:42.547270+0000","last_clean":"2023-07-20T11:22:42.547270+0000","last_became_active":"2023-07-20T11:22:41.559220+0000","last_became_peered":"2023-07-20T11:22:41.559220+0000","last_unstale":"2023-07-20T11:22:42.547270+0000","last_undegraded":"2023-07-20T11:22:42.547270+0000","last_fullsized":"2023-07-20T11:22:42.547270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:01:42.443859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180924+0000","last_change":"2023-07-20T11:22:40.558113+0000","last_active":"2023-07-20T11:22:43.180924+0000","last_peered":"2023-07-20T11:22:43.180924+0000","last_clean":"2023-07-20T11:22:43.180924+0000","last_became_active":"2023-07-20T11:22:40.557667+0000","last_became_peered":"2023-07-20T11:22:40.557667+0000","last_unstale":"2023-07-20T11:22:43.180924+0000","last_undegraded":"2023-07-20T11:22:43.180924+0000","last_fullsized":"2023-07-20T11:22:43.180924+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:48:11.926489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095482+0000","last_change":"2023-07-20T11:22:41.562515+0000","last_active":"2023-07-20T11:22:43.095482+0000","last_peered":"2023-07-20T11:22:43.095482+0000","last_clean":"2023-07-20T11:22:43.095482+0000","last_became_active":"2023-07-20T11:22:41.561863+0000","last_became_peered":"2023-07-20T11:22:41.561863+0000","last_unstale":"2023-07-20T11:22:43.095482+0000","last_undegraded":"2023-07-20T11:22:43.095482+0000","last_fullsized":"2023-07-20T11:22:43.095482+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:20:41.049918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547857+0000","last_change":"2023-07-20T11:22:40.554870+0000","last_active":"2023-07-20T11:22:42.547857+0000","last_peered":"2023-07-20T11:22:42.547857+0000","last_clean":"2023-07-20T11:22:42.547857+0000","last_became_active":"2023-07-20T11:22:40.552078+0000","last_became_peered":"2023-07-20T11:22:40.552078+0000","last_unstale":"2023-07-20T11:22:42.547857+0000","last_undegraded":"2023-07-20T11:22:42.547857+0000","last_fullsized":"2023-07-20T11:22:42.547857+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:16.188698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548405+0000","last_change":"2023-07-20T11:22:41.553677+0000","last_active":"2023-07-20T11:22:42.548405+0000","last_peered":"2023-07-20T11:22:42.548405+0000","last_clean":"2023-07-20T11:22:42.548405+0000","last_became_active":"2023-07-20T11:22:41.553030+0000","last_became_peered":"2023-07-20T11:22:41.553030+0000","last_unstale":"2023-07-20T11:22:42.548405+0000","last_undegraded":"2023-07-20T11:22:42.548405+0000","last_fullsized":"2023-07-20T11:22:42.548405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:08:29.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374076+0000","last_change":"2023-07-20T11:22:40.553623+0000","last_active":"2023-07-20T11:22:43.374076+0000","last_peered":"2023-07-20T11:22:43.374076+0000","last_clean":"2023-07-20T11:22:43.374076+0000","last_became_active":"2023-07-20T11:22:40.553293+0000","last_became_peered":"2023-07-20T11:22:40.553293+0000","last_unstale":"2023-07-20T11:22:43.374076+0000","last_undegraded":"2023-07-20T11:22:43.374076+0000","last_fullsized":"2023-07-20T11:22:43.374076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:48.527972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548675+0000","last_change":"2023-07-20T11:22:41.557599+0000","last_active":"2023-07-20T11:22:42.548675+0000","last_peered":"2023-07-20T11:22:42.548675+0000","last_clean":"2023-07-20T11:22:42.548675+0000","last_became_active":"2023-07-20T11:22:41.557282+0000","last_became_peered":"2023-07-20T11:22:41.557282+0000","last_unstale":"2023-07-20T11:22:42.548675+0000","last_undegraded":"2023-07-20T11:22:42.548675+0000","last_fullsized":"2023-07-20T11:22:42.548675+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:17.757167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547473+0000","last_change":"2023-07-20T11:22:40.557130+0000","last_active":"2023-07-20T11:22:42.547473+0000","last_peered":"2023-07-20T11:22:42.547473+0000","last_clean":"2023-07-20T11:22:42.547473+0000","last_became_active":"2023-07-20T11:22:40.556844+0000","last_became_peered":"2023-07-20T11:22:40.556844+0000","last_unstale":"2023-07-20T11:22:42.547473+0000","last_undegraded":"2023-07-20T11:22:42.547473+0000","last_fullsized":"2023-07-20T11:22:42.547473+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:44.887706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.181000+0000","last_change":"2023-07-20T11:22:41.554372+0000","last_active":"2023-07-20T11:22:43.181000+0000","last_peered":"2023-07-20T11:22:43.181000+0000","last_clean":"2023-07-20T11:22:43.181000+0000","last_became_active":"2023-07-20T11:22:41.553688+0000","last_became_peered":"2023-07-20T11:22:41.553688+0000","last_unstale":"2023-07-20T11:22:43.181000+0000","last_undegraded":"2023-07-20T11:22:43.181000+0000","last_fullsized":"2023-07-20T11:22:43.181000+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:18.383391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373921+0000","last_change":"2023-07-20T11:22:40.553901+0000","last_active":"2023-07-20T11:22:43.373921+0000","last_peered":"2023-07-20T11:22:43.373921+0000","last_clean":"2023-07-20T11:22:43.373921+0000","last_became_active":"2023-07-20T11:22:40.553629+0000","last_became_peered":"2023-07-20T11:22:40.553629+0000","last_unstale":"2023-07-20T11:22:43.373921+0000","last_undegraded":"2023-07-20T11:22:43.373921+0000","last_fullsized":"2023-07-20T11:22:43.373921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:18.155094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374150+0000","last_change":"2023-07-20T11:22:41.566474+0000","last_active":"2023-07-20T11:22:43.374150+0000","last_peered":"2023-07-20T11:22:43.374150+0000","last_clean":"2023-07-20T11:22:43.374150+0000","last_became_active":"2023-07-20T11:22:41.566184+0000","last_became_peered":"2023-07-20T11:22:41.566184+0000","last_unstale":"2023-07-20T11:22:43.374150+0000","last_undegraded":"2023-07-20T11:22:43.374150+0000","last_fullsized":"2023-07-20T11:22:43.374150+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:06.709098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548243+0000","last_change":"2023-07-20T11:22:40.560455+0000","last_active":"2023-07-20T11:22:42.548243+0000","last_peered":"2023-07-20T11:22:42.548243+0000","last_clean":"2023-07-20T11:22:42.548243+0000","last_became_active":"2023-07-20T11:22:40.560171+0000","last_became_peered":"2023-07-20T11:22:40.560171+0000","last_unstale":"2023-07-20T11:22:42.548243+0000","last_undegraded":"2023-07-20T11:22:42.548243+0000","last_fullsized":"2023-07-20T11:22:42.548243+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:54.347270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373938+0000","last_change":"2023-07-20T11:22:41.558702+0000","last_active":"2023-07-20T11:22:43.373938+0000","last_peered":"2023-07-20T11:22:43.373938+0000","last_clean":"2023-07-20T11:22:43.373938+0000","last_became_active":"2023-07-20T11:22:41.558426+0000","last_became_peered":"2023-07-20T11:22:41.558426+0000","last_unstale":"2023-07-20T11:22:43.373938+0000","last_undegraded":"2023-07-20T11:22:43.373938+0000","last_fullsized":"2023-07-20T11:22:43.373938+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:00.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546329+0000","last_change":"2023-07-20T11:22:40.548690+0000","last_active":"2023-07-20T11:22:42.546329+0000","last_peered":"2023-07-20T11:22:42.546329+0000","last_clean":"2023-07-20T11:22:42.546329+0000","last_became_active":"2023-07-20T11:22:40.548424+0000","last_became_peered":"2023-07-20T11:22:40.548424+0000","last_unstale":"2023-07-20T11:22:42.546329+0000","last_undegraded":"2023-07-20T11:22:42.546329+0000","last_fullsized":"2023-07-20T11:22:42.546329+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:58.331251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375207+0000","last_change":"2023-07-20T11:22:41.564122+0000","last_active":"2023-07-20T11:22:43.375207+0000","last_peered":"2023-07-20T11:22:43.375207+0000","last_clean":"2023-07-20T11:22:43.375207+0000","last_became_active":"2023-07-20T11:22:41.563849+0000","last_became_peered":"2023-07-20T11:22:41.563849+0000","last_unstale":"2023-07-20T11:22:43.375207+0000","last_undegraded":"2023-07-20T11:22:43.375207+0000","last_fullsized":"2023-07-20T11:22:43.375207+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:47.324411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374491+0000","last_change":"2023-07-20T11:22:40.550981+0000","last_active":"2023-07-20T11:22:43.374491+0000","last_peered":"2023-07-20T11:22:43.374491+0000","last_clean":"2023-07-20T11:22:43.374491+0000","last_became_active":"2023-07-20T11:22:40.550699+0000","last_became_peered":"2023-07-20T11:22:40.550699+0000","last_unstale":"2023-07-20T11:22:43.374491+0000","last_undegraded":"2023-07-20T11:22:43.374491+0000","last_fullsized":"2023-07-20T11:22:43.374491+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:40.980329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548288+0000","last_change":"2023-07-20T11:22:41.562400+0000","last_active":"2023-07-20T11:22:42.548288+0000","last_peered":"2023-07-20T11:22:42.548288+0000","last_clean":"2023-07-20T11:22:42.548288+0000","last_became_active":"2023-07-20T11:22:41.562101+0000","last_became_peered":"2023-07-20T11:22:41.562101+0000","last_unstale":"2023-07-20T11:22:42.548288+0000","last_undegraded":"2023-07-20T11:22:42.548288+0000","last_fullsized":"2023-07-20T11:22:42.548288+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:20.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373969+0000","last_change":"2023-07-20T11:22:40.548110+0000","last_active":"2023-07-20T11:22:43.373969+0000","last_peered":"2023-07-20T11:22:43.373969+0000","last_clean":"2023-07-20T11:22:43.373969+0000","last_became_active":"2023-07-20T11:22:40.547800+0000","last_became_peered":"2023-07-20T11:22:40.547800+0000","last_unstale":"2023-07-20T11:22:43.373969+0000","last_undegraded":"2023-07-20T11:22:43.373969+0000","last_fullsized":"2023-07-20T11:22:43.373969+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:24.762948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548049+0000","last_change":"2023-07-20T11:22:41.561763+0000","last_active":"2023-07-20T11:22:42.548049+0000","last_peered":"2023-07-20T11:22:42.548049+0000","last_clean":"2023-07-20T11:22:42.548049+0000","last_became_active":"2023-07-20T11:22:41.561496+0000","last_became_peered":"2023-07-20T11:22:41.561496+0000","last_unstale":"2023-07-20T11:22:42.548049+0000","last_undegraded":"2023-07-20T11:22:42.548049+0000","last_fullsized":"2023-07-20T11:22:42.548049+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:30.514969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.181013+0000","last_change":"2023-07-20T11:22:40.560542+0000","last_active":"2023-07-20T11:22:43.181013+0000","last_peered":"2023-07-20T11:22:43.181013+0000","last_clean":"2023-07-20T11:22:43.181013+0000","last_became_active":"2023-07-20T11:22:40.559913+0000","last_became_peered":"2023-07-20T11:22:40.559913+0000","last_unstale":"2023-07-20T11:22:43.181013+0000","last_undegraded":"2023-07-20T11:22:43.181013+0000","last_fullsized":"2023-07-20T11:22:43.181013+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:55:02.238246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546514+0000","last_change":"2023-07-20T11:22:41.562267+0000","last_active":"2023-07-20T11:22:42.546514+0000","last_peered":"2023-07-20T11:22:42.546514+0000","last_clean":"2023-07-20T11:22:42.546514+0000","last_became_active":"2023-07-20T11:22:41.561968+0000","last_became_peered":"2023-07-20T11:22:41.561968+0000","last_unstale":"2023-07-20T11:22:42.546514+0000","last_undegraded":"2023-07-20T11:22:42.546514+0000","last_fullsized":"2023-07-20T11:22:42.546514+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:03:59.345899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180751+0000","last_change":"2023-07-20T11:22:40.559588+0000","last_active":"2023-07-20T11:22:43.180751+0000","last_peered":"2023-07-20T11:22:43.180751+0000","last_clean":"2023-07-20T11:22:43.180751+0000","last_became_active":"2023-07-20T11:22:40.559296+0000","last_became_peered":"2023-07-20T11:22:40.559296+0000","last_unstale":"2023-07-20T11:22:43.180751+0000","last_undegraded":"2023-07-20T11:22:43.180751+0000","last_fullsized":"2023-07-20T11:22:43.180751+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:00:39.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547499+0000","last_change":"2023-07-20T11:22:41.558629+0000","last_active":"2023-07-20T11:22:42.547499+0000","last_peered":"2023-07-20T11:22:42.547499+0000","last_clean":"2023-07-20T11:22:42.547499+0000","last_became_active":"2023-07-20T11:22:41.558351+0000","last_became_peered":"2023-07-20T11:22:41.558351+0000","last_unstale":"2023-07-20T11:22:42.547499+0000","last_undegraded":"2023-07-20T11:22:42.547499+0000","last_fullsized":"2023-07-20T11:22:42.547499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:44.399299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546813+0000","last_change":"2023-07-20T11:22:40.552324+0000","last_active":"2023-07-20T11:22:42.546813+0000","last_peered":"2023-07-20T11:22:42.546813+0000","last_clean":"2023-07-20T11:22:42.546813+0000","last_became_active":"2023-07-20T11:22:40.551797+0000","last_became_peered":"2023-07-20T11:22:40.551797+0000","last_unstale":"2023-07-20T11:22:42.546813+0000","last_undegraded":"2023-07-20T11:22:42.546813+0000","last_fullsized":"2023-07-20T11:22:42.546813+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:01.387946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375156+0000","last_change":"2023-07-20T11:22:41.559002+0000","last_active":"2023-07-20T11:22:43.375156+0000","last_peered":"2023-07-20T11:22:43.375156+0000","last_clean":"2023-07-20T11:22:43.375156+0000","last_became_active":"2023-07-20T11:22:41.558698+0000","last_became_peered":"2023-07-20T11:22:41.558698+0000","last_unstale":"2023-07-20T11:22:43.375156+0000","last_undegraded":"2023-07-20T11:22:43.375156+0000","last_fullsized":"2023-07-20T11:22:43.375156+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:23:44.731539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374520+0000","last_change":"2023-07-20T11:22:40.553603+0000","last_active":"2023-07-20T11:22:43.374520+0000","last_peered":"2023-07-20T11:22:43.374520+0000","last_clean":"2023-07-20T11:22:43.374520+0000","last_became_active":"2023-07-20T11:22:40.553321+0000","last_became_peered":"2023-07-20T11:22:40.553321+0000","last_unstale":"2023-07-20T11:22:43.374520+0000","last_undegraded":"2023-07-20T11:22:43.374520+0000","last_fullsized":"2023-07-20T11:22:43.374520+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:25.972677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375315+0000","last_change":"2023-07-20T11:22:41.566556+0000","last_active":"2023-07-20T11:22:43.375315+0000","last_peered":"2023-07-20T11:22:43.375315+0000","last_clean":"2023-07-20T11:22:43.375315+0000","last_became_active":"2023-07-20T11:22:41.566151+0000","last_became_peered":"2023-07-20T11:22:41.566151+0000","last_unstale":"2023-07-20T11:22:43.375315+0000","last_undegraded":"2023-07-20T11:22:43.375315+0000","last_fullsized":"2023-07-20T11:22:43.375315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:54:26.130001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180810+0000","last_change":"2023-07-20T11:22:40.559775+0000","last_active":"2023-07-20T11:22:43.180810+0000","last_peered":"2023-07-20T11:22:43.180810+0000","last_clean":"2023-07-20T11:22:43.180810+0000","last_became_active":"2023-07-20T11:22:40.559477+0000","last_became_peered":"2023-07-20T11:22:40.559477+0000","last_unstale":"2023-07-20T11:22:43.180810+0000","last_undegraded":"2023-07-20T11:22:43.180810+0000","last_fullsized":"2023-07-20T11:22:43.180810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:21.072552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180994+0000","last_change":"2023-07-20T11:22:41.552796+0000","last_active":"2023-07-20T11:22:43.180994+0000","last_peered":"2023-07-20T11:22:43.180994+0000","last_clean":"2023-07-20T11:22:43.180994+0000","last_became_active":"2023-07-20T11:22:41.552411+0000","last_became_peered":"2023-07-20T11:22:41.552411+0000","last_unstale":"2023-07-20T11:22:43.180994+0000","last_undegraded":"2023-07-20T11:22:43.180994+0000","last_fullsized":"2023-07-20T11:22:43.180994+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:23:37.385636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548652+0000","last_change":"2023-07-20T11:22:40.552210+0000","last_active":"2023-07-20T11:22:42.548652+0000","last_peered":"2023-07-20T11:22:42.548652+0000","last_clean":"2023-07-20T11:22:42.548652+0000","last_became_active":"2023-07-20T11:22:40.551912+0000","last_became_peered":"2023-07-20T11:22:40.551912+0000","last_unstale":"2023-07-20T11:22:42.548652+0000","last_undegraded":"2023-07-20T11:22:42.548652+0000","last_fullsized":"2023-07-20T11:22:42.548652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:33:31.655579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546765+0000","last_change":"2023-07-20T11:22:41.556923+0000","last_active":"2023-07-20T11:22:42.546765+0000","last_peered":"2023-07-20T11:22:42.546765+0000","last_clean":"2023-07-20T11:22:42.546765+0000","last_became_active":"2023-07-20T11:22:41.556599+0000","last_became_peered":"2023-07-20T11:22:41.556599+0000","last_unstale":"2023-07-20T11:22:42.546765+0000","last_undegraded":"2023-07-20T11:22:42.546765+0000","last_fullsized":"2023-07-20T11:22:42.546765+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:45.436390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373448+0000","last_change":"2023-07-20T11:22:40.550068+0000","last_active":"2023-07-20T11:22:43.373448+0000","last_peered":"2023-07-20T11:22:43.373448+0000","last_clean":"2023-07-20T11:22:43.373448+0000","last_became_active":"2023-07-20T11:22:40.549807+0000","last_became_peered":"2023-07-20T11:22:40.549807+0000","last_unstale":"2023-07-20T11:22:43.373448+0000","last_undegraded":"2023-07-20T11:22:43.373448+0000","last_fullsized":"2023-07-20T11:22:43.373448+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:54:31.659494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374815+0000","last_change":"2023-07-20T11:22:41.563561+0000","last_active":"2023-07-20T11:22:43.374815+0000","last_peered":"2023-07-20T11:22:43.374815+0000","last_clean":"2023-07-20T11:22:43.374815+0000","last_became_active":"2023-07-20T11:22:41.563231+0000","last_became_peered":"2023-07-20T11:22:41.563231+0000","last_unstale":"2023-07-20T11:22:43.374815+0000","last_undegraded":"2023-07-20T11:22:43.374815+0000","last_fullsized":"2023-07-20T11:22:43.374815+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:56.238968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180909+0000","last_change":"2023-07-20T11:22:40.560833+0000","last_active":"2023-07-20T11:22:43.180909+0000","last_peered":"2023-07-20T11:22:43.180909+0000","last_clean":"2023-07-20T11:22:43.180909+0000","last_became_active":"2023-07-20T11:22:40.560271+0000","last_became_peered":"2023-07-20T11:22:40.560271+0000","last_unstale":"2023-07-20T11:22:43.180909+0000","last_undegraded":"2023-07-20T11:22:43.180909+0000","last_fullsized":"2023-07-20T11:22:43.180909+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:44:55.154574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"179'304","reported_seq":1169,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374710+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:22:43.374710+0000","last_peered":"2023-07-20T11:22:43.374710+0000","last_clean":"2023-07-20T11:22:43.374710+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:22:43.374710+0000","last_undegraded":"2023-07-20T11:22:43.374710+0000","last_fullsized":"2023-07-20T11:22:43.374710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:04:11.034570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":389,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548819+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:22:42.548819+0000","last_peered":"2023-07-20T11:22:42.548819+0000","last_clean":"2023-07-20T11:22:42.548819+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:22:42.548819+0000","last_undegraded":"2023-07-20T11:22:42.548819+0000","last_fullsized":"2023-07-20T11:22:42.548819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:32.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180567+0000","last_change":"2023-07-20T11:22:41.558895+0000","last_active":"2023-07-20T11:22:43.180567+0000","last_peered":"2023-07-20T11:22:43.180567+0000","last_clean":"2023-07-20T11:22:43.180567+0000","last_became_active":"2023-07-20T11:22:41.558622+0000","last_became_peered":"2023-07-20T11:22:41.558622+0000","last_unstale":"2023-07-20T11:22:43.180567+0000","last_undegraded":"2023-07-20T11:22:43.180567+0000","last_fullsized":"2023-07-20T11:22:43.180567+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:02.282109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374976+0000","last_change":"2023-07-20T11:22:40.556935+0000","last_active":"2023-07-20T11:22:43.374976+0000","last_peered":"2023-07-20T11:22:43.374976+0000","last_clean":"2023-07-20T11:22:43.374976+0000","last_became_active":"2023-07-20T11:22:40.556592+0000","last_became_peered":"2023-07-20T11:22:40.556592+0000","last_unstale":"2023-07-20T11:22:43.374976+0000","last_undegraded":"2023-07-20T11:22:43.374976+0000","last_fullsized":"2023-07-20T11:22:43.374976+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:51:43.787627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":350,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374659+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:22:43.374659+0000","last_peered":"2023-07-20T11:22:43.374659+0000","last_clean":"2023-07-20T11:22:43.374659+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:22:43.374659+0000","last_undegraded":"2023-07-20T11:22:43.374659+0000","last_fullsized":"2023-07-20T11:22:43.374659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:36:48.281254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546777+0000","last_change":"2023-07-20T11:22:41.556908+0000","last_active":"2023-07-20T11:22:42.546777+0000","last_peered":"2023-07-20T11:22:42.546777+0000","last_clean":"2023-07-20T11:22:42.546777+0000","last_became_active":"2023-07-20T11:22:41.556566+0000","last_became_peered":"2023-07-20T11:22:41.556566+0000","last_unstale":"2023-07-20T11:22:42.546777+0000","last_undegraded":"2023-07-20T11:22:42.546777+0000","last_fullsized":"2023-07-20T11:22:42.546777+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:55.737230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180823+0000","last_change":"2023-07-20T11:22:40.562270+0000","last_active":"2023-07-20T11:22:43.180823+0000","last_peered":"2023-07-20T11:22:43.180823+0000","last_clean":"2023-07-20T11:22:43.180823+0000","last_became_active":"2023-07-20T11:22:40.562015+0000","last_became_peered":"2023-07-20T11:22:40.562015+0000","last_unstale":"2023-07-20T11:22:43.180823+0000","last_undegraded":"2023-07-20T11:22:43.180823+0000","last_fullsized":"2023-07-20T11:22:43.180823+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:02:41.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":379,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546579+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:22:42.546579+0000","last_peered":"2023-07-20T11:22:42.546579+0000","last_clean":"2023-07-20T11:22:42.546579+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:22:42.546579+0000","last_undegraded":"2023-07-20T11:22:42.546579+0000","last_fullsized":"2023-07-20T11:22:42.546579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:26:53.349255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374278+0000","last_change":"2023-07-20T11:22:41.569320+0000","last_active":"2023-07-20T11:22:43.374278+0000","last_peered":"2023-07-20T11:22:43.374278+0000","last_clean":"2023-07-20T11:22:43.374278+0000","last_became_active":"2023-07-20T11:22:41.568716+0000","last_became_peered":"2023-07-20T11:22:41.568716+0000","last_unstale":"2023-07-20T11:22:43.374278+0000","last_undegraded":"2023-07-20T11:22:43.374278+0000","last_fullsized":"2023-07-20T11:22:43.374278+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:02:33.349639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180767+0000","last_change":"2023-07-20T11:22:40.557927+0000","last_active":"2023-07-20T11:22:43.180767+0000","last_peered":"2023-07-20T11:22:43.180767+0000","last_clean":"2023-07-20T11:22:43.180767+0000","last_became_active":"2023-07-20T11:22:40.557369+0000","last_became_peered":"2023-07-20T11:22:40.557369+0000","last_unstale":"2023-07-20T11:22:43.180767+0000","last_undegraded":"2023-07-20T11:22:43.180767+0000","last_fullsized":"2023-07-20T11:22:43.180767+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:02.999078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":389,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548407+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:22:42.548407+0000","last_peered":"2023-07-20T11:22:42.548407+0000","last_clean":"2023-07-20T11:22:42.548407+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:22:42.548407+0000","last_undegraded":"2023-07-20T11:22:42.548407+0000","last_fullsized":"2023-07-20T11:22:42.548407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:32.031416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548579+0000","last_change":"2023-07-20T11:22:41.565114+0000","last_active":"2023-07-20T11:22:42.548579+0000","last_peered":"2023-07-20T11:22:42.548579+0000","last_clean":"2023-07-20T11:22:42.548579+0000","last_became_active":"2023-07-20T11:22:41.564820+0000","last_became_peered":"2023-07-20T11:22:41.564820+0000","last_unstale":"2023-07-20T11:22:42.548579+0000","last_undegraded":"2023-07-20T11:22:42.548579+0000","last_fullsized":"2023-07-20T11:22:42.548579+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:19:11.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548451+0000","last_change":"2023-07-20T11:22:40.552239+0000","last_active":"2023-07-20T11:22:42.548451+0000","last_peered":"2023-07-20T11:22:42.548451+0000","last_clean":"2023-07-20T11:22:42.548451+0000","last_became_active":"2023-07-20T11:22:40.551959+0000","last_became_peered":"2023-07-20T11:22:40.551959+0000","last_unstale":"2023-07-20T11:22:42.548451+0000","last_undegraded":"2023-07-20T11:22:42.548451+0000","last_fullsized":"2023-07-20T11:22:42.548451+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:51.067178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":347,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547595+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:22:42.547595+0000","last_peered":"2023-07-20T11:22:42.547595+0000","last_clean":"2023-07-20T11:22:42.547595+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:22:42.547595+0000","last_undegraded":"2023-07-20T11:22:42.547595+0000","last_fullsized":"2023-07-20T11:22:42.547595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:26.151471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546638+0000","last_change":"2023-07-20T11:22:41.555526+0000","last_active":"2023-07-20T11:22:42.546638+0000","last_peered":"2023-07-20T11:22:42.546638+0000","last_clean":"2023-07-20T11:22:42.546638+0000","last_became_active":"2023-07-20T11:22:41.551781+0000","last_became_peered":"2023-07-20T11:22:41.551781+0000","last_unstale":"2023-07-20T11:22:42.546638+0000","last_undegraded":"2023-07-20T11:22:42.546638+0000","last_fullsized":"2023-07-20T11:22:42.546638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:06:40.311813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":21,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547301+0000","last_change":"2023-07-20T11:22:40.558450+0000","last_active":"2023-07-20T11:22:42.547301+0000","last_peered":"2023-07-20T11:22:42.547301+0000","last_clean":"2023-07-20T11:22:42.547301+0000","last_became_active":"2023-07-20T11:22:40.557826+0000","last_became_peered":"2023-07-20T11:22:40.557826+0000","last_unstale":"2023-07-20T11:22:42.547301+0000","last_undegraded":"2023-07-20T11:22:42.547301+0000","last_fullsized":"2023-07-20T11:22:42.547301+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:59.709209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":349,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375317+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:22:43.375317+0000","last_peered":"2023-07-20T11:22:43.375317+0000","last_clean":"2023-07-20T11:22:43.375317+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:22:43.375317+0000","last_undegraded":"2023-07-20T11:22:43.375317+0000","last_fullsized":"2023-07-20T11:22:43.375317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:25.898378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095394+0000","last_change":"2023-07-20T11:22:41.564671+0000","last_active":"2023-07-20T11:22:43.095394+0000","last_peered":"2023-07-20T11:22:43.095394+0000","last_clean":"2023-07-20T11:22:43.095394+0000","last_became_active":"2023-07-20T11:22:41.564382+0000","last_became_peered":"2023-07-20T11:22:41.564382+0000","last_unstale":"2023-07-20T11:22:43.095394+0000","last_undegraded":"2023-07-20T11:22:43.095394+0000","last_fullsized":"2023-07-20T11:22:43.095394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:40.678023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373925+0000","last_change":"2023-07-20T11:22:40.551206+0000","last_active":"2023-07-20T11:22:43.373925+0000","last_peered":"2023-07-20T11:22:43.373925+0000","last_clean":"2023-07-20T11:22:43.373925+0000","last_became_active":"2023-07-20T11:22:40.550900+0000","last_became_peered":"2023-07-20T11:22:40.550900+0000","last_unstale":"2023-07-20T11:22:43.373925+0000","last_undegraded":"2023-07-20T11:22:43.373925+0000","last_fullsized":"2023-07-20T11:22:43.373925+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:04.209476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":345,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547966+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:22:42.547966+0000","last_peered":"2023-07-20T11:22:42.547966+0000","last_clean":"2023-07-20T11:22:42.547966+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:22:42.547966+0000","last_undegraded":"2023-07-20T11:22:42.547966+0000","last_fullsized":"2023-07-20T11:22:42.547966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:37.402408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547921+0000","last_change":"2023-07-20T11:22:41.567829+0000","last_active":"2023-07-20T11:22:42.547921+0000","last_peered":"2023-07-20T11:22:42.547921+0000","last_clean":"2023-07-20T11:22:42.547921+0000","last_became_active":"2023-07-20T11:22:41.567399+0000","last_became_peered":"2023-07-20T11:22:41.567399+0000","last_unstale":"2023-07-20T11:22:42.547921+0000","last_undegraded":"2023-07-20T11:22:42.547921+0000","last_fullsized":"2023-07-20T11:22:42.547921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:23.931261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180633+0000","last_change":"2023-07-20T11:22:40.559705+0000","last_active":"2023-07-20T11:22:43.180633+0000","last_peered":"2023-07-20T11:22:43.180633+0000","last_clean":"2023-07-20T11:22:43.180633+0000","last_became_active":"2023-07-20T11:22:40.559185+0000","last_became_peered":"2023-07-20T11:22:40.559185+0000","last_unstale":"2023-07-20T11:22:43.180633+0000","last_undegraded":"2023-07-20T11:22:43.180633+0000","last_fullsized":"2023-07-20T11:22:43.180633+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:15:44.465928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":341,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095569+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:22:43.095569+0000","last_peered":"2023-07-20T11:22:43.095569+0000","last_clean":"2023-07-20T11:22:43.095569+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:22:43.095569+0000","last_undegraded":"2023-07-20T11:22:43.095569+0000","last_fullsized":"2023-07-20T11:22:43.095569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:19.220163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52076,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319764,"statfs":{"total":96636764160,"available":96583438336,"internally_reserved":0,"allocated":2981888,"data_stored":1815800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0629999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.996,"15min":1.1200000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.54000000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":1.081},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.0900000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0409999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0509999999999999},"last":0.879}]},{"osd":4,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.29899999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.0469999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96499999999999997,"5min":1.042,"15min":1.075},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0920000000000001},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575952,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41648,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330192,"statfs":{"total":96636764160,"available":96594116608,"internally_reserved":0,"allocated":2387968,"data_stored":1225432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.623,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.077},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.95499999999999996,"15min":0.98499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.49099999999999999},"max":{"1min":0.88,"5min":1.0389999999999999,"15min":1.1100000000000001},"last":0.997}]},{"osd":2,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.93899999999999995,"5min":1.0329999999999999,"15min":1.093},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.64600000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.02,"15min":1.0840000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.88900000000000001,"5min":0.97999999999999998,"15min":1.143},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.318},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.046},"last":0.438},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.33600000000000002},"max":{"1min":0.89600000000000002,"5min":0.93999999999999995,"15min":1.0309999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.98999999999999999,"15min":1.0620000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.93400000000000005,"15min":1.0700000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38400000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.097},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2396160,"data_stored":1225556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.753},"min":{"1min":0.67100000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.48899999999999999,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.204},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.60799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.50800000000000001,"15min":0.505},"max":{"1min":0.93700000000000006,"5min":1.0169999999999999,"15min":1.071},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"max":{"1min":0.997,"5min":1.101,"15min":1.101},"last":0.749}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.036},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.85099999999999998,"5min":1,"15min":1},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":0.87,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.71299999999999997},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41660,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330180,"statfs":{"total":96636764160,"available":96594104320,"internally_reserved":0,"allocated":2404352,"data_stored":1226196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.39500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.1870000000000001},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.1419999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1060000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.2310000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0049999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.497,"15min":0.49399999999999999},"max":{"1min":1.026,"5min":1.034,"15min":1.1160000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":1.085,"15min":1.085},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.96799999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0720000000000001},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.036},"last":0.90500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59708,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312132,"statfs":{"total":96636764160,"available":96575623168,"internally_reserved":0,"allocated":2408448,"data_stored":1227600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.61599999999999999,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.44},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77100000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.498,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.96099999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74299999999999999,"5min":0.871,"15min":0.95099999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78400000000000003,"15min":0.80500000000000005},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.55800000000000005,"15min":0.503},"max":{"1min":1.194,"5min":1.242,"15min":1.369},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1779999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.68999999999999995,"5min":0.57399999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.127,"15min":1.3620000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0620000000000001,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.85699999999999998},"min":{"1min":0.70299999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.3999999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2387968,"data_stored":1225432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.82699999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.78500000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.44}]},{"osd":3,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.01},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.54400000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.375},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.626,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.042,"5min":1.077,"15min":1.298},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.55100000000000005},"max":{"1min":1.131,"5min":1.131,"15min":1.2849999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.044,"5min":1.179,"15min":1.476},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.503},"max":{"1min":1.1499999999999999,"5min":1.153,"15min":1.494},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82299999999999995,"15min":0.83699999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3440000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.72599999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.55400000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.4099999999999999},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575950,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37564,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334276,"statfs":{"total":96636764160,"available":96598298624,"internally_reserved":0,"allocated":2400256,"data_stored":1226996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.748},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.41999999999999998},"max":{"1min":0.68799999999999994,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.62}]},{"osd":2,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.378,"5min":0.36199999999999999,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":0.753,"15min":0.753},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.83499999999999996},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":1.2050000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63700000000000001,"5min":0.72799999999999998,"15min":1.0109999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.51100000000000001,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.4790000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":0.96299999999999997,"5min":1.077,"15min":1.26},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.95299999999999996,"5min":1.1399999999999999,"15min":1.175},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.4339999999999999},"last":1.036}]},{"osd":6,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.1910000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.66500000000000004,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":1.0509999999999999,"5min":1.1100000000000001,"15min":1.3089999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.61599999999999999},"max":{"1min":1.002,"5min":1.1579999999999999,"15min":1.242},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.56200000000000006},"max":{"1min":0.98599999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":1.052}]}]},{"osd":0,"up_from":13,"seq":55834575950,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47992,"kb_used_data":2920,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323848,"statfs":{"total":96636764160,"available":96587620352,"internally_reserved":0,"allocated":2990080,"data_stored":1815904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.254},"max":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.79900000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.68000000000000005,"5min":0.79600000000000004,"15min":0.80500000000000005},"last":0.439}]},{"osd":2,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.85599999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.36399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0069999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.54300000000000004,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.56699999999999995},"max":{"1min":0.96299999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84799999999999998,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.52600000000000002},"max":{"1min":1,"5min":1.379,"15min":1.379},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.84099999999999997},"min":{"1min":0.63,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1319999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.627}]},{"osd":6,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.2509999999999999,"15min":1.3089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1140000000000001,"5min":1.355,"15min":1.355},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0289999999999999,"5min":1.204,"15min":1.2589999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:22:50.188 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:22:50.330 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.338+0000 7f74572bd640 1 Processor -- start 2023-07-20T11:22:50.331 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.338+0000 7f74572bd640 1 -- start start 2023-07-20T11:22:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f74572bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7450160bc0 0x7f745006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f74572bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f74500c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f74572bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500cc560 con 0x7f745006c700 2023-07-20T11:22:50.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f74572bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500ad7e0 con 0x7f7450160bc0 2023-07-20T11:22:50.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f74572bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74500cc790 con 0x7f7450160fa0 2023-07-20T11:22:50.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7450160bc0 0x7f745006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7454858640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f74500c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f7450160bc0 0x7f745006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:60024/0 (socket says 172.21.15.82:60024) 2023-07-20T11:22:50.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 -- 172.21.15.82:0/1234618302 learned_addr learned my addr 172.21.15.82:0/1234618302 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:50.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 -- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 msgr2=0x7f74500c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:50.334 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f74500c12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 -- 172.21.15.82:0/1234618302 >> v1:172.21.15.183:6789/0 conn(0x7f745006c700 legacy=0x7f74500aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7455059640 1 -- 172.21.15.82:0/1234618302 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500cca70 con 0x7f7450160bc0 2023-07-20T11:22:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.342+0000 7f7454858640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f74500c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:50.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f7455059640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745006c1c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32faf265269477c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f7447fff640 1 -- 172.21.15.82:0/1234618302 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0ab680 con 0x7f7450160bc0 2023-07-20T11:22:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f7447fff640 1 -- 172.21.15.82:0/1234618302 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0ab7e0 con 0x7f7450160bc0 2023-07-20T11:22:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f7447fff640 1 -- 172.21.15.82:0/1234618302 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0abb70 con 0x7f7450160bc0 2023-07-20T11:22:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 msgr2=0x7f745006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745006c1c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f744c009870 tx=0x7f744c01c480 comp rx=0 tx=0).stop 2023-07-20T11:22:50.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- 172.21.15.82:0/1234618302 shutdown_connections 2023-07-20T11:22:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f74500c12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 --2- 172.21.15.82:0/1234618302 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745006c1c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.338 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- 172.21.15.82:0/1234618302 >> 172.21.15.82:0/1234618302 conn(0x7f74500cada0 msgr2=0x7f74500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:50.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- 172.21.15.82:0/1234618302 shutdown_connections 2023-07-20T11:22:50.339 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- 172.21.15.82:0/1234618302 wait complete. 2023-07-20T11:22:50.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 Processor -- start 2023-07-20T11:22:50.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.346+0000 7f74572bd640 1 -- start start 2023-07-20T11:22:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745009a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f745015d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745009a550 con 0x7f745006c700 2023-07-20T11:22:50.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745009a760 con 0x7f7450160bc0 2023-07-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745009aa40 con 0x7f7450160fa0 2023-07-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60800/0 (socket says 172.21.15.82:60800) 2023-07-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 -- 172.21.15.82:0/2394421753 learned_addr learned my addr 172.21.15.82:0/2394421753 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:50.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7454858640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745009a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f745585a640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f745015d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 -- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 msgr2=0x7f745015d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f745015d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 -- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 msgr2=0x7f745009a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745009a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 -- 172.21.15.82:0/2394421753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440009420 con 0x7f745006c700 2023-07-20T11:22:50.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f745585a640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f745015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7455059640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ad040 tx=0x7f744c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0b4800 con 0x7f745006c700 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c0b4980 con 0x7f745006c700 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c0094d0 con 0x7f745006c700 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0b4d30 con 0x7f745006c700 2023-07-20T11:22:50.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745009b000 con 0x7f745006c700 2023-07-20T11:22:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7450073c70 con 0x7f745006c700 2023-07-20T11:22:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.350+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f744c0c7440 con 0x7f745006c700 2023-07-20T11:22:50.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.354+0000 7f7445ffb640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 0x7f7434068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.354+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f744c11ed60 con 0x7f745006c700 2023-07-20T11:22:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.354+0000 7f7454858640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 0x7f7434068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.354+0000 7f7454858640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 0x7f7434068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74500c2300 tx=0x7f7440009190 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.358+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f744c0ec010 con 0x7f745006c700 2023-07-20T11:22:50.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.506+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74500cd310 con 0x7f74340663a0 2023-07-20T11:22:50.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.514+0000 7f7445ffb640 1 -- 172.21.15.82:0/2394421753 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311909 (secure 0 0 0) 0x7f74400099c0 con 0x7f74340663a0 2023-07-20T11:22:50.509 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:50.510 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:22:50.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 msgr2=0x7f7434068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 0x7f7434068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74500c2300 tx=0x7f7440009190 comp rx=0 tx=0).stop 2023-07-20T11:22:50.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 msgr2=0x7f74500c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f744c0ad040 tx=0x7f744c01acc0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 shutdown_connections 2023-07-20T11:22:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f7450160fa0 0x7f745015d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7450160bc0 0x7f745009a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f74340663a0 0x7f7434068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 --2- 172.21.15.82:0/2394421753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f745006c700 0x7f74500c34e0 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 >> 172.21.15.82:0/2394421753 conn(0x7f74500cada0 msgr2=0x7f745006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 shutdown_connections 2023-07-20T11:22:50.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.518+0000 7f74572bd640 1 -- 172.21.15.82:0/2394421753 wait complete. 2023-07-20T11:22:50.529 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-20T11:22:50.428992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":543,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400040,"kb_used_data":19880,"kb_used_omap":13,"kb_used_meta":380018,"kb_avail":754574680,"statfs":{"total":773094113280,"available":772684472320,"internally_reserved":0,"allocated":20357120,"data_stored":10988916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":389138520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.890741"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375444+0000","last_change":"2023-07-20T11:22:41.562562+0000","last_active":"2023-07-20T11:22:43.375444+0000","last_peered":"2023-07-20T11:22:43.375444+0000","last_clean":"2023-07-20T11:22:43.375444+0000","last_became_active":"2023-07-20T11:22:41.562280+0000","last_became_peered":"2023-07-20T11:22:41.562280+0000","last_unstale":"2023-07-20T11:22:43.375444+0000","last_undegraded":"2023-07-20T11:22:43.375444+0000","last_fullsized":"2023-07-20T11:22:43.375444+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:33:50.061829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375187+0000","last_change":"2023-07-20T11:22:41.565692+0000","last_active":"2023-07-20T11:22:43.375187+0000","last_peered":"2023-07-20T11:22:43.375187+0000","last_clean":"2023-07-20T11:22:43.375187+0000","last_became_active":"2023-07-20T11:22:41.565415+0000","last_became_peered":"2023-07-20T11:22:41.565415+0000","last_unstale":"2023-07-20T11:22:43.375187+0000","last_undegraded":"2023-07-20T11:22:43.375187+0000","last_fullsized":"2023-07-20T11:22:43.375187+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:39:46.895393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374865+0000","last_change":"2023-07-20T11:22:41.548864+0000","last_active":"2023-07-20T11:22:43.374865+0000","last_peered":"2023-07-20T11:22:43.374865+0000","last_clean":"2023-07-20T11:22:43.374865+0000","last_became_active":"2023-07-20T11:22:41.548490+0000","last_became_peered":"2023-07-20T11:22:41.548490+0000","last_unstale":"2023-07-20T11:22:43.374865+0000","last_undegraded":"2023-07-20T11:22:43.374865+0000","last_fullsized":"2023-07-20T11:22:43.374865+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:22:59.670640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375069+0000","last_change":"2023-07-20T11:22:41.551267+0000","last_active":"2023-07-20T11:22:43.375069+0000","last_peered":"2023-07-20T11:22:43.375069+0000","last_clean":"2023-07-20T11:22:43.375069+0000","last_became_active":"2023-07-20T11:22:41.550843+0000","last_became_peered":"2023-07-20T11:22:41.550843+0000","last_unstale":"2023-07-20T11:22:43.375069+0000","last_undegraded":"2023-07-20T11:22:43.375069+0000","last_fullsized":"2023-07-20T11:22:43.375069+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:15:19.192138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373844+0000","last_change":"2023-07-20T11:22:41.555323+0000","last_active":"2023-07-20T11:22:43.373844+0000","last_peered":"2023-07-20T11:22:43.373844+0000","last_clean":"2023-07-20T11:22:43.373844+0000","last_became_active":"2023-07-20T11:22:41.555050+0000","last_became_peered":"2023-07-20T11:22:41.555050+0000","last_unstale":"2023-07-20T11:22:43.373844+0000","last_undegraded":"2023-07-20T11:22:43.373844+0000","last_fullsized":"2023-07-20T11:22:43.373844+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:59:28.660662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374558+0000","last_change":"2023-07-20T11:22:41.563919+0000","last_active":"2023-07-20T11:22:43.374558+0000","last_peered":"2023-07-20T11:22:43.374558+0000","last_clean":"2023-07-20T11:22:43.374558+0000","last_became_active":"2023-07-20T11:22:41.563597+0000","last_became_peered":"2023-07-20T11:22:41.563597+0000","last_unstale":"2023-07-20T11:22:43.374558+0000","last_undegraded":"2023-07-20T11:22:43.374558+0000","last_fullsized":"2023-07-20T11:22:43.374558+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:07.608809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547927+0000","last_change":"2023-07-20T11:22:41.561863+0000","last_active":"2023-07-20T11:22:42.547927+0000","last_peered":"2023-07-20T11:22:42.547927+0000","last_clean":"2023-07-20T11:22:42.547927+0000","last_became_active":"2023-07-20T11:22:41.561579+0000","last_became_peered":"2023-07-20T11:22:41.561579+0000","last_unstale":"2023-07-20T11:22:42.547927+0000","last_undegraded":"2023-07-20T11:22:42.547927+0000","last_fullsized":"2023-07-20T11:22:42.547927+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:26:03.913157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547207+0000","last_change":"2023-07-20T11:22:41.566969+0000","last_active":"2023-07-20T11:22:42.547207+0000","last_peered":"2023-07-20T11:22:42.547207+0000","last_clean":"2023-07-20T11:22:42.547207+0000","last_became_active":"2023-07-20T11:22:41.564951+0000","last_became_peered":"2023-07-20T11:22:41.564951+0000","last_unstale":"2023-07-20T11:22:42.547207+0000","last_undegraded":"2023-07-20T11:22:42.547207+0000","last_fullsized":"2023-07-20T11:22:42.547207+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:13:57.158706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547655+0000","last_change":"2023-07-20T11:22:41.566773+0000","last_active":"2023-07-20T11:22:42.547655+0000","last_peered":"2023-07-20T11:22:42.547655+0000","last_clean":"2023-07-20T11:22:42.547655+0000","last_became_active":"2023-07-20T11:22:41.566499+0000","last_became_peered":"2023-07-20T11:22:41.566499+0000","last_unstale":"2023-07-20T11:22:42.547655+0000","last_undegraded":"2023-07-20T11:22:42.547655+0000","last_fullsized":"2023-07-20T11:22:42.547655+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:50:10.281432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547815+0000","last_change":"2023-07-20T11:22:41.560701+0000","last_active":"2023-07-20T11:22:42.547815+0000","last_peered":"2023-07-20T11:22:42.547815+0000","last_clean":"2023-07-20T11:22:42.547815+0000","last_became_active":"2023-07-20T11:22:41.560447+0000","last_became_peered":"2023-07-20T11:22:41.560447+0000","last_unstale":"2023-07-20T11:22:42.547815+0000","last_undegraded":"2023-07-20T11:22:42.547815+0000","last_fullsized":"2023-07-20T11:22:42.547815+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:48:25.802399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548534+0000","last_change":"2023-07-20T11:22:41.557379+0000","last_active":"2023-07-20T11:22:42.548534+0000","last_peered":"2023-07-20T11:22:42.548534+0000","last_clean":"2023-07-20T11:22:42.548534+0000","last_became_active":"2023-07-20T11:22:41.557053+0000","last_became_peered":"2023-07-20T11:22:41.557053+0000","last_unstale":"2023-07-20T11:22:42.548534+0000","last_undegraded":"2023-07-20T11:22:42.548534+0000","last_fullsized":"2023-07-20T11:22:42.548534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:56:54.442182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374820+0000","last_change":"2023-07-20T11:22:41.564883+0000","last_active":"2023-07-20T11:22:43.374820+0000","last_peered":"2023-07-20T11:22:43.374820+0000","last_clean":"2023-07-20T11:22:43.374820+0000","last_became_active":"2023-07-20T11:22:41.563373+0000","last_became_peered":"2023-07-20T11:22:41.563373+0000","last_unstale":"2023-07-20T11:22:43.374820+0000","last_undegraded":"2023-07-20T11:22:43.374820+0000","last_fullsized":"2023-07-20T11:22:43.374820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:57:52.173973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180832+0000","last_change":"2023-07-20T11:22:41.563934+0000","last_active":"2023-07-20T11:22:43.180832+0000","last_peered":"2023-07-20T11:22:43.180832+0000","last_clean":"2023-07-20T11:22:43.180832+0000","last_became_active":"2023-07-20T11:22:41.563663+0000","last_became_peered":"2023-07-20T11:22:41.563663+0000","last_unstale":"2023-07-20T11:22:43.180832+0000","last_undegraded":"2023-07-20T11:22:43.180832+0000","last_fullsized":"2023-07-20T11:22:43.180832+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:31:07.682937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373649+0000","last_change":"2023-07-20T11:22:41.555926+0000","last_active":"2023-07-20T11:22:43.373649+0000","last_peered":"2023-07-20T11:22:43.373649+0000","last_clean":"2023-07-20T11:22:43.373649+0000","last_became_active":"2023-07-20T11:22:41.555630+0000","last_became_peered":"2023-07-20T11:22:41.555630+0000","last_unstale":"2023-07-20T11:22:43.373649+0000","last_undegraded":"2023-07-20T11:22:43.373649+0000","last_fullsized":"2023-07-20T11:22:43.373649+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:32:00.206235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548534+0000","last_change":"2023-07-20T11:22:41.559969+0000","last_active":"2023-07-20T11:22:42.548534+0000","last_peered":"2023-07-20T11:22:42.548534+0000","last_clean":"2023-07-20T11:22:42.548534+0000","last_became_active":"2023-07-20T11:22:41.559658+0000","last_became_peered":"2023-07-20T11:22:41.559658+0000","last_unstale":"2023-07-20T11:22:42.548534+0000","last_undegraded":"2023-07-20T11:22:42.548534+0000","last_fullsized":"2023-07-20T11:22:42.548534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:45:41.192906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374380+0000","last_change":"2023-07-20T11:22:41.551515+0000","last_active":"2023-07-20T11:22:43.374380+0000","last_peered":"2023-07-20T11:22:43.374380+0000","last_clean":"2023-07-20T11:22:43.374380+0000","last_became_active":"2023-07-20T11:22:41.551188+0000","last_became_peered":"2023-07-20T11:22:41.551188+0000","last_unstale":"2023-07-20T11:22:43.374380+0000","last_undegraded":"2023-07-20T11:22:43.374380+0000","last_fullsized":"2023-07-20T11:22:43.374380+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:19.108042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547786+0000","last_change":"2023-07-20T11:22:41.565999+0000","last_active":"2023-07-20T11:22:42.547786+0000","last_peered":"2023-07-20T11:22:42.547786+0000","last_clean":"2023-07-20T11:22:42.547786+0000","last_became_active":"2023-07-20T11:22:41.565711+0000","last_became_peered":"2023-07-20T11:22:41.565711+0000","last_unstale":"2023-07-20T11:22:42.547786+0000","last_undegraded":"2023-07-20T11:22:42.547786+0000","last_fullsized":"2023-07-20T11:22:42.547786+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:44:14.233628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095563+0000","last_change":"2023-07-20T11:22:41.568692+0000","last_active":"2023-07-20T11:22:43.095563+0000","last_peered":"2023-07-20T11:22:43.095563+0000","last_clean":"2023-07-20T11:22:43.095563+0000","last_became_active":"2023-07-20T11:22:41.568395+0000","last_became_peered":"2023-07-20T11:22:41.568395+0000","last_unstale":"2023-07-20T11:22:43.095563+0000","last_undegraded":"2023-07-20T11:22:43.095563+0000","last_fullsized":"2023-07-20T11:22:43.095563+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:47:50.213849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548812+0000","last_change":"2023-07-20T11:22:41.567661+0000","last_active":"2023-07-20T11:22:42.548812+0000","last_peered":"2023-07-20T11:22:42.548812+0000","last_clean":"2023-07-20T11:22:42.548812+0000","last_became_active":"2023-07-20T11:22:41.567337+0000","last_became_peered":"2023-07-20T11:22:41.567337+0000","last_unstale":"2023-07-20T11:22:42.548812+0000","last_undegraded":"2023-07-20T11:22:42.548812+0000","last_fullsized":"2023-07-20T11:22:42.548812+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:20.650363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546883+0000","last_change":"2023-07-20T11:22:41.557102+0000","last_active":"2023-07-20T11:22:42.546883+0000","last_peered":"2023-07-20T11:22:42.546883+0000","last_clean":"2023-07-20T11:22:42.546883+0000","last_became_active":"2023-07-20T11:22:41.556148+0000","last_became_peered":"2023-07-20T11:22:41.556148+0000","last_unstale":"2023-07-20T11:22:42.546883+0000","last_undegraded":"2023-07-20T11:22:42.546883+0000","last_fullsized":"2023-07-20T11:22:42.546883+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:09:50.796241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180934+0000","last_change":"2023-07-20T11:22:41.553254+0000","last_active":"2023-07-20T11:22:43.180934+0000","last_peered":"2023-07-20T11:22:43.180934+0000","last_clean":"2023-07-20T11:22:43.180934+0000","last_became_active":"2023-07-20T11:22:41.552006+0000","last_became_peered":"2023-07-20T11:22:41.552006+0000","last_unstale":"2023-07-20T11:22:43.180934+0000","last_undegraded":"2023-07-20T11:22:43.180934+0000","last_fullsized":"2023-07-20T11:22:43.180934+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:06.395820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374431+0000","last_change":"2023-07-20T11:22:41.567128+0000","last_active":"2023-07-20T11:22:43.374431+0000","last_peered":"2023-07-20T11:22:43.374431+0000","last_clean":"2023-07-20T11:22:43.374431+0000","last_became_active":"2023-07-20T11:22:41.566847+0000","last_became_peered":"2023-07-20T11:22:41.566847+0000","last_unstale":"2023-07-20T11:22:43.374431+0000","last_undegraded":"2023-07-20T11:22:43.374431+0000","last_fullsized":"2023-07-20T11:22:43.374431+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:15:31.821371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373589+0000","last_change":"2023-07-20T11:22:41.563182+0000","last_active":"2023-07-20T11:22:43.373589+0000","last_peered":"2023-07-20T11:22:43.373589+0000","last_clean":"2023-07-20T11:22:43.373589+0000","last_became_active":"2023-07-20T11:22:41.562912+0000","last_became_peered":"2023-07-20T11:22:41.562912+0000","last_unstale":"2023-07-20T11:22:43.373589+0000","last_undegraded":"2023-07-20T11:22:43.373589+0000","last_fullsized":"2023-07-20T11:22:43.373589+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:05:54.089855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374552+0000","last_change":"2023-07-20T11:22:41.551078+0000","last_active":"2023-07-20T11:22:43.374552+0000","last_peered":"2023-07-20T11:22:43.374552+0000","last_clean":"2023-07-20T11:22:43.374552+0000","last_became_active":"2023-07-20T11:22:41.550729+0000","last_became_peered":"2023-07-20T11:22:41.550729+0000","last_unstale":"2023-07-20T11:22:43.374552+0000","last_undegraded":"2023-07-20T11:22:43.374552+0000","last_fullsized":"2023-07-20T11:22:43.374552+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:59:20.913546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180862+0000","last_change":"2023-07-20T11:22:41.551001+0000","last_active":"2023-07-20T11:22:43.180862+0000","last_peered":"2023-07-20T11:22:43.180862+0000","last_clean":"2023-07-20T11:22:43.180862+0000","last_became_active":"2023-07-20T11:22:41.550712+0000","last_became_peered":"2023-07-20T11:22:41.550712+0000","last_unstale":"2023-07-20T11:22:43.180862+0000","last_undegraded":"2023-07-20T11:22:43.180862+0000","last_fullsized":"2023-07-20T11:22:43.180862+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:28.421601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546893+0000","last_change":"2023-07-20T11:22:41.552092+0000","last_active":"2023-07-20T11:22:42.546893+0000","last_peered":"2023-07-20T11:22:42.546893+0000","last_clean":"2023-07-20T11:22:42.546893+0000","last_became_active":"2023-07-20T11:22:41.551747+0000","last_became_peered":"2023-07-20T11:22:41.551747+0000","last_unstale":"2023-07-20T11:22:42.546893+0000","last_undegraded":"2023-07-20T11:22:42.546893+0000","last_fullsized":"2023-07-20T11:22:42.546893+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:59:03.179901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375158+0000","last_change":"2023-07-20T11:22:41.567240+0000","last_active":"2023-07-20T11:22:43.375158+0000","last_peered":"2023-07-20T11:22:43.375158+0000","last_clean":"2023-07-20T11:22:43.375158+0000","last_became_active":"2023-07-20T11:22:41.566557+0000","last_became_peered":"2023-07-20T11:22:41.566557+0000","last_unstale":"2023-07-20T11:22:43.375158+0000","last_undegraded":"2023-07-20T11:22:43.375158+0000","last_fullsized":"2023-07-20T11:22:43.375158+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:32:01.399005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180688+0000","last_change":"2023-07-20T11:22:41.554540+0000","last_active":"2023-07-20T11:22:43.180688+0000","last_peered":"2023-07-20T11:22:43.180688+0000","last_clean":"2023-07-20T11:22:43.180688+0000","last_became_active":"2023-07-20T11:22:41.554038+0000","last_became_peered":"2023-07-20T11:22:41.554038+0000","last_unstale":"2023-07-20T11:22:43.180688+0000","last_undegraded":"2023-07-20T11:22:43.180688+0000","last_fullsized":"2023-07-20T11:22:43.180688+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:50:29.914002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374515+0000","last_change":"2023-07-20T11:22:41.570510+0000","last_active":"2023-07-20T11:22:43.374515+0000","last_peered":"2023-07-20T11:22:43.374515+0000","last_clean":"2023-07-20T11:22:43.374515+0000","last_became_active":"2023-07-20T11:22:41.570236+0000","last_became_peered":"2023-07-20T11:22:41.570236+0000","last_unstale":"2023-07-20T11:22:43.374515+0000","last_undegraded":"2023-07-20T11:22:43.374515+0000","last_fullsized":"2023-07-20T11:22:43.374515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:52.996996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095515+0000","last_change":"2023-07-20T11:22:41.567843+0000","last_active":"2023-07-20T11:22:43.095515+0000","last_peered":"2023-07-20T11:22:43.095515+0000","last_clean":"2023-07-20T11:22:43.095515+0000","last_became_active":"2023-07-20T11:22:41.567495+0000","last_became_peered":"2023-07-20T11:22:41.567495+0000","last_unstale":"2023-07-20T11:22:43.095515+0000","last_undegraded":"2023-07-20T11:22:43.095515+0000","last_fullsized":"2023-07-20T11:22:43.095515+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:34:33.553278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548358+0000","last_change":"2023-07-20T11:22:41.563856+0000","last_active":"2023-07-20T11:22:42.548358+0000","last_peered":"2023-07-20T11:22:42.548358+0000","last_clean":"2023-07-20T11:22:42.548358+0000","last_became_active":"2023-07-20T11:22:41.563412+0000","last_became_peered":"2023-07-20T11:22:41.563412+0000","last_unstale":"2023-07-20T11:22:42.548358+0000","last_undegraded":"2023-07-20T11:22:42.548358+0000","last_fullsized":"2023-07-20T11:22:42.548358+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:58:57.483397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095380+0000","last_change":"2023-07-20T11:22:41.570119+0000","last_active":"2023-07-20T11:22:43.095380+0000","last_peered":"2023-07-20T11:22:43.095380+0000","last_clean":"2023-07-20T11:22:43.095380+0000","last_became_active":"2023-07-20T11:22:41.569810+0000","last_became_peered":"2023-07-20T11:22:41.569810+0000","last_unstale":"2023-07-20T11:22:43.095380+0000","last_undegraded":"2023-07-20T11:22:43.095380+0000","last_fullsized":"2023-07-20T11:22:43.095380+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:33:29.347762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374510+0000","last_change":"2023-07-20T11:22:41.569514+0000","last_active":"2023-07-20T11:22:43.374510+0000","last_peered":"2023-07-20T11:22:43.374510+0000","last_clean":"2023-07-20T11:22:43.374510+0000","last_became_active":"2023-07-20T11:22:41.569070+0000","last_became_peered":"2023-07-20T11:22:41.569070+0000","last_unstale":"2023-07-20T11:22:43.374510+0000","last_undegraded":"2023-07-20T11:22:43.374510+0000","last_fullsized":"2023-07-20T11:22:43.374510+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:32:24.783721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"190'4","reported_seq":17,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375505+0000","last_change":"2023-07-20T11:22:40.559619+0000","last_active":"2023-07-20T11:22:43.375505+0000","last_peered":"2023-07-20T11:22:43.375505+0000","last_clean":"2023-07-20T11:22:43.375505+0000","last_became_active":"2023-07-20T11:22:40.559314+0000","last_became_peered":"2023-07-20T11:22:40.559314+0000","last_unstale":"2023-07-20T11:22:43.375505+0000","last_undegraded":"2023-07-20T11:22:43.375505+0000","last_fullsized":"2023-07-20T11:22:43.375505+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:39:05.714617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180555+0000","last_change":"2023-07-20T11:22:41.563269+0000","last_active":"2023-07-20T11:22:43.180555+0000","last_peered":"2023-07-20T11:22:43.180555+0000","last_clean":"2023-07-20T11:22:43.180555+0000","last_became_active":"2023-07-20T11:22:41.562996+0000","last_became_peered":"2023-07-20T11:22:41.562996+0000","last_unstale":"2023-07-20T11:22:43.180555+0000","last_undegraded":"2023-07-20T11:22:43.180555+0000","last_fullsized":"2023-07-20T11:22:43.180555+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:58:59.683904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373935+0000","last_change":"2023-07-20T11:22:40.559063+0000","last_active":"2023-07-20T11:22:43.373935+0000","last_peered":"2023-07-20T11:22:43.373935+0000","last_clean":"2023-07-20T11:22:43.373935+0000","last_became_active":"2023-07-20T11:22:40.558758+0000","last_became_peered":"2023-07-20T11:22:40.558758+0000","last_unstale":"2023-07-20T11:22:43.373935+0000","last_undegraded":"2023-07-20T11:22:43.373935+0000","last_fullsized":"2023-07-20T11:22:43.373935+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:53:59.628861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373714+0000","last_change":"2023-07-20T11:22:41.553377+0000","last_active":"2023-07-20T11:22:43.373714+0000","last_peered":"2023-07-20T11:22:43.373714+0000","last_clean":"2023-07-20T11:22:43.373714+0000","last_became_active":"2023-07-20T11:22:41.553116+0000","last_became_peered":"2023-07-20T11:22:41.553116+0000","last_unstale":"2023-07-20T11:22:43.373714+0000","last_undegraded":"2023-07-20T11:22:43.373714+0000","last_fullsized":"2023-07-20T11:22:43.373714+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:21:13.969259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548658+0000","last_change":"2023-07-20T11:22:40.549010+0000","last_active":"2023-07-20T11:22:42.548658+0000","last_peered":"2023-07-20T11:22:42.548658+0000","last_clean":"2023-07-20T11:22:42.548658+0000","last_became_active":"2023-07-20T11:22:40.548728+0000","last_became_peered":"2023-07-20T11:22:40.548728+0000","last_unstale":"2023-07-20T11:22:42.548658+0000","last_undegraded":"2023-07-20T11:22:42.548658+0000","last_fullsized":"2023-07-20T11:22:42.548658+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:36:31.565617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374969+0000","last_change":"2023-07-20T11:22:41.567021+0000","last_active":"2023-07-20T11:22:43.374969+0000","last_peered":"2023-07-20T11:22:43.374969+0000","last_clean":"2023-07-20T11:22:43.374969+0000","last_became_active":"2023-07-20T11:22:41.566743+0000","last_became_peered":"2023-07-20T11:22:41.566743+0000","last_unstale":"2023-07-20T11:22:43.374969+0000","last_undegraded":"2023-07-20T11:22:43.374969+0000","last_fullsized":"2023-07-20T11:22:43.374969+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:04:47.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546682+0000","last_change":"2023-07-20T11:22:40.551321+0000","last_active":"2023-07-20T11:22:42.546682+0000","last_peered":"2023-07-20T11:22:42.546682+0000","last_clean":"2023-07-20T11:22:42.546682+0000","last_became_active":"2023-07-20T11:22:40.551064+0000","last_became_peered":"2023-07-20T11:22:40.551064+0000","last_unstale":"2023-07-20T11:22:42.546682+0000","last_undegraded":"2023-07-20T11:22:42.546682+0000","last_fullsized":"2023-07-20T11:22:42.546682+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:17:47.872799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547488+0000","last_change":"2023-07-20T11:22:41.557278+0000","last_active":"2023-07-20T11:22:42.547488+0000","last_peered":"2023-07-20T11:22:42.547488+0000","last_clean":"2023-07-20T11:22:42.547488+0000","last_became_active":"2023-07-20T11:22:41.556989+0000","last_became_peered":"2023-07-20T11:22:41.556989+0000","last_unstale":"2023-07-20T11:22:42.547488+0000","last_undegraded":"2023-07-20T11:22:42.547488+0000","last_fullsized":"2023-07-20T11:22:42.547488+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:07:36.457083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547579+0000","last_change":"2023-07-20T11:22:40.557161+0000","last_active":"2023-07-20T11:22:42.547579+0000","last_peered":"2023-07-20T11:22:42.547579+0000","last_clean":"2023-07-20T11:22:42.547579+0000","last_became_active":"2023-07-20T11:22:40.556911+0000","last_became_peered":"2023-07-20T11:22:40.556911+0000","last_unstale":"2023-07-20T11:22:42.547579+0000","last_undegraded":"2023-07-20T11:22:42.547579+0000","last_fullsized":"2023-07-20T11:22:42.547579+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:51:18.112175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546614+0000","last_change":"2023-07-20T11:22:41.547304+0000","last_active":"2023-07-20T11:22:42.546614+0000","last_peered":"2023-07-20T11:22:42.546614+0000","last_clean":"2023-07-20T11:22:42.546614+0000","last_became_active":"2023-07-20T11:22:41.546997+0000","last_became_peered":"2023-07-20T11:22:41.546997+0000","last_unstale":"2023-07-20T11:22:42.546614+0000","last_undegraded":"2023-07-20T11:22:42.546614+0000","last_fullsized":"2023-07-20T11:22:42.546614+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:00:00.454482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373764+0000","last_change":"2023-07-20T11:22:40.561910+0000","last_active":"2023-07-20T11:22:43.373764+0000","last_peered":"2023-07-20T11:22:43.373764+0000","last_clean":"2023-07-20T11:22:43.373764+0000","last_became_active":"2023-07-20T11:22:40.561553+0000","last_became_peered":"2023-07-20T11:22:40.561553+0000","last_unstale":"2023-07-20T11:22:43.373764+0000","last_undegraded":"2023-07-20T11:22:43.373764+0000","last_fullsized":"2023-07-20T11:22:43.373764+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:09:32.529464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546946+0000","last_change":"2023-07-20T11:22:41.563461+0000","last_active":"2023-07-20T11:22:42.546946+0000","last_peered":"2023-07-20T11:22:42.546946+0000","last_clean":"2023-07-20T11:22:42.546946+0000","last_became_active":"2023-07-20T11:22:41.563178+0000","last_became_peered":"2023-07-20T11:22:41.563178+0000","last_unstale":"2023-07-20T11:22:42.546946+0000","last_undegraded":"2023-07-20T11:22:42.546946+0000","last_fullsized":"2023-07-20T11:22:42.546946+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:26:34.465098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546233+0000","last_change":"2023-07-20T11:22:40.556159+0000","last_active":"2023-07-20T11:22:42.546233+0000","last_peered":"2023-07-20T11:22:42.546233+0000","last_clean":"2023-07-20T11:22:42.546233+0000","last_became_active":"2023-07-20T11:22:40.555525+0000","last_became_peered":"2023-07-20T11:22:40.555525+0000","last_unstale":"2023-07-20T11:22:42.546233+0000","last_undegraded":"2023-07-20T11:22:42.546233+0000","last_fullsized":"2023-07-20T11:22:42.546233+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:53:08.070100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375499+0000","last_change":"2023-07-20T11:22:41.549225+0000","last_active":"2023-07-20T11:22:43.375499+0000","last_peered":"2023-07-20T11:22:43.375499+0000","last_clean":"2023-07-20T11:22:43.375499+0000","last_became_active":"2023-07-20T11:22:41.548891+0000","last_became_peered":"2023-07-20T11:22:41.548891+0000","last_unstale":"2023-07-20T11:22:43.375499+0000","last_undegraded":"2023-07-20T11:22:43.375499+0000","last_fullsized":"2023-07-20T11:22:43.375499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:54:38.898126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547359+0000","last_change":"2023-07-20T11:22:40.558492+0000","last_active":"2023-07-20T11:22:42.547359+0000","last_peered":"2023-07-20T11:22:42.547359+0000","last_clean":"2023-07-20T11:22:42.547359+0000","last_became_active":"2023-07-20T11:22:40.558183+0000","last_became_peered":"2023-07-20T11:22:40.558183+0000","last_unstale":"2023-07-20T11:22:42.547359+0000","last_undegraded":"2023-07-20T11:22:42.547359+0000","last_fullsized":"2023-07-20T11:22:42.547359+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:57:28.350454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547270+0000","last_change":"2023-07-20T11:22:41.562417+0000","last_active":"2023-07-20T11:22:42.547270+0000","last_peered":"2023-07-20T11:22:42.547270+0000","last_clean":"2023-07-20T11:22:42.547270+0000","last_became_active":"2023-07-20T11:22:41.559220+0000","last_became_peered":"2023-07-20T11:22:41.559220+0000","last_unstale":"2023-07-20T11:22:42.547270+0000","last_undegraded":"2023-07-20T11:22:42.547270+0000","last_fullsized":"2023-07-20T11:22:42.547270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:01:42.443859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180924+0000","last_change":"2023-07-20T11:22:40.558113+0000","last_active":"2023-07-20T11:22:43.180924+0000","last_peered":"2023-07-20T11:22:43.180924+0000","last_clean":"2023-07-20T11:22:43.180924+0000","last_became_active":"2023-07-20T11:22:40.557667+0000","last_became_peered":"2023-07-20T11:22:40.557667+0000","last_unstale":"2023-07-20T11:22:43.180924+0000","last_undegraded":"2023-07-20T11:22:43.180924+0000","last_fullsized":"2023-07-20T11:22:43.180924+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:48:11.926489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095482+0000","last_change":"2023-07-20T11:22:41.562515+0000","last_active":"2023-07-20T11:22:43.095482+0000","last_peered":"2023-07-20T11:22:43.095482+0000","last_clean":"2023-07-20T11:22:43.095482+0000","last_became_active":"2023-07-20T11:22:41.561863+0000","last_became_peered":"2023-07-20T11:22:41.561863+0000","last_unstale":"2023-07-20T11:22:43.095482+0000","last_undegraded":"2023-07-20T11:22:43.095482+0000","last_fullsized":"2023-07-20T11:22:43.095482+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:20:41.049918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547857+0000","last_change":"2023-07-20T11:22:40.554870+0000","last_active":"2023-07-20T11:22:42.547857+0000","last_peered":"2023-07-20T11:22:42.547857+0000","last_clean":"2023-07-20T11:22:42.547857+0000","last_became_active":"2023-07-20T11:22:40.552078+0000","last_became_peered":"2023-07-20T11:22:40.552078+0000","last_unstale":"2023-07-20T11:22:42.547857+0000","last_undegraded":"2023-07-20T11:22:42.547857+0000","last_fullsized":"2023-07-20T11:22:42.547857+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:16.188698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548405+0000","last_change":"2023-07-20T11:22:41.553677+0000","last_active":"2023-07-20T11:22:42.548405+0000","last_peered":"2023-07-20T11:22:42.548405+0000","last_clean":"2023-07-20T11:22:42.548405+0000","last_became_active":"2023-07-20T11:22:41.553030+0000","last_became_peered":"2023-07-20T11:22:41.553030+0000","last_unstale":"2023-07-20T11:22:42.548405+0000","last_undegraded":"2023-07-20T11:22:42.548405+0000","last_fullsized":"2023-07-20T11:22:42.548405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:08:29.313911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"190'1","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374076+0000","last_change":"2023-07-20T11:22:40.553623+0000","last_active":"2023-07-20T11:22:43.374076+0000","last_peered":"2023-07-20T11:22:43.374076+0000","last_clean":"2023-07-20T11:22:43.374076+0000","last_became_active":"2023-07-20T11:22:40.553293+0000","last_became_peered":"2023-07-20T11:22:40.553293+0000","last_unstale":"2023-07-20T11:22:43.374076+0000","last_undegraded":"2023-07-20T11:22:43.374076+0000","last_fullsized":"2023-07-20T11:22:43.374076+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:44:48.527972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548675+0000","last_change":"2023-07-20T11:22:41.557599+0000","last_active":"2023-07-20T11:22:42.548675+0000","last_peered":"2023-07-20T11:22:42.548675+0000","last_clean":"2023-07-20T11:22:42.548675+0000","last_became_active":"2023-07-20T11:22:41.557282+0000","last_became_peered":"2023-07-20T11:22:41.557282+0000","last_unstale":"2023-07-20T11:22:42.548675+0000","last_undegraded":"2023-07-20T11:22:42.548675+0000","last_fullsized":"2023-07-20T11:22:42.548675+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:28:17.757167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547473+0000","last_change":"2023-07-20T11:22:40.557130+0000","last_active":"2023-07-20T11:22:42.547473+0000","last_peered":"2023-07-20T11:22:42.547473+0000","last_clean":"2023-07-20T11:22:42.547473+0000","last_became_active":"2023-07-20T11:22:40.556844+0000","last_became_peered":"2023-07-20T11:22:40.556844+0000","last_unstale":"2023-07-20T11:22:42.547473+0000","last_undegraded":"2023-07-20T11:22:42.547473+0000","last_fullsized":"2023-07-20T11:22:42.547473+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:47:44.887706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.181000+0000","last_change":"2023-07-20T11:22:41.554372+0000","last_active":"2023-07-20T11:22:43.181000+0000","last_peered":"2023-07-20T11:22:43.181000+0000","last_clean":"2023-07-20T11:22:43.181000+0000","last_became_active":"2023-07-20T11:22:41.553688+0000","last_became_peered":"2023-07-20T11:22:41.553688+0000","last_unstale":"2023-07-20T11:22:43.181000+0000","last_undegraded":"2023-07-20T11:22:43.181000+0000","last_fullsized":"2023-07-20T11:22:43.181000+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:18.383391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373921+0000","last_change":"2023-07-20T11:22:40.553901+0000","last_active":"2023-07-20T11:22:43.373921+0000","last_peered":"2023-07-20T11:22:43.373921+0000","last_clean":"2023-07-20T11:22:43.373921+0000","last_became_active":"2023-07-20T11:22:40.553629+0000","last_became_peered":"2023-07-20T11:22:40.553629+0000","last_unstale":"2023-07-20T11:22:43.373921+0000","last_undegraded":"2023-07-20T11:22:43.373921+0000","last_fullsized":"2023-07-20T11:22:43.373921+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:18.155094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374150+0000","last_change":"2023-07-20T11:22:41.566474+0000","last_active":"2023-07-20T11:22:43.374150+0000","last_peered":"2023-07-20T11:22:43.374150+0000","last_clean":"2023-07-20T11:22:43.374150+0000","last_became_active":"2023-07-20T11:22:41.566184+0000","last_became_peered":"2023-07-20T11:22:41.566184+0000","last_unstale":"2023-07-20T11:22:43.374150+0000","last_undegraded":"2023-07-20T11:22:43.374150+0000","last_fullsized":"2023-07-20T11:22:43.374150+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:16:06.709098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548243+0000","last_change":"2023-07-20T11:22:40.560455+0000","last_active":"2023-07-20T11:22:42.548243+0000","last_peered":"2023-07-20T11:22:42.548243+0000","last_clean":"2023-07-20T11:22:42.548243+0000","last_became_active":"2023-07-20T11:22:40.560171+0000","last_became_peered":"2023-07-20T11:22:40.560171+0000","last_unstale":"2023-07-20T11:22:42.548243+0000","last_undegraded":"2023-07-20T11:22:42.548243+0000","last_fullsized":"2023-07-20T11:22:42.548243+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:54.347270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373938+0000","last_change":"2023-07-20T11:22:41.558702+0000","last_active":"2023-07-20T11:22:43.373938+0000","last_peered":"2023-07-20T11:22:43.373938+0000","last_clean":"2023-07-20T11:22:43.373938+0000","last_became_active":"2023-07-20T11:22:41.558426+0000","last_became_peered":"2023-07-20T11:22:41.558426+0000","last_unstale":"2023-07-20T11:22:43.373938+0000","last_undegraded":"2023-07-20T11:22:43.373938+0000","last_fullsized":"2023-07-20T11:22:43.373938+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:44:00.385852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546329+0000","last_change":"2023-07-20T11:22:40.548690+0000","last_active":"2023-07-20T11:22:42.546329+0000","last_peered":"2023-07-20T11:22:42.546329+0000","last_clean":"2023-07-20T11:22:42.546329+0000","last_became_active":"2023-07-20T11:22:40.548424+0000","last_became_peered":"2023-07-20T11:22:40.548424+0000","last_unstale":"2023-07-20T11:22:42.546329+0000","last_undegraded":"2023-07-20T11:22:42.546329+0000","last_fullsized":"2023-07-20T11:22:42.546329+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:14:58.331251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375207+0000","last_change":"2023-07-20T11:22:41.564122+0000","last_active":"2023-07-20T11:22:43.375207+0000","last_peered":"2023-07-20T11:22:43.375207+0000","last_clean":"2023-07-20T11:22:43.375207+0000","last_became_active":"2023-07-20T11:22:41.563849+0000","last_became_peered":"2023-07-20T11:22:41.563849+0000","last_unstale":"2023-07-20T11:22:43.375207+0000","last_undegraded":"2023-07-20T11:22:43.375207+0000","last_fullsized":"2023-07-20T11:22:43.375207+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:09:47.324411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374491+0000","last_change":"2023-07-20T11:22:40.550981+0000","last_active":"2023-07-20T11:22:43.374491+0000","last_peered":"2023-07-20T11:22:43.374491+0000","last_clean":"2023-07-20T11:22:43.374491+0000","last_became_active":"2023-07-20T11:22:40.550699+0000","last_became_peered":"2023-07-20T11:22:40.550699+0000","last_unstale":"2023-07-20T11:22:43.374491+0000","last_undegraded":"2023-07-20T11:22:43.374491+0000","last_fullsized":"2023-07-20T11:22:43.374491+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:34:40.980329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548288+0000","last_change":"2023-07-20T11:22:41.562400+0000","last_active":"2023-07-20T11:22:42.548288+0000","last_peered":"2023-07-20T11:22:42.548288+0000","last_clean":"2023-07-20T11:22:42.548288+0000","last_became_active":"2023-07-20T11:22:41.562101+0000","last_became_peered":"2023-07-20T11:22:41.562101+0000","last_unstale":"2023-07-20T11:22:42.548288+0000","last_undegraded":"2023-07-20T11:22:42.548288+0000","last_fullsized":"2023-07-20T11:22:42.548288+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:35:20.262845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373969+0000","last_change":"2023-07-20T11:22:40.548110+0000","last_active":"2023-07-20T11:22:43.373969+0000","last_peered":"2023-07-20T11:22:43.373969+0000","last_clean":"2023-07-20T11:22:43.373969+0000","last_became_active":"2023-07-20T11:22:40.547800+0000","last_became_peered":"2023-07-20T11:22:40.547800+0000","last_unstale":"2023-07-20T11:22:43.373969+0000","last_undegraded":"2023-07-20T11:22:43.373969+0000","last_fullsized":"2023-07-20T11:22:43.373969+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:11:24.762948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548049+0000","last_change":"2023-07-20T11:22:41.561763+0000","last_active":"2023-07-20T11:22:42.548049+0000","last_peered":"2023-07-20T11:22:42.548049+0000","last_clean":"2023-07-20T11:22:42.548049+0000","last_became_active":"2023-07-20T11:22:41.561496+0000","last_became_peered":"2023-07-20T11:22:41.561496+0000","last_unstale":"2023-07-20T11:22:42.548049+0000","last_undegraded":"2023-07-20T11:22:42.548049+0000","last_fullsized":"2023-07-20T11:22:42.548049+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:07:30.514969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.181013+0000","last_change":"2023-07-20T11:22:40.560542+0000","last_active":"2023-07-20T11:22:43.181013+0000","last_peered":"2023-07-20T11:22:43.181013+0000","last_clean":"2023-07-20T11:22:43.181013+0000","last_became_active":"2023-07-20T11:22:40.559913+0000","last_became_peered":"2023-07-20T11:22:40.559913+0000","last_unstale":"2023-07-20T11:22:43.181013+0000","last_undegraded":"2023-07-20T11:22:43.181013+0000","last_fullsized":"2023-07-20T11:22:43.181013+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:55:02.238246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546514+0000","last_change":"2023-07-20T11:22:41.562267+0000","last_active":"2023-07-20T11:22:42.546514+0000","last_peered":"2023-07-20T11:22:42.546514+0000","last_clean":"2023-07-20T11:22:42.546514+0000","last_became_active":"2023-07-20T11:22:41.561968+0000","last_became_peered":"2023-07-20T11:22:41.561968+0000","last_unstale":"2023-07-20T11:22:42.546514+0000","last_undegraded":"2023-07-20T11:22:42.546514+0000","last_fullsized":"2023-07-20T11:22:42.546514+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:03:59.345899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180751+0000","last_change":"2023-07-20T11:22:40.559588+0000","last_active":"2023-07-20T11:22:43.180751+0000","last_peered":"2023-07-20T11:22:43.180751+0000","last_clean":"2023-07-20T11:22:43.180751+0000","last_became_active":"2023-07-20T11:22:40.559296+0000","last_became_peered":"2023-07-20T11:22:40.559296+0000","last_unstale":"2023-07-20T11:22:43.180751+0000","last_undegraded":"2023-07-20T11:22:43.180751+0000","last_fullsized":"2023-07-20T11:22:43.180751+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:00:39.602922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547499+0000","last_change":"2023-07-20T11:22:41.558629+0000","last_active":"2023-07-20T11:22:42.547499+0000","last_peered":"2023-07-20T11:22:42.547499+0000","last_clean":"2023-07-20T11:22:42.547499+0000","last_became_active":"2023-07-20T11:22:41.558351+0000","last_became_peered":"2023-07-20T11:22:41.558351+0000","last_unstale":"2023-07-20T11:22:42.547499+0000","last_undegraded":"2023-07-20T11:22:42.547499+0000","last_fullsized":"2023-07-20T11:22:42.547499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:44.399299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546813+0000","last_change":"2023-07-20T11:22:40.552324+0000","last_active":"2023-07-20T11:22:42.546813+0000","last_peered":"2023-07-20T11:22:42.546813+0000","last_clean":"2023-07-20T11:22:42.546813+0000","last_became_active":"2023-07-20T11:22:40.551797+0000","last_became_peered":"2023-07-20T11:22:40.551797+0000","last_unstale":"2023-07-20T11:22:42.546813+0000","last_undegraded":"2023-07-20T11:22:42.546813+0000","last_fullsized":"2023-07-20T11:22:42.546813+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:44:01.387946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375156+0000","last_change":"2023-07-20T11:22:41.559002+0000","last_active":"2023-07-20T11:22:43.375156+0000","last_peered":"2023-07-20T11:22:43.375156+0000","last_clean":"2023-07-20T11:22:43.375156+0000","last_became_active":"2023-07-20T11:22:41.558698+0000","last_became_peered":"2023-07-20T11:22:41.558698+0000","last_unstale":"2023-07-20T11:22:43.375156+0000","last_undegraded":"2023-07-20T11:22:43.375156+0000","last_fullsized":"2023-07-20T11:22:43.375156+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:23:44.731539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374520+0000","last_change":"2023-07-20T11:22:40.553603+0000","last_active":"2023-07-20T11:22:43.374520+0000","last_peered":"2023-07-20T11:22:43.374520+0000","last_clean":"2023-07-20T11:22:43.374520+0000","last_became_active":"2023-07-20T11:22:40.553321+0000","last_became_peered":"2023-07-20T11:22:40.553321+0000","last_unstale":"2023-07-20T11:22:43.374520+0000","last_undegraded":"2023-07-20T11:22:43.374520+0000","last_fullsized":"2023-07-20T11:22:43.374520+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:25.972677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375315+0000","last_change":"2023-07-20T11:22:41.566556+0000","last_active":"2023-07-20T11:22:43.375315+0000","last_peered":"2023-07-20T11:22:43.375315+0000","last_clean":"2023-07-20T11:22:43.375315+0000","last_became_active":"2023-07-20T11:22:41.566151+0000","last_became_peered":"2023-07-20T11:22:41.566151+0000","last_unstale":"2023-07-20T11:22:43.375315+0000","last_undegraded":"2023-07-20T11:22:43.375315+0000","last_fullsized":"2023-07-20T11:22:43.375315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:54:26.130001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180810+0000","last_change":"2023-07-20T11:22:40.559775+0000","last_active":"2023-07-20T11:22:43.180810+0000","last_peered":"2023-07-20T11:22:43.180810+0000","last_clean":"2023-07-20T11:22:43.180810+0000","last_became_active":"2023-07-20T11:22:40.559477+0000","last_became_peered":"2023-07-20T11:22:40.559477+0000","last_unstale":"2023-07-20T11:22:43.180810+0000","last_undegraded":"2023-07-20T11:22:43.180810+0000","last_fullsized":"2023-07-20T11:22:43.180810+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:03:21.072552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180994+0000","last_change":"2023-07-20T11:22:41.552796+0000","last_active":"2023-07-20T11:22:43.180994+0000","last_peered":"2023-07-20T11:22:43.180994+0000","last_clean":"2023-07-20T11:22:43.180994+0000","last_became_active":"2023-07-20T11:22:41.552411+0000","last_became_peered":"2023-07-20T11:22:41.552411+0000","last_unstale":"2023-07-20T11:22:43.180994+0000","last_undegraded":"2023-07-20T11:22:43.180994+0000","last_fullsized":"2023-07-20T11:22:43.180994+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:23:37.385636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548652+0000","last_change":"2023-07-20T11:22:40.552210+0000","last_active":"2023-07-20T11:22:42.548652+0000","last_peered":"2023-07-20T11:22:42.548652+0000","last_clean":"2023-07-20T11:22:42.548652+0000","last_became_active":"2023-07-20T11:22:40.551912+0000","last_became_peered":"2023-07-20T11:22:40.551912+0000","last_unstale":"2023-07-20T11:22:42.548652+0000","last_undegraded":"2023-07-20T11:22:42.548652+0000","last_fullsized":"2023-07-20T11:22:42.548652+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:33:31.655579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546765+0000","last_change":"2023-07-20T11:22:41.556923+0000","last_active":"2023-07-20T11:22:42.546765+0000","last_peered":"2023-07-20T11:22:42.546765+0000","last_clean":"2023-07-20T11:22:42.546765+0000","last_became_active":"2023-07-20T11:22:41.556599+0000","last_became_peered":"2023-07-20T11:22:41.556599+0000","last_unstale":"2023-07-20T11:22:42.546765+0000","last_undegraded":"2023-07-20T11:22:42.546765+0000","last_fullsized":"2023-07-20T11:22:42.546765+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:25:45.436390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373448+0000","last_change":"2023-07-20T11:22:40.550068+0000","last_active":"2023-07-20T11:22:43.373448+0000","last_peered":"2023-07-20T11:22:43.373448+0000","last_clean":"2023-07-20T11:22:43.373448+0000","last_became_active":"2023-07-20T11:22:40.549807+0000","last_became_peered":"2023-07-20T11:22:40.549807+0000","last_unstale":"2023-07-20T11:22:43.373448+0000","last_undegraded":"2023-07-20T11:22:43.373448+0000","last_fullsized":"2023-07-20T11:22:43.373448+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:54:31.659494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374815+0000","last_change":"2023-07-20T11:22:41.563561+0000","last_active":"2023-07-20T11:22:43.374815+0000","last_peered":"2023-07-20T11:22:43.374815+0000","last_clean":"2023-07-20T11:22:43.374815+0000","last_became_active":"2023-07-20T11:22:41.563231+0000","last_became_peered":"2023-07-20T11:22:41.563231+0000","last_unstale":"2023-07-20T11:22:43.374815+0000","last_undegraded":"2023-07-20T11:22:43.374815+0000","last_fullsized":"2023-07-20T11:22:43.374815+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:56.238968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180909+0000","last_change":"2023-07-20T11:22:40.560833+0000","last_active":"2023-07-20T11:22:43.180909+0000","last_peered":"2023-07-20T11:22:43.180909+0000","last_clean":"2023-07-20T11:22:43.180909+0000","last_became_active":"2023-07-20T11:22:40.560271+0000","last_became_peered":"2023-07-20T11:22:40.560271+0000","last_unstale":"2023-07-20T11:22:43.180909+0000","last_undegraded":"2023-07-20T11:22:43.180909+0000","last_fullsized":"2023-07-20T11:22:43.180909+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:44:55.154574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"179'304","reported_seq":1169,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374710+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:22:43.374710+0000","last_peered":"2023-07-20T11:22:43.374710+0000","last_clean":"2023-07-20T11:22:43.374710+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:22:43.374710+0000","last_undegraded":"2023-07-20T11:22:43.374710+0000","last_fullsized":"2023-07-20T11:22:43.374710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:04:11.034570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":389,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548819+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:22:42.548819+0000","last_peered":"2023-07-20T11:22:42.548819+0000","last_clean":"2023-07-20T11:22:42.548819+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:22:42.548819+0000","last_undegraded":"2023-07-20T11:22:42.548819+0000","last_fullsized":"2023-07-20T11:22:42.548819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:30:32.687814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180567+0000","last_change":"2023-07-20T11:22:41.558895+0000","last_active":"2023-07-20T11:22:43.180567+0000","last_peered":"2023-07-20T11:22:43.180567+0000","last_clean":"2023-07-20T11:22:43.180567+0000","last_became_active":"2023-07-20T11:22:41.558622+0000","last_became_peered":"2023-07-20T11:22:41.558622+0000","last_unstale":"2023-07-20T11:22:43.180567+0000","last_undegraded":"2023-07-20T11:22:43.180567+0000","last_fullsized":"2023-07-20T11:22:43.180567+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:34:02.282109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"190'3","reported_seq":16,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374976+0000","last_change":"2023-07-20T11:22:40.556935+0000","last_active":"2023-07-20T11:22:43.374976+0000","last_peered":"2023-07-20T11:22:43.374976+0000","last_clean":"2023-07-20T11:22:43.374976+0000","last_became_active":"2023-07-20T11:22:40.556592+0000","last_became_peered":"2023-07-20T11:22:40.556592+0000","last_unstale":"2023-07-20T11:22:43.374976+0000","last_undegraded":"2023-07-20T11:22:43.374976+0000","last_fullsized":"2023-07-20T11:22:43.374976+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:51:43.787627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":350,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374659+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:22:43.374659+0000","last_peered":"2023-07-20T11:22:43.374659+0000","last_clean":"2023-07-20T11:22:43.374659+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:22:43.374659+0000","last_undegraded":"2023-07-20T11:22:43.374659+0000","last_fullsized":"2023-07-20T11:22:43.374659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:36:48.281254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546777+0000","last_change":"2023-07-20T11:22:41.556908+0000","last_active":"2023-07-20T11:22:42.546777+0000","last_peered":"2023-07-20T11:22:42.546777+0000","last_clean":"2023-07-20T11:22:42.546777+0000","last_became_active":"2023-07-20T11:22:41.556566+0000","last_became_peered":"2023-07-20T11:22:41.556566+0000","last_unstale":"2023-07-20T11:22:42.546777+0000","last_undegraded":"2023-07-20T11:22:42.546777+0000","last_fullsized":"2023-07-20T11:22:42.546777+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:28:55.737230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"190'6","reported_seq":19,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180823+0000","last_change":"2023-07-20T11:22:40.562270+0000","last_active":"2023-07-20T11:22:43.180823+0000","last_peered":"2023-07-20T11:22:43.180823+0000","last_clean":"2023-07-20T11:22:43.180823+0000","last_became_active":"2023-07-20T11:22:40.562015+0000","last_became_peered":"2023-07-20T11:22:40.562015+0000","last_unstale":"2023-07-20T11:22:43.180823+0000","last_undegraded":"2023-07-20T11:22:43.180823+0000","last_fullsized":"2023-07-20T11:22:43.180823+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:02:41.474580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":379,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546579+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:22:42.546579+0000","last_peered":"2023-07-20T11:22:42.546579+0000","last_clean":"2023-07-20T11:22:42.546579+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:22:42.546579+0000","last_undegraded":"2023-07-20T11:22:42.546579+0000","last_fullsized":"2023-07-20T11:22:42.546579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:26:53.349255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.374278+0000","last_change":"2023-07-20T11:22:41.569320+0000","last_active":"2023-07-20T11:22:43.374278+0000","last_peered":"2023-07-20T11:22:43.374278+0000","last_clean":"2023-07-20T11:22:43.374278+0000","last_became_active":"2023-07-20T11:22:41.568716+0000","last_became_peered":"2023-07-20T11:22:41.568716+0000","last_unstale":"2023-07-20T11:22:43.374278+0000","last_undegraded":"2023-07-20T11:22:43.374278+0000","last_fullsized":"2023-07-20T11:22:43.374278+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:02:33.349639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180767+0000","last_change":"2023-07-20T11:22:40.557927+0000","last_active":"2023-07-20T11:22:43.180767+0000","last_peered":"2023-07-20T11:22:43.180767+0000","last_clean":"2023-07-20T11:22:43.180767+0000","last_became_active":"2023-07-20T11:22:40.557369+0000","last_became_peered":"2023-07-20T11:22:40.557369+0000","last_unstale":"2023-07-20T11:22:43.180767+0000","last_undegraded":"2023-07-20T11:22:43.180767+0000","last_fullsized":"2023-07-20T11:22:43.180767+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:02.999078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":389,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548407+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:22:42.548407+0000","last_peered":"2023-07-20T11:22:42.548407+0000","last_clean":"2023-07-20T11:22:42.548407+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:22:42.548407+0000","last_undegraded":"2023-07-20T11:22:42.548407+0000","last_fullsized":"2023-07-20T11:22:42.548407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:32.031416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548579+0000","last_change":"2023-07-20T11:22:41.565114+0000","last_active":"2023-07-20T11:22:42.548579+0000","last_peered":"2023-07-20T11:22:42.548579+0000","last_clean":"2023-07-20T11:22:42.548579+0000","last_became_active":"2023-07-20T11:22:41.564820+0000","last_became_peered":"2023-07-20T11:22:41.564820+0000","last_unstale":"2023-07-20T11:22:42.548579+0000","last_undegraded":"2023-07-20T11:22:42.548579+0000","last_fullsized":"2023-07-20T11:22:42.548579+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:19:11.978940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.548451+0000","last_change":"2023-07-20T11:22:40.552239+0000","last_active":"2023-07-20T11:22:42.548451+0000","last_peered":"2023-07-20T11:22:42.548451+0000","last_clean":"2023-07-20T11:22:42.548451+0000","last_became_active":"2023-07-20T11:22:40.551959+0000","last_became_peered":"2023-07-20T11:22:40.551959+0000","last_unstale":"2023-07-20T11:22:42.548451+0000","last_undegraded":"2023-07-20T11:22:42.548451+0000","last_fullsized":"2023-07-20T11:22:42.548451+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:57:51.067178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":347,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547595+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:22:42.547595+0000","last_peered":"2023-07-20T11:22:42.547595+0000","last_clean":"2023-07-20T11:22:42.547595+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:22:42.547595+0000","last_undegraded":"2023-07-20T11:22:42.547595+0000","last_fullsized":"2023-07-20T11:22:42.547595+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:08:26.151471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.546638+0000","last_change":"2023-07-20T11:22:41.555526+0000","last_active":"2023-07-20T11:22:42.546638+0000","last_peered":"2023-07-20T11:22:42.546638+0000","last_clean":"2023-07-20T11:22:42.546638+0000","last_became_active":"2023-07-20T11:22:41.551781+0000","last_became_peered":"2023-07-20T11:22:41.551781+0000","last_unstale":"2023-07-20T11:22:42.546638+0000","last_undegraded":"2023-07-20T11:22:42.546638+0000","last_fullsized":"2023-07-20T11:22:42.546638+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:06:40.311813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"190'8","reported_seq":21,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547301+0000","last_change":"2023-07-20T11:22:40.558450+0000","last_active":"2023-07-20T11:22:42.547301+0000","last_peered":"2023-07-20T11:22:42.547301+0000","last_clean":"2023-07-20T11:22:42.547301+0000","last_became_active":"2023-07-20T11:22:40.557826+0000","last_became_peered":"2023-07-20T11:22:40.557826+0000","last_unstale":"2023-07-20T11:22:42.547301+0000","last_undegraded":"2023-07-20T11:22:42.547301+0000","last_fullsized":"2023-07-20T11:22:42.547301+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:23:59.709209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":349,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.375317+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:22:43.375317+0000","last_peered":"2023-07-20T11:22:43.375317+0000","last_clean":"2023-07-20T11:22:43.375317+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:22:43.375317+0000","last_undegraded":"2023-07-20T11:22:43.375317+0000","last_fullsized":"2023-07-20T11:22:43.375317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:43:25.898378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095394+0000","last_change":"2023-07-20T11:22:41.564671+0000","last_active":"2023-07-20T11:22:43.095394+0000","last_peered":"2023-07-20T11:22:43.095394+0000","last_clean":"2023-07-20T11:22:43.095394+0000","last_became_active":"2023-07-20T11:22:41.564382+0000","last_became_peered":"2023-07-20T11:22:41.564382+0000","last_unstale":"2023-07-20T11:22:43.095394+0000","last_undegraded":"2023-07-20T11:22:43.095394+0000","last_fullsized":"2023-07-20T11:22:43.095394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:36:40.678023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"190'2","reported_seq":15,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.373925+0000","last_change":"2023-07-20T11:22:40.551206+0000","last_active":"2023-07-20T11:22:43.373925+0000","last_peered":"2023-07-20T11:22:43.373925+0000","last_clean":"2023-07-20T11:22:43.373925+0000","last_became_active":"2023-07-20T11:22:40.550900+0000","last_became_peered":"2023-07-20T11:22:40.550900+0000","last_unstale":"2023-07-20T11:22:43.373925+0000","last_undegraded":"2023-07-20T11:22:43.373925+0000","last_fullsized":"2023-07-20T11:22:43.373925+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:26:04.209476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":345,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547966+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:22:42.547966+0000","last_peered":"2023-07-20T11:22:42.547966+0000","last_clean":"2023-07-20T11:22:42.547966+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:22:42.547966+0000","last_undegraded":"2023-07-20T11:22:42.547966+0000","last_fullsized":"2023-07-20T11:22:42.547966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:49:37.402408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:42.547921+0000","last_change":"2023-07-20T11:22:41.567829+0000","last_active":"2023-07-20T11:22:42.547921+0000","last_peered":"2023-07-20T11:22:42.547921+0000","last_clean":"2023-07-20T11:22:42.547921+0000","last_became_active":"2023-07-20T11:22:41.567399+0000","last_became_peered":"2023-07-20T11:22:41.567399+0000","last_unstale":"2023-07-20T11:22:42.547921+0000","last_undegraded":"2023-07-20T11:22:42.547921+0000","last_fullsized":"2023-07-20T11:22:42.547921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:40.526003+0000","last_clean_scrub_stamp":"2023-07-20T11:22:40.526003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:23.931261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.180633+0000","last_change":"2023-07-20T11:22:40.559705+0000","last_active":"2023-07-20T11:22:43.180633+0000","last_peered":"2023-07-20T11:22:43.180633+0000","last_clean":"2023-07-20T11:22:43.180633+0000","last_became_active":"2023-07-20T11:22:40.559185+0000","last_became_peered":"2023-07-20T11:22:40.559185+0000","last_unstale":"2023-07-20T11:22:43.180633+0000","last_undegraded":"2023-07-20T11:22:43.180633+0000","last_fullsized":"2023-07-20T11:22:43.180633+0000","mapping_epoch":188,"log_start":"0'0","ondisk_log_start":"0'0","created":188,"last_epoch_clean":189,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:22:39.513848+0000","last_clean_scrub_stamp":"2023-07-20T11:22:39.513848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:15:44.465928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":341,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-07-20T11:22:43.095569+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:22:43.095569+0000","last_peered":"2023-07-20T11:22:43.095569+0000","last_clean":"2023-07-20T11:22:43.095569+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:22:43.095569+0000","last_undegraded":"2023-07-20T11:22:43.095569+0000","last_fullsized":"2023-07-20T11:22:43.095569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:20:19.220163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52076,"kb_used_data":2912,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319764,"statfs":{"total":96636764160,"available":96583438336,"internally_reserved":0,"allocated":2981888,"data_stored":1815800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.38300000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0629999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.996,"15min":1.1200000000000001},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.54000000000000004,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72199999999999998,"15min":0.74299999999999999},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.97299999999999998,"15min":1.081},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70499999999999996,"15min":0.72199999999999998},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.377},"max":{"1min":0.89000000000000001,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.746,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.0900000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.74199999999999999},"min":{"1min":0.46600000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.95899999999999996,"15min":1.0409999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.012,"15min":1.0509999999999999},"last":0.879}]},{"osd":4,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.29899999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68000000000000005},"min":{"1min":0.503,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98299999999999998,"5min":1.026,"15min":1.0469999999999999},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65300000000000002,"15min":0.63400000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.36099999999999999},"max":{"1min":0.872,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.51200000000000001,"5min":0.48399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96499999999999997,"5min":1.042,"15min":1.075},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.36799999999999999},"max":{"1min":0.93500000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.69499999999999995},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0920000000000001},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575952,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41648,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330192,"statfs":{"total":96636764160,"available":96594116608,"internally_reserved":0,"allocated":2387968,"data_stored":1225432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.78300000000000003,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49399999999999999,"15min":0.37},"max":{"1min":0.94999999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.623,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91600000000000004,"5min":1.0469999999999999,"15min":1.077},"last":0.85499999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.45600000000000002},"max":{"1min":0.90100000000000002,"5min":0.95499999999999996,"15min":0.98499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.59399999999999997,"5min":0.503,"15min":0.49099999999999999},"max":{"1min":0.88,"5min":1.0389999999999999,"15min":1.1100000000000001},"last":0.997}]},{"osd":2,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0640000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.752},"min":{"1min":0.56699999999999995,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.93899999999999995,"5min":1.0329999999999999,"15min":1.093},"last":0.88900000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.64600000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.96699999999999997,"5min":1.02,"15min":1.0840000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.748,"15min":0.75800000000000001},"min":{"1min":0.64800000000000002,"5min":0.52000000000000002,"15min":0.503},"max":{"1min":0.88900000000000001,"5min":0.97999999999999998,"15min":1.143},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61499999999999999,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.38200000000000001,"15min":0.318},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.046},"last":0.438},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70099999999999996,"15min":0.70399999999999996},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.33600000000000002},"max":{"1min":0.89600000000000002,"5min":0.93999999999999995,"15min":1.0309999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61199999999999999,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.439,"15min":0.38800000000000001},"max":{"1min":0.72799999999999998,"5min":0.98999999999999999,"15min":1.0620000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.64700000000000002},"min":{"1min":0.49399999999999999,"5min":0.441,"15min":0.36699999999999999},"max":{"1min":0.78500000000000003,"5min":0.93400000000000005,"15min":1.0700000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64700000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.38400000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":1.097},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68100000000000005,"15min":0.68400000000000005},"min":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.41699999999999998},"max":{"1min":0.82299999999999995,"5min":0.95099999999999996,"15min":1.054},"last":0.54000000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2340,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2396160,"data_stored":1225556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52300000000000002,"5min":0.42799999999999999,"15min":0.41499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.753},"min":{"1min":0.67100000000000004,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.95899999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76500000000000001,"15min":0.755},"min":{"1min":0.626,"5min":0.48899999999999999,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.204,"15min":1.204},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.60799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.57499999999999996,"5min":0.50800000000000001,"15min":0.505},"max":{"1min":0.93700000000000006,"5min":1.0169999999999999,"15min":1.071},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78700000000000003,"15min":0.77200000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53500000000000003},"max":{"1min":0.997,"5min":1.101,"15min":1.101},"last":0.749}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77800000000000002},"min":{"1min":0.63700000000000001,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.036},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78000000000000003,"15min":0.77200000000000002},"min":{"1min":0.59899999999999998,"5min":0.53400000000000003,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.44,"5min":0.371,"15min":0.33100000000000002},"max":{"1min":0.85099999999999998,"5min":1,"15min":1},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.64700000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.44500000000000001,"15min":0.40400000000000003},"max":{"1min":0.87,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65900000000000003,"15min":0.64100000000000001},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.433},"max":{"1min":0.91200000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.66700000000000004},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.378},"max":{"1min":0.84799999999999998,"5min":0.98699999999999999,"15min":0.98799999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.96999999999999997,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73799999999999999,"15min":0.71299999999999997},"min":{"1min":0.57499999999999996,"5min":0.49299999999999999,"15min":0.48499999999999999},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41660,"kb_used_data":2348,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330180,"statfs":{"total":96636764160,"available":96594104320,"internally_reserved":0,"allocated":2404352,"data_stored":1226196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.73099999999999998,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.73299999999999998},"min":{"1min":0.59899999999999998,"5min":0.51800000000000002,"15min":0.39500000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.1870000000000001},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.1419999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.47999999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1060000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.56499999999999995,"15min":0.56000000000000005},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.2310000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77100000000000002,"15min":0.77900000000000003},"min":{"1min":0.624,"5min":0.48399999999999999,"15min":0.46000000000000002},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.0049999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.75900000000000001,"15min":0.76600000000000001},"min":{"1min":0.59399999999999997,"5min":0.497,"15min":0.49399999999999999},"max":{"1min":1.026,"5min":1.034,"15min":1.1160000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.89600000000000002,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":1.085,"15min":1.085},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.36899999999999999},"max":{"1min":0.96799999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.745},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0329999999999999,"15min":1.0720000000000001},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.42099999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":1.036,"15min":1.036},"last":0.90500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575949,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59708,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312132,"statfs":{"total":96636764160,"available":96575623168,"internally_reserved":0,"allocated":2408448,"data_stored":1227600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45400000000000001,"15min":0.46600000000000003},"min":{"1min":0.32600000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.61599999999999999,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.44},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.77100000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.498,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65400000000000003,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.68600000000000005,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57299999999999995,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71299999999999997,"5min":0.82499999999999996,"15min":0.96099999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60499999999999998,"15min":0.60699999999999998},"min":{"1min":0.43099999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74299999999999999,"5min":0.871,"15min":0.95099999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.78400000000000003,"15min":0.80500000000000005},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.51800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.81999999999999995,"15min":0.84099999999999997},"min":{"1min":0.60299999999999998,"5min":0.55800000000000005,"15min":0.503},"max":{"1min":1.194,"5min":1.242,"15min":1.369},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81399999999999995,"15min":0.82699999999999996},"min":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1779999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81799999999999995,"15min":0.84399999999999997},"min":{"1min":0.68999999999999995,"5min":0.57399999999999995,"15min":0.56599999999999995},"max":{"1min":1.0740000000000001,"5min":1.127,"15min":1.3620000000000001},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81299999999999994,"15min":0.83699999999999997},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58199999999999996},"max":{"1min":1.0620000000000001,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.81200000000000006,"15min":0.82999999999999996},"min":{"1min":0.66100000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:22:02 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.84399999999999997,"15min":0.85699999999999998},"min":{"1min":0.70299999999999996,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.169,"5min":1.169,"15min":1.3999999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.66300000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59696,"kb_used_data":2332,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312144,"statfs":{"total":96636764160,"available":96575635456,"internally_reserved":0,"allocated":2387968,"data_stored":1225432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.48599999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27100000000000002},"max":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.82699999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.36199999999999999,"15min":0.28999999999999998},"max":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.47799999999999998,"15min":0.48799999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65900000000000003,"5min":0.76800000000000002,"15min":0.78500000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56599999999999995,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.44}]},{"osd":3,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.58599999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.01},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.64300000000000002,"5min":0.60299999999999998,"15min":0.54400000000000004},"max":{"1min":1.109,"5min":1.109,"15min":1.375},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.626,"5min":0.61299999999999999,"15min":0.59299999999999997},"max":{"1min":1.042,"5min":1.077,"15min":1.298},"last":0.85199999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.55100000000000005},"max":{"1min":1.131,"5min":1.131,"15min":1.2849999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81000000000000005,"15min":0.82399999999999995},"min":{"1min":0.68700000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.044,"5min":1.179,"15min":1.476},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.68899999999999995,"5min":0.63900000000000001,"15min":0.503},"max":{"1min":1.1499999999999999,"5min":1.153,"15min":1.494},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82299999999999995,"15min":0.83699999999999997},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.57499999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.3440000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.72599999999999998,"5min":0.60799999999999998,"15min":0.53800000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.73599999999999999,"5min":0.69199999999999995,"15min":0.55400000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.4099999999999999},"last":0.88300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575950,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37564,"kb_used_data":2344,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334276,"statfs":{"total":96636764160,"available":96598298624,"internally_reserved":0,"allocated":2400256,"data_stored":1226996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.32000000000000001,"5min":0.313,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.72999999999999998,"15min":0.748},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.433,"15min":0.41999999999999998},"max":{"1min":0.68799999999999994,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.62}]},{"osd":2,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.378,"5min":0.36199999999999999,"15min":0.33200000000000002},"max":{"1min":0.68300000000000005,"5min":0.753,"15min":0.753},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":0.65900000000000003,"5min":0.78400000000000003,"15min":0.83499999999999996},"last":0.65600000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.44800000000000001,"5min":0.40999999999999998,"15min":0.36699999999999999},"max":{"1min":0.74199999999999999,"5min":0.86699999999999999,"15min":1.2050000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.63700000000000001,"5min":0.72799999999999998,"15min":1.0109999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.51100000000000001,"15min":0.46800000000000003},"max":{"1min":1.0009999999999999,"5min":1.117,"15min":1.4790000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81599999999999995,"15min":0.81399999999999995},"min":{"1min":0.63900000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":0.96299999999999997,"5min":1.077,"15min":1.26},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.95299999999999996,"5min":1.1399999999999999,"15min":1.175},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.623,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.083,"5min":1.083,"15min":1.4339999999999999},"last":1.036}]},{"osd":6,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.1910000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82499999999999996,"15min":0.82899999999999996},"min":{"1min":0.66500000000000004,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":1.0509999999999999,"5min":1.1100000000000001,"15min":1.3089999999999999},"last":1.155}]},{"osd":7,"last update":"Thu Jul 20 11:22:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.85199999999999998,"15min":0.84499999999999997},"min":{"1min":0.65900000000000003,"5min":0.64900000000000002,"15min":0.61599999999999999},"max":{"1min":1.002,"5min":1.1579999999999999,"15min":1.242},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.65200000000000002,"5min":0.61199999999999999,"15min":0.56200000000000006},"max":{"1min":0.98599999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":1.052}]}]},{"osd":0,"up_from":13,"seq":55834575950,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47992,"kb_used_data":2920,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323848,"statfs":{"total":96636764160,"available":96587620352,"internally_reserved":0,"allocated":2990080,"data_stored":1815904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.254},"max":{"1min":0.66500000000000004,"5min":0.69599999999999995,"15min":0.79900000000000004},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54700000000000004,"15min":0.53800000000000003},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.33300000000000002},"max":{"1min":0.68000000000000005,"5min":0.79600000000000004,"15min":0.80500000000000005},"last":0.439}]},{"osd":2,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.377,"15min":0.29799999999999999},"max":{"1min":0.71199999999999997,"5min":0.76300000000000001,"15min":0.79900000000000004},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.57199999999999995},"min":{"1min":0.433,"5min":0.41399999999999998,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.83799999999999997,"15min":0.85599999999999998},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.375,"15min":0.35399999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79000000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.60399999999999998,"15min":0.60599999999999998},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.36399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":1.0069999999999999},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.82399999999999995},"min":{"1min":0.65600000000000003,"5min":0.54300000000000004,"15min":0.53400000000000003},"max":{"1min":1.0880000000000001,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.64700000000000002,"5min":0.64100000000000001,"15min":0.56699999999999995},"max":{"1min":0.96299999999999997,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.755}]},{"osd":5,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.84799999999999998,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.60499999999999998,"15min":0.52600000000000002},"max":{"1min":1,"5min":1.379,"15min":1.379},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.85599999999999998,"15min":0.84099999999999997},"min":{"1min":0.63,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1319999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.627}]},{"osd":6,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.86099999999999999,"15min":0.83799999999999997},"min":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0780000000000001,"5min":1.2509999999999999,"15min":1.3089999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85499999999999998,"15min":0.84999999999999998},"min":{"1min":0.65400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1140000000000001,"5min":1.355,"15min":1.355},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:22:01 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.878,"15min":0.86899999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.0289999999999999,"5min":1.204,"15min":1.2589999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.63300000000000001,"5min":0.62,"15min":0.55600000000000005},"max":{"1min":0.95599999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.74099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:22:50.536 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T11:22:50.537 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T11:22:50.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.726+0000 7f6167f11640 1 Processor -- start 2023-07-20T11:22:50.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.726+0000 7f6167f11640 1 -- start start 2023-07-20T11:22:50.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.726+0000 7f6167f11640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f616006f710 0x7f616006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.726+0000 7f6167f11640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6160070030 con 0x7f61600ca5a0 2023-07-20T11:22:50.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6167f11640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6160071950 con 0x7f616015a6f0 2023-07-20T11:22:50.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6167f11640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616015bad0 con 0x7f616006f710 2023-07-20T11:22:50.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f61600ca5a0 0x7f616015e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52022/0 (socket says 172.21.15.82:52022) 2023-07-20T11:22:50.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 -- 172.21.15.82:0/2767520488 learned_addr learned my addr 172.21.15.82:0/2767520488 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:50.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6165cad640 1 --2- 172.21.15.82:0/2767520488 >> v2:172.21.15.183:3300/0 conn(0x7f616006f710 0x7f616006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811273409 0 0) 0x7f6160070030 con 0x7f61600ca5a0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c003530 con 0x7f61600ca5a0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081271340 0 0) 0x7f6160071950 con 0x7f616015a6f0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6160070030 con 0x7f616015a6f0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304812683 0 0) 0x7f614c003530 con 0x7f61600ca5a0 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 >> v2:172.21.15.183:3300/0 conn(0x7f616006f710 msgr2=0x7f616006faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:50.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 --2- 172.21.15.82:0/2767520488 >> v2:172.21.15.183:3300/0 conn(0x7f616006f710 0x7f616006faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 >> v1:172.21.15.183:6789/0 conn(0x7f616015a6f0 legacy=0x7f61600c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616015b230 con 0x7f61600ca5a0 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f6150001680 con 0x7f61600ca5a0 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 >> v1:172.21.15.82:6789/0 conn(0x7f61600ca5a0 legacy=0x7f616015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f614c003b80 0x7f614c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c005190 0x7f614c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616015bad0 con 0x7f614c0047d0 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c090 con 0x7f614c005190 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c250 con 0x7f614c003b80 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f6165cad640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f614c003b80 0x7f614c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61664ae640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c005190 0x7f614c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 -- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f614c003b80 msgr2=0x7f614c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f614c003b80 0x7f614c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 -- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c005190 msgr2=0x7f614c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c005190 0x7f614c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61654ac640 1 -- 172.21.15.82:0/2767520488 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c003530 con 0x7f614c0047d0 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61664ae640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c005190 0x7f614c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:50.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.730+0000 7f61664ae640 1 -- 172.21.15.82:0/2767520488 reap_dead start 2023-07-20T11:22:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f61654ac640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f61600caa50 tx=0x7f615001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895de4c8c13913e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500058e0 con 0x7f614c0047d0 2023-07-20T11:22:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6150005a60 con 0x7f614c0047d0 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6164cab640 1 -- 172.21.15.82:0/2767520488 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150005e50 con 0x7f614c0047d0 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 msgr2=0x7f614c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f61600caa50 tx=0x7f615001cb80 comp rx=0 tx=0).stop 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- 172.21.15.82:0/2767520488 shutdown_connections 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 --2- 172.21.15.82:0/2767520488 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f614c0047d0 0x7f614c004c50 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- 172.21.15.82:0/2767520488 >> 172.21.15.82:0/2767520488 conn(0x7f61600cad50 msgr2=0x7f61600cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- 172.21.15.82:0/2767520488 shutdown_connections 2023-07-20T11:22:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- 172.21.15.82:0/2767520488 wait complete. 2023-07-20T11:22:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 Processor -- start 2023-07-20T11:22:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.734+0000 7f6167f11640 1 -- start start 2023-07-20T11:22:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 0x7f616014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 0x7f61601e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601e5170 con 0x7f6160151af0 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6160151660 con 0x7f614c0047d0 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61601e4330 con 0x7f61601e4cf0 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60832/0 (socket says 172.21.15.82:60832) 2023-07-20T11:22:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 -- 172.21.15.82:0/3136490862 learned_addr learned my addr 172.21.15.82:0/3136490862 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6165cad640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 0x7f616014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61664ae640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 0x7f61601e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 -- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 msgr2=0x7f61601e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 0x7f61601e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 -- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 msgr2=0x7f616014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 0x7f616014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 -- 172.21.15.82:0/3136490862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160150d30 con 0x7f6160151af0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61664ae640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 0x7f61601e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6165cad640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 0x7f616014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61654ac640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f615001c9b0 tx=0x7f614c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500a5c90 con 0x7f6160151af0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500a5df0 con 0x7f6160151af0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150004a30 con 0x7f6160151af0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6160151010 con 0x7f6160151af0 2023-07-20T11:22:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616014eda0 con 0x7f6160151af0 2023-07-20T11:22:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61600717a0 con 0x7f6160151af0 2023-07-20T11:22:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.738+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6150004b90 con 0x7f6160151af0 2023-07-20T11:22:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.742+0000 7f61567fc640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 0x7f6144068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.742+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f615011df20 con 0x7f6160151af0 2023-07-20T11:22:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.742+0000 7f6165cad640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 0x7f6144068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:50.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.742+0000 7f6165cad640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 0x7f6144068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f615c009b80 tx=0x7f615c008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:50.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.746+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61500eb1a0 con 0x7f6160151af0 2023-07-20T11:22:50.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.942+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f616004da30 con 0x7f6160151af0 2023-07-20T11:22:50.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f61567fc640 1 -- 172.21.15.82:0/3136490862 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v49) v1 ==== 190+0+147 (secure 0 0 0) 0x7f61500ee7c0 con 0x7f6160151af0 2023-07-20T11:22:50.940 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T11:22:50.941 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T11:22:50.941 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T11:22:50.942 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T11:22:50.942 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T11:22:50.943 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T11:22:50.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 msgr2=0x7f6144068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 0x7f6144068890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f615c009b80 tx=0x7f615c008040 comp rx=0 tx=0).stop 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 msgr2=0x7f61601e47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f615001c9b0 tx=0x7f614c005800 comp rx=0 tx=0).stop 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 shutdown_connections 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f61601e4cf0 0x7f61601e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f61440663d0 0x7f6144068890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6160151af0 0x7f61601e47b0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 --2- 172.21.15.82:0/3136490862 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614c0047d0 0x7f616014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:50.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 >> 172.21.15.82:0/3136490862 conn(0x7f61600cad50 msgr2=0x7f6160152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:50.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 shutdown_connections 2023-07-20T11:22:50.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:50.950+0000 7f6167f11640 1 -- 172.21.15.82:0/3136490862 wait complete. 2023-07-20T11:22:50.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:22:51.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 Processor -- start 2023-07-20T11:22:51.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 -- start start 2023-07-20T11:22:51.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 0x7f0ce80ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ce815a8e0 0x7f0ce80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 0x7f0ce80b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce80b3160 con 0x7f0ce815a8e0 2023-07-20T11:22:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce80b2ee0 con 0x7f0ce80afda0 2023-07-20T11:22:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cef767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b06c0 con 0x7f0ce80b2060 2023-07-20T11:22:51.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ce815a8e0 0x7f0ce80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0ce815a8e0 0x7f0ce80b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60848/0 (socket says 172.21.15.82:60848) 2023-07-20T11:22:51.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 -- 172.21.15.82:0/4068641272 learned_addr learned my addr 172.21.15.82:0/4068641272 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 -- 172.21.15.82:0/4068641272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 msgr2=0x7f0ce80b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0ced503640 1 --2- 172.21.15.82:0/4068641272 >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 0x7f0ce80ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cedd04640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 0x7f0ce80b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 0x7f0ce80b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 -- 172.21.15.82:0/4068641272 >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 msgr2=0x7f0ce80ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 --2- 172.21.15.82:0/4068641272 >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 0x7f0ce80ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cecd02640 1 -- 172.21.15.82:0/4068641272 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80b12a0 con 0x7f0ce815a8e0 2023-07-20T11:22:51.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0ced503640 1 --2- 172.21.15.82:0/4068641272 >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 0x7f0ce80ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:51.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.110+0000 7f0cedd04640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 0x7f0ce80b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:51.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cecd02640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce815a8e0 0x7f0ce80b29a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80b0b40 tx=0x7f0cd801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72c83f4ba674ce7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cdffff640 1 -- 172.21.15.82:0/4068641272 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80ab600 con 0x7f0ce815a8e0 2023-07-20T11:22:51.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cdffff640 1 -- 172.21.15.82:0/4068641272 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80a7050 con 0x7f0ce815a8e0 2023-07-20T11:22:51.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cdffff640 1 -- 172.21.15.82:0/4068641272 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80ab980 con 0x7f0ce815a8e0 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 -- 172.21.15.82:0/4068641272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce815a8e0 msgr2=0x7f0ce80b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce815a8e0 0x7f0ce80b29a0 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f0ce80b0b40 tx=0x7f0cd801c3b0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 -- 172.21.15.82:0/4068641272 shutdown_connections 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce80b2060 0x7f0ce80b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 --2- 172.21.15.82:0/4068641272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce815a8e0 0x7f0ce80b29a0 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 --2- 172.21.15.82:0/4068641272 >> v2:172.21.15.183:3300/0 conn(0x7f0ce80afda0 0x7f0ce80ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 -- 172.21.15.82:0/4068641272 >> 172.21.15.82:0/4068641272 conn(0x7f0ce80cada0 msgr2=0x7f0ce80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 -- 172.21.15.82:0/4068641272 shutdown_connections 2023-07-20T11:22:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.114+0000 7f0cef767640 1 -- 172.21.15.82:0/4068641272 wait complete. 2023-07-20T11:22:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 Processor -- start 2023-07-20T11:22:51.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- start start 2023-07-20T11:22:51.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 0x7f0ce81510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 0x7f0ce815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce815db40 con 0x7f0ce80b2060 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80abf50 con 0x7f0ce80afda0 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80ac230 con 0x7f0ce815a8e0 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60860/0 (socket says 172.21.15.82:60860) 2023-07-20T11:22:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 -- 172.21.15.82:0/2439293752 learned_addr learned my addr 172.21.15.82:0/2439293752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0ced503640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 0x7f0ce81510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 -- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 msgr2=0x7f0ce815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cedd04640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 0x7f0ce815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 0x7f0ce815bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 -- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 msgr2=0x7f0ce81510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 0x7f0ce81510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 -- 172.21.15.82:0/2439293752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80094d0 con 0x7f0ce80b2060 2023-07-20T11:22:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0ced503640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 0x7f0ce81510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cedd04640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 0x7f0ce815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cecd02640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80ae040 tx=0x7f0cd8019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80ba070 con 0x7f0ce80b2060 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80ac030 con 0x7f0ce80b2060 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80b6440 con 0x7f0ce80b2060 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce80ac510 con 0x7f0ce80b2060 2023-07-20T11:22:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.118+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce80acad0 con 0x7f0ce80b2060 2023-07-20T11:22:51.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce80accc0 con 0x7f0ce80b2060 2023-07-20T11:22:51.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0cd80b2040 con 0x7f0ce80b2060 2023-07-20T11:22:51.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0cddffb640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 0x7f0ccc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f0cd811ddb0 con 0x7f0ce80b2060 2023-07-20T11:22:51.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0ced503640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 0x7f0ccc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.115 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.122+0000 7f0ced503640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 0x7f0ccc068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4008f00 tx=0x7f0ce4008450 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.126+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cd80eafc0 con 0x7f0ce80b2060 2023-07-20T11:22:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ce8073c70 con 0x7f0ce80b2060 2023-07-20T11:22:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cddffb640 1 -- 172.21.15.82:0/2439293752 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f0cd80ee5e0 con 0x7f0ce80b2060 2023-07-20T11:22:51.297 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:22:51.298 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:22:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:22:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 msgr2=0x7f0ccc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 0x7f0ccc068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4008f00 tx=0x7f0ce4008450 comp rx=0 tx=0).stop 2023-07-20T11:22:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 msgr2=0x7f0ce815b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80ae040 tx=0x7f0cd8019150 comp rx=0 tx=0).stop 2023-07-20T11:22:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 shutdown_connections 2023-07-20T11:22:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0ce815a8e0 0x7f0ce815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f0ccc0663a0 0x7f0ccc068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ce80b2060 0x7f0ce815b830 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 --2- 172.21.15.82:0/2439293752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ce80afda0 0x7f0ce81510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 >> 172.21.15.82:0/2439293752 conn(0x7f0ce80cada0 msgr2=0x7f0ce8159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 shutdown_connections 2023-07-20T11:22:51.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.306+0000 7f0cef767640 1 -- 172.21.15.82:0/2439293752 wait complete. 2023-07-20T11:22:51.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T11:22:40.920311+0000', 'modified': '2023-07-20T11:22:44.552107+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10848}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10848': {'gid': 10848, 'name': 'c', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2112812195', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 2112812195}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2112812195}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T11:22:51.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T11:22:51.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T11:22:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 Processor -- start 2023-07-20T11:22:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 -- start start 2023-07-20T11:22:51.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6d00b1cc0 0x7fd6d00b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d00cdd60 con 0x7fd6d00ad720 2023-07-20T11:22:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d00b20a0 con 0x7fd6d00b04b0 2023-07-20T11:22:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d7567640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d00cd430 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d5303640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd6d00b1cc0 0x7fd6d00b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d4b02640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fd6d00ad720 0x7fd6d00afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52024/0 (socket says 172.21.15.82:52024) 2023-07-20T11:22:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.870+0000 7fd6d4b02640 1 -- 172.21.15.82:0/1002606340 learned_addr learned my addr 172.21.15.82:0/1002606340 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:51.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6d5303640 1 -- 172.21.15.82:0/1002606340 >> v1:172.21.15.183:6789/0 conn(0x7fd6d00b04b0 legacy=0x7fd6d0160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6d5303640 1 -- 172.21.15.82:0/1002606340 >> v1:172.21.15.82:6789/0 conn(0x7fd6d00ad720 legacy=0x7fd6d00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6d5303640 1 -- 172.21.15.82:0/1002606340 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00cd710 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6c7fff640 1 -- 172.21.15.82:0/1002606340 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288008027 0 0) 0x7fd6d00cdd60 con 0x7fd6d00ad720 2023-07-20T11:22:51.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6d5303640 1 --2- 172.21.15.82:0/1002606340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00b2a30 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009d90 tx=0x7fd6cc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38c38678767f95e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6c7fff640 1 -- 172.21.15.82:0/1002606340 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0a5930 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6c7fff640 1 -- 172.21.15.82:0/1002606340 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0a5a90 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.874+0000 7fd6c7fff640 1 -- 172.21.15.82:0/1002606340 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0a5e20 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- 172.21.15.82:0/1002606340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 msgr2=0x7fd6d00b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 --2- 172.21.15.82:0/1002606340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00b2a30 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009d90 tx=0x7fd6cc01c850 comp rx=0 tx=0).stop 2023-07-20T11:22:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- 172.21.15.82:0/1002606340 shutdown_connections 2023-07-20T11:22:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 --2- 172.21.15.82:0/1002606340 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00b2a30 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- 172.21.15.82:0/1002606340 >> 172.21.15.82:0/1002606340 conn(0x7fd6d00cada0 msgr2=0x7fd6d00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- 172.21.15.82:0/1002606340 shutdown_connections 2023-07-20T11:22:51.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- 172.21.15.82:0/1002606340 wait complete. 2023-07-20T11:22:51.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 Processor -- start 2023-07-20T11:22:51.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- start start 2023-07-20T11:22:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6d00ad720 0x7fd6d014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6d00b04b0 0x7fd6d0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0155a60 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d0156300 con 0x7fd6d00b04b0 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d7567640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d00ca8d0 con 0x7fd6d00ad720 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60876/0 (socket says 172.21.15.82:60876) 2023-07-20T11:22:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 -- 172.21.15.82:0/2274770128 learned_addr learned my addr 172.21.15.82:0/2274770128 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6d00ad720 0x7fd6d014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6d00b04b0 0x7fd6d0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 -- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6d00ad720 msgr2=0x7fd6d014b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6d00ad720 0x7fd6d014b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 -- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6d00b04b0 msgr2=0x7fd6d0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6d00b04b0 0x7fd6d0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 -- 172.21.15.82:0/2274770128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc009a70 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.878+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b410 tx=0x7fd6c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 -- 172.21.15.82:0/2274770128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8004020 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 -- 172.21.15.82:0/2274770128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8004180 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 -- 172.21.15.82:0/2274770128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011630 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d00b12f0 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d0155f90 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 -- 172.21.15.82:0/2274770128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd6c8011790 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 0x7fd6b4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6c5ffb640 1 -- 172.21.15.82:0/2274770128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd6c8083c20 con 0x7fd6d00b1cc0 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.882+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 0x7fd6b4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 Processor -- start 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- start start 2023-07-20T11:22:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 0x7fd6b4068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0af000 tx=0x7fd6cc0a7070 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab07950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab08270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a9cf0a0 con 0x556a2ab51d20 2023-07-20T11:22:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a95de40 con 0x556a2ab52640 2023-07-20T11:22:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2a95b370 con 0x556a2ab07e90 2023-07-20T11:22:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60886/0 (socket says 172.21.15.82:60886) 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 -- 172.21.15.82:0/2365643444 learned_addr learned my addr 172.21.15.82:0/2365643444 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab07950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab08270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 -- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 msgr2=0x556a2ab08270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab08270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 -- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 msgr2=0x556a2ab07950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab07950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 -- 172.21.15.82:0/2365643444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2a652890 con 0x556a2ab51d20 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab08270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000f90 tx=0x7fd6cc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74c1dabef336785 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6b2ffd640 1 -- 172.21.15.82:0/2365643444 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b8450 con 0x556a2ab51d20 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6b2ffd640 1 -- 172.21.15.82:0/2365643444 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0b85b0 con 0x556a2ab51d20 2023-07-20T11:22:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6b2ffd640 1 -- 172.21.15.82:0/2365643444 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b8920 con 0x556a2ab51d20 2023-07-20T11:22:51.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2365643444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 msgr2=0x556a2ab52100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc000f90 tx=0x7fd6cc004ac0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2365643444 shutdown_connections 2023-07-20T11:22:51.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab08270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab07950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2365643444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab52100 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2365643444 >> 172.21.15.82:0/2365643444 conn(0x556a2aaff200 msgr2=0x556a2ab06230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2365643444 shutdown_connections 2023-07-20T11:22:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2365643444 wait complete. 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 -- start start 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.886+0000 7fd6da8d0000 1 Processor -- start 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab12ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab13940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a956c60 con 0x556a2ab51d20 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a912ae0 con 0x556a2ab52640 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2a912780 con 0x556a2ab07e90 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 10 client.0 _ll_register_callbacks cb 0x556a2aaf3820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60902/0 (socket says 172.21.15.82:60902) 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 -- 172.21.15.82:0/2413156450 learned_addr learned my addr 172.21.15.82:0/2413156450 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab13940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab12ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 -- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 msgr2=0x556a2ab12ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab12ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 -- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 msgr2=0x556a2ab13940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab13940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 -- 172.21.15.82:0/2413156450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d00cd710 con 0x556a2ab51d20 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005f40 tx=0x7fd6c00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736750693a04f99e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0001d60 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a2a916fb0 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd6c00145e0 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6c00147e0 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 10 client.11001 fetch_fsmap learned FSMap version 90 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x556a2a91ad10 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a2a916fb0 con 0x556a2ab51d20 2023-07-20T11:22:51.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 90) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd6c0014940 con 0x556a2ab51d20 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 10 client.11001 fetch_fsmap finished waiting for FSMap version 90 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 10 client.11001 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 20 client.11001 populate_metadata read hostname 'smithi082' 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab14210 0x556a2ab63290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 4 client.11001 mds_command: new command op to 10848 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 --> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a2a985410 con 0x556a2ab14210 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab14210 0x556a2ab63290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6d5303640 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab14210 0x556a2ab63290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4836e07d74be6d73 server_cookie=7df1097dbf8a01da in_seq=0 out_seq=0 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.890+0000 7fd6abfff640 10 client.11001 ms_handle_connect on v2:172.21.15.82:6836/2112812195 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6abfff640 1 -- 172.21.15.82:0/2413156450 <== mds.0 v2:172.21.15.82:6836/2112812195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x556a2a985410 con 0x556a2ab14210 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6abfff640 10 client.11001 handle_command_reply: tid=0 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 client.11001 shutdown 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 msgr2=0x556a2ab13400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0005f40 tx=0x7fd6c00015f0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 shutdown_connections 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab14210 0x556a2ab63290 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab13940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2ab13400 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6abfff640 0 client.11001 ms_handle_reset on v2:172.21.15.82:6836/2112812195 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/2413156450 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2ab12ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 >> 172.21.15.82:0/2413156450 conn(0x556a2aaff200 msgr2=0x556a2ab06230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 shutdown_connections 2023-07-20T11:22:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 1 -- 172.21.15.82:0/2413156450 wait complete. 2023-07-20T11:22:51.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.894+0000 7fd6da8d0000 20 client.11001 trim_cache size 0 max 16384 2023-07-20T11:22:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.906+0000 7fd6da8d0000 1 Processor -- start 2023-07-20T11:22:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.906+0000 7fd6da8d0000 1 -- start start 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ababb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a613940 con 0x556a2ab51d20 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2ab13140 con 0x556a2ab52640 2023-07-20T11:22:51.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2a924e10 con 0x556a2ab07e90 2023-07-20T11:22:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60904/0 (socket says 172.21.15.82:60904) 2023-07-20T11:22:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3382700701 learned_addr learned my addr 172.21.15.82:0/3382700701 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 msgr2=0x556a2abab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ababb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 msgr2=0x556a2ababb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ababb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3382700701 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2a900fa0 con 0x556a2ab51d20 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0014f70 tx=0x7fd6c000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff940e5ea4eb33 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6b37fe640 1 -- 172.21.15.82:0/3382700701 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0005b30 con 0x556a2ab51d20 2023-07-20T11:22:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6b37fe640 1 -- 172.21.15.82:0/3382700701 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0001d60 con 0x556a2ab51d20 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6b37fe640 1 -- 172.21.15.82:0/3382700701 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0014800 con 0x556a2ab51d20 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3382700701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 msgr2=0x556a2abab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0014f70 tx=0x7fd6c000e000 comp rx=0 tx=0).stop 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3382700701 shutdown_connections 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ababb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abab630 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3382700701 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3382700701 >> 172.21.15.82:0/3382700701 conn(0x556a2aaff200 msgr2=0x556a2ab0cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3382700701 shutdown_connections 2023-07-20T11:22:51.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3382700701 wait complete. 2023-07-20T11:22:51.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 -- start start 2023-07-20T11:22:51.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 Processor -- start 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abaf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.910+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab63550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a95f0d0 con 0x556a2ab51d20 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2a9ca9c0 con 0x556a2ab52640 2023-07-20T11:22:51.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2a917730 con 0x556a2ab07e90 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 10 client.0 _ll_register_callbacks cb 0x556a2a9ceff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60912/0 (socket says 172.21.15.82:60912) 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3199740427 learned_addr learned my addr 172.21.15.82:0/3199740427 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d5b04640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab63550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abaf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 msgr2=0x556a2abaf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abaf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 msgr2=0x556a2ab63550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab63550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 -- 172.21.15.82:0/3199740427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a2a91ad10 con 0x556a2ab51d20 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abaf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d4b02640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0014ec0 tx=0x7fd6c0001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90684bca9cf0e7b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:22:51.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0005b30 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a2ab07d20 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd6c0004e30 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6c0001af0 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 10 client.11007 fetch_fsmap learned FSMap version 90 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x556a2a652cc0 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a2ab07d20 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 90) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd6c0037020 con 0x556a2ab51d20 2023-07-20T11:22:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 10 client.11007 fetch_fsmap finished waiting for FSMap version 90 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 10 client.11007 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 20 client.11007 populate_metadata read hostname 'smithi082' 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab63ee0 0x556a2ab642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 4 client.11007 mds_command: new command op to 10848 tid=0[{"prefix": "status"}] 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 --> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a2a91da20 con 0x556a2ab63ee0 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab63ee0 0x556a2ab642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6d5303640 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab63ee0 0x556a2ab642c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=570f3e69f759a88a server_cookie=38e326a02e6e098c in_seq=0 out_seq=0 2023-07-20T11:22:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 10 client.11007 ms_handle_connect on v2:172.21.15.82:6836/2112812195 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 1 -- 172.21.15.82:0/3199740427 <== mds.0 v2:172.21.15.82:6836/2112812195 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x556a2a91da20 con 0x556a2ab63ee0 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 10 client.11007 handle_command_reply: tid=0 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 client.11007 shutdown 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 msgr2=0x556a2abafce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0014ec0 tx=0x7fd6c0001090 comp rx=0 tx=0).stop 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 shutdown_connections 2023-07-20T11:22:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:6836/2112812195,v1:172.21.15.82:6837/2112812195] conn(0x556a2ab63ee0 0x556a2ab642c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556a2ab52640 0x556a2ab63550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a2ab51d20 0x556a2abafce0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 --2- 172.21.15.82:0/3199740427 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x556a2ab07e90 0x556a2abaf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 >> 172.21.15.82:0/3199740427 conn(0x556a2aaff200 msgr2=0x556a2ab507d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6abfff640 0 client.11007 ms_handle_reset on v2:172.21.15.82:6836/2112812195 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 shutdown_connections 2023-07-20T11:22:51.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 1 -- 172.21.15.82:0/3199740427 wait complete. 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.914+0000 7fd6da8d0000 20 client.11007 trim_cache size 0 max 16384 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 10848, 2023-07-20T11:22:51.915 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.356774661999999, 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 90, 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 191, 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 191, 2023-07-20T11:22:51.916 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.341624669000002 2023-07-20T11:22:51.917 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:22:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 msgr2=0x7fd6b4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 0x7fd6b4068860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0af000 tx=0x7fd6cc0a7070 comp rx=0 tx=0).stop 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 msgr2=0x7fd6d00c9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b410 tx=0x7fd6c800b8d0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 shutdown_connections 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7fd6b40663a0 0x7fd6b4068860 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd6d00b1cc0 0x7fd6d00c9ff0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd6d00b04b0 0x7fd6d0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 --2- 172.21.15.82:0/2274770128 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd6d00ad720 0x7fd6d014b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 >> 172.21.15.82:0/2274770128 conn(0x7fd6d00cada0 msgr2=0x7fd6d015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 shutdown_connections 2023-07-20T11:22:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:51.918+0000 7fd6d7567640 1 -- 172.21.15.82:0/2274770128 wait complete. 2023-07-20T11:22:51.926 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T11:22:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 Processor -- start 2023-07-20T11:22:52.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 -- start start 2023-07-20T11:22:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b100d0d10 0x7f2b100d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 0x7f2b100cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b100d16b0 con 0x7f2b1015cab0 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b100d31c0 con 0x7f2b100d0d10 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b155f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100b3520 con 0x7f2b100cd4b0 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b0effd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2b1015cab0 0x7f2b100d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52034/0 (socket says 172.21.15.82:52034) 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b0effd640 1 -- 172.21.15.82:0/1903867996 learned_addr learned my addr 172.21.15.82:0/1903867996 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b067fc640 1 --2- 172.21.15.82:0/1903867996 >> v2:172.21.15.82:3300/0 conn(0x7f2b100d0d10 0x7f2b100d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b0f7fe640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 0x7f2b100cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b067fc640 1 -- 172.21.15.82:0/1903867996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 msgr2=0x7f2b100cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b067fc640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 0x7f2b100cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b067fc640 1 -- 172.21.15.82:0/1903867996 >> v1:172.21.15.82:6789/0 conn(0x7f2b1015cab0 legacy=0x7f2b100d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b067fc640 1 -- 172.21.15.82:0/1903867996 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100d0a10 con 0x7f2b100d0d10 2023-07-20T11:22:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.074+0000 7f2b0f7fe640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 0x7f2b100cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:52.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b067fc640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100d0d10 0x7f2b100d1170 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097c0 tx=0x7f2af801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a60011ee054e552 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:52.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1903867996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80ab650 con 0x7f2b100d0d10 2023-07-20T11:22:52.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1903867996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80ab7b0 con 0x7f2b100d0d10 2023-07-20T11:22:52.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1903867996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80abb40 con 0x7f2b100d0d10 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 -- 172.21.15.82:0/1903867996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100d0d10 msgr2=0x7f2b100d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100d0d10 0x7f2b100d1170 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f2af80097c0 tx=0x7f2af801c450 comp rx=0 tx=0).stop 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 -- 172.21.15.82:0/1903867996 shutdown_connections 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b100cd4b0 0x7f2b100cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 --2- 172.21.15.82:0/1903867996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100d0d10 0x7f2b100d1170 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 -- 172.21.15.82:0/1903867996 >> 172.21.15.82:0/1903867996 conn(0x7f2b1008c120 msgr2=0x7f2b1009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:52.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 -- 172.21.15.82:0/1903867996 shutdown_connections 2023-07-20T11:22:52.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.078+0000 7f2b155f3640 1 -- 172.21.15.82:0/1903867996 wait complete. 2023-07-20T11:22:52.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 Processor -- start 2023-07-20T11:22:52.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- start start 2023-07-20T11:22:52.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 0x7f2b10154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 0x7f2b100b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100c88b0 con 0x7f2b100cd4b0 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100cc130 con 0x7f2b100d0d10 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100cc410 con 0x7f2b1015cab0 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60940/0 (socket says 172.21.15.82:60940) 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 -- 172.21.15.82:0/430167609 learned_addr learned my addr 172.21.15.82:0/430167609 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b067fc640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 0x7f2b10154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0f7fe640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 0x7f2b100b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 -- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 msgr2=0x7f2b100b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 0x7f2b100b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 -- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 msgr2=0x7f2b10154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 0x7f2b10154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 -- 172.21.15.82:0/430167609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009420 con 0x7f2b100cd4b0 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b067fc640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 0x7f2b10154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0f7fe640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 0x7f2b100b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:52.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b0effd640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000cba0 tx=0x7f2b0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:52.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000ad40 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b00012400 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100cc6f0 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000aea0 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.082+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b101550b0 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b100c8b20 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2b00007070 con 0x7f2b100cd4b0 2023-07-20T11:22:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b07fff640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 0x7f2af0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f2b00083d80 con 0x7f2b100cd4b0 2023-07-20T11:22:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b067fc640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 0x7f2af0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:52.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.086+0000 7f2b067fc640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 0x7f2af0068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2af80af000 tx=0x7f2af8008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.090+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b000511e0 con 0x7f2b100cd4b0 2023-07-20T11:22:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.270+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b100c8330 con 0x7f2b100cd4b0 2023-07-20T11:22:52.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.270+0000 7f2b07fff640 1 -- 172.21.15.82:0/430167609 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v90) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2b100c8330 con 0x7f2b100cd4b0 2023-07-20T11:22:52.263 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T11:22:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 msgr2=0x7f2af0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 0x7f2af0068860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2af80af000 tx=0x7f2af8008040 comp rx=0 tx=0).stop 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 msgr2=0x7f2b100c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000cba0 tx=0x7f2b0000a430 comp rx=0 tx=0).stop 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 shutdown_connections 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1015cab0 0x7f2b100b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b100d0d10 0x7f2b10154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f2af00663a0 0x7f2af0068860 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 --2- 172.21.15.82:0/430167609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b100cd4b0 0x7f2b100c8cb0 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 >> 172.21.15.82:0/430167609 conn(0x7f2b1008c120 msgr2=0x7f2b100d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 shutdown_connections 2023-07-20T11:22:52.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:52.274+0000 7f2b155f3640 1 -- 172.21.15.82:0/430167609 wait complete. 2023-07-20T11:22:52.283 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T11:22:52.283 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T11:22:52.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T11:22:52.284 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T11:22:52.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T11:22:52.285 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T11:22:52.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T11:22:52.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T11:22:52.285 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:22:52.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.286 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T11:22:52.296 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:22:52.297 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:22:52.298 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 36829sec preferred_lft 36829sec 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T11:22:52.299 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T11:22:52.300 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.301 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:22:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T11:22:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T11:22:52.302 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:22:52.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.303 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T11:22:52.362 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T11:22:52.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.365 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T11:22:52.422 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T11:22:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T11:22:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T11:22:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T11:22:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T11:22:52.423 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T11:22:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:22:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:22:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:22:52.424 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T11:22:52.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.425 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T11:22:52.425 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T11:22:52.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T11:22:52.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T11:22:52.426 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T11:22:52.427 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T11:22:52.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.518 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:22:52.528 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T11:22:52.528 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T11:22:52.528 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:22:52.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T11:22:52.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:22:52.592 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T11:22:52.643 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:22:52.643 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:22:52.644 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:22:52.694 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T11:22:52.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.695 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:22:52.789 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:22:52.790 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:22:52.790 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:22:52.804 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:22:52.805 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:22:52.805 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:22:52.805 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:22:52.805 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:22:52.813 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:22:52.813 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:22:52.813 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:22:52.814 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:22:52.814 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:22:52.814 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T11:22:52.814 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T11:22:52.814 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T11:22:52.817 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T11:22:52.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.818 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:22:52.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:52.839 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T11:22:52.896 INFO:teuthology.orchestra.run.smithi082.stdout:client10030 2023-07-20T11:22:52.897 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:22:52.897 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:22:52.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T11:22:53.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 Processor -- start 2023-07-20T11:22:53.130 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 -- start start 2023-07-20T11:22:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 0x7f99c40ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40cde70 con 0x7f99c415d2d0 2023-07-20T11:22:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c40cbef0 con 0x7f99c415c910 2023-07-20T11:22:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.138+0000 7f99cbf74640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40ca420 con 0x7f99c40ca040 2023-07-20T11:22:53.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c950f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c950f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:60154/0 (socket says 172.21.15.82:60154) 2023-07-20T11:22:53.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 0x7f99c40ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c950f640 1 -- 172.21.15.82:0/1325405173 learned_addr learned my addr 172.21.15.82:0/1325405173 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c8d0e640 1 -- 172.21.15.82:0/1325405173 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893448977 0 0) 0x7f99c40cde70 con 0x7f99c415d2d0 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c8d0e640 1 -- 172.21.15.82:0/1325405173 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b0003530 con 0x7f99c415d2d0 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 -- 172.21.15.82:0/1325405173 >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 msgr2=0x7f99c415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 --2- 172.21.15.82:0/1325405173 >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 -- 172.21.15.82:0/1325405173 >> v1:172.21.15.183:6789/0 conn(0x7f99c415d2d0 legacy=0x7f99c40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 -- 172.21.15.82:0/1325405173 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c415d760 con 0x7f99c40ca040 2023-07-20T11:22:53.134 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c950f640 1 --2- 172.21.15.82:0/1325405173 >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:53.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.142+0000 7f99c9d10640 1 --2- 172.21.15.82:0/1325405173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 0x7f99c40ad060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99c000aea0 tx=0x7f99c001da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359825bd594b9b8d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c8d0e640 1 -- 172.21.15.82:0/1325405173 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000a2d0 con 0x7f99c40ca040 2023-07-20T11:22:53.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c8d0e640 1 -- 172.21.15.82:0/1325405173 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c00a67c0 con 0x7f99c40ca040 2023-07-20T11:22:53.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c8d0e640 1 -- 172.21.15.82:0/1325405173 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c00a6b50 con 0x7f99c40ca040 2023-07-20T11:22:53.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- 172.21.15.82:0/1325405173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 msgr2=0x7f99c40ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- 172.21.15.82:0/1325405173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 0x7f99c40ad060 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f99c000aea0 tx=0x7f99c001da50 comp rx=0 tx=0).stop 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- 172.21.15.82:0/1325405173 shutdown_connections 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- 172.21.15.82:0/1325405173 >> v2:172.21.15.183:3300/0 conn(0x7f99c415c910 0x7f99c415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- 172.21.15.82:0/1325405173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c40ca040 0x7f99c40ad060 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- 172.21.15.82:0/1325405173 >> 172.21.15.82:0/1325405173 conn(0x7f99c40cada0 msgr2=0x7f99c40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- 172.21.15.82:0/1325405173 shutdown_connections 2023-07-20T11:22:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- 172.21.15.82:0/1325405173 wait complete. 2023-07-20T11:22:53.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 Processor -- start 2023-07-20T11:22:53.138 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- start start 2023-07-20T11:22:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c40ca040 0x7f99c414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c415d2d0 0x7f99c406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40acb90 con 0x7f99c415c910 2023-07-20T11:22:53.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c414be40 con 0x7f99c40ca040 2023-07-20T11:22:53.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99cbf74640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c40ab8a0 con 0x7f99c415d2d0 2023-07-20T11:22:53.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c950f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c950f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60954/0 (socket says 172.21.15.82:60954) 2023-07-20T11:22:53.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.146+0000 7f99c950f640 1 -- 172.21.15.82:0/2159514173 learned_addr learned my addr 172.21.15.82:0/2159514173 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:53.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c9d10640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c40ca040 0x7f99c414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ca511640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c415d2d0 0x7f99c406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 -- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c415d2d0 msgr2=0x7f99c406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c415d2d0 0x7f99c406ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 -- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c40ca040 msgr2=0x7f99c414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c40ca040 0x7f99c414b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 -- 172.21.15.82:0/2159514173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40094d0 con 0x7f99c415c910 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99c950f640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f99b400ea00 tx=0x7f99b400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400ca00 con 0x7f99c415c910 2023-07-20T11:22:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400cb60 con 0x7f99c415c910 2023-07-20T11:22:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400ced0 con 0x7f99c415c910 2023-07-20T11:22:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c000ab80 con 0x7f99c415c910 2023-07-20T11:22:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c40ac700 con 0x7f99c415c910 2023-07-20T11:22:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c40ac890 con 0x7f99c415c910 2023-07-20T11:22:53.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99b4013470 con 0x7f99c415c910 2023-07-20T11:22:53.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.150+0000 7f99ba7fc640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 0x7f99a8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.154+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f99b40840f0 con 0x7f99c415c910 2023-07-20T11:22:53.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.154+0000 7f99c9d10640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 0x7f99a8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.154+0000 7f99c9d10640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 0x7f99a8068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99c00af000 tx=0x7f99c00a8070 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.158+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99b4051420 con 0x7f99c415c910 2023-07-20T11:22:53.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.322+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f99c40abbb0 con 0x7f99a80663a0 2023-07-20T11:22:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.322+0000 7f99ba7fc640 1 -- 172.21.15.82:0/2159514173 <== mgr.10572 v2:172.21.15.82:6832/3370264152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f99c000a0d0 con 0x7f99a80663a0 2023-07-20T11:22:53.316 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:22:53.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:22:53.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T11:22:53.316 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:22:53.316 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:22:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 msgr2=0x7f99a8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 0x7f99a8068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f99c00af000 tx=0x7f99c00a8070 comp rx=0 tx=0).stop 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 msgr2=0x7f99c4070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f99b400ea00 tx=0x7f99b400eec0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 shutdown_connections 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99c415d2d0 0x7f99c406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f99a80663a0 0x7f99a8068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99c415c910 0x7f99c4070cd0 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 --2- 172.21.15.82:0/2159514173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99c40ca040 0x7f99c414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 >> 172.21.15.82:0/2159514173 conn(0x7f99c40cada0 msgr2=0x7f99c406b840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 shutdown_connections 2023-07-20T11:22:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.326+0000 7f99cbf74640 1 -- 172.21.15.82:0/2159514173 wait complete. 2023-07-20T11:22:53.336 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T11:22:53.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.486+0000 7f4693cd8640 1 Processor -- start 2023-07-20T11:22:53.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.486+0000 7f4693cd8640 1 -- start start 2023-07-20T11:22:53.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4693cd8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c15c8e0 0x7f468c06aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4693cd8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f468c0d0ca0 0x7f468c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4693cd8640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0cd5e0 con 0x7f468c0d0320 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4693cd8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c0d1690 con 0x7f468c0d0ca0 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4693cd8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c0cf610 con 0x7f468c15c8e0 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f468c0d0ca0 0x7f468c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f468c0d0ca0 0x7f468c0d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37866/0 (socket says 172.21.15.82:37866) 2023-07-20T11:22:53.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 -- 172.21.15.82:0/597450840 learned_addr learned my addr 172.21.15.82:0/597450840 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:53.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4691a74640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c15c8e0 0x7f468c06aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 -- 172.21.15.82:0/597450840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c15c8e0 msgr2=0x7f468c06aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:53.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c15c8e0 0x7f468c06aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 -- 172.21.15.82:0/597450840 >> v1:172.21.15.183:6789/0 conn(0x7f468c0d0320 legacy=0x7f468c0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.490+0000 7f4692275640 1 -- 172.21.15.82:0/597450840 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c06b020 con 0x7f468c0d0ca0 2023-07-20T11:22:53.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4692275640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0d1150 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f4684009e50 tx=0x7f468401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc621724a7dfa2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4690a72640 1 -- 172.21.15.82:0/597450840 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840a58a0 con 0x7f468c0d0ca0 2023-07-20T11:22:53.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4690a72640 1 -- 172.21.15.82:0/597450840 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46840a5a00 con 0x7f468c0d0ca0 2023-07-20T11:22:53.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4690a72640 1 -- 172.21.15.82:0/597450840 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46840a5d90 con 0x7f468c0d0ca0 2023-07-20T11:22:53.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- 172.21.15.82:0/597450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 msgr2=0x7f468c0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0d1150 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f4684009e50 tx=0x7f468401c9e0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- 172.21.15.82:0/597450840 shutdown_connections 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0d1150 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 --2- 172.21.15.82:0/597450840 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c15c8e0 0x7f468c06aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- 172.21.15.82:0/597450840 >> 172.21.15.82:0/597450840 conn(0x7f468c065d40 msgr2=0x7f468c09b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:53.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- 172.21.15.82:0/597450840 shutdown_connections 2023-07-20T11:22:53.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- 172.21.15.82:0/597450840 wait complete. 2023-07-20T11:22:53.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 Processor -- start 2023-07-20T11:22:53.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.494+0000 7f4693cd8640 1 -- start start 2023-07-20T11:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c0d0320 0x7f468c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 0x7f468c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15d1a0 con 0x7f468c0d0ca0 2023-07-20T11:22:53.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15d480 con 0x7f468c15c8e0 2023-07-20T11:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15d760 con 0x7f468c0d0320 2023-07-20T11:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37872/0 (socket says 172.21.15.82:37872) 2023-07-20T11:22:53.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 -- 172.21.15.82:0/4027431072 learned_addr learned my addr 172.21.15.82:0/4027431072 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:53.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691a74640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c0d0320 0x7f468c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4692275640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 0x7f468c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.490 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 -- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c0d0320 msgr2=0x7f468c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c0d0320 0x7f468c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 -- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 msgr2=0x7f468c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 0x7f468c0b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 -- 172.21.15.82:0/4027431072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009b30 con 0x7f468c0d0ca0 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4692275640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 0x7f468c0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4691273640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c4d0 tx=0x7f467c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0052d0 con 0x7f468c0d0ca0 2023-07-20T11:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c005430 con 0x7f468c0d0ca0 2023-07-20T11:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c15da40 con 0x7f468c0d0ca0 2023-07-20T11:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c012830 con 0x7f468c0d0ca0 2023-07-20T11:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c152c60 con 0x7f468c0d0ca0 2023-07-20T11:22:53.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c04da30 con 0x7f468c0d0ca0 2023-07-20T11:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.498+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 111) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f467c012990 con 0x7f468c0d0ca0 2023-07-20T11:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.502+0000 7f46827fc640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 0x7f4670068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.502+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f467c083a10 con 0x7f468c0d0ca0 2023-07-20T11:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.502+0000 7f4691a74640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 0x7f4670068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:53.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.502+0000 7f4691a74640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 0x7f4670068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f468800b930 tx=0x7f4688008040 comp rx=0 tx=0).ready entity=mgr.10572 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:53.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.506+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f467c050d30 con 0x7f468c0d0ca0 2023-07-20T11:22:53.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:53.690+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f468c15def0 con 0x7f468c0d0ca0 2023-07-20T11:22:54.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.498+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 112) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f467c081d80 con 0x7f468c0d0ca0 2023-07-20T11:22:54.493 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f46827fc640 1 -- 172.21.15.82:0/4027431072 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v112) v1 ==== 92+0+0 (secure 0 0 0) 0x7f467c06fbe0 con 0x7f468c0d0ca0 2023-07-20T11:22:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 msgr2=0x7f4670068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 0x7f4670068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f468800b930 tx=0x7f4688008040 comp rx=0 tx=0).stop 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 msgr2=0x7f468c0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f467c00c4d0 tx=0x7f467c00c990 comp rx=0 tx=0).stop 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 shutdown_connections 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f468c15c8e0 0x7f468c0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f46700663a0 0x7f4670068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f468c0d0ca0 0x7f468c0cb830 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.496 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 --2- 172.21.15.82:0/4027431072 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f468c0d0320 0x7f468c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 >> 172.21.15.82:0/4027431072 conn(0x7f468c065d40 msgr2=0x7f468c0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 shutdown_connections 2023-07-20T11:22:54.497 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.502+0000 7f4693cd8640 1 -- 172.21.15.82:0/4027431072 wait complete. 2023-07-20T11:22:54.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T11:22:54.663 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:54.672+0000 7f938b462180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:22:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 Processor -- start 2023-07-20T11:22:54.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 -- start start 2023-07-20T11:22:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efec80ca5a0 0x7efec815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec8071950 con 0x7efec806f710 2023-07-20T11:22:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec815b230 con 0x7efec815ec90 2023-07-20T11:22:54.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efeccdfa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec815bad0 con 0x7efec80ca5a0 2023-07-20T11:22:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efec659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7efec806f710 0x7efec806faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40432/0 (socket says 172.21.15.82:40432) 2023-07-20T11:22:54.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efec659c640 1 -- 172.21.15.82:0/1024982982 learned_addr learned my addr 172.21.15.82:0/1024982982 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efebffff640 1 --2- 172.21.15.82:0/1024982982 >> v2:172.21.15.82:3300/0 conn(0x7efec80ca5a0 0x7efec815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833907299 0 0) 0x7efec8071950 con 0x7efec806f710 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb4003530 con 0x7efec806f710 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249197586 0 0) 0x7efec815b230 con 0x7efec815ec90 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efebffff640 1 -- 172.21.15.82:0/1024982982 >> v1:172.21.15.183:6789/0 conn(0x7efec815ec90 legacy=0x7efec815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efebffff640 1 -- 172.21.15.82:0/1024982982 >> v1:172.21.15.82:6789/0 conn(0x7efec806f710 legacy=0x7efec806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.674+0000 7efebffff640 1 -- 172.21.15.82:0/1024982982 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec815b510 con 0x7efec80ca5a0 2023-07-20T11:22:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efebffff640 1 --2- 172.21.15.82:0/1024982982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec80ca5a0 0x7efec815e750 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097f0 tx=0x7efeb001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0325894121b6c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00ab670 con 0x7efec80ca5a0 2023-07-20T11:22:54.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb00ab7d0 con 0x7efec80ca5a0 2023-07-20T11:22:54.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efec5d9b640 1 -- 172.21.15.82:0/1024982982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00abb40 con 0x7efec80ca5a0 2023-07-20T11:22:54.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 -- 172.21.15.82:0/1024982982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec80ca5a0 msgr2=0x7efec815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1024982982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec80ca5a0 0x7efec815e750 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097f0 tx=0x7efeb001c450 comp rx=0 tx=0).stop 2023-07-20T11:22:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 -- 172.21.15.82:0/1024982982 shutdown_connections 2023-07-20T11:22:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1024982982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec80ca5a0 0x7efec815e750 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 -- 172.21.15.82:0/1024982982 >> 172.21.15.82:0/1024982982 conn(0x7efec80cad50 msgr2=0x7efec80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 -- 172.21.15.82:0/1024982982 shutdown_connections 2023-07-20T11:22:54.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.678+0000 7efeccdfa640 1 -- 172.21.15.82:0/1024982982 wait complete. 2023-07-20T11:22:54.673 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:54.682+0000 7f2fdda4b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:22:54.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.682+0000 7efeccdfa640 1 Processor -- start 2023-07-20T11:22:54.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.682+0000 7efeccdfa640 1 -- start start 2023-07-20T11:22:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec80ca5a0 0x7efec815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efec815ec90 0x7efec80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec80c8240 con 0x7efec806f710 2023-07-20T11:22:54.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec80c73d0 con 0x7efec80ca5a0 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec814f690 con 0x7efec815ec90 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37902/0 (socket says 172.21.15.82:37902) 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 -- 172.21.15.82:0/1675169184 learned_addr learned my addr 172.21.15.82:0/1675169184 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efebffff640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec80ca5a0 0x7efec815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:54.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec6d9d640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efec815ec90 0x7efec80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:54.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 -- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efec815ec90 msgr2=0x7efec80c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efec815ec90 0x7efec80c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 -- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec80ca5a0 msgr2=0x7efec815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec80ca5a0 0x7efec815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 -- 172.21.15.82:0/1675169184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb0009420 con 0x7efec806f710 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efec659c640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c450 tx=0x7efeb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8005cf0 con 0x7efec806f710 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8005e50 con 0x7efec806f710 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec80c8660 con 0x7efec806f710 2023-07-20T11:22:54.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8007290 con 0x7efec806f710 2023-07-20T11:22:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec80c78a0 con 0x7efec806f710 2023-07-20T11:22:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec80c8380 con 0x7efec806f710 2023-07-20T11:22:54.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.686+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 112) v1 ==== 85777+0+0 (secure 0 0 0) 0x7efeb80073f0 con 0x7efec806f710 2023-07-20T11:22:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.690+0000 7efebeffd640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 0x7efea80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.690+0000 7efebffff640 1 -- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 msgr2=0x7efea80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.690+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7efeb8083420 con 0x7efec806f710 2023-07-20T11:22:54.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.690+0000 7efebffff640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 0x7efea80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.694+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efec80c8380 con 0x7efec806f710 2023-07-20T11:22:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.842+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7efec80c8380 con 0x7efec806f710 2023-07-20T11:22:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efebeffd640 1 -- 172.21.15.82:0/1675169184 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7efec80c8380 con 0x7efec806f710 2023-07-20T11:22:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 msgr2=0x7efea80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 0x7efea80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 msgr2=0x7efec814f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c450 tx=0x7efeb800c910 comp rx=0 tx=0).stop 2023-07-20T11:22:54.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 shutdown_connections 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efec815ec90 0x7efec80c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efec80ca5a0 0x7efec815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7efea8066420 0x7efea80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 --2- 172.21.15.82:0/1675169184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efec806f710 0x7efec814f150 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 >> 172.21.15.82:0/1675169184 conn(0x7efec80cad50 msgr2=0x7efec80cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 shutdown_connections 2023-07-20T11:22:54.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:54.850+0000 7efeccdfa640 1 -- 172.21.15.82:0/1675169184 wait complete. 2023-07-20T11:22:54.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T11:22:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 Processor -- start 2023-07-20T11:22:55.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 -- start start 2023-07-20T11:22:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 0x7f5f2c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 0x7f5f2c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.007 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2c15ff50 con 0x7f5f2c15fb70 2023-07-20T11:22:55.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2c0d0f90 con 0x7f5f2c0d07a0 2023-07-20T11:22:55.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.014+0000 7f5f31269640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0cd190 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f30a68640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 0x7f5f2c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 0x7f5f2c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2bfff640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f5f2c15fb70 0x7f5f2c0b3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:44136/0 (socket says 172.21.15.82:44136) 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2bfff640 1 -- 172.21.15.82:0/3211572278 learned_addr learned my addr 172.21.15.82:0/3211572278 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 -- 172.21.15.82:0/3211572278 >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 msgr2=0x7f5f2c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 --2- 172.21.15.82:0/3211572278 >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 0x7f5f2c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 -- 172.21.15.82:0/3211572278 >> v1:172.21.15.183:6789/0 conn(0x7f5f2c15fb70 legacy=0x7f5f2c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 -- 172.21.15.82:0/3211572278 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c0cd470 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2b7fe640 1 -- 172.21.15.82:0/3211572278 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445277066 0 0) 0x7f5f2c15ff50 con 0x7f5f2c15fb70 2023-07-20T11:22:55.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f30a68640 1 --2- 172.21.15.82:0/3211572278 >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 0x7f5f2c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:22:55.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f23fff640 1 --2- 172.21.15.82:0/3211572278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 0x7f5f2c0d0260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5f140097c0 tx=0x7f5f1401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ee1a4f464d0d2f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:55.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2b7fe640 1 -- 172.21.15.82:0/3211572278 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140ab600 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2b7fe640 1 -- 172.21.15.82:0/3211572278 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f140a7050 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.018+0000 7f5f2b7fe640 1 -- 172.21.15.82:0/3211572278 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f140ab980 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- 172.21.15.82:0/3211572278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 msgr2=0x7f5f2c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 --2- 172.21.15.82:0/3211572278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 0x7f5f2c0d0260 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5f140097c0 tx=0x7f5f1401c330 comp rx=0 tx=0).stop 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- 172.21.15.82:0/3211572278 shutdown_connections 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 --2- 172.21.15.82:0/3211572278 >> v2:172.21.15.183:3300/0 conn(0x7f5f2c0d07a0 0x7f5f2c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 --2- 172.21.15.82:0/3211572278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c0b46a0 0x7f5f2c0d0260 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- 172.21.15.82:0/3211572278 >> 172.21.15.82:0/3211572278 conn(0x7f5f2c065710 msgr2=0x7f5f2c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- 172.21.15.82:0/3211572278 shutdown_connections 2023-07-20T11:22:55.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- 172.21.15.82:0/3211572278 wait complete. 2023-07-20T11:22:55.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 Processor -- start 2023-07-20T11:22:55.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.022+0000 7f5f31269640 1 -- start start 2023-07-20T11:22:55.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f2c0d07a0 0x7f5f2c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c15fb70 0x7f5f2c0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c1f8bd0 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c0c6df0 con 0x7f5f2c0d07a0 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c156bf0 con 0x7f5f2c15fb70 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37912/0 (socket says 172.21.15.82:37912) 2023-07-20T11:22:55.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 -- 172.21.15.82:0/1200804738 learned_addr learned my addr 172.21.15.82:0/1200804738 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f23fff640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f2c0d07a0 0x7f5f2c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f30a68640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c15fb70 0x7f5f2c0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 -- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c15fb70 msgr2=0x7f5f2c0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c15fb70 0x7f5f2c0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 -- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f2c0d07a0 msgr2=0x7f5f2c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f2c0d07a0 0x7f5f2c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 -- 172.21.15.82:0/1200804738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009a70 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f2bfff640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0011f0 tx=0x7f5f1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0074e0 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c007640 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f14009420 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0049f0 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c0c64c0 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.026+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c04da30 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.030+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 112) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f5f1c004b50 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.030+0000 7f5f297fa640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 0x7f5f0c0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.030+0000 7f5f23fff640 1 -- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 msgr2=0x7f5f0c0688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.030+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f5f1c083d10 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.022 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.030+0000 7f5f23fff640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 0x7f5f0c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:55.025 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.034+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f1c089020 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.082 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.092+0000 7f938b462180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:22:55.106 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.114+0000 7f2fdda4b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:22:55.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.186+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5f2c15c530 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.190+0000 7f5f297fa640 1 -- 172.21.15.82:0/1200804738 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5f1c051020 con 0x7f5f2c0b46a0 2023-07-20T11:22:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 msgr2=0x7f5f0c0688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 0x7f5f0c0688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 msgr2=0x7f5f2c1f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0011f0 tx=0x7f5f1c00c8f0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 shutdown_connections 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5f2c15fb70 0x7f5f2c0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5f2c0d07a0 0x7f5f2c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f5f0c0663f0 0x7f5f0c0688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 --2- 172.21.15.82:0/1200804738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f2c0b46a0 0x7f5f2c1f8690 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 >> 172.21.15.82:0/1200804738 conn(0x7f5f2c065710 msgr2=0x7f5f2c0b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:55.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 shutdown_connections 2023-07-20T11:22:55.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.194+0000 7f5f31269640 1 -- 172.21.15.82:0/1200804738 wait complete. 2023-07-20T11:22:55.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:22:55.205 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T11:22:55.222 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-20T11:22:55.235 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.244+0000 7f938b462180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:22:55.264 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.274+0000 7f2fdda4b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:22:55.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 Processor -- start 2023-07-20T11:22:55.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 -- start start 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 0x7f886406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f886415a6f0 0x7f886415ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8864070030 con 0x7f88640ca5a0 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886415bad0 con 0x7f886415a6f0 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8869367640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8864071950 con 0x7f886406f710 2023-07-20T11:22:55.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f886415a6f0 0x7f886415ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f886415a6f0 0x7f886415ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37916/0 (socket says 172.21.15.82:37916) 2023-07-20T11:22:55.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 -- 172.21.15.82:0/893183717 learned_addr learned my addr 172.21.15.82:0/893183717 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:55.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8862ffd640 1 --2- 172.21.15.82:0/893183717 >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 0x7f886406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 -- 172.21.15.82:0/893183717 >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 msgr2=0x7f886406faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:55.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 --2- 172.21.15.82:0/893183717 >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 0x7f886406faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 -- 172.21.15.82:0/893183717 >> v1:172.21.15.183:6789/0 conn(0x7f88640ca5a0 legacy=0x7f886415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f88637fe640 1 -- 172.21.15.82:0/893183717 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886415b230 con 0x7f886415a6f0 2023-07-20T11:22:55.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.418+0000 7f8862ffd640 1 --2- 172.21.15.82:0/893183717 >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 0x7f886406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:55.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f88637fe640 1 --2- 172.21.15.82:0/893183717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f886415ab40 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f88640ce230 tx=0x7f885c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d5ffd473c81316 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:55.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f88627fc640 1 -- 172.21.15.82:0/893183717 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a5780 con 0x7f886415a6f0 2023-07-20T11:22:55.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f88627fc640 1 -- 172.21.15.82:0/893183717 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0a58e0 con 0x7f886415a6f0 2023-07-20T11:22:55.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f88627fc640 1 -- 172.21.15.82:0/893183717 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a5c70 con 0x7f886415a6f0 2023-07-20T11:22:55.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 -- 172.21.15.82:0/893183717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 msgr2=0x7f886415ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 --2- 172.21.15.82:0/893183717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f886415ab40 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f88640ce230 tx=0x7f885c01c9d0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 -- 172.21.15.82:0/893183717 shutdown_connections 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 --2- 172.21.15.82:0/893183717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f886415ab40 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 --2- 172.21.15.82:0/893183717 >> v2:172.21.15.183:3300/0 conn(0x7f886406f710 0x7f886406faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 -- 172.21.15.82:0/893183717 >> 172.21.15.82:0/893183717 conn(0x7f88640cad50 msgr2=0x7f88640cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:55.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 -- 172.21.15.82:0/893183717 shutdown_connections 2023-07-20T11:22:55.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.422+0000 7f8869367640 1 -- 172.21.15.82:0/893183717 wait complete. 2023-07-20T11:22:55.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 Processor -- start 2023-07-20T11:22:55.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- start start 2023-07-20T11:22:55.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886406f710 0x7f88640c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640ca5a0 0x7f88640b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f88640c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864153320 con 0x7f886415a6f0 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c5b10 con 0x7f886406f710 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640c5df0 con 0x7f88640ca5a0 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f88640c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886406f710 0x7f88640c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f88640c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37918/0 (socket says 172.21.15.82:37918) 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 -- 172.21.15.82:0/2139594688 learned_addr learned my addr 172.21.15.82:0/2139594688 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f885bfff640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640ca5a0 0x7f88640b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640ca5a0 msgr2=0x7f88640b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88640ca5a0 0x7f88640b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886406f710 msgr2=0x7f88640c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:55.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886406f710 0x7f88640c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009b30 con 0x7f886415a6f0 2023-07-20T11:22:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f88637fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f88640c6bb0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f885c0195e0 tx=0x7f885c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:55.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0b8670 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0b87d0 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0b8b60 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88640c60d0 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.426+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88640c6690 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886404da30 con 0x7f886415a6f0 2023-07-20T11:22:55.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 112) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f885c0b8cc0 con 0x7f886415a6f0 2023-07-20T11:22:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f885b7fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f8862ffd640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 msgr2=0x7f88440688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f885c11f3f0 con 0x7f886415a6f0 2023-07-20T11:22:55.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.430+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:22:55.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.434+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f885c0ec8d0 con 0x7f886415a6f0 2023-07-20T11:22:55.597 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.606+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f886415e230 con 0x7f88440663f0 2023-07-20T11:22:55.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.634+0000 7f8862ffd640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 msgr2=0x7f88440688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:55.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:55.634+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T11:22:55.719 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.728+0000 7f938b462180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:55.757 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.766+0000 7f2fdda4b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:55.777 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.788+0000 7f938b462180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:22:55.815 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.822+0000 7f2fdda4b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:22:55.833 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.844+0000 7f938b462180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:22:55.870 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.878+0000 7f2fdda4b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:22:55.918 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.928+0000 7f938b462180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:22:55.956 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:55.966+0000 7f2fdda4b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:22:55.976 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:55.984+0000 7f938b462180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:22:56.013 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.022+0000 7f2fdda4b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:22:56.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:56.038+0000 7f8862ffd640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 msgr2=0x7f88440688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:56.028 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:56.038+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T11:22:56.060 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.068+0000 7f938b462180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:22:56.097 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.106+0000 7f2fdda4b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:22:56.116 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.124+0000 7f938b462180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:22:56.153 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.162+0000 7f2fdda4b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:22:56.258 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.268+0000 7f938b462180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:22:56.294 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.302+0000 7f2fdda4b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:22:56.317 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.324+0000 7f938b462180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:22:56.353 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.362+0000 7f2fdda4b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:22:56.560 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:22:56.560 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:22:56.560 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:22:56.568 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.576+0000 7f938b462180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:22:56.593 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:22:56.594 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:22:56.594 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:22:56.602 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.610+0000 7f2fdda4b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:22:56.702 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.712+0000 7f938b462180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:56.736 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.746+0000 7f2fdda4b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:56.827 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.836+0000 7f938b462180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:56.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:56.842+0000 7f8862ffd640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 msgr2=0x7f88440688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3370264152 2023-07-20T11:22:56.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:56.842+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T11:22:56.861 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.870+0000 7f2fdda4b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:22:56.897 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:56.904+0000 7f938b462180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:22:56.930 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:56.938+0000 7f2fdda4b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:22:57.031 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:57.040+0000 7f938b462180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:57.065 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:57.074+0000 7f2fdda4b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:22:57.576 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:57.584+0000 7f938b462180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:22:57.608 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:57.618+0000 7f2fdda4b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:22:57.660 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:57.668+0000 7f938b462180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:22:57.693 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:57.702+0000 7f2fdda4b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:22:57.807 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:57.816+0000 7f938b462180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:22:57.839 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:57.846+0000 7f2fdda4b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:22:57.890 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:57.900+0000 7f938b462180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:22:57.922 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:57.930+0000 7f2fdda4b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:22:58.159 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:58.168+0000 7f938b462180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:22:58.192 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.202+0000 7f2fdda4b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:22:58.219 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:22:58.228+0000 7f938b462180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:22:58.253 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.262+0000 7f2fdda4b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:22:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:58.270+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 113) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f885c0ecca0 con 0x7f886415a6f0 2023-07-20T11:22:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:58.270+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 msgr2=0x7f88440688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:22:58.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:58.270+0000 7f885b7fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/3370264152,v1:172.21.15.82:6833/3370264152] conn(0x7f88440663f0 0x7f88440688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:58.380 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f63039640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.381 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f63039640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.381 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f63039640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.381 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f63039640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.381 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f63039640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f60033640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f60033640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f60033640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f60033640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:58.382 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:22:58.390+0000 7f2f60033640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:22:59.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.278+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 114) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f885c0c3cc0 con 0x7f886415a6f0 2023-07-20T11:22:59.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.278+0000 7f885b7fe640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8844033e70 0x7f88440709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.278+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 --> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8844034250 con 0x7f8844033e70 2023-07-20T11:22:59.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.282+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8844033e70 0x7f88440709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.286+0000 7f8862ffd640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8844033e70 0x7f88440709c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88640c4830 tx=0x7f8854008040 comp rx=0 tx=0).ready entity=mgr.10051 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f885b7fe640 1 -- 172.21.15.82:0/2139594688 <== mgr.10051 v2:172.21.15.82:6832/2988654347 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8844034250 con 0x7f8844033e70 2023-07-20T11:22:59.333 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8844033e70 msgr2=0x7f88440709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8844033e70 0x7f88440709c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88640c4830 tx=0x7f8854008040 comp rx=0 tx=0).stop 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 msgr2=0x7f88640c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 --2- 172.21.15.82:0/2139594688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f886415a6f0 0x7f88640c6bb0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f885c0195e0 tx=0x7f885c019770 comp rx=0 tx=0).stop 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f88637fe640 1 -- 172.21.15.82:0/2139594688 reap_dead start 2023-07-20T11:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 shutdown_connections 2023-07-20T11:22:59.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 >> 172.21.15.82:0/2139594688 conn(0x7f88640cad50 msgr2=0x7f8864164ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:59.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 shutdown_connections 2023-07-20T11:22:59.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.342+0000 7f8869367640 1 -- 172.21.15.82:0/2139594688 wait complete. 2023-07-20T11:22:59.354 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T11:22:59.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-20T11:22:59.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.506+0000 7f2cb69c5640 1 Processor -- start 2023-07-20T11:22:59.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.506+0000 7f2cb69c5640 1 -- start start 2023-07-20T11:22:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb69c5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2cb006f710 0x7f2cb006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb69c5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2cb00ca5a0 0x7f2cb015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb69c5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb0070030 con 0x7f2cb015ec90 2023-07-20T11:22:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb69c5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb015bad0 con 0x7f2cb006f710 2023-07-20T11:22:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb69c5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb0071950 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb4f62640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2cb015ec90 0x7f2cb015a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40444/0 (socket says 172.21.15.82:40444) 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2cb4f62640 1 -- 172.21.15.82:0/2568910206 learned_addr learned my addr 172.21.15.82:0/2568910206 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caffff640 1 --2- 172.21.15.82:0/2568910206 >> v2:172.21.15.82:3300/0 conn(0x7f2cb006f710 0x7f2cb006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caf7fe640 1 --2- 172.21.15.82:0/2568910206 >> v2:172.21.15.183:3300/0 conn(0x7f2cb00ca5a0 0x7f2cb015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caffff640 1 -- 172.21.15.82:0/2568910206 >> v2:172.21.15.183:3300/0 conn(0x7f2cb00ca5a0 msgr2=0x7f2cb015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caffff640 1 --2- 172.21.15.82:0/2568910206 >> v2:172.21.15.183:3300/0 conn(0x7f2cb00ca5a0 0x7f2cb015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caffff640 1 -- 172.21.15.82:0/2568910206 >> v1:172.21.15.82:6789/0 conn(0x7f2cb015ec90 legacy=0x7f2cb015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caffff640 1 -- 172.21.15.82:0/2568910206 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb015b230 con 0x7f2cb006f710 2023-07-20T11:22:59.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.510+0000 7f2caeffd640 1 -- 172.21.15.82:0/2568910206 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705318561 0 0) 0x7f2cb0070030 con 0x7f2cb015ec90 2023-07-20T11:22:59.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2caffff640 1 --2- 172.21.15.82:0/2568910206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb006f710 0x7f2cb006faf0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00702d0 tx=0x7f2ca001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1723fb7f9a194abe server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2caeffd640 1 -- 172.21.15.82:0/2568910206 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00ab600 con 0x7f2cb006f710 2023-07-20T11:22:59.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2caeffd640 1 -- 172.21.15.82:0/2568910206 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca00a7050 con 0x7f2cb006f710 2023-07-20T11:22:59.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2caeffd640 1 -- 172.21.15.82:0/2568910206 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00ab980 con 0x7f2cb006f710 2023-07-20T11:22:59.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2568910206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb006f710 msgr2=0x7f2cb006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2568910206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb006f710 0x7f2cb006faf0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00702d0 tx=0x7f2ca001c430 comp rx=0 tx=0).stop 2023-07-20T11:22:59.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2568910206 shutdown_connections 2023-07-20T11:22:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2568910206 >> v2:172.21.15.183:3300/0 conn(0x7f2cb00ca5a0 0x7f2cb015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2568910206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb006f710 0x7f2cb006faf0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2568910206 >> 172.21.15.82:0/2568910206 conn(0x7f2cb00cad50 msgr2=0x7f2cb00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2568910206 shutdown_connections 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2568910206 wait complete. 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 Processor -- start 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.514+0000 7f2cb69c5640 1 -- start start 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 0x7f2cb01557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 0x7f2cb00ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0157220 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0156180 con 0x7f2cb015ec90 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0156460 con 0x7f2cb006f710 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38076/0 (socket says 172.21.15.82:38076) 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 -- 172.21.15.82:0/2874806206 learned_addr learned my addr 172.21.15.82:0/2874806206 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb4f62640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 0x7f2cb00ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caffff640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 0x7f2cb01557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 -- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 msgr2=0x7f2cb01557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 0x7f2cb01557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 -- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 msgr2=0x7f2cb00ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 0x7f2cb00ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 -- 172.21.15.82:0/2874806206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009420 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb4f62640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 0x7f2cb00ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caffff640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 0x7f2cb01557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:22:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2caf7fe640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400e900 tx=0x7f2ca400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4009690 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca400ca00 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb0156740 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400cd90 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb0156d00 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb0156e90 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.518+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 114) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f2ca4013470 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.522+0000 7f2cacff9640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 0x7f2c9c0685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.522+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f2ca4083d80 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.522+0000 7f2caffff640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 0x7f2c9c0685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.522+0000 7f2caffff640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 0x7f2c9c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2cb015dfd0 tx=0x7f2ca00a6000 comp rx=0 tx=0).ready entity=mgr.10051 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.526+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ca40513a0 con 0x7f2cb00ca5a0 2023-07-20T11:22:59.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.690+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 --> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cb015e230 con 0x7f2c9c066120 2023-07-20T11:22:59.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cacff9640 1 -- 172.21.15.82:0/2874806206 <== mgr.10051 v2:172.21.15.82:6832/2988654347 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f2ca00ab760 con 0x7f2c9c066120 2023-07-20T11:22:59.733 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path snap_test_dir1 2023-07-20T11:22:59.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 msgr2=0x7f2c9c0685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 0x7f2c9c0685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2cb015dfd0 tx=0x7f2ca00a6000 comp rx=0 tx=0).stop 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 msgr2=0x7f2cb01582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400e900 tx=0x7f2ca400edc0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 shutdown_connections 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cb015ec90 0x7f2cb00ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2c9c066120 0x7f2c9c0685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cb00ca5a0 0x7f2cb01582f0 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 --2- 172.21.15.82:0/2874806206 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2cb006f710 0x7f2cb01557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 >> 172.21.15.82:0/2874806206 conn(0x7f2cb00cad50 msgr2=0x7f2cb00afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 shutdown_connections 2023-07-20T11:22:59.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.742+0000 7f2cb69c5640 1 -- 172.21.15.82:0/2874806206 wait complete. 2023-07-20T11:22:59.754 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-20T11:22:59.754 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-20-11_23_00 in ~1s... 2023-07-20T11:22:59.755 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-20T11:22:59.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-20T11:22:59.898 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 Processor -- start 2023-07-20T11:22:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 -- start start 2023-07-20T11:22:59.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1440ad580 0x7ff1440ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff144160390 con 0x7ff1440afd50 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1440cc1d0 con 0x7ff144160820 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.906+0000 7ff14ae6d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1440cc4b0 con 0x7ff1440ad580 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff1440ad580 0x7ff1440ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff148c09640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff1440afd50 0x7ff1440b0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:40448/0 (socket says 172.21.15.82:40448) 2023-07-20T11:22:59.900 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff148c09640 1 -- 172.21.15.82:0/2112555894 learned_addr learned my addr 172.21.15.82:0/2112555894 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:22:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13b7fe640 1 -- 172.21.15.82:0/2112555894 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808223690 0 0) 0x7ff144160390 con 0x7ff1440afd50 2023-07-20T11:22:59.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13b7fe640 1 -- 172.21.15.82:0/2112555894 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff12c003530 con 0x7ff1440afd50 2023-07-20T11:22:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13bfff640 1 -- 172.21.15.82:0/2112555894 >> v1:172.21.15.183:6789/0 conn(0x7ff144160820 legacy=0x7ff144160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13bfff640 1 -- 172.21.15.82:0/2112555894 >> v1:172.21.15.82:6789/0 conn(0x7ff1440afd50 legacy=0x7ff1440b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13bfff640 1 -- 172.21.15.82:0/2112555894 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440cc790 con 0x7ff1440ad580 2023-07-20T11:22:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13bfff640 1 --2- 172.21.15.82:0/2112555894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440ad580 0x7ff1440ac770 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ff1340097c0 tx=0x7ff13401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba37d32fe5376814 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13b7fe640 1 -- 172.21.15.82:0/2112555894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340ab620 con 0x7ff1440ad580 2023-07-20T11:22:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.910+0000 7ff13b7fe640 1 -- 172.21.15.82:0/2112555894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1340ab780 con 0x7ff1440ad580 2023-07-20T11:22:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff13b7fe640 1 -- 172.21.15.82:0/2112555894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340abb10 con 0x7ff1440ad580 2023-07-20T11:22:59.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2112555894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440ad580 msgr2=0x7ff1440ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2112555894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440ad580 0x7ff1440ac770 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7ff1340097c0 tx=0x7ff13401c480 comp rx=0 tx=0).stop 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2112555894 shutdown_connections 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2112555894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440ad580 0x7ff1440ac770 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2112555894 >> 172.21.15.82:0/2112555894 conn(0x7ff1440cad50 msgr2=0x7ff1440cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2112555894 shutdown_connections 2023-07-20T11:22:59.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2112555894 wait complete. 2023-07-20T11:22:59.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 Processor -- start 2023-07-20T11:22:59.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- start start 2023-07-20T11:22:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 0x7ff144152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff144160820 0x7ff1440c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14415b5b0 con 0x7ff1440afd50 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff144152410 con 0x7ff144160820 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14ae6d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441526f0 con 0x7ff1440ad580 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38098/0 (socket says 172.21.15.82:38098) 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff13bfff640 1 -- 172.21.15.82:0/2925757391 learned_addr learned my addr 172.21.15.82:0/2925757391 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:22:59.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff148c09640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 0x7ff144152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.914+0000 7ff14940a640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff144160820 0x7ff1440c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 -- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 msgr2=0x7ff144152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 0x7ff144152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 -- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff144160820 msgr2=0x7ff1440c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff144160820 0x7ff1440c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 -- 172.21.15.82:0/2925757391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134009420 con 0x7ff1440afd50 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff148c09640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 0x7ff144152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:22:59.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff13bfff640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7ff1340ad040 tx=0x7ff13401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340abe40 con 0x7ff1440afd50 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1340bf410 con 0x7ff1440afd50 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1441529d0 con 0x7ff1440afd50 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340bf7a0 con 0x7ff1440afd50 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14415f160 con 0x7ff1440afd50 2023-07-20T11:22:59.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14415f2f0 con 0x7ff1440afd50 2023-07-20T11:22:59.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 114) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff1340b5400 con 0x7ff1440afd50 2023-07-20T11:22:59.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 0x7ff1300685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:22:59.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7ff13411e290 con 0x7ff1440afd50 2023-07-20T11:22:59.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.918+0000 7ff148c09640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 0x7ff1300685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:22:59.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.922+0000 7ff148c09640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 0x7ff1300685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1400011f0 tx=0x7ff140009040 comp rx=0 tx=0).ready entity=mgr.10051 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:22:59.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:22:59.922+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1340eb9b0 con 0x7ff1440afd50 2023-07-20T11:23:00.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.094+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 --> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff14416a680 con 0x7ff130066120 2023-07-20T11:23:00.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.098+0000 7ff1397fa640 1 -- 172.21.15.82:0/2925757391 <== mgr.10051 v2:172.21.15.82:6832/2988654347 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7ff140001480 con 0x7ff130066120 2023-07-20T11:23:00.090 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:23:00.090 INFO:teuthology.orchestra.run.smithi082.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-20T11:23:00.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 msgr2=0x7ff1300685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:23:00.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 0x7ff1300685e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff1400011f0 tx=0x7ff140009040 comp rx=0 tx=0).stop 2023-07-20T11:23:00.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 msgr2=0x7ff14415ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:23:00.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7ff1340ad040 tx=0x7ff13401acc0 comp rx=0 tx=0).stop 2023-07-20T11:23:00.092 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 shutdown_connections 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff144160820 0x7ff1440c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7ff130066120 0x7ff1300685e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1440afd50 0x7ff14415ec20 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 --2- 172.21.15.82:0/2925757391 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1440ad580 0x7ff144152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 >> 172.21.15.82:0/2925757391 conn(0x7ff1440cad50 msgr2=0x7ff144160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 shutdown_connections 2023-07-20T11:23:00.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:23:00.102+0000 7ff14ae6d640 1 -- 172.21.15.82:0/2925757391 wait complete. 2023-07-20T11:23:00.111 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-20T11:23:00.112 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-20T11:23:00.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:00.112 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:00.123 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-20T11:23:00.123 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:00.123 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:00.741 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:23:00.750+0000 7f2f52017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:23:00.742 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:23:00.750+0000 7f2f52017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:23:00.742 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:23:00.750+0000 7f2f52017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:23:00.742 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:23:00.750+0000 7f2f52017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:23:00.742 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:23:00.750+0000 7f2f52017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:23:01.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:01.125 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:01.136 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:01.136 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:01.137 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:01.137 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-20-11_23_00_UTC'] 2023-07-20T11:23:01.137 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689852179.7548168, now = 1689852181.1376815, timo = 1 2023-07-20T11:23:02.138 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-07-20-11_23_00 in ~61s... 2023-07-20T11:23:02.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:02.139 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:02.150 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:02.151 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:02.151 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:02.151 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:03.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:03.153 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:03.163 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:03.164 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:03.164 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:03.165 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:04.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:04.166 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:04.177 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:04.178 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:04.178 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:04.179 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:05.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:05.180 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:05.191 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:05.192 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:05.192 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:05.193 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:06.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:06.194 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:06.205 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:06.205 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:06.206 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:06.206 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:07.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:07.207 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:07.218 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:07.218 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:07.219 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:07.219 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:08.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:08.220 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:08.232 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:08.233 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:08.233 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:08.233 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:09.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:09.235 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:09.246 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:09.247 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:09.247 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:09.247 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:10.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:10.249 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:10.260 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:10.261 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:10.261 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:10.261 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:11.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:11.263 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:11.273 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:11.274 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:11.275 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:11.275 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:12.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:12.276 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:12.287 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:12.288 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:12.288 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:12.288 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:13.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:13.290 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:13.301 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:13.302 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:13.302 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:13.303 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:14.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:14.304 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:14.315 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:14.316 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:14.316 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:14.316 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:15.269 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:23:15.273 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:23:15.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:15.318 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:15.329 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:15.330 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:15.330 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:15.330 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:16.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:16.332 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:16.343 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:16.344 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:16.344 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:16.345 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:17.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:17.346 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:17.357 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:17.358 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:17.358 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:17.358 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:18.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:18.360 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:18.370 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:18.371 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:18.372 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:18.372 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:19.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:19.373 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:19.384 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:19.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:19.385 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:19.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:20.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:20.387 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:20.398 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:20.399 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:20.399 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:20.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:21.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:21.401 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:21.412 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:21.413 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:21.413 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:21.414 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:22.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:22.415 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:22.427 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:22.428 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:22.428 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:22.428 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:23.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:23.430 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:23.440 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:23.442 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:23.443 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:23.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:24.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:24.446 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:24.458 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:24.458 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:24.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:24.459 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:25.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:25.460 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:25.470 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:25.471 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:25.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:25.472 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:26.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:26.474 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:26.485 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:26.486 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:26.486 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:26.486 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:27.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:27.488 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:27.500 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:27.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:27.502 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:27.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:28.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:28.504 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:28.515 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:28.516 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:28.516 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:28.517 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:29.518 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:29.530 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:29.531 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:29.531 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:29.531 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:30.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:30.533 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:30.544 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:30.545 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:30.546 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:30.546 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:31.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:31.547 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:31.558 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:31.559 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:31.559 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:31.560 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:32.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:32.561 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:32.572 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:32.573 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:32.573 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:32.573 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:33.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:33.575 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:33.586 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:33.587 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:33.587 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:33.588 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:34.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:34.590 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:34.600 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:34.601 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:34.602 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:34.602 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:35.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:35.604 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:35.615 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:35.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:35.617 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:35.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:36.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:36.619 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:36.630 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:36.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:36.631 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:36.631 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:37.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:37.633 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:37.644 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:37.645 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:37.645 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:37.646 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:38.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:38.647 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:38.658 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:38.659 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:38.659 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:38.659 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:39.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:39.660 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:39.671 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:39.672 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:39.673 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:39.673 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:40.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:40.675 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:40.686 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:40.687 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:40.687 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:40.688 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:41.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:41.689 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:41.700 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:41.701 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:41.702 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:41.702 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:42.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:42.703 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:42.714 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:42.715 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:42.716 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:42.716 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:43.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:43.717 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:43.728 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:43.729 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:43.729 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:43.730 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:44.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:44.732 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:44.742 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:44.743 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:44.744 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:44.744 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:45.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:23:45.346 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:23:45.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:45.746 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:45.757 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:45.758 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:45.758 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:45.758 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:46.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:46.760 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:46.771 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:46.772 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:46.773 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:46.773 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:47.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:47.774 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:47.785 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:47.786 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:47.786 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:47.787 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:48.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:48.789 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:48.800 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:48.801 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:48.801 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:48.801 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:49.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:49.803 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:49.814 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:49.815 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:49.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:49.816 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:50.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:50.817 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:50.828 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:50.829 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:50.829 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:50.830 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:51.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:51.831 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:51.842 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:51.843 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:51.843 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:51.844 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:52.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:52.875 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:52.888 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:52.889 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:52.890 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:52.890 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:53.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:53.891 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:53.902 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:53.903 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:53.903 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:53.904 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:54.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:54.905 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:54.915 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:54.916 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:54.917 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:54.917 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:55.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:55.918 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:55.929 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:55.930 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:55.930 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:55.931 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:56.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:56.932 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:56.943 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:56.944 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:56.944 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:56.944 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:57.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:57.946 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:57.957 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:57.958 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:57.959 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:57.959 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:58.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:58.961 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:58.971 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:58.972 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:58.973 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:58.973 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:23:59.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:23:59.974 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:23:59.989 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_23_00_UTC 2023-07-20T11:23:59.989 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:23:59.990 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-20T11:23:59.990 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-20T11:24:00.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:00.991 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:24:01.001 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_24_00_UTC 2023-07-20T11:24:01.002 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-20-11_24_00_UTC'} 2023-07-20T11:24:01.002 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-20-11_24_00_UTC'} 2023-07-20T11:24:01.003 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-07-20-11_23_00_UTC'} 2023-07-20T11:24:01.003 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-07-20-11_23_00_UTC'] 2023-07-20T11:24:01.003 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689852179.7548168, now = 1689852241.0036507, timo = 61 2023-07-20T11:24:02.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-20T11:24:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 Processor -- start 2023-07-20T11:24:02.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 -- start start 2023-07-20T11:24:02.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 0x7f8fd415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fd40afd50 0x7f8fd40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40b06b0 con 0x7f8fd4159830 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40cce90 con 0x7f8fd40afd50 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fdc434640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd40cc8d0 con 0x7f8fd4159450 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fda9d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fd40afd50 0x7f8fd40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fda9d1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8fd40afd50 0x7f8fd40b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57536/0 (socket says 172.21.15.82:57536) 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.165+0000 7f8fda9d1640 1 -- 172.21.15.82:0/2900314824 learned_addr learned my addr 172.21.15.82:0/2900314824 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda1d0640 1 --2- 172.21.15.82:0/2900314824 >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 0x7f8fd415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda9d1640 1 -- 172.21.15.82:0/2900314824 >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 msgr2=0x7f8fd415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda9d1640 1 --2- 172.21.15.82:0/2900314824 >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 0x7f8fd415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda9d1640 1 -- 172.21.15.82:0/2900314824 >> v1:172.21.15.183:6789/0 conn(0x7f8fd4159830 legacy=0x7f8fd40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda9d1640 1 -- 172.21.15.82:0/2900314824 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd40ccbb0 con 0x7f8fd40afd50 2023-07-20T11:24:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda1d0640 1 --2- 172.21.15.82:0/2900314824 >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 0x7f8fd415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fda9d1640 1 --2- 172.21.15.82:0/2900314824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd40afd50 0x7f8fd40b0170 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406a6c0 tx=0x7f8fcc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dc55d9a5a2cced server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fd91ce640 1 -- 172.21.15.82:0/2900314824 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a5820 con 0x7f8fd40afd50 2023-07-20T11:24:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fd91ce640 1 -- 172.21.15.82:0/2900314824 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0a5980 con 0x7f8fd40afd50 2023-07-20T11:24:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.169+0000 7f8fd91ce640 1 -- 172.21.15.82:0/2900314824 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0a5d10 con 0x7f8fd40afd50 2023-07-20T11:24:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- 172.21.15.82:0/2900314824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd40afd50 msgr2=0x7f8fd40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- 172.21.15.82:0/2900314824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd40afd50 0x7f8fd40b0170 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f8fd406a6c0 tx=0x7f8fcc01c960 comp rx=0 tx=0).stop 2023-07-20T11:24:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- 172.21.15.82:0/2900314824 shutdown_connections 2023-07-20T11:24:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- 172.21.15.82:0/2900314824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd40afd50 0x7f8fd40b0170 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- 172.21.15.82:0/2900314824 >> v2:172.21.15.183:3300/0 conn(0x7f8fd4159450 0x7f8fd415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- 172.21.15.82:0/2900314824 >> 172.21.15.82:0/2900314824 conn(0x7f8fd40cad50 msgr2=0x7f8fd40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- 172.21.15.82:0/2900314824 shutdown_connections 2023-07-20T11:24:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- 172.21.15.82:0/2900314824 wait complete. 2023-07-20T11:24:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 Processor -- start 2023-07-20T11:24:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- start start 2023-07-20T11:24:02.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40afd50 0x7f8fd4155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd4159450 0x7f8fd40a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd40c8070 con 0x7f8fd415c0b0 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415bc20 con 0x7f8fd4159450 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fdc434640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd415b330 con 0x7f8fd40afd50 2023-07-20T11:24:02.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fda9d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fda9d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57538/0 (socket says 172.21.15.82:57538) 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fda9d1640 1 -- 172.21.15.82:0/22996360 learned_addr learned my addr 172.21.15.82:0/22996360 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fda1d0640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40afd50 0x7f8fd4155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.173+0000 7f8fd99cf640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd4159450 0x7f8fd40a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 -- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40afd50 msgr2=0x7f8fd4155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40afd50 0x7f8fd4155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 -- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd4159450 msgr2=0x7f8fd40a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd4159450 0x7f8fd40a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 -- 172.21.15.82:0/22996360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc009b30 con 0x7f8fd415c0b0 2023-07-20T11:24:02.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fda9d1640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0af040 tx=0x7f8fcc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0b8670 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc0b87d0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd415b5d0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc0b8b80 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd4155dd0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd415bdb0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 116) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f8fcc0b8ce0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 0x7f8fb8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.177+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f8fcc11f4c0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.181+0000 7f8fda1d0640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 0x7f8fb8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.181+0000 7f8fda1d0640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 0x7f8fb8068a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c84a0 tx=0x7f8fd0008040 comp rx=0 tx=0).ready entity=mgr.10051 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.185+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fcc0ec6c0 con 0x7f8fd415c0b0 2023-07-20T11:24:02.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.349+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 --> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fd40cc5b0 con 0x7f8fb8066540 2023-07-20T11:24:02.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.405+0000 7f8fcaffd640 1 -- 172.21.15.82:0/22996360 <== mgr.10051 v2:172.21.15.82:6832/2988654347 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8fd000c040 con 0x7f8fb8066540 2023-07-20T11:24:02.399 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path snap_test_dir1 2023-07-20T11:24:02.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.405+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 msgr2=0x7f8fb8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.405+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 0x7f8fb8068a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c84a0 tx=0x7f8fd0008040 comp rx=0 tx=0).stop 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 msgr2=0x7f8fd40a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0af040 tx=0x7f8fcc019700 comp rx=0 tx=0).stop 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 shutdown_connections 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f8fb8066540 0x7f8fb8068a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8fd415c0b0 0x7f8fd40a8df0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fd4159450 0x7f8fd40a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 --2- 172.21.15.82:0/22996360 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8fd40afd50 0x7f8fd4155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 >> 172.21.15.82:0/22996360 conn(0x7f8fd40cad50 msgr2=0x7f8fd4158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 shutdown_connections 2023-07-20T11:24:02.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.409+0000 7f8fdc434640 1 -- 172.21.15.82:0/22996360 wait complete. 2023-07-20T11:24:02.419 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-20T11:24:02.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:02.420 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:24:02.429 INFO:teuthology.orchestra.run.smithi082.stdout:scheduled-2023-07-20-11_24_00_UTC 2023-07-20T11:24:02.430 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-20-11_24_00_UTC 2023-07-20T11:24:02.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:02.430 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-20-11_24_00_UTC) 2023-07-20T11:24:02.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:02.489 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T11:24:02.544 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T11:24:02.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.733+0000 7fdfdfef9640 1 Processor -- start 2023-07-20T11:24:02.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 -- start start 2023-07-20T11:24:02.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8161de0 0x7fdfd80afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfd80b0290 0x7fdfd80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80b06e0 con 0x7fdfd8160ba0 2023-07-20T11:24:02.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80c9650 con 0x7fdfd80b0290 2023-07-20T11:24:02.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdfef9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81619c0 con 0x7fdfd8161de0 2023-07-20T11:24:02.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfddc95640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfd8160ba0 0x7fdfd80c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:55266/0 (socket says 172.21.15.82:55266) 2023-07-20T11:24:02.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfddc95640 1 -- 172.21.15.82:0/934656145 learned_addr learned my addr 172.21.15.82:0/934656145 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:02.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfde496640 1 --2- 172.21.15.82:0/934656145 >> v2:172.21.15.82:3300/0 conn(0x7fdfd80b0290 0x7fdfd80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdd494640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8161de0 0x7fdfd80afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdcc93640 1 -- 172.21.15.82:0/934656145 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953003439 0 0) 0x7fdfd4001120 con 0x7fdfd8160ba0 2023-07-20T11:24:02.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfdcc93640 1 -- 172.21.15.82:0/934656145 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc4003530 con 0x7fdfd8160ba0 2023-07-20T11:24:02.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfde496640 1 -- 172.21.15.82:0/934656145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8161de0 msgr2=0x7fdfd80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:02.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfde496640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8161de0 0x7fdfd80afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfde496640 1 -- 172.21.15.82:0/934656145 >> v1:172.21.15.82:6789/0 conn(0x7fdfd8160ba0 legacy=0x7fdfd80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.737+0000 7fdfde496640 1 -- 172.21.15.82:0/934656145 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80c9370 con 0x7fdfd80b0290 2023-07-20T11:24:02.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfde496640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80cbea0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009d90 tx=0x7fdfd001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5613843a5e4f874d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdcc93640 1 -- 172.21.15.82:0/934656145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00a59e0 con 0x7fdfd80b0290 2023-07-20T11:24:02.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdcc93640 1 -- 172.21.15.82:0/934656145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00a5b40 con 0x7fdfd80b0290 2023-07-20T11:24:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdcc93640 1 -- 172.21.15.82:0/934656145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00ad440 con 0x7fdfd80b0290 2023-07-20T11:24:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- 172.21.15.82:0/934656145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 msgr2=0x7fdfd80cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80cbea0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009d90 tx=0x7fdfd001c920 comp rx=0 tx=0).stop 2023-07-20T11:24:02.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- 172.21.15.82:0/934656145 shutdown_connections 2023-07-20T11:24:02.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80cbea0 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/934656145 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8161de0 0x7fdfd80afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- 172.21.15.82:0/934656145 >> 172.21.15.82:0/934656145 conn(0x7fdfd80cad50 msgr2=0x7fdfd80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- 172.21.15.82:0/934656145 shutdown_connections 2023-07-20T11:24:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- 172.21.15.82:0/934656145 wait complete. 2023-07-20T11:24:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 Processor -- start 2023-07-20T11:24:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.741+0000 7fdfdfef9640 1 -- start start 2023-07-20T11:24:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8160ba0 0x7fdfd80add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd8161de0 0x7fdfd8158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c7260 con 0x7fdfd80b0290 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81628a0 con 0x7fdfd8161de0 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c6ca0 con 0x7fdfd8160ba0 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57556/0 (socket says 172.21.15.82:57556) 2023-07-20T11:24:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 -- 172.21.15.82:0/3958277384 learned_addr learned my addr 172.21.15.82:0/3958277384 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdd494640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8160ba0 0x7fdfd80add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfde496640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd8161de0 0x7fdfd8158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 -- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8160ba0 msgr2=0x7fdfd80add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8160ba0 0x7fdfd80add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 -- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd8161de0 msgr2=0x7fdfd8158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd8161de0 0x7fdfd8158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 -- 172.21.15.82:0/3958277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009a70 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfddc95640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c4d0 tx=0x7fdfd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4005cf0 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4005e50 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4007290 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd80c6f80 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd81592a0 con 0x7fdfd80b0290 2023-07-20T11:24:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.745+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd804da30 con 0x7fdfd80b0290 2023-07-20T11:24:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.749+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 116) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fdfd40073f0 con 0x7fdfd80b0290 2023-07-20T11:24:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.749+0000 7fdfce7fc640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 0x7fdfbc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.749+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fdfd40837f0 con 0x7fdfd80b0290 2023-07-20T11:24:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.749+0000 7fdfdd494640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 0x7fdfbc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:02.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.749+0000 7fdfdd494640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 0x7fdfbc0689d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfd815e9f0 tx=0x7fdfc8008040 comp rx=0 tx=0).ready entity=mgr.10051 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:02.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.753+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfd4050770 con 0x7fdfd80b0290 2023-07-20T11:24:02.927 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:02.933+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fdfd80b06e0 con 0x7fdfd80b0290 2023-07-20T11:24:03.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.561+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fdfd40076a0 con 0x7fdfd80b0290 2023-07-20T11:24:03.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfce7fc640 1 -- 172.21.15.82:0/3958277384 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v117) v1 ==== 93+0+0 (secure 0 0 0) 0x7fdfd4070770 con 0x7fdfd80b0290 2023-07-20T11:24:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 msgr2=0x7fdfbc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 0x7fdfbc0689d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfd815e9f0 tx=0x7fdfc8008040 comp rx=0 tx=0).stop 2023-07-20T11:24:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 msgr2=0x7fdfd80ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400c4d0 tx=0x7fdfd400c990 comp rx=0 tx=0).stop 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 shutdown_connections 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfd8161de0 0x7fdfd8158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfd8160ba0 0x7fdfd80add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fdfbc066510 0x7fdfbc0689d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 --2- 172.21.15.82:0/3958277384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfd80b0290 0x7fdfd80ad800 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 >> 172.21.15.82:0/3958277384 conn(0x7fdfd80cad50 msgr2=0x7fdfd8164d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:03.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 shutdown_connections 2023-07-20T11:24:03.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.565+0000 7fdfdfef9640 1 -- 172.21.15.82:0/3958277384 wait complete. 2023-07-20T11:24:03.580 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:24:03.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:03.627 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:03.692 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:24:03.693 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:03.693 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:03.704 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:03.704 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:03.724 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:03.730+0000 7f8594b17180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:03.736 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:03.741+0000 7ffadcafd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:03.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 Processor -- start 2023-07-20T11:24:03.929 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 -- start start 2023-07-20T11:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 0x7f4b1c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0ccd60 con 0x7f4b1c0cc900 2023-07-20T11:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0ad810 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b228cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c15d0d0 con 0x7f4b1c1596b0 2023-07-20T11:24:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1b7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4b1c0cc900 0x7f4b1c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54824/0 (socket says 172.21.15.82:54824) 2023-07-20T11:24:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1b7fe640 1 -- 172.21.15.82:0/1557557529 learned_addr learned my addr 172.21.15.82:0/1557557529 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/1557557529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 0x7f4b1c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065342097 0 0) 0x7f4b1c0ccd60 con 0x7f4b1c0cc900 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b04003530 con 0x7f4b1c0cc900 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034807117 0 0) 0x7f4b1c0ad810 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c0ccd60 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1557557529 >> v1:172.21.15.183:6789/0 conn(0x7f4b1c0b2a90 legacy=0x7f4b1c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1557557529 >> v1:172.21.15.82:6789/0 conn(0x7f4b1c0cc900 legacy=0x7f4b1c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.937+0000 7f4b1bfff640 1 -- 172.21.15.82:0/1557557529 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c15d3b0 con 0x7f4b1c1596b0 2023-07-20T11:24:03.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/1557557529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 0x7f4b1c15dbb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66aaa01cfd6f2e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:03.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0a7070 con 0x7f4b1c1596b0 2023-07-20T11:24:03.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0ab430 con 0x7f4b1c1596b0 2023-07-20T11:24:03.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b1affd640 1 -- 172.21.15.82:0/1557557529 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0ab7c0 con 0x7f4b1c1596b0 2023-07-20T11:24:03.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 -- 172.21.15.82:0/1557557529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 msgr2=0x7f4b1c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 --2- 172.21.15.82:0/1557557529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 0x7f4b1c15dbb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097f0 tx=0x7f4b0c01c490 comp rx=0 tx=0).stop 2023-07-20T11:24:03.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 -- 172.21.15.82:0/1557557529 shutdown_connections 2023-07-20T11:24:03.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 --2- 172.21.15.82:0/1557557529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c1596b0 0x7f4b1c15dbb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 -- 172.21.15.82:0/1557557529 >> 172.21.15.82:0/1557557529 conn(0x7f4b1c0cada0 msgr2=0x7f4b1c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 -- 172.21.15.82:0/1557557529 shutdown_connections 2023-07-20T11:24:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.941+0000 7f4b228cb640 1 -- 172.21.15.82:0/1557557529 wait complete. 2023-07-20T11:24:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 Processor -- start 2023-07-20T11:24:03.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- start start 2023-07-20T11:24:03.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c0cc900 0x7f4b1c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b1c1596b0 0x7f4b1c06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c1529d0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c099f50 con 0x7f4b1c1596b0 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c152410 con 0x7f4b1c0cc900 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:03.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52424/0 (socket says 172.21.15.82:52424) 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 -- 172.21.15.82:0/7973346 learned_addr learned my addr 172.21.15.82:0/7973346 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1b7fe640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c0cc900 0x7f4b1c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b20e68640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b1c1596b0 0x7f4b1c06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 -- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c0cc900 msgr2=0x7f4b1c06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c0cc900 0x7f4b1c06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 -- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b1c1596b0 msgr2=0x7f4b1c06bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:03.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b1c1596b0 0x7f4b1c06bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 -- 172.21.15.82:0/7973346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009420 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b1bfff640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c01a0c0 tx=0x7f4b0c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0abd60 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0bf450 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0bf800 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c1526f0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c09a4d0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.945+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c09a6c0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.949+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f4b0c0b43f0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.949+0000 7f4b18ff9640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 0x7f4b08068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:03.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.949+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f4b0c11e7a0 con 0x7f4b1c0b2a90 2023-07-20T11:24:03.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.949+0000 7f4b1b7fe640 1 -- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 msgr2=0x7f4b08068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:03.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.949+0000 7f4b1b7fe640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 0x7f4b08068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:03.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:03.953+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b0c0eb7c0 con 0x7f4b1c0b2a90 2023-07-20T11:24:04.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.101+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1c073c70 con 0x7f4b1c0b2a90 2023-07-20T11:24:04.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b18ff9640 1 -- 172.21.15.82:0/7973346 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18884 (secure 0 0 0) 0x7f4b0c0eede0 con 0x7f4b1c0b2a90 2023-07-20T11:24:04.097 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:04.098 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":192,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:22:58.268200+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3057939453":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/1202706903":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/370784443":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2133506175":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2867668341":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6832/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2669450055":"2023-07-21T11:22:58.268166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:04.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 msgr2=0x7f4b08068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 0x7f4b08068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 msgr2=0x7f4b1c150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c01a0c0 tx=0x7f4b0c019230 comp rx=0 tx=0).stop 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 shutdown_connections 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b1c1596b0 0x7f4b1c06bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b1c0cc900 0x7f4b1c06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f4b080664c0 0x7f4b08068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 --2- 172.21.15.82:0/7973346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b1c0b2a90 0x7f4b1c150d90 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 >> 172.21.15.82:0/7973346 conn(0x7f4b1c0cada0 msgr2=0x7f4b1c164c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 shutdown_connections 2023-07-20T11:24:04.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.105+0000 7f4b228cb640 1 -- 172.21.15.82:0/7973346 wait complete. 2023-07-20T11:24:04.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:22:38.604492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:22:39.925692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:04.121 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:04.140 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.146+0000 7f8594b17180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:04.164 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:04.169+0000 7ffadcafd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:04.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 Processor -- start 2023-07-20T11:24:04.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 -- start start 2023-07-20T11:24:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f748806c120 0x7f74880cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806b220 0x7f7488160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880d0970 con 0x7f74881602b0 2023-07-20T11:24:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7488160e20 con 0x7f748806c120 2023-07-20T11:24:04.268 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f748deec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880cd300 con 0x7f748806b220 2023-07-20T11:24:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f748806c120 0x7f74880cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f748806c120 0x7f74880cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:41012/0 (socket says 172.21.15.82:41012) 2023-07-20T11:24:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 -- 172.21.15.82:0/1714790162 learned_addr learned my addr 172.21.15.82:0/1714790162 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f7487fff640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806b220 0x7f7488160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.269 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 -- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806b220 msgr2=0x7f7488160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806b220 0x7f7488160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 -- 172.21.15.82:0/1714790162 >> v1:172.21.15.183:6789/0 conn(0x7f74881602b0 legacy=0x7f748806ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.270 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.273+0000 7f74877fe640 1 -- 172.21.15.82:0/1714790162 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880cd5e0 con 0x7f748806c120 2023-07-20T11:24:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f74877fe640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748806c120 0x7f74880cdde0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7478009870 tx=0x7f747801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c53c664cebdc960 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f74867fc640 1 -- 172.21.15.82:0/1714790162 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780a6040 con 0x7f748806c120 2023-07-20T11:24:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f74867fc640 1 -- 172.21.15.82:0/1714790162 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780aa600 con 0x7f748806c120 2023-07-20T11:24:04.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f74867fc640 1 -- 172.21.15.82:0/1714790162 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780aa990 con 0x7f748806c120 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 -- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748806c120 msgr2=0x7f74880cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748806c120 0x7f74880cdde0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7478009870 tx=0x7f747801c480 comp rx=0 tx=0).stop 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 -- 172.21.15.82:0/1714790162 shutdown_connections 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806b220 0x7f7488160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 --2- 172.21.15.82:0/1714790162 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f748806c120 0x7f74880cdde0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 -- 172.21.15.82:0/1714790162 >> 172.21.15.82:0/1714790162 conn(0x7f748808c0a0 msgr2=0x7f748809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 -- 172.21.15.82:0/1714790162 shutdown_connections 2023-07-20T11:24:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.277+0000 7f748deec640 1 -- 172.21.15.82:0/1714790162 wait complete. 2023-07-20T11:24:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 Processor -- start 2023-07-20T11:24:04.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 -- start start 2023-07-20T11:24:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806c120 0x7f74880b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74881602b0 0x7f74880b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880b0750 con 0x7f748806b220 2023-07-20T11:24:04.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488157160 con 0x7f74881602b0 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f748deec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488156550 con 0x7f748806c120 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52426/0 (socket says 172.21.15.82:52426) 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 -- 172.21.15.82:0/1118416766 learned_addr learned my addr 172.21.15.82:0/1118416766 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f7486ffd640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806c120 0x7f74880b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.277 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f7487fff640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74881602b0 0x7f74880b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 -- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806c120 msgr2=0x7f74880b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.278 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806c120 0x7f74880b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 -- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74881602b0 msgr2=0x7f74880b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74881602b0 0x7f74880b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.281+0000 7f74877fe640 1 -- 172.21.15.82:0/1118416766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74780094d0 con 0x7f748806b220 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f74877fe640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f747801a0b0 tx=0x7f747801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780b3600 con 0x7f748806b220 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74780b3760 con 0x7f748806b220 2023-07-20T11:24:04.279 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7488156830 con 0x7f748806b220 2023-07-20T11:24:04.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780b3af0 con 0x7f748806b220 2023-07-20T11:24:04.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7488156df0 con 0x7f748806b220 2023-07-20T11:24:04.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488156fb0 con 0x7f748806b220 2023-07-20T11:24:04.280 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f74780b3c50 con 0x7f748806b220 2023-07-20T11:24:04.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 0x7f7474068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f7486ffd640 1 -- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 msgr2=0x7f7474068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:04.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f747811e9b0 con 0x7f748806b220 2023-07-20T11:24:04.281 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.285+0000 7f7486ffd640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 0x7f7474068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:04.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.293+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74780eb840 con 0x7f748806b220 2023-07-20T11:24:04.290 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.294+0000 7f8594b17180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:04.321 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:04.329+0000 7ffadcafd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f748806c780 con 0x7f748806b220 2023-07-20T11:24:04.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f746ffff640 1 -- 172.21.15.82:0/1118416766 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74780eee60 con 0x7f748806b220 2023-07-20T11:24:04.434 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:04.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 msgr2=0x7f7474068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 0x7f7474068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 msgr2=0x7f748814df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f747801a0b0 tx=0x7f747801acc0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 shutdown_connections 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74881602b0 0x7f74880b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f748806c120 0x7f74880b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f74740664c0 0x7f7474068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 --2- 172.21.15.82:0/1118416766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f748806b220 0x7f748814df70 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 >> 172.21.15.82:0/1118416766 conn(0x7f748808c0a0 msgr2=0x7f748806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 shutdown_connections 2023-07-20T11:24:04.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.441+0000 7f748deec640 1 -- 172.21.15.82:0/1118416766 wait complete. 2023-07-20T11:24:04.455 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:04.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.645+0000 7f3d74f67640 1 Processor -- start 2023-07-20T11:24:04.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 -- start start 2023-07-20T11:24:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d7006c120 0x7f3d700cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 0x7f3d70160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 0x7f3d7006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7006b4a0 con 0x7f3d7006c120 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d700d0970 con 0x7f3d701602b0 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d74f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70160e20 con 0x7f3d7006ab10 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d7006c120 0x7f3d700cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3d7006c120 0x7f3d700cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52434/0 (socket says 172.21.15.82:52434) 2023-07-20T11:24:04.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 -- 172.21.15.82:0/1716258120 learned_addr learned my addr 172.21.15.82:0/1716258120 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d67fff640 1 --2- 172.21.15.82:0/1716258120 >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 0x7f3d70160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6ed9d640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 0x7f3d7006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 -- 172.21.15.82:0/1716258120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 msgr2=0x7f3d7006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 0x7f3d7006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 -- 172.21.15.82:0/1716258120 >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 msgr2=0x7f3d70160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/1716258120 >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 0x7f3d70160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6e59c640 1 -- 172.21.15.82:0/1716258120 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700cd300 con 0x7f3d7006c120 2023-07-20T11:24:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d67fff640 1 --2- 172.21.15.82:0/1716258120 >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 0x7f3d70160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.649+0000 7f3d6ed9d640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 0x7f3d7006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:04.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d700cdde0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f3d7008ca40 tx=0x7f3d6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681dd284db5a5ad7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d6dd9b640 1 -- 172.21.15.82:0/1716258120 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ab600 con 0x7f3d7006c120 2023-07-20T11:24:04.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d6dd9b640 1 -- 172.21.15.82:0/1716258120 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600ab760 con 0x7f3d7006c120 2023-07-20T11:24:04.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d6dd9b640 1 -- 172.21.15.82:0/1716258120 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600abaf0 con 0x7f3d7006c120 2023-07-20T11:24:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 -- 172.21.15.82:0/1716258120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 msgr2=0x7f3d700cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d700cdde0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f3d7008ca40 tx=0x7f3d6001c440 comp rx=0 tx=0).stop 2023-07-20T11:24:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 -- 172.21.15.82:0/1716258120 shutdown_connections 2023-07-20T11:24:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 --2- 172.21.15.82:0/1716258120 >> v2:172.21.15.183:3300/0 conn(0x7f3d701602b0 0x7f3d70160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d7006ab10 0x7f3d7006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 --2- 172.21.15.82:0/1716258120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d700cdde0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 -- 172.21.15.82:0/1716258120 >> 172.21.15.82:0/1716258120 conn(0x7f3d7008c0a0 msgr2=0x7f3d7009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 -- 172.21.15.82:0/1716258120 shutdown_connections 2023-07-20T11:24:04.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.653+0000 7f3d74f67640 1 -- 172.21.15.82:0/1716258120 wait complete. 2023-07-20T11:24:04.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 Processor -- start 2023-07-20T11:24:04.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- start start 2023-07-20T11:24:04.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d70157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 0x7f3d700cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d701577d0 con 0x7f3d7006c120 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700b14e0 con 0x7f3d7006ab10 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d700b0f20 con 0x7f3d701602b0 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d67fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d70157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:41044/0 (socket says 172.21.15.82:41044) 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6ed9d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 0x7f3d700cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 -- 172.21.15.82:0/2526275665 learned_addr learned my addr 172.21.15.82:0/2526275665 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:04.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 -- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 msgr2=0x7f3d700cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 0x7f3d700cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 -- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 msgr2=0x7f3d70157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d70157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 -- 172.21.15.82:0/2526275665 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600094d0 con 0x7f3d7006ab10 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d67fff640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d70157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:04.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6ed9d640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 0x7f3d700cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d6e59c640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ad040 tx=0x7f3d6001ac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600ab600 con 0x7f3d7006ab10 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d700b1200 con 0x7f3d7006ab10 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d600b4800 con 0x7f3d7006ab10 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d600b4b70 con 0x7f3d7006ab10 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.657+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d700c8060 con 0x7f3d7006ab10 2023-07-20T11:24:04.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d700c7be0 con 0x7f3d7006ab10 2023-07-20T11:24:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f3d600b4cd0 con 0x7f3d7006ab10 2023-07-20T11:24:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d66ffd640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 0x7f3d50068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f3d6011eb50 con 0x7f3d7006ab10 2023-07-20T11:24:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d67fff640 1 -- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 msgr2=0x7f3d50068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:04.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.661+0000 7f3d67fff640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 0x7f3d50068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:04.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.669+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d700c7be0 con 0x7f3d7006ab10 2023-07-20T11:24:04.773 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.778+0000 7f8594b17180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:04.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d700c7be0 con 0x7f3d7006ab10 2023-07-20T11:24:04.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d66ffd640 1 -- 172.21.15.82:0/2526275665 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d700c7be0 con 0x7f3d7006ab10 2023-07-20T11:24:04.813 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:04.814 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:04.821+0000 7ffadcafd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:04.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 msgr2=0x7f3d50068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 0x7f3d50068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 msgr2=0x7f3d7015c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3d600ad040 tx=0x7f3d6001ac80 comp rx=0 tx=0).stop 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 shutdown_connections 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3d701602b0 0x7f3d700cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f3d500664c0 0x7f3d50068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3d7006c120 0x7f3d70157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 --2- 172.21.15.82:0/2526275665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3d7006ab10 0x7f3d7015c650 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 >> 172.21.15.82:0/2526275665 conn(0x7f3d7008c0a0 msgr2=0x7f3d700d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 shutdown_connections 2023-07-20T11:24:04.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.821+0000 7f3d74f67640 1 -- 172.21.15.82:0/2526275665 wait complete. 2023-07-20T11:24:04.832 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.838+0000 7f8594b17180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:04.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:24:04.877 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:04.885+0000 7ffadcafd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:04.888 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.894+0000 7f8594b17180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:04.934 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:04.941+0000 7ffadcafd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:04.973 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:04.978+0000 7f8594b17180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 Processor -- start 2023-07-20T11:24:04.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 -- start start 2023-07-20T11:24:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f16341602b0 0x7f1634160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f163406ab10 0x7f163406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340ce4f0 con 0x7f163406c120 2023-07-20T11:24:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16340d0970 con 0x7f16341602b0 2023-07-20T11:24:04.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f163a3ba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1634160e20 con 0x7f163406ab10 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f1633fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f163406c120 0x7f16340cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54838/0 (socket says 172.21.15.82:54838) 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f1633fff640 1 -- 172.21.15.82:0/2562255922 learned_addr learned my addr 172.21.15.82:0/2562255922 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f16337fe640 1 --2- 172.21.15.82:0/2562255922 >> v2:172.21.15.82:3300/0 conn(0x7f16341602b0 0x7f1634160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f1638957640 1 --2- 172.21.15.82:0/2562255922 >> v2:172.21.15.183:3300/0 conn(0x7f163406ab10 0x7f163406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f1632ffd640 1 -- 172.21.15.82:0/2562255922 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986585806 0 0) 0x7f16340ce4f0 con 0x7f163406c120 2023-07-20T11:24:04.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f1632ffd640 1 -- 172.21.15.82:0/2562255922 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c003530 con 0x7f163406c120 2023-07-20T11:24:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f16337fe640 1 -- 172.21.15.82:0/2562255922 >> v2:172.21.15.183:3300/0 conn(0x7f163406ab10 msgr2=0x7f163406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f16337fe640 1 --2- 172.21.15.82:0/2562255922 >> v2:172.21.15.183:3300/0 conn(0x7f163406ab10 0x7f163406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f16337fe640 1 -- 172.21.15.82:0/2562255922 >> v1:172.21.15.82:6789/0 conn(0x7f163406c120 legacy=0x7f16340cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.989+0000 7f16337fe640 1 -- 172.21.15.82:0/2562255922 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340cd300 con 0x7f16341602b0 2023-07-20T11:24:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f16337fe640 1 --2- 172.21.15.82:0/2562255922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f1634160740 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f163408ceb0 tx=0x7f162801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52943b4b393221a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f1632ffd640 1 -- 172.21.15.82:0/2562255922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280ac600 con 0x7f16341602b0 2023-07-20T11:24:04.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f1632ffd640 1 -- 172.21.15.82:0/2562255922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280a8050 con 0x7f16341602b0 2023-07-20T11:24:04.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f1632ffd640 1 -- 172.21.15.82:0/2562255922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280ac980 con 0x7f16341602b0 2023-07-20T11:24:04.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- 172.21.15.82:0/2562255922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 msgr2=0x7f1634160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 --2- 172.21.15.82:0/2562255922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f1634160740 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f163408ceb0 tx=0x7f162801c3a0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- 172.21.15.82:0/2562255922 shutdown_connections 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 --2- 172.21.15.82:0/2562255922 >> v2:172.21.15.183:3300/0 conn(0x7f163406ab10 0x7f163406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 --2- 172.21.15.82:0/2562255922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f1634160740 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- 172.21.15.82:0/2562255922 >> 172.21.15.82:0/2562255922 conn(0x7f163408c0a0 msgr2=0x7f163409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- 172.21.15.82:0/2562255922 shutdown_connections 2023-07-20T11:24:04.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- 172.21.15.82:0/2562255922 wait complete. 2023-07-20T11:24:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 Processor -- start 2023-07-20T11:24:04.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:04.997+0000 7f163a3ba640 1 -- start start 2023-07-20T11:24:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f163406ab10 0x7f16340c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163406c120 0x7f16340b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c89b0 con 0x7f16341602b0 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c7340 con 0x7f163406ab10 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16340c6d30 con 0x7f163406c120 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52454/0 (socket says 172.21.15.82:52454) 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 -- 172.21.15.82:0/4150846885 learned_addr learned my addr 172.21.15.82:0/4150846885 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:04.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f16337fe640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163406c120 0x7f16340b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1633fff640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f163406ab10 0x7f16340c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:04.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 -- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163406c120 msgr2=0x7f16340b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163406c120 0x7f16340b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 -- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f163406ab10 msgr2=0x7f16340c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f163406ab10 0x7f16340c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 -- 172.21.15.82:0/4150846885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009420 con 0x7f16341602b0 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1638957640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f162c00efc0 tx=0x7f162c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:04.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c014480 con 0x7f16341602b0 2023-07-20T11:24:04.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00f040 con 0x7f16341602b0 2023-07-20T11:24:04.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c014820 con 0x7f16341602b0 2023-07-20T11:24:04.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16340c86d0 con 0x7f16341602b0 2023-07-20T11:24:04.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16341579a0 con 0x7f16341602b0 2023-07-20T11:24:04.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.001+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340c6b90 con 0x7f16341602b0 2023-07-20T11:24:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.005+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f162c014980 con 0x7f16341602b0 2023-07-20T11:24:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.005+0000 7f1630ff9640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 0x7f1620068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.005+0000 7f1633fff640 1 -- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 msgr2=0x7f1620068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.005+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f162c085150 con 0x7f16341602b0 2023-07-20T11:24:04.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.005+0000 7f1633fff640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 0x7f1620068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:05.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.009+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16340c6b90 con 0x7f16341602b0 2023-07-20T11:24:05.027 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.033+0000 7ffadcafd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:05.031 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.038+0000 7f8594b17180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:05.084 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.089+0000 7ffadcafd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:05.115 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.122+0000 7f8594b17180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:05.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.161+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16340c6b90 con 0x7f16341602b0 2023-07-20T11:24:05.156 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.161+0000 7f1630ff9640 1 -- 172.21.15.82:0/4150846885 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v192) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16340c6b90 con 0x7f16341602b0 2023-07-20T11:24:05.156 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:24:05.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 msgr2=0x7f1620068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:05.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 0x7f1620068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 msgr2=0x7f16340b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f162c00efc0 tx=0x7f162c00c490 comp rx=0 tx=0).stop 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 shutdown_connections 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f16200664c0 0x7f1620068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16341602b0 0x7f16340b5a10 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f163406c120 0x7f16340b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 --2- 172.21.15.82:0/4150846885 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f163406ab10 0x7f16340c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 >> 172.21.15.82:0/4150846885 conn(0x7f163408c0a0 msgr2=0x7f163409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:05.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 shutdown_connections 2023-07-20T11:24:05.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.165+0000 7f163a3ba640 1 -- 172.21.15.82:0/4150846885 wait complete. 2023-07-20T11:24:05.170 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.178+0000 7f8594b17180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:05.171 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.177+0000 7ffadcafd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:05.177 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:24:05.230 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.237+0000 7ffadcafd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:05.312 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.318+0000 7f8594b17180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.369+0000 7fac43427640 1 Processor -- start 2023-07-20T11:24:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.369+0000 7fac43427640 1 -- start start 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac43427640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac3c06c120 0x7fac3c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac43427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06b220 0x7fac3c160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac43427640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c0d0970 con 0x7fac3c1602b0 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac43427640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3c160e20 con 0x7fac3c06c120 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac43427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0cd300 con 0x7fac3c06b220 2023-07-20T11:24:05.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac3c06c120 0x7fac3c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fac3c06c120 0x7fac3c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52470/0 (socket says 172.21.15.82:52470) 2023-07-20T11:24:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 -- 172.21.15.82:0/703758735 learned_addr learned my addr 172.21.15.82:0/703758735 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac419c4640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06b220 0x7fac3c160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 -- 172.21.15.82:0/703758735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06b220 msgr2=0x7fac3c160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06b220 0x7fac3c160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 -- 172.21.15.82:0/703758735 >> v1:172.21.15.183:6789/0 conn(0x7fac3c1602b0 legacy=0x7fac3c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.373+0000 7fac411c3640 1 -- 172.21.15.82:0/703758735 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c0cd5e0 con 0x7fac3c06c120 2023-07-20T11:24:05.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac411c3640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06c120 0x7fac3c0cdde0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac3801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd1ade26a9ae0b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:05.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac33fff640 1 -- 172.21.15.82:0/703758735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380a6040 con 0x7fac3c06c120 2023-07-20T11:24:05.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac33fff640 1 -- 172.21.15.82:0/703758735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac380aa600 con 0x7fac3c06c120 2023-07-20T11:24:05.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac33fff640 1 -- 172.21.15.82:0/703758735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380aa990 con 0x7fac3c06c120 2023-07-20T11:24:05.370 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.378+0000 7f8594b17180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 -- 172.21.15.82:0/703758735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06c120 msgr2=0x7fac3c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06c120 0x7fac3c0cdde0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac3801c480 comp rx=0 tx=0).stop 2023-07-20T11:24:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 -- 172.21.15.82:0/703758735 shutdown_connections 2023-07-20T11:24:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06b220 0x7fac3c160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 --2- 172.21.15.82:0/703758735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06c120 0x7fac3c0cdde0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 -- 172.21.15.82:0/703758735 >> 172.21.15.82:0/703758735 conn(0x7fac3c08c0a0 msgr2=0x7fac3c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 -- 172.21.15.82:0/703758735 shutdown_connections 2023-07-20T11:24:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.377+0000 7fac43427640 1 -- 172.21.15.82:0/703758735 wait complete. 2023-07-20T11:24:05.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 Processor -- start 2023-07-20T11:24:05.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- start start 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06c120 0x7fac3c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac3c1602b0 0x7fac3c0cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0af590 con 0x7fac3c06b220 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0b20e0 con 0x7fac3c1602b0 2023-07-20T11:24:05.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0b0d80 con 0x7fac3c06c120 2023-07-20T11:24:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52476/0 (socket says 172.21.15.82:52476) 2023-07-20T11:24:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 -- 172.21.15.82:0/372829103 learned_addr learned my addr 172.21.15.82:0/372829103 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac409c2640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06c120 0x7fac3c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac419c4640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac3c1602b0 0x7fac3c0cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 -- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06c120 msgr2=0x7fac3c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06c120 0x7fac3c0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 -- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac3c1602b0 msgr2=0x7fac3c0cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac3c1602b0 0x7fac3c0cf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 -- 172.21.15.82:0/372829103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380094d0 con 0x7fac3c06b220 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac411c3640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fac3801a0b0 tx=0x7fac3801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380b3600 con 0x7fac3c06b220 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac380b3760 con 0x7fac3c06b220 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c0b1060 con 0x7fac3c06b220 2023-07-20T11:24:05.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380b3af0 con 0x7fac3c06b220 2023-07-20T11:24:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.381+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c0af220 con 0x7fac3c06b220 2023-07-20T11:24:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c04da30 con 0x7fac3c06b220 2023-07-20T11:24:05.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fac380b3c50 con 0x7fac3c06b220 2023-07-20T11:24:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac31ffb640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 0x7fac20068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac409c2640 1 -- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 msgr2=0x7fac20068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fac3811e3d0 con 0x7fac3c06b220 2023-07-20T11:24:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.385+0000 7fac409c2640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 0x7fac20068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:05.381 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.389+0000 7ffadcafd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:05.383 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.389+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac380eb250 con 0x7fac3c06b220 2023-07-20T11:24:05.442 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.449+0000 7ffadcafd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:05.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac3c160b60 con 0x7fac3c06b220 2023-07-20T11:24:05.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac31ffb640 1 -- 172.21.15.82:0/372829103 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v192) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac380ee870 con 0x7fac3c06b220 2023-07-20T11:24:05.534 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:24:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 msgr2=0x7fac20068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 0x7fac20068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 msgr2=0x7fac3c0b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7fac3801a0b0 tx=0x7fac3801acc0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 shutdown_connections 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac3c1602b0 0x7fac3c0cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac3c06c120 0x7fac3c0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fac200664c0 0x7fac20068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 --2- 172.21.15.82:0/372829103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac3c06b220 0x7fac3c0b07a0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 >> 172.21.15.82:0/372829103 conn(0x7fac3c08c0a0 msgr2=0x7fac3c0b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:05.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 shutdown_connections 2023-07-20T11:24:05.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.541+0000 7fac43427640 1 -- 172.21.15.82:0/372829103 wait complete. 2023-07-20T11:24:05.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T11:24:05.612 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:05.612 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:05.612 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:05.620 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.626+0000 7f8594b17180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:05.690 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:05.690 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:05.690 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:05.698 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.705+0000 7ffadcafd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:05.754 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.762+0000 7f8594b17180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:05.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.789+0000 7f49110bd640 1 Processor -- start 2023-07-20T11:24:05.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.789+0000 7f49110bd640 1 -- start start 2023-07-20T11:24:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f49110bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 0x7f490c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f49110bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f490c0ce4c0 0x7f490c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f49110bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c0d16b0 con 0x7f490c0d0d10 2023-07-20T11:24:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f49110bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c0d31c0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f49110bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c0b3520 con 0x7f490c15cab0 2023-07-20T11:24:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f490c0ce4c0 0x7f490c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490ad9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 0x7f490c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f490c0ce4c0 0x7f490c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52482/0 (socket says 172.21.15.82:52482) 2023-07-20T11:24:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 -- 172.21.15.82:0/2538840989 learned_addr learned my addr 172.21.15.82:0/2538840989 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:05.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f4903fff640 1 --1- 172.21.15.82:0/2538840989 >> v1:172.21.15.183:6789/0 conn(0x7f490c0d0d10 0x7f490c0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:58264/0 (socket says 172.21.15.82:58264) 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490a59c640 1 -- 172.21.15.82:0/2538840989 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026914294 0 0) 0x7f490c0d16b0 con 0x7f490c0d0d10 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 -- 172.21.15.82:0/2538840989 >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 msgr2=0x7f490c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 --2- 172.21.15.82:0/2538840989 >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 0x7f490c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 -- 172.21.15.82:0/2538840989 >> v1:172.21.15.183:6789/0 conn(0x7f490c0d0d10 legacy=0x7f490c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490b59e640 1 -- 172.21.15.82:0/2538840989 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0b2910 con 0x7f490c0ce4c0 2023-07-20T11:24:05.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.793+0000 7f490ad9d640 1 --2- 172.21.15.82:0/2538840989 >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 0x7f490c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:05.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f490b59e640 1 --2- 172.21.15.82:0/2538840989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0d1170 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f490c06a660 tx=0x7f490401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1360ec3435d5ec server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:05.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f490a59c640 1 -- 172.21.15.82:0/2538840989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49040a5780 con 0x7f490c0ce4c0 2023-07-20T11:24:05.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f490a59c640 1 -- 172.21.15.82:0/2538840989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49040a58e0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f490a59c640 1 -- 172.21.15.82:0/2538840989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49040a5c70 con 0x7f490c0ce4c0 2023-07-20T11:24:05.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 -- 172.21.15.82:0/2538840989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 msgr2=0x7f490c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 --2- 172.21.15.82:0/2538840989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0d1170 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f490c06a660 tx=0x7f490401c9a0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 -- 172.21.15.82:0/2538840989 shutdown_connections 2023-07-20T11:24:05.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 --2- 172.21.15.82:0/2538840989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0d1170 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 --2- 172.21.15.82:0/2538840989 >> v2:172.21.15.183:3300/0 conn(0x7f490c15cab0 0x7f490c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 -- 172.21.15.82:0/2538840989 >> 172.21.15.82:0/2538840989 conn(0x7f490c08c120 msgr2=0x7f490c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:05.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 -- 172.21.15.82:0/2538840989 shutdown_connections 2023-07-20T11:24:05.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.797+0000 7f49110bd640 1 -- 172.21.15.82:0/2538840989 wait complete. 2023-07-20T11:24:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 Processor -- start 2023-07-20T11:24:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- start start 2023-07-20T11:24:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 0x7f490c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f490c15cab0 0x7f490c15f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c15fcb0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c15f9d0 con 0x7f490c0d0d10 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0b5450 con 0x7f490c15cab0 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52496/0 (socket says 172.21.15.82:52496) 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 -- 172.21.15.82:0/442520274 learned_addr learned my addr 172.21.15.82:0/442520274 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f4903fff640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 0x7f490c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490b59e640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f490c15cab0 0x7f490c15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:05.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 -- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f490c15cab0 msgr2=0x7f490c15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f490c15cab0 0x7f490c15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 -- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 msgr2=0x7f490c157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 0x7f490c157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 -- 172.21.15.82:0/442520274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc009420 con 0x7f490c0ce4c0 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f4903fff640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 0x7f490c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f490ad9d640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e980 tx=0x7f48fc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00ca00 con 0x7f490c0ce4c0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00cb60 con 0x7f490c0ce4c0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc013470 con 0x7f490c0ce4c0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4904009b30 con 0x7f490c0ce4c0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.801+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c0b5a10 con 0x7f490c0ce4c0 2023-07-20T11:24:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c0b5bd0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f48fc0135d0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f49037fe640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 0x7f48ec068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f4903fff640 1 -- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 msgr2=0x7f48ec068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:05.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f48fc084550 con 0x7f490c0ce4c0 2023-07-20T11:24:05.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.805+0000 7f4903fff640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 0x7f48ec068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:05.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.809+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48fc0514e0 con 0x7f490c0ce4c0 2023-07-20T11:24:05.840 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.845+0000 7ffadcafd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:05.879 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.886+0000 7f8594b17180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:05.949 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:05.954+0000 7f8594b17180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:05.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f490c073c70 con 0x7f490c0ce4c0 2023-07-20T11:24:05.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49037fe640 1 -- 172.21.15.82:0/442520274 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v192) v1 ==== 80+0+469 (secure 0 0 0) 0x7f48fc054b00 con 0x7f490c0ce4c0 2023-07-20T11:24:05.965 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3057939453 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1202706903 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/370784443 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2133506175 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2867668341 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/3370264152 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/3370264152 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.966 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2669450055 2023-07-21T11:22:58.268166+0000 2023-07-20T11:24:05.967 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T11:24:05.967 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:05.973+0000 7ffadcafd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 msgr2=0x7f48ec068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 0x7f48ec068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 msgr2=0x7f490c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f48fc00e980 tx=0x7f48fc00ee40 comp rx=0 tx=0).stop 2023-07-20T11:24:05.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 shutdown_connections 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f490c15cab0 0x7f490c15f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f490c0d0d10 0x7f490c157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f48ec0664c0 0x7f48ec068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 --2- 172.21.15.82:0/442520274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f490c0ce4c0 0x7f490c0b5f30 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 >> 172.21.15.82:0/442520274 conn(0x7f490c08c120 msgr2=0x7f490c06b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 shutdown_connections 2023-07-20T11:24:05.969 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:05.973+0000 7f49110bd640 1 -- 172.21.15.82:0/442520274 wait complete. 2023-07-20T11:24:05.986 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T11:24:05.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:05.987 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:06.041 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:06.049+0000 7ffadcafd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:06.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:24:06.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:06.053 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T11:24:06.063 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:06.063 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:06.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:06.073 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:06.073 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:06.084 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:06.090+0000 7f8594b17180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:06.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:06.113 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:06.113 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:06.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:06.123 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:06.179 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:06.185+0000 7ffadcafd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:06.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.301+0000 7f883886d640 1 Processor -- start 2023-07-20T11:24:06.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.301+0000 7f883886d640 1 -- start start 2023-07-20T11:24:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883886d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883886d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f88340ce4c0 0x7f88340d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883886d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340d16b0 con 0x7f88340d0d10 2023-07-20T11:24:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883886d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340d31c0 con 0x7f88340ce4c0 2023-07-20T11:24:06.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883886d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340b3520 con 0x7f883415cab0 2023-07-20T11:24:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f8832d9d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f88340ce4c0 0x7f88340d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:43390/0 (socket says 172.21.15.82:43390) 2023-07-20T11:24:06.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 -- 172.21.15.82:0/2673689614 learned_addr learned my addr 172.21.15.82:0/2673689614 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 -- 172.21.15.82:0/2673689614 >> v2:172.21.15.183:3300/0 conn(0x7f88340ce4c0 msgr2=0x7f88340d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 --2- 172.21.15.82:0/2673689614 >> v2:172.21.15.183:3300/0 conn(0x7f88340ce4c0 0x7f88340d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 -- 172.21.15.82:0/2673689614 >> v1:172.21.15.183:6789/0 conn(0x7f88340d0d10 legacy=0x7f88340cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.305+0000 7f883259c640 1 -- 172.21.15.82:0/2673689614 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340b2910 con 0x7f883415cab0 2023-07-20T11:24:06.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883259c640 1 --2- 172.21.15.82:0/2673689614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8824009e50 tx=0x7f882401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc04cb40ed68658d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883159a640 1 -- 172.21.15.82:0/2673689614 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240a57c0 con 0x7f883415cab0 2023-07-20T11:24:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883159a640 1 -- 172.21.15.82:0/2673689614 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240a5920 con 0x7f883415cab0 2023-07-20T11:24:06.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883159a640 1 -- 172.21.15.82:0/2673689614 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240a5cb0 con 0x7f883415cab0 2023-07-20T11:24:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 -- 172.21.15.82:0/2673689614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 msgr2=0x7f88340d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 --2- 172.21.15.82:0/2673689614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8824009e50 tx=0x7f882401c9e0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 -- 172.21.15.82:0/2673689614 shutdown_connections 2023-07-20T11:24:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 --2- 172.21.15.82:0/2673689614 >> v2:172.21.15.183:3300/0 conn(0x7f88340ce4c0 0x7f88340d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 --2- 172.21.15.82:0/2673689614 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f883415cab0 0x7f88340d0300 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 -- 172.21.15.82:0/2673689614 >> 172.21.15.82:0/2673689614 conn(0x7f883408c120 msgr2=0x7f883409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 -- 172.21.15.82:0/2673689614 shutdown_connections 2023-07-20T11:24:06.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.309+0000 7f883886d640 1 -- 172.21.15.82:0/2673689614 wait complete. 2023-07-20T11:24:06.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 Processor -- start 2023-07-20T11:24:06.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- start start 2023-07-20T11:24:06.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88340d0d10 0x7f8834157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 0x7f88340d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88340b68d0 con 0x7f883415cab0 2023-07-20T11:24:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88340b6bb0 con 0x7f88340ce4c0 2023-07-20T11:24:06.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340b6e90 con 0x7f88340d0d10 2023-07-20T11:24:06.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8832d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 0x7f88340d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:41100/0 (socket says 172.21.15.82:41100) 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 -- 172.21.15.82:0/1556438979 learned_addr learned my addr 172.21.15.82:0/1556438979 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8831d9b640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88340d0d10 0x7f8834157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 -- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88340d0d10 msgr2=0x7f8834157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88340d0d10 0x7f8834157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 -- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 msgr2=0x7f88340d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 0x7f88340d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 -- 172.21.15.82:0/1556438979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824009b30 con 0x7f88340ce4c0 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8832d9d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 0x7f88340d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883259c640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f882401a610 tx=0x7f8824019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240b8670 con 0x7f88340ce4c0 2023-07-20T11:24:06.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240b87d0 con 0x7f88340ce4c0 2023-07-20T11:24:06.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88240b8b80 con 0x7f88340ce4c0 2023-07-20T11:24:06.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88340b7170 con 0x7f88340ce4c0 2023-07-20T11:24:06.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340c8400 con 0x7f88340ce4c0 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.313+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340b6fd0 con 0x7f88340ce4c0 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.317+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f88240b8ce0 con 0x7f88340ce4c0 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.317+0000 7f8822ffd640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 0x7f8814068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.317+0000 7f8831d9b640 1 -- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 msgr2=0x7f8814068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.317+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f882411f790 con 0x7f88340ce4c0 2023-07-20T11:24:06.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.317+0000 7f8831d9b640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 0x7f8814068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:06.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.321+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88340b6fd0 con 0x7f88340ce4c0 2023-07-20T11:24:06.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.501+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88340b6fd0 con 0x7f88340ce4c0 2023-07-20T11:24:06.495 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.501+0000 7f8822ffd640 1 -- 172.21.15.82:0/1556438979 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f88340b6fd0 con 0x7f88340ce4c0 2023-07-20T11:24:06.496 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:06.496 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:24:06.496 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:24:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 msgr2=0x7f8814068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 0x7f8814068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 msgr2=0x7f88340c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f882401a610 tx=0x7f8824019780 comp rx=0 tx=0).stop 2023-07-20T11:24:06.498 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 shutdown_connections 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f88140664c0 0x7f8814068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f883415cab0 0x7f88340d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f88340d0d10 0x7f8834157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 --2- 172.21.15.82:0/1556438979 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f88340ce4c0 0x7f88340c6260 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 >> 172.21.15.82:0/1556438979 conn(0x7f883408c120 msgr2=0x7f8834159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 shutdown_connections 2023-07-20T11:24:06.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.505+0000 7f883886d640 1 -- 172.21.15.82:0/1556438979 wait complete. 2023-07-20T11:24:06.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:06.626 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:06.634+0000 7f8594b17180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:06.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 Processor -- start 2023-07-20T11:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 -- start start 2023-07-20T11:24:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c15cab0 0x7f2e7c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c0d16b0 con 0x7f2e7c0cf110 2023-07-20T11:24:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0d31c0 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e80f59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0b3520 con 0x7f2e7c15cab0 2023-07-20T11:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52504/0 (socket says 172.21.15.82:52504) 2023-07-20T11:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 -- 172.21.15.82:0/2381594603 learned_addr learned my addr 172.21.15.82:0/2381594603 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e7ad9d640 1 --1- 172.21.15.82:0/2381594603 >> v1:172.21.15.82:6789/0 conn(0x7f2e7c0cf110 0x7f2e7c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54842/0 (socket says 172.21.15.82:54842) 2023-07-20T11:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e7a59c640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c15cab0 0x7f2e7c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 -- 172.21.15.82:0/2381594603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c15cab0 msgr2=0x7f2e7c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c15cab0 0x7f2e7c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 -- 172.21.15.82:0/2381594603 >> v1:172.21.15.82:6789/0 conn(0x7f2e7c0cf110 legacy=0x7f2e7c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.721+0000 7f2e73fff640 1 -- 172.21.15.82:0/2381594603 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0b2910 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.717 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:06.722+0000 7f8594b17180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e73fff640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009870 tx=0x7f2e6401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f76a8f0b0c4115 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e79d9b640 1 -- 172.21.15.82:0/2381594603 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640aa670 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e79d9b640 1 -- 172.21.15.82:0/2381594603 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640aa7d0 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e79d9b640 1 -- 172.21.15.82:0/2381594603 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640aab60 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 -- 172.21.15.82:0/2381594603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c0d0d10 msgr2=0x7f2e7c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009870 tx=0x7f2e6401c510 comp rx=0 tx=0).stop 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 -- 172.21.15.82:0/2381594603 shutdown_connections 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c0d1170 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 --2- 172.21.15.82:0/2381594603 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c15cab0 0x7f2e7c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 -- 172.21.15.82:0/2381594603 >> 172.21.15.82:0/2381594603 conn(0x7f2e7c08c120 msgr2=0x7f2e7c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 -- 172.21.15.82:0/2381594603 shutdown_connections 2023-07-20T11:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.725+0000 7f2e80f59640 1 -- 172.21.15.82:0/2381594603 wait complete. 2023-07-20T11:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 Processor -- start 2023-07-20T11:24:06.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- start start 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c0cf110 0x7f2e7c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c14c630 con 0x7f2e7c15cab0 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c153e10 con 0x7f2e7c0d0d10 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c14c8c0 con 0x7f2e7c0cf110 2023-07-20T11:24:06.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52508/0 (socket says 172.21.15.82:52508) 2023-07-20T11:24:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 -- 172.21.15.82:0/1630568742 learned_addr learned my addr 172.21.15.82:0/1630568742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e73fff640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7a59c640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c0cf110 0x7f2e7c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 -- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c0cf110 msgr2=0x7f2e7c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c0cf110 0x7f2e7c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 -- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e7c0d0d10 msgr2=0x7f2e7c14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 -- 172.21.15.82:0/1630568742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640094d0 con 0x7f2e7c15cab0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e7ad9d640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c700 tx=0x7f2e7400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400ce10 con 0x7f2e7c15cab0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400a640 con 0x7f2e7c15cab0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400a9b0 con 0x7f2e7c15cab0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c14cb60 con 0x7f2e7c15cab0 2023-07-20T11:24:06.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.729+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c14d120 con 0x7f2e7c15cab0 2023-07-20T11:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0ccb40 con 0x7f2e7c15cab0 2023-07-20T11:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f2e7400ab10 con 0x7f2e7c15cab0 2023-07-20T11:24:06.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e72ffd640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 0x7f2e5c0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e7a59c640 1 -- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 msgr2=0x7f2e5c0689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f2e74083b70 con 0x7f2e7c15cab0 2023-07-20T11:24:06.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.733+0000 7f2e7a59c640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 0x7f2e5c0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:06.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.737+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e74050a20 con 0x7f2e7c15cab0 2023-07-20T11:24:06.749 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:06.757+0000 7ffadcafd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:06.834 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:06.841+0000 7ffadcafd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:06.864 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:06.870+0000 7f8594b17180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:06.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.889+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e7c0b2590 con 0x7f2e7c15cab0 2023-07-20T11:24:06.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.889+0000 7f2e72ffd640 1 -- 172.21.15.82:0/1630568742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+19042 (secure 0 0 0) 0x7f2e74054040 con 0x7f2e7c15cab0 2023-07-20T11:24:06.884 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:06.884 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":193,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:06.562512+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":193,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3057939453":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/1202706903":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/370784443":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2133506175":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2867668341":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6832/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2669450055":"2023-07-21T11:22:58.268166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":24,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 msgr2=0x7f2e5c0689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 0x7f2e5c0689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 msgr2=0x7f2e7c151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400c700 tx=0x7f2e7400cbc0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 shutdown_connections 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f2e5c0664f0 0x7f2e5c0689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e7c15cab0 0x7f2e7c151bc0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e7c0d0d10 0x7f2e7c14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 --2- 172.21.15.82:0/1630568742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2e7c0cf110 0x7f2e7c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 >> 172.21.15.82:0/1630568742 conn(0x7f2e7c08c120 msgr2=0x7f2e7c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 shutdown_connections 2023-07-20T11:24:06.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:06.893+0000 7f2e80f59640 1 -- 172.21.15.82:0/1630568742 wait complete. 2023-07-20T11:24:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:22:38.604492+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:22:39.925692+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 193, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:06.906 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:06.947 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:06.954+0000 7f8594b17180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:06.988 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:06.993+0000 7ffadcafd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:07.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 Processor -- start 2023-07-20T11:24:07.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 -- start start 2023-07-20T11:24:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148158ce0 0x7fb1480c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb14806bd30 0x7fb148070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1480c95d0 con 0x7fb148070970 2023-07-20T11:24:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb148071310 con 0x7fb14806bd30 2023-07-20T11:24:07.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb14d5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480c9fa0 con 0x7fb148158ce0 2023-07-20T11:24:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb1477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb14806bd30 0x7fb148070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb1477fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb14806bd30 0x7fb148070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52512/0 (socket says 172.21.15.82:52512) 2023-07-20T11:24:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb1477fe640 1 -- 172.21.15.82:0/392978467 learned_addr learned my addr 172.21.15.82:0/392978467 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:07.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb13ffff640 1 --1- 172.21.15.82:0/392978467 >> v1:172.21.15.183:6789/0 conn(0x7fb148070970 0x7fb14806b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:58278/0 (socket says 172.21.15.82:58278) 2023-07-20T11:24:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.057+0000 7fb146ffd640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148158ce0 0x7fb1480c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1477fe640 1 -- 172.21.15.82:0/392978467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148158ce0 msgr2=0x7fb1480c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1477fe640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148158ce0 0x7fb1480c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1477fe640 1 -- 172.21.15.82:0/392978467 >> v1:172.21.15.183:6789/0 conn(0x7fb148070970 legacy=0x7fb14806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1477fe640 1 -- 172.21.15.82:0/392978467 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1481590c0 con 0x7fb14806bd30 2023-07-20T11:24:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1477fe640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb14806bd30 0x7fb148070dd0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fb140009e50 tx=0x7fb14001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5791d3d56f8edca3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1467fc640 1 -- 172.21.15.82:0/392978467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400a5710 con 0x7fb14806bd30 2023-07-20T11:24:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1467fc640 1 -- 172.21.15.82:0/392978467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1400a5870 con 0x7fb14806bd30 2023-07-20T11:24:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb1467fc640 1 -- 172.21.15.82:0/392978467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400a5c00 con 0x7fb14806bd30 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 -- 172.21.15.82:0/392978467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb14806bd30 msgr2=0x7fb148070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb14806bd30 0x7fb148070dd0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fb140009e50 tx=0x7fb14001c9e0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 -- 172.21.15.82:0/392978467 shutdown_connections 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb14806bd30 0x7fb148070dd0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/392978467 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148158ce0 0x7fb1480c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.061+0000 7fb14d5ba640 1 -- 172.21.15.82:0/392978467 >> 172.21.15.82:0/392978467 conn(0x7fb1480cad50 msgr2=0x7fb1480cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- 172.21.15.82:0/392978467 shutdown_connections 2023-07-20T11:24:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- 172.21.15.82:0/392978467 wait complete. 2023-07-20T11:24:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 Processor -- start 2023-07-20T11:24:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- start start 2023-07-20T11:24:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 0x7fb14814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148070970 0x7fb14815a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14815bb10 con 0x7fb148158ce0 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14814ed30 con 0x7fb14806bd30 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14815af00 con 0x7fb148070970 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52528/0 (socket says 172.21.15.82:52528) 2023-07-20T11:24:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 -- 172.21.15.82:0/644428115 learned_addr learned my addr 172.21.15.82:0/644428115 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb146ffd640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 0x7fb14814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb13ffff640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148070970 0x7fb14815a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 -- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148070970 msgr2=0x7fb14815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148070970 0x7fb14815a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 -- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 msgr2=0x7fb14814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 0x7fb14814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 -- 172.21.15.82:0/644428115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb140009b30 con 0x7fb148158ce0 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb146ffd640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 0x7fb14814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb1477fe640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fb1400af040 tx=0x7fb140019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400b8670 con 0x7fb148158ce0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1400b87f0 con 0x7fb148158ce0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14815b1e0 con 0x7fb148158ce0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.065+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400b8ba0 con 0x7fb148158ce0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14815b7a0 con 0x7fb148158ce0 2023-07-20T11:24:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148158560 con 0x7fb148158ce0 2023-07-20T11:24:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb1400b8d00 con 0x7fb148158ce0 2023-07-20T11:24:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb13f7fe640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 0x7fb128068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb146ffd640 1 -- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 msgr2=0x7fb128068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fb14011f890 con 0x7fb148158ce0 2023-07-20T11:24:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.069+0000 7fb146ffd640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 0x7fb128068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:07.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.077+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1400ec8e0 con 0x7fb148158ce0 2023-07-20T11:24:07.079 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.085+0000 7ffadcafd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:07.217 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:07.222+0000 7f8594b17180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:07.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.229+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb14804da30 con 0x7fb148158ce0 2023-07-20T11:24:07.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.229+0000 7fb13f7fe640 1 -- 172.21.15.82:0/644428115 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb140009510 con 0x7fb148158ce0 2023-07-20T11:24:07.224 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 msgr2=0x7fb128068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 0x7fb128068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 msgr2=0x7fb148165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fb1400af040 tx=0x7fb140019780 comp rx=0 tx=0).stop 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 shutdown_connections 2023-07-20T11:24:07.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7fb1280664c0 0x7fb128068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb148158ce0 0x7fb148165c60 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb148070970 0x7fb14815a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 --2- 172.21.15.82:0/644428115 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb14806bd30 0x7fb14814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 >> 172.21.15.82:0/644428115 conn(0x7fb1480cad50 msgr2=0x7fb1481533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 shutdown_connections 2023-07-20T11:24:07.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.233+0000 7fb14d5ba640 1 -- 172.21.15.82:0/644428115 wait complete. 2023-07-20T11:24:07.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:07.277 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:07.282+0000 7f8594b17180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:07.357 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.365+0000 7ffadcafd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:07.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.393+0000 7f0a11627640 1 Processor -- start 2023-07-20T11:24:07.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 -- start start 2023-07-20T11:24:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f0a0c15a340 0x7f0a0c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0a0c0ce770 0x7f0a0c06ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c160ff0 con 0x7f0a0c06c360 2023-07-20T11:24:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c15a720 con 0x7f0a0c0ce770 2023-07-20T11:24:07.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a11627640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c15dbc0 con 0x7f0a0c15a340 2023-07-20T11:24:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0a7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f0a0c06c360 0x7f0a0c0ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54854/0 (socket says 172.21.15.82:54854) 2023-07-20T11:24:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0a7fc640 1 -- 172.21.15.82:0/1747539796 learned_addr learned my addr 172.21.15.82:0/1747539796 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0b7fe640 1 --2- 172.21.15.82:0/1747539796 >> v2:172.21.15.82:3300/0 conn(0x7f0a0c0ce770 0x7f0a0c06ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0affd640 1 --2- 172.21.15.82:0/1747539796 >> v2:172.21.15.183:3300/0 conn(0x7f0a0c15a340 0x7f0a0c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0b7fe640 1 -- 172.21.15.82:0/1747539796 >> v2:172.21.15.183:3300/0 conn(0x7f0a0c15a340 msgr2=0x7f0a0c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0b7fe640 1 --2- 172.21.15.82:0/1747539796 >> v2:172.21.15.183:3300/0 conn(0x7f0a0c15a340 0x7f0a0c15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0b7fe640 1 -- 172.21.15.82:0/1747539796 >> v1:172.21.15.82:6789/0 conn(0x7f0a0c06c360 legacy=0x7f0a0c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a0b7fe640 1 -- 172.21.15.82:0/1747539796 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c1603e0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.397+0000 7f0a09ffb640 1 -- 172.21.15.82:0/1747539796 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934152560 0 0) 0x7f0a0c160ff0 con 0x7f0a0c06c360 2023-07-20T11:24:07.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a0b7fe640 1 --2- 172.21.15.82:0/1747539796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c06ab70 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0b2110 tx=0x7f0a0401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5537677efbfb45b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a09ffb640 1 -- 172.21.15.82:0/1747539796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a040a59a0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a09ffb640 1 -- 172.21.15.82:0/1747539796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a040a5b00 con 0x7f0a0c0ce770 2023-07-20T11:24:07.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a09ffb640 1 -- 172.21.15.82:0/1747539796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a040a5e90 con 0x7f0a0c0ce770 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 -- 172.21.15.82:0/1747539796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 msgr2=0x7f0a0c06ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 --2- 172.21.15.82:0/1747539796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c06ab70 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0b2110 tx=0x7f0a0401c8e0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 -- 172.21.15.82:0/1747539796 shutdown_connections 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 --2- 172.21.15.82:0/1747539796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c06ab70 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 --2- 172.21.15.82:0/1747539796 >> v2:172.21.15.183:3300/0 conn(0x7f0a0c15a340 0x7f0a0c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 -- 172.21.15.82:0/1747539796 >> 172.21.15.82:0/1747539796 conn(0x7f0a0c065310 msgr2=0x7f0a0c065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 -- 172.21.15.82:0/1747539796 shutdown_connections 2023-07-20T11:24:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 -- 172.21.15.82:0/1747539796 wait complete. 2023-07-20T11:24:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.401+0000 7f0a11627640 1 Processor -- start 2023-07-20T11:24:07.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- start start 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a0c06c360 0x7f0a0c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a0c15a340 0x7f0a0c0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c155df0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0af7a0 con 0x7f0a0c06c360 2023-07-20T11:24:07.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0aec20 con 0x7f0a0c15a340 2023-07-20T11:24:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52540/0 (socket says 172.21.15.82:52540) 2023-07-20T11:24:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 -- 172.21.15.82:0/582274742 learned_addr learned my addr 172.21.15.82:0/582274742 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0affd640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a0c06c360 0x7f0a0c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.399 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0b7fe640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a0c15a340 0x7f0a0c0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 -- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a0c15a340 msgr2=0x7f0a0c0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a0c15a340 0x7f0a0c0ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 -- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a0c06c360 msgr2=0x7f0a0c1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a0c06c360 0x7f0a0c1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 -- 172.21.15.82:0/582274742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009a70 con 0x7f0a0c0ce770 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a0a7fc640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c480 tx=0x7f0a0000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000074e0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00007660 con 0x7f0a0c0ce770 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0aef00 con 0x7f0a0c0ce770 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004a30 con 0x7f0a0c0ce770 2023-07-20T11:24:07.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0af4c0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.405+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c04da30 con 0x7f0a0c0ce770 2023-07-20T11:24:07.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.409+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 117) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f0a00004b90 con 0x7f0a0c0ce770 2023-07-20T11:24:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.409+0000 7f09f37fe640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 0x7f09f8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.409+0000 7f0a0affd640 1 -- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 msgr2=0x7f09f8068980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/2988654347 2023-07-20T11:24:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.409+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f0a00083800 con 0x7f0a0c0ce770 2023-07-20T11:24:07.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.409+0000 7f0a0affd640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 0x7f09f8068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:07.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.413+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a000507c0 con 0x7f0a0c0ce770 2023-07-20T11:24:07.423 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.429+0000 7ffadcafd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:07.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.441+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 118) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0a00050b90 con 0x7f0a0c0ce770 2023-07-20T11:24:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.441+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 msgr2=0x7f09f8068980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:07.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.441+0000 7f09f37fe640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 0x7f09f8068980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.509+0000 7ffa65336640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.509+0000 7ffa65336640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.509+0000 7ffa65336640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.509+0000 7ffa65336640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.504 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.509+0000 7ffa65336640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.513+0000 7ffa68b3d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.513+0000 7ffa68b3d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.505 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.513+0000 7ffa68b3d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.513+0000 7ffa68b3d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.506 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:07.513+0000 7ffa68b3d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.589+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a0c0b2a70 con 0x7f0a0c0ce770 2023-07-20T11:24:07.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.589+0000 7f09f37fe640 1 -- 172.21.15.82:0/582274742 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v194) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a0006cd90 con 0x7f0a0c0ce770 2023-07-20T11:24:07.585 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:07.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 msgr2=0x7f0a0c0ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c480 tx=0x7f0a0000c940 comp rx=0 tx=0).stop 2023-07-20T11:24:07.586 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 shutdown_connections 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0a0c15a340 0x7f0a0c0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:6832/2988654347,v1:172.21.15.82:6833/2988654347] conn(0x7f09f80664c0 0x7f09f8068980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0a0c0ce770 0x7f0a0c0ac080 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 --2- 172.21.15.82:0/582274742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a0c06c360 0x7f0a0c1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 >> 172.21.15.82:0/582274742 conn(0x7f0a0c065310 msgr2=0x7f0a0c1564d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 shutdown_connections 2023-07-20T11:24:07.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.593+0000 7f0a11627640 1 -- 172.21.15.82:0/582274742 wait complete. 2023-07-20T11:24:07.606 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:24:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 Processor -- start 2023-07-20T11:24:07.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 -- start start 2023-07-20T11:24:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbec0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7ffbec0ce5a0 0x7ffbec06ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbec160ff0 con 0x7ffbec15a340 2023-07-20T11:24:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbec15a720 con 0x7ffbec0ce5a0 2023-07-20T11:24:07.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbf126a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0cea10 con 0x7ffbec06c360 2023-07-20T11:24:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ffbec15a340 0x7ffbec15d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54864/0 (socket says 172.21.15.82:54864) 2023-07-20T11:24:07.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3399122263 learned_addr learned my addr 172.21.15.82:0/3399122263 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:07.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbea7fc640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbec0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeb7fe640 1 --2- 172.21.15.82:0/3399122263 >> v2:172.21.15.183:3300/0 conn(0x7ffbec0ce5a0 0x7ffbec06ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013345926 0 0) 0x7ffbec160ff0 con 0x7ffbec15a340 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd4003530 con 0x7ffbec15a340 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698008244 0 0) 0x7ffbd4003530 con 0x7ffbec15a340 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 msgr2=0x7ffbec0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbec0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 >> v2:172.21.15.183:3300/0 conn(0x7ffbec0ce5a0 msgr2=0x7ffbec06ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 --2- 172.21.15.82:0/3399122263 >> v2:172.21.15.183:3300/0 conn(0x7ffbec0ce5a0 0x7ffbec06ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec1603e0 con 0x7ffbec15a340 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7ffbdc001800 con 0x7ffbec15a340 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 >> v1:172.21.15.82:6789/0 conn(0x7ffbec15a340 legacy=0x7ffbec15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbd4003a20 0x7ffbd4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4004d10 0x7ffbd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0cea10 con 0x7ffbd4004d10 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd400b990 con 0x7ffbd4003a20 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd400bb00 con 0x7ffbec06c360 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeb7fe640 1 --2- 172.21.15.82:0/3399122263 >> v2:172.21.15.183:3300/0 conn(0x7ffbec0ce5a0 0x7ffbec06ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbd4003a20 0x7ffbd4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeb7fe640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4004d10 0x7ffbd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbea7fc640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 msgr2=0x7ffbd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec06c360 0x7ffbd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3399122263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4004d10 msgr2=0x7ffbd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4004d10 0x7ffbd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.757+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3399122263 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4003530 con 0x7ffbd4003a20 2023-07-20T11:24:07.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbd4003a20 0x7ffbd4003e40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00c240 tx=0x7ffbdc01cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df13a1e1879cf47 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0a5b20 con 0x7ffbd4003a20 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0a5ca0 con 0x7ffbd4003a20 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbe9ffb640 1 -- 172.21.15.82:0/3399122263 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0072b0 con 0x7ffbd4003a20 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 -- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbd4003a20 msgr2=0x7ffbd4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 --2- 172.21.15.82:0/3399122263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbd4003a20 0x7ffbd4003e40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc00c240 tx=0x7ffbdc01cc20 comp rx=0 tx=0).stop 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbeb7fe640 1 -- 172.21.15.82:0/3399122263 reap_dead start 2023-07-20T11:24:07.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 -- 172.21.15.82:0/3399122263 shutdown_connections 2023-07-20T11:24:07.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 -- 172.21.15.82:0/3399122263 >> 172.21.15.82:0/3399122263 conn(0x7ffbec065310 msgr2=0x7ffbec065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 -- 172.21.15.82:0/3399122263 shutdown_connections 2023-07-20T11:24:07.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.761+0000 7ffbf126a640 1 -- 172.21.15.82:0/3399122263 wait complete. 2023-07-20T11:24:07.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 Processor -- start 2023-07-20T11:24:07.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- start start 2023-07-20T11:24:07.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec0aeb10 0x7ffbec0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 0x7ffbec0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:07.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0af4d0 con 0x7ffbd4003a20 2023-07-20T11:24:07.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0c6790 con 0x7ffbec0c5dd0 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbec0ac510 con 0x7ffbec0aeb10 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52646/0 (socket says 172.21.15.82:52646) 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3108717753 learned_addr learned my addr 172.21.15.82:0/3108717753 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeb7fe640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 0x7ffbec0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbea7fc640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec0aeb10 0x7ffbec0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:07.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec0aeb10 msgr2=0x7ffbec0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec0aeb10 0x7ffbec0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 msgr2=0x7ffbec0c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 0x7ffbec0c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 -- 172.21.15.82:0/3108717753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbec0ac7f0 con 0x7ffbd4003a20 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeb7fe640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 0x7ffbec0c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbeaffd640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc01ca50 tx=0x7ffbd4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:07.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0b4070 con 0x7ffbd4003a20 2023-07-20T11:24:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0a5b30 con 0x7ffbd4003a20 2023-07-20T11:24:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbec0acad0 con 0x7ffbd4003a20 2023-07-20T11:24:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0017c0 con 0x7ffbd4003a20 2023-07-20T11:24:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.765+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbec0ad090 con 0x7ffbd4003a20 2023-07-20T11:24:07.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.769+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbec04da30 con 0x7ffbd4003a20 2023-07-20T11:24:07.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.769+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 118) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ffbdc0057b0 con 0x7ffbd4003a20 2023-07-20T11:24:07.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.769+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7ffbdc11d8b0 con 0x7ffbd4003a20 2023-07-20T11:24:07.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.773+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbdc0ead10 con 0x7ffbd4003a20 2023-07-20T11:24:07.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffbec15da40 con 0x7ffbd4003a20 2023-07-20T11:24:07.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbd37fe640 1 -- 172.21.15.82:0/3108717753 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffbdc0bf020 con 0x7ffbd4003a20 2023-07-20T11:24:07.915 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:24:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 msgr2=0x7ffbec1f18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc01ca50 tx=0x7ffbd4005800 comp rx=0 tx=0).stop 2023-07-20T11:24:07.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 shutdown_connections 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbec0c5dd0 0x7ffbec0c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ffbec0aeb10 0x7ffbec0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 --2- 172.21.15.82:0/3108717753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffbd4003a20 0x7ffbec1f18e0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 >> 172.21.15.82:0/3108717753 conn(0x7ffbec065310 msgr2=0x7ffbec0b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 shutdown_connections 2023-07-20T11:24:07.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:07.921+0000 7ffbf126a640 1 -- 172.21.15.82:0/3108717753 wait complete. 2023-07-20T11:24:07.935 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:24:08.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.081+0000 7f11762e5640 1 Processor -- start 2023-07-20T11:24:08.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.081+0000 7f11762e5640 1 -- start start 2023-07-20T11:24:08.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f11762e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1170159450 0x7f117015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f11762e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159830 0x7f11700cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f11762e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700cc8d0 con 0x7f11700cc3e0 2023-07-20T11:24:08.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f11762e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cce90 con 0x7f1170159450 2023-07-20T11:24:08.078 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f11762e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700ccbb0 con 0x7f1170159830 2023-07-20T11:24:08.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f1174882640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f11700cc3e0 0x7f11700afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54876/0 (socket says 172.21.15.82:54876) 2023-07-20T11:24:08.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f1174882640 1 -- 172.21.15.82:0/3931407438 learned_addr learned my addr 172.21.15.82:0/3931407438 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:08.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116ffff640 1 --2- 172.21.15.82:0/3931407438 >> v2:172.21.15.183:3300/0 conn(0x7f1170159450 0x7f117015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116f7fe640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159830 0x7f11700cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224130366 0 0) 0x7f11700cc8d0 con 0x7f11700cc3e0 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1158003530 con 0x7f11700cc3e0 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116ffff640 1 -- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159830 msgr2=0x7f11700cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503038439 0 0) 0x7f1158003530 con 0x7f11700cc3e0 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116ffff640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159830 0x7f11700cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116ffff640 1 -- 172.21.15.82:0/3931407438 >> v1:172.21.15.82:6789/0 conn(0x7f11700cc3e0 legacy=0x7f11700afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.080 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.085+0000 7f116ffff640 1 -- 172.21.15.82:0/3931407438 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1170159cc0 con 0x7f1170159450 2023-07-20T11:24:08.081 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f116ffff640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1170159450 0x7f117015a4c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f116000ba60 tx=0x7f116001ea40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c12f204b75290d53 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168001a20 con 0x7f1170159450 2023-07-20T11:24:08.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11600a7830 con 0x7f1170159450 2023-07-20T11:24:08.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f116effd640 1 -- 172.21.15.82:0/3931407438 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11600a7bc0 con 0x7f1170159450 2023-07-20T11:24:08.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1170159450 msgr2=0x7f117015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.082 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1170159450 0x7f117015a4c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f116000ba60 tx=0x7f116001ea40 comp rx=0 tx=0).stop 2023-07-20T11:24:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- 172.21.15.82:0/3931407438 shutdown_connections 2023-07-20T11:24:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159830 0x7f11700cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.083 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 --2- 172.21.15.82:0/3931407438 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1170159450 0x7f117015a4c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- 172.21.15.82:0/3931407438 >> 172.21.15.82:0/3931407438 conn(0x7f11700cad50 msgr2=0x7f11700cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- 172.21.15.82:0/3931407438 shutdown_connections 2023-07-20T11:24:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- 172.21.15.82:0/3931407438 wait complete. 2023-07-20T11:24:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 Processor -- start 2023-07-20T11:24:08.084 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.089+0000 7f11762e5640 1 -- start start 2023-07-20T11:24:08.085 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11700cc3e0 0x7f11701f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159450 0x7f11701552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170155830 con 0x7f1170162580 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11701638a0 con 0x7f11700cc3e0 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700c83e0 con 0x7f1170159450 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52650/0 (socket says 172.21.15.82:52650) 2023-07-20T11:24:08.086 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 -- 172.21.15.82:0/3484885033 learned_addr learned my addr 172.21.15.82:0/3484885033 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f116ffff640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11700cc3e0 0x7f11701f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.087 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f116f7fe640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159450 0x7f11701552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 -- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159450 msgr2=0x7f11701552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159450 0x7f11701552f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 -- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11700cc3e0 msgr2=0x7f11701f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11700cc3e0 0x7f11701f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 -- 172.21.15.82:0/3484885033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116000b6c0 con 0x7f1170162580 2023-07-20T11:24:08.088 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f1174882640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f116800caa0 tx=0x7f116800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800a6d0 con 0x7f1170162580 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800a830 con 0x7f1170162580 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800abe0 con 0x7f1170162580 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11700c1e00 con 0x7f1170162580 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170163000 con 0x7f1170162580 2023-07-20T11:24:08.089 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.093+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117004da30 con 0x7f1170162580 2023-07-20T11:24:08.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.097+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 118) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f116800ad40 con 0x7f1170162580 2023-07-20T11:24:08.090 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.097+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f11680831e0 con 0x7f1170162580 2023-07-20T11:24:08.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.101+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11680506d0 con 0x7f1170162580 2023-07-20T11:24:08.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11700cbbf0 con 0x7f1170162580 2023-07-20T11:24:08.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f116cff9640 1 -- 172.21.15.82:0/3484885033 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1168053cf0 con 0x7f1170162580 2023-07-20T11:24:08.242 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 msgr2=0x7f117006b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f116800caa0 tx=0x7f116800cf60 comp rx=0 tx=0).stop 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 shutdown_connections 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1170162580 0x7f117006b620 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1170159450 0x7f11701552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 --2- 172.21.15.82:0/3484885033 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11700cc3e0 0x7f11701f8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 >> 172.21.15.82:0/3484885033 conn(0x7f11700cad50 msgr2=0x7f1170071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 shutdown_connections 2023-07-20T11:24:08.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.249+0000 7f11762e5640 1 -- 172.21.15.82:0/3484885033 wait complete. 2023-07-20T11:24:08.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 Processor -- start 2023-07-20T11:24:08.401 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 -- start start 2023-07-20T11:24:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 0x7f31f40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f31f40cd730 0x7f31f40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40cf880 con 0x7f31f415c590 2023-07-20T11:24:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40cd2a0 con 0x7f31f40cd730 2023-07-20T11:24:08.402 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f96bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b4f50 con 0x7f31f40d0d00 2023-07-20T11:24:08.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f2ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f31f415c590 0x7f31f40b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54888/0 (socket says 172.21.15.82:54888) 2023-07-20T11:24:08.403 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f2ffd640 1 -- 172.21.15.82:0/3880902682 learned_addr learned my addr 172.21.15.82:0/3880902682 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f27fc640 1 --2- 172.21.15.82:0/3880902682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 0x7f31f40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f37fe640 1 --2- 172.21.15.82:0/3880902682 >> v2:172.21.15.183:3300/0 conn(0x7f31f40cd730 0x7f31f40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f1ffb640 1 -- 172.21.15.82:0/3880902682 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313146791 0 0) 0x7f31f40cf880 con 0x7f31f415c590 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f1ffb640 1 -- 172.21.15.82:0/3880902682 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31dc003530 con 0x7f31f415c590 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f27fc640 1 -- 172.21.15.82:0/3880902682 >> v2:172.21.15.183:3300/0 conn(0x7f31f40cd730 msgr2=0x7f31f40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f27fc640 1 --2- 172.21.15.82:0/3880902682 >> v2:172.21.15.183:3300/0 conn(0x7f31f40cd730 0x7f31f40cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.404 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f27fc640 1 -- 172.21.15.82:0/3880902682 >> v1:172.21.15.82:6789/0 conn(0x7f31f415c590 legacy=0x7f31f40b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.405 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.409+0000 7f31f27fc640 1 -- 172.21.15.82:0/3880902682 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f40cfab0 con 0x7f31f40d0d00 2023-07-20T11:24:08.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f27fc640 1 --2- 172.21.15.82:0/3880902682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 0x7f31f40cf340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f31e80097c0 tx=0x7f31e801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594dba7216e19d27 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f1ffb640 1 -- 172.21.15.82:0/3880902682 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80ac620 con 0x7f31f40d0d00 2023-07-20T11:24:08.406 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f1ffb640 1 -- 172.21.15.82:0/3880902682 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80ac780 con 0x7f31f40d0d00 2023-07-20T11:24:08.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f1ffb640 1 -- 172.21.15.82:0/3880902682 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80acb10 con 0x7f31f40d0d00 2023-07-20T11:24:08.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 -- 172.21.15.82:0/3880902682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 msgr2=0x7f31f40cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.407 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 --2- 172.21.15.82:0/3880902682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 0x7f31f40cf340 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f31e80097c0 tx=0x7f31e801c3c0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 -- 172.21.15.82:0/3880902682 shutdown_connections 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 --2- 172.21.15.82:0/3880902682 >> v2:172.21.15.183:3300/0 conn(0x7f31f40cd730 0x7f31f40cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 --2- 172.21.15.82:0/3880902682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40d0d00 0x7f31f40cf340 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 -- 172.21.15.82:0/3880902682 >> 172.21.15.82:0/3880902682 conn(0x7f31f40654e0 msgr2=0x7f31f40658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 -- 172.21.15.82:0/3880902682 shutdown_connections 2023-07-20T11:24:08.408 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.413+0000 7f31f96bd640 1 -- 172.21.15.82:0/3880902682 wait complete. 2023-07-20T11:24:08.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 Processor -- start 2023-07-20T11:24:08.409 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- start start 2023-07-20T11:24:08.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40cd730 0x7f31f415f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31f40d0d00 0x7f31f40c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.410 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f415eee0 con 0x7f31f415c590 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40caa70 con 0x7f31f40d0d00 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f415f370 con 0x7f31f40cd730 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52654/0 (socket says 172.21.15.82:52654) 2023-07-20T11:24:08.411 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 -- 172.21.15.82:0/1855646994 learned_addr learned my addr 172.21.15.82:0/1855646994 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:08.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 -- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40cd730 msgr2=0x7f31f415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.412 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40cd730 0x7f31f415f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 -- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31f40d0d00 msgr2=0x7f31f40c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31f40d0d00 0x7f31f40c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 -- 172.21.15.82:0/1855646994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8009420 con 0x7f31f415c590 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f37fe640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00efc0 tx=0x7f31ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec014480 con 0x7f31f415c590 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00f040 con 0x7f31f415c590 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec014820 con 0x7f31f415c590 2023-07-20T11:24:08.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f415e5b0 con 0x7f31f415c590 2023-07-20T11:24:08.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.417+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f415eb70 con 0x7f31f415c590 2023-07-20T11:24:08.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.421+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f404da30 con 0x7f31f415c590 2023-07-20T11:24:08.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.421+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 118) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f31ec014980 con 0x7f31f415c590 2023-07-20T11:24:08.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.421+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f31ec0847f0 con 0x7f31f415c590 2023-07-20T11:24:08.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.425+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31ec051c30 con 0x7f31f415c590 2023-07-20T11:24:08.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.461+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 119) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f31ec0516e0 con 0x7f31f415c590 2023-07-20T11:24:08.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.461+0000 7f31db7fe640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 0x7f31e006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.465+0000 7f31f2ffd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 0x7f31e006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.465+0000 7f31f2ffd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 0x7f31e006e6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4007940 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.613+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31f415f020 con 0x7f31f415c590 2023-07-20T11:24:08.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31db7fe640 1 -- 172.21.15.82:0/1855646994 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f31ec081d50 con 0x7f31f415c590 2023-07-20T11:24:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:08.610 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:24:08.610 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:24:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 msgr2=0x7f31e006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 0x7f31e006e6e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f31e4007fd0 tx=0x7f31e4007940 comp rx=0 tx=0).stop 2023-07-20T11:24:08.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 msgr2=0x7f31f40ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00efc0 tx=0x7f31ec00c490 comp rx=0 tx=0).stop 2023-07-20T11:24:08.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 shutdown_connections 2023-07-20T11:24:08.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f31e006c2f0 0x7f31e006e6e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31f415c590 0x7f31f40ca530 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31f40d0d00 0x7f31f40c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 --2- 172.21.15.82:0/1855646994 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f31f40cd730 0x7f31f415f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 >> 172.21.15.82:0/1855646994 conn(0x7f31f40654e0 msgr2=0x7f31f40b76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 shutdown_connections 2023-07-20T11:24:08.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.617+0000 7f31f96bd640 1 -- 172.21.15.82:0/1855646994 wait complete. 2023-07-20T11:24:08.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:08.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.773+0000 7f74cfbba640 1 Processor -- start 2023-07-20T11:24:08.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 -- start start 2023-07-20T11:24:08.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c81596b0 0x7f74c815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c80cc900 0x7f74c80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 0x7f74c80b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80b2d50 con 0x7f74c80cc900 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80ad600 con 0x7f74c80b2380 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cfbba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80ccd60 con 0x7f74c81596b0 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c80cc900 0x7f74c80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f74c80cc900 0x7f74c80ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52660/0 (socket says 172.21.15.82:52660) 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 -- 172.21.15.82:0/4107681673 learned_addr learned my addr 172.21.15.82:0/4107681673 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:08.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd956640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c81596b0 0x7f74c815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74ce157640 1 --2- 172.21.15.82:0/4107681673 >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 0x7f74c80b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 -- 172.21.15.82:0/4107681673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c81596b0 msgr2=0x7f74c815dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:08.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c81596b0 0x7f74c815dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 -- 172.21.15.82:0/4107681673 >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 msgr2=0x7f74c80b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 --2- 172.21.15.82:0/4107681673 >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 0x7f74c80b2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74cd155640 1 -- 172.21.15.82:0/4107681673 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80ad810 con 0x7f74c80cc900 2023-07-20T11:24:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.777+0000 7f74ce157640 1 --2- 172.21.15.82:0/4107681673 >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 0x7f74c80b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:08.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cd155640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80cc900 0x7f74c80ad0c0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f74c80b0e20 tx=0x7f74b801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd846e98ace364e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cc954640 1 -- 172.21.15.82:0/4107681673 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80aa5f0 con 0x7f74c80cc900 2023-07-20T11:24:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cc954640 1 -- 172.21.15.82:0/4107681673 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80aa750 con 0x7f74c80cc900 2023-07-20T11:24:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cc954640 1 -- 172.21.15.82:0/4107681673 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80aaae0 con 0x7f74c80cc900 2023-07-20T11:24:08.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- 172.21.15.82:0/4107681673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80cc900 msgr2=0x7f74c80ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80cc900 0x7f74c80ad0c0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7f74c80b0e20 tx=0x7f74b801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- 172.21.15.82:0/4107681673 shutdown_connections 2023-07-20T11:24:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 --2- 172.21.15.82:0/4107681673 >> v2:172.21.15.183:3300/0 conn(0x7f74c80b2380 0x7f74c80b2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80cc900 0x7f74c80ad0c0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 --2- 172.21.15.82:0/4107681673 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c81596b0 0x7f74c815dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- 172.21.15.82:0/4107681673 >> 172.21.15.82:0/4107681673 conn(0x7f74c80cada0 msgr2=0x7f74c80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- 172.21.15.82:0/4107681673 shutdown_connections 2023-07-20T11:24:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- 172.21.15.82:0/4107681673 wait complete. 2023-07-20T11:24:08.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 Processor -- start 2023-07-20T11:24:08.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.781+0000 7f74cfbba640 1 -- start start 2023-07-20T11:24:08.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c80cc900 0x7f74c80c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 0x7f74c80abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c5c20 con 0x7f74c80b2380 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c5f00 con 0x7f74c81596b0 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80c61e0 con 0x7f74c80cc900 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52664/0 (socket says 172.21.15.82:52664) 2023-07-20T11:24:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 -- 172.21.15.82:0/3209426654 learned_addr learned my addr 172.21.15.82:0/3209426654 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd155640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c80cc900 0x7f74c80c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74ce157640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 0x7f74c80abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 -- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c80cc900 msgr2=0x7f74c80c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c80cc900 0x7f74c80c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 -- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 msgr2=0x7f74c80abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 0x7f74c80abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 -- 172.21.15.82:0/3209426654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094d0 con 0x7f74c80b2380 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74ce157640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 0x7f74c80abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cd956640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f74c400d5f0 tx=0x7f74c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c40125f0 con 0x7f74c80b2380 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c4012750 con 0x7f74c80b2380 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4012ae0 con 0x7f74c80b2380 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c80c64c0 con 0x7f74c80b2380 2023-07-20T11:24:08.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80c5930 con 0x7f74c80b2380 2023-07-20T11:24:08.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.785+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c8073c70 con 0x7f74c80b2380 2023-07-20T11:24:08.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.789+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 119) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f74c4012c40 con 0x7f74c80b2380 2023-07-20T11:24:08.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.789+0000 7f74be7fc640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 0x7f74ac068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:08.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.789+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f74c4084200 con 0x7f74c80b2380 2023-07-20T11:24:08.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.789+0000 7f74cd155640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 0x7f74ac068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:08.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.789+0000 7f74cd155640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 0x7f74ac068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ae000 tx=0x7f74b80b5040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:08.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.793+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74c4051550 con 0x7f74c80b2380 2023-07-20T11:24:08.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.941+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74c80b3100 con 0x7f74c80b2380 2023-07-20T11:24:08.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74be7fc640 1 -- 172.21.15.82:0/3209426654 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+19642 (secure 0 0 0) 0x7f74c4007380 con 0x7f74c80b2380 2023-07-20T11:24:08.937 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:08.937 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":194,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:07.436058+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":194,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1787912929":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/4190869568":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2588640047":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1036783379":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1897798858":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/723030784":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/3057939453":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/1202706903":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2311853827":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/370784443":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2133506175":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/43459402":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2867668341":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2669450055":"2023-07-21T11:22:58.268166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:08.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 msgr2=0x7f74ac068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 0x7f74ac068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ae000 tx=0x7f74b80b5040 comp rx=0 tx=0).stop 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 msgr2=0x7f74c80c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f74c400d5f0 tx=0x7f74c400dab0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 shutdown_connections 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f74ac0660d0 0x7f74ac068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74c81596b0 0x7f74c80abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f74c80cc900 0x7f74c80c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 --2- 172.21.15.82:0/3209426654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74c80b2380 0x7f74c80c53f0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 >> 172.21.15.82:0/3209426654 conn(0x7f74c80cada0 msgr2=0x7f74c80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 shutdown_connections 2023-07-20T11:24:08.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:08.945+0000 7f74cfbba640 1 -- 172.21.15.82:0/3209426654 wait complete. 2023-07-20T11:24:08.957 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:24:08.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:09.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 Processor -- start 2023-07-20T11:24:09.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 -- start start 2023-07-20T11:24:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f70380ceb70 0x7f70380b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380b7c20 con 0x7f70380ccfb0 2023-07-20T11:24:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703815c9d0 con 0x7f703815c5f0 2023-07-20T11:24:09.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703d0a1640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70380b4980 con 0x7f70380ceb70 2023-07-20T11:24:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f70377fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f70380ccfb0 0x7f70380ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54890/0 (socket says 172.21.15.82:54890) 2023-07-20T11:24:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f70377fe640 1 -- 172.21.15.82:0/613972952 learned_addr learned my addr 172.21.15.82:0/613972952 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703c8a0640 1 --2- 172.21.15.82:0/613972952 >> v2:172.21.15.82:3300/0 conn(0x7f70380ceb70 0x7f70380b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703c8a0640 1 -- 172.21.15.82:0/613972952 >> v1:172.21.15.183:6789/0 conn(0x7f703815c5f0 legacy=0x7f70380b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703c8a0640 1 -- 172.21.15.82:0/613972952 >> v1:172.21.15.82:6789/0 conn(0x7f70380ccfb0 legacy=0x7f70380ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.105+0000 7f703c8a0640 1 -- 172.21.15.82:0/613972952 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380ce030 con 0x7f70380ceb70 2023-07-20T11:24:09.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703c8a0640 1 --2- 172.21.15.82:0/613972952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ceb70 0x7f70380b0f70 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f7030009d90 tx=0x7f703001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8b18efc1fad604 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f7036ffd640 1 -- 172.21.15.82:0/613972952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300af600 con 0x7f70380ceb70 2023-07-20T11:24:09.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f7036ffd640 1 -- 172.21.15.82:0/613972952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300ab050 con 0x7f70380ceb70 2023-07-20T11:24:09.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f7036ffd640 1 -- 172.21.15.82:0/613972952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300af980 con 0x7f70380ceb70 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- 172.21.15.82:0/613972952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ceb70 msgr2=0x7f70380b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 --2- 172.21.15.82:0/613972952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ceb70 0x7f70380b0f70 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f7030009d90 tx=0x7f703001f130 comp rx=0 tx=0).stop 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- 172.21.15.82:0/613972952 shutdown_connections 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 --2- 172.21.15.82:0/613972952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ceb70 0x7f70380b0f70 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- 172.21.15.82:0/613972952 >> 172.21.15.82:0/613972952 conn(0x7f7038065710 msgr2=0x7f7038065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:09.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- 172.21.15.82:0/613972952 shutdown_connections 2023-07-20T11:24:09.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- 172.21.15.82:0/613972952 wait complete. 2023-07-20T11:24:09.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 Processor -- start 2023-07-20T11:24:09.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.109+0000 7f703d0a1640 1 -- start start 2023-07-20T11:24:09.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 0x7f703814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 0x7f703814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703814a620 con 0x7f70380ccfb0 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380aa5c0 con 0x7f70380ceb70 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380aa8a0 con 0x7f703815c5f0 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52674/0 (socket says 172.21.15.82:52674) 2023-07-20T11:24:09.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 -- 172.21.15.82:0/1415068143 learned_addr learned my addr 172.21.15.82:0/1415068143 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:09.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703c8a0640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 0x7f703814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f70377fe640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 0x7f703814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 -- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 msgr2=0x7f703814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 0x7f703814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 -- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 msgr2=0x7f703814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 0x7f703814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 -- 172.21.15.82:0/1415068143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009a70 con 0x7f70380ccfb0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703c8a0640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 0x7f703814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f70377fe640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 0x7f703814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7037fff640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f702800c3c0 tx=0x7f702800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280052d0 con 0x7f70380ccfb0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028005430 con 0x7f70380ccfb0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703814a8c0 con 0x7f70380ccfb0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028003840 con 0x7f70380ccfb0 2023-07-20T11:24:09.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70380a9900 con 0x7f70380ccfb0 2023-07-20T11:24:09.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.113+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703804da30 con 0x7f70380ccfb0 2023-07-20T11:24:09.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.117+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 119) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f70280039a0 con 0x7f70380ccfb0 2023-07-20T11:24:09.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.117+0000 7f7034ff9640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 0x7f7024068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.117+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f7028083140 con 0x7f70380ccfb0 2023-07-20T11:24:09.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.117+0000 7f70377fe640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 0x7f7024068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.117+0000 7f70377fe640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 0x7f7024068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f70380d2df0 tx=0x7f702c009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.121+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7028050490 con 0x7f70380ccfb0 2023-07-20T11:24:09.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.296+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f703815c9d0 con 0x7f70380ccfb0 2023-07-20T11:24:09.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.296+0000 7f7034ff9640 1 -- 172.21.15.82:0/1415068143 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f703815c9d0 con 0x7f70380ccfb0 2023-07-20T11:24:09.293 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:09.293 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:24:09.294 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:24:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 msgr2=0x7f7024068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 0x7f7024068590 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f70380d2df0 tx=0x7f702c009040 comp rx=0 tx=0).stop 2023-07-20T11:24:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 msgr2=0x7f7038149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f702800c3c0 tx=0x7f702800c880 comp rx=0 tx=0).stop 2023-07-20T11:24:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 shutdown_connections 2023-07-20T11:24:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f70240660d0 0x7f7024068590 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f703815c5f0 0x7f703814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f70380ceb70 0x7f703814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 --2- 172.21.15.82:0/1415068143 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70380ccfb0 0x7f7038149f60 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 >> 172.21.15.82:0/1415068143 conn(0x7f7038065710 msgr2=0x7f70380cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 shutdown_connections 2023-07-20T11:24:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.300+0000 7f703d0a1640 1 -- 172.21.15.82:0/1415068143 wait complete. 2023-07-20T11:24:09.314 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:09.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.456+0000 7faf13796640 1 Processor -- start 2023-07-20T11:24:09.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 -- start start 2023-07-20T11:24:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7faf0c15cab0 0x7faf0c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf0c0d0d10 0x7faf0c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0cf110 0x7faf0c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0d31c0 con 0x7faf0c0d0d10 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0d16b0 con 0x7faf0c15cab0 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf13796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0b3520 con 0x7faf0c0cf110 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf0c0d0d10 0x7faf0c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7faf0c0d0d10 0x7faf0c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52684/0 (socket says 172.21.15.82:52684) 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 -- 172.21.15.82:0/732308874 learned_addr learned my addr 172.21.15.82:0/732308874 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf11d33640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0cf110 0x7faf0c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf11532640 1 --2- 172.21.15.82:0/732308874 >> v2:172.21.15.183:3300/0 conn(0x7faf0c15cab0 0x7faf0c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 -- 172.21.15.82:0/732308874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0cf110 msgr2=0x7faf0c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0cf110 0x7faf0c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 -- 172.21.15.82:0/732308874 >> v2:172.21.15.183:3300/0 conn(0x7faf0c15cab0 msgr2=0x7faf0c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:09.456 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 --2- 172.21.15.82:0/732308874 >> v2:172.21.15.183:3300/0 conn(0x7faf0c15cab0 0x7faf0c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.460+0000 7faf10d31640 1 -- 172.21.15.82:0/732308874 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0b2910 con 0x7faf0c0d0d10 2023-07-20T11:24:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf10d31640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0d0d10 0x7faf0c0d1170 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7faf0c06a660 tx=0x7faefc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b07c06b87b5616c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf03fff640 1 -- 172.21.15.82:0/732308874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0aa5f0 con 0x7faf0c0d0d10 2023-07-20T11:24:09.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf03fff640 1 -- 172.21.15.82:0/732308874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc0aa750 con 0x7faf0c0d0d10 2023-07-20T11:24:09.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf03fff640 1 -- 172.21.15.82:0/732308874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0aaae0 con 0x7faf0c0d0d10 2023-07-20T11:24:09.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- 172.21.15.82:0/732308874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0d0d10 msgr2=0x7faf0c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0d0d10 0x7faf0c0d1170 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7faf0c06a660 tx=0x7faefc01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- 172.21.15.82:0/732308874 shutdown_connections 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0cf110 0x7faf0c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 --2- 172.21.15.82:0/732308874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0d0d10 0x7faf0c0d1170 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 --2- 172.21.15.82:0/732308874 >> v2:172.21.15.183:3300/0 conn(0x7faf0c15cab0 0x7faf0c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- 172.21.15.82:0/732308874 >> 172.21.15.82:0/732308874 conn(0x7faf0c08c120 msgr2=0x7faf0c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:09.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- 172.21.15.82:0/732308874 shutdown_connections 2023-07-20T11:24:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- 172.21.15.82:0/732308874 wait complete. 2023-07-20T11:24:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 Processor -- start 2023-07-20T11:24:09.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.464+0000 7faf13796640 1 -- start start 2023-07-20T11:24:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0d0d10 0x7faf0c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf0c15cab0 0x7faf0c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1531b0 con 0x7faf0c0cf110 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c90d0 con 0x7faf0c15cab0 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0c6300 con 0x7faf0c0d0d10 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52694/0 (socket says 172.21.15.82:52694) 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 -- 172.21.15.82:0/1851523470 learned_addr learned my addr 172.21.15.82:0/1851523470 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:09.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf10d31640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0d0d10 0x7faf0c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11d33640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf0c15cab0 0x7faf0c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 -- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0d0d10 msgr2=0x7faf0c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0d0d10 0x7faf0c15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 -- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf0c15cab0 msgr2=0x7faf0c15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf0c15cab0 0x7faf0c15b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 -- 172.21.15.82:0/1851523470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0094d0 con 0x7faf0c0cf110 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf11532640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7faf0800d5f0 tx=0x7faf0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf080125f0 con 0x7faf0c0cf110 2023-07-20T11:24:09.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf08012750 con 0x7faf0c0cf110 2023-07-20T11:24:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08012ae0 con 0x7faf0c0cf110 2023-07-20T11:24:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c153400 con 0x7faf0c0cf110 2023-07-20T11:24:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c1539c0 con 0x7faf0c0cf110 2023-07-20T11:24:09.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c073c70 con 0x7faf0c0cf110 2023-07-20T11:24:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.468+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 119) v1 ==== 85496+0+0 (secure 0 0 0) 0x7faf08012c40 con 0x7faf0c0cf110 2023-07-20T11:24:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.472+0000 7faf01ffb640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 0x7faef0068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.472+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7faf08084200 con 0x7faf0c0cf110 2023-07-20T11:24:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.472+0000 7faf10d31640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 0x7faef0068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.472+0000 7faf10d31640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 0x7faef0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0b5040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.476+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf08051550 con 0x7faf0c0cf110 2023-07-20T11:24:09.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.576+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 120) v1 ==== 85704+0+0 (secure 0 0 0) 0x7faf08051920 con 0x7faf0c0cf110 2023-07-20T11:24:09.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.676+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf0c069750 con 0x7faf0c0cf110 2023-07-20T11:24:09.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.676+0000 7faf01ffb640 1 -- 172.21.15.82:0/1851523470 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4685 (secure 0 0 0) 0x7faf0806d3d0 con 0x7faf0c0cf110 2023-07-20T11:24:09.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:09.672 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":90,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:22:40.920311+0000","modified":"2023-07-20T11:22:44.552107+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10848},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10848":{"gid":10848,"name":"c","rank":0,"incarnation":87,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2112812195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2112812195},{"type":"v1","addr":"172.21.15.82:6837","nonce":2112812195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-20T11:24:09.673 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 90 2023-07-20T11:24:09.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 msgr2=0x7faef0068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 0x7faef0068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faefc0ae000 tx=0x7faefc0b5040 comp rx=0 tx=0).stop 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 msgr2=0x7faf0c0c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7faf0800d5f0 tx=0x7faf0800dab0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 shutdown_connections 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7faef00660d0 0x7faef0068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf0c15cab0 0x7faf0c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7faf0c0d0d10 0x7faf0c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 --2- 172.21.15.82:0/1851523470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf0c0cf110 0x7faf0c0c8b90 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 >> 172.21.15.82:0/1851523470 conn(0x7faf0c08c120 msgr2=0x7faf0c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 shutdown_connections 2023-07-20T11:24:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.680+0000 7faf13796640 1 -- 172.21.15.82:0/1851523470 wait complete. 2023-07-20T11:24:09.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.836+0000 7fc66272c640 1 Processor -- start 2023-07-20T11:24:09.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.836+0000 7fc66272c640 1 -- start start 2023-07-20T11:24:09.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc66272c640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc65c160fa0 0x7fc65c0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc66272c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c0cd830 0x7fc65c0c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc66272c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c0cc560 con 0x7fc65c160bc0 2023-07-20T11:24:09.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc66272c640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0ad7e0 con 0x7fc65c160fa0 2023-07-20T11:24:09.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc66272c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0cc790 con 0x7fc65c0cd830 2023-07-20T11:24:09.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc65c160fa0 0x7fc65c0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc65c160fa0 0x7fc65c0c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:41364/0 (socket says 172.21.15.82:41364) 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2097397886 learned_addr learned my addr 172.21.15.82:0/2097397886 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65bfff640 1 --1- 172.21.15.82:0/2097397886 >> v1:172.21.15.183:6789/0 conn(0x7fc65c160bc0 0x7fc65c06c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:58300/0 (socket says 172.21.15.82:58300) 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc660cc9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c0cd830 0x7fc65c0c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c0cd830 msgr2=0x7fc65c0c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 --2- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c0cd830 0x7fc65c0c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2097397886 >> v1:172.21.15.183:6789/0 conn(0x7fc65c160bc0 legacy=0x7fc65c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.840+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2097397886 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0cca70 con 0x7fc65c160fa0 2023-07-20T11:24:09.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc65b7fe640 1 --2- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c160fa0 0x7fc65c0c12f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc650009870 tx=0x7fc65001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54658508586ffd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc65affd640 1 -- 172.21.15.82:0/2097397886 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500aa670 con 0x7fc65c160fa0 2023-07-20T11:24:09.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc65affd640 1 -- 172.21.15.82:0/2097397886 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6500aa7d0 con 0x7fc65c160fa0 2023-07-20T11:24:09.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc65affd640 1 -- 172.21.15.82:0/2097397886 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500aab60 con 0x7fc65c160fa0 2023-07-20T11:24:09.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c160fa0 msgr2=0x7fc65c0c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 --2- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c160fa0 0x7fc65c0c12f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fc650009870 tx=0x7fc65001c510 comp rx=0 tx=0).stop 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- 172.21.15.82:0/2097397886 shutdown_connections 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 --2- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c0cd830 0x7fc65c0c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 --2- 172.21.15.82:0/2097397886 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c160fa0 0x7fc65c0c12f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- 172.21.15.82:0/2097397886 >> 172.21.15.82:0/2097397886 conn(0x7fc65c0cada0 msgr2=0x7fc65c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- 172.21.15.82:0/2097397886 shutdown_connections 2023-07-20T11:24:09.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- 172.21.15.82:0/2097397886 wait complete. 2023-07-20T11:24:09.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 Processor -- start 2023-07-20T11:24:09.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.844+0000 7fc66272c640 1 -- start start 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c0cd830 0x7fc65c158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c160fa0 0x7fc65c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c2370 con 0x7fc65c160bc0 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c2650 con 0x7fc65c0cd830 2023-07-20T11:24:09.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c2930 con 0x7fc65c160fa0 2023-07-20T11:24:09.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52732/0 (socket says 172.21.15.82:52732) 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2481193168 learned_addr learned my addr 172.21.15.82:0/2481193168 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65bfff640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c0cd830 0x7fc65c158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc660cc9640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c160fa0 0x7fc65c15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c160fa0 msgr2=0x7fc65c15f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c160fa0 0x7fc65c15f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c0cd830 msgr2=0x7fc65c158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:09.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c0cd830 0x7fc65c158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 -- 172.21.15.82:0/2481193168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6500094d0 con 0x7fc65c160bc0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc65b7fe640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fc65001a140 tx=0x7fc65001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500b3800 con 0x7fc65c160bc0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6500b3980 con 0x7fc65c160bc0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c0c2c10 con 0x7fc65c160bc0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6500b3d30 con 0x7fc65c160bc0 2023-07-20T11:24:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c1592c0 con 0x7fc65c160bc0 2023-07-20T11:24:09.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c073c70 con 0x7fc65c160bc0 2023-07-20T11:24:09.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.848+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 120) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fc6500b2380 con 0x7fc65c160bc0 2023-07-20T11:24:09.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.852+0000 7fc658ff9640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 0x7fc6480687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:09.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.852+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7fc65011e9d0 con 0x7fc65c160bc0 2023-07-20T11:24:09.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.852+0000 7fc65bfff640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 0x7fc6480687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:09.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.852+0000 7fc65bfff640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 0x7fc6480687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc64c000f70 tx=0x7fc64c007e50 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:09.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:09.856+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6500eb960 con 0x7fc65c160bc0 2023-07-20T11:24:09.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.004+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc65c0c30c0 con 0x7fc65c160bc0 2023-07-20T11:24:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.004+0000 7fc658ff9640 1 -- 172.21.15.82:0/2481193168 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+19642 (secure 0 0 0) 0x7fc6500c3090 con 0x7fc65c160bc0 2023-07-20T11:24:09.999 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:10.000 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":194,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:07.436058+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:22:38.604492+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-20T11:22:39.925692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":194,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1787912929":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/4190869568":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2588640047":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1036783379":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1897798858":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/723030784":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/3057939453":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/1202706903":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2311853827":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/370784443":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2133506175":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/43459402":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2867668341":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2669450055":"2023-07-21T11:22:58.268166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 msgr2=0x7fc6480687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 0x7fc6480687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc64c000f70 tx=0x7fc64c007e50 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 msgr2=0x7fc65c1595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7fc65001a140 tx=0x7fc65001ad50 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 shutdown_connections 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc648066310 0x7fc6480687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc65c160fa0 0x7fc65c15f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc65c160bc0 0x7fc65c1595e0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 --2- 172.21.15.82:0/2481193168 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc65c0cd830 0x7fc65c158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 >> 172.21.15.82:0/2481193168 conn(0x7fc65c0cada0 msgr2=0x7fc65c070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 shutdown_connections 2023-07-20T11:24:10.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.008+0000 7fc66272c640 1 -- 172.21.15.82:0/2481193168 wait complete. 2023-07-20T11:24:10.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T11:24:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.164+0000 7f22f4b74640 1 Processor -- start 2023-07-20T11:24:10.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 -- start start 2023-07-20T11:24:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22f00b2a90 0x7f22f015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f00cc900 0x7f22f00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f00ccd50 con 0x7f22f01596b0 2023-07-20T11:24:10.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f00ad600 con 0x7f22f00cc900 2023-07-20T11:24:10.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22f4b74640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f00ad810 con 0x7f22f00b2a90 2023-07-20T11:24:10.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f00cc900 0x7f22f00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22f00cc900 0x7f22f00ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52734/0 (socket says 172.21.15.82:52734) 2023-07-20T11:24:10.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 -- 172.21.15.82:0/1298305473 learned_addr learned my addr 172.21.15.82:0/1298305473 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:10.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22e5d9b640 1 --2- 172.21.15.82:0/1298305473 >> v2:172.21.15.183:3300/0 conn(0x7f22f00b2a90 0x7f22f015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 -- 172.21.15.82:0/1298305473 >> v2:172.21.15.183:3300/0 conn(0x7f22f00b2a90 msgr2=0x7f22f015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:10.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 --2- 172.21.15.82:0/1298305473 >> v2:172.21.15.183:3300/0 conn(0x7f22f00b2a90 0x7f22f015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 -- 172.21.15.82:0/1298305473 >> v1:172.21.15.183:6789/0 conn(0x7f22f01596b0 legacy=0x7f22f00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.168+0000 7f22eed9d640 1 -- 172.21.15.82:0/1298305473 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f015d0d0 con 0x7f22f00cc900 2023-07-20T11:24:10.165 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22eed9d640 1 --2- 172.21.15.82:0/1298305473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ad0c0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009870 tx=0x7f22e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a57a0b9750f5a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22edd9b640 1 -- 172.21.15.82:0/1298305473 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80aa430 con 0x7f22f00cc900 2023-07-20T11:24:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22edd9b640 1 -- 172.21.15.82:0/1298305473 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80aa590 con 0x7f22f00cc900 2023-07-20T11:24:10.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22edd9b640 1 -- 172.21.15.82:0/1298305473 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80aa920 con 0x7f22f00cc900 2023-07-20T11:24:10.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 -- 172.21.15.82:0/1298305473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 msgr2=0x7f22f00ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 --2- 172.21.15.82:0/1298305473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ad0c0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009870 tx=0x7f22e801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 -- 172.21.15.82:0/1298305473 shutdown_connections 2023-07-20T11:24:10.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 --2- 172.21.15.82:0/1298305473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ad0c0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 --2- 172.21.15.82:0/1298305473 >> v2:172.21.15.183:3300/0 conn(0x7f22f00b2a90 0x7f22f015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 -- 172.21.15.82:0/1298305473 >> 172.21.15.82:0/1298305473 conn(0x7f22f00cada0 msgr2=0x7f22f00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 -- 172.21.15.82:0/1298305473 shutdown_connections 2023-07-20T11:24:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 -- 172.21.15.82:0/1298305473 wait complete. 2023-07-20T11:24:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.172+0000 7f22f4b74640 1 Processor -- start 2023-07-20T11:24:10.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- start start 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f00b2a90 0x7f22f0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 0x7f22f00acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0157f90 con 0x7f22f00cc900 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0157380 con 0x7f22f00b2a90 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0157660 con 0x7f22f01596b0 2023-07-20T11:24:10.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52740/0 (socket says 172.21.15.82:52740) 2023-07-20T11:24:10.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 -- 172.21.15.82:0/3602804949 learned_addr learned my addr 172.21.15.82:0/3602804949 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22ee59c640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f00b2a90 0x7f22f0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22eed9d640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 0x7f22f00acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 -- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 msgr2=0x7f22f00acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 0x7f22f00acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 -- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f00b2a90 msgr2=0x7f22f0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f00b2a90 0x7f22f0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 -- 172.21.15.82:0/3602804949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80094d0 con 0x7f22f00cc900 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22eed9d640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 0x7f22f00acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e5d9b640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007ef0 tx=0x7f22d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8014620 con 0x7f22f00cc900 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8014780 con 0x7f22f00cc900 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8014b30 con 0x7f22f00cc900 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f0157940 con 0x7f22f00cc900 2023-07-20T11:24:10.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f0156fc0 con 0x7f22f00cc900 2023-07-20T11:24:10.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.176+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f0073c70 con 0x7f22f00cc900 2023-07-20T11:24:10.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.180+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 120) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f22d8014c90 con 0x7f22f00cc900 2023-07-20T11:24:10.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.180+0000 7f22e77fe640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 0x7f22d00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.180+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6980+0+0 (secure 0 0 0) 0x7f22d8084b70 con 0x7f22f00cc900 2023-07-20T11:24:10.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.180+0000 7f22ee59c640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 0x7f22d00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.180+0000 7f22ee59c640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 0x7f22d00687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22e0000f70 tx=0x7f22e0009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.184+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22d8051bf0 con 0x7f22f00cc900 2023-07-20T11:24:10.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.360+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f22f00cbbd0 con 0x7f22f00cc900 2023-07-20T11:24:10.354 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T11:24:10.360+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T11:24:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22e77fe640 1 -- 172.21.15.82:0/3602804949 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22d8055210 con 0x7f22f00cc900 2023-07-20T11:24:10.361 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T11:24:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 msgr2=0x7f22d00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 0x7f22d00687d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22e0000f70 tx=0x7f22e0009040 comp rx=0 tx=0).stop 2023-07-20T11:24:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 msgr2=0x7f22f00ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f22d8007ef0 tx=0x7f22d800e4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 shutdown_connections 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f22d0066310 0x7f22d00687d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22f01596b0 0x7f22f00acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22f00cc900 0x7f22f00ac5b0 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 --2- 172.21.15.82:0/3602804949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22f00b2a90 0x7f22f0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 >> 172.21.15.82:0/3602804949 conn(0x7f22f00cada0 msgr2=0x7f22f00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 shutdown_connections 2023-07-20T11:24:10.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.368+0000 7f22f4b74640 1 -- 172.21.15.82:0/3602804949 wait complete. 2023-07-20T11:24:10.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T11:24:10.427 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:24:10.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.536+0000 7f2944696640 1 Processor -- start 2023-07-20T11:24:10.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.536+0000 7f2944696640 1 -- start start 2023-07-20T11:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2944696640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f293c159830 0x7f293c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2944696640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0cc8d0 con 0x7f293c159450 2023-07-20T11:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2944696640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0ccbb0 con 0x7f293c0cc3e0 2023-07-20T11:24:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2944696640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0cce90 con 0x7f293c159830 2023-07-20T11:24:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942432640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f293c159450 0x7f293c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:54892/0 (socket says 172.21.15.82:54892) 2023-07-20T11:24:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942432640 1 -- 172.21.15.82:0/4079033850 learned_addr learned my addr 172.21.15.82:0/4079033850 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 --2- 172.21.15.82:0/4079033850 >> v2:172.21.15.183:3300/0 conn(0x7f293c159830 0x7f293c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176282872 0 0) 0x7f293c0cc8d0 con 0x7f293c159450 2023-07-20T11:24:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2928003530 con 0x7f293c159450 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690263465 0 0) 0x7f2928003530 con 0x7f293c159450 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 >> v2:172.21.15.183:3300/0 conn(0x7f293c159830 msgr2=0x7f293c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 --2- 172.21.15.82:0/4079033850 >> v2:172.21.15.183:3300/0 conn(0x7f293c159830 0x7f293c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 >> v1:172.21.15.183:6789/0 conn(0x7f293c0cc3e0 legacy=0x7f293c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c159cc0 con 0x7f293c159450 2023-07-20T11:24:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f2938001680 con 0x7f293c159450 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 >> v1:172.21.15.82:6789/0 conn(0x7f293c159450 legacy=0x7f293c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29280039f0 0x7f2928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f2928004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2928005190 0x7f292800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0cce90 con 0x7f29280047d0 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292800c060 con 0x7f2928005190 2023-07-20T11:24:10.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292800c220 con 0x7f29280039f0 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f2928004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942c33640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2928005190 0x7f292800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942432640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29280039f0 0x7f2928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 -- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29280039f0 msgr2=0x7f2928003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29280039f0 0x7f2928003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 -- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2928005190 msgr2=0x7f292800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:10.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2928005190 0x7f292800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2941c31640 1 -- 172.21.15.82:0/4079033850 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2928003530 con 0x7f29280047d0 2023-07-20T11:24:10.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942432640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f29280039f0 0x7f2928003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:10.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.540+0000 7f2942c33640 1 -- 172.21.15.82:0/4079033850 reap_dead start 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2941c31640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f2928004c50 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f292c009ae0 tx=0x7f292c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d4c1455c67d883 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0a55c0 con 0x7f29280047d0 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0a5720 con 0x7f29280047d0 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2941430640 1 -- 172.21.15.82:0/4079033850 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0a5ad0 con 0x7f29280047d0 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 -- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 msgr2=0x7f2928004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f2928004c50 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f292c009ae0 tx=0x7f292c01ca50 comp rx=0 tx=0).stop 2023-07-20T11:24:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 -- 172.21.15.82:0/4079033850 shutdown_connections 2023-07-20T11:24:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 --2- 172.21.15.82:0/4079033850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f2928004c50 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 -- 172.21.15.82:0/4079033850 >> 172.21.15.82:0/4079033850 conn(0x7f293c0cad50 msgr2=0x7f293c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 -- 172.21.15.82:0/4079033850 shutdown_connections 2023-07-20T11:24:10.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 -- 172.21.15.82:0/4079033850 wait complete. 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.544+0000 7f2944696640 1 Processor -- start 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- start start 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f293c0c2e50 0x7f293c1ee630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 0x7f293c0ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0c4b20 con 0x7f29280047d0 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0c6ca0 con 0x7f293c0c2e50 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c1eeb70 con 0x7f293c1eedc0 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52780/0 (socket says 172.21.15.82:52780) 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 -- 172.21.15.82:0/299825237 learned_addr learned my addr 172.21.15.82:0/299825237 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2941c31640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f293c0c2e50 0x7f293c1ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942c33640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 0x7f293c0ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 -- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 msgr2=0x7f293c0ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 0x7f293c0ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 -- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f293c0c2e50 msgr2=0x7f293c1ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f293c0c2e50 0x7f293c1ee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 -- 172.21.15.82:0/299825237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0c3350 con 0x7f29280047d0 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942c33640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 0x7f293c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2942432640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f293800e780 tx=0x7f293800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800c6c0 con 0x7f29280047d0 2023-07-20T11:24:10.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293800c840 con 0x7f29280047d0 2023-07-20T11:24:10.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293c0c3630 con 0x7f29280047d0 2023-07-20T11:24:10.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293800cbf0 con 0x7f29280047d0 2023-07-20T11:24:10.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c0c3bf0 con 0x7f29280047d0 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.548+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c04da30 con 0x7f29280047d0 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.552+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 120) v1 ==== 85704+0+0 (secure 0 0 0) 0x7f293800cd50 con 0x7f29280047d0 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.552+0000 7f2932ffd640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 0x7f29200687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.552+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f2938083f20 con 0x7f29280047d0 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.552+0000 7f2941c31640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 0x7f29200687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:10.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.552+0000 7f2941c31640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 0x7f29200687c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f292c0af000 tx=0x7f292c0046d0 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:10.549 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.556+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29380b4700 con 0x7f29280047d0 2023-07-20T11:24:10.734 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:10.740+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f293c0c19f0 con 0x7f29280047d0 2023-07-20T11:24:11.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2932ffd640 1 -- 172.21.15.82:0/299825237 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v92) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2938051080 con 0x7f29280047d0 2023-07-20T11:24:11.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 msgr2=0x7f29200687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:11.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 0x7f29200687c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f292c0af000 tx=0x7f292c0046d0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 msgr2=0x7f293c1f0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f293800e780 tx=0x7f293800ec40 comp rx=0 tx=0).stop 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 shutdown_connections 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2920066300 0x7f29200687c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f293c1eedc0 0x7f293c0ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f293c0c2e50 0x7f293c1ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 --2- 172.21.15.82:0/299825237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29280047d0 0x7f293c1f0b50 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 >> 172.21.15.82:0/299825237 conn(0x7f293c0cad50 msgr2=0x7f293c158580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:11.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 shutdown_connections 2023-07-20T11:24:11.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.368+0000 7f2944696640 1 -- 172.21.15.82:0/299825237 wait complete. 2023-07-20T11:24:11.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T11:24:11.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 Processor -- start 2023-07-20T11:24:11.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 -- start start 2023-07-20T11:24:11.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0d015c8e0 0x7fa0d006aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 0x7fa0d00d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 0x7fa0d00d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00d0220 con 0x7fa0d015c8e0 2023-07-20T11:24:11.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d015ccc0 con 0x7fa0d00ceff0 2023-07-20T11:24:11.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0d5ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d006b460 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0d015c8e0 0x7fa0d006aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0d015c8e0 0x7fa0d006aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52792/0 (socket says 172.21.15.82:52792) 2023-07-20T11:24:11.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/229912077 learned_addr learned my addr 172.21.15.82:0/229912077 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:11.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/229912077 >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 0x7fa0d00d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cffff640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 0x7fa0d00d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/229912077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 msgr2=0x7fa0d00d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 0x7fa0d00d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/229912077 >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 msgr2=0x7fa0d00d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/229912077 >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 0x7fa0d00d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/229912077 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d006b740 con 0x7fa0d015c8e0 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/229912077 >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 0x7fa0d00d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:11.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.580+0000 7fa0cffff640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 0x7fa0d00d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:11.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.584+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d015c8e0 0x7fa0d006aaf0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fa0d008c9f0 tx=0x7fa0c001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134200f257b51d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0ceffd640 1 -- 172.21.15.82:0/229912077 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00ab600 con 0x7fa0d015c8e0 2023-07-20T11:24:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0ceffd640 1 -- 172.21.15.82:0/229912077 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00ab760 con 0x7fa0d015c8e0 2023-07-20T11:24:11.582 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0ceffd640 1 -- 172.21.15.82:0/229912077 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00abaf0 con 0x7fa0d015c8e0 2023-07-20T11:24:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/229912077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d015c8e0 msgr2=0x7fa0d006aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d015c8e0 0x7fa0d006aaf0 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7fa0d008c9f0 tx=0x7fa0c001c440 comp rx=0 tx=0).stop 2023-07-20T11:24:11.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/229912077 shutdown_connections 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/229912077 >> v2:172.21.15.183:3300/0 conn(0x7fa0d00ceff0 0x7fa0d00d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d00cd1f0 0x7fa0d00d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/229912077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d015c8e0 0x7fa0d006aaf0 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/229912077 >> 172.21.15.82:0/229912077 conn(0x7fa0d008c0a0 msgr2=0x7fa0d009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/229912077 shutdown_connections 2023-07-20T11:24:11.584 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.588+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/229912077 wait complete. 2023-07-20T11:24:11.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 Processor -- start 2023-07-20T11:24:11.585 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- start start 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 0x7fa0d01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d015c8e0 0x7fa0d014ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015a840 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d015b210 con 0x7fa0d00ceff0 2023-07-20T11:24:11.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0159c30 con 0x7fa0d015c8e0 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52804/0 (socket says 172.21.15.82:52804) 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/515584375 learned_addr learned my addr 172.21.15.82:0/515584375 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 0x7fa0d01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cffff640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d015c8e0 0x7fa0d014ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d015c8e0 msgr2=0x7fa0d014ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:11.588 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d015c8e0 0x7fa0d014ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 msgr2=0x7fa0d01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 0x7fa0d01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 -- 172.21.15.82:0/515584375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0009480 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.589 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 0x7fa0d01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0cf7fe640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7fa0c001aaf0 tx=0x7fa0c00191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00abce0 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.590 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00abe40 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0003860 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d0159f10 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d015a4d0 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.592+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d004da30 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.596+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 120) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fa0c00039c0 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.596+0000 7fa0ccff9640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 0x7fa0b0068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:11.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.596+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 7022+0+0 (secure 0 0 0) 0x7fa0c011eb50 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.596+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 0x7fa0b0068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:11.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.596+0000 7fa0c6ffd640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 0x7fa0b0068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0d01676c0 tx=0x7fa0b8007ab0 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:11.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.600+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0c00eba10 con 0x7fa0d00cd1f0 2023-07-20T11:24:11.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:11.748+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa0d00d2e70 con 0x7fa0d00cd1f0 2023-07-20T11:24:12.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.376+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0c00ebde0 con 0x7fa0d00cd1f0 2023-07-20T11:24:12.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.452+0000 7fa0ccff9640 1 -- 172.21.15.82:0/515584375 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa0c00c0a10 con 0x7fa0d00cd1f0 2023-07-20T11:24:12.447 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T11:24:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.456+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 msgr2=0x7fa0b0068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.456+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 0x7fa0b0068800 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0d01676c0 tx=0x7fa0b8007ab0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.456+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 msgr2=0x7fa0d015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.456+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7fa0c001aaf0 tx=0x7fa0c00191e0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 shutdown_connections 2023-07-20T11:24:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa0b0066340 0x7fa0b0068800 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0d015c8e0 0x7fa0d014ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0d00ceff0 0x7fa0d01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 --2- 172.21.15.82:0/515584375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0d00cd1f0 0x7fa0d015acd0 secure :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7fa0c001aaf0 tx=0x7fa0c00191e0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 >> 172.21.15.82:0/515584375 conn(0x7fa0d008c0a0 msgr2=0x7fa0d00d05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:12.454 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 shutdown_connections 2023-07-20T11:24:12.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.460+0000 7fa0d5ffa640 1 -- 172.21.15.82:0/515584375 wait complete. 2023-07-20T11:24:12.483 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T11:24:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 Processor -- start 2023-07-20T11:24:12.630 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 -- start start 2023-07-20T11:24:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00400cbc50 0x7f0040071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f004006b720 0x7f004006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004015a880 con 0x7f004015a4a0 2023-07-20T11:24:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004006c0d0 con 0x7f00400cbc50 2023-07-20T11:24:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0046c61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00400cce80 con 0x7f004006b720 2023-07-20T11:24:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00400cbc50 0x7f0040071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f00400cbc50 0x7f0040071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52814/0 (socket says 172.21.15.82:52814) 2023-07-20T11:24:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 -- 172.21.15.82:0/3766797220 learned_addr learned my addr 172.21.15.82:0/3766797220 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:12.632 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f00451fe640 1 --2- 172.21.15.82:0/3766797220 >> v2:172.21.15.183:3300/0 conn(0x7f004006b720 0x7f004006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 -- 172.21.15.82:0/3766797220 >> v2:172.21.15.183:3300/0 conn(0x7f004006b720 msgr2=0x7f004006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 --2- 172.21.15.82:0/3766797220 >> v2:172.21.15.183:3300/0 conn(0x7f004006b720 0x7f004006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 -- 172.21.15.82:0/3766797220 >> v1:172.21.15.183:6789/0 conn(0x7f004015a4a0 legacy=0x7f00400b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.633 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.636+0000 7f0037fff640 1 -- 172.21.15.82:0/3766797220 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400cc270 con 0x7f00400cbc50 2023-07-20T11:24:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0037fff640 1 --2- 172.21.15.82:0/3766797220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00400cbc50 0x7f0040071530 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f0040067120 tx=0x7f003001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8fd92d33b98b2d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:12.634 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f00377fe640 1 -- 172.21.15.82:0/3766797220 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00300ab670 con 0x7f00400cbc50 2023-07-20T11:24:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f00377fe640 1 -- 172.21.15.82:0/3766797220 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00300ab7d0 con 0x7f00400cbc50 2023-07-20T11:24:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f00377fe640 1 -- 172.21.15.82:0/3766797220 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00300abb60 con 0x7f00400cbc50 2023-07-20T11:24:12.635 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 -- 172.21.15.82:0/3766797220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00400cbc50 msgr2=0x7f0040071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 --2- 172.21.15.82:0/3766797220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00400cbc50 0x7f0040071530 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f0040067120 tx=0x7f003001c470 comp rx=0 tx=0).stop 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 -- 172.21.15.82:0/3766797220 shutdown_connections 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 --2- 172.21.15.82:0/3766797220 >> v2:172.21.15.183:3300/0 conn(0x7f004006b720 0x7f004006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 --2- 172.21.15.82:0/3766797220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00400cbc50 0x7f0040071530 unknown :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 -- 172.21.15.82:0/3766797220 >> 172.21.15.82:0/3766797220 conn(0x7f00400ce080 msgr2=0x7f00400ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 -- 172.21.15.82:0/3766797220 shutdown_connections 2023-07-20T11:24:12.636 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.640+0000 7f0046c61640 1 -- 172.21.15.82:0/3766797220 wait complete. 2023-07-20T11:24:12.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 Processor -- start 2023-07-20T11:24:12.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- start start 2023-07-20T11:24:12.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f004006b720 0x7f00400c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00400cbc50 0x7f00400c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400c0bb0 con 0x7f004015a4a0 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00401537e0 con 0x7f004006b720 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040153ac0 con 0x7f00400cbc50 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52824/0 (socket says 172.21.15.82:52824) 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 -- 172.21.15.82:0/1181641744 learned_addr learned my addr 172.21.15.82:0/1181641744 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:12.639 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00449fd640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f004006b720 0x7f00400c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0037fff640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00400cbc50 0x7f00400c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 -- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00400cbc50 msgr2=0x7f00400c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00400cbc50 0x7f00400c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 -- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f004006b720 msgr2=0x7f00400c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f004006b720 0x7f00400c0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 -- 172.21.15.82:0/1181641744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300094d0 con 0x7f004015a4a0 2023-07-20T11:24:12.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00451fe640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f003800efc0 tx=0x7f003800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:12.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038014480 con 0x7f004015a4a0 2023-07-20T11:24:12.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800f040 con 0x7f004015a4a0 2023-07-20T11:24:12.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038014820 con 0x7f004015a4a0 2023-07-20T11:24:12.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040153da0 con 0x7f004015a4a0 2023-07-20T11:24:12.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400c4bb0 con 0x7f004015a4a0 2023-07-20T11:24:12.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.644+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004004da30 con 0x7f004015a4a0 2023-07-20T11:24:12.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.648+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0038014980 con 0x7f004015a4a0 2023-07-20T11:24:12.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.648+0000 7f00357fa640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 0x7f002c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.648+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0038084bb0 con 0x7f004015a4a0 2023-07-20T11:24:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.648+0000 7f00449fd640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 0x7f002c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:12.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.648+0000 7f00449fd640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 0x7f002c068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:12.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.652+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0038051ca0 con 0x7f004015a4a0 2023-07-20T11:24:12.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:12.800+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0040071740 con 0x7f004015a4a0 2023-07-20T11:24:13.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.600+0000 7f00357fa640 1 -- 172.21.15.82:0/1181641744 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) v1 ==== 169+0+0 (secure 0 0 0) 0x7f00380180d0 con 0x7f004015a4a0 2023-07-20T11:24:13.597 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T11:24:13.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 msgr2=0x7f002c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 0x7f002c068890 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f003c007fd0 tx=0x7f003c009040 comp rx=0 tx=0).stop 2023-07-20T11:24:13.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 msgr2=0x7f00401593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.599 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7f003800efc0 tx=0x7f003800c490 comp rx=0 tx=0).stop 2023-07-20T11:24:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 shutdown_connections 2023-07-20T11:24:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f002c0663d0 0x7f002c068890 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f004015a4a0 0x7f00401593c0 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f00400cbc50 0x7f00400c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 --2- 172.21.15.82:0/1181641744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f004006b720 0x7f00400c0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 >> 172.21.15.82:0/1181641744 conn(0x7f00400ce080 msgr2=0x7f004015aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 shutdown_connections 2023-07-20T11:24:13.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.604+0000 7f0046c61640 1 -- 172.21.15.82:0/1181641744 wait complete. 2023-07-20T11:24:13.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T11:24:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.768+0000 7f3bc1c6a640 1 Processor -- start 2023-07-20T11:24:13.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.768+0000 7f3bc1c6a640 1 -- start start 2023-07-20T11:24:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bc1c6a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3bbc06f710 0x7f3bbc06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bc1c6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bc1c6a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc070030 con 0x7f3bbc15ec90 2023-07-20T11:24:13.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bc1c6a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc15bad0 con 0x7f3bbc06f710 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bc1c6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc071950 con 0x7f3bbc0ca5a0 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3bbc06f710 0x7f3bbc06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3bbc06f710 0x7f3bbc06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55462/0 (socket says 172.21.15.82:55462) 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 -- 172.21.15.82:0/3494678923 learned_addr learned my addr 172.21.15.82:0/3494678923 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bb3fff640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 -- 172.21.15.82:0/3494678923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 msgr2=0x7f3bbc15e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:13.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 -- 172.21.15.82:0/3494678923 >> v1:172.21.15.183:6789/0 conn(0x7f3bbc15ec90 legacy=0x7f3bbc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.772+0000 7f3bbb7fe640 1 -- 172.21.15.82:0/3494678923 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc15b230 con 0x7f3bbc06f710 2023-07-20T11:24:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bbb7fe640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc06f710 0x7f3bbc06faf0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be971b696ab7b9af server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:13.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bbaffd640 1 -- 172.21.15.82:0/3494678923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0ab620 con 0x7f3bbc06f710 2023-07-20T11:24:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bbaffd640 1 -- 172.21.15.82:0/3494678923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0ab780 con 0x7f3bbc06f710 2023-07-20T11:24:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bbaffd640 1 -- 172.21.15.82:0/3494678923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0abb10 con 0x7f3bbc06f710 2023-07-20T11:24:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/3494678923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc06f710 msgr2=0x7f3bbc06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc06f710 0x7f3bbc06faf0 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009870 tx=0x7f3bac01c510 comp rx=0 tx=0).stop 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/3494678923 shutdown_connections 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/3494678923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc06f710 0x7f3bbc06faf0 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/3494678923 >> 172.21.15.82:0/3494678923 conn(0x7f3bbc0cad50 msgr2=0x7f3bbc0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/3494678923 shutdown_connections 2023-07-20T11:24:13.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/3494678923 wait complete. 2023-07-20T11:24:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 Processor -- start 2023-07-20T11:24:13.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.776+0000 7f3bc1c6a640 1 -- start start 2023-07-20T11:24:13.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bbc06f710 0x7f3bbc0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c75c0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c8670 con 0x7f3bbc06f710 2023-07-20T11:24:13.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0c69b0 con 0x7f3bbc0ca5a0 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbb7fe640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bbc06f710 0x7f3bbc0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55468/0 (socket says 172.21.15.82:55468) 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 -- 172.21.15.82:0/2775342283 learned_addr learned my addr 172.21.15.82:0/2775342283 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bb3fff640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 -- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 msgr2=0x7f3bbc15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 -- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bbc06f710 msgr2=0x7f3bbc0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bbc06f710 0x7f3bbc0c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 -- 172.21.15.82:0/2775342283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac0094d0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bbbfff640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400c770 tx=0x7f3bb400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4003b80 con 0x7f3bbc15ec90 2023-07-20T11:24:13.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb4003ce0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb400aa90 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc0c6c90 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0c7250 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc04da30 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.780+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3bb400abf0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.784+0000 7f3bb8ff9640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 0x7f3b9c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.784+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f3bb4083bf0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.784+0000 7f3bbb7fe640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 0x7f3b9c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:13.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.784+0000 7f3bbb7fe640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 0x7f3b9c068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0af000 tx=0x7f3bac0b6040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:13.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.788+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3bb4050fc0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.928 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.932+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f3bbc0cb940 con 0x7f3bbc15ec90 2023-07-20T11:24:13.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bb8ff9640 1 -- 172.21.15.82:0/2775342283 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v67) v1 ==== 115+0+0 (secure 0 0 0) 0x7f3bb40545e0 con 0x7f3bbc15ec90 2023-07-20T11:24:13.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 msgr2=0x7f3b9c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 0x7f3b9c068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0af000 tx=0x7f3bac0b6040 comp rx=0 tx=0).stop 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 msgr2=0x7f3bbc0b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7f3bb400c770 tx=0x7f3bb400cc30 comp rx=0 tx=0).stop 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 shutdown_connections 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3b9c0663a0 0x7f3b9c068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bbc15ec90 0x7f3bbc0b2b30 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3bbc0ca5a0 0x7f3bbc15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 --2- 172.21.15.82:0/2775342283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3bbc06f710 0x7f3bbc0c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 >> 172.21.15.82:0/2775342283 conn(0x7f3bbc0cad50 msgr2=0x7f3bbc164ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 shutdown_connections 2023-07-20T11:24:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:13.940+0000 7f3bc1c6a640 1 -- 172.21.15.82:0/2775342283 wait complete. 2023-07-20T11:24:13.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T11:24:14.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.100+0000 7fb218174640 1 Processor -- start 2023-07-20T11:24:14.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.100+0000 7fb218174640 1 -- start start 2023-07-20T11:24:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb218174640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb210160ba0 0x7fb2100c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb218174640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2100c9370 con 0x7fb2100c8e60 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb218174640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb210161300 con 0x7fb2100b0460 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb218174640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2100c9650 con 0x7fb210160ba0 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb215f10640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb210160ba0 0x7fb2100c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb21570f640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb2100c8e60 0x7fb2100afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51906/0 (socket says 172.21.15.82:51906) 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb21570f640 1 -- 172.21.15.82:0/3232973894 learned_addr learned my addr 172.21.15.82:0/3232973894 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:14.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb215f10640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb210160ba0 0x7fb2100c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55482/0 (socket says 172.21.15.82:55482) 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb215f10640 1 -- 172.21.15.82:0/3232973894 >> v1:172.21.15.183:6789/0 conn(0x7fb2100b0460 legacy=0x7fb2100cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb215f10640 1 -- 172.21.15.82:0/3232973894 >> v1:172.21.15.82:6789/0 conn(0x7fb2100c8e60 legacy=0x7fb2100afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb215f10640 1 -- 172.21.15.82:0/3232973894 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2101615e0 con 0x7fb210160ba0 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.104+0000 7fb214f0e640 1 -- 172.21.15.82:0/3232973894 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096449291 0 0) 0x7fb2100c9370 con 0x7fb2100c8e60 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb215f10640 1 --2- 172.21.15.82:0/3232973894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb210160ba0 0x7fb2100c8920 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdd59c9d2efb738 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb214f0e640 1 -- 172.21.15.82:0/3232973894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a59f0 con 0x7fb210160ba0 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb214f0e640 1 -- 172.21.15.82:0/3232973894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2101656c0 con 0x7fb210160ba0 2023-07-20T11:24:14.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb214f0e640 1 -- 172.21.15.82:0/3232973894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a5d70 con 0x7fb210160ba0 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- 172.21.15.82:0/3232973894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb210160ba0 msgr2=0x7fb2100c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 --2- 172.21.15.82:0/3232973894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb210160ba0 0x7fb2100c8920 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c01c910 comp rx=0 tx=0).stop 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- 172.21.15.82:0/3232973894 shutdown_connections 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 --2- 172.21.15.82:0/3232973894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb210160ba0 0x7fb2100c8920 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- 172.21.15.82:0/3232973894 >> 172.21.15.82:0/3232973894 conn(0x7fb2100cad50 msgr2=0x7fb2100cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- 172.21.15.82:0/3232973894 shutdown_connections 2023-07-20T11:24:14.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- 172.21.15.82:0/3232973894 wait complete. 2023-07-20T11:24:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 Processor -- start 2023-07-20T11:24:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- start start 2023-07-20T11:24:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 0x7fb21015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb210160ba0 0x7fb210148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2101619c0 con 0x7fb2100c8e60 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100c5520 con 0x7fb2100b0460 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.108+0000 7fb218174640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2100b3500 con 0x7fb210160ba0 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55486/0 (socket says 172.21.15.82:55486) 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 -- 172.21.15.82:0/2722897560 learned_addr learned my addr 172.21.15.82:0/2722897560 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:14.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb215f10640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 0x7fb21015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb216711640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb210160ba0 0x7fb210148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 -- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb210160ba0 msgr2=0x7fb210148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb210160ba0 0x7fb210148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 -- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 msgr2=0x7fb21015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 0x7fb21015c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 -- 172.21.15.82:0/2722897560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009a70 con 0x7fb2100c8e60 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb215f10640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 0x7fb21015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:14.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb21570f640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fb2000011f0 tx=0x7fb20000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2000074e0 con 0x7fb2100c8e60 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200007640 con 0x7fb2100c8e60 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200004a10 con 0x7fb2100c8e60 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2100b37e0 con 0x7fb2100c8e60 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21015c8a0 con 0x7fb2100c8e60 2023-07-20T11:24:14.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2100c5380 con 0x7fb2100c8e60 2023-07-20T11:24:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.112+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb200004b70 con 0x7fb2100c8e60 2023-07-20T11:24:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.116+0000 7fb2067fc640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 0x7fb1f4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.116+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fb200083080 con 0x7fb2100c8e60 2023-07-20T11:24:14.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.116+0000 7fb215f10640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 0x7fb1f4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.112 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.116+0000 7fb215f10640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 0x7fb1f4068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0af000 tx=0x7fb20c0a7070 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.113 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.120+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2100c5380 con 0x7fb2100c8e60 2023-07-20T11:24:14.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.272+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb2100c5380 con 0x7fb2100c8e60 2023-07-20T11:24:14.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.276+0000 7fb2067fc640 1 -- 172.21.15.82:0/2722897560 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb2100c5380 con 0x7fb2100c8e60 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 msgr2=0x7fb1f4068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 0x7fb1f4068890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0af000 tx=0x7fb20c0a7070 comp rx=0 tx=0).stop 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 msgr2=0x7fb2101482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fb2000011f0 tx=0x7fb20000c9b0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 shutdown_connections 2023-07-20T11:24:14.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fb1f40663d0 0x7fb1f4068890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb210160ba0 0x7fb210148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb2100c8e60 0x7fb2101482e0 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 --2- 172.21.15.82:0/2722897560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb2100b0460 0x7fb21015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 >> 172.21.15.82:0/2722897560 conn(0x7fb2100cad50 msgr2=0x7fb2100ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 shutdown_connections 2023-07-20T11:24:14.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.280+0000 7fb218174640 1 -- 172.21.15.82:0/2722897560 wait complete. 2023-07-20T11:24:14.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T11:24:14.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 Processor -- start 2023-07-20T11:24:14.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 -- start start 2023-07-20T11:24:14.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 0x7fde6c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6c0b4930 con 0x7fde6c0d07a0 2023-07-20T11:24:14.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6c15ff50 con 0x7fde6c0b44d0 2023-07-20T11:24:14.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde70876640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0d0f90 con 0x7fde6c15fb70 2023-07-20T11:24:14.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde63fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 0x7fde6c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:38712/0 (socket says 172.21.15.82:38712) 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 -- 172.21.15.82:0/764710478 learned_addr learned my addr 172.21.15.82:0/764710478 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde63fff640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 0x7fde6c0d0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:38950/0 (socket says 172.21.15.82:38950) 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 -- 172.21.15.82:0/764710478 >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 msgr2=0x7fde6c0d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 --2- 172.21.15.82:0/764710478 >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 0x7fde6c0d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 -- 172.21.15.82:0/764710478 >> v1:172.21.15.183:6789/0 conn(0x7fde6c0d07a0 legacy=0x7fde6c06a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.442 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.444+0000 7fde6b7fe640 1 -- 172.21.15.82:0/764710478 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c0cd190 con 0x7fde6c15fb70 2023-07-20T11:24:14.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde6b7fe640 1 --2- 172.21.15.82:0/764710478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009870 tx=0x7fde5c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f461ca52aed0c1ce server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde6affd640 1 -- 172.21.15.82:0/764710478 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0ac640 con 0x7fde6c15fb70 2023-07-20T11:24:14.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde6affd640 1 -- 172.21.15.82:0/764710478 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0ac7a0 con 0x7fde6c15fb70 2023-07-20T11:24:14.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde6affd640 1 -- 172.21.15.82:0/764710478 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0acb30 con 0x7fde6c15fb70 2023-07-20T11:24:14.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 -- 172.21.15.82:0/764710478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 msgr2=0x7fde6c0b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.444 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 --2- 172.21.15.82:0/764710478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009870 tx=0x7fde5c01c3f0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 -- 172.21.15.82:0/764710478 shutdown_connections 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 --2- 172.21.15.82:0/764710478 >> v2:172.21.15.183:3300/0 conn(0x7fde6c0b44d0 0x7fde6c0d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 --2- 172.21.15.82:0/764710478 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c15fb70 0x7fde6c0b3f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 -- 172.21.15.82:0/764710478 >> 172.21.15.82:0/764710478 conn(0x7fde6c065710 msgr2=0x7fde6c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 -- 172.21.15.82:0/764710478 shutdown_connections 2023-07-20T11:24:14.445 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.448+0000 7fde70876640 1 -- 172.21.15.82:0/764710478 wait complete. 2023-07-20T11:24:14.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 Processor -- start 2023-07-20T11:24:14.446 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- start start 2023-07-20T11:24:14.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c0b44d0 0x7fde6c0c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.448 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde6c0d07a0 0x7fde6c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0c6790 con 0x7fde6c15fb70 2023-07-20T11:24:14.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0c6fb0 con 0x7fde6c0d07a0 2023-07-20T11:24:14.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0c69f0 con 0x7fde6c0b44d0 2023-07-20T11:24:14.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde63fff640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde6c0d07a0 0x7fde6c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55500/0 (socket says 172.21.15.82:55500) 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 -- 172.21.15.82:0/3690804842 learned_addr learned my addr 172.21.15.82:0/3690804842 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6b7fe640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c0b44d0 0x7fde6c0c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 -- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c0b44d0 msgr2=0x7fde6c0c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c0b44d0 0x7fde6c0c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 -- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde6c0d07a0 msgr2=0x7fde6c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde6c0d07a0 0x7fde6c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 -- 172.21.15.82:0/3690804842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0094d0 con 0x7fde6c15fb70 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde6bfff640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c730 tx=0x7fde6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64003b80 con 0x7fde6c15fb70 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64003ce0 con 0x7fde6c15fb70 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6400aa30 con 0x7fde6c15fb70 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6c0c6cd0 con 0x7fde6c15fb70 2023-07-20T11:24:14.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.452+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6c156460 con 0x7fde6c15fb70 2023-07-20T11:24:14.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6c155fe0 con 0x7fde6c15fb70 2023-07-20T11:24:14.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fde6400ab90 con 0x7fde6c15fb70 2023-07-20T11:24:14.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde68ff9640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 0x7fde4c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fde64083ad0 con 0x7fde6c15fb70 2023-07-20T11:24:14.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde6b7fe640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 0x7fde4c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.453 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.456+0000 7fde6b7fe640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 0x7fde4c068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0ae000 tx=0x7fde5c0a6070 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.460+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde6c155fe0 con 0x7fde6c15fb70 2023-07-20T11:24:14.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.608+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fde6c155fe0 con 0x7fde6c15fb70 2023-07-20T11:24:14.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde68ff9640 1 -- 172.21.15.82:0/3690804842 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7fde6c155fe0 con 0x7fde6c15fb70 2023-07-20T11:24:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 msgr2=0x7fde4c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 0x7fde4c068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0ae000 tx=0x7fde5c0a6070 comp rx=0 tx=0).stop 2023-07-20T11:24:14.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 msgr2=0x7fde6c0c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c730 tx=0x7fde6400cbf0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 shutdown_connections 2023-07-20T11:24:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fde4c0663a0 0x7fde4c068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde6c15fb70 0x7fde6c0c9db0 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fde6c0d07a0 0x7fde6c15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 --2- 172.21.15.82:0/3690804842 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fde6c0b44d0 0x7fde6c0c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 >> 172.21.15.82:0/3690804842 conn(0x7fde6c065710 msgr2=0x7fde6c0b6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:14.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 shutdown_connections 2023-07-20T11:24:14.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.616+0000 7fde70876640 1 -- 172.21.15.82:0/3690804842 wait complete. 2023-07-20T11:24:14.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-20T11:24:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 Processor -- start 2023-07-20T11:24:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 -- start start 2023-07-20T11:24:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f863c0d0d10 0x7f863c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f863c0cd4b0 0x7f863c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c0d16b0 con 0x7f863c15cab0 2023-07-20T11:24:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0d31c0 con 0x7f863c0d0d10 2023-07-20T11:24:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86416cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c0b3520 con 0x7f863c0cd4b0 2023-07-20T11:24:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f863affd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f863c15cab0 0x7f863c0d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51918/0 (socket says 172.21.15.82:51918) 2023-07-20T11:24:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f863affd640 1 -- 172.21.15.82:0/542394074 learned_addr learned my addr 172.21.15.82:0/542394074 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86327fc640 1 --2- 172.21.15.82:0/542394074 >> v2:172.21.15.82:3300/0 conn(0x7f863c0d0d10 0x7f863c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f863b7fe640 1 --2- 172.21.15.82:0/542394074 >> v2:172.21.15.183:3300/0 conn(0x7f863c0cd4b0 0x7f863c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f863a7fc640 1 -- 172.21.15.82:0/542394074 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668372226 0 0) 0x7f863c0d16b0 con 0x7f863c15cab0 2023-07-20T11:24:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f863a7fc640 1 -- 172.21.15.82:0/542394074 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8628003530 con 0x7f863c15cab0 2023-07-20T11:24:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86327fc640 1 -- 172.21.15.82:0/542394074 >> v2:172.21.15.183:3300/0 conn(0x7f863c0cd4b0 msgr2=0x7f863c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86327fc640 1 --2- 172.21.15.82:0/542394074 >> v2:172.21.15.183:3300/0 conn(0x7f863c0cd4b0 0x7f863c0cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86327fc640 1 -- 172.21.15.82:0/542394074 >> v1:172.21.15.82:6789/0 conn(0x7f863c15cab0 legacy=0x7f863c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.776+0000 7f86327fc640 1 -- 172.21.15.82:0/542394074 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c0d0a10 con 0x7f863c0d0d10 2023-07-20T11:24:14.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86327fc640 1 --2- 172.21.15.82:0/542394074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c0d0d10 0x7f863c0d1170 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f863c071cd0 tx=0x7f862401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6832aedc0ffd7e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f863a7fc640 1 -- 172.21.15.82:0/542394074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240a7070 con 0x7f863c0d0d10 2023-07-20T11:24:14.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f863a7fc640 1 -- 172.21.15.82:0/542394074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86240ab430 con 0x7f863c0d0d10 2023-07-20T11:24:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f863a7fc640 1 -- 172.21.15.82:0/542394074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86240ab7c0 con 0x7f863c0d0d10 2023-07-20T11:24:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 -- 172.21.15.82:0/542394074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c0d0d10 msgr2=0x7f863c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 --2- 172.21.15.82:0/542394074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c0d0d10 0x7f863c0d1170 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7f863c071cd0 tx=0x7f862401c430 comp rx=0 tx=0).stop 2023-07-20T11:24:14.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 -- 172.21.15.82:0/542394074 shutdown_connections 2023-07-20T11:24:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 --2- 172.21.15.82:0/542394074 >> v2:172.21.15.183:3300/0 conn(0x7f863c0cd4b0 0x7f863c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 --2- 172.21.15.82:0/542394074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c0d0d10 0x7f863c0d1170 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 -- 172.21.15.82:0/542394074 >> 172.21.15.82:0/542394074 conn(0x7f863c08c120 msgr2=0x7f863c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:14.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 -- 172.21.15.82:0/542394074 shutdown_connections 2023-07-20T11:24:14.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.780+0000 7f86416cb640 1 -- 172.21.15.82:0/542394074 wait complete. 2023-07-20T11:24:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 Processor -- start 2023-07-20T11:24:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- start start 2023-07-20T11:24:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 0x7f863c0c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f863c0d0d10 0x7f863c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c15a780 con 0x7f863c15cab0 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c159de0 con 0x7f863c0d0d10 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c15a0c0 con 0x7f863c0cd4b0 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55516/0 (socket says 172.21.15.82:55516) 2023-07-20T11:24:14.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 -- 172.21.15.82:0/994225208 learned_addr learned my addr 172.21.15.82:0/994225208 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86327fc640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f863c0d0d10 0x7f863c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863affd640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 0x7f863c0c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 -- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 msgr2=0x7f863c0c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 0x7f863c0c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 -- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f863c0d0d10 msgr2=0x7f863c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f863c0d0d10 0x7f863c15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:14.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 -- 172.21.15.82:0/994225208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8624009420 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863affd640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 0x7f863c0c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f863b7fe640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f8634007e60 tx=0x7f863400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634014420 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340145a0 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634014950 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c15a3a0 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c15b620 con 0x7f863c15cab0 2023-07-20T11:24:14.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.784+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c15a8c0 con 0x7f863c15cab0 2023-07-20T11:24:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.788+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8634014ab0 con 0x7f863c15cab0 2023-07-20T11:24:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.788+0000 7f8633fff640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 0x7f861c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.788+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f8634084830 con 0x7f863c15cab0 2023-07-20T11:24:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.788+0000 7f863affd640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 0x7f861c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:14.787 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.788+0000 7f863affd640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 0x7f861c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f862c0011f0 tx=0x7f862c009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:14.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.792+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f863c15a8c0 con 0x7f863c15cab0 2023-07-20T11:24:14.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:14.996+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f863c15a8c0 con 0x7f863c15cab0 2023-07-20T11:24:15.557 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:24:15.561 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:24:15.598 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f8633fff640 1 -- 172.21.15.82:0/994225208 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3047) v1 ==== 163+0+0 (secure 0 0 0) 0x7f863c15a8c0 con 0x7f863c15cab0 2023-07-20T11:24:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 msgr2=0x7f861c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 0x7f861c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f862c0011f0 tx=0x7f862c009040 comp rx=0 tx=0).stop 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 msgr2=0x7f863c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7f8634007e60 tx=0x7f863400e4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 shutdown_connections 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f861c0663a0 0x7f861c068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f863c15cab0 0x7f863c15b0e0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f863c0d0d10 0x7f863c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.601 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 --2- 172.21.15.82:0/994225208 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f863c0cd4b0 0x7f863c0c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 >> 172.21.15.82:0/994225208 conn(0x7f863c08c120 msgr2=0x7f863c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:15.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 shutdown_connections 2023-07-20T11:24:15.602 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.604+0000 7f86416cb640 1 -- 172.21.15.82:0/994225208 wait complete. 2023-07-20T11:24:15.621 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-07-20T11:24:15.622 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-07-20T11:24:15.622 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-07-20T11:24:15.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-20T11:24:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 Processor -- start 2023-07-20T11:24:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 -- start start 2023-07-20T11:24:15.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f818415cab0 0x7f81840d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:15.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840b3520 con 0x7f81840d0d10 2023-07-20T11:24:15.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81840cff30 con 0x7f81840ce4c0 2023-07-20T11:24:15.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8189ae5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81840d31c0 con 0x7f818415cab0 2023-07-20T11:24:15.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f818415cab0 0x7f81840d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:15.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f818415cab0 0x7f81840d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55522/0 (socket says 172.21.15.82:55522) 2023-07-20T11:24:15.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 -- 172.21.15.82:0/3777470854 learned_addr learned my addr 172.21.15.82:0/3777470854 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 -- 172.21.15.82:0/3777470854 >> v1:172.21.15.183:6789/0 conn(0x7f81840ce4c0 legacy=0x7f81840cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 -- 172.21.15.82:0/3777470854 >> v1:172.21.15.82:6789/0 conn(0x7f81840d0d10 legacy=0x7f81840cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f81837fe640 1 -- 172.21.15.82:0/3777470854 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840b2910 con 0x7f818415cab0 2023-07-20T11:24:15.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.808+0000 7f8182ffd640 1 -- 172.21.15.82:0/3777470854 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883114656 0 0) 0x7f81840b3520 con 0x7f81840d0d10 2023-07-20T11:24:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f81837fe640 1 --2- 172.21.15.82:0/3777470854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f818415cab0 0x7f81840d0300 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f8174009870 tx=0x7f817401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30127c875b120a47 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8182ffd640 1 -- 172.21.15.82:0/3777470854 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740aa430 con 0x7f818415cab0 2023-07-20T11:24:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8182ffd640 1 -- 172.21.15.82:0/3777470854 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740aa590 con 0x7f818415cab0 2023-07-20T11:24:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8182ffd640 1 -- 172.21.15.82:0/3777470854 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740aa920 con 0x7f818415cab0 2023-07-20T11:24:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 -- 172.21.15.82:0/3777470854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f818415cab0 msgr2=0x7f81840d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 --2- 172.21.15.82:0/3777470854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f818415cab0 0x7f81840d0300 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f8174009870 tx=0x7f817401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 -- 172.21.15.82:0/3777470854 shutdown_connections 2023-07-20T11:24:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 --2- 172.21.15.82:0/3777470854 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f818415cab0 0x7f81840d0300 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 -- 172.21.15.82:0/3777470854 >> 172.21.15.82:0/3777470854 conn(0x7f818408c120 msgr2=0x7f818409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 -- 172.21.15.82:0/3777470854 shutdown_connections 2023-07-20T11:24:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.812+0000 7f8189ae5640 1 -- 172.21.15.82:0/3777470854 wait complete. 2023-07-20T11:24:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 Processor -- start 2023-07-20T11:24:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- start start 2023-07-20T11:24:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 0x7f818414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f818415cab0 0x7f81840b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81841501c0 con 0x7f81840d0d10 2023-07-20T11:24:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81840cb260 con 0x7f81840ce4c0 2023-07-20T11:24:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81840cb500 con 0x7f818415cab0 2023-07-20T11:24:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55528/0 (socket says 172.21.15.82:55528) 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 -- 172.21.15.82:0/349962744 learned_addr learned my addr 172.21.15.82:0/349962744 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f81837fe640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 0x7f818414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8183fff640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f818415cab0 0x7f81840b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 -- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f818415cab0 msgr2=0x7f81840b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f818415cab0 0x7f81840b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 -- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 msgr2=0x7f818414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 0x7f818414fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 -- 172.21.15.82:0/349962744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81740094d0 con 0x7f81840d0d10 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f81837fe640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 0x7f818414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f817affd640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c7a0 tx=0x7f816c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c003db0 con 0x7f81840d0d10 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c005070 con 0x7f81840d0d10 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81840cb7e0 con 0x7f81840d0d10 2023-07-20T11:24:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c005420 con 0x7f81840d0d10 2023-07-20T11:24:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.816+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81840cbda0 con 0x7f81840d0d10 2023-07-20T11:24:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81840cbf90 con 0x7f81840d0d10 2023-07-20T11:24:15.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f816c005580 con 0x7f81840d0d10 2023-07-20T11:24:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f8180ff9640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 0x7f8164068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f816c083700 con 0x7f81840d0d10 2023-07-20T11:24:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f81837fe640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 0x7f8164068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:15.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.820+0000 7f81837fe640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 0x7f8164068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f81740ae000 tx=0x7f81740a7000 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:15.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:15.824+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f816c050a30 con 0x7f81840d0d10 2023-07-20T11:24:16.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.020+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f8184073c70 con 0x7f81840d0d10 2023-07-20T11:24:16.600 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.604+0000 7f8180ff9640 1 -- 172.21.15.82:0/349962744 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3048) v1 ==== 158+0+0 (secure 0 0 0) 0x7f816c054050 con 0x7f81840d0d10 2023-07-20T11:24:16.603 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 msgr2=0x7f8164068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 0x7f8164068860 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f81740ae000 tx=0x7f81740a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 msgr2=0x7f81840b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f816c00c7a0 tx=0x7f816c00cc60 comp rx=0 tx=0).stop 2023-07-20T11:24:16.604 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 shutdown_connections 2023-07-20T11:24:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f81640663a0 0x7f8164068860 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f818415cab0 0x7f81840b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81840d0d10 0x7f81840b5320 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 --2- 172.21.15.82:0/349962744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f81840ce4c0 0x7f818414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 >> 172.21.15.82:0/349962744 conn(0x7f818408c120 msgr2=0x7f818406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:16.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 shutdown_connections 2023-07-20T11:24:16.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.608+0000 7f8189ae5640 1 -- 172.21.15.82:0/349962744 wait complete. 2023-07-20T11:24:16.624 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.768+0000 7fc470a48640 1 Processor -- start 2023-07-20T11:24:16.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.768+0000 7fc470a48640 1 -- start start 2023-07-20T11:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc470a48640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc46c1596b0 0x7fc46c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc470a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc46c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc470a48640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46c0ccd90 con 0x7fc46c0cc900 2023-07-20T11:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc470a48640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c0ad600 con 0x7fc46c1596b0 2023-07-20T11:24:16.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc470a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ad810 con 0x7fc46c0b2a90 2023-07-20T11:24:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc46c0cc900 0x7fc46c0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51934/0 (socket says 172.21.15.82:51934) 2023-07-20T11:24:16.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 -- 172.21.15.82:0/1731699196 learned_addr learned my addr 172.21.15.82:0/1731699196 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:16.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc46c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1731699196 >> v2:172.21.15.183:3300/0 conn(0x7fc46c1596b0 0x7fc46c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663600028 0 0) 0x7fc46c0ccd90 con 0x7fc46c0cc900 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc458003530 con 0x7fc46c0cc900 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768422564 0 0) 0x7fc458003530 con 0x7fc46c0cc900 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 msgr2=0x7fc46c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc46c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 >> v2:172.21.15.183:3300/0 conn(0x7fc46c1596b0 msgr2=0x7fc46c15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 --2- 172.21.15.82:0/1731699196 >> v2:172.21.15.183:3300/0 conn(0x7fc46c1596b0 0x7fc46c15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c15d0d0 con 0x7fc46c0cc900 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fc454001680 con 0x7fc46c0cc900 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 >> v1:172.21.15.82:6789/0 conn(0x7fc46c0cc900 legacy=0x7fc46c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc458003980 0x7fc458003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580047d0 0x7fc458004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc458005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ad600 con 0x7fc4580047d0 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0ad810 con 0x7fc458003980 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45800b990 con 0x7fc46c0b2a90 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580047d0 0x7fc458004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc458003980 0x7fc458003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc458005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 -- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 msgr2=0x7fc458005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:16.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc458005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 -- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc458003980 msgr2=0x7fc458003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:16.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc458003980 0x7fc458003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc461d9b640 1 -- 172.21.15.82:0/1731699196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458003530 con 0x7fc4580047d0 2023-07-20T11:24:16.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc458003980 0x7fc458003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:16.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.772+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc46c0b2a90 0x7fc458005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:16.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc461d9b640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580047d0 0x7fc458004c50 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c240 tx=0x7fc45401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26189db41bd15c68 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:16.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540058e0 con 0x7fc4580047d0 2023-07-20T11:24:16.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc454005a60 con 0x7fc4580047d0 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc469d9b640 1 -- 172.21.15.82:0/1731699196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454005e10 con 0x7fc4580047d0 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 -- 172.21.15.82:0/1731699196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580047d0 msgr2=0x7fc458004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 --2- 172.21.15.82:0/1731699196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4580047d0 0x7fc458004c50 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fc45400c240 tx=0x7fc45401f3b0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc46ad9d640 1 -- 172.21.15.82:0/1731699196 reap_dead start 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 -- 172.21.15.82:0/1731699196 shutdown_connections 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 -- 172.21.15.82:0/1731699196 >> 172.21.15.82:0/1731699196 conn(0x7fc46c0cada0 msgr2=0x7fc46c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:16.773 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 -- 172.21.15.82:0/1731699196 shutdown_connections 2023-07-20T11:24:16.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 -- 172.21.15.82:0/1731699196 wait complete. 2023-07-20T11:24:16.774 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.776+0000 7fc470a48640 1 Processor -- start 2023-07-20T11:24:16.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- start start 2023-07-20T11:24:16.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4580047d0 0x7fc46c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc46c151250 0x7fc46c153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c152340 con 0x7fc46c0707d0 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c152be0 con 0x7fc46c151250 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c071190 con 0x7fc4580047d0 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55544/0 (socket says 172.21.15.82:55544) 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 -- 172.21.15.82:0/1041940042 learned_addr learned my addr 172.21.15.82:0/1041940042 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc461d9b640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc46c151250 0x7fc46c153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4580047d0 0x7fc46c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 -- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4580047d0 msgr2=0x7fc46c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4580047d0 0x7fc46c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.777 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 -- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc46c151250 msgr2=0x7fc46c153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc46c151250 0x7fc46c153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 -- 172.21.15.82:0/1041940042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c153fb0 con 0x7fc46c0707d0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc46ad9d640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fc46c068d50 tx=0x7fc464010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46400e050 con 0x7fc46c0707d0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46400f040 con 0x7fc46c0707d0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c154230 con 0x7fc46c0707d0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464003be0 con 0x7fc46c0707d0 2023-07-20T11:24:16.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c152800 con 0x7fc46c0707d0 2023-07-20T11:24:16.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.780+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c152d20 con 0x7fc46c0707d0 2023-07-20T11:24:16.779 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.784+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc464003d40 con 0x7fc46c0707d0 2023-07-20T11:24:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.784+0000 7fc4637fe640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 0x7fc44c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.784+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fc464084540 con 0x7fc46c0707d0 2023-07-20T11:24:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.784+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 0x7fc44c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:16.780 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.784+0000 7fc46a59c640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 0x7fc44c068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc46c06d550 tx=0x7fc45c008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:16.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.788+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc46c152d20 con 0x7fc46c0707d0 2023-07-20T11:24:16.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.936+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc46c152d20 con 0x7fc46c0707d0 2023-07-20T11:24:16.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc4637fe640 1 -- 172.21.15.82:0/1041940042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+15993 (secure 0 0 0) 0x7fc46c152d20 con 0x7fc46c0707d0 2023-07-20T11:24:16.933 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:16.933 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":197,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:13.593523+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1787912929":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6837/2112812195":"2023-07-21T11:24:10.365926+0000","172.21.15.82:0/4190869568":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2588640047":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1036783379":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/1897798858":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6836/2112812195":"2023-07-21T11:24:10.365926+0000","172.21.15.82:0/723030784":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/3057939453":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/1202706903":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2311853827":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/370784443":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2133506175":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/43459402":"2023-07-21T11:24:07.436021+0000","172.21.15.82:0/2867668341":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:6833/2988654347":"2023-07-21T11:24:07.436021+0000","172.21.15.82:6832/3370264152":"2023-07-21T11:22:58.268166+0000","172.21.15.82:0/2669450055":"2023-07-21T11:22:58.268166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 msgr2=0x7fc44c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 0x7fc44c068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc46c06d550 tx=0x7fc45c008040 comp rx=0 tx=0).stop 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 msgr2=0x7fc46c070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fc46c068d50 tx=0x7fc464010590 comp rx=0 tx=0).stop 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 shutdown_connections 2023-07-20T11:24:16.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc44c0663a0 0x7fc44c068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c0707d0 0x7fc46c070c50 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc46c151250 0x7fc46c153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 --2- 172.21.15.82:0/1041940042 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc4580047d0 0x7fc46c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 >> 172.21.15.82:0/1041940042 conn(0x7fc46c0cada0 msgr2=0x7fc46c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:16.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 shutdown_connections 2023-07-20T11:24:16.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:16.940+0000 7fc470a48640 1 -- 172.21.15.82:0/1041940042 wait complete. 2023-07-20T11:24:16.954 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:16.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.100+0000 7fa9ba688640 1 Processor -- start 2023-07-20T11:24:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.100+0000 7fa9ba688640 1 -- start start 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9ba688640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa9b406f710 0x7fa9b406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9ba688640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b4070030 con 0x7fa9b40ca5a0 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9ba688640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b4071950 con 0x7fa9b415a6f0 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9ba688640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b415bad0 con 0x7fa9b406f710 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b37fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa9b40ca5a0 0x7fa9b415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51942/0 (socket says 172.21.15.82:51942) 2023-07-20T11:24:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b37fe640 1 -- 172.21.15.82:0/2266826692 learned_addr learned my addr 172.21.15.82:0/2266826692 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b3fff640 1 --2- 172.21.15.82:0/2266826692 >> v2:172.21.15.183:3300/0 conn(0x7fa9b406f710 0x7fa9b406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615854789 0 0) 0x7fa9b4070030 con 0x7fa9b40ca5a0 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa99c003530 con 0x7fa9b40ca5a0 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40322147 0 0) 0x7fa9b4071950 con 0x7fa9b415a6f0 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b4070030 con 0x7fa9b415a6f0 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b3fff640 1 -- 172.21.15.82:0/2266826692 >> v1:172.21.15.183:6789/0 conn(0x7fa9b415a6f0 legacy=0x7fa9b40c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b3fff640 1 -- 172.21.15.82:0/2266826692 >> v1:172.21.15.82:6789/0 conn(0x7fa9b40ca5a0 legacy=0x7fa9b415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323753787 0 0) 0x7fa99c003530 con 0x7fa9b40ca5a0 2023-07-20T11:24:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.104+0000 7fa9b3fff640 1 -- 172.21.15.82:0/2266826692 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b415b230 con 0x7fa9b406f710 2023-07-20T11:24:17.101 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9b3fff640 1 --2- 172.21.15.82:0/2266826692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b406f710 0x7fa9b406faf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40097c0 tx=0x7fa9a401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398b8553078ec151 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8001680 con 0x7fa9b406f710 2023-07-20T11:24:17.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40a7050 con 0x7fa9b406f710 2023-07-20T11:24:17.102 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9b2ffd640 1 -- 172.21.15.82:0/2266826692 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40ab600 con 0x7fa9b406f710 2023-07-20T11:24:17.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 -- 172.21.15.82:0/2266826692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b406f710 msgr2=0x7fa9b406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 --2- 172.21.15.82:0/2266826692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b406f710 0x7fa9b406faf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40097c0 tx=0x7fa9a401c370 comp rx=0 tx=0).stop 2023-07-20T11:24:17.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 -- 172.21.15.82:0/2266826692 shutdown_connections 2023-07-20T11:24:17.103 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 --2- 172.21.15.82:0/2266826692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b406f710 0x7fa9b406faf0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 -- 172.21.15.82:0/2266826692 >> 172.21.15.82:0/2266826692 conn(0x7fa9b40cad50 msgr2=0x7fa9b40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 -- 172.21.15.82:0/2266826692 shutdown_connections 2023-07-20T11:24:17.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 -- 172.21.15.82:0/2266826692 wait complete. 2023-07-20T11:24:17.104 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.108+0000 7fa9ba688640 1 Processor -- start 2023-07-20T11:24:17.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- start start 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b406f710 0x7fa9b4147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 0x7fa9b414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4147c60 con 0x7fa9b415a6f0 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4147750 con 0x7fa9b40ca5a0 2023-07-20T11:24:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40cc1e0 con 0x7fa9b406f710 2023-07-20T11:24:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55552/0 (socket says 172.21.15.82:55552) 2023-07-20T11:24:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 -- 172.21.15.82:0/3559030683 learned_addr learned my addr 172.21.15.82:0/3559030683 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b3fff640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b406f710 0x7fa9b4147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b37fe640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 0x7fa9b414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 -- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b406f710 msgr2=0x7fa9b4147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b406f710 0x7fa9b4147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 -- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 msgr2=0x7fa9b414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 0x7fa9b414b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 -- 172.21.15.82:0/3559030683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4009420 con 0x7fa9b415a6f0 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b37fe640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 0x7fa9b414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b8c25640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c730 tx=0x7fa9ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac003b80 con 0x7fa9b415a6f0 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac003ce0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00aa90 con 0x7fa9b415a6f0 2023-07-20T11:24:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b4149aa0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b414a060 con 0x7fa9b415a6f0 2023-07-20T11:24:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.112+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40cc3a0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.116+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa9ac00abf0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.116+0000 7fa9b0ff9640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 0x7fa9a0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.116+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fa9ac083c10 con 0x7fa9b415a6f0 2023-07-20T11:24:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.116+0000 7fa9b3fff640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 0x7fa9a0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.116+0000 7fa9b3fff640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 0x7fa9a0068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ad000 tx=0x7fa9a40a6000 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.120+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9ac050fc0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.268+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9b415ee30 con 0x7fa9b415a6f0 2023-07-20T11:24:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.268+0000 7fa9b0ff9640 1 -- 172.21.15.82:0/3559030683 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9ac0545e0 con 0x7fa9b415a6f0 2023-07-20T11:24:17.263 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 msgr2=0x7fa9a0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 0x7fa9a0068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ad000 tx=0x7fa9a40a6000 comp rx=0 tx=0).stop 2023-07-20T11:24:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 msgr2=0x7fa9b414bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c730 tx=0x7fa9ac00cbf0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 shutdown_connections 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fa9a00663a0 0x7fa9a0068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9b415a6f0 0x7fa9b414bdc0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa9b40ca5a0 0x7fa9b414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 --2- 172.21.15.82:0/3559030683 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa9b406f710 0x7fa9b4147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 >> 172.21.15.82:0/3559030683 conn(0x7fa9b40cad50 msgr2=0x7fa9b40addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 shutdown_connections 2023-07-20T11:24:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.272+0000 7fa9ba688640 1 -- 172.21.15.82:0/3559030683 wait complete. 2023-07-20T11:24:17.284 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:17.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 Processor -- start 2023-07-20T11:24:17.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 -- start start 2023-07-20T11:24:17.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 0x7f37500ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37500ce5a0 0x7f375006ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3750160ff0 con 0x7f375015a340 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375015a720 con 0x7f37500ce5a0 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3755e88640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37500ce9d0 con 0x7f375006c360 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37500ce5a0 0x7f375006ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f37500ce5a0 0x7f375006ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55566/0 (socket says 172.21.15.82:55566) 2023-07-20T11:24:17.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 -- 172.21.15.82:0/3457682154 learned_addr learned my addr 172.21.15.82:0/3457682154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:17.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3746ffd640 1 --2- 172.21.15.82:0/3457682154 >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 0x7f37500ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 -- 172.21.15.82:0/3457682154 >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 msgr2=0x7f37500ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:17.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 --2- 172.21.15.82:0/3457682154 >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 0x7f37500ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 -- 172.21.15.82:0/3457682154 >> v1:172.21.15.183:6789/0 conn(0x7f375015a340 legacy=0x7f375015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f374ffff640 1 -- 172.21.15.82:0/3457682154 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37501603e0 con 0x7f37500ce5a0 2023-07-20T11:24:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.432+0000 7f3746ffd640 1 --2- 172.21.15.82:0/3457682154 >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 0x7f37500ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f374ffff640 1 --2- 172.21.15.82:0/3457682154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37500ce5a0 0x7f375006ab70 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f37500d1400 tx=0x7f374801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a313da4c4d42e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f374effd640 1 -- 172.21.15.82:0/3457682154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480aa5f0 con 0x7f37500ce5a0 2023-07-20T11:24:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f374effd640 1 -- 172.21.15.82:0/3457682154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480aa750 con 0x7f37500ce5a0 2023-07-20T11:24:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f374effd640 1 -- 172.21.15.82:0/3457682154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480aaae0 con 0x7f37500ce5a0 2023-07-20T11:24:17.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 -- 172.21.15.82:0/3457682154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37500ce5a0 msgr2=0x7f375006ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 --2- 172.21.15.82:0/3457682154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37500ce5a0 0x7f375006ab70 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f37500d1400 tx=0x7f374801c490 comp rx=0 tx=0).stop 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 -- 172.21.15.82:0/3457682154 shutdown_connections 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 --2- 172.21.15.82:0/3457682154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37500ce5a0 0x7f375006ab70 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 --2- 172.21.15.82:0/3457682154 >> v2:172.21.15.183:3300/0 conn(0x7f375006c360 0x7f37500ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 -- 172.21.15.82:0/3457682154 >> 172.21.15.82:0/3457682154 conn(0x7f3750065310 msgr2=0x7f3750065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 -- 172.21.15.82:0/3457682154 shutdown_connections 2023-07-20T11:24:17.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.436+0000 7f3755e88640 1 -- 172.21.15.82:0/3457682154 wait complete. 2023-07-20T11:24:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 Processor -- start 2023-07-20T11:24:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- start start 2023-07-20T11:24:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f375006c360 0x7f37500c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37500ce5a0 0x7f375015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375015ba80 con 0x7f375015a340 2023-07-20T11:24:17.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375015e2e0 con 0x7f375006c360 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375015e580 con 0x7f37500ce5a0 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55580/0 (socket says 172.21.15.82:55580) 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 -- 172.21.15.82:0/3671183334 learned_addr learned my addr 172.21.15.82:0/3671183334 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3746ffd640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37500ce5a0 0x7f375015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374f7fe640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f375006c360 0x7f37500c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 -- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37500ce5a0 msgr2=0x7f375015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37500ce5a0 0x7f375015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 -- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f375006c360 msgr2=0x7f37500c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f375006c360 0x7f37500c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 -- 172.21.15.82:0/3671183334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480094d0 con 0x7f375015a340 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374ffff640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f37480ac040 tx=0x7f374801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480b3800 con 0x7f375015a340 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480b3960 con 0x7f375015a340 2023-07-20T11:24:17.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375015e860 con 0x7f375015a340 2023-07-20T11:24:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480b3cf0 con 0x7f375015a340 2023-07-20T11:24:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.440+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375015ee20 con 0x7f375015a340 2023-07-20T11:24:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375015f010 con 0x7f375015a340 2023-07-20T11:24:17.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37480c6390 con 0x7f375015a340 2023-07-20T11:24:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f374cff9640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 0x7f3730068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f37480a7070 con 0x7f375015a340 2023-07-20T11:24:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f374f7fe640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 0x7f3730068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.444+0000 7f374f7fe640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 0x7f3730068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37501675a0 tx=0x7f3740007e90 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.443 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.448+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37480ebcb0 con 0x7f375015a340 2023-07-20T11:24:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.596+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f375004da30 con 0x7f375015a340 2023-07-20T11:24:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f374cff9640 1 -- 172.21.15.82:0/3671183334 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37480ef2d0 con 0x7f375015a340 2023-07-20T11:24:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 msgr2=0x7f3730068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 0x7f3730068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f37501675a0 tx=0x7f3740007e90 comp rx=0 tx=0).stop 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 msgr2=0x7f3750157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f37480ac040 tx=0x7f374801acd0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 shutdown_connections 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f37300663a0 0x7f3730068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f375015a340 0x7f3750157cb0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f37500ce5a0 0x7f375015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 --2- 172.21.15.82:0/3671183334 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f375006c360 0x7f37500c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 >> 172.21.15.82:0/3671183334 conn(0x7f3750065310 msgr2=0x7f375006e220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 shutdown_connections 2023-07-20T11:24:17.596 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.600+0000 7f3755e88640 1 -- 172.21.15.82:0/3671183334 wait complete. 2023-07-20T11:24:17.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-20T11:24:17.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 Processor -- start 2023-07-20T11:24:17.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 -- start start 2023-07-20T11:24:17.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a815c700 0x7f95a815d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f95a80abb30 0x7f95a80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80ac7f0 con 0x7f95a80abf90 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a80ac510 con 0x7f95a80abb30 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95af6bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a815cf00 con 0x7f95a815c700 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95adc5a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f95a80abf90 0x7f95a806b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51946/0 (socket says 172.21.15.82:51946) 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95adc5a640 1 -- 172.21.15.82:0/2112420390 learned_addr learned my addr 172.21.15.82:0/2112420390 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95ad459640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a815c700 0x7f95a815d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95acc58640 1 --2- 172.21.15.82:0/2112420390 >> v2:172.21.15.183:3300/0 conn(0x7f95a80abb30 0x7f95a80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f959ffff640 1 -- 172.21.15.82:0/2112420390 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107286830 0 0) 0x7f95a80ac7f0 con 0x7f95a80abf90 2023-07-20T11:24:17.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f959ffff640 1 -- 172.21.15.82:0/2112420390 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9594003530 con 0x7f95a80abf90 2023-07-20T11:24:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95acc58640 1 -- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a815c700 msgr2=0x7f95a815d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95acc58640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a815c700 0x7f95a815d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95acc58640 1 -- 172.21.15.82:0/2112420390 >> v1:172.21.15.82:6789/0 conn(0x7f95a80abf90 legacy=0x7f95a806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.764+0000 7f95acc58640 1 -- 172.21.15.82:0/2112420390 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a815d1e0 con 0x7f95a80abb30 2023-07-20T11:24:17.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95acc58640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abb30 0x7f95a80afc10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f95980097a0 tx=0x7f959801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21e9e4477d6d3941 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f959ffff640 1 -- 172.21.15.82:0/2112420390 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980ab600 con 0x7f95a80abb30 2023-07-20T11:24:17.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f959ffff640 1 -- 172.21.15.82:0/2112420390 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95980a7050 con 0x7f95a80abb30 2023-07-20T11:24:17.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f959ffff640 1 -- 172.21.15.82:0/2112420390 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980ab980 con 0x7f95a80abb30 2023-07-20T11:24:17.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 -- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abb30 msgr2=0x7f95a80afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abb30 0x7f95a80afc10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f95980097a0 tx=0x7f959801c430 comp rx=0 tx=0).stop 2023-07-20T11:24:17.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 -- 172.21.15.82:0/2112420390 shutdown_connections 2023-07-20T11:24:17.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abb30 0x7f95a80afc10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 --2- 172.21.15.82:0/2112420390 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a815c700 0x7f95a815d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 -- 172.21.15.82:0/2112420390 >> 172.21.15.82:0/2112420390 conn(0x7f95a80cac10 msgr2=0x7f95a80cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 -- 172.21.15.82:0/2112420390 shutdown_connections 2023-07-20T11:24:17.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.768+0000 7f95af6bd640 1 -- 172.21.15.82:0/2112420390 wait complete. 2023-07-20T11:24:17.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 Processor -- start 2023-07-20T11:24:17.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- start start 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80abb30 0x7f95a8154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 0x7f95a80b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80cc8c0 con 0x7f95a815c700 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80b1a70 con 0x7f95a80abf90 2023-07-20T11:24:17.767 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80b2430 con 0x7f95a80abb30 2023-07-20T11:24:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55590/0 (socket says 172.21.15.82:55590) 2023-07-20T11:24:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 -- 172.21.15.82:0/4050362698 learned_addr learned my addr 172.21.15.82:0/4050362698 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95acc58640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 0x7f95a80b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95ad459640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80abb30 0x7f95a8154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 -- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80abb30 msgr2=0x7f95a8154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80abb30 0x7f95a8154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 -- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 msgr2=0x7f95a80b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 0x7f95a80b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 -- 172.21.15.82:0/4050362698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95980093b0 con 0x7f95a815c700 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95acc58640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 0x7f95a80b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95adc5a640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f95a000cb40 tx=0x7f95a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a000aca0 con 0x7f95a815c700 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a000ae00 con 0x7f95a815c700 2023-07-20T11:24:17.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a80b2710 con 0x7f95a815c700 2023-07-20T11:24:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0012620 con 0x7f95a815c700 2023-07-20T11:24:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.772+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a80b2cd0 con 0x7f95a815c700 2023-07-20T11:24:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a804da30 con 0x7f95a815c700 2023-07-20T11:24:17.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95a0007070 con 0x7f95a815c700 2023-07-20T11:24:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f959dffb640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 0x7f958c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f95a0083da0 con 0x7f95a815c700 2023-07-20T11:24:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f95ad459640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 0x7f958c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:17.772 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.776+0000 7f95ad459640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 0x7f958c068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009b60 tx=0x7f95a4009190 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:17.775 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.780+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95a0051200 con 0x7f95a815c700 2023-07-20T11:24:17.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.928+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f95a80cb970 con 0x7f95a815c700 2023-07-20T11:24:17.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f959dffb640 1 -- 172.21.15.82:0/4050362698 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95a0017020 con 0x7f95a815c700 2023-07-20T11:24:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 msgr2=0x7f958c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 0x7f958c068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009b60 tx=0x7f95a4009190 comp rx=0 tx=0).stop 2023-07-20T11:24:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 msgr2=0x7f95a815b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f95a000cb40 tx=0x7f95a000a060 comp rx=0 tx=0).stop 2023-07-20T11:24:17.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 shutdown_connections 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f958c0663d0 0x7f958c068890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95a815c700 0x7f95a815b270 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95a80abf90 0x7f95a80b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 --2- 172.21.15.82:0/4050362698 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95a80abb30 0x7f95a8154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 >> 172.21.15.82:0/4050362698 conn(0x7f95a80cac10 msgr2=0x7f95a8070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 shutdown_connections 2023-07-20T11:24:17.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:17.936+0000 7f95af6bd640 1 -- 172.21.15.82:0/4050362698 wait complete. 2023-07-20T11:24:17.950 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:24:17.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:18.003 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:18.069 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:24:18.069 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:18.070 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:18.078 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:18.079 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:18.079 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:18.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:18.089 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:18.089 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:18.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:18.128 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:18.129 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:18.143 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:18.144 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-20T11:24:18.144 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 Processor -- start 2023-07-20T11:24:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 -- start start 2023-07-20T11:24:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bd00b1f30 0x7f0bd00b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00cf4a0 con 0x7f0bd006f350 2023-07-20T11:24:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd006ea80 con 0x7f0bd015c120 2023-07-20T11:24:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd6fa3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b2900 con 0x7f0bd00b1f30 2023-07-20T11:24:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bd00b1f30 0x7f0bd00b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f0bd00b1f30 0x7f0bd00b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55592/0 (socket says 172.21.15.82:55592) 2023-07-20T11:24:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 -- 172.21.15.82:0/1931172044 learned_addr learned my addr 172.21.15.82:0/1931172044 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bd4d3f640 1 --1- 172.21.15.82:0/1931172044 >> v1:172.21.15.82:6789/0 conn(0x7f0bd006f350 0x7f0bd006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51948/0 (socket says 172.21.15.82:51948) 2023-07-20T11:24:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 -- 172.21.15.82:0/1931172044 >> v1:172.21.15.183:6789/0 conn(0x7f0bd015c120 legacy=0x7f0bd015c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 -- 172.21.15.82:0/1931172044 >> v1:172.21.15.82:6789/0 conn(0x7f0bd006f350 legacy=0x7f0bd006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcffff640 1 -- 172.21.15.82:0/1931172044 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00ce890 con 0x7f0bd00b1f30 2023-07-20T11:24:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.312+0000 7f0bcf7fe640 1 -- 172.21.15.82:0/1931172044 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878179724 0 0) 0x7f0bd00cf4a0 con 0x7f0bd006f350 2023-07-20T11:24:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bcffff640 1 --2- 172.21.15.82:0/1931172044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd00b23c0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009e50 tx=0x7f0bc401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aa3d5ab89c6606 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bcf7fe640 1 -- 172.21.15.82:0/1931172044 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a57d0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bcf7fe640 1 -- 172.21.15.82:0/1931172044 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40a5930 con 0x7f0bd00b1f30 2023-07-20T11:24:18.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bcf7fe640 1 -- 172.21.15.82:0/1931172044 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5cc0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/1931172044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 msgr2=0x7f0bd00b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/1931172044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd00b23c0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009e50 tx=0x7f0bc401c910 comp rx=0 tx=0).stop 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/1931172044 shutdown_connections 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/1931172044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd00b23c0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/1931172044 >> 172.21.15.82:0/1931172044 conn(0x7f0bd0089fa0 msgr2=0x7f0bd00d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/1931172044 shutdown_connections 2023-07-20T11:24:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.316+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/1931172044 wait complete. 2023-07-20T11:24:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 Processor -- start 2023-07-20T11:24:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- start start 2023-07-20T11:24:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 0x7f0bd00b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 0x7f0bd015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd014f270 con 0x7f0bd00b1f30 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00b47c0 con 0x7f0bd006f350 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00b4aa0 con 0x7f0bd015c120 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55602/0 (socket says 172.21.15.82:55602) 2023-07-20T11:24:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 -- 172.21.15.82:0/3989989287 learned_addr learned my addr 172.21.15.82:0/3989989287 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 -- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 msgr2=0x7f0bd015ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd4d3f640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 0x7f0bd00b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd5540640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 0x7f0bd015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 0x7f0bd015ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 -- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 msgr2=0x7f0bd00b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 0x7f0bd00b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 -- 172.21.15.82:0/3989989287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009b30 con 0x7f0bd00b1f30 2023-07-20T11:24:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd4d3f640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 0x7f0bd00b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd5540640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 0x7f0bd015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcffff640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40af040 tx=0x7f0bc40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40b8880 con 0x7f0bd00b1f30 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40b89e0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd00cfab0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40b8d50 con 0x7f0bd00b1f30 2023-07-20T11:24:18.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd00b5060 con 0x7f0bd00b1f30 2023-07-20T11:24:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.320+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0073c70 con 0x7f0bd00b1f30 2023-07-20T11:24:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.324+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0bc40b6440 con 0x7f0bd00b1f30 2023-07-20T11:24:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.324+0000 7f0bcd7fa640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 0x7f0bbc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.324+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f0bc411f7f0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.324+0000 7f0bd4d3f640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 0x7f0bbc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.324+0000 7f0bd4d3f640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 0x7f0bbc068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0000f70 tx=0x7f0bc0009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.328+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bc40eca70 con 0x7f0bd00b1f30 2023-07-20T11:24:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bd00b6310 con 0x7f0bd00b1f30 2023-07-20T11:24:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bcd7fa640 1 -- 172.21.15.82:0/3989989287 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+3537 (secure 0 0 0) 0x7f0bc40bcdf0 con 0x7f0bd00b1f30 2023-07-20T11:24:18.503 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:18.503 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":92,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8690,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/2504644170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2504644170},{"type":"v1","addr":"172.21.15.183:6833","nonce":2504644170}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":9871,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/4281300873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":4281300873},{"type":"v1","addr":"172.21.15.183:6835","nonce":4281300873}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86},{"gid":10845,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3446577723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3446577723},{"type":"v1","addr":"172.21.15.82:6835","nonce":3446577723}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":11307,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1094458088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1094458088},{"type":"v1","addr":"172.21.15.82:6837","nonce":1094458088}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[]} 2023-07-20T11:24:18.504 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 92 2023-07-20T11:24:18.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 msgr2=0x7f0bbc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 0x7f0bbc068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0000f70 tx=0x7f0bc0009040 comp rx=0 tx=0).stop 2023-07-20T11:24:18.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 msgr2=0x7f0bd015e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.508+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f0bc40af040 tx=0x7f0bc40196b0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 shutdown_connections 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f0bbc0663a0 0x7f0bbc068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f0bd015c120 0x7f0bd015ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0bd00b1f30 0x7f0bd015e540 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 --2- 172.21.15.82:0/3989989287 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0bd006f350 0x7f0bd00b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 >> 172.21.15.82:0/3989989287 conn(0x7f0bd0089fa0 msgr2=0x7f0bd006da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:18.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 shutdown_connections 2023-07-20T11:24:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.512+0000 7f0bd6fa3640 1 -- 172.21.15.82:0/3989989287 wait complete. 2023-07-20T11:24:18.525 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-20T11:24:18.525 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-20T11:24:18.525 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T11:24:18.525 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:24:18.526 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-20T11:24:18.526 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-20T11:24:18.526 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T11:24:18.526 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:24:18.527 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-20T11:24:18.527 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-20T11:24:18.527 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T11:24:18.528 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:24:18.528 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-20T11:24:18.528 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-20T11:24:18.529 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T11:24:18.529 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:24:18.538 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T11:24:18.539 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-20T11:24:18.541 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T11:24:18.541 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-20T11:24:18.543 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T11:24:18.543 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-20T11:24:18.544 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T11:24:18.545 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-20T11:24:18.587 INFO:tasks.ceph.mds.a:Started 2023-07-20T11:24:18.588 DEBUG:teuthology.parallel:result is None 2023-07-20T11:24:18.590 INFO:tasks.ceph.mds.c:Started 2023-07-20T11:24:18.590 DEBUG:teuthology.parallel:result is None 2023-07-20T11:24:18.593 INFO:tasks.ceph.mds.b:Started 2023-07-20T11:24:18.594 DEBUG:teuthology.parallel:result is None 2023-07-20T11:24:18.595 INFO:tasks.ceph.mds.d:Started 2023-07-20T11:24:18.596 DEBUG:teuthology.parallel:result is None 2023-07-20T11:24:18.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-20T11:24:18.677 INFO:tasks.ceph.mds.a.smithi082.stdout:starting mds.a at 2023-07-20T11:24:18.679 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:24:18.687 INFO:tasks.ceph.mds.b.smithi183.stdout:starting mds.b at 2023-07-20T11:24:18.688 INFO:tasks.ceph.mds.d.smithi183.stdout:starting mds.d at 2023-07-20T11:24:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 Processor -- start 2023-07-20T11:24:18.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 -- start start 2023-07-20T11:24:18.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 0x7f953806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 0x7f95380c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.747 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95380cc560 con 0x7f953806c700 2023-07-20T11:24:18.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380ad7e0 con 0x7f9538160bc0 2023-07-20T11:24:18.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f953e0f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95380cc790 con 0x7f9538160fa0 2023-07-20T11:24:18.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f9537fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f953806c700 0x7f95380aae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51962/0 (socket says 172.21.15.82:51962) 2023-07-20T11:24:18.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f9537fff640 1 -- 172.21.15.82:0/3243781785 learned_addr learned my addr 172.21.15.82:0/3243781785 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f95377fe640 1 --2- 172.21.15.82:0/3243781785 >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 0x7f953806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f952ffff640 1 --2- 172.21.15.82:0/3243781785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 0x7f95380c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f9536ffd640 1 -- 172.21.15.82:0/3243781785 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998371605 0 0) 0x7f95380cc560 con 0x7f953806c700 2023-07-20T11:24:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f9536ffd640 1 -- 172.21.15.82:0/3243781785 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9524003530 con 0x7f953806c700 2023-07-20T11:24:18.749 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f952ffff640 1 -- 172.21.15.82:0/3243781785 >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 msgr2=0x7f953806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f952ffff640 1 --2- 172.21.15.82:0/3243781785 >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 0x7f953806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f952ffff640 1 -- 172.21.15.82:0/3243781785 >> v1:172.21.15.82:6789/0 conn(0x7f953806c700 legacy=0x7f95380aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f952ffff640 1 -- 172.21.15.82:0/3243781785 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380cca70 con 0x7f9538160fa0 2023-07-20T11:24:18.750 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.752+0000 7f95377fe640 1 --2- 172.21.15.82:0/3243781785 >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 0x7f953806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f952ffff640 1 --2- 172.21.15.82:0/3243781785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 0x7f95380c12f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f95200097c0 tx=0x7f952001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0358b5bb5cdd311 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f9536ffd640 1 -- 172.21.15.82:0/3243781785 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200ac620 con 0x7f9538160fa0 2023-07-20T11:24:18.751 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f9536ffd640 1 -- 172.21.15.82:0/3243781785 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95200ac780 con 0x7f9538160fa0 2023-07-20T11:24:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f9536ffd640 1 -- 172.21.15.82:0/3243781785 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200acb10 con 0x7f9538160fa0 2023-07-20T11:24:18.752 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 -- 172.21.15.82:0/3243781785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 msgr2=0x7f95380c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 --2- 172.21.15.82:0/3243781785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 0x7f95380c12f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f95200097c0 tx=0x7f952001c3c0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 -- 172.21.15.82:0/3243781785 shutdown_connections 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 --2- 172.21.15.82:0/3243781785 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9538160fa0 0x7f95380c12f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 --2- 172.21.15.82:0/3243781785 >> v2:172.21.15.183:3300/0 conn(0x7f9538160bc0 0x7f953806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 -- 172.21.15.82:0/3243781785 >> 172.21.15.82:0/3243781785 conn(0x7f95380cada0 msgr2=0x7f95380cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 -- 172.21.15.82:0/3243781785 shutdown_connections 2023-07-20T11:24:18.753 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.756+0000 7f953e0f9640 1 -- 172.21.15.82:0/3243781785 wait complete. 2023-07-20T11:24:18.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 Processor -- start 2023-07-20T11:24:18.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- start start 2023-07-20T11:24:18.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f953806c700 0x7f95380b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 0x7f953815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95380b2f20 con 0x7f9538160bc0 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95380b1910 con 0x7f9538160fa0 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953809b5e0 con 0x7f953806c700 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55658/0 (socket says 172.21.15.82:55658) 2023-07-20T11:24:18.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 -- 172.21.15.82:0/1590130957 learned_addr learned my addr 172.21.15.82:0/1590130957 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f95377fe640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f953806c700 0x7f95380b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f9537fff640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 0x7f953815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 -- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f953806c700 msgr2=0x7f95380b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f953806c700 0x7f95380b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 -- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 msgr2=0x7f953815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 0x7f953815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:18.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 -- 172.21.15.82:0/1590130957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528009420 con 0x7f9538160bc0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f9537fff640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 0x7f953815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f952ffff640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f952001aa70 tx=0x7f9520019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200ac620 con 0x7f9538160bc0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95200b5400 con 0x7f9538160bc0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200b57b0 con 0x7f9538160bc0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9520009420 con 0x7f9538160bc0 2023-07-20T11:24:18.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.760+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380b0fe0 con 0x7f9538160bc0 2023-07-20T11:24:18.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95380b1aa0 con 0x7f9538160bc0 2023-07-20T11:24:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95200b3040 con 0x7f9538160bc0 2023-07-20T11:24:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f9534ff9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 0x7f9518068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f952011dfc0 con 0x7f9538160bc0 2023-07-20T11:24:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f95377fe640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 0x7f9518068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.764+0000 7f95377fe640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 0x7f9518068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95380700b0 tx=0x7f9528009190 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.768+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95200eb1c0 con 0x7f9538160bc0 2023-07-20T11:24:18.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:18.924+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9538073c70 con 0x7f9538160bc0 2023-07-20T11:24:19.622 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f9534ff9640 1 -- 172.21.15.82:0/1590130957 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v199) v1 ==== 97+0+0 (secure 0 0 0) 0x7f95200ee7e0 con 0x7f9538160bc0 2023-07-20T11:24:19.622 INFO:teuthology.orchestra.run.smithi082.stderr: removed all blocklist entries 2023-07-20T11:24:19.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 msgr2=0x7f9518068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 0x7f9518068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95380700b0 tx=0x7f9528009190 comp rx=0 tx=0).stop 2023-07-20T11:24:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 msgr2=0x7f953809b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 secure :-1 s=READY pgs=2351 cs=0 l=1 rev1=1 crypto rx=0x7f952001aa70 tx=0x7f9520019160 comp rx=0 tx=0).stop 2023-07-20T11:24:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 shutdown_connections 2023-07-20T11:24:19.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f95180663a0 0x7f9518068860 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9538160fa0 0x7f953815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9538160bc0 0x7f953809b0a0 unknown :-1 s=CLOSED pgs=2351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 --2- 172.21.15.82:0/1590130957 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f953806c700 0x7f95380b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.628+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 >> 172.21.15.82:0/1590130957 conn(0x7f95380cada0 msgr2=0x7f95380701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:19.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.632+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 shutdown_connections 2023-07-20T11:24:19.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.632+0000 7f953e0f9640 1 -- 172.21.15.82:0/1590130957 wait complete. 2023-07-20T11:24:19.649 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-20T11:24:19.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 Processor -- start 2023-07-20T11:24:19.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 -- start start 2023-07-20T11:24:19.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 0x7efc4006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc4015d440 0x7efc4015a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc40070660 con 0x7efc400c86d0 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc400ca6f0 con 0x7efc4015d440 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.796+0000 7efc3f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400cd490 con 0x7efc4015d060 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc4015d440 0x7efc4015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7efc4015d440 0x7efc4015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55666/0 (socket says 172.21.15.82:55666) 2023-07-20T11:24:19.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 -- 172.21.15.82:0/2458705686 learned_addr learned my addr 172.21.15.82:0/2458705686 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3e59c640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 0x7efc4006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 -- 172.21.15.82:0/2458705686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 msgr2=0x7efc4006c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:19.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 0x7efc4006c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 -- 172.21.15.82:0/2458705686 >> v1:172.21.15.183:6789/0 conn(0x7efc400c86d0 legacy=0x7efc40070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 -- 172.21.15.82:0/2458705686 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400cd770 con 0x7efc4015d440 2023-07-20T11:24:19.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3e59c640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 0x7efc4006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:19.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3ed9d640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d440 0x7efc4015a240 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7efc38009870 tx=0x7efc3801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c994fb4001a5bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:19.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3dd9b640 1 -- 172.21.15.82:0/2458705686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380a7070 con 0x7efc4015d440 2023-07-20T11:24:19.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3dd9b640 1 -- 172.21.15.82:0/2458705686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc380ab430 con 0x7efc4015d440 2023-07-20T11:24:19.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.800+0000 7efc3dd9b640 1 -- 172.21.15.82:0/2458705686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380ab7c0 con 0x7efc4015d440 2023-07-20T11:24:19.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- 172.21.15.82:0/2458705686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d440 msgr2=0x7efc4015a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d440 0x7efc4015a240 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7efc38009870 tx=0x7efc3801c540 comp rx=0 tx=0).stop 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- 172.21.15.82:0/2458705686 shutdown_connections 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d440 0x7efc4015a240 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- 172.21.15.82:0/2458705686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc4015d060 0x7efc4006c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- 172.21.15.82:0/2458705686 >> 172.21.15.82:0/2458705686 conn(0x7efc400ce080 msgr2=0x7efc400ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- 172.21.15.82:0/2458705686 shutdown_connections 2023-07-20T11:24:19.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- 172.21.15.82:0/2458705686 wait complete. 2023-07-20T11:24:19.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 Processor -- start 2023-07-20T11:24:19.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- start start 2023-07-20T11:24:19.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc400c86d0 0x7efc400c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc4015d440 0x7efc400c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc40152bc0 con 0x7efc4015d060 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c6fe0 con 0x7efc4015d440 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3f59e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc400c7b70 con 0x7efc400c86d0 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc35d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc35d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55682/0 (socket says 172.21.15.82:55682) 2023-07-20T11:24:19.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc35d9b640 1 -- 172.21.15.82:0/3835350461 learned_addr learned my addr 172.21.15.82:0/3835350461 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:19.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3e59c640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc400c86d0 0x7efc400c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.804+0000 7efc3ed9d640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc4015d440 0x7efc400c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 -- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc400c86d0 msgr2=0x7efc400c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc400c86d0 0x7efc400c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 -- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc4015d440 msgr2=0x7efc400c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc4015d440 0x7efc400c5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 -- 172.21.15.82:0/3835350461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380094d0 con 0x7efc4015d060 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc35d9b640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c7f0 tx=0x7efc2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:19.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28003b80 con 0x7efc4015d060 2023-07-20T11:24:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28003ce0 con 0x7efc4015d060 2023-07-20T11:24:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc400c75b0 con 0x7efc4015d060 2023-07-20T11:24:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800aa90 con 0x7efc4015d060 2023-07-20T11:24:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc40157ba0 con 0x7efc4015d060 2023-07-20T11:24:19.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc40157dc0 con 0x7efc4015d060 2023-07-20T11:24:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc2800abf0 con 0x7efc4015d060 2023-07-20T11:24:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 0x7efc20068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7efc28083a80 con 0x7efc4015d060 2023-07-20T11:24:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.808+0000 7efc3e59c640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 0x7efc20068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:19.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.812+0000 7efc3e59c640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 0x7efc20068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc4015a750 tx=0x7efc30008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:19.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:19.812+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc28051090 con 0x7efc4015d060 2023-07-20T11:24:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efc4004da30 con 0x7efc4015d060 2023-07-20T11:24:20.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc377fe640 1 -- 172.21.15.82:0/3835350461 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v49) v1 ==== 80+0+5304 (secure 0 0 0) 0x7efc280546b0 con 0x7efc4015d060 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: "auth_dump": [ 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.a", 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkECcABRAAK+lh0rdsPPADy1VnWe7+5Q==", 2023-07-20T11:24:20.014 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.015 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.b", 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkCVueERAA4q+535aduu3CS4GUVN9nWw==", 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.016 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.c", 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lk+NdpDBAAl0r2ZzdBYijJS3KaJV7duw==", 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:24:20.017 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mds.d", 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkEAn4GBAAjOiDKIg8B9mHeozFZs7iVA==", 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.018 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.019 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.0", 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQApA7lkJ2orNxAAgu8tEjTAgosp58pQU5/Qrg==", 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.1", 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAtA7lk4NneARAAD2qdgFVtZD43SXxg5toF+w==", 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.2", 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAwA7lkoGPNCBAApnwYlWe9AS8UXHWeTKo6jw==", 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.022 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.3", 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAzA7lknYydDxAA1PZiks91CN6ocHdJbJKnUg==", 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.023 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.4", 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA5A7lk88oiGhAA0LkkmpXqIKuN2GPi1ycG4w==", 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.024 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.5", 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA8A7lkus+1IBAAaHFNrDIkqx0/nUnQ1VugGg==", 2023-07-20T11:24:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.026 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.6", 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQA/A7lkDFQFJxAAYH4DlcpVMP/z2M7p0fq6xw==", 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "osd.7", 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQBCA7lkFFMBLRAAdWQ1rF8YzraWzEkpTVZJ3w==", 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow profile osd", 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile osd", 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.0", 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw==", 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow r", 2023-07-20T11:24:20.029 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.1", 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkN7y0JhAAyx9pEHqC5Jh6JLCQuNG+7A==", 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.030 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.2", 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkgF72IhAA4ndTiqYTUXkZ+W2ckVLIBQ==", 2023-07-20T11:24:20.031 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.032 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.3", 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkkl4dLRAApEItygZMb9dCOC3xheTPkg==", 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow", 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow r", 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow rw", 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow rwx" 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "client.admin", 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkXPYRIRAAItc3WsoXzdUEMgcLbhhX0g==", 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr": "allow *", 2023-07-20T11:24:20.034 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow *", 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.x", 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAmA7lkyWpfABAA8v4IJ8q1AQ5RvIMQ0z5BdA==", 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.035 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: "entity": "mgr.y", 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: "key": "AQAlA7lkwIH4NxAAIG7mXq+DJwztprinfNU0Vw==", 2023-07-20T11:24:20.036 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": { 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": "allow *", 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: "mon": "allow profile mgr", 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: "osd": "allow *" 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2023-07-20T11:24:20.037 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 msgr2=0x7efc20068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 0x7efc20068860 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efc4015a750 tx=0x7efc30008040 comp rx=0 tx=0).stop 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 msgr2=0x7efc40153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7efc2800c7f0 tx=0x7efc2800ccb0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 shutdown_connections 2023-07-20T11:24:20.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7efc200663a0 0x7efc20068860 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc4015d440 0x7efc400c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc4015d060 0x7efc40153820 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 --2- 172.21.15.82:0/3835350461 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7efc400c86d0 0x7efc400c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 >> 172.21.15.82:0/3835350461 conn(0x7efc400ce080 msgr2=0x7efc400ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 shutdown_connections 2023-07-20T11:24:20.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.020+0000 7efc3f59e640 1 -- 172.21.15.82:0/3835350461 wait complete. 2023-07-20T11:24:20.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:20.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 Processor -- start 2023-07-20T11:24:20.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 -- start start 2023-07-20T11:24:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d300b2a90 0x7f8d3015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 0x7f8d300ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d300ccd50 con 0x7f8d301596b0 2023-07-20T11:24:20.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300ad600 con 0x7f8d300b2a90 2023-07-20T11:24:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d36ba3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d300ad810 con 0x7f8d300cc900 2023-07-20T11:24:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d27fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d300b2a90 0x7f8d3015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d27fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8d300b2a90 0x7f8d3015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55694/0 (socket says 172.21.15.82:55694) 2023-07-20T11:24:20.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.184+0000 7f8d27fff640 1 -- 172.21.15.82:0/2338764124 learned_addr learned my addr 172.21.15.82:0/2338764124 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d35140640 1 --2- 172.21.15.82:0/2338764124 >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 0x7f8d300ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d27fff640 1 -- 172.21.15.82:0/2338764124 >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 msgr2=0x7f8d300ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:20.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d27fff640 1 --2- 172.21.15.82:0/2338764124 >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 0x7f8d300ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d27fff640 1 -- 172.21.15.82:0/2338764124 >> v1:172.21.15.82:6789/0 conn(0x7f8d301596b0 legacy=0x7f8d300b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d27fff640 1 -- 172.21.15.82:0/2338764124 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3015d0d0 con 0x7f8d300b2a90 2023-07-20T11:24:20.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d35140640 1 --2- 172.21.15.82:0/2338764124 >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 0x7f8d300ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d27fff640 1 --2- 172.21.15.82:0/2338764124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d300b2a90 0x7f8d3015dbb0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009870 tx=0x7f8d2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46f4e355d35665c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d277fe640 1 -- 172.21.15.82:0/2338764124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200aa430 con 0x7f8d300b2a90 2023-07-20T11:24:20.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d277fe640 1 -- 172.21.15.82:0/2338764124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200aa590 con 0x7f8d300b2a90 2023-07-20T11:24:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.188+0000 7f8d277fe640 1 -- 172.21.15.82:0/2338764124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200aa920 con 0x7f8d300b2a90 2023-07-20T11:24:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2338764124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d300b2a90 msgr2=0x7f8d3015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2338764124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d300b2a90 0x7f8d3015dbb0 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009870 tx=0x7f8d2001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2338764124 shutdown_connections 2023-07-20T11:24:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2338764124 >> v2:172.21.15.183:3300/0 conn(0x7f8d300cc900 0x7f8d300ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2338764124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d300b2a90 0x7f8d3015dbb0 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2338764124 >> 172.21.15.82:0/2338764124 conn(0x7f8d300cada0 msgr2=0x7f8d300cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2338764124 shutdown_connections 2023-07-20T11:24:20.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2338764124 wait complete. 2023-07-20T11:24:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 Processor -- start 2023-07-20T11:24:20.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- start start 2023-07-20T11:24:20.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 0x7f8d3009b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 0x7f8d301558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3006fa20 con 0x7f8d301596b0 2023-07-20T11:24:20.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3009ab10 con 0x7f8d300cc900 2023-07-20T11:24:20.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d36ba3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3009a550 con 0x7f8d300b2a90 2023-07-20T11:24:20.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d35140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d35140640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55710/0 (socket says 172.21.15.82:55710) 2023-07-20T11:24:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.192+0000 7f8d35140640 1 -- 172.21.15.82:0/2547750292 learned_addr learned my addr 172.21.15.82:0/2547750292 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:20.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d27fff640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 0x7f8d301558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 -- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 msgr2=0x7f8d3009b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d3493f640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 0x7f8d3009b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 0x7f8d3009b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 -- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 msgr2=0x7f8d301558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 0x7f8d301558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 -- 172.21.15.82:0/2547750292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200094d0 con 0x7f8d301596b0 2023-07-20T11:24:20.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d27fff640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 0x7f8d301558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:20.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d3493f640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 0x7f8d3009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:20.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d35140640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e810 tx=0x7f8d2800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800c6d0 con 0x7f8d301596b0 2023-07-20T11:24:20.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2800c830 con 0x7f8d301596b0 2023-07-20T11:24:20.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800cbe0 con 0x7f8d301596b0 2023-07-20T11:24:20.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3009a830 con 0x7f8d301596b0 2023-07-20T11:24:20.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d30099c10 con 0x7f8d301596b0 2023-07-20T11:24:20.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3006f780 con 0x7f8d301596b0 2023-07-20T11:24:20.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d2800cd40 con 0x7f8d301596b0 2023-07-20T11:24:20.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 0x7f8d1c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f8d28083a50 con 0x7f8d301596b0 2023-07-20T11:24:20.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.196+0000 7f8d3493f640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 0x7f8d1c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.200+0000 7f8d3493f640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 0x7f8d1c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c007fd0 tx=0x7f8d2c009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.200+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d3006f780 con 0x7f8d301596b0 2023-07-20T11:24:20.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.348+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d3006fb60 con 0x7f8d301596b0 2023-07-20T11:24:20.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d257fa640 1 -- 172.21.15.82:0/2547750292 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+14740 (secure 0 0 0) 0x7f8d3006fb60 con 0x7f8d301596b0 2023-07-20T11:24:20.345 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:20.346 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":201,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:19.638787+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":189,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:20.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 msgr2=0x7f8d1c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 0x7f8d1c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c007fd0 tx=0x7f8d2c009040 comp rx=0 tx=0).stop 2023-07-20T11:24:20.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 msgr2=0x7f8d300996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 secure :-1 s=READY pgs=2356 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e810 tx=0x7f8d2800ecd0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 shutdown_connections 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8d1c0663a0 0x7f8d1c068860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d301596b0 0x7f8d300996d0 unknown :-1 s=CLOSED pgs=2356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8d300cc900 0x7f8d301558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 --2- 172.21.15.82:0/2547750292 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8d300b2a90 0x7f8d3009b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 >> 172.21.15.82:0/2547750292 conn(0x7f8d300cada0 msgr2=0x7f8d30163230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 shutdown_connections 2023-07-20T11:24:20.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.352+0000 7f8d36ba3640 1 -- 172.21.15.82:0/2547750292 wait complete. 2023-07-20T11:24:20.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:20.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 Processor -- start 2023-07-20T11:24:20.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 -- start start 2023-07-20T11:24:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d24160ba0 0x7f6d240c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6d240c8e60 0x7f6d240afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d24161de0 0x7f6d240b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d240c9650 con 0x7f6d24161de0 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d241619c0 con 0x7f6d240c8e60 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d2b71e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c9370 con 0x7f6d24160ba0 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d24161de0 0x7f6d240b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f6d24161de0 0x7f6d240b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55722/0 (socket says 172.21.15.82:55722) 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 -- 172.21.15.82:0/61765754 learned_addr learned my addr 172.21.15.82:0/61765754 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d294ba640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d24160ba0 0x7f6d240c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d28cb9640 1 --2- 172.21.15.82:0/61765754 >> v2:172.21.15.183:3300/0 conn(0x7f6d240c8e60 0x7f6d240afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 -- 172.21.15.82:0/61765754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d24160ba0 msgr2=0x7f6d240c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d24160ba0 0x7f6d240c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 -- 172.21.15.82:0/61765754 >> v2:172.21.15.183:3300/0 conn(0x7f6d240c8e60 msgr2=0x7f6d240afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/61765754 >> v2:172.21.15.183:3300/0 conn(0x7f6d240c8e60 0x7f6d240afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.516+0000 7f6d29cbb640 1 -- 172.21.15.82:0/61765754 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24161300 con 0x7f6d24161de0 2023-07-20T11:24:20.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240b0290 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f6d2406dc20 tx=0x7f6d1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96ceca856996d99 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d1bfff640 1 -- 172.21.15.82:0/61765754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0a5840 con 0x7f6d24161de0 2023-07-20T11:24:20.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d1bfff640 1 -- 172.21.15.82:0/61765754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0a59a0 con 0x7f6d24161de0 2023-07-20T11:24:20.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d1bfff640 1 -- 172.21.15.82:0/61765754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0a5d30 con 0x7f6d24161de0 2023-07-20T11:24:20.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 -- 172.21.15.82:0/61765754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 msgr2=0x7f6d240b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240b0290 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f6d2406dc20 tx=0x7f6d1c01c9a0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 -- 172.21.15.82:0/61765754 shutdown_connections 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/61765754 >> v2:172.21.15.183:3300/0 conn(0x7f6d240c8e60 0x7f6d240afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240b0290 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/61765754 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d24160ba0 0x7f6d240c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 -- 172.21.15.82:0/61765754 >> 172.21.15.82:0/61765754 conn(0x7f6d240cad50 msgr2=0x7f6d240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 -- 172.21.15.82:0/61765754 shutdown_connections 2023-07-20T11:24:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.520+0000 7f6d2b71e640 1 -- 172.21.15.82:0/61765754 wait complete. 2023-07-20T11:24:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 Processor -- start 2023-07-20T11:24:20.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- start start 2023-07-20T11:24:20.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 0x7f6d240c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 0x7f6d24070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d241588c0 con 0x7f6d24161de0 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c7300 con 0x7f6d24160ba0 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d240c6260 con 0x7f6d240c8e60 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55730/0 (socket says 172.21.15.82:55730) 2023-07-20T11:24:20.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 -- 172.21.15.82:0/3498079021 learned_addr learned my addr 172.21.15.82:0/3498079021 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:20.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d294ba640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 0x7f6d240c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d28cb9640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 0x7f6d24070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 -- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 msgr2=0x7f6d240c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 0x7f6d240c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 -- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 msgr2=0x7f6d24070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 0x7f6d24070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 -- 172.21.15.82:0/3498079021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c009b30 con 0x7f6d24161de0 2023-07-20T11:24:20.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d28cb9640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 0x7f6d24070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d294ba640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 0x7f6d240c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d29cbb640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0af040 tx=0x7f6d1c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0b8670 con 0x7f6d24161de0 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0b87f0 con 0x7f6d24161de0 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c0b8ba0 con 0x7f6d24161de0 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d240c5f80 con 0x7f6d24161de0 2023-07-20T11:24:20.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.524+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d240c6f90 con 0x7f6d24161de0 2023-07-20T11:24:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d240c74b0 con 0x7f6d24161de0 2023-07-20T11:24:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6d1c0b8d00 con 0x7f6d24161de0 2023-07-20T11:24:20.523 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d19ffb640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 0x7f6d08068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f6d1c11f360 con 0x7f6d24161de0 2023-07-20T11:24:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d294ba640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 0x7f6d08068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.524 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.528+0000 7f6d294ba640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 0x7f6d08068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009840 tx=0x7f6d20008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.532+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d240c74b0 con 0x7f6d24161de0 2023-07-20T11:24:20.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.684+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d240c74b0 con 0x7f6d24161de0 2023-07-20T11:24:20.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.684+0000 7f6d19ffb640 1 -- 172.21.15.82:0/3498079021 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v201) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d240c74b0 con 0x7f6d24161de0 2023-07-20T11:24:20.679 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 msgr2=0x7f6d08068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 0x7f6d08068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009840 tx=0x7f6d20008040 comp rx=0 tx=0).stop 2023-07-20T11:24:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 msgr2=0x7f6d240c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0af040 tx=0x7f6d1c019740 comp rx=0 tx=0).stop 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 shutdown_connections 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f6d080663a0 0x7f6d08068860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6d24161de0 0x7f6d240c53a0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6d24160ba0 0x7f6d24070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 --2- 172.21.15.82:0/3498079021 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f6d240c8e60 0x7f6d240c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 >> 172.21.15.82:0/3498079021 conn(0x7f6d240cad50 msgr2=0x7f6d2406f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 shutdown_connections 2023-07-20T11:24:20.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.688+0000 7f6d2b71e640 1 -- 172.21.15.82:0/3498079021 wait complete. 2023-07-20T11:24:20.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:20.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 Processor -- start 2023-07-20T11:24:20.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 -- start start 2023-07-20T11:24:20.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c0006f710 0x7f1c0006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c00070030 con 0x7f1c000ca5a0 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c00071950 con 0x7f1c0015a6f0 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1c05626640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0015bad0 con 0x7f1c0006f710 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfeffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c0006f710 0x7f1c0006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfe7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f1c000ca5a0 0x7f1c0015e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51986/0 (socket says 172.21.15.82:51986) 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfe7fc640 1 -- 172.21.15.82:0/4108308752 learned_addr learned my addr 172.21.15.82:0/4108308752 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:20.843 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfeffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1c0006f710 0x7f1c0006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55740/0 (socket says 172.21.15.82:55740) 2023-07-20T11:24:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfeffd640 1 -- 172.21.15.82:0/4108308752 >> v1:172.21.15.183:6789/0 conn(0x7f1c0015a6f0 legacy=0x7f1c000c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfeffd640 1 -- 172.21.15.82:0/4108308752 >> v1:172.21.15.82:6789/0 conn(0x7f1c000ca5a0 legacy=0x7f1c0015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.848+0000 7f1bfeffd640 1 -- 172.21.15.82:0/4108308752 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0015b230 con 0x7f1c0006f710 2023-07-20T11:24:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1bfeffd640 1 --2- 172.21.15.82:0/4108308752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c0006f710 0x7f1c0006faf0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00097c0 tx=0x7f1bf001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1239ab90c7abb14 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1bfdffb640 1 -- 172.21.15.82:0/4108308752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00ab610 con 0x7f1c0006f710 2023-07-20T11:24:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1bfdffb640 1 -- 172.21.15.82:0/4108308752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf00ab770 con 0x7f1c0006f710 2023-07-20T11:24:20.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1bfdffb640 1 -- 172.21.15.82:0/4108308752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf00abb00 con 0x7f1c0006f710 2023-07-20T11:24:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 -- 172.21.15.82:0/4108308752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c0006f710 msgr2=0x7f1c0006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 --2- 172.21.15.82:0/4108308752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c0006f710 0x7f1c0006faf0 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00097c0 tx=0x7f1bf001c410 comp rx=0 tx=0).stop 2023-07-20T11:24:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 -- 172.21.15.82:0/4108308752 shutdown_connections 2023-07-20T11:24:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 --2- 172.21.15.82:0/4108308752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c0006f710 0x7f1c0006faf0 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 -- 172.21.15.82:0/4108308752 >> 172.21.15.82:0/4108308752 conn(0x7f1c000cad50 msgr2=0x7f1c000cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 -- 172.21.15.82:0/4108308752 shutdown_connections 2023-07-20T11:24:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 -- 172.21.15.82:0/4108308752 wait complete. 2023-07-20T11:24:20.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.852+0000 7f1c05626640 1 Processor -- start 2023-07-20T11:24:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- start start 2023-07-20T11:24:20.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c0006f710 0x7f1c000ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c0015a6f0 0x7f1c000ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00150730 con 0x7f1c000ca5a0 2023-07-20T11:24:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00150a10 con 0x7f1c0015a6f0 2023-07-20T11:24:20.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c000aca30 con 0x7f1c0006f710 2023-07-20T11:24:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55742/0 (socket says 172.21.15.82:55742) 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 -- 172.21.15.82:0/304834675 learned_addr learned my addr 172.21.15.82:0/304834675 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bff7fe640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c0015a6f0 0x7f1c000ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfeffd640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c0006f710 0x7f1c000ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 -- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c0006f710 msgr2=0x7f1c000ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c0006f710 0x7f1c000ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 -- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c0015a6f0 msgr2=0x7f1c000ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:20.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c0015a6f0 0x7f1c000ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 -- 172.21.15.82:0/304834675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0009420 con 0x7f1c000ca5a0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1bfe7fc640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c500 tx=0x7f1bf400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4005cf0 con 0x7f1c000ca5a0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4005e50 con 0x7f1c000ca5a0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c000cc810 con 0x7f1c000ca5a0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40072f0 con 0x7f1c000ca5a0 2023-07-20T11:24:20.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c000ccdd0 con 0x7f1c000ca5a0 2023-07-20T11:24:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.856+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0004da30 con 0x7f1c000ca5a0 2023-07-20T11:24:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.860+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1bf4007450 con 0x7f1c000ca5a0 2023-07-20T11:24:20.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.860+0000 7f1be77fe640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 0x7f1bec068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.860+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f1bf4082fc0 con 0x7f1c000ca5a0 2023-07-20T11:24:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.860+0000 7f1bfeffd640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 0x7f1bec068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:20.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.860+0000 7f1bfeffd640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 0x7f1bec068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00af000 tx=0x7f1bf00a7000 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:20.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:20.864+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bf40b3700 con 0x7f1c000ca5a0 2023-07-20T11:24:21.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1c000cb940 con 0x7f1c000ca5a0 2023-07-20T11:24:21.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1be77fe640 1 -- 172.21.15.82:0/304834675 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v201) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1bf40170a0 con 0x7f1c000ca5a0 2023-07-20T11:24:21.006 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:21.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 msgr2=0x7f1bec068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 0x7f1bec068890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00af000 tx=0x7f1bf00a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:21.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 msgr2=0x7f1c000cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c500 tx=0x7f1bf400c9c0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 shutdown_connections 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1bec0663d0 0x7f1bec068890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1c0015a6f0 0x7f1c000ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c000ca5a0 0x7f1c000cbea0 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 --2- 172.21.15.82:0/304834675 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1c0006f710 0x7f1c000ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 >> 172.21.15.82:0/304834675 conn(0x7f1c000cad50 msgr2=0x7f1c0015e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:21.009 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 shutdown_connections 2023-07-20T11:24:21.010 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.012+0000 7f1c05626640 1 -- 172.21.15.82:0/304834675 wait complete. 2023-07-20T11:24:21.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-20T11:24:21.166 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 Processor -- start 2023-07-20T11:24:21.167 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 -- start start 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977406f350 0x7f977406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 0x7f977415c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740cf4a0 con 0x7f977406b970 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977406ea80 con 0x7f977406f350 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9779407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740ce890 con 0x7f97740b2640 2023-07-20T11:24:21.168 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977406f350 0x7f977406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f977406f350 0x7f977406b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55754/0 (socket says 172.21.15.82:55754) 2023-07-20T11:24:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 -- 172.21.15.82:0/3429067062 learned_addr learned my addr 172.21.15.82:0/3429067062 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:21.169 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f97737fe640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 0x7f977415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 -- 172.21.15.82:0/3429067062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 msgr2=0x7f977415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 0x7f977415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 -- 172.21.15.82:0/3429067062 >> v1:172.21.15.82:6789/0 conn(0x7f977406b970 legacy=0x7f97740b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f9772ffd640 1 -- 172.21.15.82:0/3429067062 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740ceb70 con 0x7f977406f350 2023-07-20T11:24:21.170 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.172+0000 7f97737fe640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 0x7f977415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:21.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9772ffd640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977406f350 0x7f977406b430 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f9764009e50 tx=0x7f976401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff80681490a719 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.171 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9771ffb640 1 -- 172.21.15.82:0/3429067062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a5720 con 0x7f977406f350 2023-07-20T11:24:21.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9771ffb640 1 -- 172.21.15.82:0/3429067062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640a5880 con 0x7f977406f350 2023-07-20T11:24:21.172 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9771ffb640 1 -- 172.21.15.82:0/3429067062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a5c10 con 0x7f977406f350 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 -- 172.21.15.82:0/3429067062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977406f350 msgr2=0x7f977406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977406f350 0x7f977406b430 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f9764009e50 tx=0x7f976401c950 comp rx=0 tx=0).stop 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 -- 172.21.15.82:0/3429067062 shutdown_connections 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f97740b2640 0x7f977415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 --2- 172.21.15.82:0/3429067062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f977406f350 0x7f977406b430 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 -- 172.21.15.82:0/3429067062 >> 172.21.15.82:0/3429067062 conn(0x7f9774089fa0 msgr2=0x7f97740d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:21.173 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 -- 172.21.15.82:0/3429067062 shutdown_connections 2023-07-20T11:24:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.176+0000 7f9779407640 1 -- 172.21.15.82:0/3429067062 wait complete. 2023-07-20T11:24:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 Processor -- start 2023-07-20T11:24:21.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 -- start start 2023-07-20T11:24:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 0x7f97740c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.175 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 0x7f97741f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c7990 con 0x7f97740b2640 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97741fa2b0 con 0x7f977406b970 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97741f9cf0 con 0x7f977406f350 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55756/0 (socket says 172.21.15.82:55756) 2023-07-20T11:24:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 -- 172.21.15.82:0/356575500 learned_addr learned my addr 172.21.15.82:0/356575500 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:21.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 -- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 msgr2=0x7f97741f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9772ffd640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 0x7f97740c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97727fc640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 0x7f97741f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 0x7f97741f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 -- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 msgr2=0x7f97740c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 0x7f97740c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 -- 172.21.15.82:0/356575500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764009b30 con 0x7f97740b2640 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9772ffd640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 0x7f97740c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97727fc640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 0x7f97741f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f97737fe640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f976c00d5d0 tx=0x7f976c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c012630 con 0x7f97740b2640 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c012790 con 0x7f97740b2640 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97740cfab0 con 0x7f97740b2640 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.180+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c012b40 con 0x7f97740b2640 2023-07-20T11:24:21.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97740c7620 con 0x7f97740b2640 2023-07-20T11:24:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97740cf910 con 0x7f97740b2640 2023-07-20T11:24:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f976c012ca0 con 0x7f97740b2640 2023-07-20T11:24:21.180 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f975b7fe640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 0x7f9760068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f976c083ff0 con 0x7f97740b2640 2023-07-20T11:24:21.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f9772ffd640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 0x7f9760068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.184+0000 7f9772ffd640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 0x7f9760068890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97640ae000 tx=0x7f97640a7070 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.188+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f976c0b4700 con 0x7f97740b2640 2023-07-20T11:24:21.332 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.336+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9774073c70 con 0x7f97740b2640 2023-07-20T11:24:21.333 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.336+0000 7f975b7fe640 1 -- 172.21.15.82:0/356575500 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v201) v1 ==== 84+0+126 (secure 0 0 0) 0x7f97740cf910 con 0x7f97740b2640 2023-07-20T11:24:21.333 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:21.333 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:24:21.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:21.333 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 2, 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": "rbd" 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:21.334 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:24:21.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 msgr2=0x7f9760068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 0x7f9760068890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f97640ae000 tx=0x7f97640a7070 comp rx=0 tx=0).stop 2023-07-20T11:24:21.335 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 msgr2=0x7f97741fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f976c00d5d0 tx=0x7f976c00da90 comp rx=0 tx=0).stop 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 shutdown_connections 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f97600663d0 0x7f9760068890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97740b2640 0x7f97741fcf20 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f977406f350 0x7f97741f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.336 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 --2- 172.21.15.82:0/356575500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f977406b970 0x7f97740c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 >> 172.21.15.82:0/356575500 conn(0x7f9774089fa0 msgr2=0x7f97740ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 shutdown_connections 2023-07-20T11:24:21.337 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.340+0000 7f9779407640 1 -- 172.21.15.82:0/356575500 wait complete. 2023-07-20T11:24:21.354 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-20T11:24:21.354 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-20T11:24:21.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 Processor -- start 2023-07-20T11:24:21.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 -- start start 2023-07-20T11:24:21.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba8159450 0x7f1ba815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f1ba80afd50 0x7f1ba80b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba80b06b0 con 0x7f1ba8159830 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80cce90 con 0x7f1ba8159450 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1bad5a3640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80cc8d0 con 0x7f1ba80afd50 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1ba6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba8159450 0x7f1ba815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.501 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1ba6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f1ba8159450 0x7f1ba815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55766/0 (socket says 172.21.15.82:55766) 2023-07-20T11:24:21.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.504+0000 7f1ba6ffd640 1 -- 172.21.15.82:0/1860661341 learned_addr learned my addr 172.21.15.82:0/1860661341 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:21.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba77fe640 1 --2- 172.21.15.82:0/1860661341 >> v2:172.21.15.183:3300/0 conn(0x7f1ba80afd50 0x7f1ba80b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba6ffd640 1 -- 172.21.15.82:0/1860661341 >> v2:172.21.15.183:3300/0 conn(0x7f1ba80afd50 msgr2=0x7f1ba80b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:21.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba6ffd640 1 --2- 172.21.15.82:0/1860661341 >> v2:172.21.15.183:3300/0 conn(0x7f1ba80afd50 0x7f1ba80b0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba6ffd640 1 -- 172.21.15.82:0/1860661341 >> v1:172.21.15.82:6789/0 conn(0x7f1ba8159830 legacy=0x7f1ba80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba6ffd640 1 -- 172.21.15.82:0/1860661341 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80ccbb0 con 0x7f1ba8159450 2023-07-20T11:24:21.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba6ffd640 1 --2- 172.21.15.82:0/1860661341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba815a4c0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80c1da0 tx=0x7f1b9801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f47e7809640b280 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba67fc640 1 -- 172.21.15.82:0/1860661341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a7c70 con 0x7f1ba8159450 2023-07-20T11:24:21.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba67fc640 1 -- 172.21.15.82:0/1860661341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b980a7dd0 con 0x7f1ba8159450 2023-07-20T11:24:21.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.508+0000 7f1ba67fc640 1 -- 172.21.15.82:0/1860661341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980af660 con 0x7f1ba8159450 2023-07-20T11:24:21.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- 172.21.15.82:0/1860661341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 msgr2=0x7f1ba815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/1860661341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba815a4c0 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80c1da0 tx=0x7f1b9801eba0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- 172.21.15.82:0/1860661341 shutdown_connections 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/1860661341 >> v2:172.21.15.183:3300/0 conn(0x7f1ba80afd50 0x7f1ba80b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/1860661341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba815a4c0 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- 172.21.15.82:0/1860661341 >> 172.21.15.82:0/1860661341 conn(0x7f1ba80cad50 msgr2=0x7f1ba80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- 172.21.15.82:0/1860661341 shutdown_connections 2023-07-20T11:24:21.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- 172.21.15.82:0/1860661341 wait complete. 2023-07-20T11:24:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 Processor -- start 2023-07-20T11:24:21.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- start start 2023-07-20T11:24:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba80afd50 0x7f1ba8163450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba8157430 0x7f1ba80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8158540 con 0x7f1ba8159450 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8157930 con 0x7f1ba8157430 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1bad5a3640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8157c10 con 0x7f1ba80afd50 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55776/0 (socket says 172.21.15.82:55776) 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 -- 172.21.15.82:0/3186163686 learned_addr learned my addr 172.21.15.82:0/3186163686 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1ba77fe640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba8157430 0x7f1ba80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1ba6ffd640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba80afd50 0x7f1ba8163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 -- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba80afd50 msgr2=0x7f1ba8163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba80afd50 0x7f1ba8163450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 -- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba8157430 msgr2=0x7f1ba80705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba8157430 0x7f1ba80705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.512+0000 7f1b9ffff640 1 -- 172.21.15.82:0/3186163686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9800b770 con 0x7f1ba8159450 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9ffff640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c3c0 tx=0x7f1b9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900052d0 con 0x7f1ba8159450 2023-07-20T11:24:21.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b90005430 con 0x7f1ba8159450 2023-07-20T11:24:21.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8157ef0 con 0x7f1ba8159450 2023-07-20T11:24:21.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b90003840 con 0x7f1ba8159450 2023-07-20T11:24:21.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba8163c40 con 0x7f1ba8159450 2023-07-20T11:24:21.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba804da30 con 0x7f1ba8159450 2023-07-20T11:24:21.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b900039a0 con 0x7f1ba8159450 2023-07-20T11:24:21.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 0x7f1b88068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:21.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f1b900830d0 con 0x7f1ba8159450 2023-07-20T11:24:21.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.516+0000 7f1ba6ffd640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 0x7f1b88068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:21.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.520+0000 7f1ba6ffd640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 0x7f1b88068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b980b1000 tx=0x7f1b98008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:21.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.520+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b90050750 con 0x7f1ba8159450 2023-07-20T11:24:21.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:21.672+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1ba8158680 con 0x7f1ba8159450 2023-07-20T11:24:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.648+0000 7f1b9f7fe640 1 -- 172.21.15.82:0/3186163686 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v202) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ba8158680 con 0x7f1ba8159450 2023-07-20T11:24:22.641 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 msgr2=0x7f1b88068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 0x7f1b88068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1b980b1000 tx=0x7f1b98008040 comp rx=0 tx=0).stop 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 msgr2=0x7f1ba8153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000c3c0 tx=0x7f1b9000c880 comp rx=0 tx=0).stop 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 shutdown_connections 2023-07-20T11:24:22.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f1b880663a0 0x7f1b88068860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1ba8157430 0x7f1ba80705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ba8159450 0x7f1ba8153940 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 --2- 172.21.15.82:0/3186163686 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f1ba80afd50 0x7f1ba8163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 >> 172.21.15.82:0/3186163686 conn(0x7f1ba80cad50 msgr2=0x7f1ba8071340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 shutdown_connections 2023-07-20T11:24:22.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.656+0000 7f1bad5a3640 1 -- 172.21.15.82:0/3186163686 wait complete. 2023-07-20T11:24:22.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-20T11:24:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 Processor -- start 2023-07-20T11:24:22.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 -- start start 2023-07-20T11:24:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff318159830 0x7ff3180cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180cc8d0 con 0x7ff318159450 2023-07-20T11:24:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cce90 con 0x7ff318159830 2023-07-20T11:24:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff3202cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180ccbb0 con 0x7ff3180cc3e0 2023-07-20T11:24:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31e067640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff318159450 0x7ff31815a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:51998/0 (socket says 172.21.15.82:51998) 2023-07-20T11:24:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31e067640 1 -- 172.21.15.82:0/2221128094 learned_addr learned my addr 172.21.15.82:0/2221128094 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:22.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31d866640 1 --2- 172.21.15.82:0/2221128094 >> v2:172.21.15.82:3300/0 conn(0x7ff318159830 0x7ff3180cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31e868640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31d866640 1 -- 172.21.15.82:0/2221128094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 msgr2=0x7ff3180afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31d866640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31d866640 1 -- 172.21.15.82:0/2221128094 >> v1:172.21.15.82:6789/0 conn(0x7ff318159450 legacy=0x7ff31815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.828+0000 7ff31d866640 1 -- 172.21.15.82:0/2221128094 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318159cc0 con 0x7ff318159830 2023-07-20T11:24:22.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff31d866640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159830 0x7ff3180cbea0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7ff3080097c0 tx=0x7ff30801e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9642f6a9b3ce569 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:22.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff31d065640 1 -- 172.21.15.82:0/2221128094 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080ab640 con 0x7ff318159830 2023-07-20T11:24:22.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff31d065640 1 -- 172.21.15.82:0/2221128094 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3080ab7a0 con 0x7ff318159830 2023-07-20T11:24:22.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff31d065640 1 -- 172.21.15.82:0/2221128094 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080abb30 con 0x7ff318159830 2023-07-20T11:24:22.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 -- 172.21.15.82:0/2221128094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159830 msgr2=0x7ff3180cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159830 0x7ff3180cbea0 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7ff3080097c0 tx=0x7ff30801e660 comp rx=0 tx=0).stop 2023-07-20T11:24:22.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 -- 172.21.15.82:0/2221128094 shutdown_connections 2023-07-20T11:24:22.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 --2- 172.21.15.82:0/2221128094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159830 0x7ff3180cbea0 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 -- 172.21.15.82:0/2221128094 >> 172.21.15.82:0/2221128094 conn(0x7ff3180cad50 msgr2=0x7ff3180cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:22.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 -- 172.21.15.82:0/2221128094 shutdown_connections 2023-07-20T11:24:22.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.832+0000 7ff3202cb640 1 -- 172.21.15.82:0/2221128094 wait complete. 2023-07-20T11:24:22.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 Processor -- start 2023-07-20T11:24:22.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- start start 2023-07-20T11:24:22.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 0x7ff3180c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180c1e00 con 0x7ff318159450 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff318163d60 con 0x7ff318158b00 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3180c20a0 con 0x7ff3180cc3e0 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55794/0 (socket says 172.21.15.82:55794) 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 -- 172.21.15.82:0/3895691671 learned_addr learned my addr 172.21.15.82:0/3895691671 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:22.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31e067640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 -- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 msgr2=0x7ff3180aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31e868640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 0x7ff3180c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 -- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 msgr2=0x7ff3180c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 0x7ff3180c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:22.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 -- 172.21.15.82:0/3895691671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308009420 con 0x7ff318159450 2023-07-20T11:24:22.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31e067640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:22.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31e868640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 0x7ff3180c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:22.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff31d866640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7ff30801cd10 tx=0x7ff30801b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080bb5f0 con 0x7ff318159450 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3080bb770 con 0x7ff318159450 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3180c2380 con 0x7ff318159450 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080bbb20 con 0x7ff318159450 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.836+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3180c2940 con 0x7ff318159450 2023-07-20T11:24:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31804da30 con 0x7ff318159450 2023-07-20T11:24:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff3080a9070 con 0x7ff318159450 2023-07-20T11:24:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff30effd640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 0x7ff2fc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:22.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5652+0+0 (secure 0 0 0) 0x7ff30811ed80 con 0x7ff318159450 2023-07-20T11:24:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff31e067640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 0x7ff2fc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:22.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.840+0000 7ff31e067640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 0x7ff2fc068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff314005c10 tx=0x7ff314009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:22.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.844+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3080ec260 con 0x7ff318159450 2023-07-20T11:24:22.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:22.992+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3180cbbf0 con 0x7ff318159450 2023-07-20T11:24:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.652+0000 7ff30effd640 1 -- 172.21.15.82:0/3895691671 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v203) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff3080ef880 con 0x7ff318159450 2023-07-20T11:24:23.649 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2023-07-20T11:24:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.660+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 msgr2=0x7ff2fc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.660+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 0x7ff2fc068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff314005c10 tx=0x7ff314009040 comp rx=0 tx=0).stop 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.660+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 msgr2=0x7ff3180c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.660+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7ff30801cd10 tx=0x7ff30801b400 comp rx=0 tx=0).stop 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 shutdown_connections 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7ff2fc0663a0 0x7ff2fc068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff318158b00 0x7ff3180c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff318159450 0x7ff3180c53a0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 --2- 172.21.15.82:0/3895691671 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff3180cc3e0 0x7ff3180aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 >> 172.21.15.82:0/3895691671 conn(0x7ff3180cad50 msgr2=0x7ff318071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:23.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 shutdown_connections 2023-07-20T11:24:23.661 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.664+0000 7ff3202cb640 1 -- 172.21.15.82:0/3895691671 wait complete. 2023-07-20T11:24:23.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-20T11:24:23.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 Processor -- start 2023-07-20T11:24:23.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 -- start start 2023-07-20T11:24:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0e4159450 0x7fe0e415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40cc8d0 con 0x7fe0e40afd50 2023-07-20T11:24:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40ccbb0 con 0x7fe0e4159830 2023-07-20T11:24:23.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ebdfa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e40cce90 con 0x7fe0e4159450 2023-07-20T11:24:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ea397640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe0e40afd50 0x7fe0e40b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52164/0 (socket says 172.21.15.82:52164) 2023-07-20T11:24:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0ea397640 1 -- 172.21.15.82:0/2095651389 learned_addr learned my addr 172.21.15.82:0/2095651389 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/2095651389 >> v2:172.21.15.183:3300/0 conn(0x7fe0e4159450 0x7fe0e415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.836+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420644642 0 0) 0x7fe0e40cc8d0 con 0x7fe0e40afd50 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d0003530 con 0x7fe0e40afd50 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132571755 0 0) 0x7fe0d0003530 con 0x7fe0e40afd50 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 >> v2:172.21.15.183:3300/0 conn(0x7fe0e4159450 msgr2=0x7fe0e415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 --2- 172.21.15.82:0/2095651389 >> v2:172.21.15.183:3300/0 conn(0x7fe0e4159450 0x7fe0e415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 >> v1:172.21.15.183:6789/0 conn(0x7fe0e4159830 legacy=0x7fe0e40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4159cc0 con 0x7fe0e40afd50 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fe0dc001680 con 0x7fe0e40afd50 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 >> v1:172.21.15.82:6789/0 conn(0x7fe0e40afd50 legacy=0x7fe0e40b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d00039f0 0x7fe0d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0d00047d0 0x7fe0d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 0x7fe0d000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40cce90 con 0x7fe0d0005190 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000e2d0 con 0x7fe0d00039f0 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000e490 con 0x7fe0d00047d0 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 0x7fe0d000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d00039f0 0x7fe0d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e9395640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0d00047d0 0x7fe0d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 -- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0d00047d0 msgr2=0x7fe0d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0d00047d0 0x7fe0d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 -- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d00039f0 msgr2=0x7fe0d0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d00039f0 0x7fe0d0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 -- 172.21.15.82:0/2095651389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0003530 con 0x7fe0d0005190 2023-07-20T11:24:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d00039f0 0x7fe0d0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.840+0000 7fe0ea397640 1 -- 172.21.15.82:0/2095651389 reap_dead start 2023-07-20T11:24:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ea397640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 0x7fe0d000dba0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c240 tx=0x7fe0dc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0213e232ca7ca2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0a5b40 con 0x7fe0d0005190 2023-07-20T11:24:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0a5ce0 con 0x7fe0d0005190 2023-07-20T11:24:23.840 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0e8b94640 1 -- 172.21.15.82:0/2095651389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc005b20 con 0x7fe0d0005190 2023-07-20T11:24:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 msgr2=0x7fe0d000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 0x7fe0d000dba0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00c240 tx=0x7fe0dc01cc40 comp rx=0 tx=0).stop 2023-07-20T11:24:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/2095651389 shutdown_connections 2023-07-20T11:24:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/2095651389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0d0005190 0x7fe0d000dba0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/2095651389 >> 172.21.15.82:0/2095651389 conn(0x7fe0e40cad50 msgr2=0x7fe0e40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/2095651389 shutdown_connections 2023-07-20T11:24:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/2095651389 wait complete. 2023-07-20T11:24:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 Processor -- start 2023-07-20T11:24:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- start start 2023-07-20T11:24:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 0x7fe0e4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0e40b0ec0 0x7fe0e40b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40c5de0 con 0x7fe0e40cbe10 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40cc7d0 con 0x7fe0d0005190 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ebdfa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41566a0 con 0x7fe0e40b0ec0 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ea397640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ea397640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37340/0 (socket says 172.21.15.82:37340) 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.844+0000 7fe0ea397640 1 -- 172.21.15.82:0/3708699860 learned_addr learned my addr 172.21.15.82:0/3708699860 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 0x7fe0e4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0e9395640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0e40b0ec0 0x7fe0e40b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 -- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0e40b0ec0 msgr2=0x7fe0e40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0e40b0ec0 0x7fe0e40b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 -- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 msgr2=0x7fe0e4156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 0x7fe0e4156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 -- 172.21.15.82:0/3708699860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40c5440 con 0x7fe0e40cbe10 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 0x7fe0e4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ea397640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc01d4e0 tx=0x7fe0d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc001680 con 0x7fe0e40cbe10 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc000ee0 con 0x7fe0e40cbe10 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0072c0 con 0x7fe0e40cbe10 2023-07-20T11:24:23.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40c5720 con 0x7fe0e40cbe10 2023-07-20T11:24:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4156fe0 con 0x7fe0e40cbe10 2023-07-20T11:24:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e404da30 con 0x7fe0e40cbe10 2023-07-20T11:24:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.848+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0dc007420 con 0x7fe0e40cbe10 2023-07-20T11:24:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.852+0000 7fe0da7fc640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 0x7fe0c8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.852+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fe0dc11e480 con 0x7fe0e40cbe10 2023-07-20T11:24:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.852+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 0x7fe0c8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.852+0000 7fe0e9b96640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 0x7fe0c8068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007520 tx=0x7fe0e000b040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:23.856+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0dc0eb7e0 con 0x7fe0e40cbe10 2023-07-20T11:24:24.027 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.032+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe0e40cbbf0 con 0x7fe0e40cbe10 2023-07-20T11:24:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.664+0000 7fe0da7fc640 1 -- 172.21.15.82:0/3708699860 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v95) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe0dc0eee00 con 0x7fe0e40cbe10 2023-07-20T11:24:24.663 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 25 and data pool 26 2023-07-20T11:24:24.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 msgr2=0x7fe0c8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 0x7fe0c8068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0007520 tx=0x7fe0e000b040 comp rx=0 tx=0).stop 2023-07-20T11:24:24.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 msgr2=0x7fe0e40cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc01d4e0 tx=0x7fe0d0005800 comp rx=0 tx=0).stop 2023-07-20T11:24:24.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 shutdown_connections 2023-07-20T11:24:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.676+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0c80663a0 0x7fe0c8068860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.680+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0e40cbe10 0x7fe0e40cc290 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.680+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0e40b0ec0 0x7fe0e40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.680+0000 7fe0ebdfa640 1 --2- 172.21.15.82:0/3708699860 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0d0005190 0x7fe0e4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.680+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 >> 172.21.15.82:0/3708699860 conn(0x7fe0e40cad50 msgr2=0x7fe0e40705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:24.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.684+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 shutdown_connections 2023-07-20T11:24:24.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.684+0000 7fe0ebdfa640 1 -- 172.21.15.82:0/3708699860 wait complete. 2023-07-20T11:24:24.706 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:24.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 Processor -- start 2023-07-20T11:24:24.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 -- start start 2023-07-20T11:24:24.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f48d00b2180 0x7f48d0163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:24.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d00cde70 con 0x7f48d00ca040 2023-07-20T11:24:24.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d00cbef0 con 0x7f48d00ad060 2023-07-20T11:24:24.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.852+0000 7f48d5827640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d015d730 con 0x7f48d00b2180 2023-07-20T11:24:24.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48ceffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f48d00ca040 0x7f48d015c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52174/0 (socket says 172.21.15.82:52174) 2023-07-20T11:24:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48ceffd640 1 -- 172.21.15.82:0/851966848 learned_addr learned my addr 172.21.15.82:0/851966848 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cf7fe640 1 --2- 172.21.15.82:0/851966848 >> v2:172.21.15.82:3300/0 conn(0x7f48d00b2180 0x7f48d0163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cf7fe640 1 -- 172.21.15.82:0/851966848 >> v1:172.21.15.183:6789/0 conn(0x7f48d00ad060 legacy=0x7f48d015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cf7fe640 1 -- 172.21.15.82:0/851966848 >> v1:172.21.15.82:6789/0 conn(0x7f48d00ca040 legacy=0x7f48d015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.850 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cf7fe640 1 -- 172.21.15.82:0/851966848 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00ca420 con 0x7f48d00b2180 2023-07-20T11:24:24.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cf7fe640 1 --2- 172.21.15.82:0/851966848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0163c40 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f48c80097c0 tx=0x7f48c801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5bcef52b73f2e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:24.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cdffb640 1 -- 172.21.15.82:0/851966848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80ab600 con 0x7f48d00b2180 2023-07-20T11:24:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cdffb640 1 -- 172.21.15.82:0/851966848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c80a7050 con 0x7f48d00b2180 2023-07-20T11:24:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.856+0000 7f48cdffb640 1 -- 172.21.15.82:0/851966848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80ab980 con 0x7f48d00b2180 2023-07-20T11:24:24.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- 172.21.15.82:0/851966848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 msgr2=0x7f48d0163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 --2- 172.21.15.82:0/851966848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0163c40 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7f48c80097c0 tx=0x7f48c801c440 comp rx=0 tx=0).stop 2023-07-20T11:24:24.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- 172.21.15.82:0/851966848 shutdown_connections 2023-07-20T11:24:24.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 --2- 172.21.15.82:0/851966848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0163c40 unknown :-1 s=CLOSED pgs=2375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- 172.21.15.82:0/851966848 >> 172.21.15.82:0/851966848 conn(0x7f48d00cada0 msgr2=0x7f48d00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:24.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- 172.21.15.82:0/851966848 shutdown_connections 2023-07-20T11:24:24.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- 172.21.15.82:0/851966848 wait complete. 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 Processor -- start 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- start start 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 0x7f48d006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 0x7f48d0099770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:24.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0162700 con 0x7f48d00b2180 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d006bbf0 con 0x7f48d00ad060 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48d5827640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d009b860 con 0x7f48d00ca040 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48ce7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48ce7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37358/0 (socket says 172.21.15.82:37358) 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48ce7fc640 1 -- 172.21.15.82:0/844583091 learned_addr learned my addr 172.21.15.82:0/844583091 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:24.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48ceffd640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 0x7f48d006b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.860+0000 7f48cf7fe640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 0x7f48d0099770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 -- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 msgr2=0x7f48d0099770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 0x7f48d0099770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 -- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 msgr2=0x7f48d006b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 0x7f48d006b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:24.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 -- 172.21.15.82:0/844583091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8009420 con 0x7f48d00b2180 2023-07-20T11:24:24.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ceffd640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 0x7f48d006b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:24.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48cf7fe640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 0x7f48d0099770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:24.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ce7fc640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c820 tx=0x7f48c400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:24.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400aa50 con 0x7f48d00b2180 2023-07-20T11:24:24.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400abb0 con 0x7f48d00b2180 2023-07-20T11:24:24.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0161da0 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4012420 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d0162040 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d0073c70 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48c4012580 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 0x7f48bc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f48c4084250 con 0x7f48d00b2180 2023-07-20T11:24:24.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.864+0000 7f48ceffd640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 0x7f48bc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:24.863 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.868+0000 7f48ceffd640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 0x7f48bc068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005890 tx=0x7f48c0009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:24.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:24.868+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48c40514d0 con 0x7f48d00b2180 2023-07-20T11:24:25.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.016+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48d00cbbd0 con 0x7f48d00b2180 2023-07-20T11:24:25.013 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48b7fff640 1 -- 172.21.15.82:0/844583091 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f48c4054af0 con 0x7f48d00b2180 2023-07-20T11:24:25.014 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:25.014 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":204,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:24.038814+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 msgr2=0x7f48bc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.016 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 0x7f48bc068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f48c0005890 tx=0x7f48c0009040 comp rx=0 tx=0).stop 2023-07-20T11:24:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 msgr2=0x7f48d0151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c820 tx=0x7f48c400cce0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 shutdown_connections 2023-07-20T11:24:25.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f48bc0663a0 0x7f48bc068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f48d00ca040 0x7f48d0099770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48d00b2180 0x7f48d0151b20 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 --2- 172.21.15.82:0/844583091 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48d00ad060 0x7f48d006b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 >> 172.21.15.82:0/844583091 conn(0x7f48d00cada0 msgr2=0x7f48d00c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 shutdown_connections 2023-07-20T11:24:25.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.020+0000 7f48d5827640 1 -- 172.21.15.82:0/844583091 wait complete. 2023-07-20T11:24:25.036 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.180+0000 7f218809c640 1 Processor -- start 2023-07-20T11:24:25.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.180+0000 7f218809c640 1 -- start start 2023-07-20T11:24:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f218809c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21801596b0 0x7f218015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f218809c640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800ccd90 con 0x7f21800cc900 2023-07-20T11:24:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f218809c640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800ad810 con 0x7f21800b2a90 2023-07-20T11:24:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f218809c640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218015d0d0 con 0x7f21801596b0 2023-07-20T11:24:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21801596b0 0x7f218015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21801596b0 0x7f218015dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37362/0 (socket says 172.21.15.82:37362) 2023-07-20T11:24:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 -- 172.21.15.82:0/2773649644 learned_addr learned my addr 172.21.15.82:0/2773649644 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 -- 172.21.15.82:0/2773649644 >> v1:172.21.15.183:6789/0 conn(0x7f21800b2a90 legacy=0x7f21800c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 -- 172.21.15.82:0/2773649644 >> v1:172.21.15.82:6789/0 conn(0x7f21800cc900 legacy=0x7f21800b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.184+0000 7f2185e38640 1 -- 172.21.15.82:0/2773649644 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218015d3b0 con 0x7f21801596b0 2023-07-20T11:24:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f2185e38640 1 --2- 172.21.15.82:0/2773649644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f218015dbb0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098a0 tx=0x7f217c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e861069cd271bf3c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f2184e36640 1 -- 172.21.15.82:0/2773649644 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0ab650 con 0x7f21801596b0 2023-07-20T11:24:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f2184e36640 1 -- 172.21.15.82:0/2773649644 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c0ab7b0 con 0x7f21801596b0 2023-07-20T11:24:25.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f2184e36640 1 -- 172.21.15.82:0/2773649644 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217c0abb40 con 0x7f21801596b0 2023-07-20T11:24:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- 172.21.15.82:0/2773649644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 msgr2=0x7f218015dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 --2- 172.21.15.82:0/2773649644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f218015dbb0 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f217c0098a0 tx=0x7f217c01c4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- 172.21.15.82:0/2773649644 shutdown_connections 2023-07-20T11:24:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 --2- 172.21.15.82:0/2773649644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f218015dbb0 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- 172.21.15.82:0/2773649644 >> 172.21.15.82:0/2773649644 conn(0x7f21800cada0 msgr2=0x7f21800cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- 172.21.15.82:0/2773649644 shutdown_connections 2023-07-20T11:24:25.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- 172.21.15.82:0/2773649644 wait complete. 2023-07-20T11:24:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 Processor -- start 2023-07-20T11:24:25.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.188+0000 7f218809c640 1 -- start start 2023-07-20T11:24:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21800b2a90 0x7f218014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21800cc900 0x7f2180159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c3020 con 0x7f21801596b0 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218014c160 con 0x7f21800cc900 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c23a0 con 0x7f21800b2a90 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37366/0 (socket says 172.21.15.82:37366) 2023-07-20T11:24:25.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 -- 172.21.15.82:0/3551413934 learned_addr learned my addr 172.21.15.82:0/3551413934 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:25.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 -- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21800b2a90 msgr2=0x7f218014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21800b2a90 0x7f218014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 -- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21800cc900 msgr2=0x7f2180159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21800cc900 0x7f2180159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 -- 172.21.15.82:0/3551413934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c0094d0 con 0x7f21801596b0 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f2186639640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f217800c780 tx=0x7f217800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800aa50 con 0x7f21801596b0 2023-07-20T11:24:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800abf0 con 0x7f21801596b0 2023-07-20T11:24:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217800ce30 con 0x7f21801596b0 2023-07-20T11:24:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800c2680 con 0x7f21801596b0 2023-07-20T11:24:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800c2c40 con 0x7f21801596b0 2023-07-20T11:24:25.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2180073c70 con 0x7f21801596b0 2023-07-20T11:24:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.192+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2178012420 con 0x7f21801596b0 2023-07-20T11:24:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.196+0000 7f21767fc640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 0x7f2164068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.196+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f2178084040 con 0x7f21801596b0 2023-07-20T11:24:25.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.196+0000 7f2185e38640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 0x7f2164068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.196+0000 7f2185e38640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 0x7f2164068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f217c0af000 tx=0x7f217c008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.200+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2178054df0 con 0x7f21801596b0 2023-07-20T11:24:25.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21800c3160 con 0x7f21801596b0 2023-07-20T11:24:25.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f21767fc640 1 -- 172.21.15.82:0/3551413934 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+18401 (secure 0 0 0) 0x7f21800c3160 con 0x7f21801596b0 2023-07-20T11:24:25.343 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:25.343 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":204,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:24.038814+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:25.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 msgr2=0x7f2164068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 0x7f2164068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f217c0af000 tx=0x7f217c008040 comp rx=0 tx=0).stop 2023-07-20T11:24:25.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 msgr2=0x7f2180159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f217800c780 tx=0x7f217800cc40 comp rx=0 tx=0).stop 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 shutdown_connections 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21640663a0 0x7f2164068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21801596b0 0x7f2180159fd0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21800cc900 0x7f2180159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 --2- 172.21.15.82:0/3551413934 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21800b2a90 0x7f218014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.348+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 >> 172.21.15.82:0/3551413934 conn(0x7f21800cada0 msgr2=0x7f21800b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:25.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.352+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 shutdown_connections 2023-07-20T11:24:25.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.352+0000 7f218809c640 1 -- 172.21.15.82:0/3551413934 wait complete. 2023-07-20T11:24:25.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-20T11:24:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 Processor -- start 2023-07-20T11:24:25.505 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 -- start start 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 0x7f69240c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69240afdc0 0x7f6924070970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f6924070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240c95d0 con 0x7f69240afdc0 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240c9fa0 con 0x7f6924158ce0 2023-07-20T11:24:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f692b8bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241590c0 con 0x7f69240b0250 2023-07-20T11:24:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69240afdc0 0x7f6924070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f69240afdc0 0x7f6924070970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37368/0 (socket says 172.21.15.82:37368) 2023-07-20T11:24:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 -- 172.21.15.82:0/2494086870 learned_addr learned my addr 172.21.15.82:0/2494086870 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6929659640 1 --2- 172.21.15.82:0/2494086870 >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 0x7f69240c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6929e5a640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f6924070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 -- 172.21.15.82:0/2494086870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 msgr2=0x7f6924070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f6924070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 -- 172.21.15.82:0/2494086870 >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 msgr2=0x7f69240c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 --2- 172.21.15.82:0/2494086870 >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 0x7f69240c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6928e58640 1 -- 172.21.15.82:0/2494086870 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240c89c0 con 0x7f69240afdc0 2023-07-20T11:24:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.512+0000 7f6929659640 1 --2- 172.21.15.82:0/2494086870 >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 0x7f69240c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f6928e58640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69240afdc0 0x7f6924070970 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f692406a6c0 tx=0x7f691401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae720548c5af32c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f691bfff640 1 -- 172.21.15.82:0/2494086870 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140aa5f0 con 0x7f69240afdc0 2023-07-20T11:24:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f691bfff640 1 -- 172.21.15.82:0/2494086870 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69140aa750 con 0x7f69240afdc0 2023-07-20T11:24:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f691bfff640 1 -- 172.21.15.82:0/2494086870 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140aaae0 con 0x7f69240afdc0 2023-07-20T11:24:25.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 -- 172.21.15.82:0/2494086870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69240afdc0 msgr2=0x7f6924070970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69240afdc0 0x7f6924070970 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f692406a6c0 tx=0x7f691401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 -- 172.21.15.82:0/2494086870 shutdown_connections 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f6924070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 --2- 172.21.15.82:0/2494086870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f69240afdc0 0x7f6924070970 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 --2- 172.21.15.82:0/2494086870 >> v2:172.21.15.183:3300/0 conn(0x7f6924158ce0 0x7f69240c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 -- 172.21.15.82:0/2494086870 >> 172.21.15.82:0/2494086870 conn(0x7f69240cad50 msgr2=0x7f69240cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:25.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 -- 172.21.15.82:0/2494086870 shutdown_connections 2023-07-20T11:24:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.516+0000 7f692b8bd640 1 -- 172.21.15.82:0/2494086870 wait complete. 2023-07-20T11:24:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 Processor -- start 2023-07-20T11:24:25.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- start start 2023-07-20T11:24:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240afdc0 0x7f69240c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f69240c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c14e0 con 0x7f6924158ce0 2023-07-20T11:24:25.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c2850 con 0x7f69240afdc0 2023-07-20T11:24:25.515 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240c2b30 con 0x7f69240b0250 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37380/0 (socket says 172.21.15.82:37380) 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 -- 172.21.15.82:0/3028547752 learned_addr learned my addr 172.21.15.82:0/3028547752 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929659640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240afdc0 0x7f69240c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6928e58640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f69240c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.516 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 -- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 msgr2=0x7f69240c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f69240c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 -- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240afdc0 msgr2=0x7f69240c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240afdc0 0x7f69240c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 -- 172.21.15.82:0/3028547752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140094d0 con 0x7f6924158ce0 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6929e5a640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d5f0 tx=0x7f691c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0125f0 con 0x7f6924158ce0 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c012770 con 0x7f6924158ce0 2023-07-20T11:24:25.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c012b20 con 0x7f6924158ce0 2023-07-20T11:24:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240c2e10 con 0x7f6924158ce0 2023-07-20T11:24:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240c33d0 con 0x7f6924158ce0 2023-07-20T11:24:25.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.520+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240c35c0 con 0x7f6924158ce0 2023-07-20T11:24:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.524+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f691c012c80 con 0x7f6924158ce0 2023-07-20T11:24:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.524+0000 7f6919ffb640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 0x7f6908068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.524+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f691c084330 con 0x7f6924158ce0 2023-07-20T11:24:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.524+0000 7f6929659640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 0x7f6908068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:25.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.524+0000 7f6929659640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 0x7f6908068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fd0 tx=0x7f69200097f0 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:25.522 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.528+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f691c051670 con 0x7f6924158ce0 2023-07-20T11:24:25.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:25.708+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f692404da30 con 0x7f6924158ce0 2023-07-20T11:24:26.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f6919ffb640 1 -- 172.21.15.82:0/3028547752 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v98) v1 ==== 118+0+0 (secure 0 0 0) 0x7f691c054c90 con 0x7f6924158ce0 2023-07-20T11:24:26.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 msgr2=0x7f6908068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:26.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 0x7f6908068860 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6920009fd0 tx=0x7f69200097f0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 msgr2=0x7f6924153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f691c00d5f0 tx=0x7f691c00dab0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 shutdown_connections 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f69080663a0 0x7f6908068860 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6924158ce0 0x7f6924153160 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f69240b0250 0x7f69240c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 --2- 172.21.15.82:0/3028547752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f69240afdc0 0x7f69240c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 >> 172.21.15.82:0/3028547752 conn(0x7f69240cad50 msgr2=0x7f69240adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:26.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 shutdown_connections 2023-07-20T11:24:26.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.700+0000 7f692b8bd640 1 -- 172.21.15.82:0/3028547752 wait complete. 2023-07-20T11:24:26.719 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-20T11:24:26.720 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-20T11:24:26.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 Processor -- start 2023-07-20T11:24:26.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 -- start start 2023-07-20T11:24:26.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd158159450 0x7fd15815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159830 0x7fd1580cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1580cc3e0 0x7fd1580afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580cce90 con 0x7fd1580cc3e0 2023-07-20T11:24:26.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580cc8d0 con 0x7fd158159450 2023-07-20T11:24:26.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15fbdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580ccbb0 con 0x7fd158159830 2023-07-20T11:24:26.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1580cc3e0 0x7fd1580afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1580cc3e0 0x7fd1580afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37396/0 (socket says 172.21.15.82:37396) 2023-07-20T11:24:26.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 -- 172.21.15.82:0/3072139020 learned_addr learned my addr 172.21.15.82:0/3072139020 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15d17a640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159830 0x7fd1580cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15d97b640 1 --2- 172.21.15.82:0/3072139020 >> v2:172.21.15.183:3300/0 conn(0x7fd158159450 0x7fd15815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 -- 172.21.15.82:0/3072139020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159830 msgr2=0x7fd1580cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159830 0x7fd1580cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 -- 172.21.15.82:0/3072139020 >> v2:172.21.15.183:3300/0 conn(0x7fd158159450 msgr2=0x7fd15815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 --2- 172.21.15.82:0/3072139020 >> v2:172.21.15.183:3300/0 conn(0x7fd158159450 0x7fd15815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.872+0000 7fd15e17c640 1 -- 172.21.15.82:0/3072139020 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158159cc0 con 0x7fd1580cc3e0 2023-07-20T11:24:26.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15e17c640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580cc3e0 0x7fd1580afd50 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7fd15806a6c0 tx=0x7fd15001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea90fa99fe44f4f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15c979640 1 -- 172.21.15.82:0/3072139020 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500a5730 con 0x7fd1580cc3e0 2023-07-20T11:24:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15c979640 1 -- 172.21.15.82:0/3072139020 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500a5890 con 0x7fd1580cc3e0 2023-07-20T11:24:26.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15c979640 1 -- 172.21.15.82:0/3072139020 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500a5c20 con 0x7fd1580cc3e0 2023-07-20T11:24:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 -- 172.21.15.82:0/3072139020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580cc3e0 msgr2=0x7fd1580afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580cc3e0 0x7fd1580afd50 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7fd15806a6c0 tx=0x7fd15001c9a0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 -- 172.21.15.82:0/3072139020 shutdown_connections 2023-07-20T11:24:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580cc3e0 0x7fd1580afd50 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/3072139020 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159830 0x7fd1580cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/3072139020 >> v2:172.21.15.183:3300/0 conn(0x7fd158159450 0x7fd15815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 -- 172.21.15.82:0/3072139020 >> 172.21.15.82:0/3072139020 conn(0x7fd1580cad50 msgr2=0x7fd1580cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 -- 172.21.15.82:0/3072139020 shutdown_connections 2023-07-20T11:24:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.876+0000 7fd15fbdf640 1 -- 172.21.15.82:0/3072139020 wait complete. 2023-07-20T11:24:26.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 Processor -- start 2023-07-20T11:24:26.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- start start 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 0x7fd1581573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 0x7fd1581506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158150c30 con 0x7fd1580b2310 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158152f90 con 0x7fd1580cc3e0 2023-07-20T11:24:26.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd158152cb0 con 0x7fd158159450 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37408/0 (socket says 172.21.15.82:37408) 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 -- 172.21.15.82:0/1601585516 learned_addr learned my addr 172.21.15.82:0/1601585516 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15d97b640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 0x7fd1581573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15d17a640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 0x7fd1581506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 -- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 msgr2=0x7fd1581506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:26.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 0x7fd1581506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 -- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 msgr2=0x7fd1581573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 0x7fd1581573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 -- 172.21.15.82:0/1601585516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009b30 con 0x7fd1580b2310 2023-07-20T11:24:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15d17a640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 0x7fd1581506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:26.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15d97b640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 0x7fd1581573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:26.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15e17c640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fd1500af040 tx=0x7fd150019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:26.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500b8670 con 0x7fd1580b2310 2023-07-20T11:24:26.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500b87d0 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd158156b50 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500b8b80 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1581529c0 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.880+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd158157070 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.884+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd1500b8ce0 con 0x7fd1580b2310 2023-07-20T11:24:26.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.884+0000 7fd14e7fc640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 0x7fd13c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:26.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.884+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd15011f3b0 con 0x7fd1580b2310 2023-07-20T11:24:26.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.884+0000 7fd15d97b640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 0x7fd13c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:26.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.884+0000 7fd15d97b640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 0x7fd13c068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd154009a60 tx=0x7fd154008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:26.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:26.888+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd158157070 con 0x7fd1580b2310 2023-07-20T11:24:27.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.068+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd158157070 con 0x7fd1580b2310 2023-07-20T11:24:27.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd14e7fc640 1 -- 172.21.15.82:0/1601585516 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v99) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd158157070 con 0x7fd1580b2310 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 msgr2=0x7fd13c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 0x7fd13c068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd154009a60 tx=0x7fd154008040 comp rx=0 tx=0).stop 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 msgr2=0x7fd15815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7fd1500af040 tx=0x7fd150019740 comp rx=0 tx=0).stop 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 shutdown_connections 2023-07-20T11:24:27.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd13c0663a0 0x7fd13c068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1580b2310 0x7fd15815b5c0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd158159450 0x7fd1581506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 --2- 172.21.15.82:0/1601585516 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1580cc3e0 0x7fd1581573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 >> 172.21.15.82:0/1601585516 conn(0x7fd1580cad50 msgr2=0x7fd1580ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 shutdown_connections 2023-07-20T11:24:27.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.708+0000 7fd15fbdf640 1 -- 172.21.15.82:0/1601585516 wait complete. 2023-07-20T11:24:27.727 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-20T11:24:27.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:27.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 Processor -- start 2023-07-20T11:24:27.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 -- start start 2023-07-20T11:24:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f085015cab0 0x7f08500d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08500ce4c0 0x7f08500d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08500d16b0 con 0x7f08500d0d10 2023-07-20T11:24:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500d31c0 con 0x7f08500ce4c0 2023-07-20T11:24:27.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f085566d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08500b3520 con 0x7f085015cab0 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08500ce4c0 0x7f08500d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f08500ce4c0 0x7f08500d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37422/0 (socket says 172.21.15.82:37422) 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 -- 172.21.15.82:0/3451131765 learned_addr learned my addr 172.21.15.82:0/3451131765 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084effd640 1 --2- 172.21.15.82:0/3451131765 >> v2:172.21.15.183:3300/0 conn(0x7f085015cab0 0x7f08500d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 -- 172.21.15.82:0/3451131765 >> v2:172.21.15.183:3300/0 conn(0x7f085015cab0 msgr2=0x7f08500d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 --2- 172.21.15.82:0/3451131765 >> v2:172.21.15.183:3300/0 conn(0x7f085015cab0 0x7f08500d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 -- 172.21.15.82:0/3451131765 >> v1:172.21.15.82:6789/0 conn(0x7f08500d0d10 legacy=0x7f08500cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.876+0000 7f084f7fe640 1 -- 172.21.15.82:0/3451131765 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08500b2910 con 0x7f08500ce4c0 2023-07-20T11:24:27.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f084f7fe640 1 --2- 172.21.15.82:0/3451131765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08500ce4c0 0x7f08500d1170 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f085006a660 tx=0x7f084801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663e721d829fe1b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:27.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f084dffb640 1 -- 172.21.15.82:0/3451131765 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480ab5f0 con 0x7f08500ce4c0 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f084dffb640 1 -- 172.21.15.82:0/3451131765 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480ab750 con 0x7f08500ce4c0 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f084dffb640 1 -- 172.21.15.82:0/3451131765 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480abae0 con 0x7f08500ce4c0 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 -- 172.21.15.82:0/3451131765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08500ce4c0 msgr2=0x7f08500d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 --2- 172.21.15.82:0/3451131765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08500ce4c0 0x7f08500d1170 secure :-1 s=READY pgs=2385 cs=0 l=1 rev1=1 crypto rx=0x7f085006a660 tx=0x7f084801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 -- 172.21.15.82:0/3451131765 shutdown_connections 2023-07-20T11:24:27.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 --2- 172.21.15.82:0/3451131765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08500ce4c0 0x7f08500d1170 unknown :-1 s=CLOSED pgs=2385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 --2- 172.21.15.82:0/3451131765 >> v2:172.21.15.183:3300/0 conn(0x7f085015cab0 0x7f08500d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 -- 172.21.15.82:0/3451131765 >> 172.21.15.82:0/3451131765 conn(0x7f085008c120 msgr2=0x7f085009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 -- 172.21.15.82:0/3451131765 shutdown_connections 2023-07-20T11:24:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.880+0000 7f085566d640 1 -- 172.21.15.82:0/3451131765 wait complete. 2023-07-20T11:24:27.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 Processor -- start 2023-07-20T11:24:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- start start 2023-07-20T11:24:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 0x7f08501524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08500d0d10 0x7f08500b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08501529e0 con 0x7f085015cab0 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b7890 con 0x7f08500ce4c0 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08500b7b70 con 0x7f08500d0d10 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37430/0 (socket says 172.21.15.82:37430) 2023-07-20T11:24:27.879 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 -- 172.21.15.82:0/2069149315 learned_addr learned my addr 172.21.15.82:0/2069149315 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:27.880 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 -- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08500d0d10 msgr2=0x7f08500b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08500d0d10 0x7f08500b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084effd640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 0x7f08501524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 -- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 msgr2=0x7f08501524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 0x7f08501524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 -- 172.21.15.82:0/2069149315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f085015cab0 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084effd640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 0x7f08501524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f084f7fe640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f08480190e0 tx=0x7f084801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:27.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480be5f0 con 0x7f085015cab0 2023-07-20T11:24:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480be750 con 0x7f085015cab0 2023-07-20T11:24:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480beb00 con 0x7f085015cab0 2023-07-20T11:24:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08500b7e50 con 0x7f085015cab0 2023-07-20T11:24:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08500b53c0 con 0x7f085015cab0 2023-07-20T11:24:27.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.884+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0850073c70 con 0x7f085015cab0 2023-07-20T11:24:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.888+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f08480b43f0 con 0x7f085015cab0 2023-07-20T11:24:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.888+0000 7f08377fe640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 0x7f083c068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.888+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f08480a8050 con 0x7f085015cab0 2023-07-20T11:24:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.888+0000 7f084effd640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 0x7f083c068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:27.883 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.888+0000 7f084effd640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 0x7f083c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08500c8e80 tx=0x7f0840008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:27.886 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:27.892+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08480ebd60 con 0x7f085015cab0 2023-07-20T11:24:28.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.068+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08500b2310 con 0x7f085015cab0 2023-07-20T11:24:28.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.068+0000 7f08377fe640 1 -- 172.21.15.82:0/2069149315 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f08480ef380 con 0x7f085015cab0 2023-07-20T11:24:28.064 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:28.065 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:28.065 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:28.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 msgr2=0x7f083c068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 0x7f083c068890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08500c8e80 tx=0x7f0840008040 comp rx=0 tx=0).stop 2023-07-20T11:24:28.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 msgr2=0x7f08500af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f08480190e0 tx=0x7f084801ad10 comp rx=0 tx=0).stop 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 shutdown_connections 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f083c0663d0 0x7f083c068890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f085015cab0 0x7f08500af260 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f08500d0d10 0x7f08500b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 --2- 172.21.15.82:0/2069149315 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f08500ce4c0 0x7f08501524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 >> 172.21.15.82:0/2069149315 conn(0x7f085008c120 msgr2=0x7f085015be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 shutdown_connections 2023-07-20T11:24:28.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.072+0000 7f085566d640 1 -- 172.21.15.82:0/2069149315 wait complete. 2023-07-20T11:24:28.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.228+0000 7f2ec426d640 1 Processor -- start 2023-07-20T11:24:28.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.228+0000 7f2ec426d640 1 -- start start 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec426d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec426d640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f2ebc0b2060 0x7f2ebc0b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec426d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0b06c0 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec426d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b3160 con 0x7f2ebc0afda0 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec426d640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0b12a0 con 0x7f2ebc0b2060 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.226 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37444/0 (socket says 172.21.15.82:37444) 2023-07-20T11:24:28.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 -- 172.21.15.82:0/692303668 learned_addr learned my addr 172.21.15.82:0/692303668 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:28.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 -- 172.21.15.82:0/692303668 >> v2:172.21.15.183:3300/0 conn(0x7f2ebc0b2060 msgr2=0x7f2ebc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:28.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 --2- 172.21.15.82:0/692303668 >> v2:172.21.15.183:3300/0 conn(0x7f2ebc0b2060 0x7f2ebc0b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.227 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 -- 172.21.15.82:0/692303668 >> v1:172.21.15.82:6789/0 conn(0x7f2ebc15a8e0 legacy=0x7f2ebc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.228 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.232+0000 7f2ec2009640 1 -- 172.21.15.82:0/692303668 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0b1580 con 0x7f2ebc0afda0 2023-07-20T11:24:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec2009640 1 --2- 172.21.15.82:0/692303668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc071ec0 tx=0x7f2eb801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3d1a22c40bf24f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec1007640 1 -- 172.21.15.82:0/692303668 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80ac410 con 0x7f2ebc0afda0 2023-07-20T11:24:28.229 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec1007640 1 -- 172.21.15.82:0/692303668 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb80ac570 con 0x7f2ebc0afda0 2023-07-20T11:24:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec1007640 1 -- 172.21.15.82:0/692303668 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80ac900 con 0x7f2ebc0afda0 2023-07-20T11:24:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- 172.21.15.82:0/692303668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc0afda0 msgr2=0x7f2ebc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.230 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- 172.21.15.82:0/692303668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc071ec0 tx=0x7f2eb801c3b0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- 172.21.15.82:0/692303668 shutdown_connections 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- 172.21.15.82:0/692303668 >> v2:172.21.15.183:3300/0 conn(0x7f2ebc0b2060 0x7f2ebc0b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- 172.21.15.82:0/692303668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc0afda0 0x7f2ebc0ca6b0 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- 172.21.15.82:0/692303668 >> 172.21.15.82:0/692303668 conn(0x7f2ebc0cada0 msgr2=0x7f2ebc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- 172.21.15.82:0/692303668 shutdown_connections 2023-07-20T11:24:28.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- 172.21.15.82:0/692303668 wait complete. 2023-07-20T11:24:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 Processor -- start 2023-07-20T11:24:28.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- start start 2023-07-20T11:24:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ebc0afda0 0x7f2ebc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ebc0b2060 0x7f2ebc099420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc1f7fd0 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.233 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cbef0 con 0x7f2ebc0b2060 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.236+0000 7f2ec426d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0cc790 con 0x7f2ebc0afda0 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37454/0 (socket says 172.21.15.82:37454) 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 -- 172.21.15.82:0/1250504174 learned_addr learned my addr 172.21.15.82:0/1250504174 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec2009640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ebc0afda0 0x7f2ebc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.234 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec1808640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ebc0b2060 0x7f2ebc099420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 -- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ebc0afda0 msgr2=0x7f2ebc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ebc0afda0 0x7f2ebc1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 -- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ebc0b2060 msgr2=0x7f2ebc099420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ebc0b2060 0x7f2ebc099420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 -- 172.21.15.82:0/1250504174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80094d0 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec280a640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b970 tx=0x7f2eb400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb400cb40 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb400ccc0 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4014680 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0c5930 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc0cc140 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc0cc900 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.240+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2eb401d3b0 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.244+0000 7f2eb2ffd640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 0x7f2ea0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.244+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f2eb4083e10 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.244+0000 7f2ec2009640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 0x7f2ea0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.244+0000 7f2ec2009640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 0x7f2ea0068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80ae000 tx=0x7f2eb8008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.248+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2eb4087030 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.392+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ebc073c70 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2eb2ffd640 1 -- 172.21.15.82:0/1250504174 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+18388 (secure 0 0 0) 0x7f2eb4019090 con 0x7f2ebc15a8e0 2023-07-20T11:24:28.390 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:28.390 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":205,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:25.658879+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 msgr2=0x7f2ea0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 0x7f2ea0068860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80ae000 tx=0x7f2eb8008040 comp rx=0 tx=0).stop 2023-07-20T11:24:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 msgr2=0x7f2ebc0c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f2eb400b970 tx=0x7f2eb400be30 comp rx=0 tx=0).stop 2023-07-20T11:24:28.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 shutdown_connections 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f2ea00663a0 0x7f2ea0068860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ebc15a8e0 0x7f2ebc0c53f0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ebc0b2060 0x7f2ebc099420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 --2- 172.21.15.82:0/1250504174 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2ebc0afda0 0x7f2ebc1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 >> 172.21.15.82:0/1250504174 conn(0x7f2ebc0cada0 msgr2=0x7f2ebc06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 shutdown_connections 2023-07-20T11:24:28.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.396+0000 7f2ec426d640 1 -- 172.21.15.82:0/1250504174 wait complete. 2023-07-20T11:24:28.411 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-20T11:24:28.412 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.556+0000 7f05b3b67640 1 Processor -- start 2023-07-20T11:24:28.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.556+0000 7f05b3b67640 1 -- start start 2023-07-20T11:24:28.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b3b67640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f05ac0ad720 0x7f05ac0b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b3b67640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0cdd60 con 0x7f05ac0b04b0 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b3b67640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ac0b20a0 con 0x7f05ac0b1cc0 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b3b67640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ac0cd430 con 0x7f05ac0ad720 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b1102640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f05ac0b04b0 0x7f05ac160660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52214/0 (socket says 172.21.15.82:52214) 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b1102640 1 -- 172.21.15.82:0/434945905 learned_addr learned my addr 172.21.15.82:0/434945905 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b2104640 1 --2- 172.21.15.82:0/434945905 >> v2:172.21.15.82:3300/0 conn(0x7f05ac0ad720 0x7f05ac0b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b2104640 1 -- 172.21.15.82:0/434945905 >> v1:172.21.15.183:6789/0 conn(0x7f05ac0b1cc0 legacy=0x7f05ac0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b2104640 1 -- 172.21.15.82:0/434945905 >> v1:172.21.15.82:6789/0 conn(0x7f05ac0b04b0 legacy=0x7f05ac160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.560+0000 7f05b2104640 1 -- 172.21.15.82:0/434945905 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac0cd710 con 0x7f05ac0ad720 2023-07-20T11:24:28.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b2104640 1 --2- 172.21.15.82:0/434945905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac0b2a30 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f05a40097c0 tx=0x7f05a401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85546dbebe9288df server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b0901640 1 -- 172.21.15.82:0/434945905 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40ac640 con 0x7f05ac0ad720 2023-07-20T11:24:28.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b0901640 1 -- 172.21.15.82:0/434945905 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a40ac7a0 con 0x7f05ac0ad720 2023-07-20T11:24:28.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b0901640 1 -- 172.21.15.82:0/434945905 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a40acb30 con 0x7f05ac0ad720 2023-07-20T11:24:28.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- 172.21.15.82:0/434945905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 msgr2=0x7f05ac0b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 --2- 172.21.15.82:0/434945905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac0b2a30 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f05a40097c0 tx=0x7f05a401c3c0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- 172.21.15.82:0/434945905 shutdown_connections 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 --2- 172.21.15.82:0/434945905 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac0b2a30 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- 172.21.15.82:0/434945905 >> 172.21.15.82:0/434945905 conn(0x7f05ac0cada0 msgr2=0x7f05ac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- 172.21.15.82:0/434945905 shutdown_connections 2023-07-20T11:24:28.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- 172.21.15.82:0/434945905 wait complete. 2023-07-20T11:24:28.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 Processor -- start 2023-07-20T11:24:28.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- start start 2023-07-20T11:24:28.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0b04b0 0x7f05ac155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac0b1cc0 0x7f05ac06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0aea30 con 0x7f05ac0ad720 2023-07-20T11:24:28.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0ade20 con 0x7f05ac0b1cc0 2023-07-20T11:24:28.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.564+0000 7f05b3b67640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ac0ae100 con 0x7f05ac0b04b0 2023-07-20T11:24:28.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37466/0 (socket says 172.21.15.82:37466) 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 -- 172.21.15.82:0/2949089412 learned_addr learned my addr 172.21.15.82:0/2949089412 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b2104640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac0b1cc0 0x7f05ac06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1102640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0b04b0 0x7f05ac155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 -- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0b04b0 msgr2=0x7f05ac155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0b04b0 0x7f05ac155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 -- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac0b1cc0 msgr2=0x7f05ac06b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac0b1cc0 0x7f05ac06b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 -- 172.21.15.82:0/2949089412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a4009420 con 0x7f05ac0ad720 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b1903640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8003b80 con 0x7f05ac0ad720 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8003ce0 con 0x7f05ac0ad720 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800aa90 con 0x7f05ac0ad720 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac0b12f0 con 0x7f05ac0ad720 2023-07-20T11:24:28.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ac0ae6c0 con 0x7f05ac0ad720 2023-07-20T11:24:28.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ac073c70 con 0x7f05ac0ad720 2023-07-20T11:24:28.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.568+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05a800abf0 con 0x7f05ac0ad720 2023-07-20T11:24:28.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.572+0000 7f05a27fc640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 0x7f0590068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.572+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f05a8083c70 con 0x7f05ac0ad720 2023-07-20T11:24:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.572+0000 7f05b1102640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 0x7f0590068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.572+0000 7f05b1102640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 0x7f0590068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05ac168970 tx=0x7f059c009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.576+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05a8051030 con 0x7f05ac0ad720 2023-07-20T11:24:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.720+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05ac0b1170 con 0x7f05900663a0 2023-07-20T11:24:28.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05a27fc640 1 -- 172.21.15.82:0/2949089412 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299578 (secure 0 0 0) 0x7f059c001490 con 0x7f05900663a0 2023-07-20T11:24:28.726 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:28.732 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 msgr2=0x7f0590068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 0x7f0590068860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f05ac168970 tx=0x7f059c009040 comp rx=0 tx=0).stop 2023-07-20T11:24:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 msgr2=0x7f05ac14df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c7f0 tx=0x7f05a800ccb0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.735 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 shutdown_connections 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f05900663a0 0x7f0590068860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f05ac0b1cc0 0x7f05ac06b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f05ac0b04b0 0x7f05ac155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 --2- 172.21.15.82:0/2949089412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f05ac0ad720 0x7f05ac14df50 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.732+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 >> 172.21.15.82:0/2949089412 conn(0x7f05ac0cada0 msgr2=0x7f05ac0717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.736+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 shutdown_connections 2023-07-20T11:24:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.736+0000 7f05b3b67640 1 -- 172.21.15.82:0/2949089412 wait complete. 2023-07-20T11:24:28.748 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T11:24:27.467084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419108,"kb_used_data":20936,"kb_used_omap":13,"kb_used_meta":398066,"kb_avail":754555612,"statfs":{"total":773094113280,"available":772664946688,"internally_reserved":0,"allocated":21438464,"data_stored":11570816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":407619672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.817370"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656218+0000","last_change":"2023-07-20T11:24:22.656218+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656218+0000","last_undegraded":"2023-07-20T11:24:22.656218+0000","last_fullsized":"2023-07-20T11:24:22.656218+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657003+0000","last_change":"2023-07-20T11:24:22.657003+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657003+0000","last_undegraded":"2023-07-20T11:24:22.657003+0000","last_fullsized":"2023-07-20T11:24:22.657003+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656933+0000","last_change":"2023-07-20T11:24:22.656933+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656933+0000","last_undegraded":"2023-07-20T11:24:22.656933+0000","last_fullsized":"2023-07-20T11:24:22.656933+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652832+0000","last_change":"2023-07-20T11:24:22.652832+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652832+0000","last_undegraded":"2023-07-20T11:24:22.652832+0000","last_fullsized":"2023-07-20T11:24:22.652832+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653207+0000","last_change":"2023-07-20T11:24:22.653207+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653207+0000","last_undegraded":"2023-07-20T11:24:22.653207+0000","last_fullsized":"2023-07-20T11:24:22.653207+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657618+0000","last_change":"2023-07-20T11:24:22.657618+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657618+0000","last_undegraded":"2023-07-20T11:24:22.657618+0000","last_fullsized":"2023-07-20T11:24:22.657618+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655918+0000","last_change":"2023-07-20T11:24:22.655918+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655918+0000","last_undegraded":"2023-07-20T11:24:22.655918+0000","last_fullsized":"2023-07-20T11:24:22.655918+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652663+0000","last_change":"2023-07-20T11:24:22.652663+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652663+0000","last_undegraded":"2023-07-20T11:24:22.652663+0000","last_fullsized":"2023-07-20T11:24:22.652663+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652755+0000","last_change":"2023-07-20T11:24:22.652755+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652755+0000","last_undegraded":"2023-07-20T11:24:22.652755+0000","last_fullsized":"2023-07-20T11:24:22.652755+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.658167+0000","last_change":"2023-07-20T11:24:22.658167+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.658167+0000","last_undegraded":"2023-07-20T11:24:22.658167+0000","last_fullsized":"2023-07-20T11:24:22.658167+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T11:24:22.657294+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653421+0000","last_change":"2023-07-20T11:24:22.653421+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653421+0000","last_undegraded":"2023-07-20T11:24:22.653421+0000","last_fullsized":"2023-07-20T11:24:22.653421+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652620+0000","last_change":"2023-07-20T11:24:22.652620+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652620+0000","last_undegraded":"2023-07-20T11:24:22.652620+0000","last_fullsized":"2023-07-20T11:24:22.652620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656166+0000","last_change":"2023-07-20T11:24:22.656166+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656166+0000","last_undegraded":"2023-07-20T11:24:22.656166+0000","last_fullsized":"2023-07-20T11:24:22.656166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.654042+0000","last_change":"2023-07-20T11:24:22.654042+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.654042+0000","last_undegraded":"2023-07-20T11:24:22.654042+0000","last_fullsized":"2023-07-20T11:24:22.654042+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657946+0000","last_change":"2023-07-20T11:24:22.657946+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657946+0000","last_undegraded":"2023-07-20T11:24:22.657946+0000","last_fullsized":"2023-07-20T11:24:22.657946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656734+0000","last_change":"2023-07-20T11:24:22.656734+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656734+0000","last_undegraded":"2023-07-20T11:24:22.656734+0000","last_fullsized":"2023-07-20T11:24:22.656734+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653360+0000","last_change":"2023-07-20T11:24:22.653360+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653360+0000","last_undegraded":"2023-07-20T11:24:22.653360+0000","last_fullsized":"2023-07-20T11:24:22.653360+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656324+0000","last_change":"2023-07-20T11:24:22.656324+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656324+0000","last_undegraded":"2023-07-20T11:24:22.656324+0000","last_fullsized":"2023-07-20T11:24:22.656324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655715+0000","last_change":"2023-07-20T11:24:22.655715+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655715+0000","last_undegraded":"2023-07-20T11:24:22.655715+0000","last_fullsized":"2023-07-20T11:24:22.655715+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656201+0000","last_change":"2023-07-20T11:24:22.656201+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656201+0000","last_undegraded":"2023-07-20T11:24:22.656201+0000","last_fullsized":"2023-07-20T11:24:22.656201+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656223+0000","last_change":"2023-07-20T11:24:22.656223+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656223+0000","last_undegraded":"2023-07-20T11:24:22.656223+0000","last_fullsized":"2023-07-20T11:24:22.656223+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653285+0000","last_change":"2023-07-20T11:24:22.653285+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653285+0000","last_undegraded":"2023-07-20T11:24:22.653285+0000","last_fullsized":"2023-07-20T11:24:22.653285+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657493+0000","last_change":"2023-07-20T11:24:22.657493+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657493+0000","last_undegraded":"2023-07-20T11:24:22.657493+0000","last_fullsized":"2023-07-20T11:24:22.657493+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655938+0000","last_change":"2023-07-20T11:24:22.655938+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655938+0000","last_undegraded":"2023-07-20T11:24:22.655938+0000","last_fullsized":"2023-07-20T11:24:22.655938+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"194'326","reported_seq":1266,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656690+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:22.656690+0000","last_peered":"2023-07-20T11:24:22.656690+0000","last_clean":"2023-07-20T11:24:22.656690+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:22.656690+0000","last_undegraded":"2023-07-20T11:24:22.656690+0000","last_fullsized":"2023-07-20T11:24:22.656690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:51:34.037554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.652994+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:22.652994+0000","last_peered":"2023-07-20T11:24:22.652994+0000","last_clean":"2023-07-20T11:24:22.652994+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:22.652994+0000","last_undegraded":"2023-07-20T11:24:22.652994+0000","last_fullsized":"2023-07-20T11:24:22.652994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:09.439571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655610+0000","last_change":"2023-07-20T11:24:22.655610+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655610+0000","last_undegraded":"2023-07-20T11:24:22.655610+0000","last_fullsized":"2023-07-20T11:24:22.655610+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":369,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656728+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:22.656728+0000","last_peered":"2023-07-20T11:24:22.656728+0000","last_clean":"2023-07-20T11:24:22.656728+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:22.656728+0000","last_undegraded":"2023-07-20T11:24:22.656728+0000","last_fullsized":"2023-07-20T11:24:22.656728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:21.358961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656651+0000","last_change":"2023-07-20T11:24:22.656651+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656651+0000","last_undegraded":"2023-07-20T11:24:22.656651+0000","last_fullsized":"2023-07-20T11:24:22.656651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":402,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.651422+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:22.651422+0000","last_peered":"2023-07-20T11:24:22.651422+0000","last_clean":"2023-07-20T11:24:22.651422+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:22.651422+0000","last_undegraded":"2023-07-20T11:24:22.651422+0000","last_fullsized":"2023-07-20T11:24:22.651422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:25.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652620+0000","last_change":"2023-07-20T11:24:22.652620+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652620+0000","last_undegraded":"2023-07-20T11:24:22.652620+0000","last_fullsized":"2023-07-20T11:24:22.652620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.652817+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:22.652817+0000","last_peered":"2023-07-20T11:24:22.652817+0000","last_clean":"2023-07-20T11:24:22.652817+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:22.652817+0000","last_undegraded":"2023-07-20T11:24:22.652817+0000","last_fullsized":"2023-07-20T11:24:22.652817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:44.274313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T11:24:22.657294+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":367,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.657070+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:22.657070+0000","last_peered":"2023-07-20T11:24:22.657070+0000","last_clean":"2023-07-20T11:24:22.657070+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:22.657070+0000","last_undegraded":"2023-07-20T11:24:22.657070+0000","last_fullsized":"2023-07-20T11:24:22.657070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:10.132823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657415+0000","last_change":"2023-07-20T11:24:22.657415+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657415+0000","last_undegraded":"2023-07-20T11:24:22.657415+0000","last_fullsized":"2023-07-20T11:24:22.657415+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:22.657294+0000","last_peered":"2023-07-20T11:24:22.657294+0000","last_clean":"2023-07-20T11:24:22.657294+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:10:55.274264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653085+0000","last_change":"2023-07-20T11:24:22.653085+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653085+0000","last_undegraded":"2023-07-20T11:24:22.653085+0000","last_fullsized":"2023-07-20T11:24:22.653085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":366,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.659827+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:22.659827+0000","last_peered":"2023-07-20T11:24:22.659827+0000","last_clean":"2023-07-20T11:24:22.659827+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:22.659827+0000","last_undegraded":"2023-07-20T11:24:22.659827+0000","last_fullsized":"2023-07-20T11:24:22.659827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:54.754966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653320+0000","last_change":"2023-07-20T11:24:22.653320+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653320+0000","last_undegraded":"2023-07-20T11:24:22.653320+0000","last_fullsized":"2023-07-20T11:24:22.653320+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656956+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:22.656956+0000","last_peered":"2023-07-20T11:24:22.656956+0000","last_clean":"2023-07-20T11:24:22.656956+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:22.656956+0000","last_undegraded":"2023-07-20T11:24:22.656956+0000","last_fullsized":"2023-07-20T11:24:22.656956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:37:18.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52216,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319624,"statfs":{"total":96636764160,"available":96583294976,"internally_reserved":0,"allocated":3125248,"data_stored":1889128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.88100000000000001,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":1.0409999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.081},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":1.012,"15min":1.0900000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.98499999999999999,"5min":1.012,"15min":1.0509999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.0349999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98599999999999999,"5min":1.026,"15min":1.03},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.97999999999999998,"5min":1.042,"15min":1.042},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.95499999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.95099999999999996,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41780,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330060,"statfs":{"total":96636764160,"available":96593981440,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":1.103}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.129},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.75}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":1.171},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":1.087}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":1.03}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.76900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.38},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.502}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.626}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312016,"statfs":{"total":96636764160,"available":96575504384,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.379}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37684,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334156,"statfs":{"total":96636764160,"available":96598175744,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.628},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48120,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323720,"statfs":{"total":96636764160,"available":96587489280,"internally_reserved":0,"allocated":3125248,"data_stored":1889128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.435}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.62},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:28.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:28.930 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 Processor -- start 2023-07-20T11:24:28.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 -- start start 2023-07-20T11:24:28.931 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 0x7fac5c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 0x7fac5c0b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0b7c20 con 0x7fac5c0ccfb0 2023-07-20T11:24:28.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c15c9d0 con 0x7fac5c15c5f0 2023-07-20T11:24:28.932 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac6263a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ce030 con 0x7fac5c0ceb70 2023-07-20T11:24:28.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac60e37640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fac5c0ccfb0 0x7fac5c0ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52222/0 (socket says 172.21.15.82:52222) 2023-07-20T11:24:28.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac60e37640 1 -- 172.21.15.82:0/3264736103 learned_addr learned my addr 172.21.15.82:0/3264736103 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:28.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61638640 1 --2- 172.21.15.82:0/3264736103 >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 0x7fac5c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.933 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61e39640 1 --2- 172.21.15.82:0/3264736103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 0x7fac5c0b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac53fff640 1 -- 172.21.15.82:0/3264736103 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693122630 0 0) 0x7fac5c0b7c20 con 0x7fac5c0ccfb0 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac53fff640 1 -- 172.21.15.82:0/3264736103 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac48003530 con 0x7fac5c0ccfb0 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61e39640 1 -- 172.21.15.82:0/3264736103 >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 msgr2=0x7fac5c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61e39640 1 --2- 172.21.15.82:0/3264736103 >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 0x7fac5c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61e39640 1 -- 172.21.15.82:0/3264736103 >> v1:172.21.15.82:6789/0 conn(0x7fac5c0ccfb0 legacy=0x7fac5c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.934 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61e39640 1 -- 172.21.15.82:0/3264736103 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0cd4b0 con 0x7fac5c0ceb70 2023-07-20T11:24:28.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.936+0000 7fac61638640 1 --2- 172.21.15.82:0/3264736103 >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 0x7fac5c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:28.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac61e39640 1 --2- 172.21.15.82:0/3264736103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 0x7fac5c0b0f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac540097c0 tx=0x7fac5401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9d92ed1dbc5f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac53fff640 1 -- 172.21.15.82:0/3264736103 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540a8970 con 0x7fac5c0ceb70 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac53fff640 1 -- 172.21.15.82:0/3264736103 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540a8ad0 con 0x7fac5c0ceb70 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac53fff640 1 -- 172.21.15.82:0/3264736103 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540a8e60 con 0x7fac5c0ceb70 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 -- 172.21.15.82:0/3264736103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 msgr2=0x7fac5c0b0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 --2- 172.21.15.82:0/3264736103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 0x7fac5c0b0f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fac540097c0 tx=0x7fac5401ec70 comp rx=0 tx=0).stop 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 -- 172.21.15.82:0/3264736103 shutdown_connections 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 --2- 172.21.15.82:0/3264736103 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ceb70 0x7fac5c0b0f70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 --2- 172.21.15.82:0/3264736103 >> v2:172.21.15.183:3300/0 conn(0x7fac5c15c5f0 0x7fac5c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 -- 172.21.15.82:0/3264736103 >> 172.21.15.82:0/3264736103 conn(0x7fac5c065710 msgr2=0x7fac5c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:28.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 -- 172.21.15.82:0/3264736103 shutdown_connections 2023-07-20T11:24:28.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.940+0000 7fac6263a640 1 -- 172.21.15.82:0/3264736103 wait complete. 2023-07-20T11:24:28.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 Processor -- start 2023-07-20T11:24:28.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 -- start start 2023-07-20T11:24:28.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ccfb0 0x7fac5c14dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac5c0ceb70 0x7fac5c0a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0aa380 con 0x7fac5c15c5f0 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ca6d0 con 0x7fac5c0ceb70 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0ca9b0 con 0x7fac5c0ccfb0 2023-07-20T11:24:28.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37478/0 (socket says 172.21.15.82:37478) 2023-07-20T11:24:28.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 -- 172.21.15.82:0/978050493 learned_addr learned my addr 172.21.15.82:0/978050493 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 -- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ccfb0 msgr2=0x7fac5c14dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ccfb0 0x7fac5c14dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 -- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac5c0ceb70 msgr2=0x7fac5c0a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac5c0ceb70 0x7fac5c0a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 -- 172.21.15.82:0/978050493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009a70 con 0x7fac5c15c5f0 2023-07-20T11:24:28.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac61e39640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7fac5401c8a0 tx=0x7fac5401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540b0cc0 con 0x7fac5c15c5f0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac540b0e20 con 0x7fac5c15c5f0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac540b9670 con 0x7fac5c15c5f0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.944+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac54009420 con 0x7fac5c15c5f0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c0caf70 con 0x7fac5c15c5f0 2023-07-20T11:24:28.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c04da30 con 0x7fac5c15c5f0 2023-07-20T11:24:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac540b7040 con 0x7fac5c15c5f0 2023-07-20T11:24:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac51ffb640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 0x7fac40068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fac54121a40 con 0x7fac5c15c5f0 2023-07-20T11:24:28.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac61638640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 0x7fac40068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:28.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.948+0000 7fac61638640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 0x7fac40068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac5c1f4f70 tx=0x7fac5800b040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:28.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:28.952+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac540eecc0 con 0x7fac5c15c5f0 2023-07-20T11:24:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.096+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac5c0ca840 con 0x7fac400663a0 2023-07-20T11:24:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.104+0000 7fac51ffb640 1 -- 172.21.15.82:0/978050493 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299578 (secure 0 0 0) 0x7fac5c0ca840 con 0x7fac400663a0 2023-07-20T11:24:29.103 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:29.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 msgr2=0x7fac40068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 0x7fac40068860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac5c1f4f70 tx=0x7fac5800b040 comp rx=0 tx=0).stop 2023-07-20T11:24:29.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 msgr2=0x7fac5c0d24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.105 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7fac5401c8a0 tx=0x7fac5401ba10 comp rx=0 tx=0).stop 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 shutdown_connections 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fac400663a0 0x7fac40068860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac5c15c5f0 0x7fac5c0d24f0 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac5c0ceb70 0x7fac5c0a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 --2- 172.21.15.82:0/978050493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fac5c0ccfb0 0x7fac5c14dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 >> 172.21.15.82:0/978050493 conn(0x7fac5c065710 msgr2=0x7fac5c15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 shutdown_connections 2023-07-20T11:24:29.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.108+0000 7fac6263a640 1 -- 172.21.15.82:0/978050493 wait complete. 2023-07-20T11:24:29.123 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T11:24:27.467084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419108,"kb_used_data":20936,"kb_used_omap":13,"kb_used_meta":398066,"kb_avail":754555612,"statfs":{"total":773094113280,"available":772664946688,"internally_reserved":0,"allocated":21438464,"data_stored":11570816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":407619672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.817370"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656218+0000","last_change":"2023-07-20T11:24:22.656218+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656218+0000","last_undegraded":"2023-07-20T11:24:22.656218+0000","last_fullsized":"2023-07-20T11:24:22.656218+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657003+0000","last_change":"2023-07-20T11:24:22.657003+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657003+0000","last_undegraded":"2023-07-20T11:24:22.657003+0000","last_fullsized":"2023-07-20T11:24:22.657003+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656933+0000","last_change":"2023-07-20T11:24:22.656933+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656933+0000","last_undegraded":"2023-07-20T11:24:22.656933+0000","last_fullsized":"2023-07-20T11:24:22.656933+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652832+0000","last_change":"2023-07-20T11:24:22.652832+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652832+0000","last_undegraded":"2023-07-20T11:24:22.652832+0000","last_fullsized":"2023-07-20T11:24:22.652832+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653207+0000","last_change":"2023-07-20T11:24:22.653207+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653207+0000","last_undegraded":"2023-07-20T11:24:22.653207+0000","last_fullsized":"2023-07-20T11:24:22.653207+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657618+0000","last_change":"2023-07-20T11:24:22.657618+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657618+0000","last_undegraded":"2023-07-20T11:24:22.657618+0000","last_fullsized":"2023-07-20T11:24:22.657618+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655918+0000","last_change":"2023-07-20T11:24:22.655918+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655918+0000","last_undegraded":"2023-07-20T11:24:22.655918+0000","last_fullsized":"2023-07-20T11:24:22.655918+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652663+0000","last_change":"2023-07-20T11:24:22.652663+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652663+0000","last_undegraded":"2023-07-20T11:24:22.652663+0000","last_fullsized":"2023-07-20T11:24:22.652663+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652755+0000","last_change":"2023-07-20T11:24:22.652755+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652755+0000","last_undegraded":"2023-07-20T11:24:22.652755+0000","last_fullsized":"2023-07-20T11:24:22.652755+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.658167+0000","last_change":"2023-07-20T11:24:22.658167+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.658167+0000","last_undegraded":"2023-07-20T11:24:22.658167+0000","last_fullsized":"2023-07-20T11:24:22.658167+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T11:24:22.657294+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653421+0000","last_change":"2023-07-20T11:24:22.653421+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653421+0000","last_undegraded":"2023-07-20T11:24:22.653421+0000","last_fullsized":"2023-07-20T11:24:22.653421+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652620+0000","last_change":"2023-07-20T11:24:22.652620+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652620+0000","last_undegraded":"2023-07-20T11:24:22.652620+0000","last_fullsized":"2023-07-20T11:24:22.652620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656166+0000","last_change":"2023-07-20T11:24:22.656166+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656166+0000","last_undegraded":"2023-07-20T11:24:22.656166+0000","last_fullsized":"2023-07-20T11:24:22.656166+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.654042+0000","last_change":"2023-07-20T11:24:22.654042+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.654042+0000","last_undegraded":"2023-07-20T11:24:22.654042+0000","last_fullsized":"2023-07-20T11:24:22.654042+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657946+0000","last_change":"2023-07-20T11:24:22.657946+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657946+0000","last_undegraded":"2023-07-20T11:24:22.657946+0000","last_fullsized":"2023-07-20T11:24:22.657946+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656734+0000","last_change":"2023-07-20T11:24:22.656734+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656734+0000","last_undegraded":"2023-07-20T11:24:22.656734+0000","last_fullsized":"2023-07-20T11:24:22.656734+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653360+0000","last_change":"2023-07-20T11:24:22.653360+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653360+0000","last_undegraded":"2023-07-20T11:24:22.653360+0000","last_fullsized":"2023-07-20T11:24:22.653360+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656324+0000","last_change":"2023-07-20T11:24:22.656324+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656324+0000","last_undegraded":"2023-07-20T11:24:22.656324+0000","last_fullsized":"2023-07-20T11:24:22.656324+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655715+0000","last_change":"2023-07-20T11:24:22.655715+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655715+0000","last_undegraded":"2023-07-20T11:24:22.655715+0000","last_fullsized":"2023-07-20T11:24:22.655715+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656201+0000","last_change":"2023-07-20T11:24:22.656201+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656201+0000","last_undegraded":"2023-07-20T11:24:22.656201+0000","last_fullsized":"2023-07-20T11:24:22.656201+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656223+0000","last_change":"2023-07-20T11:24:22.656223+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656223+0000","last_undegraded":"2023-07-20T11:24:22.656223+0000","last_fullsized":"2023-07-20T11:24:22.656223+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653285+0000","last_change":"2023-07-20T11:24:22.653285+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653285+0000","last_undegraded":"2023-07-20T11:24:22.653285+0000","last_fullsized":"2023-07-20T11:24:22.653285+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657493+0000","last_change":"2023-07-20T11:24:22.657493+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657493+0000","last_undegraded":"2023-07-20T11:24:22.657493+0000","last_fullsized":"2023-07-20T11:24:22.657493+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655938+0000","last_change":"2023-07-20T11:24:22.655938+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655938+0000","last_undegraded":"2023-07-20T11:24:22.655938+0000","last_fullsized":"2023-07-20T11:24:22.655938+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"194'326","reported_seq":1266,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656690+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:22.656690+0000","last_peered":"2023-07-20T11:24:22.656690+0000","last_clean":"2023-07-20T11:24:22.656690+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:22.656690+0000","last_undegraded":"2023-07-20T11:24:22.656690+0000","last_fullsized":"2023-07-20T11:24:22.656690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:51:34.037554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.652994+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:22.652994+0000","last_peered":"2023-07-20T11:24:22.652994+0000","last_clean":"2023-07-20T11:24:22.652994+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:22.652994+0000","last_undegraded":"2023-07-20T11:24:22.652994+0000","last_fullsized":"2023-07-20T11:24:22.652994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:33:09.439571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.655610+0000","last_change":"2023-07-20T11:24:22.655610+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.655610+0000","last_undegraded":"2023-07-20T11:24:22.655610+0000","last_fullsized":"2023-07-20T11:24:22.655610+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":369,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656728+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:22.656728+0000","last_peered":"2023-07-20T11:24:22.656728+0000","last_clean":"2023-07-20T11:24:22.656728+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:22.656728+0000","last_undegraded":"2023-07-20T11:24:22.656728+0000","last_fullsized":"2023-07-20T11:24:22.656728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:30:21.358961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.656651+0000","last_change":"2023-07-20T11:24:22.656651+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.656651+0000","last_undegraded":"2023-07-20T11:24:22.656651+0000","last_fullsized":"2023-07-20T11:24:22.656651+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":402,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.651422+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:22.651422+0000","last_peered":"2023-07-20T11:24:22.651422+0000","last_clean":"2023-07-20T11:24:22.651422+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:22.651422+0000","last_undegraded":"2023-07-20T11:24:22.651422+0000","last_fullsized":"2023-07-20T11:24:22.651422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:43:25.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.652620+0000","last_change":"2023-07-20T11:24:22.652620+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.652620+0000","last_undegraded":"2023-07-20T11:24:22.652620+0000","last_fullsized":"2023-07-20T11:24:22.652620+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.652817+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:22.652817+0000","last_peered":"2023-07-20T11:24:22.652817+0000","last_clean":"2023-07-20T11:24:22.652817+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:22.652817+0000","last_undegraded":"2023-07-20T11:24:22.652817+0000","last_fullsized":"2023-07-20T11:24:22.652817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:20:44.274313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T11:24:22.657294+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":367,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.657070+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:22.657070+0000","last_peered":"2023-07-20T11:24:22.657070+0000","last_clean":"2023-07-20T11:24:22.657070+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:22.657070+0000","last_undegraded":"2023-07-20T11:24:22.657070+0000","last_fullsized":"2023-07-20T11:24:22.657070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:12:10.132823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.657415+0000","last_change":"2023-07-20T11:24:22.657415+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.657415+0000","last_undegraded":"2023-07-20T11:24:22.657415+0000","last_fullsized":"2023-07-20T11:24:22.657415+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.657294+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:22.657294+0000","last_peered":"2023-07-20T11:24:22.657294+0000","last_clean":"2023-07-20T11:24:22.657294+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:22.657294+0000","last_undegraded":"2023-07-20T11:24:22.657294+0000","last_fullsized":"2023-07-20T11:24:22.657294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:10:55.274264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653085+0000","last_change":"2023-07-20T11:24:22.653085+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653085+0000","last_undegraded":"2023-07-20T11:24:22.653085+0000","last_fullsized":"2023-07-20T11:24:22.653085+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":366,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.659827+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:22.659827+0000","last_peered":"2023-07-20T11:24:22.659827+0000","last_clean":"2023-07-20T11:24:22.659827+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:22.659827+0000","last_undegraded":"2023-07-20T11:24:22.659827+0000","last_fullsized":"2023-07-20T11:24:22.659827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:29:54.754966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-20T11:24:23.649322+0000","last_change":"2023-07-20T11:24:23.649322+0000","last_active":"2023-07-20T11:24:23.649322+0000","last_peered":"2023-07-20T11:24:23.649322+0000","last_clean":"2023-07-20T11:24:23.649322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:23.649322+0000","last_undegraded":"2023-07-20T11:24:23.649322+0000","last_fullsized":"2023-07-20T11:24:23.649322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":202,"state":"creating+peering","last_fresh":"2023-07-20T11:24:22.653320+0000","last_change":"2023-07-20T11:24:22.653320+0000","last_active":"2023-07-20T11:24:22.641610+0000","last_peered":"2023-07-20T11:24:22.641610+0000","last_clean":"2023-07-20T11:24:22.641610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-20T11:24:22.653320+0000","last_undegraded":"2023-07-20T11:24:22.653320+0000","last_fullsized":"2023-07-20T11:24:22.653320+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-07-20T11:24:22.656956+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:22.656956+0000","last_peered":"2023-07-20T11:24:22.656956+0000","last_clean":"2023-07-20T11:24:22.656956+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:22.656956+0000","last_undegraded":"2023-07-20T11:24:22.656956+0000","last_fullsized":"2023-07-20T11:24:22.656956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:37:18.372421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575968,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52216,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319624,"statfs":{"total":96636764160,"available":96583294976,"internally_reserved":0,"allocated":3125248,"data_stored":1889128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.88100000000000001,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":1.0409999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.081},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":1.012,"15min":1.0900000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.98499999999999999,"5min":1.012,"15min":1.0509999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.0349999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98599999999999999,"5min":1.026,"15min":1.03},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.97999999999999998,"5min":1.042,"15min":1.042},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.95499999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.95099999999999996,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41780,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330060,"statfs":{"total":96636764160,"available":96593981440,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.755},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.79100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575968,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.85899999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.89600000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":1.103}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.129},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.75}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":1.171},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":1.087}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":1.03}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.88500000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.76900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59828,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312012,"statfs":{"total":96636764160,"available":96575500288,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.38},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.502}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.626}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.63500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59824,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94312016,"statfs":{"total":96636764160,"available":96575504384,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.379}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.67600000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575968,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37684,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334156,"statfs":{"total":96636764160,"available":96598175744,"internally_reserved":0,"allocated":2531328,"data_stored":1298760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.628},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48120,"kb_used_data":3052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323720,"statfs":{"total":96636764160,"available":96587489280,"internally_reserved":0,"allocated":3125248,"data_stored":1889128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.435}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.62},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:29.130 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:29.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 Processor -- start 2023-07-20T11:24:29.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 -- start start 2023-07-20T11:24:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4ba415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba40ccd60 con 0x7f4ba40cc900 2023-07-20T11:24:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba40ad810 con 0x7f4ba40b2a90 2023-07-20T11:24:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.312+0000 7f4ba8bba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba415d0d0 con 0x7f4ba41596b0 2023-07-20T11:24:29.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4b99d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f4ba40cc900 0x7f4ba40b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52230/0 (socket says 172.21.15.82:52230) 2023-07-20T11:24:29.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4b99d9b640 1 -- 172.21.15.82:0/367735867 learned_addr learned my addr 172.21.15.82:0/367735867 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:29.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba259c640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4ba415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603292029 0 0) 0x7f4ba40ccd60 con 0x7f4ba40cc900 2023-07-20T11:24:29.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b90003530 con 0x7f4ba40cc900 2023-07-20T11:24:29.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1298132669 0 0) 0x7f4b90003530 con 0x7f4ba40cc900 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 msgr2=0x7f4ba415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4ba415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 >> v1:172.21.15.183:6789/0 conn(0x7f4ba40b2a90 legacy=0x7f4ba40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba415d3b0 con 0x7f4ba40cc900 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f4b8c001680 con 0x7f4ba40cc900 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 >> v1:172.21.15.82:6789/0 conn(0x7f4ba40cc900 legacy=0x7f4ba40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4b900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b90003ef0 0x7f4b900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b90004d10 0x7f4b90005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba415d0d0 con 0x7f4b90004d10 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9000b9f0 con 0x7f4b90003ef0 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9000bbb0 con 0x7f4ba41596b0 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b90004d10 0x7f4b90005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba259c640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4b900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4b99d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b90003ef0 0x7f4b900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 msgr2=0x7f4b900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4ba41596b0 0x7f4b900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b90003ef0 msgr2=0x7f4b900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b90003ef0 0x7f4b900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/367735867 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90003530 con 0x7f4b90004d10 2023-07-20T11:24:29.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.316+0000 7f4b99d9b640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b90003ef0 0x7f4b900047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:29.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b90004d10 0x7f4b90005190 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001f60 tx=0x7f4b9c01c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1328a6e4d727c280 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0a5750 con 0x7f4b90004d10 2023-07-20T11:24:29.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0a58b0 con 0x7f4b90004d10 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba1d9b640 1 -- 172.21.15.82:0/367735867 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0a5ca0 con 0x7f4b90004d10 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- 172.21.15.82:0/367735867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b90004d10 msgr2=0x7f4b90005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/367735867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b90004d10 0x7f4b90005190 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001f60 tx=0x7f4b9c01c860 comp rx=0 tx=0).stop 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/367735867 reap_dead start 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- 172.21.15.82:0/367735867 shutdown_connections 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- 172.21.15.82:0/367735867 >> 172.21.15.82:0/367735867 conn(0x7f4ba40cada0 msgr2=0x7f4ba40cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- 172.21.15.82:0/367735867 shutdown_connections 2023-07-20T11:24:29.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- 172.21.15.82:0/367735867 wait complete. 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 Processor -- start 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.320+0000 7f4ba8bba640 1 -- start start 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b90004d10 0x7f4ba40aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 0x7f4ba40abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40b0bc0 con 0x7f4ba40ac490 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba41562f0 con 0x7f4ba4159a90 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba40aead0 con 0x7f4b90004d10 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37494/0 (socket says 172.21.15.82:37494) 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/3101687297 learned_addr learned my addr 172.21.15.82:0/3101687297 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:29.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba259c640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b90004d10 0x7f4ba40aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b99d9b640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 0x7f4ba40abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b90004d10 msgr2=0x7f4ba40aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b90004d10 0x7f4ba40aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 msgr2=0x7f4ba40abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 0x7f4ba40abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 -- 172.21.15.82:0/3101687297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba40aedb0 con 0x7f4ba40ac490 2023-07-20T11:24:29.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b99d9b640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 0x7f4ba40abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:29.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba2d9d640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001f60 tx=0x7f4b90005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c003b80 con 0x7f4ba40ac490 2023-07-20T11:24:29.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c003ce0 con 0x7f4ba40ac490 2023-07-20T11:24:29.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c005270 con 0x7f4ba40ac490 2023-07-20T11:24:29.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba40b0500 con 0x7f4ba40ac490 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba415c9f0 con 0x7f4ba40ac490 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba40b0360 con 0x7f4ba40ac490 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.324+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4b9c0b4040 con 0x7f4ba40ac490 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.328+0000 7f4b9b7fe640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 0x7f4b84068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.328+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4b9c11d850 con 0x7f4ba40ac490 2023-07-20T11:24:29.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.328+0000 7f4ba259c640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 0x7f4b84068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.328+0000 7f4ba259c640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 0x7f4b84068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009b20 tx=0x7f4b94008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.325 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.332+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ba40b0360 con 0x7f4ba40ac490 2023-07-20T11:24:29.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.476+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ba40ab8a0 con 0x7f4b840663a0 2023-07-20T11:24:29.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.484+0000 7f4b9b7fe640 1 -- 172.21.15.82:0/3101687297 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311823 (secure 0 0 0) 0x7f4ba40ab8a0 con 0x7f4b840663a0 2023-07-20T11:24:29.480 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:29.482 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 msgr2=0x7f4b84068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 0x7f4b84068860 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b94009b20 tx=0x7f4b94008040 comp rx=0 tx=0).stop 2023-07-20T11:24:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 msgr2=0x7f4ba40c3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c001f60 tx=0x7f4b90005800 comp rx=0 tx=0).stop 2023-07-20T11:24:29.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 shutdown_connections 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f4b840663a0 0x7f4b84068860 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ba40ac490 0x7f4ba40c3130 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ba4159a90 0x7f4ba40abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 --2- 172.21.15.82:0/3101687297 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4b90004d10 0x7f4ba40aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 >> 172.21.15.82:0/3101687297 conn(0x7f4ba40cada0 msgr2=0x7f4ba406b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 shutdown_connections 2023-07-20T11:24:29.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.488+0000 7f4ba8bba640 1 -- 172.21.15.82:0/3101687297 wait complete. 2023-07-20T11:24:29.500 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:24:29.467448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419488,"kb_used_data":21288,"kb_used_omap":13,"kb_used_meta":398066,"kb_avail":754555232,"statfs":{"total":773094113280,"available":772664557568,"internally_reserved":0,"allocated":21798912,"data_stored":11740540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":407619672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551725+0000","last_change":"2023-07-20T11:24:24.689522+0000","last_active":"2023-07-20T11:24:26.551725+0000","last_peered":"2023-07-20T11:24:26.551725+0000","last_clean":"2023-07-20T11:24:26.551725+0000","last_became_active":"2023-07-20T11:24:24.689205+0000","last_became_peered":"2023-07-20T11:24:24.689205+0000","last_unstale":"2023-07-20T11:24:26.551725+0000","last_undegraded":"2023-07-20T11:24:26.551725+0000","last_fullsized":"2023-07-20T11:24:26.551725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:17.113569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551583+0000","last_change":"2023-07-20T11:24:24.684078+0000","last_active":"2023-07-20T11:24:26.551583+0000","last_peered":"2023-07-20T11:24:26.551583+0000","last_clean":"2023-07-20T11:24:26.551583+0000","last_became_active":"2023-07-20T11:24:24.683809+0000","last_became_peered":"2023-07-20T11:24:24.683809+0000","last_unstale":"2023-07-20T11:24:26.551583+0000","last_undegraded":"2023-07-20T11:24:26.551583+0000","last_fullsized":"2023-07-20T11:24:26.551583+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:50:10.947864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550342+0000","last_change":"2023-07-20T11:24:24.685040+0000","last_active":"2023-07-20T11:24:26.550342+0000","last_peered":"2023-07-20T11:24:26.550342+0000","last_clean":"2023-07-20T11:24:26.550342+0000","last_became_active":"2023-07-20T11:24:24.684761+0000","last_became_peered":"2023-07-20T11:24:24.684761+0000","last_unstale":"2023-07-20T11:24:26.550342+0000","last_undegraded":"2023-07-20T11:24:26.550342+0000","last_fullsized":"2023-07-20T11:24:26.550342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:04.326648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550487+0000","last_change":"2023-07-20T11:24:24.678905+0000","last_active":"2023-07-20T11:24:26.550487+0000","last_peered":"2023-07-20T11:24:26.550487+0000","last_clean":"2023-07-20T11:24:26.550487+0000","last_became_active":"2023-07-20T11:24:24.678468+0000","last_became_peered":"2023-07-20T11:24:24.678468+0000","last_unstale":"2023-07-20T11:24:26.550487+0000","last_undegraded":"2023-07-20T11:24:26.550487+0000","last_fullsized":"2023-07-20T11:24:26.550487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:03.435696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550459+0000","last_change":"2023-07-20T11:24:24.677166+0000","last_active":"2023-07-20T11:24:26.550459+0000","last_peered":"2023-07-20T11:24:26.550459+0000","last_clean":"2023-07-20T11:24:26.550459+0000","last_became_active":"2023-07-20T11:24:24.675153+0000","last_became_peered":"2023-07-20T11:24:24.675153+0000","last_unstale":"2023-07-20T11:24:26.550459+0000","last_undegraded":"2023-07-20T11:24:26.550459+0000","last_fullsized":"2023-07-20T11:24:26.550459+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:18.202507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549862+0000","last_change":"2023-07-20T11:24:24.687155+0000","last_active":"2023-07-20T11:24:26.549862+0000","last_peered":"2023-07-20T11:24:26.549862+0000","last_clean":"2023-07-20T11:24:26.549862+0000","last_became_active":"2023-07-20T11:24:24.686804+0000","last_became_peered":"2023-07-20T11:24:24.686804+0000","last_unstale":"2023-07-20T11:24:26.549862+0000","last_undegraded":"2023-07-20T11:24:26.549862+0000","last_fullsized":"2023-07-20T11:24:26.549862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:58.430858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663522+0000","last_change":"2023-07-20T11:24:24.690701+0000","last_active":"2023-07-20T11:24:25.663522+0000","last_peered":"2023-07-20T11:24:25.663522+0000","last_clean":"2023-07-20T11:24:25.663522+0000","last_became_active":"2023-07-20T11:24:24.690389+0000","last_became_peered":"2023-07-20T11:24:24.690389+0000","last_unstale":"2023-07-20T11:24:25.663522+0000","last_undegraded":"2023-07-20T11:24:25.663522+0000","last_fullsized":"2023-07-20T11:24:25.663522+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:29.712784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549667+0000","last_change":"2023-07-20T11:24:24.683027+0000","last_active":"2023-07-20T11:24:26.549667+0000","last_peered":"2023-07-20T11:24:26.549667+0000","last_clean":"2023-07-20T11:24:26.549667+0000","last_became_active":"2023-07-20T11:24:24.682730+0000","last_became_peered":"2023-07-20T11:24:24.682730+0000","last_unstale":"2023-07-20T11:24:26.549667+0000","last_undegraded":"2023-07-20T11:24:26.549667+0000","last_fullsized":"2023-07-20T11:24:26.549667+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:09.177683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551773+0000","last_change":"2023-07-20T11:24:24.692353+0000","last_active":"2023-07-20T11:24:26.551773+0000","last_peered":"2023-07-20T11:24:26.551773+0000","last_clean":"2023-07-20T11:24:26.551773+0000","last_became_active":"2023-07-20T11:24:24.692085+0000","last_became_peered":"2023-07-20T11:24:24.692085+0000","last_unstale":"2023-07-20T11:24:26.551773+0000","last_undegraded":"2023-07-20T11:24:26.551773+0000","last_fullsized":"2023-07-20T11:24:26.551773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:21.058797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550398+0000","last_change":"2023-07-20T11:24:24.678931+0000","last_active":"2023-07-20T11:24:26.550398+0000","last_peered":"2023-07-20T11:24:26.550398+0000","last_clean":"2023-07-20T11:24:26.550398+0000","last_became_active":"2023-07-20T11:24:24.678641+0000","last_became_peered":"2023-07-20T11:24:24.678641+0000","last_unstale":"2023-07-20T11:24:26.550398+0000","last_undegraded":"2023-07-20T11:24:26.550398+0000","last_fullsized":"2023-07-20T11:24:26.550398+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:25.431348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666338+0000","last_change":"2023-07-20T11:24:24.679563+0000","last_active":"2023-07-20T11:24:25.666338+0000","last_peered":"2023-07-20T11:24:25.666338+0000","last_clean":"2023-07-20T11:24:25.666338+0000","last_became_active":"2023-07-20T11:24:24.679297+0000","last_became_peered":"2023-07-20T11:24:24.679297+0000","last_unstale":"2023-07-20T11:24:25.666338+0000","last_undegraded":"2023-07-20T11:24:25.666338+0000","last_fullsized":"2023-07-20T11:24:25.666338+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:00:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550612+0000","last_change":"2023-07-20T11:24:24.685142+0000","last_active":"2023-07-20T11:24:26.550612+0000","last_peered":"2023-07-20T11:24:26.550612+0000","last_clean":"2023-07-20T11:24:26.550612+0000","last_became_active":"2023-07-20T11:24:24.684811+0000","last_became_peered":"2023-07-20T11:24:24.684811+0000","last_unstale":"2023-07-20T11:24:26.550612+0000","last_undegraded":"2023-07-20T11:24:26.550612+0000","last_fullsized":"2023-07-20T11:24:26.550612+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:32.326580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664988+0000","last_change":"2023-07-20T11:24:24.679784+0000","last_active":"2023-07-20T11:24:25.664988+0000","last_peered":"2023-07-20T11:24:25.664988+0000","last_clean":"2023-07-20T11:24:25.664988+0000","last_became_active":"2023-07-20T11:24:24.679493+0000","last_became_peered":"2023-07-20T11:24:24.679493+0000","last_unstale":"2023-07-20T11:24:25.664988+0000","last_undegraded":"2023-07-20T11:24:25.664988+0000","last_fullsized":"2023-07-20T11:24:25.664988+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:02.838449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663625+0000","last_change":"2023-07-20T11:24:24.680757+0000","last_active":"2023-07-20T11:24:25.663625+0000","last_peered":"2023-07-20T11:24:25.663625+0000","last_clean":"2023-07-20T11:24:25.663625+0000","last_became_active":"2023-07-20T11:24:24.680458+0000","last_became_peered":"2023-07-20T11:24:24.680458+0000","last_unstale":"2023-07-20T11:24:25.663625+0000","last_undegraded":"2023-07-20T11:24:25.663625+0000","last_fullsized":"2023-07-20T11:24:25.663625+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:11.698388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551139+0000","last_change":"2023-07-20T11:24:24.682062+0000","last_active":"2023-07-20T11:24:26.551139+0000","last_peered":"2023-07-20T11:24:26.551139+0000","last_clean":"2023-07-20T11:24:26.551139+0000","last_became_active":"2023-07-20T11:24:24.681763+0000","last_became_peered":"2023-07-20T11:24:24.681763+0000","last_unstale":"2023-07-20T11:24:26.551139+0000","last_undegraded":"2023-07-20T11:24:26.551139+0000","last_fullsized":"2023-07-20T11:24:26.551139+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:07.320581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549640+0000","last_change":"2023-07-20T11:24:24.677393+0000","last_active":"2023-07-20T11:24:26.549640+0000","last_peered":"2023-07-20T11:24:26.549640+0000","last_clean":"2023-07-20T11:24:26.549640+0000","last_became_active":"2023-07-20T11:24:24.676507+0000","last_became_peered":"2023-07-20T11:24:24.676507+0000","last_unstale":"2023-07-20T11:24:26.549640+0000","last_undegraded":"2023-07-20T11:24:26.549640+0000","last_fullsized":"2023-07-20T11:24:26.549640+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:22:34.109165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550959+0000","last_change":"2023-07-20T11:24:24.696028+0000","last_active":"2023-07-20T11:24:26.550959+0000","last_peered":"2023-07-20T11:24:26.550959+0000","last_clean":"2023-07-20T11:24:26.550959+0000","last_became_active":"2023-07-20T11:24:24.695666+0000","last_became_peered":"2023-07-20T11:24:24.695666+0000","last_unstale":"2023-07-20T11:24:26.550959+0000","last_undegraded":"2023-07-20T11:24:26.550959+0000","last_fullsized":"2023-07-20T11:24:26.550959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:22:20.608126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665342+0000","last_change":"2023-07-20T11:24:24.690175+0000","last_active":"2023-07-20T11:24:25.665342+0000","last_peered":"2023-07-20T11:24:25.665342+0000","last_clean":"2023-07-20T11:24:25.665342+0000","last_became_active":"2023-07-20T11:24:24.689893+0000","last_became_peered":"2023-07-20T11:24:24.689893+0000","last_unstale":"2023-07-20T11:24:25.665342+0000","last_undegraded":"2023-07-20T11:24:25.665342+0000","last_fullsized":"2023-07-20T11:24:25.665342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665218+0000","last_change":"2023-07-20T11:24:24.685691+0000","last_active":"2023-07-20T11:24:25.665218+0000","last_peered":"2023-07-20T11:24:25.665218+0000","last_clean":"2023-07-20T11:24:25.665218+0000","last_became_active":"2023-07-20T11:24:24.685389+0000","last_became_peered":"2023-07-20T11:24:24.685389+0000","last_unstale":"2023-07-20T11:24:25.665218+0000","last_undegraded":"2023-07-20T11:24:25.665218+0000","last_fullsized":"2023-07-20T11:24:25.665218+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:58.929732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549998+0000","last_change":"2023-07-20T11:24:24.684881+0000","last_active":"2023-07-20T11:24:26.549998+0000","last_peered":"2023-07-20T11:24:26.549998+0000","last_clean":"2023-07-20T11:24:26.549998+0000","last_became_active":"2023-07-20T11:24:24.684558+0000","last_became_peered":"2023-07-20T11:24:24.684558+0000","last_unstale":"2023-07-20T11:24:26.549998+0000","last_undegraded":"2023-07-20T11:24:26.549998+0000","last_fullsized":"2023-07-20T11:24:26.549998+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:08:34.276396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551646+0000","last_change":"2023-07-20T11:24:24.691409+0000","last_active":"2023-07-20T11:24:26.551646+0000","last_peered":"2023-07-20T11:24:26.551646+0000","last_clean":"2023-07-20T11:24:26.551646+0000","last_became_active":"2023-07-20T11:24:24.691130+0000","last_became_peered":"2023-07-20T11:24:24.691130+0000","last_unstale":"2023-07-20T11:24:26.551646+0000","last_undegraded":"2023-07-20T11:24:26.551646+0000","last_fullsized":"2023-07-20T11:24:26.551646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:02.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550753+0000","last_change":"2023-07-20T11:24:24.691664+0000","last_active":"2023-07-20T11:24:26.550753+0000","last_peered":"2023-07-20T11:24:26.550753+0000","last_clean":"2023-07-20T11:24:26.550753+0000","last_became_active":"2023-07-20T11:24:24.691398+0000","last_became_peered":"2023-07-20T11:24:24.691398+0000","last_unstale":"2023-07-20T11:24:26.550753+0000","last_undegraded":"2023-07-20T11:24:26.550753+0000","last_fullsized":"2023-07-20T11:24:26.550753+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:48.242546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T11:24:24.688159+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T11:24:24.687858+0000","last_became_peered":"2023-07-20T11:24:24.687858+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:02.615288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550966+0000","last_change":"2023-07-20T11:24:24.691106+0000","last_active":"2023-07-20T11:24:26.550966+0000","last_peered":"2023-07-20T11:24:26.550966+0000","last_clean":"2023-07-20T11:24:26.550966+0000","last_became_active":"2023-07-20T11:24:24.690615+0000","last_became_peered":"2023-07-20T11:24:24.690615+0000","last_unstale":"2023-07-20T11:24:26.550966+0000","last_undegraded":"2023-07-20T11:24:26.550966+0000","last_fullsized":"2023-07-20T11:24:26.550966+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:16:02.556859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663976+0000","last_change":"2023-07-20T11:24:24.685774+0000","last_active":"2023-07-20T11:24:25.663976+0000","last_peered":"2023-07-20T11:24:25.663976+0000","last_clean":"2023-07-20T11:24:25.663976+0000","last_became_active":"2023-07-20T11:24:24.685518+0000","last_became_peered":"2023-07-20T11:24:24.685518+0000","last_unstale":"2023-07-20T11:24:25.663976+0000","last_undegraded":"2023-07-20T11:24:25.663976+0000","last_fullsized":"2023-07-20T11:24:25.663976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:08:02.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666609+0000","last_change":"2023-07-20T11:24:24.674557+0000","last_active":"2023-07-20T11:24:25.666609+0000","last_peered":"2023-07-20T11:24:25.666609+0000","last_clean":"2023-07-20T11:24:25.666609+0000","last_became_active":"2023-07-20T11:24:24.674218+0000","last_became_peered":"2023-07-20T11:24:24.674218+0000","last_unstale":"2023-07-20T11:24:25.666609+0000","last_undegraded":"2023-07-20T11:24:25.666609+0000","last_fullsized":"2023-07-20T11:24:25.666609+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:14.436421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549917+0000","last_change":"2023-07-20T11:24:24.684646+0000","last_active":"2023-07-20T11:24:26.549917+0000","last_peered":"2023-07-20T11:24:26.549917+0000","last_clean":"2023-07-20T11:24:26.549917+0000","last_became_active":"2023-07-20T11:24:24.684313+0000","last_became_peered":"2023-07-20T11:24:24.684313+0000","last_unstale":"2023-07-20T11:24:26.549917+0000","last_undegraded":"2023-07-20T11:24:26.549917+0000","last_fullsized":"2023-07-20T11:24:26.549917+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:10.212519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550031+0000","last_change":"2023-07-20T11:24:24.675522+0000","last_active":"2023-07-20T11:24:26.550031+0000","last_peered":"2023-07-20T11:24:26.550031+0000","last_clean":"2023-07-20T11:24:26.550031+0000","last_became_active":"2023-07-20T11:24:24.675245+0000","last_became_peered":"2023-07-20T11:24:24.675245+0000","last_unstale":"2023-07-20T11:24:26.550031+0000","last_undegraded":"2023-07-20T11:24:26.550031+0000","last_fullsized":"2023-07-20T11:24:26.550031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:19.900714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665958+0000","last_change":"2023-07-20T11:24:24.688000+0000","last_active":"2023-07-20T11:24:25.665958+0000","last_peered":"2023-07-20T11:24:25.665958+0000","last_clean":"2023-07-20T11:24:25.665958+0000","last_became_active":"2023-07-20T11:24:24.687676+0000","last_became_peered":"2023-07-20T11:24:24.687676+0000","last_unstale":"2023-07-20T11:24:25.665958+0000","last_undegraded":"2023-07-20T11:24:25.665958+0000","last_fullsized":"2023-07-20T11:24:25.665958+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:14.683745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665809+0000","last_change":"2023-07-20T11:24:24.684772+0000","last_active":"2023-07-20T11:24:25.665809+0000","last_peered":"2023-07-20T11:24:25.665809+0000","last_clean":"2023-07-20T11:24:25.665809+0000","last_became_active":"2023-07-20T11:24:24.684456+0000","last_became_peered":"2023-07-20T11:24:24.684456+0000","last_unstale":"2023-07-20T11:24:25.665809+0000","last_undegraded":"2023-07-20T11:24:25.665809+0000","last_fullsized":"2023-07-20T11:24:25.665809+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:55.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.680476+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.680169+0000","last_became_peered":"2023-07-20T11:24:24.680169+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:52:06.585577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549806+0000","last_change":"2023-07-20T11:24:24.678435+0000","last_active":"2023-07-20T11:24:26.549806+0000","last_peered":"2023-07-20T11:24:26.549806+0000","last_clean":"2023-07-20T11:24:26.549806+0000","last_became_active":"2023-07-20T11:24:24.678139+0000","last_became_peered":"2023-07-20T11:24:24.678139+0000","last_unstale":"2023-07-20T11:24:26.549806+0000","last_undegraded":"2023-07-20T11:24:26.549806+0000","last_fullsized":"2023-07-20T11:24:26.549806+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550226+0000","last_change":"2023-07-20T11:24:24.682755+0000","last_active":"2023-07-20T11:24:26.550226+0000","last_peered":"2023-07-20T11:24:26.550226+0000","last_clean":"2023-07-20T11:24:26.550226+0000","last_became_active":"2023-07-20T11:24:24.682425+0000","last_became_peered":"2023-07-20T11:24:24.682425+0000","last_unstale":"2023-07-20T11:24:26.550226+0000","last_undegraded":"2023-07-20T11:24:26.550226+0000","last_fullsized":"2023-07-20T11:24:26.550226+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:09.320170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551047+0000","last_change":"2023-07-20T11:24:23.684101+0000","last_active":"2023-07-20T11:24:26.551047+0000","last_peered":"2023-07-20T11:24:26.551047+0000","last_clean":"2023-07-20T11:24:26.551047+0000","last_became_active":"2023-07-20T11:24:23.683833+0000","last_became_peered":"2023-07-20T11:24:23.683833+0000","last_unstale":"2023-07-20T11:24:26.551047+0000","last_undegraded":"2023-07-20T11:24:26.551047+0000","last_fullsized":"2023-07-20T11:24:26.551047+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:01:34.520625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550204+0000","last_change":"2023-07-20T11:24:24.676219+0000","last_active":"2023-07-20T11:24:26.550204+0000","last_peered":"2023-07-20T11:24:26.550204+0000","last_clean":"2023-07-20T11:24:26.550204+0000","last_became_active":"2023-07-20T11:24:24.675907+0000","last_became_peered":"2023-07-20T11:24:24.675907+0000","last_unstale":"2023-07-20T11:24:26.550204+0000","last_undegraded":"2023-07-20T11:24:26.550204+0000","last_fullsized":"2023-07-20T11:24:26.550204+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:37.358044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551649+0000","last_change":"2023-07-20T11:24:23.679342+0000","last_active":"2023-07-20T11:24:26.551649+0000","last_peered":"2023-07-20T11:24:26.551649+0000","last_clean":"2023-07-20T11:24:26.551649+0000","last_became_active":"2023-07-20T11:24:23.679077+0000","last_became_peered":"2023-07-20T11:24:23.679077+0000","last_unstale":"2023-07-20T11:24:26.551649+0000","last_undegraded":"2023-07-20T11:24:26.551649+0000","last_fullsized":"2023-07-20T11:24:26.551649+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:46:04.199831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665431+0000","last_change":"2023-07-20T11:24:24.679405+0000","last_active":"2023-07-20T11:24:25.665431+0000","last_peered":"2023-07-20T11:24:25.665431+0000","last_clean":"2023-07-20T11:24:25.665431+0000","last_became_active":"2023-07-20T11:24:24.679049+0000","last_became_peered":"2023-07-20T11:24:24.679049+0000","last_unstale":"2023-07-20T11:24:25.665431+0000","last_undegraded":"2023-07-20T11:24:25.665431+0000","last_fullsized":"2023-07-20T11:24:25.665431+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:17.563561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"204'3","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550525+0000","last_change":"2023-07-20T11:24:23.682028+0000","last_active":"2023-07-20T11:24:26.550525+0000","last_peered":"2023-07-20T11:24:26.550525+0000","last_clean":"2023-07-20T11:24:26.550525+0000","last_became_active":"2023-07-20T11:24:23.681732+0000","last_became_peered":"2023-07-20T11:24:23.681732+0000","last_unstale":"2023-07-20T11:24:26.550525+0000","last_undegraded":"2023-07-20T11:24:26.550525+0000","last_fullsized":"2023-07-20T11:24:26.550525+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:43.776076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551815+0000","last_change":"2023-07-20T11:24:24.684877+0000","last_active":"2023-07-20T11:24:26.551815+0000","last_peered":"2023-07-20T11:24:26.551815+0000","last_clean":"2023-07-20T11:24:26.551815+0000","last_became_active":"2023-07-20T11:24:24.684555+0000","last_became_peered":"2023-07-20T11:24:24.684555+0000","last_unstale":"2023-07-20T11:24:26.551815+0000","last_undegraded":"2023-07-20T11:24:26.551815+0000","last_fullsized":"2023-07-20T11:24:26.551815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:13:44.684094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"204'6","reported_seq":19,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665477+0000","last_change":"2023-07-20T11:24:23.678045+0000","last_active":"2023-07-20T11:24:25.665477+0000","last_peered":"2023-07-20T11:24:25.665477+0000","last_clean":"2023-07-20T11:24:25.665477+0000","last_became_active":"2023-07-20T11:24:23.677672+0000","last_became_peered":"2023-07-20T11:24:23.677672+0000","last_unstale":"2023-07-20T11:24:25.665477+0000","last_undegraded":"2023-07-20T11:24:25.665477+0000","last_fullsized":"2023-07-20T11:24:25.665477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:03.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.682921+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.682654+0000","last_became_peered":"2023-07-20T11:24:24.682654+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:23.125250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665109+0000","last_change":"2023-07-20T11:24:23.682866+0000","last_active":"2023-07-20T11:24:25.665109+0000","last_peered":"2023-07-20T11:24:25.665109+0000","last_clean":"2023-07-20T11:24:25.665109+0000","last_became_active":"2023-07-20T11:24:23.682498+0000","last_became_peered":"2023-07-20T11:24:23.682498+0000","last_unstale":"2023-07-20T11:24:25.665109+0000","last_undegraded":"2023-07-20T11:24:25.665109+0000","last_fullsized":"2023-07-20T11:24:25.665109+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:19:29.435926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549570+0000","last_change":"2023-07-20T11:24:24.680838+0000","last_active":"2023-07-20T11:24:26.549570+0000","last_peered":"2023-07-20T11:24:26.549570+0000","last_clean":"2023-07-20T11:24:26.549570+0000","last_became_active":"2023-07-20T11:24:24.679079+0000","last_became_peered":"2023-07-20T11:24:24.679079+0000","last_unstale":"2023-07-20T11:24:26.549570+0000","last_undegraded":"2023-07-20T11:24:26.549570+0000","last_fullsized":"2023-07-20T11:24:26.549570+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:08.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550990+0000","last_change":"2023-07-20T11:24:23.684218+0000","last_active":"2023-07-20T11:24:26.550990+0000","last_peered":"2023-07-20T11:24:26.550990+0000","last_clean":"2023-07-20T11:24:26.550990+0000","last_became_active":"2023-07-20T11:24:23.683931+0000","last_became_peered":"2023-07-20T11:24:23.683931+0000","last_unstale":"2023-07-20T11:24:26.550990+0000","last_undegraded":"2023-07-20T11:24:26.550990+0000","last_fullsized":"2023-07-20T11:24:26.550990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:07:21.665674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665156+0000","last_change":"2023-07-20T11:24:24.678415+0000","last_active":"2023-07-20T11:24:25.665156+0000","last_peered":"2023-07-20T11:24:25.665156+0000","last_clean":"2023-07-20T11:24:25.665156+0000","last_became_active":"2023-07-20T11:24:24.677868+0000","last_became_peered":"2023-07-20T11:24:24.677868+0000","last_unstale":"2023-07-20T11:24:25.665156+0000","last_undegraded":"2023-07-20T11:24:25.665156+0000","last_fullsized":"2023-07-20T11:24:25.665156+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:45.774704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549780+0000","last_change":"2023-07-20T11:24:23.682204+0000","last_active":"2023-07-20T11:24:26.549780+0000","last_peered":"2023-07-20T11:24:26.549780+0000","last_clean":"2023-07-20T11:24:26.549780+0000","last_became_active":"2023-07-20T11:24:23.681404+0000","last_became_peered":"2023-07-20T11:24:23.681404+0000","last_unstale":"2023-07-20T11:24:26.549780+0000","last_undegraded":"2023-07-20T11:24:26.549780+0000","last_fullsized":"2023-07-20T11:24:26.549780+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:06:39.238103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665055+0000","last_change":"2023-07-20T11:24:24.687111+0000","last_active":"2023-07-20T11:24:25.665055+0000","last_peered":"2023-07-20T11:24:25.665055+0000","last_clean":"2023-07-20T11:24:25.665055+0000","last_became_active":"2023-07-20T11:24:24.686827+0000","last_became_peered":"2023-07-20T11:24:24.686827+0000","last_unstale":"2023-07-20T11:24:25.665055+0000","last_undegraded":"2023-07-20T11:24:25.665055+0000","last_fullsized":"2023-07-20T11:24:25.665055+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:59.453824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"204'8","reported_seq":21,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665839+0000","last_change":"2023-07-20T11:24:23.682481+0000","last_active":"2023-07-20T11:24:25.665839+0000","last_peered":"2023-07-20T11:24:25.665839+0000","last_clean":"2023-07-20T11:24:25.665839+0000","last_became_active":"2023-07-20T11:24:23.682201+0000","last_became_peered":"2023-07-20T11:24:23.682201+0000","last_unstale":"2023-07-20T11:24:25.665839+0000","last_undegraded":"2023-07-20T11:24:25.665839+0000","last_fullsized":"2023-07-20T11:24:25.665839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:10.688723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663758+0000","last_change":"2023-07-20T11:24:24.688471+0000","last_active":"2023-07-20T11:24:25.663758+0000","last_peered":"2023-07-20T11:24:25.663758+0000","last_clean":"2023-07-20T11:24:25.663758+0000","last_became_active":"2023-07-20T11:24:24.687869+0000","last_became_peered":"2023-07-20T11:24:24.687869+0000","last_unstale":"2023-07-20T11:24:25.663758+0000","last_undegraded":"2023-07-20T11:24:25.663758+0000","last_fullsized":"2023-07-20T11:24:25.663758+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:09:51.468890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:23.683827+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:23.683531+0000","last_became_peered":"2023-07-20T11:24:23.683531+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:57.957596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550130+0000","last_change":"2023-07-20T11:24:24.678725+0000","last_active":"2023-07-20T11:24:26.550130+0000","last_peered":"2023-07-20T11:24:26.550130+0000","last_clean":"2023-07-20T11:24:26.550130+0000","last_became_active":"2023-07-20T11:24:24.678410+0000","last_became_peered":"2023-07-20T11:24:24.678410+0000","last_unstale":"2023-07-20T11:24:26.550130+0000","last_undegraded":"2023-07-20T11:24:26.550130+0000","last_fullsized":"2023-07-20T11:24:26.550130+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:17.906290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550667+0000","last_change":"2023-07-20T11:24:23.681794+0000","last_active":"2023-07-20T11:24:26.550667+0000","last_peered":"2023-07-20T11:24:26.550667+0000","last_clean":"2023-07-20T11:24:26.550667+0000","last_became_active":"2023-07-20T11:24:23.681483+0000","last_became_peered":"2023-07-20T11:24:23.681483+0000","last_unstale":"2023-07-20T11:24:26.550667+0000","last_undegraded":"2023-07-20T11:24:26.550667+0000","last_fullsized":"2023-07-20T11:24:26.550667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:46:59.874775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666760+0000","last_change":"2023-07-20T11:24:24.669515+0000","last_active":"2023-07-20T11:24:25.666760+0000","last_peered":"2023-07-20T11:24:25.666760+0000","last_clean":"2023-07-20T11:24:25.666760+0000","last_became_active":"2023-07-20T11:24:24.669197+0000","last_became_peered":"2023-07-20T11:24:24.669197+0000","last_unstale":"2023-07-20T11:24:25.666760+0000","last_undegraded":"2023-07-20T11:24:25.666760+0000","last_fullsized":"2023-07-20T11:24:25.666760+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:22:02.077179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550465+0000","last_change":"2023-07-20T11:24:23.679691+0000","last_active":"2023-07-20T11:24:26.550465+0000","last_peered":"2023-07-20T11:24:26.550465+0000","last_clean":"2023-07-20T11:24:26.550465+0000","last_became_active":"2023-07-20T11:24:23.679363+0000","last_became_peered":"2023-07-20T11:24:23.679363+0000","last_unstale":"2023-07-20T11:24:26.550465+0000","last_undegraded":"2023-07-20T11:24:26.550465+0000","last_fullsized":"2023-07-20T11:24:26.550465+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:35:35.278711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551915+0000","last_change":"2023-07-20T11:24:24.688520+0000","last_active":"2023-07-20T11:24:26.551915+0000","last_peered":"2023-07-20T11:24:26.551915+0000","last_clean":"2023-07-20T11:24:26.551915+0000","last_became_active":"2023-07-20T11:24:24.688113+0000","last_became_peered":"2023-07-20T11:24:24.688113+0000","last_unstale":"2023-07-20T11:24:26.551915+0000","last_undegraded":"2023-07-20T11:24:26.551915+0000","last_fullsized":"2023-07-20T11:24:26.551915+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:21:08.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666325+0000","last_change":"2023-07-20T11:24:23.675157+0000","last_active":"2023-07-20T11:24:25.666325+0000","last_peered":"2023-07-20T11:24:25.666325+0000","last_clean":"2023-07-20T11:24:25.666325+0000","last_became_active":"2023-07-20T11:24:23.674851+0000","last_became_peered":"2023-07-20T11:24:23.674851+0000","last_unstale":"2023-07-20T11:24:25.666325+0000","last_undegraded":"2023-07-20T11:24:25.666325+0000","last_fullsized":"2023-07-20T11:24:25.666325+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:16:42.900052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551131+0000","last_change":"2023-07-20T11:24:24.690831+0000","last_active":"2023-07-20T11:24:26.551131+0000","last_peered":"2023-07-20T11:24:26.551131+0000","last_clean":"2023-07-20T11:24:26.551131+0000","last_became_active":"2023-07-20T11:24:24.689131+0000","last_became_peered":"2023-07-20T11:24:24.689131+0000","last_unstale":"2023-07-20T11:24:26.551131+0000","last_undegraded":"2023-07-20T11:24:26.551131+0000","last_fullsized":"2023-07-20T11:24:26.551131+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:14:59.067673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665256+0000","last_change":"2023-07-20T11:24:23.680375+0000","last_active":"2023-07-20T11:24:25.665256+0000","last_peered":"2023-07-20T11:24:25.665256+0000","last_clean":"2023-07-20T11:24:25.665256+0000","last_became_active":"2023-07-20T11:24:23.680085+0000","last_became_peered":"2023-07-20T11:24:23.680085+0000","last_unstale":"2023-07-20T11:24:25.665256+0000","last_undegraded":"2023-07-20T11:24:25.665256+0000","last_fullsized":"2023-07-20T11:24:25.665256+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:35.499388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549730+0000","last_change":"2023-07-20T11:24:24.678320+0000","last_active":"2023-07-20T11:24:26.549730+0000","last_peered":"2023-07-20T11:24:26.549730+0000","last_clean":"2023-07-20T11:24:26.549730+0000","last_became_active":"2023-07-20T11:24:24.678044+0000","last_became_peered":"2023-07-20T11:24:24.678044+0000","last_unstale":"2023-07-20T11:24:26.549730+0000","last_undegraded":"2023-07-20T11:24:26.549730+0000","last_fullsized":"2023-07-20T11:24:26.549730+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:51.064227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551265+0000","last_change":"2023-07-20T11:24:23.681837+0000","last_active":"2023-07-20T11:24:26.551265+0000","last_peered":"2023-07-20T11:24:26.551265+0000","last_clean":"2023-07-20T11:24:26.551265+0000","last_became_active":"2023-07-20T11:24:23.681564+0000","last_became_peered":"2023-07-20T11:24:23.681564+0000","last_unstale":"2023-07-20T11:24:26.551265+0000","last_undegraded":"2023-07-20T11:24:26.551265+0000","last_fullsized":"2023-07-20T11:24:26.551265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:24.559465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549817+0000","last_change":"2023-07-20T11:24:24.675008+0000","last_active":"2023-07-20T11:24:26.549817+0000","last_peered":"2023-07-20T11:24:26.549817+0000","last_clean":"2023-07-20T11:24:26.549817+0000","last_became_active":"2023-07-20T11:24:24.674723+0000","last_became_peered":"2023-07-20T11:24:24.674723+0000","last_unstale":"2023-07-20T11:24:26.549817+0000","last_undegraded":"2023-07-20T11:24:26.549817+0000","last_fullsized":"2023-07-20T11:24:26.549817+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:34:49.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T11:24:23.673277+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T11:24:23.672993+0000","last_became_peered":"2023-07-20T11:24:23.672993+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:12:41.364472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550594+0000","last_change":"2023-07-20T11:24:24.678376+0000","last_active":"2023-07-20T11:24:26.550594+0000","last_peered":"2023-07-20T11:24:26.550594+0000","last_clean":"2023-07-20T11:24:26.550594+0000","last_became_active":"2023-07-20T11:24:24.678085+0000","last_became_peered":"2023-07-20T11:24:24.678085+0000","last_unstale":"2023-07-20T11:24:26.550594+0000","last_undegraded":"2023-07-20T11:24:26.550594+0000","last_fullsized":"2023-07-20T11:24:26.550594+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:32.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550287+0000","last_change":"2023-07-20T11:24:23.675360+0000","last_active":"2023-07-20T11:24:26.550287+0000","last_peered":"2023-07-20T11:24:26.550287+0000","last_clean":"2023-07-20T11:24:26.550287+0000","last_became_active":"2023-07-20T11:24:23.675055+0000","last_became_peered":"2023-07-20T11:24:23.675055+0000","last_unstale":"2023-07-20T11:24:26.550287+0000","last_undegraded":"2023-07-20T11:24:26.550287+0000","last_fullsized":"2023-07-20T11:24:26.550287+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:16.555849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663778+0000","last_change":"2023-07-20T11:24:24.678995+0000","last_active":"2023-07-20T11:24:25.663778+0000","last_peered":"2023-07-20T11:24:25.663778+0000","last_clean":"2023-07-20T11:24:25.663778+0000","last_became_active":"2023-07-20T11:24:24.678730+0000","last_became_peered":"2023-07-20T11:24:24.678730+0000","last_unstale":"2023-07-20T11:24:25.663778+0000","last_undegraded":"2023-07-20T11:24:25.663778+0000","last_fullsized":"2023-07-20T11:24:25.663778+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:09:01.086386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550998+0000","last_change":"2023-07-20T11:24:23.683335+0000","last_active":"2023-07-20T11:24:26.550998+0000","last_peered":"2023-07-20T11:24:26.550998+0000","last_clean":"2023-07-20T11:24:26.550998+0000","last_became_active":"2023-07-20T11:24:23.682337+0000","last_became_peered":"2023-07-20T11:24:23.682337+0000","last_unstale":"2023-07-20T11:24:26.550998+0000","last_undegraded":"2023-07-20T11:24:26.550998+0000","last_fullsized":"2023-07-20T11:24:26.550998+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:34.528225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551551+0000","last_change":"2023-07-20T11:24:24.688964+0000","last_active":"2023-07-20T11:24:26.551551+0000","last_peered":"2023-07-20T11:24:26.551551+0000","last_clean":"2023-07-20T11:24:26.551551+0000","last_became_active":"2023-07-20T11:24:24.688628+0000","last_became_peered":"2023-07-20T11:24:24.688628+0000","last_unstale":"2023-07-20T11:24:26.551551+0000","last_undegraded":"2023-07-20T11:24:26.551551+0000","last_fullsized":"2023-07-20T11:24:26.551551+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:18.334735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663878+0000","last_change":"2023-07-20T11:24:23.674114+0000","last_active":"2023-07-20T11:24:25.663878+0000","last_peered":"2023-07-20T11:24:25.663878+0000","last_clean":"2023-07-20T11:24:25.663878+0000","last_became_active":"2023-07-20T11:24:23.673839+0000","last_became_peered":"2023-07-20T11:24:23.673839+0000","last_unstale":"2023-07-20T11:24:25.663878+0000","last_undegraded":"2023-07-20T11:24:25.663878+0000","last_fullsized":"2023-07-20T11:24:25.663878+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:27.235588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550113+0000","last_change":"2023-07-20T11:24:24.691022+0000","last_active":"2023-07-20T11:24:26.550113+0000","last_peered":"2023-07-20T11:24:26.550113+0000","last_clean":"2023-07-20T11:24:26.550113+0000","last_became_active":"2023-07-20T11:24:24.690730+0000","last_became_peered":"2023-07-20T11:24:24.690730+0000","last_unstale":"2023-07-20T11:24:26.550113+0000","last_undegraded":"2023-07-20T11:24:26.550113+0000","last_fullsized":"2023-07-20T11:24:26.550113+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:28.000651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550244+0000","last_change":"2023-07-20T11:24:23.675815+0000","last_active":"2023-07-20T11:24:26.550244+0000","last_peered":"2023-07-20T11:24:26.550244+0000","last_clean":"2023-07-20T11:24:26.550244+0000","last_became_active":"2023-07-20T11:24:23.675439+0000","last_became_peered":"2023-07-20T11:24:23.675439+0000","last_unstale":"2023-07-20T11:24:26.550244+0000","last_undegraded":"2023-07-20T11:24:26.550244+0000","last_fullsized":"2023-07-20T11:24:26.550244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:13.048858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664047+0000","last_change":"2023-07-20T11:24:24.682352+0000","last_active":"2023-07-20T11:24:25.664047+0000","last_peered":"2023-07-20T11:24:25.664047+0000","last_clean":"2023-07-20T11:24:25.664047+0000","last_became_active":"2023-07-20T11:24:24.682052+0000","last_became_peered":"2023-07-20T11:24:24.682052+0000","last_unstale":"2023-07-20T11:24:25.664047+0000","last_undegraded":"2023-07-20T11:24:25.664047+0000","last_fullsized":"2023-07-20T11:24:25.664047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:09.802004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550128+0000","last_change":"2023-07-20T11:24:23.677464+0000","last_active":"2023-07-20T11:24:26.550128+0000","last_peered":"2023-07-20T11:24:26.550128+0000","last_clean":"2023-07-20T11:24:26.550128+0000","last_became_active":"2023-07-20T11:24:23.677216+0000","last_became_peered":"2023-07-20T11:24:23.677216+0000","last_unstale":"2023-07-20T11:24:26.550128+0000","last_undegraded":"2023-07-20T11:24:26.550128+0000","last_fullsized":"2023-07-20T11:24:26.550128+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:07.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550151+0000","last_change":"2023-07-20T11:24:24.679461+0000","last_active":"2023-07-20T11:24:26.550151+0000","last_peered":"2023-07-20T11:24:26.550151+0000","last_clean":"2023-07-20T11:24:26.550151+0000","last_became_active":"2023-07-20T11:24:24.679161+0000","last_became_peered":"2023-07-20T11:24:24.679161+0000","last_unstale":"2023-07-20T11:24:26.550151+0000","last_undegraded":"2023-07-20T11:24:26.550151+0000","last_fullsized":"2023-07-20T11:24:26.550151+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:36.507100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549641+0000","last_change":"2023-07-20T11:24:23.679636+0000","last_active":"2023-07-20T11:24:26.549641+0000","last_peered":"2023-07-20T11:24:26.549641+0000","last_clean":"2023-07-20T11:24:26.549641+0000","last_became_active":"2023-07-20T11:24:23.679349+0000","last_became_peered":"2023-07-20T11:24:23.679349+0000","last_unstale":"2023-07-20T11:24:26.549641+0000","last_undegraded":"2023-07-20T11:24:26.549641+0000","last_fullsized":"2023-07-20T11:24:26.549641+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:21:22.847113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664927+0000","last_change":"2023-07-20T11:24:24.694372+0000","last_active":"2023-07-20T11:24:25.664927+0000","last_peered":"2023-07-20T11:24:25.664927+0000","last_clean":"2023-07-20T11:24:25.664927+0000","last_became_active":"2023-07-20T11:24:24.694083+0000","last_became_peered":"2023-07-20T11:24:24.694083+0000","last_unstale":"2023-07-20T11:24:25.664927+0000","last_undegraded":"2023-07-20T11:24:25.664927+0000","last_fullsized":"2023-07-20T11:24:25.664927+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:30:08.308012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549535+0000","last_change":"2023-07-20T11:24:23.679602+0000","last_active":"2023-07-20T11:24:26.549535+0000","last_peered":"2023-07-20T11:24:26.549535+0000","last_clean":"2023-07-20T11:24:26.549535+0000","last_became_active":"2023-07-20T11:24:23.679310+0000","last_became_peered":"2023-07-20T11:24:23.679310+0000","last_unstale":"2023-07-20T11:24:26.549535+0000","last_undegraded":"2023-07-20T11:24:26.549535+0000","last_fullsized":"2023-07-20T11:24:26.549535+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:53:22.184259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550897+0000","last_change":"2023-07-20T11:24:24.691099+0000","last_active":"2023-07-20T11:24:26.550897+0000","last_peered":"2023-07-20T11:24:26.550897+0000","last_clean":"2023-07-20T11:24:26.550897+0000","last_became_active":"2023-07-20T11:24:24.689393+0000","last_became_peered":"2023-07-20T11:24:24.689393+0000","last_unstale":"2023-07-20T11:24:26.550897+0000","last_undegraded":"2023-07-20T11:24:26.550897+0000","last_fullsized":"2023-07-20T11:24:26.550897+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:50.532811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663614+0000","last_change":"2023-07-20T11:24:23.675579+0000","last_active":"2023-07-20T11:24:25.663614+0000","last_peered":"2023-07-20T11:24:25.663614+0000","last_clean":"2023-07-20T11:24:25.663614+0000","last_became_active":"2023-07-20T11:24:23.675314+0000","last_became_peered":"2023-07-20T11:24:23.675314+0000","last_unstale":"2023-07-20T11:24:25.663614+0000","last_undegraded":"2023-07-20T11:24:25.663614+0000","last_fullsized":"2023-07-20T11:24:25.663614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:41.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549614+0000","last_change":"2023-07-20T11:24:24.688015+0000","last_active":"2023-07-20T11:24:26.549614+0000","last_peered":"2023-07-20T11:24:26.549614+0000","last_clean":"2023-07-20T11:24:26.549614+0000","last_became_active":"2023-07-20T11:24:24.687722+0000","last_became_peered":"2023-07-20T11:24:24.687722+0000","last_unstale":"2023-07-20T11:24:26.549614+0000","last_undegraded":"2023-07-20T11:24:26.549614+0000","last_fullsized":"2023-07-20T11:24:26.549614+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:02:04.587487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550519+0000","last_change":"2023-07-20T11:24:23.678783+0000","last_active":"2023-07-20T11:24:26.550519+0000","last_peered":"2023-07-20T11:24:26.550519+0000","last_clean":"2023-07-20T11:24:26.550519+0000","last_became_active":"2023-07-20T11:24:23.678465+0000","last_became_peered":"2023-07-20T11:24:23.678465+0000","last_unstale":"2023-07-20T11:24:26.550519+0000","last_undegraded":"2023-07-20T11:24:26.550519+0000","last_fullsized":"2023-07-20T11:24:26.550519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:37:54.623714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550280+0000","last_change":"2023-07-20T11:24:24.687465+0000","last_active":"2023-07-20T11:24:26.550280+0000","last_peered":"2023-07-20T11:24:26.550280+0000","last_clean":"2023-07-20T11:24:26.550280+0000","last_became_active":"2023-07-20T11:24:24.687197+0000","last_became_peered":"2023-07-20T11:24:24.687197+0000","last_unstale":"2023-07-20T11:24:26.550280+0000","last_undegraded":"2023-07-20T11:24:26.550280+0000","last_fullsized":"2023-07-20T11:24:26.550280+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550040+0000","last_change":"2023-07-20T11:24:23.681969+0000","last_active":"2023-07-20T11:24:26.550040+0000","last_peered":"2023-07-20T11:24:26.550040+0000","last_clean":"2023-07-20T11:24:26.550040+0000","last_became_active":"2023-07-20T11:24:23.681678+0000","last_became_peered":"2023-07-20T11:24:23.681678+0000","last_unstale":"2023-07-20T11:24:26.550040+0000","last_undegraded":"2023-07-20T11:24:26.550040+0000","last_fullsized":"2023-07-20T11:24:26.550040+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:56.853334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"194'326","reported_seq":1272,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549792+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:26.549792+0000","last_peered":"2023-07-20T11:24:26.549792+0000","last_clean":"2023-07-20T11:24:26.549792+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:26.549792+0000","last_undegraded":"2023-07-20T11:24:26.549792+0000","last_fullsized":"2023-07-20T11:24:26.549792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:49.439259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666119+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:25.666119+0000","last_peered":"2023-07-20T11:24:25.666119+0000","last_clean":"2023-07-20T11:24:25.666119+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:25.666119+0000","last_undegraded":"2023-07-20T11:24:25.666119+0000","last_fullsized":"2023-07-20T11:24:25.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:12:16.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665246+0000","last_change":"2023-07-20T11:24:24.687337+0000","last_active":"2023-07-20T11:24:25.665246+0000","last_peered":"2023-07-20T11:24:25.665246+0000","last_clean":"2023-07-20T11:24:25.665246+0000","last_became_active":"2023-07-20T11:24:24.685330+0000","last_became_peered":"2023-07-20T11:24:24.685330+0000","last_unstale":"2023-07-20T11:24:25.665246+0000","last_undegraded":"2023-07-20T11:24:25.665246+0000","last_fullsized":"2023-07-20T11:24:25.665246+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:04:22.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550688+0000","last_change":"2023-07-20T11:24:23.679447+0000","last_active":"2023-07-20T11:24:26.550688+0000","last_peered":"2023-07-20T11:24:26.550688+0000","last_clean":"2023-07-20T11:24:26.550688+0000","last_became_active":"2023-07-20T11:24:23.678259+0000","last_became_peered":"2023-07-20T11:24:23.678259+0000","last_unstale":"2023-07-20T11:24:26.550688+0000","last_undegraded":"2023-07-20T11:24:26.550688+0000","last_fullsized":"2023-07-20T11:24:26.550688+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:19.361518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":375,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549673+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:26.549673+0000","last_peered":"2023-07-20T11:24:26.549673+0000","last_clean":"2023-07-20T11:24:26.549673+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:26.549673+0000","last_undegraded":"2023-07-20T11:24:26.549673+0000","last_fullsized":"2023-07-20T11:24:26.549673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551298+0000","last_change":"2023-07-20T11:24:24.683416+0000","last_active":"2023-07-20T11:24:26.551298+0000","last_peered":"2023-07-20T11:24:26.551298+0000","last_clean":"2023-07-20T11:24:26.551298+0000","last_became_active":"2023-07-20T11:24:24.683150+0000","last_became_peered":"2023-07-20T11:24:24.683150+0000","last_unstale":"2023-07-20T11:24:26.551298+0000","last_undegraded":"2023-07-20T11:24:26.551298+0000","last_fullsized":"2023-07-20T11:24:26.551298+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:21.715673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551144+0000","last_change":"2023-07-20T11:24:23.682226+0000","last_active":"2023-07-20T11:24:26.551144+0000","last_peered":"2023-07-20T11:24:26.551144+0000","last_clean":"2023-07-20T11:24:26.551144+0000","last_became_active":"2023-07-20T11:24:23.681964+0000","last_became_peered":"2023-07-20T11:24:23.681964+0000","last_unstale":"2023-07-20T11:24:26.551144+0000","last_undegraded":"2023-07-20T11:24:26.551144+0000","last_fullsized":"2023-07-20T11:24:26.551144+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:15:39.274313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":408,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:11.628924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551185+0000","last_change":"2023-07-20T11:24:24.682604+0000","last_active":"2023-07-20T11:24:26.551185+0000","last_peered":"2023-07-20T11:24:26.551185+0000","last_clean":"2023-07-20T11:24:26.551185+0000","last_became_active":"2023-07-20T11:24:24.682343+0000","last_became_peered":"2023-07-20T11:24:24.682343+0000","last_unstale":"2023-07-20T11:24:26.551185+0000","last_undegraded":"2023-07-20T11:24:26.551185+0000","last_fullsized":"2023-07-20T11:24:26.551185+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:16:44.604561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664908+0000","last_change":"2023-07-20T11:24:23.678437+0000","last_active":"2023-07-20T11:24:25.664908+0000","last_peered":"2023-07-20T11:24:25.664908+0000","last_clean":"2023-07-20T11:24:25.664908+0000","last_became_active":"2023-07-20T11:24:23.678016+0000","last_became_peered":"2023-07-20T11:24:23.678016+0000","last_unstale":"2023-07-20T11:24:25.664908+0000","last_undegraded":"2023-07-20T11:24:25.664908+0000","last_fullsized":"2023-07-20T11:24:25.664908+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:42:42.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665908+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:25.665908+0000","last_peered":"2023-07-20T11:24:25.665908+0000","last_clean":"2023-07-20T11:24:25.665908+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:25.665908+0000","last_undegraded":"2023-07-20T11:24:25.665908+0000","last_fullsized":"2023-07-20T11:24:25.665908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:10:47.734389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549945+0000","last_change":"2023-07-20T11:24:24.683206+0000","last_active":"2023-07-20T11:24:26.549945+0000","last_peered":"2023-07-20T11:24:26.549945+0000","last_clean":"2023-07-20T11:24:26.549945+0000","last_became_active":"2023-07-20T11:24:24.682058+0000","last_became_peered":"2023-07-20T11:24:24.682058+0000","last_unstale":"2023-07-20T11:24:26.549945+0000","last_undegraded":"2023-07-20T11:24:26.549945+0000","last_fullsized":"2023-07-20T11:24:26.549945+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:18:53.350029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"204'4","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550862+0000","last_change":"2023-07-20T11:24:23.683299+0000","last_active":"2023-07-20T11:24:26.550862+0000","last_peered":"2023-07-20T11:24:26.550862+0000","last_clean":"2023-07-20T11:24:26.550862+0000","last_became_active":"2023-07-20T11:24:23.682434+0000","last_became_peered":"2023-07-20T11:24:23.682434+0000","last_unstale":"2023-07-20T11:24:26.550862+0000","last_undegraded":"2023-07-20T11:24:26.550862+0000","last_fullsized":"2023-07-20T11:24:26.550862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:47.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551530+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:26.551530+0000","last_peered":"2023-07-20T11:24:26.551530+0000","last_clean":"2023-07-20T11:24:26.551530+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:26.551530+0000","last_undegraded":"2023-07-20T11:24:26.551530+0000","last_fullsized":"2023-07-20T11:24:26.551530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:34.968590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663970+0000","last_change":"2023-07-20T11:24:24.690766+0000","last_active":"2023-07-20T11:24:25.663970+0000","last_peered":"2023-07-20T11:24:25.663970+0000","last_clean":"2023-07-20T11:24:25.663970+0000","last_became_active":"2023-07-20T11:24:24.690469+0000","last_became_peered":"2023-07-20T11:24:24.690469+0000","last_unstale":"2023-07-20T11:24:25.663970+0000","last_undegraded":"2023-07-20T11:24:25.663970+0000","last_fullsized":"2023-07-20T11:24:25.663970+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:47.324264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550515+0000","last_change":"2023-07-20T11:24:23.674048+0000","last_active":"2023-07-20T11:24:26.550515+0000","last_peered":"2023-07-20T11:24:26.550515+0000","last_clean":"2023-07-20T11:24:26.550515+0000","last_became_active":"2023-07-20T11:24:23.673205+0000","last_became_peered":"2023-07-20T11:24:23.673205+0000","last_unstale":"2023-07-20T11:24:26.550515+0000","last_undegraded":"2023-07-20T11:24:26.550515+0000","last_fullsized":"2023-07-20T11:24:26.550515+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:05:26.277401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:42:57.236342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:24.690407+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:24.689582+0000","last_became_peered":"2023-07-20T11:24:24.689582+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:47:43.635897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666311+0000","last_change":"2023-07-20T11:24:23.675940+0000","last_active":"2023-07-20T11:24:25.666311+0000","last_peered":"2023-07-20T11:24:25.666311+0000","last_clean":"2023-07-20T11:24:25.666311+0000","last_became_active":"2023-07-20T11:24:23.675669+0000","last_became_peered":"2023-07-20T11:24:23.675669+0000","last_unstale":"2023-07-20T11:24:25.666311+0000","last_undegraded":"2023-07-20T11:24:25.666311+0000","last_fullsized":"2023-07-20T11:24:25.666311+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:52:30.040768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":372,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551680+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:26.551680+0000","last_peered":"2023-07-20T11:24:26.551680+0000","last_clean":"2023-07-20T11:24:26.551680+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:26.551680+0000","last_undegraded":"2023-07-20T11:24:26.551680+0000","last_fullsized":"2023-07-20T11:24:26.551680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:51.396158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550486+0000","last_change":"2023-07-20T11:24:24.689801+0000","last_active":"2023-07-20T11:24:26.550486+0000","last_peered":"2023-07-20T11:24:26.550486+0000","last_clean":"2023-07-20T11:24:26.550486+0000","last_became_active":"2023-07-20T11:24:24.689522+0000","last_became_peered":"2023-07-20T11:24:24.689522+0000","last_unstale":"2023-07-20T11:24:26.550486+0000","last_undegraded":"2023-07-20T11:24:26.550486+0000","last_fullsized":"2023-07-20T11:24:26.550486+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:11.260814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665474+0000","last_change":"2023-07-20T11:24:23.681735+0000","last_active":"2023-07-20T11:24:25.665474+0000","last_peered":"2023-07-20T11:24:25.665474+0000","last_clean":"2023-07-20T11:24:25.665474+0000","last_became_active":"2023-07-20T11:24:23.681421+0000","last_became_peered":"2023-07-20T11:24:23.681421+0000","last_unstale":"2023-07-20T11:24:25.665474+0000","last_undegraded":"2023-07-20T11:24:25.665474+0000","last_fullsized":"2023-07-20T11:24:25.665474+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:10.253101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550575+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:26.550575+0000","last_peered":"2023-07-20T11:24:26.550575+0000","last_clean":"2023-07-20T11:24:26.550575+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:26.550575+0000","last_undegraded":"2023-07-20T11:24:26.550575+0000","last_fullsized":"2023-07-20T11:24:26.550575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:42:12.529596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52256,"kb_used_data":3088,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319584,"statfs":{"total":96636764160,"available":96583254016,"internally_reserved":0,"allocated":3162112,"data_stored":1909753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.88100000000000001,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.499},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":1.0409999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.081},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":1.012,"15min":1.0900000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.98499999999999999,"5min":1.012,"15min":1.0509999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.0349999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98599999999999999,"5min":1.026,"15min":1.03},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.97999999999999998,"5min":1.042,"15min":1.042},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.95499999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.95099999999999996,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41820,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330020,"statfs":{"total":96636764160,"available":96593940480,"internally_reserved":0,"allocated":2572288,"data_stored":1319455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":1}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":1.038}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":1.099}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":1.075},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59872,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311968,"statfs":{"total":96636764160,"available":96575455232,"internally_reserved":0,"allocated":2576384,"data_stored":1319545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59876,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311964,"statfs":{"total":96636764160,"available":96575451136,"internally_reserved":0,"allocated":2572288,"data_stored":1319967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.433}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.749},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2568192,"data_stored":1319385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48176,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323664,"statfs":{"total":96636764160,"available":96587431936,"internally_reserved":0,"allocated":3178496,"data_stored":1910481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.624},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:29.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-20T11:24:29.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.688+0000 7fe0798cb640 1 Processor -- start 2023-07-20T11:24:29.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.688+0000 7fe0798cb640 1 -- start start 2023-07-20T11:24:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.688+0000 7fe0798cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe0740ad060 0x7fe0740ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.688+0000 7fe0798cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740afe10 0x7fe07415c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe0798cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0740cde70 con 0x7fe0740b0290 2023-07-20T11:24:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe0798cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0740ad440 con 0x7fe0740ad060 2023-07-20T11:24:29.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe0798cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0740cbef0 con 0x7fe0740afe10 2023-07-20T11:24:29.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe06a7fc640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740afe10 0x7fe07415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe0737fe640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fe0740b0290 0x7fe07415ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:35720/0 (socket says 172.21.15.82:35720) 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe0737fe640 1 -- 172.21.15.82:0/4005571070 learned_addr learned my addr 172.21.15.82:0/4005571070 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 --2- 172.21.15.82:0/4005571070 >> v2:172.21.15.183:3300/0 conn(0x7fe0740ad060 0x7fe0740ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 -- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740afe10 msgr2=0x7fe07415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 --2- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740afe10 0x7fe07415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 -- 172.21.15.82:0/4005571070 >> v1:172.21.15.183:6789/0 conn(0x7fe0740b0290 legacy=0x7fe07415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 -- 172.21.15.82:0/4005571070 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0740cdb40 con 0x7fe0740ad060 2023-07-20T11:24:29.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.692+0000 7fe072ffd640 1 --2- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740ad060 0x7fe0740ca040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097c0 tx=0x7fe06401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ed5391725d9f8fc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0727fc640 1 -- 172.21.15.82:0/4005571070 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640ab670 con 0x7fe0740ad060 2023-07-20T11:24:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0727fc640 1 -- 172.21.15.82:0/4005571070 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640ab7d0 con 0x7fe0740ad060 2023-07-20T11:24:29.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0727fc640 1 -- 172.21.15.82:0/4005571070 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640abb60 con 0x7fe0740ad060 2023-07-20T11:24:29.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740ad060 msgr2=0x7fe0740ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740ad060 0x7fe0740ca040 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097c0 tx=0x7fe06401c450 comp rx=0 tx=0).stop 2023-07-20T11:24:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- 172.21.15.82:0/4005571070 shutdown_connections 2023-07-20T11:24:29.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740afe10 0x7fe07415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- 172.21.15.82:0/4005571070 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740ad060 0x7fe0740ca040 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- 172.21.15.82:0/4005571070 >> 172.21.15.82:0/4005571070 conn(0x7fe0740cada0 msgr2=0x7fe0740cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:29.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- 172.21.15.82:0/4005571070 shutdown_connections 2023-07-20T11:24:29.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- 172.21.15.82:0/4005571070 wait complete. 2023-07-20T11:24:29.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 Processor -- start 2023-07-20T11:24:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- start start 2023-07-20T11:24:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740afe10 0x7fe0740709c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740b0290 0x7fe074070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe074166cc0 con 0x7fe0740ad060 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe074162a80 con 0x7fe0740afe10 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe0798cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0741627a0 con 0x7fe0740b0290 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe072ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe072ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37506/0 (socket says 172.21.15.82:37506) 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.696+0000 7fe072ffd640 1 -- 172.21.15.82:0/1217332670 learned_addr learned my addr 172.21.15.82:0/1217332670 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe0737fe640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740b0290 0x7fe074070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe06a7fc640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740afe10 0x7fe0740709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 -- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740b0290 msgr2=0x7fe074070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740b0290 0x7fe074070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 -- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740afe10 msgr2=0x7fe0740709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740afe10 0x7fe0740709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 -- 172.21.15.82:0/1217332670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064009420 con 0x7fe0740ad060 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe072ffd640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ad040 tx=0x7fe06401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640bf610 con 0x7fe0740ad060 2023-07-20T11:24:29.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0640bf770 con 0x7fe0740ad060 2023-07-20T11:24:29.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0740addb0 con 0x7fe0740ad060 2023-07-20T11:24:29.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0640bfb20 con 0x7fe0740ad060 2023-07-20T11:24:29.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0740ae370 con 0x7fe0740ad060 2023-07-20T11:24:29.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe074073c70 con 0x7fe0740ad060 2023-07-20T11:24:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0640bfc80 con 0x7fe0740ad060 2023-07-20T11:24:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.700+0000 7fe070ff9640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 0x7fe054068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.704+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe06411edd0 con 0x7fe0740ad060 2023-07-20T11:24:29.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.704+0000 7fe06a7fc640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 0x7fe054068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:29.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.704+0000 7fe06a7fc640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 0x7fe054068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0741f6030 tx=0x7fe05c009190 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:29.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.704+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0640ec240 con 0x7fe0740ad060 2023-07-20T11:24:29.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe07406b8e0 con 0x7fe0740ad060 2023-07-20T11:24:29.899 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe070ff9640 1 -- 172.21.15.82:0/1217332670 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1020 (secure 0 0 0) 0x7fe0640ef860 con 0x7fe0740ad060 2023-07-20T11:24:29.899 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:29.900 INFO:teuthology.orchestra.run.smithi082.stdout:{"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5669,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":205,"num_osds":8,"num_up_osds":8,"osd_up_since":1689846613,"num_in_osds":8,"osd_in_since":1689846603,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":429555712,"bytes_avail":772664557568,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":99,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":11418}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-07-20T11:24:00.304137+0000","services":{}},"progress_events":{}} 2023-07-20T11:24:29.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 msgr2=0x7fe054068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 0x7fe054068860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe0741f6030 tx=0x7fe05c009190 comp rx=0 tx=0).stop 2023-07-20T11:24:29.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 msgr2=0x7fe074166780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:29.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7fe0640ad040 tx=0x7fe06401ac90 comp rx=0 tx=0).stop 2023-07-20T11:24:29.901 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 shutdown_connections 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fe0540663a0 0x7fe054068860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe0740b0290 0x7fe074070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe0740afe10 0x7fe0740709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 --2- 172.21.15.82:0/1217332670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe0740ad060 0x7fe074166780 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.904+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 >> 172.21.15.82:0/1217332670 conn(0x7fe0740cada0 msgr2=0x7fe074150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.908+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 shutdown_connections 2023-07-20T11:24:29.902 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:29.908+0000 7fe0798cb640 1 -- 172.21.15.82:0/1217332670 wait complete. 2023-07-20T11:24:29.921 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-20T11:24:29.921 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:30.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 Processor -- start 2023-07-20T11:24:30.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 -- start start 2023-07-20T11:24:30.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06f350 0x7fce3c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce3c0b2640 0x7fce3c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c0cf4a0 con 0x7fce3c06b970 2023-07-20T11:24:30.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c06ea80 con 0x7fce3c0b2640 2023-07-20T11:24:30.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce42461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0ce890 con 0x7fce3c06f350 2023-07-20T11:24:30.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce3c0b2640 0x7fce3c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fce3c0b2640 0x7fce3c15c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37516/0 (socket says 172.21.15.82:37516) 2023-07-20T11:24:30.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 -- 172.21.15.82:0/1593920682 learned_addr learned my addr 172.21.15.82:0/1593920682 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce3bfff640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06f350 0x7fce3c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 -- 172.21.15.82:0/1593920682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06f350 msgr2=0x7fce3c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06f350 0x7fce3c06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 -- 172.21.15.82:0/1593920682 >> v1:172.21.15.183:6789/0 conn(0x7fce3c06b970 legacy=0x7fce3c0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:30.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.068+0000 7fce409fe640 1 -- 172.21.15.82:0/1593920682 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0ceb70 con 0x7fce3c0b2640 2023-07-20T11:24:30.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce409fe640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c15c120 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce3401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206e124bb32e90e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:30.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce3affd640 1 -- 172.21.15.82:0/1593920682 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340a5790 con 0x7fce3c0b2640 2023-07-20T11:24:30.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce3affd640 1 -- 172.21.15.82:0/1593920682 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340a58f0 con 0x7fce3c0b2640 2023-07-20T11:24:30.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce3affd640 1 -- 172.21.15.82:0/1593920682 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340a5c80 con 0x7fce3c0b2640 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 -- 172.21.15.82:0/1593920682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 msgr2=0x7fce3c15c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c15c120 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce3401c910 comp rx=0 tx=0).stop 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 -- 172.21.15.82:0/1593920682 shutdown_connections 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c15c120 unknown :-1 s=CLOSED pgs=2399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 --2- 172.21.15.82:0/1593920682 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06f350 0x7fce3c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 -- 172.21.15.82:0/1593920682 >> 172.21.15.82:0/1593920682 conn(0x7fce3c089fa0 msgr2=0x7fce3c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:30.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 -- 172.21.15.82:0/1593920682 shutdown_connections 2023-07-20T11:24:30.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.072+0000 7fce42461640 1 -- 172.21.15.82:0/1593920682 wait complete. 2023-07-20T11:24:30.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 Processor -- start 2023-07-20T11:24:30.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- start start 2023-07-20T11:24:30.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06b970 0x7fce3c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce3c06f350 0x7fce3c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c1572f0 con 0x7fce3c0b2640 2023-07-20T11:24:30.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c156770 con 0x7fce3c06f350 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c1601d0 con 0x7fce3c06b970 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37528/0 (socket says 172.21.15.82:37528) 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 -- 172.21.15.82:0/2548418521 learned_addr learned my addr 172.21.15.82:0/2548418521 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce3bfff640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06b970 0x7fce3c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce3b7fe640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce3c06f350 0x7fce3c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 -- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06b970 msgr2=0x7fce3c154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:30.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06b970 0x7fce3c154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 -- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce3c06f350 msgr2=0x7fce3c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:30.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce3c06f350 0x7fce3c155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 -- 172.21.15.82:0/2548418521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009b30 con 0x7fce3c0b2640 2023-07-20T11:24:30.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce409fe640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:30.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340b8640 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340b87a0 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c1569c0 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce340b8b50 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.076+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c156f80 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c1574a0 con 0x7fce3c0b2640 2023-07-20T11:24:30.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce340b8cb0 con 0x7fce3c0b2640 2023-07-20T11:24:30.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce38ff9640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 0x7fce28068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:30.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fce3411f400 con 0x7fce3c0b2640 2023-07-20T11:24:30.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce3bfff640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 0x7fce28068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:30.077 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.080+0000 7fce3bfff640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 0x7fce28068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0b1a90 tx=0x7fce2c008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:30.079 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.084+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce3c1574a0 con 0x7fce3c0b2640 2023-07-20T11:24:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.228+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce3c06f730 con 0x7fce280663a0 2023-07-20T11:24:30.231 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.236+0000 7fce38ff9640 1 -- 172.21.15.82:0/2548418521 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311823 (secure 0 0 0) 0x7fce2c010990 con 0x7fce280663a0 2023-07-20T11:24:30.234 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:30.236 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 msgr2=0x7fce28068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 0x7fce28068860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0b1a90 tx=0x7fce2c008040 comp rx=0 tx=0).stop 2023-07-20T11:24:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 msgr2=0x7fce3c156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:30.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fce34009e50 tx=0x7fce340196b0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 shutdown_connections 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fce280663a0 0x7fce28068860 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce3c0b2640 0x7fce3c156230 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fce3c06f350 0x7fce3c155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 --2- 172.21.15.82:0/2548418521 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fce3c06b970 0x7fce3c154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 >> 172.21.15.82:0/2548418521 conn(0x7fce3c089fa0 msgr2=0x7fce3c157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:30.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 shutdown_connections 2023-07-20T11:24:30.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:30.240+0000 7fce42461640 1 -- 172.21.15.82:0/2548418521 wait complete. 2023-07-20T11:24:30.254 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-20T11:24:29.467448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419488,"kb_used_data":21288,"kb_used_omap":13,"kb_used_meta":398066,"kb_avail":754555232,"statfs":{"total":773094113280,"available":772664557568,"internally_reserved":0,"allocated":21798912,"data_stored":11740540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":407619672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001240"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551725+0000","last_change":"2023-07-20T11:24:24.689522+0000","last_active":"2023-07-20T11:24:26.551725+0000","last_peered":"2023-07-20T11:24:26.551725+0000","last_clean":"2023-07-20T11:24:26.551725+0000","last_became_active":"2023-07-20T11:24:24.689205+0000","last_became_peered":"2023-07-20T11:24:24.689205+0000","last_unstale":"2023-07-20T11:24:26.551725+0000","last_undegraded":"2023-07-20T11:24:26.551725+0000","last_fullsized":"2023-07-20T11:24:26.551725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:17.113569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551583+0000","last_change":"2023-07-20T11:24:24.684078+0000","last_active":"2023-07-20T11:24:26.551583+0000","last_peered":"2023-07-20T11:24:26.551583+0000","last_clean":"2023-07-20T11:24:26.551583+0000","last_became_active":"2023-07-20T11:24:24.683809+0000","last_became_peered":"2023-07-20T11:24:24.683809+0000","last_unstale":"2023-07-20T11:24:26.551583+0000","last_undegraded":"2023-07-20T11:24:26.551583+0000","last_fullsized":"2023-07-20T11:24:26.551583+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:50:10.947864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550342+0000","last_change":"2023-07-20T11:24:24.685040+0000","last_active":"2023-07-20T11:24:26.550342+0000","last_peered":"2023-07-20T11:24:26.550342+0000","last_clean":"2023-07-20T11:24:26.550342+0000","last_became_active":"2023-07-20T11:24:24.684761+0000","last_became_peered":"2023-07-20T11:24:24.684761+0000","last_unstale":"2023-07-20T11:24:26.550342+0000","last_undegraded":"2023-07-20T11:24:26.550342+0000","last_fullsized":"2023-07-20T11:24:26.550342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:04.326648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550487+0000","last_change":"2023-07-20T11:24:24.678905+0000","last_active":"2023-07-20T11:24:26.550487+0000","last_peered":"2023-07-20T11:24:26.550487+0000","last_clean":"2023-07-20T11:24:26.550487+0000","last_became_active":"2023-07-20T11:24:24.678468+0000","last_became_peered":"2023-07-20T11:24:24.678468+0000","last_unstale":"2023-07-20T11:24:26.550487+0000","last_undegraded":"2023-07-20T11:24:26.550487+0000","last_fullsized":"2023-07-20T11:24:26.550487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:03.435696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550459+0000","last_change":"2023-07-20T11:24:24.677166+0000","last_active":"2023-07-20T11:24:26.550459+0000","last_peered":"2023-07-20T11:24:26.550459+0000","last_clean":"2023-07-20T11:24:26.550459+0000","last_became_active":"2023-07-20T11:24:24.675153+0000","last_became_peered":"2023-07-20T11:24:24.675153+0000","last_unstale":"2023-07-20T11:24:26.550459+0000","last_undegraded":"2023-07-20T11:24:26.550459+0000","last_fullsized":"2023-07-20T11:24:26.550459+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:18.202507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549862+0000","last_change":"2023-07-20T11:24:24.687155+0000","last_active":"2023-07-20T11:24:26.549862+0000","last_peered":"2023-07-20T11:24:26.549862+0000","last_clean":"2023-07-20T11:24:26.549862+0000","last_became_active":"2023-07-20T11:24:24.686804+0000","last_became_peered":"2023-07-20T11:24:24.686804+0000","last_unstale":"2023-07-20T11:24:26.549862+0000","last_undegraded":"2023-07-20T11:24:26.549862+0000","last_fullsized":"2023-07-20T11:24:26.549862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:58.430858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663522+0000","last_change":"2023-07-20T11:24:24.690701+0000","last_active":"2023-07-20T11:24:25.663522+0000","last_peered":"2023-07-20T11:24:25.663522+0000","last_clean":"2023-07-20T11:24:25.663522+0000","last_became_active":"2023-07-20T11:24:24.690389+0000","last_became_peered":"2023-07-20T11:24:24.690389+0000","last_unstale":"2023-07-20T11:24:25.663522+0000","last_undegraded":"2023-07-20T11:24:25.663522+0000","last_fullsized":"2023-07-20T11:24:25.663522+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:29.712784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549667+0000","last_change":"2023-07-20T11:24:24.683027+0000","last_active":"2023-07-20T11:24:26.549667+0000","last_peered":"2023-07-20T11:24:26.549667+0000","last_clean":"2023-07-20T11:24:26.549667+0000","last_became_active":"2023-07-20T11:24:24.682730+0000","last_became_peered":"2023-07-20T11:24:24.682730+0000","last_unstale":"2023-07-20T11:24:26.549667+0000","last_undegraded":"2023-07-20T11:24:26.549667+0000","last_fullsized":"2023-07-20T11:24:26.549667+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:09.177683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551773+0000","last_change":"2023-07-20T11:24:24.692353+0000","last_active":"2023-07-20T11:24:26.551773+0000","last_peered":"2023-07-20T11:24:26.551773+0000","last_clean":"2023-07-20T11:24:26.551773+0000","last_became_active":"2023-07-20T11:24:24.692085+0000","last_became_peered":"2023-07-20T11:24:24.692085+0000","last_unstale":"2023-07-20T11:24:26.551773+0000","last_undegraded":"2023-07-20T11:24:26.551773+0000","last_fullsized":"2023-07-20T11:24:26.551773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:21.058797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550398+0000","last_change":"2023-07-20T11:24:24.678931+0000","last_active":"2023-07-20T11:24:26.550398+0000","last_peered":"2023-07-20T11:24:26.550398+0000","last_clean":"2023-07-20T11:24:26.550398+0000","last_became_active":"2023-07-20T11:24:24.678641+0000","last_became_peered":"2023-07-20T11:24:24.678641+0000","last_unstale":"2023-07-20T11:24:26.550398+0000","last_undegraded":"2023-07-20T11:24:26.550398+0000","last_fullsized":"2023-07-20T11:24:26.550398+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:25.431348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666338+0000","last_change":"2023-07-20T11:24:24.679563+0000","last_active":"2023-07-20T11:24:25.666338+0000","last_peered":"2023-07-20T11:24:25.666338+0000","last_clean":"2023-07-20T11:24:25.666338+0000","last_became_active":"2023-07-20T11:24:24.679297+0000","last_became_peered":"2023-07-20T11:24:24.679297+0000","last_unstale":"2023-07-20T11:24:25.666338+0000","last_undegraded":"2023-07-20T11:24:25.666338+0000","last_fullsized":"2023-07-20T11:24:25.666338+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:00:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550612+0000","last_change":"2023-07-20T11:24:24.685142+0000","last_active":"2023-07-20T11:24:26.550612+0000","last_peered":"2023-07-20T11:24:26.550612+0000","last_clean":"2023-07-20T11:24:26.550612+0000","last_became_active":"2023-07-20T11:24:24.684811+0000","last_became_peered":"2023-07-20T11:24:24.684811+0000","last_unstale":"2023-07-20T11:24:26.550612+0000","last_undegraded":"2023-07-20T11:24:26.550612+0000","last_fullsized":"2023-07-20T11:24:26.550612+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:32.326580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664988+0000","last_change":"2023-07-20T11:24:24.679784+0000","last_active":"2023-07-20T11:24:25.664988+0000","last_peered":"2023-07-20T11:24:25.664988+0000","last_clean":"2023-07-20T11:24:25.664988+0000","last_became_active":"2023-07-20T11:24:24.679493+0000","last_became_peered":"2023-07-20T11:24:24.679493+0000","last_unstale":"2023-07-20T11:24:25.664988+0000","last_undegraded":"2023-07-20T11:24:25.664988+0000","last_fullsized":"2023-07-20T11:24:25.664988+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:02.838449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663625+0000","last_change":"2023-07-20T11:24:24.680757+0000","last_active":"2023-07-20T11:24:25.663625+0000","last_peered":"2023-07-20T11:24:25.663625+0000","last_clean":"2023-07-20T11:24:25.663625+0000","last_became_active":"2023-07-20T11:24:24.680458+0000","last_became_peered":"2023-07-20T11:24:24.680458+0000","last_unstale":"2023-07-20T11:24:25.663625+0000","last_undegraded":"2023-07-20T11:24:25.663625+0000","last_fullsized":"2023-07-20T11:24:25.663625+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:11.698388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551139+0000","last_change":"2023-07-20T11:24:24.682062+0000","last_active":"2023-07-20T11:24:26.551139+0000","last_peered":"2023-07-20T11:24:26.551139+0000","last_clean":"2023-07-20T11:24:26.551139+0000","last_became_active":"2023-07-20T11:24:24.681763+0000","last_became_peered":"2023-07-20T11:24:24.681763+0000","last_unstale":"2023-07-20T11:24:26.551139+0000","last_undegraded":"2023-07-20T11:24:26.551139+0000","last_fullsized":"2023-07-20T11:24:26.551139+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:07.320581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549640+0000","last_change":"2023-07-20T11:24:24.677393+0000","last_active":"2023-07-20T11:24:26.549640+0000","last_peered":"2023-07-20T11:24:26.549640+0000","last_clean":"2023-07-20T11:24:26.549640+0000","last_became_active":"2023-07-20T11:24:24.676507+0000","last_became_peered":"2023-07-20T11:24:24.676507+0000","last_unstale":"2023-07-20T11:24:26.549640+0000","last_undegraded":"2023-07-20T11:24:26.549640+0000","last_fullsized":"2023-07-20T11:24:26.549640+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:22:34.109165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550959+0000","last_change":"2023-07-20T11:24:24.696028+0000","last_active":"2023-07-20T11:24:26.550959+0000","last_peered":"2023-07-20T11:24:26.550959+0000","last_clean":"2023-07-20T11:24:26.550959+0000","last_became_active":"2023-07-20T11:24:24.695666+0000","last_became_peered":"2023-07-20T11:24:24.695666+0000","last_unstale":"2023-07-20T11:24:26.550959+0000","last_undegraded":"2023-07-20T11:24:26.550959+0000","last_fullsized":"2023-07-20T11:24:26.550959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:22:20.608126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665342+0000","last_change":"2023-07-20T11:24:24.690175+0000","last_active":"2023-07-20T11:24:25.665342+0000","last_peered":"2023-07-20T11:24:25.665342+0000","last_clean":"2023-07-20T11:24:25.665342+0000","last_became_active":"2023-07-20T11:24:24.689893+0000","last_became_peered":"2023-07-20T11:24:24.689893+0000","last_unstale":"2023-07-20T11:24:25.665342+0000","last_undegraded":"2023-07-20T11:24:25.665342+0000","last_fullsized":"2023-07-20T11:24:25.665342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665218+0000","last_change":"2023-07-20T11:24:24.685691+0000","last_active":"2023-07-20T11:24:25.665218+0000","last_peered":"2023-07-20T11:24:25.665218+0000","last_clean":"2023-07-20T11:24:25.665218+0000","last_became_active":"2023-07-20T11:24:24.685389+0000","last_became_peered":"2023-07-20T11:24:24.685389+0000","last_unstale":"2023-07-20T11:24:25.665218+0000","last_undegraded":"2023-07-20T11:24:25.665218+0000","last_fullsized":"2023-07-20T11:24:25.665218+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:58.929732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549998+0000","last_change":"2023-07-20T11:24:24.684881+0000","last_active":"2023-07-20T11:24:26.549998+0000","last_peered":"2023-07-20T11:24:26.549998+0000","last_clean":"2023-07-20T11:24:26.549998+0000","last_became_active":"2023-07-20T11:24:24.684558+0000","last_became_peered":"2023-07-20T11:24:24.684558+0000","last_unstale":"2023-07-20T11:24:26.549998+0000","last_undegraded":"2023-07-20T11:24:26.549998+0000","last_fullsized":"2023-07-20T11:24:26.549998+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:08:34.276396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551646+0000","last_change":"2023-07-20T11:24:24.691409+0000","last_active":"2023-07-20T11:24:26.551646+0000","last_peered":"2023-07-20T11:24:26.551646+0000","last_clean":"2023-07-20T11:24:26.551646+0000","last_became_active":"2023-07-20T11:24:24.691130+0000","last_became_peered":"2023-07-20T11:24:24.691130+0000","last_unstale":"2023-07-20T11:24:26.551646+0000","last_undegraded":"2023-07-20T11:24:26.551646+0000","last_fullsized":"2023-07-20T11:24:26.551646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:02.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550753+0000","last_change":"2023-07-20T11:24:24.691664+0000","last_active":"2023-07-20T11:24:26.550753+0000","last_peered":"2023-07-20T11:24:26.550753+0000","last_clean":"2023-07-20T11:24:26.550753+0000","last_became_active":"2023-07-20T11:24:24.691398+0000","last_became_peered":"2023-07-20T11:24:24.691398+0000","last_unstale":"2023-07-20T11:24:26.550753+0000","last_undegraded":"2023-07-20T11:24:26.550753+0000","last_fullsized":"2023-07-20T11:24:26.550753+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:48.242546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T11:24:24.688159+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T11:24:24.687858+0000","last_became_peered":"2023-07-20T11:24:24.687858+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:02.615288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550966+0000","last_change":"2023-07-20T11:24:24.691106+0000","last_active":"2023-07-20T11:24:26.550966+0000","last_peered":"2023-07-20T11:24:26.550966+0000","last_clean":"2023-07-20T11:24:26.550966+0000","last_became_active":"2023-07-20T11:24:24.690615+0000","last_became_peered":"2023-07-20T11:24:24.690615+0000","last_unstale":"2023-07-20T11:24:26.550966+0000","last_undegraded":"2023-07-20T11:24:26.550966+0000","last_fullsized":"2023-07-20T11:24:26.550966+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:16:02.556859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663976+0000","last_change":"2023-07-20T11:24:24.685774+0000","last_active":"2023-07-20T11:24:25.663976+0000","last_peered":"2023-07-20T11:24:25.663976+0000","last_clean":"2023-07-20T11:24:25.663976+0000","last_became_active":"2023-07-20T11:24:24.685518+0000","last_became_peered":"2023-07-20T11:24:24.685518+0000","last_unstale":"2023-07-20T11:24:25.663976+0000","last_undegraded":"2023-07-20T11:24:25.663976+0000","last_fullsized":"2023-07-20T11:24:25.663976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:08:02.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666609+0000","last_change":"2023-07-20T11:24:24.674557+0000","last_active":"2023-07-20T11:24:25.666609+0000","last_peered":"2023-07-20T11:24:25.666609+0000","last_clean":"2023-07-20T11:24:25.666609+0000","last_became_active":"2023-07-20T11:24:24.674218+0000","last_became_peered":"2023-07-20T11:24:24.674218+0000","last_unstale":"2023-07-20T11:24:25.666609+0000","last_undegraded":"2023-07-20T11:24:25.666609+0000","last_fullsized":"2023-07-20T11:24:25.666609+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:14.436421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549917+0000","last_change":"2023-07-20T11:24:24.684646+0000","last_active":"2023-07-20T11:24:26.549917+0000","last_peered":"2023-07-20T11:24:26.549917+0000","last_clean":"2023-07-20T11:24:26.549917+0000","last_became_active":"2023-07-20T11:24:24.684313+0000","last_became_peered":"2023-07-20T11:24:24.684313+0000","last_unstale":"2023-07-20T11:24:26.549917+0000","last_undegraded":"2023-07-20T11:24:26.549917+0000","last_fullsized":"2023-07-20T11:24:26.549917+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:10.212519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550031+0000","last_change":"2023-07-20T11:24:24.675522+0000","last_active":"2023-07-20T11:24:26.550031+0000","last_peered":"2023-07-20T11:24:26.550031+0000","last_clean":"2023-07-20T11:24:26.550031+0000","last_became_active":"2023-07-20T11:24:24.675245+0000","last_became_peered":"2023-07-20T11:24:24.675245+0000","last_unstale":"2023-07-20T11:24:26.550031+0000","last_undegraded":"2023-07-20T11:24:26.550031+0000","last_fullsized":"2023-07-20T11:24:26.550031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:19.900714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665958+0000","last_change":"2023-07-20T11:24:24.688000+0000","last_active":"2023-07-20T11:24:25.665958+0000","last_peered":"2023-07-20T11:24:25.665958+0000","last_clean":"2023-07-20T11:24:25.665958+0000","last_became_active":"2023-07-20T11:24:24.687676+0000","last_became_peered":"2023-07-20T11:24:24.687676+0000","last_unstale":"2023-07-20T11:24:25.665958+0000","last_undegraded":"2023-07-20T11:24:25.665958+0000","last_fullsized":"2023-07-20T11:24:25.665958+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:14.683745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665809+0000","last_change":"2023-07-20T11:24:24.684772+0000","last_active":"2023-07-20T11:24:25.665809+0000","last_peered":"2023-07-20T11:24:25.665809+0000","last_clean":"2023-07-20T11:24:25.665809+0000","last_became_active":"2023-07-20T11:24:24.684456+0000","last_became_peered":"2023-07-20T11:24:24.684456+0000","last_unstale":"2023-07-20T11:24:25.665809+0000","last_undegraded":"2023-07-20T11:24:25.665809+0000","last_fullsized":"2023-07-20T11:24:25.665809+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:55.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.680476+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.680169+0000","last_became_peered":"2023-07-20T11:24:24.680169+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:52:06.585577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549806+0000","last_change":"2023-07-20T11:24:24.678435+0000","last_active":"2023-07-20T11:24:26.549806+0000","last_peered":"2023-07-20T11:24:26.549806+0000","last_clean":"2023-07-20T11:24:26.549806+0000","last_became_active":"2023-07-20T11:24:24.678139+0000","last_became_peered":"2023-07-20T11:24:24.678139+0000","last_unstale":"2023-07-20T11:24:26.549806+0000","last_undegraded":"2023-07-20T11:24:26.549806+0000","last_fullsized":"2023-07-20T11:24:26.549806+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550226+0000","last_change":"2023-07-20T11:24:24.682755+0000","last_active":"2023-07-20T11:24:26.550226+0000","last_peered":"2023-07-20T11:24:26.550226+0000","last_clean":"2023-07-20T11:24:26.550226+0000","last_became_active":"2023-07-20T11:24:24.682425+0000","last_became_peered":"2023-07-20T11:24:24.682425+0000","last_unstale":"2023-07-20T11:24:26.550226+0000","last_undegraded":"2023-07-20T11:24:26.550226+0000","last_fullsized":"2023-07-20T11:24:26.550226+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:09.320170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551047+0000","last_change":"2023-07-20T11:24:23.684101+0000","last_active":"2023-07-20T11:24:26.551047+0000","last_peered":"2023-07-20T11:24:26.551047+0000","last_clean":"2023-07-20T11:24:26.551047+0000","last_became_active":"2023-07-20T11:24:23.683833+0000","last_became_peered":"2023-07-20T11:24:23.683833+0000","last_unstale":"2023-07-20T11:24:26.551047+0000","last_undegraded":"2023-07-20T11:24:26.551047+0000","last_fullsized":"2023-07-20T11:24:26.551047+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:01:34.520625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550204+0000","last_change":"2023-07-20T11:24:24.676219+0000","last_active":"2023-07-20T11:24:26.550204+0000","last_peered":"2023-07-20T11:24:26.550204+0000","last_clean":"2023-07-20T11:24:26.550204+0000","last_became_active":"2023-07-20T11:24:24.675907+0000","last_became_peered":"2023-07-20T11:24:24.675907+0000","last_unstale":"2023-07-20T11:24:26.550204+0000","last_undegraded":"2023-07-20T11:24:26.550204+0000","last_fullsized":"2023-07-20T11:24:26.550204+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:37.358044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551649+0000","last_change":"2023-07-20T11:24:23.679342+0000","last_active":"2023-07-20T11:24:26.551649+0000","last_peered":"2023-07-20T11:24:26.551649+0000","last_clean":"2023-07-20T11:24:26.551649+0000","last_became_active":"2023-07-20T11:24:23.679077+0000","last_became_peered":"2023-07-20T11:24:23.679077+0000","last_unstale":"2023-07-20T11:24:26.551649+0000","last_undegraded":"2023-07-20T11:24:26.551649+0000","last_fullsized":"2023-07-20T11:24:26.551649+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:46:04.199831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665431+0000","last_change":"2023-07-20T11:24:24.679405+0000","last_active":"2023-07-20T11:24:25.665431+0000","last_peered":"2023-07-20T11:24:25.665431+0000","last_clean":"2023-07-20T11:24:25.665431+0000","last_became_active":"2023-07-20T11:24:24.679049+0000","last_became_peered":"2023-07-20T11:24:24.679049+0000","last_unstale":"2023-07-20T11:24:25.665431+0000","last_undegraded":"2023-07-20T11:24:25.665431+0000","last_fullsized":"2023-07-20T11:24:25.665431+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:17.563561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"204'3","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550525+0000","last_change":"2023-07-20T11:24:23.682028+0000","last_active":"2023-07-20T11:24:26.550525+0000","last_peered":"2023-07-20T11:24:26.550525+0000","last_clean":"2023-07-20T11:24:26.550525+0000","last_became_active":"2023-07-20T11:24:23.681732+0000","last_became_peered":"2023-07-20T11:24:23.681732+0000","last_unstale":"2023-07-20T11:24:26.550525+0000","last_undegraded":"2023-07-20T11:24:26.550525+0000","last_fullsized":"2023-07-20T11:24:26.550525+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:43.776076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551815+0000","last_change":"2023-07-20T11:24:24.684877+0000","last_active":"2023-07-20T11:24:26.551815+0000","last_peered":"2023-07-20T11:24:26.551815+0000","last_clean":"2023-07-20T11:24:26.551815+0000","last_became_active":"2023-07-20T11:24:24.684555+0000","last_became_peered":"2023-07-20T11:24:24.684555+0000","last_unstale":"2023-07-20T11:24:26.551815+0000","last_undegraded":"2023-07-20T11:24:26.551815+0000","last_fullsized":"2023-07-20T11:24:26.551815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:13:44.684094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"204'6","reported_seq":19,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665477+0000","last_change":"2023-07-20T11:24:23.678045+0000","last_active":"2023-07-20T11:24:25.665477+0000","last_peered":"2023-07-20T11:24:25.665477+0000","last_clean":"2023-07-20T11:24:25.665477+0000","last_became_active":"2023-07-20T11:24:23.677672+0000","last_became_peered":"2023-07-20T11:24:23.677672+0000","last_unstale":"2023-07-20T11:24:25.665477+0000","last_undegraded":"2023-07-20T11:24:25.665477+0000","last_fullsized":"2023-07-20T11:24:25.665477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:03.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.682921+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.682654+0000","last_became_peered":"2023-07-20T11:24:24.682654+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:23.125250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665109+0000","last_change":"2023-07-20T11:24:23.682866+0000","last_active":"2023-07-20T11:24:25.665109+0000","last_peered":"2023-07-20T11:24:25.665109+0000","last_clean":"2023-07-20T11:24:25.665109+0000","last_became_active":"2023-07-20T11:24:23.682498+0000","last_became_peered":"2023-07-20T11:24:23.682498+0000","last_unstale":"2023-07-20T11:24:25.665109+0000","last_undegraded":"2023-07-20T11:24:25.665109+0000","last_fullsized":"2023-07-20T11:24:25.665109+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:19:29.435926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549570+0000","last_change":"2023-07-20T11:24:24.680838+0000","last_active":"2023-07-20T11:24:26.549570+0000","last_peered":"2023-07-20T11:24:26.549570+0000","last_clean":"2023-07-20T11:24:26.549570+0000","last_became_active":"2023-07-20T11:24:24.679079+0000","last_became_peered":"2023-07-20T11:24:24.679079+0000","last_unstale":"2023-07-20T11:24:26.549570+0000","last_undegraded":"2023-07-20T11:24:26.549570+0000","last_fullsized":"2023-07-20T11:24:26.549570+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:08.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550990+0000","last_change":"2023-07-20T11:24:23.684218+0000","last_active":"2023-07-20T11:24:26.550990+0000","last_peered":"2023-07-20T11:24:26.550990+0000","last_clean":"2023-07-20T11:24:26.550990+0000","last_became_active":"2023-07-20T11:24:23.683931+0000","last_became_peered":"2023-07-20T11:24:23.683931+0000","last_unstale":"2023-07-20T11:24:26.550990+0000","last_undegraded":"2023-07-20T11:24:26.550990+0000","last_fullsized":"2023-07-20T11:24:26.550990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:07:21.665674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665156+0000","last_change":"2023-07-20T11:24:24.678415+0000","last_active":"2023-07-20T11:24:25.665156+0000","last_peered":"2023-07-20T11:24:25.665156+0000","last_clean":"2023-07-20T11:24:25.665156+0000","last_became_active":"2023-07-20T11:24:24.677868+0000","last_became_peered":"2023-07-20T11:24:24.677868+0000","last_unstale":"2023-07-20T11:24:25.665156+0000","last_undegraded":"2023-07-20T11:24:25.665156+0000","last_fullsized":"2023-07-20T11:24:25.665156+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:45.774704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549780+0000","last_change":"2023-07-20T11:24:23.682204+0000","last_active":"2023-07-20T11:24:26.549780+0000","last_peered":"2023-07-20T11:24:26.549780+0000","last_clean":"2023-07-20T11:24:26.549780+0000","last_became_active":"2023-07-20T11:24:23.681404+0000","last_became_peered":"2023-07-20T11:24:23.681404+0000","last_unstale":"2023-07-20T11:24:26.549780+0000","last_undegraded":"2023-07-20T11:24:26.549780+0000","last_fullsized":"2023-07-20T11:24:26.549780+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:06:39.238103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665055+0000","last_change":"2023-07-20T11:24:24.687111+0000","last_active":"2023-07-20T11:24:25.665055+0000","last_peered":"2023-07-20T11:24:25.665055+0000","last_clean":"2023-07-20T11:24:25.665055+0000","last_became_active":"2023-07-20T11:24:24.686827+0000","last_became_peered":"2023-07-20T11:24:24.686827+0000","last_unstale":"2023-07-20T11:24:25.665055+0000","last_undegraded":"2023-07-20T11:24:25.665055+0000","last_fullsized":"2023-07-20T11:24:25.665055+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:59.453824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"204'8","reported_seq":21,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665839+0000","last_change":"2023-07-20T11:24:23.682481+0000","last_active":"2023-07-20T11:24:25.665839+0000","last_peered":"2023-07-20T11:24:25.665839+0000","last_clean":"2023-07-20T11:24:25.665839+0000","last_became_active":"2023-07-20T11:24:23.682201+0000","last_became_peered":"2023-07-20T11:24:23.682201+0000","last_unstale":"2023-07-20T11:24:25.665839+0000","last_undegraded":"2023-07-20T11:24:25.665839+0000","last_fullsized":"2023-07-20T11:24:25.665839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:10.688723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663758+0000","last_change":"2023-07-20T11:24:24.688471+0000","last_active":"2023-07-20T11:24:25.663758+0000","last_peered":"2023-07-20T11:24:25.663758+0000","last_clean":"2023-07-20T11:24:25.663758+0000","last_became_active":"2023-07-20T11:24:24.687869+0000","last_became_peered":"2023-07-20T11:24:24.687869+0000","last_unstale":"2023-07-20T11:24:25.663758+0000","last_undegraded":"2023-07-20T11:24:25.663758+0000","last_fullsized":"2023-07-20T11:24:25.663758+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:09:51.468890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:23.683827+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:23.683531+0000","last_became_peered":"2023-07-20T11:24:23.683531+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:57.957596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550130+0000","last_change":"2023-07-20T11:24:24.678725+0000","last_active":"2023-07-20T11:24:26.550130+0000","last_peered":"2023-07-20T11:24:26.550130+0000","last_clean":"2023-07-20T11:24:26.550130+0000","last_became_active":"2023-07-20T11:24:24.678410+0000","last_became_peered":"2023-07-20T11:24:24.678410+0000","last_unstale":"2023-07-20T11:24:26.550130+0000","last_undegraded":"2023-07-20T11:24:26.550130+0000","last_fullsized":"2023-07-20T11:24:26.550130+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:17.906290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550667+0000","last_change":"2023-07-20T11:24:23.681794+0000","last_active":"2023-07-20T11:24:26.550667+0000","last_peered":"2023-07-20T11:24:26.550667+0000","last_clean":"2023-07-20T11:24:26.550667+0000","last_became_active":"2023-07-20T11:24:23.681483+0000","last_became_peered":"2023-07-20T11:24:23.681483+0000","last_unstale":"2023-07-20T11:24:26.550667+0000","last_undegraded":"2023-07-20T11:24:26.550667+0000","last_fullsized":"2023-07-20T11:24:26.550667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:46:59.874775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666760+0000","last_change":"2023-07-20T11:24:24.669515+0000","last_active":"2023-07-20T11:24:25.666760+0000","last_peered":"2023-07-20T11:24:25.666760+0000","last_clean":"2023-07-20T11:24:25.666760+0000","last_became_active":"2023-07-20T11:24:24.669197+0000","last_became_peered":"2023-07-20T11:24:24.669197+0000","last_unstale":"2023-07-20T11:24:25.666760+0000","last_undegraded":"2023-07-20T11:24:25.666760+0000","last_fullsized":"2023-07-20T11:24:25.666760+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:22:02.077179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550465+0000","last_change":"2023-07-20T11:24:23.679691+0000","last_active":"2023-07-20T11:24:26.550465+0000","last_peered":"2023-07-20T11:24:26.550465+0000","last_clean":"2023-07-20T11:24:26.550465+0000","last_became_active":"2023-07-20T11:24:23.679363+0000","last_became_peered":"2023-07-20T11:24:23.679363+0000","last_unstale":"2023-07-20T11:24:26.550465+0000","last_undegraded":"2023-07-20T11:24:26.550465+0000","last_fullsized":"2023-07-20T11:24:26.550465+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:35:35.278711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551915+0000","last_change":"2023-07-20T11:24:24.688520+0000","last_active":"2023-07-20T11:24:26.551915+0000","last_peered":"2023-07-20T11:24:26.551915+0000","last_clean":"2023-07-20T11:24:26.551915+0000","last_became_active":"2023-07-20T11:24:24.688113+0000","last_became_peered":"2023-07-20T11:24:24.688113+0000","last_unstale":"2023-07-20T11:24:26.551915+0000","last_undegraded":"2023-07-20T11:24:26.551915+0000","last_fullsized":"2023-07-20T11:24:26.551915+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:21:08.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666325+0000","last_change":"2023-07-20T11:24:23.675157+0000","last_active":"2023-07-20T11:24:25.666325+0000","last_peered":"2023-07-20T11:24:25.666325+0000","last_clean":"2023-07-20T11:24:25.666325+0000","last_became_active":"2023-07-20T11:24:23.674851+0000","last_became_peered":"2023-07-20T11:24:23.674851+0000","last_unstale":"2023-07-20T11:24:25.666325+0000","last_undegraded":"2023-07-20T11:24:25.666325+0000","last_fullsized":"2023-07-20T11:24:25.666325+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:16:42.900052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551131+0000","last_change":"2023-07-20T11:24:24.690831+0000","last_active":"2023-07-20T11:24:26.551131+0000","last_peered":"2023-07-20T11:24:26.551131+0000","last_clean":"2023-07-20T11:24:26.551131+0000","last_became_active":"2023-07-20T11:24:24.689131+0000","last_became_peered":"2023-07-20T11:24:24.689131+0000","last_unstale":"2023-07-20T11:24:26.551131+0000","last_undegraded":"2023-07-20T11:24:26.551131+0000","last_fullsized":"2023-07-20T11:24:26.551131+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:14:59.067673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665256+0000","last_change":"2023-07-20T11:24:23.680375+0000","last_active":"2023-07-20T11:24:25.665256+0000","last_peered":"2023-07-20T11:24:25.665256+0000","last_clean":"2023-07-20T11:24:25.665256+0000","last_became_active":"2023-07-20T11:24:23.680085+0000","last_became_peered":"2023-07-20T11:24:23.680085+0000","last_unstale":"2023-07-20T11:24:25.665256+0000","last_undegraded":"2023-07-20T11:24:25.665256+0000","last_fullsized":"2023-07-20T11:24:25.665256+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:35.499388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549730+0000","last_change":"2023-07-20T11:24:24.678320+0000","last_active":"2023-07-20T11:24:26.549730+0000","last_peered":"2023-07-20T11:24:26.549730+0000","last_clean":"2023-07-20T11:24:26.549730+0000","last_became_active":"2023-07-20T11:24:24.678044+0000","last_became_peered":"2023-07-20T11:24:24.678044+0000","last_unstale":"2023-07-20T11:24:26.549730+0000","last_undegraded":"2023-07-20T11:24:26.549730+0000","last_fullsized":"2023-07-20T11:24:26.549730+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:51.064227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551265+0000","last_change":"2023-07-20T11:24:23.681837+0000","last_active":"2023-07-20T11:24:26.551265+0000","last_peered":"2023-07-20T11:24:26.551265+0000","last_clean":"2023-07-20T11:24:26.551265+0000","last_became_active":"2023-07-20T11:24:23.681564+0000","last_became_peered":"2023-07-20T11:24:23.681564+0000","last_unstale":"2023-07-20T11:24:26.551265+0000","last_undegraded":"2023-07-20T11:24:26.551265+0000","last_fullsized":"2023-07-20T11:24:26.551265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:24.559465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549817+0000","last_change":"2023-07-20T11:24:24.675008+0000","last_active":"2023-07-20T11:24:26.549817+0000","last_peered":"2023-07-20T11:24:26.549817+0000","last_clean":"2023-07-20T11:24:26.549817+0000","last_became_active":"2023-07-20T11:24:24.674723+0000","last_became_peered":"2023-07-20T11:24:24.674723+0000","last_unstale":"2023-07-20T11:24:26.549817+0000","last_undegraded":"2023-07-20T11:24:26.549817+0000","last_fullsized":"2023-07-20T11:24:26.549817+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:34:49.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T11:24:23.673277+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T11:24:23.672993+0000","last_became_peered":"2023-07-20T11:24:23.672993+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:12:41.364472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550594+0000","last_change":"2023-07-20T11:24:24.678376+0000","last_active":"2023-07-20T11:24:26.550594+0000","last_peered":"2023-07-20T11:24:26.550594+0000","last_clean":"2023-07-20T11:24:26.550594+0000","last_became_active":"2023-07-20T11:24:24.678085+0000","last_became_peered":"2023-07-20T11:24:24.678085+0000","last_unstale":"2023-07-20T11:24:26.550594+0000","last_undegraded":"2023-07-20T11:24:26.550594+0000","last_fullsized":"2023-07-20T11:24:26.550594+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:32.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550287+0000","last_change":"2023-07-20T11:24:23.675360+0000","last_active":"2023-07-20T11:24:26.550287+0000","last_peered":"2023-07-20T11:24:26.550287+0000","last_clean":"2023-07-20T11:24:26.550287+0000","last_became_active":"2023-07-20T11:24:23.675055+0000","last_became_peered":"2023-07-20T11:24:23.675055+0000","last_unstale":"2023-07-20T11:24:26.550287+0000","last_undegraded":"2023-07-20T11:24:26.550287+0000","last_fullsized":"2023-07-20T11:24:26.550287+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:16.555849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663778+0000","last_change":"2023-07-20T11:24:24.678995+0000","last_active":"2023-07-20T11:24:25.663778+0000","last_peered":"2023-07-20T11:24:25.663778+0000","last_clean":"2023-07-20T11:24:25.663778+0000","last_became_active":"2023-07-20T11:24:24.678730+0000","last_became_peered":"2023-07-20T11:24:24.678730+0000","last_unstale":"2023-07-20T11:24:25.663778+0000","last_undegraded":"2023-07-20T11:24:25.663778+0000","last_fullsized":"2023-07-20T11:24:25.663778+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:09:01.086386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550998+0000","last_change":"2023-07-20T11:24:23.683335+0000","last_active":"2023-07-20T11:24:26.550998+0000","last_peered":"2023-07-20T11:24:26.550998+0000","last_clean":"2023-07-20T11:24:26.550998+0000","last_became_active":"2023-07-20T11:24:23.682337+0000","last_became_peered":"2023-07-20T11:24:23.682337+0000","last_unstale":"2023-07-20T11:24:26.550998+0000","last_undegraded":"2023-07-20T11:24:26.550998+0000","last_fullsized":"2023-07-20T11:24:26.550998+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:34.528225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551551+0000","last_change":"2023-07-20T11:24:24.688964+0000","last_active":"2023-07-20T11:24:26.551551+0000","last_peered":"2023-07-20T11:24:26.551551+0000","last_clean":"2023-07-20T11:24:26.551551+0000","last_became_active":"2023-07-20T11:24:24.688628+0000","last_became_peered":"2023-07-20T11:24:24.688628+0000","last_unstale":"2023-07-20T11:24:26.551551+0000","last_undegraded":"2023-07-20T11:24:26.551551+0000","last_fullsized":"2023-07-20T11:24:26.551551+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:18.334735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663878+0000","last_change":"2023-07-20T11:24:23.674114+0000","last_active":"2023-07-20T11:24:25.663878+0000","last_peered":"2023-07-20T11:24:25.663878+0000","last_clean":"2023-07-20T11:24:25.663878+0000","last_became_active":"2023-07-20T11:24:23.673839+0000","last_became_peered":"2023-07-20T11:24:23.673839+0000","last_unstale":"2023-07-20T11:24:25.663878+0000","last_undegraded":"2023-07-20T11:24:25.663878+0000","last_fullsized":"2023-07-20T11:24:25.663878+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:27.235588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550113+0000","last_change":"2023-07-20T11:24:24.691022+0000","last_active":"2023-07-20T11:24:26.550113+0000","last_peered":"2023-07-20T11:24:26.550113+0000","last_clean":"2023-07-20T11:24:26.550113+0000","last_became_active":"2023-07-20T11:24:24.690730+0000","last_became_peered":"2023-07-20T11:24:24.690730+0000","last_unstale":"2023-07-20T11:24:26.550113+0000","last_undegraded":"2023-07-20T11:24:26.550113+0000","last_fullsized":"2023-07-20T11:24:26.550113+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:28.000651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550244+0000","last_change":"2023-07-20T11:24:23.675815+0000","last_active":"2023-07-20T11:24:26.550244+0000","last_peered":"2023-07-20T11:24:26.550244+0000","last_clean":"2023-07-20T11:24:26.550244+0000","last_became_active":"2023-07-20T11:24:23.675439+0000","last_became_peered":"2023-07-20T11:24:23.675439+0000","last_unstale":"2023-07-20T11:24:26.550244+0000","last_undegraded":"2023-07-20T11:24:26.550244+0000","last_fullsized":"2023-07-20T11:24:26.550244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:13.048858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664047+0000","last_change":"2023-07-20T11:24:24.682352+0000","last_active":"2023-07-20T11:24:25.664047+0000","last_peered":"2023-07-20T11:24:25.664047+0000","last_clean":"2023-07-20T11:24:25.664047+0000","last_became_active":"2023-07-20T11:24:24.682052+0000","last_became_peered":"2023-07-20T11:24:24.682052+0000","last_unstale":"2023-07-20T11:24:25.664047+0000","last_undegraded":"2023-07-20T11:24:25.664047+0000","last_fullsized":"2023-07-20T11:24:25.664047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:09.802004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550128+0000","last_change":"2023-07-20T11:24:23.677464+0000","last_active":"2023-07-20T11:24:26.550128+0000","last_peered":"2023-07-20T11:24:26.550128+0000","last_clean":"2023-07-20T11:24:26.550128+0000","last_became_active":"2023-07-20T11:24:23.677216+0000","last_became_peered":"2023-07-20T11:24:23.677216+0000","last_unstale":"2023-07-20T11:24:26.550128+0000","last_undegraded":"2023-07-20T11:24:26.550128+0000","last_fullsized":"2023-07-20T11:24:26.550128+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:07.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550151+0000","last_change":"2023-07-20T11:24:24.679461+0000","last_active":"2023-07-20T11:24:26.550151+0000","last_peered":"2023-07-20T11:24:26.550151+0000","last_clean":"2023-07-20T11:24:26.550151+0000","last_became_active":"2023-07-20T11:24:24.679161+0000","last_became_peered":"2023-07-20T11:24:24.679161+0000","last_unstale":"2023-07-20T11:24:26.550151+0000","last_undegraded":"2023-07-20T11:24:26.550151+0000","last_fullsized":"2023-07-20T11:24:26.550151+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:36.507100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549641+0000","last_change":"2023-07-20T11:24:23.679636+0000","last_active":"2023-07-20T11:24:26.549641+0000","last_peered":"2023-07-20T11:24:26.549641+0000","last_clean":"2023-07-20T11:24:26.549641+0000","last_became_active":"2023-07-20T11:24:23.679349+0000","last_became_peered":"2023-07-20T11:24:23.679349+0000","last_unstale":"2023-07-20T11:24:26.549641+0000","last_undegraded":"2023-07-20T11:24:26.549641+0000","last_fullsized":"2023-07-20T11:24:26.549641+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:21:22.847113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664927+0000","last_change":"2023-07-20T11:24:24.694372+0000","last_active":"2023-07-20T11:24:25.664927+0000","last_peered":"2023-07-20T11:24:25.664927+0000","last_clean":"2023-07-20T11:24:25.664927+0000","last_became_active":"2023-07-20T11:24:24.694083+0000","last_became_peered":"2023-07-20T11:24:24.694083+0000","last_unstale":"2023-07-20T11:24:25.664927+0000","last_undegraded":"2023-07-20T11:24:25.664927+0000","last_fullsized":"2023-07-20T11:24:25.664927+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:30:08.308012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549535+0000","last_change":"2023-07-20T11:24:23.679602+0000","last_active":"2023-07-20T11:24:26.549535+0000","last_peered":"2023-07-20T11:24:26.549535+0000","last_clean":"2023-07-20T11:24:26.549535+0000","last_became_active":"2023-07-20T11:24:23.679310+0000","last_became_peered":"2023-07-20T11:24:23.679310+0000","last_unstale":"2023-07-20T11:24:26.549535+0000","last_undegraded":"2023-07-20T11:24:26.549535+0000","last_fullsized":"2023-07-20T11:24:26.549535+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:53:22.184259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550897+0000","last_change":"2023-07-20T11:24:24.691099+0000","last_active":"2023-07-20T11:24:26.550897+0000","last_peered":"2023-07-20T11:24:26.550897+0000","last_clean":"2023-07-20T11:24:26.550897+0000","last_became_active":"2023-07-20T11:24:24.689393+0000","last_became_peered":"2023-07-20T11:24:24.689393+0000","last_unstale":"2023-07-20T11:24:26.550897+0000","last_undegraded":"2023-07-20T11:24:26.550897+0000","last_fullsized":"2023-07-20T11:24:26.550897+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:50.532811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663614+0000","last_change":"2023-07-20T11:24:23.675579+0000","last_active":"2023-07-20T11:24:25.663614+0000","last_peered":"2023-07-20T11:24:25.663614+0000","last_clean":"2023-07-20T11:24:25.663614+0000","last_became_active":"2023-07-20T11:24:23.675314+0000","last_became_peered":"2023-07-20T11:24:23.675314+0000","last_unstale":"2023-07-20T11:24:25.663614+0000","last_undegraded":"2023-07-20T11:24:25.663614+0000","last_fullsized":"2023-07-20T11:24:25.663614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:41.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549614+0000","last_change":"2023-07-20T11:24:24.688015+0000","last_active":"2023-07-20T11:24:26.549614+0000","last_peered":"2023-07-20T11:24:26.549614+0000","last_clean":"2023-07-20T11:24:26.549614+0000","last_became_active":"2023-07-20T11:24:24.687722+0000","last_became_peered":"2023-07-20T11:24:24.687722+0000","last_unstale":"2023-07-20T11:24:26.549614+0000","last_undegraded":"2023-07-20T11:24:26.549614+0000","last_fullsized":"2023-07-20T11:24:26.549614+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:02:04.587487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550519+0000","last_change":"2023-07-20T11:24:23.678783+0000","last_active":"2023-07-20T11:24:26.550519+0000","last_peered":"2023-07-20T11:24:26.550519+0000","last_clean":"2023-07-20T11:24:26.550519+0000","last_became_active":"2023-07-20T11:24:23.678465+0000","last_became_peered":"2023-07-20T11:24:23.678465+0000","last_unstale":"2023-07-20T11:24:26.550519+0000","last_undegraded":"2023-07-20T11:24:26.550519+0000","last_fullsized":"2023-07-20T11:24:26.550519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:37:54.623714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550280+0000","last_change":"2023-07-20T11:24:24.687465+0000","last_active":"2023-07-20T11:24:26.550280+0000","last_peered":"2023-07-20T11:24:26.550280+0000","last_clean":"2023-07-20T11:24:26.550280+0000","last_became_active":"2023-07-20T11:24:24.687197+0000","last_became_peered":"2023-07-20T11:24:24.687197+0000","last_unstale":"2023-07-20T11:24:26.550280+0000","last_undegraded":"2023-07-20T11:24:26.550280+0000","last_fullsized":"2023-07-20T11:24:26.550280+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550040+0000","last_change":"2023-07-20T11:24:23.681969+0000","last_active":"2023-07-20T11:24:26.550040+0000","last_peered":"2023-07-20T11:24:26.550040+0000","last_clean":"2023-07-20T11:24:26.550040+0000","last_became_active":"2023-07-20T11:24:23.681678+0000","last_became_peered":"2023-07-20T11:24:23.681678+0000","last_unstale":"2023-07-20T11:24:26.550040+0000","last_undegraded":"2023-07-20T11:24:26.550040+0000","last_fullsized":"2023-07-20T11:24:26.550040+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:56.853334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"194'326","reported_seq":1272,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549792+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:26.549792+0000","last_peered":"2023-07-20T11:24:26.549792+0000","last_clean":"2023-07-20T11:24:26.549792+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:26.549792+0000","last_undegraded":"2023-07-20T11:24:26.549792+0000","last_fullsized":"2023-07-20T11:24:26.549792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:49.439259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666119+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:25.666119+0000","last_peered":"2023-07-20T11:24:25.666119+0000","last_clean":"2023-07-20T11:24:25.666119+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:25.666119+0000","last_undegraded":"2023-07-20T11:24:25.666119+0000","last_fullsized":"2023-07-20T11:24:25.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:12:16.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665246+0000","last_change":"2023-07-20T11:24:24.687337+0000","last_active":"2023-07-20T11:24:25.665246+0000","last_peered":"2023-07-20T11:24:25.665246+0000","last_clean":"2023-07-20T11:24:25.665246+0000","last_became_active":"2023-07-20T11:24:24.685330+0000","last_became_peered":"2023-07-20T11:24:24.685330+0000","last_unstale":"2023-07-20T11:24:25.665246+0000","last_undegraded":"2023-07-20T11:24:25.665246+0000","last_fullsized":"2023-07-20T11:24:25.665246+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:04:22.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550688+0000","last_change":"2023-07-20T11:24:23.679447+0000","last_active":"2023-07-20T11:24:26.550688+0000","last_peered":"2023-07-20T11:24:26.550688+0000","last_clean":"2023-07-20T11:24:26.550688+0000","last_became_active":"2023-07-20T11:24:23.678259+0000","last_became_peered":"2023-07-20T11:24:23.678259+0000","last_unstale":"2023-07-20T11:24:26.550688+0000","last_undegraded":"2023-07-20T11:24:26.550688+0000","last_fullsized":"2023-07-20T11:24:26.550688+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:19.361518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":375,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549673+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:26.549673+0000","last_peered":"2023-07-20T11:24:26.549673+0000","last_clean":"2023-07-20T11:24:26.549673+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:26.549673+0000","last_undegraded":"2023-07-20T11:24:26.549673+0000","last_fullsized":"2023-07-20T11:24:26.549673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551298+0000","last_change":"2023-07-20T11:24:24.683416+0000","last_active":"2023-07-20T11:24:26.551298+0000","last_peered":"2023-07-20T11:24:26.551298+0000","last_clean":"2023-07-20T11:24:26.551298+0000","last_became_active":"2023-07-20T11:24:24.683150+0000","last_became_peered":"2023-07-20T11:24:24.683150+0000","last_unstale":"2023-07-20T11:24:26.551298+0000","last_undegraded":"2023-07-20T11:24:26.551298+0000","last_fullsized":"2023-07-20T11:24:26.551298+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:21.715673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551144+0000","last_change":"2023-07-20T11:24:23.682226+0000","last_active":"2023-07-20T11:24:26.551144+0000","last_peered":"2023-07-20T11:24:26.551144+0000","last_clean":"2023-07-20T11:24:26.551144+0000","last_became_active":"2023-07-20T11:24:23.681964+0000","last_became_peered":"2023-07-20T11:24:23.681964+0000","last_unstale":"2023-07-20T11:24:26.551144+0000","last_undegraded":"2023-07-20T11:24:26.551144+0000","last_fullsized":"2023-07-20T11:24:26.551144+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:15:39.274313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":408,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:11.628924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551185+0000","last_change":"2023-07-20T11:24:24.682604+0000","last_active":"2023-07-20T11:24:26.551185+0000","last_peered":"2023-07-20T11:24:26.551185+0000","last_clean":"2023-07-20T11:24:26.551185+0000","last_became_active":"2023-07-20T11:24:24.682343+0000","last_became_peered":"2023-07-20T11:24:24.682343+0000","last_unstale":"2023-07-20T11:24:26.551185+0000","last_undegraded":"2023-07-20T11:24:26.551185+0000","last_fullsized":"2023-07-20T11:24:26.551185+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:16:44.604561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664908+0000","last_change":"2023-07-20T11:24:23.678437+0000","last_active":"2023-07-20T11:24:25.664908+0000","last_peered":"2023-07-20T11:24:25.664908+0000","last_clean":"2023-07-20T11:24:25.664908+0000","last_became_active":"2023-07-20T11:24:23.678016+0000","last_became_peered":"2023-07-20T11:24:23.678016+0000","last_unstale":"2023-07-20T11:24:25.664908+0000","last_undegraded":"2023-07-20T11:24:25.664908+0000","last_fullsized":"2023-07-20T11:24:25.664908+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:42:42.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665908+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:25.665908+0000","last_peered":"2023-07-20T11:24:25.665908+0000","last_clean":"2023-07-20T11:24:25.665908+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:25.665908+0000","last_undegraded":"2023-07-20T11:24:25.665908+0000","last_fullsized":"2023-07-20T11:24:25.665908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:10:47.734389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549945+0000","last_change":"2023-07-20T11:24:24.683206+0000","last_active":"2023-07-20T11:24:26.549945+0000","last_peered":"2023-07-20T11:24:26.549945+0000","last_clean":"2023-07-20T11:24:26.549945+0000","last_became_active":"2023-07-20T11:24:24.682058+0000","last_became_peered":"2023-07-20T11:24:24.682058+0000","last_unstale":"2023-07-20T11:24:26.549945+0000","last_undegraded":"2023-07-20T11:24:26.549945+0000","last_fullsized":"2023-07-20T11:24:26.549945+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:18:53.350029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"204'4","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550862+0000","last_change":"2023-07-20T11:24:23.683299+0000","last_active":"2023-07-20T11:24:26.550862+0000","last_peered":"2023-07-20T11:24:26.550862+0000","last_clean":"2023-07-20T11:24:26.550862+0000","last_became_active":"2023-07-20T11:24:23.682434+0000","last_became_peered":"2023-07-20T11:24:23.682434+0000","last_unstale":"2023-07-20T11:24:26.550862+0000","last_undegraded":"2023-07-20T11:24:26.550862+0000","last_fullsized":"2023-07-20T11:24:26.550862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:47.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551530+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:26.551530+0000","last_peered":"2023-07-20T11:24:26.551530+0000","last_clean":"2023-07-20T11:24:26.551530+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:26.551530+0000","last_undegraded":"2023-07-20T11:24:26.551530+0000","last_fullsized":"2023-07-20T11:24:26.551530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:34.968590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663970+0000","last_change":"2023-07-20T11:24:24.690766+0000","last_active":"2023-07-20T11:24:25.663970+0000","last_peered":"2023-07-20T11:24:25.663970+0000","last_clean":"2023-07-20T11:24:25.663970+0000","last_became_active":"2023-07-20T11:24:24.690469+0000","last_became_peered":"2023-07-20T11:24:24.690469+0000","last_unstale":"2023-07-20T11:24:25.663970+0000","last_undegraded":"2023-07-20T11:24:25.663970+0000","last_fullsized":"2023-07-20T11:24:25.663970+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:47.324264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550515+0000","last_change":"2023-07-20T11:24:23.674048+0000","last_active":"2023-07-20T11:24:26.550515+0000","last_peered":"2023-07-20T11:24:26.550515+0000","last_clean":"2023-07-20T11:24:26.550515+0000","last_became_active":"2023-07-20T11:24:23.673205+0000","last_became_peered":"2023-07-20T11:24:23.673205+0000","last_unstale":"2023-07-20T11:24:26.550515+0000","last_undegraded":"2023-07-20T11:24:26.550515+0000","last_fullsized":"2023-07-20T11:24:26.550515+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:05:26.277401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:42:57.236342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:24.690407+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:24.689582+0000","last_became_peered":"2023-07-20T11:24:24.689582+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:47:43.635897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666311+0000","last_change":"2023-07-20T11:24:23.675940+0000","last_active":"2023-07-20T11:24:25.666311+0000","last_peered":"2023-07-20T11:24:25.666311+0000","last_clean":"2023-07-20T11:24:25.666311+0000","last_became_active":"2023-07-20T11:24:23.675669+0000","last_became_peered":"2023-07-20T11:24:23.675669+0000","last_unstale":"2023-07-20T11:24:25.666311+0000","last_undegraded":"2023-07-20T11:24:25.666311+0000","last_fullsized":"2023-07-20T11:24:25.666311+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:52:30.040768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":372,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551680+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:26.551680+0000","last_peered":"2023-07-20T11:24:26.551680+0000","last_clean":"2023-07-20T11:24:26.551680+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:26.551680+0000","last_undegraded":"2023-07-20T11:24:26.551680+0000","last_fullsized":"2023-07-20T11:24:26.551680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:51.396158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550486+0000","last_change":"2023-07-20T11:24:24.689801+0000","last_active":"2023-07-20T11:24:26.550486+0000","last_peered":"2023-07-20T11:24:26.550486+0000","last_clean":"2023-07-20T11:24:26.550486+0000","last_became_active":"2023-07-20T11:24:24.689522+0000","last_became_peered":"2023-07-20T11:24:24.689522+0000","last_unstale":"2023-07-20T11:24:26.550486+0000","last_undegraded":"2023-07-20T11:24:26.550486+0000","last_fullsized":"2023-07-20T11:24:26.550486+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:11.260814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665474+0000","last_change":"2023-07-20T11:24:23.681735+0000","last_active":"2023-07-20T11:24:25.665474+0000","last_peered":"2023-07-20T11:24:25.665474+0000","last_clean":"2023-07-20T11:24:25.665474+0000","last_became_active":"2023-07-20T11:24:23.681421+0000","last_became_peered":"2023-07-20T11:24:23.681421+0000","last_unstale":"2023-07-20T11:24:25.665474+0000","last_undegraded":"2023-07-20T11:24:25.665474+0000","last_fullsized":"2023-07-20T11:24:25.665474+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:10.253101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550575+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:26.550575+0000","last_peered":"2023-07-20T11:24:26.550575+0000","last_clean":"2023-07-20T11:24:26.550575+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:26.550575+0000","last_undegraded":"2023-07-20T11:24:26.550575+0000","last_fullsized":"2023-07-20T11:24:26.550575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:42:12.529596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52256,"kb_used_data":3088,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319584,"statfs":{"total":96636764160,"available":96583254016,"internally_reserved":0,"allocated":3162112,"data_stored":1909753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.88100000000000001,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.499},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":1.0409999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.081},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":1.012,"15min":1.0900000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.98499999999999999,"5min":1.012,"15min":1.0509999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.0349999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98599999999999999,"5min":1.026,"15min":1.03},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.97999999999999998,"5min":1.042,"15min":1.042},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.95499999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.95099999999999996,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41820,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330020,"statfs":{"total":96636764160,"available":96593940480,"internally_reserved":0,"allocated":2572288,"data_stored":1319455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":1}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":1.038}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":1.099}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":1.075},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59872,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311968,"statfs":{"total":96636764160,"available":96575455232,"internally_reserved":0,"allocated":2576384,"data_stored":1319545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59876,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311964,"statfs":{"total":96636764160,"available":96575451136,"internally_reserved":0,"allocated":2572288,"data_stored":1319967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.433}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.749},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2568192,"data_stored":1319385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48176,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323664,"statfs":{"total":96636764160,"available":96587431936,"internally_reserved":0,"allocated":3178496,"data_stored":1910481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.624},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:30.628 INFO:tasks.ceph.mds.c.smithi082.stderr:2023-07-20T11:24:30.632+0000 7fd86be6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:24:33.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:33.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.416+0000 7fc2b2340640 1 Processor -- start 2023-07-20T11:24:33.413 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 -- start start 2023-07-20T11:24:33.414 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac0ccd60 con 0x7fc2ac0cc900 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0ad600 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b2340640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0ad810 con 0x7fc2ac1596b0 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38338/0 (socket says 172.21.15.82:38338) 2023-07-20T11:24:33.415 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 -- 172.21.15.82:0/2993302154 learned_addr learned my addr 172.21.15.82:0/2993302154 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:33.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2abfff640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 -- 172.21.15.82:0/2993302154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 msgr2=0x7fc2ac15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:33.416 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 -- 172.21.15.82:0/2993302154 >> v1:172.21.15.183:6789/0 conn(0x7fc2ac0cc900 legacy=0x7fc2ac0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.417 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.420+0000 7fc2b08dd640 1 -- 172.21.15.82:0/2993302154 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac15d0d0 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b08dd640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009e50 tx=0x7fc2a401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4171981e4279e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2aaffd640 1 -- 172.21.15.82:0/2993302154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40a58a0 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.418 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2aaffd640 1 -- 172.21.15.82:0/2993302154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40a5a00 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.419 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2aaffd640 1 -- 172.21.15.82:0/2993302154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40a5d90 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 -- 172.21.15.82:0/2993302154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 msgr2=0x7fc2ac0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009e50 tx=0x7fc2a401c9e0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 -- 172.21.15.82:0/2993302154 shutdown_connections 2023-07-20T11:24:33.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac0ad0c0 unknown :-1 s=CLOSED pgs=2401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 --2- 172.21.15.82:0/2993302154 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 -- 172.21.15.82:0/2993302154 >> 172.21.15.82:0/2993302154 conn(0x7fc2ac0cada0 msgr2=0x7fc2ac0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:33.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 -- 172.21.15.82:0/2993302154 shutdown_connections 2023-07-20T11:24:33.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 -- 172.21.15.82:0/2993302154 wait complete. 2023-07-20T11:24:33.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.424+0000 7fc2b2340640 1 Processor -- start 2023-07-20T11:24:33.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- start start 2023-07-20T11:24:33.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2ac0cc900 0x7fc2ac162e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac0c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac099870 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1636d0 con 0x7fc2ac0cc900 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac1639b0 con 0x7fc2ac1596b0 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38346/0 (socket says 172.21.15.82:38346) 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 -- 172.21.15.82:0/356862692 learned_addr learned my addr 172.21.15.82:0/356862692 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2ab7fe640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2ac0cc900 0x7fc2ac162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b08dd640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac0c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 -- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 msgr2=0x7fc2ac0c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac0c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 -- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2ac0cc900 msgr2=0x7fc2ac162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2ac0cc900 0x7fc2ac162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 -- 172.21.15.82:0/356862692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009b30 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2abfff640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fc29c008620 tx=0x7fc29c008ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c010040 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c0163f0 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac163c90 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c009ea0 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac0c2390 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.428+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac073c70 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.432+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc29c016780 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.432+0000 7fc2a8ff9640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 0x7fc298068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.432+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fc29c084090 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.432+0000 7fc2ab7fe640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 0x7fc298068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.432+0000 7fc2ab7fe640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 0x7fc298068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac1f7fa0 tx=0x7fc2a0009040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.436+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc29c0512b0 con 0x7fc2ac0b2a90 2023-07-20T11:24:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.584+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2ac099610 con 0x7fc2980663a0 2023-07-20T11:24:33.587 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.592+0000 7fc2a8ff9640 1 -- 172.21.15.82:0/356862692 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311823 (secure 0 0 0) 0x7fc2a00014f0 con 0x7fc2980663a0 2023-07-20T11:24:33.589 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:33.591 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 msgr2=0x7fc298068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 0x7fc298068860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac1f7fa0 tx=0x7fc2a0009040 comp rx=0 tx=0).stop 2023-07-20T11:24:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 msgr2=0x7fc2ac098fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7fc29c008620 tx=0x7fc29c008ae0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.592 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 shutdown_connections 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc2980663a0 0x7fc298068860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc2ac1596b0 0x7fc2ac0c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc2ac0cc900 0x7fc2ac162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 --2- 172.21.15.82:0/356862692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2ac0b2a90 0x7fc2ac098fe0 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 >> 172.21.15.82:0/356862692 conn(0x7fc2ac0cada0 msgr2=0x7fc2ac0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 shutdown_connections 2023-07-20T11:24:33.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.596+0000 7fc2b2340640 1 -- 172.21.15.82:0/356862692 wait complete. 2023-07-20T11:24:33.610 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-20T11:24:33.468427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419488,"kb_used_data":21288,"kb_used_omap":13,"kb_used_meta":398066,"kb_avail":754555232,"statfs":{"total":773094113280,"available":772664557568,"internally_reserved":0,"allocated":21798912,"data_stored":11740540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":407619672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.808392"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551725+0000","last_change":"2023-07-20T11:24:24.689522+0000","last_active":"2023-07-20T11:24:26.551725+0000","last_peered":"2023-07-20T11:24:26.551725+0000","last_clean":"2023-07-20T11:24:26.551725+0000","last_became_active":"2023-07-20T11:24:24.689205+0000","last_became_peered":"2023-07-20T11:24:24.689205+0000","last_unstale":"2023-07-20T11:24:26.551725+0000","last_undegraded":"2023-07-20T11:24:26.551725+0000","last_fullsized":"2023-07-20T11:24:26.551725+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:17.113569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551583+0000","last_change":"2023-07-20T11:24:24.684078+0000","last_active":"2023-07-20T11:24:26.551583+0000","last_peered":"2023-07-20T11:24:26.551583+0000","last_clean":"2023-07-20T11:24:26.551583+0000","last_became_active":"2023-07-20T11:24:24.683809+0000","last_became_peered":"2023-07-20T11:24:24.683809+0000","last_unstale":"2023-07-20T11:24:26.551583+0000","last_undegraded":"2023-07-20T11:24:26.551583+0000","last_fullsized":"2023-07-20T11:24:26.551583+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:50:10.947864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550342+0000","last_change":"2023-07-20T11:24:24.685040+0000","last_active":"2023-07-20T11:24:26.550342+0000","last_peered":"2023-07-20T11:24:26.550342+0000","last_clean":"2023-07-20T11:24:26.550342+0000","last_became_active":"2023-07-20T11:24:24.684761+0000","last_became_peered":"2023-07-20T11:24:24.684761+0000","last_unstale":"2023-07-20T11:24:26.550342+0000","last_undegraded":"2023-07-20T11:24:26.550342+0000","last_fullsized":"2023-07-20T11:24:26.550342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:04.326648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550487+0000","last_change":"2023-07-20T11:24:24.678905+0000","last_active":"2023-07-20T11:24:26.550487+0000","last_peered":"2023-07-20T11:24:26.550487+0000","last_clean":"2023-07-20T11:24:26.550487+0000","last_became_active":"2023-07-20T11:24:24.678468+0000","last_became_peered":"2023-07-20T11:24:24.678468+0000","last_unstale":"2023-07-20T11:24:26.550487+0000","last_undegraded":"2023-07-20T11:24:26.550487+0000","last_fullsized":"2023-07-20T11:24:26.550487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:56:03.435696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550459+0000","last_change":"2023-07-20T11:24:24.677166+0000","last_active":"2023-07-20T11:24:26.550459+0000","last_peered":"2023-07-20T11:24:26.550459+0000","last_clean":"2023-07-20T11:24:26.550459+0000","last_became_active":"2023-07-20T11:24:24.675153+0000","last_became_peered":"2023-07-20T11:24:24.675153+0000","last_unstale":"2023-07-20T11:24:26.550459+0000","last_undegraded":"2023-07-20T11:24:26.550459+0000","last_fullsized":"2023-07-20T11:24:26.550459+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:18.202507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549862+0000","last_change":"2023-07-20T11:24:24.687155+0000","last_active":"2023-07-20T11:24:26.549862+0000","last_peered":"2023-07-20T11:24:26.549862+0000","last_clean":"2023-07-20T11:24:26.549862+0000","last_became_active":"2023-07-20T11:24:24.686804+0000","last_became_peered":"2023-07-20T11:24:24.686804+0000","last_unstale":"2023-07-20T11:24:26.549862+0000","last_undegraded":"2023-07-20T11:24:26.549862+0000","last_fullsized":"2023-07-20T11:24:26.549862+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:53:58.430858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663522+0000","last_change":"2023-07-20T11:24:24.690701+0000","last_active":"2023-07-20T11:24:25.663522+0000","last_peered":"2023-07-20T11:24:25.663522+0000","last_clean":"2023-07-20T11:24:25.663522+0000","last_became_active":"2023-07-20T11:24:24.690389+0000","last_became_peered":"2023-07-20T11:24:24.690389+0000","last_unstale":"2023-07-20T11:24:25.663522+0000","last_undegraded":"2023-07-20T11:24:25.663522+0000","last_fullsized":"2023-07-20T11:24:25.663522+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:58:29.712784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549667+0000","last_change":"2023-07-20T11:24:24.683027+0000","last_active":"2023-07-20T11:24:26.549667+0000","last_peered":"2023-07-20T11:24:26.549667+0000","last_clean":"2023-07-20T11:24:26.549667+0000","last_became_active":"2023-07-20T11:24:24.682730+0000","last_became_peered":"2023-07-20T11:24:24.682730+0000","last_unstale":"2023-07-20T11:24:26.549667+0000","last_undegraded":"2023-07-20T11:24:26.549667+0000","last_fullsized":"2023-07-20T11:24:26.549667+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:38:09.177683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551773+0000","last_change":"2023-07-20T11:24:24.692353+0000","last_active":"2023-07-20T11:24:26.551773+0000","last_peered":"2023-07-20T11:24:26.551773+0000","last_clean":"2023-07-20T11:24:26.551773+0000","last_became_active":"2023-07-20T11:24:24.692085+0000","last_became_peered":"2023-07-20T11:24:24.692085+0000","last_unstale":"2023-07-20T11:24:26.551773+0000","last_undegraded":"2023-07-20T11:24:26.551773+0000","last_fullsized":"2023-07-20T11:24:26.551773+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:10:21.058797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550398+0000","last_change":"2023-07-20T11:24:24.678931+0000","last_active":"2023-07-20T11:24:26.550398+0000","last_peered":"2023-07-20T11:24:26.550398+0000","last_clean":"2023-07-20T11:24:26.550398+0000","last_became_active":"2023-07-20T11:24:24.678641+0000","last_became_peered":"2023-07-20T11:24:24.678641+0000","last_unstale":"2023-07-20T11:24:26.550398+0000","last_undegraded":"2023-07-20T11:24:26.550398+0000","last_fullsized":"2023-07-20T11:24:26.550398+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:44:25.431348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666338+0000","last_change":"2023-07-20T11:24:24.679563+0000","last_active":"2023-07-20T11:24:25.666338+0000","last_peered":"2023-07-20T11:24:25.666338+0000","last_clean":"2023-07-20T11:24:25.666338+0000","last_became_active":"2023-07-20T11:24:24.679297+0000","last_became_peered":"2023-07-20T11:24:24.679297+0000","last_unstale":"2023-07-20T11:24:25.666338+0000","last_undegraded":"2023-07-20T11:24:25.666338+0000","last_fullsized":"2023-07-20T11:24:25.666338+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:00:25.320977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550612+0000","last_change":"2023-07-20T11:24:24.685142+0000","last_active":"2023-07-20T11:24:26.550612+0000","last_peered":"2023-07-20T11:24:26.550612+0000","last_clean":"2023-07-20T11:24:26.550612+0000","last_became_active":"2023-07-20T11:24:24.684811+0000","last_became_peered":"2023-07-20T11:24:24.684811+0000","last_unstale":"2023-07-20T11:24:26.550612+0000","last_undegraded":"2023-07-20T11:24:26.550612+0000","last_fullsized":"2023-07-20T11:24:26.550612+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:26:32.326580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664988+0000","last_change":"2023-07-20T11:24:24.679784+0000","last_active":"2023-07-20T11:24:25.664988+0000","last_peered":"2023-07-20T11:24:25.664988+0000","last_clean":"2023-07-20T11:24:25.664988+0000","last_became_active":"2023-07-20T11:24:24.679493+0000","last_became_peered":"2023-07-20T11:24:24.679493+0000","last_unstale":"2023-07-20T11:24:25.664988+0000","last_undegraded":"2023-07-20T11:24:25.664988+0000","last_fullsized":"2023-07-20T11:24:25.664988+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:54:02.838449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663625+0000","last_change":"2023-07-20T11:24:24.680757+0000","last_active":"2023-07-20T11:24:25.663625+0000","last_peered":"2023-07-20T11:24:25.663625+0000","last_clean":"2023-07-20T11:24:25.663625+0000","last_became_active":"2023-07-20T11:24:24.680458+0000","last_became_peered":"2023-07-20T11:24:24.680458+0000","last_unstale":"2023-07-20T11:24:25.663625+0000","last_undegraded":"2023-07-20T11:24:25.663625+0000","last_fullsized":"2023-07-20T11:24:25.663625+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:41:11.698388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551139+0000","last_change":"2023-07-20T11:24:24.682062+0000","last_active":"2023-07-20T11:24:26.551139+0000","last_peered":"2023-07-20T11:24:26.551139+0000","last_clean":"2023-07-20T11:24:26.551139+0000","last_became_active":"2023-07-20T11:24:24.681763+0000","last_became_peered":"2023-07-20T11:24:24.681763+0000","last_unstale":"2023-07-20T11:24:26.551139+0000","last_undegraded":"2023-07-20T11:24:26.551139+0000","last_fullsized":"2023-07-20T11:24:26.551139+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:53:07.320581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549640+0000","last_change":"2023-07-20T11:24:24.677393+0000","last_active":"2023-07-20T11:24:26.549640+0000","last_peered":"2023-07-20T11:24:26.549640+0000","last_clean":"2023-07-20T11:24:26.549640+0000","last_became_active":"2023-07-20T11:24:24.676507+0000","last_became_peered":"2023-07-20T11:24:24.676507+0000","last_unstale":"2023-07-20T11:24:26.549640+0000","last_undegraded":"2023-07-20T11:24:26.549640+0000","last_fullsized":"2023-07-20T11:24:26.549640+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:22:34.109165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550959+0000","last_change":"2023-07-20T11:24:24.696028+0000","last_active":"2023-07-20T11:24:26.550959+0000","last_peered":"2023-07-20T11:24:26.550959+0000","last_clean":"2023-07-20T11:24:26.550959+0000","last_became_active":"2023-07-20T11:24:24.695666+0000","last_became_peered":"2023-07-20T11:24:24.695666+0000","last_unstale":"2023-07-20T11:24:26.550959+0000","last_undegraded":"2023-07-20T11:24:26.550959+0000","last_fullsized":"2023-07-20T11:24:26.550959+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:22:20.608126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665342+0000","last_change":"2023-07-20T11:24:24.690175+0000","last_active":"2023-07-20T11:24:25.665342+0000","last_peered":"2023-07-20T11:24:25.665342+0000","last_clean":"2023-07-20T11:24:25.665342+0000","last_became_active":"2023-07-20T11:24:24.689893+0000","last_became_peered":"2023-07-20T11:24:24.689893+0000","last_unstale":"2023-07-20T11:24:25.665342+0000","last_undegraded":"2023-07-20T11:24:25.665342+0000","last_fullsized":"2023-07-20T11:24:25.665342+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665218+0000","last_change":"2023-07-20T11:24:24.685691+0000","last_active":"2023-07-20T11:24:25.665218+0000","last_peered":"2023-07-20T11:24:25.665218+0000","last_clean":"2023-07-20T11:24:25.665218+0000","last_became_active":"2023-07-20T11:24:24.685389+0000","last_became_peered":"2023-07-20T11:24:24.685389+0000","last_unstale":"2023-07-20T11:24:25.665218+0000","last_undegraded":"2023-07-20T11:24:25.665218+0000","last_fullsized":"2023-07-20T11:24:25.665218+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:36:58.929732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549998+0000","last_change":"2023-07-20T11:24:24.684881+0000","last_active":"2023-07-20T11:24:26.549998+0000","last_peered":"2023-07-20T11:24:26.549998+0000","last_clean":"2023-07-20T11:24:26.549998+0000","last_became_active":"2023-07-20T11:24:24.684558+0000","last_became_peered":"2023-07-20T11:24:24.684558+0000","last_unstale":"2023-07-20T11:24:26.549998+0000","last_undegraded":"2023-07-20T11:24:26.549998+0000","last_fullsized":"2023-07-20T11:24:26.549998+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:08:34.276396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551646+0000","last_change":"2023-07-20T11:24:24.691409+0000","last_active":"2023-07-20T11:24:26.551646+0000","last_peered":"2023-07-20T11:24:26.551646+0000","last_clean":"2023-07-20T11:24:26.551646+0000","last_became_active":"2023-07-20T11:24:24.691130+0000","last_became_peered":"2023-07-20T11:24:24.691130+0000","last_unstale":"2023-07-20T11:24:26.551646+0000","last_undegraded":"2023-07-20T11:24:26.551646+0000","last_fullsized":"2023-07-20T11:24:26.551646+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:14:02.682087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550753+0000","last_change":"2023-07-20T11:24:24.691664+0000","last_active":"2023-07-20T11:24:26.550753+0000","last_peered":"2023-07-20T11:24:26.550753+0000","last_clean":"2023-07-20T11:24:26.550753+0000","last_became_active":"2023-07-20T11:24:24.691398+0000","last_became_peered":"2023-07-20T11:24:24.691398+0000","last_unstale":"2023-07-20T11:24:26.550753+0000","last_undegraded":"2023-07-20T11:24:26.550753+0000","last_fullsized":"2023-07-20T11:24:26.550753+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:27:48.242546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T11:24:24.688159+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T11:24:24.687858+0000","last_became_peered":"2023-07-20T11:24:24.687858+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:48:02.615288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550966+0000","last_change":"2023-07-20T11:24:24.691106+0000","last_active":"2023-07-20T11:24:26.550966+0000","last_peered":"2023-07-20T11:24:26.550966+0000","last_clean":"2023-07-20T11:24:26.550966+0000","last_became_active":"2023-07-20T11:24:24.690615+0000","last_became_peered":"2023-07-20T11:24:24.690615+0000","last_unstale":"2023-07-20T11:24:26.550966+0000","last_undegraded":"2023-07-20T11:24:26.550966+0000","last_fullsized":"2023-07-20T11:24:26.550966+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:16:02.556859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663976+0000","last_change":"2023-07-20T11:24:24.685774+0000","last_active":"2023-07-20T11:24:25.663976+0000","last_peered":"2023-07-20T11:24:25.663976+0000","last_clean":"2023-07-20T11:24:25.663976+0000","last_became_active":"2023-07-20T11:24:24.685518+0000","last_became_peered":"2023-07-20T11:24:24.685518+0000","last_unstale":"2023-07-20T11:24:25.663976+0000","last_undegraded":"2023-07-20T11:24:25.663976+0000","last_fullsized":"2023-07-20T11:24:25.663976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:08:02.849698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666609+0000","last_change":"2023-07-20T11:24:24.674557+0000","last_active":"2023-07-20T11:24:25.666609+0000","last_peered":"2023-07-20T11:24:25.666609+0000","last_clean":"2023-07-20T11:24:25.666609+0000","last_became_active":"2023-07-20T11:24:24.674218+0000","last_became_peered":"2023-07-20T11:24:24.674218+0000","last_unstale":"2023-07-20T11:24:25.666609+0000","last_undegraded":"2023-07-20T11:24:25.666609+0000","last_fullsized":"2023-07-20T11:24:25.666609+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:14.436421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549917+0000","last_change":"2023-07-20T11:24:24.684646+0000","last_active":"2023-07-20T11:24:26.549917+0000","last_peered":"2023-07-20T11:24:26.549917+0000","last_clean":"2023-07-20T11:24:26.549917+0000","last_became_active":"2023-07-20T11:24:24.684313+0000","last_became_peered":"2023-07-20T11:24:24.684313+0000","last_unstale":"2023-07-20T11:24:26.549917+0000","last_undegraded":"2023-07-20T11:24:26.549917+0000","last_fullsized":"2023-07-20T11:24:26.549917+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:18:10.212519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550031+0000","last_change":"2023-07-20T11:24:24.675522+0000","last_active":"2023-07-20T11:24:26.550031+0000","last_peered":"2023-07-20T11:24:26.550031+0000","last_clean":"2023-07-20T11:24:26.550031+0000","last_became_active":"2023-07-20T11:24:24.675245+0000","last_became_peered":"2023-07-20T11:24:24.675245+0000","last_unstale":"2023-07-20T11:24:26.550031+0000","last_undegraded":"2023-07-20T11:24:26.550031+0000","last_fullsized":"2023-07-20T11:24:26.550031+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:41:19.900714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665958+0000","last_change":"2023-07-20T11:24:24.688000+0000","last_active":"2023-07-20T11:24:25.665958+0000","last_peered":"2023-07-20T11:24:25.665958+0000","last_clean":"2023-07-20T11:24:25.665958+0000","last_became_active":"2023-07-20T11:24:24.687676+0000","last_became_peered":"2023-07-20T11:24:24.687676+0000","last_unstale":"2023-07-20T11:24:25.665958+0000","last_undegraded":"2023-07-20T11:24:25.665958+0000","last_fullsized":"2023-07-20T11:24:25.665958+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:56:14.683745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665809+0000","last_change":"2023-07-20T11:24:24.684772+0000","last_active":"2023-07-20T11:24:25.665809+0000","last_peered":"2023-07-20T11:24:25.665809+0000","last_clean":"2023-07-20T11:24:25.665809+0000","last_became_active":"2023-07-20T11:24:24.684456+0000","last_became_peered":"2023-07-20T11:24:24.684456+0000","last_unstale":"2023-07-20T11:24:25.665809+0000","last_undegraded":"2023-07-20T11:24:25.665809+0000","last_fullsized":"2023-07-20T11:24:25.665809+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:15:55.517668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.680476+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.680169+0000","last_became_peered":"2023-07-20T11:24:24.680169+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:52:06.585577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549806+0000","last_change":"2023-07-20T11:24:24.678435+0000","last_active":"2023-07-20T11:24:26.549806+0000","last_peered":"2023-07-20T11:24:26.549806+0000","last_clean":"2023-07-20T11:24:26.549806+0000","last_became_active":"2023-07-20T11:24:24.678139+0000","last_became_peered":"2023-07-20T11:24:24.678139+0000","last_unstale":"2023-07-20T11:24:26.549806+0000","last_undegraded":"2023-07-20T11:24:26.549806+0000","last_fullsized":"2023-07-20T11:24:26.549806+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:49:47.719799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550226+0000","last_change":"2023-07-20T11:24:24.682755+0000","last_active":"2023-07-20T11:24:26.550226+0000","last_peered":"2023-07-20T11:24:26.550226+0000","last_clean":"2023-07-20T11:24:26.550226+0000","last_became_active":"2023-07-20T11:24:24.682425+0000","last_became_peered":"2023-07-20T11:24:24.682425+0000","last_unstale":"2023-07-20T11:24:26.550226+0000","last_undegraded":"2023-07-20T11:24:26.550226+0000","last_fullsized":"2023-07-20T11:24:26.550226+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:15:09.320170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551047+0000","last_change":"2023-07-20T11:24:23.684101+0000","last_active":"2023-07-20T11:24:26.551047+0000","last_peered":"2023-07-20T11:24:26.551047+0000","last_clean":"2023-07-20T11:24:26.551047+0000","last_became_active":"2023-07-20T11:24:23.683833+0000","last_became_peered":"2023-07-20T11:24:23.683833+0000","last_unstale":"2023-07-20T11:24:26.551047+0000","last_undegraded":"2023-07-20T11:24:26.551047+0000","last_fullsized":"2023-07-20T11:24:26.551047+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:01:34.520625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550204+0000","last_change":"2023-07-20T11:24:24.676219+0000","last_active":"2023-07-20T11:24:26.550204+0000","last_peered":"2023-07-20T11:24:26.550204+0000","last_clean":"2023-07-20T11:24:26.550204+0000","last_became_active":"2023-07-20T11:24:24.675907+0000","last_became_peered":"2023-07-20T11:24:24.675907+0000","last_unstale":"2023-07-20T11:24:26.550204+0000","last_undegraded":"2023-07-20T11:24:26.550204+0000","last_fullsized":"2023-07-20T11:24:26.550204+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:37.358044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551649+0000","last_change":"2023-07-20T11:24:23.679342+0000","last_active":"2023-07-20T11:24:26.551649+0000","last_peered":"2023-07-20T11:24:26.551649+0000","last_clean":"2023-07-20T11:24:26.551649+0000","last_became_active":"2023-07-20T11:24:23.679077+0000","last_became_peered":"2023-07-20T11:24:23.679077+0000","last_unstale":"2023-07-20T11:24:26.551649+0000","last_undegraded":"2023-07-20T11:24:26.551649+0000","last_fullsized":"2023-07-20T11:24:26.551649+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:46:04.199831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665431+0000","last_change":"2023-07-20T11:24:24.679405+0000","last_active":"2023-07-20T11:24:25.665431+0000","last_peered":"2023-07-20T11:24:25.665431+0000","last_clean":"2023-07-20T11:24:25.665431+0000","last_became_active":"2023-07-20T11:24:24.679049+0000","last_became_peered":"2023-07-20T11:24:24.679049+0000","last_unstale":"2023-07-20T11:24:25.665431+0000","last_undegraded":"2023-07-20T11:24:25.665431+0000","last_fullsized":"2023-07-20T11:24:25.665431+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:17.563561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"204'3","reported_seq":16,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550525+0000","last_change":"2023-07-20T11:24:23.682028+0000","last_active":"2023-07-20T11:24:26.550525+0000","last_peered":"2023-07-20T11:24:26.550525+0000","last_clean":"2023-07-20T11:24:26.550525+0000","last_became_active":"2023-07-20T11:24:23.681732+0000","last_became_peered":"2023-07-20T11:24:23.681732+0000","last_unstale":"2023-07-20T11:24:26.550525+0000","last_undegraded":"2023-07-20T11:24:26.550525+0000","last_fullsized":"2023-07-20T11:24:26.550525+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:05:43.776076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551815+0000","last_change":"2023-07-20T11:24:24.684877+0000","last_active":"2023-07-20T11:24:26.551815+0000","last_peered":"2023-07-20T11:24:26.551815+0000","last_clean":"2023-07-20T11:24:26.551815+0000","last_became_active":"2023-07-20T11:24:24.684555+0000","last_became_peered":"2023-07-20T11:24:24.684555+0000","last_unstale":"2023-07-20T11:24:26.551815+0000","last_undegraded":"2023-07-20T11:24:26.551815+0000","last_fullsized":"2023-07-20T11:24:26.551815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:13:44.684094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"204'6","reported_seq":19,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665477+0000","last_change":"2023-07-20T11:24:23.678045+0000","last_active":"2023-07-20T11:24:25.665477+0000","last_peered":"2023-07-20T11:24:25.665477+0000","last_clean":"2023-07-20T11:24:25.665477+0000","last_became_active":"2023-07-20T11:24:23.677672+0000","last_became_peered":"2023-07-20T11:24:23.677672+0000","last_unstale":"2023-07-20T11:24:25.665477+0000","last_undegraded":"2023-07-20T11:24:25.665477+0000","last_fullsized":"2023-07-20T11:24:25.665477+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:39:03.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663521+0000","last_change":"2023-07-20T11:24:24.682921+0000","last_active":"2023-07-20T11:24:25.663521+0000","last_peered":"2023-07-20T11:24:25.663521+0000","last_clean":"2023-07-20T11:24:25.663521+0000","last_became_active":"2023-07-20T11:24:24.682654+0000","last_became_peered":"2023-07-20T11:24:24.682654+0000","last_unstale":"2023-07-20T11:24:25.663521+0000","last_undegraded":"2023-07-20T11:24:25.663521+0000","last_fullsized":"2023-07-20T11:24:25.663521+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:58:23.125250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665109+0000","last_change":"2023-07-20T11:24:23.682866+0000","last_active":"2023-07-20T11:24:25.665109+0000","last_peered":"2023-07-20T11:24:25.665109+0000","last_clean":"2023-07-20T11:24:25.665109+0000","last_became_active":"2023-07-20T11:24:23.682498+0000","last_became_peered":"2023-07-20T11:24:23.682498+0000","last_unstale":"2023-07-20T11:24:25.665109+0000","last_undegraded":"2023-07-20T11:24:25.665109+0000","last_fullsized":"2023-07-20T11:24:25.665109+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:19:29.435926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549570+0000","last_change":"2023-07-20T11:24:24.680838+0000","last_active":"2023-07-20T11:24:26.549570+0000","last_peered":"2023-07-20T11:24:26.549570+0000","last_clean":"2023-07-20T11:24:26.549570+0000","last_became_active":"2023-07-20T11:24:24.679079+0000","last_became_peered":"2023-07-20T11:24:24.679079+0000","last_unstale":"2023-07-20T11:24:26.549570+0000","last_undegraded":"2023-07-20T11:24:26.549570+0000","last_fullsized":"2023-07-20T11:24:26.549570+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:07:08.710836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550990+0000","last_change":"2023-07-20T11:24:23.684218+0000","last_active":"2023-07-20T11:24:26.550990+0000","last_peered":"2023-07-20T11:24:26.550990+0000","last_clean":"2023-07-20T11:24:26.550990+0000","last_became_active":"2023-07-20T11:24:23.683931+0000","last_became_peered":"2023-07-20T11:24:23.683931+0000","last_unstale":"2023-07-20T11:24:26.550990+0000","last_undegraded":"2023-07-20T11:24:26.550990+0000","last_fullsized":"2023-07-20T11:24:26.550990+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:07:21.665674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665156+0000","last_change":"2023-07-20T11:24:24.678415+0000","last_active":"2023-07-20T11:24:25.665156+0000","last_peered":"2023-07-20T11:24:25.665156+0000","last_clean":"2023-07-20T11:24:25.665156+0000","last_became_active":"2023-07-20T11:24:24.677868+0000","last_became_peered":"2023-07-20T11:24:24.677868+0000","last_unstale":"2023-07-20T11:24:25.665156+0000","last_undegraded":"2023-07-20T11:24:25.665156+0000","last_fullsized":"2023-07-20T11:24:25.665156+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:21:45.774704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549780+0000","last_change":"2023-07-20T11:24:23.682204+0000","last_active":"2023-07-20T11:24:26.549780+0000","last_peered":"2023-07-20T11:24:26.549780+0000","last_clean":"2023-07-20T11:24:26.549780+0000","last_became_active":"2023-07-20T11:24:23.681404+0000","last_became_peered":"2023-07-20T11:24:23.681404+0000","last_unstale":"2023-07-20T11:24:26.549780+0000","last_undegraded":"2023-07-20T11:24:26.549780+0000","last_fullsized":"2023-07-20T11:24:26.549780+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:06:39.238103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665055+0000","last_change":"2023-07-20T11:24:24.687111+0000","last_active":"2023-07-20T11:24:25.665055+0000","last_peered":"2023-07-20T11:24:25.665055+0000","last_clean":"2023-07-20T11:24:25.665055+0000","last_became_active":"2023-07-20T11:24:24.686827+0000","last_became_peered":"2023-07-20T11:24:24.686827+0000","last_unstale":"2023-07-20T11:24:25.665055+0000","last_undegraded":"2023-07-20T11:24:25.665055+0000","last_fullsized":"2023-07-20T11:24:25.665055+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:02:59.453824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"204'8","reported_seq":21,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665839+0000","last_change":"2023-07-20T11:24:23.682481+0000","last_active":"2023-07-20T11:24:25.665839+0000","last_peered":"2023-07-20T11:24:25.665839+0000","last_clean":"2023-07-20T11:24:25.665839+0000","last_became_active":"2023-07-20T11:24:23.682201+0000","last_became_peered":"2023-07-20T11:24:23.682201+0000","last_unstale":"2023-07-20T11:24:25.665839+0000","last_undegraded":"2023-07-20T11:24:25.665839+0000","last_fullsized":"2023-07-20T11:24:25.665839+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:22:10.688723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663758+0000","last_change":"2023-07-20T11:24:24.688471+0000","last_active":"2023-07-20T11:24:25.663758+0000","last_peered":"2023-07-20T11:24:25.663758+0000","last_clean":"2023-07-20T11:24:25.663758+0000","last_became_active":"2023-07-20T11:24:24.687869+0000","last_became_peered":"2023-07-20T11:24:24.687869+0000","last_unstale":"2023-07-20T11:24:25.663758+0000","last_undegraded":"2023-07-20T11:24:25.663758+0000","last_fullsized":"2023-07-20T11:24:25.663758+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:09:51.468890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:23.683827+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:23.683531+0000","last_became_peered":"2023-07-20T11:24:23.683531+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:43:57.957596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550130+0000","last_change":"2023-07-20T11:24:24.678725+0000","last_active":"2023-07-20T11:24:26.550130+0000","last_peered":"2023-07-20T11:24:26.550130+0000","last_clean":"2023-07-20T11:24:26.550130+0000","last_became_active":"2023-07-20T11:24:24.678410+0000","last_became_peered":"2023-07-20T11:24:24.678410+0000","last_unstale":"2023-07-20T11:24:26.550130+0000","last_undegraded":"2023-07-20T11:24:26.550130+0000","last_fullsized":"2023-07-20T11:24:26.550130+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:08:17.906290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550667+0000","last_change":"2023-07-20T11:24:23.681794+0000","last_active":"2023-07-20T11:24:26.550667+0000","last_peered":"2023-07-20T11:24:26.550667+0000","last_clean":"2023-07-20T11:24:26.550667+0000","last_became_active":"2023-07-20T11:24:23.681483+0000","last_became_peered":"2023-07-20T11:24:23.681483+0000","last_unstale":"2023-07-20T11:24:26.550667+0000","last_undegraded":"2023-07-20T11:24:26.550667+0000","last_fullsized":"2023-07-20T11:24:26.550667+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:46:59.874775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666760+0000","last_change":"2023-07-20T11:24:24.669515+0000","last_active":"2023-07-20T11:24:25.666760+0000","last_peered":"2023-07-20T11:24:25.666760+0000","last_clean":"2023-07-20T11:24:25.666760+0000","last_became_active":"2023-07-20T11:24:24.669197+0000","last_became_peered":"2023-07-20T11:24:24.669197+0000","last_unstale":"2023-07-20T11:24:25.666760+0000","last_undegraded":"2023-07-20T11:24:25.666760+0000","last_fullsized":"2023-07-20T11:24:25.666760+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:22:02.077179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550465+0000","last_change":"2023-07-20T11:24:23.679691+0000","last_active":"2023-07-20T11:24:26.550465+0000","last_peered":"2023-07-20T11:24:26.550465+0000","last_clean":"2023-07-20T11:24:26.550465+0000","last_became_active":"2023-07-20T11:24:23.679363+0000","last_became_peered":"2023-07-20T11:24:23.679363+0000","last_unstale":"2023-07-20T11:24:26.550465+0000","last_undegraded":"2023-07-20T11:24:26.550465+0000","last_fullsized":"2023-07-20T11:24:26.550465+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:35:35.278711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551915+0000","last_change":"2023-07-20T11:24:24.688520+0000","last_active":"2023-07-20T11:24:26.551915+0000","last_peered":"2023-07-20T11:24:26.551915+0000","last_clean":"2023-07-20T11:24:26.551915+0000","last_became_active":"2023-07-20T11:24:24.688113+0000","last_became_peered":"2023-07-20T11:24:24.688113+0000","last_unstale":"2023-07-20T11:24:26.551915+0000","last_undegraded":"2023-07-20T11:24:26.551915+0000","last_fullsized":"2023-07-20T11:24:26.551915+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:21:08.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666325+0000","last_change":"2023-07-20T11:24:23.675157+0000","last_active":"2023-07-20T11:24:25.666325+0000","last_peered":"2023-07-20T11:24:25.666325+0000","last_clean":"2023-07-20T11:24:25.666325+0000","last_became_active":"2023-07-20T11:24:23.674851+0000","last_became_peered":"2023-07-20T11:24:23.674851+0000","last_unstale":"2023-07-20T11:24:25.666325+0000","last_undegraded":"2023-07-20T11:24:25.666325+0000","last_fullsized":"2023-07-20T11:24:25.666325+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:16:42.900052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551131+0000","last_change":"2023-07-20T11:24:24.690831+0000","last_active":"2023-07-20T11:24:26.551131+0000","last_peered":"2023-07-20T11:24:26.551131+0000","last_clean":"2023-07-20T11:24:26.551131+0000","last_became_active":"2023-07-20T11:24:24.689131+0000","last_became_peered":"2023-07-20T11:24:24.689131+0000","last_unstale":"2023-07-20T11:24:26.551131+0000","last_undegraded":"2023-07-20T11:24:26.551131+0000","last_fullsized":"2023-07-20T11:24:26.551131+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:14:59.067673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665256+0000","last_change":"2023-07-20T11:24:23.680375+0000","last_active":"2023-07-20T11:24:25.665256+0000","last_peered":"2023-07-20T11:24:25.665256+0000","last_clean":"2023-07-20T11:24:25.665256+0000","last_became_active":"2023-07-20T11:24:23.680085+0000","last_became_peered":"2023-07-20T11:24:23.680085+0000","last_unstale":"2023-07-20T11:24:25.665256+0000","last_undegraded":"2023-07-20T11:24:25.665256+0000","last_fullsized":"2023-07-20T11:24:25.665256+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:35.499388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549730+0000","last_change":"2023-07-20T11:24:24.678320+0000","last_active":"2023-07-20T11:24:26.549730+0000","last_peered":"2023-07-20T11:24:26.549730+0000","last_clean":"2023-07-20T11:24:26.549730+0000","last_became_active":"2023-07-20T11:24:24.678044+0000","last_became_peered":"2023-07-20T11:24:24.678044+0000","last_unstale":"2023-07-20T11:24:26.549730+0000","last_undegraded":"2023-07-20T11:24:26.549730+0000","last_fullsized":"2023-07-20T11:24:26.549730+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:09:51.064227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551265+0000","last_change":"2023-07-20T11:24:23.681837+0000","last_active":"2023-07-20T11:24:26.551265+0000","last_peered":"2023-07-20T11:24:26.551265+0000","last_clean":"2023-07-20T11:24:26.551265+0000","last_became_active":"2023-07-20T11:24:23.681564+0000","last_became_peered":"2023-07-20T11:24:23.681564+0000","last_unstale":"2023-07-20T11:24:26.551265+0000","last_undegraded":"2023-07-20T11:24:26.551265+0000","last_fullsized":"2023-07-20T11:24:26.551265+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:03:24.559465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549817+0000","last_change":"2023-07-20T11:24:24.675008+0000","last_active":"2023-07-20T11:24:26.549817+0000","last_peered":"2023-07-20T11:24:26.549817+0000","last_clean":"2023-07-20T11:24:26.549817+0000","last_became_active":"2023-07-20T11:24:24.674723+0000","last_became_peered":"2023-07-20T11:24:24.674723+0000","last_unstale":"2023-07-20T11:24:26.549817+0000","last_undegraded":"2023-07-20T11:24:26.549817+0000","last_fullsized":"2023-07-20T11:24:26.549817+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:34:49.947789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T11:24:23.673277+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T11:24:23.672993+0000","last_became_peered":"2023-07-20T11:24:23.672993+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:12:41.364472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550594+0000","last_change":"2023-07-20T11:24:24.678376+0000","last_active":"2023-07-20T11:24:26.550594+0000","last_peered":"2023-07-20T11:24:26.550594+0000","last_clean":"2023-07-20T11:24:26.550594+0000","last_became_active":"2023-07-20T11:24:24.678085+0000","last_became_peered":"2023-07-20T11:24:24.678085+0000","last_unstale":"2023-07-20T11:24:26.550594+0000","last_undegraded":"2023-07-20T11:24:26.550594+0000","last_fullsized":"2023-07-20T11:24:26.550594+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:57:32.700408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550287+0000","last_change":"2023-07-20T11:24:23.675360+0000","last_active":"2023-07-20T11:24:26.550287+0000","last_peered":"2023-07-20T11:24:26.550287+0000","last_clean":"2023-07-20T11:24:26.550287+0000","last_became_active":"2023-07-20T11:24:23.675055+0000","last_became_peered":"2023-07-20T11:24:23.675055+0000","last_unstale":"2023-07-20T11:24:26.550287+0000","last_undegraded":"2023-07-20T11:24:26.550287+0000","last_fullsized":"2023-07-20T11:24:26.550287+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:47:16.555849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663778+0000","last_change":"2023-07-20T11:24:24.678995+0000","last_active":"2023-07-20T11:24:25.663778+0000","last_peered":"2023-07-20T11:24:25.663778+0000","last_clean":"2023-07-20T11:24:25.663778+0000","last_became_active":"2023-07-20T11:24:24.678730+0000","last_became_peered":"2023-07-20T11:24:24.678730+0000","last_unstale":"2023-07-20T11:24:25.663778+0000","last_undegraded":"2023-07-20T11:24:25.663778+0000","last_fullsized":"2023-07-20T11:24:25.663778+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:09:01.086386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550998+0000","last_change":"2023-07-20T11:24:23.683335+0000","last_active":"2023-07-20T11:24:26.550998+0000","last_peered":"2023-07-20T11:24:26.550998+0000","last_clean":"2023-07-20T11:24:26.550998+0000","last_became_active":"2023-07-20T11:24:23.682337+0000","last_became_peered":"2023-07-20T11:24:23.682337+0000","last_unstale":"2023-07-20T11:24:26.550998+0000","last_undegraded":"2023-07-20T11:24:26.550998+0000","last_fullsized":"2023-07-20T11:24:26.550998+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:14:34.528225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551551+0000","last_change":"2023-07-20T11:24:24.688964+0000","last_active":"2023-07-20T11:24:26.551551+0000","last_peered":"2023-07-20T11:24:26.551551+0000","last_clean":"2023-07-20T11:24:26.551551+0000","last_became_active":"2023-07-20T11:24:24.688628+0000","last_became_peered":"2023-07-20T11:24:24.688628+0000","last_unstale":"2023-07-20T11:24:26.551551+0000","last_undegraded":"2023-07-20T11:24:26.551551+0000","last_fullsized":"2023-07-20T11:24:26.551551+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:38:18.334735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663878+0000","last_change":"2023-07-20T11:24:23.674114+0000","last_active":"2023-07-20T11:24:25.663878+0000","last_peered":"2023-07-20T11:24:25.663878+0000","last_clean":"2023-07-20T11:24:25.663878+0000","last_became_active":"2023-07-20T11:24:23.673839+0000","last_became_peered":"2023-07-20T11:24:23.673839+0000","last_unstale":"2023-07-20T11:24:25.663878+0000","last_undegraded":"2023-07-20T11:24:25.663878+0000","last_fullsized":"2023-07-20T11:24:25.663878+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:17:27.235588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550113+0000","last_change":"2023-07-20T11:24:24.691022+0000","last_active":"2023-07-20T11:24:26.550113+0000","last_peered":"2023-07-20T11:24:26.550113+0000","last_clean":"2023-07-20T11:24:26.550113+0000","last_became_active":"2023-07-20T11:24:24.690730+0000","last_became_peered":"2023-07-20T11:24:24.690730+0000","last_unstale":"2023-07-20T11:24:26.550113+0000","last_undegraded":"2023-07-20T11:24:26.550113+0000","last_fullsized":"2023-07-20T11:24:26.550113+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:28.000651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550244+0000","last_change":"2023-07-20T11:24:23.675815+0000","last_active":"2023-07-20T11:24:26.550244+0000","last_peered":"2023-07-20T11:24:26.550244+0000","last_clean":"2023-07-20T11:24:26.550244+0000","last_became_active":"2023-07-20T11:24:23.675439+0000","last_became_peered":"2023-07-20T11:24:23.675439+0000","last_unstale":"2023-07-20T11:24:26.550244+0000","last_undegraded":"2023-07-20T11:24:26.550244+0000","last_fullsized":"2023-07-20T11:24:26.550244+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:07:13.048858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664047+0000","last_change":"2023-07-20T11:24:24.682352+0000","last_active":"2023-07-20T11:24:25.664047+0000","last_peered":"2023-07-20T11:24:25.664047+0000","last_clean":"2023-07-20T11:24:25.664047+0000","last_became_active":"2023-07-20T11:24:24.682052+0000","last_became_peered":"2023-07-20T11:24:24.682052+0000","last_unstale":"2023-07-20T11:24:25.664047+0000","last_undegraded":"2023-07-20T11:24:25.664047+0000","last_fullsized":"2023-07-20T11:24:25.664047+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:58:09.802004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550128+0000","last_change":"2023-07-20T11:24:23.677464+0000","last_active":"2023-07-20T11:24:26.550128+0000","last_peered":"2023-07-20T11:24:26.550128+0000","last_clean":"2023-07-20T11:24:26.550128+0000","last_became_active":"2023-07-20T11:24:23.677216+0000","last_became_peered":"2023-07-20T11:24:23.677216+0000","last_unstale":"2023-07-20T11:24:26.550128+0000","last_undegraded":"2023-07-20T11:24:26.550128+0000","last_fullsized":"2023-07-20T11:24:26.550128+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:16:07.143521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550151+0000","last_change":"2023-07-20T11:24:24.679461+0000","last_active":"2023-07-20T11:24:26.550151+0000","last_peered":"2023-07-20T11:24:26.550151+0000","last_clean":"2023-07-20T11:24:26.550151+0000","last_became_active":"2023-07-20T11:24:24.679161+0000","last_became_peered":"2023-07-20T11:24:24.679161+0000","last_unstale":"2023-07-20T11:24:26.550151+0000","last_undegraded":"2023-07-20T11:24:26.550151+0000","last_fullsized":"2023-07-20T11:24:26.550151+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:53:36.507100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549641+0000","last_change":"2023-07-20T11:24:23.679636+0000","last_active":"2023-07-20T11:24:26.549641+0000","last_peered":"2023-07-20T11:24:26.549641+0000","last_clean":"2023-07-20T11:24:26.549641+0000","last_became_active":"2023-07-20T11:24:23.679349+0000","last_became_peered":"2023-07-20T11:24:23.679349+0000","last_unstale":"2023-07-20T11:24:26.549641+0000","last_undegraded":"2023-07-20T11:24:26.549641+0000","last_fullsized":"2023-07-20T11:24:26.549641+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:21:22.847113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664927+0000","last_change":"2023-07-20T11:24:24.694372+0000","last_active":"2023-07-20T11:24:25.664927+0000","last_peered":"2023-07-20T11:24:25.664927+0000","last_clean":"2023-07-20T11:24:25.664927+0000","last_became_active":"2023-07-20T11:24:24.694083+0000","last_became_peered":"2023-07-20T11:24:24.694083+0000","last_unstale":"2023-07-20T11:24:25.664927+0000","last_undegraded":"2023-07-20T11:24:25.664927+0000","last_fullsized":"2023-07-20T11:24:25.664927+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:30:08.308012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549535+0000","last_change":"2023-07-20T11:24:23.679602+0000","last_active":"2023-07-20T11:24:26.549535+0000","last_peered":"2023-07-20T11:24:26.549535+0000","last_clean":"2023-07-20T11:24:26.549535+0000","last_became_active":"2023-07-20T11:24:23.679310+0000","last_became_peered":"2023-07-20T11:24:23.679310+0000","last_unstale":"2023-07-20T11:24:26.549535+0000","last_undegraded":"2023-07-20T11:24:26.549535+0000","last_fullsized":"2023-07-20T11:24:26.549535+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:53:22.184259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550897+0000","last_change":"2023-07-20T11:24:24.691099+0000","last_active":"2023-07-20T11:24:26.550897+0000","last_peered":"2023-07-20T11:24:26.550897+0000","last_clean":"2023-07-20T11:24:26.550897+0000","last_became_active":"2023-07-20T11:24:24.689393+0000","last_became_peered":"2023-07-20T11:24:24.689393+0000","last_unstale":"2023-07-20T11:24:26.550897+0000","last_undegraded":"2023-07-20T11:24:26.550897+0000","last_fullsized":"2023-07-20T11:24:26.550897+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:35:50.532811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663614+0000","last_change":"2023-07-20T11:24:23.675579+0000","last_active":"2023-07-20T11:24:25.663614+0000","last_peered":"2023-07-20T11:24:25.663614+0000","last_clean":"2023-07-20T11:24:25.663614+0000","last_became_active":"2023-07-20T11:24:23.675314+0000","last_became_peered":"2023-07-20T11:24:23.675314+0000","last_unstale":"2023-07-20T11:24:25.663614+0000","last_undegraded":"2023-07-20T11:24:25.663614+0000","last_fullsized":"2023-07-20T11:24:25.663614+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:34:41.275418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549614+0000","last_change":"2023-07-20T11:24:24.688015+0000","last_active":"2023-07-20T11:24:26.549614+0000","last_peered":"2023-07-20T11:24:26.549614+0000","last_clean":"2023-07-20T11:24:26.549614+0000","last_became_active":"2023-07-20T11:24:24.687722+0000","last_became_peered":"2023-07-20T11:24:24.687722+0000","last_unstale":"2023-07-20T11:24:26.549614+0000","last_undegraded":"2023-07-20T11:24:26.549614+0000","last_fullsized":"2023-07-20T11:24:26.549614+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:02:04.587487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550519+0000","last_change":"2023-07-20T11:24:23.678783+0000","last_active":"2023-07-20T11:24:26.550519+0000","last_peered":"2023-07-20T11:24:26.550519+0000","last_clean":"2023-07-20T11:24:26.550519+0000","last_became_active":"2023-07-20T11:24:23.678465+0000","last_became_peered":"2023-07-20T11:24:23.678465+0000","last_unstale":"2023-07-20T11:24:26.550519+0000","last_undegraded":"2023-07-20T11:24:26.550519+0000","last_fullsized":"2023-07-20T11:24:26.550519+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:37:54.623714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550280+0000","last_change":"2023-07-20T11:24:24.687465+0000","last_active":"2023-07-20T11:24:26.550280+0000","last_peered":"2023-07-20T11:24:26.550280+0000","last_clean":"2023-07-20T11:24:26.550280+0000","last_became_active":"2023-07-20T11:24:24.687197+0000","last_became_peered":"2023-07-20T11:24:24.687197+0000","last_unstale":"2023-07-20T11:24:26.550280+0000","last_undegraded":"2023-07-20T11:24:26.550280+0000","last_fullsized":"2023-07-20T11:24:26.550280+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:38:33.823749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550040+0000","last_change":"2023-07-20T11:24:23.681969+0000","last_active":"2023-07-20T11:24:26.550040+0000","last_peered":"2023-07-20T11:24:26.550040+0000","last_clean":"2023-07-20T11:24:26.550040+0000","last_became_active":"2023-07-20T11:24:23.681678+0000","last_became_peered":"2023-07-20T11:24:23.681678+0000","last_unstale":"2023-07-20T11:24:26.550040+0000","last_undegraded":"2023-07-20T11:24:26.550040+0000","last_fullsized":"2023-07-20T11:24:26.550040+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:00:56.853334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"194'326","reported_seq":1272,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549792+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:26.549792+0000","last_peered":"2023-07-20T11:24:26.549792+0000","last_clean":"2023-07-20T11:24:26.549792+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:26.549792+0000","last_undegraded":"2023-07-20T11:24:26.549792+0000","last_fullsized":"2023-07-20T11:24:26.549792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:07:49.439259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666119+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:25.666119+0000","last_peered":"2023-07-20T11:24:25.666119+0000","last_clean":"2023-07-20T11:24:25.666119+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:25.666119+0000","last_undegraded":"2023-07-20T11:24:25.666119+0000","last_fullsized":"2023-07-20T11:24:25.666119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:12:16.632401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665246+0000","last_change":"2023-07-20T11:24:24.687337+0000","last_active":"2023-07-20T11:24:25.665246+0000","last_peered":"2023-07-20T11:24:25.665246+0000","last_clean":"2023-07-20T11:24:25.665246+0000","last_became_active":"2023-07-20T11:24:24.685330+0000","last_became_peered":"2023-07-20T11:24:24.685330+0000","last_unstale":"2023-07-20T11:24:25.665246+0000","last_undegraded":"2023-07-20T11:24:25.665246+0000","last_fullsized":"2023-07-20T11:24:25.665246+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:04:22.912815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550688+0000","last_change":"2023-07-20T11:24:23.679447+0000","last_active":"2023-07-20T11:24:26.550688+0000","last_peered":"2023-07-20T11:24:26.550688+0000","last_clean":"2023-07-20T11:24:26.550688+0000","last_became_active":"2023-07-20T11:24:23.678259+0000","last_became_peered":"2023-07-20T11:24:23.678259+0000","last_unstale":"2023-07-20T11:24:26.550688+0000","last_undegraded":"2023-07-20T11:24:26.550688+0000","last_fullsized":"2023-07-20T11:24:26.550688+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:33:19.361518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":375,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549673+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:26.549673+0000","last_peered":"2023-07-20T11:24:26.549673+0000","last_clean":"2023-07-20T11:24:26.549673+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:26.549673+0000","last_undegraded":"2023-07-20T11:24:26.549673+0000","last_fullsized":"2023-07-20T11:24:26.549673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551298+0000","last_change":"2023-07-20T11:24:24.683416+0000","last_active":"2023-07-20T11:24:26.551298+0000","last_peered":"2023-07-20T11:24:26.551298+0000","last_clean":"2023-07-20T11:24:26.551298+0000","last_became_active":"2023-07-20T11:24:24.683150+0000","last_became_peered":"2023-07-20T11:24:24.683150+0000","last_unstale":"2023-07-20T11:24:26.551298+0000","last_undegraded":"2023-07-20T11:24:26.551298+0000","last_fullsized":"2023-07-20T11:24:26.551298+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:48:21.715673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551144+0000","last_change":"2023-07-20T11:24:23.682226+0000","last_active":"2023-07-20T11:24:26.551144+0000","last_peered":"2023-07-20T11:24:26.551144+0000","last_clean":"2023-07-20T11:24:26.551144+0000","last_became_active":"2023-07-20T11:24:23.681964+0000","last_became_peered":"2023-07-20T11:24:23.681964+0000","last_unstale":"2023-07-20T11:24:26.551144+0000","last_undegraded":"2023-07-20T11:24:26.551144+0000","last_fullsized":"2023-07-20T11:24:26.551144+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T22:15:39.274313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":408,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663808+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:25.663808+0000","last_peered":"2023-07-20T11:24:25.663808+0000","last_clean":"2023-07-20T11:24:25.663808+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:25.663808+0000","last_undegraded":"2023-07-20T11:24:25.663808+0000","last_fullsized":"2023-07-20T11:24:25.663808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:49:11.628924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551185+0000","last_change":"2023-07-20T11:24:24.682604+0000","last_active":"2023-07-20T11:24:26.551185+0000","last_peered":"2023-07-20T11:24:26.551185+0000","last_clean":"2023-07-20T11:24:26.551185+0000","last_became_active":"2023-07-20T11:24:24.682343+0000","last_became_peered":"2023-07-20T11:24:24.682343+0000","last_unstale":"2023-07-20T11:24:26.551185+0000","last_undegraded":"2023-07-20T11:24:26.551185+0000","last_fullsized":"2023-07-20T11:24:26.551185+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:16:44.604561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.664908+0000","last_change":"2023-07-20T11:24:23.678437+0000","last_active":"2023-07-20T11:24:25.664908+0000","last_peered":"2023-07-20T11:24:25.664908+0000","last_clean":"2023-07-20T11:24:25.664908+0000","last_became_active":"2023-07-20T11:24:23.678016+0000","last_became_peered":"2023-07-20T11:24:23.678016+0000","last_unstale":"2023-07-20T11:24:25.664908+0000","last_undegraded":"2023-07-20T11:24:25.664908+0000","last_fullsized":"2023-07-20T11:24:25.664908+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:42:42.824183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":418,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665908+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:25.665908+0000","last_peered":"2023-07-20T11:24:25.665908+0000","last_clean":"2023-07-20T11:24:25.665908+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:25.665908+0000","last_undegraded":"2023-07-20T11:24:25.665908+0000","last_fullsized":"2023-07-20T11:24:25.665908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:10:47.734389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549945+0000","last_change":"2023-07-20T11:24:24.683206+0000","last_active":"2023-07-20T11:24:26.549945+0000","last_peered":"2023-07-20T11:24:26.549945+0000","last_clean":"2023-07-20T11:24:26.549945+0000","last_became_active":"2023-07-20T11:24:24.682058+0000","last_became_peered":"2023-07-20T11:24:24.682058+0000","last_unstale":"2023-07-20T11:24:26.549945+0000","last_undegraded":"2023-07-20T11:24:26.549945+0000","last_fullsized":"2023-07-20T11:24:26.549945+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:18:53.350029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"204'4","reported_seq":17,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550862+0000","last_change":"2023-07-20T11:24:23.683299+0000","last_active":"2023-07-20T11:24:26.550862+0000","last_peered":"2023-07-20T11:24:26.550862+0000","last_clean":"2023-07-20T11:24:26.550862+0000","last_became_active":"2023-07-20T11:24:23.682434+0000","last_became_peered":"2023-07-20T11:24:23.682434+0000","last_unstale":"2023-07-20T11:24:26.550862+0000","last_undegraded":"2023-07-20T11:24:26.550862+0000","last_fullsized":"2023-07-20T11:24:26.550862+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:55:47.617623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551530+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:26.551530+0000","last_peered":"2023-07-20T11:24:26.551530+0000","last_clean":"2023-07-20T11:24:26.551530+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:26.551530+0000","last_undegraded":"2023-07-20T11:24:26.551530+0000","last_fullsized":"2023-07-20T11:24:26.551530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:31:34.968590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.663970+0000","last_change":"2023-07-20T11:24:24.690766+0000","last_active":"2023-07-20T11:24:25.663970+0000","last_peered":"2023-07-20T11:24:25.663970+0000","last_clean":"2023-07-20T11:24:25.663970+0000","last_became_active":"2023-07-20T11:24:24.690469+0000","last_became_peered":"2023-07-20T11:24:24.690469+0000","last_unstale":"2023-07-20T11:24:25.663970+0000","last_undegraded":"2023-07-20T11:24:25.663970+0000","last_fullsized":"2023-07-20T11:24:25.663970+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:05:47.324264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"204'1","reported_seq":14,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550515+0000","last_change":"2023-07-20T11:24:23.674048+0000","last_active":"2023-07-20T11:24:26.550515+0000","last_peered":"2023-07-20T11:24:26.550515+0000","last_clean":"2023-07-20T11:24:26.550515+0000","last_became_active":"2023-07-20T11:24:23.673205+0000","last_became_peered":"2023-07-20T11:24:23.673205+0000","last_unstale":"2023-07-20T11:24:26.550515+0000","last_undegraded":"2023-07-20T11:24:26.550515+0000","last_fullsized":"2023-07-20T11:24:26.550515+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:05:26.277401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":373,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.549861+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:26.549861+0000","last_peered":"2023-07-20T11:24:26.549861+0000","last_clean":"2023-07-20T11:24:26.549861+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:26.549861+0000","last_undegraded":"2023-07-20T11:24:26.549861+0000","last_fullsized":"2023-07-20T11:24:26.549861+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:42:57.236342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666658+0000","last_change":"2023-07-20T11:24:24.690407+0000","last_active":"2023-07-20T11:24:25.666658+0000","last_peered":"2023-07-20T11:24:25.666658+0000","last_clean":"2023-07-20T11:24:25.666658+0000","last_became_active":"2023-07-20T11:24:24.689582+0000","last_became_peered":"2023-07-20T11:24:24.689582+0000","last_unstale":"2023-07-20T11:24:25.666658+0000","last_undegraded":"2023-07-20T11:24:25.666658+0000","last_fullsized":"2023-07-20T11:24:25.666658+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:47:43.635897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.666311+0000","last_change":"2023-07-20T11:24:23.675940+0000","last_active":"2023-07-20T11:24:25.666311+0000","last_peered":"2023-07-20T11:24:25.666311+0000","last_clean":"2023-07-20T11:24:25.666311+0000","last_became_active":"2023-07-20T11:24:23.675669+0000","last_became_peered":"2023-07-20T11:24:23.675669+0000","last_unstale":"2023-07-20T11:24:25.666311+0000","last_undegraded":"2023-07-20T11:24:25.666311+0000","last_fullsized":"2023-07-20T11:24:25.666311+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:52:30.040768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":372,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.551680+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:26.551680+0000","last_peered":"2023-07-20T11:24:26.551680+0000","last_clean":"2023-07-20T11:24:26.551680+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:26.551680+0000","last_undegraded":"2023-07-20T11:24:26.551680+0000","last_fullsized":"2023-07-20T11:24:26.551680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T16:32:51.396158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550486+0000","last_change":"2023-07-20T11:24:24.689801+0000","last_active":"2023-07-20T11:24:26.550486+0000","last_peered":"2023-07-20T11:24:26.550486+0000","last_clean":"2023-07-20T11:24:26.550486+0000","last_became_active":"2023-07-20T11:24:24.689522+0000","last_became_peered":"2023-07-20T11:24:24.689522+0000","last_unstale":"2023-07-20T11:24:26.550486+0000","last_undegraded":"2023-07-20T11:24:26.550486+0000","last_fullsized":"2023-07-20T11:24:26.550486+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:23.649322+0000","last_clean_scrub_stamp":"2023-07-20T11:24:23.649322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:11.260814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"204'2","reported_seq":15,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:25.665474+0000","last_change":"2023-07-20T11:24:23.681735+0000","last_active":"2023-07-20T11:24:25.665474+0000","last_peered":"2023-07-20T11:24:25.665474+0000","last_clean":"2023-07-20T11:24:25.665474+0000","last_became_active":"2023-07-20T11:24:23.681421+0000","last_became_peered":"2023-07-20T11:24:23.681421+0000","last_unstale":"2023-07-20T11:24:25.665474+0000","last_undegraded":"2023-07-20T11:24:25.665474+0000","last_fullsized":"2023-07-20T11:24:25.665474+0000","mapping_epoch":202,"log_start":"0'0","ondisk_log_start":"0'0","created":202,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:24:22.641610+0000","last_clean_scrub_stamp":"2023-07-20T11:24:22.641610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:23:10.253101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-07-20T11:24:26.550575+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:26.550575+0000","last_peered":"2023-07-20T11:24:26.550575+0000","last_clean":"2023-07-20T11:24:26.550575+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:26.550575+0000","last_undegraded":"2023-07-20T11:24:26.550575+0000","last_fullsized":"2023-07-20T11:24:26.550575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:42:12.529596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52256,"kb_used_data":3088,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319584,"statfs":{"total":96636764160,"available":96583254016,"internally_reserved":0,"allocated":3162112,"data_stored":1909753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.88100000000000001,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.499},{"interface":"front","average":{"1min":0.755,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96699999999999997,"5min":0.995,"15min":1.0409999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.94899999999999995,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.54100000000000004,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.081},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.71699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.93000000000000005,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.51700000000000002,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93700000000000006,"5min":1.012,"15min":1.0900000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.502,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.0409999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.76400000000000001,"15min":0.77700000000000002},"min":{"1min":0.54500000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.98499999999999999,"5min":1.012,"15min":1.0509999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.85399999999999998,"5min":1.006,"15min":1.0349999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68300000000000005},"min":{"1min":0.55300000000000005,"5min":0.5,"15min":0.28299999999999997},"max":{"1min":0.98599999999999999,"5min":1.026,"15min":1.03},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65200000000000002,"15min":0.63600000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.96899999999999997,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.97999999999999998,"5min":1.042,"15min":1.042},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jul 20 11:23:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.95499999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69699999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.33200000000000002},"max":{"1min":0.95099999999999996,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.94599999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41820,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94330020,"statfs":{"total":96636764160,"available":96593940480,"internally_reserved":0,"allocated":2572288,"data_stored":1319455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40237323},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.80700000000000005}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":1}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.82099999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":1.038}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.98099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.745}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59884,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311956,"statfs":{"total":96636764160,"available":96575442944,"internally_reserved":0,"allocated":2584576,"data_stored":1320983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":1.099}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.98999999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":1.075},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":1.0409999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59872,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311968,"statfs":{"total":96636764160,"available":96575455232,"internally_reserved":0,"allocated":2576384,"data_stored":1319545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.94099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.88700000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59876,"kb_used_data":2512,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311964,"statfs":{"total":96636764160,"available":96575451136,"internally_reserved":0,"allocated":2572288,"data_stored":1319967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.433}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.749},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.73499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37720,"kb_used_data":2508,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334120,"statfs":{"total":96636764160,"available":96598138880,"internally_reserved":0,"allocated":2568192,"data_stored":1319385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.438}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.81799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48176,"kb_used_data":3104,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323664,"statfs":{"total":96636764160,"available":96587431936,"internally_reserved":0,"allocated":3178496,"data_stored":1910481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.624},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:33.617 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-20T11:24:33.617 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-20T11:24:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 Processor -- start 2023-07-20T11:24:33.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 -- start start 2023-07-20T11:24:33.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5684158ce0 0x7f568415c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684069750 0x7f568406bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5684069bb0 0x7f568406c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56841590c0 con 0x7f5684158ce0 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56840c9610 con 0x7f5684069bb0 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f568bbe8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568415d670 con 0x7f5684069750 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5684158ce0 0x7f568415c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5684158ce0 0x7f568415c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38348/0 (socket says 172.21.15.82:38348) 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 -- 172.21.15.82:0/1228918186 learned_addr learned my addr 172.21.15.82:0/1228918186 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 -- 172.21.15.82:0/1228918186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684069750 msgr2=0x7f568406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:33.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 --2- 172.21.15.82:0/1228918186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684069750 0x7f568406bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 -- 172.21.15.82:0/1228918186 >> v2:172.21.15.183:3300/0 conn(0x7f5684069bb0 msgr2=0x7f568406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:33.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 --2- 172.21.15.82:0/1228918186 >> v2:172.21.15.183:3300/0 conn(0x7f5684069bb0 0x7f568406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.804+0000 7f5689984640 1 -- 172.21.15.82:0/1228918186 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568415d0b0 con 0x7f5684158ce0 2023-07-20T11:24:33.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f5689984640 1 --2- 172.21.15.82:0/1228918186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684158ce0 0x7f568415c740 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f568406e130 tx=0x7f568001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e5daa6ff575e95 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f5688982640 1 -- 172.21.15.82:0/1228918186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800a7bb0 con 0x7f5684158ce0 2023-07-20T11:24:33.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f5688982640 1 -- 172.21.15.82:0/1228918186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800a7d10 con 0x7f5684158ce0 2023-07-20T11:24:33.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f5688982640 1 -- 172.21.15.82:0/1228918186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800af660 con 0x7f5684158ce0 2023-07-20T11:24:33.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 -- 172.21.15.82:0/1228918186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684158ce0 msgr2=0x7f568415c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1228918186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684158ce0 0x7f568415c740 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f568406e130 tx=0x7f568001eba0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 -- 172.21.15.82:0/1228918186 shutdown_connections 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1228918186 >> v2:172.21.15.183:3300/0 conn(0x7f5684069bb0 0x7f568406c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1228918186 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684069750 0x7f568406bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1228918186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684158ce0 0x7f568415c740 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 -- 172.21.15.82:0/1228918186 >> 172.21.15.82:0/1228918186 conn(0x7f56840cf070 msgr2=0x7f56840cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 -- 172.21.15.82:0/1228918186 shutdown_connections 2023-07-20T11:24:33.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.808+0000 7f568bbe8640 1 -- 172.21.15.82:0/1228918186 wait complete. 2023-07-20T11:24:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 Processor -- start 2023-07-20T11:24:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- start start 2023-07-20T11:24:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5684069bb0 0x7f5684154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684158ce0 0x7f56841f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56840afda0 con 0x7f5684069750 2023-07-20T11:24:33.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568414d060 con 0x7f5684069bb0 2023-07-20T11:24:33.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568415ae00 con 0x7f5684158ce0 2023-07-20T11:24:33.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38362/0 (socket says 172.21.15.82:38362) 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 -- 172.21.15.82:0/1641087493 learned_addr learned my addr 172.21.15.82:0/1641087493 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 -- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684158ce0 msgr2=0x7f56841f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684158ce0 0x7f56841f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 -- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5684069bb0 msgr2=0x7f5684154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5684069bb0 0x7f5684154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:33.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 -- 172.21.15.82:0/1641087493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568000b770 con 0x7f5684069750 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f5689984640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f568000b2c0 tx=0x7f568001d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800ba480 con 0x7f5684069750 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800ba600 con 0x7f5684069750 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56800ba9b0 con 0x7f5684069750 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568415a280 con 0x7f5684069750 2023-07-20T11:24:33.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.812+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568415a840 con 0x7f5684069750 2023-07-20T11:24:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568404da30 con 0x7f5684069750 2023-07-20T11:24:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56800bab10 con 0x7f5684069750 2023-07-20T11:24:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f567a7fc640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 0x7f5668068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:33.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f568011f6a0 con 0x7f5684069750 2023-07-20T11:24:33.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f5689183640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 0x7f5668068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:33.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.816+0000 7f5689183640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 0x7f5668068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56841f63e0 tx=0x7f5674006ca0 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:33.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:33.820+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56800ec920 con 0x7f5684069750 2023-07-20T11:24:34.011 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.016+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f56840cce30 con 0x7f5684069750 2023-07-20T11:24:34.017 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.020+0000 7f567a7fc640 1 -- 172.21.15.82:0/1641087493 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v50) v1 ==== 190+0+147 (secure 0 0 0) 0x7f56800eff40 con 0x7f5684069750 2023-07-20T11:24:34.017 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2023-07-20T11:24:34.017 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAmA7lkqvH7HBAAFfmS0/o5ByUaYvbqvDn1Cw== 2023-07-20T11:24:34.017 INFO:teuthology.orchestra.run.smithi082.stdout: caps mds = "allow" 2023-07-20T11:24:34.018 INFO:teuthology.orchestra.run.smithi082.stdout: caps mon = "allow r" 2023-07-20T11:24:34.018 INFO:teuthology.orchestra.run.smithi082.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-20T11:24:34.018 INFO:teuthology.orchestra.run.smithi082.stderr:updated caps for client.0 2023-07-20T11:24:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 msgr2=0x7f5668068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 0x7f5668068860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f56841f63e0 tx=0x7f5674006ca0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 msgr2=0x7f568414cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f568000b2c0 tx=0x7f568001d3e0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 shutdown_connections 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f56680663a0 0x7f5668068860 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5684158ce0 0x7f56841f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5684069bb0 0x7f5684154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 --2- 172.21.15.82:0/1641087493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5684069750 0x7f568414cb20 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 >> 172.21.15.82:0/1641087493 conn(0x7f56840cf070 msgr2=0x7f56841632f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.020 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 shutdown_connections 2023-07-20T11:24:34.021 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.024+0000 7f568bbe8640 1 -- 172.21.15.82:0/1641087493 wait complete. 2023-07-20T11:24:34.038 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:34.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.180+0000 7f8fa0f33640 1 Processor -- start 2023-07-20T11:24:34.176 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.180+0000 7f8fa0f33640 1 -- start start 2023-07-20T11:24:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8fa0f33640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f9c0ca040 0x7f8f9c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8fa0f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8fa0f33640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0cde70 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8fa0f33640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c0cbef0 con 0x7f8f9c0ca040 2023-07-20T11:24:34.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8fa0f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0ca420 con 0x7f8f9c15c910 2023-07-20T11:24:34.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f9ad9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8f9c15d2d0 0x7f8f9c0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36666/0 (socket says 172.21.15.82:36666) 2023-07-20T11:24:34.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f9ad9d640 1 -- 172.21.15.82:0/2878493687 learned_addr learned my addr 172.21.15.82:0/2878493687 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:34.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f93fff640 1 --2- 172.21.15.82:0/2878493687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f9a59c640 1 --2- 172.21.15.82:0/2878493687 >> v2:172.21.15.183:3300/0 conn(0x7f8f9c0ca040 0x7f8f9c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f99d9b640 1 -- 172.21.15.82:0/2878493687 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807402465 0 0) 0x7f8f9c0cde70 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f99d9b640 1 -- 172.21.15.82:0/2878493687 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f88003530 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f93fff640 1 -- 172.21.15.82:0/2878493687 >> v2:172.21.15.183:3300/0 conn(0x7f8f9c0ca040 msgr2=0x7f8f9c0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f93fff640 1 --2- 172.21.15.82:0/2878493687 >> v2:172.21.15.183:3300/0 conn(0x7f8f9c0ca040 0x7f8f9c0ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f93fff640 1 -- 172.21.15.82:0/2878493687 >> v1:172.21.15.82:6789/0 conn(0x7f8f9c15d2d0 legacy=0x7f8f9c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.179 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.184+0000 7f8f93fff640 1 -- 172.21.15.82:0/2878493687 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c15d760 con 0x7f8f9c15c910 2023-07-20T11:24:34.181 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8f93fff640 1 --2- 172.21.15.82:0/2878493687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c15cd90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097c0 tx=0x7f8f8401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce26117b121c568 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8f99d9b640 1 -- 172.21.15.82:0/2878493687 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840ac640 con 0x7f8f9c15c910 2023-07-20T11:24:34.182 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8f99d9b640 1 -- 172.21.15.82:0/2878493687 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f840ac7a0 con 0x7f8f9c15c910 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8f99d9b640 1 -- 172.21.15.82:0/2878493687 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f840acb10 con 0x7f8f9c15c910 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2878493687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 msgr2=0x7f8f9c15cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2878493687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c15cd90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8f840097c0 tx=0x7f8f8401c480 comp rx=0 tx=0).stop 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2878493687 shutdown_connections 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2878493687 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c15cd90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2878493687 >> v2:172.21.15.183:3300/0 conn(0x7f8f9c0ca040 0x7f8f9c0ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.183 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2878493687 >> 172.21.15.82:0/2878493687 conn(0x7f8f9c0cada0 msgr2=0x7f8f9c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2878493687 shutdown_connections 2023-07-20T11:24:34.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2878493687 wait complete. 2023-07-20T11:24:34.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 Processor -- start 2023-07-20T11:24:34.184 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.188+0000 7f8fa0f33640 1 -- start start 2023-07-20T11:24:34.185 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 0x7f8f9c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0abcb0 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0ab960 con 0x7f8f9c0ca040 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0c6cc0 con 0x7f8f9c15c910 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38364/0 (socket says 172.21.15.82:38364) 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 -- 172.21.15.82:0/2003725954 learned_addr learned my addr 172.21.15.82:0/2003725954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9a59c640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 0x7f8f9c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f93fff640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 -- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 msgr2=0x7f8f9c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 -- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 msgr2=0x7f8f9c154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.187 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 0x7f8f9c154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 -- 172.21.15.82:0/2003725954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f84009420 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9a59c640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 0x7f8f9c154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f9ad9d640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400caa0 tx=0x7f8f9400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400ac00 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400ad60 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c0c6fa0 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94012620 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c1656e0 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c073c70 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.192+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8f94007070 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.196+0000 7f8f92ffd640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 0x7f8f7c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.196+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8f94083de0 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.196+0000 7f8f9a59c640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 0x7f8f7c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.196+0000 7f8f9a59c640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 0x7f8f7c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009bb0 tx=0x7f8f8c008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.200+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f94051190 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.376+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f9c0cbbd0 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.376+0000 7f8f92ffd640 1 -- 172.21.15.82:0/2003725954 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f8f94017020 con 0x7f8f9c15d2d0 2023-07-20T11:24:34.372 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:34.372 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:34.373 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 msgr2=0x7f8f7c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 0x7f8f7c068860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009bb0 tx=0x7f8f8c008040 comp rx=0 tx=0).stop 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 msgr2=0x7f8f9c0c65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400caa0 tx=0x7f8f9400cf60 comp rx=0 tx=0).stop 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 shutdown_connections 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f8f7c0663a0 0x7f8f7c068860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f9c15d2d0 0x7f8f9c0c65e0 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f9c15c910 0x7f8f9c155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 --2- 172.21.15.82:0/2003725954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9c0ca040 0x7f8f9c154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 >> 172.21.15.82:0/2003725954 conn(0x7f8f9c0cada0 msgr2=0x7f8f9c0c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 shutdown_connections 2023-07-20T11:24:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.380+0000 7f8fa0f33640 1 -- 172.21.15.82:0/2003725954 wait complete. 2023-07-20T11:24:34.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-20T11:24:24.039156+0000', 'modified': '2023-07-20T11:24:27.702303+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11418': {'gid': 11418, 'name': 'c', 'rank': 0, 'incarnation': 95, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6837/2909452184', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6835', 'nonce': 2909452184}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 2909452184}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-20T11:24:34.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-20T11:24:34.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-20T11:24:34.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.940+0000 7fcbe29d2640 1 Processor -- start 2023-07-20T11:24:34.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.940+0000 7fcbe29d2640 1 -- start start 2023-07-20T11:24:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe29d2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcbdc0b2a90 0x7fcbdc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe29d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbdc0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe29d2640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0ccd90 con 0x7fcbdc1596b0 2023-07-20T11:24:34.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe29d2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0ad600 con 0x7fcbdc0b2a90 2023-07-20T11:24:34.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe29d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0ad810 con 0x7fcbdc0cc900 2023-07-20T11:24:34.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdbfff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcbdc1596b0 0x7fcbdc0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36674/0 (socket says 172.21.15.82:36674) 2023-07-20T11:24:34.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdbfff640 1 -- 172.21.15.82:0/1235947057 learned_addr learned my addr 172.21.15.82:0/1235947057 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:34.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/1235947057 >> v2:172.21.15.183:3300/0 conn(0x7fcbdc0b2a90 0x7fcbdc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbdc0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410970310 0 0) 0x7fcbdc0ccd90 con 0x7fcbdc1596b0 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc4005740 con 0x7fcbdc1596b0 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898240534 0 0) 0x7fcbc4005740 con 0x7fcbdc1596b0 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 msgr2=0x7fcbdc0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbdc0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 >> v2:172.21.15.183:3300/0 conn(0x7fcbdc0b2a90 msgr2=0x7fcbdc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/1235947057 >> v2:172.21.15.183:3300/0 conn(0x7fcbdc0b2a90 0x7fcbdc15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc15d0d0 con 0x7fcbdc1596b0 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7fcbcc001680 con 0x7fcbdc1596b0 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 >> v1:172.21.15.82:6789/0 conn(0x7fcbdc1596b0 legacy=0x7fcbdc0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc4005b90 0x7fcbc4005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbc40069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc4006f20 0x7fcbc40073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0ad600 con 0x7fcbc4006f20 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0ad810 con 0x7fcbc4005b90 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc400dba0 con 0x7fcbdc0cc900 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc4006f20 0x7fcbc40073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc4005b90 0x7fcbc4005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbc40069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 msgr2=0x7fcbc40069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbdc0cc900 0x7fcbc40069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc4005b90 msgr2=0x7fcbc4005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbc4005b90 0x7fcbc4005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.944+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1235947057 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4005740 con 0x7fcbc4006f20 2023-07-20T11:24:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc4006f20 0x7fcbc40073a0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009fc0 tx=0x7fcbd401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b6f5ea7cbb625e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40a5c70 con 0x7fcbc4006f20 2023-07-20T11:24:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd400f040 con 0x7fcbc4006f20 2023-07-20T11:24:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbdaffd640 1 -- 172.21.15.82:0/1235947057 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40ad440 con 0x7fcbc4006f20 2023-07-20T11:24:34.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- 172.21.15.82:0/1235947057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc4006f20 msgr2=0x7fcbc40073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/1235947057 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbc4006f20 0x7fcbc40073a0 secure :-1 s=READY pgs=2408 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009fc0 tx=0x7fcbd401cc60 comp rx=0 tx=0).stop 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1235947057 reap_dead start 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- 172.21.15.82:0/1235947057 shutdown_connections 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- 172.21.15.82:0/1235947057 >> 172.21.15.82:0/1235947057 conn(0x7fcbdc0cada0 msgr2=0x7fcbdc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- 172.21.15.82:0/1235947057 shutdown_connections 2023-07-20T11:24:34.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- 172.21.15.82:0/1235947057 wait complete. 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 Processor -- start 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.948+0000 7fcbe29d2640 1 -- start start 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc4006f20 0x7fcbdc0c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc1f0f10 0x7fcbdc1eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc155610 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc155860 con 0x7fcbdc1f0f10 2023-07-20T11:24:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc155b40 con 0x7fcbc4006f20 2023-07-20T11:24:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38378/0 (socket says 172.21.15.82:38378) 2023-07-20T11:24:34.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3670645385 learned_addr learned my addr 172.21.15.82:0/3670645385 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc4006f20 0x7fcbdc0c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc1f0f10 0x7fcbdc1eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc4006f20 msgr2=0x7fcbdc0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc4006f20 0x7fcbdc0c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc1f0f10 msgr2=0x7fcbdc1eff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc1f0f10 0x7fcbdc1eff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3670645385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc155e20 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0011980 tx=0x7fcbd0011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbd8ff9640 1 -- 172.21.15.82:0/3670645385 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd000faf0 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbd8ff9640 1 -- 172.21.15.82:0/3670645385 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd000fc50 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbd8ff9640 1 -- 172.21.15.82:0/3670645385 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0014440 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc156100 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.952+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc1eec50 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbd8ff9640 1 -- 172.21.15.82:0/3670645385 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbd00145a0 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbd8ff9640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 0x7fcbc8068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbd8ff9640 1 -- 172.21.15.82:0/3670645385 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fcbd0084560 con 0x7fcbdc1ee7d0 2023-07-20T11:24:34.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 0x7fcbc8068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 Processor -- start 2023-07-20T11:24:34.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 -- start start 2023-07-20T11:24:34.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 0x7fcbc8068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc001060 tx=0x7fcbcc000f90 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 0x55c78ef01d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef022a0 0x55c78ef02680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78edc50a0 con 0x55c78ef4bf70 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed53e40 con 0x55c78ef022a0 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed51370 con 0x55c78ef4c890 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38382/0 (socket says 172.21.15.82:38382) 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 -- 172.21.15.82:0/2779898397 learned_addr learned my addr 172.21.15.82:0/2779898397 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 0x55c78ef01d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef022a0 0x55c78ef02680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 -- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 msgr2=0x55c78ef01d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 0x55c78ef01d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 -- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef022a0 msgr2=0x55c78ef02680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef022a0 0x55c78ef02680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdbfff640 1 -- 172.21.15.82:0/2779898397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c78ea48890 con 0x55c78ef4bf70 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.956+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 0x55c78ef01d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:34.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0077a0 tx=0x7fcbcc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f08dabe8081253d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbc27fc640 1 -- 172.21.15.82:0/2779898397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc01a040 con 0x55c78ef4bf70 2023-07-20T11:24:34.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbc27fc640 1 -- 172.21.15.82:0/2779898397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0159c0 con 0x55c78ef4bf70 2023-07-20T11:24:34.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbc27fc640 1 -- 172.21.15.82:0/2779898397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc015d90 con 0x55c78ef4bf70 2023-07-20T11:24:34.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/2779898397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 msgr2=0x55c78ef4c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0077a0 tx=0x7fcbcc00c000 comp rx=0 tx=0).stop 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/2779898397 shutdown_connections 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef022a0 0x55c78ef02680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef4c890 0x55c78ef01d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/2779898397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef4c350 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/2779898397 >> 172.21.15.82:0/2779898397 conn(0x55c78eef5200 msgr2=0x55c78ef00640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/2779898397 shutdown_connections 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/2779898397 wait complete. 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- start start 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 Processor -- start 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78ef532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78ef39d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed4cc60 con 0x55c78ef4bf70 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed08ae0 con 0x55c78ef4c890 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed08780 con 0x55c78ef022a0 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe5d2f000 10 client.0 _ll_register_callbacks cb 0x55c78eee9820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38394/0 (socket says 172.21.15.82:38394) 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3581627837 learned_addr learned my addr 172.21.15.82:0/3581627837 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78ef532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78ef39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 msgr2=0x55c78ef532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78ef532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 msgr2=0x55c78ef39d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78ef39d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3581627837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc15d0d0 con 0x55c78ef4bf70 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78ef39d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:34.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fcbd005d3f0 tx=0x7fcbd005d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02c4f59196d4338 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.960+0000 7fcbbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0059380 con 0x55c78ef4bf70 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c78ed0cfb0 con 0x55c78ef4bf70 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fcbd0054b70 con 0x55c78ef4bf70 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbd0054d30 con 0x55c78ef4bf70 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 10 client.11595 fetch_fsmap learned FSMap version 99 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x55c78ed10d10 con 0x55c78ef4bf70 2023-07-20T11:24:34.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c78ed0cfb0 con 0x55c78ef4bf70 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 99) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcbd001b020 con 0x55c78ef4bf70 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 10 client.11595 fetch_fsmap finished waiting for FSMap version 99 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 10 client.11595 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 20 client.11595 populate_metadata read hostname 'smithi082' 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef3aac0 0x55c78ef3aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 4 client.11595 mds_command: new command op to 11418 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-20T11:24:34.964 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 --> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c78ed7b410 con 0x55c78ef3aac0 2023-07-20T11:24:34.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef3aac0 0x55c78ef3aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 10 client.11595 ms_handle_connect on v2:172.21.15.82:6835/2909452184 2023-07-20T11:24:34.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef3aac0 0x55c78ef3aea0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44928fa651e0c4eb server_cookie=bf6536059de98140 in_seq=0 out_seq=0 2023-07-20T11:24:34.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/3581627837 <== mds.0 v2:172.21.15.82:6835/2909452184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55c78ed7b410 con 0x55c78ef3aac0 2023-07-20T11:24:34.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 10 client.11595 handle_command_reply: tid=0 2023-07-20T11:24:34.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 client.11595 shutdown 2023-07-20T11:24:34.966 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 msgr2=0x55c78ef53810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 secure :-1 s=READY pgs=2411 cs=0 l=1 rev1=1 crypto rx=0x7fcbd005d3f0 tx=0x7fcbd005d920 comp rx=0 tx=0).stop 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 shutdown_connections 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef3aac0 0x55c78ef3aea0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78ef39d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78ef53810 unknown :-1 s=CLOSED pgs=2411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3581627837 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78ef532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.967 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbbb7fe640 0 client.11595 ms_handle_reset on v2:172.21.15.82:6835/2909452184 2023-07-20T11:24:34.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 >> 172.21.15.82:0/3581627837 conn(0x55c78eef5200 msgr2=0x55c78ef02f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 shutdown_connections 2023-07-20T11:24:34.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3581627837 wait complete. 2023-07-20T11:24:34.968 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.964+0000 7fcbe5d2f000 20 client.11595 trim_cache size 0 max 16384 2023-07-20T11:24:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 Processor -- start 2023-07-20T11:24:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- start start 2023-07-20T11:24:34.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78efa65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ea09940 con 0x55c78ef4bf70 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed46f60 con 0x55c78ef4c890 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed41290 con 0x55c78ef022a0 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38402/0 (socket says 172.21.15.82:38402) 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3060175197 learned_addr learned my addr 172.21.15.82:0/3060175197 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78efa65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 msgr2=0x55c78efa5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 msgr2=0x55c78efa65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78efa65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 -- 172.21.15.82:0/3060175197 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c78ecf6fa0 con 0x55c78ef4bf70 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00555a0 tx=0x7fcbd0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50208c0fd14a55c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbc2ffd640 1 -- 172.21.15.82:0/3060175197 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0059380 con 0x55c78ef4bf70 2023-07-20T11:24:34.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbc2ffd640 1 -- 172.21.15.82:0/3060175197 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0054d70 con 0x55c78ef4bf70 2023-07-20T11:24:34.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbc2ffd640 1 -- 172.21.15.82:0/3060175197 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd005d6d0 con 0x55c78ef4bf70 2023-07-20T11:24:34.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3060175197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 msgr2=0x55c78efa6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00555a0 tx=0x7fcbd0059000 comp rx=0 tx=0).stop 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3060175197 shutdown_connections 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4c890 0x55c78efa65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4bf70 0x55c78efa6090 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/3060175197 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.980+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3060175197 >> 172.21.15.82:0/3060175197 conn(0x55c78eef5200 msgr2=0x55c78ef59120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3060175197 shutdown_connections 2023-07-20T11:24:34.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/3060175197 wait complete. 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- start start 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 Processor -- start 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4bf70 0x55c78ef50be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed12fe0 con 0x55c78ef4c890 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78ef39cb0 con 0x55c78ef4bf70 2023-07-20T11:24:34.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c78ed485d0 con 0x55c78ef022a0 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 10 client.0 _ll_register_callbacks cb 0x55c78edc4ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38404/0 (socket says 172.21.15.82:38404) 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1364018079 learned_addr learned my addr 172.21.15.82:0/1364018079 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbdb7fe640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4bf70 0x55c78ef50be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 msgr2=0x55c78efa51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4bf70 msgr2=0x55c78ef50be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4bf70 0x55c78ef50be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 -- 172.21.15.82:0/1364018079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c78ed10d10 con 0x55c78ef4c890 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe0f6f640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40b0040 tx=0x7fcbc4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd39bec9bf5cc38 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40c2470 con 0x55c78ef4c890 2023-07-20T11:24:34.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fcbd40c3e30 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c78ef08dc0 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbd40ad440 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 10 client.11601 fetch_fsmap learned FSMap version 99 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x55c78ea48cc0 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.984+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c78ef08dc0 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 99) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcbd4005d20 con 0x55c78ef4c890 2023-07-20T11:24:34.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 10 client.11601 fetch_fsmap finished waiting for FSMap version 99 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 10 client.11601 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 20 client.11601 populate_metadata read hostname 'smithi082' 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef51660 0x55c78ef51a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 4 client.11601 mds_command: new command op to 11418 tid=0[{"prefix": "status"}] 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 --> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c78ed13a20 con 0x55c78ef51660 2023-07-20T11:24:34.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef51660 0x55c78ef51a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:34.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbdbfff640 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef51660 0x55c78ef51a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc906bb1a906281 server_cookie=2ede142930838239 in_seq=0 out_seq=0 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbbb7fe640 10 client.11601 ms_handle_connect on v2:172.21.15.82:6835/2909452184 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbbb7fe640 1 -- 172.21.15.82:0/1364018079 <== mds.0 v2:172.21.15.82:6835/2909452184 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55c78ed13a20 con 0x55c78ef51660 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbbb7fe640 10 client.11601 handle_command_reply: tid=0 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 client.11601 shutdown 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 msgr2=0x55c78ef51120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fcbd40b0040 tx=0x7fcbc4007a10 comp rx=0 tx=0).stop 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 shutdown_connections 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:6835/2909452184,v1:172.21.15.82:6837/2909452184] conn(0x55c78ef51660 0x55c78ef51a40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c78ef4c890 0x55c78ef51120 unknown :-1 s=CLOSED pgs=2413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c78ef4bf70 0x55c78ef50be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbbb7fe640 0 client.11601 ms_handle_reset on v2:172.21.15.82:6835/2909452184 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 --2- 172.21.15.82:0/1364018079 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x55c78ef022a0 0x55c78efa51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 >> 172.21.15.82:0/1364018079 conn(0x55c78eef5200 msgr2=0x55c78ef599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 shutdown_connections 2023-07-20T11:24:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 1 -- 172.21.15.82:0/1364018079 wait complete. 2023-07-20T11:24:34.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe5d2f000 20 client.11601 trim_cache size 0 max 16384 2023-07-20T11:24:34.991 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:24:34.991 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "79d507c4-9484-40cb-9468-5aa547ff1f30", 2023-07-20T11:24:34.991 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 11418, 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 10.333555681, 2023-07-20T11:24:34.992 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 99, 2023-07-20T11:24:34.993 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 205, 2023-07-20T11:24:34.993 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 205, 2023-07-20T11:24:34.993 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 16.298381018000001 2023-07-20T11:24:34.993 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 msgr2=0x7fcbc8068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 0x7fcbc8068890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc001060 tx=0x7fcbcc000f90 comp rx=0 tx=0).stop 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 msgr2=0x7fcbdc0c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0011980 tx=0x7fcbd0011e40 comp rx=0 tx=0).stop 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 shutdown_connections 2023-07-20T11:24:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fcbc80663d0 0x7fcbc8068890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcbdc1f0f10 0x7fcbdc1eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbdc1ee7d0 0x7fcbdc0c7ae0 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 --2- 172.21.15.82:0/3670645385 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcbc4006f20 0x7fcbdc0c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 >> 172.21.15.82:0/3670645385 conn(0x7fcbdc0cada0 msgr2=0x7fcbdc0c8930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 shutdown_connections 2023-07-20T11:24:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:34.988+0000 7fcbe29d2640 1 -- 172.21.15.82:0/3670645385 wait complete. 2023-07-20T11:24:35.002 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-20T11:24:35.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.144+0000 7fd11fc88640 1 Processor -- start 2023-07-20T11:24:35.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.144+0000 7fd11fc88640 1 -- start start 2023-07-20T11:24:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11fc88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1180b2a90 0x7fd11815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11fc88640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180ccd50 con 0x7fd1181596b0 2023-07-20T11:24:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11fc88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180ad810 con 0x7fd1180cc900 2023-07-20T11:24:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11fc88640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11815d0d0 con 0x7fd1180b2a90 2023-07-20T11:24:35.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1180b2a90 0x7fd11815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:35.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd1180b2a90 0x7fd11815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38412/0 (socket says 172.21.15.82:38412) 2023-07-20T11:24:35.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 -- 172.21.15.82:0/3356142186 learned_addr learned my addr 172.21.15.82:0/3356142186 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:35.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 -- 172.21.15.82:0/3356142186 >> v1:172.21.15.183:6789/0 conn(0x7fd1180cc900 legacy=0x7fd1180c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:35.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 -- 172.21.15.82:0/3356142186 >> v1:172.21.15.82:6789/0 conn(0x7fd1181596b0 legacy=0x7fd1180b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.144 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.148+0000 7fd11d223640 1 -- 172.21.15.82:0/3356142186 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11815d3b0 con 0x7fd1180b2a90 2023-07-20T11:24:35.145 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11d223640 1 --2- 172.21.15.82:0/3356142186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd11815dbb0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fd1080098a0 tx=0x7fd10801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce4e15b997ba84c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:35.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11ca22640 1 -- 172.21.15.82:0/3356142186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1080ab650 con 0x7fd1180b2a90 2023-07-20T11:24:35.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11ca22640 1 -- 172.21.15.82:0/3356142186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1080ab7b0 con 0x7fd1180b2a90 2023-07-20T11:24:35.146 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11ca22640 1 -- 172.21.15.82:0/3356142186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1080abb40 con 0x7fd1180b2a90 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- 172.21.15.82:0/3356142186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 msgr2=0x7fd11815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 --2- 172.21.15.82:0/3356142186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd11815dbb0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7fd1080098a0 tx=0x7fd10801c4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- 172.21.15.82:0/3356142186 shutdown_connections 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 --2- 172.21.15.82:0/3356142186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd11815dbb0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- 172.21.15.82:0/3356142186 >> 172.21.15.82:0/3356142186 conn(0x7fd1180cada0 msgr2=0x7fd1180cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:35.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- 172.21.15.82:0/3356142186 shutdown_connections 2023-07-20T11:24:35.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- 172.21.15.82:0/3356142186 wait complete. 2023-07-20T11:24:35.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 Processor -- start 2023-07-20T11:24:35.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.152+0000 7fd11fc88640 1 -- start start 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1180cc900 0x7fd1181518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1181596b0 0x7fd1180add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c1e50 con 0x7fd1180b2a90 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180706d0 con 0x7fd1180cc900 2023-07-20T11:24:35.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1180c20a0 con 0x7fd1181596b0 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38420/0 (socket says 172.21.15.82:38420) 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 -- 172.21.15.82:0/1112519309 learned_addr learned my addr 172.21.15.82:0/1112519309 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 -- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1181596b0 msgr2=0x7fd1180add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1181596b0 0x7fd1180add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 -- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1180cc900 msgr2=0x7fd1181518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1180cc900 0x7fd1181518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 -- 172.21.15.82:0/1112519309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080094d0 con 0x7fd1180b2a90 2023-07-20T11:24:35.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11da24640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c3c0 tx=0x7fd11400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:35.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140052d0 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114005430 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114003840 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180c2380 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1180c2940 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd118073c70 con 0x7fd1180b2a90 2023-07-20T11:24:35.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.156+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd1140039a0 con 0x7fd1180b2a90 2023-07-20T11:24:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.160+0000 7fd10e7fc640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 0x7fd0fc068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.160+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd114083390 con 0x7fd1180b2a90 2023-07-20T11:24:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.160+0000 7fd11d223640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 0x7fd0fc068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:35.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.160+0000 7fd11d223640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 0x7fd0fc068890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1080af000 tx=0x7fd108008040 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:35.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.164+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd114050740 con 0x7fd1180b2a90 2023-07-20T11:24:35.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.344+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1180c2b30 con 0x7fd1180b2a90 2023-07-20T11:24:35.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.344+0000 7fd10e7fc640 1 -- 172.21.15.82:0/1112519309 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd114053d60 con 0x7fd1180b2a90 2023-07-20T11:24:35.341 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 msgr2=0x7fd0fc068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 0x7fd0fc068890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1080af000 tx=0x7fd108008040 comp rx=0 tx=0).stop 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 msgr2=0x7fd118070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c3c0 tx=0x7fd11400c880 comp rx=0 tx=0).stop 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 shutdown_connections 2023-07-20T11:24:35.343 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd0fc0663d0 0x7fd0fc068890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd1181596b0 0x7fd1180add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1180cc900 0x7fd1181518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 --2- 172.21.15.82:0/1112519309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1180b2a90 0x7fd118070190 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 >> 172.21.15.82:0/1112519309 conn(0x7fd1180cada0 msgr2=0x7fd1180ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 shutdown_connections 2023-07-20T11:24:35.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:35.348+0000 7fd11fc88640 1 -- 172.21.15.82:0/1112519309 wait complete. 2023-07-20T11:24:35.361 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-20T11:24:35.362 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-20T11:24:35.362 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2023-07-20T11:24:35.362 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-20T11:24:35.363 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:35.363 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-20T11:24:35.363 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-20T11:24:35.363 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-20T11:24:35.364 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:24:35.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.364 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2023-07-20T11:24:35.373 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.374 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.375 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 36726sec preferred_lft 36726sec 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-20T11:24:35.376 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 02:42:7c:cb:5d:ff brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-20T11:24:35.377 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-20T11:24:35.378 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2023-07-20T11:24:35.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.380 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-20T11:24:35.440 INFO:teuthology.orchestra.run.smithi082.stdout:1 2023-07-20T11:24:35.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.442 DEBUG:teuthology.orchestra.run.smithi082:> route 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-20T11:24:35.500 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-20T11:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-20T11:24:35.501 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-20T11:24:35.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.502 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec bash -c ' 2023-07-20T11:24:35.502 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2023-07-20T11:24:35.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-20T11:24:35.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-20T11:24:35.503 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-20T11:24:35.503 DEBUG:teuthology.orchestra.run.smithi082:> ') 2023-07-20T11:24:35.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.593 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:24:35.602 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T11:24:35.603 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T11:24:35.603 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:24:35.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2023-07-20T11:24:35.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:24:35.666 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:35.717 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-20T11:24:35.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-20T11:24:35.718 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:35.768 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-20T11:24:35.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:24:35.859 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:24:35.859 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:24:35.859 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:24:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:24:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:24:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:24:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:24:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:24:35.883 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-20T11:24:35.883 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-20T11:24:35.883 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2023-07-20T11:24:35.884 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.183:3300,172.21.15.183:3301" 2023-07-20T11:24:35.884 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-20T11:24:35.884 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790" 2023-07-20T11:24:35.884 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.183:6789,172.21.15.183:6790:/ 2023-07-20T11:24:35.884 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=79d507c4-9484-40cb-9468-5aa547ff1f30" will pass to kernel 2023-07-20T11:24:35.887 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-20T11:24:35.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:35.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:35.910 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-20T11:24:35.972 INFO:teuthology.orchestra.run.smithi082.stdout:client11613 2023-07-20T11:24:35.972 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:35.973 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:36.022 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-20T11:24:36.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 Processor -- start 2023-07-20T11:24:36.202 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 -- start start 2023-07-20T11:24:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1b80b3860 0x7fc1b80715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1b806c8b0 0x7fc1b806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b815e130 con 0x7fc1b806bc60 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b806c0d0 con 0x7fc1b806c8b0 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1be791640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b815e410 con 0x7fc1b80b3860 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1b806c8b0 0x7fc1b806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc1b806c8b0 0x7fc1b806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38434/0 (socket says 172.21.15.82:38434) 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 -- 172.21.15.82:0/710360952 learned_addr learned my addr 172.21.15.82:0/710360952 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bd78f640 1 --2- 172.21.15.82:0/710360952 >> v2:172.21.15.183:3300/0 conn(0x7fc1b80b3860 0x7fc1b80715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 -- 172.21.15.82:0/710360952 >> v2:172.21.15.183:3300/0 conn(0x7fc1b80b3860 msgr2=0x7fc1b80715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 --2- 172.21.15.82:0/710360952 >> v2:172.21.15.183:3300/0 conn(0x7fc1b80b3860 0x7fc1b80715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 -- 172.21.15.82:0/710360952 >> v1:172.21.15.183:6789/0 conn(0x7fc1b806bc60 legacy=0x7fc1b80cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.208+0000 7fc1bcf8e640 1 -- 172.21.15.82:0/710360952 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b815e6f0 con 0x7fc1b806c8b0 2023-07-20T11:24:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1bcf8e640 1 --2- 172.21.15.82:0/710360952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b806c8b0 0x7fc1b806b720 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009870 tx=0x7fc1a801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4296dfca76b6f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1affff640 1 -- 172.21.15.82:0/710360952 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80ab600 con 0x7fc1b806c8b0 2023-07-20T11:24:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1affff640 1 -- 172.21.15.82:0/710360952 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a80ab760 con 0x7fc1b806c8b0 2023-07-20T11:24:36.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1affff640 1 -- 172.21.15.82:0/710360952 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a80abaf0 con 0x7fc1b806c8b0 2023-07-20T11:24:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 -- 172.21.15.82:0/710360952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b806c8b0 msgr2=0x7fc1b806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 --2- 172.21.15.82:0/710360952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b806c8b0 0x7fc1b806b720 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009870 tx=0x7fc1a801c400 comp rx=0 tx=0).stop 2023-07-20T11:24:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 -- 172.21.15.82:0/710360952 shutdown_connections 2023-07-20T11:24:36.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 --2- 172.21.15.82:0/710360952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b806c8b0 0x7fc1b806b720 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 --2- 172.21.15.82:0/710360952 >> v2:172.21.15.183:3300/0 conn(0x7fc1b80b3860 0x7fc1b80715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 -- 172.21.15.82:0/710360952 >> 172.21.15.82:0/710360952 conn(0x7fc1b80ce080 msgr2=0x7fc1b80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 -- 172.21.15.82:0/710360952 shutdown_connections 2023-07-20T11:24:36.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.212+0000 7fc1be791640 1 -- 172.21.15.82:0/710360952 wait complete. 2023-07-20T11:24:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 Processor -- start 2023-07-20T11:24:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- start start 2023-07-20T11:24:36.211 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1b806bc60 0x7fc1b80cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1b806c8b0 0x7fc1b80c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80cd590 con 0x7fc1b80b3860 2023-07-20T11:24:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80c4b60 con 0x7fc1b806bc60 2023-07-20T11:24:36.212 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80cccf0 con 0x7fc1b806c8b0 2023-07-20T11:24:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38446/0 (socket says 172.21.15.82:38446) 2023-07-20T11:24:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 -- 172.21.15.82:0/3075746400 learned_addr learned my addr 172.21.15.82:0/3075746400 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bd78f640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1b806bc60 0x7fc1b80cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.213 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bcf8e640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1b806c8b0 0x7fc1b80c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 -- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1b806c8b0 msgr2=0x7fc1b80c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1b806c8b0 0x7fc1b80c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.214 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 -- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1b806bc60 msgr2=0x7fc1b80cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1b806bc60 0x7fc1b80cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 -- 172.21.15.82:0/3075746400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80094d0 con 0x7fc1b80b3860 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1bdf90640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c3c0 tx=0x7fc1b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0011790 con 0x7fc1b80b3860 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b00118f0 con 0x7fc1b80b3860 2023-07-20T11:24:36.215 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0011ca0 con 0x7fc1b80b3860 2023-07-20T11:24:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80ccfd0 con 0x7fc1b80b3860 2023-07-20T11:24:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.216+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b80c6290 con 0x7fc1b80b3860 2023-07-20T11:24:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b80c6480 con 0x7fc1b80b3860 2023-07-20T11:24:36.216 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc1b001c460 con 0x7fc1b80b3860 2023-07-20T11:24:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1adffb640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 0x7fc19c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fc1b0083c80 con 0x7fc1b80b3860 2023-07-20T11:24:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1bd78f640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 0x7fc19c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.220+0000 7fc1bd78f640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 0x7fc19c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4003ab0 tx=0x7fc1b4009830 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.219 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.224+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1b0051040 con 0x7fc1b80b3860 2023-07-20T11:24:36.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1b80cee20 con 0x7fc19c0663a0 2023-07-20T11:24:36.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1adffb640 1 -- 172.21.15.82:0/3075746400 <== mgr.11154 v2:172.21.15.82:6832/1948044010 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc1b4009d20 con 0x7fc19c0663a0 2023-07-20T11:24:36.387 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2023-07-20T11:24:36.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2023-07-20T11:24:36.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephfs" 2023-07-20T11:24:36.387 INFO:teuthology.orchestra.run.smithi082.stdout: } 2023-07-20T11:24:36.387 INFO:teuthology.orchestra.run.smithi082.stdout:] 2023-07-20T11:24:36.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 msgr2=0x7fc19c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 0x7fc19c068860 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4003ab0 tx=0x7fc1b4009830 comp rx=0 tx=0).stop 2023-07-20T11:24:36.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 msgr2=0x7fc1b81530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c3c0 tx=0x7fc1b000c880 comp rx=0 tx=0).stop 2023-07-20T11:24:36.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 shutdown_connections 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fc19c0663a0 0x7fc19c068860 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1b80b3860 0x7fc1b81530d0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1b806c8b0 0x7fc1b80c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 --2- 172.21.15.82:0/3075746400 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1b806bc60 0x7fc1b80cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 >> 172.21.15.82:0/3075746400 conn(0x7fc1b80ce080 msgr2=0x7fc1b8070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.392+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 shutdown_connections 2023-07-20T11:24:36.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.396+0000 7fc1be791640 1 -- 172.21.15.82:0/3075746400 wait complete. 2023-07-20T11:24:36.408 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-20T11:24:36.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 Processor -- start 2023-07-20T11:24:36.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 -- start start 2023-07-20T11:24:36.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd51006f710 0x7fd51006faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51015e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 0x7fd51015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51015bad0 con 0x7fd51006f710 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd510070030 con 0x7fd51015ec90 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd516e93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd510071950 con 0x7fd5100ca5a0 2023-07-20T11:24:36.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd51006f710 0x7fd51006faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd51006f710 0x7fd51006faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38456/0 (socket says 172.21.15.82:38456) 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 -- 172.21.15.82:0/3678088529 learned_addr learned my addr 172.21.15.82:0/3678088529 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd515430640 1 --2- 172.21.15.82:0/3678088529 >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 0x7fd51015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd50ffff640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 -- 172.21.15.82:0/3678088529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 msgr2=0x7fd51015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.553 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 -- 172.21.15.82:0/3678088529 >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 msgr2=0x7fd51015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 --2- 172.21.15.82:0/3678088529 >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 0x7fd51015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd514c2f640 1 -- 172.21.15.82:0/3678088529 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51015b230 con 0x7fd51006f710 2023-07-20T11:24:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd515430640 1 --2- 172.21.15.82:0/3678088529 >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 0x7fd51015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:36.554 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.556+0000 7fd50ffff640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:36.555 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd514c2f640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51006f710 0x7fd51006faf0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fd5100702d0 tx=0x7fd50401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52acc0254c4416be server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd50f7fe640 1 -- 172.21.15.82:0/3678088529 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040ac600 con 0x7fd51006f710 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd50f7fe640 1 -- 172.21.15.82:0/3678088529 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5040a8050 con 0x7fd51006f710 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd50f7fe640 1 -- 172.21.15.82:0/3678088529 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040ac980 con 0x7fd51006f710 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 -- 172.21.15.82:0/3678088529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51006f710 msgr2=0x7fd51006faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51006f710 0x7fd51006faf0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7fd5100702d0 tx=0x7fd50401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 -- 172.21.15.82:0/3678088529 shutdown_connections 2023-07-20T11:24:36.556 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 --2- 172.21.15.82:0/3678088529 >> v2:172.21.15.183:3300/0 conn(0x7fd51015ec90 0x7fd51015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 --2- 172.21.15.82:0/3678088529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51006f710 0x7fd51006faf0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 -- 172.21.15.82:0/3678088529 >> 172.21.15.82:0/3678088529 conn(0x7fd5100cad50 msgr2=0x7fd5100cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 -- 172.21.15.82:0/3678088529 shutdown_connections 2023-07-20T11:24:36.557 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.560+0000 7fd516e93640 1 -- 172.21.15.82:0/3678088529 wait complete. 2023-07-20T11:24:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 Processor -- start 2023-07-20T11:24:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- start start 2023-07-20T11:24:36.558 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 0x7fd510153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 0x7fd5101f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd510153550 con 0x7fd51015ec90 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51014d3b0 con 0x7fd51006f710 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5101525c0 con 0x7fd5100ca5a0 2023-07-20T11:24:36.559 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 0x7fd5101f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd514c2f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 0x7fd510153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd514c2f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 0x7fd510153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:45448/0 (socket says 172.21.15.82:45448) 2023-07-20T11:24:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd514c2f640 1 -- 172.21.15.82:0/4283112172 learned_addr learned my addr 172.21.15.82:0/4283112172 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:36.560 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd50ffff640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 -- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 msgr2=0x7fd51014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51014ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 -- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 msgr2=0x7fd510153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 0x7fd510153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 -- 172.21.15.82:0/4283112172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040094d0 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd515430640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 0x7fd5101f6aa0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ccc0 tx=0x7fd50800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800f680 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800f800 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd510152b80 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800fbb0 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5101f7840 con 0x7fd51015ec90 2023-07-20T11:24:36.562 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.564+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510152d10 con 0x7fd51015ec90 2023-07-20T11:24:36.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.568+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 121) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd50800b040 con 0x7fd51015ec90 2023-07-20T11:24:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.568+0000 7fd50d7fa640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 0x7fd4f4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.568+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd508084710 con 0x7fd51015ec90 2023-07-20T11:24:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.568+0000 7fd514c2f640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 0x7fd4f4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.568+0000 7fd514c2f640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 0x7fd4f4068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd504000c10 tx=0x7fd5040a7000 comp rx=0 tx=0).ready entity=mgr.11154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:36.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.572+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd508051a60 con 0x7fd51015ec90 2023-07-20T11:24:36.748 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:36.752+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd51004da30 con 0x7fd51015ec90 2023-07-20T11:24:37.533 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.540+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 122) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd50800fd10 con 0x7fd51015ec90 2023-07-20T11:24:37.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.544+0000 7fd50d7fa640 1 -- 172.21.15.82:0/4283112172 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v122) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd508072390 con 0x7fd51015ec90 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.544+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 msgr2=0x7fd4f4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.544+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 0x7fd4f4068860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd504000c10 tx=0x7fd5040a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.544+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 msgr2=0x7fd5101f6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.544+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 0x7fd5101f6aa0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7fd50800ccc0 tx=0x7fd50800a650 comp rx=0 tx=0).stop 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 shutdown_connections 2023-07-20T11:24:37.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7fd4f40663a0 0x7fd4f4068860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd51015ec90 0x7fd5101f6aa0 unknown :-1 s=CLOSED pgs=2421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd5100ca5a0 0x7fd51014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 --2- 172.21.15.82:0/4283112172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd51006f710 0x7fd510153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 >> 172.21.15.82:0/4283112172 conn(0x7fd5100cad50 msgr2=0x7fd5100cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:37.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 shutdown_connections 2023-07-20T11:24:37.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.548+0000 7fd516e93640 1 -- 172.21.15.82:0/4283112172 wait complete. 2023-07-20T11:24:37.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-20T11:24:37.702 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:37.709+0000 7fef4d42f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.720+0000 7f5407eec640 1 Processor -- start 2023-07-20T11:24:37.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5407eec640 1 -- start start 2023-07-20T11:24:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5407eec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540006c120 0x7f54000cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:37.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5407eec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000d0970 con 0x7f54001602b0 2023-07-20T11:24:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5407eec640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5400160e20 con 0x7f540006b220 2023-07-20T11:24:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5407eec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000cd300 con 0x7f540006c120 2023-07-20T11:24:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540006c120 0x7f54000cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f540006c120 0x7f54000cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38476/0 (socket says 172.21.15.82:38476) 2023-07-20T11:24:37.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 -- 172.21.15.82:0/1527375846 learned_addr learned my addr 172.21.15.82:0/1527375846 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 -- 172.21.15.82:0/1527375846 >> v1:172.21.15.183:6789/0 conn(0x7f540006b220 legacy=0x7f54000d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 -- 172.21.15.82:0/1527375846 >> v1:172.21.15.82:6789/0 conn(0x7f54001602b0 legacy=0x7f540006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.724+0000 7f5405c88640 1 -- 172.21.15.82:0/1527375846 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000cd5e0 con 0x7f540006c120 2023-07-20T11:24:37.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5405c88640 1 --2- 172.21.15.82:0/1527375846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000cdde0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009870 tx=0x7f53fc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1022c0c4f2b0da26 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5404c86640 1 -- 172.21.15.82:0/1527375846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0ab610 con 0x7f540006c120 2023-07-20T11:24:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5404c86640 1 -- 172.21.15.82:0/1527375846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0ab770 con 0x7f540006c120 2023-07-20T11:24:37.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5404c86640 1 -- 172.21.15.82:0/1527375846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0abb00 con 0x7f540006c120 2023-07-20T11:24:37.719 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f9dcc646180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:37.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- 172.21.15.82:0/1527375846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 msgr2=0x7f54000cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 --2- 172.21.15.82:0/1527375846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000cdde0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009870 tx=0x7f53fc01c3f0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- 172.21.15.82:0/1527375846 shutdown_connections 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 --2- 172.21.15.82:0/1527375846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000cdde0 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- 172.21.15.82:0/1527375846 >> 172.21.15.82:0/1527375846 conn(0x7f540008c0a0 msgr2=0x7f540009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- 172.21.15.82:0/1527375846 shutdown_connections 2023-07-20T11:24:37.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- 172.21.15.82:0/1527375846 wait complete. 2023-07-20T11:24:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 Processor -- start 2023-07-20T11:24:37.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.728+0000 7f5407eec640 1 -- start start 2023-07-20T11:24:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540006b220 0x7f54001519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54001602b0 0x7f54000affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:37.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400158bf0 con 0x7f540006c120 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540015cf00 con 0x7f540006b220 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54000cc520 con 0x7f54001602b0 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38488/0 (socket says 172.21.15.82:38488) 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 -- 172.21.15.82:0/3231433520 learned_addr learned my addr 172.21.15.82:0/3231433520 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405c88640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540006b220 0x7f54001519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:37.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5406489640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54001602b0 0x7f54000affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:37.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 -- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54001602b0 msgr2=0x7f54000affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54001602b0 0x7f54000affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 -- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540006b220 msgr2=0x7f54001519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540006b220 0x7f54001519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 -- 172.21.15.82:0/3231433520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0094d0 con 0x7f540006c120 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5405487640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c3c0 tx=0x7f53f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00052d0 con 0x7f540006c120 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f0005430 con 0x7f540006c120 2023-07-20T11:24:37.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0003840 con 0x7f540006c120 2023-07-20T11:24:37.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540015c5d0 con 0x7f540006c120 2023-07-20T11:24:37.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540015cb90 con 0x7f540006c120 2023-07-20T11:24:37.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.732+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540015d0b0 con 0x7f540006c120 2023-07-20T11:24:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.736+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 122) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f53f00039a0 con 0x7f540006c120 2023-07-20T11:24:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.736+0000 7f53f67fc640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 0x7f53e40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.736+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f53f00833b0 con 0x7f540006c120 2023-07-20T11:24:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.736+0000 7f5405c88640 1 -- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 msgr2=0x7f53e40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:37.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.736+0000 7f5405c88640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 0x7f53e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:37.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.740+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f540015d0b0 con 0x7f540006c120 2023-07-20T11:24:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.892+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f540015d070 con 0x7f540006c120 2023-07-20T11:24:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f53f67fc640 1 -- 172.21.15.82:0/3231433520 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7f53f0050780 con 0x7f540006c120 2023-07-20T11:24:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 msgr2=0x7f53e40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 0x7f53e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 msgr2=0x7f54000afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f53f000c3c0 tx=0x7f53f000c880 comp rx=0 tx=0).stop 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 shutdown_connections 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f53e4066420 0x7f53e40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54001602b0 0x7f54000affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006c120 0x7f54000afa70 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 --2- 172.21.15.82:0/3231433520 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540006b220 0x7f54001519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 >> 172.21.15.82:0/3231433520 conn(0x7f540008c0a0 msgr2=0x7f54000af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 shutdown_connections 2023-07-20T11:24:37.891 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:37.896+0000 7f5407eec640 1 -- 172.21.15.82:0/3231433520 wait complete. 2023-07-20T11:24:37.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-20T11:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 Processor -- start 2023-07-20T11:24:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 -- start start 2023-07-20T11:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3a4c06c120 0x7f3a4c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c0d0970 con 0x7f3a4c1602b0 2023-07-20T11:24:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c160e20 con 0x7f3a4c06b220 2023-07-20T11:24:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a53c88640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0cd300 con 0x7f3a4c06c120 2023-07-20T11:24:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51223640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3a4c1602b0 0x7f3a4c06ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36688/0 (socket says 172.21.15.82:36688) 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51223640 1 -- 172.21.15.82:0/3251975299 learned_addr learned my addr 172.21.15.82:0/3251975299 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51a24640 1 --2- 172.21.15.82:0/3251975299 >> v2:172.21.15.183:3300/0 conn(0x7f3a4c06c120 0x7f3a4c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a50a22640 1 -- 172.21.15.82:0/3251975299 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297796752 0 0) 0x7f3a4c0d0970 con 0x7f3a4c1602b0 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a50a22640 1 -- 172.21.15.82:0/3251975299 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a38003530 con 0x7f3a4c1602b0 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51a24640 1 -- 172.21.15.82:0/3251975299 >> v1:172.21.15.183:6789/0 conn(0x7f3a4c06b220 legacy=0x7f3a4c0d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51a24640 1 -- 172.21.15.82:0/3251975299 >> v1:172.21.15.82:6789/0 conn(0x7f3a4c1602b0 legacy=0x7f3a4c06ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.064+0000 7f3a51a24640 1 -- 172.21.15.82:0/3251975299 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0cd5e0 con 0x7f3a4c06c120 2023-07-20T11:24:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a51a24640 1 --2- 172.21.15.82:0/3251975299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c0cdde0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3a480097c0 tx=0x7f3a4801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361256fc03d0d39b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a50a22640 1 -- 172.21.15.82:0/3251975299 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48004230 con 0x7f3a4c06c120 2023-07-20T11:24:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a50a22640 1 -- 172.21.15.82:0/3251975299 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a480a7050 con 0x7f3a4c06c120 2023-07-20T11:24:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a50a22640 1 -- 172.21.15.82:0/3251975299 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48003620 con 0x7f3a4c06c120 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 -- 172.21.15.82:0/3251975299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 msgr2=0x7f3a4c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 --2- 172.21.15.82:0/3251975299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c0cdde0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3a480097c0 tx=0x7f3a4801c330 comp rx=0 tx=0).stop 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 -- 172.21.15.82:0/3251975299 shutdown_connections 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 --2- 172.21.15.82:0/3251975299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c0cdde0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 -- 172.21.15.82:0/3251975299 >> 172.21.15.82:0/3251975299 conn(0x7f3a4c08c0a0 msgr2=0x7f3a4c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 -- 172.21.15.82:0/3251975299 shutdown_connections 2023-07-20T11:24:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.068+0000 7f3a53c88640 1 -- 172.21.15.82:0/3251975299 wait complete. 2023-07-20T11:24:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 Processor -- start 2023-07-20T11:24:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- start start 2023-07-20T11:24:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a4c1602b0 0x7f3a4c0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1564a0 con 0x7f3a4c06b220 2023-07-20T11:24:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0c70e0 con 0x7f3a4c06c120 2023-07-20T11:24:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0c6560 con 0x7f3a4c1602b0 2023-07-20T11:24:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51a24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51a24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38498/0 (socket says 172.21.15.82:38498) 2023-07-20T11:24:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51a24640 1 -- 172.21.15.82:0/509178437 learned_addr learned my addr 172.21.15.82:0/509178437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a52225640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a4c1602b0 0x7f3a4c0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 -- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a4c1602b0 msgr2=0x7f3a4c0c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a4c1602b0 0x7f3a4c0c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 -- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 msgr2=0x7f3a4c155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 -- 172.21.15.82:0/509178437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48009420 con 0x7f3a4c06c120 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51a24640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a51223640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c152850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c390 tx=0x7f3a3c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c005cf0 con 0x7f3a4c06c120 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c005e50 con 0x7f3a4c06c120 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0072d0 con 0x7f3a4c06c120 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0c6840 con 0x7f3a4c06c120 2023-07-20T11:24:38.068 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.072+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0c6e00 con 0x7f3a4c06c120 2023-07-20T11:24:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c04da30 con 0x7f3a4c06c120 2023-07-20T11:24:38.069 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 122) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f3a3c007430 con 0x7f3a4c06c120 2023-07-20T11:24:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a427fc640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 0x7f3a300688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a51a24640 1 -- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 msgr2=0x7f3a300688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f3a3c083500 con 0x7f3a4c06c120 2023-07-20T11:24:38.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.076+0000 7f3a51a24640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 0x7f3a300688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:38.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.080+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a3c0507a0 con 0x7f3a4c06c120 2023-07-20T11:24:38.122 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.129+0000 7fef4d42f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:38.150 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:38.160+0000 7f9dcc646180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:38.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.232+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f3a4c0cee40 con 0x7f3a4c06c120 2023-07-20T11:24:38.232 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.240+0000 7f3a427fc640 1 -- 172.21.15.82:0/509178437 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3a3c053dc0 con 0x7f3a4c06c120 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 msgr2=0x7f3a300688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 0x7f3a300688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 msgr2=0x7f3a4c152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c152850 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c390 tx=0x7f3a3c00c850 comp rx=0 tx=0).stop 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 shutdown_connections 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f3a300663f0 0x7f3a300688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3a4c1602b0 0x7f3a4c0c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a4c06c120 0x7f3a4c152850 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 --2- 172.21.15.82:0/509178437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a4c06b220 0x7f3a4c155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 >> 172.21.15.82:0/509178437 conn(0x7f3a4c08c0a0 msgr2=0x7f3a4c15a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:38.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 shutdown_connections 2023-07-20T11:24:38.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.244+0000 7f3a53c88640 1 -- 172.21.15.82:0/509178437 wait complete. 2023-07-20T11:24:38.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:38.254 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-20T11:24:38.269 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-20T11:24:38.273 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.281+0000 7fef4d42f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:38.304 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:38.312+0000 7f9dcc646180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:38.449 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 Processor -- start 2023-07-20T11:24:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 -- start start 2023-07-20T11:24:38.450 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21f80ca5a0 0x7f21f815e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8071950 con 0x7f21f815ec90 2023-07-20T11:24:38.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f815b230 con 0x7f21f806f710 2023-07-20T11:24:38.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f220006d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815bad0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.451 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21f80ca5a0 0x7f21f815e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f21f80ca5a0 0x7f21f815e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38502/0 (socket says 172.21.15.82:38502) 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fe60a640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f21f815ec90 0x7f21f815a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:36700/0 (socket says 172.21.15.82:36700) 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 -- 172.21.15.82:0/2625074352 learned_addr learned my addr 172.21.15.82:0/2625074352 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 -- 172.21.15.82:0/2625074352 >> v1:172.21.15.183:6789/0 conn(0x7f21f806f710 legacy=0x7f21f806faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 -- 172.21.15.82:0/2625074352 >> v1:172.21.15.82:6789/0 conn(0x7f21f815ec90 legacy=0x7f21f815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.452 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.460+0000 7f21fd608640 1 -- 172.21.15.82:0/2625074352 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f815b510 con 0x7f21f80ca5a0 2023-07-20T11:24:38.455 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.464+0000 7f21fd608640 1 --2- 172.21.15.82:0/2625074352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f815e750 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098a0 tx=0x7f21e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d375164c37eab server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f21fce07640 1 -- 172.21.15.82:0/2625074352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80ab600 con 0x7f21f80ca5a0 2023-07-20T11:24:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f21fce07640 1 -- 172.21.15.82:0/2625074352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80ab760 con 0x7f21f80ca5a0 2023-07-20T11:24:38.457 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f21fce07640 1 -- 172.21.15.82:0/2625074352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80abaf0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- 172.21.15.82:0/2625074352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 msgr2=0x7f21f815e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 --2- 172.21.15.82:0/2625074352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f815e750 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f21e80098a0 tx=0x7f21e801c4f0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- 172.21.15.82:0/2625074352 shutdown_connections 2023-07-20T11:24:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 --2- 172.21.15.82:0/2625074352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f815e750 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- 172.21.15.82:0/2625074352 >> 172.21.15.82:0/2625074352 conn(0x7f21f80cad50 msgr2=0x7f21f80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- 172.21.15.82:0/2625074352 shutdown_connections 2023-07-20T11:24:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- 172.21.15.82:0/2625074352 wait complete. 2023-07-20T11:24:38.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 Processor -- start 2023-07-20T11:24:38.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 -- start start 2023-07-20T11:24:38.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21f806f710 0x7f21f80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.468+0000 7f220006d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f80af570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21f815ec90 0x7f21f80afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80aea50 con 0x7f21f80ca5a0 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80ae490 con 0x7f21f806f710 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80ae770 con 0x7f21f815ec90 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f80af570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f80af570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38508/0 (socket says 172.21.15.82:38508) 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 -- 172.21.15.82:0/991308948 learned_addr learned my addr 172.21.15.82:0/991308948 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:38.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21f806f710 0x7f21f80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fe60a640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21f815ec90 0x7f21f80afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21f815ec90 msgr2=0x7f21f80afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f21f815ec90 0x7f21f80afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21f806f710 msgr2=0x7f21f80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21f806f710 0x7f21f80acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e80094d0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21fd608640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f80af570 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f21e80ad040 tx=0x7f21e801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:38.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80b4800 con 0x7f21f80ca5a0 2023-07-20T11:24:38.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80b4980 con 0x7f21f80ca5a0 2023-07-20T11:24:38.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80c6630 con 0x7f21f80ca5a0 2023-07-20T11:24:38.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80b4d30 con 0x7f21f80ca5a0 2023-07-20T11:24:38.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f81509a0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804da30 con 0x7f21f80ca5a0 2023-07-20T11:24:38.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.472+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 122) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f21e80bd3e0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.476+0000 7f21ee7fc640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:38.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.476+0000 7f21fde09640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:38.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.476+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f21e811e2e0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.476+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:38.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.480+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21e80eb5a0 con 0x7f21f80ca5a0 2023-07-20T11:24:38.638 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.648+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f8168440 con 0x7f21dc066420 2023-07-20T11:24:38.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.680+0000 7f21fde09640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:38.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:38.680+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-20T11:24:38.758 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.765+0000 7fef4d42f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:38.791 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:38.800+0000 7f9dcc646180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:38.817 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.825+0000 7fef4d42f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:38.850 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:38.860+0000 7f9dcc646180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:38.872 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.881+0000 7fef4d42f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:38.905 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:38.912+0000 7f9dcc646180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:38.958 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:38.965+0000 7fef4d42f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:38.990 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.000+0000 7f9dcc646180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:39.016 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.025+0000 7fef4d42f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:39.047 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.056+0000 7f9dcc646180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:39.084+0000 7f21fde09640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:39.084+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-20T11:24:39.100 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.109+0000 7fef4d42f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:39.131 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.140+0000 7f9dcc646180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:39.156 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.165+0000 7fef4d42f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:39.186 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.196+0000 7f9dcc646180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:39.299 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.305+0000 7fef4d42f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:39.327 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.336+0000 7f9dcc646180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:39.356 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.365+0000 7fef4d42f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:39.385 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.396+0000 7f9dcc646180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:39.596 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:39.597 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:39.597 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:39.605 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.613+0000 7fef4d42f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:39.625 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:39.625 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:39.625 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:39.633 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.644+0000 7f9dcc646180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:39.742 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.749+0000 7fef4d42f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:39.769 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.776+0000 7f9dcc646180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:39.867 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.877+0000 7fef4d42f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:39.888+0000 7f21fde09640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/1948044010 2023-07-20T11:24:39.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:39.888+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-20T11:24:39.892 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.900+0000 7f9dcc646180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:39.936 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:39.945+0000 7fef4d42f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:39.963 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:39.972+0000 7f9dcc646180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:40.071 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:40.081+0000 7fef4d42f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:40.096 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:40.104+0000 7f9dcc646180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:40.609 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:40.617+0000 7fef4d42f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:40.629 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:40.636+0000 7f9dcc646180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:40.699 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:40.709+0000 7fef4d42f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:40.717 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:40.728+0000 7f9dcc646180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:40.846 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:40.853+0000 7fef4d42f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:40.864 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:40.872+0000 7f9dcc646180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:40.930 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:40.937+0000 7fef4d42f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:40.946 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:40.956+0000 7f9dcc646180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:41.201 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:41.209+0000 7fef4d42f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:41.213 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.224+0000 7f9dcc646180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:41.261 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:41.269+0000 7fef4d42f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:41.273 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.284+0000 7f9dcc646180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:41.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:41.296+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 123) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f21e811c650 con 0x7f21f80ca5a0 2023-07-20T11:24:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:41.296+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 msgr2=0x7f21dc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:41.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:41.296+0000 7f21ee7fc640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/1948044010,v1:172.21.15.82:6833/1948044010] conn(0x7f21dc066420 0x7f21dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:41.405 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d51bf1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.405 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d51bf1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.405 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d51bf1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d51bf1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d51bf1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.406 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d4eaeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d4eaeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d4eaeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d4eaeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:41.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:41.412+0000 7f9d4eaeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:42.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.300+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 124) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f21e80eb970 con 0x7f21f80ca5a0 2023-07-20T11:24:42.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.300+0000 7f21ee7fc640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f21dc033ee0 0x7f21dc0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.300+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 --> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f21dc0342c0 con 0x7f21dc033ee0 2023-07-20T11:24:42.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.304+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f21dc033ee0 0x7f21dc0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.304+0000 7f21fde09640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f21dc033ee0 0x7f21dc0709f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f21f80c8430 tx=0x7f21f4007e40 comp rx=0 tx=0).ready entity=mgr.10531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.368+0000 7f21ee7fc640 1 -- 172.21.15.82:0/991308948 <== mgr.10531 v2:172.21.15.82:6832/3699090616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f21dc0342c0 con 0x7f21dc033ee0 2023-07-20T11:24:42.361 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path snap_test_dir1 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f21dc033ee0 msgr2=0x7f21dc0709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f21dc033ee0 0x7f21dc0709f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f21f80c8430 tx=0x7f21f4007e40 comp rx=0 tx=0).stop 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 msgr2=0x7f21f80af570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 --2- 172.21.15.82:0/991308948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f21f80ca5a0 0x7f21f80af570 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f21e80ad040 tx=0x7f21e801ad30 comp rx=0 tx=0).stop 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f21fe60a640 1 -- 172.21.15.82:0/991308948 reap_dead start 2023-07-20T11:24:42.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 shutdown_connections 2023-07-20T11:24:42.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 >> 172.21.15.82:0/991308948 conn(0x7f21f80cad50 msgr2=0x7f21f80ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:42.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 shutdown_connections 2023-07-20T11:24:42.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.372+0000 7f220006d640 1 -- 172.21.15.82:0/991308948 wait complete. 2023-07-20T11:24:42.383 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-20T11:24:42.383 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-20T11:24:42.529 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 Processor -- start 2023-07-20T11:24:42.530 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 -- start start 2023-07-20T11:24:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd934159450 0x7fd93415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9340cc8d0 con 0x7fd934159830 2023-07-20T11:24:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9340ccbb0 con 0x7fd9340afd50 2023-07-20T11:24:42.531 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd93b056640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340cce90 con 0x7fd934159450 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd934159450 0x7fd93415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd934159450 0x7fd93415a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38644/0 (socket says 172.21.15.82:38644) 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 -- 172.21.15.82:0/620649534 learned_addr learned my addr 172.21.15.82:0/620649534 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 -- 172.21.15.82:0/620649534 >> v1:172.21.15.183:6789/0 conn(0x7fd9340afd50 legacy=0x7fd9340b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 -- 172.21.15.82:0/620649534 >> v1:172.21.15.82:6789/0 conn(0x7fd934159830 legacy=0x7fd9340cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.532 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.540+0000 7fd938df2640 1 -- 172.21.15.82:0/620649534 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd934159cc0 con 0x7fd934159450 2023-07-20T11:24:42.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd938df2640 1 --2- 172.21.15.82:0/620649534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93415a4c0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009870 tx=0x7fd91c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0610ec806b3c64 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd9337fe640 1 -- 172.21.15.82:0/620649534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0ab600 con 0x7fd934159450 2023-07-20T11:24:42.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd9337fe640 1 -- 172.21.15.82:0/620649534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c0a7050 con 0x7fd934159450 2023-07-20T11:24:42.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd9337fe640 1 -- 172.21.15.82:0/620649534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0ab980 con 0x7fd934159450 2023-07-20T11:24:42.535 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- 172.21.15.82:0/620649534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 msgr2=0x7fd93415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 --2- 172.21.15.82:0/620649534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93415a4c0 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009870 tx=0x7fd91c01c3d0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- 172.21.15.82:0/620649534 shutdown_connections 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 --2- 172.21.15.82:0/620649534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93415a4c0 unknown :-1 s=CLOSED pgs=2442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- 172.21.15.82:0/620649534 >> 172.21.15.82:0/620649534 conn(0x7fd9340cad50 msgr2=0x7fd9340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- 172.21.15.82:0/620649534 shutdown_connections 2023-07-20T11:24:42.536 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- 172.21.15.82:0/620649534 wait complete. 2023-07-20T11:24:42.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 Processor -- start 2023-07-20T11:24:42.537 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.544+0000 7fd93b056640 1 -- start start 2023-07-20T11:24:42.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 0x7fd9340c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 0x7fd93415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340c1270 con 0x7fd934159450 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340c5a10 con 0x7fd9340afd50 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340c5cf0 con 0x7fd93414d270 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38652/0 (socket says 172.21.15.82:38652) 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 -- 172.21.15.82:0/1137721211 learned_addr learned my addr 172.21.15.82:0/1137721211 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd938df2640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 0x7fd9340c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.539 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd9395f3640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 0x7fd93415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.540 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 -- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 msgr2=0x7fd93415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 0x7fd93415ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 -- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 msgr2=0x7fd9340c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 0x7fd9340c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 -- 172.21.15.82:0/1137721211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0094d0 con 0x7fd934159450 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd9395f3640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 0x7fd93415ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:42.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd938df2640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 0x7fd9340c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd933fff640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fd924009e30 tx=0x7fd92400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924018070 con 0x7fd934159450 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92400ce10 con 0x7fd934159450 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340c5fd0 con 0x7fd934159450 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924004260 con 0x7fd934159450 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93414bee0 con 0x7fd934159450 2023-07-20T11:24:42.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.548+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93404da30 con 0x7fd934159450 2023-07-20T11:24:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.552+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 124) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fd9240087f0 con 0x7fd934159450 2023-07-20T11:24:42.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.552+0000 7fd9317fa640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 0x7fd9140685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.552+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fd924085d40 con 0x7fd934159450 2023-07-20T11:24:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.552+0000 7fd938df2640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 0x7fd9140685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.552+0000 7fd938df2640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 0x7fd9140685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0ad000 tx=0x7fd91c008040 comp rx=0 tx=0).ready entity=mgr.10531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.556+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd924053290 con 0x7fd934159450 2023-07-20T11:24:42.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.724+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 --> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd93415aa00 con 0x7fd914066120 2023-07-20T11:24:42.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd9317fa640 1 -- 172.21.15.82:0/1137721211 <== mgr.10531 v2:172.21.15.82:6832/3699090616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fd91c0bb0e0 con 0x7fd914066120 2023-07-20T11:24:42.766 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path snap_test_dir1 2023-07-20T11:24:42.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 msgr2=0x7fd9140685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 0x7fd9140685e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0ad000 tx=0x7fd91c008040 comp rx=0 tx=0).stop 2023-07-20T11:24:42.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 msgr2=0x7fd93414b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fd924009e30 tx=0x7fd92400c430 comp rx=0 tx=0).stop 2023-07-20T11:24:42.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 shutdown_connections 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fd914066120 0x7fd9140685e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd93414d270 0x7fd93415ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd934159450 0x7fd93414b9a0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 --2- 172.21.15.82:0/1137721211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd9340afd50 0x7fd9340c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 >> 172.21.15.82:0/1137721211 conn(0x7fd9340cad50 msgr2=0x7fd9340b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 shutdown_connections 2023-07-20T11:24:42.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.776+0000 7fd93b056640 1 -- 172.21.15.82:0/1137721211 wait complete. 2023-07-20T11:24:42.787 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-20T11:24:42.791 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-20-11_25_00 in ~18s... 2023-07-20T11:24:42.791 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-20T11:24:42.792 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-20T11:24:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 Processor -- start 2023-07-20T11:24:42.935 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 -- start start 2023-07-20T11:24:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80afd50 0x7f26a80ac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f26a80ad580 0x7f26a80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a8160820 0x7f26a8160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.936 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a8160390 con 0x7f26a80afd50 2023-07-20T11:24:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80b0670 con 0x7f26a80ad580 2023-07-20T11:24:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26ad8df640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80cc1d0 con 0x7f26a8160820 2023-07-20T11:24:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80afd50 0x7f26a80ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f26a80afd50 0x7f26a80ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38668/0 (socket says 172.21.15.82:38668) 2023-07-20T11:24:42.937 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 -- 172.21.15.82:0/3951845769 learned_addr learned my addr 172.21.15.82:0/3951845769 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a77fe640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a8160820 0x7f26a8160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a67fc640 1 --2- 172.21.15.82:0/3951845769 >> v2:172.21.15.183:3300/0 conn(0x7f26a80ad580 0x7f26a80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 -- 172.21.15.82:0/3951845769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a8160820 msgr2=0x7f26a8160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a8160820 0x7f26a8160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 -- 172.21.15.82:0/3951845769 >> v2:172.21.15.183:3300/0 conn(0x7f26a80ad580 msgr2=0x7f26a80b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:42.938 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3951845769 >> v2:172.21.15.183:3300/0 conn(0x7f26a80ad580 0x7f26a80b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.944+0000 7f26a6ffd640 1 -- 172.21.15.82:0/3951845769 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80cc4b0 con 0x7f26a80afd50 2023-07-20T11:24:42.939 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80afd50 0x7f26a80ac770 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f26a80cbe30 tx=0x7f269801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9800c171d337a86a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26a5ffb640 1 -- 172.21.15.82:0/3951845769 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980aa610 con 0x7f26a80afd50 2023-07-20T11:24:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26a5ffb640 1 -- 172.21.15.82:0/3951845769 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26980a6040 con 0x7f26a80afd50 2023-07-20T11:24:42.940 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26a5ffb640 1 -- 172.21.15.82:0/3951845769 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980aa990 con 0x7f26a80afd50 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 -- 172.21.15.82:0/3951845769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80afd50 msgr2=0x7f26a80ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80afd50 0x7f26a80ac770 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f26a80cbe30 tx=0x7f269801c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 -- 172.21.15.82:0/3951845769 shutdown_connections 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3951845769 >> v2:172.21.15.183:3300/0 conn(0x7f26a80ad580 0x7f26a80b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a8160820 0x7f26a8160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.941 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3951845769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a80afd50 0x7f26a80ac770 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 -- 172.21.15.82:0/3951845769 >> 172.21.15.82:0/3951845769 conn(0x7f26a80cad50 msgr2=0x7f26a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:42.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 -- 172.21.15.82:0/3951845769 shutdown_connections 2023-07-20T11:24:42.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.948+0000 7f26ad8df640 1 -- 172.21.15.82:0/3951845769 wait complete. 2023-07-20T11:24:42.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 Processor -- start 2023-07-20T11:24:42.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- start start 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a80ad580 0x7f26a81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26a80afd50 0x7f26a8154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80c1320 con 0x7f26a8160820 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a8154e70 con 0x7f26a80afd50 2023-07-20T11:24:42.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a81557f0 con 0x7f26a80ad580 2023-07-20T11:24:42.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38684/0 (socket says 172.21.15.82:38684) 2023-07-20T11:24:42.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 -- 172.21.15.82:0/3232996423 learned_addr learned my addr 172.21.15.82:0/3232996423 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:42.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a67fc640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26a80afd50 0x7f26a8154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a80ad580 0x7f26a81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 -- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a80ad580 msgr2=0x7f26a81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a80ad580 0x7f26a81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 -- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26a80afd50 msgr2=0x7f26a8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:42.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26a80afd50 0x7f26a8154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 -- 172.21.15.82:0/3232996423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980094d0 con 0x7f26a8160820 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26a77fe640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f26a000efc0 tx=0x7f26a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0009ba0 con 0x7f26a8160820 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a000f040 con 0x7f26a8160820 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8155ad0 con 0x7f26a8160820 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00146c0 con 0x7f26a8160820 2023-07-20T11:24:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.952+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a8156090 con 0x7f26a8160820 2023-07-20T11:24:42.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a804da30 con 0x7f26a8160820 2023-07-20T11:24:42.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 124) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f26a0014820 con 0x7f26a8160820 2023-07-20T11:24:42.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f268ffff640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 0x7f2694068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:42.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f26a00845c0 con 0x7f26a8160820 2023-07-20T11:24:42.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 0x7f2694068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:42.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.956+0000 7f26a6ffd640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 0x7f2694068610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26980ae000 tx=0x7f26980b5040 comp rx=0 tx=0).ready entity=mgr.10531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:42.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:42.960+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26a0051bc0 con 0x7f26a8160820 2023-07-20T11:24:43.118 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.128+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 --> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26a80cbea0 con 0x7f2694066150 2023-07-20T11:24:43.125 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.132+0000 7f268ffff640 1 -- 172.21.15.82:0/3232996423 <== mgr.10531 v2:172.21.15.82:6832/3699090616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f26980aa630 con 0x7f2694066150 2023-07-20T11:24:43.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:43.125 INFO:teuthology.orchestra.run.smithi082.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-20T11:24:43.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 msgr2=0x7f2694068610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 0x7f2694068610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26980ae000 tx=0x7f26980b5040 comp rx=0 tx=0).stop 2023-07-20T11:24:43.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 msgr2=0x7f26a80c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f26a000efc0 tx=0x7f26a000c490 comp rx=0 tx=0).stop 2023-07-20T11:24:43.127 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 shutdown_connections 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2694066150 0x7f2694068610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f26a8160820 0x7f26a80c22a0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26a80afd50 0x7f26a8154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 --2- 172.21.15.82:0/3232996423 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f26a80ad580 0x7f26a81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 >> 172.21.15.82:0/3232996423 conn(0x7f26a80cad50 msgr2=0x7f26a8158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 shutdown_connections 2023-07-20T11:24:43.128 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.136+0000 7f26ad8df640 1 -- 172.21.15.82:0/3232996423 wait complete. 2023-07-20T11:24:43.146 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-20T11:24:43.146 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-20T11:24:43.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-20T11:24:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 Processor -- start 2023-07-20T11:24:43.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 -- start start 2023-07-20T11:24:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b180cccd0 0x7f2b180b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180b4920 con 0x7f2b1815c710 2023-07-20T11:24:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180ced70 con 0x7f2b180b44d0 2023-07-20T11:24:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b1d5ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1815caf0 con 0x7f2b180cccd0 2023-07-20T11:24:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b0e7fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f2b180cccd0 0x7f2b180b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b16ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f2b1815c710 0x7f2b180ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47808/0 (socket says 172.21.15.82:47808) 2023-07-20T11:24:43.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b16ffd640 1 -- 172.21.15.82:0/1213363145 learned_addr learned my addr 172.21.15.82:0/1213363145 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:43.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1213363145 >> v1:172.21.15.183:6789/0 conn(0x7f2b180b44d0 legacy=0x7f2b180b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1213363145 >> v1:172.21.15.82:6789/0 conn(0x7f2b1815c710 legacy=0x7f2b180ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.300+0000 7f2b0e7fc640 1 -- 172.21.15.82:0/1213363145 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180cd160 con 0x7f2b180cccd0 2023-07-20T11:24:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b0e7fc640 1 --2- 172.21.15.82:0/1213363145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b180cccd0 0x7f2b180b3f90 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f2b000097c0 tx=0x7f2b0001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f22154570ea3a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b167fc640 1 -- 172.21.15.82:0/1213363145 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000a8970 con 0x7f2b180cccd0 2023-07-20T11:24:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b167fc640 1 -- 172.21.15.82:0/1213363145 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b000a8ad0 con 0x7f2b180cccd0 2023-07-20T11:24:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b167fc640 1 -- 172.21.15.82:0/1213363145 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000a8e60 con 0x7f2b180cccd0 2023-07-20T11:24:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/1213363145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b180cccd0 msgr2=0x7f2b180b3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/1213363145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b180cccd0 0x7f2b180b3f90 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7f2b000097c0 tx=0x7f2b0001ec70 comp rx=0 tx=0).stop 2023-07-20T11:24:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/1213363145 shutdown_connections 2023-07-20T11:24:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/1213363145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b180cccd0 0x7f2b180b3f90 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/1213363145 >> 172.21.15.82:0/1213363145 conn(0x7f2b18065710 msgr2=0x7f2b18065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:43.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/1213363145 shutdown_connections 2023-07-20T11:24:43.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.304+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/1213363145 wait complete. 2023-07-20T11:24:43.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 Processor -- start 2023-07-20T11:24:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- start start 2023-07-20T11:24:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b180b44d0 0x7f2b180c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1815c710 0x7f2b181525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815e690 con 0x7f2b18155630 2023-07-20T11:24:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815f210 con 0x7f2b180b44d0 2023-07-20T11:24:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815e8e0 con 0x7f2b1815c710 2023-07-20T11:24:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58082/0 (socket says 172.21.15.82:58082) 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 -- 172.21.15.82:0/3449058833 learned_addr learned my addr 172.21.15.82:0/3449058833 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b0e7fc640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1815c710 0x7f2b181525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b16ffd640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b180b44d0 0x7f2b180c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 -- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1815c710 msgr2=0x7f2b181525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1815c710 0x7f2b181525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 -- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b180b44d0 msgr2=0x7f2b180c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b180b44d0 0x7f2b180c87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 -- 172.21.15.82:0/3449058833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00009420 con 0x7f2b18155630 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b177fe640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000c370 tx=0x7f2b1000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10005220 con 0x7f2b18155630 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b10005380 con 0x7f2b18155630 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10007270 con 0x7f2b18155630 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1815ebc0 con 0x7f2b18155630 2023-07-20T11:24:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.308+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b180c8cf0 con 0x7f2b18155630 2023-07-20T11:24:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1815f680 con 0x7f2b18155630 2023-07-20T11:24:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 124) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f2b100073d0 con 0x7f2b18155630 2023-07-20T11:24:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b0ffff640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 0x7f2af80685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f2b10082f30 con 0x7f2b18155630 2023-07-20T11:24:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b16ffd640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 0x7f2af80685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.312+0000 7f2b16ffd640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 0x7f2af80685e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005c10 tx=0x7f2b08009040 comp rx=0 tx=0).ready entity=mgr.10531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.316+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b10050570 con 0x7f2b18155630 2023-07-20T11:24:43.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.476+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 125) v1 ==== 85778+0+0 (secure 0 0 0) 0x7f2b10050940 con 0x7f2b18155630 2023-07-20T11:24:43.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.496+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 --> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b180cd720 con 0x7f2af8066120 2023-07-20T11:24:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.552+0000 7f2b0ffff640 1 -- 172.21.15.82:0/3449058833 <== mgr.10531 v2:172.21.15.82:6832/3699090616 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2b0800fe90 con 0x7f2af8066120 2023-07-20T11:24:43.544 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule removed for path snap_test_dir1 2023-07-20T11:24:43.545 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 msgr2=0x7f2af80685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 0x7f2af80685e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b08005c10 tx=0x7f2b08009040 comp rx=0 tx=0).stop 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 msgr2=0x7f2b181f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 secure :-1 s=READY pgs=2448 cs=0 l=1 rev1=1 crypto rx=0x7f2b1000c370 tx=0x7f2b1000c830 comp rx=0 tx=0).stop 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 shutdown_connections 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f2af8066120 0x7f2af80685e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b18155630 0x7f2b181f5050 unknown :-1 s=CLOSED pgs=2448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f2b1815c710 0x7f2b181525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 --2- 172.21.15.82:0/3449058833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b180b44d0 0x7f2b180c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 >> 172.21.15.82:0/3449058833 conn(0x7f2b18065710 msgr2=0x7f2b180b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 shutdown_connections 2023-07-20T11:24:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.556+0000 7f2b1d5ba640 1 -- 172.21.15.82:0/3449058833 wait complete. 2023-07-20T11:24:43.565 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-20T11:24:43.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:43.566 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-20T11:24:43.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:43.577 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-20T11:24:43.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-20T11:24:43.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.820+0000 7f9a03488640 1 Processor -- start 2023-07-20T11:24:43.813 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.820+0000 7f9a03488640 1 -- start start 2023-07-20T11:24:43.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a03488640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f99fc0cd5b0 0x7f99fc06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a03488640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0caf40 con 0x7f99fc15c720 2023-07-20T11:24:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a03488640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0ce060 con 0x7f99fc0caae0 2023-07-20T11:24:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a03488640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc06c6a0 con 0x7f99fc0cd5b0 2023-07-20T11:24:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f99fc15c720 0x7f99fc0d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47820/0 (socket says 172.21.15.82:47820) 2023-07-20T11:24:43.815 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 -- 172.21.15.82:0/2359307743 learned_addr learned my addr 172.21.15.82:0/2359307743 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:43.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01a25640 1 --2- 172.21.15.82:0/2359307743 >> v2:172.21.15.183:3300/0 conn(0x7f99fc0cd5b0 0x7f99fc06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974271446 0 0) 0x7f99fc0caf40 con 0x7f99fc15c720 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e8003530 con 0x7f99fc15c720 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1053920798 0 0) 0x7f99e8003530 con 0x7f99fc15c720 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 >> v2:172.21.15.183:3300/0 conn(0x7f99fc0cd5b0 msgr2=0x7f99fc06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 --2- 172.21.15.82:0/2359307743 >> v2:172.21.15.183:3300/0 conn(0x7f99fc0cd5b0 0x7f99fc06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 >> v1:172.21.15.183:6789/0 conn(0x7f99fc0caae0 legacy=0x7f99fc0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0ce340 con 0x7f99fc15c720 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f99f8001800 con 0x7f99fc15c720 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 >> v1:172.21.15.82:6789/0 conn(0x7f99fc15c720 legacy=0x7f99fc0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e80047d0 0x7f99e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e8005190 0x7f99e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06c6a0 con 0x7f99e80039f0 2023-07-20T11:24:43.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800c0c0 con 0x7f99e8005190 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800c280 con 0x7f99e80047d0 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01a25640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e8005190 0x7f99e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a00a23640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e80047d0 0x7f99e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 -- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e80047d0 msgr2=0x7f99e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99e80047d0 0x7f99e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 -- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e8005190 msgr2=0x7f99e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99e8005190 0x7f99e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01224640 1 -- 172.21.15.82:0/2359307743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8003530 con 0x7f99e80039f0 2023-07-20T11:24:43.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.824+0000 7f9a01a25640 1 -- 172.21.15.82:0/2359307743 reap_dead start 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a01224640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99e8003e10 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c240 tx=0x7f99f801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3ac24ed06cb08c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8007270 con 0x7f99e80039f0 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80073f0 con 0x7f99e80039f0 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f99f3fff640 1 -- 172.21.15.82:0/2359307743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80057b0 con 0x7f99e80039f0 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 -- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 msgr2=0x7f99e8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99e8003e10 secure :-1 s=READY pgs=2452 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c240 tx=0x7f99f801cb70 comp rx=0 tx=0).stop 2023-07-20T11:24:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 -- 172.21.15.82:0/2359307743 shutdown_connections 2023-07-20T11:24:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 --2- 172.21.15.82:0/2359307743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99e8003e10 unknown :-1 s=CLOSED pgs=2452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 -- 172.21.15.82:0/2359307743 >> 172.21.15.82:0/2359307743 conn(0x7f99fc065310 msgr2=0x7f99fc065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 -- 172.21.15.82:0/2359307743 shutdown_connections 2023-07-20T11:24:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.828+0000 7f9a03488640 1 -- 172.21.15.82:0/2359307743 wait complete. 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 Processor -- start 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- start start 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0ca450 0x7f99fc1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 0x7f99fc06b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06be20 con 0x7f99e80039f0 2023-07-20T11:24:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0c8870 con 0x7f99fc06b430 2023-07-20T11:24:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc14f360 con 0x7f99fc0ca450 2023-07-20T11:24:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58110/0 (socket says 172.21.15.82:58110) 2023-07-20T11:24:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 -- 172.21.15.82:0/4120965995 learned_addr learned my addr 172.21.15.82:0/4120965995 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01a25640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 0x7f99fc06b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 -- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0ca450 msgr2=0x7f99fc1f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0ca450 0x7f99fc1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 -- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 msgr2=0x7f99fc06b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 0x7f99fc06b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 -- 172.21.15.82:0/4120965995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc14f640 con 0x7f99e80039f0 2023-07-20T11:24:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01a25640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 0x7f99fc06b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a01224640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f99f8000f00 tx=0x7f99e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80b4070 con 0x7f99e80039f0 2023-07-20T11:24:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80a5dd0 con 0x7f99e80039f0 2023-07-20T11:24:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8000f80 con 0x7f99e80039f0 2023-07-20T11:24:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc14f920 con 0x7f99e80039f0 2023-07-20T11:24:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0c8480 con 0x7f99e80039f0 2023-07-20T11:24:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.832+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc0cc670 con 0x7f99e80039f0 2023-07-20T11:24:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.836+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 125) v1 ==== 85778+0+0 (secure 0 0 0) 0x7f99f80070d0 con 0x7f99e80039f0 2023-07-20T11:24:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.836+0000 7f99f1ffb640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 0x7f99e00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.836+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f99f811d930 con 0x7f99e80039f0 2023-07-20T11:24:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.836+0000 7f9a00a23640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 0x7f99e00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.836+0000 7f9a00a23640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 0x7f99e00688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0b13d0 tx=0x7f99ec009040 comp rx=0 tx=0).ready entity=mgr.10531 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:43.840+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99f80eaaf0 con 0x7f99e80039f0 2023-07-20T11:24:44.012 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.020+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f99fc04da30 con 0x7f99e80039f0 2023-07-20T11:24:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.484+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f99f80eaec0 con 0x7f99e80039f0 2023-07-20T11:24:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f99f1ffb640 1 -- 172.21.15.82:0/4120965995 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v126) v1 ==== 93+0+0 (secure 0 0 0) 0x7f99f81175f0 con 0x7f99e80039f0 2023-07-20T11:24:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 msgr2=0x7f99e00688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 0x7f99e00688b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0b13d0 tx=0x7f99ec009040 comp rx=0 tx=0).stop 2023-07-20T11:24:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 msgr2=0x7f99fc0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7f99f8000f00 tx=0x7f99e8005800 comp rx=0 tx=0).stop 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 shutdown_connections 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f99e00663f0 0x7f99e00688b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b430 0x7f99fc06b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f99fc0ca450 0x7f99fc1f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 --2- 172.21.15.82:0/4120965995 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f99e80039f0 0x7f99fc0c7f40 unknown :-1 s=CLOSED pgs=2453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 >> 172.21.15.82:0/4120965995 conn(0x7f99fc065310 msgr2=0x7f99fc0b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 shutdown_connections 2023-07-20T11:24:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.488+0000 7f9a03488640 1 -- 172.21.15.82:0/4120965995 wait complete. 2023-07-20T11:24:44.501 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-20T11:24:44.502 DEBUG:teuthology.orchestra.run.smithi082:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:44.576 DEBUG:teuthology.orchestra.run.smithi183:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-20T11:24:44.637 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-20T11:24:44.638 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:44.638 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:44.647 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:44.648 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:44.648 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:44.657+0000 7f1d25d97180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:44.652 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:44.660+0000 7fdeab9a6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-20T11:24:44.660 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 Processor -- start 2023-07-20T11:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 -- start start 2023-07-20T11:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc56c0b2180 0x7fc56c163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0cde70 con 0x7fc56c0ca040 2023-07-20T11:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c0cbef0 con 0x7fc56c0ad060 2023-07-20T11:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc570d00640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c15d730 con 0x7fc56c0b2180 2023-07-20T11:24:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc56c0b2180 0x7fc56c163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc56c0b2180 0x7fc56c163c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58122/0 (socket says 172.21.15.82:58122) 2023-07-20T11:24:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fc56c0ca040 0x7fc56c15c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47832/0 (socket says 172.21.15.82:47832) 2023-07-20T11:24:44.848 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 -- 172.21.15.82:0/2944347104 learned_addr learned my addr 172.21.15.82:0/2944347104 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 -- 172.21.15.82:0/2944347104 >> v1:172.21.15.183:6789/0 conn(0x7fc56c0ad060 legacy=0x7fc56c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 -- 172.21.15.82:0/2944347104 >> v1:172.21.15.82:6789/0 conn(0x7fc56c0ca040 legacy=0x7fc56c15c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56959a640 1 -- 172.21.15.82:0/2944347104 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381387899 0 0) 0x7fc56c0cde70 con 0x7fc56c0ca040 2023-07-20T11:24:44.849 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.856+0000 7fc56ad9d640 1 -- 172.21.15.82:0/2944347104 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0ca420 con 0x7fc56c0b2180 2023-07-20T11:24:44.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc56ad9d640 1 --2- 172.21.15.82:0/2944347104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0b2180 0x7fc56c163c40 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7fc56400af60 tx=0x7fc56401db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27096c119b06dce6 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:44.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc56959a640 1 -- 172.21.15.82:0/2944347104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400a2d0 con 0x7fc56c0b2180 2023-07-20T11:24:44.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc56959a640 1 -- 172.21.15.82:0/2944347104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640a6770 con 0x7fc56c0b2180 2023-07-20T11:24:44.851 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc56959a640 1 -- 172.21.15.82:0/2944347104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640a6b00 con 0x7fc56c0b2180 2023-07-20T11:24:44.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 -- 172.21.15.82:0/2944347104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0b2180 msgr2=0x7fc56c163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 --2- 172.21.15.82:0/2944347104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0b2180 0x7fc56c163c40 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7fc56400af60 tx=0x7fc56401db10 comp rx=0 tx=0).stop 2023-07-20T11:24:44.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 -- 172.21.15.82:0/2944347104 shutdown_connections 2023-07-20T11:24:44.852 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 --2- 172.21.15.82:0/2944347104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0b2180 0x7fc56c163c40 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 -- 172.21.15.82:0/2944347104 >> 172.21.15.82:0/2944347104 conn(0x7fc56c0cada0 msgr2=0x7fc56c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 -- 172.21.15.82:0/2944347104 shutdown_connections 2023-07-20T11:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.860+0000 7fc570d00640 1 -- 172.21.15.82:0/2944347104 wait complete. 2023-07-20T11:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 Processor -- start 2023-07-20T11:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- start start 2023-07-20T11:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 0x7fc56c153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc56c0ca040 0x7fc56c167210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c7a70 con 0x7fc56c0ad060 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0c7e90 con 0x7fc56c0b2180 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c1541e0 con 0x7fc56c0ca040 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58130/0 (socket says 172.21.15.82:58130) 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 -- 172.21.15.82:0/2109471442 learned_addr learned my addr 172.21.15.82:0/2109471442 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56ad9d640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc56c0ca040 0x7fc56c167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc569d9b640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 0x7fc56c153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 -- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc56c0ca040 msgr2=0x7fc56c167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc56c0ca040 0x7fc56c167210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 -- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 msgr2=0x7fc56c153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 0x7fc56c153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 -- 172.21.15.82:0/2109471442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56400ac40 con 0x7fc56c0ad060 2023-07-20T11:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc569d9b640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 0x7fc56c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc56a59c640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00c440 tx=0x7fc55c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0074e0 con 0x7fc56c0ad060 2023-07-20T11:24:44.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c007640 con 0x7fc56c0ad060 2023-07-20T11:24:44.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c004a10 con 0x7fc56c0ad060 2023-07-20T11:24:44.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c167750 con 0x7fc56c0ad060 2023-07-20T11:24:44.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.864+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c0c70d0 con 0x7fc56c0ad060 2023-07-20T11:24:44.859 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0c7bb0 con 0x7fc56c0ad060 2023-07-20T11:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fc55c004b70 con 0x7fc56c0ad060 2023-07-20T11:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc55affd640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 0x7fc54c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fc55c083100 con 0x7fc56c0ad060 2023-07-20T11:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc569d9b640 1 -- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 msgr2=0x7fc54c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.868+0000 7fc569d9b640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 0x7fc54c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:44.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:44.872+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc56c0c7bb0 con 0x7fc56c0ad060 2023-07-20T11:24:45.014 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.024+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc56c0c7bb0 con 0x7fc56c0ad060 2023-07-20T11:24:45.015 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.024+0000 7fc55affd640 1 -- 172.21.15.82:0/2109471442 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+18887 (secure 0 0 0) 0x7fc56c0c7bb0 con 0x7fc56c0ad060 2023-07-20T11:24:45.016 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:45.016 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":206,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:41.286857+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:6832/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4135921357":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/3061030549":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2009112200":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2902554209":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/367903546":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/666160418":"2023-07-21T11:24:41.286826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 msgr2=0x7fc54c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 0x7fc54c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 msgr2=0x7fc56c0c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00c440 tx=0x7fc55c00c900 comp rx=0 tx=0).stop 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 shutdown_connections 2023-07-20T11:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc54c0663a0 0x7fc54c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc56c0ca040 0x7fc56c167210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc56c0b2180 0x7fc56c153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 --2- 172.21.15.82:0/2109471442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc56c0ad060 0x7fc56c0c6710 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 >> 172.21.15.82:0/2109471442 conn(0x7fc56c0cada0 msgr2=0x7fc56c070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 shutdown_connections 2023-07-20T11:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.028+0000 7fc570d00640 1 -- 172.21.15.82:0/2109471442 wait complete. 2023-07-20T11:24:45.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:24:21.724849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '204', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:24:23.044606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:45.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:45.066 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.073+0000 7f1d25d97180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:45.081 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.088+0000 7fdeab9a6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-20T11:24:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 Processor -- start 2023-07-20T11:24:45.186 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 -- start start 2023-07-20T11:24:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f153c06c120 0x7f153c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.188 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c0d0970 con 0x7f153c06ab10 2023-07-20T11:24:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c160e20 con 0x7f153c06c120 2023-07-20T11:24:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f154386a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0cd300 con 0x7f153c1602b0 2023-07-20T11:24:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f153c06c120 0x7f153c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f153c06c120 0x7f153c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58146/0 (socket says 172.21.15.82:58146) 2023-07-20T11:24:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 -- 172.21.15.82:0/1321233229 learned_addr learned my addr 172.21.15.82:0/1321233229 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1540e05640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 -- 172.21.15.82:0/1321233229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 msgr2=0x7f153c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 -- 172.21.15.82:0/1321233229 >> v1:172.21.15.183:6789/0 conn(0x7f153c06ab10 legacy=0x7f153c06af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.196+0000 7f1541606640 1 -- 172.21.15.82:0/1321233229 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0cd5e0 con 0x7f153c06c120 2023-07-20T11:24:45.191 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f1541606640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06c120 0x7f153c0cdde0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f1538009870 tx=0x7f153801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790998ff6612bcc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f1533fff640 1 -- 172.21.15.82:0/1321233229 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380ab600 con 0x7f153c06c120 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f1533fff640 1 -- 172.21.15.82:0/1321233229 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15380a7050 con 0x7f153c06c120 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f1533fff640 1 -- 172.21.15.82:0/1321233229 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380ab980 con 0x7f153c06c120 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 -- 172.21.15.82:0/1321233229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06c120 msgr2=0x7f153c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06c120 0x7f153c0cdde0 secure :-1 s=READY pgs=2458 cs=0 l=1 rev1=1 crypto rx=0x7f1538009870 tx=0x7f153801c470 comp rx=0 tx=0).stop 2023-07-20T11:24:45.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 -- 172.21.15.82:0/1321233229 shutdown_connections 2023-07-20T11:24:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 --2- 172.21.15.82:0/1321233229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06c120 0x7f153c0cdde0 unknown :-1 s=CLOSED pgs=2458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 -- 172.21.15.82:0/1321233229 >> 172.21.15.82:0/1321233229 conn(0x7f153c08c0a0 msgr2=0x7f153c09b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 -- 172.21.15.82:0/1321233229 shutdown_connections 2023-07-20T11:24:45.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.200+0000 7f154386a640 1 -- 172.21.15.82:0/1321233229 wait complete. 2023-07-20T11:24:45.194 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 Processor -- start 2023-07-20T11:24:45.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- start start 2023-07-20T11:24:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 0x7f153c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c0c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c7a20 con 0x7f153c06ab10 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c6b60 con 0x7f153c06c120 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c1514b0 con 0x7f153c1602b0 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58152/0 (socket says 172.21.15.82:58152) 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 -- 172.21.15.82:0/2538580099 learned_addr learned my addr 172.21.15.82:0/2538580099 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:45.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541e07640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c0c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1540e05640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 0x7f153c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 -- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 msgr2=0x7f153c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c0c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 -- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 msgr2=0x7f153c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 0x7f153c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 -- 172.21.15.82:0/2538580099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380094d0 con 0x7f153c06ab10 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1540e05640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 0x7f153c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1541606640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f153801cd10 tx=0x7f1538019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380b6440 con 0x7f153c06ab10 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15380b65a0 con 0x7f153c06ab10 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c0c6da0 con 0x7f153c06ab10 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380b6950 con 0x7f153c06ab10 2023-07-20T11:24:45.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.204+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c0c7360 con 0x7f153c06ab10 2023-07-20T11:24:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c0c7c90 con 0x7f153c06ab10 2023-07-20T11:24:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f15380b2040 con 0x7f153c06ab10 2023-07-20T11:24:45.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f1531ffb640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 0x7f1520068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f153811e0d0 con 0x7f153c06ab10 2023-07-20T11:24:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f1540e05640 1 -- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 msgr2=0x7f1520068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:45.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.208+0000 7f1540e05640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 0x7f1520068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:45.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.216+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15380eb200 con 0x7f153c06ab10 2023-07-20T11:24:45.217 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.225+0000 7f1d25d97180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:45.239 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.248+0000 7fdeab9a6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-20T11:24:45.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.364+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f153c15f280 con 0x7f153c06ab10 2023-07-20T11:24:45.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.364+0000 7f1531ffb640 1 -- 172.21.15.82:0/2538580099 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v206) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15380ee820 con 0x7f153c06ab10 2023-07-20T11:24:45.357 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:45.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 msgr2=0x7f1520068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:45.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 0x7f1520068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 msgr2=0x7f153c150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f153801cd10 tx=0x7f1538019210 comp rx=0 tx=0).stop 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 shutdown_connections 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f15200663a0 0x7f1520068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f153c1602b0 0x7f153c0c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f153c06c120 0x7f153c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 --2- 172.21.15.82:0/2538580099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f153c06ab10 0x7f153c150890 unknown :-1 s=CLOSED pgs=2459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 >> 172.21.15.82:0/2538580099 conn(0x7f153c08c0a0 msgr2=0x7f153c157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 shutdown_connections 2023-07-20T11:24:45.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.368+0000 7f154386a640 1 -- 172.21.15.82:0/2538580099 wait complete. 2023-07-20T11:24:45.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:45.564 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.572+0000 7fcfeffba640 1 Processor -- start 2023-07-20T11:24:45.565 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.572+0000 7fcfeffba640 1 -- start start 2023-07-20T11:24:45.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfeffba640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 0x7fcfe80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfeffba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcfe81602b0 0x7fcfe8160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfeffba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80d0970 con 0x7fcfe806ab10 2023-07-20T11:24:45.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfeffba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe8160e20 con 0x7fcfe81602b0 2023-07-20T11:24:45.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfeffba640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe80cd300 con 0x7fcfe806c120 2023-07-20T11:24:45.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcfe81602b0 0x7fcfe8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcfe81602b0 0x7fcfe8160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58166/0 (socket says 172.21.15.82:58166) 2023-07-20T11:24:45.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 -- 172.21.15.82:0/161640509 learned_addr learned my addr 172.21.15.82:0/161640509 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:45.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfedd56640 1 --2- 172.21.15.82:0/161640509 >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 0x7fcfe80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 -- 172.21.15.82:0/161640509 >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 msgr2=0x7fcfe80cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:45.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 --2- 172.21.15.82:0/161640509 >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 0x7fcfe80cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 -- 172.21.15.82:0/161640509 >> v1:172.21.15.183:6789/0 conn(0x7fcfe806ab10 legacy=0x7fcfe806af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfed555640 1 -- 172.21.15.82:0/161640509 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80cd5e0 con 0x7fcfe81602b0 2023-07-20T11:24:45.568 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfedd56640 1 --2- 172.21.15.82:0/161640509 >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 0x7fcfe80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:45.569 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.576+0000 7fcfecd54640 1 -- 172.21.15.82:0/161640509 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3353930780 0 0) 0x7fcfe80d0970 con 0x7fcfe806ab10 2023-07-20T11:24:45.571 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfed555640 1 --2- 172.21.15.82:0/161640509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe81602b0 0x7fcfe8160740 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80d00e0 tx=0x7fcfd801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e78658f4ac827aa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfecd54640 1 -- 172.21.15.82:0/161640509 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80ac630 con 0x7fcfe81602b0 2023-07-20T11:24:45.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfecd54640 1 -- 172.21.15.82:0/161640509 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80ac790 con 0x7fcfe81602b0 2023-07-20T11:24:45.572 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfecd54640 1 -- 172.21.15.82:0/161640509 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80acb20 con 0x7fcfe81602b0 2023-07-20T11:24:45.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 -- 172.21.15.82:0/161640509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe81602b0 msgr2=0x7fcfe8160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 --2- 172.21.15.82:0/161640509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe81602b0 0x7fcfe8160740 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80d00e0 tx=0x7fcfd801c3b0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 -- 172.21.15.82:0/161640509 shutdown_connections 2023-07-20T11:24:45.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 --2- 172.21.15.82:0/161640509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe81602b0 0x7fcfe8160740 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.573 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 --2- 172.21.15.82:0/161640509 >> v2:172.21.15.183:3300/0 conn(0x7fcfe806c120 0x7fcfe80cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 -- 172.21.15.82:0/161640509 >> 172.21.15.82:0/161640509 conn(0x7fcfe808c0a0 msgr2=0x7fcfe809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 -- 172.21.15.82:0/161640509 shutdown_connections 2023-07-20T11:24:45.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.580+0000 7fcfeffba640 1 -- 172.21.15.82:0/161640509 wait complete. 2023-07-20T11:24:45.574 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 Processor -- start 2023-07-20T11:24:45.575 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- start start 2023-07-20T11:24:45.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfe806c120 0x7fcfe80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfe81602b0 0x7fcfe80b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.576 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80c8c50 con 0x7fcfe806ab10 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cb220 con 0x7fcfe81602b0 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cb500 con 0x7fcfe806c120 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58172/0 (socket says 172.21.15.82:58172) 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 -- 172.21.15.82:0/227965069 learned_addr learned my addr 172.21.15.82:0/227965069 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfed555640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfe806c120 0x7fcfe80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.577 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfee557640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfe81602b0 0x7fcfe80b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 -- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfe806c120 msgr2=0x7fcfe80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfe806c120 0x7fcfe80cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 -- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfe81602b0 msgr2=0x7fcfe80b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfe81602b0 0x7fcfe80b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.578 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 -- 172.21.15.82:0/227965069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80094d0 con 0x7fcfe806ab10 2023-07-20T11:24:45.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfedd56640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009fc0 tx=0x7fcfe400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4003ba0 con 0x7fcfe806ab10 2023-07-20T11:24:45.579 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400f040 con 0x7fcfe806ab10 2023-07-20T11:24:45.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004030 con 0x7fcfe806ab10 2023-07-20T11:24:45.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe80cb7e0 con 0x7fcfe806ab10 2023-07-20T11:24:45.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.584+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe80c88e0 con 0x7fcfe806ab10 2023-07-20T11:24:45.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe804da30 con 0x7fcfe806ab10 2023-07-20T11:24:45.580 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fcfe4004190 con 0x7fcfe806ab10 2023-07-20T11:24:45.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfde7fc640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 0x7fcfcc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fcfe40844b0 con 0x7fcfe806ab10 2023-07-20T11:24:45.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfed555640 1 -- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 msgr2=0x7fcfcc068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:45.581 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.588+0000 7fcfed555640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 0x7fcfcc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:45.583 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.592+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfe4051610 con 0x7fcfe806ab10 2023-07-20T11:24:45.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:24:45.607 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:24:45.701 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.709+0000 7f1d25d97180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:45.735 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.744+0000 7fdeab9a6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.744+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcfe806a8f0 con 0x7fcfe806ab10 2023-07-20T11:24:45.736 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.744+0000 7fcfde7fc640 1 -- 172.21.15.82:0/227965069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v206) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcfe4054c30 con 0x7fcfe806ab10 2023-07-20T11:24:45.736 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:45.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 msgr2=0x7fcfcc068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:45.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 0x7fcfcc068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 msgr2=0x7fcfe81569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 secure :-1 s=READY pgs=2461 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009fc0 tx=0x7fcfe400d560 comp rx=0 tx=0).stop 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 shutdown_connections 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcfcc0663a0 0x7fcfcc068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcfe81602b0 0x7fcfe80b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcfe806c120 0x7fcfe80cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 --2- 172.21.15.82:0/227965069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcfe806ab10 0x7fcfe81569d0 unknown :-1 s=CLOSED pgs=2461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 >> 172.21.15.82:0/227965069 conn(0x7fcfe808c0a0 msgr2=0x7fcfe809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 shutdown_connections 2023-07-20T11:24:45.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.748+0000 7fcfeffba640 1 -- 172.21.15.82:0/227965069 wait complete. 2023-07-20T11:24:45.758 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:24:45.760 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.769+0000 7f1d25d97180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:45.797 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.804+0000 7fdeab9a6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-20T11:24:45.816 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.825+0000 7f1d25d97180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:45.854 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.864+0000 7fdeab9a6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-20T11:24:45.902 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.909+0000 7f1d25d97180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:45.903 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 Processor -- start 2023-07-20T11:24:45.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 -- start start 2023-07-20T11:24:45.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 0x7f42600cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42600d0970 con 0x7f426006b220 2023-07-20T11:24:45.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4260160e20 con 0x7f42601602b0 2023-07-20T11:24:45.905 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.912+0000 7f4265903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600cd300 con 0x7f426006c120 2023-07-20T11:24:45.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425f7fe640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f426006b220 0x7f42600d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47838/0 (socket says 172.21.15.82:47838) 2023-07-20T11:24:45.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425f7fe640 1 -- 172.21.15.82:0/3349125376 learned_addr learned my addr 172.21.15.82:0/3349125376 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:45.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425effd640 1 --2- 172.21.15.82:0/3349125376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 0x7f42600cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230868391 0 0) 0x7f42600d0970 con 0x7f426006b220 2023-07-20T11:24:45.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003530 con 0x7f426006b220 2023-07-20T11:24:45.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946856103 0 0) 0x7f4260160e20 con 0x7f42601602b0 2023-07-20T11:24:45.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425effd640 1 -- 172.21.15.82:0/3349125376 >> v1:172.21.15.183:6789/0 conn(0x7f42601602b0 legacy=0x7f426006ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425effd640 1 -- 172.21.15.82:0/3349125376 >> v1:172.21.15.82:6789/0 conn(0x7f426006b220 legacy=0x7f42600d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425effd640 1 -- 172.21.15.82:0/3349125376 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600cd5e0 con 0x7f426006c120 2023-07-20T11:24:45.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425effd640 1 --2- 172.21.15.82:0/3349125376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 0x7f42600cdde0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42500097f0 tx=0x7f425001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47c5d1da7992c8e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500ab620 con 0x7f426006c120 2023-07-20T11:24:45.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42500ab780 con 0x7f426006c120 2023-07-20T11:24:45.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.916+0000 7f425dffb640 1 -- 172.21.15.82:0/3349125376 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42500abaf0 con 0x7f426006c120 2023-07-20T11:24:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- 172.21.15.82:0/3349125376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 msgr2=0x7f42600cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 --2- 172.21.15.82:0/3349125376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 0x7f42600cdde0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42500097f0 tx=0x7f425001c400 comp rx=0 tx=0).stop 2023-07-20T11:24:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- 172.21.15.82:0/3349125376 shutdown_connections 2023-07-20T11:24:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 --2- 172.21.15.82:0/3349125376 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006c120 0x7f42600cdde0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.910 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- 172.21.15.82:0/3349125376 >> 172.21.15.82:0/3349125376 conn(0x7f426008c0a0 msgr2=0x7f426009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:45.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- 172.21.15.82:0/3349125376 shutdown_connections 2023-07-20T11:24:45.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- 172.21.15.82:0/3349125376 wait complete. 2023-07-20T11:24:45.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 Processor -- start 2023-07-20T11:24:45.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- start start 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 0x7f42600c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426006c120 0x7f42600c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c7950 con 0x7f42601602b0 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c7c30 con 0x7f426006c120 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f4265903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c7f10 con 0x7f426006b220 2023-07-20T11:24:45.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f425f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f425effd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 0x7f42600c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f425f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58176/0 (socket says 172.21.15.82:58176) 2023-07-20T11:24:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f425e7fc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426006c120 0x7f42600c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:45.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.920+0000 7f425f7fe640 1 -- 172.21.15.82:0/1057385008 learned_addr learned my addr 172.21.15.82:0/1057385008 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:45.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 -- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 msgr2=0x7f42600c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.915 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 0x7f42600c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 -- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426006c120 msgr2=0x7f42600c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:45.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426006c120 0x7f42600c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:45.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 -- 172.21.15.82:0/1057385008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009420 con 0x7f42601602b0 2023-07-20T11:24:45.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425effd640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 0x7f42600c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425f7fe640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f425800cb40 tx=0x7f425800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800aca0 con 0x7f42601602b0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800ae00 con 0x7f42601602b0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600c81f0 con 0x7f42601602b0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258012620 con 0x7f42601602b0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426014d2e0 con 0x7f42601602b0 2023-07-20T11:24:45.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4260154920 con 0x7f42601602b0 2023-07-20T11:24:45.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f4258007070 con 0x7f42601602b0 2023-07-20T11:24:45.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 0x7f424c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:45.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f4258083f50 con 0x7f42601602b0 2023-07-20T11:24:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425effd640 1 -- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 msgr2=0x7f424c068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.924+0000 7f425effd640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 0x7f424c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:45.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:45.928+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4260154920 con 0x7f42601602b0 2023-07-20T11:24:45.946 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:45.956+0000 7fdeab9a6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-20T11:24:45.961 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:45.969+0000 7f1d25d97180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:46.004 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.012+0000 7fdeab9a6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-20T11:24:46.045 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.053+0000 7f1d25d97180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:46.072 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.080+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4260154920 con 0x7f42601602b0 2023-07-20T11:24:46.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.080+0000 7f4247fff640 1 -- 172.21.15.82:0/1057385008 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v206) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4260154920 con 0x7f42601602b0 2023-07-20T11:24:46.073 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 msgr2=0x7f424c068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 0x7f424c068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 msgr2=0x7f426014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 secure :-1 s=READY pgs=2463 cs=0 l=1 rev1=1 crypto rx=0x7f425800cb40 tx=0x7f425800a060 comp rx=0 tx=0).stop 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 shutdown_connections 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f424c0663a0 0x7f424c068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.075 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f42601602b0 0x7f426014cda0 unknown :-1 s=CLOSED pgs=2463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f426006c120 0x7f42600c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 --2- 172.21.15.82:0/1057385008 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f426006b220 0x7f42600c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 >> 172.21.15.82:0/1057385008 conn(0x7f426008c0a0 msgr2=0x7f42600b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 shutdown_connections 2023-07-20T11:24:46.076 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.084+0000 7f4265903640 1 -- 172.21.15.82:0/1057385008 wait complete. 2023-07-20T11:24:46.090 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.100+0000 7fdeab9a6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-20T11:24:46.095 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:24:46.101 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.109+0000 7f1d25d97180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:46.147 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.156+0000 7fdeab9a6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-20T11:24:46.243 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.253+0000 7f1d25d97180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 Processor -- start 2023-07-20T11:24:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 -- start start 2023-07-20T11:24:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fcc5c15cac0 0x7fcc5c0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cdb40 con 0x7fcc5c0d3200 2023-07-20T11:24:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0d07a0 con 0x7fcc5c15cac0 2023-07-20T11:24:46.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc631fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cd4f0 con 0x7fcc5c15c6e0 2023-07-20T11:24:46.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58182/0 (socket says 172.21.15.82:58182) 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 -- 172.21.15.82:0/1994750199 learned_addr learned my addr 172.21.15.82:0/1994750199 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc60f96640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc61797640 1 --2- 172.21.15.82:0/1994750199 >> v2:172.21.15.183:3300/0 conn(0x7fcc5c15cac0 0x7fcc5c0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 -- 172.21.15.82:0/1994750199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 msgr2=0x7fcc5c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 -- 172.21.15.82:0/1994750199 >> v2:172.21.15.183:3300/0 conn(0x7fcc5c15cac0 msgr2=0x7fcc5c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 --2- 172.21.15.82:0/1994750199 >> v2:172.21.15.183:3300/0 conn(0x7fcc5c15cac0 0x7fcc5c0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.292+0000 7fcc5bfff640 1 -- 172.21.15.82:0/1994750199 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0cd7d0 con 0x7fcc5c0d3200 2023-07-20T11:24:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc5bfff640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b2010 tx=0x7fcc4801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f465ded8c685288 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc5b7fe640 1 -- 172.21.15.82:0/1994750199 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc480ab600 con 0x7fcc5c0d3200 2023-07-20T11:24:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc5b7fe640 1 -- 172.21.15.82:0/1994750199 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc480a7050 con 0x7fcc5c0d3200 2023-07-20T11:24:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc5b7fe640 1 -- 172.21.15.82:0/1994750199 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc480ab980 con 0x7fcc5c0d3200 2023-07-20T11:24:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 -- 172.21.15.82:0/1994750199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c0d3200 msgr2=0x7fcc5c0cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 secure :-1 s=READY pgs=2464 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b2010 tx=0x7fcc4801c3e0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 -- 172.21.15.82:0/1994750199 shutdown_connections 2023-07-20T11:24:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 --2- 172.21.15.82:0/1994750199 >> v2:172.21.15.183:3300/0 conn(0x7fcc5c15cac0 0x7fcc5c0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c0cdfd0 unknown :-1 s=CLOSED pgs=2464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 --2- 172.21.15.82:0/1994750199 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 -- 172.21.15.82:0/1994750199 >> 172.21.15.82:0/1994750199 conn(0x7fcc5c0d2600 msgr2=0x7fcc5c0d2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 -- 172.21.15.82:0/1994750199 shutdown_connections 2023-07-20T11:24:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.296+0000 7fcc631fa640 1 -- 172.21.15.82:0/1994750199 wait complete. 2023-07-20T11:24:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 Processor -- start 2023-07-20T11:24:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- start start 2023-07-20T11:24:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c15aef0 con 0x7fcc5c15cac0 2023-07-20T11:24:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0b83a0 con 0x7fcc5c0d3200 2023-07-20T11:24:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c15a2e0 con 0x7fcc5c15c6e0 2023-07-20T11:24:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58186/0 (socket says 172.21.15.82:58186) 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 -- 172.21.15.82:0/3988083806 learned_addr learned my addr 172.21.15.82:0/3988083806 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc5bfff640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc60f96640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 -- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 msgr2=0x7fcc5c0b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 -- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5c0d3200 msgr2=0x7fcc5c159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 -- 172.21.15.82:0/3988083806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480094d0 con 0x7fcc5c15cac0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc5bfff640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc61797640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7fcc54007e90 tx=0x7fcc5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54014420 con 0x7fcc5c15cac0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc54014580 con 0x7fcc5c15cac0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc54014930 con 0x7fcc5c15cac0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c15a5c0 con 0x7fcc5c15cac0 2023-07-20T11:24:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.300+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c15ab80 con 0x7fcc5c15cac0 2023-07-20T11:24:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c15b060 con 0x7fcc5c15cac0 2023-07-20T11:24:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fcc54014a90 con 0x7fcc5c15cac0 2023-07-20T11:24:46.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc597fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 0x7fcc40068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc60f96640 1 -- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 msgr2=0x7fcc40068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fcc54084840 con 0x7fcc5c15cac0 2023-07-20T11:24:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fcc60f96640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 0x7fcc40068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:46.296 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.304+0000 7fdeab9a6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-20T11:24:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.308+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc54055530 con 0x7fcc5c15cac0 2023-07-20T11:24:46.303 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.313+0000 7f1d25d97180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:46.364 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.372+0000 7fdeab9a6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-20T11:24:46.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc5c04da30 con 0x7fcc5c15cac0 2023-07-20T11:24:46.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc597fa640 1 -- 172.21.15.82:0/3988083806 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v206) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc540550c0 con 0x7fcc5c15cac0 2023-07-20T11:24:46.459 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:24:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 msgr2=0x7fcc40068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 0x7fcc40068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 msgr2=0x7fcc5c1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.468+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7fcc54007e90 tx=0x7fcc5400e4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 shutdown_connections 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fcc400663a0 0x7fcc40068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc5c15cac0 0x7fcc5c1544b0 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc5c15c6e0 0x7fcc5c0b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 --2- 172.21.15.82:0/3988083806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc5c0d3200 0x7fcc5c159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 >> 172.21.15.82:0/3988083806 conn(0x7fcc5c0d2600 msgr2=0x7fcc5c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:46.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 shutdown_connections 2023-07-20T11:24:46.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.472+0000 7fcc631fa640 1 -- 172.21.15.82:0/3988083806 wait complete. 2023-07-20T11:24:46.482 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-20T11:24:46.545 INFO:tasks.ceph.mgr.x.smithi183.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:46.545 INFO:tasks.ceph.mgr.x.smithi183.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:46.545 INFO:tasks.ceph.mgr.x.smithi183.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:46.553 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.561+0000 7f1d25d97180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:46.610 INFO:tasks.ceph.mgr.y.smithi082.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-20T11:24:46.610 INFO:tasks.ceph.mgr.y.smithi082.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-20T11:24:46.610 INFO:tasks.ceph.mgr.y.smithi082.stderr: from numpy import show_config as show_numpy_config 2023-07-20T11:24:46.619 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.628+0000 7fdeab9a6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-20T11:24:46.688 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.697+0000 7f1d25d97180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:46.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.716+0000 7fc313503640 1 Processor -- start 2023-07-20T11:24:46.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 -- start start 2023-07-20T11:24:46.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 0x7fc30c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c0d16b0 con 0x7fc30c15cab0 2023-07-20T11:24:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0d31c0 con 0x7fc30c0cd4b0 2023-07-20T11:24:46.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc313503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0b3520 con 0x7fc30c0d0d10 2023-07-20T11:24:46.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:34824/0 (socket says 172.21.15.82:34824) 2023-07-20T11:24:46.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 -- 172.21.15.82:0/558293087 learned_addr learned my addr 172.21.15.82:0/558293087 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:46.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc311aa0640 1 --2- 172.21.15.82:0/558293087 >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 0x7fc30c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 -- 172.21.15.82:0/558293087 >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 msgr2=0x7fc30c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 --2- 172.21.15.82:0/558293087 >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 0x7fc30c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 -- 172.21.15.82:0/558293087 >> v1:172.21.15.183:6789/0 conn(0x7fc30c15cab0 legacy=0x7fc30c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc310a9e640 1 -- 172.21.15.82:0/558293087 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0d0a10 con 0x7fc30c0d0d10 2023-07-20T11:24:46.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.720+0000 7fc311aa0640 1 --2- 172.21.15.82:0/558293087 >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 0x7fc30c0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:46.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc310a9e640 1 --2- 172.21.15.82:0/558293087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009870 tx=0x7fc2fc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c3561df1884181b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:46.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc303fff640 1 -- 172.21.15.82:0/558293087 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0aa670 con 0x7fc30c0d0d10 2023-07-20T11:24:46.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc303fff640 1 -- 172.21.15.82:0/558293087 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0aa7d0 con 0x7fc30c0d0d10 2023-07-20T11:24:46.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc303fff640 1 -- 172.21.15.82:0/558293087 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0aab60 con 0x7fc30c0d0d10 2023-07-20T11:24:46.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 -- 172.21.15.82:0/558293087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 msgr2=0x7fc30c0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 --2- 172.21.15.82:0/558293087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009870 tx=0x7fc2fc01c510 comp rx=0 tx=0).stop 2023-07-20T11:24:46.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 -- 172.21.15.82:0/558293087 shutdown_connections 2023-07-20T11:24:46.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 --2- 172.21.15.82:0/558293087 >> v2:172.21.15.183:3300/0 conn(0x7fc30c0cd4b0 0x7fc30c0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 --2- 172.21.15.82:0/558293087 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0d1170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 -- 172.21.15.82:0/558293087 >> 172.21.15.82:0/558293087 conn(0x7fc30c08c120 msgr2=0x7fc30c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:46.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 -- 172.21.15.82:0/558293087 shutdown_connections 2023-07-20T11:24:46.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.724+0000 7fc313503640 1 -- 172.21.15.82:0/558293087 wait complete. 2023-07-20T11:24:46.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 Processor -- start 2023-07-20T11:24:46.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- start start 2023-07-20T11:24:46.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc30c0cd4b0 0x7fc30c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0b5c40 con 0x7fc30c15cab0 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0b5e90 con 0x7fc30c0cd4b0 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0b6170 con 0x7fc30c0d0d10 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58198/0 (socket says 172.21.15.82:58198) 2023-07-20T11:24:46.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 -- 172.21.15.82:0/361980977 learned_addr learned my addr 172.21.15.82:0/361980977 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:46.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc310a9e640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc31129f640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc30c0cd4b0 0x7fc30c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 -- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 msgr2=0x7fc30c0b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 -- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc30c0cd4b0 msgr2=0x7fc30c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc30c0cd4b0 0x7fc30c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 -- 172.21.15.82:0/361980977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0094d0 con 0x7fc30c15cab0 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc310a9e640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:46.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc311aa0640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7fc304007df0 tx=0x7fc30400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:46.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040039a0 con 0x7fc30c15cab0 2023-07-20T11:24:46.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30400f040 con 0x7fc30c15cab0 2023-07-20T11:24:46.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc304003d40 con 0x7fc30c15cab0 2023-07-20T11:24:46.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0b6450 con 0x7fc30c15cab0 2023-07-20T11:24:46.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.728+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0b6a10 con 0x7fc30c15cab0 2023-07-20T11:24:46.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c073c70 con 0x7fc30c15cab0 2023-07-20T11:24:46.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fc304004030 con 0x7fc30c15cab0 2023-07-20T11:24:46.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc301ffb640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 0x7fc2f0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:46.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc31129f640 1 -- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 msgr2=0x7fc2f0068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:46.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fc3040843f0 con 0x7fc30c15cab0 2023-07-20T11:24:46.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.732+0000 7fc31129f640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 0x7fc2f0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:46.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.736+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc304051560 con 0x7fc30c15cab0 2023-07-20T11:24:46.761 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.772+0000 7fdeab9a6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:46.815 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.825+0000 7f1d25d97180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:46.885 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:46.893+0000 7f1d25d97180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:46.888 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.896+0000 7fdeab9a6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-20T11:24:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.896+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc30c0b6bd0 con 0x7fc30c15cab0 2023-07-20T11:24:46.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.896+0000 7fc301ffb640 1 -- 172.21.15.82:0/361980977 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v206) v1 ==== 80+0+468 (secure 0 0 0) 0x7fc304054b80 con 0x7fc30c15cab0 2023-07-20T11:24:46.889 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6833/1948044010 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.889 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6832/1948044010 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/4135921357 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3061030549 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2009112200 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2902554209 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/367903546 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.890 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/666160418 2023-07-21T11:24:41.286826+0000 2023-07-20T11:24:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:listed 8 entries 2023-07-20T11:24:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 msgr2=0x7fc2f0068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 0x7fc2f0068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 msgr2=0x7fc30c0b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7fc304007df0 tx=0x7fc30400d4a0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 shutdown_connections 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fc2f00663a0 0x7fc2f0068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc30c15cab0 0x7fc30c0b08e0 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc30c0d0d10 0x7fc30c0b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 --2- 172.21.15.82:0/361980977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc30c0cd4b0 0x7fc30c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 >> 172.21.15.82:0/361980977 conn(0x7fc30c08c120 msgr2=0x7fc30c0af260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 shutdown_connections 2023-07-20T11:24:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:46.900+0000 7fc313503640 1 -- 172.21.15.82:0/361980977 wait complete. 2023-07-20T11:24:46.911 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-20T11:24:46.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:46.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-20T11:24:46.962 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:46.972+0000 7fdeab9a6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-20T11:24:46.990 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:24:46.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:46.991 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-20T11:24:47.002 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:47.002 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:47.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:47.013 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:47.014 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:47.023 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:47.033+0000 7f1d25d97180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:47.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:47.054 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:47.054 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:47.063 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:47.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:47.100 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:47.108+0000 7fdeab9a6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-20T11:24:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 Processor -- start 2023-07-20T11:24:47.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 -- start start 2023-07-20T11:24:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f71440cd4b0 0x7f71440cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440d16b0 con 0x7f714415cab0 2023-07-20T11:24:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440d31c0 con 0x7f71440cd4b0 2023-07-20T11:24:47.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f714b248640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440b3520 con 0x7f71440d0d10 2023-07-20T11:24:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f7148fe4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f714415cab0 0x7f71440d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47852/0 (socket says 172.21.15.82:47852) 2023-07-20T11:24:47.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f7148fe4640 1 -- 172.21.15.82:0/3018224943 learned_addr learned my addr 172.21.15.82:0/3018224943 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71497e5640 1 --2- 172.21.15.82:0/3018224943 >> v2:172.21.15.183:3300/0 conn(0x7f71440cd4b0 0x7f71440cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f7143fff640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71437fe640 1 -- 172.21.15.82:0/3018224943 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337029884 0 0) 0x7f71440d16b0 con 0x7f714415cab0 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71437fe640 1 -- 172.21.15.82:0/3018224943 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7134003530 con 0x7f714415cab0 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71497e5640 1 -- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 msgr2=0x7f71440d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71497e5640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71497e5640 1 -- 172.21.15.82:0/3018224943 >> v1:172.21.15.82:6789/0 conn(0x7f714415cab0 legacy=0x7f71440d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.248+0000 7f71497e5640 1 -- 172.21.15.82:0/3018224943 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440d0a10 con 0x7f71440cd4b0 2023-07-20T11:24:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f71497e5640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f71440cd940 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840b0c82d29ab835 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f71437fe640 1 -- 172.21.15.82:0/3018224943 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a59e0 con 0x7f71440cd4b0 2023-07-20T11:24:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f71437fe640 1 -- 172.21.15.82:0/3018224943 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0a5b40 con 0x7f71440cd4b0 2023-07-20T11:24:47.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f71437fe640 1 -- 172.21.15.82:0/3018224943 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0ad440 con 0x7f71440cd4b0 2023-07-20T11:24:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 -- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 msgr2=0x7f71440cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f71440cd940 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c01c920 comp rx=0 tx=0).stop 2023-07-20T11:24:47.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 -- 172.21.15.82:0/3018224943 shutdown_connections 2023-07-20T11:24:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f71440cd940 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 --2- 172.21.15.82:0/3018224943 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 -- 172.21.15.82:0/3018224943 >> 172.21.15.82:0/3018224943 conn(0x7f714408c120 msgr2=0x7f714409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 -- 172.21.15.82:0/3018224943 shutdown_connections 2023-07-20T11:24:47.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.252+0000 7f714b248640 1 -- 172.21.15.82:0/3018224943 wait complete. 2023-07-20T11:24:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 Processor -- start 2023-07-20T11:24:47.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- start start 2023-07-20T11:24:47.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71441544c0 con 0x7f714415cab0 2023-07-20T11:24:47.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71441547a0 con 0x7f71440cd4b0 2023-07-20T11:24:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7144154a80 con 0x7f71440d0d10 2023-07-20T11:24:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71497e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7143fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71497e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58204/0 (socket says 172.21.15.82:58204) 2023-07-20T11:24:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71497e5640 1 -- 172.21.15.82:0/3239423284 learned_addr learned my addr 172.21.15.82:0/3239423284 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:47.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:35340/0 (socket says 172.21.15.82:35340) 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 -- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 msgr2=0x7f71440c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 -- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 msgr2=0x7f714406bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 -- 172.21.15.82:0/3239423284 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c009a70 con 0x7f71440cd4b0 2023-07-20T11:24:47.252 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71497e5640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f7148fe4640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f713800c400 tx=0x7f713800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138005cf0 con 0x7f71440cd4b0 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138005e50 con 0x7f71440cd4b0 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7144154d60 con 0x7f71440cd4b0 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71380072d0 con 0x7f71440cd4b0 2023-07-20T11:24:47.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.256+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7144154150 con 0x7f71440cd4b0 2023-07-20T11:24:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71440b3190 con 0x7f71440cd4b0 2023-07-20T11:24:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f7138007430 con 0x7f71440cd4b0 2023-07-20T11:24:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f71417fa640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 0x7f7128068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.254 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f7143fff640 1 -- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 msgr2=0x7f7128068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f71380835f0 con 0x7f71440cd4b0 2023-07-20T11:24:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.260+0000 7f7143fff640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 0x7f7128068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:47.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.264+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71440b3190 con 0x7f71440cd4b0 2023-07-20T11:24:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.444+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71440b3190 con 0x7f71440cd4b0 2023-07-20T11:24:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.444+0000 7f71417fa640 1 -- 172.21.15.82:0/3239423284 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f71440b3190 con 0x7f71440cd4b0 2023-07-20T11:24:47.437 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:47.437 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 msgr2=0x7f7128068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 0x7f7128068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 msgr2=0x7f7144153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f713800c400 tx=0x7f713800c8c0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 shutdown_connections 2023-07-20T11:24:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f71280663a0 0x7f7128068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f714415cab0 0x7f714406bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f71440d0d10 0x7f71440c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 --2- 172.21.15.82:0/3239423284 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f71440cd4b0 0x7f7144153b20 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 >> 172.21.15.82:0/3239423284 conn(0x7f714408c120 msgr2=0x7f71441590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 shutdown_connections 2023-07-20T11:24:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.448+0000 7f714b248640 1 -- 172.21.15.82:0/3239423284 wait complete. 2023-07-20T11:24:47.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:47.568 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:47.577+0000 7f1d25d97180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:47.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.612+0000 7f9bcb234640 1 Processor -- start 2023-07-20T11:24:47.605 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 -- start start 2023-07-20T11:24:47.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9bc415cab0 0x7f9bc40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.606 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40d16b0 con 0x7f9bc40cf110 2023-07-20T11:24:47.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc40d31c0 con 0x7f9bc415cab0 2023-07-20T11:24:47.607 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bcb234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40b3520 con 0x7f9bc40d0d10 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc3fff640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc8fd0640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9bc415cab0 0x7f9bc40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc97d1640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f9bc40cf110 0x7f9bc40cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:57220/0 (socket says 172.21.15.82:57220) 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc97d1640 1 -- 172.21.15.82:0/4249457067 learned_addr learned my addr 172.21.15.82:0/4249457067 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc8fd0640 1 -- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 msgr2=0x7f9bc40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc8fd0640 1 --2- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.608 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc8fd0640 1 -- 172.21.15.82:0/4249457067 >> v1:172.21.15.183:6789/0 conn(0x7f9bc40cf110 legacy=0x7f9bc40cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc8fd0640 1 -- 172.21.15.82:0/4249457067 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc40b2910 con 0x7f9bc415cab0 2023-07-20T11:24:47.609 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.616+0000 7f9bc37fe640 1 -- 172.21.15.82:0/4249457067 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755245255 0 0) 0x7f9bc40d16b0 con 0x7f9bc40cf110 2023-07-20T11:24:47.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bc8fd0640 1 --2- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc415cab0 0x7f9bc40d0300 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097c0 tx=0x7f9bb801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742b255928971621 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.610 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bc37fe640 1 -- 172.21.15.82:0/4249457067 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80ab650 con 0x7f9bc415cab0 2023-07-20T11:24:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bc37fe640 1 -- 172.21.15.82:0/4249457067 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb80ab7b0 con 0x7f9bc415cab0 2023-07-20T11:24:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bc37fe640 1 -- 172.21.15.82:0/4249457067 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80abb40 con 0x7f9bc415cab0 2023-07-20T11:24:47.611 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 -- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc415cab0 msgr2=0x7f9bc40d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc415cab0 0x7f9bc40d0300 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097c0 tx=0x7f9bb801c450 comp rx=0 tx=0).stop 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 -- 172.21.15.82:0/4249457067 shutdown_connections 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4249457067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc415cab0 0x7f9bc40d0300 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 -- 172.21.15.82:0/4249457067 >> 172.21.15.82:0/4249457067 conn(0x7f9bc408c120 msgr2=0x7f9bc409ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 -- 172.21.15.82:0/4249457067 shutdown_connections 2023-07-20T11:24:47.612 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 -- 172.21.15.82:0/4249457067 wait complete. 2023-07-20T11:24:47.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.620+0000 7f9bcb234640 1 Processor -- start 2023-07-20T11:24:47.613 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- start start 2023-07-20T11:24:47.614 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc40cf110 0x7f9bc40cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40cb100 con 0x7f9bc415cab0 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40ca210 con 0x7f9bc40cf110 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc40ca4f0 con 0x7f9bc40d0d10 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc97d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.615 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc97d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58208/0 (socket says 172.21.15.82:58208) 2023-07-20T11:24:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc97d1640 1 -- 172.21.15.82:0/4241835644 learned_addr learned my addr 172.21.15.82:0/4241835644 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.616 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc8fd0640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc40cf110 0x7f9bc40cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 -- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc40cf110 msgr2=0x7f9bc40cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc40cf110 0x7f9bc40cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 -- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 msgr2=0x7f9bc40c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.617 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 -- 172.21.15.82:0/4241835644 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8009420 con 0x7f9bc40d0d10 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc97d1640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc3fff640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40c8000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e870 tx=0x7f9bb000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ee60 con 0x7f9bc40d0d10 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000c940 con 0x7f9bc40d0d10 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ccd0 con 0x7f9bc40d0d10 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc40ca7d0 con 0x7f9bc40d0d10 2023-07-20T11:24:47.618 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc40cad90 con 0x7f9bc40d0d10 2023-07-20T11:24:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.624+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc4073c70 con 0x7f9bc40d0d10 2023-07-20T11:24:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.628+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f9bb0013470 con 0x7f9bc40d0d10 2023-07-20T11:24:47.619 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.628+0000 7f9bc17fa640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 0x7f9ba8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.628+0000 7f9bc8fd0640 1 -- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 msgr2=0x7f9ba8068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.628+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f9bb0084080 con 0x7f9bc40d0d10 2023-07-20T11:24:47.620 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.628+0000 7f9bc8fd0640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 0x7f9ba8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:47.623 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.632+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bb00b4700 con 0x7f9bc40d0d10 2023-07-20T11:24:47.654 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:47.661+0000 7f1d25d97180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:47.657 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:47.668+0000 7fdeab9a6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-20T11:24:47.744 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:47.752+0000 7fdeab9a6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-20T11:24:47.776 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.784+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bc40cb270 con 0x7f9bc40d0d10 2023-07-20T11:24:47.778 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bc17fa640 1 -- 172.21.15.82:0/4241835644 <== mon.2 v2:172.21.15.183:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+18887 (secure 0 0 0) 0x7f9bb0017090 con 0x7f9bc40d0d10 2023-07-20T11:24:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:47.779 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":206,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:41.286857+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:6832/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4135921357":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/3061030549":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2009112200":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2902554209":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/367903546":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/666160418":"2023-07-21T11:24:41.286826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:47.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 msgr2=0x7f9ba8068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:47.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 0x7f9ba8068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.781 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 msgr2=0x7f9bc40c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40c8000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e870 tx=0x7f9bb000ed30 comp rx=0 tx=0).stop 2023-07-20T11:24:47.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 shutdown_connections 2023-07-20T11:24:47.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f9ba80663a0 0x7f9ba8068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc415cab0 0x7f9bc40c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9bc40d0d10 0x7f9bc40c8000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 --2- 172.21.15.82:0/4241835644 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9bc40cf110 0x7f9bc40cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 >> 172.21.15.82:0/4241835644 conn(0x7f9bc408c120 msgr2=0x7f9bc415bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:47.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 shutdown_connections 2023-07-20T11:24:47.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.788+0000 7f9bcb234640 1 -- 172.21.15.82:0/4241835644 wait complete. 2023-07-20T11:24:47.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-20T09:50:13.898859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-20T09:50:19.684821+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-20T11:24:21.724849+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '204', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-07-20T11:24:23.044606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '205', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-20T11:24:47.803 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-20T11:24:47.804 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:47.813+0000 7f1d25d97180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:47.887 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:47.897+0000 7f1d25d97180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:47.896 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:47.904+0000 7fdeab9a6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-20T11:24:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.956+0000 7f198c06d640 1 Processor -- start 2023-07-20T11:24:47.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.956+0000 7f198c06d640 1 -- start start 2023-07-20T11:24:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.956+0000 7f198c06d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f198406b220 0x7f1984160740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198c06d640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840ce4f0 con 0x7f19841602b0 2023-07-20T11:24:47.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198c06d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840d0970 con 0x7f198406c120 2023-07-20T11:24:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198c06d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1984160e20 con 0x7f198406b220 2023-07-20T11:24:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f198406b220 0x7f1984160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f1989e09640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f198406c120 0x7f19840cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:57230/0 (socket says 172.21.15.82:57230) 2023-07-20T11:24:47.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f198406b220 0x7f1984160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58210/0 (socket says 172.21.15.82:58210) 2023-07-20T11:24:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f1989e09640 1 -- 172.21.15.82:0/3425161169 learned_addr learned my addr 172.21.15.82:0/3425161169 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 -- 172.21.15.82:0/3425161169 >> v1:172.21.15.183:6789/0 conn(0x7f198406c120 legacy=0x7f19840cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 -- 172.21.15.82:0/3425161169 >> v1:172.21.15.82:6789/0 conn(0x7f19841602b0 legacy=0x7f198406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 -- 172.21.15.82:0/3425161169 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840cd300 con 0x7f198406b220 2023-07-20T11:24:47.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.960+0000 7f198a60a640 1 --2- 172.21.15.82:0/3425161169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984160740 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f197c009d90 tx=0x7f197c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2f73284ba66b71 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f1988e07640 1 -- 172.21.15.82:0/3425161169 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0a58c0 con 0x7f198406b220 2023-07-20T11:24:47.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f1988e07640 1 -- 172.21.15.82:0/3425161169 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0a5a20 con 0x7f198406b220 2023-07-20T11:24:47.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f1988e07640 1 -- 172.21.15.82:0/3425161169 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0a5db0 con 0x7f198406b220 2023-07-20T11:24:47.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- 172.21.15.82:0/3425161169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 msgr2=0x7f1984160740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 --2- 172.21.15.82:0/3425161169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984160740 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f197c009d90 tx=0x7f197c01c800 comp rx=0 tx=0).stop 2023-07-20T11:24:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- 172.21.15.82:0/3425161169 shutdown_connections 2023-07-20T11:24:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 --2- 172.21.15.82:0/3425161169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984160740 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- 172.21.15.82:0/3425161169 >> 172.21.15.82:0/3425161169 conn(0x7f198408c0a0 msgr2=0x7f198409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- 172.21.15.82:0/3425161169 shutdown_connections 2023-07-20T11:24:47.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- 172.21.15.82:0/3425161169 wait complete. 2023-07-20T11:24:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 Processor -- start 2023-07-20T11:24:47.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 -- start start 2023-07-20T11:24:47.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 0x7f198414d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.964+0000 7f198c06d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 0x7f1984154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841560b0 con 0x7f198406b220 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1984153440 con 0x7f19841602b0 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1984153720 con 0x7f198406c120 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58212/0 (socket says 172.21.15.82:58212) 2023-07-20T11:24:47.958 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989e09640 1 -- 172.21.15.82:0/1250858767 learned_addr learned my addr 172.21.15.82:0/1250858767 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:47.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 0x7f1984154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989608640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 0x7f198414d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:47.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 -- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 msgr2=0x7f198414d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 0x7f198414d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 -- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 msgr2=0x7f1984151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 -- 172.21.15.82:0/1250858767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009a70 con 0x7f19841602b0 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989608640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 0x7f198414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:47.960 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f1989e09640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198a60a640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 0x7f1984154200 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f197c0ac000 tx=0x7f197c0195a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0b9860 con 0x7f19841602b0 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0b99c0 con 0x7f19841602b0 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0b9d30 con 0x7f19841602b0 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1984153a00 con 0x7f19841602b0 2023-07-20T11:24:47.961 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198414dd30 con 0x7f19841602b0 2023-07-20T11:24:47.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198404da30 con 0x7f19841602b0 2023-07-20T11:24:47.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.968+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7f197c0ad440 con 0x7f19841602b0 2023-07-20T11:24:47.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.972+0000 7f197a7fc640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 0x7f1968068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:47.962 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.972+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f197c11f3a0 con 0x7f19841602b0 2023-07-20T11:24:47.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.972+0000 7f1989e09640 1 -- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 msgr2=0x7f1968068860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:47.963 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.972+0000 7f1989e09640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 0x7f1968068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:47.965 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:47.976+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f197c0ec610 con 0x7f19841602b0 2023-07-20T11:24:47.984 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:47.992+0000 7fdeab9a6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-20T11:24:48.116 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.124+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1984153580 con 0x7f19841602b0 2023-07-20T11:24:48.117 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.124+0000 7f197a7fc640 1 -- 172.21.15.82:0/1250858767 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v206) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1984153580 con 0x7f19841602b0 2023-07-20T11:24:48.117 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2023-07-20T11:24:48.120 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 msgr2=0x7f1968068860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 0x7f1968068860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 msgr2=0x7f1984154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 0x7f1984154200 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f197c0ac000 tx=0x7f197c0195a0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 shutdown_connections 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7f19680663a0 0x7f1968068860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.121 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f19841602b0 0x7f1984154200 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f198406c120 0x7f198414d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 --2- 172.21.15.82:0/1250858767 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f198406b220 0x7f1984151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 >> 172.21.15.82:0/1250858767 conn(0x7f198408c0a0 msgr2=0x7f198409b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 shutdown_connections 2023-07-20T11:24:48.122 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.128+0000 7f198c06d640 1 -- 172.21.15.82:0/1250858767 wait complete. 2023-07-20T11:24:48.140 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-20T11:24:48.158 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:48.169+0000 7f1d25d97180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:48.219 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-07-20T11:24:48.229+0000 7f1d25d97180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:48.261 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.272+0000 7fdeab9a6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-20T11:24:48.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.292+0000 7fa0ada34640 1 Processor -- start 2023-07-20T11:24:48.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.292+0000 7fa0ada34640 1 -- start start 2023-07-20T11:24:48.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0ada34640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa0a806bd30 0x7fa0a8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0ada34640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a80c95d0 con 0x7fa0a8158ce0 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0ada34640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a81590c0 con 0x7fa0a8070970 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0ada34640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a80c89c0 con 0x7fa0a806bd30 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa0a8158ce0 0x7fa0a80c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47864/0 (socket says 172.21.15.82:47864) 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a6ffd640 1 -- 172.21.15.82:0/2476476271 learned_addr learned my addr 172.21.15.82:0/2476476271 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:48.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a77fe640 1 --2- 172.21.15.82:0/2476476271 >> v2:172.21.15.82:3300/0 conn(0x7fa0a806bd30 0x7fa0a8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2476476271 >> v1:172.21.15.183:6789/0 conn(0x7fa0a8070970 legacy=0x7fa0a806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2476476271 >> v1:172.21.15.82:6789/0 conn(0x7fa0a8158ce0 legacy=0x7fa0a80c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.296+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2476476271 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a80c8ca0 con 0x7fa0a806bd30 2023-07-20T11:24:48.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0a77fe640 1 --2- 172.21.15.82:0/2476476271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a806bd30 0x7fa0a8070e00 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009d90 tx=0x7fa0a001da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24465e487e9702f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0a67fc640 1 -- 172.21.15.82:0/2476476271 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00a6990 con 0x7fa0a806bd30 2023-07-20T11:24:48.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0a67fc640 1 -- 172.21.15.82:0/2476476271 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00a6af0 con 0x7fa0a806bd30 2023-07-20T11:24:48.291 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0a67fc640 1 -- 172.21.15.82:0/2476476271 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00a6e80 con 0x7fa0a806bd30 2023-07-20T11:24:48.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 -- 172.21.15.82:0/2476476271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a806bd30 msgr2=0x7fa0a8070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.292 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2476476271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a806bd30 0x7fa0a8070e00 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009d90 tx=0x7fa0a001da60 comp rx=0 tx=0).stop 2023-07-20T11:24:48.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 -- 172.21.15.82:0/2476476271 shutdown_connections 2023-07-20T11:24:48.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2476476271 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a806bd30 0x7fa0a8070e00 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 -- 172.21.15.82:0/2476476271 >> 172.21.15.82:0/2476476271 conn(0x7fa0a80cad50 msgr2=0x7fa0a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 -- 172.21.15.82:0/2476476271 shutdown_connections 2023-07-20T11:24:48.293 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.300+0000 7fa0ada34640 1 -- 172.21.15.82:0/2476476271 wait complete. 2023-07-20T11:24:48.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 Processor -- start 2023-07-20T11:24:48.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- start start 2023-07-20T11:24:48.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0a806bd30 0x7fa0a814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0a8070970 0x7fa0a814b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a81460e0 con 0x7fa0a8158ce0 2023-07-20T11:24:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a8145c50 con 0x7fa0a806bd30 2023-07-20T11:24:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a8145040 con 0x7fa0a8070970 2023-07-20T11:24:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58222/0 (socket says 172.21.15.82:58222) 2023-07-20T11:24:48.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2841613909 learned_addr learned my addr 172.21.15.82:0/2841613909 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a6ffd640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0a806bd30 0x7fa0a814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa09ffff640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0a8070970 0x7fa0a814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0a8070970 msgr2=0x7fa0a814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0a8070970 0x7fa0a814b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0a806bd30 msgr2=0x7fa0a814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0a806bd30 0x7fa0a814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 -- 172.21.15.82:0/2841613909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009a70 con 0x7fa0a8158ce0 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a77fe640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00b1040 tx=0x7fa0a001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00aee40 con 0x7fa0a8158ce0 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a00b9470 con 0x7fa0a8158ce0 2023-07-20T11:24:48.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a8145320 con 0x7fa0a8158ce0 2023-07-20T11:24:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00b9820 con 0x7fa0a8158ce0 2023-07-20T11:24:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.304+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a81458e0 con 0x7fa0a8158ce0 2023-07-20T11:24:48.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a80ce0c0 con 0x7fa0a8158ce0 2023-07-20T11:24:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 126) v1 ==== 85761+0+0 (secure 0 0 0) 0x7fa0a00b5070 con 0x7fa0a8158ce0 2023-07-20T11:24:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0a4ff9640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 0x7fa088068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fa0a011f290 con 0x7fa0a8158ce0 2023-07-20T11:24:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0a6ffd640 1 -- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 msgr2=0x7fa088068890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6832/3699090616 2023-07-20T11:24:48.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.308+0000 7fa0a6ffd640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 0x7fa088068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-20T11:24:48.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.316+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0a00ec500 con 0x7fa0a8158ce0 2023-07-20T11:24:48.330 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.340+0000 7fdeab9a6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-20T11:24:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.348+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 127) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fa0a00ec8d0 con 0x7fa0a8158ce0 2023-07-20T11:24:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.352+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 msgr2=0x7fa088068890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-20T11:24:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.352+0000 7fa0a4ff9640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 0x7fa088068890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde382f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde382f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde382f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde382f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.407 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde382f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.408 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde34aeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.408 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde34aeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.408 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde34aeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.408 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde34aeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.408 INFO:tasks.ceph.mgr.y.smithi082.stderr:2023-07-20T11:24:48.416+0000 7fde34aeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-20T11:24:48.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0a8164930 con 0x7fa0a8158ce0 2023-07-20T11:24:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0a4ff9640 1 -- 172.21.15.82:0/2841613909 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v207) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0a00f2a10 con 0x7fa0a8158ce0 2023-07-20T11:24:48.478 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 8 2023-07-20T11:24:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 msgr2=0x7fa0a8148930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00b1040 tx=0x7fa0a001c2a0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 shutdown_connections 2023-07-20T11:24:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:6832/3699090616,v1:172.21.15.82:6833/3699090616] conn(0x7fa0880663d0 0x7fa088068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa0a8158ce0 0x7fa0a8148930 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa0a8070970 0x7fa0a814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 --2- 172.21.15.82:0/2841613909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa0a806bd30 0x7fa0a814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 >> 172.21.15.82:0/2841613909 conn(0x7fa0a80cad50 msgr2=0x7fa0a814ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 shutdown_connections 2023-07-20T11:24:48.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.488+0000 7fa0ada34640 1 -- 172.21.15.82:0/2841613909 wait complete. 2023-07-20T11:24:48.499 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-20T11:24:48.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.648+0000 7fa414902640 1 Processor -- start 2023-07-20T11:24:48.641 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.648+0000 7fa414902640 1 -- start start 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa414902640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa410159290 0x7fa410070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa414902640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fa4100c9f70 0x7fa41006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa414902640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa410070990 con 0x7fa4100cd770 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa414902640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa410159670 con 0x7fa410159290 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa414902640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41015d1f0 con 0x7fa4100c9f70 2023-07-20T11:24:48.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa410159290 0x7fa410070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fa410159290 0x7fa410070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58322/0 (socket says 172.21.15.82:58322) 2023-07-20T11:24:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 -- 172.21.15.82:0/788939485 learned_addr learned my addr 172.21.15.82:0/788939485 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:48.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40659c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fa4100cd770 0x7fa4100c9860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47880/0 (socket says 172.21.15.82:47880) 2023-07-20T11:24:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40f59e640 1 --2- 172.21.15.82:0/788939485 >> v2:172.21.15.183:3300/0 conn(0x7fa4100c9f70 0x7fa41006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 -- 172.21.15.82:0/788939485 >> v2:172.21.15.183:3300/0 conn(0x7fa4100c9f70 msgr2=0x7fa41006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 --2- 172.21.15.82:0/788939485 >> v2:172.21.15.183:3300/0 conn(0x7fa4100c9f70 0x7fa41006ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 -- 172.21.15.82:0/788939485 >> v1:172.21.15.82:6789/0 conn(0x7fa4100cd770 legacy=0x7fa4100c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.652+0000 7fa40ed9d640 1 -- 172.21.15.82:0/788939485 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41015d4d0 con 0x7fa410159290 2023-07-20T11:24:48.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa40ed9d640 1 --2- 172.21.15.82:0/788939485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410159290 0x7fa410070450 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fa40000d150 tx=0x7fa40001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81640db899f3b119 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa40e59c640 1 -- 172.21.15.82:0/788939485 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40000b2d0 con 0x7fa410159290 2023-07-20T11:24:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa40e59c640 1 -- 172.21.15.82:0/788939485 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40000b430 con 0x7fa410159290 2023-07-20T11:24:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa40e59c640 1 -- 172.21.15.82:0/788939485 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4000a7b70 con 0x7fa410159290 2023-07-20T11:24:48.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- 172.21.15.82:0/788939485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410159290 msgr2=0x7fa410070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 --2- 172.21.15.82:0/788939485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410159290 0x7fa410070450 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fa40000d150 tx=0x7fa40001ea80 comp rx=0 tx=0).stop 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- 172.21.15.82:0/788939485 shutdown_connections 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 --2- 172.21.15.82:0/788939485 >> v2:172.21.15.183:3300/0 conn(0x7fa4100c9f70 0x7fa41006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 --2- 172.21.15.82:0/788939485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa410159290 0x7fa410070450 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- 172.21.15.82:0/788939485 >> 172.21.15.82:0/788939485 conn(0x7fa4100ce080 msgr2=0x7fa4100ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- 172.21.15.82:0/788939485 shutdown_connections 2023-07-20T11:24:48.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- 172.21.15.82:0/788939485 wait complete. 2023-07-20T11:24:48.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 Processor -- start 2023-07-20T11:24:48.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.656+0000 7fa414902640 1 -- start start 2023-07-20T11:24:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4100c9f70 0x7fa4101f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa410159290 0x7fa41015a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101522b0 con 0x7fa4100cd770 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4101f8d10 con 0x7fa410159290 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4100b31e0 con 0x7fa4100c9f70 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58332/0 (socket says 172.21.15.82:58332) 2023-07-20T11:24:48.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 -- 172.21.15.82:0/2051621452 learned_addr learned my addr 172.21.15.82:0/2051621452 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:48.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40f59e640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa410159290 0x7fa41015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40ed9d640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4100c9f70 0x7fa4101f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 -- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4100c9f70 msgr2=0x7fa4101f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4100c9f70 0x7fa4101f87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 -- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa410159290 msgr2=0x7fa41015a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa410159290 0x7fa41015a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 -- 172.21.15.82:0/2051621452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40000bd40 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa40659c640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c500 tx=0x7fa3f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80074e0 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f8007640 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8004a10 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4101546b0 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa410159a90 con 0x7fa4100cd770 2023-07-20T11:24:48.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41004da30 con 0x7fa4100cd770 2023-07-20T11:24:48.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.660+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 127) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fa3f8004b70 con 0x7fa4100cd770 2023-07-20T11:24:48.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.664+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fa3f80834d0 con 0x7fa4100cd770 2023-07-20T11:24:48.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.664+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3f80509b0 con 0x7fa4100cd770 2023-07-20T11:24:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.816+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4100b4000 con 0x7fa4100cd770 2023-07-20T11:24:48.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.816+0000 7fa407fff640 1 -- 172.21.15.82:0/2051621452 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v207) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3f8053fd0 con 0x7fa4100cd770 2023-07-20T11:24:48.808 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2023-07-20T11:24:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 msgr2=0x7fa4100b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 secure :-1 s=READY pgs=2484 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800c500 tx=0x7fa3f800c900 comp rx=0 tx=0).stop 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 shutdown_connections 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa410159290 0x7fa41015a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4100cd770 0x7fa4100b2ca0 unknown :-1 s=CLOSED pgs=2484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 --2- 172.21.15.82:0/2051621452 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fa4100c9f70 0x7fa4101f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 >> 172.21.15.82:0/2051621452 conn(0x7fa4100ce080 msgr2=0x7fa4100ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 shutdown_connections 2023-07-20T11:24:48.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.820+0000 7fa414902640 1 -- 172.21.15.82:0/2051621452 wait complete. 2023-07-20T11:24:48.829 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-20T11:24:48.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 Processor -- start 2023-07-20T11:24:48.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 -- start start 2023-07-20T11:24:48.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5434159450 0x7f543415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434159830 0x7f54340cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54340cc3e0 0x7f54340afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54340cce90 con 0x7f54340cc3e0 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54340cc8d0 con 0x7f5434159450 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f54389db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54340ccbb0 con 0x7f5434159830 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54340cc3e0 0x7f54340afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54340cc3e0 0x7f54340afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58336/0 (socket says 172.21.15.82:58336) 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 -- 172.21.15.82:0/1005158954 learned_addr learned my addr 172.21.15.82:0/1005158954 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:48.972 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f543259c640 1 --2- 172.21.15.82:0/1005158954 >> v2:172.21.15.183:3300/0 conn(0x7f5434159450 0x7f543415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5429d9b640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434159830 0x7f54340cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 -- 172.21.15.82:0/1005158954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434159830 msgr2=0x7f54340cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:48.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434159830 0x7f54340cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 -- 172.21.15.82:0/1005158954 >> v2:172.21.15.183:3300/0 conn(0x7f5434159450 msgr2=0x7f543415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:48.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 --2- 172.21.15.82:0/1005158954 >> v2:172.21.15.183:3300/0 conn(0x7f5434159450 0x7f543415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.980+0000 7f5432d9d640 1 -- 172.21.15.82:0/1005158954 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434159cc0 con 0x7f54340cc3e0 2023-07-20T11:24:48.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f5432d9d640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54340cc3e0 0x7f54340afd50 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f543406a6c0 tx=0x7f542c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd65cc7f5716316a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f5431d9b640 1 -- 172.21.15.82:0/1005158954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0ac600 con 0x7f54340cc3e0 2023-07-20T11:24:48.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f5431d9b640 1 -- 172.21.15.82:0/1005158954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f542c0a8050 con 0x7f54340cc3e0 2023-07-20T11:24:48.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f5431d9b640 1 -- 172.21.15.82:0/1005158954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c0ac980 con 0x7f54340cc3e0 2023-07-20T11:24:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 -- 172.21.15.82:0/1005158954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54340cc3e0 msgr2=0x7f54340afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54340cc3e0 0x7f54340afd50 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7f543406a6c0 tx=0x7f542c01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 -- 172.21.15.82:0/1005158954 shutdown_connections 2023-07-20T11:24:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54340cc3e0 0x7f54340afd50 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 --2- 172.21.15.82:0/1005158954 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434159830 0x7f54340cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 --2- 172.21.15.82:0/1005158954 >> v2:172.21.15.183:3300/0 conn(0x7f5434159450 0x7f543415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 -- 172.21.15.82:0/1005158954 >> 172.21.15.82:0/1005158954 conn(0x7f54340cad50 msgr2=0x7f54340cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 -- 172.21.15.82:0/1005158954 shutdown_connections 2023-07-20T11:24:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.984+0000 7f54389db640 1 -- 172.21.15.82:0/1005158954 wait complete. 2023-07-20T11:24:48.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 Processor -- start 2023-07-20T11:24:48.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- start start 2023-07-20T11:24:48.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54340cc3e0 0x7f5434070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434156a30 0x7f5434158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340c2f10 con 0x7f5434159450 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434156f30 con 0x7f54340cc3e0 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5434157210 con 0x7f5434156a30 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58348/0 (socket says 172.21.15.82:58348) 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 -- 172.21.15.82:0/3733055358 learned_addr learned my addr 172.21.15.82:0/3733055358 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f543259c640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54340cc3e0 0x7f5434070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5432d9d640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434156a30 0x7f5434158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 -- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434156a30 msgr2=0x7f5434158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434156a30 0x7f5434158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 -- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54340cc3e0 msgr2=0x7f5434070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:48.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54340cc3e0 0x7f5434070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 -- 172.21.15.82:0/3733055358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0094d0 con 0x7f5434159450 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f5429d9b640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f541c007e40 tx=0x7f541c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c014620 con 0x7f5434159450 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00ee90 con 0x7f5434159450 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54341574f0 con 0x7f5434159450 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0149c0 con 0x7f5434159450 2023-07-20T11:24:48.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54341511e0 con 0x7f5434159450 2023-07-20T11:24:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.988+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54340c3080 con 0x7f5434159450 2023-07-20T11:24:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.992+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 127) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f541c014b20 con 0x7f5434159450 2023-07-20T11:24:48.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.992+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f541c0843d0 con 0x7f5434159450 2023-07-20T11:24:48.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:48.996+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f541c051960 con 0x7f5434159450 2023-07-20T11:24:49.132 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.140+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f543404da30 con 0x7f5434159450 2023-07-20T11:24:49.133 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.140+0000 7f542b7fe640 1 -- 172.21.15.82:0/3733055358 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v207) v1 ==== 100+0+11 (secure 0 0 0) 0x7f541c054f80 con 0x7f5434159450 2023-07-20T11:24:49.134 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 msgr2=0x7f5434070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7f541c007e40 tx=0x7f541c00e4b0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 shutdown_connections 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5434156a30 0x7f5434158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5434159450 0x7f5434070e80 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.135 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 --2- 172.21.15.82:0/3733055358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54340cc3e0 0x7f5434070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 >> 172.21.15.82:0/3733055358 conn(0x7f54340cad50 msgr2=0x7f54340afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 shutdown_connections 2023-07-20T11:24:49.136 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.144+0000 7f54389db640 1 -- 172.21.15.82:0/3733055358 wait complete. 2023-07-20T11:24:49.154 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:49.294 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 Processor -- start 2023-07-20T11:24:49.295 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 -- start start 2023-07-20T11:24:49.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9a6c15cab0 0x7f9a6c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c0d31c0 con 0x7f9a6c0cf110 2023-07-20T11:24:49.296 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c0d16b0 con 0x7f9a6c15cab0 2023-07-20T11:24:49.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a74634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b3520 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58352/0 (socket says 172.21.15.82:58352) 2023-07-20T11:24:49.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 -- 172.21.15.82:0/3489509904 learned_addr learned my addr 172.21.15.82:0/3489509904 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:49.297 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a71bcf640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a723d0640 1 --2- 172.21.15.82:0/3489509904 >> v2:172.21.15.183:3300/0 conn(0x7f9a6c15cab0 0x7f9a6c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 -- 172.21.15.82:0/3489509904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0d0d10 msgr2=0x7f9a6c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 -- 172.21.15.82:0/3489509904 >> v2:172.21.15.183:3300/0 conn(0x7f9a6c15cab0 msgr2=0x7f9a6c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 --2- 172.21.15.82:0/3489509904 >> v2:172.21.15.183:3300/0 conn(0x7f9a6c15cab0 0x7f9a6c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.298 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.304+0000 7f9a72bd1640 1 -- 172.21.15.82:0/3489509904 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0b2910 con 0x7f9a6c0cf110 2023-07-20T11:24:49.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a72bd1640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06a660 tx=0x7f9a6401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2684c55513949f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a713ce640 1 -- 172.21.15.82:0/3489509904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640aa5f0 con 0x7f9a6c0cf110 2023-07-20T11:24:49.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a713ce640 1 -- 172.21.15.82:0/3489509904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a640aa750 con 0x7f9a6c0cf110 2023-07-20T11:24:49.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a713ce640 1 -- 172.21.15.82:0/3489509904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a640aaae0 con 0x7f9a6c0cf110 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 -- 172.21.15.82:0/3489509904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf110 msgr2=0x7f9a6c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 secure :-1 s=READY pgs=2487 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c06a660 tx=0x7f9a6401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 -- 172.21.15.82:0/3489509904 shutdown_connections 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0cf110 0x7f9a6c0cf5a0 unknown :-1 s=CLOSED pgs=2487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 --2- 172.21.15.82:0/3489509904 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 --2- 172.21.15.82:0/3489509904 >> v2:172.21.15.183:3300/0 conn(0x7f9a6c15cab0 0x7f9a6c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 -- 172.21.15.82:0/3489509904 >> 172.21.15.82:0/3489509904 conn(0x7f9a6c08c120 msgr2=0x7f9a6c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 -- 172.21.15.82:0/3489509904 shutdown_connections 2023-07-20T11:24:49.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.308+0000 7f9a74634640 1 -- 172.21.15.82:0/3489509904 wait complete. 2023-07-20T11:24:49.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 Processor -- start 2023-07-20T11:24:49.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- start start 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0cf110 0x7f9a6c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a6c15cab0 0x7f9a6c0d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c154010 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c1563d0 con 0x7f9a6c15cab0 2023-07-20T11:24:49.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c154360 con 0x7f9a6c0cf110 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58368/0 (socket says 172.21.15.82:58368) 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 -- 172.21.15.82:0/531320955 learned_addr learned my addr 172.21.15.82:0/531320955 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a723d0640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0cf110 0x7f9a6c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a72bd1640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a6c15cab0 0x7f9a6c0d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 -- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0cf110 msgr2=0x7f9a6c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0cf110 0x7f9a6c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 -- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a6c15cab0 msgr2=0x7f9a6c0d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a6c15cab0 0x7f9a6c0d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 -- 172.21.15.82:0/531320955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a640094d0 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a71bcf640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00d800 tx=0x7f9a5c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0096a0 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c009800 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c154640 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c009990 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.312+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c154c00 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.316+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c073c70 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.316+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 127) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9a5c009af0 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.316+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f9a5c083f90 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.320+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a5c051490 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.356+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 128) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9a5c050f40 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.356+0000 7f9a62ffd640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 0x7f9a5006e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.356+0000 7f9a723d0640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 0x7f9a5006e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.360+0000 7f9a723d0640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 0x7f9a5006e520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9a68003b90 tx=0x7f9a680098d0 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.499 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.508+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a6c06b600 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.500 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.508+0000 7f9a62ffd640 1 -- 172.21.15.82:0/531320955 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f9a5c07edf0 con 0x7f9a6c0d0d10 2023-07-20T11:24:49.500 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:49.501 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:49.501 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:49.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 msgr2=0x7f9a5006e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 0x7f9a5006e520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9a68003b90 tx=0x7f9a680098d0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 msgr2=0x7f9a6c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.502 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00d800 tx=0x7f9a5c00dcc0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 shutdown_connections 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f9a5006c130 0x7f9a5006e520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9a6c15cab0 0x7f9a6c0d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a6c0d0d10 0x7f9a6c0d2520 unknown :-1 s=CLOSED pgs=2488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 --2- 172.21.15.82:0/531320955 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f9a6c0cf110 0x7f9a6c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 >> 172.21.15.82:0/531320955 conn(0x7f9a6c08c120 msgr2=0x7f9a6c0af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.503 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 shutdown_connections 2023-07-20T11:24:49.504 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.512+0000 7f9a74634640 1 -- 172.21.15.82:0/531320955 wait complete. 2023-07-20T11:24:49.521 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:49.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.668+0000 7f124feec640 1 Processor -- start 2023-07-20T11:24:49.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.668+0000 7f124feec640 1 -- start start 2023-07-20T11:24:49.662 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124feec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 0x7f12480ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124feec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12480b2060 0x7f12480b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124feec640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12480b06c0 con 0x7f12480afda0 2023-07-20T11:24:49.663 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124feec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480b3160 con 0x7f12480b2060 2023-07-20T11:24:49.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124feec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480b12a0 con 0x7f124815a8e0 2023-07-20T11:24:49.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124dc88640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f12480afda0 0x7f12480b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47894/0 (socket says 172.21.15.82:47894) 2023-07-20T11:24:49.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124dc88640 1 -- 172.21.15.82:0/448417500 learned_addr learned my addr 172.21.15.82:0/448417500 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:49.664 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 --2- 172.21.15.82:0/448417500 >> v2:172.21.15.82:3300/0 conn(0x7f12480b2060 0x7f12480b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124d487640 1 --2- 172.21.15.82:0/448417500 >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 0x7f12480ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 -- 172.21.15.82:0/448417500 >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 msgr2=0x7f12480ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 --2- 172.21.15.82:0/448417500 >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 0x7f12480ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 -- 172.21.15.82:0/448417500 >> v1:172.21.15.82:6789/0 conn(0x7f12480afda0 legacy=0x7f12480b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 -- 172.21.15.82:0/448417500 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480b1580 con 0x7f12480b2060 2023-07-20T11:24:49.665 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124d487640 1 --2- 172.21.15.82:0/448417500 >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 0x7f12480ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:49.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.672+0000 7f124e489640 1 --2- 172.21.15.82:0/448417500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12480b0180 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f12480b0f10 tx=0x7f124001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb595aaf8158c98 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.666 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124cc86640 1 -- 172.21.15.82:0/448417500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400a5880 con 0x7f12480b2060 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124cc86640 1 -- 172.21.15.82:0/448417500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12400a59e0 con 0x7f12480b2060 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124cc86640 1 -- 172.21.15.82:0/448417500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400a5d70 con 0x7f12480b2060 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- 172.21.15.82:0/448417500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 msgr2=0x7f12480b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- 172.21.15.82:0/448417500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12480b0180 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f12480b0f10 tx=0x7f124001c7c0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- 172.21.15.82:0/448417500 shutdown_connections 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- 172.21.15.82:0/448417500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12480b0180 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.667 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- 172.21.15.82:0/448417500 >> v2:172.21.15.183:3300/0 conn(0x7f124815a8e0 0x7f12480ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- 172.21.15.82:0/448417500 >> 172.21.15.82:0/448417500 conn(0x7f12480cada0 msgr2=0x7f12480cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- 172.21.15.82:0/448417500 shutdown_connections 2023-07-20T11:24:49.668 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- 172.21.15.82:0/448417500 wait complete. 2023-07-20T11:24:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 Processor -- start 2023-07-20T11:24:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- start start 2023-07-20T11:24:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 0x7f12480c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.669 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 0x7f124815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124815d020 con 0x7f12480b2060 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124815d300 con 0x7f12480afda0 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124feec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12480c2ce0 con 0x7f124815a8e0 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124d487640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124d487640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58382/0 (socket says 172.21.15.82:58382) 2023-07-20T11:24:49.670 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.676+0000 7f124d487640 1 -- 172.21.15.82:0/2215686397 learned_addr learned my addr 172.21.15.82:0/2215686397 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124dc88640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 0x7f12480c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.671 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124e489640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 0x7f124815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 -- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 msgr2=0x7f124815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 0x7f124815c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 -- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 msgr2=0x7f12480c37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 0x7f12480c37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 -- 172.21.15.82:0/2215686397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240009a70 con 0x7f12480b2060 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124dc88640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 0x7f12480c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:49.672 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124e489640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 0x7f124815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124d487640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7f0 tx=0x7f123800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238004220 con 0x7f12480b2060 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1238004380 con 0x7f12480b2060 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238003840 con 0x7f12480b2060 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12480c2fc0 con 0x7f12480b2060 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248159f20 con 0x7f12480b2060 2023-07-20T11:24:49.673 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1248073c70 con 0x7f12480b2060 2023-07-20T11:24:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 128) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1238003bb0 con 0x7f12480b2060 2023-07-20T11:24:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 0x7f122c068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f1238083b90 con 0x7f12480b2060 2023-07-20T11:24:49.674 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.680+0000 7f124dc88640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 0x7f122c068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.684+0000 7f124dc88640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 0x7f122c068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1244005890 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.684+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1238051050 con 0x7f12480b2060 2023-07-20T11:24:49.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12480cb990 con 0x7f12480b2060 2023-07-20T11:24:49.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f123e7fc640 1 -- 172.21.15.82:0/2215686397 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+19389 (secure 0 0 0) 0x7f1238003e60 con 0x7f12480b2060 2023-07-20T11:24:49.827 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:49.828 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":207,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:48.343217+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6832/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3893355374":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/1542867210":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6833/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:6832/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4135921357":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/3655290478":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3061030549":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2009112200":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2902554209":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4144401913":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/2113730571":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/367903546":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/1169598737":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/666160418":"2023-07-21T11:24:41.286826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 msgr2=0x7f122c068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 0x7f122c068590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1244005890 tx=0x7f1244009040 comp rx=0 tx=0).stop 2023-07-20T11:24:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 msgr2=0x7f12481599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f123800c7f0 tx=0x7f123800ccb0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 shutdown_connections 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f122c0660d0 0x7f122c068590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f124815a8e0 0x7f124815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12480b2060 0x7f12481599e0 unknown :-1 s=CLOSED pgs=2491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 --2- 172.21.15.82:0/2215686397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12480afda0 0x7f12480c37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.836+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 >> 172.21.15.82:0/2215686397 conn(0x7f12480cada0 msgr2=0x7f12480af580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.840+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 shutdown_connections 2023-07-20T11:24:49.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:49.840+0000 7f124feec640 1 -- 172.21.15.82:0/2215686397 wait complete. 2023-07-20T11:24:49.848 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:24:49.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 Processor -- start 2023-07-20T11:24:49.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 -- start start 2023-07-20T11:24:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 0x7fb6e015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb6e00cc900 0x7fb6e00ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00ccd90 con 0x7fb6e01596b0 2023-07-20T11:24:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00ad600 con 0x7fb6e00cc900 2023-07-20T11:24:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e7834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00ad810 con 0x7fb6e00b2a90 2023-07-20T11:24:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e55d0640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb6e01596b0 0x7fb6e00b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47896/0 (socket says 172.21.15.82:47896) 2023-07-20T11:24:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e55d0640 1 -- 172.21.15.82:0/2637838814 learned_addr learned my addr 172.21.15.82:0/2637838814 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e5dd1640 1 --2- 172.21.15.82:0/2637838814 >> v2:172.21.15.183:3300/0 conn(0x7fb6e00cc900 0x7fb6e00ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6e4dcf640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 0x7fb6e015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6d7fff640 1 -- 172.21.15.82:0/2637838814 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313501867 0 0) 0x7fb6e00ccd90 con 0x7fb6e01596b0 2023-07-20T11:24:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.000+0000 7fb6d7fff640 1 -- 172.21.15.82:0/2637838814 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6cc003530 con 0x7fb6e01596b0 2023-07-20T11:24:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e5dd1640 1 -- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 msgr2=0x7fb6e015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e5dd1640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 0x7fb6e015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e5dd1640 1 -- 172.21.15.82:0/2637838814 >> v1:172.21.15.82:6789/0 conn(0x7fb6e01596b0 legacy=0x7fb6e00b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e5dd1640 1 -- 172.21.15.82:0/2637838814 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e015d0d0 con 0x7fb6e00cc900 2023-07-20T11:24:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e4dcf640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 0x7fb6e015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6e5dd1640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e00cc900 0x7fb6e00ad0c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009d90 tx=0x7fb6d801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29120e461cb33e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6d7fff640 1 -- 172.21.15.82:0/2637838814 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80a59e0 con 0x7fb6e00cc900 2023-07-20T11:24:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6d7fff640 1 -- 172.21.15.82:0/2637838814 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d80a5b40 con 0x7fb6e00cc900 2023-07-20T11:24:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.004+0000 7fb6d7fff640 1 -- 172.21.15.82:0/2637838814 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d80ad440 con 0x7fb6e00cc900 2023-07-20T11:24:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e00cc900 msgr2=0x7fb6e00ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e00cc900 0x7fb6e00ad0c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009d90 tx=0x7fb6d801c920 comp rx=0 tx=0).stop 2023-07-20T11:24:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- 172.21.15.82:0/2637838814 shutdown_connections 2023-07-20T11:24:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e00cc900 0x7fb6e00ad0c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- 172.21.15.82:0/2637838814 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00b2a90 0x7fb6e015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- 172.21.15.82:0/2637838814 >> 172.21.15.82:0/2637838814 conn(0x7fb6e00cada0 msgr2=0x7fb6e00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- 172.21.15.82:0/2637838814 shutdown_connections 2023-07-20T11:24:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- 172.21.15.82:0/2637838814 wait complete. 2023-07-20T11:24:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 Processor -- start 2023-07-20T11:24:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- start start 2023-07-20T11:24:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00cc900 0x7fb6e0159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e01596b0 0x7fb6e0159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015bf40 con 0x7fb6e00b2a90 2023-07-20T11:24:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00c5800 con 0x7fb6e01596b0 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e7834640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00c7ef0 con 0x7fb6e00cc900 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58396/0 (socket says 172.21.15.82:58396) 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 -- 172.21.15.82:0/1469347748 learned_addr learned my addr 172.21.15.82:0/1469347748 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 -- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00cc900 msgr2=0x7fb6e0159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00cc900 0x7fb6e0159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 -- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e01596b0 msgr2=0x7fb6e0159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e01596b0 0x7fb6e0159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.008+0000 7fb6e55d0640 1 -- 172.21.15.82:0/1469347748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009420 con 0x7fb6e00b2a90 2023-07-20T11:24:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6e55d0640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c3f0 tx=0x7fb6dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc005cf0 con 0x7fb6e00b2a90 2023-07-20T11:24:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc005e50 con 0x7fb6e00b2a90 2023-07-20T11:24:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d8009a70 con 0x7fb6e00b2a90 2023-07-20T11:24:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc0072f0 con 0x7fb6e00b2a90 2023-07-20T11:24:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e006c3c0 con 0x7fb6e00b2a90 2023-07-20T11:24:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e0073c70 con 0x7fb6e00b2a90 2023-07-20T11:24:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 128) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb6dc007450 con 0x7fb6e00b2a90 2023-07-20T11:24:50.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 0x7fb6c40685c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fb6dc083360 con 0x7fb6e00b2a90 2023-07-20T11:24:50.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.012+0000 7fb6e4dcf640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 0x7fb6c40685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.006 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.016+0000 7fb6e4dcf640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 0x7fb6c40685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0006e90 tx=0x7fb6d0006de0 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.008 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.016+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6dc050750 con 0x7fb6e00b2a90 2023-07-20T11:24:50.189 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.196+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6e00c86b0 con 0x7fb6e00b2a90 2023-07-20T11:24:50.190 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6d5ffb640 1 -- 172.21.15.82:0/1469347748 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fb6dc017020 con 0x7fb6e00b2a90 2023-07-20T11:24:50.190 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:50.190 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:50.191 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:50.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 msgr2=0x7fb6c40685c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 0x7fb6c40685c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0006e90 tx=0x7fb6d0006de0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 msgr2=0x7fb6e00c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.192 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c3f0 tx=0x7fb6dc00c8b0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 shutdown_connections 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb6c4066100 0x7fb6c40685c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb6e01596b0 0x7fb6e0159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb6e00cc900 0x7fb6e0159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 --2- 172.21.15.82:0/1469347748 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6e00b2a90 0x7fb6e00c79b0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 >> 172.21.15.82:0/1469347748 conn(0x7fb6e00cada0 msgr2=0x7fb6e0156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 shutdown_connections 2023-07-20T11:24:50.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.200+0000 7fb6e7834640 1 -- 172.21.15.82:0/1469347748 wait complete. 2023-07-20T11:24:50.211 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:24:50.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 Processor -- start 2023-07-20T11:24:50.352 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 -- start start 2023-07-20T11:24:50.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb1000ce600 0x7fb1000cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 0x7fb1000c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000aed60 con 0x7fb1000b0360 2023-07-20T11:24:50.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000af040 con 0x7fb1000ce600 2023-07-20T11:24:50.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.360+0000 7fb1054bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000af320 con 0x7fb1000c9a70 2023-07-20T11:24:50.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 0x7fb1000c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0f67fc640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fb1000ce600 0x7fb1000cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0feffd640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7fb1000b0360 0x7fb1000b0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:57248/0 (socket says 172.21.15.82:57248) 2023-07-20T11:24:50.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0feffd640 1 -- 172.21.15.82:0/1543116699 learned_addr learned my addr 172.21.15.82:0/1543116699 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:50.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 -- 172.21.15.82:0/1543116699 >> v2:172.21.15.183:3300/0 conn(0x7fb1000ce600 msgr2=0x7fb1000cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:50.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 --2- 172.21.15.82:0/1543116699 >> v2:172.21.15.183:3300/0 conn(0x7fb1000ce600 0x7fb1000cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 -- 172.21.15.82:0/1543116699 >> v1:172.21.15.183:6789/0 conn(0x7fb1000b0360 legacy=0x7fb1000b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 -- 172.21.15.82:0/1543116699 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000af600 con 0x7fb1000c9a70 2023-07-20T11:24:50.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0ff7fe640 1 --2- 172.21.15.82:0/1543116699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 0x7fb1000c9f00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47890d354f61404b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0fe7fc640 1 -- 172.21.15.82:0/1543116699 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80a5a00 con 0x7fb1000c9a70 2023-07-20T11:24:50.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0fe7fc640 1 -- 172.21.15.82:0/1543116699 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1000cf1b0 con 0x7fb1000c9a70 2023-07-20T11:24:50.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.364+0000 7fb0fe7fc640 1 -- 172.21.15.82:0/1543116699 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80a5d80 con 0x7fb1000c9a70 2023-07-20T11:24:50.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- 172.21.15.82:0/1543116699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 msgr2=0x7fb1000c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- 172.21.15.82:0/1543116699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 0x7fb1000c9f00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009d90 tx=0x7fb0f801c920 comp rx=0 tx=0).stop 2023-07-20T11:24:50.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- 172.21.15.82:0/1543116699 shutdown_connections 2023-07-20T11:24:50.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- 172.21.15.82:0/1543116699 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000c9a70 0x7fb1000c9f00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- 172.21.15.82:0/1543116699 >> v2:172.21.15.183:3300/0 conn(0x7fb1000ce600 0x7fb1000cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- 172.21.15.82:0/1543116699 >> 172.21.15.82:0/1543116699 conn(0x7fb100098a10 msgr2=0x7fb1000cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:50.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- 172.21.15.82:0/1543116699 shutdown_connections 2023-07-20T11:24:50.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- 172.21.15.82:0/1543116699 wait complete. 2023-07-20T11:24:50.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 Processor -- start 2023-07-20T11:24:50.360 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- start start 2023-07-20T11:24:50.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 0x7fb1000cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000ce600 0x7fb1000cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000ac810 con 0x7fb1000c9a70 2023-07-20T11:24:50.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000ad600 con 0x7fb1000b0360 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb1054bd640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000ac9f0 con 0x7fb1000ce600 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb0f67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb0f67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58412/0 (socket says 172.21.15.82:58412) 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.368+0000 7fb0f67fc640 1 -- 172.21.15.82:0/2096755554 learned_addr learned my addr 172.21.15.82:0/2096755554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0ff7fe640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000ce600 0x7fb1000cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.362 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0feffd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 0x7fb1000cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 -- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000ce600 msgr2=0x7fb1000cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.363 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000ce600 0x7fb1000cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 -- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 msgr2=0x7fb1000cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 0x7fb1000cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 -- 172.21.15.82:0/2096755554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8009a70 con 0x7fb1000c9a70 2023-07-20T11:24:50.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0feffd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 0x7fb1000cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:50.364 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f67fc640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800e870 tx=0x7fb0e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e8009510 con 0x7fb1000c9a70 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e800eec0 con 0x7fb1000c9a70 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1000accd0 con 0x7fb1000c9a70 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e800cb40 con 0x7fb1000c9a70 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1000ad290 con 0x7fb1000c9a70 2023-07-20T11:24:50.365 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1000ad7b0 con 0x7fb1000c9a70 2023-07-20T11:24:50.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 128) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb0e800ccc0 con 0x7fb1000c9a70 2023-07-20T11:24:50.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.372+0000 7fb0f7fff640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 0x7fb0e4068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.366 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.376+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fb0e8083d40 con 0x7fb1000c9a70 2023-07-20T11:24:50.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.376+0000 7fb0feffd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 0x7fb0e4068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.376+0000 7fb0feffd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 0x7fb0e4068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005890 tx=0x7fb0f0009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.380+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1000ad7b0 con 0x7fb1000c9a70 2023-07-20T11:24:50.492 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.500+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 129) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fb0e80515b0 con 0x7fb1000c9a70 2023-07-20T11:24:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.572+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1000ad770 con 0x7fb1000c9a70 2023-07-20T11:24:50.563 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.572+0000 7fb0f7fff640 1 -- 172.21.15.82:0/2096755554 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fb0e8017020 con 0x7fb1000c9a70 2023-07-20T11:24:50.564 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:50.564 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":99,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-20T11:24:24.039156+0000","modified":"2023-07-20T11:24:27.702303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":11418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11418":{"gid":11418,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6837/2909452184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2909452184},{"type":"v1","addr":"172.21.15.82:6837","nonce":2909452184}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-07-20T11:24:50.564 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 99 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 msgr2=0x7fb0e4068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 0x7fb0e4068590 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0005890 tx=0x7fb0f0009040 comp rx=0 tx=0).stop 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 msgr2=0x7fb1001539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fb0e800e870 tx=0x7fb0e800ec70 comp rx=0 tx=0).stop 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 shutdown_connections 2023-07-20T11:24:50.566 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0e40660d0 0x7fb0e4068590 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb1000ce600 0x7fb1000cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb1000c9a70 0x7fb1001539d0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 --2- 172.21.15.82:0/2096755554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1000b0360 0x7fb1000cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 >> 172.21.15.82:0/2096755554 conn(0x7fb100098a10 msgr2=0x7fb1000b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 shutdown_connections 2023-07-20T11:24:50.567 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.576+0000 7fb1054bd640 1 -- 172.21.15.82:0/2096755554 wait complete. 2023-07-20T11:24:50.584 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:50.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 Processor -- start 2023-07-20T11:24:50.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 -- start start 2023-07-20T11:24:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc7f8160bc0 0x7fc7f806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7f80c1a00 0x7fc7f80aae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80cc560 con 0x7fc7f8160fa0 2023-07-20T11:24:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80ad7e0 con 0x7fc7f80c1a00 2023-07-20T11:24:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.732+0000 7fc7ff782640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80cc790 con 0x7fc7f8160bc0 2023-07-20T11:24:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7f80c1a00 0x7fc7f80aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fc7f80c1a00 0x7fc7f80aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58450/0 (socket says 172.21.15.82:58450) 2023-07-20T11:24:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 -- 172.21.15.82:0/3843469236 learned_addr learned my addr 172.21.15.82:0/3843469236 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fd51e640 1 --2- 172.21.15.82:0/3843469236 >> v2:172.21.15.183:3300/0 conn(0x7fc7f8160bc0 0x7fc7f806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 -- 172.21.15.82:0/3843469236 >> v2:172.21.15.183:3300/0 conn(0x7fc7f8160bc0 msgr2=0x7fc7f806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 --2- 172.21.15.82:0/3843469236 >> v2:172.21.15.183:3300/0 conn(0x7fc7f8160bc0 0x7fc7f806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 -- 172.21.15.82:0/3843469236 >> v1:172.21.15.183:6789/0 conn(0x7fc7f8160fa0 legacy=0x7fc7f80c12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 -- 172.21.15.82:0/3843469236 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80cca70 con 0x7fc7f80c1a00 2023-07-20T11:24:50.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7fdd1f640 1 --2- 172.21.15.82:0/3843469236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f80c1a00 0x7fc7f80aae90 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cf420 tx=0x7fc7f001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b2aa865ce92bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7effff640 1 -- 172.21.15.82:0/3843469236 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a5860 con 0x7fc7f80c1a00 2023-07-20T11:24:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7effff640 1 -- 172.21.15.82:0/3843469236 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f00a59c0 con 0x7fc7f80c1a00 2023-07-20T11:24:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.736+0000 7fc7effff640 1 -- 172.21.15.82:0/3843469236 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a5d50 con 0x7fc7f80c1a00 2023-07-20T11:24:50.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- 172.21.15.82:0/3843469236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f80c1a00 msgr2=0x7fc7f80aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- 172.21.15.82:0/3843469236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f80c1a00 0x7fc7f80aae90 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80cf420 tx=0x7fc7f001c9a0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- 172.21.15.82:0/3843469236 shutdown_connections 2023-07-20T11:24:50.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- 172.21.15.82:0/3843469236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f80c1a00 0x7fc7f80aae90 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- 172.21.15.82:0/3843469236 >> v2:172.21.15.183:3300/0 conn(0x7fc7f8160bc0 0x7fc7f806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- 172.21.15.82:0/3843469236 >> 172.21.15.82:0/3843469236 conn(0x7fc7f80cada0 msgr2=0x7fc7f80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- 172.21.15.82:0/3843469236 shutdown_connections 2023-07-20T11:24:50.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- 172.21.15.82:0/3843469236 wait complete. 2023-07-20T11:24:50.737 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 Processor -- start 2023-07-20T11:24:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- start start 2023-07-20T11:24:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7f80c1a00 0x7fc7f81545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.738 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f8160fa0 0x7fc7f8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8154af0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8099d00 con 0x7fc7f8160fa0 2023-07-20T11:24:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7ff782640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8099fe0 con 0x7fc7f80c1a00 2023-07-20T11:24:50.739 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58466/0 (socket says 172.21.15.82:58466) 2023-07-20T11:24:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 -- 172.21.15.82:0/172654181 learned_addr learned my addr 172.21.15.82:0/172654181 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fd51e640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7f80c1a00 0x7fc7f81545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.740 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fdd1f640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f8160fa0 0x7fc7f8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 -- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7f80c1a00 msgr2=0x7fc7f81545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7f80c1a00 0x7fc7f81545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 -- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f8160fa0 msgr2=0x7fc7f8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f8160fa0 0x7fc7f8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 -- 172.21.15.82:0/172654181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009b30 con 0x7fc7f8160bc0 2023-07-20T11:24:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7fcd1d640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c3c0 tx=0x7fc7e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.740+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80052d0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8005430 con 0x7fc7f8160bc0 2023-07-20T11:24:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8003840 con 0x7fc7f8160bc0 2023-07-20T11:24:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f809a2c0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f809a880 con 0x7fc7f8160bc0 2023-07-20T11:24:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f809aaa0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 129) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fc7e80039a0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7edffb640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 0x7fc7dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:50.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fc7e80835d0 con 0x7fc7f8160bc0 2023-07-20T11:24:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7fd51e640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 0x7fc7dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.744+0000 7fc7fd51e640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 0x7fc7dc0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8099710 tx=0x7fc7f4008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.748+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7e8050710 con 0x7fc7f8160bc0 2023-07-20T11:24:50.889 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.896+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7f8073c70 con 0x7fc7f8160bc0 2023-07-20T11:24:50.890 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7edffb640 1 -- 172.21.15.82:0/172654181 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+19389 (secure 0 0 0) 0x7fc7e8053d30 con 0x7fc7f8160bc0 2023-07-20T11:24:50.891 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:50.891 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":207,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:48.343217+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-07-20T11:24:21.724849+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"204","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-07-20T11:24:23.044606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6833/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6832/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3893355374":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/1542867210":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6833/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:6832/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4135921357":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/3655290478":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3061030549":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2009112200":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2902554209":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4144401913":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/2113730571":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/367903546":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/1169598737":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/666160418":"2023-07-21T11:24:41.286826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:50.892 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 msgr2=0x7fc7dc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 0x7fc7dc0687d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8099710 tx=0x7fc7f4008040 comp rx=0 tx=0).stop 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 msgr2=0x7fc7f8157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800c3c0 tx=0x7fc7e800c880 comp rx=0 tx=0).stop 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 shutdown_connections 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc7dc066310 0x7fc7dc0687d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.893 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc7f8160fa0 0x7fc7f8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f8160bc0 0x7fc7f8157f40 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 --2- 172.21.15.82:0/172654181 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc7f80c1a00 0x7fc7f81545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 >> 172.21.15.82:0/172654181 conn(0x7fc7f80cada0 msgr2=0x7fc7f80b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 shutdown_connections 2023-07-20T11:24:50.894 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:50.900+0000 7fc7ff782640 1 -- 172.21.15.82:0/172654181 wait complete. 2023-07-20T11:24:50.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-20T11:24:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 Processor -- start 2023-07-20T11:24:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 -- start start 2023-07-20T11:24:51.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fe48415dbb0 0x7fe4840cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4840ad810 con 0x7fe4840b2a90 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48415d0d0 con 0x7fe4841596b0 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48918f640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48415e000 con 0x7fe48415dbb0 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe47a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe4840b2a90 0x7fe4840c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47900/0 (socket says 172.21.15.82:47900) 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe47a59c640 1 -- 172.21.15.82:0/3905054534 learned_addr learned my addr 172.21.15.82:0/3905054534 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48359e640 1 --2- 172.21.15.82:0/3905054534 >> v2:172.21.15.183:3300/0 conn(0x7fe48415dbb0 0x7fe4840cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48259c640 1 -- 172.21.15.82:0/3905054534 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078516722 0 0) 0x7fe4840ad810 con 0x7fe4840b2a90 2023-07-20T11:24:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48259c640 1 -- 172.21.15.82:0/3905054534 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470003530 con 0x7fe4840b2a90 2023-07-20T11:24:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48359e640 1 -- 172.21.15.82:0/3905054534 >> v1:172.21.15.183:6789/0 conn(0x7fe4841596b0 legacy=0x7fe4840b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48359e640 1 -- 172.21.15.82:0/3905054534 >> v1:172.21.15.82:6789/0 conn(0x7fe4840b2a90 legacy=0x7fe4840c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.060+0000 7fe48359e640 1 -- 172.21.15.82:0/3905054534 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48415d3b0 con 0x7fe48415dbb0 2023-07-20T11:24:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48359e640 1 --2- 172.21.15.82:0/3905054534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe48415dbb0 0x7fe4840cc900 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0097f0 tx=0x7fe47c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39a373fb4dc2bdc server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48259c640 1 -- 172.21.15.82:0/3905054534 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0ab5f0 con 0x7fe48415dbb0 2023-07-20T11:24:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48259c640 1 -- 172.21.15.82:0/3905054534 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c0ab750 con 0x7fe48415dbb0 2023-07-20T11:24:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48259c640 1 -- 172.21.15.82:0/3905054534 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0abae0 con 0x7fe48415dbb0 2023-07-20T11:24:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 -- 172.21.15.82:0/3905054534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe48415dbb0 msgr2=0x7fe4840cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 --2- 172.21.15.82:0/3905054534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe48415dbb0 0x7fe4840cc900 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0097f0 tx=0x7fe47c01c450 comp rx=0 tx=0).stop 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 -- 172.21.15.82:0/3905054534 shutdown_connections 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 --2- 172.21.15.82:0/3905054534 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe48415dbb0 0x7fe4840cc900 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 -- 172.21.15.82:0/3905054534 >> 172.21.15.82:0/3905054534 conn(0x7fe4840cada0 msgr2=0x7fe4840cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 -- 172.21.15.82:0/3905054534 shutdown_connections 2023-07-20T11:24:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.064+0000 7fe48918f640 1 -- 172.21.15.82:0/3905054534 wait complete. 2023-07-20T11:24:51.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 Processor -- start 2023-07-20T11:24:51.058 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- start start 2023-07-20T11:24:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4840b2a90 0x7fe4840c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe48415dbb0 0x7fe4840b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840cce40 con 0x7fe4841596b0 2023-07-20T11:24:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe484158460 con 0x7fe4840b2a90 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4840c48d0 con 0x7fe48415dbb0 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58476/0 (socket says 172.21.15.82:58476) 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 -- 172.21.15.82:0/3565876194 learned_addr learned my addr 172.21.15.82:0/3565876194 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe482d9d640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4840b2a90 0x7fe4840c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48359e640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe48415dbb0 0x7fe4840b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 -- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe48415dbb0 msgr2=0x7fe4840b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe48415dbb0 0x7fe4840b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 -- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4840b2a90 msgr2=0x7fe4840c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4840b2a90 0x7fe4840c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 -- 172.21.15.82:0/3565876194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c009420 con 0x7fe4841596b0 2023-07-20T11:24:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47a59c640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00cbc0 tx=0x7fe46c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00ad40 con 0x7fe4841596b0 2023-07-20T11:24:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c012400 con 0x7fe4841596b0 2023-07-20T11:24:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00aea0 con 0x7fe4841596b0 2023-07-20T11:24:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4840c4b70 con 0x7fe4841596b0 2023-07-20T11:24:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.068+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe484157e10 con 0x7fe4841596b0 2023-07-20T11:24:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4841585d0 con 0x7fe4841596b0 2023-07-20T11:24:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 129) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fe46c007070 con 0x7fe4841596b0 2023-07-20T11:24:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe47bfff640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 0x7fe464068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fe46c0840c0 con 0x7fe4841596b0 2023-07-20T11:24:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe482d9d640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 0x7fe464068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.072+0000 7fe482d9d640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 0x7fe464068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe48406bbf0 tx=0x7fe474009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.076+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe46c051200 con 0x7fe4841596b0 2023-07-20T11:24:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.252+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe484073c70 con 0x7fe4841596b0 2023-07-20T11:24:51.245 INFO:tasks.ceph.mon.a.smithi082.stderr:2023-07-20T11:24:51.252+0000 7eff32b95640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-20T11:24:51.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.260+0000 7fe47bfff640 1 -- 172.21.15.82:0/3565876194 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe46c017090 con 0x7fe4841596b0 2023-07-20T11:24:51.253 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-20T11:24:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 msgr2=0x7fe464068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 0x7fe464068800 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe48406bbf0 tx=0x7fe474009040 comp rx=0 tx=0).stop 2023-07-20T11:24:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 msgr2=0x7fe4840b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00cbc0 tx=0x7fe46c00a430 comp rx=0 tx=0).stop 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 shutdown_connections 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe464066340 0x7fe464068800 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe48415dbb0 0x7fe4840b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4841596b0 0x7fe4840b1b00 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 --2- 172.21.15.82:0/3565876194 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe4840b2a90 0x7fe4840c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 >> 172.21.15.82:0/3565876194 conn(0x7fe4840cada0 msgr2=0x7fe48406d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 shutdown_connections 2023-07-20T11:24:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.264+0000 7fe48918f640 1 -- 172.21.15.82:0/3565876194 wait complete. 2023-07-20T11:24:51.258 INFO:tasks.ceph.mds.c.smithi082.stderr: -4076> 2023-07-20T11:24:30.632+0000 7fd86be6d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-20T11:24:51.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-20T11:24:51.309 INFO:tasks.ceph.mds.c.smithi082.stdout:starting mds.c at 2023-07-20T11:24:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 Processor -- start 2023-07-20T11:24:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 -- start start 2023-07-20T11:24:51.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a8159450 0x7fe5a815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.421 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 0x7fe5a80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a80cc8d0 con 0x7fe5a80cc3e0 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80cce90 con 0x7fe5a8159450 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.428+0000 7fe5ae967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80ccbb0 con 0x7fe5a8159830 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a8159450 0x7fe5a815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fe5a8159450 0x7fe5a815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58498/0 (socket says 172.21.15.82:58498) 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5acf04640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fe5a80cc3e0 0x7fe5a80afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:47914/0 (socket says 172.21.15.82:47914) 2023-07-20T11:24:51.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 -- 172.21.15.82:0/2181272646 learned_addr learned my addr 172.21.15.82:0/2181272646 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a77fe640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 0x7fe5a80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 -- 172.21.15.82:0/2181272646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 msgr2=0x7fe5a80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 0x7fe5a80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 -- 172.21.15.82:0/2181272646 >> v1:172.21.15.82:6789/0 conn(0x7fe5a80cc3e0 legacy=0x7fe5a80afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 -- 172.21.15.82:0/2181272646 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8159cc0 con 0x7fe5a8159450 2023-07-20T11:24:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a77fe640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 0x7fe5a80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a7fff640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a8159450 0x7fe5a815a4c0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fe598009870 tx=0x7fe59801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275573f4190b962 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a6ffd640 1 -- 172.21.15.82:0/2181272646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980aa650 con 0x7fe5a8159450 2023-07-20T11:24:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a6ffd640 1 -- 172.21.15.82:0/2181272646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5980aa7b0 con 0x7fe5a8159450 2023-07-20T11:24:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.432+0000 7fe5a6ffd640 1 -- 172.21.15.82:0/2181272646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980aab40 con 0x7fe5a8159450 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- 172.21.15.82:0/2181272646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a8159450 msgr2=0x7fe5a815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a8159450 0x7fe5a815a4c0 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fe598009870 tx=0x7fe59801c510 comp rx=0 tx=0).stop 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- 172.21.15.82:0/2181272646 shutdown_connections 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159830 0x7fe5a80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- 172.21.15.82:0/2181272646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a8159450 0x7fe5a815a4c0 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- 172.21.15.82:0/2181272646 >> 172.21.15.82:0/2181272646 conn(0x7fe5a80cad50 msgr2=0x7fe5a80cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- 172.21.15.82:0/2181272646 shutdown_connections 2023-07-20T11:24:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- 172.21.15.82:0/2181272646 wait complete. 2023-07-20T11:24:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 Processor -- start 2023-07-20T11:24:51.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- start start 2023-07-20T11:24:51.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5a80cc3e0 0x7fe5a80b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159450 0x7fe5a81467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80b13f0 con 0x7fe5a81f2940 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80b16d0 con 0x7fe5a80cc3e0 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5ae967640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80b19b0 con 0x7fe5a8159450 2023-07-20T11:24:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5acf04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5acf04640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58510/0 (socket says 172.21.15.82:58510) 2023-07-20T11:24:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5acf04640 1 -- 172.21.15.82:0/1975662267 learned_addr learned my addr 172.21.15.82:0/1975662267 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5a7fff640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5a80cc3e0 0x7fe5a80b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.436+0000 7fe5a77fe640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159450 0x7fe5a81467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 -- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159450 msgr2=0x7fe5a81467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159450 0x7fe5a81467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 -- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5a80cc3e0 msgr2=0x7fe5a80b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5a80cc3e0 0x7fe5a80b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 -- 172.21.15.82:0/1975662267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980094d0 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5acf04640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c730 tx=0x7fe5a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000ce40 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000a640 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000a9f0 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a80b1c90 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a80b10e0 con 0x7fe5a81f2940 2023-07-20T11:24:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a80b21b0 con 0x7fe5a81f2940 2023-07-20T11:24:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 129) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fe5a000ab50 con 0x7fe5a81f2940 2023-07-20T11:24:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 0x7fe5940687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.440+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fe5a0083890 con 0x7fe5a81f2940 2023-07-20T11:24:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.444+0000 7fe5a7fff640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 0x7fe5940687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:51.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.444+0000 7fe5a7fff640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 0x7fe5940687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5980ae000 tx=0x7fe5980b5040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:51.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.444+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5a80b21b0 con 0x7fe5a81f2940 2023-07-20T11:24:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:51.636+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe5a80b21b0 con 0x7fe5a81f2940 2023-07-20T11:24:52.253 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.260+0000 7fe5a4ff9640 1 -- 172.21.15.82:0/1975662267 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v101) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5a80b21b0 con 0x7fe5a81f2940 2023-07-20T11:24:52.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 msgr2=0x7fe5940687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 0x7fe5940687d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe5980ae000 tx=0x7fe5980b5040 comp rx=0 tx=0).stop 2023-07-20T11:24:52.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 msgr2=0x7fe5a80c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.256 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7fe5a000c730 tx=0x7fe5a000cbf0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 shutdown_connections 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fe594066310 0x7fe5940687d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5a81f2940 0x7fe5a80c53a0 unknown :-1 s=CLOSED pgs=2505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fe5a8159450 0x7fe5a81467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 --2- 172.21.15.82:0/1975662267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe5a80cc3e0 0x7fe5a80b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.257 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 >> 172.21.15.82:0/1975662267 conn(0x7fe5a80cad50 msgr2=0x7fe5a80ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:52.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 shutdown_connections 2023-07-20T11:24:52.258 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.264+0000 7fe5ae967640 1 -- 172.21.15.82:0/1975662267 wait complete. 2023-07-20T11:24:52.279 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-20T11:24:52.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 Processor -- start 2023-07-20T11:24:52.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 -- start start 2023-07-20T11:24:52.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd960161de0 0x7fd9600afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd9600b0290 0x7fd9600cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9600b06e0 con 0x7fd960160ba0 2023-07-20T11:24:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9600c9650 con 0x7fd960161de0 2023-07-20T11:24:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd967537640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9601619c0 con 0x7fd9600b0290 2023-07-20T11:24:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd960161de0 0x7fd9600afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd960161de0 0x7fd9600afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58518/0 (socket says 172.21.15.82:58518) 2023-07-20T11:24:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 -- 172.21.15.82:0/3997048852 learned_addr learned my addr 172.21.15.82:0/3997048852 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:52.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd965ad4640 1 --2- 172.21.15.82:0/3997048852 >> v2:172.21.15.183:3300/0 conn(0x7fd9600b0290 0x7fd9600cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 -- 172.21.15.82:0/3997048852 >> v2:172.21.15.183:3300/0 conn(0x7fd9600b0290 msgr2=0x7fd9600cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:52.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 --2- 172.21.15.82:0/3997048852 >> v2:172.21.15.183:3300/0 conn(0x7fd9600b0290 0x7fd9600cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 -- 172.21.15.82:0/3997048852 >> v1:172.21.15.183:6789/0 conn(0x7fd960160ba0 legacy=0x7fd9600c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.480+0000 7fd964ad2640 1 -- 172.21.15.82:0/3997048852 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9600c9370 con 0x7fd960161de0 2023-07-20T11:24:52.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd964ad2640 1 --2- 172.21.15.82:0/3997048852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd960161de0 0x7fd9600afd50 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ca0b0 tx=0x7fd95001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5427e014bc2ba1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:52.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd957fff640 1 -- 172.21.15.82:0/3997048852 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500aa430 con 0x7fd960161de0 2023-07-20T11:24:52.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd957fff640 1 -- 172.21.15.82:0/3997048852 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9500aa590 con 0x7fd960161de0 2023-07-20T11:24:52.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd957fff640 1 -- 172.21.15.82:0/3997048852 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9500aa920 con 0x7fd960161de0 2023-07-20T11:24:52.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 -- 172.21.15.82:0/3997048852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd960161de0 msgr2=0x7fd9600afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 --2- 172.21.15.82:0/3997048852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd960161de0 0x7fd9600afd50 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7fd9600ca0b0 tx=0x7fd95001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 -- 172.21.15.82:0/3997048852 shutdown_connections 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 --2- 172.21.15.82:0/3997048852 >> v2:172.21.15.183:3300/0 conn(0x7fd9600b0290 0x7fd9600cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 --2- 172.21.15.82:0/3997048852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd960161de0 0x7fd9600afd50 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 -- 172.21.15.82:0/3997048852 >> 172.21.15.82:0/3997048852 conn(0x7fd9600cad50 msgr2=0x7fd9600cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 -- 172.21.15.82:0/3997048852 shutdown_connections 2023-07-20T11:24:52.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.484+0000 7fd967537640 1 -- 172.21.15.82:0/3997048852 wait complete. 2023-07-20T11:24:52.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 Processor -- start 2023-07-20T11:24:52.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- start start 2023-07-20T11:24:52.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd960160ba0 0x7fd96015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd960161de0 0x7fd96015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015c0d0 con 0x7fd9600b0290 2023-07-20T11:24:52.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9600b3340 con 0x7fd960161de0 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96015c320 con 0x7fd960160ba0 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58528/0 (socket says 172.21.15.82:58528) 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 -- 172.21.15.82:0/715303479 learned_addr learned my addr 172.21.15.82:0/715303479 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd964ad2640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd960160ba0 0x7fd96015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd965ad4640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd960161de0 0x7fd96015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 -- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd960160ba0 msgr2=0x7fd96015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd960160ba0 0x7fd96015b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 -- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd960161de0 msgr2=0x7fd96015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd960161de0 0x7fd96015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:52.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 -- 172.21.15.82:0/715303479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9500094d0 con 0x7fd9600b0290 2023-07-20T11:24:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd9652d3640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c500 tx=0x7fd95c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c005220 con 0x7fd9600b0290 2023-07-20T11:24:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c005380 con 0x7fd9600b0290 2023-07-20T11:24:52.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96015c600 con 0x7fd9600b0290 2023-07-20T11:24:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c007270 con 0x7fd9600b0290 2023-07-20T11:24:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.488+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96015bde0 con 0x7fd9600b0290 2023-07-20T11:24:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96015cb20 con 0x7fd9600b0290 2023-07-20T11:24:52.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 129) v1 ==== 85704+0+0 (secure 0 0 0) 0x7fd95c0073d0 con 0x7fd9600b0290 2023-07-20T11:24:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd955ffb640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 0x7fd9440687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fd95c083800 con 0x7fd9600b0290 2023-07-20T11:24:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd964ad2640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 0x7fd9440687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:52.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.492+0000 7fd964ad2640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 0x7fd9440687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ae000 tx=0x7fd9500a7000 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:52.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.496+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd96015cb20 con 0x7fd9600b0290 2023-07-20T11:24:52.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:52.648+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd9600b06e0 con 0x7fd9600b0290 2023-07-20T11:24:53.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.272+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd95c050d20 con 0x7fd9600b0290 2023-07-20T11:24:53.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.516+0000 7fd955ffb640 1 -- 172.21.15.82:0/715303479 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v209) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd95c07e7a0 con 0x7fd9600b0290 2023-07-20T11:24:53.506 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2023-07-20T11:24:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 msgr2=0x7fd9440687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 0x7fd9440687d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd9500ae000 tx=0x7fd9500a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 msgr2=0x7fd960163b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:53.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c500 tx=0x7fd95c00c9c0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 shutdown_connections 2023-07-20T11:24:53.511 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd944066310 0x7fd9440687d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd960161de0 0x7fd96015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd960160ba0 0x7fd96015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 --2- 172.21.15.82:0/715303479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9600b0290 0x7fd960163b90 secure :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00c500 tx=0x7fd95c00c9c0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 >> 172.21.15.82:0/715303479 conn(0x7fd9600cad50 msgr2=0x7fd9600701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:53.512 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 shutdown_connections 2023-07-20T11:24:53.513 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.520+0000 7fd967537640 1 -- 172.21.15.82:0/715303479 wait complete. 2023-07-20T11:24:53.538 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-20T11:24:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.695+0000 7fd3a3100640 1 Processor -- start 2023-07-20T11:24:53.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.695+0000 7fd3a3100640 1 -- start start 2023-07-20T11:24:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fd39c15c7e0 0x7fd39c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd39c0b2230 0x7fd39c160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0caf00 0x7fd39c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0b26a0 con 0x7fd39c0b2230 2023-07-20T11:24:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0c9190 con 0x7fd39c15c7e0 2023-07-20T11:24:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a3100640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0cb8d0 con 0x7fd39c0caf00 2023-07-20T11:24:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd39c0b2230 0x7fd39c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fd39c0b2230 0x7fd39c160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59398/0 (socket says 172.21.15.82:59398) 2023-07-20T11:24:53.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 -- 172.21.15.82:0/3393592518 learned_addr learned my addr 172.21.15.82:0/3393592518 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a0e9c640 1 --2- 172.21.15.82:0/3393592518 >> v2:172.21.15.183:3300/0 conn(0x7fd39c15c7e0 0x7fd39c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd3a169d640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0caf00 0x7fd39c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 -- 172.21.15.82:0/3393592518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0caf00 msgr2=0x7fd39c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0caf00 0x7fd39c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 -- 172.21.15.82:0/3393592518 >> v2:172.21.15.183:3300/0 conn(0x7fd39c15c7e0 msgr2=0x7fd39c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 --2- 172.21.15.82:0/3393592518 >> v2:172.21.15.183:3300/0 conn(0x7fd39c15c7e0 0x7fd39c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.699+0000 7fd393fff640 1 -- 172.21.15.82:0/3393592518 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c15cbc0 con 0x7fd39c0b2230 2023-07-20T11:24:53.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd393fff640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c0b2230 0x7fd39c160370 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0cbc20 tx=0x7fd38c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e154f5159e44be server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3937fe640 1 -- 172.21.15.82:0/3393592518 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0aa5f0 con 0x7fd39c0b2230 2023-07-20T11:24:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3937fe640 1 -- 172.21.15.82:0/3393592518 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0aa750 con 0x7fd39c0b2230 2023-07-20T11:24:53.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3937fe640 1 -- 172.21.15.82:0/3393592518 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0aaae0 con 0x7fd39c0b2230 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- 172.21.15.82:0/3393592518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c0b2230 msgr2=0x7fd39c160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c0b2230 0x7fd39c160370 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fd39c0cbc20 tx=0x7fd38c01c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- 172.21.15.82:0/3393592518 shutdown_connections 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0caf00 0x7fd39c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 --2- 172.21.15.82:0/3393592518 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c0b2230 0x7fd39c160370 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 --2- 172.21.15.82:0/3393592518 >> v2:172.21.15.183:3300/0 conn(0x7fd39c15c7e0 0x7fd39c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- 172.21.15.82:0/3393592518 >> 172.21.15.82:0/3393592518 conn(0x7fd39c065710 msgr2=0x7fd39c069750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- 172.21.15.82:0/3393592518 shutdown_connections 2023-07-20T11:24:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- 172.21.15.82:0/3393592518 wait complete. 2023-07-20T11:24:53.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 Processor -- start 2023-07-20T11:24:53.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.703+0000 7fd3a3100640 1 -- start start 2023-07-20T11:24:53.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0b2230 0x7fd39c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd39c0caf00 0x7fd39c0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0c6400 con 0x7fd39c15c7e0 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c153c40 con 0x7fd39c0caf00 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0c68f0 con 0x7fd39c0b2230 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59414/0 (socket says 172.21.15.82:59414) 2023-07-20T11:24:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 -- 172.21.15.82:0/1969675278 learned_addr learned my addr 172.21.15.82:0/1969675278 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd393fff640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd39c0caf00 0x7fd39c0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a0e9c640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0b2230 0x7fd39c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 -- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0b2230 msgr2=0x7fd39c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0b2230 0x7fd39c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 -- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd39c0caf00 msgr2=0x7fd39c0c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd39c0caf00 0x7fd39c0c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:53.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 -- 172.21.15.82:0/1969675278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c0094d0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a169d640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d600 tx=0x7fd39400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394014620 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940147a0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0c76f0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394014b50 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c0c6b80 con 0x7fd39c15c7e0 2023-07-20T11:24:53.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c04da30 con 0x7fd39c15c7e0 2023-07-20T11:24:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.707+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd394014cb0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.711+0000 7fd3917fa640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 0x7fd388068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.711+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 6470+0+0 (secure 0 0 0) 0x7fd3940843a0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.711+0000 7fd3a0e9c640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 0x7fd388068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:53.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.711+0000 7fd3a0e9c640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 0x7fd388068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd398003b90 tx=0x7fd3980098d0 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:53.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.715+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd3940550b0 con 0x7fd39c15c7e0 2023-07-20T11:24:53.862 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:53.871+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd39c0c6b20 con 0x7fd39c15c7e0 2023-07-20T11:24:54.514 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.523+0000 7fd3917fa640 1 -- 172.21.15.82:0/1969675278 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v210) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd394054c40 con 0x7fd39c15c7e0 2023-07-20T11:24:54.514 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2023-07-20T11:24:54.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.523+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 msgr2=0x7fd388068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.523+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 0x7fd388068860 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd398003b90 tx=0x7fd3980098d0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.523+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 msgr2=0x7fd39c152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.523+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fd39400d600 tx=0x7fd39400dac0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 shutdown_connections 2023-07-20T11:24:54.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fd3880663a0 0x7fd388068860 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd39c15c7e0 0x7fd39c152fc0 unknown :-1 s=CLOSED pgs=2509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.518 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd39c0caf00 0x7fd39c0c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 --2- 172.21.15.82:0/1969675278 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fd39c0b2230 0x7fd39c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 >> 172.21.15.82:0/1969675278 conn(0x7fd39c065710 msgr2=0x7fd39c0c4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:54.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 shutdown_connections 2023-07-20T11:24:54.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.527+0000 7fd3a3100640 1 -- 172.21.15.82:0/1969675278 wait complete. 2023-07-20T11:24:54.540 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-20T11:24:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.691+0000 7f8dc6461640 1 Processor -- start 2023-07-20T11:24:54.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.691+0000 7f8dc6461640 1 -- start start 2023-07-20T11:24:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.691+0000 7f8dc6461640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8dc0069750 0x7f8dc006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.691+0000 7f8dc6461640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 0x7f8dc0070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dc6461640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc006e6d0 con 0x7f8dc00cd080 2023-07-20T11:24:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dc6461640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00cd900 con 0x7f8dc0069750 2023-07-20T11:24:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dc6461640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00cd620 con 0x7f8dc015d670 2023-07-20T11:24:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8dc0069750 0x7f8dc006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f8dc0069750 0x7f8dc006eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59422/0 (socket says 172.21.15.82:59422) 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 -- 172.21.15.82:0/912247575 learned_addr learned my addr 172.21.15.82:0/912247575 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbf7fe640 1 --1- 172.21.15.82:0/912247575 >> v1:172.21.15.82:6789/0 conn(0x7f8dc00cd080 0x7f8dc0069b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57726/0 (socket says 172.21.15.82:57726) 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dc49fe640 1 --2- 172.21.15.82:0/912247575 >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 0x7f8dc0070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 -- 172.21.15.82:0/912247575 >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 msgr2=0x7f8dc0070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 --2- 172.21.15.82:0/912247575 >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 0x7f8dc0070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 -- 172.21.15.82:0/912247575 >> v1:172.21.15.82:6789/0 conn(0x7f8dc00cd080 legacy=0x7f8dc0069b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 -- 172.21.15.82:0/912247575 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc006e080 con 0x7f8dc0069750 2023-07-20T11:24:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dc49fe640 1 --2- 172.21.15.82:0/912247575 >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 0x7f8dc0070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbeffd640 1 -- 172.21.15.82:0/912247575 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238494377 0 0) 0x7f8dc006e6d0 con 0x7f8dc00cd080 2023-07-20T11:24:54.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbffff640 1 --2- 172.21.15.82:0/912247575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc0069750 0x7f8dc006eb60 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00664f0 tx=0x7f8db001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b1874af18f464b server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbeffd640 1 -- 172.21.15.82:0/912247575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00ab5f0 con 0x7f8dc0069750 2023-07-20T11:24:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbeffd640 1 -- 172.21.15.82:0/912247575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db00ab750 con 0x7f8dc0069750 2023-07-20T11:24:54.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.695+0000 7f8dbeffd640 1 -- 172.21.15.82:0/912247575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00abae0 con 0x7f8dc0069750 2023-07-20T11:24:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- 172.21.15.82:0/912247575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc0069750 msgr2=0x7f8dc006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- 172.21.15.82:0/912247575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc0069750 0x7f8dc006eb60 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00664f0 tx=0x7f8db001c4d0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- 172.21.15.82:0/912247575 shutdown_connections 2023-07-20T11:24:54.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- 172.21.15.82:0/912247575 >> v2:172.21.15.183:3300/0 conn(0x7f8dc015d670 0x7f8dc0070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- 172.21.15.82:0/912247575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc0069750 0x7f8dc006eb60 unknown :-1 s=CLOSED pgs=2511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- 172.21.15.82:0/912247575 >> 172.21.15.82:0/912247575 conn(0x7f8dc00cbc00 msgr2=0x7f8dc00cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- 172.21.15.82:0/912247575 shutdown_connections 2023-07-20T11:24:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- 172.21.15.82:0/912247575 wait complete. 2023-07-20T11:24:54.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 Processor -- start 2023-07-20T11:24:54.692 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- start start 2023-07-20T11:24:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 0x7f8dc014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc00cd080 0x7f8dc00b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.693 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc014d6e0 con 0x7f8dc015d670 2023-07-20T11:24:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00afbb0 con 0x7f8dc00cd080 2023-07-20T11:24:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc6461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00aefa0 con 0x7f8dc0069750 2023-07-20T11:24:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc49fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc49fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59430/0 (socket says 172.21.15.82:59430) 2023-07-20T11:24:54.694 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.699+0000 7f8dc49fe640 1 -- 172.21.15.82:0/2831032196 learned_addr learned my addr 172.21.15.82:0/2831032196 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:54.695 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbf7fe640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc00cd080 0x7f8dc00b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbffff640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 0x7f8dc014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 -- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 msgr2=0x7f8dc014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 0x7f8dc014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 -- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc00cd080 msgr2=0x7f8dc00b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc00cd080 0x7f8dc00b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.696 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 -- 172.21.15.82:0/2831032196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00094d0 con 0x7f8dc015d670 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbffff640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 0x7f8dc014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc49fe640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f8db800cca0 tx=0x7f8db800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800f680 con 0x7f8dc015d670 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db800f800 con 0x7f8dc015d670 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc00af280 con 0x7f8dc015d670 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800fbb0 con 0x7f8dc015d670 2023-07-20T11:24:54.697 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc00af840 con 0x7f8dc015d670 2023-07-20T11:24:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc00afd60 con 0x7f8dc015d670 2023-07-20T11:24:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8db800b040 con 0x7f8dc015d670 2023-07-20T11:24:54.698 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 0x7f8dac068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:54.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.703+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f8db80849b0 con 0x7f8dc015d670 2023-07-20T11:24:54.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.707+0000 7f8dbffff640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 0x7f8dac068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:54.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.707+0000 7f8dbffff640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 0x7f8dac068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8db00af000 tx=0x7f8db0008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:54.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.707+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8dc00afd60 con 0x7f8dc015d670 2023-07-20T11:24:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.871+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f8dc00afd20 con 0x7f8dc015d670 2023-07-20T11:24:54.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dbcff9640 1 -- 172.21.15.82:0/2831032196 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v73) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8db801d0b0 con 0x7f8dc015d670 2023-07-20T11:24:54.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 msgr2=0x7f8dac068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 0x7f8dac068860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8db00af000 tx=0x7f8db0008040 comp rx=0 tx=0).stop 2023-07-20T11:24:54.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 msgr2=0x7f8dc00b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:54.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f8db800cca0 tx=0x7f8db800a650 comp rx=0 tx=0).stop 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 shutdown_connections 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8dac0663a0 0x7f8dac068860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8dc015d670 0x7f8dc00b0040 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dc00cd080 0x7f8dc00b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 --2- 172.21.15.82:0/2831032196 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8dc0069750 0x7f8dc014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 >> 172.21.15.82:0/2831032196 conn(0x7f8dc00cbc00 msgr2=0x7f8dc0156590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:54.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 shutdown_connections 2023-07-20T11:24:54.874 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:54.879+0000 7f8dc6461640 1 -- 172.21.15.82:0/2831032196 wait complete. 2023-07-20T11:24:54.892 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-20T11:24:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 Processor -- start 2023-07-20T11:24:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 -- start start 2023-07-20T11:24:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb840159450 0x7fb84015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400cc8d0 con 0x7fb840159830 2023-07-20T11:24:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400ccbb0 con 0x7fb8400afd50 2023-07-20T11:24:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb84831e640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400cce90 con 0x7fb840159450 2023-07-20T11:24:55.036 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb840159450 0x7fb84015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb840159450 0x7fb84015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59444/0 (socket says 172.21.15.82:59444) 2023-07-20T11:24:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 -- 172.21.15.82:0/1029005147 learned_addr learned my addr 172.21.15.82:0/1029005147 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 -- 172.21.15.82:0/1029005147 >> v1:172.21.15.183:6789/0 conn(0x7fb8400afd50 legacy=0x7fb8400b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 -- 172.21.15.82:0/1029005147 >> v1:172.21.15.82:6789/0 conn(0x7fb840159830 legacy=0x7fb8400cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8460ba640 1 -- 172.21.15.82:0/1029005147 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840159cc0 con 0x7fb840159450 2023-07-20T11:24:55.038 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.043+0000 7fb8450b8640 1 -- 172.21.15.82:0/1029005147 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332946351 0 0) 0x7fb8400cc8d0 con 0x7fb840159830 2023-07-20T11:24:55.039 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb8460ba640 1 --2- 172.21.15.82:0/1029005147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb840159450 0x7fb84015a4c0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00d150 tx=0x7fb83c01ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a33672320bb0fd server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb8450b8640 1 -- 172.21.15.82:0/1029005147 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00b2d0 con 0x7fb840159450 2023-07-20T11:24:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb8450b8640 1 -- 172.21.15.82:0/1029005147 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b430 con 0x7fb840159450 2023-07-20T11:24:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb8450b8640 1 -- 172.21.15.82:0/1029005147 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0a7cb0 con 0x7fb840159450 2023-07-20T11:24:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 -- 172.21.15.82:0/1029005147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb840159450 msgr2=0x7fb84015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.040 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 --2- 172.21.15.82:0/1029005147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb840159450 0x7fb84015a4c0 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00d150 tx=0x7fb83c01ebe0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 -- 172.21.15.82:0/1029005147 shutdown_connections 2023-07-20T11:24:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 --2- 172.21.15.82:0/1029005147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb840159450 0x7fb84015a4c0 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 -- 172.21.15.82:0/1029005147 >> 172.21.15.82:0/1029005147 conn(0x7fb8400cad50 msgr2=0x7fb8400cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 -- 172.21.15.82:0/1029005147 shutdown_connections 2023-07-20T11:24:55.041 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.047+0000 7fb84831e640 1 -- 172.21.15.82:0/1029005147 wait complete. 2023-07-20T11:24:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 Processor -- start 2023-07-20T11:24:55.042 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- start start 2023-07-20T11:24:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 0x7fb8400c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb840159450 0x7fb8400b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.043 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b29d0 con 0x7fb8400b3330 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb840163330 con 0x7fb8400afd50 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400b2030 con 0x7fb840159450 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8460ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 0x7fb8400c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.044 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59448/0 (socket says 172.21.15.82:59448) 2023-07-20T11:24:55.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8460ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 0x7fb8400c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.82:45760/0 (socket says 172.21.15.82:45760) 2023-07-20T11:24:55.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 -- 172.21.15.82:0/1801383654 learned_addr learned my addr 172.21.15.82:0/1801383654 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:55.045 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8458b9640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb840159450 0x7fb8400b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 -- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb840159450 msgr2=0x7fb8400b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb840159450 0x7fb8400b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 -- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 msgr2=0x7fb8400c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.046 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 0x7fb8400c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 -- 172.21.15.82:0/1801383654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c00bd40 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb8468bb640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c430 tx=0x7fb83800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838005220 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838005380 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400b2310 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838007270 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400c8530 con 0x7fb8400b3330 2023-07-20T11:24:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.051+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400b2b10 con 0x7fb8400b3330 2023-07-20T11:24:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.055+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb8380073d0 con 0x7fb8400b3330 2023-07-20T11:24:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.055+0000 7fb836ffd640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 0x7fb824068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.055+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fb8380833a0 con 0x7fb8400b3330 2023-07-20T11:24:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.055+0000 7fb8460ba640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 0x7fb824068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.055+0000 7fb8460ba640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 0x7fb824068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0b0000 tx=0x7fb83c0a9070 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.051 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.059+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8400b2b10 con 0x7fb8400b3330 2023-07-20T11:24:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.207+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb8400b2b10 con 0x7fb8400b3330 2023-07-20T11:24:55.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.211+0000 7fb836ffd640 1 -- 172.21.15.82:0/1801383654 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v74) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb8400b2b10 con 0x7fb8400b3330 2023-07-20T11:24:55.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 msgr2=0x7fb824068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 0x7fb824068860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0b0000 tx=0x7fb83c0a9070 comp rx=0 tx=0).stop 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 msgr2=0x7fb84006bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c430 tx=0x7fb83800c8f0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 shutdown_connections 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb8240663a0 0x7fb824068860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8400b3330 0x7fb84006bbc0 unknown :-1 s=CLOSED pgs=2515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb840159450 0x7fb8400b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 --2- 172.21.15.82:0/1801383654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8400afd50 0x7fb8400c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 >> 172.21.15.82:0/1801383654 conn(0x7fb8400cad50 msgr2=0x7fb8400c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 shutdown_connections 2023-07-20T11:24:55.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.215+0000 7fb84831e640 1 -- 172.21.15.82:0/1801383654 wait complete. 2023-07-20T11:24:55.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-20T11:24:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 Processor -- start 2023-07-20T11:24:55.367 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 -- start start 2023-07-20T11:24:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 0x7fc1e415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40b06b0 con 0x7fc1e4159830 2023-07-20T11:24:55.368 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40cce90 con 0x7fc1e4159450 2023-07-20T11:24:55.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e9937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40cc8d0 con 0x7fc1e40afd50 2023-07-20T11:24:55.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.369 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:40164/0 (socket says 172.21.15.82:40164) 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 -- 172.21.15.82:0/1652569384 learned_addr learned my addr 172.21.15.82:0/1652569384 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e2ffd640 1 --2- 172.21.15.82:0/1652569384 >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 0x7fc1e415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e1ffb640 1 -- 172.21.15.82:0/1652569384 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044455941 0 0) 0x7fc1e40b06b0 con 0x7fc1e4159830 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 -- 172.21.15.82:0/1652569384 >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 msgr2=0x7fc1e415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 --2- 172.21.15.82:0/1652569384 >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 0x7fc1e415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.375+0000 7fc1e37fe640 1 -- 172.21.15.82:0/1652569384 >> v1:172.21.15.183:6789/0 conn(0x7fc1e4159830 legacy=0x7fc1e40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.370 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e37fe640 1 -- 172.21.15.82:0/1652569384 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40ccbb0 con 0x7fc1e40afd50 2023-07-20T11:24:55.371 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e2ffd640 1 --2- 172.21.15.82:0/1652569384 >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 0x7fc1e415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e37fe640 1 --2- 172.21.15.82:0/1652569384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00bb10 tx=0x7fc1dc01ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42aca878a01fa752 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.372 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e1ffb640 1 -- 172.21.15.82:0/1652569384 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0a7cb0 con 0x7fc1e40afd50 2023-07-20T11:24:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e1ffb640 1 -- 172.21.15.82:0/1652569384 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0a7e10 con 0x7fc1e40afd50 2023-07-20T11:24:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e1ffb640 1 -- 172.21.15.82:0/1652569384 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0af660 con 0x7fc1e40afd50 2023-07-20T11:24:55.373 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 -- 172.21.15.82:0/1652569384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 msgr2=0x7fc1e40b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 --2- 172.21.15.82:0/1652569384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00bb10 tx=0x7fc1dc01ebe0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 -- 172.21.15.82:0/1652569384 shutdown_connections 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 --2- 172.21.15.82:0/1652569384 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40b0170 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 --2- 172.21.15.82:0/1652569384 >> v2:172.21.15.183:3300/0 conn(0x7fc1e4159450 0x7fc1e415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.379+0000 7fc1e9937640 1 -- 172.21.15.82:0/1652569384 >> 172.21.15.82:0/1652569384 conn(0x7fc1e40cad50 msgr2=0x7fc1e40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- 172.21.15.82:0/1652569384 shutdown_connections 2023-07-20T11:24:55.374 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- 172.21.15.82:0/1652569384 wait complete. 2023-07-20T11:24:55.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 Processor -- start 2023-07-20T11:24:55.375 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- start start 2023-07-20T11:24:55.376 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e40b0130 0x7fc1e40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40b0b20 con 0x7fc1e4159450 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40c39e0 con 0x7fc1e40b0130 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e9937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e414d790 con 0x7fc1e40afd50 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.377 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59452/0 (socket says 172.21.15.82:59452) 2023-07-20T11:24:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 -- 172.21.15.82:0/2820366853 learned_addr learned my addr 172.21.15.82:0/2820366853 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:55.378 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e37fe640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e40b0130 0x7fc1e40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e2ffd640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 -- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 msgr2=0x7fc1e40c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 -- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e40b0130 msgr2=0x7fc1e40b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e40b0130 0x7fc1e40b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.383+0000 7fc1e27fc640 1 -- 172.21.15.82:0/2820366853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d4009420 con 0x7fc1e4159450 2023-07-20T11:24:55.379 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1e27fc640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c7a0 tx=0x7fc1d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8003db0 con 0x7fc1e4159450 2023-07-20T11:24:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8005070 con 0x7fc1e4159450 2023-07-20T11:24:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8005420 con 0x7fc1e4159450 2023-07-20T11:24:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc00b770 con 0x7fc1e4159450 2023-07-20T11:24:55.380 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40c3390 con 0x7fc1e4159450 2023-07-20T11:24:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e40c3b50 con 0x7fc1e4159450 2023-07-20T11:24:55.381 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc1d8005580 con 0x7fc1e4159450 2023-07-20T11:24:55.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 0x7fc1d0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fc1d8083730 con 0x7fc1e4159450 2023-07-20T11:24:55.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.387+0000 7fc1e2ffd640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 0x7fc1d0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.382 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.391+0000 7fc1e2ffd640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 0x7fc1d0068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009c80 tx=0x7fc1d4008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.391+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1d8050ab0 con 0x7fc1e4159450 2023-07-20T11:24:55.534 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.543+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1e404da30 con 0x7fc1e4159450 2023-07-20T11:24:55.538 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1cbfff640 1 -- 172.21.15.82:0/2820366853 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1d80540d0 con 0x7fc1e4159450 2023-07-20T11:24:55.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 msgr2=0x7fc1d0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 0x7fc1d0068860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009c80 tx=0x7fc1d4008040 comp rx=0 tx=0).stop 2023-07-20T11:24:55.541 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 msgr2=0x7fc1e414d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c7a0 tx=0x7fc1d800cc60 comp rx=0 tx=0).stop 2023-07-20T11:24:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 shutdown_connections 2023-07-20T11:24:55.542 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fc1d00663a0 0x7fc1d0068860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc1e40b0130 0x7fc1e40b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1e4159450 0x7fc1e414d250 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 --2- 172.21.15.82:0/2820366853 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fc1e40afd50 0x7fc1e40c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.543 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 >> 172.21.15.82:0/2820366853 conn(0x7fc1e40cad50 msgr2=0x7fc1e40c13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 shutdown_connections 2023-07-20T11:24:55.544 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.547+0000 7fc1e9937640 1 -- 172.21.15.82:0/2820366853 wait complete. 2023-07-20T11:24:55.560 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-20T11:24:55.699 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 Processor -- start 2023-07-20T11:24:55.700 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 -- start start 2023-07-20T11:24:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f8f3c15d4a0 0x7f8f3c0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3c0cde70 con 0x7f8f3c15c910 2023-07-20T11:24:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3c0cbef0 con 0x7f8f3c15d4a0 2023-07-20T11:24:55.701 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f40c61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c0ca420 con 0x7f8f3c0ca040 2023-07-20T11:24:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f31d9b640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f8f3c15c910 0x7f8f3c15cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57746/0 (socket says 172.21.15.82:57746) 2023-07-20T11:24:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.707+0000 7f8f31d9b640 1 -- 172.21.15.82:0/818303664 learned_addr learned my addr 172.21.15.82:0/818303664 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3ad9d640 1 --2- 172.21.15.82:0/818303664 >> v2:172.21.15.183:3300/0 conn(0x7f8f3c15d4a0 0x7f8f3c0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.702 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/818303664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f39d9b640 1 -- 172.21.15.82:0/818303664 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187115507 0 0) 0x7f8f3c0cde70 con 0x7f8f3c15c910 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f39d9b640 1 -- 172.21.15.82:0/818303664 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f28003530 con 0x7f8f3c15c910 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 -- 172.21.15.82:0/818303664 >> v2:172.21.15.183:3300/0 conn(0x7f8f3c15d4a0 msgr2=0x7f8f3c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/818303664 >> v2:172.21.15.183:3300/0 conn(0x7f8f3c15d4a0 0x7f8f3c0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 -- 172.21.15.82:0/818303664 >> v1:172.21.15.82:6789/0 conn(0x7f8f3c15c910 legacy=0x7f8f3c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 -- 172.21.15.82:0/818303664 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c0cdb40 con 0x7f8f3c0ca040 2023-07-20T11:24:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.711+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/818303664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0ad060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0097c0 tx=0x7f8f2c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d35792aaeab2a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f39d9b640 1 -- 172.21.15.82:0/818303664 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0ab5f0 con 0x7f8f3c0ca040 2023-07-20T11:24:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f39d9b640 1 -- 172.21.15.82:0/818303664 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c0ab750 con 0x7f8f3c0ca040 2023-07-20T11:24:55.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f39d9b640 1 -- 172.21.15.82:0/818303664 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c0abae0 con 0x7f8f3c0ca040 2023-07-20T11:24:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- 172.21.15.82:0/818303664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 msgr2=0x7f8f3c0ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- 172.21.15.82:0/818303664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0ad060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0097c0 tx=0x7f8f2c01c450 comp rx=0 tx=0).stop 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- 172.21.15.82:0/818303664 shutdown_connections 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- 172.21.15.82:0/818303664 >> v2:172.21.15.183:3300/0 conn(0x7f8f3c15d4a0 0x7f8f3c0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- 172.21.15.82:0/818303664 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0ad060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- 172.21.15.82:0/818303664 >> 172.21.15.82:0/818303664 conn(0x7f8f3c0cada0 msgr2=0x7f8f3c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- 172.21.15.82:0/818303664 shutdown_connections 2023-07-20T11:24:55.707 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- 172.21.15.82:0/818303664 wait complete. 2023-07-20T11:24:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 Processor -- start 2023-07-20T11:24:55.708 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 -- start start 2023-07-20T11:24:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.709 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.715+0000 7f8f40c61640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f3c15d4a0 0x7f8f3c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1593c0 con 0x7f8f3c15c910 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c1596a0 con 0x7f8f3c15d4a0 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3c159980 con 0x7f8f3c0ca040 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59464/0 (socket says 172.21.15.82:59464) 2023-07-20T11:24:55.710 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 -- 172.21.15.82:0/2531637482 learned_addr learned my addr 172.21.15.82:0/2531637482 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.711 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f3ad9d640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f3c15d4a0 0x7f8f3c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 -- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 msgr2=0x7f8f3c0c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 -- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f3c15d4a0 msgr2=0x7f8f3c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f3c15d4a0 0x7f8f3c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 -- 172.21.15.82:0/2531637482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009420 con 0x7f8f3c15c910 2023-07-20T11:24:55.712 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f31d9b640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cbc0 tx=0x7f8f2400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400ad40 con 0x7f8f3c15c910 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24012400 con 0x7f8f3c15c910 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400aea0 con 0x7f8f3c15c910 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3c159c60 con 0x7f8f3c15c910 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3c15b8a0 con 0x7f8f3c15c910 2023-07-20T11:24:55.713 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3c159e80 con 0x7f8f3c15c910 2023-07-20T11:24:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.719+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8f24007070 con 0x7f8f3c15c910 2023-07-20T11:24:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.723+0000 7f8f337fe640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 0x7f8f1c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.723+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f8f24083ee0 con 0x7f8f3c15c910 2023-07-20T11:24:55.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.723+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 0x7f8f1c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:55.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.723+0000 7f8f3a59c640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 0x7f8f1c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0af000 tx=0x7f8f2c0a7000 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:55.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.727+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f24051260 con 0x7f8f3c15c910 2023-07-20T11:24:55.916 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:55.923+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f8f3c159500 con 0x7f8f3c15c910 2023-07-20T11:24:56.517 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.523+0000 7f8f337fe640 1 -- 172.21.15.82:0/2531637482 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3084) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8f3c159500 con 0x7f8f3c15c910 2023-07-20T11:24:56.519 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 msgr2=0x7f8f1c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 0x7f8f1c068860 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0af000 tx=0x7f8f2c0a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 msgr2=0x7f8f3c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 secure :-1 s=READY pgs=2518 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400cbc0 tx=0x7f8f2400a430 comp rx=0 tx=0).stop 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 shutdown_connections 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f8f1c0663a0 0x7f8f1c068860 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f3c15d4a0 0x7f8f3c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:56.520 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f3c15c910 0x7f8f3c157fd0 unknown :-1 s=CLOSED pgs=2518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:56.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 --2- 172.21.15.82:0/2531637482 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f8f3c0ca040 0x7f8f3c0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:56.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 >> 172.21.15.82:0/2531637482 conn(0x7f8f3c0cada0 msgr2=0x7f8f3c0b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:56.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 shutdown_connections 2023-07-20T11:24:56.521 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:56.527+0000 7f8f40c61640 1 -- 172.21.15.82:0/2531637482 wait complete. 2023-07-20T11:24:56.541 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-07-20T11:24:56.542 INFO:tasks.cephfs_test_runner: 2023-07-20T11:24:56.542 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-20T11:24:56.543 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5640.317s 2023-07-20T11:24:56.544 INFO:tasks.cephfs_test_runner: 2023-07-20T11:24:56.544 INFO:tasks.cephfs_test_runner:OK 2023-07-20T11:24:56.544 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-20T11:24:56.561 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-20T11:24:56.689 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-20T11:24:56.690 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:56.690 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:56.699 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:56.700 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2023-07-20T11:24:56.700 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:56.755 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15437 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275376k,nr_inodes=818844,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-20T11:24:56.755 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:56.755 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:56.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:56.766 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-07-20T11:24:56.766 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-20T11:24:56.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354640k,nr_inodes=4088660,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15911 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275380k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-20T11:24:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:56.815 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:24:56.824 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-20T11:24:56.825 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-20T11:24:56.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:56.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-20T11:24:56.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:56.893 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-20T11:24:56.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:56.999 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-07-20T11:24:57.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.156 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2023-07-20T11:24:57.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.166 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2023-07-20T11:24:57.236 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2023-07-20T11:24:57.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T11:24:57.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.239 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T11:24:57.249 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-20T11:24:57.250 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-20T11:24:57.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.251 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-20T11:24:57.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-20T11:24:57.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.412 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-07-20T11:24:57.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.582 DEBUG:teuthology.orchestra.run.smithi183:> ip netns list 2023-07-20T11:24:57.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-20T11:24:57.593 DEBUG:teuthology.orchestra.run.smithi183:> sudo ip link delete ceph-brx 2023-07-20T11:24:57.664 INFO:teuthology.orchestra.run.smithi183.stderr:Cannot find device "ceph-brx" 2023-07-20T11:24:57.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T11:24:57.667 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-20T11:24:57.677 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-20T11:24:57.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 Processor -- start 2023-07-20T11:24:57.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 -- start start 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1180b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180b7c20 con 0x7ff11815c5f0 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11815c9d0 con 0x7ff1180ccfb0 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11d4d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b4980 con 0x7ff1180ceb70 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff11815c5f0 0x7ff1180b4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57760/0 (socket says 172.21.15.82:57760) 2023-07-20T11:24:57.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 -- 172.21.15.82:0/2476277723 learned_addr learned my addr 172.21.15.82:0/2476277723 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1180b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972170115 0 0) 0x7ff1180b7c20 con 0x7ff11815c5f0 2023-07-20T11:24:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff100003530 con 0x7ff11815c5f0 2023-07-20T11:24:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611179426 0 0) 0x7ff10c001120 con 0x7ff1180ccfb0 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> v1:172.21.15.183:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1180b7c20 con 0x7ff1180ccfb0 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 113205168 0 0) 0x7ff100003530 con 0x7ff11815c5f0 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 msgr2=0x7ff1180b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1180b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 >> v1:172.21.15.183:6789/0 conn(0x7ff1180ccfb0 legacy=0x7ff1180ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1180ce030 con 0x7ff11815c5f0 2023-07-20T11:24:57.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7ff108001680 con 0x7ff11815c5f0 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 >> v1:172.21.15.82:6789/0 conn(0x7ff11815c5f0 legacy=0x7ff1180b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff100003b40 0x7ff100003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100004d10 0x7ff100005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180b4980 con 0x7ff100003b40 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10000ba70 con 0x7ff100004d10 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10000bc30 con 0x7ff1180ceb70 2023-07-20T11:24:57.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff100003b40 0x7ff100003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff1177fe640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100004d10 0x7ff100005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 -- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 msgr2=0x7ff1000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff1180ceb70 0x7ff1000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 -- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100004d10 msgr2=0x7ff100005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100004d10 0x7ff100005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff117fff640 1 -- 172.21.15.82:0/2476277723 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff100003530 con 0x7ff100003b40 2023-07-20T11:24:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.827+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100004d10 0x7ff100005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:57.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff117fff640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff100003b40 0x7ff100003f40 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7ff108007fb0 tx=0x7ff10801caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc4d35a130f3782 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108005ae0 con 0x7ff100003b40 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff108005c40 con 0x7ff100003b40 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff116ffd640 1 -- 172.21.15.82:0/2476277723 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1080a57f0 con 0x7ff100003b40 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 -- 172.21.15.82:0/2476277723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff100003b40 msgr2=0x7ff100003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/2476277723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff100003b40 0x7ff100003f40 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7ff108007fb0 tx=0x7ff10801caf0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11ccd4640 1 -- 172.21.15.82:0/2476277723 reap_dead start 2023-07-20T11:24:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 -- 172.21.15.82:0/2476277723 shutdown_connections 2023-07-20T11:24:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 -- 172.21.15.82:0/2476277723 >> 172.21.15.82:0/2476277723 conn(0x7ff118065710 msgr2=0x7ff118065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 -- 172.21.15.82:0/2476277723 shutdown_connections 2023-07-20T11:24:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.831+0000 7ff11d4d5640 1 -- 172.21.15.82:0/2476277723 wait complete. 2023-07-20T11:24:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 Processor -- start 2023-07-20T11:24:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- start start 2023-07-20T11:24:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100003b40 0x7ff1181f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff11815d4f0 0x7ff11815d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1181f4e20 con 0x7ff118145690 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11815deb0 con 0x7ff100003b40 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff118147480 con 0x7ff11815d4f0 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59480/0 (socket says 172.21.15.82:59480) 2023-07-20T11:24:57.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 -- 172.21.15.82:0/3049726787 learned_addr learned my addr 172.21.15.82:0/3049726787 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff117fff640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100003b40 0x7ff1181f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff1177fe640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff11815d4f0 0x7ff11815d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 -- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff11815d4f0 msgr2=0x7ff11815d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff11815d4f0 0x7ff11815d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 -- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100003b40 msgr2=0x7ff1181f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100003b40 0x7ff1181f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.830 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 -- 172.21.15.82:0/3049726787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1181463e0 con 0x7ff118145690 2023-07-20T11:24:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11ccd4640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7ff1180c9570 tx=0x7ff110010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000e050 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11000f040 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1181466c0 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1100039a0 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.835+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff118146c80 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11804da30 con 0x7ff118145690 2023-07-20T11:24:57.832 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff110015440 con 0x7ff118145690 2023-07-20T11:24:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff114ff9640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 0x7ff104068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7ff110084440 con 0x7ff118145690 2023-07-20T11:24:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff117fff640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 0x7ff104068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:57.833 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.839+0000 7ff117fff640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 0x7ff104068890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff108007f80 tx=0x7ff1080a7070 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:57.835 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.843+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff110051740 con 0x7ff118145690 2023-07-20T11:24:57.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.991+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1180cd790 con 0x7ff1040663d0 2023-07-20T11:24:57.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.991+0000 7ff114ff9640 1 -- 172.21.15.82:0/3049726787 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72816 (secure 0 0 0) 0x7ff1080b5040 con 0x7ff1040663d0 2023-07-20T11:24:57.986 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:57.987 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:57.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 msgr2=0x7ff104068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 0x7ff104068890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff108007f80 tx=0x7ff1080a7070 comp rx=0 tx=0).stop 2023-07-20T11:24:57.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 msgr2=0x7ff118145b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:57.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 secure :-1 s=READY pgs=2521 cs=0 l=1 rev1=1 crypto rx=0x7ff1180c9570 tx=0x7ff110010590 comp rx=0 tx=0).stop 2023-07-20T11:24:57.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 shutdown_connections 2023-07-20T11:24:57.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff1040663d0 0x7ff104068890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff118145690 0x7ff118145b10 unknown :-1 s=CLOSED pgs=2521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff11815d4f0 0x7ff11815d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 --2- 172.21.15.82:0/3049726787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff100003b40 0x7ff1181f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:57.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 >> 172.21.15.82:0/3049726787 conn(0x7ff118065710 msgr2=0x7ff118065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:57.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 shutdown_connections 2023-07-20T11:24:57.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:57.995+0000 7ff11d4d5640 1 -- 172.21.15.82:0/3049726787 wait complete. 2023-07-20T11:24:58.006 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-20T11:24:56.365302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438172,"kb_used_data":21936,"kb_used_omap":13,"kb_used_meta":416114,"kb_avail":754536548,"statfs":{"total":773094113280,"available":772645425152,"internally_reserved":0,"allocated":22462464,"data_stored":12279531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":426100824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001538"},"pg_stats":[{"pgid":"1.0","version":"207'348","reported_seq":1359,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748843+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:53.748843+0000","last_peered":"2023-07-20T11:24:53.748843+0000","last_clean":"2023-07-20T11:24:53.748843+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:53.748843+0000","last_undegraded":"2023-07-20T11:24:53.748843+0000","last_fullsized":"2023-07-20T11:24:53.748843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:02.773578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.520171+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:53.520171+0000","last_peered":"2023-07-20T11:24:53.520171+0000","last_clean":"2023-07-20T11:24:53.520171+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:53.520171+0000","last_undegraded":"2023-07-20T11:24:53.520171+0000","last_fullsized":"2023-07-20T11:24:53.520171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:50.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":383,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.747837+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:53.747837+0000","last_peered":"2023-07-20T11:24:53.747837+0000","last_clean":"2023-07-20T11:24:53.747837+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:53.747837+0000","last_undegraded":"2023-07-20T11:24:53.747837+0000","last_fullsized":"2023-07-20T11:24:53.747837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:45.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":416,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.581063+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:53.581063+0000","last_peered":"2023-07-20T11:24:53.581063+0000","last_clean":"2023-07-20T11:24:53.581063+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:53.581063+0000","last_undegraded":"2023-07-20T11:24:53.581063+0000","last_fullsized":"2023-07-20T11:24:53.581063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:55.693316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.519535+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:53.519535+0000","last_peered":"2023-07-20T11:24:53.519535+0000","last_clean":"2023-07-20T11:24:53.519535+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:53.519535+0000","last_undegraded":"2023-07-20T11:24:53.519535+0000","last_fullsized":"2023-07-20T11:24:53.519535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523016+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:53.523016+0000","last_peered":"2023-07-20T11:24:53.523016+0000","last_clean":"2023-07-20T11:24:53.523016+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:53.523016+0000","last_undegraded":"2023-07-20T11:24:53.523016+0000","last_fullsized":"2023-07-20T11:24:53.523016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:11.787419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748121+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:53.748121+0000","last_peered":"2023-07-20T11:24:53.748121+0000","last_clean":"2023-07-20T11:24:53.748121+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:53.748121+0000","last_undegraded":"2023-07-20T11:24:53.748121+0000","last_fullsized":"2023-07-20T11:24:53.748121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:17:12.813300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":380,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523964+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:53.523964+0000","last_peered":"2023-07-20T11:24:53.523964+0000","last_clean":"2023-07-20T11:24:53.523964+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:53.523964+0000","last_undegraded":"2023-07-20T11:24:53.523964+0000","last_fullsized":"2023-07-20T11:24:53.523964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:51.790971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":374,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.746379+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:53.746379+0000","last_peered":"2023-07-20T11:24:53.746379+0000","last_clean":"2023-07-20T11:24:53.746379+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:53.746379+0000","last_undegraded":"2023-07-20T11:24:53.746379+0000","last_fullsized":"2023-07-20T11:24:53.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.808158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":3124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":3198976,"data_stored":1931335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.96699999999999997,"15min":1.0409999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":1.01,"15min":1.081},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.97499999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93999999999999995,"5min":1.012,"15min":1.0900000000000001},"last":0.629}]},{"osd":3,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.94899999999999995,"5min":0.997,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.80900000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.28299999999999997},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.03},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.505}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.873},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.748}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.504},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2940928,"data_stored":1669330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.876},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.998}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48212,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323628,"statfs":{"total":96636764160,"available":96587395072,"internally_reserved":0,"allocated":3215360,"data_stored":1938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.309},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.497}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.752}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:58.008 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:58.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 Processor -- start 2023-07-20T11:24:58.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 -- start start 2023-07-20T11:24:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f226c15cab0 0x7f226c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0cf110 0x7f226c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0d31c0 con 0x7f226c0d0d10 2023-07-20T11:24:58.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0d16b0 con 0x7f226c15cab0 2023-07-20T11:24:58.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2273a07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b3520 con 0x7f226c0cf110 2023-07-20T11:24:58.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2270fa2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f226c15cab0 0x7f226c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2270fa2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59488/0 (socket says 172.21.15.82:59488) 2023-07-20T11:24:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2270fa2640 1 -- 172.21.15.82:0/4228465132 learned_addr learned my addr 172.21.15.82:0/4228465132 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2271fa4640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0cf110 0x7f226c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 -- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0cf110 msgr2=0x7f226c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0cf110 0x7f226c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 -- 172.21.15.82:0/4228465132 >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 msgr2=0x7f226c0d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:58.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 --2- 172.21.15.82:0/4228465132 >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f22717a3640 1 -- 172.21.15.82:0/4228465132 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0b2910 con 0x7f226c15cab0 2023-07-20T11:24:58.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.155+0000 7f2270fa2640 1 --2- 172.21.15.82:0/4228465132 >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-20T11:24:58.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f22717a3640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c15cab0 0x7f226c0d0300 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f226c06a660 tx=0x7f226801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3e6a982896d8cf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2263fff640 1 -- 172.21.15.82:0/4228465132 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680ab5f0 con 0x7f226c15cab0 2023-07-20T11:24:58.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2263fff640 1 -- 172.21.15.82:0/4228465132 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22680ab750 con 0x7f226c15cab0 2023-07-20T11:24:58.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2263fff640 1 -- 172.21.15.82:0/4228465132 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680abae0 con 0x7f226c15cab0 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 -- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c15cab0 msgr2=0x7f226c0d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c15cab0 0x7f226c0d0300 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f226c06a660 tx=0x7f226801c430 comp rx=0 tx=0).stop 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 -- 172.21.15.82:0/4228465132 shutdown_connections 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0cf110 0x7f226c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 --2- 172.21.15.82:0/4228465132 >> v2:172.21.15.82:3300/0 conn(0x7f226c0d0d10 0x7f226c0d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 --2- 172.21.15.82:0/4228465132 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c15cab0 0x7f226c0d0300 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 -- 172.21.15.82:0/4228465132 >> 172.21.15.82:0/4228465132 conn(0x7f226c08c120 msgr2=0x7f226c09ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 -- 172.21.15.82:0/4228465132 shutdown_connections 2023-07-20T11:24:58.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.159+0000 7f2273a07640 1 -- 172.21.15.82:0/4228465132 wait complete. 2023-07-20T11:24:58.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 Processor -- start 2023-07-20T11:24:58.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 -- start start 2023-07-20T11:24:58.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 0x7f226c1f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0d0d10 0x7f226c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c6e10 con 0x7f226c15cab0 2023-07-20T11:24:58.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c6260 con 0x7f226c0cf110 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c6470 con 0x7f226c0d0d10 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59494/0 (socket says 172.21.15.82:59494) 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 -- 172.21.15.82:0/2448029999 learned_addr learned my addr 172.21.15.82:0/2448029999 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2270fa2640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0d0d10 0x7f226c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f22717a3640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 0x7f226c1f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 -- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0d0d10 msgr2=0x7f226c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0d0d10 0x7f226c0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 -- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 msgr2=0x7f226c1f95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 0x7f226c1f95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 -- 172.21.15.82:0/2448029999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0094d0 con 0x7f226c15cab0 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f22717a3640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 0x7f226c1f95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2271fa4640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f226400eed0 tx=0x7f226400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264010040 con 0x7f226c15cab0 2023-07-20T11:24:58.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226400bd20 con 0x7f226c15cab0 2023-07-20T11:24:58.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2268009420 con 0x7f226c15cab0 2023-07-20T11:24:58.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.163+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264014640 con 0x7f226c15cab0 2023-07-20T11:24:58.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0c6a30 con 0x7f226c15cab0 2023-07-20T11:24:58.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c0c6f50 con 0x7f226c15cab0 2023-07-20T11:24:58.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22640147a0 con 0x7f226c15cab0 2023-07-20T11:24:58.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f2261ffb640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 0x7f2250068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f22640846f0 con 0x7f226c15cab0 2023-07-20T11:24:58.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f22717a3640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 0x7f2250068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.167+0000 7f22717a3640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 0x7f2250068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f22680af000 tx=0x7f22680a7000 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.164 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.171+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f226c0c6f50 con 0x7f226c15cab0 2023-07-20T11:24:58.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.315+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f226c0b31b0 con 0x7f22500663a0 2023-07-20T11:24:58.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.319+0000 7f2261ffb640 1 -- 172.21.15.82:0/2448029999 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72816 (secure 0 0 0) 0x7f22680ab5b0 con 0x7f22500663a0 2023-07-20T11:24:58.312 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:58.312 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:58.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.319+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 msgr2=0x7f2250068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.319+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 0x7f2250068860 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f22680af000 tx=0x7f22680a7000 comp rx=0 tx=0).stop 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.319+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 msgr2=0x7f226c14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.319+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f226400eed0 tx=0x7f226400b480 comp rx=0 tx=0).stop 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 shutdown_connections 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f22500663a0 0x7f2250068860 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f226c15cab0 0x7f226c14a470 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.314 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f226c0d0d10 0x7f226c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 --2- 172.21.15.82:0/2448029999 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f226c0cf110 0x7f226c1f95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 >> 172.21.15.82:0/2448029999 conn(0x7f226c08c120 msgr2=0x7f226c0d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 shutdown_connections 2023-07-20T11:24:58.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.323+0000 7f2273a07640 1 -- 172.21.15.82:0/2448029999 wait complete. 2023-07-20T11:24:58.332 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-20T11:24:56.365302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438172,"kb_used_data":21936,"kb_used_omap":13,"kb_used_meta":416114,"kb_avail":754536548,"statfs":{"total":773094113280,"available":772645425152,"internally_reserved":0,"allocated":22462464,"data_stored":12279531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":426100824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001538"},"pg_stats":[{"pgid":"1.0","version":"207'348","reported_seq":1359,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748843+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:53.748843+0000","last_peered":"2023-07-20T11:24:53.748843+0000","last_clean":"2023-07-20T11:24:53.748843+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:53.748843+0000","last_undegraded":"2023-07-20T11:24:53.748843+0000","last_fullsized":"2023-07-20T11:24:53.748843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:02.773578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.520171+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:53.520171+0000","last_peered":"2023-07-20T11:24:53.520171+0000","last_clean":"2023-07-20T11:24:53.520171+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:53.520171+0000","last_undegraded":"2023-07-20T11:24:53.520171+0000","last_fullsized":"2023-07-20T11:24:53.520171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:50.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":383,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.747837+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:53.747837+0000","last_peered":"2023-07-20T11:24:53.747837+0000","last_clean":"2023-07-20T11:24:53.747837+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:53.747837+0000","last_undegraded":"2023-07-20T11:24:53.747837+0000","last_fullsized":"2023-07-20T11:24:53.747837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:45.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":416,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.581063+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:53.581063+0000","last_peered":"2023-07-20T11:24:53.581063+0000","last_clean":"2023-07-20T11:24:53.581063+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:53.581063+0000","last_undegraded":"2023-07-20T11:24:53.581063+0000","last_fullsized":"2023-07-20T11:24:53.581063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:55.693316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.519535+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:53.519535+0000","last_peered":"2023-07-20T11:24:53.519535+0000","last_clean":"2023-07-20T11:24:53.519535+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:53.519535+0000","last_undegraded":"2023-07-20T11:24:53.519535+0000","last_fullsized":"2023-07-20T11:24:53.519535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523016+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:53.523016+0000","last_peered":"2023-07-20T11:24:53.523016+0000","last_clean":"2023-07-20T11:24:53.523016+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:53.523016+0000","last_undegraded":"2023-07-20T11:24:53.523016+0000","last_fullsized":"2023-07-20T11:24:53.523016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:11.787419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748121+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:53.748121+0000","last_peered":"2023-07-20T11:24:53.748121+0000","last_clean":"2023-07-20T11:24:53.748121+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:53.748121+0000","last_undegraded":"2023-07-20T11:24:53.748121+0000","last_fullsized":"2023-07-20T11:24:53.748121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:17:12.813300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":380,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523964+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:53.523964+0000","last_peered":"2023-07-20T11:24:53.523964+0000","last_clean":"2023-07-20T11:24:53.523964+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:53.523964+0000","last_undegraded":"2023-07-20T11:24:53.523964+0000","last_fullsized":"2023-07-20T11:24:53.523964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:51.790971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":374,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.746379+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:53.746379+0000","last_peered":"2023-07-20T11:24:53.746379+0000","last_clean":"2023-07-20T11:24:53.746379+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:53.746379+0000","last_undegraded":"2023-07-20T11:24:53.746379+0000","last_fullsized":"2023-07-20T11:24:53.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.808158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":3124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":3198976,"data_stored":1931335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.96699999999999997,"15min":1.0409999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":1.01,"15min":1.081},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.97499999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93999999999999995,"5min":1.012,"15min":1.0900000000000001},"last":0.629}]},{"osd":3,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.94899999999999995,"5min":0.997,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.80900000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.28299999999999997},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.03},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.505}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.873},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.748}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.504},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2940928,"data_stored":1669330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.876},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.998}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48212,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323628,"statfs":{"total":96636764160,"available":96587395072,"internally_reserved":0,"allocated":3215360,"data_stored":1938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.309},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.497}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.752}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:58.334 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-20T11:24:58.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:24:58.474 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 Processor -- start 2023-07-20T11:24:58.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 -- start start 2023-07-20T11:24:58.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfbc0afda0 0x7fdfbc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.476 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 0x7fdfbc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfbc0b2ee0 con 0x7fdfbc0b2060 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b3160 con 0x7fdfbc0afda0 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc30e5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfbc0b12a0 con 0x7fdfbc15a8e0 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc0e81640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fdfbc0afda0 0x7fdfbc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc1682640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fdfbc0b2060 0x7fdfbc0b0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57766/0 (socket says 172.21.15.82:57766) 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc1682640 1 -- 172.21.15.82:0/4196015127 learned_addr learned my addr 172.21.15.82:0/4196015127 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:58.477 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/4196015127 >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 0x7fdfbc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc0e81640 1 -- 172.21.15.82:0/4196015127 >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 msgr2=0x7fdfbc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc0e81640 1 --2- 172.21.15.82:0/4196015127 >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 0x7fdfbc0b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc0e81640 1 -- 172.21.15.82:0/4196015127 >> v1:172.21.15.82:6789/0 conn(0x7fdfbc0b2060 legacy=0x7fdfbc0b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfb37fe640 1 -- 172.21.15.82:0/4196015127 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499366843 0 0) 0x7fdfbc0b2ee0 con 0x7fdfbc0b2060 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfc0e81640 1 -- 172.21.15.82:0/4196015127 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc0b1580 con 0x7fdfbc0afda0 2023-07-20T11:24:58.478 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.483+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/4196015127 >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 0x7fdfbc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:58.479 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc0e81640 1 --2- 172.21.15.82:0/4196015127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc0ca6b0 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b0f10 tx=0x7fdfb801c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db7cd7305459927 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfb37fe640 1 -- 172.21.15.82:0/4196015127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80a5880 con 0x7fdfbc0afda0 2023-07-20T11:24:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfb37fe640 1 -- 172.21.15.82:0/4196015127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80a59e0 con 0x7fdfbc0afda0 2023-07-20T11:24:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfb37fe640 1 -- 172.21.15.82:0/4196015127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80a5d70 con 0x7fdfbc0afda0 2023-07-20T11:24:58.480 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 -- 172.21.15.82:0/4196015127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 msgr2=0x7fdfbc0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/4196015127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc0ca6b0 secure :-1 s=READY pgs=2524 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0b0f10 tx=0x7fdfb801c7c0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 -- 172.21.15.82:0/4196015127 shutdown_connections 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/4196015127 >> v2:172.21.15.183:3300/0 conn(0x7fdfbc15a8e0 0x7fdfbc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/4196015127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc0ca6b0 unknown :-1 s=CLOSED pgs=2524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 -- 172.21.15.82:0/4196015127 >> 172.21.15.82:0/4196015127 conn(0x7fdfbc0cada0 msgr2=0x7fdfbc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 -- 172.21.15.82:0/4196015127 shutdown_connections 2023-07-20T11:24:58.481 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.487+0000 7fdfc30e5640 1 -- 172.21.15.82:0/4196015127 wait complete. 2023-07-20T11:24:58.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 Processor -- start 2023-07-20T11:24:58.482 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- start start 2023-07-20T11:24:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 0x7fdfbc0c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfbc15a8e0 0x7fdfbc0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.483 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0c7510 con 0x7fdfbc0afda0 2023-07-20T11:24:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc0c79a0 con 0x7fdfbc0b2060 2023-07-20T11:24:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc1592c0 con 0x7fdfbc15a8e0 2023-07-20T11:24:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59510/0 (socket says 172.21.15.82:59510) 2023-07-20T11:24:58.484 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 -- 172.21.15.82:0/3662001437 learned_addr learned my addr 172.21.15.82:0/3662001437 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:58.485 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 -- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfbc15a8e0 msgr2=0x7fdfbc0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfbc15a8e0 0x7fdfbc0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 -- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 msgr2=0x7fdfbc0c1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 0x7fdfbc0c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 0x7fdfbc0c1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 -- 172.21.15.82:0/3662001437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb8009a70 con 0x7fdfbc0afda0 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 0x7fdfbc0c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:58.486 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc0e81640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80b0040 tx=0x7fdfb8019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80ad8d0 con 0x7fdfbc0afda0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb80ada50 con 0x7fdfbc0afda0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80ade00 con 0x7fdfbc0afda0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfbc0c6900 con 0x7fdfbc0afda0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfbc0c6ec0 con 0x7fdfbc0afda0 2023-07-20T11:24:58.487 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.491+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc073c70 con 0x7fdfbc0afda0 2023-07-20T11:24:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.495+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfb80b4050 con 0x7fdfbc0afda0 2023-07-20T11:24:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.495+0000 7fdfb17fa640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 0x7fdfa8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.488 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.495+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fdfb811f240 con 0x7fdfbc0afda0 2023-07-20T11:24:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.495+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 0x7fdfa8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.489 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.495+0000 7fdfb3fff640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 0x7fdfa8068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc15d850 tx=0x7fdfac008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.491 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.499+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfb80ec6f0 con 0x7fdfbc0afda0 2023-07-20T11:24:58.637 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.643+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfbc0b24b0 con 0x7fdfa80663a0 2023-07-20T11:24:58.640 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.647+0000 7fdfb17fa640 1 -- 172.21.15.82:0/3662001437 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72816 (secure 0 0 0) 0x7fdfac00c040 con 0x7fdfa80663a0 2023-07-20T11:24:58.641 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:58.642 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:24:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 msgr2=0x7fdfa8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 0x7fdfa8068860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc15d850 tx=0x7fdfac008040 comp rx=0 tx=0).stop 2023-07-20T11:24:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 msgr2=0x7fdfbc158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80b0040 tx=0x7fdfb8019560 comp rx=0 tx=0).stop 2023-07-20T11:24:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 shutdown_connections 2023-07-20T11:24:58.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fdfa80663a0 0x7fdfa8068860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fdfbc15a8e0 0x7fdfbc0c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdfbc0b2060 0x7fdfbc0c1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 --2- 172.21.15.82:0/3662001437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfbc0afda0 0x7fdfbc158d80 unknown :-1 s=CLOSED pgs=2525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 >> 172.21.15.82:0/3662001437 conn(0x7fdfbc0cada0 msgr2=0x7fdfbc070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 shutdown_connections 2023-07-20T11:24:58.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.651+0000 7fdfc30e5640 1 -- 172.21.15.82:0/3662001437 wait complete. 2023-07-20T11:24:58.661 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-20T11:24:58.365612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":196,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":438172,"kb_used_data":21936,"kb_used_omap":13,"kb_used_meta":416114,"kb_avail":754536548,"statfs":{"total":773094113280,"available":772645425152,"internally_reserved":0,"allocated":22462464,"data_stored":12279531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":426100824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.104622"},"pg_stats":[{"pgid":"1.0","version":"207'348","reported_seq":1359,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748843+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:53.748843+0000","last_peered":"2023-07-20T11:24:53.748843+0000","last_clean":"2023-07-20T11:24:53.748843+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:53.748843+0000","last_undegraded":"2023-07-20T11:24:53.748843+0000","last_fullsized":"2023-07-20T11:24:53.748843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:43:02.773578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.520171+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:53.520171+0000","last_peered":"2023-07-20T11:24:53.520171+0000","last_clean":"2023-07-20T11:24:53.520171+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:53.520171+0000","last_undegraded":"2023-07-20T11:24:53.520171+0000","last_fullsized":"2023-07-20T11:24:53.520171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:44:50.024832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":383,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.747837+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:53.747837+0000","last_peered":"2023-07-20T11:24:53.747837+0000","last_clean":"2023-07-20T11:24:53.747837+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:53.747837+0000","last_undegraded":"2023-07-20T11:24:53.747837+0000","last_fullsized":"2023-07-20T11:24:53.747837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T17:19:45.296527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":416,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.581063+0000","last_change":"2023-07-20T09:50:21.470005+0000","last_active":"2023-07-20T11:24:53.581063+0000","last_peered":"2023-07-20T11:24:53.581063+0000","last_clean":"2023-07-20T11:24:53.581063+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:24:53.581063+0000","last_undegraded":"2023-07-20T11:24:53.581063+0000","last_fullsized":"2023-07-20T11:24:53.581063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:36:55.693316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":426,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.519535+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:53.519535+0000","last_peered":"2023-07-20T11:24:53.519535+0000","last_clean":"2023-07-20T11:24:53.519535+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:53.519535+0000","last_undegraded":"2023-07-20T11:24:53.519535+0000","last_fullsized":"2023-07-20T11:24:53.519535+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:29:21.016187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523016+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:53.523016+0000","last_peered":"2023-07-20T11:24:53.523016+0000","last_clean":"2023-07-20T11:24:53.523016+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:53.523016+0000","last_undegraded":"2023-07-20T11:24:53.523016+0000","last_fullsized":"2023-07-20T11:24:53.523016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T10:58:11.787419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":382,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.748121+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:53.748121+0000","last_peered":"2023-07-20T11:24:53.748121+0000","last_clean":"2023-07-20T11:24:53.748121+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:53.748121+0000","last_undegraded":"2023-07-20T11:24:53.748121+0000","last_fullsized":"2023-07-20T11:24:53.748121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T21:17:12.813300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":380,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.523964+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:53.523964+0000","last_peered":"2023-07-20T11:24:53.523964+0000","last_clean":"2023-07-20T11:24:53.523964+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:53.523964+0000","last_undegraded":"2023-07-20T11:24:53.523964+0000","last_fullsized":"2023-07-20T11:24:53.523964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:21:51.790971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":374,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-07-20T11:24:53.746379+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:53.746379+0000","last_peered":"2023-07-20T11:24:53.746379+0000","last_clean":"2023-07-20T11:24:53.746379+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:53.746379+0000","last_undegraded":"2023-07-20T11:24:53.746379+0000","last_fullsized":"2023-07-20T11:24:53.746379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:47:53.808158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52288,"kb_used_data":3124,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319552,"statfs":{"total":96636764160,"available":96583221248,"internally_reserved":0,"allocated":3198976,"data_stored":1931335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.96699999999999997,"15min":1.0409999999999999},"last":0.77700000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":1.01,"15min":1.081},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.97499999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93999999999999995,"5min":1.012,"15min":1.0900000000000001},"last":0.629}]},{"osd":3,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.94899999999999995,"5min":0.997,"15min":1.0409999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.0509999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.80900000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.28299999999999997},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.03},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.505},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.45100000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.505}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.873},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.748}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.82299999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.80000000000000004}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":0.504},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.91300000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.84299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575973,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59920,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311920,"statfs":{"total":96636764160,"available":96575406080,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.72899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59916,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311924,"statfs":{"total":96636764160,"available":96575410176,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.496},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.624},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":2872,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":2940928,"data_stored":1669330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":2621440,"data_stored":1348083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.629}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.876},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.998}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.93700000000000006}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48212,"kb_used_data":3140,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323628,"statfs":{"total":96636764160,"available":96587395072,"internally_reserved":0,"allocated":3215360,"data_stored":1938451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.309},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.497}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.752}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.78000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:24:58.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-20T11:24:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 Processor -- start 2023-07-20T11:24:58.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 -- start start 2023-07-20T11:24:58.808 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f12fc15c5f0 0x7f12fc0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12fc0ccfb0 0x7f12fc0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12fc0b7c20 con 0x7f12fc0ce9a0 2023-07-20T11:24:58.809 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc0cee30 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13026d5640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12fc15c9d0 con 0x7f12fc15c5f0 2023-07-20T11:24:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f12fc0ccfb0 0x7f12fc0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1301ed4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f12fc0ce9a0 0x7f12fc0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57776/0 (socket says 172.21.15.82:57776) 2023-07-20T11:24:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1301ed4640 1 -- 172.21.15.82:0/3898660171 learned_addr learned my addr 172.21.15.82:0/3898660171 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:24:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 --2- 172.21.15.82:0/3898660171 >> v2:172.21.15.82:3300/0 conn(0x7f12fc0ccfb0 0x7f12fc0ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59516/0 (socket says 172.21.15.82:59516) 2023-07-20T11:24:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f13016d3640 1 --2- 172.21.15.82:0/3898660171 >> v2:172.21.15.183:3300/0 conn(0x7f12fc15c5f0 0x7f12fc0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 -- 172.21.15.82:0/3898660171 >> v2:172.21.15.183:3300/0 conn(0x7f12fc15c5f0 msgr2=0x7f12fc0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:24:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 --2- 172.21.15.82:0/3898660171 >> v2:172.21.15.183:3300/0 conn(0x7f12fc15c5f0 0x7f12fc0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 -- 172.21.15.82:0/3898660171 >> v1:172.21.15.82:6789/0 conn(0x7f12fc0ce9a0 legacy=0x7f12fc0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f12f3fff640 1 -- 172.21.15.82:0/3898660171 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128101668 0 0) 0x7f12fc0b7c20 con 0x7f12fc0ce9a0 2023-07-20T11:24:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.815+0000 7f1300ed2640 1 -- 172.21.15.82:0/3898660171 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc0ce030 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f1300ed2640 1 --2- 172.21.15.82:0/3898660171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ce460 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0d2470 tx=0x7f12ec01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa05000b347a5fc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f12f3fff640 1 -- 172.21.15.82:0/3898660171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0a8950 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f12f3fff640 1 -- 172.21.15.82:0/3898660171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec0a8ab0 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f12f3fff640 1 -- 172.21.15.82:0/3898660171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0a8e40 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 -- 172.21.15.82:0/3898660171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 msgr2=0x7f12fc0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 --2- 172.21.15.82:0/3898660171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ce460 secure :-1 s=READY pgs=2527 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0d2470 tx=0x7f12ec01ec50 comp rx=0 tx=0).stop 2023-07-20T11:24:58.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 -- 172.21.15.82:0/3898660171 shutdown_connections 2023-07-20T11:24:58.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 --2- 172.21.15.82:0/3898660171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ce460 unknown :-1 s=CLOSED pgs=2527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 --2- 172.21.15.82:0/3898660171 >> v2:172.21.15.183:3300/0 conn(0x7f12fc15c5f0 0x7f12fc0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.818 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 -- 172.21.15.82:0/3898660171 >> 172.21.15.82:0/3898660171 conn(0x7f12fc065710 msgr2=0x7f12fc065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 -- 172.21.15.82:0/3898660171 shutdown_connections 2023-07-20T11:24:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 -- 172.21.15.82:0/3898660171 wait complete. 2023-07-20T11:24:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.819+0000 7f13026d5640 1 Processor -- start 2023-07-20T11:24:58.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- start start 2023-07-20T11:24:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 0x7f12fc1f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12fc15c5f0 0x7f12fc0aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc0a9300 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f5750 con 0x7f12fc0ce9a0 2023-07-20T11:24:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12fc1f5a30 con 0x7f12fc15c5f0 2023-07-20T11:24:58.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59532/0 (socket says 172.21.15.82:59532) 2023-07-20T11:24:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 -- 172.21.15.82:0/651371537 learned_addr learned my addr 172.21.15.82:0/651371537 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:24:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 -- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12fc15c5f0 msgr2=0x7f12fc0aa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.822 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12fc15c5f0 0x7f12fc0aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 -- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 msgr2=0x7f12fc1f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f1300ed2640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 0x7f12fc1f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.823 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 0x7f12fc1f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 -- 172.21.15.82:0/651371537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec009420 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f1300ed2640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 0x7f12fc1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:24:58.824 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13016d3640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e870 tx=0x7f12f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8009510 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800eec0 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800cb40 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.825 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12fc0a8f90 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.826 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12fc0acd70 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.823+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12fc04da30 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.827 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.827+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f12f800cca0 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.827+0000 7f12f1ffb640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 0x7f12e0068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:24:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.827+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f12f8084010 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.828 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.827+0000 7f1300ed2640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 0x7f12e0068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:24:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.827+0000 7f1300ed2640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 0x7f12e0068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0b2000 tx=0x7f12ec0aa070 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:24:58.829 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.831+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12f80512e0 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.970 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12fc0d0ce0 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.971 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f12f1ffb640 1 -- 172.21.15.82:0/651371537 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v210) v1 ==== 74+0+15871 (secure 0 0 0) 0x7f12f8017090 con 0x7f12fc0ccfb0 2023-07-20T11:24:58.971 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:24:58.972 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":210,"fsid":"79d507c4-9484-40cb-9468-5aa547ff1f30","created":"2023-07-20T09:50:00.864403+0000","modified":"2023-07-20T11:24:54.514208+0000","last_up_change":"2023-07-20T09:50:13.280772+0000","last_in_change":"2023-07-20T09:50:03.448089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-20T09:50:13.898859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-20T09:50:19.684821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee31b39e-c1a3-4d63-af6f-0eb7857b5a3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6810","nonce":1720305563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6814","nonce":1720305563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6824","nonce":1720305563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":1720305563},{"type":"v1","addr":"172.21.15.82:6818","nonce":1720305563}]},"public_addr":"172.21.15.82:6810/1720305563","cluster_addr":"172.21.15.82:6814/1720305563","heartbeat_back_addr":"172.21.15.82:6824/1720305563","heartbeat_front_addr":"172.21.15.82:6818/1720305563","state":["exists","up"]},{"osd":1,"uuid":"200bd499-11e9-4e25-b0e8-7f3663f2d3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6809","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6811","nonce":403607720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6813","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6815","nonce":403607720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6823","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6826","nonce":403607720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6817","nonce":403607720},{"type":"v1","addr":"172.21.15.82:6819","nonce":403607720}]},"public_addr":"172.21.15.82:6811/403607720","cluster_addr":"172.21.15.82:6815/403607720","heartbeat_back_addr":"172.21.15.82:6826/403607720","heartbeat_front_addr":"172.21.15.82:6819/403607720","state":["exists","up"]},{"osd":2,"uuid":"ff0d60d9-8dad-43bf-9708-b699417f3003","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6821","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6822","nonce":3865820031}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6825","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6827","nonce":3865820031}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6831","nonce":3865820031}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3865820031},{"type":"v1","addr":"172.21.15.82:6829","nonce":3865820031}]},"public_addr":"172.21.15.82:6822/3865820031","cluster_addr":"172.21.15.82:6827/3865820031","heartbeat_back_addr":"172.21.15.82:6831/3865820031","heartbeat_front_addr":"172.21.15.82:6829/3865820031","state":["exists","up"]},{"osd":3,"uuid":"dc91d622-b11a-46b2-8e34-2032bc7885b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6801","nonce":2403361967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6803","nonce":2403361967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6807","nonce":2403361967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2403361967},{"type":"v1","addr":"172.21.15.82:6805","nonce":2403361967}]},"public_addr":"172.21.15.82:6801/2403361967","cluster_addr":"172.21.15.82:6803/2403361967","heartbeat_back_addr":"172.21.15.82:6807/2403361967","heartbeat_front_addr":"172.21.15.82:6805/2403361967","state":["exists","up"]},{"osd":4,"uuid":"2b3f3f0f-df34-4331-b077-eb84fac8e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6825","nonce":683958145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6827","nonce":683958145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6831","nonce":683958145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":683958145},{"type":"v1","addr":"172.21.15.183:6829","nonce":683958145}]},"public_addr":"172.21.15.183:6825/683958145","cluster_addr":"172.21.15.183:6827/683958145","heartbeat_back_addr":"172.21.15.183:6831/683958145","heartbeat_front_addr":"172.21.15.183:6829/683958145","state":["exists","up"]},{"osd":5,"uuid":"82ef737b-bb06-4ca4-9a12-4b9c9f9ddfd1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6810","nonce":454263273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6814","nonce":454263273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6822","nonce":454263273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":454263273},{"type":"v1","addr":"172.21.15.183:6818","nonce":454263273}]},"public_addr":"172.21.15.183:6810/454263273","cluster_addr":"172.21.15.183:6814/454263273","heartbeat_back_addr":"172.21.15.183:6822/454263273","heartbeat_front_addr":"172.21.15.183:6818/454263273","state":["exists","up"]},{"osd":6,"uuid":"1622ed3e-f458-450f-998d-7e4534c6e551","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6801","nonce":2355022847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6803","nonce":2355022847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6807","nonce":2355022847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2355022847},{"type":"v1","addr":"172.21.15.183:6805","nonce":2355022847}]},"public_addr":"172.21.15.183:6801/2355022847","cluster_addr":"172.21.15.183:6803/2355022847","heartbeat_back_addr":"172.21.15.183:6807/2355022847","heartbeat_front_addr":"172.21.15.183:6805/2355022847","state":["exists","up"]},{"osd":7,"uuid":"2c6df0ea-6d1c-4055-8891-dcaa9bd489c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":203,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6809","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6811","nonce":1024675739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6813","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6815","nonce":1024675739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6821","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6823","nonce":1024675739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6817","nonce":1024675739},{"type":"v1","addr":"172.21.15.183:6819","nonce":1024675739}]},"public_addr":"172.21.15.183:6811/1024675739","cluster_addr":"172.21.15.183:6815/1024675739","heartbeat_back_addr":"172.21.15.183:6823/1024675739","heartbeat_front_addr":"172.21.15.183:6819/1024675739","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.181950+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.274653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.121119+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.019042+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.031721+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.201027+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:08.985553+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-20T09:50:09.168695+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:6837/2909452184":"2023-07-21T11:24:51.255958+0000","172.21.15.82:6835/2909452184":"2023-07-21T11:24:51.255958+0000","172.21.15.82:6833/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6832/3699090616":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3893355374":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/1542867210":"2023-07-21T11:24:48.343184+0000","172.21.15.82:6833/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:6832/1948044010":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4135921357":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/3655290478":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/3061030549":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2009112200":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/2902554209":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/4144401913":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/2113730571":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/367903546":"2023-07-21T11:24:41.286826+0000","172.21.15.82:0/1169598737":"2023-07-21T11:24:48.343184+0000","172.21.15.82:0/666160418":"2023-07-21T11:24:41.286826+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-20T11:24:58.973 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 msgr2=0x7f12e0068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 0x7f12e0068860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12ec0b2000 tx=0x7f12ec0aa070 comp rx=0 tx=0).stop 2023-07-20T11:24:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 msgr2=0x7f12fc0ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:24:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f12f800e870 tx=0x7f12f800ec70 comp rx=0 tx=0).stop 2023-07-20T11:24:58.974 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 shutdown_connections 2023-07-20T11:24:58.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f12e00663a0 0x7f12e0068860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f12fc15c5f0 0x7f12fc0aa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12fc0ce9a0 0x7f12fc1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 --2- 172.21.15.82:0/651371537 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12fc0ccfb0 0x7f12fc0ac830 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:24:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 >> 172.21.15.82:0/651371537 conn(0x7f12fc065710 msgr2=0x7f12fc15cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:24:58.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 shutdown_connections 2023-07-20T11:24:58.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:24:58.979+0000 7f13026d5640 1 -- 172.21.15.82:0/651371537 wait complete. 2023-07-20T11:24:59.994 INFO:tasks.ceph:Scrubbing osd.0 2023-07-20T11:24:59.994 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:00.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 Processor -- start 2023-07-20T11:25:00.147 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 -- start start 2023-07-20T11:25:00.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f396806c120 0x7f39680cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39681602b0 0x7f3968160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39680d0970 con 0x7f396806ab10 2023-07-20T11:25:00.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3968160e20 con 0x7f396806c120 2023-07-20T11:25:00.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396cc96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680cd300 con 0x7f39681602b0 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396659c640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f396806c120 0x7f39680cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f3966d9d640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f396806ab10 0x7f396806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57792/0 (socket says 172.21.15.82:57792) 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f3966d9d640 1 -- 172.21.15.82:0/2396862225 learned_addr learned my addr 172.21.15.82:0/2396862225 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f395dd9b640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39681602b0 0x7f3968160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396659c640 1 -- 172.21.15.82:0/2396862225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39681602b0 msgr2=0x7f3968160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396659c640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39681602b0 0x7f3968160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.150 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396659c640 1 -- 172.21.15.82:0/2396862225 >> v1:172.21.15.82:6789/0 conn(0x7f396806ab10 legacy=0x7f396806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f396659c640 1 -- 172.21.15.82:0/2396862225 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680cd5e0 con 0x7f396806c120 2023-07-20T11:25:00.151 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.155+0000 7f3965d9b640 1 -- 172.21.15.82:0/2396862225 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 263223993 0 0) 0x7f39680d0970 con 0x7f396806ab10 2023-07-20T11:25:00.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396659c640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f39680cdde0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f39580097c0 tx=0x7f395801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69aaec730268e6e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f3965d9b640 1 -- 172.21.15.82:0/2396862225 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580ab600 con 0x7f396806c120 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f3965d9b640 1 -- 172.21.15.82:0/2396862225 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39580a7050 con 0x7f396806c120 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f3965d9b640 1 -- 172.21.15.82:0/2396862225 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580ab980 con 0x7f396806c120 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 -- 172.21.15.82:0/2396862225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 msgr2=0x7f39680cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f39680cdde0 secure :-1 s=READY pgs=2530 cs=0 l=1 rev1=1 crypto rx=0x7f39580097c0 tx=0x7f395801c3f0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 -- 172.21.15.82:0/2396862225 shutdown_connections 2023-07-20T11:25:00.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f39681602b0 0x7f3968160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 --2- 172.21.15.82:0/2396862225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f39680cdde0 unknown :-1 s=CLOSED pgs=2530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 -- 172.21.15.82:0/2396862225 >> 172.21.15.82:0/2396862225 conn(0x7f396808c0a0 msgr2=0x7f396809b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 -- 172.21.15.82:0/2396862225 shutdown_connections 2023-07-20T11:25:00.154 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.159+0000 7f396cc96640 1 -- 172.21.15.82:0/2396862225 wait complete. 2023-07-20T11:25:00.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 Processor -- start 2023-07-20T11:25:00.155 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- start start 2023-07-20T11:25:00.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f396806ab10 0x7f39680c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f396814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39681602b0 0x7f39680d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680b84a0 con 0x7f396806c120 2023-07-20T11:25:00.157 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680ca1f0 con 0x7f39681602b0 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680c8e40 con 0x7f396806ab10 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f396814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f396814aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59552/0 (socket says 172.21.15.82:59552) 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 -- 172.21.15.82:0/3101287219 learned_addr learned my addr 172.21.15.82:0/3101287219 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396659c640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f396806ab10 0x7f39680c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f3966d9d640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39681602b0 0x7f39680d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.158 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 -- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f396806ab10 msgr2=0x7f39680c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f396806ab10 0x7f39680c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 -- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39681602b0 msgr2=0x7f39680d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f39681602b0 0x7f39680d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009420 con 0x7f396806c120 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395dd9b640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f396814aad0 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f395000e8a0 tx=0x7f395000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950009530 con 0x7f396806c120 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395000c940 con 0x7f396806c120 2023-07-20T11:25:00.159 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395000ccd0 con 0x7f396806c120 2023-07-20T11:25:00.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39680c98c0 con 0x7f396806c120 2023-07-20T11:25:00.160 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.163+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39680c9e80 con 0x7f396806c120 2023-07-20T11:25:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f396815f2d0 con 0x7f396806c120 2023-07-20T11:25:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3950013470 con 0x7f396806c120 2023-07-20T11:25:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f39480663d0 0x7f3948068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f3950083ff0 con 0x7f396806c120 2023-07-20T11:25:00.161 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f396659c640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f39480663d0 0x7f3948068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f394806ce70 0x7f394806f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f394806f960 con 0x7f394806ce70 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39500865f0 con 0x7f396806c120 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f3966d9d640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f394806ce70 0x7f394806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f396659c640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f39480663d0 0x7f3948068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39580ad000 tx=0x7f39580a4f90 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.162 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.167+0000 7f3966d9d640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f394806ce70 0x7f394806f290 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.163 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.171+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== osd.0 v2:172.21.15.82:6808/1720305563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f394806f960 con 0x7f394806ce70 2023-07-20T11:25:00.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 --> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39680ca360 con 0x7f394806ce70 2023-07-20T11:25:00.174 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f395f7fe640 1 -- 172.21.15.82:0/3101287219 <== osd.0 v2:172.21.15.82:6808/1720305563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f39680ca360 con 0x7f394806ce70 2023-07-20T11:25:00.175 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:00.175 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:00.175 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f394806ce70 msgr2=0x7f394806f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6808/1720305563,v1:172.21.15.82:6810/1720305563] conn(0x7f394806ce70 0x7f394806f290 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f39480663d0 msgr2=0x7f3948068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f39480663d0 0x7f3948068890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39580ad000 tx=0x7f39580a4f90 comp rx=0 tx=0).stop 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 msgr2=0x7f396814aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 --2- 172.21.15.82:0/3101287219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f396806c120 0x7f396814aad0 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f395000e8a0 tx=0x7f395000ed60 comp rx=0 tx=0).stop 2023-07-20T11:25:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f3966d9d640 1 -- 172.21.15.82:0/3101287219 reap_dead start 2023-07-20T11:25:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 shutdown_connections 2023-07-20T11:25:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 >> 172.21.15.82:0/3101287219 conn(0x7f396808c0a0 msgr2=0x7f396815af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 shutdown_connections 2023-07-20T11:25:00.178 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.183+0000 7f396cc96640 1 -- 172.21.15.82:0/3101287219 wait complete. 2023-07-20T11:25:00.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-20T11:25:00.340 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 Processor -- start 2023-07-20T11:25:00.341 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 -- start start 2023-07-20T11:25:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f20a015a8e0 0x7f20a00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20a00b2060 0x7f20a00b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a00b06c0 con 0x7f20a00afda0 2023-07-20T11:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a00b3160 con 0x7f20a00b2060 2023-07-20T11:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f20a4937640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a00b12a0 con 0x7f20a015a8e0 2023-07-20T11:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f209ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20a00b2060 0x7f20a00b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f209ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f20a00b2060 0x7f20a00b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59562/0 (socket says 172.21.15.82:59562) 2023-07-20T11:25:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f209ed9d640 1 -- 172.21.15.82:0/1827104631 learned_addr learned my addr 172.21.15.82:0/1827104631 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.347+0000 7f2095d9b640 1 --2- 172.21.15.82:0/1827104631 >> v2:172.21.15.183:3300/0 conn(0x7f20a015a8e0 0x7f20a00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209ed9d640 1 -- 172.21.15.82:0/1827104631 >> v2:172.21.15.183:3300/0 conn(0x7f20a015a8e0 msgr2=0x7f20a00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:00.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209ed9d640 1 --2- 172.21.15.82:0/1827104631 >> v2:172.21.15.183:3300/0 conn(0x7f20a015a8e0 0x7f20a00ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209ed9d640 1 -- 172.21.15.82:0/1827104631 >> v1:172.21.15.82:6789/0 conn(0x7f20a00afda0 legacy=0x7f20a00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209ed9d640 1 -- 172.21.15.82:0/1827104631 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00b1580 con 0x7f20a00b2060 2023-07-20T11:25:00.347 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209dd9b640 1 -- 172.21.15.82:0/1827104631 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472064793 0 0) 0x7f20a00b06c0 con 0x7f20a00afda0 2023-07-20T11:25:00.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209ed9d640 1 --2- 172.21.15.82:0/1827104631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a00b2060 0x7f20a00b0180 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f20a00b0f10 tx=0x7f209801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac19347ca5279f35 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.348 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209dd9b640 1 -- 172.21.15.82:0/1827104631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980a5740 con 0x7f20a00b2060 2023-07-20T11:25:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209dd9b640 1 -- 172.21.15.82:0/1827104631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980a58a0 con 0x7f20a00b2060 2023-07-20T11:25:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f209dd9b640 1 -- 172.21.15.82:0/1827104631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980a5c30 con 0x7f20a00b2060 2023-07-20T11:25:00.349 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 -- 172.21.15.82:0/1827104631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a00b2060 msgr2=0x7f20a00b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 --2- 172.21.15.82:0/1827104631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a00b2060 0x7f20a00b0180 secure :-1 s=READY pgs=2533 cs=0 l=1 rev1=1 crypto rx=0x7f20a00b0f10 tx=0x7f209801c880 comp rx=0 tx=0).stop 2023-07-20T11:25:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 -- 172.21.15.82:0/1827104631 shutdown_connections 2023-07-20T11:25:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 --2- 172.21.15.82:0/1827104631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a00b2060 0x7f20a00b0180 unknown :-1 s=CLOSED pgs=2533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.350 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 --2- 172.21.15.82:0/1827104631 >> v2:172.21.15.183:3300/0 conn(0x7f20a015a8e0 0x7f20a00ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 -- 172.21.15.82:0/1827104631 >> 172.21.15.82:0/1827104631 conn(0x7f20a00cada0 msgr2=0x7f20a00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 -- 172.21.15.82:0/1827104631 shutdown_connections 2023-07-20T11:25:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.351+0000 7f20a4937640 1 -- 172.21.15.82:0/1827104631 wait complete. 2023-07-20T11:25:00.353 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 Processor -- start 2023-07-20T11:25:00.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 -- start start 2023-07-20T11:25:00.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20a00afda0 0x7f20a00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20a00b2060 0x7f20a0155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.354 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0157ad0 con 0x7f20a015a8e0 2023-07-20T11:25:00.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a00c2130 con 0x7f20a00b2060 2023-07-20T11:25:00.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f20a4937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0157d20 con 0x7f20a00afda0 2023-07-20T11:25:00.355 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59564/0 (socket says 172.21.15.82:59564) 2023-07-20T11:25:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 -- 172.21.15.82:0/3415238588 learned_addr learned my addr 172.21.15.82:0/3415238588 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209e59c640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20a00afda0 0x7f20a00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f2095d9b640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20a00b2060 0x7f20a0155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 -- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20a00afda0 msgr2=0x7f20a00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20a00afda0 0x7f20a00c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 -- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20a00b2060 msgr2=0x7f20a0155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20a00b2060 0x7f20a0155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 -- 172.21.15.82:0/3415238588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2098009b30 con 0x7f20a015a8e0 2023-07-20T11:25:00.357 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.355+0000 7f209ed9d640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f2098019490 tx=0x7f2098019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980b8670 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20980b87f0 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a0158000 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980b8ba0 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a01585c0 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a0073c70 con 0x7f20a015a8e0 2023-07-20T11:25:00.358 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f20980b8d00 con 0x7f20a015a8e0 2023-07-20T11:25:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 0x7f2080068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f209811f400 con 0x7f20a015a8e0 2023-07-20T11:25:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f209e59c640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 0x7f2080068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.359 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.359+0000 7f209e59c640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 0x7f2080068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2090000f70 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.363+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20980ec780 con 0x7f20a015a8e0 2023-07-20T11:25:00.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f20a00b24f0 con 0x7f20800663a0 2023-07-20T11:25:00.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20977fe640 1 -- 172.21.15.82:0/3415238588 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f209000f820 con 0x7f20800663a0 2023-07-20T11:25:00.507 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 0 to deep-scrub 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 msgr2=0x7f2080068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 0x7f2080068860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2090000f70 tx=0x7f2090009040 comp rx=0 tx=0).stop 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 msgr2=0x7f20a00c40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f2098019490 tx=0x7f2098019620 comp rx=0 tx=0).stop 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 shutdown_connections 2023-07-20T11:25:00.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f20800663a0 0x7f2080068860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20a015a8e0 0x7f20a00c40b0 unknown :-1 s=CLOSED pgs=2534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f20a00b2060 0x7f20a0155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 --2- 172.21.15.82:0/3415238588 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f20a00afda0 0x7f20a00c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 >> 172.21.15.82:0/3415238588 conn(0x7f20a00cada0 msgr2=0x7f20a00cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 shutdown_connections 2023-07-20T11:25:00.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.511+0000 7f20a4937640 1 -- 172.21.15.82:0/3415238588 wait complete. 2023-07-20T11:25:00.524 INFO:tasks.ceph:Scrubbing osd.1 2023-07-20T11:25:00.524 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:00.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 Processor -- start 2023-07-20T11:25:00.676 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 -- start start 2023-07-20T11:25:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356815a4f0 0x7f356806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f35681603e0 0x7f3568070820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.678 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3568069750 0x7f3568069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356815a8d0 con 0x7f3568069750 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356806a120 con 0x7f35681603e0 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.683+0000 7f356d5fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356806ce00 con 0x7f356815a4f0 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3568069750 0x7f3568069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f3568069750 0x7f3568069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59572/0 (socket says 172.21.15.82:59572) 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 -- 172.21.15.82:0/1717056792 learned_addr learned my addr 172.21.15.82:0/1717056792 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.679 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f355e7fc640 1 --2- 172.21.15.82:0/1717056792 >> v2:172.21.15.183:3300/0 conn(0x7f35681603e0 0x7f3568070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f3566ffd640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356815a4f0 0x7f356806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 -- 172.21.15.82:0/1717056792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356815a4f0 msgr2=0x7f356806c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356815a4f0 0x7f356806c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 -- 172.21.15.82:0/1717056792 >> v2:172.21.15.183:3300/0 conn(0x7f35681603e0 msgr2=0x7f3568070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 --2- 172.21.15.82:0/1717056792 >> v2:172.21.15.183:3300/0 conn(0x7f35681603e0 0x7f3568070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 -- 172.21.15.82:0/1717056792 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35681609a0 con 0x7f3568069750 2023-07-20T11:25:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35677fe640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3568069750 0x7f3568069be0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f356806f550 tx=0x7f356001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970f13e2618b0d77 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35667fc640 1 -- 172.21.15.82:0/1717056792 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600ab600 con 0x7f3568069750 2023-07-20T11:25:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35667fc640 1 -- 172.21.15.82:0/1717056792 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35600a7050 con 0x7f3568069750 2023-07-20T11:25:00.681 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.687+0000 7f35667fc640 1 -- 172.21.15.82:0/1717056792 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600ab980 con 0x7f3568069750 2023-07-20T11:25:00.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- 172.21.15.82:0/1717056792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3568069750 msgr2=0x7f3568069be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3568069750 0x7f3568069be0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f356806f550 tx=0x7f356001c500 comp rx=0 tx=0).stop 2023-07-20T11:25:00.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- 172.21.15.82:0/1717056792 shutdown_connections 2023-07-20T11:25:00.682 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- 172.21.15.82:0/1717056792 >> v2:172.21.15.183:3300/0 conn(0x7f35681603e0 0x7f3568070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3568069750 0x7f3568069be0 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- 172.21.15.82:0/1717056792 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f356815a4f0 0x7f356806c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- 172.21.15.82:0/1717056792 >> 172.21.15.82:0/1717056792 conn(0x7f35680cbe80 msgr2=0x7f35680cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- 172.21.15.82:0/1717056792 shutdown_connections 2023-07-20T11:25:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- 172.21.15.82:0/1717056792 wait complete. 2023-07-20T11:25:00.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 Processor -- start 2023-07-20T11:25:00.684 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- start start 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3568069750 0x7f35680c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 0x7f35680ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35681603e0 0x7f3568153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680abcf0 con 0x7f356815a4f0 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35680aba10 con 0x7f35681603e0 2023-07-20T11:25:00.685 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f356d5fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35680ade10 con 0x7f3568069750 2023-07-20T11:25:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 0x7f35680ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 0x7f35680ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59576/0 (socket says 172.21.15.82:59576) 2023-07-20T11:25:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 -- 172.21.15.82:0/4225937819 learned_addr learned my addr 172.21.15.82:0/4225937819 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f3566ffd640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3568069750 0x7f35680c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f35677fe640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35681603e0 0x7f3568153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 -- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3568069750 msgr2=0x7f35680c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3568069750 0x7f35680c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 -- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35681603e0 msgr2=0x7f3568153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f35681603e0 0x7f3568153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.691+0000 7f355e7fc640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600094d0 con 0x7f356815a4f0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355e7fc640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 0x7f35680ad460 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7f355000d800 tx=0x7f355000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b6c0 con 0x7f356815a4f0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b820 con 0x7f356815a4f0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bb90 con 0x7f356815a4f0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35680ae0f0 con 0x7f356815a4f0 2023-07-20T11:25:00.688 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35680ad9a0 con 0x7f356815a4f0 2023-07-20T11:25:00.689 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3568161240 con 0x7f356815a4f0 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f355000bcf0 con 0x7f356815a4f0 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f35480663a0 0x7f3548068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f3550084d40 con 0x7f356815a4f0 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.695+0000 7f3566ffd640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f35480663a0 0x7f3548068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f355ffff640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7f354806ce40 0x7f354806f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f354806f930 con 0x7f354806ce40 2023-07-20T11:25:00.690 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3550085160 con 0x7f356815a4f0 2023-07-20T11:25:00.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f35677fe640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7f354806ce40 0x7f354806f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f3566ffd640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f35480663a0 0x7f3548068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3558003ab0 tx=0x7f3558009830 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f35677fe640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7f354806ce40 0x7f354806f260 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.691 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.699+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== osd.1 v2:172.21.15.82:6809/403607720 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f354806f930 con 0x7f354806ce40 2023-07-20T11:25:00.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 --> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f356815cf00 con 0x7f354806ce40 2023-07-20T11:25:00.703 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f355ffff640 1 -- 172.21.15.82:0/4225937819 <== osd.1 v2:172.21.15.82:6809/403607720 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f35600ab5a0 con 0x7f354806ce40 2023-07-20T11:25:00.704 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:00.704 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:00.704 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7f354806ce40 msgr2=0x7f354806f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6809/403607720,v1:172.21.15.82:6811/403607720] conn(0x7f354806ce40 0x7f354806f260 crc :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f35480663a0 msgr2=0x7f3548068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f35480663a0 0x7f3548068860 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3558003ab0 tx=0x7f3558009830 comp rx=0 tx=0).stop 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 msgr2=0x7f35680ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.705 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 --2- 172.21.15.82:0/4225937819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f356815a4f0 0x7f35680ad460 secure :-1 s=READY pgs=2536 cs=0 l=1 rev1=1 crypto rx=0x7f355000d800 tx=0x7f355000dcc0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f35677fe640 1 -- 172.21.15.82:0/4225937819 reap_dead start 2023-07-20T11:25:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 shutdown_connections 2023-07-20T11:25:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 >> 172.21.15.82:0/4225937819 conn(0x7f35680cbe80 msgr2=0x7f356815f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 shutdown_connections 2023-07-20T11:25:00.706 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.711+0000 7f356d5fa640 1 -- 172.21.15.82:0/4225937819 wait complete. 2023-07-20T11:25:00.722 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-20T11:25:00.864 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.871+0000 7f27c3034640 1 Processor -- start 2023-07-20T11:25:00.865 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.871+0000 7f27c3034640 1 -- start start 2023-07-20T11:25:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.871+0000 7f27c3034640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f27bc0b2a90 0x7f27bc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c3034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c3034640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0ccd90 con 0x7f27bc1596b0 2023-07-20T11:25:00.866 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c3034640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0ad600 con 0x7f27bc0b2a90 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c3034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0ad810 con 0x7f27bc0cc900 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:40320/0 (socket says 172.21.15.82:40320) 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 -- 172.21.15.82:0/3545705040 learned_addr learned my addr 172.21.15.82:0/3545705040 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c0dd0640 1 --1- 172.21.15.82:0/3545705040 >> v1:172.21.15.183:6789/0 conn(0x7f27bc1596b0 0x7f27bc0b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:60146/0 (socket says 172.21.15.82:60146) 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27bbfff640 1 --2- 172.21.15.82:0/3545705040 >> v2:172.21.15.183:3300/0 conn(0x7f27bc0b2a90 0x7f27bc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.867 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 -- 172.21.15.82:0/3545705040 >> v2:172.21.15.183:3300/0 conn(0x7f27bc0b2a90 msgr2=0x7f27bc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 --2- 172.21.15.82:0/3545705040 >> v2:172.21.15.183:3300/0 conn(0x7f27bc0b2a90 0x7f27bc15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 -- 172.21.15.82:0/3545705040 >> v1:172.21.15.183:6789/0 conn(0x7f27bc1596b0 legacy=0x7f27bc0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.868 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 -- 172.21.15.82:0/3545705040 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc15d0d0 con 0x7f27bc0cc900 2023-07-20T11:25:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27c15d1640 1 --2- 172.21.15.82:0/3545705040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009e80 tx=0x7f27b401c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fc6882a871328be server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.869 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.875+0000 7f27bb7fe640 1 -- 172.21.15.82:0/3545705040 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a5880 con 0x7f27bc0cc900 2023-07-20T11:25:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27bb7fe640 1 -- 172.21.15.82:0/3545705040 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40a59e0 con 0x7f27bc0cc900 2023-07-20T11:25:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27bb7fe640 1 -- 172.21.15.82:0/3545705040 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a5d70 con 0x7f27bc0cc900 2023-07-20T11:25:00.870 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- 172.21.15.82:0/3545705040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 msgr2=0x7f27bc0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- 172.21.15.82:0/3545705040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009e80 tx=0x7f27b401c9c0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- 172.21.15.82:0/3545705040 shutdown_connections 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- 172.21.15.82:0/3545705040 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0cc900 0x7f27bc0ad0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- 172.21.15.82:0/3545705040 >> v2:172.21.15.183:3300/0 conn(0x7f27bc0b2a90 0x7f27bc15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- 172.21.15.82:0/3545705040 >> 172.21.15.82:0/3545705040 conn(0x7f27bc0cada0 msgr2=0x7f27bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- 172.21.15.82:0/3545705040 shutdown_connections 2023-07-20T11:25:00.871 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- 172.21.15.82:0/3545705040 wait complete. 2023-07-20T11:25:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 Processor -- start 2023-07-20T11:25:00.872 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- start start 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 0x7f27bc154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 0x7f27bc0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c4920 con 0x7f27bc0cc900 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c54a0 con 0x7f27bc1596b0 2023-07-20T11:25:00.873 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27c3034640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0c4b50 con 0x7f27bc0b2a90 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59588/0 (socket says 172.21.15.82:59588) 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.879+0000 7f27bbfff640 1 -- 172.21.15.82:0/2293658625 learned_addr learned my addr 172.21.15.82:0/2293658625 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c15d1640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 0x7f27bc0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 -- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 msgr2=0x7f27bc154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.875 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c0dd0640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 0x7f27bc154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 0x7f27bc154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 -- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 msgr2=0x7f27bc0c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 0x7f27bc0c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 -- 172.21.15.82:0/2293658625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009b30 con 0x7f27bc0cc900 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c15d1640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 0x7f27bc0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c0dd0640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 0x7f27bc154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:25:00.876 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27bbfff640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00e930 tx=0x7f27ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac009690 con 0x7f27bc0cc900 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac00c9a0 con 0x7f27bc0cc900 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00cd10 con 0x7f27bc0cc900 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc0c56f0 con 0x7f27bc0cc900 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc0c5cb0 con 0x7f27bc0cc900 2023-07-20T11:25:00.877 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc073c70 con 0x7f27bc0cc900 2023-07-20T11:25:00.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27ac013470 con 0x7f27bc0cc900 2023-07-20T11:25:00.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 0x7f279c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:00.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f27ac084440 con 0x7f27bc0cc900 2023-07-20T11:25:00.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.883+0000 7f27c0dd0640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 0x7f279c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:00.878 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.887+0000 7f27c0dd0640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 0x7f279c068860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27a4007fd0 tx=0x7f27a4009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:00.881 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:00.887+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27ac051870 con 0x7f27bc0cc900 2023-07-20T11:25:01.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.035+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f27bc0adaf0 con 0x7f279c0663a0 2023-07-20T11:25:01.029 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.035+0000 7f27b97fa640 1 -- 172.21.15.82:0/2293658625 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27a4001c50 con 0x7f279c0663a0 2023-07-20T11:25:01.030 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 1 to deep-scrub 2023-07-20T11:25:01.030 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 msgr2=0x7f279c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 0x7f279c068860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f27a4007fd0 tx=0x7f27a4009040 comp rx=0 tx=0).stop 2023-07-20T11:25:01.031 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 msgr2=0x7f27bc0c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00e930 tx=0x7f27ac00edf0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 shutdown_connections 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f279c0663a0 0x7f279c068860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f27bc1596b0 0x7f27bc0c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27bc0cc900 0x7f27bc0c1f50 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 --2- 172.21.15.82:0/2293658625 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f27bc0b2a90 0x7f27bc154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.032 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 >> 172.21.15.82:0/2293658625 conn(0x7f27bc0cada0 msgr2=0x7f27bc070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 shutdown_connections 2023-07-20T11:25:01.033 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.039+0000 7f27c3034640 1 -- 172.21.15.82:0/2293658625 wait complete. 2023-07-20T11:25:01.050 INFO:tasks.ceph:Scrubbing osd.2 2023-07-20T11:25:01.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.199+0000 7f5e449ba640 1 Processor -- start 2023-07-20T11:25:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.199+0000 7f5e449ba640 1 -- start start 2023-07-20T11:25:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e449ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40070970 0x7f5e40070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e449ba640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e4006b620 0x7f5e4006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e449ba640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400c95d0 con 0x7f5e40158ce0 2023-07-20T11:25:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e449ba640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e40071310 con 0x7f5e4006b620 2023-07-20T11:25:01.195 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e449ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4006bff0 con 0x7f5e40070970 2023-07-20T11:25:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e4006b620 0x7f5e4006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3e59c640 1 --1- >> v1:172.21.15.183:6789/0 conn(0x7f5e40158ce0 0x7f5e400c9a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:60150/0 (socket says 172.21.15.82:60150) 2023-07-20T11:25:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f5e4006b620 0x7f5e4006bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59592/0 (socket says 172.21.15.82:59592) 2023-07-20T11:25:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3e59c640 1 -- 172.21.15.82:0/456435654 learned_addr learned my addr 172.21.15.82:0/456435654 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:01.196 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e35d9b640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40070970 0x7f5e40070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 -- 172.21.15.82:0/456435654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40070970 msgr2=0x7f5e40070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40070970 0x7f5e40070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 -- 172.21.15.82:0/456435654 >> v1:172.21.15.183:6789/0 conn(0x7f5e40158ce0 legacy=0x7f5e400c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.203+0000 7f5e3ed9d640 1 -- 172.21.15.82:0/456435654 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e401590c0 con 0x7f5e4006b620 2023-07-20T11:25:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e3ed9d640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006b620 0x7f5e4006bab0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009d90 tx=0x7f5e3801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a7ccdc8c58703d server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e3dd9b640 1 -- 172.21.15.82:0/456435654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380a5850 con 0x7f5e4006b620 2023-07-20T11:25:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e3dd9b640 1 -- 172.21.15.82:0/456435654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380a59b0 con 0x7f5e4006b620 2023-07-20T11:25:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e3dd9b640 1 -- 172.21.15.82:0/456435654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e380a5d40 con 0x7f5e4006b620 2023-07-20T11:25:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- 172.21.15.82:0/456435654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006b620 msgr2=0x7f5e4006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006b620 0x7f5e4006bab0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009d90 tx=0x7f5e3801c920 comp rx=0 tx=0).stop 2023-07-20T11:25:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- 172.21.15.82:0/456435654 shutdown_connections 2023-07-20T11:25:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e4006b620 0x7f5e4006bab0 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 --2- 172.21.15.82:0/456435654 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40070970 0x7f5e40070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- 172.21.15.82:0/456435654 >> 172.21.15.82:0/456435654 conn(0x7f5e400cad50 msgr2=0x7f5e400cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- 172.21.15.82:0/456435654 shutdown_connections 2023-07-20T11:25:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- 172.21.15.82:0/456435654 wait complete. 2023-07-20T11:25:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 Processor -- start 2023-07-20T11:25:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.207+0000 7f5e449ba640 1 -- start start 2023-07-20T11:25:01.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4006b620 0x7f5e400c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 0x7f5e4014b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40158ce0 0x7f5e4014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.203 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015a630 con 0x7f5e40070970 2023-07-20T11:25:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400b2240 con 0x7f5e4006b620 2023-07-20T11:25:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400b2520 con 0x7f5e40158ce0 2023-07-20T11:25:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 0x7f5e4014b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 0x7f5e4014b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59602/0 (socket says 172.21.15.82:59602) 2023-07-20T11:25:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 -- 172.21.15.82:0/3535542743 learned_addr learned my addr 172.21.15.82:0/3535542743 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e3e59c640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4006b620 0x7f5e400c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e3ed9d640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40158ce0 0x7f5e4014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 -- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40158ce0 msgr2=0x7f5e4014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f5e40158ce0 0x7f5e4014bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 -- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4006b620 msgr2=0x7f5e400c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.205 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e4006b620 0x7f5e400c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38009a70 con 0x7f5e40070970 2023-07-20T11:25:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e35d9b640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 0x7f5e4014b580 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800e930 tx=0x7f5e2800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e28009690 con 0x7f5e40070970 2023-07-20T11:25:01.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2800ca00 con 0x7f5e40070970 2023-07-20T11:25:01.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800cd70 con 0x7f5e40070970 2023-07-20T11:25:01.207 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e400b2800 con 0x7f5e40070970 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400c12c0 con 0x7f5e40070970 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.211+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e400b23b0 con 0x7f5e40070970 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e28013470 con 0x7f5e40070970 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f5e200663d0 0x7f5e20068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f5e280840f0 con 0x7f5e40070970 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e3e59c640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f5e200663d0 0x7f5e20068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.208 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f5e2006ce70 0x7f5e2006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e2006f960 con 0x7f5e2006ce70 2023-07-20T11:25:01.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e280866d0 con 0x7f5e40070970 2023-07-20T11:25:01.209 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e3ed9d640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f5e2006ce70 0x7f5e2006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e3e59c640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f5e200663d0 0x7f5e20068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e30005890 tx=0x7f5e30009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e3ed9d640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f5e2006ce70 0x7f5e2006f290 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.210 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.215+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== osd.2 v2:172.21.15.82:6821/3865820031 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5e2006f960 con 0x7f5e2006ce70 2023-07-20T11:25:01.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.227+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 --> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5e400c9260 con 0x7f5e2006ce70 2023-07-20T11:25:01.221 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.227+0000 7f5e377fe640 1 -- 172.21.15.82:0/3535542743 <== osd.2 v2:172.21.15.82:6821/3865820031 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5e38009450 con 0x7f5e2006ce70 2023-07-20T11:25:01.222 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:01.222 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:01.222 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.227+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f5e2006ce70 msgr2=0x7f5e2006f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.227+0000 7f5e449ba640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6821/3865820031,v1:172.21.15.82:6822/3865820031] conn(0x7f5e2006ce70 0x7f5e2006f290 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f5e200663d0 msgr2=0x7f5e20068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f5e200663d0 0x7f5e20068890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e30005890 tx=0x7f5e30009040 comp rx=0 tx=0).stop 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 msgr2=0x7f5e4014b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.223 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 --2- 172.21.15.82:0/3535542743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40070970 0x7f5e4014b580 secure :-1 s=READY pgs=2539 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800e930 tx=0x7f5e2800edf0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e3ed9d640 1 -- 172.21.15.82:0/3535542743 reap_dead start 2023-07-20T11:25:01.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 shutdown_connections 2023-07-20T11:25:01.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 >> 172.21.15.82:0/3535542743 conn(0x7f5e400cad50 msgr2=0x7f5e401507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 shutdown_connections 2023-07-20T11:25:01.224 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.231+0000 7f5e449ba640 1 -- 172.21.15.82:0/3535542743 wait complete. 2023-07-20T11:25:01.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-20T11:25:01.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 Processor -- start 2023-07-20T11:25:01.384 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 -- start start 2023-07-20T11:25:01.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f168c1596b0 0x7f168c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f168c0cc900 0x7f168c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0ccd90 con 0x7f168c0b2380 2023-07-20T11:25:01.385 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0ad600 con 0x7f168c1596b0 2023-07-20T11:25:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f16920cb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0ad810 con 0x7f168c0cc900 2023-07-20T11:25:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f168c1596b0 0x7f168c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f168c1596b0 0x7f168c15dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59608/0 (socket says 172.21.15.82:59608) 2023-07-20T11:25:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 -- 172.21.15.82:0/3486667728 learned_addr learned my addr 172.21.15.82:0/3486667728 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f1682ffd640 1 --2- 172.21.15.82:0/3486667728 >> v2:172.21.15.183:3300/0 conn(0x7f168c0cc900 0x7f168c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 -- 172.21.15.82:0/3486667728 >> v2:172.21.15.183:3300/0 conn(0x7f168c0cc900 msgr2=0x7f168c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 --2- 172.21.15.82:0/3486667728 >> v2:172.21.15.183:3300/0 conn(0x7f168c0cc900 0x7f168c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 -- 172.21.15.82:0/3486667728 >> v1:172.21.15.183:6789/0 conn(0x7f168c0b2380 legacy=0x7f168c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.387 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.391+0000 7f168b7fe640 1 -- 172.21.15.82:0/3486667728 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c15d0d0 con 0x7f168c1596b0 2023-07-20T11:25:01.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f168b7fe640 1 --2- 172.21.15.82:0/3486667728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c15dbb0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f1674009870 tx=0x7f167401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3214e1d7299b03e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.388 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f168affd640 1 -- 172.21.15.82:0/3486667728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740aa5f0 con 0x7f168c1596b0 2023-07-20T11:25:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f168affd640 1 -- 172.21.15.82:0/3486667728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16740aa750 con 0x7f168c1596b0 2023-07-20T11:25:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f168affd640 1 -- 172.21.15.82:0/3486667728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740aaae0 con 0x7f168c1596b0 2023-07-20T11:25:01.389 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 -- 172.21.15.82:0/3486667728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 msgr2=0x7f168c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 --2- 172.21.15.82:0/3486667728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c15dbb0 secure :-1 s=READY pgs=2540 cs=0 l=1 rev1=1 crypto rx=0x7f1674009870 tx=0x7f167401c490 comp rx=0 tx=0).stop 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 -- 172.21.15.82:0/3486667728 shutdown_connections 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 --2- 172.21.15.82:0/3486667728 >> v2:172.21.15.183:3300/0 conn(0x7f168c0cc900 0x7f168c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 --2- 172.21.15.82:0/3486667728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c15dbb0 unknown :-1 s=CLOSED pgs=2540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 -- 172.21.15.82:0/3486667728 >> 172.21.15.82:0/3486667728 conn(0x7f168c0cada0 msgr2=0x7f168c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 -- 172.21.15.82:0/3486667728 shutdown_connections 2023-07-20T11:25:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.395+0000 7f16920cb640 1 -- 172.21.15.82:0/3486667728 wait complete. 2023-07-20T11:25:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 Processor -- start 2023-07-20T11:25:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 -- start start 2023-07-20T11:25:01.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168c0b2380 0x7f168c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.392 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168c0cc900 0x7f168c0c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c154e20 con 0x7f168c1596b0 2023-07-20T11:25:01.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c154020 con 0x7f168c0b2380 2023-07-20T11:25:01.393 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f16920cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0c6950 con 0x7f168c0cc900 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59618/0 (socket says 172.21.15.82:59618) 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 -- 172.21.15.82:0/1531643798 learned_addr learned my addr 172.21.15.82:0/1531643798 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168b7fe640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168c0b2380 0x7f168c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f1682ffd640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168c0cc900 0x7f168c0c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 -- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168c0cc900 msgr2=0x7f168c0c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.394 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168c0cc900 0x7f168c0c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 -- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168c0b2380 msgr2=0x7f168c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168c0b2380 0x7f168c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 -- 172.21.15.82:0/1531643798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740094d0 con 0x7f168c1596b0 2023-07-20T11:25:01.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f168bfff640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f168400c780 tx=0x7f168400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.395 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.399+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684004b70 con 0x7f168c1596b0 2023-07-20T11:25:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400ce90 con 0x7f168c1596b0 2023-07-20T11:25:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c1550c0 con 0x7f168c1596b0 2023-07-20T11:25:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400a850 con 0x7f168c1596b0 2023-07-20T11:25:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c153b00 con 0x7f168c1596b0 2023-07-20T11:25:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c1555e0 con 0x7f168c1596b0 2023-07-20T11:25:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f168400a9b0 con 0x7f168c1596b0 2023-07-20T11:25:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f1688ff9640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 0x7f166c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f16840840c0 con 0x7f168c1596b0 2023-07-20T11:25:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f168b7fe640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 0x7f166c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.398 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.403+0000 7f168b7fe640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 0x7f166c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16740ae000 tx=0x7f16740b5040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.407+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1684054d90 con 0x7f168c1596b0 2023-07-20T11:25:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.555+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f168c0b2c20 con 0x7f166c0663a0 2023-07-20T11:25:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.555+0000 7f1688ff9640 1 -- 172.21.15.82:0/1531643798 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f16740aa570 con 0x7f166c0663a0 2023-07-20T11:25:01.548 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 2 to deep-scrub 2023-07-20T11:25:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 msgr2=0x7f166c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 0x7f166c068860 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f16740ae000 tx=0x7f16740b5040 comp rx=0 tx=0).stop 2023-07-20T11:25:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 msgr2=0x7f168c0c6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.550 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 secure :-1 s=READY pgs=2541 cs=0 l=1 rev1=1 crypto rx=0x7f168400c780 tx=0x7f168400cc40 comp rx=0 tx=0).stop 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 shutdown_connections 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f166c0663a0 0x7f166c068860 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f168c1596b0 0x7f168c0c6340 unknown :-1 s=CLOSED pgs=2541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f168c0cc900 0x7f168c0c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 --2- 172.21.15.82:0/1531643798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f168c0b2380 0x7f168c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 >> 172.21.15.82:0/1531643798 conn(0x7f168c0cada0 msgr2=0x7f168c06c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.551 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 shutdown_connections 2023-07-20T11:25:01.552 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.559+0000 7f16920cb640 1 -- 172.21.15.82:0/1531643798 wait complete. 2023-07-20T11:25:01.569 INFO:tasks.ceph:Scrubbing osd.3 2023-07-20T11:25:01.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:01.714 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 Processor -- start 2023-07-20T11:25:01.715 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 -- start start 2023-07-20T11:25:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 0x7f8534165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f853406b2b0 0x7f853406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853406a860 con 0x7f85340c3950 2023-07-20T11:25:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853406bc40 con 0x7f853406b2b0 2023-07-20T11:25:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f853a461640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85340ce4d0 con 0x7f85340ce040 2023-07-20T11:25:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f853406b2b0 0x7f853406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f853406b2b0 0x7f853406b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59624/0 (socket says 172.21.15.82:59624) 2023-07-20T11:25:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 -- 172.21.15.82:0/1234860130 learned_addr learned my addr 172.21.15.82:0/1234860130 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 -- 172.21.15.82:0/1234860130 >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 msgr2=0x7f8534165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85337fe640 1 --2- 172.21.15.82:0/1234860130 >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 0x7f8534165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 --2- 172.21.15.82:0/1234860130 >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 0x7f8534165190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 -- 172.21.15.82:0/1234860130 >> v1:172.21.15.183:6789/0 conn(0x7f85340c3950 legacy=0x7f85340caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85389fe640 1 -- 172.21.15.82:0/1234860130 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340ce740 con 0x7f853406b2b0 2023-07-20T11:25:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.723+0000 7f85337fe640 1 --2- 172.21.15.82:0/1234860130 >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 0x7f8534165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:25:01.719 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f85389fe640 1 --2- 172.21.15.82:0/1234860130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853406b2b0 0x7f853406b700 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7f8534066990 tx=0x7f852c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca040a88f692864f server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f8532ffd640 1 -- 172.21.15.82:0/1234860130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c0a5740 con 0x7f853406b2b0 2023-07-20T11:25:01.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f8532ffd640 1 -- 172.21.15.82:0/1234860130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c0a58a0 con 0x7f853406b2b0 2023-07-20T11:25:01.720 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f8532ffd640 1 -- 172.21.15.82:0/1234860130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c0a5c30 con 0x7f853406b2b0 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 -- 172.21.15.82:0/1234860130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853406b2b0 msgr2=0x7f853406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 --2- 172.21.15.82:0/1234860130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853406b2b0 0x7f853406b700 secure :-1 s=READY pgs=2542 cs=0 l=1 rev1=1 crypto rx=0x7f8534066990 tx=0x7f852c01c990 comp rx=0 tx=0).stop 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 -- 172.21.15.82:0/1234860130 shutdown_connections 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 --2- 172.21.15.82:0/1234860130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f853406b2b0 0x7f853406b700 unknown :-1 s=CLOSED pgs=2542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 --2- 172.21.15.82:0/1234860130 >> v2:172.21.15.183:3300/0 conn(0x7f85340ce040 0x7f8534165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 -- 172.21.15.82:0/1234860130 >> 172.21.15.82:0/1234860130 conn(0x7f853406da00 msgr2=0x7f853406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 -- 172.21.15.82:0/1234860130 shutdown_connections 2023-07-20T11:25:01.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.727+0000 7f853a461640 1 -- 172.21.15.82:0/1234860130 wait complete. 2023-07-20T11:25:01.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 Processor -- start 2023-07-20T11:25:01.722 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- start start 2023-07-20T11:25:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853406b2b0 0x7f853415e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85340c3950 0x7f85341587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 0x7f8534162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534159880 con 0x7f85340ce040 2023-07-20T11:25:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85340c4d90 con 0x7f853406b2b0 2023-07-20T11:25:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8534159230 con 0x7f85340c3950 2023-07-20T11:25:01.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 0x7f8534162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 0x7f8534162160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59634/0 (socket says 172.21.15.82:59634) 2023-07-20T11:25:01.725 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 -- 172.21.15.82:0/1227461779 learned_addr learned my addr 172.21.15.82:0/1227461779 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f8533fff640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853406b2b0 0x7f853415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85337fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85340c3950 0x7f85341587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 -- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85340c3950 msgr2=0x7f85341587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85340c3950 0x7f85341587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 -- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853406b2b0 msgr2=0x7f853415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f853406b2b0 0x7f853415e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c009b30 con 0x7f85340ce040 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85337fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f85340c3950 0x7f85341587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f85389fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 0x7f8534162160 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f852c01a5c0 tx=0x7f852c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c0b8670 con 0x7f85340ce040 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c0b87f0 con 0x7f85340ce040 2023-07-20T11:25:01.727 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c0b8ba0 con 0x7f85340ce040 2023-07-20T11:25:01.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8534159510 con 0x7f85340ce040 2023-07-20T11:25:01.728 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.731+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8534158d00 con 0x7f85340ce040 2023-07-20T11:25:01.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85340c3d30 con 0x7f85340ce040 2023-07-20T11:25:01.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f852c0b8d00 con 0x7f85340ce040 2023-07-20T11:25:01.729 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f85200663a0 0x7f8520068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f852c11f940 con 0x7f85340ce040 2023-07-20T11:25:01.730 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8533fff640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f85200663a0 0x7f8520068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f852006ce40 0x7f852006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f852006f930 con 0x7f852006ce40 2023-07-20T11:25:01.731 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f852c11fcb0 con 0x7f85340ce040 2023-07-20T11:25:01.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f85337fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f852006ce40 0x7f852006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8533fff640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f85200663a0 0x7f8520068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85340b55c0 tx=0x7f8524007e40 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.732 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f85337fe640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f852006ce40 0x7f852006f260 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.733 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.735+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== osd.3 v2:172.21.15.82:6800/2403361967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f852006f930 con 0x7f852006ce40 2023-07-20T11:25:01.741 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 --> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f85340c4a60 con 0x7f852006ce40 2023-07-20T11:25:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f8530ff9640 1 -- 172.21.15.82:0/1227461779 <== osd.3 v2:172.21.15.82:6800/2403361967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f85340c4a60 con 0x7f852006ce40 2023-07-20T11:25:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:01.742 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:01.742 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:01.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f852006ce40 msgr2=0x7f852006f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6800/2403361967,v1:172.21.15.82:6801/2403361967] conn(0x7f852006ce40 0x7f852006f260 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.743 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f85200663a0 msgr2=0x7f8520068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f85200663a0 0x7f8520068860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85340b55c0 tx=0x7f8524007e40 comp rx=0 tx=0).stop 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 msgr2=0x7f8534162160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 --2- 172.21.15.82:0/1227461779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85340ce040 0x7f8534162160 secure :-1 s=READY pgs=2543 cs=0 l=1 rev1=1 crypto rx=0x7f852c01a5c0 tx=0x7f852c019730 comp rx=0 tx=0).stop 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f85389fe640 1 -- 172.21.15.82:0/1227461779 reap_dead start 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 shutdown_connections 2023-07-20T11:25:01.744 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 >> 172.21.15.82:0/1227461779 conn(0x7f853406da00 msgr2=0x7f85341638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 shutdown_connections 2023-07-20T11:25:01.745 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.751+0000 7f853a461640 1 -- 172.21.15.82:0/1227461779 wait complete. 2023-07-20T11:25:01.761 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-20T11:25:01.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 Processor -- start 2023-07-20T11:25:01.904 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 -- start start 2023-07-20T11:25:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f836c0b2a90 0x7f836c15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.906 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c0cc900 0x7f836c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0ccd90 con 0x7f836c1596b0 2023-07-20T11:25:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0ad600 con 0x7f836c0b2a90 2023-07-20T11:25:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837306d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0ad810 con 0x7f836c0cc900 2023-07-20T11:25:01.907 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f8363fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f836c0b2a90 0x7f836c15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f8363fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f836c0b2a90 0x7f836c15dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59644/0 (socket says 172.21.15.82:59644) 2023-07-20T11:25:01.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f8363fff640 1 -- 172.21.15.82:0/2922351832 learned_addr learned my addr 172.21.15.82:0/2922351832 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.908 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.911+0000 7f837160a640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c0cc900 0x7f836c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f8363fff640 1 -- 172.21.15.82:0/2922351832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c0cc900 msgr2=0x7f836c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f8363fff640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c0cc900 0x7f836c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f8363fff640 1 -- 172.21.15.82:0/2922351832 >> v1:172.21.15.183:6789/0 conn(0x7f836c1596b0 legacy=0x7f836c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.909 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f8363fff640 1 -- 172.21.15.82:0/2922351832 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c15d0d0 con 0x7f836c0b2a90 2023-07-20T11:25:01.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f8363fff640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c15dbb0 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f835c0098a0 tx=0x7f835c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84e8d1158e733be server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.911 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f83637fe640 1 -- 172.21.15.82:0/2922351832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0aa650 con 0x7f836c0b2a90 2023-07-20T11:25:01.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f83637fe640 1 -- 172.21.15.82:0/2922351832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0aa7b0 con 0x7f836c0b2a90 2023-07-20T11:25:01.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f83637fe640 1 -- 172.21.15.82:0/2922351832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c0aab40 con 0x7f836c0b2a90 2023-07-20T11:25:01.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f837306d640 1 -- 172.21.15.82:0/2922351832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 msgr2=0x7f836c15dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.912 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.915+0000 7f837306d640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c15dbb0 secure :-1 s=READY pgs=2544 cs=0 l=1 rev1=1 crypto rx=0x7f835c0098a0 tx=0x7f835c01c4f0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- 172.21.15.82:0/2922351832 shutdown_connections 2023-07-20T11:25:01.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c0cc900 0x7f836c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 --2- 172.21.15.82:0/2922351832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c15dbb0 unknown :-1 s=CLOSED pgs=2544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.913 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- 172.21.15.82:0/2922351832 >> 172.21.15.82:0/2922351832 conn(0x7f836c0cada0 msgr2=0x7f836c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- 172.21.15.82:0/2922351832 shutdown_connections 2023-07-20T11:25:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- 172.21.15.82:0/2922351832 wait complete. 2023-07-20T11:25:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 Processor -- start 2023-07-20T11:25:01.914 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- start start 2023-07-20T11:25:01.917 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836c0cc900 0x7f836c163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 0x7f836c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c15c0c0 con 0x7f836c0b2a90 2023-07-20T11:25:01.918 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c23d0 con 0x7f836c0cc900 2023-07-20T11:25:01.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837306d640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0c20a0 con 0x7f836c1596b0 2023-07-20T11:25:01.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59648/0 (socket says 172.21.15.82:59648) 2023-07-20T11:25:01.919 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 -- 172.21.15.82:0/903214554 learned_addr learned my addr 172.21.15.82:0/903214554 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8363fff640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836c0cc900 0x7f836c163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837160a640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 0x7f836c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 -- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 msgr2=0x7f836c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 0x7f836c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.920 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 -- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836c0cc900 msgr2=0x7f836c163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836c0cc900 0x7f836c163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 -- 172.21.15.82:0/903214554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0094d0 con 0x7f836c0b2a90 2023-07-20T11:25:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f837160a640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 0x7f836c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:01.921 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.919+0000 7f8370e09640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f836800c3c0 tx=0x7f836800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680052d0 con 0x7f836c0b2a90 2023-07-20T11:25:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368005430 con 0x7f836c0b2a90 2023-07-20T11:25:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003840 con 0x7f836c0b2a90 2023-07-20T11:25:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c15c310 con 0x7f836c0b2a90 2023-07-20T11:25:01.922 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c15c8d0 con 0x7f836c0b2a90 2023-07-20T11:25:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c073c70 con 0x7f836c0b2a90 2023-07-20T11:25:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f83680039a0 con 0x7f836c0b2a90 2023-07-20T11:25:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 0x7f8358068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:01.923 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f8368083310 con 0x7f836c0b2a90 2023-07-20T11:25:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.923+0000 7f8363fff640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 0x7f8358068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.927+0000 7f8363fff640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 0x7f8358068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ae000 tx=0x7f835c0b5040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:01.924 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:01.927+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8368050720 con 0x7f836c0b2a90 2023-07-20T11:25:02.070 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f836c0adaf0 con 0x7f83580663a0 2023-07-20T11:25:02.071 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f83617fa640 1 -- 172.21.15.82:0/903214554 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f835c0aa920 con 0x7f83580663a0 2023-07-20T11:25:02.071 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 3 to deep-scrub 2023-07-20T11:25:02.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 msgr2=0x7f8358068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 0x7f8358068860 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f835c0ae000 tx=0x7f835c0b5040 comp rx=0 tx=0).stop 2023-07-20T11:25:02.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 msgr2=0x7f836c159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 secure :-1 s=READY pgs=2545 cs=0 l=1 rev1=1 crypto rx=0x7f836800c3c0 tx=0x7f836800c880 comp rx=0 tx=0).stop 2023-07-20T11:25:02.073 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 shutdown_connections 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f83580663a0 0x7f8358068860 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f836c1596b0 0x7f836c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f836c0cc900 0x7f836c163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 --2- 172.21.15.82:0/903214554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f836c0b2a90 0x7f836c159a90 unknown :-1 s=CLOSED pgs=2545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 >> 172.21.15.82:0/903214554 conn(0x7f836c0cada0 msgr2=0x7f836c162d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 shutdown_connections 2023-07-20T11:25:02.074 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.079+0000 7f837306d640 1 -- 172.21.15.82:0/903214554 wait complete. 2023-07-20T11:25:02.092 INFO:tasks.ceph:Scrubbing osd.4 2023-07-20T11:25:02.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:02.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 Processor -- start 2023-07-20T11:25:02.235 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 -- start start 2023-07-20T11:25:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f3ca4159450 0x7f3ca415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4159830 0x7f3ca40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca40cc8d0 con 0x7f3ca40cc3e0 2023-07-20T11:25:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40cce90 con 0x7f3ca4159450 2023-07-20T11:25:02.236 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3caa937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40ccbb0 con 0x7f3ca4159830 2023-07-20T11:25:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca8ed4640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f3ca40cc3e0 0x7f3ca40afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:57798/0 (socket says 172.21.15.82:57798) 2023-07-20T11:25:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca8ed4640 1 -- 172.21.15.82:0/712732477 learned_addr learned my addr 172.21.15.82:0/712732477 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:02.237 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/712732477 >> v2:172.21.15.183:3300/0 conn(0x7f3ca4159450 0x7f3ca415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca37fe640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4159830 0x7f3ca40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570170018 0 0) 0x7f3ca40cc8d0 con 0x7f3ca40cc3e0 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c8c003530 con 0x7f3ca40cc3e0 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca3fff640 1 -- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4159830 msgr2=0x7f3ca40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4159830 0x7f3ca40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca3fff640 1 -- 172.21.15.82:0/712732477 >> v1:172.21.15.82:6789/0 conn(0x7f3ca40cc3e0 legacy=0x7f3ca40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.238 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646261145 0 0) 0x7f3c8c003530 con 0x7f3ca40cc3e0 2023-07-20T11:25:02.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.243+0000 7f3ca3fff640 1 -- 172.21.15.82:0/712732477 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4159cc0 con 0x7f3ca4159450 2023-07-20T11:25:02.239 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca4159450 0x7f3ca415a4c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097c0 tx=0x7f3c9401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3961a0c20b7c7c3c server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a7070 con 0x7f3ca4159450 2023-07-20T11:25:02.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940ab430 con 0x7f3ca4159450 2023-07-20T11:25:02.240 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3ca2ffd640 1 -- 172.21.15.82:0/712732477 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940ab7c0 con 0x7f3ca4159450 2023-07-20T11:25:02.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 -- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca4159450 msgr2=0x7f3ca415a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.241 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca4159450 0x7f3ca415a4c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097c0 tx=0x7f3c9401c450 comp rx=0 tx=0).stop 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 -- 172.21.15.82:0/712732477 shutdown_connections 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca4159830 0x7f3ca40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 --2- 172.21.15.82:0/712732477 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca4159450 0x7f3ca415a4c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 -- 172.21.15.82:0/712732477 >> 172.21.15.82:0/712732477 conn(0x7f3ca40cad50 msgr2=0x7f3ca40cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 -- 172.21.15.82:0/712732477 shutdown_connections 2023-07-20T11:25:02.242 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.247+0000 7f3caa937640 1 -- 172.21.15.82:0/712732477 wait complete. 2023-07-20T11:25:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 Processor -- start 2023-07-20T11:25:02.243 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 -- start start 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40cc3e0 0x7f3ca40ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 0x7f3ca40adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca40ae480 0x7f3ca4157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40ac890 con 0x7f3ca4159450 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40ae900 con 0x7f3ca40cc3e0 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3caa937640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41f5060 con 0x7f3ca40ae480 2023-07-20T11:25:02.245 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 0x7f3ca40adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 0x7f3ca40adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59652/0 (socket says 172.21.15.82:59652) 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 -- 172.21.15.82:0/261995604 learned_addr learned my addr 172.21.15.82:0/261995604 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca8ed4640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca40ae480 0x7f3ca4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40cc3e0 0x7f3ca40ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 -- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca40ae480 msgr2=0x7f3ca4157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f3ca40ae480 0x7f3ca4157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.246 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 -- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40cc3e0 msgr2=0x7f3ca40ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40cc3e0 0x7f3ca40ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009420 con 0x7f3ca4159450 2023-07-20T11:25:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3ca40cc3e0 0x7f3ca40ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:02.247 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca37fe640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 0x7f3ca40adf40 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800e8a0 tx=0x7f3c9800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98009510 con 0x7f3ca4159450 2023-07-20T11:25:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9800c940 con 0x7f3ca4159450 2023-07-20T11:25:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.251+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800ccb0 con 0x7f3ca4159450 2023-07-20T11:25:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca40ab890 con 0x7f3ca4159450 2023-07-20T11:25:02.248 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40aee00 con 0x7f3ca4159450 2023-07-20T11:25:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ca40af020 con 0x7f3ca4159450 2023-07-20T11:25:02.249 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c98026480 con 0x7f3ca4159450 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f3c900663a0 0x7f3c90068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f3c98084760 con 0x7f3ca4159450 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f3c900663a0 0x7f3c90068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f3c9006ce40 0x7f3c9006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c9006f930 con 0x7f3c9006ce40 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c98084ad0 con 0x7f3ca4159450 2023-07-20T11:25:02.250 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca8ed4640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f3c9006ce40 0x7f3c9006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.255+0000 7f3ca3fff640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f3c900663a0 0x7f3c90068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c940af000 tx=0x7f3c94008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.259+0000 7f3ca8ed4640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f3c9006ce40 0x7f3c9006f260 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.251 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.259+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== osd.4 v2:172.21.15.183:6824/683958145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3c9006f930 con 0x7f3c9006ce40 2023-07-20T11:25:02.262 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 --> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3ca40b0460 con 0x7f3c9006ce40 2023-07-20T11:25:02.263 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3ca0ff9640 1 -- 172.21.15.82:0/261995604 <== osd.4 v2:172.21.15.183:6824/683958145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3c9c001f00 con 0x7f3c9006ce40 2023-07-20T11:25:02.263 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:02.264 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:02.264 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f3c9006ce40 msgr2=0x7f3c9006f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.183:6824/683958145,v1:172.21.15.183:6825/683958145] conn(0x7f3c9006ce40 0x7f3c9006f260 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f3c900663a0 msgr2=0x7f3c90068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f3c900663a0 0x7f3c90068860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3c940af000 tx=0x7f3c94008040 comp rx=0 tx=0).stop 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 msgr2=0x7f3ca40adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 --2- 172.21.15.82:0/261995604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca4159450 0x7f3ca40adf40 secure :-1 s=READY pgs=2547 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800e8a0 tx=0x7f3c9800eca0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.265 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3ca8ed4640 1 -- 172.21.15.82:0/261995604 reap_dead start 2023-07-20T11:25:02.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 shutdown_connections 2023-07-20T11:25:02.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 >> 172.21.15.82:0/261995604 conn(0x7f3ca40cad50 msgr2=0x7f3ca4156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 shutdown_connections 2023-07-20T11:25:02.266 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.271+0000 7f3caa937640 1 -- 172.21.15.82:0/261995604 wait complete. 2023-07-20T11:25:02.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-20T11:25:02.422 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 Processor -- start 2023-07-20T11:25:02.423 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 -- start start 2023-07-20T11:25:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7febd806c8b0 0x7febd8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd815e130 con 0x7febd80b3860 2023-07-20T11:25:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd815e410 con 0x7febd806c8b0 2023-07-20T11:25:02.424 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febde3d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd815e6f0 con 0x7febd806be30 2023-07-20T11:25:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:40434/0 (socket says 172.21.15.82:40434) 2023-07-20T11:25:02.425 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 -- 172.21.15.82:0/2702313148 learned_addr learned my addr 172.21.15.82:0/2702313148 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febddbd1640 1 --2- 172.21.15.82:0/2702313148 >> v2:172.21.15.183:3300/0 conn(0x7febd806c8b0 0x7febd8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 -- 172.21.15.82:0/2702313148 >> v2:172.21.15.183:3300/0 conn(0x7febd806c8b0 msgr2=0x7febd8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 --2- 172.21.15.82:0/2702313148 >> v2:172.21.15.183:3300/0 conn(0x7febd806c8b0 0x7febd8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 -- 172.21.15.82:0/2702313148 >> v1:172.21.15.183:6789/0 conn(0x7febd80b3860 legacy=0x7febd806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febcffff640 1 -- 172.21.15.82:0/2702313148 <== mon.1 v1:172.21.15.183:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741563670 0 0) 0x7febd815e130 con 0x7febd80b3860 2023-07-20T11:25:02.426 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.431+0000 7febdcbcf640 1 -- 172.21.15.82:0/2702313148 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd815e9d0 con 0x7febd806be30 2023-07-20T11:25:02.427 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febdcbcf640 1 --2- 172.21.15.82:0/2702313148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7febc8009870 tx=0x7febc801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d794e507824243e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febcffff640 1 -- 172.21.15.82:0/2702313148 <== mon.2 v2:172.21.15.183:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80a6040 con 0x7febd806be30 2023-07-20T11:25:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febcffff640 1 -- 172.21.15.82:0/2702313148 <== mon.2 v2:172.21.15.183:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80aa600 con 0x7febd806be30 2023-07-20T11:25:02.428 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febcffff640 1 -- 172.21.15.82:0/2702313148 <== mon.2 v2:172.21.15.183:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80aa990 con 0x7febd806be30 2023-07-20T11:25:02.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 -- 172.21.15.82:0/2702313148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 msgr2=0x7febd80715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 --2- 172.21.15.82:0/2702313148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7febc8009870 tx=0x7febc801c480 comp rx=0 tx=0).stop 2023-07-20T11:25:02.429 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 -- 172.21.15.82:0/2702313148 shutdown_connections 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 --2- 172.21.15.82:0/2702313148 >> v2:172.21.15.183:3300/0 conn(0x7febd806c8b0 0x7febd8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 --2- 172.21.15.82:0/2702313148 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806be30 0x7febd80715a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 -- 172.21.15.82:0/2702313148 >> 172.21.15.82:0/2702313148 conn(0x7febd80ce080 msgr2=0x7febd80ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 -- 172.21.15.82:0/2702313148 shutdown_connections 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.435+0000 7febde3d2640 1 -- 172.21.15.82:0/2702313148 wait complete. 2023-07-20T11:25:02.430 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 Processor -- start 2023-07-20T11:25:02.431 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- start start 2023-07-20T11:25:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806c8b0 0x7febd80b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febd80b3860 0x7febd80b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81528a0 con 0x7febd806be30 2023-07-20T11:25:02.432 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81476d0 con 0x7febd80b3860 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd8151f00 con 0x7febd806c8b0 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59666/0 (socket says 172.21.15.82:59666) 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 -- 172.21.15.82:0/714645152 learned_addr learned my addr 172.21.15.82:0/714645152 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdcbcf640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806c8b0 0x7febd80b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.433 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febddbd1640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febd80b3860 0x7febd80b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 -- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806c8b0 msgr2=0x7febd80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806c8b0 0x7febd80b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.434 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 -- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febd80b3860 msgr2=0x7febd80b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febd80b3860 0x7febd80b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 -- 172.21.15.82:0/714645152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80094d0 con 0x7febd806be30 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febdd3d0640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7febd4001ec0 tx=0x7febd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40054e0 con 0x7febd806be30 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4003600 con 0x7febd806be30 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd81521e0 con 0x7febd806be30 2023-07-20T11:25:02.435 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40039b0 con 0x7febd806be30 2023-07-20T11:25:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.439+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd81652c0 con 0x7febd806be30 2023-07-20T11:25:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd804da30 con 0x7febd806be30 2023-07-20T11:25:02.436 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7febd4003b10 con 0x7febd806be30 2023-07-20T11:25:02.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febcdffb640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 0x7febbc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7febd4083340 con 0x7febd806be30 2023-07-20T11:25:02.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febdcbcf640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 0x7febbc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.437 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.443+0000 7febdcbcf640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 0x7febbc068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7febc80ae000 tx=0x7febc80b5040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.439 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.447+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febd40507d0 con 0x7febd806be30 2023-07-20T11:25:02.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7febd8152070 con 0x7febbc0663a0 2023-07-20T11:25:02.591 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febcdffb640 1 -- 172.21.15.82:0/714645152 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febd8152070 con 0x7febbc0663a0 2023-07-20T11:25:02.591 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 4 to deep-scrub 2023-07-20T11:25:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 msgr2=0x7febbc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 0x7febbc068860 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7febc80ae000 tx=0x7febc80b5040 comp rx=0 tx=0).stop 2023-07-20T11:25:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 msgr2=0x7febd8147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.593 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 secure :-1 s=READY pgs=2548 cs=0 l=1 rev1=1 crypto rx=0x7febd4001ec0 tx=0x7febd400c8e0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 shutdown_connections 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7febbc0663a0 0x7febbc068860 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7febd80b3860 0x7febd80b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7febd806c8b0 0x7febd80b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 --2- 172.21.15.82:0/714645152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7febd806be30 0x7febd8147190 unknown :-1 s=CLOSED pgs=2548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 >> 172.21.15.82:0/714645152 conn(0x7febd80ce080 msgr2=0x7febd81514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.594 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 shutdown_connections 2023-07-20T11:25:02.595 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.599+0000 7febde3d2640 1 -- 172.21.15.82:0/714645152 wait complete. 2023-07-20T11:25:02.612 INFO:tasks.ceph:Scrubbing osd.5 2023-07-20T11:25:02.612 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:02.754 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 Processor -- start 2023-07-20T11:25:02.755 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 -- start start 2023-07-20T11:25:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 0x7f4c6815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c68159830 0x7f4c680cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c680cc8d0 con 0x7f4c680cc3e0 2023-07-20T11:25:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680cce90 con 0x7f4c68159830 2023-07-20T11:25:02.756 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6eccb640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680ccbb0 con 0x7f4c68159450 2023-07-20T11:25:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c68159830 0x7f4c680cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f4c68159830 0x7f4c680cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59678/0 (socket says 172.21.15.82:59678) 2023-07-20T11:25:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 -- 172.21.15.82:0/318852262 learned_addr learned my addr 172.21.15.82:0/318852262 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.757 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6ca67640 1 --2- 172.21.15.82:0/318852262 >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 0x7f4c6815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 -- 172.21.15.82:0/318852262 >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 msgr2=0x7f4c6815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:02.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 --2- 172.21.15.82:0/318852262 >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 0x7f4c6815a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 -- 172.21.15.82:0/318852262 >> v1:172.21.15.183:6789/0 conn(0x7f4c680cc3e0 legacy=0x7f4c680afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:02.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c5ffff640 1 -- 172.21.15.82:0/318852262 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68159cc0 con 0x7f4c68159830 2023-07-20T11:25:02.758 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.763+0000 7f4c6ca67640 1 --2- 172.21.15.82:0/318852262 >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 0x7f4c6815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:25:02.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c5ffff640 1 --2- 172.21.15.82:0/318852262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c68159830 0x7f4c680cbea0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806a6c0 tx=0x7f4c5801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df45da1348f22c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.759 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c5f7fe640 1 -- 172.21.15.82:0/318852262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580ab670 con 0x7f4c68159830 2023-07-20T11:25:02.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c5f7fe640 1 -- 172.21.15.82:0/318852262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c580ab7d0 con 0x7f4c68159830 2023-07-20T11:25:02.760 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c5f7fe640 1 -- 172.21.15.82:0/318852262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c580abb60 con 0x7f4c68159830 2023-07-20T11:25:02.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 -- 172.21.15.82:0/318852262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c68159830 msgr2=0x7f4c680cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/318852262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c68159830 0x7f4c680cbea0 secure :-1 s=READY pgs=2549 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806a6c0 tx=0x7f4c5801c490 comp rx=0 tx=0).stop 2023-07-20T11:25:02.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 -- 172.21.15.82:0/318852262 shutdown_connections 2023-07-20T11:25:02.761 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/318852262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c68159830 0x7f4c680cbea0 unknown :-1 s=CLOSED pgs=2549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/318852262 >> v2:172.21.15.183:3300/0 conn(0x7f4c68159450 0x7f4c6815a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 -- 172.21.15.82:0/318852262 >> 172.21.15.82:0/318852262 conn(0x7f4c680cad50 msgr2=0x7f4c680cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 -- 172.21.15.82:0/318852262 shutdown_connections 2023-07-20T11:25:02.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.767+0000 7f4c6eccb640 1 -- 172.21.15.82:0/318852262 wait complete. 2023-07-20T11:25:02.762 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 Processor -- start 2023-07-20T11:25:02.763 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- start start 2023-07-20T11:25:02.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c680cc3e0 0x7f4c680c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c68159450 0x7f4c681543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 0x7f4c68154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c5cb0 con 0x7f4c680c9010 2023-07-20T11:25:02.764 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c5f00 con 0x7f4c68159450 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c61e0 con 0x7f4c680cc3e0 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 0x7f4c68154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 0x7f4c68154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59694/0 (socket says 172.21.15.82:59694) 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 -- 172.21.15.82:0/870847200 learned_addr learned my addr 172.21.15.82:0/870847200 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6ca67640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c680cc3e0 0x7f4c680c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.765 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c5ffff640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c68159450 0x7f4c681543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 -- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c680cc3e0 msgr2=0x7f4c680c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f4c680cc3e0 0x7f4c680c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 -- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c68159450 msgr2=0x7f4c681543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4c68159450 0x7f4c681543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.766 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580094d0 con 0x7f4c680c9010 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6d268640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 0x7f4c68154900 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c780 tx=0x7f4c6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000a9f0 con 0x7f4c680c9010 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000ce90 con 0x7f4c680c9010 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c680c64c0 con 0x7f4c680c9010 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000add0 con 0x7f4c680c9010 2023-07-20T11:25:02.768 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.771+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c68157a40 con 0x7f4c680c9010 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4c680b0460 con 0x7f4c680c9010 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4c60012420 con 0x7f4c680c9010 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f4c540663a0 0x7f4c54068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f4c60083e00 con 0x7f4c680c9010 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c6ca67640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f4c540663a0 0x7f4c54068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f4c5406ce40 0x7f4c5406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.769 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4c5406f930 con 0x7f4c5406ce40 2023-07-20T11:25:02.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c600863e0 con 0x7f4c680c9010 2023-07-20T11:25:02.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c6ca67640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f4c540663a0 0x7f4c54068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a9a0 tx=0x7f4c64008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.770 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5ffff640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f4c5406ce40 0x7f4c5406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.775+0000 7f4c5ffff640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f4c5406ce40 0x7f4c5406f260 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.771 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.779+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== osd.5 v2:172.21.15.183:6808/454263273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4c5406f930 con 0x7f4c5406ce40 2023-07-20T11:25:02.782 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 --> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4c6804da30 con 0x7f4c5406ce40 2023-07-20T11:25:02.783 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c5d7fa640 1 -- 172.21.15.82:0/870847200 <== osd.5 v2:172.21.15.183:6808/454263273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4c6804da30 con 0x7f4c5406ce40 2023-07-20T11:25:02.783 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:02.783 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:02.783 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:02.784 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f4c5406ce40 msgr2=0x7f4c5406f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.183:6808/454263273,v1:172.21.15.183:6810/454263273] conn(0x7f4c5406ce40 0x7f4c5406f260 crc :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f4c540663a0 msgr2=0x7f4c54068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f4c540663a0 0x7f4c54068860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a9a0 tx=0x7f4c64008040 comp rx=0 tx=0).stop 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 msgr2=0x7f4c68154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 --2- 172.21.15.82:0/870847200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c680c9010 0x7f4c68154900 secure :-1 s=READY pgs=2550 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c780 tx=0x7f4c6000cc40 comp rx=0 tx=0).stop 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6d268640 1 -- 172.21.15.82:0/870847200 reap_dead start 2023-07-20T11:25:02.785 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 shutdown_connections 2023-07-20T11:25:02.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 >> 172.21.15.82:0/870847200 conn(0x7f4c680cad50 msgr2=0x7f4c680711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 shutdown_connections 2023-07-20T11:25:02.786 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.791+0000 7f4c6eccb640 1 -- 172.21.15.82:0/870847200 wait complete. 2023-07-20T11:25:02.801 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-20T11:25:02.942 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 Processor -- start 2023-07-20T11:25:02.943 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 -- start start 2023-07-20T11:25:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17c815c5e0 0x7f17c80adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c80ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80ab890 con 0x7f17c80cd080 2023-07-20T11:25:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80cd4f0 con 0x7f17c815c5e0 2023-07-20T11:25:02.944 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17ce903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8069ac0 con 0x7f17c80c91f0 2023-07-20T11:25:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17c815c5e0 0x7f17c80adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f17c815c5e0 0x7f17c80adcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59700/0 (socket says 172.21.15.82:59700) 2023-07-20T11:25:02.945 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 -- 172.21.15.82:0/3184327849 learned_addr learned my addr 172.21.15.82:0/3184327849 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17bffff640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c80ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 -- 172.21.15.82:0/3184327849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 msgr2=0x7f17c80ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c80ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 -- 172.21.15.82:0/3184327849 >> v1:172.21.15.183:6789/0 conn(0x7f17c80cd080 legacy=0x7f17c8160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.946 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.951+0000 7f17c7fff640 1 -- 172.21.15.82:0/3184327849 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80ce2d0 con 0x7f17c815c5e0 2023-07-20T11:25:02.947 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17c7fff640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c815c5e0 0x7f17c80adcf0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ad484e4819732a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17c77fe640 1 -- 172.21.15.82:0/3184327849 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80a7070 con 0x7f17c815c5e0 2023-07-20T11:25:02.948 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17c77fe640 1 -- 172.21.15.82:0/3184327849 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80ab430 con 0x7f17c815c5e0 2023-07-20T11:25:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17c77fe640 1 -- 172.21.15.82:0/3184327849 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80ab7c0 con 0x7f17c815c5e0 2023-07-20T11:25:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 -- 172.21.15.82:0/3184327849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c815c5e0 msgr2=0x7f17c80adcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c815c5e0 0x7f17c80adcf0 secure :-1 s=READY pgs=2551 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009870 tx=0x7f17b801c510 comp rx=0 tx=0).stop 2023-07-20T11:25:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 -- 172.21.15.82:0/3184327849 shutdown_connections 2023-07-20T11:25:02.949 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c80ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 --2- 172.21.15.82:0/3184327849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c815c5e0 0x7f17c80adcf0 unknown :-1 s=CLOSED pgs=2551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 -- 172.21.15.82:0/3184327849 >> 172.21.15.82:0/3184327849 conn(0x7f17c80cb620 msgr2=0x7f17c80cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:02.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 -- 172.21.15.82:0/3184327849 shutdown_connections 2023-07-20T11:25:02.950 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.955+0000 7f17ce903640 1 -- 172.21.15.82:0/3184327849 wait complete. 2023-07-20T11:25:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 Processor -- start 2023-07-20T11:25:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- start start 2023-07-20T11:25:02.951 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c815d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.952 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 0x7f17c80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8146030 con 0x7f17c80cd080 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81485c0 con 0x7f17c815c5e0 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81f8550 con 0x7f17c80c91f0 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59704/0 (socket says 172.21.15.82:59704) 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 -- 172.21.15.82:0/2437085953 learned_addr learned my addr 172.21.15.82:0/2437085953 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:02.953 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17c7fff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.954 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ccea0640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 0x7f17c80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 -- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 msgr2=0x7f17c815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 -- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 msgr2=0x7f17c80afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 0x7f17c80afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 -- 172.21.15.82:0/2437085953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80094d0 con 0x7f17c80cd080 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ccea0640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 0x7f17c80afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:02.955 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17bffff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f17b000d5f0 tx=0x7f17b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00125f0 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0012750 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c81f8830 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0012ae0 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81f8df0 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.959+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c8073c70 con 0x7f17c80cd080 2023-07-20T11:25:02.956 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.963+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f17b0012c40 con 0x7f17c80cd080 2023-07-20T11:25:02.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.963+0000 7f17c57fa640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 0x7f17a8068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:02.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.963+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f17b00842a0 con 0x7f17c80cd080 2023-07-20T11:25:02.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.963+0000 7f17c7fff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 0x7f17a8068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:02.957 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.963+0000 7f17c7fff640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 0x7f17a8068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17b80af000 tx=0x7f17b8008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:02.967+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17b00515f0 con 0x7f17c80cd080 2023-07-20T11:25:03.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c80ae230 con 0x7f17a80663a0 2023-07-20T11:25:03.107 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17c57fa640 1 -- 172.21.15.82:0/2437085953 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f17b80bc090 con 0x7f17a80663a0 2023-07-20T11:25:03.107 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 5 to deep-scrub 2023-07-20T11:25:03.109 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 msgr2=0x7f17a8068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 0x7f17a8068860 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17b80af000 tx=0x7f17b8008040 comp rx=0 tx=0).stop 2023-07-20T11:25:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 msgr2=0x7f17c80af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 secure :-1 s=READY pgs=2552 cs=0 l=1 rev1=1 crypto rx=0x7f17b000d5f0 tx=0x7f17b000dab0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.110 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 shutdown_connections 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f17a80663a0 0x7f17a8068860 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17c815c5e0 0x7f17c80afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f17c80cd080 0x7f17c80af6a0 unknown :-1 s=CLOSED pgs=2552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 --2- 172.21.15.82:0/2437085953 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f17c80c91f0 0x7f17c815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 >> 172.21.15.82:0/2437085953 conn(0x7f17c80cb620 msgr2=0x7f17c806d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 shutdown_connections 2023-07-20T11:25:03.111 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.115+0000 7f17ce903640 1 -- 172.21.15.82:0/2437085953 wait complete. 2023-07-20T11:25:03.128 INFO:tasks.ceph:Scrubbing osd.6 2023-07-20T11:25:03.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:03.271 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 Processor -- start 2023-07-20T11:25:03.272 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 -- start start 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fcc9c0afd50 0x7fcc9c0b0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0b06b0 con 0x7fcc9c159450 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0cc8d0 con 0x7fcc9c159830 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcca09fa640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0cce90 con 0x7fcc9c0afd50 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcc9a59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fcc9c159450 0x7fcc9c15a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52140/0 (socket says 172.21.15.82:52140) 2023-07-20T11:25:03.273 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcc9a59c640 1 -- 172.21.15.82:0/3015014359 learned_addr learned my addr 172.21.15.82:0/3015014359 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:03.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcc9ad9d640 1 --2- 172.21.15.82:0/3015014359 >> v2:172.21.15.82:3300/0 conn(0x7fcc9c0afd50 0x7fcc9c0b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcc99d9b640 1 -- 172.21.15.82:0/3015014359 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484875822 0 0) 0x7fcc9c0b06b0 con 0x7fcc9c159450 2023-07-20T11:25:03.274 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.279+0000 7fcc99d9b640 1 -- 172.21.15.82:0/3015014359 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc88003530 con 0x7fcc9c159450 2023-07-20T11:25:03.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc9ad9d640 1 -- 172.21.15.82:0/3015014359 >> v1:172.21.15.183:6789/0 conn(0x7fcc9c159830 legacy=0x7fcc9c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc9ad9d640 1 -- 172.21.15.82:0/3015014359 >> v1:172.21.15.82:6789/0 conn(0x7fcc9c159450 legacy=0x7fcc9c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.275 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc9ad9d640 1 -- 172.21.15.82:0/3015014359 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c0ccbb0 con 0x7fcc9c0afd50 2023-07-20T11:25:03.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc9ad9d640 1 --2- 172.21.15.82:0/3015014359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c0afd50 0x7fcc9c0b0170 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb051ccfad3b9127 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.276 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc99d9b640 1 -- 172.21.15.82:0/3015014359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940ab650 con 0x7fcc9c0afd50 2023-07-20T11:25:03.283 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc99d9b640 1 -- 172.21.15.82:0/3015014359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940ab7b0 con 0x7fcc9c0afd50 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcc99d9b640 1 -- 172.21.15.82:0/3015014359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940abb40 con 0x7fcc9c0afd50 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 -- 172.21.15.82:0/3015014359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c0afd50 msgr2=0x7fcc9c0b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 --2- 172.21.15.82:0/3015014359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c0afd50 0x7fcc9c0b0170 secure :-1 s=READY pgs=2554 cs=0 l=1 rev1=1 crypto rx=0x7fcc940097c0 tx=0x7fcc9401c450 comp rx=0 tx=0).stop 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 -- 172.21.15.82:0/3015014359 shutdown_connections 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 --2- 172.21.15.82:0/3015014359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c0afd50 0x7fcc9c0b0170 unknown :-1 s=CLOSED pgs=2554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.284 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 -- 172.21.15.82:0/3015014359 >> 172.21.15.82:0/3015014359 conn(0x7fcc9c0cad50 msgr2=0x7fcc9c0cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 -- 172.21.15.82:0/3015014359 shutdown_connections 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.283+0000 7fcca09fa640 1 -- 172.21.15.82:0/3015014359 wait complete. 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 Processor -- start 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 -- start start 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc9c0afd50 0x7fcc9c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 0x7fcc9c0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.285 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc9c14e630 0x7fcc9c158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b12c0 con 0x7fcc9c159450 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b2100 con 0x7fcc9c14e630 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcca09fa640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c0b14f0 con 0x7fcc9c0afd50 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 0x7fcc9c0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 0x7fcc9c0b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48008/0 (socket says 172.21.15.82:48008) 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 -- 172.21.15.82:0/3529681294 learned_addr learned my addr 172.21.15.82:0/3529681294 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc9ad9d640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc9c14e630 0x7fcc9c158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.286 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc9a59c640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc9c0afd50 0x7fcc9c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 -- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc9c0afd50 msgr2=0x7fcc9c0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fcc9c0afd50 0x7fcc9c0b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 -- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc9c14e630 msgr2=0x7fcc9c158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcc9c14e630 0x7fcc9c158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009420 con 0x7fcc9c159450 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc91d9b640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 0x7fcc9c0b0d80 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c3c0 tx=0x7fcc8400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840052d0 con 0x7fcc9c159450 2023-07-20T11:25:03.287 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.287+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84005430 con 0x7fcc9c159450 2023-07-20T11:25:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c0b17d0 con 0x7fcc9c159450 2023-07-20T11:25:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84003840 con 0x7fcc9c159450 2023-07-20T11:25:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0b1d90 con 0x7fcc9c159450 2023-07-20T11:25:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc9c0cc5b0 con 0x7fcc9c159450 2023-07-20T11:25:03.288 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcc840039a0 con 0x7fcc9c159450 2023-07-20T11:25:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fcc7c0663a0 0x7fcc7c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fcc84083460 con 0x7fcc9c159450 2023-07-20T11:25:03.289 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fcc7c06ce40 0x7fcc7c06f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc7c06f930 con 0x7fcc7c06ce40 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc840859e0 con 0x7fcc9c159450 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc9a59c640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fcc7c0663a0 0x7fcc7c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc9ad9d640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fcc7c06ce40 0x7fcc7c06f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.291+0000 7fcc9a59c640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fcc7c0663a0 0x7fcc7c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001570 tx=0x7fcc8c009040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.295+0000 7fcc9ad9d640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fcc7c06ce40 0x7fcc7c06f260 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.290 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.295+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== osd.6 v2:172.21.15.183:6800/2355022847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcc7c06f930 con 0x7fcc7c06ce40 2023-07-20T11:25:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 --> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc9c0b2270 con 0x7fcc7c06ce40 2023-07-20T11:25:03.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcc937fe640 1 -- 172.21.15.82:0/3529681294 <== osd.6 v2:172.21.15.183:6800/2355022847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcc9c0b2270 con 0x7fcc7c06ce40 2023-07-20T11:25:03.299 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:03.300 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:03.300 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fcc7c06ce40 msgr2=0x7fcc7c06f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.183:6800/2355022847,v1:172.21.15.183:6801/2355022847] conn(0x7fcc7c06ce40 0x7fcc7c06f260 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fcc7c0663a0 msgr2=0x7fcc7c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fcc7c0663a0 0x7fcc7c068860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c001570 tx=0x7fcc8c009040 comp rx=0 tx=0).stop 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 msgr2=0x7fcc9c0b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 --2- 172.21.15.82:0/3529681294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc9c159450 0x7fcc9c0b0d80 secure :-1 s=READY pgs=2555 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c3c0 tx=0x7fcc8400c880 comp rx=0 tx=0).stop 2023-07-20T11:25:03.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcc9ad9d640 1 -- 172.21.15.82:0/3529681294 reap_dead start 2023-07-20T11:25:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 shutdown_connections 2023-07-20T11:25:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 >> 172.21.15.82:0/3529681294 conn(0x7fcc9c0cad50 msgr2=0x7fcc9c071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 shutdown_connections 2023-07-20T11:25:03.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.307+0000 7fcca09fa640 1 -- 172.21.15.82:0/3529681294 wait complete. 2023-07-20T11:25:03.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-20T11:25:03.458 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 Processor -- start 2023-07-20T11:25:03.459 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 -- start start 2023-07-20T11:25:03.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0c80b2a90 0x7ff0c815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c80ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c80ccd90 con 0x7ff0c81596b0 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c80ad600 con 0x7ff0c80b2a90 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0cd940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80ad810 con 0x7ff0c80cc900 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c67fc640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7ff0c80b2a90 0x7ff0c815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c6ffd640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7ff0c81596b0 0x7ff0c80b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52150/0 (socket says 172.21.15.82:52150) 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c6ffd640 1 -- 172.21.15.82:0/699950540 learned_addr learned my addr 172.21.15.82:0/699950540 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:03.461 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c77fe640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c80ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c67fc640 1 -- 172.21.15.82:0/699950540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 msgr2=0x7ff0c80ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c67fc640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c80ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.462 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c67fc640 1 -- 172.21.15.82:0/699950540 >> v1:172.21.15.82:6789/0 conn(0x7ff0c81596b0 legacy=0x7ff0c80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c67fc640 1 -- 172.21.15.82:0/699950540 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c815d0d0 con 0x7ff0c80b2a90 2023-07-20T11:25:03.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c5ffb640 1 -- 172.21.15.82:0/699950540 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507403302 0 0) 0x7ff0c80ccd90 con 0x7ff0c81596b0 2023-07-20T11:25:03.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.467+0000 7ff0c77fe640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c80ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:03.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0c67fc640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c80b2a90 0x7ff0c815dbb0 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0097f0 tx=0x7ff0bc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbba43621456b652 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0c5ffb640 1 -- 172.21.15.82:0/699950540 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0ab650 con 0x7ff0c80b2a90 2023-07-20T11:25:03.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0c5ffb640 1 -- 172.21.15.82:0/699950540 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc0ab7b0 con 0x7ff0c80b2a90 2023-07-20T11:25:03.464 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0c5ffb640 1 -- 172.21.15.82:0/699950540 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0abb40 con 0x7ff0c80b2a90 2023-07-20T11:25:03.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 -- 172.21.15.82:0/699950540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c80b2a90 msgr2=0x7ff0c815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c80b2a90 0x7ff0c815dbb0 secure :-1 s=READY pgs=2557 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0097f0 tx=0x7ff0bc01c450 comp rx=0 tx=0).stop 2023-07-20T11:25:03.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 -- 172.21.15.82:0/699950540 shutdown_connections 2023-07-20T11:25:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c80ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 --2- 172.21.15.82:0/699950540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c80b2a90 0x7ff0c815dbb0 unknown :-1 s=CLOSED pgs=2557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 -- 172.21.15.82:0/699950540 >> 172.21.15.82:0/699950540 conn(0x7ff0c80cada0 msgr2=0x7ff0c80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 -- 172.21.15.82:0/699950540 shutdown_connections 2023-07-20T11:25:03.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.471+0000 7ff0cd940640 1 -- 172.21.15.82:0/699950540 wait complete. 2023-07-20T11:25:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 Processor -- start 2023-07-20T11:25:03.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- start start 2023-07-20T11:25:03.468 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0c80b2a90 0x7ff0c80b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c81572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8156e50 con 0x7ff0c81596b0 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8156240 con 0x7ff0c80b2a90 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8156520 con 0x7ff0c80cc900 2023-07-20T11:25:03.469 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48030/0 (socket says 172.21.15.82:48030) 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 -- 172.21.15.82:0/17287762 learned_addr learned my addr 172.21.15.82:0/17287762 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c67fc640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c81572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c6ffd640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0c80b2a90 0x7ff0c80b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 -- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 msgr2=0x7ff0c81572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c81572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 -- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0c80b2a90 msgr2=0x7ff0c80b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.470 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0c80b2a90 0x7ff0c80b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 -- 172.21.15.82:0/17287762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc009420 con 0x7ff0c81596b0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0c77fe640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007ef0 tx=0x7ff0c000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0003ba0 con 0x7ff0c81596b0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000f040 con 0x7ff0c81596b0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8156800 con 0x7ff0c81596b0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000de80 con 0x7ff0c81596b0 2023-07-20T11:25:03.471 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.475+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c80b0b40 con 0x7ff0c81596b0 2023-07-20T11:25:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8156fc0 con 0x7ff0c81596b0 2023-07-20T11:25:03.472 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff0c0004030 con 0x7ff0c81596b0 2023-07-20T11:25:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0affff640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 0x7ff0b4068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7ff0c0084210 con 0x7ff0c81596b0 2023-07-20T11:25:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0c6ffd640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 0x7ff0b4068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.473 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.479+0000 7ff0c6ffd640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 0x7ff0b4068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000f70 tx=0x7ff0b8007c10 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.475 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.483+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0c00515b0 con 0x7ff0c81596b0 2023-07-20T11:25:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.631+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0c8073c70 con 0x7ff0b40663a0 2023-07-20T11:25:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.631+0000 7ff0affff640 1 -- 172.21.15.82:0/17287762 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0c8073c70 con 0x7ff0b40663a0 2023-07-20T11:25:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 6 to deep-scrub 2023-07-20T11:25:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 msgr2=0x7ff0b4068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 0x7ff0b4068860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8000f70 tx=0x7ff0b8007c10 comp rx=0 tx=0).stop 2023-07-20T11:25:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 msgr2=0x7ff0c806c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 secure :-1 s=READY pgs=2558 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0007ef0 tx=0x7ff0c000d4a0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 shutdown_connections 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7ff0b40663a0 0x7ff0b4068860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c81596b0 0x7ff0c806c490 unknown :-1 s=CLOSED pgs=2558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7ff0c80cc900 0x7ff0c81572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 --2- 172.21.15.82:0/17287762 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff0c80b2a90 0x7ff0c80b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 >> 172.21.15.82:0/17287762 conn(0x7ff0c80cada0 msgr2=0x7ff0c80cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 shutdown_connections 2023-07-20T11:25:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.635+0000 7ff0cd940640 1 -- 172.21.15.82:0/17287762 wait complete. 2023-07-20T11:25:03.645 INFO:tasks.ceph:Scrubbing osd.7 2023-07-20T11:25:03.646 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-20T11:25:03.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 Processor -- start 2023-07-20T11:25:03.788 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 -- start start 2023-07-20T11:25:03.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f5750159830 0x7f57500cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57500cc8d0 con 0x7f5750159450 2023-07-20T11:25:03.789 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57500ccbb0 con 0x7f57500cc3e0 2023-07-20T11:25:03.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.795+0000 7f5754d52640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500cce90 con 0x7f5750159830 2023-07-20T11:25:03.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574e59c640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f5750159450 0x7f575015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52158/0 (socket says 172.21.15.82:52158) 2023-07-20T11:25:03.790 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574e59c640 1 -- 172.21.15.82:0/1366359412 learned_addr learned my addr 172.21.15.82:0/1366359412 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:03.791 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225258064 0 0) 0x7f57500cc8d0 con 0x7f5750159450 2023-07-20T11:25:03.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f573c003530 con 0x7f5750159450 2023-07-20T11:25:03.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f5745d9b640 1 --2- 172.21.15.82:0/1366359412 >> v2:172.21.15.183:3300/0 conn(0x7f5750159830 0x7f57500cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v1:172.21.15.82:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84758348 0 0) 0x7f573c003530 con 0x7f5750159450 2023-07-20T11:25:03.792 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 >> v2:172.21.15.183:3300/0 conn(0x7f5750159830 msgr2=0x7f57500cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 --2- 172.21.15.82:0/1366359412 >> v2:172.21.15.183:3300/0 conn(0x7f5750159830 0x7f57500cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 >> v1:172.21.15.183:6789/0 conn(0x7f57500cc3e0 legacy=0x7f57500afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 --> v1:172.21.15.82:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750159cc0 con 0x7f5750159450 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v1:172.21.15.82:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 121390711 0 0) 0x7f5740001680 con 0x7f5750159450 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 >> v1:172.21.15.82:6789/0 conn(0x7f5750159450 legacy=0x7f575015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.793 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f573c003a40 0x7f573c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f573c0047d0 0x7f573c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f573c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500cce90 con 0x7f573c0051e0 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c00c110 con 0x7f573c003a40 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c00e4e0 con 0x7f573c0047d0 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f573c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.794 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574e59c640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f573c003a40 0x7f573c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f5745d9b640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f573c0047d0 0x7f573c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 -- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f573c0047d0 msgr2=0x7f573c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f573c0047d0 0x7f573c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 -- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f573c003a40 msgr2=0x7f573c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f573c003a40 0x7f573c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.795 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.799+0000 7f574ed9d640 1 -- 172.21.15.82:0/1366359412 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c003530 con 0x7f573c0051e0 2023-07-20T11:25:03.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f574ed9d640 1 -- 172.21.15.82:0/1366359412 reap_dead start 2023-07-20T11:25:03.796 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f574ed9d640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f573c00b990 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f5748001e40 tx=0x7f574801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff3aa77acae875e server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748003b80 con 0x7f573c0051e0 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748003ce0 con 0x7f573c0051e0 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f574dd9b640 1 -- 172.21.15.82:0/1366359412 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748005260 con 0x7f573c0051e0 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 msgr2=0x7f573c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f573c00b990 secure :-1 s=READY pgs=2560 cs=0 l=1 rev1=1 crypto rx=0x7f5748001e40 tx=0x7f574801c740 comp rx=0 tx=0).stop 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- 172.21.15.82:0/1366359412 shutdown_connections 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 --2- 172.21.15.82:0/1366359412 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f573c00b990 unknown :-1 s=CLOSED pgs=2560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.797 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- 172.21.15.82:0/1366359412 >> 172.21.15.82:0/1366359412 conn(0x7f57500cad50 msgr2=0x7f57500cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- 172.21.15.82:0/1366359412 shutdown_connections 2023-07-20T11:25:03.798 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- 172.21.15.82:0/1366359412 wait complete. 2023-07-20T11:25:03.799 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 Processor -- start 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.803+0000 7f5754d52640 1 -- start start 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f575014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5750153800 0x7f57500c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57501f55b0 0x7f57501f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575014fe20 con 0x7f573c0051e0 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57500c3790 con 0x7f5750153800 2023-07-20T11:25:03.800 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5750153d00 con 0x7f57501f55b0 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f575014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f575014f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48038/0 (socket says 172.21.15.82:48038) 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 -- 172.21.15.82:0/2587383267 learned_addr learned my addr 172.21.15.82:0/2587383267 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574ed9d640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57501f55b0 0x7f57501f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5745d9b640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5750153800 0x7f57500c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 -- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57501f55b0 msgr2=0x7f57501f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57501f55b0 0x7f57501f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.801 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 -- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5750153800 msgr2=0x7f57500c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5750153800 0x7f57500c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750153fe0 con 0x7f573c0051e0 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574ed9d640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f57501f55b0 0x7f57501f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f574e59c640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f575014f8e0 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f5740004ed0 tx=0x7f5740007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000f730 con 0x7f573c0051e0 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000f8b0 con 0x7f573c0051e0 2023-07-20T11:25:03.802 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000fc60 con 0x7f573c0051e0 2023-07-20T11:25:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57501542c0 con 0x7f573c0051e0 2023-07-20T11:25:03.803 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57500c40f0 con 0x7f573c0051e0 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5750159fa0 con 0x7f573c0051e0 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.807+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f574001d460 con 0x7f573c0051e0 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f57300663a0 0x7f5730068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f5740083fe0 con 0x7f573c0051e0 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f573006ce40 0x7f573006f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.804 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f5745d9b640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f57300663a0 0x7f5730068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f573006f930 con 0x7f573006ce40 2023-07-20T11:25:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=210) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57400865c0 con 0x7f573c0051e0 2023-07-20T11:25:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f574ed9d640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f573006ce40 0x7f573006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f5745d9b640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f57300663a0 0x7f5730068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5750158960 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.805 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f574ed9d640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f573006ce40 0x7f573006f260 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.806 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.811+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== osd.7 v2:172.21.15.183:6809/1024675739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f573006f930 con 0x7f573006ce40 2023-07-20T11:25:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.823+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 --> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f575004da30 con 0x7f573006ce40 2023-07-20T11:25:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f57477fe640 1 -- 172.21.15.82:0/2587383267 <== osd.7 v2:172.21.15.183:6809/1024675739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f575004da30 con 0x7f573006ce40 2023-07-20T11:25:03.818 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2023-07-20T11:25:03.818 INFO:teuthology.orchestra.run.smithi082.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-20T11:25:03.818 INFO:teuthology.orchestra.run.smithi082.stdout:} 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f573006ce40 msgr2=0x7f573006f260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.183:6809/1024675739,v1:172.21.15.183:6811/1024675739] conn(0x7f573006ce40 0x7f573006f260 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f57300663a0 msgr2=0x7f5730068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f57300663a0 0x7f5730068860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5750158960 tx=0x7f5738008040 comp rx=0 tx=0).stop 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 msgr2=0x7f575014f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 --2- 172.21.15.82:0/2587383267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f573c0051e0 0x7f575014f8e0 secure :-1 s=READY pgs=2561 cs=0 l=1 rev1=1 crypto rx=0x7f5740004ed0 tx=0x7f5740007430 comp rx=0 tx=0).stop 2023-07-20T11:25:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f574ed9d640 1 -- 172.21.15.82:0/2587383267 reap_dead start 2023-07-20T11:25:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 shutdown_connections 2023-07-20T11:25:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 >> 172.21.15.82:0/2587383267 conn(0x7f57500cad50 msgr2=0x7f57500c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 shutdown_connections 2023-07-20T11:25:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.827+0000 7f5754d52640 1 -- 172.21.15.82:0/2587383267 wait complete. 2023-07-20T11:25:03.836 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-20T11:25:03.975 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 Processor -- start 2023-07-20T11:25:03.976 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 -- start start 2023-07-20T11:25:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54080ca040 0x7f54080ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f540815c910 0x7f540815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f540815d2d0 0x7f54080c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.977 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54080cde70 con 0x7f54080ca040 2023-07-20T11:25:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540815d760 con 0x7f540815d2d0 2023-07-20T11:25:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540faec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080cbef0 con 0x7f540815c910 2023-07-20T11:25:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540d888640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54080ca040 0x7f54080ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540d888640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f54080ca040 0x7f54080ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48044/0 (socket says 172.21.15.82:48044) 2023-07-20T11:25:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.983+0000 7f540d888640 1 -- 172.21.15.82:0/552662975 learned_addr learned my addr 172.21.15.82:0/552662975 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d087640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f540815c910 0x7f540815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540e089640 1 --2- 172.21.15.82:0/552662975 >> v2:172.21.15.183:3300/0 conn(0x7f540815d2d0 0x7f54080c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 -- 172.21.15.82:0/552662975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f540815c910 msgr2=0x7f540815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f540815c910 0x7f540815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 -- 172.21.15.82:0/552662975 >> v2:172.21.15.183:3300/0 conn(0x7f540815d2d0 msgr2=0x7f54080c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 --2- 172.21.15.82:0/552662975 >> v2:172.21.15.183:3300/0 conn(0x7f540815d2d0 0x7f54080c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 -- 172.21.15.82:0/552662975 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080ca420 con 0x7f54080ca040 2023-07-20T11:25:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540d888640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080ca040 0x7f54080ad060 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7f5408066390 tx=0x7f540401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b03b11f12b66a19 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540c886640 1 -- 172.21.15.82:0/552662975 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404004230 con 0x7f54080ca040 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540c886640 1 -- 172.21.15.82:0/552662975 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040a7050 con 0x7f54080ca040 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540c886640 1 -- 172.21.15.82:0/552662975 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404003620 con 0x7f54080ca040 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540faec640 1 -- 172.21.15.82:0/552662975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080ca040 msgr2=0x7f54080ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.987+0000 7f540faec640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080ca040 0x7f54080ad060 secure :-1 s=READY pgs=2562 cs=0 l=1 rev1=1 crypto rx=0x7f5408066390 tx=0x7f540401c500 comp rx=0 tx=0).stop 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- 172.21.15.82:0/552662975 shutdown_connections 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- 172.21.15.82:0/552662975 >> v2:172.21.15.183:3300/0 conn(0x7f540815d2d0 0x7f54080c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f540815c910 0x7f540815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- 172.21.15.82:0/552662975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54080ca040 0x7f54080ad060 unknown :-1 s=CLOSED pgs=2562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- 172.21.15.82:0/552662975 >> 172.21.15.82:0/552662975 conn(0x7f54080cada0 msgr2=0x7f54080cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:03.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- 172.21.15.82:0/552662975 shutdown_connections 2023-07-20T11:25:03.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- 172.21.15.82:0/552662975 wait complete. 2023-07-20T11:25:03.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 Processor -- start 2023-07-20T11:25:03.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- start start 2023-07-20T11:25:03.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54080ca040 0x7f5408152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 0x7f540809a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408153160 con 0x7f540815d2d0 2023-07-20T11:25:03.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5408099420 con 0x7f540815c910 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540faec640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54080996e0 con 0x7f54080ca040 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48046/0 (socket says 172.21.15.82:48046) 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 -- 172.21.15.82:0/3675774930 learned_addr learned my addr 172.21.15.82:0/3675774930 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540d888640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54080ca040 0x7f5408152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540d087640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 0x7f540809a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 -- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54080ca040 msgr2=0x7f5408152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54080ca040 0x7f5408152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 -- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 msgr2=0x7f540809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 0x7f540809a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 -- 172.21.15.82:0/3675774930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040094d0 con 0x7f540815d2d0 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540d087640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 0x7f540809a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-20T11:25:03.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.991+0000 7f540e089640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f5400008ac0 tx=0x7f540000d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400010070 con 0x7f540815d2d0 2023-07-20T11:25:03.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000db30 con 0x7f540815d2d0 2023-07-20T11:25:03.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540000dec0 con 0x7f540815d2d0 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54080999c0 con 0x7f540815d2d0 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5408099f80 con 0x7f540815d2d0 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540809a1a0 con 0x7f540815d2d0 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f540001d3b0 con 0x7f540815d2d0 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 0x7f53ec068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:03.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f5400083bf0 con 0x7f540815d2d0 2023-07-20T11:25:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.995+0000 7f540d888640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 0x7f53ec068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:03.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.999+0000 7f540d888640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 0x7f53ec068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54040ad000 tx=0x7f54040a6000 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:03.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:03.999+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5400050e60 con 0x7f540815d2d0 2023-07-20T11:25:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f54080c8eb0 con 0x7f53ec0663a0 2023-07-20T11:25:04.140 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f53fe7fc640 1 -- 172.21.15.82:0/3675774930 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54040041b0 con 0x7f53ec0663a0 2023-07-20T11:25:04.140 INFO:teuthology.orchestra.run.smithi082.stderr:instructed osd(s) 7 to deep-scrub 2023-07-20T11:25:04.141 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 msgr2=0x7f53ec068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 0x7f53ec068860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54040ad000 tx=0x7f54040a6000 comp rx=0 tx=0).stop 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 msgr2=0x7f5408070170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 secure :-1 s=READY pgs=2563 cs=0 l=1 rev1=1 crypto rx=0x7f5400008ac0 tx=0x7f540000d420 comp rx=0 tx=0).stop 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 shutdown_connections 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f53ec0663a0 0x7f53ec068860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.142 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540815d2d0 0x7f5408070170 unknown :-1 s=CLOSED pgs=2563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f540815c910 0x7f540809a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 --2- 172.21.15.82:0/3675774930 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f54080ca040 0x7f5408152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 >> 172.21.15.82:0/3675774930 conn(0x7f54080cada0 msgr2=0x7f54080acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 shutdown_connections 2023-07-20T11:25:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.147+0000 7f540faec640 1 -- 172.21.15.82:0/3675774930 wait complete. 2023-07-20T11:25:04.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:25:04.299 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 Processor -- start 2023-07-20T11:25:04.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 -- start start 2023-07-20T11:25:04.300 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22481596b0 0x7f224815dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f22480b2a90 0x7f22480ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22480ccd90 con 0x7f22480cc900 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480ad600 con 0x7f22481596b0 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224f359640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480ad810 con 0x7f22480b2a90 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22481596b0 0x7f224815dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f22481596b0 0x7f224815dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48058/0 (socket says 172.21.15.82:48058) 2023-07-20T11:25:04.301 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 -- 172.21.15.82:0/1410939183 learned_addr learned my addr 172.21.15.82:0/1410939183 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224c8f4640 1 --1- 172.21.15.82:0/1410939183 >> v1:172.21.15.82:6789/0 conn(0x7f22480cc900 0x7f22480b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:52162/0 (socket says 172.21.15.82:52162) 2023-07-20T11:25:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d8f6640 1 --2- 172.21.15.82:0/1410939183 >> v2:172.21.15.183:3300/0 conn(0x7f22480b2a90 0x7f22480ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.302 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 -- 172.21.15.82:0/1410939183 >> v2:172.21.15.183:3300/0 conn(0x7f22480b2a90 msgr2=0x7f22480ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 --2- 172.21.15.82:0/1410939183 >> v2:172.21.15.183:3300/0 conn(0x7f22480b2a90 0x7f22480ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 -- 172.21.15.82:0/1410939183 >> v1:172.21.15.82:6789/0 conn(0x7f22480cc900 legacy=0x7f22480b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f223ffff640 1 -- 172.21.15.82:0/1410939183 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969965450 0 0) 0x7f22480ccd90 con 0x7f22480cc900 2023-07-20T11:25:04.303 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.307+0000 7f224d0f5640 1 -- 172.21.15.82:0/1410939183 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224815d0d0 con 0x7f22481596b0 2023-07-20T11:25:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224d0f5640 1 --2- 172.21.15.82:0/1410939183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22481596b0 0x7f224815dbb0 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7f2244009870 tx=0x7f224401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea61205f73e0eaa server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f223ffff640 1 -- 172.21.15.82:0/1410939183 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440aa430 con 0x7f22481596b0 2023-07-20T11:25:04.304 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f223ffff640 1 -- 172.21.15.82:0/1410939183 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440aa590 con 0x7f22481596b0 2023-07-20T11:25:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f223ffff640 1 -- 172.21.15.82:0/1410939183 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22440aa920 con 0x7f22481596b0 2023-07-20T11:25:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 -- 172.21.15.82:0/1410939183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22481596b0 msgr2=0x7f224815dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 --2- 172.21.15.82:0/1410939183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22481596b0 0x7f224815dbb0 secure :-1 s=READY pgs=2565 cs=0 l=1 rev1=1 crypto rx=0x7f2244009870 tx=0x7f224401c4d0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.305 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 -- 172.21.15.82:0/1410939183 shutdown_connections 2023-07-20T11:25:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 --2- 172.21.15.82:0/1410939183 >> v2:172.21.15.183:3300/0 conn(0x7f22480b2a90 0x7f22480ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 --2- 172.21.15.82:0/1410939183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22481596b0 0x7f224815dbb0 unknown :-1 s=CLOSED pgs=2565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 -- 172.21.15.82:0/1410939183 >> 172.21.15.82:0/1410939183 conn(0x7f22480cada0 msgr2=0x7f22480cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 -- 172.21.15.82:0/1410939183 shutdown_connections 2023-07-20T11:25:04.306 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.311+0000 7f224f359640 1 -- 172.21.15.82:0/1410939183 wait complete. 2023-07-20T11:25:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 Processor -- start 2023-07-20T11:25:04.307 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- start start 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22480b2a90 0x7f22480accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 0x7f2248163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480aae90 con 0x7f22480cc900 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22480ab0e0 con 0x7f22480b2a90 2023-07-20T11:25:04.308 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22480ab3c0 con 0x7f22481596b0 2023-07-20T11:25:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48068/0 (socket says 172.21.15.82:48068) 2023-07-20T11:25:04.309 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 -- 172.21.15.82:0/360485305 learned_addr learned my addr 172.21.15.82:0/360485305 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224d0f5640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22480b2a90 0x7f22480accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224d8f6640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 0x7f2248163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 -- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 msgr2=0x7f2248163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 0x7f2248163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 -- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22480b2a90 msgr2=0x7f22480accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22480b2a90 0x7f22480accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 -- 172.21.15.82:0/360485305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440094d0 con 0x7f22480cc900 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224d8f6640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 0x7f2248163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224c8f4640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f22380011f0 tx=0x7f223800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380074e0 con 0x7f22480cc900 2023-07-20T11:25:04.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238007640 con 0x7f22480cc900 2023-07-20T11:25:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238004a10 con 0x7f22480cc900 2023-07-20T11:25:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22480ab6a0 con 0x7f22480cc900 2023-07-20T11:25:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.315+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22480ad200 con 0x7f22480cc900 2023-07-20T11:25:04.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2248073c70 con 0x7f22480cc900 2023-07-20T11:25:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2238004b70 con 0x7f22480cc900 2023-07-20T11:25:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f223dffb640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 0x7f222c068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f2238083170 con 0x7f22480cc900 2023-07-20T11:25:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f224d0f5640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 0x7f222c068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:04.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.319+0000 7f224d0f5640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 0x7f222c068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22440ae000 tx=0x7f22440a7000 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:04.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.323+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22380504d0 con 0x7f22480cc900 2023-07-20T11:25:04.460 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.467+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22480adaf0 con 0x7f222c0663a0 2023-07-20T11:25:04.463 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f223dffb640 1 -- 172.21.15.82:0/360485305 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72640 (secure 0 0 0) 0x7f22440aa800 con 0x7f222c0663a0 2023-07-20T11:25:04.463 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:25:04.464 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:25:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 msgr2=0x7f222c068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 0x7f222c068860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22440ae000 tx=0x7f22440a7000 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 msgr2=0x7f2248154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 secure :-1 s=READY pgs=2566 cs=0 l=1 rev1=1 crypto rx=0x7f22380011f0 tx=0x7f223800c9b0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 shutdown_connections 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f222c0663a0 0x7f222c068860 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f22481596b0 0x7f2248163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22480cc900 0x7f2248154b00 unknown :-1 s=CLOSED pgs=2566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 --2- 172.21.15.82:0/360485305 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f22480b2a90 0x7f22480accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.471+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 >> 172.21.15.82:0/360485305 conn(0x7f22480cada0 msgr2=0x7f22480b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.475+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 shutdown_connections 2023-07-20T11:25:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:04.475+0000 7f224f359640 1 -- 172.21.15.82:0/360485305 wait complete. 2023-07-20T11:25:04.484 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-07-20T11:25:04.366490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":438000,"kb_used_data":21768,"kb_used_omap":13,"kb_used_meta":416114,"kb_avail":754536720,"statfs":{"total":773094113280,"available":772645601280,"internally_reserved":0,"allocated":22290432,"data_stored":12018824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":426100824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001854"},"pg_stats":[{"pgid":"1.0","version":"207'348","reported_seq":1362,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.849886+0000","last_change":"2023-07-20T09:50:15.297189+0000","last_active":"2023-07-20T11:24:54.849886+0000","last_peered":"2023-07-20T11:24:54.849886+0000","last_clean":"2023-07-20T11:24:54.849886+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:24:54.849886+0000","last_undegraded":"2023-07-20T11:24:54.849886+0000","last_fullsized":"2023-07-20T11:24:54.849886+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:14.283638+0000","last_clean_scrub_stamp":"2023-07-20T09:50:14.283638+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":428,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.525747+0000","last_change":"2023-07-20T09:50:21.343835+0000","last_active":"2023-07-20T11:24:54.525747+0000","last_peered":"2023-07-20T11:24:54.525747+0000","last_clean":"2023-07-20T11:24:54.525747+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:24:54.525747+0000","last_undegraded":"2023-07-20T11:24:54.525747+0000","last_fullsized":"2023-07-20T11:24:54.525747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:54:04.539286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":387,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:59.364644+0000","last_change":"2023-07-20T09:50:21.347189+0000","last_active":"2023-07-20T11:24:59.364644+0000","last_peered":"2023-07-20T11:24:59.364644+0000","last_clean":"2023-07-20T11:24:59.364644+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:24:59.364644+0000","last_undegraded":"2023-07-20T11:24:59.364644+0000","last_fullsized":"2023-07-20T11:24:59.364644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":427,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:02.546016+0000","last_change":"2023-07-20T11:25:02.546053+0000","last_active":"2023-07-20T11:25:02.546016+0000","last_peered":"2023-07-20T11:25:02.546016+0000","last_clean":"2023-07-20T11:25:02.546016+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:25:02.546016+0000","last_undegraded":"2023-07-20T11:25:02.546016+0000","last_fullsized":"2023-07-20T11:25:02.546016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:02.545928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:02.545928+0000","last_clean_scrub_stamp":"2023-07-20T11:25:02.545928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:23.274493+0000","scrub_duration":0.0037211089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":428,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.525275+0000","last_change":"2023-07-20T09:50:21.342406+0000","last_active":"2023-07-20T11:24:54.525275+0000","last_peered":"2023-07-20T11:24:54.525275+0000","last_clean":"2023-07-20T11:24:54.525275+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:24:54.525275+0000","last_undegraded":"2023-07-20T11:24:54.525275+0000","last_fullsized":"2023-07-20T11:24:54.525275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T13:59:00.573520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":384,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.848875+0000","last_change":"2023-07-20T09:50:21.469788+0000","last_active":"2023-07-20T11:24:54.848875+0000","last_peered":"2023-07-20T11:24:54.848875+0000","last_clean":"2023-07-20T11:24:54.848875+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:24:54.848875+0000","last_undegraded":"2023-07-20T11:24:54.848875+0000","last_fullsized":"2023-07-20T11:24:54.848875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:14:12.049434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":385,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.848591+0000","last_change":"2023-07-20T09:50:21.469666+0000","last_active":"2023-07-20T11:24:54.848591+0000","last_peered":"2023-07-20T11:24:54.848591+0000","last_clean":"2023-07-20T11:24:54.848591+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:24:54.848591+0000","last_undegraded":"2023-07-20T11:24:54.848591+0000","last_fullsized":"2023-07-20T11:24:54.848591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":382,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.850787+0000","last_change":"2023-07-20T09:50:21.347604+0000","last_active":"2023-07-20T11:24:54.850787+0000","last_peered":"2023-07-20T11:24:54.850787+0000","last_clean":"2023-07-20T11:24:54.850787+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:24:54.850787+0000","last_undegraded":"2023-07-20T11:24:54.850787+0000","last_fullsized":"2023-07-20T11:24:54.850787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T11:04:58.602734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:24:54.847693+0000","last_change":"2023-07-20T09:50:21.347914+0000","last_active":"2023-07-20T11:24:54.847693+0000","last_peered":"2023-07-20T11:24:54.847693+0000","last_clean":"2023-07-20T11:24:54.847693+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:24:54.847693+0000","last_undegraded":"2023-07-20T11:24:54.847693+0000","last_fullsized":"2023-07-20T11:24:54.847693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T09:50:20.324126+0000","last_clean_scrub_stamp":"2023-07-20T09:50:20.324126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T12:55:02.936820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52320,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319520,"statfs":{"total":96636764160,"available":96583188480,"internally_reserved":0,"allocated":3231744,"data_stored":1945129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.96699999999999997,"15min":1.0409999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":1.01,"15min":1.081},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.97499999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93999999999999995,"5min":1.012,"15min":1.0900000000000001},"last":0.746}]},{"osd":3,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.94899999999999995,"5min":0.997,"15min":1.0409999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.0509999999999999},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.80900000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.28299999999999997},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.03},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59936,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.878},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.749}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.71599999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.84399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71499999999999997,"15min":0.72199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.752,"15min":0.75},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94399999999999995,"5min":0.99199999999999999,"15min":1.024},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.50900000000000001,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":0.96899999999999997,"5min":1.204,"15min":1.204},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.56699999999999995,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.59599999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":0.95299999999999996,"15min":1.071},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77800000000000002,"15min":0.77400000000000002},"min":{"1min":0.65900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93400000000000005,"5min":1.101,"15min":1.101},"last":0.97599999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76500000000000001,"15min":0.77700000000000002},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.036},"last":1.034},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77700000000000002,"15min":0.77300000000000002},"min":{"1min":0.58499999999999996,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.94099999999999995,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.80100000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.33100000000000002},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.41499999999999998,"15min":0.40400000000000003},"max":{"1min":0.82699999999999996,"5min":1.012,"15min":1.0600000000000001},"last":1.071}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86099999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.012},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.68999999999999995,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.432,"15min":0.378},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.99299999999999999}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.72799999999999998,"15min":0.70399999999999996},"min":{"1min":0.56100000000000005,"5min":0.46899999999999997,"15min":0.46200000000000002},"max":{"1min":0.92900000000000005,"5min":1.0740000000000001,"15min":1.0880000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.752,"15min":0.72099999999999997},"min":{"1min":0.51500000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1,"5min":1.085,"15min":1.085},"last":0.91400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575975,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59932,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.71399999999999997,"15min":0.73399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.73499999999999999},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99199999999999999,"5min":1.052,"15min":1.052},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78700000000000003,"15min":0.80000000000000004},"min":{"1min":0.57299999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.53000000000000003},"max":{"1min":1.0269999999999999,"5min":1.131,"15min":1.131},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.50800000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97399999999999998,"5min":0.996,"15min":0.999},"last":0.621},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.58099999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93600000000000005,"5min":1.034,"15min":1.034},"last":0.752}]},{"osd":5,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65600000000000003,"15min":0.63900000000000001},"min":{"1min":0.44800000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":1.0109999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.51500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.085},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65300000000000002,"15min":0.629},"min":{"1min":0.40999999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.95599999999999996,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.56499999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0329999999999999},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jul 20 11:24:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.52300000000000002,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":0.98199999999999998,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70399999999999996,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.036},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59936,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.442,"15min":0.46000000000000002},"min":{"1min":0.29199999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.497,"15min":0.52000000000000002},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.376}]},{"osd":1,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47599999999999998,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.61299999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.53900000000000003},"min":{"1min":0.37,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.76900000000000002,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55200000000000005,"15min":0.57699999999999996},"min":{"1min":0.442,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.96099999999999997},"last":0.504},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.60299999999999998},"min":{"1min":0.38300000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77200000000000002,"15min":0.79900000000000004},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.044,"5min":1.232,"15min":1.232},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.64700000000000002,"5min":0.55600000000000005,"15min":0.503},"max":{"1min":1.0860000000000001,"5min":1.242,"15min":1.369},"last":0.625}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.028,"5min":1.129,"15min":1.1779999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79700000000000004,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.497,"15min":0.497},"max":{"1min":1.014,"5min":1.127,"15min":1.3620000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.82599999999999996},"min":{"1min":0.60499999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96099999999999997,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.82699999999999996},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.82299999999999995,"15min":0.85099999999999998},"min":{"1min":0.67300000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.089,"5min":1.169,"15min":1.3999999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.82699999999999996,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.012,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575974,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.438},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.621}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.749},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575974,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37792,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334048,"statfs":{"total":96636764160,"available":96598065152,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47399999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55100000000000005,"15min":0.56899999999999995},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67600000000000005,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.65400000000000003,"5min":0.753,"15min":0.753},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56699999999999995,"15min":0.59499999999999997},"min":{"1min":0.376,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53300000000000003,"15min":0.54800000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.78700000000000003},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.4790000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.59299999999999997},"max":{"1min":0.97199999999999998,"5min":1.0740000000000001,"15min":1.26},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78300000000000003,"15min":0.80100000000000005},"min":{"1min":0.59999999999999998,"5min":0.56100000000000005,"15min":0.55600000000000005},"max":{"1min":1.0089999999999999,"5min":1.137,"15min":1.175},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80100000000000005,"15min":0.82099999999999995},"min":{"1min":0.59599999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0149999999999999,"5min":1.083,"15min":1.4339999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79400000000000004,"15min":0.81399999999999995},"min":{"1min":0.59299999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.97799999999999998,"5min":1.119,"15min":1.1910000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.54700000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0640000000000001,"5min":1.155,"15min":1.3089999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83199999999999996,"15min":0.84299999999999997},"min":{"1min":0.69399999999999995,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0669999999999999,"5min":1.1579999999999999,"15min":1.242},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80300000000000005,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0449999999999999,"5min":1.1830000000000001,"15min":1.2789999999999999},"last":0.59599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575975,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48224,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323616,"statfs":{"total":96636764160,"available":96587382784,"internally_reserved":0,"allocated":3231744,"data_stored":1945129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47099999999999997},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.61399999999999999,"5min":1.302,"15min":1.302},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52400000000000002,"15min":0.53400000000000003},"min":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.33300000000000002},"max":{"1min":0.72099999999999997,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.435}]},{"osd":2,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52800000000000002,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.29799999999999999},"max":{"1min":0.70399999999999996,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.56200000000000006,"15min":0.56999999999999995},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66900000000000004,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.67600000000000005,"5min":1.282,"15min":1.282},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.60499999999999998},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.76100000000000001,"5min":1.347,"15min":1.347},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.70899999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97499999999999998,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.66100000000000003,"5min":0.624,"15min":0.59099999999999997},"max":{"1min":0.99299999999999999,"5min":1.577,"15min":1.577},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81899999999999995,"15min":0.82299999999999995},"min":{"1min":0.63800000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":1.0189999999999999,"5min":1.379,"15min":1.379},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83399999999999996,"15min":0.83799999999999997},"min":{"1min":0.58899999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.84199999999999997,"15min":0.83299999999999996},"min":{"1min":0.63100000000000001,"5min":0.58399999999999996,"15min":0.54700000000000004},"max":{"1min":1.0620000000000001,"5min":1.625,"15min":1.625},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83699999999999997,"15min":0.84499999999999997},"min":{"1min":0.67900000000000005,"5min":0.59699999999999998,"15min":0.58999999999999997},"max":{"1min":0.96299999999999997,"5min":1.355,"15min":1.355},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jul 20 11:24:03 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85299999999999998,"15min":0.86299999999999999},"min":{"1min":0.73799999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.04,"5min":1.1910000000000001,"15min":1.2589999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.83499999999999996,"15min":0.83699999999999997},"min":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":1.0700000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:25:04.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-20T09:50:14.283638+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=14, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.489 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.489 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.489 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.489 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.490 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.490 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-20T09:50:20.324126+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=9, tm_min=50, tm_sec=20, tm_wday=3, tm_yday=201, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=20, tm_hour=11, tm_min=24, tm_sec=58, tm_wday=3, tm_yday=201, tm_isdst=0) 2023-07-20T11:25:04.490 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-20T11:25:15.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:15.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:24.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-20T11:25:24.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 Processor -- start 2023-07-20T11:25:24.642 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 -- start start 2023-07-20T11:25:24.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f96640c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9664159aa0 0x7f966406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9664070df0 con 0x7f966406b720 2023-07-20T11:25:24.643 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 -- --> v2:172.21.15.183:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9664159f30 con 0x7f9664159aa0 2023-07-20T11:25:24.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f966a558640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966415d4d0 con 0x7f966415cfc0 2023-07-20T11:25:24.644 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669556640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f96640c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669d57640 1 --2- >> v2:172.21.15.183:3300/0 conn(0x7f9664159aa0 0x7f966406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669556640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f96640c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3301/0 says I am v2:172.21.15.82:51956/0 (socket says 172.21.15.82:51956) 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669556640 1 -- 172.21.15.82:0/3500025694 learned_addr learned my addr 172.21.15.82:0/3500025694 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9668d55640 1 --1- 172.21.15.82:0/3500025694 >> v1:172.21.15.183:6789/0 conn(0x7f966406b720 0x7f966406bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.183:6789/0 says I am v1:172.21.15.82:34322/0 (socket says 172.21.15.82:34322) 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669d57640 1 -- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 msgr2=0x7f96640c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669d57640 1 --2- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f96640c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.645 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669d57640 1 -- 172.21.15.82:0/3500025694 >> v1:172.21.15.183:6789/0 conn(0x7f966406b720 legacy=0x7f966406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.646 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.651+0000 7f9669d57640 1 -- 172.21.15.82:0/3500025694 --> v2:172.21.15.183:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96640c8de0 con 0x7f9664159aa0 2023-07-20T11:25:24.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f9669d57640 1 --2- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f966406c270 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f965c009d90 tx=0x7f965c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e22ad03948f1159a server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.647 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f965bfff640 1 -- 172.21.15.82:0/3500025694 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0a5950 con 0x7f9664159aa0 2023-07-20T11:25:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f965bfff640 1 -- 172.21.15.82:0/3500025694 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c0a5ab0 con 0x7f9664159aa0 2023-07-20T11:25:24.648 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f965bfff640 1 -- 172.21.15.82:0/3500025694 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0a5e40 con 0x7f9664159aa0 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 -- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 msgr2=0x7f966406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 --2- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f966406c270 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f965c009d90 tx=0x7f965c01c890 comp rx=0 tx=0).stop 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 -- 172.21.15.82:0/3500025694 shutdown_connections 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 --2- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f966406c270 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 --2- 172.21.15.82:0/3500025694 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f96640c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 -- 172.21.15.82:0/3500025694 >> 172.21.15.82:0/3500025694 conn(0x7f96640ce080 msgr2=0x7f96640ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:24.649 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 -- 172.21.15.82:0/3500025694 shutdown_connections 2023-07-20T11:25:24.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.655+0000 7f966a558640 1 -- 172.21.15.82:0/3500025694 wait complete. 2023-07-20T11:25:24.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 Processor -- start 2023-07-20T11:25:24.650 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- start start 2023-07-20T11:25:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f9664150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.651 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f9664150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664150550 con 0x7f966406b720 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96640c5150 con 0x7f9664159aa0 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96640c5960 con 0x7f966415cfc0 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39126/0 (socket says 172.21.15.82:39126) 2023-07-20T11:25:24.652 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 -- 172.21.15.82:0/1968227861 learned_addr learned my addr 172.21.15.82:0/1968227861 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:24.653 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9668d55640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f9664150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669d57640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f9664150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 -- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 msgr2=0x7f9664150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f9664150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 -- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 msgr2=0x7f9664150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f9664150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 -- 172.21.15.82:0/1968227861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c009a70 con 0x7f966406b720 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9669556640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f966000e890 tx=0x7f966000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.654 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660009620 con 0x7f966406b720 2023-07-20T11:25:24.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966000c940 con 0x7f966406b720 2023-07-20T11:25:24.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966000ccf0 con 0x7f966406b720 2023-07-20T11:25:24.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664150980 con 0x7f966406b720 2023-07-20T11:25:24.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96640c53a0 con 0x7f966406b720 2023-07-20T11:25:24.655 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.659+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966404da30 con 0x7f966406b720 2023-07-20T11:25:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.663+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9660013470 con 0x7f966406b720 2023-07-20T11:25:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.663+0000 7f9659ffb640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 0x7f9648068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.656 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.663+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f9660083fb0 con 0x7f966406b720 2023-07-20T11:25:24.657 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.663+0000 7f9668d55640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 0x7f9648068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.663+0000 7f9668d55640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 0x7f9648068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96641f6650 tx=0x7f9654007c90 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.660 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.667+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9660051310 con 0x7f966406b720 2023-07-20T11:25:24.814 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.823+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 --> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96640cedd0 con 0x7f96480663d0 2023-07-20T11:25:24.817 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.823+0000 7f9659ffb640 1 -- 172.21.15.82:0/1968227861 <== mgr.11736 v2:172.21.15.82:6832/1351452777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72769 (secure 0 0 0) 0x7f9654005a60 con 0x7f96480663d0 2023-07-20T11:25:24.818 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:25:24.818 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2023-07-20T11:25:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 msgr2=0x7f9648068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.819 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 0x7f9648068890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f96641f6650 tx=0x7f9654007c90 comp rx=0 tx=0).stop 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 msgr2=0x7f966415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 secure :-1 s=READY pgs=2567 cs=0 l=1 rev1=1 crypto rx=0x7f966000e890 tx=0x7f966000ed50 comp rx=0 tx=0).stop 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 shutdown_connections 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f96480663d0 0x7f9648068890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f966415cfc0 0x7f9664150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9664159aa0 0x7f9664150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.820 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 --2- 172.21.15.82:0/1968227861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f966406b720 0x7f966415bd80 unknown :-1 s=CLOSED pgs=2567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 >> 172.21.15.82:0/1968227861 conn(0x7f96640ce080 msgr2=0x7f96640af180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 shutdown_connections 2023-07-20T11:25:24.821 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.827+0000 7f966a558640 1 -- 172.21.15.82:0/1968227861 wait complete. 2023-07-20T11:25:24.838 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-20T11:25:24.370663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":437972,"kb_used_data":21768,"kb_used_omap":13,"kb_used_meta":416114,"kb_avail":754536748,"statfs":{"total":773094113280,"available":772645629952,"internally_reserved":0,"allocated":22290432,"data_stored":12018824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":426100824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002737"},"pg_stats":[{"pgid":"1.0","version":"210'349","reported_seq":1371,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:08.496196+0000","last_change":"2023-07-20T11:25:08.496269+0000","last_active":"2023-07-20T11:25:08.496196+0000","last_peered":"2023-07-20T11:25:08.496196+0000","last_clean":"2023-07-20T11:25:08.496196+0000","last_became_active":"2023-07-20T09:50:15.296836+0000","last_became_peered":"2023-07-20T09:50:15.296836+0000","last_unstale":"2023-07-20T11:25:08.496196+0000","last_undegraded":"2023-07-20T11:25:08.496196+0000","last_fullsized":"2023-07-20T11:25:08.496196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"210'349","last_scrub_stamp":"2023-07-20T11:25:08.496084+0000","last_deep_scrub":"210'349","last_deep_scrub_stamp":"2023-07-20T11:25:08.496084+0000","last_clean_scrub_stamp":"2023-07-20T11:25:08.496084+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:43:46.550295+0000","scrub_duration":0.0074534559999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":437,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:08.674946+0000","last_change":"2023-07-20T11:25:08.674994+0000","last_active":"2023-07-20T11:25:08.674946+0000","last_peered":"2023-07-20T11:25:08.674946+0000","last_clean":"2023-07-20T11:25:08.674946+0000","last_became_active":"2023-07-20T09:50:21.343514+0000","last_became_peered":"2023-07-20T09:50:21.343514+0000","last_unstale":"2023-07-20T11:25:08.674946+0000","last_undegraded":"2023-07-20T11:25:08.674946+0000","last_fullsized":"2023-07-20T11:25:08.674946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:08.674813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:08.674813+0000","last_clean_scrub_stamp":"2023-07-20T11:25:08.674813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T15:43:56.568991+0000","scrub_duration":0.003987366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":395,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:15.515643+0000","last_change":"2023-07-20T11:25:15.515712+0000","last_active":"2023-07-20T11:25:15.515643+0000","last_peered":"2023-07-20T11:25:15.515643+0000","last_clean":"2023-07-20T11:25:15.515643+0000","last_became_active":"2023-07-20T09:50:21.346841+0000","last_became_peered":"2023-07-20T09:50:21.346841+0000","last_unstale":"2023-07-20T11:25:15.515643+0000","last_undegraded":"2023-07-20T11:25:15.515643+0000","last_fullsized":"2023-07-20T11:25:15.515643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:15.515480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:15.515480+0000","last_clean_scrub_stamp":"2023-07-20T11:25:15.515480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T18:44:05.157129+0000","scrub_duration":0.0042987060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":427,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:02.546016+0000","last_change":"2023-07-20T11:25:02.546053+0000","last_active":"2023-07-20T11:25:02.546016+0000","last_peered":"2023-07-20T11:25:02.546016+0000","last_clean":"2023-07-20T11:25:02.546016+0000","last_became_active":"2023-07-20T09:50:21.469624+0000","last_became_peered":"2023-07-20T09:50:21.469624+0000","last_unstale":"2023-07-20T11:25:02.546016+0000","last_undegraded":"2023-07-20T11:25:02.546016+0000","last_fullsized":"2023-07-20T11:25:02.546016+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:02.545928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:02.545928+0000","last_clean_scrub_stamp":"2023-07-20T11:25:02.545928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T14:29:23.274493+0000","scrub_duration":0.0037211089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":437,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:06.607443+0000","last_change":"2023-07-20T11:25:06.607495+0000","last_active":"2023-07-20T11:25:06.607443+0000","last_peered":"2023-07-20T11:25:06.607443+0000","last_clean":"2023-07-20T11:25:06.607443+0000","last_became_active":"2023-07-20T09:50:21.341994+0000","last_became_peered":"2023-07-20T09:50:21.341994+0000","last_unstale":"2023-07-20T11:25:06.607443+0000","last_undegraded":"2023-07-20T11:25:06.607443+0000","last_fullsized":"2023-07-20T11:25:06.607443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:06.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:06.607332+0000","last_clean_scrub_stamp":"2023-07-20T11:25:06.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T19:43:26.037827+0000","scrub_duration":0.0042705130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":393,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:02.906597+0000","last_change":"2023-07-20T11:25:02.906635+0000","last_active":"2023-07-20T11:25:02.906597+0000","last_peered":"2023-07-20T11:25:02.906597+0000","last_clean":"2023-07-20T11:25:02.906597+0000","last_became_active":"2023-07-20T09:50:21.469464+0000","last_became_peered":"2023-07-20T09:50:21.469464+0000","last_unstale":"2023-07-20T11:25:02.906597+0000","last_undegraded":"2023-07-20T11:25:02.906597+0000","last_fullsized":"2023-07-20T11:25:02.906597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:02.906514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:02.906514+0000","last_clean_scrub_stamp":"2023-07-20T11:25:02.906514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:50:22.443651+0000","scrub_duration":0.0033268070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":393,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:11.523888+0000","last_change":"2023-07-20T11:25:11.523938+0000","last_active":"2023-07-20T11:25:11.523888+0000","last_peered":"2023-07-20T11:25:11.523888+0000","last_clean":"2023-07-20T11:25:11.523888+0000","last_became_active":"2023-07-20T09:50:21.469243+0000","last_became_peered":"2023-07-20T09:50:21.469243+0000","last_unstale":"2023-07-20T11:25:11.523888+0000","last_undegraded":"2023-07-20T11:25:11.523888+0000","last_fullsized":"2023-07-20T11:25:11.523888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:11.523790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:11.523790+0000","last_clean_scrub_stamp":"2023-07-20T11:25:11.523790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:00:10.125893+0000","scrub_duration":0.0041443670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":391,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:05.855428+0000","last_change":"2023-07-20T11:25:05.855474+0000","last_active":"2023-07-20T11:25:05.855428+0000","last_peered":"2023-07-20T11:25:05.855428+0000","last_clean":"2023-07-20T11:25:05.855428+0000","last_became_active":"2023-07-20T09:50:21.347255+0000","last_became_peered":"2023-07-20T09:50:21.347255+0000","last_unstale":"2023-07-20T11:25:05.855428+0000","last_undegraded":"2023-07-20T11:25:05.855428+0000","last_fullsized":"2023-07-20T11:25:05.855428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:05.855320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:05.855320+0000","last_clean_scrub_stamp":"2023-07-20T11:25:05.855320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T23:23:56.204360+0000","scrub_duration":0.0039869479999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":385,"reported_epoch":210,"state":"active+clean","last_fresh":"2023-07-20T11:25:11.212992+0000","last_change":"2023-07-20T11:25:11.213035+0000","last_active":"2023-07-20T11:25:11.212992+0000","last_peered":"2023-07-20T11:25:11.212992+0000","last_clean":"2023-07-20T11:25:11.212992+0000","last_became_active":"2023-07-20T09:50:21.347606+0000","last_became_peered":"2023-07-20T09:50:21.347606+0000","last_unstale":"2023-07-20T11:25:11.212992+0000","last_undegraded":"2023-07-20T11:25:11.212992+0000","last_fullsized":"2023-07-20T11:25:11.212992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-20T11:25:11.212877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-20T11:25:11.212877+0000","last_clean_scrub_stamp":"2023-07-20T11:25:11.212877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-21T20:24:20.910509+0000","scrub_duration":0.0036041129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575979,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52316,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94319524,"statfs":{"total":96636764160,"available":96583192576,"internally_reserved":0,"allocated":3231744,"data_stored":1945129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50329867},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.38300000000000001,"15min":0.29599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.0529999999999999},"last":1.008},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92400000000000004,"5min":0.96699999999999997,"15min":1.0409999999999999},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.71499999999999997,"15min":0.72299999999999998},"min":{"1min":0.49099999999999999,"5min":0.46200000000000002,"15min":0.34000000000000002},"max":{"1min":0.90500000000000003,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":1.01,"15min":1.081},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.71199999999999997},"min":{"1min":0.55000000000000004,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":0.93000000000000005,"15min":0.97499999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.76200000000000001},"min":{"1min":0.56000000000000005,"5min":0.504,"15min":0.44600000000000001},"max":{"1min":0.93999999999999995,"5min":1.012,"15min":1.0900000000000001},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.71799999999999997,"15min":0.73899999999999999},"min":{"1min":0.61099999999999999,"5min":0.46600000000000003,"15min":0.45400000000000001},"max":{"1min":0.94899999999999995,"5min":0.997,"15min":1.0409999999999999},"last":0.878},{"interface":"front","average":{"1min":0.748,"5min":0.754,"15min":0.77200000000000002},"min":{"1min":0.54000000000000004,"5min":0.53800000000000003,"15min":0.48399999999999999},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.0509999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.29899999999999999},"max":{"1min":0.80900000000000005,"5min":1.006,"15min":1.0349999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.71299999999999997,"15min":0.68799999999999994},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.28299999999999997},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.03},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.63600000000000001},"min":{"1min":0.44900000000000001,"5min":0.38700000000000001,"15min":0.36099999999999999},"max":{"1min":0.90100000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.33000000000000002},"max":{"1min":0.88200000000000001,"5min":1.042,"15min":1.042},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jul 20 11:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.57499999999999996,"5min":0.48099999999999998,"15min":0.36799999999999999},"max":{"1min":0.88400000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.45700000000000002,"15min":0.33200000000000002},"max":{"1min":0.94599999999999995,"5min":0.97699999999999998,"15min":1.0489999999999999},"last":0.71999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575980,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.59399999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.012,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.78700000000000003},"min":{"1min":0.55700000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.998,"5min":1.0089999999999999,"15min":1.077},"last":0.754}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.53000000000000003,"5min":0.503,"15min":0.48199999999999998},"max":{"1min":0.94899999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.57499999999999996,"5min":0.51700000000000002,"15min":0.49099999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1100000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.51100000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.0640000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":0.753},"min":{"1min":0.53800000000000003,"5min":0.53400000000000003,"15min":0.505},"max":{"1min":0.98499999999999999,"5min":1.0169999999999999,"15min":1.093},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.501,"5min":0.443,"15min":0.443},"max":{"1min":0.92900000000000005,"5min":0.99399999999999999,"15min":1.0840000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.61099999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96799999999999997,"5min":0.97999999999999998,"15min":1.143},"last":0.83099999999999996}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.46899999999999997,"5min":0.34300000000000003,"15min":0.318},"max":{"1min":0.85899999999999999,"5min":0.96299999999999997,"15min":1.046},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68100000000000005,"15min":0.69799999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.33600000000000002},"max":{"1min":0.872,"5min":0.91000000000000003,"15min":1.0229999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":0.98399999999999999,"15min":1.0620000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47099999999999997,"5min":0.38900000000000001,"15min":0.36699999999999999},"max":{"1min":0.92800000000000005,"5min":0.96099999999999997,"15min":1.0700000000000001},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63900000000000001,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.46700000000000003,"15min":0.38400000000000001},"max":{"1min":0.81299999999999994,"5min":0.95299999999999996,"15min":1.097},"last":0.88},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.45800000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.93500000000000005,"15min":1.054},"last":0.86099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575978,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.42699999999999999,"5min":0.42499999999999999,"15min":0.41499999999999998},"max":{"1min":0.95599999999999996,"5min":1.107,"15min":1.107},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.745,"15min":0.747},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95999999999999996,"5min":0.99199999999999999,"15min":1.024},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46999999999999997},"max":{"1min":1.0549999999999999,"5min":1.204,"15min":1.204},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.72699999999999998,"15min":0.73899999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.38800000000000001},"max":{"1min":0.89400000000000002,"5min":1.016,"15min":1.016},"last":0.751}]},{"osd":2,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.745,"15min":0.75700000000000001},"min":{"1min":0.47299999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":0.95299999999999996,"15min":1.071},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97599999999999998,"5min":1.101,"15min":1.101},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.034,"5min":1.034,"15min":1.036},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.75,"5min":0.77500000000000002,"15min":0.77400000000000002},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.52200000000000002},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.33100000000000002},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65000000000000002,"15min":0.63900000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65200000000000002},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.378},"max":{"1min":0.99299999999999999,"5min":1.147,"15min":1.147},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.74099999999999999,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.752,"15min":0.72799999999999998},"min":{"1min":0.58699999999999997,"5min":0.435,"15min":0.435},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.63500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59932,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71099999999999997,"15min":0.72799999999999998},"min":{"1min":0.47799999999999998,"5min":0.46500000000000002,"15min":0.41199999999999998},"max":{"1min":0.97699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.50900000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.69799999999999995}]},{"osd":1,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.56200000000000006,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.71899999999999997,"15min":0.72799999999999998},"min":{"1min":0.51100000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98999999999999999,"5min":1.0229999999999999,"15min":1.1060000000000001},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77000000000000002,"15min":0.79500000000000004},"min":{"1min":0.48499999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.66900000000000004,"15min":0.64700000000000002},"min":{"1min":0.50600000000000001,"5min":0.40200000000000002,"15min":0.39300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.085},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64900000000000002,"15min":0.63},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88500000000000001,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.75},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.754}]},{"osd":7,"last update":"Thu Jul 20 11:25:09 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.90500000000000003,"5min":1.0089999999999999,"15min":1.0569999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69699999999999995,"15min":0.68999999999999995},"min":{"1min":0.42299999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93400000000000005,"5min":1.014,"15min":1.036},"last":0.82999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575978,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59936,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311904,"statfs":{"total":96636764160,"available":96575389696,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.439,"15min":0.45700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.57199999999999995,"5min":0.81200000000000006,"15min":0.88600000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.49099999999999999,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.66800000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46500000000000002,"15min":0.48999999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.61699999999999999,"5min":0.72099999999999997,"15min":0.81999999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51500000000000001,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.74099999999999999,"5min":0.86099999999999999,"15min":0.88600000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.54200000000000004,"15min":0.57299999999999995},"min":{"1min":0.39600000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76400000000000001,"5min":0.77200000000000002,"15min":0.96099999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57999999999999996,"15min":0.59899999999999998},"min":{"1min":0.39000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77100000000000002,"5min":0.90700000000000003,"15min":0.95099999999999996},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.505,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94799999999999995,"5min":1.232,"15min":1.232},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78900000000000003,"15min":0.82499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0269999999999999,"5min":1.242,"15min":1.369},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79700000000000004,"15min":0.81899999999999995},"min":{"1min":0.57899999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.129,"15min":1.1779999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.071,"5min":1.127,"15min":1.3620000000000001},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78100000000000003,"15min":0.81799999999999995},"min":{"1min":0.54400000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0189999999999999,"5min":1.2050000000000001,"15min":1.3300000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98599999999999999,"5min":1.2989999999999999,"15min":1.3240000000000001},"last":0.875}]},{"osd":7,"last update":"Thu Jul 20 11:25:11 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.81699999999999995,"15min":0.84299999999999997},"min":{"1min":0.58399999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.01,"5min":1.169,"15min":1.3999999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.80700000000000005,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0900000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.755}]}]},{"osd":2,"up_from":13,"seq":55834575978,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59928,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":57342,"kb_avail":94311912,"statfs":{"total":96636764160,"available":96575397888,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58718475},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.27100000000000002},"max":{"1min":0.57999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.28999999999999998},"max":{"1min":0.68600000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.57299999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.83399999999999996,"15min":0.83999999999999997},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.40100000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77300000000000002,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.82399999999999995,"15min":1.01},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78900000000000003,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"max":{"1min":1.167,"5min":1.167,"15min":1.375},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82999999999999996,"15min":0.83499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.141,"5min":4.2190000000000003,"15min":4.2190000000000003},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82699999999999996,"15min":0.82999999999999996},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.55100000000000005},"max":{"1min":1.1970000000000001,"5min":2.613,"15min":2.613},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79300000000000004,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1180000000000001,"5min":1.179,"15min":1.476},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81000000000000005,"15min":0.82899999999999996},"min":{"1min":0.58499999999999996,"5min":0.56399999999999995,"15min":0.503},"max":{"1min":1.139,"5min":1.153,"15min":1.494},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.80800000000000005,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"max":{"1min":1.159,"5min":1.175,"15min":1.3440000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Thu Jul 20 11:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.82199999999999995,"15min":0.82799999999999996},"min":{"1min":0.68700000000000006,"5min":0.59999999999999998,"15min":0.53800000000000003},"max":{"1min":1.1799999999999999,"5min":1.1919999999999999,"15min":1.431},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.85399999999999998},"min":{"1min":0.62,"5min":0.61099999999999999,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575979,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37784,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94334056,"statfs":{"total":96636764160,"available":96598073344,"internally_reserved":0,"allocated":2637824,"data_stored":1354761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66900000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65300000000000002,"5min":0.73199999999999998,"15min":0.78500000000000003},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47799999999999998,"15min":0.5},"min":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.33200000000000002},"max":{"1min":0.50600000000000001,"5min":0.753,"15min":0.753},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52700000000000002,"15min":0.54600000000000004},"min":{"1min":0.35399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67500000000000004,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68400000000000005}]},{"osd":3,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.59199999999999997},"min":{"1min":0.45800000000000002,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.75700000000000001,"15min":1.2050000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.54500000000000004},"min":{"1min":0.39900000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.60699999999999998,"5min":0.85299999999999998,"15min":1.0109999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.998,"5min":1.095,"15min":1.4790000000000001},"last":1.018},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.998,"5min":1.0740000000000001,"15min":1.26},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55600000000000005},"max":{"1min":0.96699999999999997,"5min":1.137,"15min":1.175},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.78400000000000003,"15min":0.81499999999999995},"min":{"1min":0.54200000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.92100000000000004,"5min":1.083,"15min":1.4339999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78100000000000003,"15min":0.81100000000000005},"min":{"1min":0.55700000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89900000000000002,"5min":1.095,"15min":1.1910000000000001},"last":1.095},{"interface":"front","average":{"1min":0.755,"5min":0.79800000000000004,"15min":0.81999999999999995},"min":{"1min":0.54600000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0429999999999999,"5min":1.155,"15min":1.3089999999999999},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:25:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.82499999999999996,"15min":0.83999999999999997},"min":{"1min":0.60599999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":0.95899999999999996,"5min":1.1579999999999999,"15min":1.242},"last":1.1180000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.79100000000000004,"15min":0.82299999999999995},"min":{"1min":0.59399999999999997,"5min":0.58299999999999996,"15min":0.56200000000000006},"max":{"1min":1.0089999999999999,"5min":1.052,"15min":1.2789999999999999},"last":0.93100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575979,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48220,"kb_used_data":3156,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323620,"statfs":{"total":96636764160,"available":96587386880,"internally_reserved":0,"allocated":3231744,"data_stored":1945129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.314,"5min":0.29799999999999999,"15min":0.254},"max":{"1min":0.71699999999999997,"5min":1.302,"15min":1.302},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.50600000000000001,"15min":0.53100000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.92000000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.51400000000000001,"15min":0.52600000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.29799999999999999},"max":{"1min":0.66100000000000003,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.54600000000000004,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61599999999999999,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.371,"15min":0.35399999999999998},"max":{"1min":0.82199999999999995,"5min":1.282,"15min":1.282},"last":0.373},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59099999999999997,"15min":0.59899999999999998},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.36399999999999999},"max":{"1min":0.68999999999999995,"5min":1.347,"15min":1.347},"last":0.51300000000000001}]},{"osd":4,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.77900000000000003,"15min":0.81599999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.80200000000000005,"5min":1.3720000000000001,"15min":1.3799999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.80100000000000005,"15min":0.81799999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59099999999999997},"max":{"1min":0.93300000000000005,"5min":1.577,"15min":1.577},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.59199999999999997,"5min":0.54200000000000004,"15min":0.52600000000000002},"max":{"1min":0.84499999999999997,"5min":1.3129999999999999,"15min":1.379},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79400000000000004,"15min":0.82999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90300000000000002,"5min":1.331,"15min":1.4339999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96799999999999997,"5min":1.625,"15min":1.625},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.80200000000000005,"15min":0.83799999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.93300000000000005,"5min":1.355,"15min":1.355},"last":0.83899999999999997}]},{"osd":7,"last update":"Thu Jul 20 11:25:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.81599999999999995,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.89800000000000002,"5min":1.1439999999999999,"15min":1.2589999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.60999999999999999,"5min":0.57399999999999995,"15min":0.56899999999999995},"max":{"1min":0.86199999999999999,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.96299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-20T11:25:24.841 DEBUG:teuthology.orchestra.run.smithi082:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-20T11:25:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 Processor -- start 2023-07-20T11:25:24.978 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 -- start start 2023-07-20T11:25:24.979 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f95d0158ce0 0x7f95d00c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00c95d0 con 0x7f95d0070970 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00c9fa0 con 0x7f95d006bd30 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95d52cb640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d01590c0 con 0x7f95d0158ce0 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ceffd640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7f95d0158ce0 0x7f95d00c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ce7fc640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7f95d0070970 0x7f95d006b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43392/0 (socket says 172.21.15.82:43392) 2023-07-20T11:25:24.980 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ce7fc640 1 -- 172.21.15.82:0/4081607475 learned_addr learned my addr 172.21.15.82:0/4081607475 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ceffd640 1 -- 172.21.15.82:0/4081607475 >> v1:172.21.15.183:6789/0 conn(0x7f95d006bd30 legacy=0x7f95d00cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ceffd640 1 -- 172.21.15.82:0/4081607475 >> v1:172.21.15.82:6789/0 conn(0x7f95d0070970 legacy=0x7f95d006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95ceffd640 1 -- 172.21.15.82:0/4081607475 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00c89c0 con 0x7f95d0158ce0 2023-07-20T11:25:24.981 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.987+0000 7f95cdffb640 1 -- 172.21.15.82:0/4081607475 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594416818 0 0) 0x7f95d00c95d0 con 0x7f95d0070970 2023-07-20T11:25:24.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95ceffd640 1 --2- 172.21.15.82:0/4081607475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d0158ce0 0x7f95d00c9a60 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f95c000a960 tx=0x7f95c001d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da28017188621e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95cdffb640 1 -- 172.21.15.82:0/4081607475 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00a6890 con 0x7f95d0158ce0 2023-07-20T11:25:24.983 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95cdffb640 1 -- 172.21.15.82:0/4081607475 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00a69f0 con 0x7f95d0158ce0 2023-07-20T11:25:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95cdffb640 1 -- 172.21.15.82:0/4081607475 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00a6d80 con 0x7f95d0158ce0 2023-07-20T11:25:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 -- 172.21.15.82:0/4081607475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d0158ce0 msgr2=0x7f95d00c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.984 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4081607475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d0158ce0 0x7f95d00c9a60 secure :-1 s=READY pgs=2569 cs=0 l=1 rev1=1 crypto rx=0x7f95c000a960 tx=0x7f95c001d7e0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 -- 172.21.15.82:0/4081607475 shutdown_connections 2023-07-20T11:25:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4081607475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d0158ce0 0x7f95d00c9a60 unknown :-1 s=CLOSED pgs=2569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 -- 172.21.15.82:0/4081607475 >> 172.21.15.82:0/4081607475 conn(0x7f95d00cad50 msgr2=0x7f95d00cb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 -- 172.21.15.82:0/4081607475 shutdown_connections 2023-07-20T11:25:24.985 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.991+0000 7f95d52cb640 1 -- 172.21.15.82:0/4081607475 wait complete. 2023-07-20T11:25:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 Processor -- start 2023-07-20T11:25:24.986 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- start start 2023-07-20T11:25:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d0070970 0x7f95d01467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0158ce0 0x7f95d00c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.987 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00c1e00 con 0x7f95d006bd30 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b3f60 con 0x7f95d0158ce0 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d015bf40 con 0x7f95d0070970 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39148/0 (socket says 172.21.15.82:39148) 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 -- 172.21.15.82:0/4196644894 learned_addr learned my addr 172.21.15.82:0/4196644894 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ce7fc640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d0070970 0x7f95d01467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.988 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95cf7fe640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0158ce0 0x7f95d00c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.989 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 -- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d0070970 msgr2=0x7f95d01467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d0070970 0x7f95d01467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 -- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0158ce0 msgr2=0x7f95d00c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0158ce0 0x7f95d00c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 -- 172.21.15.82:0/4196644894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c000a5c0 con 0x7f95d006bd30 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95ceffd640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b1040 tx=0x7f95c001a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b9910 con 0x7f95d006bd30 2023-07-20T11:25:24.990 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00b9a90 con 0x7f95d006bd30 2023-07-20T11:25:24.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00b9e40 con 0x7f95d006bd30 2023-07-20T11:25:24.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d00c2010 con 0x7f95d006bd30 2023-07-20T11:25:24.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d00c25d0 con 0x7f95d006bd30 2023-07-20T11:25:24.991 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.995+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d015c220 con 0x7f95d006bd30 2023-07-20T11:25:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.999+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f95c00b5040 con 0x7f95d006bd30 2023-07-20T11:25:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.999+0000 7f95b77fe640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 0x7f95bc068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.999+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7f95c011e9c0 con 0x7f95d006bd30 2023-07-20T11:25:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.999+0000 7f95ce7fc640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 0x7f95bc068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:24.992 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:24.999+0000 7f95ce7fc640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 0x7f95bc068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95d00b3620 tx=0x7f95c4007d60 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:24.996 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.003+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95c00ebef0 con 0x7f95d006bd30 2023-07-20T11:25:25.143 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.151+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f95d00c9230 con 0x7f95d006bd30 2023-07-20T11:25:25.148 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.155+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95c00ebef0 con 0x7f95d006bd30 2023-07-20T11:25:25.149 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.155+0000 7f95b77fe640 1 -- 172.21.15.82:0/4196644894 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f95c00ef510 con 0x7f95d006bd30 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 msgr2=0x7f95bc068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 0x7f95bc068860 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95d00b3620 tx=0x7f95c4007d60 comp rx=0 tx=0).stop 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 msgr2=0x7f95d00b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 secure :-1 s=READY pgs=2570 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b1040 tx=0x7f95c001a580 comp rx=0 tx=0).stop 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 shutdown_connections 2023-07-20T11:25:25.152 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7f95bc0663a0 0x7f95bc068860 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d0158ce0 0x7f95d00c2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7f95d0070970 0x7f95d01467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 --2- 172.21.15.82:0/4196644894 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95d006bd30 0x7f95d00b0ef0 unknown :-1 s=CLOSED pgs=2570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 >> 172.21.15.82:0/4196644894 conn(0x7f95d00cad50 msgr2=0x7f95d00cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 shutdown_connections 2023-07-20T11:25:25.153 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.159+0000 7f95d52cb640 1 -- 172.21.15.82:0/4196644894 wait complete. 2023-07-20T11:25:25.171 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-20T11:25:25.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-20T11:25:25.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 Processor -- start 2023-07-20T11:25:25.310 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 -- start start 2023-07-20T11:25:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb08c15c5f0 0x7fb08c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 -- --> v1:172.21.15.82:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c0b7c20 con 0x7fb08c0ceb70 2023-07-20T11:25:25.311 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 -- --> v1:172.21.15.183:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c15c9d0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092c08640 1 -- --> v2:172.21.15.82:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0ce030 con 0x7fb08c15c5f0 2023-07-20T11:25:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb091c06640 1 --2- >> v2:172.21.15.82:3300/0 conn(0x7fb08c15c5f0 0x7fb08c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092407640 1 --1- >> v1:172.21.15.82:6789/0 conn(0x7fb08c0ceb70 0x7fb08c0b0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.82:6789/0 says I am v1:172.21.15.82:43394/0 (socket says 172.21.15.82:43394) 2023-07-20T11:25:25.312 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb092407640 1 -- 172.21.15.82:0/2981180890 learned_addr learned my addr 172.21.15.82:0/2981180890 (peer_addr_for_me v1:172.21.15.82:0/0) 2023-07-20T11:25:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb090c04640 1 -- 172.21.15.82:0/2981180890 <== mon.0 v1:172.21.15.82:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381096892 0 0) 0x7fb08c0b7c20 con 0x7fb08c0ceb70 2023-07-20T11:25:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb090c04640 1 -- 172.21.15.82:0/2981180890 --> v1:172.21.15.82:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb078003530 con 0x7fb08c0ceb70 2023-07-20T11:25:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb091c06640 1 -- 172.21.15.82:0/2981180890 >> v1:172.21.15.183:6789/0 conn(0x7fb08c0ccfb0 legacy=0x7fb08c0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-20T11:25:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb091c06640 1 -- 172.21.15.82:0/2981180890 >> v1:172.21.15.82:6789/0 conn(0x7fb08c0ceb70 legacy=0x7fb08c0b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.313 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.319+0000 7fb091c06640 1 -- 172.21.15.82:0/2981180890 --> v2:172.21.15.82:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0cd4b0 con 0x7fb08c15c5f0 2023-07-20T11:25:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb091c06640 1 --2- 172.21.15.82:0/2981180890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c15c5f0 0x7fb08c0b4270 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fb088009d90 tx=0x7fb08801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2101e95b85363cb server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb090c04640 1 -- 172.21.15.82:0/2981180890 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880af600 con 0x7fb08c15c5f0 2023-07-20T11:25:25.315 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb090c04640 1 -- 172.21.15.82:0/2981180890 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb0880ab050 con 0x7fb08c15c5f0 2023-07-20T11:25:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb090c04640 1 -- 172.21.15.82:0/2981180890 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880af9a0 con 0x7fb08c15c5f0 2023-07-20T11:25:25.316 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 -- 172.21.15.82:0/2981180890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c15c5f0 msgr2=0x7fb08c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 --2- 172.21.15.82:0/2981180890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c15c5f0 0x7fb08c0b4270 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7fb088009d90 tx=0x7fb08801f100 comp rx=0 tx=0).stop 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 -- 172.21.15.82:0/2981180890 shutdown_connections 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 --2- 172.21.15.82:0/2981180890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c15c5f0 0x7fb08c0b4270 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 -- 172.21.15.82:0/2981180890 >> 172.21.15.82:0/2981180890 conn(0x7fb08c065710 msgr2=0x7fb08c065b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 -- 172.21.15.82:0/2981180890 shutdown_connections 2023-07-20T11:25:25.317 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.323+0000 7fb092c08640 1 -- 172.21.15.82:0/2981180890 wait complete. 2023-07-20T11:25:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 Processor -- start 2023-07-20T11:25:25.318 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- start start 2023-07-20T11:25:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 --2- >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08c0ceb70 0x7fb08c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08c15c5f0 0x7fb08c15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15d9c0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.319 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c154bf0 con 0x7fb08c15c5f0 2023-07-20T11:25:25.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- --> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c152060 con 0x7fb08c0ceb70 2023-07-20T11:25:25.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:25.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39168/0 (socket says 172.21.15.82:39168) 2023-07-20T11:25:25.320 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 -- 172.21.15.82:0/3004147658 learned_addr learned my addr 172.21.15.82:0/3004147658 (peer_addr_for_me v2:172.21.15.82:0/0) 2023-07-20T11:25:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 -- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08c0ceb70 msgr2=0x7fb08c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08c0ceb70 0x7fb08c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.321 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 -- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08c15c5f0 msgr2=0x7fb08c15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08c15c5f0 0x7fb08c15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 -- 172.21.15.82:0/3004147658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088009a70 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb091c06640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fb0880b2040 tx=0x7fb08801bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088009450 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb0880b9410 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c158ae0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.322 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880b97c0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c158240 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.327+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c152920 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.323 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.331+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 130) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb0880b6050 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.331+0000 7fb0827fc640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 0x7fb070068860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-20T11:25:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.331+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 6056+0+0 (secure 0 0 0) 0x7fb0881224e0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.331+0000 7fb091405640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 0x7fb070068860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-20T11:25:25.324 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.331+0000 7fb091405640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 0x7fb070068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0cb7e0 tx=0x7fb07c0079c0 comp rx=0 tx=0).ready entity=mgr.11736 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-20T11:25:25.326 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.335+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb08c152920 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.506 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb08c15c9d0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.507 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb0827fc640 1 -- 172.21.15.82:0/3004147658 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+3540 (secure 0 0 0) 0x7fb0880b4df0 con 0x7fb08c0ccfb0 2023-07-20T11:25:25.507 INFO:teuthology.orchestra.run.smithi082.stdout: 2023-07-20T11:25:25.507 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":101,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6834/2783824995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":2783824995},{"type":"v1","addr":"172.21.15.183:6834","nonce":2783824995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10399,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/3342574607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6833","nonce":3342574607},{"type":"v1","addr":"172.21.15.183:6835","nonce":3342574607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":11415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6836/1511093174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":1511093174},{"type":"v1","addr":"172.21.15.82:6836","nonce":1511093174}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":11889,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2398283555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6835","nonce":2398283555},{"type":"v1","addr":"172.21.15.82:6837","nonce":2398283555}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[]} 2023-07-20T11:25:25.508 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 101 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 msgr2=0x7fb070068860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 0x7fb070068860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0cb7e0 tx=0x7fb07c0079c0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 msgr2=0x7fb08c151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fb0880b2040 tx=0x7fb08801bea0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 shutdown_connections 2023-07-20T11:25:25.509 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:6832/1351452777,v1:172.21.15.82:6833/1351452777] conn(0x7fb0700663a0 0x7fb070068860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb08c15c5f0 0x7fb08c15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.183:3301/0,v1:172.21.15.183:6790/0] conn(0x7fb08c0ceb70 0x7fb08c15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 --2- 172.21.15.82:0/3004147658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb08c0ccfb0 0x7fb08c151b20 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 >> 172.21.15.82:0/3004147658 conn(0x7fb08c065710 msgr2=0x7fb08c15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 shutdown_connections 2023-07-20T11:25:25.510 INFO:teuthology.orchestra.run.smithi082.stderr:2023-07-20T11:25:25.515+0000 7fb092c08640 1 -- 172.21.15.82:0/3004147658 wait complete. 2023-07-20T11:25:25.528 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-20T11:25:25.528 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-20T11:25:25.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-20T11:25:25.529 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:25.541 INFO:tasks.ceph.mds.a:Stopped 2023-07-20T11:25:25.541 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-20T11:25:25.541 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:25.597 INFO:tasks.ceph.mds.c:Stopped 2023-07-20T11:25:25.598 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-20T11:25:25.598 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:25.613 INFO:tasks.ceph.mds.b:Stopped 2023-07-20T11:25:25.614 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-20T11:25:25.614 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:25.672 INFO:tasks.ceph.mds.d:Stopped 2023-07-20T11:25:25.673 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-20T11:25:25.673 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-20T11:25:25.674 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:25.754 INFO:tasks.ceph.osd.0:Stopped 2023-07-20T11:25:25.831 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-20T11:25:25.832 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:31.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-07-20T11:25:31.934 INFO:tasks.ceph.osd.1:Stopped 2023-07-20T11:25:31.935 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-20T11:25:31.935 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:32.007 INFO:tasks.ceph.osd.2:Stopped 2023-07-20T11:25:32.008 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-20T11:25:32.008 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:32.108 INFO:tasks.ceph.osd.3:Stopped 2023-07-20T11:25:32.109 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-20T11:25:32.109 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:32.205 INFO:tasks.ceph.osd.4:Stopped 2023-07-20T11:25:32.205 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-20T11:25:32.206 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:37.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-20T11:25:37.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-07-20T11:25:38.307 INFO:tasks.ceph.osd.5:Stopped 2023-07-20T11:25:38.308 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-20T11:25:38.308 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:38.372 INFO:tasks.ceph.osd.6:Stopped 2023-07-20T11:25:38.372 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-20T11:25:38.372 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:42.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-20T11:25:42.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-20T11:25:44.474 INFO:tasks.ceph.osd.7:Stopped 2023-07-20T11:25:44.474 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-20T11:25:44.475 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-20T11:25:44.475 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:44.538 INFO:tasks.ceph.mgr.y:Stopped 2023-07-20T11:25:44.539 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-20T11:25:44.539 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:44.592 INFO:tasks.ceph.mgr.x:Stopped 2023-07-20T11:25:44.593 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-20T11:25:44.593 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-20T11:25:44.593 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:44.624 INFO:tasks.ceph.mon.a:Stopped 2023-07-20T11:25:44.625 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-20T11:25:44.626 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:44.649 INFO:tasks.ceph.mon.b:Stopped 2023-07-20T11:25:44.649 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-20T11:25:44.650 INFO:teuthology.orchestra.run:waiting for 300 2023-07-20T11:25:44.713 INFO:tasks.ceph.mon.c:Stopped 2023-07-20T11:25:44.713 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-20T11:25:44.714 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-20T11:25:44.744 INFO:teuthology.orchestra.run.smithi082.stdout:2023-07-20T09:52:37.831387+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-20T11:25:44.745 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-20T11:25:44.746 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-20T11:25:44.824 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-20T11:25:44.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-20T11:25:44.974 INFO:teuthology.orchestra.run.smithi082.stdout:2023-07-20T09:52:37.831387+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-20T11:25:44.976 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:25:44.977 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-20T11:25:45.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:25:45.493 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-20T11:25:45.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:25:45.981 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-20T11:25:46.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:46.318 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:46.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:25:46.345 DEBUG:teuthology.orchestra.run.smithi082:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-20T11:25:46.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T11:25:46.809 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-20T11:25:47.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T11:25:47.214 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-20T11:25:47.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-20T11:25:47.606 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T11:25:47.606 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-20T11:25:48.046 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T11:25:48.046 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-20T11:25:48.473 INFO:tasks.ceph:Archiving mon data... 2023-07-20T11:25:48.475 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/data/mon.a.tgz 2023-07-20T11:25:48.475 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2023-07-20T11:25:48.484 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.1JCrbmdc3u 2023-07-20T11:25:48.485 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1JCrbmdc3u 2023-07-20T11:25:48.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.1JCrbmdc3u 2023-07-20T11:25:49.046 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.1JCrbmdc3u is 3MB 2023-07-20T11:25:49.158 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.1JCrbmdc3u 2023-07-20T11:25:49.168 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/data/mon.b.tgz 2023-07-20T11:25:49.169 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-07-20T11:25:49.178 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.1trbdD8xz3 2023-07-20T11:25:49.179 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.1trbdD8xz3 2023-07-20T11:25:49.671 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.1trbdD8xz3 2023-07-20T11:25:49.751 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.1trbdD8xz3 is 3MB 2023-07-20T11:25:49.839 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.1trbdD8xz3 2023-07-20T11:25:49.848 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/data/mon.c.tgz 2023-07-20T11:25:49.849 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-07-20T11:25:49.898 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.tCvpj0Wfm3 2023-07-20T11:25:49.898 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tCvpj0Wfm3 2023-07-20T11:25:50.384 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.tCvpj0Wfm3 2023-07-20T11:25:50.459 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.tCvpj0Wfm3 is 3MB 2023-07-20T11:25:50.551 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.tCvpj0Wfm3 2023-07-20T11:25:50.561 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-20T11:25:50.561 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-20T11:25:50.565 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-20T11:25:50.623 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-20T11:25:50.623 DEBUG:teuthology.orchestra.run.smithi082:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-20T11:25:50.637 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-20T11:25:50.677 INFO:teuthology.orchestra.run.smithi082.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-20T11:25:50.700 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-20T11:25:50.707 INFO:tasks.ceph:Archiving crash dumps... 2023-07-20T11:25:50.714 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi082/crash 2023-07-20T11:25:50.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-20T11:25:50.751 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi183/crash 2023-07-20T11:25:50.756 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-20T11:25:50.777 INFO:tasks.ceph:Shutting down logrotate 2023-07-20T11:25:50.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:50.804 DEBUG:teuthology.orchestra.run.smithi183:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:50.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:50.892 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-20T11:25:50.913 INFO:tasks.ceph:Compressing logs... 2023-07-20T11:25:50.913 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-20T11:25:50.941 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-20T11:25:50.981 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60831.log 2023-07-20T11:25:50.981 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70954.log 2023-07-20T11:25:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66913.log 2023-07-20T11:25:50.982 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60831.log.gz 2023-07-20T11:25:50.982 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52977.log 2023-07-20T11:25:50.983 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70954.log.gz 2023-07-20T11:25:50.983 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55537.log 2023-07-20T11:25:50.983 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66913.log.gz 2023-07-20T11:25:50.984 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2023-07-20T11:25:50.984 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52977.log.gz 2023-07-20T11:25:50.985 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53738.log 88.3% 2023-07-20T11:25:50.985 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55537.log.gz 2023-07-20T11:25:50.985 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43565.log 2023-07-20T11:25:50.986 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2023-07-20T11:25:50.986 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2023-07-20T11:25:50.987 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37755.log 2023-07-20T11:25:50.987 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2023-07-20T11:25:50.988 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz 2023-07-20T11:25:50.989 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43473.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gz 2023-07-20T11:25:50.989 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55431.log 2023-07-20T11:25:50.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.3.43565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43565.log.gz 2023-07-20T11:25:50.989 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2023-07-20T11:25:50.989 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37731.log 2023-07-20T11:25:50.990 INFO:teuthology.orchestra.run.smithi183.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37755.log.gz 2023-07-20T11:25:50.990 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37683.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2023-07-20T11:25:50.991 INFO:teuthology.orchestra.run.smithi183.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-20T11:25:50.991 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37731.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-20T11:25:50.991 INFO:teuthology.orchestra.run.smithi183.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37731.log.gz 2023-07-20T11:25:50.992 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43050.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2023-07-20T11:25:50.992 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50254.log 2023-07-20T11:25:50.992 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55431.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55431.log.gz 2023-07-20T11:25:50.992 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2023-07-20T11:25:50.993 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50254.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.50254.log.gz 2023-07-20T11:25:50.993 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55797.log 2023-07-20T11:25:50.994 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2023-07-20T11:25:50.994 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2023-07-20T11:25:50.994 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2023-07-20T11:25:50.994 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.55797.log.gz 2023-07-20T11:25:50.995 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37634.log 2023-07-20T11:25:50.995 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2023-07-20T11:25:50.995 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37634.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37634.log.gz 2023-07-20T11:25:50.995 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-20T11:25:50.995 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43480.log 2023-07-20T11:25:50.996 INFO:teuthology.orchestra.run.smithi183.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2023-07-20T11:25:50.997 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-20T11:25:50.997 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.43480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43480.log.gz 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44979.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56015.log 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50939.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53853.log 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47584.log 2023-07-20T11:25:50.998 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56015.log.gz 2023-07-20T11:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53660.log 2023-07-20T11:25:50.999 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53853.log.gz 2023-07-20T11:25:51.000 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2023-07-20T11:25:51.000 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-20T11:25:51.001 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gz 2023-07-20T11:25:51.001 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-20T11:25:51.001 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.47584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47584.log.gz 2023-07-20T11:25:51.001 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63875.log 2023-07-20T11:25:51.002 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2023-07-20T11:25:51.002 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53660.log.gz 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63875.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.67342.log -- replaced with /var/log/ceph/ceph-client.admin.63875.log.gz 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48887.log 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2023-07-20T11:25:51.004 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2023-07-20T11:25:51.005 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67342.log.gz 2023-07-20T11:25:51.005 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43489.log 2023-07-20T11:25:51.006 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51453.log 2023-07-20T11:25:51.006 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48887.log.gz 2023-07-20T11:25:51.006 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46947.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2023-07-20T11:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45904.log 2023-07-20T11:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.51453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51453.log.gz 2023-07-20T11:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2023-07-20T11:25:51.007 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45904.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.45904.log.gz --verbose 2023-07-20T11:25:51.008 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.50291.log 2023-07-20T11:25:51.008 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2023-07-20T11:25:51.008 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2023-07-20T11:25:51.009 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68892.log 2023-07-20T11:25:51.009 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2023-07-20T11:25:51.010 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62180.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz /var/log/ceph/ceph-client.admin.66587.log 2023-07-20T11:25:51.010 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.011 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68892.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68892.log.gz 2023-07-20T11:25:51.011 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2023-07-20T11:25:51.012 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65403.log 2023-07-20T11:25:51.012 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66587.log.gz 2023-07-20T11:25:51.013 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.d.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-20T11:25:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48186.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2023-07-20T11:25:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2023-07-20T11:25:51.014 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67210.log 2023-07-20T11:25:51.015 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65403.log.gz 2023-07-20T11:25:51.015 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37781.log 2023-07-20T11:25:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52627.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2023-07-20T11:25:51.016 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51603.log 2023-07-20T11:25:51.017 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56999.log 2023-07-20T11:25:51.017 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67210.log.gz 2023-07-20T11:25:51.018 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.1.43489.log: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-20T11:25:51.018 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43489.log.gz 2023-07-20T11:25:51.018 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37707.log 2023-07-20T11:25:51.019 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51603.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 88.9% 2023-07-20T11:25:51.019 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51603.log.gz 2023-07-20T11:25:51.019 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68814.log 2023-07-20T11:25:51.019 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56999.log.gz 2023-07-20T11:25:51.020 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2023-07-20T11:25:51.021 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68814.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.68814.log.gz -- 2023-07-20T11:25:51.021 INFO:teuthology.orchestra.run.smithi082.stderr: /var/log/ceph/ceph-client.admin.56850.log 2023-07-20T11:25:51.021 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37781.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-20T11:25:51.021 INFO:teuthology.orchestra.run.smithi183.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37781.log.gz 2023-07-20T11:25:51.022 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.37707.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-20T11:25:51.022 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mds.b.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37707.log.gz 2023-07-20T11:25:51.023 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42927.log 2023-07-20T11:25:51.023 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2023-07-20T11:25:51.023 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56850.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56850.log.gz 2023-07-20T11:25:51.023 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61669.log 2023-07-20T11:25:51.024 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-20T11:25:51.024 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.42927.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gz 2023-07-20T11:25:51.025 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64493.log 2023-07-20T11:25:51.025 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61669.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61669.log.gz 2023-07-20T11:25:51.025 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47916.log 2023-07-20T11:25:51.026 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2023-07-20T11:25:51.026 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63328.log 2023-07-20T11:25:51.026 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47916.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47916.log.gz 2023-07-20T11:25:51.027 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48807.log 2023-07-20T11:25:51.027 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63328.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63328.log.gz 2023-07-20T11:25:51.028 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2023-07-20T11:25:51.028 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48807.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48807.log.gz 2023-07-20T11:25:51.029 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57550.log 2023-07-20T11:25:51.030 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57337.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2023-07-20T11:25:51.030 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50060.log 2023-07-20T11:25:51.031 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57550.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57550.log.gz 2023-07-20T11:25:51.031 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65066.log 2023-07-20T11:25:51.032 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50060.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50060.log.gz 2023-07-20T11:25:51.032 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69906.log 2023-07-20T11:25:51.033 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65066.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65066.log.gz 2023-07-20T11:25:51.033 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43839.log 2023-07-20T11:25:51.034 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69906.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69906.log.gz 2023-07-20T11:25:51.034 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61460.log 2023-07-20T11:25:51.035 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59771.log 2023-07-20T11:25:51.035 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43839.log.gz 2023-07-20T11:25:51.036 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70551.log 2023-07-20T11:25:51.037 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61460.log.gz 2023-07-20T11:25:51.037 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59771.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59771.log.gz 2023-07-20T11:25:51.038 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47985.log 2023-07-20T11:25:51.038 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66141.log 2023-07-20T11:25:51.038 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70551.log.gz 2023-07-20T11:25:51.039 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59344.log 87.4% 2023-07-20T11:25:51.039 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47985.log.gz 2023-07-20T11:25:51.040 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43570.log 2023-07-20T11:25:51.040 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47025.log 2023-07-20T11:25:51.041 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66141.log.gz 2023-07-20T11:25:51.041 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59344.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59344.log.gz 2023-07-20T11:25:51.041 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45795.log 2023-07-20T11:25:51.042 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72964.log 2023-07-20T11:25:51.043 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47025.log.gz 2023-07-20T11:25:51.043 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45795.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45795.log.gz 2023-07-20T11:25:51.043 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55210.log 2023-07-20T11:25:51.044 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72964.log: gzip -5 --verbose -- 88.9% /var/log/ceph/ceph-client.admin.65092.log -- replaced with /var/log/ceph/ceph-client.admin.72964.log.gz 2023-07-20T11:25:51.045 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.045 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55210.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55210.log.gz 2023-07-20T11:25:51.046 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58972.log 2023-07-20T11:25:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68665.log 2023-07-20T11:25:51.047 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65092.log.gz 2023-07-20T11:25:51.047 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58972.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58972.log.gz 2023-07-20T11:25:51.048 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71550.log 2023-07-20T11:25:51.049 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57963.log 2023-07-20T11:25:51.049 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68665.log.gz 2023-07-20T11:25:51.050 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71550.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71550.log.gz 2023-07-20T11:25:51.051 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61155.log 2023-07-20T11:25:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.57963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57963.log.gz 2023-07-20T11:25:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2023-07-20T11:25:51.052 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61155.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61155.log.gz 2023-07-20T11:25:51.052 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58426.log 2023-07-20T11:25:51.053 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54331.log 2023-07-20T11:25:51.053 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2023-07-20T11:25:51.054 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70787.log 2023-07-20T11:25:51.054 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58426.log.gz 2023-07-20T11:25:51.055 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54331.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.54331.log.gz 2023-07-20T11:25:51.055 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.60132.log 2023-07-20T11:25:51.056 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59494.log 2023-07-20T11:25:51.056 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70787.log.gz 2023-07-20T11:25:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.60132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60132.log.gz 2023-07-20T11:25:51.057 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2023-07-20T11:25:51.058 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59494.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59494.log.gz 2023-07-20T11:25:51.058 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57444.log 2023-07-20T11:25:51.059 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48294.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2023-07-20T11:25:51.059 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49271.log 2023-07-20T11:25:51.060 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57444.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.64050.log -- replaced with /var/log/ceph/ceph-client.admin.57444.log.gz 2023-07-20T11:25:51.060 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.061 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2023-07-20T11:25:51.061 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49271.log.gz 2023-07-20T11:25:51.062 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70865.log 2023-07-20T11:25:51.062 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64050.log.gz 2023-07-20T11:25:51.063 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 89.1% 2023-07-20T11:25:51.063 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2023-07-20T11:25:51.064 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2023-07-20T11:25:51.064 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70865.log.gz 2023-07-20T11:25:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53372.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2023-07-20T11:25:51.065 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64665.log 2023-07-20T11:25:51.066 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 88.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz -- 2023-07-20T11:25:51.066 INFO:teuthology.orchestra.run.smithi082.stderr: /var/log/ceph/ceph-client.admin.47353.log 2023-07-20T11:25:51.067 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64665.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.64665.log.gz 2023-07-20T11:25:51.067 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66639.log 2023-07-20T11:25:51.068 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48833.log 2023-07-20T11:25:51.068 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2023-07-20T11:25:51.069 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66639.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-20T11:25:51.069 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66639.log.gz 2023-07-20T11:25:51.070 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54363.log 2023-07-20T11:25:51.070 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48833.log.gz 2023-07-20T11:25:51.071 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55289.log 2023-07-20T11:25:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54363.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54363.log.gz 2023-07-20T11:25:51.072 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2023-07-20T11:25:51.073 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.3.43570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43570.log.gz 2023-07-20T11:25:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64206.log 2023-07-20T11:25:51.074 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55289.log.gz 2023-07-20T11:25:51.074 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43076.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2023-07-20T11:25:51.075 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48971.log 2023-07-20T11:25:51.076 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68472.log 2023-07-20T11:25:51.076 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64206.log.gz 2023-07-20T11:25:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48971.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48971.log.gz 2023-07-20T11:25:51.077 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61722.log 2023-07-20T11:25:51.078 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2023-07-20T11:25:51.078 INFO:teuthology.orchestra.run.smithi082.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.68472.log.gz 2023-07-20T11:25:51.080 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61722.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61722.log.gz 2023-07-20T11:25:51.080 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73642.log 2023-07-20T11:25:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70434.log 2023-07-20T11:25:51.081 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2023-07-20T11:25:51.081 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73642.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73642.log.gz 2023-07-20T11:25:51.082 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44031.log 2023-07-20T11:25:51.082 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70434.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70434.log.gz 2023-07-20T11:25:51.083 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68762.log 2023-07-20T11:25:51.084 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44031.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.44031.log.gz 2023-07-20T11:25:51.084 INFO:teuthology.orchestra.run.smithi082.stderr: /var/log/ceph/ceph-client.admin.42953.log 2023-07-20T11:25:51.085 INFO:teuthology.orchestra.run.smithi183.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-20T11:25:51.085 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55000.log 2023-07-20T11:25:51.085 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.68762.log.gz 2023-07-20T11:25:51.086 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.42953.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42953.log.gz 2023-07-20T11:25:51.086 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59180.log 2023-07-20T11:25:51.087 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73408.log 2023-07-20T11:25:51.087 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55000.log.gz 2023-07-20T11:25:51.088 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59180.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59180.log.gz 2023-07-20T11:25:51.088 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54298.log 2023-07-20T11:25:51.089 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2023-07-20T11:25:51.090 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73408.log.gz 2023-07-20T11:25:51.090 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54298.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54298.log.gz 2023-07-20T11:25:51.091 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58263.log 2023-07-20T11:25:51.092 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70980.log 2023-07-20T11:25:51.092 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2023-07-20T11:25:51.093 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58263.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58263.log.gz 2023-07-20T11:25:51.093 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53238.log 2023-07-20T11:25:51.094 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45956.log 2023-07-20T11:25:51.094 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70980.log.gz 2023-07-20T11:25:51.095 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53238.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53238.log.gz 2023-07-20T11:25:51.095 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48781.log 2023-07-20T11:25:51.096 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69287.log 2023-07-20T11:25:51.096 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45956.log.gz 2023-07-20T11:25:51.097 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48781.log.gz 2023-07-20T11:25:51.097 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49141.log 2023-07-20T11:25:51.098 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69287.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69287.log.gz 2023-07-20T11:25:51.099 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63838.log 2023-07-20T11:25:51.100 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49141.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz 2023-07-20T11:25:51.100 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68788.log 2023-07-20T11:25:51.101 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47579.log 2023-07-20T11:25:51.101 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63838.log.gz 2023-07-20T11:25:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68788.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68788.log.gz 2023-07-20T11:25:51.102 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2023-07-20T11:25:51.103 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.47579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47579.log.gz 2023-07-20T11:25:51.103 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46224.log 2023-07-20T11:25:51.104 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2023-07-20T11:25:51.104 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2023-07-20T11:25:51.105 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71692.log 2023-07-20T11:25:51.105 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46224.log.gz 2023-07-20T11:25:51.106 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43499.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2023-07-20T11:25:51.106 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63972.log 2023-07-20T11:25:51.107 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73905.log 2023-07-20T11:25:51.107 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71692.log.gz 2023-07-20T11:25:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63972.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63972.log.gz 2023-07-20T11:25:51.108 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50343.log 2023-07-20T11:25:51.109 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66939.log 2023-07-20T11:25:51.110 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73905.log.gz 2023-07-20T11:25:51.110 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50859.log 2023-07-20T11:25:51.111 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50343.log.gz 2023-07-20T11:25:51.112 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2023-07-20T11:25:51.112 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66939.log.gz 2023-07-20T11:25:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50859.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50859.log.gz 2023-07-20T11:25:51.113 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57390.log 2023-07-20T11:25:51.114 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2023-07-20T11:25:51.114 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2023-07-20T11:25:51.115 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-20T11:25:51.116 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57390.log.gz 2023-07-20T11:25:51.116 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56735.log 2023-07-20T11:25:51.116 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58729.log 2023-07-20T11:25:51.117 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gz 2023-07-20T11:25:51.117 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56735.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56735.log.gz 2023-07-20T11:25:51.118 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72107.log 2023-07-20T11:25:51.119 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73016.log 2023-07-20T11:25:51.120 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58729.log.gz 2023-07-20T11:25:51.121 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.72107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72107.log.gz 2023-07-20T11:25:51.121 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73934.log 2023-07-20T11:25:51.121 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73016.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.50492.log -- replaced with /var/log/ceph/ceph-client.admin.73016.log.gz 2023-07-20T11:25:51.121 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.122 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49479.log 2023-07-20T11:25:51.122 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73934.log.gz 2023-07-20T11:25:51.123 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50492.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50492.log.gz 2023-07-20T11:25:51.123 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68236.log 2023-07-20T11:25:51.124 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2023-07-20T11:25:51.124 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49479.log.gz 2023-07-20T11:25:51.125 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68236.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68236.log.gz 2023-07-20T11:25:51.125 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65196.log 2023-07-20T11:25:51.126 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50681.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2023-07-20T11:25:51.126 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2023-07-20T11:25:51.127 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2023-07-20T11:25:51.128 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65196.log.gz 2023-07-20T11:25:51.128 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43623.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2023-07-20T11:25:51.129 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52716.log 2023-07-20T11:25:51.130 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62282.log 2023-07-20T11:25:51.131 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52716.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2023-07-20T11:25:51.131 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52716.log.gz 2023-07-20T11:25:51.131 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57732.log 2023-07-20T11:25:51.133 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71902.log 2023-07-20T11:25:51.133 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62282.log.gz 2023-07-20T11:25:51.134 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57732.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57732.log.gz 2023-07-20T11:25:51.134 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2023-07-20T11:25:51.135 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55965.log 2023-07-20T11:25:51.135 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.71902.log.gz 2023-07-20T11:25:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49849.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2023-07-20T11:25:51.136 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59546.log 2023-07-20T11:25:51.137 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50622.log 2023-07-20T11:25:51.137 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55965.log.gz 2023-07-20T11:25:51.138 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59546.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59546.log.gz 2023-07-20T11:25:51.138 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71445.log 2023-07-20T11:25:51.139 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2023-07-20T11:25:51.140 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50622.log.gz 2023-07-20T11:25:51.140 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71445.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71445.log.gz 2023-07-20T11:25:51.141 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61802.log 2023-07-20T11:25:51.142 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62399.log 2023-07-20T11:25:51.142 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2023-07-20T11:25:51.142 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61802.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61802.log.gz 2023-07-20T11:25:51.143 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57025.log 2023-07-20T11:25:51.144 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47625.log 2023-07-20T11:25:51.144 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62399.log.gz 2023-07-20T11:25:51.145 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57025.log.gz 2023-07-20T11:25:51.145 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56798.log 2023-07-20T11:25:51.146 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52951.log 2023-07-20T11:25:51.146 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47625.log.gz 2023-07-20T11:25:51.147 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56798.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56798.log.gz 2023-07-20T11:25:51.147 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66044.log 2023-07-20T11:25:51.148 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52846.log 2023-07-20T11:25:51.148 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52951.log.gz 2023-07-20T11:25:51.149 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66044.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66044.log.gz 2023-07-20T11:25:51.149 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2023-07-20T11:25:51.150 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61207.log 2023-07-20T11:25:51.151 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52846.log.gz 2023-07-20T11:25:51.151 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45683.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2023-07-20T11:25:51.152 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69321.log 2023-07-20T11:25:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71353.log 2023-07-20T11:25:51.153 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61207.log.gz 2023-07-20T11:25:51.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69321.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69321.log.gz 2023-07-20T11:25:51.154 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2023-07-20T11:25:51.155 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48159.log 2023-07-20T11:25:51.155 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71353.log.gz 2023-07-20T11:25:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2023-07-20T11:25:51.156 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2023-07-20T11:25:51.157 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65694.log 2023-07-20T11:25:51.158 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48159.log.gz 2023-07-20T11:25:51.158 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53159.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2023-07-20T11:25:51.159 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53185.log 2023-07-20T11:25:51.160 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54870.log 2023-07-20T11:25:51.160 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65694.log.gz 2023-07-20T11:25:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53185.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53185.log.gz 2023-07-20T11:25:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53983.log 2023-07-20T11:25:51.163 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48375.log 2023-07-20T11:25:51.164 INFO:teuthology.orchestra.run.smithi082.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54870.log.gz 2023-07-20T11:25:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53983.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53983.log.gz 2023-07-20T11:25:51.164 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64441.log 2023-07-20T11:25:51.165 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59849.log 2023-07-20T11:25:51.165 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48375.log.gz 2023-07-20T11:25:51.165 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64441.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64441.log.gz 2023-07-20T11:25:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2023-07-20T11:25:51.166 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2023-07-20T11:25:51.167 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59849.log.gz 2023-07-20T11:25:51.167 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55719.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2023-07-20T11:25:51.168 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58530.log 2023-07-20T11:25:51.169 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65877.log 2023-07-20T11:25:51.169 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2023-07-20T11:25:51.169 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58530.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58530.log.gz 2023-07-20T11:25:51.170 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2023-07-20T11:25:51.171 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65877.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65877.log.gz 2023-07-20T11:25:51.171 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68446.log 2023-07-20T11:25:51.172 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44032.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2023-07-20T11:25:51.172 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53094.log 2023-07-20T11:25:51.173 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72122.log 2023-07-20T11:25:51.173 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68446.log.gz 2023-07-20T11:25:51.174 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53094.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53094.log.gz 2023-07-20T11:25:51.174 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2023-07-20T11:25:51.175 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52169.log 2023-07-20T11:25:51.176 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72122.log.gz 2023-07-20T11:25:51.176 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48267.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2023-07-20T11:25:51.177 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2023-07-20T11:25:51.177 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2023-07-20T11:25:51.178 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52169.log.gz 2023-07-20T11:25:51.178 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46588.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2023-07-20T11:25:51.179 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58883.log 2023-07-20T11:25:51.180 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64415.log 2023-07-20T11:25:51.180 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2023-07-20T11:25:51.181 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58883.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58883.log.gz 2023-07-20T11:25:51.181 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66325.log 2023-07-20T11:25:51.182 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2023-07-20T11:25:51.183 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64415.log.gz 2023-07-20T11:25:51.183 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66325.log.gz 2023-07-20T11:25:51.184 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57129.log 2023-07-20T11:25:51.185 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2023-07-20T11:25:51.185 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2023-07-20T11:25:51.186 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57129.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57129.log.gz 2023-07-20T11:25:51.186 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2023-07-20T11:25:51.187 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2023-07-20T11:25:51.187 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2023-07-20T11:25:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51097.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2023-07-20T11:25:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2023-07-20T11:25:51.189 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60634.log 2023-07-20T11:25:51.189 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2023-07-20T11:25:51.190 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46744.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2023-07-20T11:25:51.190 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57680.log 2023-07-20T11:25:51.191 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51760.log 2023-07-20T11:25:51.192 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60634.log.gz 2023-07-20T11:25:51.192 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57680.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57680.log.gz 2023-07-20T11:25:51.193 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64847.log 2023-07-20T11:25:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68066.log 2023-07-20T11:25:51.194 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51760.log.gz 2023-07-20T11:25:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64847.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64847.log.gz 2023-07-20T11:25:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64951.log 2023-07-20T11:25:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62076.log 2023-07-20T11:25:51.196 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68066.log.gz 2023-07-20T11:25:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46328.log 2023-07-20T11:25:51.197 INFO:teuthology.orchestra.run.smithi082.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.64951.log.gz 2023-07-20T11:25:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62076.log.gz 2023-07-20T11:25:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73068.log 2023-07-20T11:25:51.199 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47247.log 2023-07-20T11:25:51.200 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46328.log.gz 2023-07-20T11:25:51.201 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60248.log 2023-07-20T11:25:51.201 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73068.log.gz 2023-07-20T11:25:51.201 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47247.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47247.log.gz 2023-07-20T11:25:51.202 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63380.log 2023-07-20T11:25:51.202 INFO:teuthology.orchestra.run.smithi183.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-20T11:25:51.203 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66115.log 2023-07-20T11:25:51.203 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60248.log.gz 2023-07-20T11:25:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63380.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63380.log.gz 2023-07-20T11:25:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50832.log 2023-07-20T11:25:51.205 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2023-07-20T11:25:51.205 INFO:teuthology.orchestra.run.smithi082.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.66115.log.gz 2023-07-20T11:25:51.206 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50832.log.gz 2023-07-20T11:25:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2023-07-20T11:25:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-20T11:25:51.208 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2023-07-20T11:25:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46510.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2023-07-20T11:25:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2023-07-20T11:25:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2023-07-20T11:25:51.211 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43181.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2023-07-20T11:25:51.211 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2023-07-20T11:25:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57912.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz 2023-07-20T11:25:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71578.log 2023-07-20T11:25:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60660.log 2023-07-20T11:25:51.214 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2023-07-20T11:25:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71578.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71578.log.gz 2023-07-20T11:25:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71288.log 2023-07-20T11:25:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66195.log 2023-07-20T11:25:51.217 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60660.log.gz 2023-07-20T11:25:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71288.log.gz 2023-07-20T11:25:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48625.log 2023-07-20T11:25:51.219 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57576.log 2023-07-20T11:25:51.219 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66195.log.gz 2023-07-20T11:25:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48625.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48625.log.gz 2023-07-20T11:25:51.220 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57051.log 2023-07-20T11:25:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61643.log 2023-07-20T11:25:51.222 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57576.log.gz 2023-07-20T11:25:51.222 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57051.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57051.log.gz 2023-07-20T11:25:51.223 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2023-07-20T11:25:51.224 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73801.log 2023-07-20T11:25:51.224 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61643.log.gz 2023-07-20T11:25:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43129.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2023-07-20T11:25:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45930.log 2023-07-20T11:25:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60172.log 2023-07-20T11:25:51.227 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73801.log.gz 2023-07-20T11:25:51.227 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45930.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45930.log.gz 2023-07-20T11:25:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2023-07-20T11:25:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70891.log 2023-07-20T11:25:51.229 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60172.log.gz 2023-07-20T11:25:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54272.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2023-07-20T11:25:51.230 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64637.log 2023-07-20T11:25:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54651.log 2023-07-20T11:25:51.232 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70891.log.gz 2023-07-20T11:25:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64637.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64637.log.gz 2023-07-20T11:25:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45631.log 2023-07-20T11:25:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64611.log 2023-07-20T11:25:51.234 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54651.log.gz 2023-07-20T11:25:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45631.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2023-07-20T11:25:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62477.log 2023-07-20T11:25:51.236 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64521.log 2023-07-20T11:25:51.237 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64611.log.gz 2023-07-20T11:25:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62477.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62477.log.gz 2023-07-20T11:25:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61944.log 2023-07-20T11:25:51.239 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72148.log 2023-07-20T11:25:51.239 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64521.log.gz 2023-07-20T11:25:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61944.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61944.log.gz 2023-07-20T11:25:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46089.log 2023-07-20T11:25:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65047.log 2023-07-20T11:25:51.242 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.72148.log.gz 2023-07-20T11:25:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46089.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46089.log.gz 2023-07-20T11:25:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67196.log 2023-07-20T11:25:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.65047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65047.log.gz 2023-07-20T11:25:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70486.log 2023-07-20T11:25:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.67196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67196.log.gz 2023-07-20T11:25:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68289.log 2023-07-20T11:25:51.246 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70486.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70486.log.gz 2023-07-20T11:25:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55080.log 2023-07-20T11:25:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68289.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68289.log.gz 2023-07-20T11:25:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2023-07-20T11:25:51.249 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58083.log 2023-07-20T11:25:51.250 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55080.log.gz 2023-07-20T11:25:51.251 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72056.log 2023-07-20T11:25:51.251 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2023-07-20T11:25:51.252 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58083.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58083.log.gz 2023-07-20T11:25:51.252 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59128.log 2023-07-20T11:25:51.253 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2023-07-20T11:25:51.254 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72056.log.gz 2023-07-20T11:25:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59128.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59128.log.gz 2023-07-20T11:25:51.255 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68263.log 2023-07-20T11:25:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50911.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2023-07-20T11:25:51.256 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72609.log 2023-07-20T11:25:51.257 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68498.log 2023-07-20T11:25:51.258 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68263.log.gz 2023-07-20T11:25:51.259 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72609.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72609.log.gz 2023-07-20T11:25:51.259 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63786.log 2023-07-20T11:25:51.260 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68498.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68498.log.gz 2023-07-20T11:25:51.260 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2023-07-20T11:25:51.262 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71498.log 2023-07-20T11:25:51.262 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63786.log.gz 2023-07-20T11:25:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43631.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2023-07-20T11:25:51.263 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46776.log 2023-07-20T11:25:51.264 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71498.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71498.log.gz 2023-07-20T11:25:51.265 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63458.log 2023-07-20T11:25:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46776.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2023-07-20T11:25:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62154.log 2023-07-20T11:25:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63458.log.gz 2023-07-20T11:25:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-20T11:25:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62154.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62154.log.gz 2023-07-20T11:25:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58621.log 2023-07-20T11:25:51.271 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2023-07-20T11:25:51.273 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63734.log 2023-07-20T11:25:51.273 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58621.log.gz 2023-07-20T11:25:51.274 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49687.log: gzip -5 89.2% --verbose -- /var/log/ceph/ceph-client.admin.67236.log 2023-07-20T11:25:51.274 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2023-07-20T11:25:51.275 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63734.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63734.log.gz 2023-07-20T11:25:51.275 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2023-07-20T11:25:51.277 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67236.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.67236.log.gz 2023-07-20T11:25:51.277 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56947.log 2023-07-20T11:25:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43551.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2023-07-20T11:25:51.279 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58674.log 2023-07-20T11:25:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56947.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56947.log.gz 2023-07-20T11:25:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55847.log 2023-07-20T11:25:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58674.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.58674.log.gz --verbose 2023-07-20T11:25:51.282 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.0.69790.log 2023-07-20T11:25:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-07-20T11:25:51.283 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55847.log.gz 2023-07-20T11:25:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.69790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69790.log.gz 2023-07-20T11:25:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43832.log 2023-07-20T11:25:51.286 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58343.log 2023-07-20T11:25:51.286 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-07-20T11:25:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43832.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43832.log.gz 2023-07-20T11:25:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54194.log 2023-07-20T11:25:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58343.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.58343.log.gz 2023-07-20T11:25:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48132.log 2023-07-20T11:25:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54194.log: gzip -5 --verbose 88.4% -- /var/log/ceph/ceph-client.admin.71103.log -- replaced with /var/log/ceph/ceph-client.admin.54194.log.gz 2023-07-20T11:25:51.291 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71928.log 2023-07-20T11:25:51.292 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48132.log.gz 2023-07-20T11:25:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71051.log 87.8% 2023-07-20T11:25:51.293 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71103.log.gz 2023-07-20T11:25:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71928.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.71928.log.gz -5 2023-07-20T11:25:51.295 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.72433.log 2023-07-20T11:25:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71051.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46536.log 2023-07-20T11:25:51.297 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71051.log.gz 2023-07-20T11:25:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72433.log: gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72433.log.gz 2023-07-20T11:25:51.298 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2023-07-20T11:25:51.299 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46536.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46536.log.gz 2023-07-20T11:25:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73157.log 2023-07-20T11:25:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60608.log 2023-07-20T11:25:51.301 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2023-07-20T11:25:51.302 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73157.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.65498.log 2023-07-20T11:25:51.303 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73157.log.gz 2023-07-20T11:25:51.304 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46276.log 2023-07-20T11:25:51.304 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60608.log.gz 2023-07-20T11:25:51.305 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61864.log 88.1% 2023-07-20T11:25:51.306 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65498.log.gz 2023-07-20T11:25:51.307 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72728.log 2023-07-20T11:25:51.307 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2023-07-20T11:25:51.308 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61864.log.gz 2023-07-20T11:25:51.309 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56387.log 2023-07-20T11:25:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72728.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72728.log.gz 2023-07-20T11:25:51.310 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61890.log 2023-07-20T11:25:51.312 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2023-07-20T11:25:51.312 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56387.log.gz 2023-07-20T11:25:51.313 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61890.log: gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61890.log.gz 2023-07-20T11:25:51.313 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66299.log 2023-07-20T11:25:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45161.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2023-07-20T11:25:51.315 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71876.log 2023-07-20T11:25:51.316 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66299.log: gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.63812.log -- replaced with /var/log/ceph/ceph-client.admin.66299.log.gz 2023-07-20T11:25:51.316 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.318 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71876.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71876.log.gz 2023-07-20T11:25:51.318 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59050.log 2023-07-20T11:25:51.319 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63812.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63812.log.gz 2023-07-20T11:25:51.320 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63901.log 2023-07-20T11:25:51.321 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69373.log 2023-07-20T11:25:51.321 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59050.log.gz 2023-07-20T11:25:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63901.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66273.log 2023-07-20T11:25:51.323 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63901.log.gz 2023-07-20T11:25:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46614.log 2023-07-20T11:25:51.324 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69373.log.gz 2023-07-20T11:25:51.325 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66273.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66273.log.gz 2023-07-20T11:25:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2023-07-20T11:25:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46614.log: gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46614.log.gz 2023-07-20T11:25:51.327 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63432.log 2023-07-20T11:25:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54974.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2023-07-20T11:25:51.329 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72102.log 2023-07-20T11:25:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47731.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63432.log.gz 2023-07-20T11:25:51.331 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.72102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72102.log.gz 2023-07-20T11:25:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44643.log 2023-07-20T11:25:51.334 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2023-07-20T11:25:51.334 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47731.log.gz 2023-07-20T11:25:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44643.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44643.log.gz 2023-07-20T11:25:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2023-07-20T11:25:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43395.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55236.log 2023-07-20T11:25:51.337 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2023-07-20T11:25:51.338 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53424.log 2023-07-20T11:25:51.339 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2023-07-20T11:25:51.340 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2023-07-20T11:25:51.340 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55236.log.gz 2023-07-20T11:25:51.342 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53424.log: gzip -5 89.1% --verbose -- /var/log/ceph/ceph-client.admin.64585.log 2023-07-20T11:25:51.342 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53424.log.gz 2023-07-20T11:25:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52601.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2023-07-20T11:25:51.343 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46141.log 2023-07-20T11:25:51.344 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2023-07-20T11:25:51.345 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64585.log.gz 2023-07-20T11:25:51.347 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45057.log 2023-07-20T11:25:51.347 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46141.log.gz 2023-07-20T11:25:51.348 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70839.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2023-07-20T11:25:51.349 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54844.log 2023-07-20T11:25:51.350 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67892.log 2023-07-20T11:25:51.350 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45057.log.gz 2023-07-20T11:25:51.351 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54844.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54844.log.gz 2023-07-20T11:25:51.352 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43155.log 2023-07-20T11:25:51.353 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56498.log 2023-07-20T11:25:51.353 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67892.log.gz 2023-07-20T11:25:51.354 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69934.log 2023-07-20T11:25:51.354 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43155.log.gz 2023-07-20T11:25:51.356 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56498.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2023-07-20T11:25:51.356 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56498.log.gz 2023-07-20T11:25:51.357 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66247.log 2023-07-20T11:25:51.358 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69934.log.gz 2023-07-20T11:25:51.359 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59797.log 2023-07-20T11:25:51.360 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2023-07-20T11:25:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66247.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66247.log.gz 2023-07-20T11:25:51.362 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61513.log 2023-07-20T11:25:51.362 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59797.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59797.log.gz 2023-07-20T11:25:51.363 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60276.log 2023-07-20T11:25:51.367 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65667.log 2023-07-20T11:25:51.367 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61513.log.gz 2023-07-20T11:25:51.368 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60276.log: gzip -5 --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60276.log.gz 2023-07-20T11:25:51.369 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.60686.log 2023-07-20T11:25:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65667.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65667.log.gz 2023-07-20T11:25:51.370 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68918.log 2023-07-20T11:25:51.376 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60686.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60686.log.gz 2023-07-20T11:25:51.376 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59206.log 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68918.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68918.log.gz 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65524.log 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59206.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59206.log.gz 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65168.log 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65524.log: gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.65524.log.gz --verbose 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.52339.log 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65168.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65168.log.gz 2023-07-20T11:25:51.377 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.2.44954.log 2023-07-20T11:25:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52339.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52339.log.gz 2023-07-20T11:25:51.378 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68576.log 2023-07-20T11:25:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.2.44954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44954.log.gz 2023-07-20T11:25:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49583.log 2023-07-20T11:25:51.379 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53839.log 2023-07-20T11:25:51.379 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68576.log.gz 2023-07-20T11:25:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49583.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49583.log.gz 2023-07-20T11:25:51.380 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43821.log 2023-07-20T11:25:51.381 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.53839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53839.log.gz 2023-07-20T11:25:51.382 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64128.log 2023-07-20T11:25:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43821.log.gz 2023-07-20T11:25:51.383 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53879.log 2023-07-20T11:25:51.386 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64128.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.71666.log -- replaced with /var/log/ceph/ceph-client.admin.64128.log.gz 2023-07-20T11:25:51.386 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.392 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53879.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53879.log.gz 2023-07-20T11:25:51.393 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2023-07-20T11:25:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71666.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71666.log.gz 2023-07-20T11:25:51.394 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69856.log 2023-07-20T11:25:51.395 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61434.log 2023-07-20T11:25:51.396 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2023-07-20T11:25:51.396 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69856.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52273.log 2023-07-20T11:25:51.397 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69856.log.gz 2023-07-20T11:25:51.407 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63270.log 2023-07-20T11:25:51.408 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61434.log.gz 2023-07-20T11:25:51.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53955.log 2023-07-20T11:25:51.409 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52273.log.gz 2023-07-20T11:25:51.409 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73827.log 2023-07-20T11:25:51.409 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63270.log.gz 2023-07-20T11:25:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69739.log 2023-07-20T11:25:51.410 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53955.log.gz 2023-07-20T11:25:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73827.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73827.log.gz 2023-07-20T11:25:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46380.log 2023-07-20T11:25:51.410 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69739.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69739.log.gz 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55113.log 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46380.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46380.log.gz 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55113.log.gz 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48043.log 2023-07-20T11:25:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2023-07-20T11:25:51.412 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2023-07-20T11:25:51.414 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48043.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48043.log.gz 2023-07-20T11:25:51.415 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60198.log 2023-07-20T11:25:51.415 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51331.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2023-07-20T11:25:51.415 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68196.log 2023-07-20T11:25:51.415 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60198.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60198.log.gz 2023-07-20T11:25:51.416 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.48213.log 2023-07-20T11:25:51.416 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68196.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68196.log.gz 2023-07-20T11:25:51.416 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71262.log 2023-07-20T11:25:51.417 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48213.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2023-07-20T11:25:51.417 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48213.log.gz 2023-07-20T11:25:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71210.log 2023-07-20T11:25:51.419 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71262.log.gz 2023-07-20T11:25:51.419 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2023-07-20T11:25:51.420 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2023-07-20T11:25:51.420 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2023-07-20T11:25:51.421 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71210.log.gz 2023-07-20T11:25:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2023-07-20T11:25:51.424 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65929.log 2023-07-20T11:25:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45553.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2023-07-20T11:25:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72224.log 2023-07-20T11:25:51.426 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60551.log 2023-07-20T11:25:51.426 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65929.log.gz 2023-07-20T11:25:51.429 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72006.log 2023-07-20T11:25:51.430 INFO:teuthology.orchestra.run.smithi082.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72224.log.gz 2023-07-20T11:25:51.431 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60551.log: gzip 87.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.53530.log 2023-07-20T11:25:51.431 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60551.log.gz 2023-07-20T11:25:51.432 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73131.log 2023-07-20T11:25:51.432 INFO:teuthology.orchestra.run.smithi082.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.72006.log.gz 2023-07-20T11:25:51.433 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53530.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.53530.log.gz 2023-07-20T11:25:51.433 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62206.log 2023-07-20T11:25:51.441 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73131.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73131.log.gz 2023-07-20T11:25:51.442 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49823.log 2023-07-20T11:25:51.442 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62206.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62206.log.gz 2023-07-20T11:25:51.443 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2023-07-20T11:25:51.443 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2023-07-20T11:25:51.444 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49823.log.gz 2023-07-20T11:25:51.444 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58909.log 2023-07-20T11:25:51.445 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2023-07-20T11:25:51.445 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47051.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2023-07-20T11:25:51.445 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66781.log 2023-07-20T11:25:51.446 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2023-07-20T11:25:51.446 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58909.log.gz 2023-07-20T11:25:51.446 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66781.log: gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.0.44852.log 2023-07-20T11:25:51.446 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66781.log.gz 2023-07-20T11:25:51.446 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45501.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz -5 2023-07-20T11:25:51.447 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66508.log 2023-07-20T11:25:51.449 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.44852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44852.log.gz 2023-07-20T11:25:51.449 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2023-07-20T11:25:51.449 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66508.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66508.log.gz 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54625.log 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54389.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47273.log 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69830.log 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54625.log.gz 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47273.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47273.log.gz 2023-07-20T11:25:51.450 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2023-07-20T11:25:51.451 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69830.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69830.log.gz 2023-07-20T11:25:51.451 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55641.log 2023-07-20T11:25:51.452 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44409.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2023-07-20T11:25:51.452 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43830.log 2023-07-20T11:25:51.454 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55641.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55641.log.gz 2023-07-20T11:25:51.454 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50596.log 2023-07-20T11:25:51.455 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43830.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65001.log 2023-07-20T11:25:51.456 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43830.log.gz 2023-07-20T11:25:51.457 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2023-07-20T11:25:51.457 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50596.log.gz 2023-07-20T11:25:51.458 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65001.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65001.log.gz 2023-07-20T11:25:51.459 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59259.log 2023-07-20T11:25:51.460 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45873.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2023-07-20T11:25:51.460 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62631.log 2023-07-20T11:25:51.461 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59259.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59259.log.gzgzip 2023-07-20T11:25:51.461 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2023-07-20T11:25:51.463 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52794.log 2023-07-20T11:25:51.463 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62631.log.gz 2023-07-20T11:25:51.464 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56354.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz -- 2023-07-20T11:25:51.464 INFO:teuthology.orchestra.run.smithi082.stderr: /var/log/ceph/ceph-client.admin.56472.log 2023-07-20T11:25:51.466 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52794.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52794.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56973.log 2023-07-20T11:25:51.466 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.468 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56895.log 2023-07-20T11:25:51.468 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56472.log.gz 2023-07-20T11:25:51.469 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69035.log 2023-07-20T11:25:51.470 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56973.log.gz 2023-07-20T11:25:51.471 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56895.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56895.log.gz 2023-07-20T11:25:51.472 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48103.log 2023-07-20T11:25:51.473 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69035.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69035.log.gz 2023-07-20T11:25:51.473 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45291.log 2023-07-20T11:25:51.475 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48103.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48103.log.gz 2023-07-20T11:25:51.475 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65472.log 2023-07-20T11:25:51.476 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45291.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45291.log.gz 2023-07-20T11:25:51.476 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71824.log 2023-07-20T11:25:51.478 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65472.log.gz 2023-07-20T11:25:51.478 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64102.log 2023-07-20T11:25:51.479 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71824.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71824.log.gz 2023-07-20T11:25:51.479 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2023-07-20T11:25:51.481 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64102.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64102.log.gz 2023-07-20T11:25:51.481 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63524.log 2023-07-20T11:25:51.483 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59628.log: gzip -5 --verbose 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2023-07-20T11:25:51.483 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.43421.log 2023-07-20T11:25:51.484 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63524.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63524.log.gz 2023-07-20T11:25:51.484 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68736.log 2023-07-20T11:25:51.486 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43421.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53478.log 2023-07-20T11:25:51.486 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2023-07-20T11:25:51.487 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71850.log 2023-07-20T11:25:51.487 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68736.log.gz 2023-07-20T11:25:51.488 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2023-07-20T11:25:51.489 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53478.log.gz 2023-07-20T11:25:51.490 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71850.log: gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.66169.log 2023-07-20T11:25:51.490 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71850.log.gz 2023-07-20T11:25:51.491 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54922.log 2023-07-20T11:25:51.492 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2023-07-20T11:25:51.493 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66169.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72807.log 2023-07-20T11:25:51.493 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66169.log.gz 2023-07-20T11:25:51.494 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54922.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54922.log.gz 2023-07-20T11:25:51.495 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73538.log 2023-07-20T11:25:51.497 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72807.log: gzip -5 --verbose 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72807.log.gz 2023-07-20T11:25:51.497 INFO:teuthology.orchestra.run.smithi082.stderr: -- /var/log/ceph/ceph-client.admin.53346.log 2023-07-20T11:25:51.498 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73538.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73538.log.gz 2023-07-20T11:25:51.499 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2023-07-20T11:25:51.499 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53346.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53346.log.gz 2023-07-20T11:25:51.500 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-20T11:25:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43838.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2023-07-20T11:25:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46063.log 2023-07-20T11:25:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70630.log 2023-07-20T11:25:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46063.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46063.log.gz 2023-07-20T11:25:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72990.log 2023-07-20T11:25:51.506 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70630.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71418.log 2023-07-20T11:25:51.506 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70630.log.gz 2023-07-20T11:25:51.507 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53905.log 2023-07-20T11:25:51.507 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72990.log.gz 2023-07-20T11:25:51.509 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59662.log 2023-07-20T11:25:51.509 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71418.log.gz 2023-07-20T11:25:51.510 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64691.log 2023-07-20T11:25:51.511 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53905.log.gz 2023-07-20T11:25:51.512 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59662.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.69481.log 2023-07-20T11:25:51.512 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59662.log.gz 2023-07-20T11:25:51.513 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57628.log 2023-07-20T11:25:51.514 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69481.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64691.log.gz 2023-07-20T11:25:51.515 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45475.log 2023-07-20T11:25:51.516 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69481.log.gz 2023-07-20T11:25:51.516 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2023-07-20T11:25:51.517 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57628.log.gz 2023-07-20T11:25:51.518 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63927.log 2023-07-20T11:25:51.519 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5%/var/log/ceph/ceph-client.admin.55315.log: -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2023-07-20T11:25:51.519 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66221.log 2023-07-20T11:25:51.520 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2023-07-20T11:25:51.521 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69347.log 2023-07-20T11:25:51.521 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63927.log.gz 2023-07-20T11:25:51.522 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72174.log 2023-07-20T11:25:51.523 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66221.log.gz 2023-07-20T11:25:51.524 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69347.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69347.log.gz -5 2023-07-20T11:25:51.524 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71155.log 2023-07-20T11:25:51.525 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72174.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59901.log 2023-07-20T11:25:51.526 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72174.log.gz 2023-07-20T11:25:51.527 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68840.log 2023-07-20T11:25:51.527 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71155.log.gz 2023-07-20T11:25:51.528 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59901.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.59901.log.gz 2023-07-20T11:25:51.529 INFO:teuthology.orchestra.run.smithi082.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59468.log 2023-07-20T11:25:51.530 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2023-07-20T11:25:51.530 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68840.log.gz 2023-07-20T11:25:51.531 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59468.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45579.log 2023-07-20T11:25:51.531 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59468.log.gz 2023-07-20T11:25:51.533 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55341.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz -5 2023-07-20T11:25:51.533 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55615.log 2023-07-20T11:25:51.534 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50544.log 2023-07-20T11:25:51.536 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55615.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45579.log.gz 2023-07-20T11:25:51.536 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2023-07-20T11:25:51.536 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55615.log.gz 2023-07-20T11:25:51.537 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62102.log 2023-07-20T11:25:51.538 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50544.log.gz 2023-07-20T11:25:51.539 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57498.log 2023-07-20T11:25:51.540 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62102.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz 2023-07-20T11:25:51.540 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66534.log 2023-07-20T11:25:51.541 INFO:teuthology.orchestra.run.smithi082.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.62102.log.gz 2023-07-20T11:25:51.542 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59520.log 2023-07-20T11:25:51.542 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57498.log.gz 2023-07-20T11:25:51.543 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52195.log 2023-07-20T11:25:51.543 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66534.log.gz 2023-07-20T11:25:51.545 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67017.log 2023-07-20T11:25:51.545 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59520.log.gz 2023-07-20T11:25:51.546 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52195.log: gzip -5 --verbose 88.5% -- /var/log/ceph/ceph-client.admin.58452.log -- replaced with /var/log/ceph/ceph-client.admin.52195.log.gz 2023-07-20T11:25:51.547 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.547 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67017.log.gz 2023-07-20T11:25:51.548 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48402.log 2023-07-20T11:25:51.549 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58452.log: gzip -5 88.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.58452.log.gz /var/log/ceph/ceph-client.admin.72663.log 2023-07-20T11:25:51.549 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.551 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72406.log 2023-07-20T11:25:51.551 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48402.log.gz 2023-07-20T11:25:51.552 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72663.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43626.log 2023-07-20T11:25:51.552 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72663.log.gz 2023-07-20T11:25:51.554 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57836.log 2023-07-20T11:25:51.554 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72406.log.gz 2023-07-20T11:25:51.555 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67262.log 2023-07-20T11:25:51.556 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43626.log.gz 2023-07-20T11:25:51.557 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70519.log 2023-07-20T11:25:51.557 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57836.log.gz 2023-07-20T11:25:51.558 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67262.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67262.log.gz 2023-07-20T11:25:51.560 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69637.log 2023-07-20T11:25:51.561 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70519.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.52924.log 2023-07-20T11:25:51.561 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70519.log.gz 2023-07-20T11:25:51.563 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60430.log 2023-07-20T11:25:51.564 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69637.log.gz 2023-07-20T11:25:51.565 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58369.log 2023-07-20T11:25:51.565 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2023-07-20T11:25:51.566 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56921.log 2023-07-20T11:25:51.566 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60430.log.gz 2023-07-20T11:25:51.567 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58369.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62347.log 2023-07-20T11:25:51.567 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58369.log.gz 2023-07-20T11:25:51.569 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56921.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.56921.log.gz -5 2023-07-20T11:25:51.569 INFO:teuthology.orchestra.run.smithi082.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66070.log 2023-07-20T11:25:51.571 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2023-07-20T11:25:51.572 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66070.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62347.log.gz 2023-07-20T11:25:51.573 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55589.log 2023-07-20T11:25:51.573 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66070.log.gz 2023-07-20T11:25:51.574 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62232.log 2023-07-20T11:25:51.574 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2023-07-20T11:25:51.575 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71129.log 2023-07-20T11:25:51.575 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55589.log.gz 2023-07-20T11:25:51.577 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55667.log 2023-07-20T11:25:51.577 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.62232.log.gz 2023-07-20T11:25:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.71129.log.gz 2023-07-20T11:25:51.578 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52143.log 2023-07-20T11:25:51.580 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2023-07-20T11:25:51.581 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55667.log.gz 2023-07-20T11:25:51.581 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66613.log 2023-07-20T11:25:51.582 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44279.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52143.log.gz 2023-07-20T11:25:51.583 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64154.log 2023-07-20T11:25:51.583 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2023-07-20T11:25:51.584 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2023-07-20T11:25:51.584 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66613.log.gz 2023-07-20T11:25:51.585 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58935.log 2023-07-20T11:25:51.586 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64154.log.gz 2023-07-20T11:25:51.587 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56657.log 2023-07-20T11:25:51.587 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2023-07-20T11:25:51.588 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-07-20T11:25:51.589 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58935.log.gz 2023-07-20T11:25:51.590 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56657.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61830.log 2023-07-20T11:25:51.590 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56657.log.gz 2023-07-20T11:25:51.591 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44729.log: 89.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48651.log 2023-07-20T11:25:51.592 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-07-20T11:25:51.593 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61830.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61830.log.gz 2023-07-20T11:25:51.593 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-20T11:25:51.595 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66835.log 2023-07-20T11:25:51.595 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48651.log.gz 2023-07-20T11:25:51.596 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60005.log 2023-07-20T11:25:51.598 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64180.log 2023-07-20T11:25:51.598 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66835.log.gz 2023-07-20T11:25:51.599 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54792.log 2023-07-20T11:25:51.601 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1%/var/log/ceph/ceph-client.admin.64180.log: -- replaced with /var/log/ceph/ceph-client.admin.60005.log.gz 2023-07-20T11:25:51.601 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64180.log.gz 2023-07-20T11:25:51.602 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61970.log 2023-07-20T11:25:51.603 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51305.log 2023-07-20T11:25:51.604 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61970.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54792.log.gz 2023-07-20T11:25:51.605 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61970.log.gz 2023-07-20T11:25:51.606 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59376.log 2023-07-20T11:25:51.608 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51305.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51499.log 2023-07-20T11:25:51.608 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51305.log.gz 2023-07-20T11:25:51.609 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66442.log 2023-07-20T11:25:51.611 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51499.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59376.log.gz 2023-07-20T11:25:51.611 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51499.log.gz 2023-07-20T11:25:51.612 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60804.log 2023-07-20T11:25:51.613 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64769.log 2023-07-20T11:25:51.614 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60804.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66442.log.gz 2023-07-20T11:25:51.615 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60804.log.gz 2023-07-20T11:25:51.616 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2023-07-20T11:25:51.617 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56446.log 2023-07-20T11:25:51.618 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48755.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64769.log.gz 2023-07-20T11:25:51.619 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2023-07-20T11:25:51.620 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57155.log 2023-07-20T11:25:51.621 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2023-07-20T11:25:51.622 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57155.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56446.log.gz 2023-07-20T11:25:51.623 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57155.log.gz 2023-07-20T11:25:51.623 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56041.log 2023-07-20T11:25:51.625 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66695.log 2023-07-20T11:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56041.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2023-07-20T11:25:51.626 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56041.log.gz 2023-07-20T11:25:51.627 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50993.log 2023-07-20T11:25:51.629 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66809.log 2023-07-20T11:25:51.630 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66695.log.gz 2023-07-20T11:25:51.630 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50993.log.gz 2023-07-20T11:25:51.631 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59233.log 2023-07-20T11:25:51.633 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45982.log 2023-07-20T11:25:51.634 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59233.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66809.log.gz 2023-07-20T11:25:51.635 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59233.log.gz 2023-07-20T11:25:51.635 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63354.log 2023-07-20T11:25:51.637 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46921.log 2023-07-20T11:25:51.638 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63354.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45982.log.gz 2023-07-20T11:25:51.639 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63354.log.gz 2023-07-20T11:25:51.639 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59285.log 2023-07-20T11:25:51.641 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2023-07-20T11:25:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59285.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46921.log.gz 2023-07-20T11:25:51.643 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59285.log.gz 2023-07-20T11:25:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69179.log 2023-07-20T11:25:51.645 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37496.log 2023-07-20T11:25:51.646 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69179.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2023-07-20T11:25:51.646 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69179.log.gz 2023-07-20T11:25:51.647 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46302.log 2023-07-20T11:25:51.649 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51019.log 2023-07-20T11:25:51.650 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46302.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37496.log.gz 2023-07-20T11:25:51.651 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2023-07-20T11:25:51.651 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50518.log 2023-07-20T11:25:51.653 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2023-07-20T11:25:51.653 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50518.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51019.log.gz 2023-07-20T11:25:51.654 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50518.log.gz 2023-07-20T11:25:51.655 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44843.log 2023-07-20T11:25:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50780.log 2023-07-20T11:25:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.44843.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2023-07-20T11:25:51.658 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44843.log.gz 2023-07-20T11:25:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2023-07-20T11:25:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62022.log 2023-07-20T11:25:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50780.log.gz 2023-07-20T11:25:51.662 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2023-07-20T11:25:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49219.log 2023-07-20T11:25:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52690.log 2023-07-20T11:25:51.666 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49219.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62022.log.gz 2023-07-20T11:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49219.log.gz 2023-07-20T11:25:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54766.log 2023-07-20T11:25:51.669 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51071.log 2023-07-20T11:25:51.670 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54766.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52690.log.gz 2023-07-20T11:25:51.670 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54766.log.gz 2023-07-20T11:25:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49967.log 2023-07-20T11:25:51.673 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2023-07-20T11:25:51.673 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49967.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51071.log.gz 2023-07-20T11:25:51.674 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49967.log.gz 2023-07-20T11:25:51.675 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61487.log 2023-07-20T11:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62128.log 2023-07-20T11:25:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53450.log: /var/log/ceph/ceph-client.admin.61487.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2023-07-20T11:25:51.678 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61487.log.gz 2023-07-20T11:25:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64899.log 2023-07-20T11:25:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46115.log 2023-07-20T11:25:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64899.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62128.log.gz 2023-07-20T11:25:51.682 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64899.log.gz 2023-07-20T11:25:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63498.log 2023-07-20T11:25:51.685 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44046.log 2023-07-20T11:25:51.685 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63498.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46115.log.gz 2023-07-20T11:25:51.686 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63498.log.gz 2023-07-20T11:25:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2023-07-20T11:25:51.689 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45109.log 2023-07-20T11:25:51.690 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51279.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44046.log.gz 2023-07-20T11:25:51.690 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2023-07-20T11:25:51.691 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73723.log 2023-07-20T11:25:51.693 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45265.log 2023-07-20T11:25:51.694 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73723.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45109.log.gz 2023-07-20T11:25:51.694 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73723.log.gz 2023-07-20T11:25:51.695 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60778.log 2023-07-20T11:25:51.697 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64925.log 2023-07-20T11:25:51.698 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60778.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45265.log.gz 2023-07-20T11:25:51.699 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60778.log.gz 2023-07-20T11:25:51.699 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53582.log 2023-07-20T11:25:51.701 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50806.log 2023-07-20T11:25:51.702 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53582.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64925.log.gz 2023-07-20T11:25:51.702 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53582.log.gz 2023-07-20T11:25:51.703 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53211.log 2023-07-20T11:25:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58556.log 2023-07-20T11:25:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53211.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50806.log.gz 2023-07-20T11:25:51.706 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53211.log.gz 2023-07-20T11:25:51.707 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2023-07-20T11:25:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69126.log 2023-07-20T11:25:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58556.log.gz 2023-07-20T11:25:51.710 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2023-07-20T11:25:51.711 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64363.log 2023-07-20T11:25:51.713 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52898.log 2023-07-20T11:25:51.714 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64363.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.69126.log.gz 2023-07-20T11:25:51.715 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64363.log.gz 2023-07-20T11:25:51.715 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54220.log 2023-07-20T11:25:51.717 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64717.log 2023-07-20T11:25:51.718 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54220.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52898.log.gz 2023-07-20T11:25:51.718 INFO:teuthology.orchestra.run.smithi082.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54220.log.gz 2023-07-20T11:25:51.720 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64795.log 2023-07-20T11:25:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69663.log 2023-07-20T11:25:51.721 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64717.log.gz 2023-07-20T11:25:51.723 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64795.log.gz 2023-07-20T11:25:51.723 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2023-07-20T11:25:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56761.log 2023-07-20T11:25:51.725 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47185.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.69663.log.gz 2023-07-20T11:25:51.726 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2023-07-20T11:25:51.727 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2023-07-20T11:25:51.729 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2023-07-20T11:25:51.730 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56761.log.gz 2023-07-20T11:25:51.730 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2023-07-20T11:25:51.731 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71321.log 2023-07-20T11:25:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57220.log 2023-07-20T11:25:51.733 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71321.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2023-07-20T11:25:51.734 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71321.log.gz 2023-07-20T11:25:51.735 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52742.log 2023-07-20T11:25:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56302.log 2023-07-20T11:25:51.737 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52742.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57220.log.gz 2023-07-20T11:25:51.738 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52742.log.gz 2023-07-20T11:25:51.739 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53290.log 2023-07-20T11:25:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45821.log 2023-07-20T11:25:51.741 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53290.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56302.log.gz 2023-07-20T11:25:51.742 INFO:teuthology.orchestra.run.smithi082.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53290.log.gz 2023-07-20T11:25:51.743 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70382.log 2023-07-20T11:25:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50466.log 2023-07-20T11:25:51.745 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70382.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45821.log.gz 2023-07-20T11:25:51.746 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70382.log.gz 2023-07-20T11:25:51.747 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73460.log 2023-07-20T11:25:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70088.log 2023-07-20T11:25:51.749 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73460.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50466.log.gz 2023-07-20T11:25:51.750 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73460.log.gz 2023-07-20T11:25:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51458.log 2023-07-20T11:25:51.753 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52247.log 2023-07-20T11:25:51.754 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.51458.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70088.log.gz 2023-07-20T11:25:51.754 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51458.log.gz 2023-07-20T11:25:51.755 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73853.log 2023-07-20T11:25:51.764 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73853.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52247.log.gz 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73853.log.gz 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72500.log 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67496.log 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72500.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72500.log.gz 2023-07-20T11:25:51.765 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71746.log 2023-07-20T11:25:51.766 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58648.log 2023-07-20T11:25:51.767 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67496.log.gz 2023-07-20T11:25:51.767 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71746.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71746.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65376.log 2023-07-20T11:25:51.767 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.768 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2023-07-20T11:25:51.768 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65376.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58648.log.gz 2023-07-20T11:25:51.769 INFO:teuthology.orchestra.run.smithi082.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.65376.log.gz 2023-07-20T11:25:51.770 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56709.log 2023-07-20T11:25:51.771 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46167.log 2023-07-20T11:25:51.772 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2023-07-20T11:25:51.774 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56709.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57602.log 2023-07-20T11:25:51.774 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56709.log.gz 2023-07-20T11:25:51.775 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46167.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46167.log.gz 2023-07-20T11:25:51.777 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58504.log 2023-07-20T11:25:51.778 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68524.log 2023-07-20T11:25:51.779 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57602.log.gz 2023-07-20T11:25:51.780 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69003.log 2023-07-20T11:25:51.781 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68524.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58504.log.gz 2023-07-20T11:25:51.781 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68524.log.gz 2023-07-20T11:25:51.782 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-20T11:25:51.784 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46666.log 2023-07-20T11:25:51.785 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69003.log.gz 2023-07-20T11:25:51.787 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60519.log 2023-07-20T11:25:51.788 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46666.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46666.log.gz 2023-07-20T11:25:51.790 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68118.log 2023-07-20T11:25:51.792 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60519.log.gz 2023-07-20T11:25:51.794 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68639.log 2023-07-20T11:25:51.796 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68118.log: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-20T11:25:51.796 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68118.log.gz 2023-07-20T11:25:51.798 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63551.log 2023-07-20T11:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68639.log: gzip 88.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.59823.log 2023-07-20T11:25:51.799 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68639.log.gz 2023-07-20T11:25:51.801 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67946.log 2023-07-20T11:25:51.801 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59823.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63551.log.gz 2023-07-20T11:25:51.802 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59823.log.gz 2023-07-20T11:25:51.804 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57958.log 2023-07-20T11:25:51.805 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44047.log 2023-07-20T11:25:51.806 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67946.log.gz 2023-07-20T11:25:51.807 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.57958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60712.log 2023-07-20T11:25:51.807 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57958.log.gz 2023-07-20T11:25:51.808 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44047.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44047.log.gz 2023-07-20T11:25:51.810 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66667.log 2023-07-20T11:25:51.811 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2023-07-20T11:25:51.812 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60712.log.gz 2023-07-20T11:25:51.813 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55457.log 2023-07-20T11:25:51.814 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66667.log.gz 2023-07-20T11:25:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50414.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2023-07-20T11:25:51.815 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70928.log 2023-07-20T11:25:51.817 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43826.log 2023-07-20T11:25:51.818 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55457.log: /var/log/ceph/ceph-client.admin.70928.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55457.log.gz 2023-07-20T11:25:51.818 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70928.log.gz 2023-07-20T11:25:51.819 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67043.log 2023-07-20T11:25:51.821 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57810.log 2023-07-20T11:25:51.822 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67043.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43826.log.gz 2023-07-20T11:25:51.823 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67043.log.gz 2023-07-20T11:25:51.824 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 2023-07-20T11:25:51.826 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52653.log 2023-07-20T11:25:51.827 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44669.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57810.log.gz 2023-07-20T11:25:51.827 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2023-07-20T11:25:51.828 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69689.log 2023-07-20T11:25:51.829 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49993.log 2023-07-20T11:25:51.830 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52653.log.gz 2023-07-20T11:25:51.831 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59979.log 2023-07-20T11:25:51.832 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49993.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.69689.log.gz 2023-07-20T11:25:51.833 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49993.log.gz 2023-07-20T11:25:51.833 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70604.log 2023-07-20T11:25:51.835 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2023-07-20T11:25:51.836 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70604.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59979.log.gz 2023-07-20T11:25:51.837 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70604.log.gz 2023-07-20T11:25:51.837 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69427.log 2023-07-20T11:25:51.839 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73775.log 2023-07-20T11:25:51.840 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2023-07-20T11:25:51.841 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69427.log.gz 2023-07-20T11:25:51.841 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50317.log 2023-07-20T11:25:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61278.log 2023-07-20T11:25:51.844 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50317.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73775.log.gz 2023-07-20T11:25:51.845 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50317.log.gz 2023-07-20T11:25:51.845 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2023-07-20T11:25:51.847 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52820.log 2023-07-20T11:25:51.848 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61278.log.gz 2023-07-20T11:25:51.849 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2023-07-20T11:25:51.849 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2023-07-20T11:25:51.851 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2023-07-20T11:25:51.852 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46008.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52820.log.gz 2023-07-20T11:25:51.853 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2023-07-20T11:25:51.853 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61356.log 2023-07-20T11:25:51.855 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46718.log 2023-07-20T11:25:51.857 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61356.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2023-07-20T11:25:51.857 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61356.log.gz 2023-07-20T11:25:51.858 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66887.log 2023-07-20T11:25:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73486.log 2023-07-20T11:25:51.861 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46718.log.gz 2023-07-20T11:25:51.861 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66887.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66887.log.gz 2023-07-20T11:25:51.862 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71077.log 2023-07-20T11:25:51.863 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70408.log 2023-07-20T11:25:51.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73486.log.gz 2023-07-20T11:25:51.865 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71077.log.gz 2023-07-20T11:25:51.865 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60857.log 2023-07-20T11:25:51.867 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2023-07-20T11:25:51.868 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70408.log: /var/log/ceph/ceph-client.admin.60857.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70408.log.gz 2023-07-20T11:25:51.868 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60857.log.gz 2023-07-20T11:25:51.869 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2023-07-20T11:25:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62048.log 2023-07-20T11:25:51.871 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47103.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2023-07-20T11:25:51.872 INFO:teuthology.orchestra.run.smithi082.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2023-07-20T11:25:51.873 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2023-07-20T11:25:51.874 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57285.log 2023-07-20T11:25:51.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62048.log: /var/log/ceph/ceph-client.admin.45743.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62048.log.gz 2023-07-20T11:25:51.876 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2023-07-20T11:25:51.877 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68944.log 2023-07-20T11:25:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2023-07-20T11:25:51.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68944.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57285.log.gz 2023-07-20T11:25:51.880 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68944.log.gz 2023-07-20T11:25:51.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60945.log 2023-07-20T11:25:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73306.log 2023-07-20T11:25:51.883 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60945.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2023-07-20T11:25:51.884 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60945.log.gz 2023-07-20T11:25:51.885 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57862.log 2023-07-20T11:25:51.886 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64467.log 2023-07-20T11:25:51.888 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73306.log: /var/log/ceph/ceph-client.admin.57862.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73306.log.gz 2023-07-20T11:25:51.889 INFO:teuthology.orchestra.run.smithi082.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.57862.log.gz 2023-07-20T11:25:51.890 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61252.log 2023-07-20T11:25:51.891 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66965.log 2023-07-20T11:25:51.893 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64467.log.gz/var/log/ceph/ceph-client.admin.61252.log: 2023-07-20T11:25:51.893 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61252.log.gz 2023-07-20T11:25:51.894 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71471.log 2023-07-20T11:25:51.895 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61066.log 2023-07-20T11:25:51.896 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66965.log: /var/log/ceph/ceph-client.admin.71471.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66965.log.gz 2023-07-20T11:25:51.896 INFO:teuthology.orchestra.run.smithi082.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.71471.log.gz 2023-07-20T11:25:51.897 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73434.log 2023-07-20T11:25:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46432.log 2023-07-20T11:25:51.899 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73434.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61066.log.gz 2023-07-20T11:25:51.900 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73434.log.gz 2023-07-20T11:25:51.901 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58595.log 2023-07-20T11:25:51.903 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70115.log 2023-07-20T11:25:51.904 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58595.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46432.log.gz 2023-07-20T11:25:51.904 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58595.log.gz 2023-07-20T11:25:51.905 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53834.log 2023-07-20T11:25:51.907 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2023-07-20T11:25:51.907 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.53834.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70115.log.gz 2023-07-20T11:25:51.908 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53834.log.gz 2023-07-20T11:25:51.909 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56824.log 2023-07-20T11:25:51.911 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52392.log 2023-07-20T11:25:51.912 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56824.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2023-07-20T11:25:51.913 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56824.log.gz 2023-07-20T11:25:51.913 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46354.log 2023-07-20T11:25:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2023-07-20T11:25:51.915 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46354.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52392.log.gz 2023-07-20T11:25:51.916 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46354.log.gz 2023-07-20T11:25:51.917 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66729.log 2023-07-20T11:25:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62373.log 2023-07-20T11:25:51.919 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2023-07-20T11:25:51.920 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66729.log.gz 2023-07-20T11:25:51.920 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2023-07-20T11:25:51.922 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52505.log 2023-07-20T11:25:51.923 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62373.log: /var/log/ceph/ceph-client.admin.53634.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62373.log.gz 2023-07-20T11:25:51.924 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2023-07-20T11:25:51.925 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48072.log 2023-07-20T11:25:51.926 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73042.log 2023-07-20T11:25:51.927 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48072.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52505.log.gz 2023-07-20T11:25:51.928 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48072.log.gz 2023-07-20T11:25:51.928 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46895.log 2023-07-20T11:25:51.930 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53556.log 2023-07-20T11:25:51.931 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46895.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73042.log.gz 2023-07-20T11:25:51.932 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46895.log.gz 2023-07-20T11:25:51.932 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47129.log 2023-07-20T11:25:51.934 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57416.log 2023-07-20T11:25:51.935 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1%/var/log/ceph/ceph-client.admin.47129.log: -- replaced with /var/log/ceph/ceph-client.admin.53556.log.gz 2023-07-20T11:25:51.936 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47129.log.gz 2023-07-20T11:25:51.936 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58478.log 2023-07-20T11:25:51.938 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59875.log 2023-07-20T11:25:51.939 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57416.log: /var/log/ceph/ceph-client.admin.58478.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57416.log.gz 2023-07-20T11:25:51.941 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58478.log.gz 2023-07-20T11:25:51.941 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73382.log 2023-07-20T11:25:51.942 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65350.log 2023-07-20T11:25:51.943 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73382.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59875.log.gz 2023-07-20T11:25:51.944 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73382.log.gz 2023-07-20T11:25:51.944 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64265.log 2023-07-20T11:25:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65350.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65350.log.gz 2023-07-20T11:25:51.947 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57977.log 2023-07-20T11:25:51.949 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72459.log 2023-07-20T11:25:51.949 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64265.log.gz 2023-07-20T11:25:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57977.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57977.log.gz 2023-07-20T11:25:51.951 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48703.log 2023-07-20T11:25:51.953 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72459.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72459.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72583.log 2023-07-20T11:25:51.953 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.954 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72252.log 2023-07-20T11:25:51.955 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48703.log: /var/log/ceph/ceph-client.admin.72583.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48703.log.gz 2023-07-20T11:25:51.956 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72583.log.gz 2023-07-20T11:25:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68315.log 2023-07-20T11:25:51.958 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60081.log 2023-07-20T11:25:51.959 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68315.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72252.log.gz 2023-07-20T11:25:51.960 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68315.log.gz 2023-07-20T11:25:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58998.log 2023-07-20T11:25:51.963 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60081.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55511.log 2023-07-20T11:25:51.963 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60081.log.gz 2023-07-20T11:25:51.965 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65955.log 2023-07-20T11:25:51.965 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55511.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58998.log.gz 2023-07-20T11:25:51.966 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55511.log.gz 2023-07-20T11:25:51.967 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2023-07-20T11:25:51.969 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-07-20T11:25:51.969 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65955.log.gz 2023-07-20T11:25:51.971 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53504.log 2023-07-20T11:25:51.971 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47219.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2023-07-20T11:25:51.972 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-07-20T11:25:51.973 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55939.log 2023-07-20T11:25:51.975 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57364.log 2023-07-20T11:25:51.975 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53504.log.gz 2023-07-20T11:25:51.977 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71524.log 2023-07-20T11:25:51.977 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57364.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55939.log.gz 2023-07-20T11:25:51.978 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57364.log.gz 2023-07-20T11:25:51.980 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2023-07-20T11:25:51.981 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2023-07-20T11:25:51.981 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71524.log.gz 2023-07-20T11:25:51.983 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69231.log 2023-07-20T11:25:51.984 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45031.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2023-07-20T11:25:51.984 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2023-07-20T11:25:51.986 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60146.log 2023-07-20T11:25:51.987 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66560.log 2023-07-20T11:25:51.987 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69231.log.gz 2023-07-20T11:25:51.989 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2023-07-20T11:25:51.990 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66560.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60146.log.gz 2023-07-20T11:25:51.990 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66560.log.gz 2023-07-20T11:25:51.992 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63998.log 2023-07-20T11:25:51.993 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49940.log 2023-07-20T11:25:51.993 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2023-07-20T11:25:51.995 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2023-07-20T11:25:51.995 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63998.log.gz 2023-07-20T11:25:51.997 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49940.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49940.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50570.log 2023-07-20T11:25:51.998 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:51.999 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69401.log 2023-07-20T11:25:51.999 INFO:teuthology.orchestra.run.smithi082.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2023-07-20T11:25:52.001 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2023-07-20T11:25:52.001 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50570.log: /var/log/ceph/ceph-client.admin.69401.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2023-07-20T11:25:52.002 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69401.log.gz 2023-07-20T11:25:52.003 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57077.log 2023-07-20T11:25:52.005 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2023-07-20T11:25:52.006 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56193.log: /var/log/ceph/ceph-client.admin.57077.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2023-07-20T11:25:52.006 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57077.log.gz 2023-07-20T11:25:52.007 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71025.log 2023-07-20T11:25:52.009 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55397.log 2023-07-20T11:25:52.010 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71025.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2023-07-20T11:25:52.010 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71025.log.gz 2023-07-20T11:25:52.011 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64743.log 2023-07-20T11:25:52.013 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73671.log 2023-07-20T11:25:52.013 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55397.log.gz 2023-07-20T11:25:52.014 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64743.log.gz 2023-07-20T11:25:52.015 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59688.log 2023-07-20T11:25:52.017 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61408.log 2023-07-20T11:25:52.017 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73671.log.gz 2023-07-20T11:25:52.018 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59688.log.gz 2023-07-20T11:25:52.019 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68550.log 2023-07-20T11:25:52.021 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54599.log 2023-07-20T11:25:52.021 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68550.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61408.log.gz 2023-07-20T11:25:52.022 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68550.log.gz 2023-07-20T11:25:52.023 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52768.log 2023-07-20T11:25:52.024 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71772.log 2023-07-20T11:25:52.025 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54599.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54599.log.gz 2023-07-20T11:25:52.026 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52768.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52768.log.gz 2023-07-20T11:25:52.027 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66351.log 2023-07-20T11:25:52.029 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2023-07-20T11:25:52.029 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66351.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71772.log.gz 2023-07-20T11:25:52.030 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66351.log.gz 2023-07-20T11:25:52.031 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68970.log 2023-07-20T11:25:52.033 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52313.log 2023-07-20T11:25:52.033 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68970.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2023-07-20T11:25:52.034 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68970.log.gz 2023-07-20T11:25:52.035 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73202.log 2023-07-20T11:25:52.036 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2023-07-20T11:25:52.037 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52313.log.gz 2023-07-20T11:25:52.039 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73202.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56419.log 2023-07-20T11:25:52.039 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:52.040 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64389.log 2023-07-20T11:25:52.041 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2023-07-20T11:25:52.043 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54740.log 2023-07-20T11:25:52.043 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56419.log.gz 2023-07-20T11:25:52.044 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64389.log.gz 2023-07-20T11:25:52.044 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-07-20T11:25:52.046 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65720.log 2023-07-20T11:25:52.047 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54740.log.gz 2023-07-20T11:25:52.048 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51175.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-07-20T11:25:52.048 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61774.log 2023-07-20T11:25:52.050 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49323.log 2023-07-20T11:25:52.051 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61774.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65720.log.gz 2023-07-20T11:25:52.052 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61774.log.gz 2023-07-20T11:25:52.052 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73697.log 2023-07-20T11:25:52.054 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60127.log 2023-07-20T11:25:52.055 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73697.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49323.log.gz 2023-07-20T11:25:52.056 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73697.log.gz 2023-07-20T11:25:52.056 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73958.log 2023-07-20T11:25:52.058 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.60127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45397.log 2023-07-20T11:25:52.059 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60127.log.gz 2023-07-20T11:25:52.059 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73958.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73958.log.gz 2023-07-20T11:25:52.060 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64551.log 2023-07-20T11:25:52.062 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43612.log 2023-07-20T11:25:52.063 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45397.log.gz 2023-07-20T11:25:52.063 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64551.log.gz 2023-07-20T11:25:52.064 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66991.log 2023-07-20T11:25:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54416.log 2023-07-20T11:25:52.066 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66991.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43612.log.gz 2023-07-20T11:25:52.067 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66991.log.gz 2023-07-20T11:25:52.068 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-20T11:25:52.070 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2023-07-20T11:25:52.071 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54416.log.gz 2023-07-20T11:25:52.073 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57472.log 2023-07-20T11:25:52.075 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37613.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2023-07-20T11:25:52.077 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63129.log 2023-07-20T11:25:52.077 INFO:teuthology.orchestra.run.smithi082.stderr: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-20T11:25:52.078 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57472.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-20T11:25:52.079 INFO:teuthology.orchestra.run.smithi082.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57472.log.gz 2023-07-20T11:25:52.080 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70761.log 2023-07-20T11:25:52.081 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.c.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63129.log.gz 2023-07-20T11:25:52.082 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2023-07-20T11:25:52.084 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70761.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70761.log.gz 2023-07-20T11:25:52.086 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68170.log 2023-07-20T11:25:52.088 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52549.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2023-07-20T11:25:52.089 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73280.log 2023-07-20T11:25:52.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68170.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68170.log.gz 2023-07-20T11:25:52.093 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2023-07-20T11:25:52.094 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73280.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73280.log.gz 2023-07-20T11:25:52.096 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59714.log 2023-07-20T11:25:52.098 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53712.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2023-07-20T11:25:52.099 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59600.log 2023-07-20T11:25:52.101 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59714.log.gz 2023-07-20T11:25:52.103 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54442.log 2023-07-20T11:25:52.104 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59600.log.gz 2023-07-20T11:25:52.106 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-20T11:25:52.108 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54442.log.gz 2023-07-20T11:25:52.109 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57706.log 2023-07-20T11:25:52.123 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59102.log 2023-07-20T11:25:52.125 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57706.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57706.log.gz 2023-07-20T11:25:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69533.log 2023-07-20T11:25:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59102.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59102.log.gz 2023-07-20T11:25:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54137.log 2023-07-20T11:25:52.144 INFO:teuthology.orchestra.run.smithi183.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-20T11:25:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55771.log 2023-07-20T11:25:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54137.log: /var/log/ceph/ceph-client.admin.69533.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69533.log.gz 2023-07-20T11:25:52.167 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54137.log.gz 2023-07-20T11:25:52.167 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58831.log 2023-07-20T11:25:52.168 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55771.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55771.log.gz 2023-07-20T11:25:52.176 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59076.log 2023-07-20T11:25:52.176 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58831.log.gz 2023-07-20T11:25:52.183 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69259.log 2023-07-20T11:25:52.184 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59076.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59076.log.gz 2023-07-20T11:25:52.191 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2023-07-20T11:25:52.192 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69259.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69259.log.gz 2023-07-20T11:25:52.208 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66377.log 2023-07-20T11:25:52.209 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43835.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2023-07-20T11:25:52.215 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55745.log 2023-07-20T11:25:52.216 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66377.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66377.log.gz 2023-07-20T11:25:52.223 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62449.log 2023-07-20T11:25:52.224 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55745.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55745.log.gz 2023-07-20T11:25:52.243 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2023-07-20T11:25:52.245 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62449.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62449.log.gz 2023-07-20T11:25:52.252 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65981.log 2023-07-20T11:25:52.252 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57524.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2023-07-20T11:25:52.264 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73228.log 2023-07-20T11:25:52.265 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65981.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65981.log.gz 2023-07-20T11:25:52.283 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70813.log 2023-07-20T11:25:52.284 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73228.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73228.log.gz 2023-07-20T11:25:52.295 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49914.log 2023-07-20T11:25:52.296 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70813.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70813.log.gz 2023-07-20T11:25:52.315 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48729.log 2023-07-20T11:25:52.317 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49914.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49914.log.gz 2023-07-20T11:25:52.327 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48321.log 2023-07-20T11:25:52.328 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48729.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48729.log.gz 2023-07-20T11:25:52.335 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73984.log 2023-07-20T11:25:52.336 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48321.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48321.log.gz 2023-07-20T11:25:52.344 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63604.log 2023-07-20T11:25:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73984.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73984.log.gz 2023-07-20T11:25:52.359 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71980.log 2023-07-20T11:25:52.360 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63604.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63604.log.gz 2023-07-20T11:25:52.368 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53608.log 2023-07-20T11:25:52.369 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71980.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71980.log.gz 2023-07-20T11:25:52.375 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61330.log 2023-07-20T11:25:52.376 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53608.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53608.log.gz 2023-07-20T11:25:52.395 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54677.log 2023-07-20T11:25:52.396 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61330.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61330.log.gz 2023-07-20T11:25:52.407 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2023-07-20T11:25:52.408 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54677.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54677.log.gz 2023-07-20T11:25:52.415 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61382.log 2023-07-20T11:25:52.416 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56683.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz 2023-07-20T11:25:52.423 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72637.log 2023-07-20T11:25:52.424 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61382.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61382.log.gz 2023-07-20T11:25:52.443 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2023-07-20T11:25:52.444 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72637.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72637.log.gz 2023-07-20T11:25:52.451 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2023-07-20T11:25:52.452 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45769.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2023-07-20T11:25:52.471 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69100.log 2023-07-20T11:25:52.473 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51473.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2023-07-20T11:25:52.487 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72696.log 2023-07-20T11:25:52.489 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69100.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69100.log.gz 2023-07-20T11:25:52.503 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46843.log 2023-07-20T11:25:52.504 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72696.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72696.log.gz 2023-07-20T11:25:52.515 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71236.log 2023-07-20T11:25:52.527 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46843.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62658.log 2023-07-20T11:25:52.530 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71236.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46843.log.gz 2023-07-20T11:25:52.539 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2023-07-20T11:25:52.542 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.62658.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71236.log.gz 2023-07-20T11:25:52.551 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55898.log 2023-07-20T11:25:52.554 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45847.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62658.log.gz 2023-07-20T11:25:52.566 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2023-07-20T11:25:52.567 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69559.log 2023-07-20T11:25:52.568 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.55898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55898.log.gz 2023-07-20T11:25:52.575 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54703.log 2023-07-20T11:25:52.583 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69559.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.69559.log.gz 2023-07-20T11:25:52.599 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55145.log 2023-07-20T11:25:52.601 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54703.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54703.log.gz 2023-07-20T11:25:52.611 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57103.log 2023-07-20T11:25:52.622 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55145.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55145.log.gz 2023-07-20T11:25:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67627.log 2023-07-20T11:25:52.638 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57103.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57103.log.gz 2023-07-20T11:25:52.643 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44305.log 2023-07-20T11:25:52.645 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67627.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67627.log.gz 2023-07-20T11:25:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42902.log 2023-07-20T11:25:52.667 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44305.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47533.log 2023-07-20T11:25:52.670 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.42902.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44305.log.gz 2023-07-20T11:25:52.675 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67145.log 2023-07-20T11:25:52.682 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47533.log: -- replaced with /var/log/ceph/ceph-client.admin.42902.log.gz 2023-07-20T11:25:52.687 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73879.log 2023-07-20T11:25:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67145.log: 89.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47533.log.gz 2023-07-20T11:25:52.699 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44044.log 2023-07-20T11:25:52.702 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67145.log.gz 2023-07-20T11:25:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64232.log 2023-07-20T11:25:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44044.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73879.log.gz 2023-07-20T11:25:52.722 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44044.log.gz 2023-07-20T11:25:52.723 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47651.log 2023-07-20T11:25:52.738 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64232.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64232.log.gz 2023-07-20T11:25:52.743 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54818.log 2023-07-20T11:25:52.745 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47651.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47651.log.gz 2023-07-20T11:25:52.759 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2023-07-20T11:25:52.761 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54818.log.gz 2023-07-20T11:25:52.771 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68092.log 2023-07-20T11:25:52.783 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.37732.log: 87.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2023-07-20T11:25:52.786 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68092.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2023-07-20T11:25:52.798 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68092.log.gz 2023-07-20T11:25:52.799 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67095.log 2023-07-20T11:25:52.800 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48943.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2023-07-20T11:25:52.815 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72557.log 2023-07-20T11:25:52.817 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67095.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.67095.log.gz 2023-07-20T11:25:52.823 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65750.log 2023-07-20T11:25:52.824 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72557.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72557.log.gz 2023-07-20T11:25:52.844 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61578.log 2023-07-20T11:25:52.845 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65750.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.65750.log.gz 2023-07-20T11:25:52.855 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59743.log 2023-07-20T11:25:52.856 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61578.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61578.log.gz 2023-07-20T11:25:52.863 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53264.log 2023-07-20T11:25:52.864 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59743.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59743.log.gz 2023-07-20T11:25:52.868 INFO:teuthology.orchestra.run.smithi082.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-20T11:25:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54896.log 2023-07-20T11:25:52.872 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53264.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53264.log.gz 2023-07-20T11:25:52.873 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63577.log 2023-07-20T11:25:52.876 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54896.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2023-07-20T11:25:52.877 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61014.log 2023-07-20T11:25:52.879 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63577.log.gz 2023-07-20T11:25:52.881 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2023-07-20T11:25:52.885 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61014.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61014.log.gz 2023-07-20T11:25:52.885 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2023-07-20T11:25:52.886 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50967.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2023-07-20T11:25:52.888 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58003.log 2023-07-20T11:25:52.890 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43369.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2023-07-20T11:25:52.892 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57758.log 2023-07-20T11:25:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58003.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58003.log.gz 2023-07-20T11:25:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2023-07-20T11:25:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57758.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57758.log.gz 2023-07-20T11:25:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59572.log 2023-07-20T11:25:52.901 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46869.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2023-07-20T11:25:52.903 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53062.log 2023-07-20T11:25:52.905 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59572.log.gz 2023-07-20T11:25:52.906 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71183.log 2023-07-20T11:25:52.908 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53062.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53062.log.gz 2023-07-20T11:25:52.910 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2023-07-20T11:25:52.911 INFO:teuthology.orchestra.run.smithi183.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-20T11:25:52.912 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71183.log.gz 2023-07-20T11:25:52.914 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2023-07-20T11:25:52.916 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46999.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2023-07-20T11:25:52.917 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44959.log 2023-07-20T11:25:52.920 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47956.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2023-07-20T11:25:52.921 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50648.log 2023-07-20T11:25:52.923 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.2.44959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44959.log.gz 2023-07-20T11:25:52.925 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42985.log 2023-07-20T11:25:52.927 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50648.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50648.log.gz 2023-07-20T11:25:52.928 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45343.log 2023-07-20T11:25:52.930 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.42985.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42985.log.gz 2023-07-20T11:25:52.932 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57311.log 2023-07-20T11:25:52.934 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45343.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45343.log.gz 2023-07-20T11:25:52.936 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2023-07-20T11:25:52.937 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57311.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57311.log.gz 2023-07-20T11:25:52.939 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73332.log 2023-07-20T11:25:52.941 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55262.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2023-07-20T11:25:52.943 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55563.log 2023-07-20T11:25:52.945 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73332.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73332.log.gz 2023-07-20T11:25:52.947 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67312.log 2023-07-20T11:25:52.949 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55563.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55563.log.gz 2023-07-20T11:25:52.951 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62328.log 2023-07-20T11:25:52.952 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67312.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67312.log.gz 2023-07-20T11:25:52.954 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67191.log 2023-07-20T11:25:52.956 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.62328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62328.log.gz 2023-07-20T11:25:52.958 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51253.log 2023-07-20T11:25:52.959 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.67191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67191.log.gz 2023-07-20T11:25:52.961 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64821.log 2023-07-20T11:25:52.963 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51253.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51253.log.gz 2023-07-20T11:25:52.965 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2023-07-20T11:25:52.967 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64821.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64821.log.gz 2023-07-20T11:25:52.968 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65602.log 2023-07-20T11:25:52.970 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2023-07-20T11:25:52.972 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2023-07-20T11:25:52.974 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65602.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65602.log.gz 2023-07-20T11:25:52.976 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69152.log 2023-07-20T11:25:52.978 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47599.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2023-07-20T11:25:52.980 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69205.log 2023-07-20T11:25:52.982 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69152.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69152.log.gz 2023-07-20T11:25:52.983 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59927.log 2023-07-20T11:25:52.985 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69205.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69205.log.gz 2023-07-20T11:25:52.987 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43235.log 2023-07-20T11:25:52.989 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59927.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59927.log.gz 2023-07-20T11:25:52.991 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2023-07-20T11:25:52.993 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43235.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43235.log.gz 2023-07-20T11:25:52.994 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65641.log 2023-07-20T11:25:52.996 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61916.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2023-07-20T11:25:52.998 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61996.log 2023-07-20T11:25:53.000 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65641.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65641.log.gz 2023-07-20T11:25:53.001 INFO:teuthology.orchestra.run.smithi082.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-20T11:25:53.002 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59024.log 2023-07-20T11:25:53.003 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61996.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61996.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2023-07-20T11:25:53.004 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:53.005 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63760.log 2023-07-20T11:25:53.006 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59024.log.gz 2023-07-20T11:25:53.008 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53318.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50440.log 2023-07-20T11:25:53.008 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:53.009 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63760.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63760.log.gz 2023-07-20T11:25:53.009 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60031.log 2023-07-20T11:25:53.011 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2023-07-20T11:25:53.012 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50440.log.gz 2023-07-20T11:25:53.013 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2023-07-20T11:25:53.014 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44591.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60031.log.gz 2023-07-20T11:25:53.015 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2023-07-20T11:25:53.015 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61040.log 2023-07-20T11:25:53.017 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2023-07-20T11:25:53.019 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61040.log: 87.7% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2023-07-20T11:25:53.019 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61040.log.gz 2023-07-20T11:25:53.020 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68613.log 2023-07-20T11:25:53.021 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68144.log 2023-07-20T11:25:53.022 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68613.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2023-07-20T11:25:53.023 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68613.log.gz 2023-07-20T11:25:53.024 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61546.log 2023-07-20T11:25:53.026 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58031.log 2023-07-20T11:25:53.026 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61546.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68144.log.gz 2023-07-20T11:25:53.027 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61546.log.gz 2023-07-20T11:25:53.028 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68710.log 2023-07-20T11:25:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62333.log 2023-07-20T11:25:53.030 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68710.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58031.log.gz 2023-07-20T11:25:53.031 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68710.log.gz 2023-07-20T11:25:53.032 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61181.log 2023-07-20T11:25:53.034 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.62333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2023-07-20T11:25:53.035 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0%/var/log/ceph/ceph-client.admin.61181.log: -- replaced with /var/log/ceph/ceph-client.0.62333.log.gz 2023-07-20T11:25:53.035 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61181.log.gz 2023-07-20T11:25:53.036 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64076.log 2023-07-20T11:25:53.038 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66755.log 2023-07-20T11:25:53.039 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2023-07-20T11:25:53.039 INFO:teuthology.orchestra.run.smithi082.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64076.log.gz 2023-07-20T11:25:53.040 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61695.log 2023-07-20T11:25:53.042 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2023-07-20T11:25:53.043 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66755.log.gz 2023-07-20T11:25:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61695.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61695.log.gz 2023-07-20T11:25:53.044 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65903.log 2023-07-20T11:25:53.046 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2023-07-20T11:25:53.047 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65903.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2023-07-20T11:25:53.047 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65903.log.gz 2023-07-20T11:25:53.048 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2023-07-20T11:25:53.050 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2023-07-20T11:25:53.051 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45317.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2023-07-20T11:25:53.051 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2023-07-20T11:25:53.052 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55893.log 2023-07-20T11:25:53.054 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60738.log 2023-07-20T11:25:53.055 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45423.log: /var/log/ceph/ceph-client.0.55893.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2023-07-20T11:25:53.055 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55893.log.gz 2023-07-20T11:25:53.056 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69507.log 2023-07-20T11:25:53.058 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.60738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2023-07-20T11:25:53.059 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69507.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60738.log.gz 2023-07-20T11:25:53.060 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69507.log.gz 2023-07-20T11:25:53.061 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2023-07-20T11:25:53.062 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2023-07-20T11:25:53.063 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49113.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2023-07-20T11:25:53.064 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2023-07-20T11:25:53.065 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59154.log 2023-07-20T11:25:53.067 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55369.log 2023-07-20T11:25:53.067 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59154.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2023-07-20T11:25:53.068 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59154.log.gz 2023-07-20T11:25:53.068 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59953.log 2023-07-20T11:25:53.070 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73616.log 2023-07-20T11:25:53.071 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55369.log.gz 2023-07-20T11:25:53.072 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59953.log.gz 2023-07-20T11:25:53.072 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70578.log 2023-07-20T11:25:53.075 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67920.log 2023-07-20T11:25:53.075 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73616.log.gz/var/log/ceph/ceph-client.admin.70578.log: 2023-07-20T11:25:53.076 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70578.log.gz 2023-07-20T11:25:53.076 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73749.log 2023-07-20T11:25:53.079 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2023-07-20T11:25:53.079 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73749.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67920.log.gz 2023-07-20T11:25:53.080 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.73749.log.gz 2023-07-20T11:25:53.080 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50228.log 2023-07-20T11:25:53.082 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2023-07-20T11:25:53.083 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46692.log: /var/log/ceph/ceph-client.admin.50228.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2023-07-20T11:25:53.084 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50228.log.gz 2023-07-20T11:25:53.085 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49055.log 2023-07-20T11:25:53.086 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69804.log 2023-07-20T11:25:53.087 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2023-07-20T11:25:53.088 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49055.log.gz 2023-07-20T11:25:53.088 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48915.log 2023-07-20T11:25:53.090 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49027.log 2023-07-20T11:25:53.091 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48915.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69804.log.gz 2023-07-20T11:25:53.092 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48915.log.gz 2023-07-20T11:25:53.092 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54573.log 2023-07-20T11:25:53.094 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68866.log 2023-07-20T11:25:53.095 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3%/var/log/ceph/ceph-client.admin.54573.log: -- replaced with /var/log/ceph/ceph-client.admin.49027.log.gz 2023-07-20T11:25:53.096 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54573.log.gz 2023-07-20T11:25:53.096 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53003.log 2023-07-20T11:25:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.68866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55054.log 2023-07-20T11:25:53.099 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53003.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68866.log.gz 2023-07-20T11:25:53.100 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53003.log.gz 2023-07-20T11:25:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 2023-07-20T11:25:53.102 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66007.log 2023-07-20T11:25:53.103 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55054.log: /var/log/ceph/ceph-client.admin.44041.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55054.log.gz 2023-07-20T11:25:53.104 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2023-07-20T11:25:53.104 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61118.log 2023-07-20T11:25:53.106 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71640.log 2023-07-20T11:25:53.107 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61118.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66007.log.gz 2023-07-20T11:25:53.108 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61118.log.gz 2023-07-20T11:25:53.108 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2023-07-20T11:25:53.110 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73105.log 2023-07-20T11:25:53.110 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71640.log.gz 2023-07-20T11:25:53.112 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2023-07-20T11:25:53.113 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz/var/log/ceph/ceph-client.admin.73105.log: 2023-07-20T11:25:53.113 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73105.log.gz 2023-07-20T11:25:53.115 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50388.log 2023-07-20T11:25:53.117 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2023-07-20T11:25:53.117 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-07-20T11:25:53.119 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72781.log 2023-07-20T11:25:53.119 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50388.log: /var/log/ceph/ceph-client.admin.51227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50388.log.gz 2023-07-20T11:25:53.120 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2023-07-20T11:25:53.120 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53788.log 2023-07-20T11:25:53.123 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53398.log 2023-07-20T11:25:53.123 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53788.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72781.log.gz 2023-07-20T11:25:53.124 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53788.log.gz 2023-07-20T11:25:53.125 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2023-07-20T11:25:53.127 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67653.log 2023-07-20T11:25:53.127 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48677.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53398.log.gz 2023-07-20T11:25:53.128 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2023-07-20T11:25:53.129 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56250.log 2023-07-20T11:25:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43447.log 2023-07-20T11:25:53.131 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56250.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67653.log.gz 2023-07-20T11:25:53.132 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56250.log.gz 2023-07-20T11:25:53.133 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66410.log 2023-07-20T11:25:53.135 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2023-07-20T11:25:53.135 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66410.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43447.log.gz 2023-07-20T11:25:53.136 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66410.log.gz 2023-07-20T11:25:53.137 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73564.log 2023-07-20T11:25:53.138 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2023-07-20T11:25:53.139 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73564.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2023-07-20T11:25:53.140 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73564.log.gz 2023-07-20T11:25:53.141 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49875.log 2023-07-20T11:25:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70325.log 2023-07-20T11:25:53.143 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49875.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2023-07-20T11:25:53.144 INFO:teuthology.orchestra.run.smithi082.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49875.log.gz 2023-07-20T11:25:53.145 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45213.log 2023-07-20T11:25:53.146 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64873.log 2023-07-20T11:25:53.147 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70325.log: /var/log/ceph/ceph-client.admin.45213.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70325.log.gz 2023-07-20T11:25:53.148 INFO:teuthology.orchestra.run.smithi082.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45213.log.gz 2023-07-20T11:25:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61748.log 2023-07-20T11:25:53.151 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2023-07-20T11:25:53.151 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61748.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64873.log.gz 2023-07-20T11:25:53.152 INFO:teuthology.orchestra.run.smithi082.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61748.log.gz 2023-07-20T11:25:53.153 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47405.log 2023-07-20T11:25:53.155 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2023-07-20T11:25:53.156 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47405.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2023-07-20T11:25:53.156 INFO:teuthology.orchestra.run.smithi082.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47405.log.gz 2023-07-20T11:25:53.157 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46484.log 2023-07-20T11:25:53.158 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70293.log 2023-07-20T11:25:53.159 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46034.log: /var/log/ceph/ceph-client.admin.46484.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2023-07-20T11:25:53.160 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46484.log.gz 2023-07-20T11:25:53.161 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2023-07-20T11:25:53.163 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2023-07-20T11:25:53.163 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44435.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70293.log.gz 2023-07-20T11:25:53.164 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2023-07-20T11:25:53.165 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32643.log 2023-07-20T11:25:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71954.log 2023-07-20T11:25:53.167 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph.tmp-client.admin.32643.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2023-07-20T11:25:53.168 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32643.log.gz 2023-07-20T11:25:53.169 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2023-07-20T11:25:53.170 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73254.log 2023-07-20T11:25:53.171 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71954.log.gz 2023-07-20T11:25:53.173 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47887.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65550.log 2023-07-20T11:25:53.173 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:53.174 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73254.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73254.log.gz 2023-07-20T11:25:53.176 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61092.log 2023-07-20T11:25:53.177 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2023-07-20T11:25:53.177 INFO:teuthology.orchestra.run.smithi082.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65550.log.gz 2023-07-20T11:25:53.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.61092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56328.log 2023-07-20T11:25:53.180 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61092.log.gz/var/log/ceph/ceph-client.admin.47379.log: 2023-07-20T11:25:53.180 INFO:teuthology.orchestra.run.smithi082.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2023-07-20T11:25:53.182 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73590.log 2023-07-20T11:25:53.184 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2023-07-20T11:25:53.184 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56328.log.gz 2023-07-20T11:25:53.185 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2023-07-20T11:25:53.186 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43619.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73590.log.gz 2023-07-20T11:25:53.187 INFO:teuthology.orchestra.run.smithi082.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2023-07-20T11:25:53.187 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71798.log 2023-07-20T11:25:53.189 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2023-07-20T11:25:53.190 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71798.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2023-07-20T11:25:53.191 INFO:teuthology.orchestra.run.smithi082.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71798.log.gz 2023-07-20T11:25:53.192 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58109.log 2023-07-20T11:25:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47301.log 2023-07-20T11:25:53.198 INFO:teuthology.orchestra.run.smithi082.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2023-07-20T11:25:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48999.log 2023-07-20T11:25:53.198 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47301.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58109.log.gz 2023-07-20T11:25:53.199 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47301.log.gz 2023-07-20T11:25:53.199 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64297.log 2023-07-20T11:25:53.200 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.48999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45187.log 2023-07-20T11:25:53.200 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48999.log.gz 2023-07-20T11:25:53.202 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.64297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2023-07-20T11:25:53.202 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45187.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64297.log.gz 2023-07-20T11:25:53.203 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45187.log.gz 2023-07-20T11:25:53.204 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2023-07-20T11:25:53.205 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57188.log 2023-07-20T11:25:53.206 INFO:teuthology.orchestra.run.smithi082.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2023-07-20T11:25:53.207 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46562.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2023-07-20T11:25:53.208 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58857.log 2023-07-20T11:25:53.209 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57188.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57188.log.gz 2023-07-20T11:25:53.210 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66861.log 2023-07-20T11:25:53.211 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59311.log 2023-07-20T11:25:53.212 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.66861.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58857.log.gz 2023-07-20T11:25:53.213 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66861.log.gz 2023-07-20T11:25:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45369.log 2023-07-20T11:25:53.215 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.59311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65576.log 2023-07-20T11:25:53.216 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.45369.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59311.log.gz 2023-07-20T11:25:53.217 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45369.log.gz 2023-07-20T11:25:53.217 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53686.log 2023-07-20T11:25:53.219 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70460.log 2023-07-20T11:25:53.220 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.53686.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65576.log.gz 2023-07-20T11:25:53.221 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53686.log.gz 2023-07-20T11:25:53.221 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71606.log 2023-07-20T11:25:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57654.log 2023-07-20T11:25:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.70460.log: /var/log/ceph/ceph-client.admin.71606.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70460.log.gz 2023-07-20T11:25:53.225 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71606.log.gz 2023-07-20T11:25:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2023-07-20T11:25:53.227 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63406.log 2023-07-20T11:25:53.228 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57654.log.gz 2023-07-20T11:25:53.230 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43823.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2023-07-20T11:25:53.230 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:53.231 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.63406.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63406.log.gz 2023-07-20T11:25:53.233 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55693.log 2023-07-20T11:25:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2023-07-20T11:25:53.234 INFO:teuthology.orchestra.run.smithi082.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2023-07-20T11:25:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54246.log 2023-07-20T11:25:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44357.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55693.log.gz 2023-07-20T11:25:53.237 INFO:teuthology.orchestra.run.smithi082.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2023-07-20T11:25:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50150.log 2023-07-20T11:25:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.54246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57784.log 2023-07-20T11:25:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.50150.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54246.log.gz 2023-07-20T11:25:53.241 INFO:teuthology.orchestra.run.smithi082.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50150.log.gz 2023-07-20T11:25:53.242 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47431.log 2023-07-20T11:25:53.244 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.57784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72754.log 2023-07-20T11:25:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47431.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57784.log.gz 2023-07-20T11:25:53.245 INFO:teuthology.orchestra.run.smithi082.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47431.log.gz 2023-07-20T11:25:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2023-07-20T11:25:53.248 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69585.log 2023-07-20T11:25:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.47701.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72754.log.gz 2023-07-20T11:25:53.250 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2023-07-20T11:25:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56276.log 2023-07-20T11:25:53.252 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69611.log 2023-07-20T11:25:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.56276.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69585.log.gz 2023-07-20T11:25:53.253 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56276.log.gz 2023-07-20T11:25:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2023-07-20T11:25:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73512.log 2023-07-20T11:25:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.43263.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69611.log.gz 2023-07-20T11:25:53.257 INFO:teuthology.orchestra.run.smithi082.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2023-07-20T11:25:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72938.log 2023-07-20T11:25:53.260 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.73512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55483.log 2023-07-20T11:25:53.261 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.72938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73512.log.gz 2023-07-20T11:25:53.261 INFO:teuthology.orchestra.run.smithi082.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72938.log.gz 2023-07-20T11:25:53.262 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65052.log 2023-07-20T11:25:53.264 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65118.log 2023-07-20T11:25:53.264 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.65052.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55483.log.gz 2023-07-20T11:25:53.265 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65052.log.gz 2023-07-20T11:25:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55913.log 2023-07-20T11:25:53.268 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.65118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44539.log 2023-07-20T11:25:53.268 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.55913.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65118.log.gz 2023-07-20T11:25:53.269 INFO:teuthology.orchestra.run.smithi082.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55913.log.gz 2023-07-20T11:25:53.270 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69453.log 2023-07-20T11:25:53.271 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.44539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52221.log 2023-07-20T11:25:53.272 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.69453.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44539.log.gz 2023-07-20T11:25:53.273 INFO:teuthology.orchestra.run.smithi082.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69453.log.gz 2023-07-20T11:25:53.273 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67069.log 2023-07-20T11:25:53.275 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.52221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2023-07-20T11:25:53.276 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.67069.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52221.log.gz 2023-07-20T11:25:53.277 INFO:teuthology.orchestra.run.smithi082.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67069.log.gz 2023-07-20T11:25:53.277 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69785.log 2023-07-20T11:25:53.279 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.46250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71720.log 2023-07-20T11:25:53.280 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.0.69785.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2023-07-20T11:25:53.281 INFO:teuthology.orchestra.run.smithi082.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69785.log.gz 2023-07-20T11:25:53.281 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2023-07-20T11:25:53.283 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.71720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49531.log 2023-07-20T11:25:53.284 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.51149.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.71720.log.gz 2023-07-20T11:25:53.285 INFO:teuthology.orchestra.run.smithi082.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2023-07-20T11:25:53.285 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58317.log 2023-07-20T11:25:53.289 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.49531.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49531.log.gz 2023-07-20T11:25:53.289 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/ceph-client.admin.58317.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58317.log.gz 2023-07-20T11:25:53.368 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-20T11:25:53.739 INFO:teuthology.orchestra.run.smithi183.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-20T11:25:54.150 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-20T11:25:54.199 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-20T11:25:54.259 INFO:teuthology.orchestra.run.smithi183.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-20T11:25:54.261 INFO:teuthology.orchestra.run.smithi183.stderr: 2023-07-20T11:25:54.261 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m3.296s 2023-07-20T11:25:54.261 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m14.532s 2023-07-20T11:25:54.261 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m1.260s 2023-07-20T11:25:54.440 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-20T11:25:54.923 INFO:teuthology.orchestra.run.smithi082.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-20T11:25:54.950 INFO:teuthology.orchestra.run.smithi082.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-20T11:25:55.002 INFO:teuthology.orchestra.run.smithi082.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-20T11:25:55.674 INFO:teuthology.orchestra.run.smithi082.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-20T11:25:55.677 INFO:teuthology.orchestra.run.smithi082.stderr: 2023-07-20T11:25:55.677 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m4.732s 2023-07-20T11:25:55.677 INFO:teuthology.orchestra.run.smithi082.stderr:user 0m21.595s 2023-07-20T11:25:55.677 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m3.574s 2023-07-20T11:25:55.678 INFO:tasks.ceph:Archiving logs... 2023-07-20T11:25:55.678 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi082/log 2023-07-20T11:25:55.679 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-20T11:25:58.145 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi183/log 2023-07-20T11:25:58.146 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-20T11:25:59.449 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-20T11:25:59.458 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-20T11:25:59.459 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-20T11:25:59.462 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-20T11:25:59.555 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-20T11:25:59.564 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-20T11:25:59.565 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T11:25:59.568 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-20T11:25:59.585 INFO:teuthology.orchestra.run.smithi082.stdout: remote refid st t when poll reach delay offset jitter 2023-07-20T11:25:59.586 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================== 2023-07-20T11:25:59.586 INFO:teuthology.orchestra.run.smithi082.stdout:*hv01.front.sepi 44.4.53.2 2 u 112 128 377 0.188 -2.871 0.429 2023-07-20T11:25:59.586 INFO:teuthology.orchestra.run.smithi082.stdout:+hv02.front.sepi 63.231.80.2 3 u 4 128 377 0.175 -1.831 0.173 2023-07-20T11:25:59.586 INFO:teuthology.orchestra.run.smithi082.stdout:+hv03.front.sepi 74.6.168.72 3 u 100 128 377 0.199 -2.253 1.672 2023-07-20T11:25:59.586 INFO:teuthology.orchestra.run.smithi082.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout: remote refid st t when poll reach delay offset jitter 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout:============================================================================== 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout:*hv01.front.sepi 44.4.53.2 2 u 195 256 377 0.179 -2.220 0.376 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout:+hv02.front.sepi 63.231.80.2 3 u 234 256 377 0.140 -1.597 0.211 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout:+hv03.front.sepi 74.6.168.72 3 u 230 256 377 0.199 +0.380 1.122 2023-07-20T11:25:59.589 INFO:teuthology.orchestra.run.smithi183.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-20T11:25:59.590 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-20T11:25:59.602 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-20T11:25:59.603 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-20T11:25:59.635 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-20T11:25:59.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-20T11:25:59.691 INFO:teuthology.task.internal:Duration was 6550.810456 seconds 2023-07-20T11:25:59.691 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-20T11:25:59.719 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-20T11:25:59.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-20T11:25:59.723 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-20T11:25:59.833 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-20T11:25:59.833 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2023-07-20T11:25:59.833 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-20T11:25:59.857 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-07-20T11:25:59.857 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-20T11:25:59.881 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-20T11:25:59.881 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T11:25:59.905 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-20T11:25:59.962 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-20T11:25:59.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-20T11:25:59.993 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-20T11:26:00.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-20T11:26:00.093 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-20T11:26:00.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-20T11:26:00.115 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-20T11:26:00.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-20T11:26:00.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-20T11:26:00.161 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-20T11:26:00.176 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2023-07-20T11:26:00.197 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-07-20T11:26:00.216 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-20T11:26:00.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T11:26:00.245 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-20T11:26:00.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-20T11:26:00.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-20T11:26:00.286 INFO:teuthology.task.internal:Transferring archived files... 2023-07-20T11:26:00.287 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi082 2023-07-20T11:26:00.287 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-20T11:26:00.313 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461/remote/smithi183 2023-07-20T11:26:00.313 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-20T11:26:00.338 INFO:teuthology.task.internal:Removing archive directory... 2023-07-20T11:26:00.338 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-20T11:26:00.357 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-20T11:26:00.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-20T11:26:00.416 INFO:teuthology.task.internal:Not uploading archives. 2023-07-20T11:26:00.417 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-20T11:26:00.476 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-20T11:26:00.476 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-20T11:26:00.479 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-20T11:26:00.485 INFO:teuthology.orchestra.run.smithi082.stdout: 657836 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 20 11:26 /home/ubuntu/cephtest 2023-07-20T11:26:00.488 INFO:teuthology.orchestra.run.smithi183.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 20 11:26 /home/ubuntu/cephtest 2023-07-20T11:26:00.490 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-20T11:26:00.507 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-20T11:26:00.601 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T11:26:00.633 DEBUG:teuthology.nuke:shortname: smithi082 2023-07-20T11:26:00.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T11:26:00.663 DEBUG:teuthology.nuke:shortname: smithi183 2023-07-20T11:26:00.663 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T11:26:00.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:32.659460', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIODH0sPfyutXLZWq/SXYQcdS80yOrImKWKlzMyK29SPS'} 2023-07-20T11:26:00.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344461', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:32.657426', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5kztsB4HHg4Sk4pRWO2OP/y1BTalgZzqg/o3iOpQIXlxidEhWS9y0FPHRRJGQDmsdbakH8Jzjn/HFnXugrUoc='} 2023-07-20T11:26:00.724 INFO:teuthology.orchestra.console:Power off smithi082 2023-07-20T11:26:00.725 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:26:00.742 INFO:teuthology.orchestra.console:Power off smithi183 2023-07-20T11:26:00.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T11:26:00.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:00.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:04.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:04.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:08.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:08.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:13.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:13.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T11:26:13.218 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-07-20T11:26:13.227 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2023-07-20T11:26:13.332 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8c15ad6dab84a191431785901a40e4f9fa32bda8 client.1-kernel-sha1: 8c15ad6dab84a191431785901a40e4f9fa32bda8 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6550.810455799103 failure_reason: '"2023-07-20T09:52:37.831387+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-07-20T11:26:13.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T11:26:13.416 INFO:teuthology.run:FAIL